2024-03-04T06:20:06.162 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-03-04T06:20:06.162 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7580657 --description rados/upgrade/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} --owner scheduled_pdhange@teuthology --name pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi --verbose -- /home/teuthworker/archive/pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7580657/orig.config.yaml 2024-03-04T06:20:06.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T06:20:06.300 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7580657 branch: wip-yuri-testing-2024-03-01-0756 description: rados/upgrade/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} email: null first_in_suite: false job_id: '7580657' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'run run randomized correctness test for rados operations on an erasure-coded pool ' - desc: 'object class functional tests ' - desc: 'generate read/write load with rados objects ranging from 1MB to 25MB ' - desc: 'run basic import/export cli tests for rbd ' - desc: 'librbd C and C++ api tests ' - desc: 'librbd python api tests ' name: pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri-testing-2024-03-01-0756 ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true create_rbd_pool: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: efb04e5e69d058b0c47e511cb7e10d57a92f59ae ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: extra_system_packages: - python3-pytest flavor: default sha1: efb04e5e69d058b0c47e511cb7e10d57a92f59ae selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-yuri-testing-2024-03-01-0756 sha1: efb04e5e69d058b0c47e511cb7e10d57a92f59ae owner: scheduled_pdhange@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mds.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 3018 sha1: efb04e5e69d058b0c47e511cb7e10d57a92f59ae sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri-testing-2024-03-01-0756 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_efb04e5e69d058b0c47e511cb7e10d57a92f59ae/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: efb04e5e69d058b0c47e511cb7e10d57a92f59ae targets: smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL5et8RVHHsCf3HAN+HeYMnTKbTXm4aGXvpfGQaCvlVGWmJINU3sgDYoN7U8xqtWW8/G1yX3wdjnBXsd1kTMQRs= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPVvhukuPV/SZNKqeAmvye5Qd10whdRAe4O76RdkFqx9nvVQMH7ei7DTlMigLfCrStUuQX27mw9jpE6QQPiMMPo= tasks: - install: branch: reef exclude_packages: - ceph-volume - print: '**** done install task...' - print: '**** done start installing reef cephadm ...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:reef - print: '**** done end installing reef cephadm ...' - print: '**** done start cephadm.shell ceph config set mgr...' - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - print: '**** done start telemetry reef...' - workunit: clients: client.0: - test_telemetry_reef.sh - print: '**** done end telemetry reef...' - print: '**** done start parallel' - parallel: - workload - upgrade-sequence - print: '**** done end parallel' - print: '**** done start telemetry x...' - workunit: clients: client.0: - test_telemetry_reef_x.sh - print: '**** done end telemetry x...' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-03-04_06:12:22 tube: smithi upgrade-sequence: sequential: - print: '**** done start upgrade, wait' - cephadm.shell: env: - sha1 mon.a: - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - print: '**** done end upgrade, wait...' user: pdhange verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload: full_sequential: - print: '**** done start ec-rados-default.yaml' - rados: clients: - client.0 ec_pool: true objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 4000 write_append_excl: false - print: '**** done end ec-rados-default.yaml' - print: '**** done start rados_api.yaml' - workunit: branch: reef clients: client.0: - cls - print: '**** done end rados_api.yaml' - print: '**** done start rados_loadgenbig.yaml' - workunit: branch: reef clients: client.0: - rados/load-gen-big.sh - print: '**** done end rados_loadgenbig.yaml' - print: '**** done start rbd_import_export.yaml' - workunit: branch: reef clients: client.1: - rbd/import_export.sh env: RBD_CREATE_ARGS: --new-format - print: '**** done end rbd_import_export.yaml' - print: '**** done start test_rbd_api.yaml' - workunit: branch: reef clients: client.0: - rbd/test_librbd.sh env: RBD_FEATURES: '61' - print: '**** done end test_rbd_api.yaml' - print: '**** done start test_rbd_python.yaml' - workunit: branch: reef clients: client.0: - rbd/test_librbd_python.sh env: RBD_FEATURES: '61' - print: '**** done end test_rbd_python.yaml' 2024-03-04T06:20:06.300 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_efb04e5e69d058b0c47e511cb7e10d57a92f59ae/qa; will attempt to use it 2024-03-04T06:20:06.300 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_efb04e5e69d058b0c47e511cb7e10d57a92f59ae/qa/tasks 2024-03-04T06:20:06.301 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-04T06:20:06.302 INFO:teuthology.task.internal:Checking packages... 2024-03-04T06:20:06.322 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'efb04e5e69d058b0c47e511cb7e10d57a92f59ae' 2024-03-04T06:20:06.322 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-04T06:20:06.322 INFO:teuthology.packaging:ref: None 2024-03-04T06:20:06.322 INFO:teuthology.packaging:tag: None 2024-03-04T06:20:06.322 INFO:teuthology.packaging:branch: wip-yuri-testing-2024-03-01-0756 2024-03-04T06:20:06.322 INFO:teuthology.packaging:sha1: efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:20:06.323 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri-testing-2024-03-01-0756 2024-03-04T06:20:06.459 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1791.gefb04e5e 2024-03-04T06:20:06.460 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-04T06:20:06.467 INFO:teuthology.task.internal:no buildpackages task found 2024-03-04T06:20:06.467 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-04T06:20:06.513 INFO:teuthology.task.internal:Saving configuration 2024-03-04T06:20:06.529 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-04T06:20:06.572 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T06:20:06.597 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7580657', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 06:14:33.554744', 'locked_by': 'scheduled_pdhange@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL5et8RVHHsCf3HAN+HeYMnTKbTXm4aGXvpfGQaCvlVGWmJINU3sgDYoN7U8xqtWW8/G1yX3wdjnBXsd1kTMQRs='} 2024-03-04T06:20:06.617 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7580657', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 06:14:33.551727', 'locked_by': 'scheduled_pdhange@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPVvhukuPV/SZNKqeAmvye5Qd10whdRAe4O76RdkFqx9nvVQMH7ei7DTlMigLfCrStUuQX27mw9jpE6QQPiMMPo='} 2024-03-04T06:20:06.617 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-04T06:20:06.623 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-03-04T06:20:06.623 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-03-04T06:20:06.623 INFO:teuthology.run_tasks:Running task console_log... 2024-03-04T06:20:06.716 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe875a68160>, signals=[15]) 2024-03-04T06:20:06.716 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-04T06:20:06.722 INFO:teuthology.task.internal:Opening connections... 2024-03-04T06:20:06.722 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-03-04T06:20:06.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T06:20:06.813 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2024-03-04T06:20:06.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T06:20:06.899 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-04T06:20:06.905 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-03-04T06:20:06.922 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-03-04T06:20:06.923 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-03-04T06:20:06.979 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-03-04T06:20:06.980 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-03-04T06:20:06.980 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-03-04T06:20:06.980 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-03-04T06:20:06.980 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-03-04T06:20:06.980 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-03-04T06:20:06.980 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T06:20:06.980 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-03-04T06:20:06.980 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-03-04T06:20:06.980 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T06:20:06.980 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-03-04T06:20:06.980 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T06:20:06.980 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T06:20:06.980 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T06:20:06.981 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-03-04T06:20:07.007 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-03-04T06:20:07.023 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-03-04T06:20:07.024 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-03-04T06:20:07.080 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2024-03-04T06:20:07.080 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2024-03-04T06:20:07.080 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2024-03-04T06:20:07.080 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2024-03-04T06:20:07.080 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2024-03-04T06:20:07.080 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2024-03-04T06:20:07.080 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T06:20:07.080 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2024-03-04T06:20:07.080 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2024-03-04T06:20:07.080 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T06:20:07.080 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2024-03-04T06:20:07.081 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T06:20:07.081 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T06:20:07.081 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T06:20:07.081 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-03-04T06:20:07.098 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-04T06:20:07.107 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-04T06:20:07.130 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-04T06:20:07.130 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-03-04T06:20:07.133 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2024-03-04T06:20:07.148 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-04T06:20:07.154 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-04T06:20:07.154 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-03-04T06:20:07.189 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2024-03-04T06:20:07.298 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-04T06:20:07.354 INFO:teuthology.run_tasks:Running task kernel... 2024-03-04T06:20:07.367 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-04T06:20:07.367 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-04T06:20:07.367 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-04T06:20:07.368 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-04T06:20:07.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T06:20:07.384 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-03-04T06:20:07.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T06:20:07.385 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-03-04T06:20:07.440 INFO:teuthology.orchestra.run.smithi203.stdout:5.14.0-361.el9.x86_64 2024-03-04T06:20:07.440 INFO:teuthology.task.kernel:Running kernel on smithi203: 5.14.0-361.el9.x86_64 2024-03-04T06:20:07.440 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum install -y kernel 2024-03-04T06:20:07.442 INFO:teuthology.orchestra.run.smithi137.stdout:5.14.0-361.el9.x86_64 2024-03-04T06:20:07.442 INFO:teuthology.task.kernel:Running kernel on smithi137: 5.14.0-361.el9.x86_64 2024-03-04T06:20:07.443 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum install -y kernel 2024-03-04T06:20:09.551 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-03-04T06:20:09.705 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-04T06:20:11.210 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2024-03-04T06:20:11.472 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS-9 - BaseOS 3.0 MB/s | 2.0 MB 00:00 2024-03-04T06:20:12.409 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 9.2 MB/s | 8.0 MB 00:00 2024-03-04T06:20:14.495 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-03-04T06:20:24.103 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 670 kB/s | 8.0 MB 00:12 2024-03-04T06:20:26.242 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 762 kB/s | 6.1 MB 00:08 2024-03-04T06:20:27.004 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-03-04T06:20:27.676 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 15 kB 00:00 2024-03-04T06:20:28.728 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2024-03-04T06:20:32.222 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.1 MB 00:01 2024-03-04T06:20:33.561 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-03-04T06:20:33.622 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 15 kB 00:00 2024-03-04T06:20:34.837 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2024-03-04T06:20:35.818 INFO:teuthology.orchestra.run.smithi137.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-04T06:20:35.818 INFO:teuthology.orchestra.run.smithi137.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-04T06:20:35.912 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-03-04T06:20:35.924 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-03-04T06:20:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-03-04T06:20:35.927 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-03-04T06:20:35.927 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-03-04T06:20:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-04T06:20:35.927 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-03-04T06:20:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-04T06:20:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-04T06:20:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-04T06:20:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:20:35.928 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-03-04T06:20:35.928 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-03-04T06:20:35.928 INFO:teuthology.orchestra.run.smithi137.stdout:Install 4 Packages 2024-03-04T06:20:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:20:35.928 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 100 M 2024-03-04T06:20:35.928 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 123 M 2024-03-04T06:20:35.928 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-03-04T06:20:36.271 INFO:teuthology.orchestra.run.smithi137.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 20 MB/s | 6.0 MB 00:00 2024-03-04T06:20:36.696 INFO:teuthology.orchestra.run.smithi137.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 29 MB/s | 21 MB 00:00 2024-03-04T06:20:37.296 INFO:teuthology.orchestra.run.smithi137.stdout:(3/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 30 MB/s | 39 MB 00:01 2024-03-04T06:20:38.455 INFO:teuthology.orchestra.run.smithi137.stdout:(4/4): kernel-modules-core-5.14.0-427.el9.x86_6 15 MB/s | 33 MB 00:02 2024-03-04T06:20:38.455 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-03-04T06:20:38.455 INFO:teuthology.orchestra.run.smithi137.stdout:Total 39 MB/s | 100 MB 00:02 2024-03-04T06:20:39.345 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-03-04T06:20:39.709 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-03-04T06:20:39.716 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-03-04T06:20:39.716 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-03-04T06:20:41.376 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-03-04T06:20:41.376 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-03-04T06:20:41.982 INFO:teuthology.orchestra.run.smithi203.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-04T06:20:41.983 INFO:teuthology.orchestra.run.smithi203.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-04T06:20:42.104 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-03-04T06:20:42.116 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-03-04T06:20:42.116 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-03-04T06:20:42.116 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-03-04T06:20:42.116 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-03-04T06:20:42.116 INFO:teuthology.orchestra.run.smithi203.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-04T06:20:42.117 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-03-04T06:20:42.117 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-04T06:20:42.117 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-04T06:20:42.117 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-04T06:20:42.117 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:20:42.117 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-03-04T06:20:42.117 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-03-04T06:20:42.117 INFO:teuthology.orchestra.run.smithi203.stdout:Install 4 Packages 2024-03-04T06:20:42.117 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:20:42.118 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 100 M 2024-03-04T06:20:42.118 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 123 M 2024-03-04T06:20:42.118 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-03-04T06:20:44.285 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-03-04T06:20:44.962 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-04T06:20:45.088 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T06:20:47.872 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T06:20:48.049 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T06:20:52.790 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T06:20:52.908 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T06:20:53.718 INFO:teuthology.orchestra.run.smithi203.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 542 kB/s | 6.0 MB 00:11 2024-03-04T06:20:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T06:21:17.873 INFO:teuthology.orchestra.run.smithi203.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 601 kB/s | 21 MB 00:35 2024-03-04T06:21:26.727 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T06:21:26.727 INFO:teuthology.orchestra.run.smithi137.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-04T06:21:26.727 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:21:26.813 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-04T06:21:27.230 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T06:21:27.230 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-04T06:21:27.230 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T06:21:27.230 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T06:21:27.651 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T06:21:27.651 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:21:27.651 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-03-04T06:21:27.651 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-04T06:21:27.651 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-04T06:21:27.651 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-04T06:21:27.651 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-04T06:21:27.651 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:21:27.652 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-03-04T06:21:28.168 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T06:21:28.305 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T06:21:28.305 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T06:21:28.305 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-04T06:21:28.305 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-04T06:21:28.305 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-04T06:21:28.305 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-04T06:21:28.305 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=None, version=distro) 2024-03-04T06:21:28.305 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T06:21:28.427 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T06:21:28.427 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T06:21:28.428 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -qi grub2-tools 2024-03-04T06:21:28.461 INFO:teuthology.orchestra.run.smithi137.stdout:Name : grub2-tools 2024-03-04T06:21:28.462 INFO:teuthology.orchestra.run.smithi137.stdout:Epoch : 1 2024-03-04T06:21:28.462 INFO:teuthology.orchestra.run.smithi137.stdout:Version : 2.06 2024-03-04T06:21:28.462 INFO:teuthology.orchestra.run.smithi137.stdout:Release : 68.el9 2024-03-04T06:21:28.462 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: x86_64 2024-03-04T06:21:28.462 INFO:teuthology.orchestra.run.smithi137.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-04T06:21:28.462 INFO:teuthology.orchestra.run.smithi137.stdout:Group : Unspecified 2024-03-04T06:21:28.462 INFO:teuthology.orchestra.run.smithi137.stdout:Size : 8264254 2024-03-04T06:21:28.462 INFO:teuthology.orchestra.run.smithi137.stdout:License : GPLv3+ 2024-03-04T06:21:28.462 INFO:teuthology.orchestra.run.smithi137.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-04T06:21:28.462 INFO:teuthology.orchestra.run.smithi137.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-04T06:21:28.462 INFO:teuthology.orchestra.run.smithi137.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-04T06:21:28.462 INFO:teuthology.orchestra.run.smithi137.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-04T06:21:28.463 INFO:teuthology.orchestra.run.smithi137.stdout:Packager : builder@centos.org 2024-03-04T06:21:28.463 INFO:teuthology.orchestra.run.smithi137.stdout:Vendor : CentOS 2024-03-04T06:21:28.463 INFO:teuthology.orchestra.run.smithi137.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-04T06:21:28.463 INFO:teuthology.orchestra.run.smithi137.stdout:Summary : Support tools for GRUB. 2024-03-04T06:21:28.463 INFO:teuthology.orchestra.run.smithi137.stdout:Description : 2024-03-04T06:21:28.463 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:21:28.463 INFO:teuthology.orchestra.run.smithi137.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-04T06:21:28.463 INFO:teuthology.orchestra.run.smithi137.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-04T06:21:28.463 INFO:teuthology.orchestra.run.smithi137.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-04T06:21:28.463 INFO:teuthology.orchestra.run.smithi137.stdout:hardware devices. 2024-03-04T06:21:28.463 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:21:28.463 INFO:teuthology.orchestra.run.smithi137.stdout:This subpackage provides tools for support of all platforms. 2024-03-04T06:21:28.464 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-04T06:21:28.464 INFO:teuthology.task.kernel:Updating grub on smithi137 to boot 5.14.0-427.el9.x86_64 2024-03-04T06:21:28.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-04T06:21:29.060 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-03-04T06:21:30.434 INFO:teuthology.orchestra.run.smithi137.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-04T06:21:30.466 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-03-04T06:21:30.468 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-03-04T06:21:30.483 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.bphPW0Ni4b 2024-03-04T06:21:30.483 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bphPW0Ni4b 2024-03-04T06:21:30.559 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.bphPW0Ni4b 2024-03-04T06:21:30.694 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.bphPW0Ni4b is 6KB 2024-03-04T06:21:30.743 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.bphPW0Ni4b 2024-03-04T06:21:30.757 DEBUG:teuthology.orchestra.run.smithi137:> sudo /bin/ls /boot/loader/entries || true 2024-03-04T06:21:30.830 INFO:teuthology.orchestra.run.smithi137.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-04T06:21:30.830 INFO:teuthology.orchestra.run.smithi137.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-04T06:21:30.830 INFO:teuthology.orchestra.run.smithi137.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-04T06:21:30.830 INFO:teuthology.orchestra.run.smithi137.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-04T06:21:30.831 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-04T06:21:30.980 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2024-03-04T06:21:49.836 INFO:teuthology.orchestra.run.smithi203.stdout:(3/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 597 kB/s | 39 MB 01:07 2024-03-04T06:21:50.044 INFO:teuthology.orchestra.run.smithi203.stdout:(4/4): kernel-modules-core-5.14.0-427.el9.x86_6 607 kB/s | 33 MB 00:56 2024-03-04T06:21:50.045 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-03-04T06:21:50.045 INFO:teuthology.orchestra.run.smithi203.stdout:Total 1.5 MB/s | 100 MB 01:07 2024-03-04T06:21:50.926 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-03-04T06:21:51.330 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-03-04T06:21:51.330 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-03-04T06:21:52.673 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-03-04T06:21:52.673 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-03-04T06:21:55.378 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-03-04T06:21:56.027 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-04T06:21:56.164 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T06:21:58.967 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T06:21:59.160 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T06:22:00.982 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-04T06:22:00.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-04T06:22:00.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T06:22:03.933 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T06:22:04.145 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T06:22:08.925 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T06:22:19.452 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-03-04T06:22:28.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-04T06:22:28.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T06:22:31.516 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-03-04T06:22:38.278 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T06:22:38.278 INFO:teuthology.orchestra.run.smithi203.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-04T06:22:38.278 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:22:38.360 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-04T06:22:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T06:22:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-04T06:22:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T06:22:38.852 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T06:22:39.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T06:22:39.305 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:22:39.305 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-03-04T06:22:39.305 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-04T06:22:39.305 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-04T06:22:39.305 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-04T06:22:39.305 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-04T06:22:39.305 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:22:39.305 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-03-04T06:22:39.844 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T06:22:39.984 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T06:22:39.985 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T06:22:39.985 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-04T06:22:39.985 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-04T06:22:39.985 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-04T06:22:39.985 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-04T06:22:39.985 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi203.front.sepia.ceph.com, path=None, version=distro) 2024-03-04T06:22:39.985 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T06:22:40.106 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T06:22:40.106 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T06:22:40.106 DEBUG:teuthology.orchestra.run.smithi203:> sudo rpm -qi grub2-tools 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:Name : grub2-tools 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:Epoch : 1 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:Version : 2.06 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:Release : 68.el9 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:Architecture: x86_64 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:Group : Unspecified 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:Size : 8264254 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:License : GPLv3+ 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-04T06:22:40.150 INFO:teuthology.orchestra.run.smithi203.stdout:Packager : builder@centos.org 2024-03-04T06:22:40.151 INFO:teuthology.orchestra.run.smithi203.stdout:Vendor : CentOS 2024-03-04T06:22:40.151 INFO:teuthology.orchestra.run.smithi203.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-04T06:22:40.151 INFO:teuthology.orchestra.run.smithi203.stdout:Summary : Support tools for GRUB. 2024-03-04T06:22:40.151 INFO:teuthology.orchestra.run.smithi203.stdout:Description : 2024-03-04T06:22:40.151 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:22:40.151 INFO:teuthology.orchestra.run.smithi203.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-04T06:22:40.151 INFO:teuthology.orchestra.run.smithi203.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-04T06:22:40.151 INFO:teuthology.orchestra.run.smithi203.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-04T06:22:40.151 INFO:teuthology.orchestra.run.smithi203.stdout:hardware devices. 2024-03-04T06:22:40.151 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:22:40.151 INFO:teuthology.orchestra.run.smithi203.stdout:This subpackage provides tools for support of all platforms. 2024-03-04T06:22:40.152 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-04T06:22:40.152 INFO:teuthology.task.kernel:Updating grub on smithi203 to boot 5.14.0-427.el9.x86_64 2024-03-04T06:22:40.152 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-04T06:22:40.754 INFO:teuthology.orchestra.run.smithi203.stderr:Generating grub configuration file ... 2024-03-04T06:22:42.086 INFO:teuthology.orchestra.run.smithi203.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-04T06:22:42.116 INFO:teuthology.orchestra.run.smithi203.stderr:done 2024-03-04T06:22:42.119 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-03-04T06:22:42.134 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.4eZmZwkqg0 2024-03-04T06:22:42.134 DEBUG:teuthology.orchestra.run.smithi203:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4eZmZwkqg0 2024-03-04T06:22:42.202 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.4eZmZwkqg0 2024-03-04T06:22:42.338 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.4eZmZwkqg0 is 6KB 2024-03-04T06:22:42.386 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.4eZmZwkqg0 2024-03-04T06:22:42.400 DEBUG:teuthology.orchestra.run.smithi203:> sudo /bin/ls /boot/loader/entries || true 2024-03-04T06:22:42.466 INFO:teuthology.orchestra.run.smithi203.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-04T06:22:42.466 INFO:teuthology.orchestra.run.smithi203.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-04T06:22:42.466 INFO:teuthology.orchestra.run.smithi203.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-04T06:22:42.466 INFO:teuthology.orchestra.run.smithi203.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-04T06:22:42.467 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-04T06:22:42.603 DEBUG:teuthology.orchestra.run.smithi203:> sudo shutdown -r now 2024-03-04T06:22:43.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-04T06:22:43.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T06:23:12.632 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-04T06:23:12.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-03-04T06:23:12.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T06:23:15.403 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-03-04T06:23:15.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-04T06:23:15.901 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-427.el9.x86_64"... 2024-03-04T06:23:15.901 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-03-04T06:23:15.914 INFO:teuthology.orchestra.run.smithi137.stdout:5.14.0-427.el9.x86_64 2024-03-04T06:23:15.914 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-04T06:23:15.915 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-04T06:23:15.915 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-04T06:23:16.915 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-04T06:23:16.916 DEBUG:teuthology.orchestra.run.smithi137:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-04T06:23:16.977 INFO:teuthology.orchestra.run.smithi137.stdout:ttyS1 2024-03-04T06:23:17.017 DEBUG:teuthology.parallel:result is None 2024-03-04T06:23:31.132 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-04T06:23:40.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-03-04T06:23:40.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T06:23:43.196 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-04T06:23:55.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-03-04T06:23:55.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T06:24:55.200 DEBUG:teuthology.orchestra.remote:timed out 2024-03-04T06:25:10.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-03-04T06:25:10.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T06:25:10.621 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-03-04T06:25:11.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-03-04T06:25:11.027 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-427.el9.x86_64"... 2024-03-04T06:25:11.027 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-03-04T06:25:11.043 INFO:teuthology.orchestra.run.smithi203.stdout:5.14.0-427.el9.x86_64 2024-03-04T06:25:11.043 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-04T06:25:11.043 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-04T06:25:11.043 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-04T06:25:12.044 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-04T06:25:12.044 DEBUG:teuthology.orchestra.run.smithi203:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-04T06:25:12.118 INFO:teuthology.orchestra.run.smithi203.stdout:ttyS1 2024-03-04T06:25:12.151 DEBUG:teuthology.parallel:result is None 2024-03-04T06:25:12.152 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-04T06:25:12.158 INFO:teuthology.task.internal:Creating test directory... 2024-03-04T06:25:12.159 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-04T06:25:12.162 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-04T06:25:12.179 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-04T06:25:12.190 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-04T06:25:12.240 INFO:teuthology.task.internal:Creating archive directory... 2024-03-04T06:25:12.240 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-04T06:25:12.243 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-04T06:25:12.275 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-04T06:25:12.290 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-04T06:25:12.290 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-04T06:25:12.308 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-04T06:25:12.344 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T06:25:12.350 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T06:25:12.358 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T06:25:12.364 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T06:25:12.366 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-04T06:25:12.373 INFO:teuthology.task.internal:Configuring sudo... 2024-03-04T06:25:12.374 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-04T06:25:12.402 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-04T06:25:12.435 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-04T06:25:12.518 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-04T06:25:12.518 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-04T06:25:12.521 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-04T06:25:12.537 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T06:25:12.620 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T06:25:12.665 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T06:25:12.747 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T06:25:12.792 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:25:12.792 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-04T06:25:12.860 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T06:25:12.901 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T06:25:12.962 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T06:25:13.044 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T06:25:13.090 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-04T06:25:13.090 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-04T06:25:13.158 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-03-04T06:25:13.161 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2024-03-04T06:25:13.207 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T06:25:13.255 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T06:25:13.627 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-04T06:25:13.635 INFO:teuthology.task.internal:Starting timer... 2024-03-04T06:25:13.635 INFO:teuthology.run_tasks:Running task pcp... 2024-03-04T06:25:13.678 INFO:teuthology.run_tasks:Running task selinux... 2024-03-04T06:25:13.726 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-03-04T06:25:13.727 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2024-03-04T06:25:13.796 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: 2024-03-04T06:25:13.798 DEBUG:teuthology.orchestra.run.smithi203:> sudo service auditd rotate 2024-03-04T06:25:13.852 INFO:teuthology.orchestra.run.smithi203.stdout:Rotating logs: 2024-03-04T06:25:13.854 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-04T06:25:13.854 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2024-03-04T06:25:13.877 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2024-03-04T06:25:13.877 DEBUG:teuthology.orchestra.run.smithi203:> /usr/sbin/getenforce 2024-03-04T06:25:13.901 INFO:teuthology.orchestra.run.smithi203.stdout:Permissive 2024-03-04T06:25:13.901 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi137.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi203.front.sepia.ceph.com': 'permissive'} 2024-03-04T06:25:13.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T06:25:13.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T06:25:13.945 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T06:25:13.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T06:25:13.973 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-04T06:25:13.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2024-03-04T06:25:14.030 DEBUG:teuthology.orchestra.run.smithi203:> sudo /usr/sbin/setenforce permissive 2024-03-04T06:25:14.069 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-04T06:25:14.078 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-04T06:25:14.097 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-04T06:25:14.099 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi137.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-04T06:29:25.633 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi137.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2024-03-04T06:29:25.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-04T06:29:25.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T06:29:25.726 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-03-04T06:29:25.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-04T06:29:25.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-03-04T06:29:25.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T06:29:25.900 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-03-04T06:29:25.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-03-04T06:29:25.987 INFO:teuthology.run_tasks:Running task clock... 2024-03-04T06:29:25.999 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-04T06:29:25.999 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-04T06:29:25.999 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T06:29:26.002 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-04T06:29:26.002 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T06:29:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-04T06:29:26.047 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-04T06:29:26.058 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-04T06:29:26.075 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-04T06:29:26.076 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2024-03-04T06:29:26.090 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2024-03-04T06:29:26.104 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: ntpd: command not found 2024-03-04T06:29:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-04T06:29:26.118 INFO:teuthology.orchestra.run.smithi203.stdout:506 Cannot talk to daemon 2024-03-04T06:29:26.123 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-04T06:29:26.135 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-04T06:29:26.151 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-04T06:29:26.184 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-03-04T06:29:26.187 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T06:29:26.187 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-03-04T06:29:26.187 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T06:29:26.187 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T06:29:26.187 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T06:29:26.187 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T06:29:26.207 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-03-04T06:29:26.210 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T06:29:26.210 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-03-04T06:29:26.210 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T06:29:26.210 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T06:29:26.210 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T06:29:26.211 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T06:29:26.211 INFO:teuthology.run_tasks:Running task install... 2024-03-04T06:29:26.219 DEBUG:teuthology.task.install:project ceph 2024-03-04T06:29:26.219 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'default', 'sha1': 'efb04e5e69d058b0c47e511cb7e10d57a92f59ae'}} 2024-03-04T06:29:26.219 DEBUG:teuthology.task.install:config {'branch': 'reef', 'exclude_packages': ['ceph-volume'], 'extra_system_packages': ['python3-pytest'], 'flavor': 'default', 'sha1': 'efb04e5e69d058b0c47e511cb7e10d57a92f59ae'} 2024-03-04T06:29:26.220 INFO:teuthology.task.install:Using flavor: default 2024-03-04T06:29:26.225 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-04T06:29:26.225 INFO:teuthology.task.install:extra packages: [] 2024-03-04T06:29:26.226 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'efb04e5e69d058b0c47e511cb7e10d57a92f59ae', 'tag': None, 'wait_for_package': False} 2024-03-04T06:29:26.226 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-04T06:29:26.226 INFO:teuthology.packaging:ref: None 2024-03-04T06:29:26.226 INFO:teuthology.packaging:tag: None 2024-03-04T06:29:26.226 INFO:teuthology.packaging:branch: reef 2024-03-04T06:29:26.226 INFO:teuthology.packaging:sha1: efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:29:26.227 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-03-04T06:29:26.229 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'efb04e5e69d058b0c47e511cb7e10d57a92f59ae', 'tag': None, 'wait_for_package': False} 2024-03-04T06:29:26.229 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-04T06:29:26.229 INFO:teuthology.packaging:ref: None 2024-03-04T06:29:26.229 INFO:teuthology.packaging:tag: None 2024-03-04T06:29:26.229 INFO:teuthology.packaging:branch: reef 2024-03-04T06:29:26.229 INFO:teuthology.packaging:sha1: efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:29:26.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-03-04T06:29:26.547 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/5cc7a7679b7ba0f0befea649a39bb50c530f1e24/centos/9/flavors/default/ 2024-03-04T06:29:26.547 INFO:teuthology.task.install.rpm:Package version is 18.2.1-696.g5cc7a767 2024-03-04T06:29:26.564 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/5cc7a7679b7ba0f0befea649a39bb50c530f1e24/centos/9/flavors/default/ 2024-03-04T06:29:26.564 INFO:teuthology.task.install.rpm:Package version is 18.2.1-696.g5cc7a767 2024-03-04T06:29:26.906 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/5cc7a7679b7ba0f0befea649a39bb50c530f1e24/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/5cc7a7679b7ba0f0befea649a39bb50c530f1e24/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/5cc7a7679b7ba0f0befea649a39bb50c530f1e24/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-04T06:29:26.907 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-04T06:29:26.907 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-04T06:29:26.938 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest, python3-pytest, python3-pytest on remote rpm x86_64 2024-03-04T06:29:26.938 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-04T06:29:26.938 INFO:teuthology.packaging:ref: None 2024-03-04T06:29:26.938 INFO:teuthology.packaging:tag: None 2024-03-04T06:29:26.938 INFO:teuthology.packaging:branch: reef 2024-03-04T06:29:26.938 INFO:teuthology.packaging:sha1: efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:29:26.938 DEBUG:teuthology.orchestra.run.smithi203:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-04T06:29:26.951 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/5cc7a7679b7ba0f0befea649a39bb50c530f1e24/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/5cc7a7679b7ba0f0befea649a39bb50c530f1e24/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/5cc7a7679b7ba0f0befea649a39bb50c530f1e24/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-04T06:29:26.951 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:29:26.951 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-04T06:29:26.982 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest, python3-pytest, python3-pytest, python3-pytest on remote rpm x86_64 2024-03-04T06:29:26.982 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-04T06:29:26.982 INFO:teuthology.packaging:ref: None 2024-03-04T06:29:26.982 INFO:teuthology.packaging:tag: None 2024-03-04T06:29:26.983 INFO:teuthology.packaging:branch: reef 2024-03-04T06:29:26.983 INFO:teuthology.packaging:sha1: efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:29:26.983 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-04T06:29:27.007 DEBUG:teuthology.orchestra.run.smithi203:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-04T06:29:27.052 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-04T06:29:27.090 DEBUG:teuthology.orchestra.run.smithi203:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-04T06:29:27.134 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-04T06:29:27.157 INFO:teuthology.orchestra.run.smithi203.stdout:check_obsoletes = 1 2024-03-04T06:29:27.158 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum clean all 2024-03-04T06:29:27.201 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2024-03-04T06:29:27.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2024-03-04T06:29:27.397 INFO:teuthology.orchestra.run.smithi203.stdout:74 files removed 2024-03-04T06:29:27.425 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest python3-pytest python3-pytest python3-pytest 2024-03-04T06:29:27.444 INFO:teuthology.orchestra.run.smithi137.stdout:74 files removed 2024-03-04T06:29:27.470 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest python3-pytest python3-pytest python3-pytest 2024-03-04T06:29:28.792 INFO:teuthology.orchestra.run.smithi203.stdout:ceph packages for x86_64 73 kB/s | 77 kB 00:01 2024-03-04T06:29:28.812 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 75 kB/s | 77 kB 00:01 2024-03-04T06:29:29.593 INFO:teuthology.orchestra.run.smithi203.stdout:ceph noarch packages 13 kB/s | 9.9 kB 00:00 2024-03-04T06:29:29.595 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 14 kB/s | 9.9 kB 00:00 2024-03-04T06:29:30.021 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-03-04T06:29:30.035 INFO:teuthology.orchestra.run.smithi203.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-03-04T06:29:30.582 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-04T06:29:30.654 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-04T06:29:32.088 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS-9 - BaseOS 6.8 MB/s | 2.0 MB 00:00 2024-03-04T06:29:32.140 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-9 - BaseOS 4.6 MB/s | 2.0 MB 00:00 2024-03-04T06:29:33.170 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-03-04T06:29:33.289 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.0 MB 00:00 2024-03-04T06:29:35.392 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-03-04T06:29:47.111 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 1.5 MB/s | 19 MB 00:12 2024-03-04T06:29:47.515 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 729 kB/s | 6.1 MB 00:08 2024-03-04T06:29:49.716 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 15 kB 00:01 2024-03-04T06:29:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 6.1 MB 00:03 2024-03-04T06:29:55.662 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 15 kB 00:00 2024-03-04T06:30:10.402 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 20 MB 00:20 2024-03-04T06:30:15.123 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 20 MB 00:19 2024-03-04T06:30:15.440 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-03-04T06:30:18.028 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T06:30:18.029 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T06:30:18.102 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-03-04T06:30:18.113 INFO:teuthology.orchestra.run.smithi137.stdout:=========================================================================================== 2024-03-04T06:30:18.113 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-03-04T06:30:18.113 INFO:teuthology.orchestra.run.smithi137.stdout:=========================================================================================== 2024-03-04T06:30:18.114 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-03-04T06:30:18.114 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 6.5 k 2024-03-04T06:30:18.114 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 5.2 M 2024-03-04T06:30:18.114 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 841 k 2024-03-04T06:30:18.114 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 143 k 2024-03-04T06:30:18.114 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 1.4 M 2024-03-04T06:30:18.115 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 137 k 2024-03-04T06:30:18.115 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 1.7 M 2024-03-04T06:30:18.115 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 7.4 M 2024-03-04T06:30:18.115 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 49 k 2024-03-04T06:30:18.115 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 7.7 M 2024-03-04T06:30:18.115 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 40 M 2024-03-04T06:30:18.116 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 223 k 2024-03-04T06:30:18.116 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 31 k 2024-03-04T06:30:18.116 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 660 k 2024-03-04T06:30:18.116 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 127 k 2024-03-04T06:30:18.116 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 161 k 2024-03-04T06:30:18.116 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytest noarch 6.2.2-6.el9 CentOS-AppStream 474 k 2024-03-04T06:30:18.116 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 321 k 2024-03-04T06:30:18.116 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 298 k 2024-03-04T06:30:18.117 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 99 k 2024-03-04T06:30:18.117 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 87 k 2024-03-04T06:30:18.117 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 3.0 M 2024-03-04T06:30:18.117 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 172 k 2024-03-04T06:30:18.117 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2024-03-04T06:30:18.117 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 3.3 M 2024-03-04T06:30:18.117 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 3.0 M 2024-03-04T06:30:18.117 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-03-04T06:30:18.117 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-04T06:30:18.118 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 18 M 2024-03-04T06:30:18.118 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 23 k 2024-03-04T06:30:18.118 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 2.1 M 2024-03-04T06:30:18.118 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 245 k 2024-03-04T06:30:18.118 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 4.5 M 2024-03-04T06:30:18.118 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 18 M 2024-03-04T06:30:18.118 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 15 k 2024-03-04T06:30:18.118 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 25 k 2024-03-04T06:30:18.119 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-04T06:30:18.119 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-04T06:30:18.119 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-04T06:30:18.119 INFO:teuthology.orchestra.run.smithi137.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-04T06:30:18.119 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-04T06:30:18.119 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-04T06:30:18.119 INFO:teuthology.orchestra.run.smithi137.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-03-04T06:30:18.119 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-04T06:30:18.120 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-04T06:30:18.120 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 166 k 2024-03-04T06:30:18.120 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-03-04T06:30:18.120 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-04T06:30:18.120 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-04T06:30:18.120 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-03-04T06:30:18.120 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-04T06:30:18.120 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 474 k 2024-03-04T06:30:18.120 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-04T06:30:18.120 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 4.5 M 2024-03-04T06:30:18.120 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-04T06:30:18.120 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-04T06:30:18.121 INFO:teuthology.orchestra.run.smithi137.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-03-04T06:30:18.121 INFO:teuthology.orchestra.run.smithi137.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-04T06:30:18.121 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-04T06:30:18.121 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-04T06:30:18.121 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-04T06:30:18.121 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-04T06:30:18.121 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-04T06:30:18.121 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-04T06:30:18.121 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-04T06:30:18.121 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 45 k 2024-03-04T06:30:18.121 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 126 k 2024-03-04T06:30:18.121 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-04T06:30:18.121 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-iniconfig noarch 1.1.1-7.el9 CentOS-AppStream 16 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-04T06:30:18.122 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pluggy noarch 0.13.1-7.el9 CentOS-AppStream 38 k 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-04T06:30:18.123 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-04T06:30:18.124 INFO:teuthology.orchestra.run.smithi137.stdout: python3-py noarch 1.10.0-6.el9 CentOS-AppStream 427 k 2024-03-04T06:30:18.124 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-04T06:30:18.124 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-04T06:30:18.124 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-04T06:30:18.124 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-04T06:30:18.124 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-04T06:30:18.124 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-04T06:30:18.124 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-03-04T06:30:18.124 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-04T06:30:18.124 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-04T06:30:18.124 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-04T06:30:18.124 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-04T06:30:18.124 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-03-04T06:30:18.125 INFO:teuthology.orchestra.run.smithi137.stdout:=========================================================================================== 2024-03-04T06:30:18.126 INFO:teuthology.orchestra.run.smithi137.stdout:Install 118 Packages 2024-03-04T06:30:18.126 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 2 Packages 2024-03-04T06:30:18.126 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:30:18.126 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 177 M 2024-03-04T06:30:18.126 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-03-04T06:30:19.349 INFO:teuthology.orchestra.run.smithi137.stdout:(1/120): ceph-18.2.1-696.g5cc7a767.el9.x86_64.r 11 kB/s | 6.5 kB 00:00 2024-03-04T06:30:20.003 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-03-04T06:30:20.899 INFO:teuthology.orchestra.run.smithi137.stdout:(2/120): ceph-fuse-18.2.1-696.g5cc7a767.el9.x86 543 kB/s | 841 kB 00:01 2024-03-04T06:30:21.083 INFO:teuthology.orchestra.run.smithi137.stdout:(3/120): ceph-common-18.2.1-696.g5cc7a767.el9.x 7.9 MB/s | 18 MB 00:02 2024-03-04T06:30:21.127 INFO:teuthology.orchestra.run.smithi137.stdout:(4/120): ceph-immutable-object-cache-18.2.1-696 627 kB/s | 143 kB 00:00 2024-03-04T06:30:21.269 INFO:teuthology.orchestra.run.smithi137.stdout:(5/120): ceph-base-18.2.1-696.g5cc7a767.el9.x86 2.1 MB/s | 5.2 MB 00:02 2024-03-04T06:30:21.311 INFO:teuthology.orchestra.run.smithi137.stdout:(6/120): ceph-mds-18.2.1-696.g5cc7a767.el9.x86_ 9.3 MB/s | 2.1 MB 00:00 2024-03-04T06:30:22.566 INFO:teuthology.orchestra.run.smithi203.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T06:30:22.567 INFO:teuthology.orchestra.run.smithi203.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T06:30:22.638 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-03-04T06:30:22.650 INFO:teuthology.orchestra.run.smithi203.stdout:=========================================================================================== 2024-03-04T06:30:22.650 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-03-04T06:30:22.650 INFO:teuthology.orchestra.run.smithi203.stdout:=========================================================================================== 2024-03-04T06:30:22.650 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-03-04T06:30:22.650 INFO:teuthology.orchestra.run.smithi203.stdout: ceph x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 6.5 k 2024-03-04T06:30:22.650 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 5.2 M 2024-03-04T06:30:22.650 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 841 k 2024-03-04T06:30:22.650 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 143 k 2024-03-04T06:30:22.650 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 1.4 M 2024-03-04T06:30:22.650 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 137 k 2024-03-04T06:30:22.650 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 1.7 M 2024-03-04T06:30:22.650 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 7.4 M 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 49 k 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 7.7 M 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 40 M 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 223 k 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 31 k 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2 x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 660 k 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 127 k 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 161 k 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytest noarch 6.2.2-6.el9 CentOS-AppStream 474 k 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 321 k 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 298 k 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 99 k 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 87 k 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 3.0 M 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 172 k 2024-03-04T06:30:22.651 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrading: 2024-03-04T06:30:22.652 INFO:teuthology.orchestra.run.smithi203.stdout: librados2 x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 3.3 M 2024-03-04T06:30:22.652 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1 x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 3.0 M 2024-03-04T06:30:22.652 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-03-04T06:30:22.652 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-04T06:30:22.652 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 18 M 2024-03-04T06:30:22.652 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 23 k 2024-03-04T06:30:22.652 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 2.1 M 2024-03-04T06:30:22.652 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 245 k 2024-03-04T06:30:22.652 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 4.5 M 2024-03-04T06:30:22.652 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 18 M 2024-03-04T06:30:22.652 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts noarch 2:18.2.1-696.g5cc7a767.el9 ceph-noarch 15 k 2024-03-04T06:30:22.653 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 25 k 2024-03-04T06:30:22.653 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-04T06:30:22.653 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-04T06:30:22.653 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-04T06:30:22.653 INFO:teuthology.orchestra.run.smithi203.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-04T06:30:22.653 INFO:teuthology.orchestra.run.smithi203.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-04T06:30:22.653 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-04T06:30:22.653 INFO:teuthology.orchestra.run.smithi203.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-03-04T06:30:22.653 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-04T06:30:22.653 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-04T06:30:22.653 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 166 k 2024-03-04T06:30:22.653 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-03-04T06:30:22.653 INFO:teuthology.orchestra.run.smithi203.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-04T06:30:22.654 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-04T06:30:22.654 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-03-04T06:30:22.654 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-04T06:30:22.654 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1 x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 474 k 2024-03-04T06:30:22.654 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-04T06:30:22.654 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2 x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 4.5 M 2024-03-04T06:30:22.654 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-04T06:30:22.654 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-04T06:30:22.654 INFO:teuthology.orchestra.run.smithi203.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-03-04T06:30:22.654 INFO:teuthology.orchestra.run.smithi203.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-04T06:30:22.654 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-04T06:30:22.654 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 45 k 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common x86_64 2:18.2.1-696.g5cc7a767.el9 ceph 126 k 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-04T06:30:22.655 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-04T06:30:22.656 INFO:teuthology.orchestra.run.smithi203.stdout: python3-iniconfig noarch 1.1.1-7.el9 CentOS-AppStream 16 k 2024-03-04T06:30:22.656 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-04T06:30:22.656 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-04T06:30:22.656 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-04T06:30:22.656 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-04T06:30:22.656 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-04T06:30:22.656 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-03-04T06:30:22.656 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-04T06:30:22.656 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-04T06:30:22.656 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-04T06:30:22.656 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-04T06:30:22.656 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-04T06:30:22.656 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-04T06:30:22.657 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-04T06:30:22.657 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-04T06:30:22.657 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-04T06:30:22.657 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-04T06:30:22.657 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-04T06:30:22.657 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-04T06:30:22.657 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-04T06:30:22.657 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pluggy noarch 0.13.1-7.el9 CentOS-AppStream 38 k 2024-03-04T06:30:22.657 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-04T06:30:22.657 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-04T06:30:22.657 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-04T06:30:22.657 INFO:teuthology.orchestra.run.smithi203.stdout: python3-py noarch 1.10.0-6.el9 CentOS-AppStream 427 k 2024-03-04T06:30:22.657 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-04T06:30:22.658 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout:=========================================================================================== 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout:Install 118 Packages 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrade 2 Packages 2024-03-04T06:30:22.659 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:30:22.660 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 177 M 2024-03-04T06:30:22.660 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-03-04T06:30:22.769 INFO:teuthology.orchestra.run.smithi137.stdout:(7/120): ceph-osd-18.2.1-696.g5cc7a767.el9.x86_ 12 MB/s | 18 MB 00:01 2024-03-04T06:30:22.827 INFO:teuthology.orchestra.run.smithi137.stdout:(8/120): ceph-mon-18.2.1-696.g5cc7a767.el9.x86_ 2.9 MB/s | 4.5 MB 00:01 2024-03-04T06:30:23.119 INFO:teuthology.orchestra.run.smithi137.stdout:(9/120): ceph-mgr-18.2.1-696.g5cc7a767.el9.x86_ 744 kB/s | 1.4 MB 00:01 2024-03-04T06:30:23.246 INFO:teuthology.orchestra.run.smithi203.stdout:(1/120): ceph-18.2.1-696.g5cc7a767.el9.x86_64.r 37 kB/s | 6.5 kB 00:00 2024-03-04T06:30:23.403 INFO:teuthology.orchestra.run.smithi137.stdout:(10/120): ceph-radosgw-18.2.1-696.g5cc7a767.el9 12 MB/s | 7.7 MB 00:00 2024-03-04T06:30:23.462 INFO:teuthology.orchestra.run.smithi137.stdout:(11/120): ceph-selinux-18.2.1-696.g5cc7a767.el9 40 kB/s | 25 kB 00:00 2024-03-04T06:30:23.512 INFO:teuthology.orchestra.run.smithi137.stdout:(12/120): libcephfs-devel-18.2.1-696.g5cc7a767. 287 kB/s | 31 kB 00:00 2024-03-04T06:30:23.720 INFO:teuthology.orchestra.run.smithi137.stdout:(13/120): libcephsqlite-18.2.1-696.g5cc7a767.el 796 kB/s | 166 kB 00:00 2024-03-04T06:30:23.821 INFO:teuthology.orchestra.run.smithi137.stdout:(14/120): libcephfs2-18.2.1-696.g5cc7a767.el9.x 1.8 MB/s | 660 kB 00:00 2024-03-04T06:30:23.846 INFO:teuthology.orchestra.run.smithi137.stdout:(15/120): librados-devel-18.2.1-696.g5cc7a767.e 1.0 MB/s | 127 kB 00:00 2024-03-04T06:30:23.920 INFO:teuthology.orchestra.run.smithi203.stdout:(2/120): ceph-fuse-18.2.1-696.g5cc7a767.el9.x86 1.2 MB/s | 841 kB 00:00 2024-03-04T06:30:23.988 INFO:teuthology.orchestra.run.smithi137.stdout:(16/120): libradosstriper1-18.2.1-696.g5cc7a767 2.8 MB/s | 474 kB 00:00 2024-03-04T06:30:24.013 INFO:teuthology.orchestra.run.smithi203.stdout:(3/120): ceph-immutable-object-cache-18.2.1-696 1.5 MB/s | 143 kB 00:00 2024-03-04T06:30:24.297 INFO:teuthology.orchestra.run.smithi137.stdout:(17/120): librgw2-18.2.1-696.g5cc7a767.el9.x86_ 9.9 MB/s | 4.5 MB 00:00 2024-03-04T06:30:24.322 INFO:teuthology.orchestra.run.smithi137.stdout:(18/120): python3-ceph-argparse-18.2.1-696.g5cc 135 kB/s | 45 kB 00:00 2024-03-04T06:30:24.413 INFO:teuthology.orchestra.run.smithi137.stdout:(19/120): python3-ceph-common-18.2.1-696.g5cc7a 1.1 MB/s | 126 kB 00:00 2024-03-04T06:30:24.447 INFO:teuthology.orchestra.run.smithi137.stdout:(20/120): python3-cephfs-18.2.1-696.g5cc7a767.e 1.3 MB/s | 161 kB 00:00 2024-03-04T06:30:24.488 INFO:teuthology.orchestra.run.smithi203.stdout:(4/120): ceph-mds-18.2.1-696.g5cc7a767.el9.x86_ 4.4 MB/s | 2.1 MB 00:00 2024-03-04T06:30:24.573 INFO:teuthology.orchestra.run.smithi137.stdout:(21/120): python3-rados-18.2.1-696.g5cc7a767.el 2.0 MB/s | 321 kB 00:00 2024-03-04T06:30:24.606 INFO:teuthology.orchestra.run.smithi137.stdout:(22/120): python3-rbd-18.2.1-696.g5cc7a767.el9. 1.8 MB/s | 298 kB 00:00 2024-03-04T06:30:24.672 INFO:teuthology.orchestra.run.smithi203.stdout:(5/120): ceph-base-18.2.1-696.g5cc7a767.el9.x86 3.2 MB/s | 5.2 MB 00:01 2024-03-04T06:30:24.690 INFO:teuthology.orchestra.run.smithi137.stdout:(23/120): python3-rgw-18.2.1-696.g5cc7a767.el9. 850 kB/s | 99 kB 00:00 2024-03-04T06:30:24.715 INFO:teuthology.orchestra.run.smithi137.stdout:(24/120): rbd-fuse-18.2.1-696.g5cc7a767.el9.x86 797 kB/s | 87 kB 00:00 2024-03-04T06:30:24.822 INFO:teuthology.orchestra.run.smithi203.stdout:(6/120): ceph-mgr-18.2.1-696.g5cc7a767.el9.x86_ 4.3 MB/s | 1.4 MB 00:00 2024-03-04T06:30:25.040 INFO:teuthology.orchestra.run.smithi137.stdout:(25/120): rbd-mirror-18.2.1-696.g5cc7a767.el9.x 8.5 MB/s | 3.0 MB 00:00 2024-03-04T06:30:25.065 INFO:teuthology.orchestra.run.smithi137.stdout:(26/120): rbd-nbd-18.2.1-696.g5cc7a767.el9.x86_ 491 kB/s | 172 kB 00:00 2024-03-04T06:30:25.124 INFO:teuthology.orchestra.run.smithi137.stdout:(27/120): ceph-grafana-dashboards-18.2.1-696.g5 278 kB/s | 23 kB 00:00 2024-03-04T06:30:25.233 INFO:teuthology.orchestra.run.smithi137.stdout:(28/120): ceph-mgr-cephadm-18.2.1-696.g5cc7a767 821 kB/s | 137 kB 00:00 2024-03-04T06:30:25.433 INFO:teuthology.orchestra.run.smithi137.stdout:(29/120): ceph-mgr-dashboard-18.2.1-696.g5cc7a7 5.6 MB/s | 1.7 MB 00:00 2024-03-04T06:30:25.708 INFO:teuthology.orchestra.run.smithi137.stdout:(30/120): ceph-mgr-modules-core-18.2.1-696.g5cc 890 kB/s | 245 kB 00:00 2024-03-04T06:30:25.756 INFO:teuthology.orchestra.run.smithi203.stdout:(7/120): ceph-mon-18.2.1-696.g5cc7a767.el9.x86_ 4.1 MB/s | 4.5 MB 00:01 2024-03-04T06:30:25.792 INFO:teuthology.orchestra.run.smithi137.stdout:(31/120): ceph-mgr-rook-18.2.1-696.g5cc7a767.el 593 kB/s | 49 kB 00:00 2024-03-04T06:30:25.884 INFO:teuthology.orchestra.run.smithi137.stdout:(32/120): ceph-prometheus-alerts-18.2.1-696.g5c 163 kB/s | 15 kB 00:00 2024-03-04T06:30:26.043 INFO:teuthology.orchestra.run.smithi137.stdout:(33/120): cephadm-18.2.1-696.g5cc7a767.el9.noar 1.4 MB/s | 223 kB 00:00 2024-03-04T06:30:26.151 INFO:teuthology.orchestra.run.smithi137.stdout:(34/120): boost-program-options-1.75.0-8.el9.x8 981 kB/s | 106 kB 00:00 2024-03-04T06:30:26.193 INFO:teuthology.orchestra.run.smithi137.stdout:(35/120): flexiblas-3.0.4-8.el9.x86_64.rpm 762 kB/s | 32 kB 00:00 2024-03-04T06:30:26.369 INFO:teuthology.orchestra.run.smithi137.stdout:(36/120): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-03-04T06:30:26.402 INFO:teuthology.orchestra.run.smithi137.stdout:(37/120): flexiblas-openblas-openmp-3.0.4-8.el9 515 kB/s | 17 kB 00:00 2024-03-04T06:30:26.444 INFO:teuthology.orchestra.run.smithi137.stdout:(38/120): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-03-04T06:30:26.478 INFO:teuthology.orchestra.run.smithi137.stdout:(39/120): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-04T06:30:26.662 INFO:teuthology.orchestra.run.smithi137.stdout:(40/120): ceph-mgr-diskprediction-local-18.2.1- 5.2 MB/s | 7.4 MB 00:01 2024-03-04T06:30:26.664 INFO:teuthology.orchestra.run.smithi203.stdout:(8/120): ceph-osd-18.2.1-696.g5cc7a767.el9.x86_ 9.6 MB/s | 18 MB 00:01 2024-03-04T06:30:26.687 INFO:teuthology.orchestra.run.smithi137.stdout:(41/120): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 661 kB 00:00 2024-03-04T06:30:26.746 INFO:teuthology.orchestra.run.smithi137.stdout:(42/120): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.3 MB/s | 282 kB 00:00 2024-03-04T06:30:26.748 INFO:teuthology.orchestra.run.smithi203.stdout:(9/120): ceph-selinux-18.2.1-696.g5cc7a767.el9. 303 kB/s | 25 kB 00:00 2024-03-04T06:30:26.879 INFO:teuthology.orchestra.run.smithi137.stdout:(43/120): openblas-0.3.21-2.el9.x86_64.rpm 178 kB/s | 34 kB 00:00 2024-03-04T06:30:27.046 INFO:teuthology.orchestra.run.smithi137.stdout:(44/120): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2024-03-04T06:30:27.063 INFO:teuthology.orchestra.run.smithi137.stdout:(45/120): python3-attrs-20.3.0-7.el9.noarch.rpm 427 kB/s | 78 kB 00:00 2024-03-04T06:30:27.130 INFO:teuthology.orchestra.run.smithi137.stdout:(46/120): python3-iniconfig-1.1.1-7.el9.noarch. 247 kB/s | 16 kB 00:00 2024-03-04T06:30:27.205 INFO:teuthology.orchestra.run.smithi137.stdout:(47/120): python3-babel-2.9.1-2.el9.noarch.rpm 41 MB/s | 5.8 MB 00:00 2024-03-04T06:30:27.230 INFO:teuthology.orchestra.run.smithi137.stdout:(48/120): python3-jinja2-2.11.3-5.el9.noarch.rp 2.3 MB/s | 227 kB 00:00 2024-03-04T06:30:27.256 INFO:teuthology.orchestra.run.smithi137.stdout:(49/120): python3-jsonpatch-1.21-16.el9.noarch. 489 kB/s | 24 kB 00:00 2024-03-04T06:30:27.281 INFO:teuthology.orchestra.run.smithi137.stdout:(50/120): python3-jsonpointer-2.0-4.el9.noarch. 360 kB/s | 18 kB 00:00 2024-03-04T06:30:27.306 INFO:teuthology.orchestra.run.smithi137.stdout:(51/120): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-04T06:30:27.332 INFO:teuthology.orchestra.run.smithi137.stdout:(52/120): python3-markupsafe-1.1.1-12.el9.x86_6 630 kB/s | 32 kB 00:00 2024-03-04T06:30:27.382 INFO:teuthology.orchestra.run.smithi137.stdout:(53/120): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.4 MB/s | 217 kB 00:00 2024-03-04T06:30:27.457 INFO:teuthology.orchestra.run.smithi137.stdout:(54/120): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-03-04T06:30:27.482 INFO:teuthology.orchestra.run.smithi137.stdout:(55/120): python3-oauthlib-3.1.1-5.el9.noarch.r 1.8 MB/s | 174 kB 00:00 2024-03-04T06:30:27.507 INFO:teuthology.orchestra.run.smithi137.stdout:(56/120): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-03-04T06:30:27.541 INFO:teuthology.orchestra.run.smithi137.stdout:(57/120): python3-pluggy-0.13.1-7.el9.noarch.rp 646 kB/s | 38 kB 00:00 2024-03-04T06:30:27.566 INFO:teuthology.orchestra.run.smithi137.stdout:(58/120): python3-prettytable-0.7.2-27.el9.noar 701 kB/s | 41 kB 00:00 2024-03-04T06:30:27.658 INFO:teuthology.orchestra.run.smithi137.stdout:(59/120): python3-py-1.10.0-6.el9.noarch.rpm 3.6 MB/s | 427 kB 00:00 2024-03-04T06:30:27.690 INFO:teuthology.orchestra.run.smithi203.stdout:(10/120): ceph-radosgw-18.2.1-696.g5cc7a767.el9 4.0 MB/s | 7.7 MB 00:01 2024-03-04T06:30:27.692 INFO:teuthology.orchestra.run.smithi137.stdout:(60/120): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 132 kB 00:00 2024-03-04T06:30:27.734 INFO:teuthology.orchestra.run.smithi137.stdout:(61/120): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-03-04T06:30:27.790 INFO:teuthology.orchestra.run.smithi203.stdout:(11/120): libcephfs-devel-18.2.1-696.g5cc7a767. 311 kB/s | 31 kB 00:00 2024-03-04T06:30:27.843 INFO:teuthology.orchestra.run.smithi137.stdout:(62/120): python3-pytest-6.2.2-6.el9.noarch.rpm 3.1 MB/s | 474 kB 00:00 2024-03-04T06:30:27.868 INFO:teuthology.orchestra.run.smithi137.stdout:(63/120): python3-pytz-2021.1-5.el9.noarch.rpm 354 kB/s | 47 kB 00:00 2024-03-04T06:30:27.893 INFO:teuthology.orchestra.run.smithi137.stdout:(64/120): python3-requests-oauthlib-1.3.0-12.el 857 kB/s | 43 kB 00:00 2024-03-04T06:30:28.065 INFO:teuthology.orchestra.run.smithi203.stdout:(12/120): libcephfs2-18.2.1-696.g5cc7a767.el9.x 2.3 MB/s | 660 kB 00:00 2024-03-04T06:30:28.177 INFO:teuthology.orchestra.run.smithi137.stdout:(65/120): python3-toml-0.10.2-6.el9.noarch.rpm 136 kB/s | 39 kB 00:00 2024-03-04T06:30:28.427 INFO:teuthology.orchestra.run.smithi137.stdout:(66/120): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 300 kB 00:00 2024-03-04T06:30:28.678 INFO:teuthology.orchestra.run.smithi137.stdout:(67/120): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-03-04T06:30:28.703 INFO:teuthology.orchestra.run.smithi137.stdout:(68/120): xmlstarlet-1.6.1-20.el9.x86_64.rpm 230 kB/s | 63 kB 00:00 2024-03-04T06:30:28.728 INFO:teuthology.orchestra.run.smithi137.stdout:(69/120): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-03-04T06:30:28.753 INFO:teuthology.orchestra.run.smithi137.stdout:(70/120): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-03-04T06:30:28.779 INFO:teuthology.orchestra.run.smithi137.stdout:(71/120): libgfortran-11.4.1-3.el9.x86_64.rpm 16 MB/s | 802 kB 00:00 2024-03-04T06:30:28.804 INFO:teuthology.orchestra.run.smithi137.stdout:(72/120): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 194 kB 00:00 2024-03-04T06:30:28.829 INFO:teuthology.orchestra.run.smithi137.stdout:(73/120): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-03-04T06:30:28.854 INFO:teuthology.orchestra.run.smithi137.stdout:(74/120): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-04T06:30:28.905 INFO:teuthology.orchestra.run.smithi137.stdout:(75/120): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.1 MB 00:00 2024-03-04T06:30:28.930 INFO:teuthology.orchestra.run.smithi137.stdout:(76/120): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-03-04T06:30:28.955 INFO:teuthology.orchestra.run.smithi137.stdout:(77/120): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-03-04T06:30:28.981 INFO:teuthology.orchestra.run.smithi137.stdout:(78/120): python3-requests-2.25.1-8.el9.noarch. 2.2 MB/s | 113 kB 00:00 2024-03-04T06:30:29.006 INFO:teuthology.orchestra.run.smithi137.stdout:(79/120): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2024-03-04T06:30:29.214 INFO:teuthology.orchestra.run.smithi137.stdout:(80/120): fmt-8.1.1-5.el9.x86_64.rpm 532 kB/s | 111 kB 00:00 2024-03-04T06:30:29.240 INFO:teuthology.orchestra.run.smithi137.stdout:(81/120): python3-devel-3.9.17-2.el9.x86_64.rpm 950 kB/s | 245 kB 00:00 2024-03-04T06:30:29.332 INFO:teuthology.orchestra.run.smithi137.stdout:(82/120): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.6 MB/s | 309 kB 00:00 2024-03-04T06:30:29.390 INFO:teuthology.orchestra.run.smithi137.stdout:(83/120): libarrow-doc-9.0.0-10.el9.noarch.rpm 445 kB/s | 26 kB 00:00 2024-03-04T06:30:29.449 INFO:teuthology.orchestra.run.smithi137.stdout:(84/120): liboath-2.6.7-2.el9.x86_64.rpm 834 kB/s | 49 kB 00:00 2024-03-04T06:30:29.507 INFO:teuthology.orchestra.run.smithi137.stdout:(85/120): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-03-04T06:30:29.641 INFO:teuthology.orchestra.run.smithi137.stdout:(86/120): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.1 MB/s | 838 kB 00:00 2024-03-04T06:30:29.708 INFO:teuthology.orchestra.run.smithi137.stdout:(87/120): libarrow-9.0.0-10.el9.x86_64.rpm 9.4 MB/s | 4.4 MB 00:00 2024-03-04T06:30:29.733 INFO:teuthology.orchestra.run.smithi137.stdout:(88/120): python3-asyncssh-2.13.2-4.el9.noarch. 5.8 MB/s | 548 kB 00:00 2024-03-04T06:30:29.767 INFO:teuthology.orchestra.run.smithi137.stdout:(89/120): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 743 kB/s | 43 kB 00:00 2024-03-04T06:30:29.792 INFO:teuthology.orchestra.run.smithi137.stdout:(90/120): python3-cachetools-4.2.4-1.el9.noarch 551 kB/s | 32 kB 00:00 2024-03-04T06:30:29.826 INFO:teuthology.orchestra.run.smithi137.stdout:(91/120): python3-certifi-2021.10.8-2.el9.noarc 255 kB/s | 15 kB 00:00 2024-03-04T06:30:29.851 INFO:teuthology.orchestra.run.smithi137.stdout:(92/120): python3-cheroot-8.6.0-4.el9.noarch.rp 2.9 MB/s | 172 kB 00:00 2024-03-04T06:30:29.885 INFO:teuthology.orchestra.run.smithi137.stdout:(93/120): python3-cherrypy-18.6.1-2.el9.noarch. 6.0 MB/s | 358 kB 00:00 2024-03-04T06:30:29.910 INFO:teuthology.orchestra.run.smithi137.stdout:(94/120): python3-google-auth-2.28.0-1.el9.noar 3.4 MB/s | 203 kB 00:00 2024-03-04T06:30:29.944 INFO:teuthology.orchestra.run.smithi137.stdout:(95/120): python3-jaraco-8.2.1-3.el9.noarch.rpm 183 kB/s | 11 kB 00:00 2024-03-04T06:30:29.969 INFO:teuthology.orchestra.run.smithi137.stdout:(96/120): python3-jaraco-classes-3.2.1-5.el9.no 303 kB/s | 18 kB 00:00 2024-03-04T06:30:29.990 INFO:teuthology.orchestra.run.smithi203.stdout:(13/120): ceph-test-18.2.1-696.g5cc7a767.el9.x8 12 MB/s | 40 MB 00:03 2024-03-04T06:30:30.003 INFO:teuthology.orchestra.run.smithi137.stdout:(97/120): python3-jaraco-collections-3.0.0-8.el 395 kB/s | 23 kB 00:00 2024-03-04T06:30:30.016 INFO:teuthology.orchestra.run.smithi203.stdout:(14/120): libcephsqlite-18.2.1-696.g5cc7a767.el 85 kB/s | 166 kB 00:01 2024-03-04T06:30:30.028 INFO:teuthology.orchestra.run.smithi137.stdout:(98/120): python3-jaraco-functools-3.5.0-2.el9. 331 kB/s | 19 kB 00:00 2024-03-04T06:30:30.062 INFO:teuthology.orchestra.run.smithi137.stdout:(99/120): python3-jaraco-text-3.2.0-6.el9.noarc 336 kB/s | 20 kB 00:00 2024-03-04T06:30:30.112 INFO:teuthology.orchestra.run.smithi137.stdout:(100/120): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-03-04T06:30:30.137 INFO:teuthology.orchestra.run.smithi137.stdout:(101/120): python3-logutils-0.3.5-21.el9.noarch 618 kB/s | 46 kB 00:00 2024-03-04T06:30:30.171 INFO:teuthology.orchestra.run.smithi137.stdout:(102/120): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-03-04T06:30:30.196 INFO:teuthology.orchestra.run.smithi137.stdout:(103/120): python3-natsort-7.1.1-5.el9.noarch.r 986 kB/s | 58 kB 00:00 2024-03-04T06:30:30.200 INFO:teuthology.orchestra.run.smithi203.stdout:(15/120): ceph-common-18.2.1-696.g5cc7a767.el9. 2.6 MB/s | 18 MB 00:07 2024-03-04T06:30:30.224 INFO:teuthology.orchestra.run.smithi203.stdout:(16/120): librados-devel-18.2.1-696.g5cc7a767.e 542 kB/s | 127 kB 00:00 2024-03-04T06:30:30.229 INFO:teuthology.orchestra.run.smithi137.stdout:(104/120): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-03-04T06:30:30.255 INFO:teuthology.orchestra.run.smithi137.stdout:(105/120): python3-portend-3.1.0-2.el9.noarch.r 279 kB/s | 16 kB 00:00 2024-03-04T06:30:30.288 INFO:teuthology.orchestra.run.smithi137.stdout:(106/120): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-03-04T06:30:30.291 INFO:teuthology.orchestra.run.smithi203.stdout:(17/120): libradosstriper1-18.2.1-696.g5cc7a767 1.7 MB/s | 474 kB 00:00 2024-03-04T06:30:30.305 INFO:teuthology.orchestra.run.smithi137.stdout:(107/120): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-03-04T06:30:30.317 INFO:teuthology.orchestra.run.smithi203.stdout:(18/120): python3-ceph-argparse-18.2.1-696.g5cc 490 kB/s | 45 kB 00:00 2024-03-04T06:30:30.347 INFO:teuthology.orchestra.run.smithi137.stdout:(108/120): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-03-04T06:30:30.364 INFO:teuthology.orchestra.run.smithi137.stdout:(109/120): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-03-04T06:30:30.383 INFO:teuthology.orchestra.run.smithi203.stdout:(19/120): python3-ceph-common-18.2.1-696.g5cc7a 1.3 MB/s | 126 kB 00:00 2024-03-04T06:30:30.406 INFO:teuthology.orchestra.run.smithi137.stdout:(110/120): python3-tempora-5.0.0-2.el9.noarch.r 613 kB/s | 36 kB 00:00 2024-03-04T06:30:30.409 INFO:teuthology.orchestra.run.smithi203.stdout:(20/120): python3-cephfs-18.2.1-696.g5cc7a767.e 1.7 MB/s | 161 kB 00:00 2024-03-04T06:30:30.431 INFO:teuthology.orchestra.run.smithi137.stdout:(111/120): python3-typing-extensions-4.4.0-2.el 762 kB/s | 51 kB 00:00 2024-03-04T06:30:30.465 INFO:teuthology.orchestra.run.smithi137.stdout:(112/120): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-03-04T06:30:30.484 INFO:teuthology.orchestra.run.smithi203.stdout:(21/120): python3-rbd-18.2.1-696.g5cc7a767.el9. 3.9 MB/s | 298 kB 00:00 2024-03-04T06:30:30.490 INFO:teuthology.orchestra.run.smithi137.stdout:(113/120): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-03-04T06:30:30.509 INFO:teuthology.orchestra.run.smithi203.stdout:(22/120): python3-rados-18.2.1-696.g5cc7a767.el 2.5 MB/s | 321 kB 00:00 2024-03-04T06:30:30.532 INFO:teuthology.orchestra.run.smithi137.stdout:(114/120): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2024-03-04T06:30:30.549 INFO:teuthology.orchestra.run.smithi137.stdout:(115/120): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-03-04T06:30:30.560 INFO:teuthology.orchestra.run.smithi203.stdout:(23/120): python3-rgw-18.2.1-696.g5cc7a767.el9. 1.3 MB/s | 99 kB 00:00 2024-03-04T06:30:30.585 INFO:teuthology.orchestra.run.smithi203.stdout:(24/120): rbd-fuse-18.2.1-696.g5cc7a767.el9.x86 1.1 MB/s | 87 kB 00:00 2024-03-04T06:30:30.608 INFO:teuthology.orchestra.run.smithi137.stdout:(116/120): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-04T06:30:30.659 INFO:teuthology.orchestra.run.smithi137.stdout:(117/120): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-03-04T06:30:30.668 INFO:teuthology.orchestra.run.smithi203.stdout:(25/120): rbd-nbd-18.2.1-696.g5cc7a767.el9.x86_ 2.0 MB/s | 172 kB 00:00 2024-03-04T06:30:30.744 INFO:teuthology.orchestra.run.smithi203.stdout:(26/120): ceph-grafana-dashboards-18.2.1-696.g5 309 kB/s | 23 kB 00:00 2024-03-04T06:30:30.819 INFO:teuthology.orchestra.run.smithi203.stdout:(27/120): rbd-mirror-18.2.1-696.g5cc7a767.el9.x 12 MB/s | 3.0 MB 00:00 2024-03-04T06:30:30.844 INFO:teuthology.orchestra.run.smithi203.stdout:(28/120): ceph-mgr-cephadm-18.2.1-696.g5cc7a767 1.3 MB/s | 137 kB 00:00 2024-03-04T06:30:31.003 INFO:teuthology.orchestra.run.smithi203.stdout:(29/120): ceph-mgr-dashboard-18.2.1-696.g5cc7a7 9.5 MB/s | 1.7 MB 00:00 2024-03-04T06:30:31.129 INFO:teuthology.orchestra.run.smithi203.stdout:(30/120): librgw2-18.2.1-696.g5cc7a767.el9.x86_ 4.8 MB/s | 4.5 MB 00:00 2024-03-04T06:30:31.154 INFO:teuthology.orchestra.run.smithi203.stdout:(31/120): ceph-mgr-modules-core-18.2.1-696.g5cc 1.6 MB/s | 245 kB 00:00 2024-03-04T06:30:31.212 INFO:teuthology.orchestra.run.smithi203.stdout:(32/120): ceph-mgr-rook-18.2.1-696.g5cc7a767.el 592 kB/s | 49 kB 00:00 2024-03-04T06:30:31.229 INFO:teuthology.orchestra.run.smithi203.stdout:(33/120): ceph-prometheus-alerts-18.2.1-696.g5c 198 kB/s | 15 kB 00:00 2024-03-04T06:30:31.259 INFO:teuthology.orchestra.run.smithi137.stdout:(118/120): librbd1-18.2.1-696.g5cc7a767.el9.x86 5.0 MB/s | 3.0 MB 00:00 2024-03-04T06:30:31.296 INFO:teuthology.orchestra.run.smithi203.stdout:(34/120): cephadm-18.2.1-696.g5cc7a767.el9.noar 2.6 MB/s | 223 kB 00:00 2024-03-04T06:30:31.342 INFO:teuthology.orchestra.run.smithi137.stdout:(119/120): librados2-18.2.1-696.g5cc7a767.el9.x 4.5 MB/s | 3.3 MB 00:00 2024-03-04T06:30:31.363 INFO:teuthology.orchestra.run.smithi203.stdout:(35/120): boost-program-options-1.75.0-8.el9.x8 795 kB/s | 106 kB 00:00 2024-03-04T06:30:31.380 INFO:teuthology.orchestra.run.smithi203.stdout:(36/120): flexiblas-3.0.4-8.el9.x86_64.rpm 385 kB/s | 32 kB 00:00 2024-03-04T06:30:31.497 INFO:teuthology.orchestra.run.smithi203.stdout:(37/120): flexiblas-openblas-openmp-3.0.4-8.el9 147 kB/s | 17 kB 00:00 2024-03-04T06:30:31.572 INFO:teuthology.orchestra.run.smithi203.stdout:(38/120): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-03-04T06:30:31.597 INFO:teuthology.orchestra.run.smithi203.stdout:(39/120): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 159 kB 00:00 2024-03-04T06:30:31.623 INFO:teuthology.orchestra.run.smithi203.stdout:(40/120): librabbitmq-0.11.0-7.el9.x86_64.rpm 885 kB/s | 44 kB 00:00 2024-03-04T06:30:31.656 INFO:teuthology.orchestra.run.smithi203.stdout:(41/120): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-04T06:30:31.681 INFO:teuthology.orchestra.run.smithi203.stdout:(42/120): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-03-04T06:30:31.707 INFO:teuthology.orchestra.run.smithi203.stdout:(43/120): openblas-0.3.21-2.el9.x86_64.rpm 690 kB/s | 34 kB 00:00 2024-03-04T06:30:31.849 INFO:teuthology.orchestra.run.smithi203.stdout:(44/120): openblas-openmp-0.3.21-2.el9.x86_64.r 28 MB/s | 4.7 MB 00:00 2024-03-04T06:30:31.874 INFO:teuthology.orchestra.run.smithi203.stdout:(45/120): python3-attrs-20.3.0-7.el9.noarch.rpm 470 kB/s | 78 kB 00:00 2024-03-04T06:30:32.016 INFO:teuthology.orchestra.run.smithi203.stdout:(46/120): python3-babel-2.9.1-2.el9.noarch.rpm 35 MB/s | 5.8 MB 00:00 2024-03-04T06:30:32.050 INFO:teuthology.orchestra.run.smithi203.stdout:(47/120): python3-iniconfig-1.1.1-7.el9.noarch. 95 kB/s | 16 kB 00:00 2024-03-04T06:30:32.075 INFO:teuthology.orchestra.run.smithi203.stdout:(48/120): python3-jinja2-2.11.3-5.el9.noarch.rp 3.8 MB/s | 227 kB 00:00 2024-03-04T06:30:32.100 INFO:teuthology.orchestra.run.smithi203.stdout:(49/120): python3-jsonpatch-1.21-16.el9.noarch. 490 kB/s | 24 kB 00:00 2024-03-04T06:30:32.126 INFO:teuthology.orchestra.run.smithi203.stdout:(50/120): python3-jsonpointer-2.0-4.el9.noarch. 361 kB/s | 18 kB 00:00 2024-03-04T06:30:32.151 INFO:teuthology.orchestra.run.smithi203.stdout:(51/120): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-04T06:30:32.176 INFO:teuthology.orchestra.run.smithi203.stdout:(52/120): python3-markupsafe-1.1.1-12.el9.x86_6 633 kB/s | 32 kB 00:00 2024-03-04T06:30:32.268 INFO:teuthology.orchestra.run.smithi203.stdout:(53/120): ceph-mgr-diskprediction-local-18.2.1- 5.2 MB/s | 7.4 MB 00:01 2024-03-04T06:30:32.335 INFO:teuthology.orchestra.run.smithi203.stdout:(54/120): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2024-03-04T06:30:32.360 INFO:teuthology.orchestra.run.smithi203.stdout:(55/120): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-03-04T06:30:32.386 INFO:teuthology.orchestra.run.smithi203.stdout:(56/120): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 174 kB 00:00 2024-03-04T06:30:32.411 INFO:teuthology.orchestra.run.smithi203.stdout:(57/120): python3-packaging-20.9-5.el9.noarch.r 1.4 MB/s | 69 kB 00:00 2024-03-04T06:30:32.436 INFO:teuthology.orchestra.run.smithi203.stdout:(58/120): python3-pluggy-0.13.1-7.el9.noarch.rp 504 kB/s | 38 kB 00:00 2024-03-04T06:30:32.461 INFO:teuthology.orchestra.run.smithi203.stdout:(59/120): python3-prettytable-0.7.2-27.el9.noar 548 kB/s | 41 kB 00:00 2024-03-04T06:30:32.503 INFO:teuthology.orchestra.run.smithi203.stdout:(60/120): python3-py-1.10.0-6.el9.noarch.rpm 6.3 MB/s | 427 kB 00:00 2024-03-04T06:30:32.528 INFO:teuthology.orchestra.run.smithi203.stdout:(61/120): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 132 kB 00:00 2024-03-04T06:30:32.554 INFO:teuthology.orchestra.run.smithi203.stdout:(62/120): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 211 kB 00:00 2024-03-04T06:30:32.579 INFO:teuthology.orchestra.run.smithi203.stdout:(63/120): python3-pytest-6.2.2-6.el9.noarch.rpm 6.2 MB/s | 474 kB 00:00 2024-03-04T06:30:32.613 INFO:teuthology.orchestra.run.smithi203.stdout:(64/120): python3-pytz-2021.1-5.el9.noarch.rpm 821 kB/s | 47 kB 00:00 2024-03-04T06:30:32.638 INFO:teuthology.orchestra.run.smithi203.stdout:(65/120): python3-requests-oauthlib-1.3.0-12.el 517 kB/s | 43 kB 00:00 2024-03-04T06:30:32.938 INFO:teuthology.orchestra.run.smithi203.stdout:(66/120): python3-toml-0.10.2-6.el9.noarch.rpm 119 kB/s | 39 kB 00:00 2024-03-04T06:30:32.963 INFO:teuthology.orchestra.run.smithi203.stdout:(67/120): socat-1.7.4.1-5.el9.x86_64.rpm 930 kB/s | 300 kB 00:00 2024-03-04T06:30:33.164 INFO:teuthology.orchestra.run.smithi203.stdout:(68/120): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-03-04T06:30:33.189 INFO:teuthology.orchestra.run.smithi203.stdout:(69/120): xmlstarlet-1.6.1-20.el9.x86_64.rpm 250 kB/s | 63 kB 00:00 2024-03-04T06:30:33.214 INFO:teuthology.orchestra.run.smithi203.stdout:(70/120): fuse-2.9.9-15.el9.x86_64.rpm 317 kB/s | 79 kB 00:00 2024-03-04T06:30:33.239 INFO:teuthology.orchestra.run.smithi203.stdout:(71/120): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2024-03-04T06:30:33.264 INFO:teuthology.orchestra.run.smithi203.stdout:(72/120): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 194 kB 00:00 2024-03-04T06:30:33.298 INFO:teuthology.orchestra.run.smithi203.stdout:(73/120): libgfortran-11.4.1-3.el9.x86_64.rpm 9.4 MB/s | 802 kB 00:00 2024-03-04T06:30:33.323 INFO:teuthology.orchestra.run.smithi203.stdout:(74/120): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.5 MB/s | 217 kB 00:00 2024-03-04T06:30:33.348 INFO:teuthology.orchestra.run.smithi203.stdout:(75/120): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2024-03-04T06:30:33.374 INFO:teuthology.orchestra.run.smithi203.stdout:(76/120): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2024-03-04T06:30:33.408 INFO:teuthology.orchestra.run.smithi203.stdout:(77/120): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-04T06:30:33.433 INFO:teuthology.orchestra.run.smithi203.stdout:(78/120): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2024-03-04T06:30:33.458 INFO:teuthology.orchestra.run.smithi203.stdout:(79/120): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 113 kB 00:00 2024-03-04T06:30:33.483 INFO:teuthology.orchestra.run.smithi203.stdout:(80/120): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-03-04T06:30:33.717 INFO:teuthology.orchestra.run.smithi203.stdout:(81/120): python3-devel-3.9.17-2.el9.x86_64.rpm 867 kB/s | 245 kB 00:00 2024-03-04T06:30:33.742 INFO:teuthology.orchestra.run.smithi203.stdout:(82/120): fmt-8.1.1-5.el9.x86_64.rpm 391 kB/s | 111 kB 00:00 2024-03-04T06:30:33.801 INFO:teuthology.orchestra.run.smithi203.stdout:(83/120): libarrow-doc-9.0.0-10.el9.noarch.rpm 445 kB/s | 26 kB 00:00 2024-03-04T06:30:33.851 INFO:teuthology.orchestra.run.smithi203.stdout:(84/120): gperftools-libs-2.9.1-2.el9.x86_64.rp 840 kB/s | 309 kB 00:00 2024-03-04T06:30:33.876 INFO:teuthology.orchestra.run.smithi203.stdout:(85/120): liboath-2.6.7-2.el9.x86_64.rpm 646 kB/s | 49 kB 00:00 2024-03-04T06:30:33.918 INFO:teuthology.orchestra.run.smithi203.stdout:(86/120): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-03-04T06:30:34.043 INFO:teuthology.orchestra.run.smithi203.stdout:(87/120): python3-asyncssh-2.13.2-4.el9.noarch. 4.3 MB/s | 548 kB 00:00 2024-03-04T06:30:34.077 INFO:teuthology.orchestra.run.smithi203.stdout:(88/120): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.1 MB/s | 838 kB 00:00 2024-03-04T06:30:34.102 INFO:teuthology.orchestra.run.smithi203.stdout:(89/120): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 744 kB/s | 43 kB 00:00 2024-03-04T06:30:34.136 INFO:teuthology.orchestra.run.smithi203.stdout:(90/120): python3-cachetools-4.2.4-1.el9.noarch 552 kB/s | 32 kB 00:00 2024-03-04T06:30:34.161 INFO:teuthology.orchestra.run.smithi203.stdout:(91/120): python3-certifi-2021.10.8-2.el9.noarc 256 kB/s | 15 kB 00:00 2024-03-04T06:30:34.211 INFO:teuthology.orchestra.run.smithi203.stdout:(92/120): python3-cheroot-8.6.0-4.el9.noarch.rp 2.2 MB/s | 172 kB 00:00 2024-03-04T06:30:34.279 INFO:teuthology.orchestra.run.smithi203.stdout:(93/120): libarrow-9.0.0-10.el9.x86_64.rpm 7.9 MB/s | 4.4 MB 00:00 2024-03-04T06:30:34.303 INFO:teuthology.orchestra.run.smithi203.stdout:(94/120): python3-google-auth-2.28.0-1.el9.noar 2.2 MB/s | 203 kB 00:00 2024-03-04T06:30:34.329 INFO:teuthology.orchestra.run.smithi203.stdout:(95/120): python3-cherrypy-18.6.1-2.el9.noarch. 2.1 MB/s | 358 kB 00:00 2024-03-04T06:30:34.354 INFO:teuthology.orchestra.run.smithi203.stdout:(96/120): python3-jaraco-8.2.1-3.el9.noarch.rpm 142 kB/s | 11 kB 00:00 2024-03-04T06:30:34.379 INFO:teuthology.orchestra.run.smithi203.stdout:(97/120): python3-jaraco-classes-3.2.1-5.el9.no 234 kB/s | 18 kB 00:00 2024-03-04T06:30:34.405 INFO:teuthology.orchestra.run.smithi203.stdout:(98/120): python3-jaraco-collections-3.0.0-8.el 307 kB/s | 23 kB 00:00 2024-03-04T06:30:34.430 INFO:teuthology.orchestra.run.smithi203.stdout:(99/120): python3-jaraco-functools-3.5.0-2.el9. 258 kB/s | 19 kB 00:00 2024-03-04T06:30:34.455 INFO:teuthology.orchestra.run.smithi203.stdout:(100/120): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-03-04T06:30:34.489 INFO:teuthology.orchestra.run.smithi203.stdout:(101/120): python3-logutils-0.3.5-21.el9.noarch 790 kB/s | 46 kB 00:00 2024-03-04T06:30:34.522 INFO:teuthology.orchestra.run.smithi203.stdout:(102/120): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-03-04T06:30:34.548 INFO:teuthology.orchestra.run.smithi203.stdout:(103/120): python3-natsort-7.1.1-5.el9.noarch.r 987 kB/s | 58 kB 00:00 2024-03-04T06:30:34.573 INFO:teuthology.orchestra.run.smithi203.stdout:(104/120): python3-more-itertools-8.12.0-2.el9. 672 kB/s | 79 kB 00:00 2024-03-04T06:30:34.598 INFO:teuthology.orchestra.run.smithi203.stdout:(105/120): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-04T06:30:34.624 INFO:teuthology.orchestra.run.smithi203.stdout:(106/120): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-03-04T06:30:34.674 INFO:teuthology.orchestra.run.smithi203.stdout:(107/120): python3-pyOpenSSL-21.0.0-1.el9.noarc 894 kB/s | 90 kB 00:00 2024-03-04T06:30:34.691 INFO:teuthology.orchestra.run.smithi203.stdout:(108/120): python3-repoze-lru-0.7-16.el9.noarch 333 kB/s | 31 kB 00:00 2024-03-04T06:30:34.716 INFO:teuthology.orchestra.run.smithi203.stdout:(109/120): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-03-04T06:30:34.741 INFO:teuthology.orchestra.run.smithi203.stdout:(110/120): python3-rsa-4.9-2.el9.noarch.rpm 883 kB/s | 59 kB 00:00 2024-03-04T06:30:34.758 INFO:teuthology.orchestra.run.smithi203.stdout:(111/120): python3-tempora-5.0.0-2.el9.noarch.r 533 kB/s | 36 kB 00:00 2024-03-04T06:30:34.775 INFO:teuthology.orchestra.run.smithi203.stdout:(112/120): python3-typing-extensions-4.4.0-2.el 871 kB/s | 51 kB 00:00 2024-03-04T06:30:34.801 INFO:teuthology.orchestra.run.smithi203.stdout:(113/120): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-03-04T06:30:34.826 INFO:teuthology.orchestra.run.smithi203.stdout:(114/120): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-03-04T06:30:34.851 INFO:teuthology.orchestra.run.smithi203.stdout:(115/120): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-03-04T06:30:34.868 INFO:teuthology.orchestra.run.smithi203.stdout:(116/120): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-03-04T06:30:34.893 INFO:teuthology.orchestra.run.smithi203.stdout:(117/120): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-03-04T06:30:34.969 INFO:teuthology.orchestra.run.smithi203.stdout:(118/120): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-03-04T06:30:35.344 INFO:teuthology.orchestra.run.smithi203.stdout:(119/120): librados2-18.2.1-696.g5cc7a767.el9.x 6.9 MB/s | 3.3 MB 00:00 2024-03-04T06:30:35.561 INFO:teuthology.orchestra.run.smithi203.stdout:(120/120): librbd1-18.2.1-696.g5cc7a767.el9.x86 4.5 MB/s | 3.0 MB 00:00 2024-03-04T06:30:35.568 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-03-04T06:30:35.568 INFO:teuthology.orchestra.run.smithi203.stdout:Total 14 MB/s | 177 MB 00:12 2024-03-04T06:30:35.589 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-03-04T06:30:35.688 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-03-04T06:30:35.689 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-03-04T06:30:37.185 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-03-04T06:30:37.185 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-03-04T06:30:41.850 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-03-04T06:30:41.938 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/122 2024-03-04T06:30:41.963 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/122 2024-03-04T06:30:42.017 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/122 2024-03-04T06:30:42.385 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/122 2024-03-04T06:30:42.414 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librados2-2:18.2.1-696.g5cc7a767.el9.x86_64 5/122 2024-03-04T06:30:42.529 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:18.2.1-696.g5cc7a767.el9.x86_64 5/122 2024-03-04T06:30:42.557 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs2-2:18.2.1-696.g5cc7a767.el9.x86_64 6/122 2024-03-04T06:30:42.652 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephfs2-2:18.2.1-696.g5cc7a767.el9.x86_64 6/122 2024-03-04T06:30:42.698 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rados-2:18.2.1-696.g5cc7a767.el9.x86_64 7/122 2024-03-04T06:30:42.728 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/122 2024-03-04T06:30:42.764 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/122 2024-03-04T06:30:42.792 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephsqlite-2:18.2.1-696.g5cc7a767.el9.x86_64 10/122 2024-03-04T06:30:42.903 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephsqlite-2:18.2.1-696.g5cc7a767.el9.x86_64 10/122 2024-03-04T06:30:42.919 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libradosstriper1-2:18.2.1-696.g5cc7a767.el9.x86_ 11/122 2024-03-04T06:30:43.029 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libradosstriper1-2:18.2.1-696.g5cc7a767.el9.x86_ 11/122 2024-03-04T06:30:43.073 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 12/122 2024-03-04T06:30:43.142 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : liboath-2.6.7-2.el9.x86_64 13/122 2024-03-04T06:30:43.195 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 14/122 2024-03-04T06:30:43.234 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 15/122 2024-03-04T06:30:43.278 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 16/122 2024-03-04T06:30:43.316 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 17/122 2024-03-04T06:30:43.346 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 18/122 2024-03-04T06:30:43.394 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 19/122 2024-03-04T06:30:43.460 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/122 2024-03-04T06:30:43.494 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/122 2024-03-04T06:30:43.521 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/122 2024-03-04T06:30:43.550 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/122 2024-03-04T06:30:43.593 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-argparse-2:18.2.1-696.g5cc7a767.el9 24/122 2024-03-04T06:30:43.668 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cephfs-2:18.2.1-696.g5cc7a767.el9.x86_64 25/122 2024-03-04T06:30:43.805 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/122 2024-03-04T06:30:43.855 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/122 2024-03-04T06:30:44.387 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/122 2024-03-04T06:30:44.466 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/122 2024-03-04T06:30:44.505 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/122 2024-03-04T06:30:44.539 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 31/122 2024-03-04T06:30:44.573 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 32/122 2024-03-04T06:30:44.614 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 33/122 2024-03-04T06:30:44.657 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librados-devel-2:18.2.1-696.g5cc7a767.el9.x86_64 34/122 2024-03-04T06:30:44.688 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 35/122 2024-03-04T06:30:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 36/122 2024-03-04T06:30:44.829 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/122 2024-03-04T06:30:44.867 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 38/122 2024-03-04T06:30:44.923 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/122 2024-03-04T06:30:45.005 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/122 2024-03-04T06:30:45.035 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/122 2024-03-04T06:30:45.063 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/122 2024-03-04T06:30:45.110 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/122 2024-03-04T06:30:45.155 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/122 2024-03-04T06:30:45.197 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/122 2024-03-04T06:30:45.333 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/122 2024-03-04T06:30:45.383 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/122 2024-03-04T06:30:45.449 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/122 2024-03-04T06:30:45.545 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/122 2024-03-04T06:30:45.574 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 50/122 2024-03-04T06:30:45.615 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/122 2024-03-04T06:30:45.648 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/122 2024-03-04T06:30:45.675 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 53/122 2024-03-04T06:30:45.777 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/122 2024-03-04T06:30:45.825 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 55/122 2024-03-04T06:30:45.873 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ply-3.11-14.el9.noarch 56/122 2024-03-04T06:30:45.891 INFO:teuthology.orchestra.run.smithi137.stdout:(120/120): ceph-test-18.2.1-696.g5cc7a767.el9.x 1.7 MB/s | 40 MB 00:22 2024-03-04T06:30:45.895 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-03-04T06:30:45.895 INFO:teuthology.orchestra.run.smithi137.stdout:Total 6.4 MB/s | 177 MB 00:27 2024-03-04T06:30:45.917 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-03-04T06:30:45.930 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 57/122 2024-03-04T06:30:46.016 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-03-04T06:30:46.016 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-03-04T06:30:46.124 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 58/122 2024-03-04T06:30:46.171 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 59/122 2024-03-04T06:30:46.249 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 60/122 2024-03-04T06:30:46.339 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 61/122 2024-03-04T06:30:46.480 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 62/122 2024-03-04T06:30:46.522 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 63/122 2024-03-04T06:30:46.554 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 64/122 2024-03-04T06:30:46.587 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 65/122 2024-03-04T06:30:46.622 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : jq-1.6-16.el9.x86_64 66/122 2024-03-04T06:30:46.655 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : fuse-2.9.9-15.el9.x86_64 67/122 2024-03-04T06:30:46.700 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/122 2024-03-04T06:30:46.822 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 69/122 2024-03-04T06:30:46.859 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-py-1.10.0-6.el9.noarch 70/122 2024-03-04T06:30:46.898 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 71/122 2024-03-04T06:30:46.940 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 72/122 2024-03-04T06:30:47.038 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-packaging-20.9-5.el9.noarch 73/122 2024-03-04T06:30:47.094 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 74/122 2024-03-04T06:30:47.498 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-03-04T06:30:47.498 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-03-04T06:30:47.838 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/122 2024-03-04T06:30:47.900 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 76/122 2024-03-04T06:30:47.934 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 77/122 2024-03-04T06:30:47.976 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 78/122 2024-03-04T06:30:48.025 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 79/122 2024-03-04T06:30:48.059 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 80/122 2024-03-04T06:30:48.238 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-0.3.21-2.el9.x86_64 81/122 2024-03-04T06:30:48.266 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 82/122 2024-03-04T06:30:48.345 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/122 2024-03-04T06:30:49.004 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/122 2024-03-04T06:30:49.108 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/122 2024-03-04T06:30:50.385 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/122 2024-03-04T06:30:50.474 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/122 2024-03-04T06:30:50.777 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 88/122 2024-03-04T06:30:50.803 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librbd1-2:18.2.1-696.g5cc7a767.el9.x86_64 89/122 2024-03-04T06:30:50.877 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:18.2.1-696.g5cc7a767.el9.x86_64 89/122 2024-03-04T06:30:50.908 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rbd-2:18.2.1-696.g5cc7a767.el9.x86_64 90/122 2024-03-04T06:30:50.947 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 91/122 2024-03-04T06:30:51.344 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 92/122 2024-03-04T06:30:51.373 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librgw2-2:18.2.1-696.g5cc7a767.el9.x86_64 93/122 2024-03-04T06:30:51.445 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librgw2-2:18.2.1-696.g5cc7a767.el9.x86_64 93/122 2024-03-04T06:30:51.474 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rgw-2:18.2.1-696.g5cc7a767.el9.x86_64 94/122 2024-03-04T06:30:51.814 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephadm-2:18.2.1-696.g5cc7a767.el9.noarch 95/122 2024-03-04T06:30:51.838 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephadm-2:18.2.1-696.g5cc7a767.el9.noarch 95/122 2024-03-04T06:30:51.868 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-696.g5cc7a767.el 96/122 2024-03-04T06:30:51.944 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-696.g5cc7a767.e 97/122 2024-03-04T06:30:51.972 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-common-2:18.2.1-696.g5cc7a767.el9.x 98/122 2024-03-04T06:30:52.215 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-03-04T06:30:52.303 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/122 2024-03-04T06:30:52.410 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/122 2024-03-04T06:30:52.462 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/122 2024-03-04T06:30:52.781 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/122 2024-03-04T06:30:52.844 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:18.2.1-696.g5cc7a767.el9.x86_64 5/122 2024-03-04T06:30:52.960 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:18.2.1-696.g5cc7a767.el9.x86_64 5/122 2024-03-04T06:30:52.986 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:18.2.1-696.g5cc7a767.el9.x86_64 6/122 2024-03-04T06:30:53.061 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:18.2.1-696.g5cc7a767.el9.x86_64 6/122 2024-03-04T06:30:53.119 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:18.2.1-696.g5cc7a767.el9.x86_64 7/122 2024-03-04T06:30:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/122 2024-03-04T06:30:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/122 2024-03-04T06:30:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephsqlite-2:18.2.1-696.g5cc7a767.el9.x86_64 10/122 2024-03-04T06:30:53.324 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephsqlite-2:18.2.1-696.g5cc7a767.el9.x86_64 10/122 2024-03-04T06:30:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:18.2.1-696.g5cc7a767.el9.x86_ 11/122 2024-03-04T06:30:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:18.2.1-696.g5cc7a767.el9.x86_ 11/122 2024-03-04T06:30:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 12/122 2024-03-04T06:30:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.7-2.el9.x86_64 13/122 2024-03-04T06:30:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 14/122 2024-03-04T06:30:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 15/122 2024-03-04T06:30:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 16/122 2024-03-04T06:30:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 17/122 2024-03-04T06:30:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 18/122 2024-03-04T06:30:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 19/122 2024-03-04T06:30:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/122 2024-03-04T06:30:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/122 2024-03-04T06:30:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/122 2024-03-04T06:30:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/122 2024-03-04T06:30:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:18.2.1-696.g5cc7a767.el9 24/122 2024-03-04T06:30:54.086 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:18.2.1-696.g5cc7a767.el9.x86_64 25/122 2024-03-04T06:30:54.160 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:18.2.1-696.g5cc7a767.el9.x86_64 99/122 2024-03-04T06:30:54.194 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-common-2:18.2.1-696.g5cc7a767.el9.x86_64 99/122 2024-03-04T06:30:54.220 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/122 2024-03-04T06:30:54.274 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/122 2024-03-04T06:30:54.732 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:18.2.1-696.g5cc7a767.el9.x86_64 99/122 2024-03-04T06:30:54.765 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-base-2:18.2.1-696.g5cc7a767.el9.x86_64 100/122 2024-03-04T06:30:54.796 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/122 2024-03-04T06:30:54.854 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-base-2:18.2.1-696.g5cc7a767.el9.x86_64 100/122 2024-03-04T06:30:54.854 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-04T06:30:54.854 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-04T06:30:54.854 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:30:54.872 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/122 2024-03-04T06:30:54.900 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-selinux-2:18.2.1-696.g5cc7a767.el9.x86_64 101/122 2024-03-04T06:30:54.911 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/122 2024-03-04T06:30:54.946 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 31/122 2024-03-04T06:30:54.981 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 32/122 2024-03-04T06:30:55.013 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 33/122 2024-03-04T06:30:55.043 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:18.2.1-696.g5cc7a767.el9.x86_64 34/122 2024-03-04T06:30:55.073 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 35/122 2024-03-04T06:30:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 36/122 2024-03-04T06:30:55.214 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/122 2024-03-04T06:30:55.252 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 38/122 2024-03-04T06:30:55.307 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/122 2024-03-04T06:30:55.380 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/122 2024-03-04T06:30:55.411 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/122 2024-03-04T06:30:55.447 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/122 2024-03-04T06:30:55.486 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/122 2024-03-04T06:30:55.531 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/122 2024-03-04T06:30:55.573 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/122 2024-03-04T06:30:55.707 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/122 2024-03-04T06:30:55.742 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/122 2024-03-04T06:30:55.783 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/122 2024-03-04T06:30:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/122 2024-03-04T06:30:55.918 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 50/122 2024-03-04T06:30:55.959 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/122 2024-03-04T06:30:55.991 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/122 2024-03-04T06:30:56.018 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 53/122 2024-03-04T06:30:56.110 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/122 2024-03-04T06:30:56.152 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 55/122 2024-03-04T06:30:56.201 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ply-3.11-14.el9.noarch 56/122 2024-03-04T06:30:56.256 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 57/122 2024-03-04T06:30:56.452 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 58/122 2024-03-04T06:30:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 59/122 2024-03-04T06:30:56.567 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 60/122 2024-03-04T06:30:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 61/122 2024-03-04T06:30:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 62/122 2024-03-04T06:30:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 63/122 2024-03-04T06:30:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 64/122 2024-03-04T06:30:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 65/122 2024-03-04T06:30:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : jq-1.6-16.el9.x86_64 66/122 2024-03-04T06:30:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.9-15.el9.x86_64 67/122 2024-03-04T06:30:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/122 2024-03-04T06:30:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 69/122 2024-03-04T06:30:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-py-1.10.0-6.el9.noarch 70/122 2024-03-04T06:30:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 71/122 2024-03-04T06:30:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 72/122 2024-03-04T06:30:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-packaging-20.9-5.el9.noarch 73/122 2024-03-04T06:30:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 74/122 2024-03-04T06:30:58.128 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/122 2024-03-04T06:30:58.174 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 76/122 2024-03-04T06:30:58.208 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 77/122 2024-03-04T06:30:58.241 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 78/122 2024-03-04T06:30:58.281 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 79/122 2024-03-04T06:30:58.308 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 80/122 2024-03-04T06:30:58.477 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-0.3.21-2.el9.x86_64 81/122 2024-03-04T06:30:58.507 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 82/122 2024-03-04T06:30:58.584 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/122 2024-03-04T06:30:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/122 2024-03-04T06:30:59.362 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/122 2024-03-04T06:31:00.612 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/122 2024-03-04T06:31:00.697 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/122 2024-03-04T06:31:00.999 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 88/122 2024-03-04T06:31:01.026 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:18.2.1-696.g5cc7a767.el9.x86_64 89/122 2024-03-04T06:31:01.115 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:18.2.1-696.g5cc7a767.el9.x86_64 89/122 2024-03-04T06:31:01.139 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:18.2.1-696.g5cc7a767.el9.x86_64 90/122 2024-03-04T06:31:01.175 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 91/122 2024-03-04T06:31:01.574 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 92/122 2024-03-04T06:31:01.604 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:18.2.1-696.g5cc7a767.el9.x86_64 93/122 2024-03-04T06:31:01.658 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:18.2.1-696.g5cc7a767.el9.x86_64 93/122 2024-03-04T06:31:01.680 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:18.2.1-696.g5cc7a767.el9.x86_64 94/122 2024-03-04T06:31:02.129 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:18.2.1-696.g5cc7a767.el9.noarch 95/122 2024-03-04T06:31:02.152 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephadm-2:18.2.1-696.g5cc7a767.el9.noarch 95/122 2024-03-04T06:31:02.182 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-696.g5cc7a767.el 96/122 2024-03-04T06:31:02.256 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-696.g5cc7a767.e 97/122 2024-03-04T06:31:02.285 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:18.2.1-696.g5cc7a767.el9.x 98/122 2024-03-04T06:31:04.353 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:18.2.1-696.g5cc7a767.el9.x86_64 99/122 2024-03-04T06:31:04.391 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:18.2.1-696.g5cc7a767.el9.x86_64 99/122 2024-03-04T06:31:04.931 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:18.2.1-696.g5cc7a767.el9.x86_64 99/122 2024-03-04T06:31:04.969 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:18.2.1-696.g5cc7a767.el9.x86_64 100/122 2024-03-04T06:31:05.062 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:18.2.1-696.g5cc7a767.el9.x86_64 100/122 2024-03-04T06:31:05.063 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-04T06:31:05.063 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-04T06:31:05.063 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:31:05.095 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:18.2.1-696.g5cc7a767.el9.x86_64 101/122 2024-03-04T06:31:06.583 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-selinux-2:18.2.1-696.g5cc7a767.el9.x86_64 101/122 2024-03-04T06:31:06.583 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /sys 2024-03-04T06:31:06.583 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /proc 2024-03-04T06:31:06.583 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /mnt 2024-03-04T06:31:06.583 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /var/tmp 2024-03-04T06:31:06.584 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /home 2024-03-04T06:31:06.584 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /root 2024-03-04T06:31:06.584 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /tmp 2024-03-04T06:31:06.584 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:31:06.666 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-696.g5cc7a767.el9.noar 102/122 2024-03-04T06:31:06.892 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-696.g5cc7a767.el9.noar 102/122 2024-03-04T06:31:06.926 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-696.g5cc7a767.el9.no 103/122 2024-03-04T06:31:07.893 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-696.g5cc7a767.el9.no 103/122 2024-03-04T06:31:07.920 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-696.g5cc7 104/122 2024-03-04T06:31:08.019 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-696.g5cc7 104/122 2024-03-04T06:31:08.177 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-696.g5cc7a767.el9 105/122 2024-03-04T06:31:08.197 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-2:18.2.1-696.g5cc7a767.el9.x86_64 106/122 2024-03-04T06:31:08.220 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-2:18.2.1-696.g5cc7a767.el9.x86_64 106/122 2024-03-04T06:31:08.220 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:08.220 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-04T06:31:08.220 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T06:31:08.220 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T06:31:08.220 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:31:08.265 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-rook-2:18.2.1-696.g5cc7a767.el9.noarch 107/122 2024-03-04T06:31:08.453 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-696.g5cc7a767.el9.noarch 107/122 2024-03-04T06:31:08.482 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mds-2:18.2.1-696.g5cc7a767.el9.x86_64 108/122 2024-03-04T06:31:08.504 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mds-2:18.2.1-696.g5cc7a767.el9.x86_64 108/122 2024-03-04T06:31:08.504 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:08.504 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-04T06:31:08.504 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T06:31:08.504 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T06:31:08.504 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:31:08.949 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mon-2:18.2.1-696.g5cc7a767.el9.x86_64 109/122 2024-03-04T06:31:08.971 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mon-2:18.2.1-696.g5cc7a767.el9.x86_64 109/122 2024-03-04T06:31:08.972 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:08.972 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-04T06:31:08.972 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T06:31:08.972 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T06:31:08.972 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:31:10.467 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-osd-2:18.2.1-696.g5cc7a767.el9.x86_64 110/122 2024-03-04T06:31:10.492 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-osd-2:18.2.1-696.g5cc7a767.el9.x86_64 110/122 2024-03-04T06:31:10.492 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:10.492 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-04T06:31:10.492 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T06:31:10.492 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T06:31:10.492 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:31:11.215 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-2:18.2.1-696.g5cc7a767.el9.x86_64 111/122 2024-03-04T06:31:11.244 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-radosgw-2:18.2.1-696.g5cc7a767.el9.x86_64 112/122 2024-03-04T06:31:11.266 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-696.g5cc7a767.el9.x86_64 112/122 2024-03-04T06:31:11.266 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:11.267 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-04T06:31:11.267 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T06:31:11.267 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T06:31:11.267 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:31:11.319 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-696.g5cc7a7 113/122 2024-03-04T06:31:11.341 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-696.g5cc7a7 113/122 2024-03-04T06:31:11.341 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:11.341 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-04T06:31:11.342 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:31:11.637 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-mirror-2:18.2.1-696.g5cc7a767.el9.x86_64 114/122 2024-03-04T06:31:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-mirror-2:18.2.1-696.g5cc7a767.el9.x86_64 114/122 2024-03-04T06:31:11.659 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:11.659 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-04T06:31:11.659 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T06:31:11.659 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T06:31:11.659 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:31:15.324 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-test-2:18.2.1-696.g5cc7a767.el9.x86_64 115/122 2024-03-04T06:31:15.365 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-fuse-2:18.2.1-696.g5cc7a767.el9.x86_64 116/122 2024-03-04T06:31:15.482 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-nbd-2:18.2.1-696.g5cc7a767.el9.x86_64 117/122 2024-03-04T06:31:15.588 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pytest-6.2.2-6.el9.noarch 118/122 2024-03-04T06:31:15.623 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-fuse-2:18.2.1-696.g5cc7a767.el9.x86_64 119/122 2024-03-04T06:31:15.654 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs-devel-2:18.2.1-696.g5cc7a767.el9.x86_6 120/122 2024-03-04T06:31:15.655 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 121/122 2024-03-04T06:31:15.738 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 121/122 2024-03-04T06:31:15.738 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 122/122 2024-03-04T06:31:16.574 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:18.2.1-696.g5cc7a767.el9.x86_64 101/122 2024-03-04T06:31:16.574 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2024-03-04T06:31:16.575 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2024-03-04T06:31:16.575 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2024-03-04T06:31:16.575 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2024-03-04T06:31:16.575 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2024-03-04T06:31:16.575 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /root 2024-03-04T06:31:16.575 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2024-03-04T06:31:16.575 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:31:16.655 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-696.g5cc7a767.el9.noar 102/122 2024-03-04T06:31:16.882 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-696.g5cc7a767.el9.noar 102/122 2024-03-04T06:31:16.914 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-696.g5cc7a767.el9.no 103/122 2024-03-04T06:31:17.917 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-696.g5cc7a767.el9.no 103/122 2024-03-04T06:31:17.958 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-696.g5cc7 104/122 2024-03-04T06:31:18.057 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-696.g5cc7 104/122 2024-03-04T06:31:18.215 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-696.g5cc7a767.el9 105/122 2024-03-04T06:31:18.244 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:18.2.1-696.g5cc7a767.el9.x86_64 106/122 2024-03-04T06:31:18.266 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:18.2.1-696.g5cc7a767.el9.x86_64 106/122 2024-03-04T06:31:18.266 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:18.266 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-04T06:31:18.266 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T06:31:18.266 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T06:31:18.266 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:31:18.311 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-rook-2:18.2.1-696.g5cc7a767.el9.noarch 107/122 2024-03-04T06:31:18.499 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-696.g5cc7a767.el9.noarch 107/122 2024-03-04T06:31:18.528 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:18.2.1-696.g5cc7a767.el9.x86_64 108/122 2024-03-04T06:31:18.550 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:18.2.1-696.g5cc7a767.el9.x86_64 108/122 2024-03-04T06:31:18.550 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:18.550 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-04T06:31:18.550 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T06:31:18.550 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T06:31:18.550 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:31:18.996 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:18.2.1-696.g5cc7a767.el9.x86_64 109/122 2024-03-04T06:31:19.018 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:18.2.1-696.g5cc7a767.el9.x86_64 109/122 2024-03-04T06:31:19.018 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:19.018 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-04T06:31:19.018 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T06:31:19.018 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T06:31:19.019 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:31:20.074 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 122/122 2024-03-04T06:31:20.074 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-2:18.2.1-696.g5cc7a767.el9.x86_64 1/122 2024-03-04T06:31:20.074 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-base-2:18.2.1-696.g5cc7a767.el9.x86_64 2/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-common-2:18.2.1-696.g5cc7a767.el9.x86_64 3/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-fuse-2:18.2.1-696.g5cc7a767.el9.x86_64 4/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-696.g5cc7a7 5/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mds-2:18.2.1-696.g5cc7a767.el9.x86_64 6/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-2:18.2.1-696.g5cc7a767.el9.x86_64 7/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mon-2:18.2.1-696.g5cc7a767.el9.x86_64 8/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-osd-2:18.2.1-696.g5cc7a767.el9.x86_64 9/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-radosgw-2:18.2.1-696.g5cc7a767.el9.x86_64 10/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-selinux-2:18.2.1-696.g5cc7a767.el9.x86_64 11/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-test-2:18.2.1-696.g5cc7a767.el9.x86_64 12/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs-devel-2:18.2.1-696.g5cc7a767.el9.x86_6 13/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs2-2:18.2.1-696.g5cc7a767.el9.x86_64 14/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephsqlite-2:18.2.1-696.g5cc7a767.el9.x86_64 15/122 2024-03-04T06:31:20.075 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados-devel-2:18.2.1-696.g5cc7a767.el9.x86_64 16/122 2024-03-04T06:31:20.076 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libradosstriper1-2:18.2.1-696.g5cc7a767.el9.x86_ 17/122 2024-03-04T06:31:20.076 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librgw2-2:18.2.1-696.g5cc7a767.el9.x86_64 18/122 2024-03-04T06:31:20.076 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-argparse-2:18.2.1-696.g5cc7a767.el9 19/122 2024-03-04T06:31:20.076 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-common-2:18.2.1-696.g5cc7a767.el9.x 20/122 2024-03-04T06:31:20.076 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cephfs-2:18.2.1-696.g5cc7a767.el9.x86_64 21/122 2024-03-04T06:31:20.076 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rados-2:18.2.1-696.g5cc7a767.el9.x86_64 22/122 2024-03-04T06:31:20.076 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rbd-2:18.2.1-696.g5cc7a767.el9.x86_64 23/122 2024-03-04T06:31:20.076 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rgw-2:18.2.1-696.g5cc7a767.el9.x86_64 24/122 2024-03-04T06:31:20.076 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-fuse-2:18.2.1-696.g5cc7a767.el9.x86_64 25/122 2024-03-04T06:31:20.076 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-mirror-2:18.2.1-696.g5cc7a767.el9.x86_64 26/122 2024-03-04T06:31:20.076 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-nbd-2:18.2.1-696.g5cc7a767.el9.x86_64 27/122 2024-03-04T06:31:20.085 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-696.g5cc7a767.e 28/122 2024-03-04T06:31:20.085 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-696.g5cc7a767.el9.noar 29/122 2024-03-04T06:31:20.085 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-696.g5cc7a767.el9.no 30/122 2024-03-04T06:31:20.085 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-696.g5cc7 31/122 2024-03-04T06:31:20.085 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-696.g5cc7a767.el9 32/122 2024-03-04T06:31:20.086 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-rook-2:18.2.1-696.g5cc7a767.el9.noarch 33/122 2024-03-04T06:31:20.086 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-696.g5cc7a767.el 34/122 2024-03-04T06:31:20.086 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephadm-2:18.2.1-696.g5cc7a767.el9.noarch 35/122 2024-03-04T06:31:20.086 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 36/122 2024-03-04T06:31:20.086 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 37/122 2024-03-04T06:31:20.086 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 38/122 2024-03-04T06:31:20.086 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 39/122 2024-03-04T06:31:20.086 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 40/122 2024-03-04T06:31:20.086 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 41/122 2024-03-04T06:31:20.086 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 42/122 2024-03-04T06:31:20.086 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 43/122 2024-03-04T06:31:20.086 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 44/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 45/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 46/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 47/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 48/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 49/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 50/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 51/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 52/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 53/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 54/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 55/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 56/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 57/122 2024-03-04T06:31:20.087 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 58/122 2024-03-04T06:31:20.088 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 59/122 2024-03-04T06:31:20.088 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 60/122 2024-03-04T06:31:20.088 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 61/122 2024-03-04T06:31:20.088 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 62/122 2024-03-04T06:31:20.088 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pytest-6.2.2-6.el9.noarch 63/122 2024-03-04T06:31:20.088 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 64/122 2024-03-04T06:31:20.088 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 65/122 2024-03-04T06:31:20.088 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 66/122 2024-03-04T06:31:20.088 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 67/122 2024-03-04T06:31:20.088 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 68/122 2024-03-04T06:31:20.088 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 69/122 2024-03-04T06:31:20.088 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 70/122 2024-03-04T06:31:20.089 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : jq-1.6-16.el9.x86_64 71/122 2024-03-04T06:31:20.089 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 72/122 2024-03-04T06:31:20.089 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 73/122 2024-03-04T06:31:20.089 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 74/122 2024-03-04T06:31:20.089 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 75/122 2024-03-04T06:31:20.089 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 76/122 2024-03-04T06:31:20.089 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ply-3.11-14.el9.noarch 77/122 2024-03-04T06:31:20.089 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 78/122 2024-03-04T06:31:20.089 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 79/122 2024-03-04T06:31:20.089 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 80/122 2024-03-04T06:31:20.089 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 81/122 2024-03-04T06:31:20.089 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 82/122 2024-03-04T06:31:20.089 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 83/122 2024-03-04T06:31:20.090 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 84/122 2024-03-04T06:31:20.090 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 85/122 2024-03-04T06:31:20.090 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 86/122 2024-03-04T06:31:20.090 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 87/122 2024-03-04T06:31:20.090 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 88/122 2024-03-04T06:31:20.090 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 89/122 2024-03-04T06:31:20.090 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 90/122 2024-03-04T06:31:20.090 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 91/122 2024-03-04T06:31:20.090 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 92/122 2024-03-04T06:31:20.090 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 93/122 2024-03-04T06:31:20.090 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 94/122 2024-03-04T06:31:20.090 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 95/122 2024-03-04T06:31:20.090 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 96/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 97/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 98/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 99/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 100/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 101/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 102/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 103/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 104/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 105/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 106/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 107/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 108/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 109/122 2024-03-04T06:31:20.091 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 110/122 2024-03-04T06:31:20.092 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 111/122 2024-03-04T06:31:20.092 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 112/122 2024-03-04T06:31:20.092 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 113/122 2024-03-04T06:31:20.092 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 114/122 2024-03-04T06:31:20.092 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 115/122 2024-03-04T06:31:20.092 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 116/122 2024-03-04T06:31:20.092 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : re2-1:20211101-3.el9.x86_64 117/122 2024-03-04T06:31:20.092 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 118/122 2024-03-04T06:31:20.092 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:18.2.1-696.g5cc7a767.el9.x86_64 119/122 2024-03-04T06:31:20.092 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 120/122 2024-03-04T06:31:20.092 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:18.2.1-696.g5cc7a767.el9.x86_64 121/122 2024-03-04T06:31:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:18.2.1-696.g5cc7a767.el9.x86_64 110/122 2024-03-04T06:31:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:18.2.1-696.g5cc7a767.el9.x86_64 110/122 2024-03-04T06:31:20.546 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:20.546 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-04T06:31:20.546 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T06:31:20.546 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T06:31:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:31:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:18.2.1-696.g5cc7a767.el9.x86_64 111/122 2024-03-04T06:31:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:18.2.1-696.g5cc7a767.el9.x86_64 112/122 2024-03-04T06:31:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-696.g5cc7a767.el9.x86_64 112/122 2024-03-04T06:31:21.303 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:21.303 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-04T06:31:21.304 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T06:31:21.304 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T06:31:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:31:21.340 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-696.g5cc7a7 113/122 2024-03-04T06:31:21.362 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-696.g5cc7a7 113/122 2024-03-04T06:31:21.362 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:21.362 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-04T06:31:21.362 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:31:21.657 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:18.2.1-696.g5cc7a767.el9.x86_64 114/122 2024-03-04T06:31:21.679 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:18.2.1-696.g5cc7a767.el9.x86_64 114/122 2024-03-04T06:31:21.679 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T06:31:21.679 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-04T06:31:21.679 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T06:31:21.679 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T06:31:21.679 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:31:22.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 122/122 2024-03-04T06:31:22.051 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:31:22.051 INFO:teuthology.orchestra.run.smithi203.stdout:Upgraded: 2024-03-04T06:31:22.051 INFO:teuthology.orchestra.run.smithi203.stdout: librados2-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.051 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.051 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-03-04T06:31:22.051 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-04T06:31:22.051 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.052 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.053 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:22.053 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.053 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.053 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.053 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:22.053 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-04T06:31:22.053 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-04T06:31:22.053 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-04T06:31:22.053 INFO:teuthology.orchestra.run.smithi203.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-04T06:31:22.053 INFO:teuthology.orchestra.run.smithi203.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-04T06:31:22.053 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-04T06:31:22.053 INFO:teuthology.orchestra.run.smithi203.stdout: jq-1.6-16.el9.x86_64 2024-03-04T06:31:22.053 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-04T06:31:22.054 INFO:teuthology.orchestra.run.smithi203.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-04T06:31:22.055 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-04T06:31:22.056 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pluggy-0.13.1-7.el9.noarch 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply-3.11-14.el9.noarch 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-py-1.10.0-6.el9.noarch 2024-03-04T06:31:22.057 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-04T06:31:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-04T06:31:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-04T06:31:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-04T06:31:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytest-6.2.2-6.el9.noarch 2024-03-04T06:31:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-04T06:31:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-04T06:31:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-04T06:31:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-04T06:31:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-04T06:31:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: re2-1:20211101-3.el9.x86_64 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-04T06:31:22.059 INFO:teuthology.orchestra.run.smithi203.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-04T06:31:22.060 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-04T06:31:22.060 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:31:22.060 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-03-04T06:31:22.409 DEBUG:teuthology.parallel:result is None 2024-03-04T06:31:25.360 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:18.2.1-696.g5cc7a767.el9.x86_64 115/122 2024-03-04T06:31:25.410 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:18.2.1-696.g5cc7a767.el9.x86_64 116/122 2024-03-04T06:31:25.528 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:18.2.1-696.g5cc7a767.el9.x86_64 117/122 2024-03-04T06:31:25.633 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytest-6.2.2-6.el9.noarch 118/122 2024-03-04T06:31:25.668 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:18.2.1-696.g5cc7a767.el9.x86_64 119/122 2024-03-04T06:31:25.699 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:18.2.1-696.g5cc7a767.el9.x86_6 120/122 2024-03-04T06:31:25.699 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 121/122 2024-03-04T06:31:25.783 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 121/122 2024-03-04T06:31:25.783 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 122/122 2024-03-04T06:31:29.910 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 122/122 2024-03-04T06:31:29.910 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:18.2.1-696.g5cc7a767.el9.x86_64 1/122 2024-03-04T06:31:29.910 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:18.2.1-696.g5cc7a767.el9.x86_64 2/122 2024-03-04T06:31:29.911 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:18.2.1-696.g5cc7a767.el9.x86_64 3/122 2024-03-04T06:31:29.911 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:18.2.1-696.g5cc7a767.el9.x86_64 4/122 2024-03-04T06:31:29.911 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-696.g5cc7a7 5/122 2024-03-04T06:31:29.911 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:18.2.1-696.g5cc7a767.el9.x86_64 6/122 2024-03-04T06:31:29.911 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:18.2.1-696.g5cc7a767.el9.x86_64 7/122 2024-03-04T06:31:29.911 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:18.2.1-696.g5cc7a767.el9.x86_64 8/122 2024-03-04T06:31:29.911 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:18.2.1-696.g5cc7a767.el9.x86_64 9/122 2024-03-04T06:31:29.911 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:18.2.1-696.g5cc7a767.el9.x86_64 10/122 2024-03-04T06:31:29.911 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:18.2.1-696.g5cc7a767.el9.x86_64 11/122 2024-03-04T06:31:29.911 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:18.2.1-696.g5cc7a767.el9.x86_64 12/122 2024-03-04T06:31:29.911 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:18.2.1-696.g5cc7a767.el9.x86_6 13/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:18.2.1-696.g5cc7a767.el9.x86_64 14/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephsqlite-2:18.2.1-696.g5cc7a767.el9.x86_64 15/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:18.2.1-696.g5cc7a767.el9.x86_64 16/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:18.2.1-696.g5cc7a767.el9.x86_ 17/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:18.2.1-696.g5cc7a767.el9.x86_64 18/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:18.2.1-696.g5cc7a767.el9 19/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:18.2.1-696.g5cc7a767.el9.x 20/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:18.2.1-696.g5cc7a767.el9.x86_64 21/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:18.2.1-696.g5cc7a767.el9.x86_64 22/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:18.2.1-696.g5cc7a767.el9.x86_64 23/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:18.2.1-696.g5cc7a767.el9.x86_64 24/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:18.2.1-696.g5cc7a767.el9.x86_64 25/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:18.2.1-696.g5cc7a767.el9.x86_64 26/122 2024-03-04T06:31:29.912 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:18.2.1-696.g5cc7a767.el9.x86_64 27/122 2024-03-04T06:31:29.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-696.g5cc7a767.e 28/122 2024-03-04T06:31:29.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-696.g5cc7a767.el9.noar 29/122 2024-03-04T06:31:29.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-696.g5cc7a767.el9.no 30/122 2024-03-04T06:31:29.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-696.g5cc7 31/122 2024-03-04T06:31:29.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-696.g5cc7a767.el9 32/122 2024-03-04T06:31:29.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-rook-2:18.2.1-696.g5cc7a767.el9.noarch 33/122 2024-03-04T06:31:29.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-696.g5cc7a767.el 34/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephadm-2:18.2.1-696.g5cc7a767.el9.noarch 35/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 36/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 37/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 38/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 39/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 40/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 41/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 42/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 43/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 44/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 45/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 46/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 47/122 2024-03-04T06:31:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 48/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 49/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 50/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 51/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 52/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 53/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 54/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 55/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 56/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 57/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 58/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 59/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 60/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 61/122 2024-03-04T06:31:29.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 62/122 2024-03-04T06:31:29.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytest-6.2.2-6.el9.noarch 63/122 2024-03-04T06:31:29.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 64/122 2024-03-04T06:31:29.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 65/122 2024-03-04T06:31:29.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 66/122 2024-03-04T06:31:29.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 67/122 2024-03-04T06:31:29.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 68/122 2024-03-04T06:31:29.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 69/122 2024-03-04T06:31:29.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 70/122 2024-03-04T06:31:29.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : jq-1.6-16.el9.x86_64 71/122 2024-03-04T06:31:29.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 72/122 2024-03-04T06:31:29.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 73/122 2024-03-04T06:31:29.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 74/122 2024-03-04T06:31:29.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 75/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 76/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ply-3.11-14.el9.noarch 77/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 78/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 79/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 80/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 81/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 82/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 83/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 84/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 85/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 86/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 87/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 88/122 2024-03-04T06:31:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 89/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 90/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 91/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 92/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 93/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 94/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 95/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 96/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 97/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 98/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 99/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 100/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 101/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 102/122 2024-03-04T06:31:29.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 103/122 2024-03-04T06:31:29.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 104/122 2024-03-04T06:31:29.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 105/122 2024-03-04T06:31:29.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 106/122 2024-03-04T06:31:29.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 107/122 2024-03-04T06:31:29.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 108/122 2024-03-04T06:31:29.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 109/122 2024-03-04T06:31:29.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 110/122 2024-03-04T06:31:29.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 111/122 2024-03-04T06:31:29.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 112/122 2024-03-04T06:31:29.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 113/122 2024-03-04T06:31:29.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 114/122 2024-03-04T06:31:29.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 115/122 2024-03-04T06:31:29.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 116/122 2024-03-04T06:31:29.928 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : re2-1:20211101-3.el9.x86_64 117/122 2024-03-04T06:31:29.928 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 118/122 2024-03-04T06:31:29.928 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:18.2.1-696.g5cc7a767.el9.x86_64 119/122 2024-03-04T06:31:29.928 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 120/122 2024-03-04T06:31:29.928 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:18.2.1-696.g5cc7a767.el9.x86_64 121/122 2024-03-04T06:31:32.052 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 122/122 2024-03-04T06:31:32.053 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:31:32.053 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2024-03-04T06:31:32.053 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.053 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.053 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-03-04T06:31:32.053 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-04T06:31:32.053 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.053 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.053 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.053 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.053 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:32.054 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.054 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.054 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.054 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:32.054 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:32.054 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:32.054 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:32.054 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm-2:18.2.1-696.g5cc7a767.el9.noarch 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: jq-1.6-16.el9.x86_64 2024-03-04T06:31:32.055 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-04T06:31:32.056 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-04T06:31:32.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-04T06:31:32.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pluggy-0.13.1-7.el9.noarch 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply-3.11-14.el9.noarch 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-04T06:31:32.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-py-1.10.0-6.el9.noarch 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytest-6.2.2-6.el9.noarch 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-04T06:31:32.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:18.2.1-696.g5cc7a767.el9.x86_64 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: re2-1:20211101-3.el9.x86_64 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-04T06:31:32.061 INFO:teuthology.orchestra.run.smithi137.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-04T06:31:32.062 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-04T06:31:32.062 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:31:32.062 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-03-04T06:31:32.392 DEBUG:teuthology.parallel:result is None 2024-03-04T06:31:32.392 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-04T06:31:32.392 INFO:teuthology.packaging:ref: None 2024-03-04T06:31:32.392 INFO:teuthology.packaging:tag: None 2024-03-04T06:31:32.392 INFO:teuthology.packaging:branch: reef 2024-03-04T06:31:32.393 INFO:teuthology.packaging:sha1: efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:31:32.393 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-03-04T06:31:32.720 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-04T06:31:32.742 INFO:teuthology.orchestra.run.smithi137.stdout:18.2.1-696.g5cc7a767.el9 2024-03-04T06:31:32.742 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-696.g5cc7a767.el9 2024-03-04T06:31:32.742 INFO:teuthology.task.install:The correct ceph version 18.2.1-696.g5cc7a767 is installed. 2024-03-04T06:31:32.744 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-04T06:31:32.744 INFO:teuthology.packaging:ref: None 2024-03-04T06:31:32.744 INFO:teuthology.packaging:tag: None 2024-03-04T06:31:32.744 INFO:teuthology.packaging:branch: reef 2024-03-04T06:31:32.744 INFO:teuthology.packaging:sha1: efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:31:32.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-03-04T06:31:32.973 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-04T06:31:32.999 INFO:teuthology.orchestra.run.smithi203.stdout:18.2.1-696.g5cc7a767.el9 2024-03-04T06:31:32.999 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-696.g5cc7a767.el9 2024-03-04T06:31:32.999 INFO:teuthology.task.install:The correct ceph version 18.2.1-696.g5cc7a767 is installed. 2024-03-04T06:31:33.001 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-04T06:31:33.001 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:31:33.001 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-04T06:31:33.032 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-04T06:31:33.032 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-04T06:31:33.072 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-04T06:31:33.072 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:31:33.072 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-03-04T06:31:33.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-04T06:31:33.167 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-04T06:31:33.167 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2024-03-04T06:31:33.197 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-04T06:31:33.266 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-04T06:31:33.266 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:31:33.267 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-04T06:31:33.293 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-04T06:31:33.361 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-04T06:31:33.361 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-04T06:31:33.390 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-04T06:31:33.457 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-04T06:31:33.458 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:31:33.458 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-03-04T06:31:33.484 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-04T06:31:33.550 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-04T06:31:33.550 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2024-03-04T06:31:33.577 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-04T06:31:33.644 INFO:teuthology.run_tasks:Running task print... 2024-03-04T06:31:33.655 INFO:teuthology.task.print:**** done install task... 2024-03-04T06:31:33.655 INFO:teuthology.run_tasks:Running task print... 2024-03-04T06:31:33.693 INFO:teuthology.task.print:**** done start installing reef cephadm ... 2024-03-04T06:31:33.693 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-04T06:31:33.823 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}, 'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'image': 'quay.ceph.io/ceph-ci/ceph:reef', 'create_rbd_pool': True, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'efb04e5e69d058b0c47e511cb7e10d57a92f59ae'} 2024-03-04T06:31:33.823 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:reef 2024-03-04T06:31:33.823 INFO:tasks.cephadm:Cluster fsid is d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:31:33.823 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-04T06:31:33.824 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.137', 'mon.c': '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]', 'mon.b': '172.21.15.203'} 2024-03-04T06:31:33.824 INFO:tasks.cephadm:First mon is mon.a on smithi137 2024-03-04T06:31:33.824 INFO:tasks.cephadm:First mgr is y 2024-03-04T06:31:33.824 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-04T06:31:33.824 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname $(hostname -s) 2024-03-04T06:31:33.851 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname $(hostname -s) 2024-03-04T06:31:33.879 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-03-04T06:31:33.879 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:31:34.094 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'efb04e5e69d058b0c47e511cb7e10d57a92f59ae', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77213/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1791-gefb04e5e', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1791.gefb04e5e'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2024-03-01-0756/efb04e5e69d058b0c47e511cb7e10d57a92f59ae/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-01 17:44:28.987428', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-yuri-testing-2024-03-01-0756', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-yuri-testing-2024-03-01-0756/efb04e5e69d058b0c47e511cb7e10d57a92f59ae/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-03-04T06:31:34.322 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref reef, sha1 5cc7a7679b7ba0f0befea649a39bb50c530f1e24 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-03-04T06:31:34.324 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/reef/5cc7a7679b7ba0f0befea649a39bb50c530f1e24/centos/9/x86_64/flavors/default/cephadm 2024-03-04T06:31:34.324 DEBUG:teuthology.orchestra.run.smithi137:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/5cc7a7679b7ba0f0befea649a39bb50c530f1e24/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-04T06:31:35.441 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r--. 1 ubuntu ubuntu 214740 Mar 4 06:31 /home/ubuntu/cephtest/cephadm 2024-03-04T06:31:35.441 DEBUG:teuthology.orchestra.run.smithi203:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/5cc7a7679b7ba0f0befea649a39bb50c530f1e24/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-04T06:31:36.381 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r--. 1 ubuntu ubuntu 214740 Mar 4 06:31 /home/ubuntu/cephtest/cephadm 2024-03-04T06:31:36.382 DEBUG:teuthology.orchestra.run.smithi137:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-04T06:31:36.400 DEBUG:teuthology.orchestra.run.smithi203:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-04T06:31:36.432 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:reef on all hosts... 2024-03-04T06:31:36.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-03-04T06:31:36.443 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-03-04T06:31:37.311 INFO:teuthology.orchestra.run.smithi203.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-03-04T06:31:37.329 INFO:teuthology.orchestra.run.smithi137.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-03-04T06:32:34.195 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-03-04T06:32:34.199 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_version": "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)", 2024-03-04T06:32:34.199 INFO:teuthology.orchestra.run.smithi203.stdout: "image_id": "540557f94930c38870197995629adb1ba474514589432062c4a23b4aa6496def", 2024-03-04T06:32:34.199 INFO:teuthology.orchestra.run.smithi203.stdout: "repo_digests": [ 2024-03-04T06:32:34.199 INFO:teuthology.orchestra.run.smithi203.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc" 2024-03-04T06:32:34.199 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-03-04T06:32:34.199 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-03-04T06:32:36.728 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:32:36.728 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)", 2024-03-04T06:32:36.728 INFO:teuthology.orchestra.run.smithi137.stdout: "image_id": "540557f94930c38870197995629adb1ba474514589432062c4a23b4aa6496def", 2024-03-04T06:32:36.728 INFO:teuthology.orchestra.run.smithi137.stdout: "repo_digests": [ 2024-03-04T06:32:36.728 INFO:teuthology.orchestra.run.smithi137.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc" 2024-03-04T06:32:36.728 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-03-04T06:32:36.728 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:32:36.745 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph 2024-03-04T06:32:36.798 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph 2024-03-04T06:32:36.834 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /etc/ceph 2024-03-04T06:32:36.861 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /etc/ceph 2024-03-04T06:32:36.903 INFO:tasks.cephadm:Writing seed config... 2024-03-04T06:32:36.904 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-03-04T06:32:36.904 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-03-04T06:32:36.904 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-04T06:32:36.905 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-04T06:32:36.905 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-03-04T06:32:36.905 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-03-04T06:32:36.905 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-04T06:32:36.905 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-04T06:32:36.905 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-04T06:32:36.905 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-04T06:32:36.905 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-04T06:32:36.905 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:32:36.905 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-04T06:32:36.920 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d83bc156-d9f0-11ee-95c6-87774f69a715 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-03-04T06:32:36.920 DEBUG:teuthology.orchestra.run.smithi137:mon.a> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.a.service 2024-03-04T06:32:36.962 DEBUG:teuthology.orchestra.run.smithi137:mgr.y> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.y.service 2024-03-04T06:32:37.004 INFO:tasks.cephadm:Bootstrapping... 2024-03-04T06:32:37.005 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef -v bootstrap --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.137 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-04T06:32:37.161 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-03-04T06:32:37.161 INFO:teuthology.orchestra.run.smithi137.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:reef', '-v', 'bootstrap', '--fsid', 'd83bc156-d9f0-11ee-95c6-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.137', '--skip-admin-label'] 2024-03-04T06:32:37.185 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-04T06:32:37.185 INFO:teuthology.orchestra.run.smithi137.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-04T06:32:37.185 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying podman|docker is present... 2024-03-04T06:32:37.208 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-04T06:32:37.208 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying lvm2 is present... 2024-03-04T06:32:37.208 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying time synchronization is in place... 2024-03-04T06:32:37.216 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-04T06:32:37.216 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-04T06:32:37.221 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-04T06:32:37.222 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout inactive 2024-03-04T06:32:37.227 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout enabled 2024-03-04T06:32:37.233 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout active 2024-03-04T06:32:37.233 INFO:teuthology.orchestra.run.smithi137.stdout:Unit chronyd.service is enabled and running 2024-03-04T06:32:37.233 INFO:teuthology.orchestra.run.smithi137.stdout:Repeating the final host check... 2024-03-04T06:32:37.255 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-04T06:32:37.256 INFO:teuthology.orchestra.run.smithi137.stdout:podman (/bin/podman) version 4.9.3 is present 2024-03-04T06:32:37.256 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl is present 2024-03-04T06:32:37.256 INFO:teuthology.orchestra.run.smithi137.stdout:lvcreate is present 2024-03-04T06:32:37.262 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-04T06:32:37.262 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-04T06:32:37.268 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-04T06:32:37.268 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout inactive 2024-03-04T06:32:37.274 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout enabled 2024-03-04T06:32:37.280 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout active 2024-03-04T06:32:37.280 INFO:teuthology.orchestra.run.smithi137.stdout:Unit chronyd.service is enabled and running 2024-03-04T06:32:37.280 INFO:teuthology.orchestra.run.smithi137.stdout:Host looks OK 2024-03-04T06:32:37.280 INFO:teuthology.orchestra.run.smithi137.stdout:Cluster fsid: d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:32:37.280 INFO:teuthology.orchestra.run.smithi137.stdout:Acquiring lock 140479594198928 on /run/cephadm/d83bc156-d9f0-11ee-95c6-87774f69a715.lock 2024-03-04T06:32:37.280 INFO:teuthology.orchestra.run.smithi137.stdout:Lock 140479594198928 acquired on /run/cephadm/d83bc156-d9f0-11ee-95c6-87774f69a715.lock 2024-03-04T06:32:37.281 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying IP 172.21.15.137 port 3300 ... 2024-03-04T06:32:37.281 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying IP 172.21.15.137 port 6789 ... 2024-03-04T06:32:37.281 INFO:teuthology.orchestra.run.smithi137.stdout:Base mon IP(s) is [172.21.15.137:3300, 172.21.15.137:6789], mon addrv is [v2:172.21.15.137:3300,v1:172.21.15.137:6789] 2024-03-04T06:32:37.284 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.137 metric 100 2024-03-04T06:32:37.284 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.137 metric 100 2024-03-04T06:32:37.286 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-04T06:32:37.286 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-03-04T06:32:37.286 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1550sec hoplimit 64 pref medium 2024-03-04T06:32:37.288 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-04T06:32:37.289 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-04T06:32:37.289 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-04T06:32:37.289 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-03-04T06:32:37.289 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-03-04T06:32:37.289 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-04T06:32:37.289 INFO:teuthology.orchestra.run.smithi137.stdout:Mon IP `172.21.15.137` is in CIDR network `172.21.0.0/20` 2024-03-04T06:32:37.289 INFO:teuthology.orchestra.run.smithi137.stdout:Mon IP `172.21.15.137` is in CIDR network `172.21.0.0/20` 2024-03-04T06:32:37.289 INFO:teuthology.orchestra.run.smithi137.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-04T06:32:37.290 INFO:teuthology.orchestra.run.smithi137.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-04T06:32:37.290 INFO:teuthology.orchestra.run.smithi137.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-03-04T06:32:37.856 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stdout 540557f94930c38870197995629adb1ba474514589432062c4a23b4aa6496def 2024-03-04T06:32:37.856 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:reef... 2024-03-04T06:32:37.856 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stderr Getting image source signatures 2024-03-04T06:32:37.856 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stderr Copying blob sha256:dfb7886b76495ce2b472682f92d3d4adc0edcc4e75d0cd312551681f8efa0697 2024-03-04T06:32:37.856 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stderr Copying blob sha256:7feca07754707458c3945cf0062cf4dabc512f6d90fe1a9a1370b362b6011124 2024-03-04T06:32:37.857 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stderr Copying config sha256:540557f94930c38870197995629adb1ba474514589432062c4a23b4aa6496def 2024-03-04T06:32:37.857 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stderr Writing manifest to image destination 2024-03-04T06:32:38.743 INFO:teuthology.orchestra.run.smithi137.stdout:ceph: stdout ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable) 2024-03-04T06:32:38.743 INFO:teuthology.orchestra.run.smithi137.stdout:Ceph version: ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable) 2024-03-04T06:32:38.743 INFO:teuthology.orchestra.run.smithi137.stdout:Extracting ceph user uid/gid from container image... 2024-03-04T06:32:39.682 INFO:teuthology.orchestra.run.smithi137.stdout:stat: stdout 167 167 2024-03-04T06:32:39.682 INFO:teuthology.orchestra.run.smithi137.stdout:Creating initial keys... 2024-03-04T06:32:40.520 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph-authtool: stdout AQAHa+Vlf9WOOxAAZe6lbqMyn/mFNp0nmIBPrQ== 2024-03-04T06:32:41.433 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph-authtool: stdout AQAIa+Vlnt4ZMhAAgMdrxOOOcoZYDMnj7TctIA== 2024-03-04T06:32:42.281 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph-authtool: stdout AQAJa+VlAJW/KhAA3GunECyPfptixHEaa5IPBQ== 2024-03-04T06:32:42.282 INFO:teuthology.orchestra.run.smithi137.stdout:Creating initial monmap... 2024-03-04T06:32:43.103 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-04T06:32:43.103 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-03-04T06:32:43.103 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:32:43.104 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-04T06:32:43.104 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool for a [v2:172.21.15.137:3300,v1:172.21.15.137:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-04T06:32:43.104 INFO:teuthology.orchestra.run.smithi137.stdout:setting min_mon_release = pacific 2024-03-04T06:32:43.104 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/monmaptool: set fsid to d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:32:43.104 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-04T06:32:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:32:43.104 INFO:teuthology.orchestra.run.smithi137.stdout:Creating mon... 2024-03-04T06:32:43.991 INFO:teuthology.orchestra.run.smithi137.stdout:create mon.a on 2024-03-04T06:32:44.189 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-03-04T06:32:44.334 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-04T06:32:44.524 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d83bc156-d9f0-11ee-95c6-87774f69a715.target → /etc/systemd/system/ceph-d83bc156-d9f0-11ee-95c6-87774f69a715.target. 2024-03-04T06:32:44.525 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d83bc156-d9f0-11ee-95c6-87774f69a715.target → /etc/systemd/system/ceph-d83bc156-d9f0-11ee-95c6-87774f69a715.target. 2024-03-04T06:32:44.738 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.a 2024-03-04T06:32:44.738 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.a.service: Unit ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.a.service not loaded. 2024-03-04T06:32:44.889 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d83bc156-d9f0-11ee-95c6-87774f69a715.target.wants/ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.a.service → /etc/systemd/system/ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@.service. 2024-03-04T06:32:45.440 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-04T06:32:45.440 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout disabled 2024-03-04T06:32:45.446 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-04T06:32:45.446 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout inactive 2024-03-04T06:32:45.446 INFO:teuthology.orchestra.run.smithi137.stdout:firewalld.service is not enabled 2024-03-04T06:32:45.447 INFO:teuthology.orchestra.run.smithi137.stdout:Not possible to enable service . firewalld.service is not available 2024-03-04T06:32:45.447 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for mon to start... 2024-03-04T06:32:45.447 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for mon... 2024-03-04T06:32:46.420 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout cluster: 2024-03-04T06:32:46.420 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout id: d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:32:46.420 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-04T06:32:46.420 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-03-04T06:32:46.420 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout services: 2024-03-04T06:32:46.421 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.522736s) 2024-03-04T06:32:46.421 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-04T06:32:46.421 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-04T06:32:46.421 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-03-04T06:32:46.421 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout data: 2024-03-04T06:32:46.421 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-04T06:32:46.421 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-04T06:32:46.421 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-04T06:32:46.421 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout pgs: 2024-03-04T06:32:46.421 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-03-04T06:32:46.421 INFO:teuthology.orchestra.run.smithi137.stdout:mon is available 2024-03-04T06:32:46.421 INFO:teuthology.orchestra.run.smithi137.stdout:Assimilating anything we can from ceph.conf... 2024-03-04T06:32:47.446 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:47 smithi137 ceph-mon[26470]: from='client.? 172.21.15.137:0/584774913' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-04T06:32:47.450 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-03-04T06:32:47.450 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout [global] 2024-03-04T06:32:47.450 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout fsid = d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:32:47.450 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.137:3300,v1:172.21.15.137:6789] 2024-03-04T06:32:47.450 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-04T06:32:47.450 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-04T06:32:47.451 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-04T06:32:47.451 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-04T06:32:47.451 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-03-04T06:32:47.451 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-04T06:32:47.451 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-04T06:32:47.451 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-03-04T06:32:47.451 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout [osd] 2024-03-04T06:32:47.451 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-04T06:32:47.451 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-04T06:32:47.451 INFO:teuthology.orchestra.run.smithi137.stdout:Generating new minimal ceph.conf... 2024-03-04T06:32:48.447 INFO:teuthology.orchestra.run.smithi137.stdout:Restarting the monitor... 2024-03-04T06:32:48.466 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:48 smithi137 ceph-mon[26470]: from='client.? 172.21.15.137:0/3710854011' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:32:48.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:48 smithi137 systemd[1]: Stopping Ceph mon.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:32:48.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[26466]: 2024-03-04T06:32:48.705+0000 7f57bd446700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:32:48.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[26466]: 2024-03-04T06:32:48.705+0000 7f57bd446700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-04T06:32:49.204 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:48 smithi137 podman[26715]: 2024-03-04 06:32:48.88971097 +0000 UTC m=+0.283668003 container died 7185ca1d8b0b169a1962ad94e2df874df1bca717af17a8de00fcc93ba4bcb6d6 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=reef-5cc7a76, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:32:49.205 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:49 smithi137 podman[26715]: 2024-03-04 06:32:49.20494314 +0000 UTC m=+0.598900173 container cleanup 7185ca1d8b0b169a1962ad94e2df874df1bca717af17a8de00fcc93ba4bcb6d6 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-5cc7a76, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:32:49.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:49 smithi137 bash[26715]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a 2024-03-04T06:32:49.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:49 smithi137 podman[26729]: 2024-03-04 06:32:49.380590874 +0000 UTC m=+0.487858984 container remove 7185ca1d8b0b169a1962ad94e2df874df1bca717af17a8de00fcc93ba4bcb6d6 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=reef-5cc7a76, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True) 2024-03-04T06:32:49.909 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:49 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.a.service: Deactivated successfully. 2024-03-04T06:32:49.909 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:49 smithi137 systemd[1]: Stopped Ceph mon.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:32:49.909 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:49 smithi137 systemd[1]: Starting Ceph mon.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:32:49.909 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:49 smithi137 podman[26827]: 2024-03-04 06:32:49.814641312 +0000 UTC m=+0.098387115 container create 0279ece55dcce5ba82312214c2ff2e825003a66225c0d180d1b0e454e9e4fdbf (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, ceph=True, RELEASE=reef-5cc7a76, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-04T06:32:49.910 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:49 smithi137 podman[26827]: 2024-03-04 06:32:49.734206754 +0000 UTC m=+0.017952569 image pull 540557f94930c38870197995629adb1ba474514589432062c4a23b4aa6496def quay.ceph.io/ceph-ci/ceph:reef 2024-03-04T06:32:50.070 INFO:teuthology.orchestra.run.smithi137.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-04T06:32:50.176 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:49 smithi137 podman[26827]: 2024-03-04 06:32:49.991940821 +0000 UTC m=+0.275686633 container init 0279ece55dcce5ba82312214c2ff2e825003a66225c0d180d1b0e454e9e4fdbf (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, ceph=True, RELEASE=reef-5cc7a76, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:49 smithi137 podman[26827]: 2024-03-04 06:32:49.994785593 +0000 UTC m=+0.278531398 container start 0279ece55dcce5ba82312214c2ff2e825003a66225c0d180d1b0e454e9e4fdbf (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=reef-5cc7a76, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True) 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: set uid:gid to 167:167 (ceph:ceph) 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable), process ceph-mon, pid 2 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: pidfile_write: ignore empty --pid-file 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: load: jerasure load: lrc 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: RocksDB version: 7.9.2 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Git sha 0 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Compile date 2024-03-03 15:03:44 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: DB SUMMARY 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: DB Session ID: VAL5ENS6QM5P4WZQ1HS1 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: CURRENT file: CURRENT 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: IDENTITY file: IDENTITY 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-04T06:32:50.177 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-04T06:32:50.178 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 84548 ; 2024-03-04T06:32:50.178 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.error_if_exists: 0 2024-03-04T06:32:50.178 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.create_if_missing: 0 2024-03-04T06:32:50.178 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.paranoid_checks: 1 2024-03-04T06:32:50.178 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-04T06:32:50.178 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-04T06:32:50.178 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-04T06:32:50.178 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.env: 0x55a2e6617720 2024-03-04T06:32:50.178 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.fs: PosixFileSystem 2024-03-04T06:32:50.178 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.info_log: 0x55a2e897d4c0 2024-03-04T06:32:50.178 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_file_opening_threads: 16 2024-03-04T06:32:50.178 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.statistics: (nil) 2024-03-04T06:32:50.178 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.use_fsync: 0 2024-03-04T06:32:50.179 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_log_file_size: 0 2024-03-04T06:32:50.179 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-04T06:32:50.179 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-04T06:32:50.179 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.keep_log_file_num: 1000 2024-03-04T06:32:50.179 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.recycle_log_file_num: 0 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.allow_fallocate: 1 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.allow_mmap_reads: 0 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.allow_mmap_writes: 0 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.use_direct_reads: 0 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.create_missing_column_families: 0 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.db_log_dir: 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.wal_dir: 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-04T06:32:50.180 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.advise_random_on_open: 1 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.db_write_buffer_size: 0 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.write_buffer_manager: 0x55a2e7bee140 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.rate_limiter: (nil) 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.wal_recovery_mode: 2 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.enable_thread_tracking: 0 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.enable_pipelined_write: 0 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.unordered_write: 0 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-04T06:32:50.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.row_cache: None 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.wal_filter: None 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.allow_ingest_behind: 0 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.two_write_queues: 0 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.manual_wal_flush: 0 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.wal_compression: 0 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.atomic_flush: 0 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.log_readahead_size: 0 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.best_efforts_recovery: 0 2024-03-04T06:32:50.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.allow_data_in_errors: 0 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.db_host_id: __hostname__ 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_background_jobs: 2 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_background_compactions: -1 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_subcompactions: 1 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_total_wal_size: 0 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-04T06:32:50.183 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_open_files: -1 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.bytes_per_sync: 0 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compaction_readahead_size: 0 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_background_flushes: -1 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Compression algorithms supported: 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: kZSTD supported: 0 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: kXpressCompression supported: 0 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: kLZ4HCCompression supported: 1 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: kZlibCompression supported: 1 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: kSnappyCompression supported: 1 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: kLZ4Compression supported: 1 2024-03-04T06:32:50.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: kBZip2Compression supported: 0 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.merge_operator: 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compaction_filter: None 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compaction_filter_factory: None 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.sst_partitioner_factory: None 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a2e897d5c0) 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout: cache_index_and_filter_blocks: 1 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-04T06:32:50.185 INFO:journalctl@ceph.mon.a.smithi137.stdout: pin_top_level_index_and_filter: 1 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: index_type: 0 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: data_block_index_type: 0 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: index_shortening: 1 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: checksum: 4 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: no_block_cache: 0 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_cache: 0x55a2e7c8f1f0 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_cache_name: BinnedLRUCache 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_cache_options: 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: capacity : 536870912 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: num_shard_bits : 4 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: strict_capacity_limit : 0 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: high_pri_pool_ratio: 0.000 2024-03-04T06:32:50.186 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_cache_compressed: (nil) 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: persistent_cache: (nil) 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_size: 4096 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_size_deviation: 10 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_restart_interval: 16 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: index_block_restart_interval: 1 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: metadata_block_size: 4096 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: partition_filters: 0 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: use_delta_encoding: 1 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: filter_policy: bloomfilter 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: whole_key_filtering: 1 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: verify_compression: 0 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: read_amp_bytes_per_bit: 0 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: format_version: 5 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: enable_index_compression: 1 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_align: 0 2024-03-04T06:32:50.187 INFO:journalctl@ceph.mon.a.smithi137.stdout: max_auto_readahead_size: 262144 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout: prepopulate_block_cache: 0 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout: initial_auto_readahead_size: 8192 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout: num_file_reads_for_auto_readahead: 2 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.write_buffer_size: 33554432 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_write_buffer_number: 2 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compression: NoCompression 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.bottommost_compression: Disabled 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.prefix_extractor: nullptr 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.num_levels: 7 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-04T06:32:50.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compression_opts.level: 32767 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compression_opts.strategy: 0 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compression_opts.enabled: false 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-04T06:32:50.189 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-04T06:32:50.190 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-04T06:32:50.190 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-04T06:32:50.190 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.target_file_size_base: 67108864 2024-03-04T06:32:50.190 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-04T06:32:50.190 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-04T06:32:50.190 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-04T06:32:50.190 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-04T06:32:50.190 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-04T06:32:50.190 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-04T06:32:50.190 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-04T06:32:50.190 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-04T06:32:50.191 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-04T06:32:50.191 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-04T06:32:50.191 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-04T06:32:50.191 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-04T06:32:50.191 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-04T06:32:50.191 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-04T06:32:50.191 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.arena_block_size: 1048576 2024-03-04T06:32:50.191 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-04T06:32:50.191 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-04T06:32:50.191 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.disable_auto_compactions: 0 2024-03-04T06:32:50.191 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.table_properties_collectors: 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.inplace_update_support: 0 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-04T06:32:50.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.bloom_locality: 0 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.max_successive_merges: 0 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.paranoid_file_checks: 0 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.force_consistency_checks: 1 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.report_bg_io_stats: 0 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.ttl: 2592000 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.enable_blob_files: false 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.min_blob_size: 0 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.blob_file_size: 268435456 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-04T06:32:50.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.blob_file_starting_level: 0 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1bf909fe-1f6c-485a-8c25-696c6a455d26 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709533970023462, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709533970024301, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 81072, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 256, "table_properties": {"data_size": 79248, "index_size": 234, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10267, "raw_average_key_size": 47, "raw_value_size": 73449, "raw_average_value_size": 341, "num_data_blocks": 10, "num_entries": 215, "num_filter_entries": 215, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709533970, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1bf909fe-1f6c-485a-8c25-696c6a455d26", "db_session_id": "VAL5ENS6QM5P4WZQ1HS1", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709533970024383, "job": 1, "event": "recovery_finished"} 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a2e7d2c000 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: DB pointer 0x55a2e7d1a000 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-04T06:32:50.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: ** DB Stats ** 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: ** Compaction Stats [default] ** 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: L0 2/0 81.01 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 149.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: Sum 2/0 81.01 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 149.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 149.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-04T06:32:50.195 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: ** Compaction Stats [default] ** 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 149.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: Cumulative compaction: 0.00 GB write, 28.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T06:32:50.196 INFO:journalctl@ceph.mon.a.smithi137.stdout: Interval compaction: 0.00 GB write, 28.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout: Block cache BinnedLRUCache@0x55a2e7c8f1f0#2 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: starting mon.a rank 0 at public addrs [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] at bind addrs [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: mon.a@-1(???) e1 preinit fsid d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: mon.a@-1(???).mds e1 new map 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: mon.a@-1(???).mds e1 print_map 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout: e1 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout: legacy client fscid: -1 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout: No filesystems configured 2024-03-04T06:32:50.197 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-04T06:32:50.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T06:32:50.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T06:32:50.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T06:32:50.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-04T06:32:50.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 bash[26827]: 0279ece55dcce5ba82312214c2ff2e825003a66225c0d180d1b0e454e9e4fdbf 2024-03-04T06:32:50.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 systemd[1]: Started Ceph mon.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:32:50.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-04T06:32:50.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: monmap e1: 1 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:32:50.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: fsmap 2024-03-04T06:32:50.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: osdmap e1: 0 total, 0 up, 0 in 2024-03-04T06:32:50.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:50 smithi137 ceph-mon[26846]: mgrmap e1: no daemons active 2024-03-04T06:32:51.117 INFO:teuthology.orchestra.run.smithi137.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-04T06:32:51.139 INFO:teuthology.orchestra.run.smithi137.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-04T06:32:51.139 INFO:teuthology.orchestra.run.smithi137.stdout:Creating mgr... 2024-03-04T06:32:51.139 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-04T06:32:51.140 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-04T06:32:51.386 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.y 2024-03-04T06:32:51.386 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.y.service: Unit ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.y.service not loaded. 2024-03-04T06:32:51.535 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d83bc156-d9f0-11ee-95c6-87774f69a715.target.wants/ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.y.service → /etc/systemd/system/ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@.service. 2024-03-04T06:32:51.749 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:51 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/4192681078' entity='client.admin' 2024-03-04T06:32:52.010 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:51 smithi137 podman[27062]: 2024-03-04 06:32:51.938059302 +0000 UTC m=+0.285660845 container start d360a32fa2a312892e0fca411600a39a893961a0a8480a6e7d9e23c10832ffc8 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y, org.label-schema.schema-version=1.0, RELEASE=reef-5cc7a76, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, ceph=True, org.label-schema.vendor=CentOS) 2024-03-04T06:32:52.010 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:52 smithi137 bash[27062]: d360a32fa2a312892e0fca411600a39a893961a0a8480a6e7d9e23c10832ffc8 2024-03-04T06:32:52.023 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-04T06:32:52.023 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout disabled 2024-03-04T06:32:52.030 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-04T06:32:52.030 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout inactive 2024-03-04T06:32:52.030 INFO:teuthology.orchestra.run.smithi137.stdout:firewalld.service is not enabled 2024-03-04T06:32:52.030 INFO:teuthology.orchestra.run.smithi137.stdout:Not possible to enable service . firewalld.service is not available 2024-03-04T06:32:52.038 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-04T06:32:52.038 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout disabled 2024-03-04T06:32:52.045 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-04T06:32:52.046 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout inactive 2024-03-04T06:32:52.046 INFO:teuthology.orchestra.run.smithi137.stdout:firewalld.service is not enabled 2024-03-04T06:32:52.046 INFO:teuthology.orchestra.run.smithi137.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-03-04T06:32:52.046 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for mgr to start... 2024-03-04T06:32:52.046 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for mgr... 2024-03-04T06:32:52.267 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:52 smithi137 systemd[1]: Started Ceph mgr.y for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:32:52.533 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:52.490+0000 7f30be5b5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T06:32:52.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:52 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2909634930' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-04T06:32:52.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:52.593+0000 7f30be5b5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T06:32:53.102 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-03-04T06:32:53.107 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-03-04T06:32:53.107 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsid": "d83bc156-d9f0-11ee-95c6-87774f69a715", 2024-03-04T06:32:53.107 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "health": { 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 0 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "a" 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-04T06:32:53.108 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-04T06:32:53.109 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-04T06:32:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-04T06:32:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-04T06:32:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "restful" 2024-03-04T06:32:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-03-04T06:32:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T06:32:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-04T06:32:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:32:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modified": "2024-03-04T06:32:45.412383+0000", 2024-03-04T06:32:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T06:32:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-04T06:32:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-03-04T06:32:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:mgr not available, waiting (1/15)... 2024-03-04T06:32:53.465 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:53.234+0000 7f30be5b5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T06:32:53.465 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:53.324+0000 7f30be5b5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T06:32:53.465 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:53.464+0000 7f30be5b5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T06:32:53.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:53.558+0000 7f30be5b5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T06:32:53.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:53.641+0000 7f30be5b5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T06:32:54.190 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:53.900+0000 7f30be5b5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T06:32:54.190 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:54.008+0000 7f30be5b5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T06:32:54.190 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:54.095+0000 7f30be5b5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T06:32:54.190 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:54.189+0000 7f30be5b5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T06:32:54.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:54.376+0000 7f30be5b5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T06:32:55.482 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:55.348+0000 7f30be5b5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T06:32:55.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:55.481+0000 7f30be5b5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T06:32:56.112 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:56 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3720540451' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-04T06:32:56.112 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:55.823+0000 7f30be5b5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T06:32:56.112 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:55.914+0000 7f30be5b5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T06:32:56.112 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:56.111+0000 7f30be5b5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:32:56.165 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-03-04T06:32:56.165 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-03-04T06:32:56.165 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsid": "d83bc156-d9f0-11ee-95c6-87774f69a715", 2024-03-04T06:32:56.166 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "health": { 2024-03-04T06:32:56.166 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-04T06:32:56.166 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-04T06:32:56.166 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-04T06:32:56.166 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:56.166 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-04T06:32:56.166 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-04T06:32:56.166 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 0 2024-03-04T06:32:56.166 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-03-04T06:32:56.166 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-04T06:32:56.167 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "a" 2024-03-04T06:32:56.167 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-03-04T06:32:56.167 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-03-04T06:32:56.167 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-04T06:32:56.167 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:32:56.167 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-03-04T06:32:56.167 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-04T06:32:56.167 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:56.167 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-04T06:32:56.167 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:32:56.167 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-04T06:32:56.168 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-04T06:32:56.168 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-04T06:32:56.168 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-04T06:32:56.168 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-04T06:32:56.168 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-04T06:32:56.168 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:56.168 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-04T06:32:56.168 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-04T06:32:56.168 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-04T06:32:56.169 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-04T06:32:56.169 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-04T06:32:56.169 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-04T06:32:56.169 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-04T06:32:56.169 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-04T06:32:56.169 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-04T06:32:56.169 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:56.169 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-04T06:32:56.169 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:32:56.169 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-04T06:32:56.169 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-04T06:32:56.170 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:56.170 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-04T06:32:56.170 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-04T06:32:56.170 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-04T06:32:56.170 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-04T06:32:56.170 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-04T06:32:56.170 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-04T06:32:56.170 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "restful" 2024-03-04T06:32:56.170 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-03-04T06:32:56.170 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T06:32:56.170 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:56.170 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-04T06:32:56.171 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:32:56.171 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modified": "2024-03-04T06:32:45.412383+0000", 2024-03-04T06:32:56.171 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T06:32:56.171 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:32:56.171 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-04T06:32:56.171 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-03-04T06:32:56.171 INFO:teuthology.orchestra.run.smithi137.stdout:mgr not available, waiting (2/15)... 2024-03-04T06:32:56.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:56.298+0000 7f30be5b5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T06:32:56.838 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:56.578+0000 7f30be5b5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:32:57.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:56.837+0000 7f30be5b5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T06:32:57.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:57.068+0000 7f30be5b5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T06:32:58.290 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:57.861+0000 7f30be5b5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T06:32:58.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:58.473+0000 7f30be5b5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T06:32:59.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:58 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2374970720' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-04T06:32:59.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:58.573+0000 7f30be5b5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T06:32:59.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:32:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:32:58.794+0000 7f30be5b5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T06:33:00.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:59 smithi137 ceph-mon[26846]: Activating manager daemon y 2024-03-04T06:33:00.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:59 smithi137 ceph-mon[26846]: mgrmap e2: y(active, starting, since 0.00303943s) 2024-03-04T06:33:00.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:59 smithi137 ceph-mon[26846]: from='mgr.14100 172.21.15.137:0/202660689' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:33:00.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:59 smithi137 ceph-mon[26846]: from='mgr.14100 172.21.15.137:0/202660689' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:33:00.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:59 smithi137 ceph-mon[26846]: from='mgr.14100 172.21.15.137:0/202660689' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:33:00.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:59 smithi137 ceph-mon[26846]: from='mgr.14100 172.21.15.137:0/202660689' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:33:00.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:59 smithi137 ceph-mon[26846]: from='mgr.14100 172.21.15.137:0/202660689' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:33:00.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:59 smithi137 ceph-mon[26846]: Manager daemon y is now available 2024-03-04T06:33:00.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:59 smithi137 ceph-mon[26846]: from='mgr.14100 172.21.15.137:0/202660689' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:33:00.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:59 smithi137 ceph-mon[26846]: from='mgr.14100 172.21.15.137:0/202660689' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:33:00.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:59 smithi137 ceph-mon[26846]: from='mgr.14100 172.21.15.137:0/202660689' entity='mgr.y' 2024-03-04T06:33:00.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:59 smithi137 ceph-mon[26846]: from='mgr.14100 172.21.15.137:0/202660689' entity='mgr.y' 2024-03-04T06:33:00.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:32:59 smithi137 ceph-mon[26846]: from='mgr.14100 172.21.15.137:0/202660689' entity='mgr.y' 2024-03-04T06:33:01.129 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:00 smithi137 ceph-mon[26846]: mgrmap e3: y(active, since 1.00716s) 2024-03-04T06:33:01.134 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsid": "d83bc156-d9f0-11ee-95c6-87774f69a715", 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "health": { 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 0 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "a" 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-03-04T06:33:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-03-04T06:33:01.136 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-04T06:33:01.136 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:33:01.136 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-03-04T06:33:01.136 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-04T06:33:01.136 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:01.136 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-04T06:33:01.136 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:33:01.136 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-04T06:33:01.136 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-04T06:33:01.136 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-04T06:33:01.136 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-04T06:33:01.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-04T06:33:01.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-04T06:33:01.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:01.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-04T06:33:01.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-04T06:33:01.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-04T06:33:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "restful" 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modified": "2024-03-04T06:32:45.412383+0000", 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-03-04T06:33:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:mgr not available, waiting (3/15)... 2024-03-04T06:33:03.267 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:02 smithi137 ceph-mon[26846]: mgrmap e4: y(active, since 3s) 2024-03-04T06:33:06.808 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:06 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/4150684005' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-04T06:33:09.125 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-03-04T06:33:09.125 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-03-04T06:33:09.125 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsid": "d83bc156-d9f0-11ee-95c6-87774f69a715", 2024-03-04T06:33:09.125 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "health": { 2024-03-04T06:33:09.125 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-04T06:33:09.125 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-04T06:33:09.125 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-04T06:33:09.125 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 0 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "a" 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-04T06:33:09.126 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-04T06:33:09.127 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-04T06:33:09.128 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "restful" 2024-03-04T06:33:09.129 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-03-04T06:33:09.129 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T06:33:09.129 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:09.129 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-04T06:33:09.129 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T06:33:09.129 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modified": "2024-03-04T06:32:45.412383+0000", 2024-03-04T06:33:09.129 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T06:33:09.129 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-03-04T06:33:09.129 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-04T06:33:09.129 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-03-04T06:33:09.129 INFO:teuthology.orchestra.run.smithi137.stdout:mgr is available 2024-03-04T06:33:10.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:09 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1219051521' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-04T06:33:10.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-03-04T06:33:10.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout [global] 2024-03-04T06:33:10.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout fsid = d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:33:10.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-04T06:33:10.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-04T06:33:10.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-04T06:33:10.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-04T06:33:10.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-03-04T06:33:10.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-04T06:33:10.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-04T06:33:10.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-03-04T06:33:10.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout [osd] 2024-03-04T06:33:10.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-04T06:33:10.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-04T06:33:10.160 INFO:teuthology.orchestra.run.smithi137.stdout:Enabling cephadm module... 2024-03-04T06:33:11.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:11 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2687818439' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-04T06:33:11.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ignoring --setuser ceph since I am not root 2024-03-04T06:33:11.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ignoring --setgroup ceph since I am not root 2024-03-04T06:33:11.620 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:11.593+0000 7f0b94539200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T06:33:11.914 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:11.693+0000 7f0b94539200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T06:33:12.271 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:12 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2687818439' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-04T06:33:12.271 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:12 smithi137 ceph-mon[26846]: mgrmap e5: y(active, since 12s) 2024-03-04T06:33:12.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:12.339+0000 7f0b94539200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T06:33:12.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:12.430+0000 7f0b94539200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T06:33:13.010 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:12.572+0000 7f0b94539200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T06:33:13.010 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:12.666+0000 7f0b94539200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T06:33:13.010 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:12.748+0000 7f0b94539200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T06:33:13.010 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:13.009+0000 7f0b94539200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T06:33:13.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:13 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1997247935' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-04T06:33:13.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:13.122+0000 7f0b94539200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T06:33:13.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:13.208+0000 7f0b94539200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T06:33:13.422 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-03-04T06:33:13.422 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-04T06:33:13.422 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-04T06:33:13.422 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-03-04T06:33:13.422 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-04T06:33:13.422 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-03-04T06:33:13.422 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for the mgr to restart... 2024-03-04T06:33:13.422 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for mgr epoch 5... 2024-03-04T06:33:13.569 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:13.304+0000 7f0b94539200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T06:33:13.569 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:13.483+0000 7f0b94539200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T06:33:14.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:14.448+0000 7f0b94539200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T06:33:14.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:14.577+0000 7f0b94539200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T06:33:15.191 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:14.907+0000 7f0b94539200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T06:33:15.192 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:14.997+0000 7f0b94539200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T06:33:15.192 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:15.191+0000 7f0b94539200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:33:15.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:15.375+0000 7f0b94539200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T06:33:15.913 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:15.655+0000 7f0b94539200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:33:16.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:15.913+0000 7f0b94539200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T06:33:16.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:16.147+0000 7f0b94539200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T06:33:17.229 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:16.945+0000 7f0b94539200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T06:33:17.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:17.516+0000 7f0b94539200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T06:33:17.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:17.613+0000 7f0b94539200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T06:33:18.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:17.836+0000 7f0b94539200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T06:33:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: Active manager daemon y restarted 2024-03-04T06:33:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: Activating manager daemon y 2024-03-04T06:33:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: osdmap e2: 0 total, 0 up, 0 in 2024-03-04T06:33:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: mgrmap e6: y(active, starting, since 0.00327617s) 2024-03-04T06:33:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:33:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:33:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:33:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:33:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:33:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: Manager daemon y is now available 2024-03-04T06:33:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:33:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:33:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:17 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:33:19.173 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:18 smithi137 ceph-mon[26846]: Found migration_current of "None". Setting to last migration. 2024-03-04T06:33:19.173 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:18 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:33:19.173 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:18 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:33:19.173 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:18 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:19.173 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:18 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:19.173 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:18 smithi137 ceph-mon[26846]: mgrmap e7: y(active, since 1.00535s) 2024-03-04T06:33:19.453 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-03-04T06:33:19.453 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-04T06:33:19.453 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-04T06:33:19.453 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-03-04T06:33:19.453 INFO:teuthology.orchestra.run.smithi137.stdout:mgr epoch 5 is available 2024-03-04T06:33:19.453 INFO:teuthology.orchestra.run.smithi137.stdout:Setting orchestrator backend to cephadm... 2024-03-04T06:33:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:19 smithi137 ceph-mon[26846]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-04T06:33:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:19 smithi137 ceph-mon[26846]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-04T06:33:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:19 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:33:20.983 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:20 smithi137 ceph-mon[26846]: [04/Mar/2024:06:33:19] ENGINE Bus STARTING 2024-03-04T06:33:20.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:20 smithi137 ceph-mon[26846]: [04/Mar/2024:06:33:19] ENGINE Serving on https://172.21.15.137:7150 2024-03-04T06:33:20.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:20 smithi137 ceph-mon[26846]: [04/Mar/2024:06:33:19] ENGINE Serving on http://172.21.15.137:8765 2024-03-04T06:33:20.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:20 smithi137 ceph-mon[26846]: [04/Mar/2024:06:33:19] ENGINE Bus STARTED 2024-03-04T06:33:20.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:20 smithi137 ceph-mon[26846]: mgrmap e8: y(active, since 2s) 2024-03-04T06:33:20.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:20 smithi137 ceph-mon[26846]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:33:20.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:20 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:20.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:20 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:33:21.830 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-04T06:33:21.830 INFO:teuthology.orchestra.run.smithi137.stdout:Generating ssh key... 2024-03-04T06:33:22.222 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-mon[26846]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:33:23.276 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: Generating public/private rsa key pair. 2024-03-04T06:33:23.276 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: Your identification has been saved in /tmp/tmpch1q48nj/key. 2024-03-04T06:33:23.276 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: Your public key has been saved in /tmp/tmpch1q48nj/key.pub. 2024-03-04T06:33:23.276 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: The key fingerprint is: 2024-03-04T06:33:23.276 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: SHA256:Okc33rx3wmQr4IM+ABaext58+XfzZbx41pRceALiv2s ceph-d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:33:23.277 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: The key's randomart image is: 2024-03-04T06:33:23.277 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: +---[RSA 3072]----+ 2024-03-04T06:33:23.277 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: | | 2024-03-04T06:33:23.277 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: | . . . | 2024-03-04T06:33:23.277 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: | o o . . . . | 2024-03-04T06:33:23.277 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: | B . o o| 2024-03-04T06:33:23.277 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: | + + S.o. .oo| 2024-03-04T06:33:23.277 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: | . +ooo.+. o+.| 2024-03-04T06:33:23.277 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: | oo.+..o= o=| 2024-03-04T06:33:23.277 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: | oo + E.O+=| 2024-03-04T06:33:23.277 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: | ... +o*o*.| 2024-03-04T06:33:23.277 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: +----[SHA256]-----+ 2024-03-04T06:33:24.167 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:23 smithi137 ceph-mon[26846]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:33:24.167 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:23 smithi137 ceph-mon[26846]: Generating ssh key... 2024-03-04T06:33:24.167 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:23 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:24.167 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:23 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:24.752 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy/JeWl2VJ7qmSpJNktWgmwoC7q8MSBRQDqFdFc1FU2eaVIqQC727nzpxQ+5HXWz6tI/1+m2Deur4gxcZo0TBadMM8X6qvhDezn25dqyB0yfyiLoxWd+BXEW7BMzR3vxCBb2nBGSgLKs4PE3qshrPDXmDmkdm2JwXZrcb6dHFjdf2o0Czdw6fklvzL+ZXTopkOLLQoi1oN4bnuSlQDO9kiZIMGaRgUUFWB9COq+l90GWrTMtSpbsg/+Gundd9+Uc/leLDTBrjrp7VvI/uKdAUPeyTbTv6flr1qFOJnHb+DKkO8nA98YEtVcxIflIWFTuwxiUj8qqSnrgAcMim5BzSmrXVqKmjh+nZVB4joJdQAM0r/bEaBgVvMyaprIRayGedoqJ8hWVXGafT8nBg9Lsfr4fiHa1ChbwI1kL9s1bfeZ4aevve8pZtvEMlgdJLYnAvJ4fnD03dJQY03aBd2RVd5M1ws6U094UjsMNQMjwtpvatHzqMP935xO34XDpi9eOU= ceph-d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:33:24.752 INFO:teuthology.orchestra.run.smithi137.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-04T06:33:24.752 INFO:teuthology.orchestra.run.smithi137.stdout:Adding key to root@localhost authorized_keys... 2024-03-04T06:33:24.753 INFO:teuthology.orchestra.run.smithi137.stdout:Adding host smithi137... 2024-03-04T06:33:26.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:26 smithi137 ceph-mon[26846]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:33:27.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:27 smithi137 ceph-mon[26846]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi137", "addr": "172.21.15.137", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:33:27.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:27 smithi137 ceph-mon[26846]: Deploying cephadm binary to smithi137 2024-03-04T06:33:28.459 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout Added host 'smithi137' with addr '172.21.15.137' 2024-03-04T06:33:28.459 INFO:teuthology.orchestra.run.smithi137.stdout:Deploying unmanaged mon service... 2024-03-04T06:33:29.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:28 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:29.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:28 smithi137 ceph-mon[26846]: Added host smithi137 2024-03-04T06:33:29.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:28 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:33:29.719 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-04T06:33:29.719 INFO:teuthology.orchestra.run.smithi137.stdout:Deploying unmanaged mgr service... 2024-03-04T06:33:30.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:30 smithi137 ceph-mon[26846]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:33:30.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:30 smithi137 ceph-mon[26846]: Saving service mon spec with placement count:5 2024-03-04T06:33:30.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:30 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:31.693 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:31 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:31.693 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:31 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:31.694 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:31 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:31.696 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-04T06:33:32.599 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:32 smithi137 ceph-mon[26846]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:33:32.600 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:32 smithi137 ceph-mon[26846]: Saving service mgr spec with placement count:2 2024-03-04T06:33:32.600 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:32 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1324426529' entity='client.admin' 2024-03-04T06:33:34.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:33 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:34.603 INFO:teuthology.orchestra.run.smithi137.stdout:Enabling the dashboard module... 2024-03-04T06:33:35.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:34 smithi137 ceph-mon[26846]: from='mgr.14120 172.21.15.137:0/1148813430' entity='mgr.y' 2024-03-04T06:33:35.181 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:34 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1188854417' entity='client.admin' 2024-03-04T06:33:36.128 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:36 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1458498524' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-04T06:33:36.128 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ignoring --setuser ceph since I am not root 2024-03-04T06:33:36.128 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ignoring --setgroup ceph since I am not root 2024-03-04T06:33:36.868 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:36.614+0000 7f0c2a7f2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T06:33:36.868 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:36.713+0000 7f0c2a7f2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T06:33:37.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:37 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1458498524' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-04T06:33:37.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:37 smithi137 ceph-mon[26846]: mgrmap e9: y(active, since 18s) 2024-03-04T06:33:37.615 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:37.373+0000 7f0c2a7f2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T06:33:37.616 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:37.471+0000 7f0c2a7f2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T06:33:37.616 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:37.614+0000 7f0c2a7f2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T06:33:37.979 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:37.710+0000 7f0c2a7f2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T06:33:37.979 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:37.793+0000 7f0c2a7f2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T06:33:37.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-03-04T06:33:37.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-04T06:33:37.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-04T06:33:37.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-03-04T06:33:37.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-04T06:33:37.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-03-04T06:33:37.983 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for the mgr to restart... 2024-03-04T06:33:37.983 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for mgr epoch 9... 2024-03-04T06:33:38.263 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:38 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1241578924' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-04T06:33:38.264 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:38.061+0000 7f0c2a7f2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T06:33:38.264 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:38.174+0000 7f0c2a7f2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T06:33:38.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:38.264+0000 7f0c2a7f2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T06:33:38.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:38.365+0000 7f0c2a7f2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T06:33:39.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:38.549+0000 7f0c2a7f2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T06:33:39.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:39.535+0000 7f0c2a7f2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T06:33:39.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:39.662+0000 7f0c2a7f2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T06:33:40.284 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:39.998+0000 7f0c2a7f2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T06:33:40.284 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:40.087+0000 7f0c2a7f2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T06:33:40.284 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:40.282+0000 7f0c2a7f2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:33:40.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:40.467+0000 7f0c2a7f2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T06:33:41.008 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:40.746+0000 7f0c2a7f2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:33:41.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:41.006+0000 7f0c2a7f2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T06:33:41.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:41.240+0000 7f0c2a7f2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T06:33:42.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:42.035+0000 7f0c2a7f2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T06:33:42.919 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:42.606+0000 7f0c2a7f2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T06:33:42.919 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:42.703+0000 7f0c2a7f2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T06:33:42.919 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:33:42.917+0000 7f0c2a7f2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T06:33:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-mon[26846]: Active manager daemon y restarted 2024-03-04T06:33:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-mon[26846]: Activating manager daemon y 2024-03-04T06:33:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-mon[26846]: osdmap e3: 0 total, 0 up, 0 in 2024-03-04T06:33:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-mon[26846]: mgrmap e10: y(active, starting, since 0.00315917s) 2024-03-04T06:33:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:33:43.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:33:43.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:33:43.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:33:43.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:33:43.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-mon[26846]: Manager daemon y is now available 2024-03-04T06:33:43.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:33:43.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:33:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:43 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:33:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:43 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:33:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:43 smithi137 ceph-mon[26846]: mgrmap e11: y(active, since 1.00531s) 2024-03-04T06:33:44.622 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-03-04T06:33:44.622 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-04T06:33:44.622 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-04T06:33:44.622 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-03-04T06:33:44.623 INFO:teuthology.orchestra.run.smithi137.stdout:mgr epoch 9 is available 2024-03-04T06:33:44.623 INFO:teuthology.orchestra.run.smithi137.stdout:Generating a dashboard self-signed certificate... 2024-03-04T06:33:45.039 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:44 smithi137 ceph-mon[26846]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-04T06:33:45.039 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:44 smithi137 ceph-mon[26846]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-04T06:33:45.039 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:44 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:33:45.936 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-04T06:33:45.936 INFO:teuthology.orchestra.run.smithi137.stdout:Creating initial admin user... 2024-03-04T06:33:46.253 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:46 smithi137 ceph-mon[26846]: [04/Mar/2024:06:33:44] ENGINE Bus STARTING 2024-03-04T06:33:46.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:46 smithi137 ceph-mon[26846]: [04/Mar/2024:06:33:44] ENGINE Serving on http://172.21.15.137:8765 2024-03-04T06:33:46.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:46 smithi137 ceph-mon[26846]: [04/Mar/2024:06:33:44] ENGINE Serving on https://172.21.15.137:7150 2024-03-04T06:33:46.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:46 smithi137 ceph-mon[26846]: [04/Mar/2024:06:33:44] ENGINE Bus STARTED 2024-03-04T06:33:46.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:46 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:33:46.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:46 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:33:46.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:46 smithi137 ceph-mon[26846]: mgrmap e12: y(active, since 2s) 2024-03-04T06:33:47.131 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:47 smithi137 ceph-mon[26846]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:33:47.132 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:47 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:33:47.132 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:47 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:33:47.972 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$8yPgPM5DPDjP9oCLzhuz/ehTPSDX5JW53H0XJM6xy2K0b9r4eIWP2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1709534026, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-04T06:33:47.972 INFO:teuthology.orchestra.run.smithi137.stdout:Fetching dashboard port number... 2024-03-04T06:33:48.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:48 smithi137 ceph-mon[26846]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:33:49.630 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 8443 2024-03-04T06:33:49.639 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-04T06:33:49.639 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout disabled 2024-03-04T06:33:49.646 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-04T06:33:49.646 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout inactive 2024-03-04T06:33:49.646 INFO:teuthology.orchestra.run.smithi137.stdout:firewalld.service is not enabled 2024-03-04T06:33:49.646 INFO:teuthology.orchestra.run.smithi137.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-04T06:33:49.647 INFO:teuthology.orchestra.run.smithi137.stdout:Ceph Dashboard is now available at: 2024-03-04T06:33:49.647 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:33:49.648 INFO:teuthology.orchestra.run.smithi137.stdout: URL: https://smithi137.front.sepia.ceph.com:8443/ 2024-03-04T06:33:49.648 INFO:teuthology.orchestra.run.smithi137.stdout: User: admin 2024-03-04T06:33:49.648 INFO:teuthology.orchestra.run.smithi137.stdout: Password: 62sm2hw1qt 2024-03-04T06:33:49.648 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:33:49.648 INFO:teuthology.orchestra.run.smithi137.stdout:Saving cluster configuration to /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config directory 2024-03-04T06:33:49.648 INFO:teuthology.orchestra.run.smithi137.stdout:Enabling autotune for osd_memory_target 2024-03-04T06:33:50.239 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:50 smithi137 ceph-mon[26846]: mgrmap e13: y(active, since 6s) 2024-03-04T06:33:50.239 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:50 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1330824932' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-04T06:33:52.050 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-04T06:33:52.050 INFO:teuthology.orchestra.run.smithi137.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-04T06:33:52.050 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:33:52.050 INFO:teuthology.orchestra.run.smithi137.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-04T06:33:52.050 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:33:52.050 INFO:teuthology.orchestra.run.smithi137.stdout:Or, if you are only running a single cluster on this host: 2024-03-04T06:33:52.051 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:33:52.051 INFO:teuthology.orchestra.run.smithi137.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-04T06:33:52.051 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:33:52.051 INFO:teuthology.orchestra.run.smithi137.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-04T06:33:52.051 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:33:52.051 INFO:teuthology.orchestra.run.smithi137.stdout: ceph telemetry on 2024-03-04T06:33:52.051 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:33:52.051 INFO:teuthology.orchestra.run.smithi137.stdout:For more information see: 2024-03-04T06:33:52.051 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:33:52.051 INFO:teuthology.orchestra.run.smithi137.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-04T06:33:52.051 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:33:52.051 INFO:teuthology.orchestra.run.smithi137.stdout:Bootstrap complete. 2024-03-04T06:33:52.086 INFO:tasks.cephadm:Fetching config... 2024-03-04T06:33:52.086 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:33:52.086 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-04T06:33:52.100 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-04T06:33:52.101 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:33:52.101 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-04T06:33:52.156 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-04T06:33:52.156 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:33:52.156 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/keyring of=/dev/stdout 2024-03-04T06:33:52.223 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-04T06:33:52.223 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:33:52.224 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-04T06:33:52.279 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-04T06:33:52.280 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy/JeWl2VJ7qmSpJNktWgmwoC7q8MSBRQDqFdFc1FU2eaVIqQC727nzpxQ+5HXWz6tI/1+m2Deur4gxcZo0TBadMM8X6qvhDezn25dqyB0yfyiLoxWd+BXEW7BMzR3vxCBb2nBGSgLKs4PE3qshrPDXmDmkdm2JwXZrcb6dHFjdf2o0Czdw6fklvzL+ZXTopkOLLQoi1oN4bnuSlQDO9kiZIMGaRgUUFWB9COq+l90GWrTMtSpbsg/+Gundd9+Uc/leLDTBrjrp7VvI/uKdAUPeyTbTv6flr1qFOJnHb+DKkO8nA98YEtVcxIflIWFTuwxiUj8qqSnrgAcMim5BzSmrXVqKmjh+nZVB4joJdQAM0r/bEaBgVvMyaprIRayGedoqJ8hWVXGafT8nBg9Lsfr4fiHa1ChbwI1kL9s1bfeZ4aevve8pZtvEMlgdJLYnAvJ4fnD03dJQY03aBd2RVd5M1ws6U094UjsMNQMjwtpvatHzqMP935xO34XDpi9eOU= ceph-d83bc156-d9f0-11ee-95c6-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-04T06:33:52.358 INFO:teuthology.orchestra.run.smithi137.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy/JeWl2VJ7qmSpJNktWgmwoC7q8MSBRQDqFdFc1FU2eaVIqQC727nzpxQ+5HXWz6tI/1+m2Deur4gxcZo0TBadMM8X6qvhDezn25dqyB0yfyiLoxWd+BXEW7BMzR3vxCBb2nBGSgLKs4PE3qshrPDXmDmkdm2JwXZrcb6dHFjdf2o0Czdw6fklvzL+ZXTopkOLLQoi1oN4bnuSlQDO9kiZIMGaRgUUFWB9COq+l90GWrTMtSpbsg/+Gundd9+Uc/leLDTBrjrp7VvI/uKdAUPeyTbTv6flr1qFOJnHb+DKkO8nA98YEtVcxIflIWFTuwxiUj8qqSnrgAcMim5BzSmrXVqKmjh+nZVB4joJdQAM0r/bEaBgVvMyaprIRayGedoqJ8hWVXGafT8nBg9Lsfr4fiHa1ChbwI1kL9s1bfeZ4aevve8pZtvEMlgdJLYnAvJ4fnD03dJQY03aBd2RVd5M1ws6U094UjsMNQMjwtpvatHzqMP935xO34XDpi9eOU= ceph-d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:33:52.371 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy/JeWl2VJ7qmSpJNktWgmwoC7q8MSBRQDqFdFc1FU2eaVIqQC727nzpxQ+5HXWz6tI/1+m2Deur4gxcZo0TBadMM8X6qvhDezn25dqyB0yfyiLoxWd+BXEW7BMzR3vxCBb2nBGSgLKs4PE3qshrPDXmDmkdm2JwXZrcb6dHFjdf2o0Czdw6fklvzL+ZXTopkOLLQoi1oN4bnuSlQDO9kiZIMGaRgUUFWB9COq+l90GWrTMtSpbsg/+Gundd9+Uc/leLDTBrjrp7VvI/uKdAUPeyTbTv6flr1qFOJnHb+DKkO8nA98YEtVcxIflIWFTuwxiUj8qqSnrgAcMim5BzSmrXVqKmjh+nZVB4joJdQAM0r/bEaBgVvMyaprIRayGedoqJ8hWVXGafT8nBg9Lsfr4fiHa1ChbwI1kL9s1bfeZ4aevve8pZtvEMlgdJLYnAvJ4fnD03dJQY03aBd2RVd5M1ws6U094UjsMNQMjwtpvatHzqMP935xO34XDpi9eOU= ceph-d83bc156-d9f0-11ee-95c6-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-04T06:33:52.417 INFO:teuthology.orchestra.run.smithi203.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy/JeWl2VJ7qmSpJNktWgmwoC7q8MSBRQDqFdFc1FU2eaVIqQC727nzpxQ+5HXWz6tI/1+m2Deur4gxcZo0TBadMM8X6qvhDezn25dqyB0yfyiLoxWd+BXEW7BMzR3vxCBb2nBGSgLKs4PE3qshrPDXmDmkdm2JwXZrcb6dHFjdf2o0Czdw6fklvzL+ZXTopkOLLQoi1oN4bnuSlQDO9kiZIMGaRgUUFWB9COq+l90GWrTMtSpbsg/+Gundd9+Uc/leLDTBrjrp7VvI/uKdAUPeyTbTv6flr1qFOJnHb+DKkO8nA98YEtVcxIflIWFTuwxiUj8qqSnrgAcMim5BzSmrXVqKmjh+nZVB4joJdQAM0r/bEaBgVvMyaprIRayGedoqJ8hWVXGafT8nBg9Lsfr4fiHa1ChbwI1kL9s1bfeZ4aevve8pZtvEMlgdJLYnAvJ4fnD03dJQY03aBd2RVd5M1ws6U094UjsMNQMjwtpvatHzqMP935xO34XDpi9eOU= ceph-d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:33:52.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-04T06:33:52.644 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:33:52.760 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:52 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/768338698' entity='client.admin' 2024-03-04T06:33:55.473 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:55 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:33:55.473 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:55 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:33:55.473 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:55 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:33:55.473 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:55 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:33:55.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:55 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:33:55.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:55 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:33:55.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:55 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3883402476' entity='client.admin' 2024-03-04T06:33:55.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:55 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:33:55.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:55 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:33:55.725 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-04T06:33:55.725 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-04T06:33:56.309 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:33:58.738 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi203 2024-03-04T06:33:58.738 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-04T06:33:58.739 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.conf 2024-03-04T06:33:58.757 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-04T06:33:58.757 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:33:58.814 INFO:tasks.cephadm:Adding host smithi203 to orchestrator... 2024-03-04T06:33:58.814 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch host add smithi203 2024-03-04T06:33:59.016 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:33:59.137 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:59 smithi137 ceph-mon[26846]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:33:59.137 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:33:59.138 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:33:59.138 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:33:59.138 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:33:59.138 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:59 smithi137 ceph-mon[26846]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:33:59.138 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:33:59.138 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:33:59.138 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:33:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:00.158 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:00 smithi137 ceph-mon[26846]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:34:00.159 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:00 smithi137 ceph-mon[26846]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:34:00.159 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:00 smithi137 ceph-mon[26846]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:34:01.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:01 smithi137 ceph-mon[26846]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:34:02.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:02 smithi137 ceph-mon[26846]: Deploying cephadm binary to smithi203 2024-03-04T06:34:03.223 INFO:teuthology.orchestra.run.smithi137.stdout:Added host 'smithi203' with addr '172.21.15.203' 2024-03-04T06:34:03.784 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch host ls --format=json 2024-03-04T06:34:03.982 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:34:04.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:03 smithi137 ceph-mon[26846]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:04.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:03 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:04.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:03 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:04.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:03 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:05.245 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:04 smithi137 ceph-mon[26846]: Added host smithi203 2024-03-04T06:34:05.245 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:05.246 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:05.551 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:34:05.551 INFO:teuthology.orchestra.run.smithi137.stdout:[{"addr": "172.21.15.137", "hostname": "smithi137", "labels": [], "status": ""}, {"addr": "172.21.15.203", "hostname": "smithi203", "labels": [], "status": ""}] 2024-03-04T06:34:06.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:06 smithi137 ceph-mon[26846]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:06.179 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-04T06:34:06.179 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd crush tunables default 2024-03-04T06:34:06.378 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:34:07.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:07 smithi137 ceph-mon[26846]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:34:08.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:08 smithi137 ceph-mon[26846]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:08.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:08.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:08.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:34:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:08 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3761078682' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-04T06:34:08.721 INFO:teuthology.orchestra.run.smithi137.stderr:adjusted tunables profile to default 2024-03-04T06:34:09.221 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:09 smithi137 ceph-mon[26846]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:34:09.222 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:09 smithi137 ceph-mon[26846]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:34:09.222 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:09.222 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:09.222 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:09.222 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:09 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3761078682' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-04T06:34:09.222 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:09 smithi137 ceph-mon[26846]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T06:34:09.223 INFO:tasks.cephadm:Adding mon.a on smithi137 2024-03-04T06:34:09.223 INFO:tasks.cephadm:Adding mon.c on smithi137 2024-03-04T06:34:09.223 INFO:tasks.cephadm:Adding mon.b on smithi203 2024-03-04T06:34:09.223 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch apply mon '3;smithi137:172.21.15.137=a;smithi137:[v2:172.21.15.137:3301,v1:172.21.15.137:6790]=c;smithi203:172.21.15.203=b' 2024-03-04T06:34:09.416 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:34:10.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:10 smithi137 ceph-mon[26846]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:34:10.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:10 smithi137 ceph-mon[26846]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:34:10.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:10 smithi137 ceph-mon[26846]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:11.042 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mon update... 2024-03-04T06:34:11.627 DEBUG:teuthology.orchestra.run.smithi137:mon.c> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.c.service 2024-03-04T06:34:11.630 DEBUG:teuthology.orchestra.run.smithi203:mon.b> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.b.service 2024-03-04T06:34:11.632 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-04T06:34:11.632 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph mon dump -f json 2024-03-04T06:34:12.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:12 smithi137 ceph-mon[26846]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:12.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:12 smithi137 ceph-mon[26846]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi137:172.21.15.137=a;smithi137:[v2:172.21.15.137:3301,v1:172.21.15.137:6790]=c;smithi203:172.21.15.203=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:34:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:12 smithi137 ceph-mon[26846]: Saving service mon spec with placement smithi137:172.21.15.137=a;smithi137:[v2:172.21.15.137:3301,v1:172.21.15.137:6790]=c;smithi203:172.21.15.203=b;count:3 2024-03-04T06:34:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:12 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:12 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:12 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:12 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:12 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:12 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:12 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:12 smithi137 ceph-mon[26846]: Deploying daemon mon.b on smithi203 2024-03-04T06:34:12.833 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:34:14.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:14 smithi137 ceph-mon[26846]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:15.652 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:34:15.653 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","modified":"2024-03-04T06:32:42.596028Z","created":"2024-03-04T06:32:42.596028Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3300","nonce":0},{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-04T06:34:15.655 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-03-04T06:34:15.949 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:15 smithi203 systemd[1]: Starting Ceph mon.b for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:34:16.470 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 podman[30737]: 2024-03-04 06:34:16.384567381 +0000 UTC m=+0.102936288 container create c1087568a24648aac52339e8dd525c6f333a866bb58884a14166ec7d8a725c91 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=reef-5cc7a76, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-04T06:34:16.470 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 podman[30737]: 2024-03-04 06:34:16.299217016 +0000 UTC m=+0.017585933 image pull 540557f94930c38870197995629adb1ba474514589432062c4a23b4aa6496def quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc 2024-03-04T06:34:16.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:16 smithi137 ceph-mon[26846]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:16.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:16 smithi137 ceph-mon[26846]: from='client.? 172.21.15.203:0/3960512265' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T06:34:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 podman[30737]: 2024-03-04 06:34:16.570333633 +0000 UTC m=+0.288702540 container init c1087568a24648aac52339e8dd525c6f333a866bb58884a14166ec7d8a725c91 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=reef-5cc7a76, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS) 2024-03-04T06:34:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 podman[30737]: 2024-03-04 06:34:16.573313364 +0000 UTC m=+0.291682275 container start c1087568a24648aac52339e8dd525c6f333a866bb58884a14166ec7d8a725c91 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=reef-5cc7a76, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS) 2024-03-04T06:34:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: set uid:gid to 167:167 (ceph:ceph) 2024-03-04T06:34:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable), process ceph-mon, pid 2 2024-03-04T06:34:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: pidfile_write: ignore empty --pid-file 2024-03-04T06:34:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: load: jerasure load: lrc 2024-03-04T06:34:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: RocksDB version: 7.9.2 2024-03-04T06:34:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Git sha 0 2024-03-04T06:34:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Compile date 2024-03-03 15:03:44 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: DB SUMMARY 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: DB Session ID: HO72RT2KTC04SVO8NUPY 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: CURRENT file: CURRENT 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: IDENTITY file: IDENTITY 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 511 ; 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.error_if_exists: 0 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.create_if_missing: 0 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.paranoid_checks: 1 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.env: 0x55d8c8d7a720 2024-03-04T06:34:16.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.fs: PosixFileSystem 2024-03-04T06:34:16.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.info_log: 0x55d8cb7694c0 2024-03-04T06:34:16.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_file_opening_threads: 16 2024-03-04T06:34:16.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.statistics: (nil) 2024-03-04T06:34:16.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.use_fsync: 0 2024-03-04T06:34:16.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_log_file_size: 0 2024-03-04T06:34:16.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-04T06:34:16.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-04T06:34:16.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.keep_log_file_num: 1000 2024-03-04T06:34:16.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.recycle_log_file_num: 0 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.allow_fallocate: 1 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.allow_mmap_reads: 0 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.allow_mmap_writes: 0 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.use_direct_reads: 0 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.create_missing_column_families: 0 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.db_log_dir: 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.wal_dir: 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.advise_random_on_open: 1 2024-03-04T06:34:16.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.db_write_buffer_size: 0 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.write_buffer_manager: 0x55d8ca9da140 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.rate_limiter: (nil) 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.wal_recovery_mode: 2 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.enable_thread_tracking: 0 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.enable_pipelined_write: 0 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.unordered_write: 0 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-04T06:34:16.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.row_cache: None 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.wal_filter: None 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.allow_ingest_behind: 0 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.two_write_queues: 0 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.manual_wal_flush: 0 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.wal_compression: 0 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.atomic_flush: 0 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.log_readahead_size: 0 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.best_efforts_recovery: 0 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-04T06:34:16.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.allow_data_in_errors: 0 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.db_host_id: __hostname__ 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_background_jobs: 2 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_background_compactions: -1 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_subcompactions: 1 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_total_wal_size: 0 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_open_files: -1 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.bytes_per_sync: 0 2024-03-04T06:34:16.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compaction_readahead_size: 0 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_background_flushes: -1 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Compression algorithms supported: 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: kZSTD supported: 0 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: kXpressCompression supported: 0 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: kLZ4HCCompression supported: 1 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: kZlibCompression supported: 1 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: kSnappyCompression supported: 1 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: kLZ4Compression supported: 1 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: kBZip2Compression supported: 0 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-04T06:34:16.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.merge_operator: 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compaction_filter: None 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compaction_filter_factory: None 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.sst_partitioner_factory: None 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d8cb7695c0) 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout: cache_index_and_filter_blocks: 1 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout: pin_top_level_index_and_filter: 1 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout: index_type: 0 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout: data_block_index_type: 0 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout: index_shortening: 1 2024-03-04T06:34:16.855 INFO:journalctl@ceph.mon.b.smithi203.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: checksum: 4 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: no_block_cache: 0 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_cache: 0x55d8caa7b1f0 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_cache_name: BinnedLRUCache 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_cache_options: 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: capacity : 536870912 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: num_shard_bits : 4 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: strict_capacity_limit : 0 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: high_pri_pool_ratio: 0.000 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_cache_compressed: (nil) 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: persistent_cache: (nil) 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_size: 4096 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_size_deviation: 10 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_restart_interval: 16 2024-03-04T06:34:16.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: index_block_restart_interval: 1 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: metadata_block_size: 4096 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: partition_filters: 0 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: use_delta_encoding: 1 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: filter_policy: bloomfilter 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: whole_key_filtering: 1 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: verify_compression: 0 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: read_amp_bytes_per_bit: 0 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: format_version: 5 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: enable_index_compression: 1 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_align: 0 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: max_auto_readahead_size: 262144 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: prepopulate_block_cache: 0 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: initial_auto_readahead_size: 8192 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: num_file_reads_for_auto_readahead: 2 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.write_buffer_size: 33554432 2024-03-04T06:34:16.857 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_write_buffer_number: 2 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compression: NoCompression 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.bottommost_compression: Disabled 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.prefix_extractor: nullptr 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.num_levels: 7 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-04T06:34:16.858 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compression_opts.level: 32767 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compression_opts.strategy: 0 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compression_opts.enabled: false 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.target_file_size_base: 67108864 2024-03-04T06:34:16.859 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.arena_block_size: 1048576 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-04T06:34:16.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.disable_auto_compactions: 0 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.table_properties_collectors: 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.inplace_update_support: 0 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-04T06:34:16.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.bloom_locality: 0 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.max_successive_merges: 0 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.paranoid_file_checks: 0 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.force_consistency_checks: 1 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.report_bg_io_stats: 0 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.ttl: 2592000 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.enable_blob_files: false 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.min_blob_size: 0 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.blob_file_size: 268435456 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-04T06:34:16.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.blob_file_starting_level: 0 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c6147200-c21d-4ff7-94c5-2fe598fef76e 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534056603520, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534056604073, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709534056, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c6147200-c21d-4ff7-94c5-2fe598fef76e", "db_session_id": "HO72RT2KTC04SVO8NUPY", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534056604179, "job": 1, "event": "recovery_finished"} 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d8cab18000 2024-03-04T06:34:16.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: DB pointer 0x55d8cab06000 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout: ** DB Stats ** 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout: ** Compaction Stats [default] ** 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-04T06:34:16.864 INFO:journalctl@ceph.mon.b.smithi203.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: ** Compaction Stats [default] ** 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-04T06:34:16.865 INFO:journalctl@ceph.mon.b.smithi203.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout: Interval compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout: Block cache BinnedLRUCache@0x55d8caa7b1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: using public_addr v2:172.21.15.203:0/0 -> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: starting mon.b rank -1 at public addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] at bind addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(???) e0 preinit fsid d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(synchronizing).mds e1 new map 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(synchronizing).mds e1 print_map 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout: e1 2024-03-04T06:34:16.866 INFO:journalctl@ceph.mon.b.smithi203.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout: legacy client fscid: -1 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout: No filesystems configured 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:34:16.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3761078682' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3761078682' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T06:34:16.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi137:172.21.15.137=a;smithi137:[v2:172.21.15.137:3301,v1:172.21.15.137:6790]=c;smithi203:172.21.15.203=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: Saving service mon spec with placement smithi137:172.21.15.137=a;smithi137:[v2:172.21.15.137:3301,v1:172.21.15.137:6790]=c;smithi203:172.21.15.203=b;count:3 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: Deploying daemon mon.b on smithi203 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:16.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: from='client.? 172.21.15.203:0/3960512265' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T06:34:16.870 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 ceph-mon[30756]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-04T06:34:16.870 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 bash[30737]: c1087568a24648aac52339e8dd525c6f333a866bb58884a14166ec7d8a725c91 2024-03-04T06:34:16.870 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:16 smithi203 systemd[1]: Started Ceph mon.b for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:34:17.206 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-04T06:34:17.206 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph mon dump -f json 2024-03-04T06:34:17.408 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:34:22.027 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:34:22.027 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":2,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","modified":"2024-03-04T06:34:16.628231Z","created":"2024-03-04T06:32:42.596028Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3300","nonce":0},{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-04T06:34:22.027 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:34:22.027 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:22.027 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: mon.a calling monitor election 2024-03-04T06:34:22.027 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:22.027 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:22.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:22.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: mon.b calling monitor election 2024-03-04T06:34:22.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:22.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:22.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:22.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:22.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:22.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-04T06:34:22.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: monmap e2: 2 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:34:22.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: fsmap 2024-03-04T06:34:22.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T06:34:22.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: mgrmap e13: y(active, since 38s) 2024-03-04T06:34:22.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: overall HEALTH_OK 2024-03-04T06:34:22.029 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:22.029 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:22.029 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:22.029 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:22.029 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:22.029 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 2 2024-03-04T06:34:22.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:34:22.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:22.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: mon.a calling monitor election 2024-03-04T06:34:22.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:22.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:22.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: mon.b calling monitor election 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: monmap e2: 2 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: fsmap 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: mgrmap e13: y(active, since 38s) 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: overall HEALTH_OK 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:22.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:22.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:22.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:23.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:22 smithi137 ceph-mon[26846]: Deploying daemon mon.c on smithi137 2024-03-04T06:34:23.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:22 smithi137 ceph-mon[26846]: from='client.? 172.21.15.203:0/1992621755' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T06:34:23.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:22 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:23.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:22 smithi203 ceph-mon[30756]: Deploying daemon mon.c on smithi137 2024-03-04T06:34:23.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:22 smithi203 ceph-mon[30756]: from='client.? 172.21.15.203:0/1992621755' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T06:34:23.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:22 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:23.648 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-04T06:34:23.649 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph mon dump -f json 2024-03-04T06:34:23.863 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:34:23.986 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:23 smithi203 ceph-mon[30756]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:24.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:23 smithi137 ceph-mon[26846]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:24.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 systemd[1]: Starting Ceph mon.c for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:34:24.822 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 podman[37337]: 2024-03-04 06:34:24.715148255 +0000 UTC m=+0.110210836 container create 63f51a40232d4b89850f48423548f614a5df5626e3a82eeed49dbbb1361e056b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-5cc7a76, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-04T06:34:24.822 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 podman[37337]: 2024-03-04 06:34:24.622466093 +0000 UTC m=+0.017528686 image pull 540557f94930c38870197995629adb1ba474514589432062c4a23b4aa6496def quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc 2024-03-04T06:34:25.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 podman[37337]: 2024-03-04 06:34:24.925894873 +0000 UTC m=+0.320957462 container init 63f51a40232d4b89850f48423548f614a5df5626e3a82eeed49dbbb1361e056b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=reef-5cc7a76, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222) 2024-03-04T06:34:25.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 podman[37337]: 2024-03-04 06:34:24.928952754 +0000 UTC m=+0.324015343 container start 63f51a40232d4b89850f48423548f614a5df5626e3a82eeed49dbbb1361e056b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=reef-5cc7a76, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-04T06:34:25.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: set uid:gid to 167:167 (ceph:ceph) 2024-03-04T06:34:25.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable), process ceph-mon, pid 2 2024-03-04T06:34:25.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: pidfile_write: ignore empty --pid-file 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: load: jerasure load: lrc 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: RocksDB version: 7.9.2 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Git sha 0 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Compile date 2024-03-03 15:03:44 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: DB SUMMARY 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: DB Session ID: XRZ1LKY39A4PFXOG5KJ7 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: CURRENT file: CURRENT 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: IDENTITY file: IDENTITY 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 636 ; 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.error_if_exists: 0 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.create_if_missing: 0 2024-03-04T06:34:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.paranoid_checks: 1 2024-03-04T06:34:25.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-04T06:34:25.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-04T06:34:25.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-04T06:34:25.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.env: 0x564d7bf61720 2024-03-04T06:34:25.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.fs: PosixFileSystem 2024-03-04T06:34:25.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.info_log: 0x564d7f25b4c0 2024-03-04T06:34:25.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_file_opening_threads: 16 2024-03-04T06:34:25.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.statistics: (nil) 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.use_fsync: 0 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_log_file_size: 0 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.keep_log_file_num: 1000 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.recycle_log_file_num: 0 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.allow_fallocate: 1 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.allow_mmap_reads: 0 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.allow_mmap_writes: 0 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.use_direct_reads: 0 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.create_missing_column_families: 0 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.db_log_dir: 2024-03-04T06:34:25.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.wal_dir: 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.advise_random_on_open: 1 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.db_write_buffer_size: 0 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.write_buffer_manager: 0x564d7e4cc140 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.rate_limiter: (nil) 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-04T06:34:25.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.wal_recovery_mode: 2 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.enable_thread_tracking: 0 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.enable_pipelined_write: 0 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.unordered_write: 0 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.row_cache: None 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.wal_filter: None 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.allow_ingest_behind: 0 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.two_write_queues: 0 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.manual_wal_flush: 0 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.wal_compression: 0 2024-03-04T06:34:25.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.atomic_flush: 0 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.log_readahead_size: 0 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.best_efforts_recovery: 0 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.allow_data_in_errors: 0 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.db_host_id: __hostname__ 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_background_jobs: 2 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_background_compactions: -1 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_subcompactions: 1 2024-03-04T06:34:25.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_total_wal_size: 0 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_open_files: -1 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.bytes_per_sync: 0 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compaction_readahead_size: 0 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_background_flushes: -1 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Compression algorithms supported: 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-04T06:34:25.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: kZSTD supported: 0 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: kXpressCompression supported: 0 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: kLZ4HCCompression supported: 1 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: kZlibCompression supported: 1 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: kSnappyCompression supported: 1 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: kLZ4Compression supported: 1 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: kBZip2Compression supported: 0 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.merge_operator: 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compaction_filter: None 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compaction_filter_factory: None 2024-03-04T06:34:25.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.sst_partitioner_factory: None 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564d7f25b5c0) 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: cache_index_and_filter_blocks: 1 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: pin_top_level_index_and_filter: 1 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: index_type: 0 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: data_block_index_type: 0 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: index_shortening: 1 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: checksum: 4 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: no_block_cache: 0 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_cache: 0x564d7e56d1f0 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_cache_name: BinnedLRUCache 2024-03-04T06:34:25.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_cache_options: 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: capacity : 536870912 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: num_shard_bits : 4 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: strict_capacity_limit : 0 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: high_pri_pool_ratio: 0.000 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_cache_compressed: (nil) 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: persistent_cache: (nil) 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_size: 4096 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_size_deviation: 10 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_restart_interval: 16 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: index_block_restart_interval: 1 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: metadata_block_size: 4096 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: partition_filters: 0 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: use_delta_encoding: 1 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: filter_policy: bloomfilter 2024-03-04T06:34:25.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: whole_key_filtering: 1 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: verify_compression: 0 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: read_amp_bytes_per_bit: 0 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: format_version: 5 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: enable_index_compression: 1 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_align: 0 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: max_auto_readahead_size: 262144 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: prepopulate_block_cache: 0 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: initial_auto_readahead_size: 8192 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: num_file_reads_for_auto_readahead: 2 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.write_buffer_size: 33554432 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_write_buffer_number: 2 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compression: NoCompression 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.bottommost_compression: Disabled 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.prefix_extractor: nullptr 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-04T06:34:25.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.num_levels: 7 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compression_opts.level: 32767 2024-03-04T06:34:25.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compression_opts.strategy: 0 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compression_opts.enabled: false 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.target_file_size_base: 67108864 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-04T06:34:25.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.arena_block_size: 1048576 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.disable_auto_compactions: 0 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-04T06:34:25.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.table_properties_collectors: 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.inplace_update_support: 0 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.bloom_locality: 0 2024-03-04T06:34:25.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.max_successive_merges: 0 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.paranoid_file_checks: 0 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.force_consistency_checks: 1 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.report_bg_io_stats: 0 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.ttl: 2592000 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.enable_blob_files: false 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.min_blob_size: 0 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.blob_file_size: 268435456 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-04T06:34:25.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.blob_file_starting_level: 0 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 06277ad3-8ea4-4637-a751-ef7266e44b2a 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534064958920, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534064959331, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709534064, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "06277ad3-8ea4-4637-a751-ef7266e44b2a", "db_session_id": "XRZ1LKY39A4PFXOG5KJ7", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534064959410, "job": 1, "event": "recovery_finished"} 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564d7e60a000 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: DB pointer 0x564d7e5f8000 2024-03-04T06:34:25.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: ** DB Stats ** 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: ** Compaction Stats [default] ** 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T06:34:25.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: ** Compaction Stats [default] ** 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-04T06:34:25.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: Cumulative compaction: 0.00 GB write, 0.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: Interval compaction: 0.00 GB write, 0.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: Block cache BinnedLRUCache@0x564d7e56d1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: using public_addrv [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: starting mon.c rank -1 at public addrs [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] at bind addrs [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(???) e0 preinit fsid d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(synchronizing).mds e1 new map 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(synchronizing).mds e1 print_map 2024-03-04T06:34:25.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: e1 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: legacy client fscid: -1 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: No filesystems configured 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T06:34:25.315 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3761078682' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:25.316 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3761078682' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi137:172.21.15.137=a;smithi137:[v2:172.21.15.137:3301,v1:172.21.15.137:6790]=c;smithi203:172.21.15.203=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: Saving service mon spec with placement smithi137:172.21.15.137=a;smithi137:[v2:172.21.15.137:3301,v1:172.21.15.137:6790]=c;smithi203:172.21.15.203=b;count:3 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:25.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: Deploying daemon mon.b on smithi203 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='client.? 172.21.15.203:0/3960512265' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.a calling monitor election 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.b calling monitor election 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:25.318 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: monmap e2: 2 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: fsmap 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mgrmap e13: y(active, since 38s) 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: overall HEALTH_OK 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: Deploying daemon mon.c on smithi137 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='client.? 172.21.15.203:0/1992621755' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T06:34:25.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:25.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:25.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:24 smithi137 ceph-mon[37364]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-04T06:34:25.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:25 smithi137 bash[37337]: 63f51a40232d4b89850f48423548f614a5df5626e3a82eeed49dbbb1361e056b 2024-03-04T06:34:25.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:25 smithi137 systemd[1]: Started Ceph mon.c for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:34:30.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:30.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:34:30.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: mon.a calling monitor election 2024-03-04T06:34:30.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: mon.b calling monitor election 2024-03-04T06:34:30.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:30.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:30.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: mon.c calling monitor election 2024-03-04T06:34:30.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:30.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-04T06:34:30.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: monmap e3: 3 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0],c=[v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:34:30.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: fsmap 2024-03-04T06:34:30.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T06:34:30.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: mgrmap e13: y(active, since 47s) 2024-03-04T06:34:30.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: overall HEALTH_OK 2024-03-04T06:34:30.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:30.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:30.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:30.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:30.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: mon.a calling monitor election 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: mon.b calling monitor election 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: mon.c calling monitor election 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-04T06:34:30.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: monmap e3: 3 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0],c=[v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:34:30.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: fsmap 2024-03-04T06:34:30.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T06:34:30.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: mgrmap e13: y(active, since 47s) 2024-03-04T06:34:30.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: overall HEALTH_OK 2024-03-04T06:34:30.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:30.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:30.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:30.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:34:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: mon.a calling monitor election 2024-03-04T06:34:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: mon.b calling monitor election 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: mon.c calling monitor election 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: monmap e3: 3 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0],c=[v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: fsmap 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T06:34:30.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: mgrmap e13: y(active, since 47s) 2024-03-04T06:34:30.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: overall HEALTH_OK 2024-03-04T06:34:30.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:30.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:30.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:30.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:31.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:31 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:31.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:31 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:31.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:31 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:31.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:31 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:31.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:31 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:31.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:31 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:34:31.669 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-04T06:34:31.669 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":3,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","modified":"2024-03-04T06:34:24.981312Z","created":"2024-03-04T06:32:42.596028Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3300","nonce":0},{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3301","nonce":0},{"type":"v1","addr":"172.21.15.137:6790","nonce":0}]},"addr":"172.21.15.137:6790/0","public_addr":"172.21.15.137:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-04T06:34:31.671 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 3 2024-03-04T06:34:32.267 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:32.267 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.267 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.267 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.267 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.267 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:32.267 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:32.268 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='client.? 172.21.15.203:0/2047031343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T06:34:32.268 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.268 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.268 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.268 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.268 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.268 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.268 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.268 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.268 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.268 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:32.268 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:34:32.268 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:32 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:32.290 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-04T06:34:32.290 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph config generate-minimal-conf 2024-03-04T06:34:32.358 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:32.358 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.358 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.358 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.358 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.358 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:32.358 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:32.358 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='client.? 172.21.15.203:0/2047031343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T06:34:32.358 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.358 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.358 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.358 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.359 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.359 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.359 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.359 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.359 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.359 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:32.359 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:34:32.359 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:32.359 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:32.359 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.359 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='client.? 172.21.15.203:0/2047031343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.360 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:32.361 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:32.361 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:34:32.361 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:32 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:33.296 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:34:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:33 smithi203 ceph-mon[30756]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:34:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:33 smithi203 ceph-mon[30756]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:34:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:33 smithi203 ceph-mon[30756]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:34:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:33 smithi203 ceph-mon[30756]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:34:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:33 smithi203 ceph-mon[30756]: Reconfiguring mon.a (unknown last config time)... 2024-03-04T06:34:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:33 smithi203 ceph-mon[30756]: Reconfiguring daemon mon.a on smithi137 2024-03-04T06:34:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:33 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:33.391 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[26846]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:34:33.392 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[26846]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:34:33.392 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[26846]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:34:33.392 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[26846]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:34:33.392 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[26846]: Reconfiguring mon.a (unknown last config time)... 2024-03-04T06:34:33.392 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[26846]: Reconfiguring daemon mon.a on smithi137 2024-03-04T06:34:33.392 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:33.393 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[37364]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:34:33.393 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[37364]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:34:33.393 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[37364]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:34:33.393 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[37364]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:34:33.393 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[37364]: Reconfiguring mon.a (unknown last config time)... 2024-03-04T06:34:33.393 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[37364]: Reconfiguring daemon mon.a on smithi137 2024-03-04T06:34:33.394 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:33 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:34 smithi203 ceph-mon[30756]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:34 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:34 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:34 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:34 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:34:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:34 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:34.392 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:34 smithi137 ceph-mon[26846]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:34.392 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:34 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:34.392 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:34 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:34.392 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:34 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:34.392 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:34 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:34:34.392 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:34 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:34.392 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:34 smithi137 ceph-mon[37364]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:34.393 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:34 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:34.393 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:34 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:34.393 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:34 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:34.393 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:34 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:34:34.393 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:34 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:35.162 INFO:teuthology.orchestra.run.smithi137.stdout:# minimal ceph.conf for d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:34:35.163 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-03-04T06:34:35.163 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:34:35.163 INFO:teuthology.orchestra.run.smithi137.stdout: mon_host = [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] 2024-03-04T06:34:35.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:35 smithi137 ceph-mon[26846]: Reconfiguring mon.c (monmap changed)... 2024-03-04T06:34:35.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:35 smithi137 ceph-mon[26846]: Reconfiguring daemon mon.c on smithi137 2024-03-04T06:34:35.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:35 smithi137 ceph-mon[37364]: Reconfiguring mon.c (monmap changed)... 2024-03-04T06:34:35.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:35 smithi137 ceph-mon[37364]: Reconfiguring daemon mon.c on smithi137 2024-03-04T06:34:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:35 smithi203 ceph-mon[30756]: Reconfiguring mon.c (monmap changed)... 2024-03-04T06:34:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:35 smithi203 ceph-mon[30756]: Reconfiguring daemon mon.c on smithi137 2024-03-04T06:34:35.972 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-04T06:34:36.009 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:34:36.009 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.conf 2024-03-04T06:34:36.038 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:34:36.038 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:34:36.105 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-04T06:34:36.105 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.conf 2024-03-04T06:34:36.139 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-04T06:34:36.139 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:34:36.209 INFO:tasks.cephadm:Adding mgr.y on smithi137 2024-03-04T06:34:36.210 INFO:tasks.cephadm:Adding mgr.x on smithi203 2024-03-04T06:34:36.210 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch apply mgr '2;smithi137=y;smithi203=x' 2024-03-04T06:34:36.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:36 smithi137 ceph-mon[37364]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:36.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:36 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1810709814' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:36.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:36 smithi137 ceph-mon[26846]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:36.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:36 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1810709814' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:36.449 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:34:36.571 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:36 smithi203 ceph-mon[30756]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:36.571 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:36 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1810709814' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:37.490 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:37 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:37.490 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:37 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:37.490 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:37 smithi203 ceph-mon[30756]: Reconfiguring mon.b (monmap changed)... 2024-03-04T06:34:37.490 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:37 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:37.490 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:37 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:34:37.490 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:37 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:37.490 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:37 smithi203 ceph-mon[30756]: Reconfiguring daemon mon.b on smithi203 2024-03-04T06:34:37.490 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:37 smithi203 ceph-mon[30756]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:37.642 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:37.642 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:37.642 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[26846]: Reconfiguring mon.b (monmap changed)... 2024-03-04T06:34:37.642 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:37.642 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:34:37.642 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:37.642 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[26846]: Reconfiguring daemon mon.b on smithi203 2024-03-04T06:34:37.643 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[26846]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:37.643 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:37.643 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:37.643 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[37364]: Reconfiguring mon.b (monmap changed)... 2024-03-04T06:34:37.643 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:34:37.643 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:34:37.643 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:37.643 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[37364]: Reconfiguring daemon mon.b on smithi203 2024-03-04T06:34:37.643 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:37 smithi137 ceph-mon[37364]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:39.151 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mgr update... 2024-03-04T06:34:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:39 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:39 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:39 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:39 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:39 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:39 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:39.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:39 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:39.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:39 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:39.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:39 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:39.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:39 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:39.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:39 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:39.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:39 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:39 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:39 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:39 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:39 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:39 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:39 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:39.695 DEBUG:teuthology.orchestra.run.smithi203:mgr.x> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.x.service 2024-03-04T06:34:39.697 INFO:tasks.cephadm:Deploying OSDs... 2024-03-04T06:34:39.697 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:34:39.698 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-03-04T06:34:39.716 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-04T06:34:39.716 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-03-04T06:34:39.775 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-04T06:34:39.775 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T06:34:39.775 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-03-04T06:34:39.775 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T06:34:39.775 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T06:34:39.775 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-03-04 06:34:24.427964794 +0000 2024-03-04T06:34:39.775 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-03-04 06:29:03.374721012 +0000 2024-03-04T06:34:39.776 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-03-04 06:29:03.374721012 +0000 2024-03-04T06:34:39.776 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-03-04 06:29:03.374721012 +0000 2024-03-04T06:34:39.776 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-04T06:34:39.845 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-03-04T06:34:39.845 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-03-04T06:34:39.845 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000267223 s, 1.9 MB/s 2024-03-04T06:34:39.846 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-04T06:34:39.903 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-03-04T06:34:39.960 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-04T06:34:39.960 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T06:34:39.960 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-03-04T06:34:39.960 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T06:34:39.961 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T06:34:39.961 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-03-04 06:34:24.427964794 +0000 2024-03-04T06:34:39.961 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-03-04 06:29:03.711715084 +0000 2024-03-04T06:34:39.961 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-03-04 06:29:03.711715084 +0000 2024-03-04T06:34:39.961 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-03-04 06:29:03.711715084 +0000 2024-03-04T06:34:39.961 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-04T06:34:40.027 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-03-04T06:34:40.028 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-03-04T06:34:40.028 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000222416 s, 2.3 MB/s 2024-03-04T06:34:40.029 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-04T06:34:40.085 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-03-04T06:34:40.141 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-04T06:34:40.141 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T06:34:40.141 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-04T06:34:40.141 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T06:34:40.142 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T06:34:40.142 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-03-04 06:34:24.427964794 +0000 2024-03-04T06:34:40.142 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-03-04 06:29:04.036709368 +0000 2024-03-04T06:34:40.142 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-03-04 06:29:04.036709368 +0000 2024-03-04T06:34:40.142 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-03-04 06:29:04.036709368 +0000 2024-03-04T06:34:40.142 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-04T06:34:40.208 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-03-04T06:34:40.208 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-03-04T06:34:40.208 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.00019044 s, 2.7 MB/s 2024-03-04T06:34:40.209 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-04T06:34:40.265 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-03-04T06:34:40.320 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-04T06:34:40.320 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T06:34:40.320 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-03-04T06:34:40.320 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T06:34:40.320 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T06:34:40.320 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-03-04 06:34:24.428964777 +0000 2024-03-04T06:34:40.320 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-03-04 06:29:04.379703335 +0000 2024-03-04T06:34:40.320 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-03-04 06:29:04.379703335 +0000 2024-03-04T06:34:40.320 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-03-04 06:29:04.379703335 +0000 2024-03-04T06:34:40.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-04T06:34:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:40 smithi203 ceph-mon[30756]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:40 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:40 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:40 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:40 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:40 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:40 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:34:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:40 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-04T06:34:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:40 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:34:40.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:40 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:40.383 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[37364]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:40.384 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:40.384 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:40.384 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:40.384 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:40.384 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:40.384 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:34:40.384 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-04T06:34:40.384 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:34:40.384 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:40.384 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[26846]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:40.384 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:40.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:40.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:40.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:40.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:40.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:34:40.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-04T06:34:40.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:34:40.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:40 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:40.386 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-03-04T06:34:40.386 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-03-04T06:34:40.386 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000202642 s, 2.5 MB/s 2024-03-04T06:34:40.387 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-04T06:34:40.443 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-04T06:34:40.443 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/scratch_devs of=/dev/stdout 2024-03-04T06:34:40.460 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-04T06:34:40.461 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_1 2024-03-04T06:34:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-04T06:34:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T06:34:40.517 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-03-04T06:34:40.517 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T06:34:40.517 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T06:34:40.517 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-03-04 06:34:15.663413335 +0000 2024-03-04T06:34:40.517 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-03-04 06:29:03.347346466 +0000 2024-03-04T06:34:40.517 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-03-04 06:29:03.347346466 +0000 2024-03-04T06:34:40.517 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-03-04 06:29:03.347346466 +0000 2024-03-04T06:34:40.518 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-04T06:34:40.585 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-03-04T06:34:40.585 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-03-04T06:34:40.585 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000205381 s, 2.5 MB/s 2024-03-04T06:34:40.586 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-04T06:34:40.642 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_2 2024-03-04T06:34:40.697 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-04T06:34:40.698 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T06:34:40.698 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-03-04T06:34:40.698 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T06:34:40.698 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T06:34:40.698 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-03-04 06:34:15.664413311 +0000 2024-03-04T06:34:40.698 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-03-04 06:29:03.704338083 +0000 2024-03-04T06:34:40.698 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-03-04 06:29:03.705338059 +0000 2024-03-04T06:34:40.698 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-03-04 06:29:03.704338083 +0000 2024-03-04T06:34:40.698 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-04T06:34:40.834 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-03-04T06:34:40.835 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-03-04T06:34:40.835 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000189255 s, 2.7 MB/s 2024-03-04T06:34:40.836 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-04T06:34:40.851 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_3 2024-03-04T06:34:40.908 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-04T06:34:40.908 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T06:34:40.908 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-03-04T06:34:40.908 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T06:34:40.908 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T06:34:40.908 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-03-04 06:34:40.790820680 +0000 2024-03-04T06:34:40.908 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-03-04 06:29:04.061329699 +0000 2024-03-04T06:34:40.908 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-03-04 06:29:04.061329699 +0000 2024-03-04T06:34:40.909 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-03-04 06:29:04.061329699 +0000 2024-03-04T06:34:40.909 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-04T06:34:41.020 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-03-04T06:34:41.021 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-03-04T06:34:41.021 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000190912 s, 2.7 MB/s 2024-03-04T06:34:41.022 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-04T06:34:41.036 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_4 2024-03-04T06:34:41.092 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-04T06:34:41.092 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T06:34:41.092 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-03-04T06:34:41.092 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T06:34:41.092 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T06:34:41.092 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-03-04 06:34:40.977816269 +0000 2024-03-04T06:34:41.093 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-03-04 06:29:04.395321855 +0000 2024-03-04T06:34:41.093 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-03-04 06:29:04.395321855 +0000 2024-03-04T06:34:41.093 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-03-04 06:29:04.395321855 +0000 2024-03-04T06:34:41.093 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-04T06:34:41.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:41 smithi203 systemd[1]: Starting Ceph mgr.x for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:34:41.125 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-03-04T06:34:41.125 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-03-04T06:34:41.125 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000199567 s, 2.6 MB/s 2024-03-04T06:34:41.126 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-04T06:34:41.182 INFO:tasks.cephadm:Deploying osd.0 on smithi137 with /dev/vg_nvme/lv_4... 2024-03-04T06:34:41.182 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-04T06:34:41.366 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:41 smithi203 ceph-mon[30756]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi137=y;smithi203=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:34:41.367 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:41 smithi203 ceph-mon[30756]: Saving service mgr spec with placement smithi137=y;smithi203=x;count:2 2024-03-04T06:34:41.367 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:41 smithi203 ceph-mon[30756]: Deploying daemon mgr.x on smithi203 2024-03-04T06:34:41.367 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:41 smithi203 podman[32620]: 2024-03-04 06:34:41.251465083 +0000 UTC m=+0.101302928 container create 994a02c2e1ef0687a0e4a93f5549c6833b3257e9d97767c548b674ef9b11920b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=reef-5cc7a76, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-04T06:34:41.367 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:41 smithi203 podman[32620]: 2024-03-04 06:34:41.168436405 +0000 UTC m=+0.018274260 image pull 540557f94930c38870197995629adb1ba474514589432062c4a23b4aa6496def quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc 2024-03-04T06:34:41.388 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:34:41.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:41 smithi137 ceph-mon[26846]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi137=y;smithi203=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:34:41.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:41 smithi137 ceph-mon[26846]: Saving service mgr spec with placement smithi137=y;smithi203=x;count:2 2024-03-04T06:34:41.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:41 smithi137 ceph-mon[26846]: Deploying daemon mgr.x on smithi203 2024-03-04T06:34:41.506 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:41 smithi137 ceph-mon[37364]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi137=y;smithi203=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:34:41.506 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:41 smithi137 ceph-mon[37364]: Saving service mgr spec with placement smithi137=y;smithi203=x;count:2 2024-03-04T06:34:41.506 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:41 smithi137 ceph-mon[37364]: Deploying daemon mgr.x on smithi203 2024-03-04T06:34:41.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:41 smithi203 podman[32620]: 2024-03-04 06:34:41.462179302 +0000 UTC m=+0.312017148 container init 994a02c2e1ef0687a0e4a93f5549c6833b3257e9d97767c548b674ef9b11920b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=reef-5cc7a76, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:34:41.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:41 smithi203 podman[32620]: 2024-03-04 06:34:41.464859759 +0000 UTC m=+0.314697596 container start 994a02c2e1ef0687a0e4a93f5549c6833b3257e9d97767c548b674ef9b11920b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, GIT_CLEAN=True, RELEASE=reef-5cc7a76, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-03-04T06:34:41.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:41 smithi203 ceph-mgr[32658]: -- 172.21.15.203:0/2240844464 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55afcc0111e0 con 0x55afcbfe7000 2024-03-04T06:34:41.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:41 smithi203 bash[32620]: 994a02c2e1ef0687a0e4a93f5549c6833b3257e9d97767c548b674ef9b11920b 2024-03-04T06:34:41.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:41 smithi203 systemd[1]: Started Ceph mgr.x for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:34:42.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:42.023+0000 7fc0fc044200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T06:34:42.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:42.127+0000 7fc0fc044200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T06:34:42.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:42 smithi203 ceph-mon[30756]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:42.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:42 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:42.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:42 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:42.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:42 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:42.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:42 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:42.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:42 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:42.368 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:42 smithi137 ceph-mon[26846]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:42.368 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:42.368 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:42.368 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:42.369 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:42.369 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:42.369 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:42 smithi137 ceph-mon[37364]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:42.369 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:42 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:42.369 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:42 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:42.369 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:42 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:42.369 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:42 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:42.369 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:42 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:43.026 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:42.783+0000 7fc0fc044200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T06:34:43.026 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:42.878+0000 7fc0fc044200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T06:34:43.245 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-04T06:34:43.246 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-04T06:34:43.246 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2024-03-04T06:34:43.246 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2024-03-04T06:34:43.246 INFO:teuthology.orchestra.run.smithi137.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124659 s, 841 MB/s 2024-03-04T06:34:43.246 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2024-03-04T06:34:43.279 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:43.024+0000 7fc0fc044200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T06:34:43.279 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:43.124+0000 7fc0fc044200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T06:34:43.279 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:43.207+0000 7fc0fc044200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T06:34:43.594 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:43.480+0000 7fc0fc044200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T06:34:43.594 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:43.592+0000 7fc0fc044200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T06:34:43.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:43.681+0000 7fc0fc044200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T06:34:43.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:43.777+0000 7fc0fc044200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T06:34:43.896 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi137:vg_nvme/lv_4 2024-03-04T06:34:44.146 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:44.146 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:44.146 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:44.146 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:44.146 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[26846]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:44.146 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:44.146 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:44.146 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[26846]: Reconfiguring mgr.y (unknown last config time)... 2024-03-04T06:34:44.146 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:34:44.146 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:34:44.146 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:44.147 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[26846]: Reconfiguring daemon mgr.y on smithi137 2024-03-04T06:34:44.147 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:44.147 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:44.147 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:44.147 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:44.147 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[37364]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:44.147 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:44.147 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:44.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[37364]: Reconfiguring mgr.y (unknown last config time)... 2024-03-04T06:34:44.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:34:44.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:34:44.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:44.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:43 smithi137 ceph-mon[37364]: Reconfiguring daemon mgr.y on smithi137 2024-03-04T06:34:44.244 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:43.959+0000 7fc0fc044200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T06:34:44.244 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:44.245 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:44.245 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:44.245 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:44.245 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-mon[30756]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:44.245 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:44.245 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:44.245 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-mon[30756]: Reconfiguring mgr.y (unknown last config time)... 2024-03-04T06:34:44.245 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:34:44.245 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:34:44.245 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:44.245 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:43 smithi203 ceph-mon[30756]: Reconfiguring daemon mgr.y on smithi137 2024-03-04T06:34:44.935 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:34:45.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:44.932+0000 7fc0fc044200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T06:34:45.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:45.065+0000 7fc0fc044200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T06:34:45.698 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:45.417+0000 7fc0fc044200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T06:34:45.698 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:45.505+0000 7fc0fc044200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T06:34:45.698 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:45.697+0000 7fc0fc044200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:34:46.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:45.878+0000 7fc0fc044200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T06:34:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:45 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:45 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:45 smithi203 ceph-mon[30756]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:45 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:45 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:45 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:45 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:46.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:46.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:46.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[26846]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:46.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:46.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:46.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:46.198 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:46.199 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:46.199 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:46.199 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[37364]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:46.199 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:34:46.199 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:46.199 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:34:46.199 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:45 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:34:46.421 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:46.159+0000 7fc0fc044200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:34:46.421 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:46.420+0000 7fc0fc044200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T06:34:46.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:46.649+0000 7fc0fc044200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T06:34:47.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:46 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:34:47.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:46 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:34:47.192 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:46 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:47.193 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:46 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:34:47.193 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:46 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:34:47.193 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:46 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:46 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:34:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:46 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:34:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:46 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:47.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:47.440+0000 7fc0fc044200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T06:34:48.217 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:47 smithi137 ceph-mon[37364]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:34:48.217 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:47 smithi137 ceph-mon[37364]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:48.217 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:47 smithi137 ceph-mon[26846]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:34:48.217 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:47 smithi137 ceph-mon[26846]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:48.318 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:47 smithi203 ceph-mon[30756]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:34:48.318 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:47 smithi203 ceph-mon[30756]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:48.318 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:48.007+0000 7fc0fc044200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T06:34:48.318 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:48.105+0000 7fc0fc044200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T06:34:48.318 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:34:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:34:48.316+0000 7fc0fc044200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T06:34:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[26846]: Standby manager daemon x started 2024-03-04T06:34:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/1499944085' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:34:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/1499944085' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:34:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/1499944085' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:34:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/1499944085' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:34:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2529207630' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1b7579c-6846-4ce6-a717-07c255155577"}]: dispatch 2024-03-04T06:34:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2529207630' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1b7579c-6846-4ce6-a717-07c255155577"}]': finished 2024-03-04T06:34:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[26846]: osdmap e5: 1 total, 0 up, 1 in 2024-03-04T06:34:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:34:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[37364]: Standby manager daemon x started 2024-03-04T06:34:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/1499944085' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:34:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/1499944085' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:34:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/1499944085' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:34:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/1499944085' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:34:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2529207630' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1b7579c-6846-4ce6-a717-07c255155577"}]: dispatch 2024-03-04T06:34:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2529207630' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1b7579c-6846-4ce6-a717-07c255155577"}]': finished 2024-03-04T06:34:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[37364]: osdmap e5: 1 total, 0 up, 1 in 2024-03-04T06:34:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:48 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:34:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:48 smithi203 ceph-mon[30756]: Standby manager daemon x started 2024-03-04T06:34:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:48 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/1499944085' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:34:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:48 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/1499944085' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:34:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:48 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/1499944085' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:34:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:48 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/1499944085' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:34:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:48 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2529207630' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1b7579c-6846-4ce6-a717-07c255155577"}]: dispatch 2024-03-04T06:34:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:48 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2529207630' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1b7579c-6846-4ce6-a717-07c255155577"}]': finished 2024-03-04T06:34:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:48 smithi203 ceph-mon[30756]: osdmap e5: 1 total, 0 up, 1 in 2024-03-04T06:34:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:48 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:34:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:49 smithi137 ceph-mon[26846]: mgrmap e14: y(active, since 65s), standbys: x 2024-03-04T06:34:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:49 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:34:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:49 smithi137 ceph-mon[26846]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:49 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/123127691' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:34:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:49 smithi137 ceph-mon[37364]: mgrmap e14: y(active, since 65s), standbys: x 2024-03-04T06:34:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:49 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:34:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:49 smithi137 ceph-mon[37364]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:49 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/123127691' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:34:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:49 smithi203 ceph-mon[30756]: mgrmap e14: y(active, since 65s), standbys: x 2024-03-04T06:34:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:49 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:34:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:49 smithi203 ceph-mon[30756]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:49 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/123127691' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:34:52.330 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:52 smithi137 ceph-mon[26846]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:52.331 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:52 smithi137 ceph-mon[37364]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:52.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:52 smithi203 ceph-mon[30756]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:54.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:54 smithi137 ceph-mon[26846]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:54.156 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:54 smithi137 ceph-mon[37364]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:54.307 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:54 smithi203 ceph-mon[30756]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:55.287 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:55 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-04T06:34:55.287 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:55 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:55.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:55 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-04T06:34:55.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:55 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:55 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-04T06:34:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:55 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:34:56.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:56 smithi203 ceph-mon[30756]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:56.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:56 smithi203 ceph-mon[30756]: Deploying daemon osd.0 on smithi137 2024-03-04T06:34:56.465 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:56 smithi137 ceph-mon[26846]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:56.465 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:56 smithi137 ceph-mon[26846]: Deploying daemon osd.0 on smithi137 2024-03-04T06:34:56.465 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:56 smithi137 ceph-mon[37364]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:56.465 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:56 smithi137 ceph-mon[37364]: Deploying daemon osd.0 on smithi137 2024-03-04T06:34:58.243 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:34:58 smithi137 ceph-mon[26846]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:58.243 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:34:58 smithi137 ceph-mon[37364]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:34:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:34:58 smithi203 ceph-mon[30756]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:00.232 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:00 smithi137 ceph-mon[26846]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:00.233 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:00 smithi137 ceph-mon[37364]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:00 smithi203 ceph-mon[30756]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:01.538 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:01 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:01.539 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:01 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:01.539 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:01 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:01.539 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:01 smithi137 ceph-mon[26846]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:01.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:01 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:01.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:01 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:01.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:01 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:01.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:01 smithi137 ceph-mon[37364]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:01.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:01 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:01.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:01 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:01.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:01 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:01.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:01 smithi203 ceph-mon[30756]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:03.558 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 0 on host 'smithi137' 2024-03-04T06:35:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[26846]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[26846]: from='osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-04T06:35:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[37364]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[37364]: from='osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-04T06:35:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:03 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:04.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:03 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:04.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:03 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:04.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:03 smithi203 ceph-mon[30756]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:04.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:03 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:04.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:03 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:04.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:03 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:04.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:03 smithi203 ceph-mon[30756]: from='osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-04T06:35:04.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:03 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:04.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:03 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:04.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:03 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:04.223 DEBUG:teuthology.orchestra.run.smithi137:osd.0> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.0.service 2024-03-04T06:35:04.226 INFO:tasks.cephadm:Deploying osd.1 on smithi137 with /dev/vg_nvme/lv_3... 2024-03-04T06:35:04.226 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-04T06:35:05.514 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:05 smithi137 ceph-mon[37364]: from='osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-04T06:35:05.514 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:05 smithi137 ceph-mon[37364]: osdmap e6: 1 total, 0 up, 1 in 2024-03-04T06:35:05.515 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:05 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:35:05.515 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:05 smithi137 ceph-mon[37364]: from='osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:35:05.515 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:05 smithi137 ceph-mon[37364]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:05.515 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:05 smithi137 ceph-mon[26846]: from='osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-04T06:35:05.515 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:05 smithi137 ceph-mon[26846]: osdmap e6: 1 total, 0 up, 1 in 2024-03-04T06:35:05.515 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:05 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:35:05.515 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:05 smithi137 ceph-mon[26846]: from='osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:35:05.515 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:05 smithi137 ceph-mon[26846]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:05.516 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:35:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[41303]: 2024-03-04T06:35:05.321+0000 7f008111c700 -1 osd.0 0 waiting for initial osdmap 2024-03-04T06:35:05.516 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:35:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[41303]: 2024-03-04T06:35:05.324+0000 7f007cf11700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:35:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:05 smithi203 ceph-mon[30756]: from='osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-04T06:35:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:05 smithi203 ceph-mon[30756]: osdmap e6: 1 total, 0 up, 1 in 2024-03-04T06:35:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:05 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:35:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:05 smithi203 ceph-mon[30756]: from='osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:35:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:05 smithi203 ceph-mon[30756]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:05.766 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:35:06.427 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:06 smithi137 ceph-mon[26846]: from='osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-03-04T06:35:06.427 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:06 smithi137 ceph-mon[26846]: osdmap e7: 1 total, 0 up, 1 in 2024-03-04T06:35:06.427 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:06 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:35:06.427 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:06 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:35:06.428 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:06 smithi137 ceph-mon[37364]: from='osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-03-04T06:35:06.428 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:06 smithi137 ceph-mon[37364]: osdmap e7: 1 total, 0 up, 1 in 2024-03-04T06:35:06.428 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:06 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:35:06.428 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:06 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:35:06.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:06 smithi203 ceph-mon[30756]: from='osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-03-04T06:35:06.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:06 smithi203 ceph-mon[30756]: osdmap e7: 1 total, 0 up, 1 in 2024-03-04T06:35:06.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:06 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:35:06.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:06 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:35:07.384 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:07 smithi137 ceph-mon[26846]: purged_snaps scrub starts 2024-03-04T06:35:07.384 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:07 smithi137 ceph-mon[26846]: purged_snaps scrub ok 2024-03-04T06:35:07.384 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:07 smithi137 ceph-mon[26846]: osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079] boot 2024-03-04T06:35:07.384 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:07 smithi137 ceph-mon[26846]: osdmap e8: 1 total, 1 up, 1 in 2024-03-04T06:35:07.384 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:07 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:35:07.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:07 smithi137 ceph-mon[26846]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:07.385 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:07 smithi137 ceph-mon[37364]: purged_snaps scrub starts 2024-03-04T06:35:07.385 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:07 smithi137 ceph-mon[37364]: purged_snaps scrub ok 2024-03-04T06:35:07.385 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:07 smithi137 ceph-mon[37364]: osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079] boot 2024-03-04T06:35:07.385 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:07 smithi137 ceph-mon[37364]: osdmap e8: 1 total, 1 up, 1 in 2024-03-04T06:35:07.385 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:07 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:35:07.385 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:07 smithi137 ceph-mon[37364]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:07 smithi203 ceph-mon[30756]: purged_snaps scrub starts 2024-03-04T06:35:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:07 smithi203 ceph-mon[30756]: purged_snaps scrub ok 2024-03-04T06:35:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:07 smithi203 ceph-mon[30756]: osd.0 [v2:172.21.15.137:6802/120753079,v1:172.21.15.137:6803/120753079] boot 2024-03-04T06:35:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:07 smithi203 ceph-mon[30756]: osdmap e8: 1 total, 1 up, 1 in 2024-03-04T06:35:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:07 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:35:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:07 smithi203 ceph-mon[30756]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T06:35:07.676 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-04T06:35:07.676 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-04T06:35:07.676 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2024-03-04T06:35:07.676 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2024-03-04T06:35:07.676 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125828 s, 833 MB/s 2024-03-04T06:35:07.676 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2024-03-04T06:35:08.483 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi137:vg_nvme/lv_3 2024-03-04T06:35:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:08 smithi203 ceph-mon[30756]: osdmap e9: 1 total, 1 up, 1 in 2024-03-04T06:35:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:08 smithi203 ceph-mon[30756]: Detected new or changed devices on smithi137 2024-03-04T06:35:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:08 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:08 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:08 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:08 smithi203 ceph-mon[30756]: Adjusting osd_memory_target on smithi137 to 16064M 2024-03-04T06:35:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:08 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:08 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:08.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:08 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:08.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:08 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:08.690 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:35:08.761 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[26846]: osdmap e9: 1 total, 1 up, 1 in 2024-03-04T06:35:08.761 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[26846]: Detected new or changed devices on smithi137 2024-03-04T06:35:08.761 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:08.761 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:08.761 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:08.761 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[26846]: Adjusting osd_memory_target on smithi137 to 16064M 2024-03-04T06:35:08.761 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:08.761 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:08.761 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:08.761 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:08.762 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[37364]: osdmap e9: 1 total, 1 up, 1 in 2024-03-04T06:35:08.762 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[37364]: Detected new or changed devices on smithi137 2024-03-04T06:35:08.762 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:08.762 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:08.762 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:08.762 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[37364]: Adjusting osd_memory_target on smithi137 to 16064M 2024-03-04T06:35:08.762 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:08.762 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:08.762 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:08.762 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:08 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:09 smithi203 ceph-mon[30756]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:09.698 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:09 smithi137 ceph-mon[26846]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:09.698 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:09 smithi137 ceph-mon[37364]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:11.197 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:11 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:35:11.197 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:11 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:35:11.197 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:11 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:11.197 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:11 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:35:11.197 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:11 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:35:11.198 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:11 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:11 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:35:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:11 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:35:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:11 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:12.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:12 smithi137 ceph-mon[26846]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:35:12.182 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:12 smithi137 ceph-mon[26846]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:12.183 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:12 smithi137 ceph-mon[37364]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:35:12.183 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:12 smithi137 ceph-mon[37364]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:12 smithi203 ceph-mon[30756]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:35:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:12 smithi203 ceph-mon[30756]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:13.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:13 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3351521437' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b6cf83c-0990-4fd2-b69b-e6dc3fda3339"}]: dispatch 2024-03-04T06:35:13.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:13 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3351521437' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b6cf83c-0990-4fd2-b69b-e6dc3fda3339"}]': finished 2024-03-04T06:35:13.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:13 smithi203 ceph-mon[30756]: osdmap e10: 2 total, 1 up, 2 in 2024-03-04T06:35:13.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:13 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:13.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:13 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3351521437' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b6cf83c-0990-4fd2-b69b-e6dc3fda3339"}]: dispatch 2024-03-04T06:35:13.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:13 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3351521437' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b6cf83c-0990-4fd2-b69b-e6dc3fda3339"}]': finished 2024-03-04T06:35:13.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:13 smithi137 ceph-mon[26846]: osdmap e10: 2 total, 1 up, 2 in 2024-03-04T06:35:13.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:13 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:13.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:13 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3351521437' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b6cf83c-0990-4fd2-b69b-e6dc3fda3339"}]: dispatch 2024-03-04T06:35:13.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:13 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3351521437' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b6cf83c-0990-4fd2-b69b-e6dc3fda3339"}]': finished 2024-03-04T06:35:13.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:13 smithi137 ceph-mon[37364]: osdmap e10: 2 total, 1 up, 2 in 2024-03-04T06:35:13.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:13 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:14 smithi203 ceph-mon[30756]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:14 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1447469131' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:35:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:14 smithi137 ceph-mon[26846]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:14 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1447469131' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:35:14.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:14 smithi137 ceph-mon[37364]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:14.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:14 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1447469131' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:35:16.216 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:16 smithi137 ceph-mon[26846]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:16.216 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:16 smithi137 ceph-mon[37364]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:16.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:16 smithi203 ceph-mon[30756]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:18.175 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:18 smithi137 ceph-mon[37364]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:18.175 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:18 smithi137 ceph-mon[26846]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:18.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:18 smithi203 ceph-mon[30756]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:20 smithi137 ceph-mon[26846]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:20 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-04T06:35:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:20 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:20.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:20 smithi137 ceph-mon[37364]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:20 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-04T06:35:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:20 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:20 smithi203 ceph-mon[30756]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:20 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-04T06:35:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:20 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:21.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:21 smithi203 ceph-mon[30756]: Deploying daemon osd.1 on smithi137 2024-03-04T06:35:21.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:21 smithi137 ceph-mon[26846]: Deploying daemon osd.1 on smithi137 2024-03-04T06:35:21.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:21 smithi137 ceph-mon[37364]: Deploying daemon osd.1 on smithi137 2024-03-04T06:35:22.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:22 smithi137 ceph-mon[26846]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:22.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:22 smithi137 ceph-mon[37364]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:22 smithi203 ceph-mon[30756]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:24.223 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:24 smithi137 ceph-mon[26846]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:24.224 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:24 smithi137 ceph-mon[37364]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:24.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:24 smithi203 ceph-mon[30756]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:25 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:25 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:25.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:25 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:25.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:25 smithi137 ceph-mon[26846]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:25 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:25 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:25 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:25 smithi137 ceph-mon[37364]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:25 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:25 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:25 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:25 smithi203 ceph-mon[30756]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:28.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[26846]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:28.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:28.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:28.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:28.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:28.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:28.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[26846]: from='osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T06:35:28.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[37364]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:28.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:28.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:28.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:28.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:28.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:28.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:28 smithi137 ceph-mon[37364]: from='osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T06:35:28.116 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 1 on host 'smithi137' 2024-03-04T06:35:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:28 smithi203 ceph-mon[30756]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:28 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:28 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:28 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:28 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:28 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:28 smithi203 ceph-mon[30756]: from='osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T06:35:28.651 DEBUG:teuthology.orchestra.run.smithi137:osd.1> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.1.service 2024-03-04T06:35:28.653 INFO:tasks.cephadm:Deploying osd.2 on smithi137 with /dev/vg_nvme/lv_2... 2024-03-04T06:35:28.654 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-04T06:35:29.233 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:29.234 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:29.234 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:29.234 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[26846]: from='osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-04T06:35:29.234 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[26846]: osdmap e11: 2 total, 1 up, 2 in 2024-03-04T06:35:29.234 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:29.234 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[26846]: from='osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:35:29.234 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:29.234 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:29.235 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:29.235 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[37364]: from='osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-04T06:35:29.235 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[37364]: osdmap e11: 2 total, 1 up, 2 in 2024-03-04T06:35:29.235 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:29.235 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-mon[37364]: from='osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:35:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:29 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:29 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:29 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:29 smithi203 ceph-mon[30756]: from='osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-04T06:35:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:29 smithi203 ceph-mon[30756]: osdmap e11: 2 total, 1 up, 2 in 2024-03-04T06:35:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:29 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:29 smithi203 ceph-mon[30756]: from='osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:35:29.476 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:35:29.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[47423]: 2024-03-04T06:35:29.237+0000 7f45338ac700 -1 osd.1 0 waiting for initial osdmap 2024-03-04T06:35:29.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:35:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[47423]: 2024-03-04T06:35:29.240+0000 7f452e69f700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:35:30.232 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:30 smithi137 ceph-mon[26846]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:30.232 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:30 smithi137 ceph-mon[26846]: from='osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-03-04T06:35:30.232 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:30 smithi137 ceph-mon[26846]: osdmap e12: 2 total, 1 up, 2 in 2024-03-04T06:35:30.232 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:30.233 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:30.233 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:30 smithi137 ceph-mon[37364]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:30.233 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:30 smithi137 ceph-mon[37364]: from='osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-03-04T06:35:30.233 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:30 smithi137 ceph-mon[37364]: osdmap e12: 2 total, 1 up, 2 in 2024-03-04T06:35:30.233 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:30.233 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:30 smithi203 ceph-mon[30756]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T06:35:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:30 smithi203 ceph-mon[30756]: from='osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-03-04T06:35:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:30 smithi203 ceph-mon[30756]: osdmap e12: 2 total, 1 up, 2 in 2024-03-04T06:35:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:31.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:31 smithi137 ceph-mon[26846]: purged_snaps scrub starts 2024-03-04T06:35:31.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:31 smithi137 ceph-mon[26846]: purged_snaps scrub ok 2024-03-04T06:35:31.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:31 smithi137 ceph-mon[26846]: osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936] boot 2024-03-04T06:35:31.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:31 smithi137 ceph-mon[26846]: osdmap e13: 2 total, 2 up, 2 in 2024-03-04T06:35:31.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:31 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:31.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:31 smithi137 ceph-mon[26846]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:31.498 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:31 smithi137 ceph-mon[37364]: purged_snaps scrub starts 2024-03-04T06:35:31.498 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:31 smithi137 ceph-mon[37364]: purged_snaps scrub ok 2024-03-04T06:35:31.498 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:31 smithi137 ceph-mon[37364]: osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936] boot 2024-03-04T06:35:31.498 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:31 smithi137 ceph-mon[37364]: osdmap e13: 2 total, 2 up, 2 in 2024-03-04T06:35:31.498 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:31 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:31.498 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:31 smithi137 ceph-mon[37364]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:31 smithi203 ceph-mon[30756]: purged_snaps scrub starts 2024-03-04T06:35:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:31 smithi203 ceph-mon[30756]: purged_snaps scrub ok 2024-03-04T06:35:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:31 smithi203 ceph-mon[30756]: osd.1 [v2:172.21.15.137:6810/2976801936,v1:172.21.15.137:6811/2976801936] boot 2024-03-04T06:35:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:31 smithi203 ceph-mon[30756]: osdmap e13: 2 total, 2 up, 2 in 2024-03-04T06:35:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:31 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:35:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:31 smithi203 ceph-mon[30756]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:32.243 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-04T06:35:32.243 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-04T06:35:32.243 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2024-03-04T06:35:32.243 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2024-03-04T06:35:32.243 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126042 s, 832 MB/s 2024-03-04T06:35:32.243 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2024-03-04T06:35:32.503 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:32 smithi137 ceph-mon[26846]: osdmap e14: 2 total, 2 up, 2 in 2024-03-04T06:35:32.504 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:32 smithi137 ceph-mon[37364]: osdmap e14: 2 total, 2 up, 2 in 2024-03-04T06:35:32.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:32 smithi203 ceph-mon[30756]: osdmap e14: 2 total, 2 up, 2 in 2024-03-04T06:35:32.843 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi137:vg_nvme/lv_2 2024-03-04T06:35:33.261 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:35:33.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:33 smithi137 ceph-mon[26846]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:33.497 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:33 smithi137 ceph-mon[37364]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:33.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:33 smithi203 ceph-mon[30756]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:34.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[37364]: Detected new or changed devices on smithi137 2024-03-04T06:35:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[37364]: Adjusting osd_memory_target on smithi137 to 8032M 2024-03-04T06:35:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[26846]: Detected new or changed devices on smithi137 2024-03-04T06:35:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[26846]: Adjusting osd_memory_target on smithi137 to 8032M 2024-03-04T06:35:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:34 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:34.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:34 smithi203 ceph-mon[30756]: Detected new or changed devices on smithi137 2024-03-04T06:35:34.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:34 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:34.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:34 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:34.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:34 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:34.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:34 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:34.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:34 smithi203 ceph-mon[30756]: Adjusting osd_memory_target on smithi137 to 8032M 2024-03-04T06:35:34.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:34 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:34.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:34 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:34.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:34 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:34.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:34 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:35.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:35 smithi137 ceph-mon[26846]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:35.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:35 smithi137 ceph-mon[26846]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:35:35.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:35 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:35:35.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:35 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:35:35.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:35 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:35 smithi137 ceph-mon[37364]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:35 smithi137 ceph-mon[37364]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:35:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:35 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:35:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:35 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:35:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:35 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:35 smithi203 ceph-mon[30756]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:35 smithi203 ceph-mon[30756]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:35:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:35 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:35:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:35 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:35:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:35 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:38.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:38 smithi137 ceph-mon[26846]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:38.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:38 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3522002011' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3967105b-5aac-4700-8634-52d41c48bf38"}]: dispatch 2024-03-04T06:35:38.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:38 smithi137 ceph-mon[26846]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3967105b-5aac-4700-8634-52d41c48bf38"}]: dispatch 2024-03-04T06:35:38.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:38 smithi137 ceph-mon[26846]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3967105b-5aac-4700-8634-52d41c48bf38"}]': finished 2024-03-04T06:35:38.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:38 smithi137 ceph-mon[26846]: osdmap e15: 3 total, 2 up, 3 in 2024-03-04T06:35:38.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:38 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:38.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:38 smithi137 ceph-mon[37364]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:38.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:38 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3522002011' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3967105b-5aac-4700-8634-52d41c48bf38"}]: dispatch 2024-03-04T06:35:38.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:38 smithi137 ceph-mon[37364]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3967105b-5aac-4700-8634-52d41c48bf38"}]: dispatch 2024-03-04T06:35:38.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:38 smithi137 ceph-mon[37364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3967105b-5aac-4700-8634-52d41c48bf38"}]': finished 2024-03-04T06:35:38.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:38 smithi137 ceph-mon[37364]: osdmap e15: 3 total, 2 up, 3 in 2024-03-04T06:35:38.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:38 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:38.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:38 smithi203 ceph-mon[30756]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:38.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:38 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3522002011' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3967105b-5aac-4700-8634-52d41c48bf38"}]: dispatch 2024-03-04T06:35:38.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:38 smithi203 ceph-mon[30756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3967105b-5aac-4700-8634-52d41c48bf38"}]: dispatch 2024-03-04T06:35:38.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:38 smithi203 ceph-mon[30756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3967105b-5aac-4700-8634-52d41c48bf38"}]': finished 2024-03-04T06:35:38.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:38 smithi203 ceph-mon[30756]: osdmap e15: 3 total, 2 up, 3 in 2024-03-04T06:35:38.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:38 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:39.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:39 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/22344489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:35:39.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:39 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/22344489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:35:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:39 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/22344489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:35:40.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:40 smithi137 ceph-mon[26846]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:40.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:40 smithi137 ceph-mon[37364]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:40.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:40 smithi203 ceph-mon[30756]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:42.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:42 smithi203 ceph-mon[30756]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:42.361 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:42 smithi137 ceph-mon[26846]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:42.361 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:42 smithi137 ceph-mon[37364]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:44 smithi203 ceph-mon[30756]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:44 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-04T06:35:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:44 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:44.354 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:44 smithi137 ceph-mon[26846]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:44.354 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:44 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-04T06:35:44.354 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:44 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:44.354 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:44 smithi137 ceph-mon[37364]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:44.354 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:44 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-04T06:35:44.354 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:44 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:45.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:45 smithi137 ceph-mon[26846]: Deploying daemon osd.2 on smithi137 2024-03-04T06:35:45.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:45 smithi137 ceph-mon[37364]: Deploying daemon osd.2 on smithi137 2024-03-04T06:35:45.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:45 smithi203 ceph-mon[30756]: Deploying daemon osd.2 on smithi137 2024-03-04T06:35:46.330 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:46 smithi137 ceph-mon[26846]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:46.331 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:46 smithi137 ceph-mon[37364]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:46.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:46 smithi203 ceph-mon[30756]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:48.305 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:48 smithi137 ceph-mon[26846]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:48.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:48 smithi137 ceph-mon[37364]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:48.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:48 smithi203 ceph-mon[30756]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:50.166 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:49 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:50.166 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:49 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:50.166 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:49 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:50.167 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:49 smithi137 ceph-mon[37364]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:50.167 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:49 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:50.167 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:49 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:50.167 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:49 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:50.167 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:49 smithi137 ceph-mon[26846]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:49 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:49 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:49 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:49 smithi203 ceph-mon[30756]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:52.207 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 2 on host 'smithi137' 2024-03-04T06:35:52.208 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[26846]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:52.208 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:52.208 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:52.208 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:52.208 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:52.208 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:52.208 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[26846]: from='osd.2 [v2:172.21.15.137:6818/788153355,v1:172.21.15.137:6819/788153355]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T06:35:52.208 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[26846]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T06:35:52.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[37364]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:52.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:52.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:52.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:52.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:52.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:52.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[37364]: from='osd.2 [v2:172.21.15.137:6818/788153355,v1:172.21.15.137:6819/788153355]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T06:35:52.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:52 smithi137 ceph-mon[37364]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T06:35:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:52 smithi203 ceph-mon[30756]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:52 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:52 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:52 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:52 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:52 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:52 smithi203 ceph-mon[30756]: from='osd.2 [v2:172.21.15.137:6818/788153355,v1:172.21.15.137:6819/788153355]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T06:35:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:52 smithi203 ceph-mon[30756]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T06:35:52.766 DEBUG:teuthology.orchestra.run.smithi137:osd.2> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.2.service 2024-03-04T06:35:52.769 INFO:tasks.cephadm:Deploying osd.3 on smithi137 with /dev/vg_nvme/lv_1... 2024-03-04T06:35:52.769 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-04T06:35:53.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:53.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:53.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:53.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[26846]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-04T06:35:53.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[26846]: osdmap e16: 3 total, 2 up, 3 in 2024-03-04T06:35:53.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:53.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[26846]: from='osd.2 [v2:172.21.15.137:6818/788153355,v1:172.21.15.137:6819/788153355]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:35:53.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[26846]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:35:53.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[26846]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:53.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:53.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:53.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:53.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[37364]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-04T06:35:53.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[37364]: osdmap e16: 3 total, 2 up, 3 in 2024-03-04T06:35:53.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:53.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[37364]: from='osd.2 [v2:172.21.15.137:6818/788153355,v1:172.21.15.137:6819/788153355]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:35:53.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[37364]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:35:53.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-mon[37364]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:53.300 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[53055]: 2024-03-04T06:35:53.228+0000 7fc3a5566700 -1 osd.2 0 waiting for initial osdmap 2024-03-04T06:35:53.300 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:35:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[53055]: 2024-03-04T06:35:53.232+0000 7fc39f357700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:35:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:53 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:53 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:35:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:53 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:53 smithi203 ceph-mon[30756]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-04T06:35:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:53 smithi203 ceph-mon[30756]: osdmap e16: 3 total, 2 up, 3 in 2024-03-04T06:35:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:53 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:53 smithi203 ceph-mon[30756]: from='osd.2 [v2:172.21.15.137:6818/788153355,v1:172.21.15.137:6819/788153355]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:35:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:53 smithi203 ceph-mon[30756]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:35:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:53 smithi203 ceph-mon[30756]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-04T06:35:54.416 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:35:54.538 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:54 smithi137 ceph-mon[26846]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-03-04T06:35:54.538 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:54 smithi137 ceph-mon[26846]: osdmap e17: 3 total, 2 up, 3 in 2024-03-04T06:35:54.538 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:54 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:54.539 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:54 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:54.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:54 smithi137 ceph-mon[37364]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-03-04T06:35:54.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:54 smithi137 ceph-mon[37364]: osdmap e17: 3 total, 2 up, 3 in 2024-03-04T06:35:54.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:54 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:54.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:54 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:54.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:54 smithi203 ceph-mon[30756]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-03-04T06:35:54.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:54 smithi203 ceph-mon[30756]: osdmap e17: 3 total, 2 up, 3 in 2024-03-04T06:35:54.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:54 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:54.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:54 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:55.354 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:55 smithi137 ceph-mon[26846]: purged_snaps scrub starts 2024-03-04T06:35:55.354 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:55 smithi137 ceph-mon[26846]: purged_snaps scrub ok 2024-03-04T06:35:55.354 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:55 smithi137 ceph-mon[26846]: osd.2 [v2:172.21.15.137:6818/788153355,v1:172.21.15.137:6819/788153355] boot 2024-03-04T06:35:55.355 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:55 smithi137 ceph-mon[26846]: osdmap e18: 3 total, 3 up, 3 in 2024-03-04T06:35:55.355 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:55 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:55.355 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:55 smithi137 ceph-mon[37364]: purged_snaps scrub starts 2024-03-04T06:35:55.355 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:55 smithi137 ceph-mon[37364]: purged_snaps scrub ok 2024-03-04T06:35:55.355 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:55 smithi137 ceph-mon[37364]: osd.2 [v2:172.21.15.137:6818/788153355,v1:172.21.15.137:6819/788153355] boot 2024-03-04T06:35:55.355 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:55 smithi137 ceph-mon[37364]: osdmap e18: 3 total, 3 up, 3 in 2024-03-04T06:35:55.355 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:55 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:55 smithi203 ceph-mon[30756]: purged_snaps scrub starts 2024-03-04T06:35:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:55 smithi203 ceph-mon[30756]: purged_snaps scrub ok 2024-03-04T06:35:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:55 smithi203 ceph-mon[30756]: osd.2 [v2:172.21.15.137:6818/788153355,v1:172.21.15.137:6819/788153355] boot 2024-03-04T06:35:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:55 smithi203 ceph-mon[30756]: osdmap e18: 3 total, 3 up, 3 in 2024-03-04T06:35:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:55 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:35:56.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:35:56.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-04T06:35:56.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-04T06:35:56.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: osdmap e19: 3 total, 3 up, 3 in 2024-03-04T06:35:56.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T06:35:56.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: Detected new or changed devices on smithi137 2024-03-04T06:35:56.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:56.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:56.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:56.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:56.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:56.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: Adjusting osd_memory_target on smithi137 to 5354M 2024-03-04T06:35:56.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:56.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:56.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:35:56.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-04T06:35:56.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-04T06:35:56.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: osdmap e19: 3 total, 3 up, 3 in 2024-03-04T06:35:56.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T06:35:56.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: Detected new or changed devices on smithi137 2024-03-04T06:35:56.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:56.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:56.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:56.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:56.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:56.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: Adjusting osd_memory_target on smithi137 to 5354M 2024-03-04T06:35:56.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:56.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:56.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:56.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:35:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-04T06:35:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-04T06:35:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: osdmap e19: 3 total, 3 up, 3 in 2024-03-04T06:35:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T06:35:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: Detected new or changed devices on smithi137 2024-03-04T06:35:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:35:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: Adjusting osd_memory_target on smithi137 to 5354M 2024-03-04T06:35:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:35:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:35:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:56.864 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:35:56 smithi137 sudo[57040]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-04T06:35:56.864 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:35:56 smithi137 sudo[57040]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T06:35:56.864 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:35:56 smithi137 sudo[57040]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T06:35:56.864 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:35:56 smithi137 sudo[57040]: pam_unix(sudo:session): session closed for user root 2024-03-04T06:35:56.909 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-04T06:35:56.909 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-04T06:35:56.910 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2024-03-04T06:35:56.910 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2024-03-04T06:35:56.910 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113569 s, 923 MB/s 2024-03-04T06:35:56.910 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2024-03-04T06:35:57.134 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:35:56 smithi137 sudo[57064]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-04T06:35:57.135 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:35:56 smithi137 sudo[57064]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T06:35:57.135 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:35:56 smithi137 sudo[57064]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T06:35:57.135 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:35:56 smithi137 sudo[57064]: pam_unix(sudo:session): session closed for user root 2024-03-04T06:35:57.394 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-04T06:35:57.394 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:57 smithi137 ceph-mon[37364]: osdmap e20: 3 total, 3 up, 3 in 2024-03-04T06:35:57.394 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:57.394 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:57 smithi137 ceph-mon[37364]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:35:57.394 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-04T06:35:57.395 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:57 smithi137 ceph-mon[26846]: osdmap e20: 3 total, 3 up, 3 in 2024-03-04T06:35:57.395 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:57.395 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:57 smithi137 ceph-mon[26846]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:35:57.395 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57157]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-04T06:35:57.395 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57157]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T06:35:57.395 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57157]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T06:35:57.395 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57157]: pam_unix(sudo:session): session closed for user root 2024-03-04T06:35:57.551 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi137:vg_nvme/lv_1 2024-03-04T06:35:57.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-04T06:35:57.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:57 smithi203 ceph-mon[30756]: osdmap e20: 3 total, 3 up, 3 in 2024-03-04T06:35:57.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:57.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:57 smithi203 ceph-mon[30756]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:35:57.645 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57161]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-04T06:35:57.645 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57161]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T06:35:57.646 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57161]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T06:35:57.646 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57161]: pam_unix(sudo:session): session closed for user root 2024-03-04T06:35:57.760 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:35:57.910 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57182]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-04T06:35:57.910 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57182]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T06:35:57.910 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57182]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T06:35:57.911 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57182]: pam_unix(sudo:session): session closed for user root 2024-03-04T06:35:58.162 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57241]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-04T06:35:58.193 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57241]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T06:35:58.193 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57241]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T06:35:58.193 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:35:57 smithi137 sudo[57241]: pam_unix(sudo:session): session closed for user root 2024-03-04T06:35:58.419 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:58 smithi137 sudo[57262]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-04T06:35:58.419 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:58 smithi137 sudo[57262]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T06:35:58.419 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:58 smithi137 sudo[57262]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T06:35:58.420 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:58 smithi137 sudo[57262]: pam_unix(sudo:session): session closed for user root 2024-03-04T06:35:58.683 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:58 smithi203 ceph-mon[30756]: osdmap e21: 3 total, 3 up, 3 in 2024-03-04T06:35:58.683 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:58 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T06:35:58.683 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:58 smithi203 sudo[33371]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-04T06:35:58.684 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:58 smithi203 sudo[33371]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T06:35:58.684 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:58 smithi203 sudo[33371]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T06:35:58.684 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:58 smithi203 sudo[33371]: pam_unix(sudo:session): session closed for user root 2024-03-04T06:35:58.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:58 smithi137 ceph-mon[37364]: osdmap e21: 3 total, 3 up, 3 in 2024-03-04T06:35:58.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:58 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T06:35:58.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:58 smithi137 sudo[57265]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-04T06:35:58.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:58 smithi137 sudo[57265]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T06:35:58.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:58 smithi137 sudo[57265]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T06:35:58.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:58 smithi137 sudo[57265]: pam_unix(sudo:session): session closed for user root 2024-03-04T06:35:58.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:58 smithi137 ceph-mon[26846]: osdmap e21: 3 total, 3 up, 3 in 2024-03-04T06:35:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:58 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T06:35:59.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:58 smithi203 sudo[33374]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-04T06:35:59.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:58 smithi203 sudo[33374]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T06:35:59.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:58 smithi203 sudo[33374]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T06:35:59.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:58 smithi203 sudo[33374]: pam_unix(sudo:session): session closed for user root 2024-03-04T06:35:59.423 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 sudo[57295]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-04T06:35:59.424 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 sudo[57295]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T06:35:59.424 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 sudo[57295]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T06:35:59.424 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 sudo[57295]: pam_unix(sudo:session): session closed for user root 2024-03-04T06:35:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: mgrmap e15: y(active, since 2m), standbys: x 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:35:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[26846]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 sudo[57320]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 sudo[57320]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 sudo[57320]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 sudo[57320]: pam_unix(sudo:session): session closed for user root 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: mgrmap e15: y(active, since 2m), standbys: x 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:35:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T06:35:59.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:59.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:35:59.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:35:59.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:35:59.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:35:59 smithi137 ceph-mon[37364]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:35:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T06:35:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:35:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:35:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:35:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T06:35:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: mgrmap e15: y(active, since 2m), standbys: x 2024-03-04T06:35:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:35:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:35:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:35:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T06:35:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:35:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:35:59.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:35:59.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:35:59.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:35:59 smithi203 ceph-mon[30756]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:00.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:00 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T06:36:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:00 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T06:36:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:00 smithi137 ceph-mon[26846]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:36:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:00 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:36:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:00 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:36:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:00 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:00 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T06:36:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:00 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T06:36:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:00 smithi137 ceph-mon[37364]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:36:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:00 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:36:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:00 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:36:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:00 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:00 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T06:36:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:00 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T06:36:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:00 smithi203 ceph-mon[30756]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:36:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:00 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:36:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:00 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:36:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:00 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:01.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:01 smithi137 ceph-mon[26846]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:01.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:01 smithi137 ceph-mon[37364]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:01.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:01 smithi203 ceph-mon[30756]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:02.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:02 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3927889797' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3782548-3104-4ff4-8f6c-e162f3219a86"}]: dispatch 2024-03-04T06:36:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:02 smithi137 ceph-mon[26846]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3782548-3104-4ff4-8f6c-e162f3219a86"}]: dispatch 2024-03-04T06:36:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:02 smithi137 ceph-mon[26846]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3782548-3104-4ff4-8f6c-e162f3219a86"}]': finished 2024-03-04T06:36:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:02 smithi137 ceph-mon[26846]: osdmap e22: 4 total, 3 up, 4 in 2024-03-04T06:36:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:02 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:02 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3927889797' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3782548-3104-4ff4-8f6c-e162f3219a86"}]: dispatch 2024-03-04T06:36:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:02 smithi137 ceph-mon[37364]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3782548-3104-4ff4-8f6c-e162f3219a86"}]: dispatch 2024-03-04T06:36:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:02 smithi137 ceph-mon[37364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3782548-3104-4ff4-8f6c-e162f3219a86"}]': finished 2024-03-04T06:36:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:02 smithi137 ceph-mon[37364]: osdmap e22: 4 total, 3 up, 4 in 2024-03-04T06:36:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:02 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:02.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:02 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3927889797' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3782548-3104-4ff4-8f6c-e162f3219a86"}]: dispatch 2024-03-04T06:36:02.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:02 smithi203 ceph-mon[30756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3782548-3104-4ff4-8f6c-e162f3219a86"}]: dispatch 2024-03-04T06:36:02.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:02 smithi203 ceph-mon[30756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3782548-3104-4ff4-8f6c-e162f3219a86"}]': finished 2024-03-04T06:36:02.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:02 smithi203 ceph-mon[30756]: osdmap e22: 4 total, 3 up, 4 in 2024-03-04T06:36:02.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:02 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:03.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:03 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/380396369' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:36:03.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:03 smithi137 ceph-mon[26846]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:03.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:03 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/380396369' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:36:03.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:03 smithi137 ceph-mon[37364]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:03.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:03 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/380396369' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:36:03.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:03 smithi203 ceph-mon[30756]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:06.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:06 smithi137 ceph-mon[26846]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:06 smithi137 ceph-mon[37364]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:06 smithi203 ceph-mon[30756]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:08.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:08 smithi137 ceph-mon[26846]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:08.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:08 smithi137 ceph-mon[37364]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:08 smithi203 ceph-mon[30756]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:09.222 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-04T06:36:09.222 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:09.222 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:09 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-04T06:36:09.222 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:09 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:09.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:09 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-04T06:36:09.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:09 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:10.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:10 smithi137 ceph-mon[26846]: Deploying daemon osd.3 on smithi137 2024-03-04T06:36:10.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:10 smithi137 ceph-mon[26846]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:10.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:10 smithi137 ceph-mon[37364]: Deploying daemon osd.3 on smithi137 2024-03-04T06:36:10.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:10 smithi137 ceph-mon[37364]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:10 smithi203 ceph-mon[30756]: Deploying daemon osd.3 on smithi137 2024-03-04T06:36:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:10 smithi203 ceph-mon[30756]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:11.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:11 smithi137 ceph-mon[26846]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:11.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:11 smithi137 ceph-mon[37364]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:11.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:11 smithi203 ceph-mon[30756]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:14 smithi137 ceph-mon[37364]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:14 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:14 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:14 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:36:14.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:14 smithi137 ceph-mon[26846]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:14.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:14 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:14.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:14 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:14.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:14 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:36:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:14 smithi203 ceph-mon[30756]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:14 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:14 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:14 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:36:16.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:16 smithi137 ceph-mon[26846]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:16.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:16 smithi137 ceph-mon[37364]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:16.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:16 smithi203 ceph-mon[30756]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:16.894 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 3 on host 'smithi137' 2024-03-04T06:36:17.711 DEBUG:teuthology.orchestra.run.smithi137:osd.3> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.3.service 2024-03-04T06:36:17.714 INFO:tasks.cephadm:Deploying osd.4 on smithi203 with /dev/vg_nvme/lv_4... 2024-03-04T06:36:17.714 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-04T06:36:17.925 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:36:18.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:17 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:18.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:17 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:18.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:17 smithi137 ceph-mon[26846]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:18.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:17 smithi137 ceph-mon[26846]: from='osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-04T06:36:18.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:17 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:18.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:17 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:18.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:17 smithi137 ceph-mon[37364]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:18.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:17 smithi137 ceph-mon[37364]: from='osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-04T06:36:18.046 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:17 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:18.046 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:17 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:18.046 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:17 smithi203 ceph-mon[30756]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:18.046 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:17 smithi203 ceph-mon[30756]: from='osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-04T06:36:18.897 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-mon[26846]: from='osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-04T06:36:18.897 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-mon[26846]: osdmap e23: 4 total, 3 up, 4 in 2024-03-04T06:36:18.897 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:18.897 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-mon[26846]: from='osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:36:18.897 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:18.898 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:18.898 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-mon[37364]: from='osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-04T06:36:18.898 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-mon[37364]: osdmap e23: 4 total, 3 up, 4 in 2024-03-04T06:36:18.898 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:18.898 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-mon[37364]: from='osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:36:18.898 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:18.898 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:18.898 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[59225]: 2024-03-04T06:36:18.891+0000 7fb28aa93700 -1 osd.3 0 waiting for initial osdmap 2024-03-04T06:36:18.898 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:36:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[59225]: 2024-03-04T06:36:18.895+0000 7fb284083700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:36:19.181 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:18 smithi203 ceph-mon[30756]: from='osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-04T06:36:19.181 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:18 smithi203 ceph-mon[30756]: osdmap e23: 4 total, 3 up, 4 in 2024-03-04T06:36:19.182 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:18 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:19.182 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:18 smithi203 ceph-mon[30756]: from='osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:36:19.182 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:18 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:19.182 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:18 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:19.856 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-04T06:36:19.856 INFO:teuthology.orchestra.run.smithi203.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-04T06:36:19.856 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10+0 records in 2024-03-04T06:36:19.856 INFO:teuthology.orchestra.run.smithi203.stderr:10+0 records out 2024-03-04T06:36:19.856 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126909 s, 826 MB/s 2024-03-04T06:36:19.857 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping successful for: 2024-03-04T06:36:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:19 smithi137 ceph-mon[26846]: from='osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-03-04T06:36:20.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:19 smithi137 ceph-mon[26846]: osdmap e24: 4 total, 3 up, 4 in 2024-03-04T06:36:20.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:19 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:20.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:19 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:20.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:19 smithi137 ceph-mon[26846]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:20.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:19 smithi137 ceph-mon[37364]: from='osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-03-04T06:36:20.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:19 smithi137 ceph-mon[37364]: osdmap e24: 4 total, 3 up, 4 in 2024-03-04T06:36:20.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:19 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:20.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:19 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:20.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:19 smithi137 ceph-mon[37364]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:20.176 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:19 smithi203 ceph-mon[30756]: from='osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-03-04T06:36:20.176 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:19 smithi203 ceph-mon[30756]: osdmap e24: 4 total, 3 up, 4 in 2024-03-04T06:36:20.176 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:19 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:20.176 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:19 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:20.176 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:19 smithi203 ceph-mon[30756]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-04T06:36:20.464 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi203:vg_nvme/lv_4 2024-03-04T06:36:20.674 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:36:21.013 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:20 smithi203 ceph-mon[30756]: purged_snaps scrub starts 2024-03-04T06:36:21.013 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:20 smithi203 ceph-mon[30756]: purged_snaps scrub ok 2024-03-04T06:36:21.013 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:20 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:21.013 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:20 smithi203 ceph-mon[30756]: osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615] boot 2024-03-04T06:36:21.013 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:20 smithi203 ceph-mon[30756]: osdmap e25: 4 total, 4 up, 4 in 2024-03-04T06:36:21.014 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:20 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:21.260 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:20 smithi137 ceph-mon[26846]: purged_snaps scrub starts 2024-03-04T06:36:21.260 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:20 smithi137 ceph-mon[26846]: purged_snaps scrub ok 2024-03-04T06:36:21.260 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:20 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:21.260 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:20 smithi137 ceph-mon[26846]: osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615] boot 2024-03-04T06:36:21.260 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:20 smithi137 ceph-mon[26846]: osdmap e25: 4 total, 4 up, 4 in 2024-03-04T06:36:21.261 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:20 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:21.261 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:20 smithi137 ceph-mon[37364]: purged_snaps scrub starts 2024-03-04T06:36:21.261 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:20 smithi137 ceph-mon[37364]: purged_snaps scrub ok 2024-03-04T06:36:21.261 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:20 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:21.261 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:20 smithi137 ceph-mon[37364]: osd.3 [v2:172.21.15.137:6826/1906308615,v1:172.21.15.137:6827/1906308615] boot 2024-03-04T06:36:21.261 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:20 smithi137 ceph-mon[37364]: osdmap e25: 4 total, 4 up, 4 in 2024-03-04T06:36:21.261 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:20 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:36:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: osdmap e26: 4 total, 4 up, 4 in 2024-03-04T06:36:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:36:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:36:22.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:22.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:36:22.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: osdmap e26: 4 total, 4 up, 4 in 2024-03-04T06:36:22.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:22.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:22.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:22.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:22.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:22.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:22.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:36:22.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:36:22.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:22.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:36:22.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:21 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: osdmap e26: 4 total, 4 up, 4 in 2024-03-04T06:36:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:36:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:36:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:36:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:21 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:23.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:22 smithi203 ceph-mon[30756]: Detected new or changed devices on smithi137 2024-03-04T06:36:23.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:22 smithi203 ceph-mon[30756]: Adjusting osd_memory_target on smithi137 to 4016M 2024-03-04T06:36:23.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:22 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:36:23.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:22 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:36:23.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:22 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:23.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:22 smithi137 ceph-mon[26846]: Detected new or changed devices on smithi137 2024-03-04T06:36:23.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:22 smithi137 ceph-mon[26846]: Adjusting osd_memory_target on smithi137 to 4016M 2024-03-04T06:36:23.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:22 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:36:23.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:22 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:36:23.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:22 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:23.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:22 smithi137 ceph-mon[37364]: Detected new or changed devices on smithi137 2024-03-04T06:36:23.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:22 smithi137 ceph-mon[37364]: Adjusting osd_memory_target on smithi137 to 4016M 2024-03-04T06:36:23.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:22 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:36:23.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:22 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:36:23.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:22 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:24.035 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:23 smithi203 ceph-mon[30756]: from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:36:24.035 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:23 smithi203 ceph-mon[30756]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:24.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:23 smithi137 ceph-mon[37364]: from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:36:24.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:23 smithi137 ceph-mon[37364]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:23 smithi137 ceph-mon[26846]: from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:36:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:23 smithi137 ceph-mon[26846]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:25.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:24 smithi137 ceph-mon[26846]: from='client.? 172.21.15.203:0/2838750342' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85c12b50-823e-41f7-9cd3-df96128e06a5"}]: dispatch 2024-03-04T06:36:25.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:24 smithi137 ceph-mon[26846]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85c12b50-823e-41f7-9cd3-df96128e06a5"}]: dispatch 2024-03-04T06:36:25.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:24 smithi137 ceph-mon[26846]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85c12b50-823e-41f7-9cd3-df96128e06a5"}]': finished 2024-03-04T06:36:25.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:24 smithi137 ceph-mon[26846]: osdmap e27: 5 total, 4 up, 5 in 2024-03-04T06:36:25.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:24 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:24 smithi137 ceph-mon[37364]: from='client.? 172.21.15.203:0/2838750342' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85c12b50-823e-41f7-9cd3-df96128e06a5"}]: dispatch 2024-03-04T06:36:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:24 smithi137 ceph-mon[37364]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85c12b50-823e-41f7-9cd3-df96128e06a5"}]: dispatch 2024-03-04T06:36:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:24 smithi137 ceph-mon[37364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85c12b50-823e-41f7-9cd3-df96128e06a5"}]': finished 2024-03-04T06:36:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:24 smithi137 ceph-mon[37364]: osdmap e27: 5 total, 4 up, 5 in 2024-03-04T06:36:25.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:24 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:24 smithi203 ceph-mon[30756]: from='client.? 172.21.15.203:0/2838750342' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85c12b50-823e-41f7-9cd3-df96128e06a5"}]: dispatch 2024-03-04T06:36:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:24 smithi203 ceph-mon[30756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85c12b50-823e-41f7-9cd3-df96128e06a5"}]: dispatch 2024-03-04T06:36:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:24 smithi203 ceph-mon[30756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85c12b50-823e-41f7-9cd3-df96128e06a5"}]': finished 2024-03-04T06:36:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:24 smithi203 ceph-mon[30756]: osdmap e27: 5 total, 4 up, 5 in 2024-03-04T06:36:25.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:24 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:26.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:25 smithi137 ceph-mon[26846]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:26.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:25 smithi137 ceph-mon[26846]: from='client.? 172.21.15.203:0/1086662911' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:36:26.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:25 smithi137 ceph-mon[37364]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:26.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:25 smithi137 ceph-mon[37364]: from='client.? 172.21.15.203:0/1086662911' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:36:26.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:25 smithi203 ceph-mon[30756]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:26.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:25 smithi203 ceph-mon[30756]: from='client.? 172.21.15.203:0/1086662911' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:36:28.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:28 smithi137 ceph-mon[26846]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:28.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:28 smithi137 ceph-mon[37364]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:28.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:28 smithi203 ceph-mon[30756]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:30.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:30 smithi137 ceph-mon[26846]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:30.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:30 smithi137 ceph-mon[37364]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:30 smithi203 ceph-mon[30756]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:31.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:31 smithi203 ceph-mon[30756]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:31.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:31 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-04T06:36:31.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:31 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:31.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:31 smithi203 ceph-mon[30756]: Deploying daemon osd.4 on smithi203 2024-03-04T06:36:31.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:31 smithi137 ceph-mon[26846]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:31.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:31 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-04T06:36:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:31 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:31 smithi137 ceph-mon[26846]: Deploying daemon osd.4 on smithi203 2024-03-04T06:36:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:31 smithi137 ceph-mon[37364]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:31 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-04T06:36:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:31 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:31 smithi137 ceph-mon[37364]: Deploying daemon osd.4 on smithi203 2024-03-04T06:36:34.194 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:34 smithi203 ceph-mon[30756]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:34.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:34 smithi137 ceph-mon[26846]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:34.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:34 smithi137 ceph-mon[37364]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:36.251 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:36 smithi203 ceph-mon[30756]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:36.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:36 smithi137 ceph-mon[26846]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:36.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:36 smithi137 ceph-mon[37364]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:37.767 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:37 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:37.767 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:37 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:37.767 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:37 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:36:37.767 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:37 smithi203 ceph-mon[30756]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:37 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:37 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:37 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:36:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:37 smithi137 ceph-mon[26846]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:37.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:37 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:37 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:37 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:36:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:37 smithi137 ceph-mon[37364]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:39.469 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 4 on host 'smithi203' 2024-03-04T06:36:40.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:40 smithi203 ceph-mon[30756]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:40.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:40 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:40.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:40 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:40.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:40 smithi203 ceph-mon[30756]: from='osd.4 [v2:172.21.15.203:6800/483489448,v1:172.21.15.203:6801/483489448]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T06:36:40.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:40 smithi203 ceph-mon[30756]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T06:36:40.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:40 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:40.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:40 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:40.138 DEBUG:teuthology.orchestra.run.smithi203:osd.4> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.4.service 2024-03-04T06:36:40.140 INFO:tasks.cephadm:Deploying osd.5 on smithi203 with /dev/vg_nvme/lv_3... 2024-03-04T06:36:40.140 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-04T06:36:40.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[26846]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:40.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:40.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:40.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[26846]: from='osd.4 [v2:172.21.15.203:6800/483489448,v1:172.21.15.203:6801/483489448]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T06:36:40.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[26846]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T06:36:40.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:40.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:40.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[37364]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:40.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:40.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:40.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[37364]: from='osd.4 [v2:172.21.15.203:6800/483489448,v1:172.21.15.203:6801/483489448]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T06:36:40.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[37364]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T06:36:40.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:40.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:40 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:40.383 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:36:41.775 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:41 smithi203 ceph-mon[30756]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-04T06:36:41.775 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:41 smithi203 ceph-mon[30756]: osdmap e28: 5 total, 4 up, 5 in 2024-03-04T06:36:41.775 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:41 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:41.775 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:41 smithi203 ceph-mon[30756]: from='osd.4 [v2:172.21.15.203:6800/483489448,v1:172.21.15.203:6801/483489448]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:36:41.775 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:41 smithi203 ceph-mon[30756]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:36:41.775 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:41 smithi203 ceph-mon[30756]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:41.775 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:36:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[35700]: 2024-03-04T06:36:41.438+0000 7fcd24580700 -1 osd.4 0 waiting for initial osdmap 2024-03-04T06:36:41.775 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:36:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[35700]: 2024-03-04T06:36:41.443+0000 7fcd1cb6e700 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:36:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:41 smithi137 ceph-mon[26846]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-04T06:36:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:41 smithi137 ceph-mon[26846]: osdmap e28: 5 total, 4 up, 5 in 2024-03-04T06:36:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:41 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:41 smithi137 ceph-mon[26846]: from='osd.4 [v2:172.21.15.203:6800/483489448,v1:172.21.15.203:6801/483489448]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:36:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:41 smithi137 ceph-mon[26846]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:36:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:41 smithi137 ceph-mon[26846]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:41.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:41 smithi137 ceph-mon[37364]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-04T06:36:41.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:41 smithi137 ceph-mon[37364]: osdmap e28: 5 total, 4 up, 5 in 2024-03-04T06:36:41.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:41 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:41.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:41 smithi137 ceph-mon[37364]: from='osd.4 [v2:172.21.15.203:6800/483489448,v1:172.21.15.203:6801/483489448]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:36:41.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:41 smithi137 ceph-mon[37364]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:36:41.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:41 smithi137 ceph-mon[37364]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-04T06:36:42.418 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-04T06:36:42.418 INFO:teuthology.orchestra.run.smithi203.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-04T06:36:42.419 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10+0 records in 2024-03-04T06:36:42.419 INFO:teuthology.orchestra.run.smithi203.stderr:10+0 records out 2024-03-04T06:36:42.419 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128599 s, 815 MB/s 2024-03-04T06:36:42.419 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping successful for: 2024-03-04T06:36:42.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[26846]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-03-04T06:36:42.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[26846]: osdmap e29: 5 total, 4 up, 5 in 2024-03-04T06:36:42.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:42.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:42.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[26846]: osd.4 [v2:172.21.15.203:6800/483489448,v1:172.21.15.203:6801/483489448] boot 2024-03-04T06:36:42.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[26846]: osdmap e30: 5 total, 5 up, 5 in 2024-03-04T06:36:42.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[37364]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-03-04T06:36:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[37364]: osdmap e29: 5 total, 4 up, 5 in 2024-03-04T06:36:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[37364]: osd.4 [v2:172.21.15.203:6800/483489448,v1:172.21.15.203:6801/483489448] boot 2024-03-04T06:36:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[37364]: osdmap e30: 5 total, 5 up, 5 in 2024-03-04T06:36:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:42 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:42.820 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:42 smithi203 ceph-mon[30756]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-03-04T06:36:42.821 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:42 smithi203 ceph-mon[30756]: osdmap e29: 5 total, 4 up, 5 in 2024-03-04T06:36:42.821 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:42 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:42.821 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:42 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:42.821 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:42 smithi203 ceph-mon[30756]: osd.4 [v2:172.21.15.203:6800/483489448,v1:172.21.15.203:6801/483489448] boot 2024-03-04T06:36:42.821 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:42 smithi203 ceph-mon[30756]: osdmap e30: 5 total, 5 up, 5 in 2024-03-04T06:36:42.821 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:42 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:36:43.151 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi203:vg_nvme/lv_3 2024-03-04T06:36:43.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:43 smithi203 ceph-mon[30756]: purged_snaps scrub starts 2024-03-04T06:36:43.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:43 smithi203 ceph-mon[30756]: purged_snaps scrub ok 2024-03-04T06:36:43.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:43 smithi203 ceph-mon[30756]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:43.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:43 smithi203 ceph-mon[30756]: osdmap e31: 5 total, 5 up, 5 in 2024-03-04T06:36:43.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:43 smithi137 ceph-mon[26846]: purged_snaps scrub starts 2024-03-04T06:36:43.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:43 smithi137 ceph-mon[26846]: purged_snaps scrub ok 2024-03-04T06:36:43.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:43 smithi137 ceph-mon[26846]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:43.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:43 smithi137 ceph-mon[26846]: osdmap e31: 5 total, 5 up, 5 in 2024-03-04T06:36:43.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:43 smithi137 ceph-mon[37364]: purged_snaps scrub starts 2024-03-04T06:36:43.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:43 smithi137 ceph-mon[37364]: purged_snaps scrub ok 2024-03-04T06:36:43.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:43 smithi137 ceph-mon[37364]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:43.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:43 smithi137 ceph-mon[37364]: osdmap e31: 5 total, 5 up, 5 in 2024-03-04T06:36:44.015 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:36:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:45 smithi203 ceph-mon[30756]: osdmap e32: 5 total, 5 up, 5 in 2024-03-04T06:36:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:45 smithi203 ceph-mon[30756]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:45 smithi203 ceph-mon[30756]: osdmap e33: 5 total, 5 up, 5 in 2024-03-04T06:36:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:45 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:45 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:45 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:45 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:45 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:45 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:36:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:45 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:45.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[26846]: osdmap e32: 5 total, 5 up, 5 in 2024-03-04T06:36:45.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[26846]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:45.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[26846]: osdmap e33: 5 total, 5 up, 5 in 2024-03-04T06:36:45.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:45.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:45.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:45.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:45.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:45.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:36:45.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[37364]: osdmap e32: 5 total, 5 up, 5 in 2024-03-04T06:36:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[37364]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[37364]: osdmap e33: 5 total, 5 up, 5 in 2024-03-04T06:36:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:36:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:36:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:45 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:46.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[26846]: Detected new or changed devices on smithi203 2024-03-04T06:36:46.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[26846]: Adjusting osd_memory_target on smithi203 to 17088M 2024-03-04T06:36:46.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:36:46.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:46.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:36:46.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:46.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[26846]: osdmap e34: 5 total, 5 up, 5 in 2024-03-04T06:36:46.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[37364]: Detected new or changed devices on smithi203 2024-03-04T06:36:46.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[37364]: Adjusting osd_memory_target on smithi203 to 17088M 2024-03-04T06:36:46.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:36:46.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:46.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:36:46.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:46.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:46 smithi137 ceph-mon[37364]: osdmap e34: 5 total, 5 up, 5 in 2024-03-04T06:36:46.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:46 smithi203 ceph-mon[30756]: Detected new or changed devices on smithi203 2024-03-04T06:36:46.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:46 smithi203 ceph-mon[30756]: Adjusting osd_memory_target on smithi203 to 17088M 2024-03-04T06:36:46.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:46 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:36:46.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:46 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:46.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:46 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:36:46.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:46 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:36:46.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:46 smithi203 ceph-mon[30756]: osdmap e34: 5 total, 5 up, 5 in 2024-03-04T06:36:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:47 smithi203 ceph-mon[30756]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:36:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:47 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:36:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:47 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:36:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:47 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:47 smithi203 ceph-mon[30756]: pgmap v116: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-04T06:36:47.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:47 smithi137 ceph-mon[26846]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:36:47.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:47 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:36:47.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:47 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:36:47.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:47 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:47.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:47 smithi137 ceph-mon[26846]: pgmap v116: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-04T06:36:47.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:47 smithi137 ceph-mon[37364]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:36:47.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:47 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:36:47.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:47 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:36:47.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:47 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:47.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:47 smithi137 ceph-mon[37364]: pgmap v116: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-04T06:36:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[26846]: pgmap v117: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 136 MiB used, 447 GiB / 447 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-03-04T06:36:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[26846]: from='client.? 172.21.15.203:0/3394006257' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28d2b3b3-e24b-4975-8c7f-191f0c984331"}]: dispatch 2024-03-04T06:36:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[26846]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28d2b3b3-e24b-4975-8c7f-191f0c984331"}]: dispatch 2024-03-04T06:36:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[26846]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28d2b3b3-e24b-4975-8c7f-191f0c984331"}]': finished 2024-03-04T06:36:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[26846]: osdmap e35: 6 total, 5 up, 6 in 2024-03-04T06:36:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:36:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[26846]: from='client.? 172.21.15.203:0/3213005771' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:36:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[37364]: pgmap v117: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 136 MiB used, 447 GiB / 447 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-03-04T06:36:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[37364]: from='client.? 172.21.15.203:0/3394006257' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28d2b3b3-e24b-4975-8c7f-191f0c984331"}]: dispatch 2024-03-04T06:36:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[37364]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28d2b3b3-e24b-4975-8c7f-191f0c984331"}]: dispatch 2024-03-04T06:36:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[37364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28d2b3b3-e24b-4975-8c7f-191f0c984331"}]': finished 2024-03-04T06:36:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[37364]: osdmap e35: 6 total, 5 up, 6 in 2024-03-04T06:36:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:36:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:50 smithi137 ceph-mon[37364]: from='client.? 172.21.15.203:0/3213005771' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:36:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:50 smithi203 ceph-mon[30756]: pgmap v117: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 136 MiB used, 447 GiB / 447 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-03-04T06:36:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:50 smithi203 ceph-mon[30756]: from='client.? 172.21.15.203:0/3394006257' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28d2b3b3-e24b-4975-8c7f-191f0c984331"}]: dispatch 2024-03-04T06:36:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:50 smithi203 ceph-mon[30756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28d2b3b3-e24b-4975-8c7f-191f0c984331"}]: dispatch 2024-03-04T06:36:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:50 smithi203 ceph-mon[30756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28d2b3b3-e24b-4975-8c7f-191f0c984331"}]': finished 2024-03-04T06:36:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:50 smithi203 ceph-mon[30756]: osdmap e35: 6 total, 5 up, 6 in 2024-03-04T06:36:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:50 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:36:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:50 smithi203 ceph-mon[30756]: from='client.? 172.21.15.203:0/3213005771' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:36:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:51 smithi137 ceph-mon[26846]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-04T06:36:51.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:51 smithi137 ceph-mon[37364]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-04T06:36:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:51 smithi203 ceph-mon[30756]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-04T06:36:54.245 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:54 smithi203 ceph-mon[30756]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:54.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:54 smithi137 ceph-mon[26846]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:54.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:54 smithi137 ceph-mon[37364]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:56.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:56 smithi203 ceph-mon[30756]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:56.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-04T06:36:56.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:56 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:56.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:56 smithi137 ceph-mon[26846]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:56.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-04T06:36:56.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:56 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:56.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:56 smithi137 ceph-mon[37364]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:56.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-04T06:36:56.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:56 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:36:57.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:57 smithi137 ceph-mon[37364]: Deploying daemon osd.5 on smithi203 2024-03-04T06:36:57.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:57 smithi137 ceph-mon[26846]: Deploying daemon osd.5 on smithi203 2024-03-04T06:36:57.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:57 smithi203 ceph-mon[30756]: Deploying daemon osd.5 on smithi203 2024-03-04T06:36:58.070 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:36:58 smithi203 ceph-mon[30756]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:58.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:36:58 smithi137 ceph-mon[26846]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:36:58.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:36:58 smithi137 ceph-mon[37364]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:37:00.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:00 smithi137 ceph-mon[26846]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:37:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:00 smithi137 ceph-mon[37364]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:37:00.308 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:00 smithi203 ceph-mon[30756]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:37:01.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:01 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:01.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:01 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:01 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:01 smithi137 ceph-mon[37364]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:37:01.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:01 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:01.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:01 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:01.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:01 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:01.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:01 smithi137 ceph-mon[26846]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:37:01.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:01 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:01.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:01 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:01.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:01 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:01.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:01 smithi203 ceph-mon[30756]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:37:04.017 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 5 on host 'smithi203' 2024-03-04T06:37:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:04 smithi203 ceph-mon[30756]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:37:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:04 smithi203 ceph-mon[30756]: from='osd.5 [v2:172.21.15.203:6808/1227714102,v1:172.21.15.203:6809/1227714102]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T06:37:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:04 smithi203 ceph-mon[30756]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T06:37:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:04.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[26846]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:37:04.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[26846]: from='osd.5 [v2:172.21.15.203:6808/1227714102,v1:172.21.15.203:6809/1227714102]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T06:37:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[26846]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T06:37:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:04.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[37364]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:37:04.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:04.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:04.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[37364]: from='osd.5 [v2:172.21.15.203:6808/1227714102,v1:172.21.15.203:6809/1227714102]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T06:37:04.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[37364]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T06:37:04.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:04.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:04.673 DEBUG:teuthology.orchestra.run.smithi203:osd.5> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.5.service 2024-03-04T06:37:04.676 INFO:tasks.cephadm:Deploying osd.6 on smithi203 with /dev/vg_nvme/lv_2... 2024-03-04T06:37:04.676 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-04T06:37:05.239 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:05 smithi203 ceph-mon[30756]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-04T06:37:05.239 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:05 smithi203 ceph-mon[30756]: osdmap e36: 6 total, 5 up, 6 in 2024-03-04T06:37:05.239 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:05 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:37:05.239 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:05 smithi203 ceph-mon[30756]: from='osd.5 [v2:172.21.15.203:6808/1227714102,v1:172.21.15.203:6809/1227714102]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:05.240 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:05 smithi203 ceph-mon[30756]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:05.240 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:37:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[41578]: 2024-03-04T06:37:05.134+0000 7f1226f22700 -1 osd.5 0 waiting for initial osdmap 2024-03-04T06:37:05.240 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:37:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[41578]: 2024-03-04T06:37:05.139+0000 7f1222d17700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:37:05.465 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:37:05.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:05 smithi137 ceph-mon[26846]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-04T06:37:05.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:05 smithi137 ceph-mon[26846]: osdmap e36: 6 total, 5 up, 6 in 2024-03-04T06:37:05.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:05 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:37:05.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:05 smithi137 ceph-mon[26846]: from='osd.5 [v2:172.21.15.203:6808/1227714102,v1:172.21.15.203:6809/1227714102]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:05.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:05 smithi137 ceph-mon[26846]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:05.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:05 smithi137 ceph-mon[37364]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-04T06:37:05.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:05 smithi137 ceph-mon[37364]: osdmap e36: 6 total, 5 up, 6 in 2024-03-04T06:37:05.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:05 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:37:05.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:05 smithi137 ceph-mon[37364]: from='osd.5 [v2:172.21.15.203:6808/1227714102,v1:172.21.15.203:6809/1227714102]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:05.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:05 smithi137 ceph-mon[37364]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:06.237 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:06 smithi203 ceph-mon[30756]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:37:06.238 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:06 smithi203 ceph-mon[30756]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-03-04T06:37:06.238 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:06 smithi203 ceph-mon[30756]: osdmap e37: 6 total, 5 up, 6 in 2024-03-04T06:37:06.238 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:06 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:37:06.238 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:06 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:37:06.238 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:06 smithi203 ceph-mon[30756]: osd.5 [v2:172.21.15.203:6808/1227714102,v1:172.21.15.203:6809/1227714102] boot 2024-03-04T06:37:06.238 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:06 smithi203 ceph-mon[30756]: osdmap e38: 6 total, 6 up, 6 in 2024-03-04T06:37:06.238 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:06 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:37:06.444 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[26846]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:37:06.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[26846]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-03-04T06:37:06.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[26846]: osdmap e37: 6 total, 5 up, 6 in 2024-03-04T06:37:06.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:37:06.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:37:06.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[26846]: osd.5 [v2:172.21.15.203:6808/1227714102,v1:172.21.15.203:6809/1227714102] boot 2024-03-04T06:37:06.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[26846]: osdmap e38: 6 total, 6 up, 6 in 2024-03-04T06:37:06.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:37:06.445 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[37364]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-04T06:37:06.445 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[37364]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-03-04T06:37:06.445 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[37364]: osdmap e37: 6 total, 5 up, 6 in 2024-03-04T06:37:06.445 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:37:06.445 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:37:06.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[37364]: osd.5 [v2:172.21.15.203:6808/1227714102,v1:172.21.15.203:6809/1227714102] boot 2024-03-04T06:37:06.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[37364]: osdmap e38: 6 total, 6 up, 6 in 2024-03-04T06:37:06.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:06 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:37:07.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:07 smithi137 ceph-mon[26846]: purged_snaps scrub starts 2024-03-04T06:37:07.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:07 smithi137 ceph-mon[26846]: purged_snaps scrub ok 2024-03-04T06:37:07.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:07 smithi137 ceph-mon[26846]: osdmap e39: 6 total, 6 up, 6 in 2024-03-04T06:37:07.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:07 smithi137 ceph-mon[26846]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:07 smithi137 ceph-mon[37364]: purged_snaps scrub starts 2024-03-04T06:37:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:07 smithi137 ceph-mon[37364]: purged_snaps scrub ok 2024-03-04T06:37:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:07 smithi137 ceph-mon[37364]: osdmap e39: 6 total, 6 up, 6 in 2024-03-04T06:37:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:07 smithi137 ceph-mon[37364]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:07 smithi203 ceph-mon[30756]: purged_snaps scrub starts 2024-03-04T06:37:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:07 smithi203 ceph-mon[30756]: purged_snaps scrub ok 2024-03-04T06:37:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:07 smithi203 ceph-mon[30756]: osdmap e39: 6 total, 6 up, 6 in 2024-03-04T06:37:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:07 smithi203 ceph-mon[30756]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:07.836 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-04T06:37:07.836 INFO:teuthology.orchestra.run.smithi203.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-04T06:37:07.836 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10+0 records in 2024-03-04T06:37:07.836 INFO:teuthology.orchestra.run.smithi203.stderr:10+0 records out 2024-03-04T06:37:07.836 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.013192 s, 795 MB/s 2024-03-04T06:37:07.836 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping successful for: 2024-03-04T06:37:08.472 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:08 smithi203 ceph-mon[30756]: osdmap e40: 6 total, 6 up, 6 in 2024-03-04T06:37:08.497 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi203:vg_nvme/lv_2 2024-03-04T06:37:08.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:08 smithi137 ceph-mon[26846]: osdmap e40: 6 total, 6 up, 6 in 2024-03-04T06:37:08.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:08 smithi137 ceph-mon[37364]: osdmap e40: 6 total, 6 up, 6 in 2024-03-04T06:37:08.784 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:37:09.419 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:09 smithi203 ceph-mon[30756]: osdmap e41: 6 total, 6 up, 6 in 2024-03-04T06:37:09.419 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:09 smithi203 ceph-mon[30756]: pgmap v134: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-03-04T06:37:09.419 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:09 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:09.420 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:09 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:09.420 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:09 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:09.420 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:09 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:09.420 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:09 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:09.420 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:09 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:09.420 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:09 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:09.420 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:09 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[26846]: osdmap e41: 6 total, 6 up, 6 in 2024-03-04T06:37:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[26846]: pgmap v134: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-03-04T06:37:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:09.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:09.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[37364]: osdmap e41: 6 total, 6 up, 6 in 2024-03-04T06:37:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[37364]: pgmap v134: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-03-04T06:37:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:09 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:10.492 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:10 smithi203 ceph-mon[30756]: Detected new or changed devices on smithi203 2024-03-04T06:37:10.492 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:10 smithi203 ceph-mon[30756]: Adjusting osd_memory_target on smithi203 to 8544M 2024-03-04T06:37:10.492 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:10 smithi203 ceph-mon[30756]: osdmap e42: 6 total, 6 up, 6 in 2024-03-04T06:37:10.492 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:10 smithi203 ceph-mon[30756]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-03-04T06:37:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:10 smithi137 ceph-mon[26846]: Detected new or changed devices on smithi203 2024-03-04T06:37:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:10 smithi137 ceph-mon[26846]: Adjusting osd_memory_target on smithi203 to 8544M 2024-03-04T06:37:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:10 smithi137 ceph-mon[26846]: osdmap e42: 6 total, 6 up, 6 in 2024-03-04T06:37:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:10 smithi137 ceph-mon[26846]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-03-04T06:37:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:10 smithi137 ceph-mon[37364]: Detected new or changed devices on smithi203 2024-03-04T06:37:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:10 smithi137 ceph-mon[37364]: Adjusting osd_memory_target on smithi203 to 8544M 2024-03-04T06:37:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:10 smithi137 ceph-mon[37364]: osdmap e42: 6 total, 6 up, 6 in 2024-03-04T06:37:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:10 smithi137 ceph-mon[37364]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-03-04T06:37:11.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:11 smithi203 ceph-mon[30756]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:37:11.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:11 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:37:11.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:11 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:37:11.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:11 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:11.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:11 smithi203 ceph-mon[30756]: pgmap v136: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-03-04T06:37:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:11 smithi137 ceph-mon[26846]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:37:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:11 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:37:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:11 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:37:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:11 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:11 smithi137 ceph-mon[26846]: pgmap v136: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-03-04T06:37:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:11 smithi137 ceph-mon[37364]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:37:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:11 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:37:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:11 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:37:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:11 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:11 smithi137 ceph-mon[37364]: pgmap v136: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-03-04T06:37:13.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:13 smithi203 ceph-mon[30756]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-03-04T06:37:13.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:13 smithi203 ceph-mon[30756]: Cluster is now healthy 2024-03-04T06:37:13.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:13 smithi137 ceph-mon[26846]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-03-04T06:37:13.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:13 smithi137 ceph-mon[26846]: Cluster is now healthy 2024-03-04T06:37:13.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:13 smithi137 ceph-mon[37364]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-03-04T06:37:13.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:13 smithi137 ceph-mon[37364]: Cluster is now healthy 2024-03-04T06:37:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:14 smithi203 ceph-mon[30756]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:14 smithi203 ceph-mon[30756]: from='client.? 172.21.15.203:0/2476000621' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "930f40c0-a191-4015-b238-ab6f546be67c"}]: dispatch 2024-03-04T06:37:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:14 smithi203 ceph-mon[30756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "930f40c0-a191-4015-b238-ab6f546be67c"}]: dispatch 2024-03-04T06:37:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:14 smithi203 ceph-mon[30756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "930f40c0-a191-4015-b238-ab6f546be67c"}]': finished 2024-03-04T06:37:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:14 smithi203 ceph-mon[30756]: osdmap e43: 7 total, 6 up, 7 in 2024-03-04T06:37:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:14 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:14 smithi137 ceph-mon[26846]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:14 smithi137 ceph-mon[26846]: from='client.? 172.21.15.203:0/2476000621' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "930f40c0-a191-4015-b238-ab6f546be67c"}]: dispatch 2024-03-04T06:37:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:14 smithi137 ceph-mon[26846]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "930f40c0-a191-4015-b238-ab6f546be67c"}]: dispatch 2024-03-04T06:37:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:14 smithi137 ceph-mon[26846]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "930f40c0-a191-4015-b238-ab6f546be67c"}]': finished 2024-03-04T06:37:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:14 smithi137 ceph-mon[26846]: osdmap e43: 7 total, 6 up, 7 in 2024-03-04T06:37:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:14 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:14 smithi137 ceph-mon[37364]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:14 smithi137 ceph-mon[37364]: from='client.? 172.21.15.203:0/2476000621' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "930f40c0-a191-4015-b238-ab6f546be67c"}]: dispatch 2024-03-04T06:37:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:14 smithi137 ceph-mon[37364]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "930f40c0-a191-4015-b238-ab6f546be67c"}]: dispatch 2024-03-04T06:37:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:14 smithi137 ceph-mon[37364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "930f40c0-a191-4015-b238-ab6f546be67c"}]': finished 2024-03-04T06:37:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:14 smithi137 ceph-mon[37364]: osdmap e43: 7 total, 6 up, 7 in 2024-03-04T06:37:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:14 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:15.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:15 smithi203 ceph-mon[30756]: from='client.? 172.21.15.203:0/290147319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:37:15.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:15 smithi137 ceph-mon[26846]: from='client.? 172.21.15.203:0/290147319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:37:15.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:15 smithi137 ceph-mon[37364]: from='client.? 172.21.15.203:0/290147319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:37:16.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:16 smithi203 ceph-mon[30756]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-04T06:37:16.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:16 smithi137 ceph-mon[26846]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-04T06:37:16.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:16 smithi137 ceph-mon[37364]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-04T06:37:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:18 smithi203 ceph-mon[30756]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-04T06:37:18.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:18 smithi137 ceph-mon[26846]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-04T06:37:18.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:18 smithi137 ceph-mon[37364]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-04T06:37:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:20 smithi203 ceph-mon[30756]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-03-04T06:37:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:20 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-04T06:37:20.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:20 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:20.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:20 smithi137 ceph-mon[26846]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-03-04T06:37:20.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:20 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-04T06:37:20.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:20 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:20 smithi137 ceph-mon[37364]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-03-04T06:37:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:20 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-04T06:37:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:20 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:21.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:21 smithi203 ceph-mon[30756]: Deploying daemon osd.6 on smithi203 2024-03-04T06:37:21.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:21 smithi137 ceph-mon[37364]: Deploying daemon osd.6 on smithi203 2024-03-04T06:37:21.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:21 smithi137 ceph-mon[26846]: Deploying daemon osd.6 on smithi203 2024-03-04T06:37:22.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:22 smithi203 ceph-mon[30756]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-04T06:37:22.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:22 smithi137 ceph-mon[37364]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-04T06:37:22.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:22 smithi137 ceph-mon[26846]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-04T06:37:24.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:24 smithi203 ceph-mon[30756]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:24.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:24 smithi137 ceph-mon[26846]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:24.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:24 smithi137 ceph-mon[37364]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:26.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:26 smithi137 ceph-mon[26846]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:26.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:26 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:26.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:26 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:26.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:26 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:26.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:26 smithi137 ceph-mon[37364]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:26.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:26 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:26.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:26 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:26.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:26 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:26.341 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:26 smithi203 ceph-mon[30756]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:26.341 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:26 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:26.341 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:26 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:26.341 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:26 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:28.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:28 smithi137 ceph-mon[26846]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:28.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:28 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:28.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:28 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:28.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:28 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:28.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:28 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:28.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:28 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:28.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:28 smithi137 ceph-mon[37364]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:28.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:28 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:28.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:28 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:28.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:28 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:28.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:28 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:28.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:28 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:28.302 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:28 smithi203 ceph-mon[30756]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:28.302 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:28 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:28.302 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:28 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:28.302 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:28 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:28.302 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:28 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:28.302 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:28 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:28.360 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 6 on host 'smithi203' 2024-03-04T06:37:28.978 DEBUG:teuthology.orchestra.run.smithi203:osd.6> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.6.service 2024-03-04T06:37:28.981 INFO:tasks.cephadm:Deploying osd.7 on smithi203 with /dev/vg_nvme/lv_1... 2024-03-04T06:37:28.981 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-04T06:37:29.286 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:29 smithi203 ceph-mon[30756]: from='osd.6 [v2:172.21.15.203:6816/593999121,v1:172.21.15.203:6817/593999121]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T06:37:29.286 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:29 smithi203 ceph-mon[30756]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T06:37:29.286 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:29 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:29.286 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:29 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:29.286 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:29 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:29.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:29 smithi137 ceph-mon[26846]: from='osd.6 [v2:172.21.15.203:6816/593999121,v1:172.21.15.203:6817/593999121]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T06:37:29.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:29 smithi137 ceph-mon[26846]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T06:37:29.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:29 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:29.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:29 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:29.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:29 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:29.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:29 smithi137 ceph-mon[37364]: from='osd.6 [v2:172.21.15.203:6816/593999121,v1:172.21.15.203:6817/593999121]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T06:37:29.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:29 smithi137 ceph-mon[37364]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T06:37:29.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:29 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:29.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:29 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:29.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:29 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:29.685 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:37:30.056 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:30 smithi203 ceph-mon[30756]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:30.056 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:30 smithi203 ceph-mon[30756]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-04T06:37:30.056 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:30 smithi203 ceph-mon[30756]: osdmap e44: 7 total, 6 up, 7 in 2024-03-04T06:37:30.056 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:30.056 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:30 smithi203 ceph-mon[30756]: from='osd.6 [v2:172.21.15.203:6816/593999121,v1:172.21.15.203:6817/593999121]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:30.056 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:30 smithi203 ceph-mon[30756]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:30.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:37:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[47437]: 2024-03-04T06:37:30.054+0000 7fe462b90700 -1 osd.6 0 waiting for initial osdmap 2024-03-04T06:37:30.362 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:37:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[47437]: 2024-03-04T06:37:30.060+0000 7fe45e184700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:37:30.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:30 smithi137 ceph-mon[26846]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:30.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:30 smithi137 ceph-mon[26846]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-04T06:37:30.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:30 smithi137 ceph-mon[26846]: osdmap e44: 7 total, 6 up, 7 in 2024-03-04T06:37:30.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:30 smithi137 ceph-mon[26846]: from='osd.6 [v2:172.21.15.203:6816/593999121,v1:172.21.15.203:6817/593999121]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:30 smithi137 ceph-mon[26846]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:30 smithi137 ceph-mon[37364]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:30 smithi137 ceph-mon[37364]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-04T06:37:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:30 smithi137 ceph-mon[37364]: osdmap e44: 7 total, 6 up, 7 in 2024-03-04T06:37:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:30 smithi137 ceph-mon[37364]: from='osd.6 [v2:172.21.15.203:6816/593999121,v1:172.21.15.203:6817/593999121]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:30 smithi137 ceph-mon[37364]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:31.293 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:31 smithi203 ceph-mon[30756]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-03-04T06:37:31.293 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:31 smithi203 ceph-mon[30756]: osdmap e45: 7 total, 6 up, 7 in 2024-03-04T06:37:31.293 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:31 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:31.293 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:31 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:31.293 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:31 smithi203 ceph-mon[30756]: osd.6 [v2:172.21.15.203:6816/593999121,v1:172.21.15.203:6817/593999121] boot 2024-03-04T06:37:31.294 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:31 smithi203 ceph-mon[30756]: osdmap e46: 7 total, 7 up, 7 in 2024-03-04T06:37:31.294 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:31 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:31.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[26846]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-03-04T06:37:31.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[26846]: osdmap e45: 7 total, 6 up, 7 in 2024-03-04T06:37:31.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:31.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:31.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[26846]: osd.6 [v2:172.21.15.203:6816/593999121,v1:172.21.15.203:6817/593999121] boot 2024-03-04T06:37:31.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[26846]: osdmap e46: 7 total, 7 up, 7 in 2024-03-04T06:37:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[37364]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-03-04T06:37:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[37364]: osdmap e45: 7 total, 6 up, 7 in 2024-03-04T06:37:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[37364]: osd.6 [v2:172.21.15.203:6816/593999121,v1:172.21.15.203:6817/593999121] boot 2024-03-04T06:37:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[37364]: osdmap e46: 7 total, 7 up, 7 in 2024-03-04T06:37:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:31 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:37:32.017 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-04T06:37:32.017 INFO:teuthology.orchestra.run.smithi203.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-04T06:37:32.017 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10+0 records in 2024-03-04T06:37:32.017 INFO:teuthology.orchestra.run.smithi203.stderr:10+0 records out 2024-03-04T06:37:32.017 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.014236 s, 737 MB/s 2024-03-04T06:37:32.017 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping successful for: 2024-03-04T06:37:32.324 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:32 smithi203 ceph-mon[30756]: purged_snaps scrub starts 2024-03-04T06:37:32.324 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:32 smithi203 ceph-mon[30756]: purged_snaps scrub ok 2024-03-04T06:37:32.324 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:32 smithi203 ceph-mon[30756]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:32.324 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:32 smithi203 ceph-mon[30756]: osdmap e47: 7 total, 7 up, 7 in 2024-03-04T06:37:32.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:32 smithi137 ceph-mon[26846]: purged_snaps scrub starts 2024-03-04T06:37:32.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:32 smithi137 ceph-mon[26846]: purged_snaps scrub ok 2024-03-04T06:37:32.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:32 smithi137 ceph-mon[26846]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:32.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:32 smithi137 ceph-mon[26846]: osdmap e47: 7 total, 7 up, 7 in 2024-03-04T06:37:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:32 smithi137 ceph-mon[37364]: purged_snaps scrub starts 2024-03-04T06:37:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:32 smithi137 ceph-mon[37364]: purged_snaps scrub ok 2024-03-04T06:37:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:32 smithi137 ceph-mon[37364]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-04T06:37:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:32 smithi137 ceph-mon[37364]: osdmap e47: 7 total, 7 up, 7 in 2024-03-04T06:37:32.642 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi203:vg_nvme/lv_1 2024-03-04T06:37:33.194 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:37:33.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:33 smithi203 ceph-mon[30756]: osdmap e48: 7 total, 7 up, 7 in 2024-03-04T06:37:33.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:33 smithi203 ceph-mon[30756]: pgmap v153: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 2/6 objects degraded (33.333%) 2024-03-04T06:37:33.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:33 smithi203 ceph-mon[30756]: Detected new or changed devices on smithi203 2024-03-04T06:37:33.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:33 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:33.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:33 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:33.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:33 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:33.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:33 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:33.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:33 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:33.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:33 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:33.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:33 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:33.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:33 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:33.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:33 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[26846]: osdmap e48: 7 total, 7 up, 7 in 2024-03-04T06:37:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[26846]: pgmap v153: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 2/6 objects degraded (33.333%) 2024-03-04T06:37:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[26846]: Detected new or changed devices on smithi203 2024-03-04T06:37:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[37364]: osdmap e48: 7 total, 7 up, 7 in 2024-03-04T06:37:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[37364]: pgmap v153: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 2/6 objects degraded (33.333%) 2024-03-04T06:37:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[37364]: Detected new or changed devices on smithi203 2024-03-04T06:37:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:33 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:34.578 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:34 smithi203 ceph-mon[30756]: Adjusting osd_memory_target on smithi203 to 5696M 2024-03-04T06:37:34.579 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:34 smithi203 ceph-mon[30756]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-03-04T06:37:34.579 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:34 smithi203 ceph-mon[30756]: osdmap e49: 7 total, 7 up, 7 in 2024-03-04T06:37:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:34 smithi137 ceph-mon[26846]: Adjusting osd_memory_target on smithi203 to 5696M 2024-03-04T06:37:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:34 smithi137 ceph-mon[26846]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-03-04T06:37:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:34 smithi137 ceph-mon[26846]: osdmap e49: 7 total, 7 up, 7 in 2024-03-04T06:37:34.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:34 smithi137 ceph-mon[37364]: Adjusting osd_memory_target on smithi203 to 5696M 2024-03-04T06:37:34.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:34 smithi137 ceph-mon[37364]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-03-04T06:37:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:34 smithi137 ceph-mon[37364]: osdmap e49: 7 total, 7 up, 7 in 2024-03-04T06:37:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:35 smithi203 ceph-mon[30756]: osdmap e50: 7 total, 7 up, 7 in 2024-03-04T06:37:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:35 smithi203 ceph-mon[30756]: pgmap v156: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 2/6 objects degraded (33.333%) 2024-03-04T06:37:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:35 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:37:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:35 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:37:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:35 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:35 smithi137 ceph-mon[26846]: osdmap e50: 7 total, 7 up, 7 in 2024-03-04T06:37:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:35 smithi137 ceph-mon[26846]: pgmap v156: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 2/6 objects degraded (33.333%) 2024-03-04T06:37:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:35 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:37:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:35 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:37:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:35 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:35 smithi137 ceph-mon[37364]: osdmap e50: 7 total, 7 up, 7 in 2024-03-04T06:37:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:35 smithi137 ceph-mon[37364]: pgmap v156: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 2/6 objects degraded (33.333%) 2024-03-04T06:37:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:35 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T06:37:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:35 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T06:37:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:35 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:36.587 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:36 smithi203 ceph-mon[30756]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:37:36.694 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:36 smithi137 ceph-mon[26846]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:37:36.694 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:36 smithi137 ceph-mon[37364]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:37:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:37 smithi203 ceph-mon[30756]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-03-04T06:37:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:37 smithi137 ceph-mon[26846]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-03-04T06:37:37.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:37 smithi137 ceph-mon[37364]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-03-04T06:37:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:38 smithi203 ceph-mon[30756]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-03-04T06:37:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:38 smithi203 ceph-mon[30756]: Cluster is now healthy 2024-03-04T06:37:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:38 smithi203 ceph-mon[30756]: from='client.? 172.21.15.203:0/924476310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0016ca9e-43b4-4734-9646-70f257795c04"}]: dispatch 2024-03-04T06:37:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:38 smithi203 ceph-mon[30756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0016ca9e-43b4-4734-9646-70f257795c04"}]: dispatch 2024-03-04T06:37:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:38 smithi203 ceph-mon[30756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0016ca9e-43b4-4734-9646-70f257795c04"}]': finished 2024-03-04T06:37:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:38 smithi203 ceph-mon[30756]: osdmap e51: 8 total, 7 up, 8 in 2024-03-04T06:37:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:38 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:38 smithi203 ceph-mon[30756]: from='client.? 172.21.15.203:0/1136411515' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:37:38.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[26846]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-03-04T06:37:38.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[26846]: Cluster is now healthy 2024-03-04T06:37:38.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[26846]: from='client.? 172.21.15.203:0/924476310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0016ca9e-43b4-4734-9646-70f257795c04"}]: dispatch 2024-03-04T06:37:38.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[26846]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0016ca9e-43b4-4734-9646-70f257795c04"}]: dispatch 2024-03-04T06:37:38.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[26846]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0016ca9e-43b4-4734-9646-70f257795c04"}]': finished 2024-03-04T06:37:38.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[26846]: osdmap e51: 8 total, 7 up, 8 in 2024-03-04T06:37:38.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:38.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[26846]: from='client.? 172.21.15.203:0/1136411515' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:37:38.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[37364]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-03-04T06:37:38.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[37364]: Cluster is now healthy 2024-03-04T06:37:38.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[37364]: from='client.? 172.21.15.203:0/924476310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0016ca9e-43b4-4734-9646-70f257795c04"}]: dispatch 2024-03-04T06:37:38.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[37364]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0016ca9e-43b4-4734-9646-70f257795c04"}]: dispatch 2024-03-04T06:37:38.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[37364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0016ca9e-43b4-4734-9646-70f257795c04"}]': finished 2024-03-04T06:37:38.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[37364]: osdmap e51: 8 total, 7 up, 8 in 2024-03-04T06:37:38.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:38.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:38 smithi137 ceph-mon[37364]: from='client.? 172.21.15.203:0/1136411515' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T06:37:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:39 smithi203 ceph-mon[30756]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-04T06:37:39.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:39 smithi137 ceph-mon[26846]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-04T06:37:39.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:39 smithi137 ceph-mon[37364]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-04T06:37:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:41 smithi137 ceph-mon[26846]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-03-04T06:37:41.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:41 smithi137 ceph-mon[37364]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-03-04T06:37:41.562 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:41 smithi203 ceph-mon[30756]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-03-04T06:37:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:44 smithi137 ceph-mon[26846]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-03-04T06:37:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:44 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-04T06:37:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:44 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:44.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:44 smithi137 ceph-mon[37364]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-03-04T06:37:44.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:44 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-04T06:37:44.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:44 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:44 smithi203 ceph-mon[30756]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-03-04T06:37:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:44 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-04T06:37:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:44 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:45.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:45 smithi137 ceph-mon[26846]: Deploying daemon osd.7 on smithi203 2024-03-04T06:37:45.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:45 smithi137 ceph-mon[37364]: Deploying daemon osd.7 on smithi203 2024-03-04T06:37:45.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:45 smithi203 ceph-mon[30756]: Deploying daemon osd.7 on smithi203 2024-03-04T06:37:46.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:46 smithi137 ceph-mon[26846]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-04T06:37:46.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:46 smithi137 ceph-mon[37364]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-04T06:37:46.344 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:46 smithi203 ceph-mon[30756]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-04T06:37:48.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:48 smithi137 ceph-mon[26846]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-04T06:37:48.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:48 smithi137 ceph-mon[37364]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-04T06:37:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:48 smithi203 ceph-mon[30756]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-04T06:37:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:49 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:49 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:49 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:49 smithi137 ceph-mon[26846]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-04T06:37:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:49 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:49 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:49 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:49 smithi137 ceph-mon[37364]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-04T06:37:50.298 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:49 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:50.298 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:49 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:50.298 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:49 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:50.298 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:49 smithi203 ceph-mon[30756]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-04T06:37:51.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:51 smithi137 ceph-mon[26846]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-04T06:37:51.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:51 smithi137 ceph-mon[37364]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-04T06:37:51.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:51 smithi203 ceph-mon[30756]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-04T06:37:52.550 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 7 on host 'smithi203' 2024-03-04T06:37:53.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:52 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:53.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:52 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:53.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:52 smithi137 ceph-mon[37364]: from='osd.7 [v2:172.21.15.203:6824/4089764819,v1:172.21.15.203:6825/4089764819]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T06:37:53.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:52 smithi137 ceph-mon[37364]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T06:37:53.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:52 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:53.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:52 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:53.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:52 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:53.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:52 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:53.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:52 smithi137 ceph-mon[26846]: from='osd.7 [v2:172.21.15.203:6824/4089764819,v1:172.21.15.203:6825/4089764819]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T06:37:53.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:52 smithi137 ceph-mon[26846]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T06:37:53.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:52 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:53.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:52 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:53.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:52 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:53.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:52 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:53.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:52 smithi203 ceph-mon[30756]: from='osd.7 [v2:172.21.15.203:6824/4089764819,v1:172.21.15.203:6825/4089764819]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T06:37:53.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:52 smithi203 ceph-mon[30756]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T06:37:53.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:52 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:53.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:52 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:53.160 DEBUG:teuthology.orchestra.run.smithi203:osd.7> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.7.service 2024-03-04T06:37:53.162 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-03-04T06:37:53.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd stat -f json 2024-03-04T06:37:53.380 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:37:54.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:53 smithi203 ceph-mon[30756]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-04T06:37:54.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:53 smithi203 ceph-mon[30756]: osdmap e52: 8 total, 7 up, 8 in 2024-03-04T06:37:54.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:53 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:54.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:53 smithi203 ceph-mon[30756]: from='osd.7 [v2:172.21.15.203:6824/4089764819,v1:172.21.15.203:6825/4089764819]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:54.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:53 smithi203 ceph-mon[30756]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:54.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:53 smithi203 ceph-mon[30756]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-04T06:37:54.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:37:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[53464]: 2024-03-04T06:37:53.812+0000 7f67fa578700 -1 osd.7 0 waiting for initial osdmap 2024-03-04T06:37:54.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:37:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[53464]: 2024-03-04T06:37:53.819+0000 7f67f636d700 -1 osd.7 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:37:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:53 smithi137 ceph-mon[26846]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-04T06:37:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:53 smithi137 ceph-mon[26846]: osdmap e52: 8 total, 7 up, 8 in 2024-03-04T06:37:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:53 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:53 smithi137 ceph-mon[26846]: from='osd.7 [v2:172.21.15.203:6824/4089764819,v1:172.21.15.203:6825/4089764819]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:53 smithi137 ceph-mon[26846]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:53 smithi137 ceph-mon[26846]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-04T06:37:54.211 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:53 smithi137 ceph-mon[37364]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-04T06:37:54.211 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:53 smithi137 ceph-mon[37364]: osdmap e52: 8 total, 7 up, 8 in 2024-03-04T06:37:54.211 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:53 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:54.211 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:53 smithi137 ceph-mon[37364]: from='osd.7 [v2:172.21.15.203:6824/4089764819,v1:172.21.15.203:6825/4089764819]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:54.211 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:53 smithi137 ceph-mon[37364]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:37:54.211 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:53 smithi137 ceph-mon[37364]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-04T06:37:54.861 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[37364]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-03-04T06:37:54.862 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[37364]: osdmap e53: 8 total, 7 up, 8 in 2024-03-04T06:37:54.862 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:54.862 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:54.862 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[37364]: osd.7 [v2:172.21.15.203:6824/4089764819,v1:172.21.15.203:6825/4089764819] boot 2024-03-04T06:37:54.862 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[37364]: osdmap e54: 8 total, 8 up, 8 in 2024-03-04T06:37:54.862 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:54.862 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[26846]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-03-04T06:37:54.862 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[26846]: osdmap e53: 8 total, 7 up, 8 in 2024-03-04T06:37:54.862 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:54.862 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:54.862 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[26846]: osd.7 [v2:172.21.15.203:6824/4089764819,v1:172.21.15.203:6825/4089764819] boot 2024-03-04T06:37:54.863 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[26846]: osdmap e54: 8 total, 8 up, 8 in 2024-03-04T06:37:54.863 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:54 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:55.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:54 smithi203 ceph-mon[30756]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-03-04T06:37:55.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:54 smithi203 ceph-mon[30756]: osdmap e53: 8 total, 7 up, 8 in 2024-03-04T06:37:55.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:54 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:55.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:54 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:55.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:54 smithi203 ceph-mon[30756]: osd.7 [v2:172.21.15.203:6824/4089764819,v1:172.21.15.203:6825/4089764819] boot 2024-03-04T06:37:55.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:54 smithi203 ceph-mon[30756]: osdmap e54: 8 total, 8 up, 8 in 2024-03-04T06:37:55.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:54 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:37:55.271 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:37:56.024 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1709534274,"num_in_osds":8,"osd_in_since":1709534257,"num_remapped_pgs":1} 2024-03-04T06:37:56.025 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd dump --format=json 2024-03-04T06:37:56.045 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:55 smithi203 ceph-mon[30756]: purged_snaps scrub starts 2024-03-04T06:37:56.045 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:55 smithi203 ceph-mon[30756]: purged_snaps scrub ok 2024-03-04T06:37:56.045 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:55 smithi203 ceph-mon[30756]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:37:56.045 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:55 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3693165468' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-04T06:37:56.045 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:55 smithi203 ceph-mon[30756]: osdmap e55: 8 total, 8 up, 8 in 2024-03-04T06:37:56.243 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:37:56.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:55 smithi137 ceph-mon[26846]: purged_snaps scrub starts 2024-03-04T06:37:56.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:55 smithi137 ceph-mon[26846]: purged_snaps scrub ok 2024-03-04T06:37:56.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:55 smithi137 ceph-mon[26846]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:37:56.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:55 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3693165468' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-04T06:37:56.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:55 smithi137 ceph-mon[26846]: osdmap e55: 8 total, 8 up, 8 in 2024-03-04T06:37:56.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:55 smithi137 ceph-mon[37364]: purged_snaps scrub starts 2024-03-04T06:37:56.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:55 smithi137 ceph-mon[37364]: purged_snaps scrub ok 2024-03-04T06:37:56.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:55 smithi137 ceph-mon[37364]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:37:56.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:55 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3693165468' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-04T06:37:56.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:55 smithi137 ceph-mon[37364]: osdmap e55: 8 total, 8 up, 8 in 2024-03-04T06:37:57.318 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: Detected new or changed devices on smithi203 2024-03-04T06:37:57.318 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.318 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.318 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:57.318 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:57.318 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:57.319 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:57.319 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: Adjusting osd_memory_target on smithi203 to 4272M 2024-03-04T06:37:57.319 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.319 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:57.319 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:57.319 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.319 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:57.319 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:57.319 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:57.319 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.319 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[26846]: osdmap e56: 8 total, 8 up, 8 in 2024-03-04T06:37:57.319 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: Detected new or changed devices on smithi203 2024-03-04T06:37:57.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:57.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:57.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:57.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:57.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: Adjusting osd_memory_target on smithi203 to 4272M 2024-03-04T06:37:57.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:57.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:57.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:57.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:57.321 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:57.321 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.321 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:57 smithi137 ceph-mon[37364]: osdmap e56: 8 total, 8 up, 8 in 2024-03-04T06:37:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: Detected new or changed devices on smithi203 2024-03-04T06:37:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:37:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: Adjusting osd_memory_target on smithi203 to 4272M 2024-03-04T06:37:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:57.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:37:57.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:37:57.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:37:57.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:37:57.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:57 smithi203 ceph-mon[30756]: osdmap e56: 8 total, 8 up, 8 in 2024-03-04T06:37:58.006 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:37:58.006 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":57,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:37:57.290570+0000","last_up_change":"2024-03-04T06:37:54.799220+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6803","nonce":120753079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6805","nonce":120753079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6809","nonce":120753079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6807","nonce":120753079}]},"public_addr":"172.21.15.137:6803/120753079","cluster_addr":"172.21.15.137:6805/120753079","heartbeat_back_addr":"172.21.15.137:6809/120753079","heartbeat_front_addr":"172.21.15.137:6807/120753079","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6811","nonce":2976801936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6813","nonce":2976801936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6817","nonce":2976801936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6815","nonce":2976801936}]},"public_addr":"172.21.15.137:6811/2976801936","cluster_addr":"172.21.15.137:6813/2976801936","heartbeat_back_addr":"172.21.15.137:6817/2976801936","heartbeat_front_addr":"172.21.15.137:6815/2976801936","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6819","nonce":788153355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6821","nonce":788153355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6825","nonce":788153355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6823","nonce":788153355}]},"public_addr":"172.21.15.137:6819/788153355","cluster_addr":"172.21.15.137:6821/788153355","heartbeat_back_addr":"172.21.15.137:6825/788153355","heartbeat_front_addr":"172.21.15.137:6823/788153355","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6827","nonce":1906308615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6829","nonce":1906308615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6833","nonce":1906308615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6831","nonce":1906308615}]},"public_addr":"172.21.15.137:6827/1906308615","cluster_addr":"172.21.15.137:6829/1906308615","heartbeat_back_addr":"172.21.15.137:6833/1906308615","heartbeat_front_addr":"172.21.15.137:6831/1906308615","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6801","nonce":483489448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6803","nonce":483489448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6807","nonce":483489448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6805","nonce":483489448}]},"public_addr":"172.21.15.203:6801/483489448","cluster_addr":"172.21.15.203:6803/483489448","heartbeat_back_addr":"172.21.15.203:6807/483489448","heartbeat_front_addr":"172.21.15.203:6805/483489448","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6809","nonce":1227714102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6811","nonce":1227714102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6815","nonce":1227714102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6813","nonce":1227714102}]},"public_addr":"172.21.15.203:6809/1227714102","cluster_addr":"172.21.15.203:6811/1227714102","heartbeat_back_addr":"172.21.15.203:6815/1227714102","heartbeat_front_addr":"172.21.15.203:6813/1227714102","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6817","nonce":593999121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6819","nonce":593999121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6823","nonce":593999121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6821","nonce":593999121}]},"public_addr":"172.21.15.203:6817/593999121","cluster_addr":"172.21.15.203:6819/593999121","heartbeat_back_addr":"172.21.15.203:6823/593999121","heartbeat_front_addr":"172.21.15.203:6821/593999121","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6825","nonce":4089764819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6827","nonce":4089764819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6831","nonce":4089764819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6829","nonce":4089764819}]},"public_addr":"172.21.15.203:6825/4089764819","cluster_addr":"172.21.15.203:6827/4089764819","heartbeat_back_addr":"172.21.15.203:6831/4089764819","heartbeat_front_addr":"172.21.15.203:6829/4089764819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T06:37:58.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:58 smithi137 ceph-mon[26846]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:37:58.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:58 smithi137 ceph-mon[26846]: osdmap e57: 8 total, 8 up, 8 in 2024-03-04T06:37:58.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:58 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2859323901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:37:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:58 smithi137 ceph-mon[37364]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:37:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:58 smithi137 ceph-mon[37364]: osdmap e57: 8 total, 8 up, 8 in 2024-03-04T06:37:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:58 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2859323901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:37:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:58 smithi203 ceph-mon[30756]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:37:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:58 smithi203 ceph-mon[30756]: osdmap e57: 8 total, 8 up, 8 in 2024-03-04T06:37:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:58 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2859323901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:37:58.695 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T06:35:55.259476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T06:37:58.696 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-03-04T06:37:58.898 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:37:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:59 smithi203 ceph-mon[30756]: osdmap e58: 8 total, 8 up, 8 in 2024-03-04T06:37:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:37:59 smithi203 ceph-mon[30756]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:37:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:59 smithi137 ceph-mon[26846]: osdmap e58: 8 total, 8 up, 8 in 2024-03-04T06:37:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:37:59 smithi137 ceph-mon[26846]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:37:59.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:59 smithi137 ceph-mon[37364]: osdmap e58: 8 total, 8 up, 8 in 2024-03-04T06:37:59.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:37:59 smithi137 ceph-mon[37364]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:00.659 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-03-04T06:38:01.283 INFO:tasks.cephadm:Adding mds.a on smithi137 2024-03-04T06:38:01.283 INFO:tasks.cephadm:Adding mds.b on smithi203 2024-03-04T06:38:01.284 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch apply mds all '2;smithi137=a;smithi203=b' 2024-03-04T06:38:01.500 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:38:01.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:01 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1410730610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:38:01.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:01 smithi137 ceph-mon[26846]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-04T06:38:01.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:01 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1410730610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:38:01.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:01 smithi137 ceph-mon[37364]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-04T06:38:01.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:01 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1410730610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:38:01.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:01 smithi203 ceph-mon[30756]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-04T06:38:03.142 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mds.all update... 2024-03-04T06:38:03.825 DEBUG:teuthology.orchestra.run.smithi137:mds.a> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mds.a.service 2024-03-04T06:38:03.827 DEBUG:teuthology.orchestra.run.smithi203:mds.b> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mds.b.service 2024-03-04T06:38:03.830 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-03-04T06:38:03.831 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T06:38:04.197 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:04.197 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":58,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:37:58.297142+0000","last_up_change":"2024-03-04T06:37:54.799220+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6803","nonce":120753079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6805","nonce":120753079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6809","nonce":120753079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6807","nonce":120753079}]},"public_addr":"172.21.15.137:6803/120753079","cluster_addr":"172.21.15.137:6805/120753079","heartbeat_back_addr":"172.21.15.137:6809/120753079","heartbeat_front_addr":"172.21.15.137:6807/120753079","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6811","nonce":2976801936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6813","nonce":2976801936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6817","nonce":2976801936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6815","nonce":2976801936}]},"public_addr":"172.21.15.137:6811/2976801936","cluster_addr":"172.21.15.137:6813/2976801936","heartbeat_back_addr":"172.21.15.137:6817/2976801936","heartbeat_front_addr":"172.21.15.137:6815/2976801936","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6819","nonce":788153355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6821","nonce":788153355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6825","nonce":788153355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6823","nonce":788153355}]},"public_addr":"172.21.15.137:6819/788153355","cluster_addr":"172.21.15.137:6821/788153355","heartbeat_back_addr":"172.21.15.137:6825/788153355","heartbeat_front_addr":"172.21.15.137:6823/788153355","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6827","nonce":1906308615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6829","nonce":1906308615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6833","nonce":1906308615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6831","nonce":1906308615}]},"public_addr":"172.21.15.137:6827/1906308615","cluster_addr":"172.21.15.137:6829/1906308615","heartbeat_back_addr":"172.21.15.137:6833/1906308615","heartbeat_front_addr":"172.21.15.137:6831/1906308615","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6801","nonce":483489448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6803","nonce":483489448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6807","nonce":483489448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6805","nonce":483489448}]},"public_addr":"172.21.15.203:6801/483489448","cluster_addr":"172.21.15.203:6803/483489448","heartbeat_back_addr":"172.21.15.203:6807/483489448","heartbeat_front_addr":"172.21.15.203:6805/483489448","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6809","nonce":1227714102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6811","nonce":1227714102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6815","nonce":1227714102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6813","nonce":1227714102}]},"public_addr":"172.21.15.203:6809/1227714102","cluster_addr":"172.21.15.203:6811/1227714102","heartbeat_back_addr":"172.21.15.203:6815/1227714102","heartbeat_front_addr":"172.21.15.203:6813/1227714102","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6817","nonce":593999121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6819","nonce":593999121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6823","nonce":593999121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6821","nonce":593999121}]},"public_addr":"172.21.15.203:6817/593999121","cluster_addr":"172.21.15.203:6819/593999121","heartbeat_back_addr":"172.21.15.203:6823/593999121","heartbeat_front_addr":"172.21.15.203:6821/593999121","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6825","nonce":4089764819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6827","nonce":4089764819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6831","nonce":4089764819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6829","nonce":4089764819}]},"public_addr":"172.21.15.203:6825/4089764819","cluster_addr":"172.21.15.203:6827/4089764819","heartbeat_back_addr":"172.21.15.203:6831/4089764819","heartbeat_front_addr":"172.21.15.203:6829/4089764819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T06:38:04.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[37364]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-04T06:38:04.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[37364]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "2;smithi137=a;smithi203=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:04.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[37364]: Saving service mds.all spec with placement smithi137=a;smithi203=b;count:2 2024-03-04T06:38:04.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:04.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:04.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:04.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:04.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:04.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:38:04.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T06:38:04.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:04.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[26846]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-04T06:38:04.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[26846]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "2;smithi137=a;smithi203=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:04.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[26846]: Saving service mds.all spec with placement smithi137=a;smithi203=b;count:2 2024-03-04T06:38:04.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:04.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:04.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:04.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:04.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:04.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:38:04.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T06:38:04.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:04 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:04.211 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T06:35:55.259476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T06:38:04.212 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T06:38:04.497 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-03-04T06:38:04.510 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T06:38:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:04 smithi203 ceph-mon[30756]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-04T06:38:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:04 smithi203 ceph-mon[30756]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "2;smithi137=a;smithi203=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:04 smithi203 ceph-mon[30756]: Saving service mds.all spec with placement smithi137=a;smithi203=b;count:2 2024-03-04T06:38:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:38:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T06:38:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:04 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:04.858 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:04.858 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-04T06:38:04.859 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 1 2024-03-04T06:38:05.149 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:38:05 smithi137 systemd[1]: Starting Ceph mds.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:38:05.417 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:05 smithi137 ceph-mon[37364]: Deploying daemon mds.a on smithi137 2024-03-04T06:38:05.417 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:05 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/530205472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:05.417 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:05 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/4195655055' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:38:05.417 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:05 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/4213302130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:38:05.418 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:05 smithi137 ceph-mon[26846]: Deploying daemon mds.a on smithi137 2024-03-04T06:38:05.418 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:05 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/530205472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:05.418 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:05 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/4195655055' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:38:05.418 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:05 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/4213302130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:38:05.418 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:38:05 smithi137 podman[64335]: 2024-03-04 06:38:05.196130019 +0000 UTC m=+0.017587130 image pull 540557f94930c38870197995629adb1ba474514589432062c4a23b4aa6496def quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc 2024-03-04T06:38:05.418 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:38:05 smithi137 podman[64335]: 2024-03-04 06:38:05.29608104 +0000 UTC m=+0.117538138 container create dd13fbd7ec2fdffc702cd7aa5574cb3ea7ef1faaacacbea88eebd72958ca9a13 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=reef-5cc7a76, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-04T06:38:05.513 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:05 smithi203 ceph-mon[30756]: Deploying daemon mds.a on smithi137 2024-03-04T06:38:05.513 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:05 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/530205472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:05.513 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:05 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/4195655055' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:38:05.514 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:05 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/4213302130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:38:05.793 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:38:05 smithi137 podman[64335]: 2024-03-04 06:38:05.54025952 +0000 UTC m=+0.361716618 container init dd13fbd7ec2fdffc702cd7aa5574cb3ea7ef1faaacacbea88eebd72958ca9a13 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=reef-5cc7a76, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-04T06:38:05.793 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:38:05 smithi137 podman[64335]: 2024-03-04 06:38:05.542892049 +0000 UTC m=+0.364349156 container start dd13fbd7ec2fdffc702cd7aa5574cb3ea7ef1faaacacbea88eebd72958ca9a13 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=reef-5cc7a76, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-04T06:38:05.793 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:38:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a[64350]: starting mds.a at 2024-03-04T06:38:05.793 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:38:05 smithi137 bash[64335]: dd13fbd7ec2fdffc702cd7aa5574cb3ea7ef1faaacacbea88eebd72958ca9a13 2024-03-04T06:38:05.793 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:38:05 smithi137 systemd[1]: Started Ceph mds.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:38:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[37364]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-04T06:38:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[37364]: mds.? [v2:172.21.15.137:6834/3869447426,v1:172.21.15.137:6835/3869447426] up:boot 2024-03-04T06:38:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[37364]: fsmap 1 up:standby 2024-03-04T06:38:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:38:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:38:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T06:38:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[37364]: Deploying daemon mds.b on smithi203 2024-03-04T06:38:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[26846]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-04T06:38:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[26846]: mds.? [v2:172.21.15.137:6834/3869447426,v1:172.21.15.137:6835/3869447426] up:boot 2024-03-04T06:38:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[26846]: fsmap 1 up:standby 2024-03-04T06:38:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:38:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:38:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T06:38:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:06 smithi137 ceph-mon[26846]: Deploying daemon mds.b on smithi203 2024-03-04T06:38:06.404 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:06 smithi203 ceph-mon[30756]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-04T06:38:06.404 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:06 smithi203 ceph-mon[30756]: mds.? [v2:172.21.15.137:6834/3869447426,v1:172.21.15.137:6835/3869447426] up:boot 2024-03-04T06:38:06.404 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:06 smithi203 ceph-mon[30756]: fsmap 1 up:standby 2024-03-04T06:38:06.404 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:06 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:38:06.404 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:06 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:06.404 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:06 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:06.404 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:06 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:06.404 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:06 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:38:06.404 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:06 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T06:38:06.405 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:06 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:06.405 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:06 smithi203 ceph-mon[30756]: Deploying daemon mds.b on smithi203 2024-03-04T06:38:06.874 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T06:38:07.207 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:07.207 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3869447426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3869447426},{"type":"v1","addr":"172.21.15.137:6835","nonce":3869447426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-03-04T06:38:07.207 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 2 2024-03-04T06:38:07.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:07 smithi203 ceph-mon[30756]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-03-04T06:38:07.479 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:07 smithi137 ceph-mon[26846]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-03-04T06:38:07.479 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:07 smithi137 ceph-mon[37364]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-03-04T06:38:07.736 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:38:07 smithi203 systemd[1]: Starting Ceph mds.b for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:38:07.998 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:38:07 smithi203 podman[57846]: 2024-03-04 06:38:07.640308752 +0000 UTC m=+0.018141678 image pull 540557f94930c38870197995629adb1ba474514589432062c4a23b4aa6496def quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc 2024-03-04T06:38:07.998 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:38:07 smithi203 podman[57846]: 2024-03-04 06:38:07.744218689 +0000 UTC m=+0.122051648 container create 3c8bab6bae3034d421b240579d0e00a3517ecf4bb673c06eec0a111e9a1c2b4b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=reef-5cc7a76, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240222) 2024-03-04T06:38:07.998 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:38:07 smithi203 podman[57846]: 2024-03-04 06:38:07.972084566 +0000 UTC m=+0.349917493 container init 3c8bab6bae3034d421b240579d0e00a3517ecf4bb673c06eec0a111e9a1c2b4b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=reef-5cc7a76, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-03-04T06:38:07.998 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:38:07 smithi203 podman[57846]: 2024-03-04 06:38:07.974551391 +0000 UTC m=+0.352384307 container start 3c8bab6bae3034d421b240579d0e00a3517ecf4bb673c06eec0a111e9a1c2b4b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=reef-5cc7a76, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-03-04T06:38:07.998 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:38:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b[57861]: starting mds.b at 2024-03-04T06:38:08.345 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:38:08 smithi203 bash[57846]: 3c8bab6bae3034d421b240579d0e00a3517ecf4bb673c06eec0a111e9a1c2b4b 2024-03-04T06:38:08.346 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:38:08 smithi203 systemd[1]: Started Ceph mds.b for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:38:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:08 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/4020425832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:38:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:08 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:08 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:08 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:08 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:08 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.418 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:08 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/4020425832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:38:08.419 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.419 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.419 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.419 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.419 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:08 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.419 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:08 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/4020425832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:38:08.419 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:08 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.419 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:08 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.419 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:08 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.419 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:08 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:08.420 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:08 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:09.220 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T06:38:09.247 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:09 smithi137 ceph-mon[37364]: mds.? [v2:172.21.15.203:6832/3636376444,v1:172.21.15.203:6833/3636376444] up:boot 2024-03-04T06:38:09.247 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:09 smithi137 ceph-mon[37364]: fsmap 2 up:standby 2024-03-04T06:38:09.247 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:09 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:38:09.247 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:09 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:09.247 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:09 smithi137 ceph-mon[37364]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-03-04T06:38:09.248 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:09 smithi137 ceph-mon[26846]: mds.? [v2:172.21.15.203:6832/3636376444,v1:172.21.15.203:6833/3636376444] up:boot 2024-03-04T06:38:09.248 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:09 smithi137 ceph-mon[26846]: fsmap 2 up:standby 2024-03-04T06:38:09.248 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:38:09.248 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:09 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:09.248 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:09 smithi137 ceph-mon[26846]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-03-04T06:38:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:09.562 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3869447426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3869447426},{"type":"v1","addr":"172.21.15.137:6835","nonce":3869447426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3636376444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3636376444},{"type":"v1","addr":"172.21.15.203:6833","nonce":3636376444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-03-04T06:38:09.562 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 3 2024-03-04T06:38:09.576 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T06:38:09.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:09 smithi203 ceph-mon[30756]: mds.? [v2:172.21.15.203:6832/3636376444,v1:172.21.15.203:6833/3636376444] up:boot 2024-03-04T06:38:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:09 smithi203 ceph-mon[30756]: fsmap 2 up:standby 2024-03-04T06:38:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:09 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:38:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:09 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:09 smithi203 ceph-mon[30756]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-03-04T06:38:09.923 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:09.923 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":58,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:37:58.297142+0000","last_up_change":"2024-03-04T06:37:54.799220+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6803","nonce":120753079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6805","nonce":120753079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6809","nonce":120753079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6807","nonce":120753079}]},"public_addr":"172.21.15.137:6803/120753079","cluster_addr":"172.21.15.137:6805/120753079","heartbeat_back_addr":"172.21.15.137:6809/120753079","heartbeat_front_addr":"172.21.15.137:6807/120753079","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6811","nonce":2976801936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6813","nonce":2976801936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6817","nonce":2976801936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6815","nonce":2976801936}]},"public_addr":"172.21.15.137:6811/2976801936","cluster_addr":"172.21.15.137:6813/2976801936","heartbeat_back_addr":"172.21.15.137:6817/2976801936","heartbeat_front_addr":"172.21.15.137:6815/2976801936","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6819","nonce":788153355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6821","nonce":788153355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6825","nonce":788153355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6823","nonce":788153355}]},"public_addr":"172.21.15.137:6819/788153355","cluster_addr":"172.21.15.137:6821/788153355","heartbeat_back_addr":"172.21.15.137:6825/788153355","heartbeat_front_addr":"172.21.15.137:6823/788153355","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6827","nonce":1906308615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6829","nonce":1906308615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6833","nonce":1906308615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6831","nonce":1906308615}]},"public_addr":"172.21.15.137:6827/1906308615","cluster_addr":"172.21.15.137:6829/1906308615","heartbeat_back_addr":"172.21.15.137:6833/1906308615","heartbeat_front_addr":"172.21.15.137:6831/1906308615","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6801","nonce":483489448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6803","nonce":483489448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6807","nonce":483489448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6805","nonce":483489448}]},"public_addr":"172.21.15.203:6801/483489448","cluster_addr":"172.21.15.203:6803/483489448","heartbeat_back_addr":"172.21.15.203:6807/483489448","heartbeat_front_addr":"172.21.15.203:6805/483489448","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6809","nonce":1227714102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6811","nonce":1227714102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6815","nonce":1227714102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6813","nonce":1227714102}]},"public_addr":"172.21.15.203:6809/1227714102","cluster_addr":"172.21.15.203:6811/1227714102","heartbeat_back_addr":"172.21.15.203:6815/1227714102","heartbeat_front_addr":"172.21.15.203:6813/1227714102","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6817","nonce":593999121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6819","nonce":593999121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6823","nonce":593999121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6821","nonce":593999121}]},"public_addr":"172.21.15.203:6817/593999121","cluster_addr":"172.21.15.203:6819/593999121","heartbeat_back_addr":"172.21.15.203:6823/593999121","heartbeat_front_addr":"172.21.15.203:6821/593999121","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6825","nonce":4089764819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6827","nonce":4089764819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6831","nonce":4089764819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6829","nonce":4089764819}]},"public_addr":"172.21.15.203:6825/4089764819","cluster_addr":"172.21.15.203:6827/4089764819","heartbeat_back_addr":"172.21.15.203:6831/4089764819","heartbeat_front_addr":"172.21.15.203:6829/4089764819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T06:38:09.936 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T06:35:55.259476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T06:38:09.937 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T06:38:10.219 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-03-04T06:38:10.232 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-04T06:38:10.515 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.516 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.516 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2382827102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:38:10.516 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.516 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.516 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:10.516 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:10.516 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.516 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:10.518 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-03-04T06:38:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-03-04T06:38:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-03-04T06:38:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-03-04T06:38:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:38:10.519 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-03-04T06:38:10.531 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-04T06:38:10.531 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-04T06:38:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2005305696' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3178372361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2382827102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2005305696' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:10 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3178372361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:38:10.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2382827102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:38:10.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:10.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:10.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:10.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:10.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2005305696' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:10 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3178372361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:38:11.525 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-03-04T06:38:11.542 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-04T06:38:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:11 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/307788179' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-04T06:38:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:11 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2438149497' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-04T06:38:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:11 smithi137 ceph-mon[26846]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-04T06:38:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:11 smithi137 ceph-mon[26846]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-04T06:38:11.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:11 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/307788179' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-04T06:38:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:11 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2438149497' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-04T06:38:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:11 smithi137 ceph-mon[37364]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-04T06:38:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:11 smithi137 ceph-mon[37364]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-04T06:38:11.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:11 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/307788179' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-04T06:38:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:11 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2438149497' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-04T06:38:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:11 smithi203 ceph-mon[30756]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-04T06:38:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:11 smithi203 ceph-mon[30756]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-04T06:38:12.533 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-03-04T06:38:12.558 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-04T06:38:12.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:12 smithi137 ceph-mon[26846]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-04T06:38:12.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:12 smithi137 ceph-mon[26846]: osdmap e59: 8 total, 8 up, 8 in 2024-03-04T06:38:12.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:12 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1379815817' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-04T06:38:12.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:12 smithi137 ceph-mon[26846]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-04T06:38:12.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:12 smithi137 ceph-mon[37364]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-04T06:38:12.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:12 smithi137 ceph-mon[37364]: osdmap e59: 8 total, 8 up, 8 in 2024-03-04T06:38:12.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:12 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1379815817' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-04T06:38:12.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:12 smithi137 ceph-mon[37364]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-04T06:38:12.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:12 smithi203 ceph-mon[30756]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-04T06:38:12.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:12 smithi203 ceph-mon[30756]: osdmap e59: 8 total, 8 up, 8 in 2024-03-04T06:38:12.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:12 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1379815817' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-04T06:38:12.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:12 smithi203 ceph-mon[30756]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-04T06:38:12.884 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 2 and data pool 3 2024-03-04T06:38:12.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T06:38:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:13.196 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":61,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:38:12.879249+0000","last_up_change":"2024-03-04T06:37:54.799220+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T06:38:11.049505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T06:38:12.066145+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6803","nonce":120753079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6805","nonce":120753079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6809","nonce":120753079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6807","nonce":120753079}]},"public_addr":"172.21.15.137:6803/120753079","cluster_addr":"172.21.15.137:6805/120753079","heartbeat_back_addr":"172.21.15.137:6809/120753079","heartbeat_front_addr":"172.21.15.137:6807/120753079","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6811","nonce":2976801936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6813","nonce":2976801936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6817","nonce":2976801936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6815","nonce":2976801936}]},"public_addr":"172.21.15.137:6811/2976801936","cluster_addr":"172.21.15.137:6813/2976801936","heartbeat_back_addr":"172.21.15.137:6817/2976801936","heartbeat_front_addr":"172.21.15.137:6815/2976801936","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6819","nonce":788153355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6821","nonce":788153355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6825","nonce":788153355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6823","nonce":788153355}]},"public_addr":"172.21.15.137:6819/788153355","cluster_addr":"172.21.15.137:6821/788153355","heartbeat_back_addr":"172.21.15.137:6825/788153355","heartbeat_front_addr":"172.21.15.137:6823/788153355","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6827","nonce":1906308615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6829","nonce":1906308615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6833","nonce":1906308615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6831","nonce":1906308615}]},"public_addr":"172.21.15.137:6827/1906308615","cluster_addr":"172.21.15.137:6829/1906308615","heartbeat_back_addr":"172.21.15.137:6833/1906308615","heartbeat_front_addr":"172.21.15.137:6831/1906308615","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6801","nonce":483489448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6803","nonce":483489448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6807","nonce":483489448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6805","nonce":483489448}]},"public_addr":"172.21.15.203:6801/483489448","cluster_addr":"172.21.15.203:6803/483489448","heartbeat_back_addr":"172.21.15.203:6807/483489448","heartbeat_front_addr":"172.21.15.203:6805/483489448","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6809","nonce":1227714102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6811","nonce":1227714102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6815","nonce":1227714102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6813","nonce":1227714102}]},"public_addr":"172.21.15.203:6809/1227714102","cluster_addr":"172.21.15.203:6811/1227714102","heartbeat_back_addr":"172.21.15.203:6815/1227714102","heartbeat_front_addr":"172.21.15.203:6813/1227714102","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6817","nonce":593999121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6819","nonce":593999121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6823","nonce":593999121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6821","nonce":593999121}]},"public_addr":"172.21.15.203:6817/593999121","cluster_addr":"172.21.15.203:6819/593999121","heartbeat_back_addr":"172.21.15.203:6823/593999121","heartbeat_front_addr":"172.21.15.203:6821/593999121","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6825","nonce":4089764819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6827","nonce":4089764819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6831","nonce":4089764819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6829","nonce":4089764819}]},"public_addr":"172.21.15.203:6825/4089764819","cluster_addr":"172.21.15.203:6827/4089764819","heartbeat_back_addr":"172.21.15.203:6831/4089764819","heartbeat_front_addr":"172.21.15.203:6829/4089764819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T06:38:13.209 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T06:38:13.490 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:13.490 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":61,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:38:12.879249+0000","last_up_change":"2024-03-04T06:37:54.799220+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T06:38:11.049505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T06:38:12.066145+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6803","nonce":120753079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6805","nonce":120753079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6809","nonce":120753079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6807","nonce":120753079}]},"public_addr":"172.21.15.137:6803/120753079","cluster_addr":"172.21.15.137:6805/120753079","heartbeat_back_addr":"172.21.15.137:6809/120753079","heartbeat_front_addr":"172.21.15.137:6807/120753079","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6811","nonce":2976801936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6813","nonce":2976801936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6817","nonce":2976801936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6815","nonce":2976801936}]},"public_addr":"172.21.15.137:6811/2976801936","cluster_addr":"172.21.15.137:6813/2976801936","heartbeat_back_addr":"172.21.15.137:6817/2976801936","heartbeat_front_addr":"172.21.15.137:6815/2976801936","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6819","nonce":788153355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6821","nonce":788153355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6825","nonce":788153355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6823","nonce":788153355}]},"public_addr":"172.21.15.137:6819/788153355","cluster_addr":"172.21.15.137:6821/788153355","heartbeat_back_addr":"172.21.15.137:6825/788153355","heartbeat_front_addr":"172.21.15.137:6823/788153355","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6827","nonce":1906308615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6829","nonce":1906308615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6833","nonce":1906308615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6831","nonce":1906308615}]},"public_addr":"172.21.15.137:6827/1906308615","cluster_addr":"172.21.15.137:6829/1906308615","heartbeat_back_addr":"172.21.15.137:6833/1906308615","heartbeat_front_addr":"172.21.15.137:6831/1906308615","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6801","nonce":483489448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6803","nonce":483489448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6807","nonce":483489448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6805","nonce":483489448}]},"public_addr":"172.21.15.203:6801/483489448","cluster_addr":"172.21.15.203:6803/483489448","heartbeat_back_addr":"172.21.15.203:6807/483489448","heartbeat_front_addr":"172.21.15.203:6805/483489448","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6809","nonce":1227714102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6811","nonce":1227714102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6815","nonce":1227714102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6813","nonce":1227714102}]},"public_addr":"172.21.15.203:6809/1227714102","cluster_addr":"172.21.15.203:6811/1227714102","heartbeat_back_addr":"172.21.15.203:6815/1227714102","heartbeat_front_addr":"172.21.15.203:6813/1227714102","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6817","nonce":593999121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6819","nonce":593999121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6823","nonce":593999121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6821","nonce":593999121}]},"public_addr":"172.21.15.203:6817/593999121","cluster_addr":"172.21.15.203:6819/593999121","heartbeat_back_addr":"172.21.15.203:6823/593999121","heartbeat_front_addr":"172.21.15.203:6821/593999121","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6825","nonce":4089764819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6827","nonce":4089764819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6831","nonce":4089764819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6829","nonce":4089764819}]},"public_addr":"172.21.15.203:6825/4089764819","cluster_addr":"172.21.15.203:6827/4089764819","heartbeat_back_addr":"172.21.15.203:6831/4089764819","heartbeat_front_addr":"172.21.15.203:6829/4089764819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T06:38:13.503 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-04T06:38:13.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[26846]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-04T06:38:13.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[26846]: osdmap e60: 8 total, 8 up, 8 in 2024-03-04T06:38:13.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1583086518' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-04T06:38:13.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[26846]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-04T06:38:13.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[26846]: osdmap e61: 8 total, 8 up, 8 in 2024-03-04T06:38:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1583086518' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-04T06:38:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[26846]: fsmap cephfs:1 {0=b=up:creating} 1 up:standby 2024-03-04T06:38:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[26846]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-04T06:38:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[26846]: pgmap v186: 97 pgs: 3 creating+peering, 1 active+clean, 93 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2520390314' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/168241101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:13.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[37364]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-04T06:38:13.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[37364]: osdmap e60: 8 total, 8 up, 8 in 2024-03-04T06:38:13.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1583086518' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-04T06:38:13.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[37364]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-04T06:38:13.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[37364]: osdmap e61: 8 total, 8 up, 8 in 2024-03-04T06:38:13.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1583086518' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-04T06:38:13.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[37364]: fsmap cephfs:1 {0=b=up:creating} 1 up:standby 2024-03-04T06:38:13.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[37364]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-04T06:38:13.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[37364]: pgmap v186: 97 pgs: 3 creating+peering, 1 active+clean, 93 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:13.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:13.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2520390314' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:13.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:13 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/168241101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:13 smithi203 ceph-mon[30756]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-04T06:38:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:13 smithi203 ceph-mon[30756]: osdmap e60: 8 total, 8 up, 8 in 2024-03-04T06:38:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:13 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1583086518' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-04T06:38:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:13 smithi203 ceph-mon[30756]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-04T06:38:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:13 smithi203 ceph-mon[30756]: osdmap e61: 8 total, 8 up, 8 in 2024-03-04T06:38:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:13 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1583086518' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-04T06:38:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:13 smithi203 ceph-mon[30756]: fsmap cephfs:1 {0=b=up:creating} 1 up:standby 2024-03-04T06:38:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:13 smithi203 ceph-mon[30756]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-04T06:38:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:13 smithi203 ceph-mon[30756]: pgmap v186: 97 pgs: 3 creating+peering, 1 active+clean, 93 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:13 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:13 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2520390314' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:13 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/168241101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:13.901 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-04T06:38:13.901 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-04T06:38:14.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3860679676' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-04T06:38:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[26846]: osdmap e62: 8 total, 8 up, 8 in 2024-03-04T06:38:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[26846]: mds.? [v2:172.21.15.203:6832/3636376444,v1:172.21.15.203:6833/3636376444] up:active 2024-03-04T06:38:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3860679676' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-04T06:38:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[26846]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:38:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/4002504004' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-04T06:38:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[26846]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-04T06:38:14.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3860679676' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-04T06:38:14.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[37364]: osdmap e62: 8 total, 8 up, 8 in 2024-03-04T06:38:14.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[37364]: mds.? [v2:172.21.15.203:6832/3636376444,v1:172.21.15.203:6833/3636376444] up:active 2024-03-04T06:38:14.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3860679676' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-04T06:38:14.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[37364]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:38:14.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/4002504004' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-04T06:38:14.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:14 smithi137 ceph-mon[37364]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-04T06:38:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:14 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3860679676' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-04T06:38:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:14 smithi203 ceph-mon[30756]: osdmap e62: 8 total, 8 up, 8 in 2024-03-04T06:38:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:14 smithi203 ceph-mon[30756]: mds.? [v2:172.21.15.203:6832/3636376444,v1:172.21.15.203:6833/3636376444] up:active 2024-03-04T06:38:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:14 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3860679676' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-04T06:38:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:14 smithi203 ceph-mon[30756]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:38:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:14 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/4002504004' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-04T06:38:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:14 smithi203 ceph-mon[30756]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-04T06:38:14.905 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-04T06:38:14.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T06:38:15.229 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:15.229 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3869447426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3869447426},{"type":"v1","addr":"172.21.15.137:6835","nonce":3869447426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T06:38:12.879589+0000","modified":"2024-03-04T06:38:14.885821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24352":{"gid":24352,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6833/3636376444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3636376444},{"type":"v1","addr":"172.21.15.203:6833","nonce":3636376444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-04T06:38:15.229 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 6 2024-03-04T06:38:15.241 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T06:38:15.527 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:15.527 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":62,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:38:13.881442+0000","last_up_change":"2024-03-04T06:37:54.799220+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T06:38:11.049505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T06:38:12.066145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6803","nonce":120753079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6805","nonce":120753079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6809","nonce":120753079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6807","nonce":120753079}]},"public_addr":"172.21.15.137:6803/120753079","cluster_addr":"172.21.15.137:6805/120753079","heartbeat_back_addr":"172.21.15.137:6809/120753079","heartbeat_front_addr":"172.21.15.137:6807/120753079","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6811","nonce":2976801936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6813","nonce":2976801936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6817","nonce":2976801936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6815","nonce":2976801936}]},"public_addr":"172.21.15.137:6811/2976801936","cluster_addr":"172.21.15.137:6813/2976801936","heartbeat_back_addr":"172.21.15.137:6817/2976801936","heartbeat_front_addr":"172.21.15.137:6815/2976801936","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6819","nonce":788153355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6821","nonce":788153355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6825","nonce":788153355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6823","nonce":788153355}]},"public_addr":"172.21.15.137:6819/788153355","cluster_addr":"172.21.15.137:6821/788153355","heartbeat_back_addr":"172.21.15.137:6825/788153355","heartbeat_front_addr":"172.21.15.137:6823/788153355","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6827","nonce":1906308615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6829","nonce":1906308615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6833","nonce":1906308615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6831","nonce":1906308615}]},"public_addr":"172.21.15.137:6827/1906308615","cluster_addr":"172.21.15.137:6829/1906308615","heartbeat_back_addr":"172.21.15.137:6833/1906308615","heartbeat_front_addr":"172.21.15.137:6831/1906308615","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6801","nonce":483489448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6803","nonce":483489448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6807","nonce":483489448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6805","nonce":483489448}]},"public_addr":"172.21.15.203:6801/483489448","cluster_addr":"172.21.15.203:6803/483489448","heartbeat_back_addr":"172.21.15.203:6807/483489448","heartbeat_front_addr":"172.21.15.203:6805/483489448","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6809","nonce":1227714102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6811","nonce":1227714102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6815","nonce":1227714102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6813","nonce":1227714102}]},"public_addr":"172.21.15.203:6809/1227714102","cluster_addr":"172.21.15.203:6811/1227714102","heartbeat_back_addr":"172.21.15.203:6815/1227714102","heartbeat_front_addr":"172.21.15.203:6813/1227714102","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6817","nonce":593999121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6819","nonce":593999121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6823","nonce":593999121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6821","nonce":593999121}]},"public_addr":"172.21.15.203:6817/593999121","cluster_addr":"172.21.15.203:6819/593999121","heartbeat_back_addr":"172.21.15.203:6823/593999121","heartbeat_front_addr":"172.21.15.203:6821/593999121","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6825","nonce":4089764819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6827","nonce":4089764819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6831","nonce":4089764819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6829","nonce":4089764819}]},"public_addr":"172.21.15.203:6825/4089764819","cluster_addr":"172.21.15.203:6827/4089764819","heartbeat_back_addr":"172.21.15.203:6831/4089764819","heartbeat_front_addr":"172.21.15.203:6829/4089764819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T06:38:15.539 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-04T06:38:15.539 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T06:38:15.829 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:15.830 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:38:15.839 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-03-04T06:38:14.982385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":749961216,"kb_used":222504,"kb_used_data":6328,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":749738712,"statfs":{"total":767960285184,"available":767732441088,"internally_reserved":0,"allocated":6479872,"data_stored":3691016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000654"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889794+0000","last_change":"2024-03-04T06:38:12.919238+0000","last_active":"2024-03-04T06:38:13.889794+0000","last_peered":"2024-03-04T06:38:13.889794+0000","last_clean":"2024-03-04T06:38:13.889794+0000","last_became_active":"2024-03-04T06:38:12.918941+0000","last_became_peered":"2024-03-04T06:38:12.918941+0000","last_unstale":"2024-03-04T06:38:13.889794+0000","last_undegraded":"2024-03-04T06:38:13.889794+0000","last_fullsized":"2024-03-04T06:38:13.889794+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:10:03.122262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889213+0000","last_change":"2024-03-04T06:38:12.913797+0000","last_active":"2024-03-04T06:38:13.889213+0000","last_peered":"2024-03-04T06:38:13.889213+0000","last_clean":"2024-03-04T06:38:13.889213+0000","last_became_active":"2024-03-04T06:38:12.913517+0000","last_became_peered":"2024-03-04T06:38:12.913517+0000","last_unstale":"2024-03-04T06:38:13.889213+0000","last_undegraded":"2024-03-04T06:38:13.889213+0000","last_fullsized":"2024-03-04T06:38:13.889213+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:24.837813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888865+0000","last_change":"2024-03-04T06:38:12.913825+0000","last_active":"2024-03-04T06:38:13.888865+0000","last_peered":"2024-03-04T06:38:13.888865+0000","last_clean":"2024-03-04T06:38:13.888865+0000","last_became_active":"2024-03-04T06:38:12.913553+0000","last_became_peered":"2024-03-04T06:38:12.913553+0000","last_unstale":"2024-03-04T06:38:13.888865+0000","last_undegraded":"2024-03-04T06:38:13.888865+0000","last_fullsized":"2024-03-04T06:38:13.888865+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:23:17.322436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889777+0000","last_change":"2024-03-04T06:38:12.916933+0000","last_active":"2024-03-04T06:38:13.889777+0000","last_peered":"2024-03-04T06:38:13.889777+0000","last_clean":"2024-03-04T06:38:13.889777+0000","last_became_active":"2024-03-04T06:38:12.913922+0000","last_became_peered":"2024-03-04T06:38:12.913922+0000","last_unstale":"2024-03-04T06:38:13.889777+0000","last_undegraded":"2024-03-04T06:38:13.889777+0000","last_fullsized":"2024-03-04T06:38:13.889777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:08:21.342061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888473+0000","last_change":"2024-03-04T06:38:12.899134+0000","last_active":"2024-03-04T06:38:13.888473+0000","last_peered":"2024-03-04T06:38:13.888473+0000","last_clean":"2024-03-04T06:38:13.888473+0000","last_became_active":"2024-03-04T06:38:12.898801+0000","last_became_peered":"2024-03-04T06:38:12.898801+0000","last_unstale":"2024-03-04T06:38:13.888473+0000","last_undegraded":"2024-03-04T06:38:13.888473+0000","last_fullsized":"2024-03-04T06:38:13.888473+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:21:48.465552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889197+0000","last_change":"2024-03-04T06:38:12.918000+0000","last_active":"2024-03-04T06:38:13.889197+0000","last_peered":"2024-03-04T06:38:13.889197+0000","last_clean":"2024-03-04T06:38:13.889197+0000","last_became_active":"2024-03-04T06:38:12.914159+0000","last_became_peered":"2024-03-04T06:38:12.914159+0000","last_unstale":"2024-03-04T06:38:13.889197+0000","last_undegraded":"2024-03-04T06:38:13.889197+0000","last_fullsized":"2024-03-04T06:38:13.889197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:24.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-03-04T06:38:11.527764+0000","last_change":"2024-03-04T06:38:11.527764+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.527764+0000","last_undegraded":"2024-03-04T06:38:11.527764+0000","last_fullsized":"2024-03-04T06:38:11.527764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:01.969570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889631+0000","last_change":"2024-03-04T06:38:12.557057+0000","last_active":"2024-03-04T06:38:13.889631+0000","last_peered":"2024-03-04T06:38:13.889631+0000","last_clean":"2024-03-04T06:38:13.889631+0000","last_became_active":"2024-03-04T06:38:12.556733+0000","last_became_peered":"2024-03-04T06:38:12.556733+0000","last_unstale":"2024-03-04T06:38:13.889631+0000","last_undegraded":"2024-03-04T06:38:13.889631+0000","last_fullsized":"2024-03-04T06:38:13.889631+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:15.847471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889309+0000","last_change":"2024-03-04T06:38:12.556246+0000","last_active":"2024-03-04T06:38:13.889309+0000","last_peered":"2024-03-04T06:38:13.889309+0000","last_clean":"2024-03-04T06:38:13.889309+0000","last_became_active":"2024-03-04T06:38:12.555860+0000","last_became_peered":"2024-03-04T06:38:12.555860+0000","last_unstale":"2024-03-04T06:38:13.889309+0000","last_undegraded":"2024-03-04T06:38:13.889309+0000","last_fullsized":"2024-03-04T06:38:13.889309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:41.910480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889396+0000","last_change":"2024-03-04T06:38:12.919415+0000","last_active":"2024-03-04T06:38:13.889396+0000","last_peered":"2024-03-04T06:38:13.889396+0000","last_clean":"2024-03-04T06:38:13.889396+0000","last_became_active":"2024-03-04T06:38:12.918269+0000","last_became_peered":"2024-03-04T06:38:12.918269+0000","last_unstale":"2024-03-04T06:38:13.889396+0000","last_undegraded":"2024-03-04T06:38:13.889396+0000","last_fullsized":"2024-03-04T06:38:13.889396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:26:56.067995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-03-04T06:38:11.526600+0000","last_change":"2024-03-04T06:38:11.526600+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.526600+0000","last_undegraded":"2024-03-04T06:38:11.526600+0000","last_fullsized":"2024-03-04T06:38:11.526600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:21:00.773241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889084+0000","last_change":"2024-03-04T06:38:12.913767+0000","last_active":"2024-03-04T06:38:13.889084+0000","last_peered":"2024-03-04T06:38:13.889084+0000","last_clean":"2024-03-04T06:38:13.889084+0000","last_became_active":"2024-03-04T06:38:12.913476+0000","last_became_peered":"2024-03-04T06:38:12.913476+0000","last_unstale":"2024-03-04T06:38:13.889084+0000","last_undegraded":"2024-03-04T06:38:13.889084+0000","last_fullsized":"2024-03-04T06:38:13.889084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:44:53.483514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887301+0000","last_change":"2024-03-04T06:38:12.544896+0000","last_active":"2024-03-04T06:38:13.887301+0000","last_peered":"2024-03-04T06:38:13.887301+0000","last_clean":"2024-03-04T06:38:13.887301+0000","last_became_active":"2024-03-04T06:38:12.543579+0000","last_became_peered":"2024-03-04T06:38:12.543579+0000","last_unstale":"2024-03-04T06:38:13.887301+0000","last_undegraded":"2024-03-04T06:38:13.887301+0000","last_fullsized":"2024-03-04T06:38:13.887301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:39.451118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888937+0000","last_change":"2024-03-04T06:38:12.919018+0000","last_active":"2024-03-04T06:38:13.888937+0000","last_peered":"2024-03-04T06:38:13.888937+0000","last_clean":"2024-03-04T06:38:13.888937+0000","last_became_active":"2024-03-04T06:38:12.918716+0000","last_became_peered":"2024-03-04T06:38:12.918716+0000","last_unstale":"2024-03-04T06:38:13.888937+0000","last_undegraded":"2024-03-04T06:38:13.888937+0000","last_fullsized":"2024-03-04T06:38:13.888937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:06:47.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-03-04T06:38:11.524636+0000","last_change":"2024-03-04T06:38:11.524636+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.524636+0000","last_undegraded":"2024-03-04T06:38:11.524636+0000","last_fullsized":"2024-03-04T06:38:11.524636+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:04.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889815+0000","last_change":"2024-03-04T06:38:12.913566+0000","last_active":"2024-03-04T06:38:13.889815+0000","last_peered":"2024-03-04T06:38:13.889815+0000","last_clean":"2024-03-04T06:38:13.889815+0000","last_became_active":"2024-03-04T06:38:12.910660+0000","last_became_peered":"2024-03-04T06:38:12.910660+0000","last_unstale":"2024-03-04T06:38:13.889815+0000","last_undegraded":"2024-03-04T06:38:13.889815+0000","last_fullsized":"2024-03-04T06:38:13.889815+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:16:42.862745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887360+0000","last_change":"2024-03-04T06:38:12.540510+0000","last_active":"2024-03-04T06:38:13.887360+0000","last_peered":"2024-03-04T06:38:13.887360+0000","last_clean":"2024-03-04T06:38:13.887360+0000","last_became_active":"2024-03-04T06:38:12.540155+0000","last_became_peered":"2024-03-04T06:38:12.540155+0000","last_unstale":"2024-03-04T06:38:13.887360+0000","last_undegraded":"2024-03-04T06:38:13.887360+0000","last_fullsized":"2024-03-04T06:38:13.887360+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:39.660282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"21'117","reported_seq":218,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.894459+0000","last_change":"2024-03-04T06:37:58.310255+0000","last_active":"2024-03-04T06:38:12.894459+0000","last_peered":"2024-03-04T06:38:12.894459+0000","last_clean":"2024-03-04T06:38:12.894459+0000","last_became_active":"2024-03-04T06:37:58.309800+0000","last_became_peered":"2024-03-04T06:37:58.309800+0000","last_unstale":"2024-03-04T06:38:12.894459+0000","last_undegraded":"2024-03-04T06:38:12.894459+0000","last_fullsized":"2024-03-04T06:38:12.894459+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:38.185918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888963+0000","last_change":"2024-03-04T06:38:12.556986+0000","last_active":"2024-03-04T06:38:13.888963+0000","last_peered":"2024-03-04T06:38:13.888963+0000","last_clean":"2024-03-04T06:38:13.888963+0000","last_became_active":"2024-03-04T06:38:12.556594+0000","last_became_peered":"2024-03-04T06:38:12.556594+0000","last_unstale":"2024-03-04T06:38:13.888963+0000","last_undegraded":"2024-03-04T06:38:13.888963+0000","last_fullsized":"2024-03-04T06:38:13.888963+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:52.669745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889491+0000","last_change":"2024-03-04T06:38:12.557967+0000","last_active":"2024-03-04T06:38:13.889491+0000","last_peered":"2024-03-04T06:38:13.889491+0000","last_clean":"2024-03-04T06:38:13.889491+0000","last_became_active":"2024-03-04T06:38:12.557397+0000","last_became_peered":"2024-03-04T06:38:12.557397+0000","last_unstale":"2024-03-04T06:38:13.889491+0000","last_undegraded":"2024-03-04T06:38:13.889491+0000","last_fullsized":"2024-03-04T06:38:13.889491+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.366465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888779+0000","last_change":"2024-03-04T06:38:12.556654+0000","last_active":"2024-03-04T06:38:13.888779+0000","last_peered":"2024-03-04T06:38:13.888779+0000","last_clean":"2024-03-04T06:38:13.888779+0000","last_became_active":"2024-03-04T06:38:12.556014+0000","last_became_peered":"2024-03-04T06:38:12.556014+0000","last_unstale":"2024-03-04T06:38:13.888779+0000","last_undegraded":"2024-03-04T06:38:13.888779+0000","last_fullsized":"2024-03-04T06:38:13.888779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:45.975559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889065+0000","last_change":"2024-03-04T06:38:12.558399+0000","last_active":"2024-03-04T06:38:13.889065+0000","last_peered":"2024-03-04T06:38:13.889065+0000","last_clean":"2024-03-04T06:38:13.889065+0000","last_became_active":"2024-03-04T06:38:12.558068+0000","last_became_peered":"2024-03-04T06:38:12.558068+0000","last_unstale":"2024-03-04T06:38:13.889065+0000","last_undegraded":"2024-03-04T06:38:13.889065+0000","last_fullsized":"2024-03-04T06:38:13.889065+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:00.895079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887826+0000","last_change":"2024-03-04T06:38:12.548200+0000","last_active":"2024-03-04T06:38:13.887826+0000","last_peered":"2024-03-04T06:38:13.887826+0000","last_clean":"2024-03-04T06:38:13.887826+0000","last_became_active":"2024-03-04T06:38:12.547906+0000","last_became_peered":"2024-03-04T06:38:12.547906+0000","last_unstale":"2024-03-04T06:38:13.887826+0000","last_undegraded":"2024-03-04T06:38:13.887826+0000","last_fullsized":"2024-03-04T06:38:13.887826+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:11:39.491360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889452+0000","last_change":"2024-03-04T06:38:12.918955+0000","last_active":"2024-03-04T06:38:13.889452+0000","last_peered":"2024-03-04T06:38:13.889452+0000","last_clean":"2024-03-04T06:38:13.889452+0000","last_became_active":"2024-03-04T06:38:12.918684+0000","last_became_peered":"2024-03-04T06:38:12.918684+0000","last_unstale":"2024-03-04T06:38:13.889452+0000","last_undegraded":"2024-03-04T06:38:13.889452+0000","last_fullsized":"2024-03-04T06:38:13.889452+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:47:29.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888468+0000","last_change":"2024-03-04T06:38:12.547376+0000","last_active":"2024-03-04T06:38:13.888468+0000","last_peered":"2024-03-04T06:38:13.888468+0000","last_clean":"2024-03-04T06:38:13.888468+0000","last_became_active":"2024-03-04T06:38:12.547108+0000","last_became_peered":"2024-03-04T06:38:12.547108+0000","last_unstale":"2024-03-04T06:38:13.888468+0000","last_undegraded":"2024-03-04T06:38:13.888468+0000","last_fullsized":"2024-03-04T06:38:13.888468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:34:14.300865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889848+0000","last_change":"2024-03-04T06:38:12.917263+0000","last_active":"2024-03-04T06:38:13.889848+0000","last_peered":"2024-03-04T06:38:13.889848+0000","last_clean":"2024-03-04T06:38:13.889848+0000","last_became_active":"2024-03-04T06:38:12.917001+0000","last_became_peered":"2024-03-04T06:38:12.917001+0000","last_unstale":"2024-03-04T06:38:13.889848+0000","last_undegraded":"2024-03-04T06:38:13.889848+0000","last_fullsized":"2024-03-04T06:38:13.889848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:54.912481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887725+0000","last_change":"2024-03-04T06:38:12.892619+0000","last_active":"2024-03-04T06:38:13.887725+0000","last_peered":"2024-03-04T06:38:13.887725+0000","last_clean":"2024-03-04T06:38:13.887725+0000","last_became_active":"2024-03-04T06:38:12.892261+0000","last_became_peered":"2024-03-04T06:38:12.892261+0000","last_unstale":"2024-03-04T06:38:13.887725+0000","last_undegraded":"2024-03-04T06:38:13.887725+0000","last_fullsized":"2024-03-04T06:38:13.887725+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:19:13.957414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":39,"acting":39,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":39,"acting":39,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28212,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716940,"statfs":{"total":95995035648,"available":95966146560,"internally_reserved":0,"allocated":1220608,"data_stored":850082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495626,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1167360,"data_stored":822922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717568,"statfs":{"total":95995035648,"available":95966789632,"internally_reserved":0,"allocated":573440,"data_stored":232554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:35 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.31900000000000001,"15min":0.313},"min":{"1min":0.254,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Mar 4 06:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.375,"15min":0.36399999999999999},"min":{"1min":0.32300000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33500000000000002}]},{"osd":3,"last update":"Mon Mar 4 06:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.37}]},{"osd":4,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.40100000000000002}]},{"osd":5,"last update":"Mon Mar 4 06:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716980,"statfs":{"total":95995035648,"available":95966187520,"internally_reserved":0,"allocated":1179648,"data_stored":829169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 4 06:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.27700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.28799999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.38700000000000001}]},{"osd":2,"last update":"Mon Mar 4 06:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.38800000000000001},"min":{"1min":0.30499999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57399999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63200000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.34000000000000002}]},{"osd":3,"last update":"Mon Mar 4 06:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.37},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.27200000000000002}]},{"osd":4,"last update":"Mon Mar 4 06:37:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411358,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717532,"statfs":{"total":95995035648,"available":95966752768,"internally_reserved":0,"allocated":610304,"data_stored":252711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.33700000000000002,"15min":0.32100000000000001},"min":{"1min":0.308,"5min":0.221,"15min":0.221},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.373,"15min":0.36299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.25800000000000001}]},{"osd":1,"last update":"Mon Mar 4 06:37:55 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.378,"15min":0.36599999999999999},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.32500000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.30299999999999999}]},{"osd":3,"last update":"Mon Mar 4 06:37:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.28899999999999998}]},{"osd":4,"last update":"Mon Mar 4 06:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60899999999999999}]},{"osd":5,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182425,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717564,"statfs":{"total":95995035648,"available":95966785536,"internally_reserved":0,"allocated":573440,"data_stored":232554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.254},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.375}]},{"osd":1,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.29999999999999999}]},{"osd":2,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Mar 4 06:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.45200000000000001}]},{"osd":5,"last update":"Mon Mar 4 06:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":4,"up_from":30,"seq":128849018900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717560,"statfs":{"total":95995035648,"available":95966781440,"internally_reserved":0,"allocated":585728,"data_stored":238801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42699999999999999}]},{"osd":1,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.377},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.38500000000000001}]},{"osd":5,"last update":"Mon Mar 4 06:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717576,"statfs":{"total":95995035648,"available":95966797824,"internally_reserved":0,"allocated":569344,"data_stored":232223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.30499999999999999}]},{"osd":2,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.496}]},{"osd":3,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":6.6180000000000003,"5min":6.6180000000000003,"15min":6.6180000000000003},"last":6.6180000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.443}]},{"osd":4,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:38:15.845 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T06:38:16.165 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:16.167 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:38:16.176 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:15 smithi137 ceph-mon[26846]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-03-04T06:38:16.176 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:15 smithi137 ceph-mon[26846]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:38:16.176 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:15 smithi137 ceph-mon[26846]: pgmap v188: 97 pgs: 24 active+clean, 3 creating+peering, 70 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 5 op/s 2024-03-04T06:38:16.176 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:15 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2416294301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:38:16.176 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:15 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3847281661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:16.176 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:15 smithi137 ceph-mon[37364]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-03-04T06:38:16.176 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:15 smithi137 ceph-mon[37364]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:38:16.176 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:15 smithi137 ceph-mon[37364]: pgmap v188: 97 pgs: 24 active+clean, 3 creating+peering, 70 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 5 op/s 2024-03-04T06:38:16.176 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:15 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2416294301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:38:16.177 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:15 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3847281661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:16.177 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-03-04T06:38:14.982385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":749961216,"kb_used":222504,"kb_used_data":6328,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":749738712,"statfs":{"total":767960285184,"available":767732441088,"internally_reserved":0,"allocated":6479872,"data_stored":3691016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000654"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889794+0000","last_change":"2024-03-04T06:38:12.919238+0000","last_active":"2024-03-04T06:38:13.889794+0000","last_peered":"2024-03-04T06:38:13.889794+0000","last_clean":"2024-03-04T06:38:13.889794+0000","last_became_active":"2024-03-04T06:38:12.918941+0000","last_became_peered":"2024-03-04T06:38:12.918941+0000","last_unstale":"2024-03-04T06:38:13.889794+0000","last_undegraded":"2024-03-04T06:38:13.889794+0000","last_fullsized":"2024-03-04T06:38:13.889794+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:10:03.122262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889213+0000","last_change":"2024-03-04T06:38:12.913797+0000","last_active":"2024-03-04T06:38:13.889213+0000","last_peered":"2024-03-04T06:38:13.889213+0000","last_clean":"2024-03-04T06:38:13.889213+0000","last_became_active":"2024-03-04T06:38:12.913517+0000","last_became_peered":"2024-03-04T06:38:12.913517+0000","last_unstale":"2024-03-04T06:38:13.889213+0000","last_undegraded":"2024-03-04T06:38:13.889213+0000","last_fullsized":"2024-03-04T06:38:13.889213+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:24.837813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888865+0000","last_change":"2024-03-04T06:38:12.913825+0000","last_active":"2024-03-04T06:38:13.888865+0000","last_peered":"2024-03-04T06:38:13.888865+0000","last_clean":"2024-03-04T06:38:13.888865+0000","last_became_active":"2024-03-04T06:38:12.913553+0000","last_became_peered":"2024-03-04T06:38:12.913553+0000","last_unstale":"2024-03-04T06:38:13.888865+0000","last_undegraded":"2024-03-04T06:38:13.888865+0000","last_fullsized":"2024-03-04T06:38:13.888865+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:23:17.322436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889777+0000","last_change":"2024-03-04T06:38:12.916933+0000","last_active":"2024-03-04T06:38:13.889777+0000","last_peered":"2024-03-04T06:38:13.889777+0000","last_clean":"2024-03-04T06:38:13.889777+0000","last_became_active":"2024-03-04T06:38:12.913922+0000","last_became_peered":"2024-03-04T06:38:12.913922+0000","last_unstale":"2024-03-04T06:38:13.889777+0000","last_undegraded":"2024-03-04T06:38:13.889777+0000","last_fullsized":"2024-03-04T06:38:13.889777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:08:21.342061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888473+0000","last_change":"2024-03-04T06:38:12.899134+0000","last_active":"2024-03-04T06:38:13.888473+0000","last_peered":"2024-03-04T06:38:13.888473+0000","last_clean":"2024-03-04T06:38:13.888473+0000","last_became_active":"2024-03-04T06:38:12.898801+0000","last_became_peered":"2024-03-04T06:38:12.898801+0000","last_unstale":"2024-03-04T06:38:13.888473+0000","last_undegraded":"2024-03-04T06:38:13.888473+0000","last_fullsized":"2024-03-04T06:38:13.888473+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:21:48.465552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889197+0000","last_change":"2024-03-04T06:38:12.918000+0000","last_active":"2024-03-04T06:38:13.889197+0000","last_peered":"2024-03-04T06:38:13.889197+0000","last_clean":"2024-03-04T06:38:13.889197+0000","last_became_active":"2024-03-04T06:38:12.914159+0000","last_became_peered":"2024-03-04T06:38:12.914159+0000","last_unstale":"2024-03-04T06:38:13.889197+0000","last_undegraded":"2024-03-04T06:38:13.889197+0000","last_fullsized":"2024-03-04T06:38:13.889197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:24.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-03-04T06:38:11.527764+0000","last_change":"2024-03-04T06:38:11.527764+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.527764+0000","last_undegraded":"2024-03-04T06:38:11.527764+0000","last_fullsized":"2024-03-04T06:38:11.527764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:01.969570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889631+0000","last_change":"2024-03-04T06:38:12.557057+0000","last_active":"2024-03-04T06:38:13.889631+0000","last_peered":"2024-03-04T06:38:13.889631+0000","last_clean":"2024-03-04T06:38:13.889631+0000","last_became_active":"2024-03-04T06:38:12.556733+0000","last_became_peered":"2024-03-04T06:38:12.556733+0000","last_unstale":"2024-03-04T06:38:13.889631+0000","last_undegraded":"2024-03-04T06:38:13.889631+0000","last_fullsized":"2024-03-04T06:38:13.889631+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:15.847471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889309+0000","last_change":"2024-03-04T06:38:12.556246+0000","last_active":"2024-03-04T06:38:13.889309+0000","last_peered":"2024-03-04T06:38:13.889309+0000","last_clean":"2024-03-04T06:38:13.889309+0000","last_became_active":"2024-03-04T06:38:12.555860+0000","last_became_peered":"2024-03-04T06:38:12.555860+0000","last_unstale":"2024-03-04T06:38:13.889309+0000","last_undegraded":"2024-03-04T06:38:13.889309+0000","last_fullsized":"2024-03-04T06:38:13.889309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:41.910480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889396+0000","last_change":"2024-03-04T06:38:12.919415+0000","last_active":"2024-03-04T06:38:13.889396+0000","last_peered":"2024-03-04T06:38:13.889396+0000","last_clean":"2024-03-04T06:38:13.889396+0000","last_became_active":"2024-03-04T06:38:12.918269+0000","last_became_peered":"2024-03-04T06:38:12.918269+0000","last_unstale":"2024-03-04T06:38:13.889396+0000","last_undegraded":"2024-03-04T06:38:13.889396+0000","last_fullsized":"2024-03-04T06:38:13.889396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:26:56.067995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-03-04T06:38:11.526600+0000","last_change":"2024-03-04T06:38:11.526600+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.526600+0000","last_undegraded":"2024-03-04T06:38:11.526600+0000","last_fullsized":"2024-03-04T06:38:11.526600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:21:00.773241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889084+0000","last_change":"2024-03-04T06:38:12.913767+0000","last_active":"2024-03-04T06:38:13.889084+0000","last_peered":"2024-03-04T06:38:13.889084+0000","last_clean":"2024-03-04T06:38:13.889084+0000","last_became_active":"2024-03-04T06:38:12.913476+0000","last_became_peered":"2024-03-04T06:38:12.913476+0000","last_unstale":"2024-03-04T06:38:13.889084+0000","last_undegraded":"2024-03-04T06:38:13.889084+0000","last_fullsized":"2024-03-04T06:38:13.889084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:44:53.483514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887301+0000","last_change":"2024-03-04T06:38:12.544896+0000","last_active":"2024-03-04T06:38:13.887301+0000","last_peered":"2024-03-04T06:38:13.887301+0000","last_clean":"2024-03-04T06:38:13.887301+0000","last_became_active":"2024-03-04T06:38:12.543579+0000","last_became_peered":"2024-03-04T06:38:12.543579+0000","last_unstale":"2024-03-04T06:38:13.887301+0000","last_undegraded":"2024-03-04T06:38:13.887301+0000","last_fullsized":"2024-03-04T06:38:13.887301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:39.451118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888937+0000","last_change":"2024-03-04T06:38:12.919018+0000","last_active":"2024-03-04T06:38:13.888937+0000","last_peered":"2024-03-04T06:38:13.888937+0000","last_clean":"2024-03-04T06:38:13.888937+0000","last_became_active":"2024-03-04T06:38:12.918716+0000","last_became_peered":"2024-03-04T06:38:12.918716+0000","last_unstale":"2024-03-04T06:38:13.888937+0000","last_undegraded":"2024-03-04T06:38:13.888937+0000","last_fullsized":"2024-03-04T06:38:13.888937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:06:47.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-03-04T06:38:11.524636+0000","last_change":"2024-03-04T06:38:11.524636+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.524636+0000","last_undegraded":"2024-03-04T06:38:11.524636+0000","last_fullsized":"2024-03-04T06:38:11.524636+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:04.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889815+0000","last_change":"2024-03-04T06:38:12.913566+0000","last_active":"2024-03-04T06:38:13.889815+0000","last_peered":"2024-03-04T06:38:13.889815+0000","last_clean":"2024-03-04T06:38:13.889815+0000","last_became_active":"2024-03-04T06:38:12.910660+0000","last_became_peered":"2024-03-04T06:38:12.910660+0000","last_unstale":"2024-03-04T06:38:13.889815+0000","last_undegraded":"2024-03-04T06:38:13.889815+0000","last_fullsized":"2024-03-04T06:38:13.889815+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:16:42.862745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887360+0000","last_change":"2024-03-04T06:38:12.540510+0000","last_active":"2024-03-04T06:38:13.887360+0000","last_peered":"2024-03-04T06:38:13.887360+0000","last_clean":"2024-03-04T06:38:13.887360+0000","last_became_active":"2024-03-04T06:38:12.540155+0000","last_became_peered":"2024-03-04T06:38:12.540155+0000","last_unstale":"2024-03-04T06:38:13.887360+0000","last_undegraded":"2024-03-04T06:38:13.887360+0000","last_fullsized":"2024-03-04T06:38:13.887360+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:39.660282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"21'117","reported_seq":218,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.894459+0000","last_change":"2024-03-04T06:37:58.310255+0000","last_active":"2024-03-04T06:38:12.894459+0000","last_peered":"2024-03-04T06:38:12.894459+0000","last_clean":"2024-03-04T06:38:12.894459+0000","last_became_active":"2024-03-04T06:37:58.309800+0000","last_became_peered":"2024-03-04T06:37:58.309800+0000","last_unstale":"2024-03-04T06:38:12.894459+0000","last_undegraded":"2024-03-04T06:38:12.894459+0000","last_fullsized":"2024-03-04T06:38:12.894459+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:38.185918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888963+0000","last_change":"2024-03-04T06:38:12.556986+0000","last_active":"2024-03-04T06:38:13.888963+0000","last_peered":"2024-03-04T06:38:13.888963+0000","last_clean":"2024-03-04T06:38:13.888963+0000","last_became_active":"2024-03-04T06:38:12.556594+0000","last_became_peered":"2024-03-04T06:38:12.556594+0000","last_unstale":"2024-03-04T06:38:13.888963+0000","last_undegraded":"2024-03-04T06:38:13.888963+0000","last_fullsized":"2024-03-04T06:38:13.888963+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:52.669745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889491+0000","last_change":"2024-03-04T06:38:12.557967+0000","last_active":"2024-03-04T06:38:13.889491+0000","last_peered":"2024-03-04T06:38:13.889491+0000","last_clean":"2024-03-04T06:38:13.889491+0000","last_became_active":"2024-03-04T06:38:12.557397+0000","last_became_peered":"2024-03-04T06:38:12.557397+0000","last_unstale":"2024-03-04T06:38:13.889491+0000","last_undegraded":"2024-03-04T06:38:13.889491+0000","last_fullsized":"2024-03-04T06:38:13.889491+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.366465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888779+0000","last_change":"2024-03-04T06:38:12.556654+0000","last_active":"2024-03-04T06:38:13.888779+0000","last_peered":"2024-03-04T06:38:13.888779+0000","last_clean":"2024-03-04T06:38:13.888779+0000","last_became_active":"2024-03-04T06:38:12.556014+0000","last_became_peered":"2024-03-04T06:38:12.556014+0000","last_unstale":"2024-03-04T06:38:13.888779+0000","last_undegraded":"2024-03-04T06:38:13.888779+0000","last_fullsized":"2024-03-04T06:38:13.888779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:45.975559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889065+0000","last_change":"2024-03-04T06:38:12.558399+0000","last_active":"2024-03-04T06:38:13.889065+0000","last_peered":"2024-03-04T06:38:13.889065+0000","last_clean":"2024-03-04T06:38:13.889065+0000","last_became_active":"2024-03-04T06:38:12.558068+0000","last_became_peered":"2024-03-04T06:38:12.558068+0000","last_unstale":"2024-03-04T06:38:13.889065+0000","last_undegraded":"2024-03-04T06:38:13.889065+0000","last_fullsized":"2024-03-04T06:38:13.889065+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:00.895079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887826+0000","last_change":"2024-03-04T06:38:12.548200+0000","last_active":"2024-03-04T06:38:13.887826+0000","last_peered":"2024-03-04T06:38:13.887826+0000","last_clean":"2024-03-04T06:38:13.887826+0000","last_became_active":"2024-03-04T06:38:12.547906+0000","last_became_peered":"2024-03-04T06:38:12.547906+0000","last_unstale":"2024-03-04T06:38:13.887826+0000","last_undegraded":"2024-03-04T06:38:13.887826+0000","last_fullsized":"2024-03-04T06:38:13.887826+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:11:39.491360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889452+0000","last_change":"2024-03-04T06:38:12.918955+0000","last_active":"2024-03-04T06:38:13.889452+0000","last_peered":"2024-03-04T06:38:13.889452+0000","last_clean":"2024-03-04T06:38:13.889452+0000","last_became_active":"2024-03-04T06:38:12.918684+0000","last_became_peered":"2024-03-04T06:38:12.918684+0000","last_unstale":"2024-03-04T06:38:13.889452+0000","last_undegraded":"2024-03-04T06:38:13.889452+0000","last_fullsized":"2024-03-04T06:38:13.889452+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:47:29.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888468+0000","last_change":"2024-03-04T06:38:12.547376+0000","last_active":"2024-03-04T06:38:13.888468+0000","last_peered":"2024-03-04T06:38:13.888468+0000","last_clean":"2024-03-04T06:38:13.888468+0000","last_became_active":"2024-03-04T06:38:12.547108+0000","last_became_peered":"2024-03-04T06:38:12.547108+0000","last_unstale":"2024-03-04T06:38:13.888468+0000","last_undegraded":"2024-03-04T06:38:13.888468+0000","last_fullsized":"2024-03-04T06:38:13.888468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:34:14.300865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889848+0000","last_change":"2024-03-04T06:38:12.917263+0000","last_active":"2024-03-04T06:38:13.889848+0000","last_peered":"2024-03-04T06:38:13.889848+0000","last_clean":"2024-03-04T06:38:13.889848+0000","last_became_active":"2024-03-04T06:38:12.917001+0000","last_became_peered":"2024-03-04T06:38:12.917001+0000","last_unstale":"2024-03-04T06:38:13.889848+0000","last_undegraded":"2024-03-04T06:38:13.889848+0000","last_fullsized":"2024-03-04T06:38:13.889848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:54.912481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887725+0000","last_change":"2024-03-04T06:38:12.892619+0000","last_active":"2024-03-04T06:38:13.887725+0000","last_peered":"2024-03-04T06:38:13.887725+0000","last_clean":"2024-03-04T06:38:13.887725+0000","last_became_active":"2024-03-04T06:38:12.892261+0000","last_became_peered":"2024-03-04T06:38:12.892261+0000","last_unstale":"2024-03-04T06:38:13.887725+0000","last_undegraded":"2024-03-04T06:38:13.887725+0000","last_fullsized":"2024-03-04T06:38:13.887725+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:19:13.957414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":39,"acting":39,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":39,"acting":39,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28212,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716940,"statfs":{"total":95995035648,"available":95966146560,"internally_reserved":0,"allocated":1220608,"data_stored":850082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495626,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1167360,"data_stored":822922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717568,"statfs":{"total":95995035648,"available":95966789632,"internally_reserved":0,"allocated":573440,"data_stored":232554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:35 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.31900000000000001,"15min":0.313},"min":{"1min":0.254,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Mar 4 06:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.375,"15min":0.36399999999999999},"min":{"1min":0.32300000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33500000000000002}]},{"osd":3,"last update":"Mon Mar 4 06:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.37}]},{"osd":4,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.40100000000000002}]},{"osd":5,"last update":"Mon Mar 4 06:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716980,"statfs":{"total":95995035648,"available":95966187520,"internally_reserved":0,"allocated":1179648,"data_stored":829169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 4 06:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.27700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.28799999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.38700000000000001}]},{"osd":2,"last update":"Mon Mar 4 06:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.38800000000000001},"min":{"1min":0.30499999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57399999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63200000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.34000000000000002}]},{"osd":3,"last update":"Mon Mar 4 06:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.37},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.27200000000000002}]},{"osd":4,"last update":"Mon Mar 4 06:37:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411358,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717532,"statfs":{"total":95995035648,"available":95966752768,"internally_reserved":0,"allocated":610304,"data_stored":252711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.33700000000000002,"15min":0.32100000000000001},"min":{"1min":0.308,"5min":0.221,"15min":0.221},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.373,"15min":0.36299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.25800000000000001}]},{"osd":1,"last update":"Mon Mar 4 06:37:55 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.378,"15min":0.36599999999999999},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.32500000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.30299999999999999}]},{"osd":3,"last update":"Mon Mar 4 06:37:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.28899999999999998}]},{"osd":4,"last update":"Mon Mar 4 06:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60899999999999999}]},{"osd":5,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182425,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717564,"statfs":{"total":95995035648,"available":95966785536,"internally_reserved":0,"allocated":573440,"data_stored":232554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.254},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.375}]},{"osd":1,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.29999999999999999}]},{"osd":2,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Mar 4 06:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.45200000000000001}]},{"osd":5,"last update":"Mon Mar 4 06:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":4,"up_from":30,"seq":128849018900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717560,"statfs":{"total":95995035648,"available":95966781440,"internally_reserved":0,"allocated":585728,"data_stored":238801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42699999999999999}]},{"osd":1,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.377},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.38500000000000001}]},{"osd":5,"last update":"Mon Mar 4 06:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717576,"statfs":{"total":95995035648,"available":95966797824,"internally_reserved":0,"allocated":569344,"data_stored":232223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.30499999999999999}]},{"osd":2,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.496}]},{"osd":3,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":6.6180000000000003,"5min":6.6180000000000003,"15min":6.6180000000000003},"last":6.6180000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.443}]},{"osd":4,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:38:16.182 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T06:38:16.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:15 smithi203 ceph-mon[30756]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-03-04T06:38:16.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:15 smithi203 ceph-mon[30756]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:38:16.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:15 smithi203 ceph-mon[30756]: pgmap v188: 97 pgs: 24 active+clean, 3 creating+peering, 70 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 5 op/s 2024-03-04T06:38:16.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:15 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2416294301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:38:16.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:15 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3847281661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:16.506 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:16.507 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:38:16.517 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-03-04T06:38:14.982385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":749961216,"kb_used":222504,"kb_used_data":6328,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":749738712,"statfs":{"total":767960285184,"available":767732441088,"internally_reserved":0,"allocated":6479872,"data_stored":3691016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000654"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889794+0000","last_change":"2024-03-04T06:38:12.919238+0000","last_active":"2024-03-04T06:38:13.889794+0000","last_peered":"2024-03-04T06:38:13.889794+0000","last_clean":"2024-03-04T06:38:13.889794+0000","last_became_active":"2024-03-04T06:38:12.918941+0000","last_became_peered":"2024-03-04T06:38:12.918941+0000","last_unstale":"2024-03-04T06:38:13.889794+0000","last_undegraded":"2024-03-04T06:38:13.889794+0000","last_fullsized":"2024-03-04T06:38:13.889794+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:10:03.122262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889213+0000","last_change":"2024-03-04T06:38:12.913797+0000","last_active":"2024-03-04T06:38:13.889213+0000","last_peered":"2024-03-04T06:38:13.889213+0000","last_clean":"2024-03-04T06:38:13.889213+0000","last_became_active":"2024-03-04T06:38:12.913517+0000","last_became_peered":"2024-03-04T06:38:12.913517+0000","last_unstale":"2024-03-04T06:38:13.889213+0000","last_undegraded":"2024-03-04T06:38:13.889213+0000","last_fullsized":"2024-03-04T06:38:13.889213+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:24.837813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888865+0000","last_change":"2024-03-04T06:38:12.913825+0000","last_active":"2024-03-04T06:38:13.888865+0000","last_peered":"2024-03-04T06:38:13.888865+0000","last_clean":"2024-03-04T06:38:13.888865+0000","last_became_active":"2024-03-04T06:38:12.913553+0000","last_became_peered":"2024-03-04T06:38:12.913553+0000","last_unstale":"2024-03-04T06:38:13.888865+0000","last_undegraded":"2024-03-04T06:38:13.888865+0000","last_fullsized":"2024-03-04T06:38:13.888865+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:23:17.322436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889777+0000","last_change":"2024-03-04T06:38:12.916933+0000","last_active":"2024-03-04T06:38:13.889777+0000","last_peered":"2024-03-04T06:38:13.889777+0000","last_clean":"2024-03-04T06:38:13.889777+0000","last_became_active":"2024-03-04T06:38:12.913922+0000","last_became_peered":"2024-03-04T06:38:12.913922+0000","last_unstale":"2024-03-04T06:38:13.889777+0000","last_undegraded":"2024-03-04T06:38:13.889777+0000","last_fullsized":"2024-03-04T06:38:13.889777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:08:21.342061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888473+0000","last_change":"2024-03-04T06:38:12.899134+0000","last_active":"2024-03-04T06:38:13.888473+0000","last_peered":"2024-03-04T06:38:13.888473+0000","last_clean":"2024-03-04T06:38:13.888473+0000","last_became_active":"2024-03-04T06:38:12.898801+0000","last_became_peered":"2024-03-04T06:38:12.898801+0000","last_unstale":"2024-03-04T06:38:13.888473+0000","last_undegraded":"2024-03-04T06:38:13.888473+0000","last_fullsized":"2024-03-04T06:38:13.888473+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:21:48.465552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889197+0000","last_change":"2024-03-04T06:38:12.918000+0000","last_active":"2024-03-04T06:38:13.889197+0000","last_peered":"2024-03-04T06:38:13.889197+0000","last_clean":"2024-03-04T06:38:13.889197+0000","last_became_active":"2024-03-04T06:38:12.914159+0000","last_became_peered":"2024-03-04T06:38:12.914159+0000","last_unstale":"2024-03-04T06:38:13.889197+0000","last_undegraded":"2024-03-04T06:38:13.889197+0000","last_fullsized":"2024-03-04T06:38:13.889197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:24.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-03-04T06:38:11.527764+0000","last_change":"2024-03-04T06:38:11.527764+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.527764+0000","last_undegraded":"2024-03-04T06:38:11.527764+0000","last_fullsized":"2024-03-04T06:38:11.527764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:01.969570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889631+0000","last_change":"2024-03-04T06:38:12.557057+0000","last_active":"2024-03-04T06:38:13.889631+0000","last_peered":"2024-03-04T06:38:13.889631+0000","last_clean":"2024-03-04T06:38:13.889631+0000","last_became_active":"2024-03-04T06:38:12.556733+0000","last_became_peered":"2024-03-04T06:38:12.556733+0000","last_unstale":"2024-03-04T06:38:13.889631+0000","last_undegraded":"2024-03-04T06:38:13.889631+0000","last_fullsized":"2024-03-04T06:38:13.889631+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:15.847471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889309+0000","last_change":"2024-03-04T06:38:12.556246+0000","last_active":"2024-03-04T06:38:13.889309+0000","last_peered":"2024-03-04T06:38:13.889309+0000","last_clean":"2024-03-04T06:38:13.889309+0000","last_became_active":"2024-03-04T06:38:12.555860+0000","last_became_peered":"2024-03-04T06:38:12.555860+0000","last_unstale":"2024-03-04T06:38:13.889309+0000","last_undegraded":"2024-03-04T06:38:13.889309+0000","last_fullsized":"2024-03-04T06:38:13.889309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:41.910480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889396+0000","last_change":"2024-03-04T06:38:12.919415+0000","last_active":"2024-03-04T06:38:13.889396+0000","last_peered":"2024-03-04T06:38:13.889396+0000","last_clean":"2024-03-04T06:38:13.889396+0000","last_became_active":"2024-03-04T06:38:12.918269+0000","last_became_peered":"2024-03-04T06:38:12.918269+0000","last_unstale":"2024-03-04T06:38:13.889396+0000","last_undegraded":"2024-03-04T06:38:13.889396+0000","last_fullsized":"2024-03-04T06:38:13.889396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:26:56.067995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-03-04T06:38:11.526600+0000","last_change":"2024-03-04T06:38:11.526600+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.526600+0000","last_undegraded":"2024-03-04T06:38:11.526600+0000","last_fullsized":"2024-03-04T06:38:11.526600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:21:00.773241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889084+0000","last_change":"2024-03-04T06:38:12.913767+0000","last_active":"2024-03-04T06:38:13.889084+0000","last_peered":"2024-03-04T06:38:13.889084+0000","last_clean":"2024-03-04T06:38:13.889084+0000","last_became_active":"2024-03-04T06:38:12.913476+0000","last_became_peered":"2024-03-04T06:38:12.913476+0000","last_unstale":"2024-03-04T06:38:13.889084+0000","last_undegraded":"2024-03-04T06:38:13.889084+0000","last_fullsized":"2024-03-04T06:38:13.889084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:44:53.483514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887301+0000","last_change":"2024-03-04T06:38:12.544896+0000","last_active":"2024-03-04T06:38:13.887301+0000","last_peered":"2024-03-04T06:38:13.887301+0000","last_clean":"2024-03-04T06:38:13.887301+0000","last_became_active":"2024-03-04T06:38:12.543579+0000","last_became_peered":"2024-03-04T06:38:12.543579+0000","last_unstale":"2024-03-04T06:38:13.887301+0000","last_undegraded":"2024-03-04T06:38:13.887301+0000","last_fullsized":"2024-03-04T06:38:13.887301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:39.451118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888937+0000","last_change":"2024-03-04T06:38:12.919018+0000","last_active":"2024-03-04T06:38:13.888937+0000","last_peered":"2024-03-04T06:38:13.888937+0000","last_clean":"2024-03-04T06:38:13.888937+0000","last_became_active":"2024-03-04T06:38:12.918716+0000","last_became_peered":"2024-03-04T06:38:12.918716+0000","last_unstale":"2024-03-04T06:38:13.888937+0000","last_undegraded":"2024-03-04T06:38:13.888937+0000","last_fullsized":"2024-03-04T06:38:13.888937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:06:47.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-03-04T06:38:11.524636+0000","last_change":"2024-03-04T06:38:11.524636+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.524636+0000","last_undegraded":"2024-03-04T06:38:11.524636+0000","last_fullsized":"2024-03-04T06:38:11.524636+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:04.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889815+0000","last_change":"2024-03-04T06:38:12.913566+0000","last_active":"2024-03-04T06:38:13.889815+0000","last_peered":"2024-03-04T06:38:13.889815+0000","last_clean":"2024-03-04T06:38:13.889815+0000","last_became_active":"2024-03-04T06:38:12.910660+0000","last_became_peered":"2024-03-04T06:38:12.910660+0000","last_unstale":"2024-03-04T06:38:13.889815+0000","last_undegraded":"2024-03-04T06:38:13.889815+0000","last_fullsized":"2024-03-04T06:38:13.889815+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:16:42.862745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887360+0000","last_change":"2024-03-04T06:38:12.540510+0000","last_active":"2024-03-04T06:38:13.887360+0000","last_peered":"2024-03-04T06:38:13.887360+0000","last_clean":"2024-03-04T06:38:13.887360+0000","last_became_active":"2024-03-04T06:38:12.540155+0000","last_became_peered":"2024-03-04T06:38:12.540155+0000","last_unstale":"2024-03-04T06:38:13.887360+0000","last_undegraded":"2024-03-04T06:38:13.887360+0000","last_fullsized":"2024-03-04T06:38:13.887360+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:39.660282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"21'117","reported_seq":218,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.894459+0000","last_change":"2024-03-04T06:37:58.310255+0000","last_active":"2024-03-04T06:38:12.894459+0000","last_peered":"2024-03-04T06:38:12.894459+0000","last_clean":"2024-03-04T06:38:12.894459+0000","last_became_active":"2024-03-04T06:37:58.309800+0000","last_became_peered":"2024-03-04T06:37:58.309800+0000","last_unstale":"2024-03-04T06:38:12.894459+0000","last_undegraded":"2024-03-04T06:38:12.894459+0000","last_fullsized":"2024-03-04T06:38:12.894459+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:38.185918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888963+0000","last_change":"2024-03-04T06:38:12.556986+0000","last_active":"2024-03-04T06:38:13.888963+0000","last_peered":"2024-03-04T06:38:13.888963+0000","last_clean":"2024-03-04T06:38:13.888963+0000","last_became_active":"2024-03-04T06:38:12.556594+0000","last_became_peered":"2024-03-04T06:38:12.556594+0000","last_unstale":"2024-03-04T06:38:13.888963+0000","last_undegraded":"2024-03-04T06:38:13.888963+0000","last_fullsized":"2024-03-04T06:38:13.888963+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:52.669745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889491+0000","last_change":"2024-03-04T06:38:12.557967+0000","last_active":"2024-03-04T06:38:13.889491+0000","last_peered":"2024-03-04T06:38:13.889491+0000","last_clean":"2024-03-04T06:38:13.889491+0000","last_became_active":"2024-03-04T06:38:12.557397+0000","last_became_peered":"2024-03-04T06:38:12.557397+0000","last_unstale":"2024-03-04T06:38:13.889491+0000","last_undegraded":"2024-03-04T06:38:13.889491+0000","last_fullsized":"2024-03-04T06:38:13.889491+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.366465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888779+0000","last_change":"2024-03-04T06:38:12.556654+0000","last_active":"2024-03-04T06:38:13.888779+0000","last_peered":"2024-03-04T06:38:13.888779+0000","last_clean":"2024-03-04T06:38:13.888779+0000","last_became_active":"2024-03-04T06:38:12.556014+0000","last_became_peered":"2024-03-04T06:38:12.556014+0000","last_unstale":"2024-03-04T06:38:13.888779+0000","last_undegraded":"2024-03-04T06:38:13.888779+0000","last_fullsized":"2024-03-04T06:38:13.888779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:45.975559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889065+0000","last_change":"2024-03-04T06:38:12.558399+0000","last_active":"2024-03-04T06:38:13.889065+0000","last_peered":"2024-03-04T06:38:13.889065+0000","last_clean":"2024-03-04T06:38:13.889065+0000","last_became_active":"2024-03-04T06:38:12.558068+0000","last_became_peered":"2024-03-04T06:38:12.558068+0000","last_unstale":"2024-03-04T06:38:13.889065+0000","last_undegraded":"2024-03-04T06:38:13.889065+0000","last_fullsized":"2024-03-04T06:38:13.889065+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:00.895079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887826+0000","last_change":"2024-03-04T06:38:12.548200+0000","last_active":"2024-03-04T06:38:13.887826+0000","last_peered":"2024-03-04T06:38:13.887826+0000","last_clean":"2024-03-04T06:38:13.887826+0000","last_became_active":"2024-03-04T06:38:12.547906+0000","last_became_peered":"2024-03-04T06:38:12.547906+0000","last_unstale":"2024-03-04T06:38:13.887826+0000","last_undegraded":"2024-03-04T06:38:13.887826+0000","last_fullsized":"2024-03-04T06:38:13.887826+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:11:39.491360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889452+0000","last_change":"2024-03-04T06:38:12.918955+0000","last_active":"2024-03-04T06:38:13.889452+0000","last_peered":"2024-03-04T06:38:13.889452+0000","last_clean":"2024-03-04T06:38:13.889452+0000","last_became_active":"2024-03-04T06:38:12.918684+0000","last_became_peered":"2024-03-04T06:38:12.918684+0000","last_unstale":"2024-03-04T06:38:13.889452+0000","last_undegraded":"2024-03-04T06:38:13.889452+0000","last_fullsized":"2024-03-04T06:38:13.889452+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:47:29.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:11.515848+0000","last_change":"2024-03-04T06:38:11.515848+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.515848+0000","last_undegraded":"2024-03-04T06:38:11.515848+0000","last_fullsized":"2024-03-04T06:38:11.515848+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888468+0000","last_change":"2024-03-04T06:38:12.547376+0000","last_active":"2024-03-04T06:38:13.888468+0000","last_peered":"2024-03-04T06:38:13.888468+0000","last_clean":"2024-03-04T06:38:13.888468+0000","last_became_active":"2024-03-04T06:38:12.547108+0000","last_became_peered":"2024-03-04T06:38:12.547108+0000","last_unstale":"2024-03-04T06:38:13.888468+0000","last_undegraded":"2024-03-04T06:38:13.888468+0000","last_fullsized":"2024-03-04T06:38:13.888468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:34:14.300865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889848+0000","last_change":"2024-03-04T06:38:12.917263+0000","last_active":"2024-03-04T06:38:13.889848+0000","last_peered":"2024-03-04T06:38:13.889848+0000","last_clean":"2024-03-04T06:38:13.889848+0000","last_became_active":"2024-03-04T06:38:12.917001+0000","last_became_peered":"2024-03-04T06:38:12.917001+0000","last_unstale":"2024-03-04T06:38:13.889848+0000","last_undegraded":"2024-03-04T06:38:13.889848+0000","last_fullsized":"2024-03-04T06:38:13.889848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:54.912481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887725+0000","last_change":"2024-03-04T06:38:12.892619+0000","last_active":"2024-03-04T06:38:13.887725+0000","last_peered":"2024-03-04T06:38:13.887725+0000","last_clean":"2024-03-04T06:38:13.887725+0000","last_became_active":"2024-03-04T06:38:12.892261+0000","last_became_peered":"2024-03-04T06:38:12.892261+0000","last_unstale":"2024-03-04T06:38:13.887725+0000","last_undegraded":"2024-03-04T06:38:13.887725+0000","last_fullsized":"2024-03-04T06:38:13.887725+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:19:13.957414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":39,"acting":39,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":39,"acting":39,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28212,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716940,"statfs":{"total":95995035648,"available":95966146560,"internally_reserved":0,"allocated":1220608,"data_stored":850082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495626,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1167360,"data_stored":822922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717568,"statfs":{"total":95995035648,"available":95966789632,"internally_reserved":0,"allocated":573440,"data_stored":232554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:35 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.31900000000000001,"15min":0.313},"min":{"1min":0.254,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Mar 4 06:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.375,"15min":0.36399999999999999},"min":{"1min":0.32300000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33500000000000002}]},{"osd":3,"last update":"Mon Mar 4 06:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.37}]},{"osd":4,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.40100000000000002}]},{"osd":5,"last update":"Mon Mar 4 06:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716980,"statfs":{"total":95995035648,"available":95966187520,"internally_reserved":0,"allocated":1179648,"data_stored":829169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 4 06:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.27700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.28799999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.38700000000000001}]},{"osd":2,"last update":"Mon Mar 4 06:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.38800000000000001},"min":{"1min":0.30499999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57399999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63200000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.34000000000000002}]},{"osd":3,"last update":"Mon Mar 4 06:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.37},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.27200000000000002}]},{"osd":4,"last update":"Mon Mar 4 06:37:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411358,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717532,"statfs":{"total":95995035648,"available":95966752768,"internally_reserved":0,"allocated":610304,"data_stored":252711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.33700000000000002,"15min":0.32100000000000001},"min":{"1min":0.308,"5min":0.221,"15min":0.221},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.373,"15min":0.36299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.25800000000000001}]},{"osd":1,"last update":"Mon Mar 4 06:37:55 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.378,"15min":0.36599999999999999},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.32500000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.30299999999999999}]},{"osd":3,"last update":"Mon Mar 4 06:37:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.28899999999999998}]},{"osd":4,"last update":"Mon Mar 4 06:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60899999999999999}]},{"osd":5,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182425,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717564,"statfs":{"total":95995035648,"available":95966785536,"internally_reserved":0,"allocated":573440,"data_stored":232554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.254},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.375}]},{"osd":1,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.29999999999999999}]},{"osd":2,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Mar 4 06:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.45200000000000001}]},{"osd":5,"last update":"Mon Mar 4 06:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":4,"up_from":30,"seq":128849018900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717560,"statfs":{"total":95995035648,"available":95966781440,"internally_reserved":0,"allocated":585728,"data_stored":238801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42699999999999999}]},{"osd":1,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.377},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.38500000000000001}]},{"osd":5,"last update":"Mon Mar 4 06:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717576,"statfs":{"total":95995035648,"available":95966797824,"internally_reserved":0,"allocated":569344,"data_stored":232223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.30499999999999999}]},{"osd":2,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.496}]},{"osd":3,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":6.6180000000000003,"5min":6.6180000000000003,"15min":6.6180000000000003},"last":6.6180000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.443}]},{"osd":4,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:38:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-03-04T06:38:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-03-04T06:38:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-03-04T06:38:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-03-04T06:38:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-03-04T06:38:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-03-04T06:38:16.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-03-04T06:38:16.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-03-04T06:38:16.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-03-04T06:38:16.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-03-04T06:38:16.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-03-04T06:38:16.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-03-04T06:38:16.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-03-04T06:38:16.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-03-04T06:38:16.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-03-04T06:38:11.527764+0000', 'last_change': '2024-03-04T06:38:11.527764+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.527764+0000', 'last_undegraded': '2024-03-04T06:38:11.527764+0000', 'last_fullsized': '2024-03-04T06:38:11.527764+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-05T16:45:01.969570+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7, 4], 'acting': [0, 7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-04T06:38:16.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-03-04T06:38:16.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-03-04T06:38:16.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-03-04T06:38:16.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-03-04T06:38:16.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-03-04T06:38:16.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-03-04T06:38:16.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-03-04T06:38:16.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-03-04T06:38:16.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-03-04T06:38:16.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-03-04T06:38:16.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-03-04T06:38:16.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-03-04T06:38:16.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-03-04T06:38:16.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-03-04T06:38:16.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-03-04T06:38:16.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-03-04T06:38:16.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-03-04T06:38:16.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2024-03-04T06:38:16.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-03-04T06:38:16.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-03-04T06:38:16.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-03-04T06:38:16.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-03-04T06:38:11.526600+0000', 'last_change': '2024-03-04T06:38:11.526600+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.526600+0000', 'last_undegraded': '2024-03-04T06:38:11.526600+0000', 'last_fullsized': '2024-03-04T06:38:11.526600+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-05T11:21:00.773241+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4, 3], 'acting': [0, 4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-04T06:38:16.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-03-04T06:38:16.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-03-04T06:38:16.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-03-04T06:38:16.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-03-04T06:38:16.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-03-04T06:38:16.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-03-04T06:38:11.524636+0000', 'last_change': '2024-03-04T06:38:11.524636+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.524636+0000', 'last_undegraded': '2024-03-04T06:38:11.524636+0000', 'last_fullsized': '2024-03-04T06:38:11.524636+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-05T15:07:04.949081+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0, 7], 'acting': [4, 0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-04T06:38:16.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-03-04T06:38:16.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-03-04T06:38:16.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-03-04T06:38:16.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-03-04T06:38:16.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-03-04T06:38:16.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-03-04T06:38:16.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-03-04T06:38:16.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-03-04T06:38:16.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-03-04T06:38:16.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-03-04T06:38:16.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-03-04T06:38:16.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-03-04T06:38:16.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-03-04T06:38:16.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-03-04T06:38:16.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-03-04T06:38:16.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-03-04T06:38:16.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2024-03-04T06:38:16.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-03-04T06:38:16.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-03-04T06:38:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2024-03-04T06:38:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:11.515848+0000', 'last_change': '2024-03-04T06:38:11.515848+0000', 'last_active': '2024-03-04T06:38:11.515848+0000', 'last_peered': '2024-03-04T06:38:11.515848+0000', 'last_clean': '2024-03-04T06:38:11.515848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:11.515848+0000', 'last_undegraded': '2024-03-04T06:38:11.515848+0000', 'last_fullsized': '2024-03-04T06:38:11.515848+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:11.515848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-03-04T06:38:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-03-04T06:38:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-03-04T06:38:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-03-04T06:38:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-03-04T06:38:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-03-04T06:38:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-03-04T06:38:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-03-04T06:38:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-03-04T06:38:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-03-04T06:38:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-03-04T06:38:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-03-04T06:38:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-03-04T06:38:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T06:38:12.520695+0000', 'last_change': '2024-03-04T06:38:12.520695+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:38:12.520695+0000', 'last_undegraded': '2024-03-04T06:38:12.520695+0000', 'last_fullsized': '2024-03-04T06:38:12.520695+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T06:38:16.537 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-04T06:38:16.903 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:16.903 INFO:teuthology.orchestra.run.smithi137.stdout:{"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":226,"monmap":{"epoch":3,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1709534274,"num_in_osds":8,"osd_in_since":1709534257,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":70},{"state_name":"active+clean","count":24},{"state_name":"creating+peering","count":3}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":590368,"bytes_used":227844096,"bytes_avail":767732441088,"bytes_total":767960285184,"unknown_pgs_ratio":0.72164946794509888,"inactive_pgs_ratio":0.030927835032343864,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24352}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.137:8443/"}},"servicemap":{"epoch":11,"modified":"2024-03-04T06:38:06.981188+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-03-04T06:38:16.916 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-04T06:38:16.916 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T06:38:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:17.207 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:38:17.213 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:16 smithi137 ceph-mon[26846]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:17.213 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:16 smithi137 ceph-mon[37364]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:17.214 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-03-04T06:38:16.982778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592092,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":246,"acting":246,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":222728,"kb_used_data":6540,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":749738488,"statfs":{"total":767960285184,"available":767732211712,"internally_reserved":0,"allocated":6696960,"data_stored":3783420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1724,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.460814"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889794+0000","last_change":"2024-03-04T06:38:12.919238+0000","last_active":"2024-03-04T06:38:13.889794+0000","last_peered":"2024-03-04T06:38:13.889794+0000","last_clean":"2024-03-04T06:38:13.889794+0000","last_became_active":"2024-03-04T06:38:12.918941+0000","last_became_peered":"2024-03-04T06:38:12.918941+0000","last_unstale":"2024-03-04T06:38:13.889794+0000","last_undegraded":"2024-03-04T06:38:13.889794+0000","last_fullsized":"2024-03-04T06:38:13.889794+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:10:03.122262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.915161+0000","last_change":"2024-03-04T06:38:12.914740+0000","last_active":"2024-03-04T06:38:12.915161+0000","last_peered":"2024-03-04T06:38:12.915161+0000","last_clean":"2024-03-04T06:38:12.915161+0000","last_became_active":"2024-03-04T06:38:12.914436+0000","last_became_peered":"2024-03-04T06:38:12.914436+0000","last_unstale":"2024-03-04T06:38:12.915161+0000","last_undegraded":"2024-03-04T06:38:12.915161+0000","last_fullsized":"2024-03-04T06:38:12.915161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:58.781088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407489+0000","last_change":"2024-03-04T06:38:12.902256+0000","last_active":"2024-03-04T06:38:15.407489+0000","last_peered":"2024-03-04T06:38:15.407489+0000","last_clean":"2024-03-04T06:38:15.407489+0000","last_became_active":"2024-03-04T06:38:12.901792+0000","last_became_peered":"2024-03-04T06:38:12.901792+0000","last_unstale":"2024-03-04T06:38:15.407489+0000","last_undegraded":"2024-03-04T06:38:15.407489+0000","last_fullsized":"2024-03-04T06:38:15.407489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:45.163241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889213+0000","last_change":"2024-03-04T06:38:12.913797+0000","last_active":"2024-03-04T06:38:13.889213+0000","last_peered":"2024-03-04T06:38:13.889213+0000","last_clean":"2024-03-04T06:38:13.889213+0000","last_became_active":"2024-03-04T06:38:12.913517+0000","last_became_peered":"2024-03-04T06:38:12.913517+0000","last_unstale":"2024-03-04T06:38:13.889213+0000","last_undegraded":"2024-03-04T06:38:13.889213+0000","last_fullsized":"2024-03-04T06:38:13.889213+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:24.837813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407453+0000","last_change":"2024-03-04T06:38:12.904787+0000","last_active":"2024-03-04T06:38:15.407453+0000","last_peered":"2024-03-04T06:38:15.407453+0000","last_clean":"2024-03-04T06:38:15.407453+0000","last_became_active":"2024-03-04T06:38:12.904484+0000","last_became_peered":"2024-03-04T06:38:12.904484+0000","last_unstale":"2024-03-04T06:38:15.407453+0000","last_undegraded":"2024-03-04T06:38:15.407453+0000","last_fullsized":"2024-03-04T06:38:15.407453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:03:28.898688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888865+0000","last_change":"2024-03-04T06:38:12.913825+0000","last_active":"2024-03-04T06:38:13.888865+0000","last_peered":"2024-03-04T06:38:13.888865+0000","last_clean":"2024-03-04T06:38:13.888865+0000","last_became_active":"2024-03-04T06:38:12.913553+0000","last_became_peered":"2024-03-04T06:38:12.913553+0000","last_unstale":"2024-03-04T06:38:13.888865+0000","last_undegraded":"2024-03-04T06:38:13.888865+0000","last_fullsized":"2024-03-04T06:38:13.888865+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:23:17.322436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.406773+0000","last_change":"2024-03-04T06:38:12.902309+0000","last_active":"2024-03-04T06:38:15.406773+0000","last_peered":"2024-03-04T06:38:15.406773+0000","last_clean":"2024-03-04T06:38:15.406773+0000","last_became_active":"2024-03-04T06:38:12.902009+0000","last_became_peered":"2024-03-04T06:38:12.902009+0000","last_unstale":"2024-03-04T06:38:15.406773+0000","last_undegraded":"2024-03-04T06:38:15.406773+0000","last_fullsized":"2024-03-04T06:38:15.406773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:36:04.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889777+0000","last_change":"2024-03-04T06:38:12.916933+0000","last_active":"2024-03-04T06:38:13.889777+0000","last_peered":"2024-03-04T06:38:13.889777+0000","last_clean":"2024-03-04T06:38:13.889777+0000","last_became_active":"2024-03-04T06:38:12.913922+0000","last_became_peered":"2024-03-04T06:38:12.913922+0000","last_unstale":"2024-03-04T06:38:13.889777+0000","last_undegraded":"2024-03-04T06:38:13.889777+0000","last_fullsized":"2024-03-04T06:38:13.889777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:08:21.342061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.081175+0000","last_change":"2024-03-04T06:38:12.911185+0000","last_active":"2024-03-04T06:38:15.081175+0000","last_peered":"2024-03-04T06:38:15.081175+0000","last_clean":"2024-03-04T06:38:15.081175+0000","last_became_active":"2024-03-04T06:38:12.910906+0000","last_became_peered":"2024-03-04T06:38:12.910906+0000","last_unstale":"2024-03-04T06:38:15.081175+0000","last_undegraded":"2024-03-04T06:38:15.081175+0000","last_fullsized":"2024-03-04T06:38:15.081175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:45.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.081084+0000","last_change":"2024-03-04T06:38:12.916277+0000","last_active":"2024-03-04T06:38:15.081084+0000","last_peered":"2024-03-04T06:38:15.081084+0000","last_clean":"2024-03-04T06:38:15.081084+0000","last_became_active":"2024-03-04T06:38:12.915998+0000","last_became_peered":"2024-03-04T06:38:12.915998+0000","last_unstale":"2024-03-04T06:38:15.081084+0000","last_undegraded":"2024-03-04T06:38:15.081084+0000","last_fullsized":"2024-03-04T06:38:15.081084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:22:53.166929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407288+0000","last_change":"2024-03-04T06:38:12.897003+0000","last_active":"2024-03-04T06:38:15.407288+0000","last_peered":"2024-03-04T06:38:15.407288+0000","last_clean":"2024-03-04T06:38:15.407288+0000","last_became_active":"2024-03-04T06:38:12.896729+0000","last_became_peered":"2024-03-04T06:38:12.896729+0000","last_unstale":"2024-03-04T06:38:15.407288+0000","last_undegraded":"2024-03-04T06:38:15.407288+0000","last_fullsized":"2024-03-04T06:38:15.407288+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:01:03.497642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.909063+0000","last_change":"2024-03-04T06:38:12.907997+0000","last_active":"2024-03-04T06:38:12.909063+0000","last_peered":"2024-03-04T06:38:12.909063+0000","last_clean":"2024-03-04T06:38:12.909063+0000","last_became_active":"2024-03-04T06:38:12.907720+0000","last_became_peered":"2024-03-04T06:38:12.907720+0000","last_unstale":"2024-03-04T06:38:12.909063+0000","last_undegraded":"2024-03-04T06:38:12.909063+0000","last_fullsized":"2024-03-04T06:38:12.909063+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:46:55.140847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.406923+0000","last_change":"2024-03-04T06:38:12.899219+0000","last_active":"2024-03-04T06:38:15.406923+0000","last_peered":"2024-03-04T06:38:15.406923+0000","last_clean":"2024-03-04T06:38:15.406923+0000","last_became_active":"2024-03-04T06:38:12.898928+0000","last_became_peered":"2024-03-04T06:38:12.898928+0000","last_unstale":"2024-03-04T06:38:15.406923+0000","last_undegraded":"2024-03-04T06:38:15.406923+0000","last_fullsized":"2024-03-04T06:38:15.406923+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:13.412822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407624+0000","last_change":"2024-03-04T06:38:12.908332+0000","last_active":"2024-03-04T06:38:15.407624+0000","last_peered":"2024-03-04T06:38:15.407624+0000","last_clean":"2024-03-04T06:38:15.407624+0000","last_became_active":"2024-03-04T06:38:12.908038+0000","last_became_peered":"2024-03-04T06:38:12.908038+0000","last_unstale":"2024-03-04T06:38:15.407624+0000","last_undegraded":"2024-03-04T06:38:15.407624+0000","last_fullsized":"2024-03-04T06:38:15.407624+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:05:49.146138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888473+0000","last_change":"2024-03-04T06:38:12.899134+0000","last_active":"2024-03-04T06:38:13.888473+0000","last_peered":"2024-03-04T06:38:13.888473+0000","last_clean":"2024-03-04T06:38:13.888473+0000","last_became_active":"2024-03-04T06:38:12.898801+0000","last_became_peered":"2024-03-04T06:38:12.898801+0000","last_unstale":"2024-03-04T06:38:13.888473+0000","last_undegraded":"2024-03-04T06:38:13.888473+0000","last_fullsized":"2024-03-04T06:38:13.888473+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:21:48.465552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889197+0000","last_change":"2024-03-04T06:38:12.918000+0000","last_active":"2024-03-04T06:38:13.889197+0000","last_peered":"2024-03-04T06:38:13.889197+0000","last_clean":"2024-03-04T06:38:13.889197+0000","last_became_active":"2024-03-04T06:38:12.914159+0000","last_became_peered":"2024-03-04T06:38:12.914159+0000","last_unstale":"2024-03-04T06:38:13.889197+0000","last_undegraded":"2024-03-04T06:38:13.889197+0000","last_fullsized":"2024-03-04T06:38:13.889197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:24.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-03-04T06:38:11.527764+0000","last_change":"2024-03-04T06:38:11.527764+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.527764+0000","last_undegraded":"2024-03-04T06:38:11.527764+0000","last_fullsized":"2024-03-04T06:38:11.527764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:01.969570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407408+0000","last_change":"2024-03-04T06:38:12.896389+0000","last_active":"2024-03-04T06:38:15.407408+0000","last_peered":"2024-03-04T06:38:15.407408+0000","last_clean":"2024-03-04T06:38:15.407408+0000","last_became_active":"2024-03-04T06:38:12.896120+0000","last_became_peered":"2024-03-04T06:38:12.896120+0000","last_unstale":"2024-03-04T06:38:15.407408+0000","last_undegraded":"2024-03-04T06:38:15.407408+0000","last_fullsized":"2024-03-04T06:38:15.407408+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:57.729499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"61'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407220+0000","last_change":"2024-03-04T06:38:12.550800+0000","last_active":"2024-03-04T06:38:15.407220+0000","last_peered":"2024-03-04T06:38:15.407220+0000","last_clean":"2024-03-04T06:38:15.407220+0000","last_became_active":"2024-03-04T06:38:12.550444+0000","last_became_peered":"2024-03-04T06:38:12.550444+0000","last_unstale":"2024-03-04T06:38:15.407220+0000","last_undegraded":"2024-03-04T06:38:15.407220+0000","last_fullsized":"2024-03-04T06:38:15.407220+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:42.209194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889631+0000","last_change":"2024-03-04T06:38:12.557057+0000","last_active":"2024-03-04T06:38:13.889631+0000","last_peered":"2024-03-04T06:38:13.889631+0000","last_clean":"2024-03-04T06:38:13.889631+0000","last_became_active":"2024-03-04T06:38:12.556733+0000","last_became_peered":"2024-03-04T06:38:12.556733+0000","last_unstale":"2024-03-04T06:38:13.889631+0000","last_undegraded":"2024-03-04T06:38:13.889631+0000","last_fullsized":"2024-03-04T06:38:13.889631+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:15.847471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407644+0000","last_change":"2024-03-04T06:38:12.907223+0000","last_active":"2024-03-04T06:38:15.407644+0000","last_peered":"2024-03-04T06:38:15.407644+0000","last_clean":"2024-03-04T06:38:15.407644+0000","last_became_active":"2024-03-04T06:38:12.906911+0000","last_became_peered":"2024-03-04T06:38:12.906911+0000","last_unstale":"2024-03-04T06:38:15.407644+0000","last_undegraded":"2024-03-04T06:38:15.407644+0000","last_fullsized":"2024-03-04T06:38:15.407644+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:29.474153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889309+0000","last_change":"2024-03-04T06:38:12.556246+0000","last_active":"2024-03-04T06:38:13.889309+0000","last_peered":"2024-03-04T06:38:13.889309+0000","last_clean":"2024-03-04T06:38:13.889309+0000","last_became_active":"2024-03-04T06:38:12.555860+0000","last_became_peered":"2024-03-04T06:38:12.555860+0000","last_unstale":"2024-03-04T06:38:13.889309+0000","last_undegraded":"2024-03-04T06:38:13.889309+0000","last_fullsized":"2024-03-04T06:38:13.889309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:41.910480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407434+0000","last_change":"2024-03-04T06:38:12.906907+0000","last_active":"2024-03-04T06:38:15.407434+0000","last_peered":"2024-03-04T06:38:15.407434+0000","last_clean":"2024-03-04T06:38:15.407434+0000","last_became_active":"2024-03-04T06:38:12.906615+0000","last_became_peered":"2024-03-04T06:38:12.906615+0000","last_unstale":"2024-03-04T06:38:15.407434+0000","last_undegraded":"2024-03-04T06:38:15.407434+0000","last_fullsized":"2024-03-04T06:38:15.407434+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:21:15.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"61'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407782+0000","last_change":"2024-03-04T06:38:12.546234+0000","last_active":"2024-03-04T06:38:15.407782+0000","last_peered":"2024-03-04T06:38:15.407782+0000","last_clean":"2024-03-04T06:38:15.407782+0000","last_became_active":"2024-03-04T06:38:12.545975+0000","last_became_peered":"2024-03-04T06:38:12.545975+0000","last_unstale":"2024-03-04T06:38:15.407782+0000","last_undegraded":"2024-03-04T06:38:15.407782+0000","last_fullsized":"2024-03-04T06:38:15.407782+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:04.341190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.080840+0000","last_change":"2024-03-04T06:38:12.554332+0000","last_active":"2024-03-04T06:38:15.080840+0000","last_peered":"2024-03-04T06:38:15.080840+0000","last_clean":"2024-03-04T06:38:15.080840+0000","last_became_active":"2024-03-04T06:38:12.554044+0000","last_became_peered":"2024-03-04T06:38:12.554044+0000","last_unstale":"2024-03-04T06:38:15.080840+0000","last_undegraded":"2024-03-04T06:38:15.080840+0000","last_fullsized":"2024-03-04T06:38:15.080840+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:28:40.250342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407591+0000","last_change":"2024-03-04T06:38:12.543180+0000","last_active":"2024-03-04T06:38:15.407591+0000","last_peered":"2024-03-04T06:38:15.407591+0000","last_clean":"2024-03-04T06:38:15.407591+0000","last_became_active":"2024-03-04T06:38:12.542896+0000","last_became_peered":"2024-03-04T06:38:12.542896+0000","last_unstale":"2024-03-04T06:38:15.407591+0000","last_undegraded":"2024-03-04T06:38:15.407591+0000","last_fullsized":"2024-03-04T06:38:15.407591+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:15:09.816539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.406884+0000","last_change":"2024-03-04T06:38:12.895735+0000","last_active":"2024-03-04T06:38:15.406884+0000","last_peered":"2024-03-04T06:38:15.406884+0000","last_clean":"2024-03-04T06:38:15.406884+0000","last_became_active":"2024-03-04T06:38:12.895201+0000","last_became_peered":"2024-03-04T06:38:12.895201+0000","last_unstale":"2024-03-04T06:38:15.406884+0000","last_undegraded":"2024-03-04T06:38:15.406884+0000","last_fullsized":"2024-03-04T06:38:15.406884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:12:35.373175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.406999+0000","last_change":"2024-03-04T06:38:12.551089+0000","last_active":"2024-03-04T06:38:15.406999+0000","last_peered":"2024-03-04T06:38:15.406999+0000","last_clean":"2024-03-04T06:38:15.406999+0000","last_became_active":"2024-03-04T06:38:12.550791+0000","last_became_peered":"2024-03-04T06:38:12.550791+0000","last_unstale":"2024-03-04T06:38:15.406999+0000","last_undegraded":"2024-03-04T06:38:15.406999+0000","last_fullsized":"2024-03-04T06:38:15.406999+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:49.576267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.911990+0000","last_change":"2024-03-04T06:38:12.909194+0000","last_active":"2024-03-04T06:38:12.911990+0000","last_peered":"2024-03-04T06:38:12.911990+0000","last_clean":"2024-03-04T06:38:12.911990+0000","last_became_active":"2024-03-04T06:38:12.908879+0000","last_became_peered":"2024-03-04T06:38:12.908879+0000","last_unstale":"2024-03-04T06:38:12.911990+0000","last_undegraded":"2024-03-04T06:38:12.911990+0000","last_fullsized":"2024-03-04T06:38:12.911990+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:23.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.081282+0000","last_change":"2024-03-04T06:38:12.544023+0000","last_active":"2024-03-04T06:38:15.081282+0000","last_peered":"2024-03-04T06:38:15.081282+0000","last_clean":"2024-03-04T06:38:15.081282+0000","last_became_active":"2024-03-04T06:38:12.543699+0000","last_became_peered":"2024-03-04T06:38:12.543699+0000","last_unstale":"2024-03-04T06:38:15.081282+0000","last_undegraded":"2024-03-04T06:38:15.081282+0000","last_fullsized":"2024-03-04T06:38:15.081282+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:19.418372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407428+0000","last_change":"2024-03-04T06:38:12.903510+0000","last_active":"2024-03-04T06:38:15.407428+0000","last_peered":"2024-03-04T06:38:15.407428+0000","last_clean":"2024-03-04T06:38:15.407428+0000","last_became_active":"2024-03-04T06:38:12.903226+0000","last_became_peered":"2024-03-04T06:38:12.903226+0000","last_unstale":"2024-03-04T06:38:15.407428+0000","last_undegraded":"2024-03-04T06:38:15.407428+0000","last_fullsized":"2024-03-04T06:38:15.407428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:49:29.474747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407368+0000","last_change":"2024-03-04T06:38:12.550879+0000","last_active":"2024-03-04T06:38:15.407368+0000","last_peered":"2024-03-04T06:38:15.407368+0000","last_clean":"2024-03-04T06:38:15.407368+0000","last_became_active":"2024-03-04T06:38:12.549931+0000","last_became_peered":"2024-03-04T06:38:12.549931+0000","last_unstale":"2024-03-04T06:38:15.407368+0000","last_undegraded":"2024-03-04T06:38:15.407368+0000","last_fullsized":"2024-03-04T06:38:15.407368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:33.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.908729+0000","last_change":"2024-03-04T06:38:12.551496+0000","last_active":"2024-03-04T06:38:12.908729+0000","last_peered":"2024-03-04T06:38:12.908729+0000","last_clean":"2024-03-04T06:38:12.908729+0000","last_became_active":"2024-03-04T06:38:12.551202+0000","last_became_peered":"2024-03-04T06:38:12.551202+0000","last_unstale":"2024-03-04T06:38:12.908729+0000","last_undegraded":"2024-03-04T06:38:12.908729+0000","last_fullsized":"2024-03-04T06:38:12.908729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:19.526762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"61'6","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.080905+0000","last_change":"2024-03-04T06:38:12.546352+0000","last_active":"2024-03-04T06:38:15.080905+0000","last_peered":"2024-03-04T06:38:15.080905+0000","last_clean":"2024-03-04T06:38:15.080905+0000","last_became_active":"2024-03-04T06:38:12.545863+0000","last_became_peered":"2024-03-04T06:38:12.545863+0000","last_unstale":"2024-03-04T06:38:15.080905+0000","last_undegraded":"2024-03-04T06:38:15.080905+0000","last_fullsized":"2024-03-04T06:38:15.080905+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:08.181131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889396+0000","last_change":"2024-03-04T06:38:12.919415+0000","last_active":"2024-03-04T06:38:13.889396+0000","last_peered":"2024-03-04T06:38:13.889396+0000","last_clean":"2024-03-04T06:38:13.889396+0000","last_became_active":"2024-03-04T06:38:12.918269+0000","last_became_peered":"2024-03-04T06:38:12.918269+0000","last_unstale":"2024-03-04T06:38:13.889396+0000","last_undegraded":"2024-03-04T06:38:13.889396+0000","last_fullsized":"2024-03-04T06:38:13.889396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:26:56.067995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-03-04T06:38:11.526600+0000","last_change":"2024-03-04T06:38:11.526600+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.526600+0000","last_undegraded":"2024-03-04T06:38:11.526600+0000","last_fullsized":"2024-03-04T06:38:11.526600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:21:00.773241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407057+0000","last_change":"2024-03-04T06:38:12.549608+0000","last_active":"2024-03-04T06:38:15.407057+0000","last_peered":"2024-03-04T06:38:15.407057+0000","last_clean":"2024-03-04T06:38:15.407057+0000","last_became_active":"2024-03-04T06:38:12.549299+0000","last_became_peered":"2024-03-04T06:38:12.549299+0000","last_unstale":"2024-03-04T06:38:15.407057+0000","last_undegraded":"2024-03-04T06:38:15.407057+0000","last_fullsized":"2024-03-04T06:38:15.407057+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:12:23.543702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889084+0000","last_change":"2024-03-04T06:38:12.913767+0000","last_active":"2024-03-04T06:38:13.889084+0000","last_peered":"2024-03-04T06:38:13.889084+0000","last_clean":"2024-03-04T06:38:13.889084+0000","last_became_active":"2024-03-04T06:38:12.913476+0000","last_became_peered":"2024-03-04T06:38:12.913476+0000","last_unstale":"2024-03-04T06:38:13.889084+0000","last_undegraded":"2024-03-04T06:38:13.889084+0000","last_fullsized":"2024-03-04T06:38:13.889084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:44:53.483514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.080514+0000","last_change":"2024-03-04T06:38:12.549514+0000","last_active":"2024-03-04T06:38:15.080514+0000","last_peered":"2024-03-04T06:38:15.080514+0000","last_clean":"2024-03-04T06:38:15.080514+0000","last_became_active":"2024-03-04T06:38:12.549222+0000","last_became_peered":"2024-03-04T06:38:12.549222+0000","last_unstale":"2024-03-04T06:38:15.080514+0000","last_undegraded":"2024-03-04T06:38:15.080514+0000","last_fullsized":"2024-03-04T06:38:15.080514+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:54:24.051519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.080747+0000","last_change":"2024-03-04T06:38:12.909428+0000","last_active":"2024-03-04T06:38:15.080747+0000","last_peered":"2024-03-04T06:38:15.080747+0000","last_clean":"2024-03-04T06:38:15.080747+0000","last_became_active":"2024-03-04T06:38:12.909146+0000","last_became_peered":"2024-03-04T06:38:12.909146+0000","last_unstale":"2024-03-04T06:38:15.080747+0000","last_undegraded":"2024-03-04T06:38:15.080747+0000","last_fullsized":"2024-03-04T06:38:15.080747+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:44.391084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887301+0000","last_change":"2024-03-04T06:38:12.544896+0000","last_active":"2024-03-04T06:38:13.887301+0000","last_peered":"2024-03-04T06:38:13.887301+0000","last_clean":"2024-03-04T06:38:13.887301+0000","last_became_active":"2024-03-04T06:38:12.543579+0000","last_became_peered":"2024-03-04T06:38:12.543579+0000","last_unstale":"2024-03-04T06:38:13.887301+0000","last_undegraded":"2024-03-04T06:38:13.887301+0000","last_fullsized":"2024-03-04T06:38:13.887301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:39.451118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888937+0000","last_change":"2024-03-04T06:38:12.919018+0000","last_active":"2024-03-04T06:38:13.888937+0000","last_peered":"2024-03-04T06:38:13.888937+0000","last_clean":"2024-03-04T06:38:13.888937+0000","last_became_active":"2024-03-04T06:38:12.918716+0000","last_became_peered":"2024-03-04T06:38:12.918716+0000","last_unstale":"2024-03-04T06:38:13.888937+0000","last_undegraded":"2024-03-04T06:38:13.888937+0000","last_fullsized":"2024-03-04T06:38:13.888937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:06:47.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-03-04T06:38:11.524636+0000","last_change":"2024-03-04T06:38:11.524636+0000","last_active":"2024-03-04T06:38:11.515848+0000","last_peered":"2024-03-04T06:38:11.515848+0000","last_clean":"2024-03-04T06:38:11.515848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:11.524636+0000","last_undegraded":"2024-03-04T06:38:11.524636+0000","last_fullsized":"2024-03-04T06:38:11.524636+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:04.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889815+0000","last_change":"2024-03-04T06:38:12.913566+0000","last_active":"2024-03-04T06:38:13.889815+0000","last_peered":"2024-03-04T06:38:13.889815+0000","last_clean":"2024-03-04T06:38:13.889815+0000","last_became_active":"2024-03-04T06:38:12.910660+0000","last_became_peered":"2024-03-04T06:38:12.910660+0000","last_unstale":"2024-03-04T06:38:13.889815+0000","last_undegraded":"2024-03-04T06:38:13.889815+0000","last_fullsized":"2024-03-04T06:38:13.889815+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:16:42.862745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.894002+0000","last_change":"2024-03-04T06:38:12.554795+0000","last_active":"2024-03-04T06:38:12.894002+0000","last_peered":"2024-03-04T06:38:12.894002+0000","last_clean":"2024-03-04T06:38:12.894002+0000","last_became_active":"2024-03-04T06:38:12.554461+0000","last_became_peered":"2024-03-04T06:38:12.554461+0000","last_unstale":"2024-03-04T06:38:12.894002+0000","last_undegraded":"2024-03-04T06:38:12.894002+0000","last_fullsized":"2024-03-04T06:38:12.894002+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:03:44.989709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407470+0000","last_change":"2024-03-04T06:38:12.897411+0000","last_active":"2024-03-04T06:38:15.407470+0000","last_peered":"2024-03-04T06:38:15.407470+0000","last_clean":"2024-03-04T06:38:15.407470+0000","last_became_active":"2024-03-04T06:38:12.896742+0000","last_became_peered":"2024-03-04T06:38:12.896742+0000","last_unstale":"2024-03-04T06:38:15.407470+0000","last_undegraded":"2024-03-04T06:38:15.407470+0000","last_fullsized":"2024-03-04T06:38:15.407470+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:14:21.032038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407036+0000","last_change":"2024-03-04T06:38:12.548860+0000","last_active":"2024-03-04T06:38:15.407036+0000","last_peered":"2024-03-04T06:38:15.407036+0000","last_clean":"2024-03-04T06:38:15.407036+0000","last_became_active":"2024-03-04T06:38:12.548550+0000","last_became_peered":"2024-03-04T06:38:12.548550+0000","last_unstale":"2024-03-04T06:38:15.407036+0000","last_undegraded":"2024-03-04T06:38:15.407036+0000","last_fullsized":"2024-03-04T06:38:15.407036+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:47:43.188556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.914724+0000","last_change":"2024-03-04T06:38:12.914172+0000","last_active":"2024-03-04T06:38:12.914724+0000","last_peered":"2024-03-04T06:38:12.914724+0000","last_clean":"2024-03-04T06:38:12.914724+0000","last_became_active":"2024-03-04T06:38:12.913896+0000","last_became_peered":"2024-03-04T06:38:12.913896+0000","last_unstale":"2024-03-04T06:38:12.914724+0000","last_undegraded":"2024-03-04T06:38:12.914724+0000","last_fullsized":"2024-03-04T06:38:12.914724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:53.141176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887360+0000","last_change":"2024-03-04T06:38:12.540510+0000","last_active":"2024-03-04T06:38:13.887360+0000","last_peered":"2024-03-04T06:38:13.887360+0000","last_clean":"2024-03-04T06:38:13.887360+0000","last_became_active":"2024-03-04T06:38:12.540155+0000","last_became_peered":"2024-03-04T06:38:12.540155+0000","last_unstale":"2024-03-04T06:38:13.887360+0000","last_undegraded":"2024-03-04T06:38:13.887360+0000","last_fullsized":"2024-03-04T06:38:13.887360+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:39.660282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407172+0000","last_change":"2024-03-04T06:38:12.903488+0000","last_active":"2024-03-04T06:38:15.407172+0000","last_peered":"2024-03-04T06:38:15.407172+0000","last_clean":"2024-03-04T06:38:15.407172+0000","last_became_active":"2024-03-04T06:38:12.903235+0000","last_became_peered":"2024-03-04T06:38:12.903235+0000","last_unstale":"2024-03-04T06:38:15.407172+0000","last_undegraded":"2024-03-04T06:38:15.407172+0000","last_fullsized":"2024-03-04T06:38:15.407172+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:43.099957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407160+0000","last_change":"2024-03-04T06:38:12.550672+0000","last_active":"2024-03-04T06:38:15.407160+0000","last_peered":"2024-03-04T06:38:15.407160+0000","last_clean":"2024-03-04T06:38:15.407160+0000","last_became_active":"2024-03-04T06:38:12.550367+0000","last_became_peered":"2024-03-04T06:38:12.550367+0000","last_unstale":"2024-03-04T06:38:15.407160+0000","last_undegraded":"2024-03-04T06:38:15.407160+0000","last_fullsized":"2024-03-04T06:38:15.407160+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:57:27.060139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"21'117","reported_seq":218,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.894459+0000","last_change":"2024-03-04T06:37:58.310255+0000","last_active":"2024-03-04T06:38:12.894459+0000","last_peered":"2024-03-04T06:38:12.894459+0000","last_clean":"2024-03-04T06:38:12.894459+0000","last_became_active":"2024-03-04T06:37:58.309800+0000","last_became_peered":"2024-03-04T06:37:58.309800+0000","last_unstale":"2024-03-04T06:38:12.894459+0000","last_undegraded":"2024-03-04T06:38:12.894459+0000","last_fullsized":"2024-03-04T06:38:12.894459+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:38.185918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888963+0000","last_change":"2024-03-04T06:38:12.556986+0000","last_active":"2024-03-04T06:38:13.888963+0000","last_peered":"2024-03-04T06:38:13.888963+0000","last_clean":"2024-03-04T06:38:13.888963+0000","last_became_active":"2024-03-04T06:38:12.556594+0000","last_became_peered":"2024-03-04T06:38:12.556594+0000","last_unstale":"2024-03-04T06:38:13.888963+0000","last_undegraded":"2024-03-04T06:38:13.888963+0000","last_fullsized":"2024-03-04T06:38:13.888963+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:52.669745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889491+0000","last_change":"2024-03-04T06:38:12.557967+0000","last_active":"2024-03-04T06:38:13.889491+0000","last_peered":"2024-03-04T06:38:13.889491+0000","last_clean":"2024-03-04T06:38:13.889491+0000","last_became_active":"2024-03-04T06:38:12.557397+0000","last_became_peered":"2024-03-04T06:38:12.557397+0000","last_unstale":"2024-03-04T06:38:13.889491+0000","last_undegraded":"2024-03-04T06:38:13.889491+0000","last_fullsized":"2024-03-04T06:38:13.889491+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.366465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.906403+0000","last_change":"2024-03-04T06:38:12.905517+0000","last_active":"2024-03-04T06:38:12.906403+0000","last_peered":"2024-03-04T06:38:12.906403+0000","last_clean":"2024-03-04T06:38:12.906403+0000","last_became_active":"2024-03-04T06:38:12.905234+0000","last_became_peered":"2024-03-04T06:38:12.905234+0000","last_unstale":"2024-03-04T06:38:12.906403+0000","last_undegraded":"2024-03-04T06:38:12.906403+0000","last_fullsized":"2024-03-04T06:38:12.906403+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:32:58.487468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.896097+0000","last_change":"2024-03-04T06:38:12.542943+0000","last_active":"2024-03-04T06:38:12.896097+0000","last_peered":"2024-03-04T06:38:12.896097+0000","last_clean":"2024-03-04T06:38:12.896097+0000","last_became_active":"2024-03-04T06:38:12.542663+0000","last_became_peered":"2024-03-04T06:38:12.542663+0000","last_unstale":"2024-03-04T06:38:12.896097+0000","last_undegraded":"2024-03-04T06:38:12.896097+0000","last_fullsized":"2024-03-04T06:38:12.896097+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:11.583290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407622+0000","last_change":"2024-03-04T06:38:12.898034+0000","last_active":"2024-03-04T06:38:15.407622+0000","last_peered":"2024-03-04T06:38:15.407622+0000","last_clean":"2024-03-04T06:38:15.407622+0000","last_became_active":"2024-03-04T06:38:12.897766+0000","last_became_peered":"2024-03-04T06:38:12.897766+0000","last_unstale":"2024-03-04T06:38:15.407622+0000","last_undegraded":"2024-03-04T06:38:15.407622+0000","last_fullsized":"2024-03-04T06:38:15.407622+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:56.085588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.081184+0000","last_change":"2024-03-04T06:38:12.554846+0000","last_active":"2024-03-04T06:38:15.081184+0000","last_peered":"2024-03-04T06:38:15.081184+0000","last_clean":"2024-03-04T06:38:15.081184+0000","last_became_active":"2024-03-04T06:38:12.554544+0000","last_became_peered":"2024-03-04T06:38:12.554544+0000","last_unstale":"2024-03-04T06:38:15.081184+0000","last_undegraded":"2024-03-04T06:38:15.081184+0000","last_fullsized":"2024-03-04T06:38:15.081184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:44.524183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888779+0000","last_change":"2024-03-04T06:38:12.556654+0000","last_active":"2024-03-04T06:38:13.888779+0000","last_peered":"2024-03-04T06:38:13.888779+0000","last_clean":"2024-03-04T06:38:13.888779+0000","last_became_active":"2024-03-04T06:38:12.556014+0000","last_became_peered":"2024-03-04T06:38:12.556014+0000","last_unstale":"2024-03-04T06:38:13.888779+0000","last_undegraded":"2024-03-04T06:38:13.888779+0000","last_fullsized":"2024-03-04T06:38:13.888779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:45.975559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.892560+0000","last_change":"2024-03-04T06:38:12.555463+0000","last_active":"2024-03-04T06:38:12.892560+0000","last_peered":"2024-03-04T06:38:12.892560+0000","last_clean":"2024-03-04T06:38:12.892560+0000","last_became_active":"2024-03-04T06:38:12.555150+0000","last_became_peered":"2024-03-04T06:38:12.555150+0000","last_unstale":"2024-03-04T06:38:12.892560+0000","last_undegraded":"2024-03-04T06:38:12.892560+0000","last_fullsized":"2024-03-04T06:38:12.892560+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:30.714863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.406835+0000","last_change":"2024-03-04T06:38:12.897860+0000","last_active":"2024-03-04T06:38:15.406835+0000","last_peered":"2024-03-04T06:38:15.406835+0000","last_clean":"2024-03-04T06:38:15.406835+0000","last_became_active":"2024-03-04T06:38:12.897568+0000","last_became_peered":"2024-03-04T06:38:12.897568+0000","last_unstale":"2024-03-04T06:38:15.406835+0000","last_undegraded":"2024-03-04T06:38:15.406835+0000","last_fullsized":"2024-03-04T06:38:15.406835+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:22:30.116519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.894505+0000","last_change":"2024-03-04T06:38:12.556223+0000","last_active":"2024-03-04T06:38:12.894505+0000","last_peered":"2024-03-04T06:38:12.894505+0000","last_clean":"2024-03-04T06:38:12.894505+0000","last_became_active":"2024-03-04T06:38:12.555948+0000","last_became_peered":"2024-03-04T06:38:12.555948+0000","last_unstale":"2024-03-04T06:38:12.894505+0000","last_undegraded":"2024-03-04T06:38:12.894505+0000","last_fullsized":"2024-03-04T06:38:12.894505+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:19:51.659542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407827+0000","last_change":"2024-03-04T06:38:12.908686+0000","last_active":"2024-03-04T06:38:15.407827+0000","last_peered":"2024-03-04T06:38:15.407827+0000","last_clean":"2024-03-04T06:38:15.407827+0000","last_became_active":"2024-03-04T06:38:12.907114+0000","last_became_peered":"2024-03-04T06:38:12.907114+0000","last_unstale":"2024-03-04T06:38:15.407827+0000","last_undegraded":"2024-03-04T06:38:15.407827+0000","last_fullsized":"2024-03-04T06:38:15.407827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:08:03.009115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889065+0000","last_change":"2024-03-04T06:38:12.558399+0000","last_active":"2024-03-04T06:38:13.889065+0000","last_peered":"2024-03-04T06:38:13.889065+0000","last_clean":"2024-03-04T06:38:13.889065+0000","last_became_active":"2024-03-04T06:38:12.558068+0000","last_became_peered":"2024-03-04T06:38:12.558068+0000","last_unstale":"2024-03-04T06:38:13.889065+0000","last_undegraded":"2024-03-04T06:38:13.889065+0000","last_fullsized":"2024-03-04T06:38:13.889065+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:00.895079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.080878+0000","last_change":"2024-03-04T06:38:12.904212+0000","last_active":"2024-03-04T06:38:15.080878+0000","last_peered":"2024-03-04T06:38:15.080878+0000","last_clean":"2024-03-04T06:38:15.080878+0000","last_became_active":"2024-03-04T06:38:12.903906+0000","last_became_peered":"2024-03-04T06:38:12.903906+0000","last_unstale":"2024-03-04T06:38:15.080878+0000","last_undegraded":"2024-03-04T06:38:15.080878+0000","last_fullsized":"2024-03-04T06:38:15.080878+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:27:10.766546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887826+0000","last_change":"2024-03-04T06:38:12.548200+0000","last_active":"2024-03-04T06:38:13.887826+0000","last_peered":"2024-03-04T06:38:13.887826+0000","last_clean":"2024-03-04T06:38:13.887826+0000","last_became_active":"2024-03-04T06:38:12.547906+0000","last_became_peered":"2024-03-04T06:38:12.547906+0000","last_unstale":"2024-03-04T06:38:13.887826+0000","last_undegraded":"2024-03-04T06:38:13.887826+0000","last_fullsized":"2024-03-04T06:38:13.887826+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:11:39.491360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889452+0000","last_change":"2024-03-04T06:38:12.918955+0000","last_active":"2024-03-04T06:38:13.889452+0000","last_peered":"2024-03-04T06:38:13.889452+0000","last_clean":"2024-03-04T06:38:13.889452+0000","last_became_active":"2024-03-04T06:38:12.918684+0000","last_became_peered":"2024-03-04T06:38:12.918684+0000","last_unstale":"2024-03-04T06:38:13.889452+0000","last_undegraded":"2024-03-04T06:38:13.889452+0000","last_fullsized":"2024-03-04T06:38:13.889452+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:47:29.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.908932+0000","last_change":"2024-03-04T06:38:12.547660+0000","last_active":"2024-03-04T06:38:12.908932+0000","last_peered":"2024-03-04T06:38:12.908932+0000","last_clean":"2024-03-04T06:38:12.908932+0000","last_became_active":"2024-03-04T06:38:12.547358+0000","last_became_peered":"2024-03-04T06:38:12.547358+0000","last_unstale":"2024-03-04T06:38:12.908932+0000","last_undegraded":"2024-03-04T06:38:12.908932+0000","last_fullsized":"2024-03-04T06:38:12.908932+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:10.370020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407342+0000","last_change":"2024-03-04T06:38:12.902066+0000","last_active":"2024-03-04T06:38:15.407342+0000","last_peered":"2024-03-04T06:38:15.407342+0000","last_clean":"2024-03-04T06:38:15.407342+0000","last_became_active":"2024-03-04T06:38:12.901331+0000","last_became_peered":"2024-03-04T06:38:12.901331+0000","last_unstale":"2024-03-04T06:38:15.407342+0000","last_undegraded":"2024-03-04T06:38:15.407342+0000","last_fullsized":"2024-03-04T06:38:15.407342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:46:51.413734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888468+0000","last_change":"2024-03-04T06:38:12.547376+0000","last_active":"2024-03-04T06:38:13.888468+0000","last_peered":"2024-03-04T06:38:13.888468+0000","last_clean":"2024-03-04T06:38:13.888468+0000","last_became_active":"2024-03-04T06:38:12.547108+0000","last_became_peered":"2024-03-04T06:38:12.547108+0000","last_unstale":"2024-03-04T06:38:13.888468+0000","last_undegraded":"2024-03-04T06:38:13.888468+0000","last_fullsized":"2024-03-04T06:38:13.888468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:34:14.300865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889848+0000","last_change":"2024-03-04T06:38:12.917263+0000","last_active":"2024-03-04T06:38:13.889848+0000","last_peered":"2024-03-04T06:38:13.889848+0000","last_clean":"2024-03-04T06:38:13.889848+0000","last_became_active":"2024-03-04T06:38:12.917001+0000","last_became_peered":"2024-03-04T06:38:12.917001+0000","last_unstale":"2024-03-04T06:38:13.889848+0000","last_undegraded":"2024-03-04T06:38:13.889848+0000","last_fullsized":"2024-03-04T06:38:13.889848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:54.912481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.080699+0000","last_change":"2024-03-04T06:38:12.916968+0000","last_active":"2024-03-04T06:38:15.080699+0000","last_peered":"2024-03-04T06:38:15.080699+0000","last_clean":"2024-03-04T06:38:15.080699+0000","last_became_active":"2024-03-04T06:38:12.916669+0000","last_became_peered":"2024-03-04T06:38:12.916669+0000","last_unstale":"2024-03-04T06:38:15.080699+0000","last_undegraded":"2024-03-04T06:38:15.080699+0000","last_fullsized":"2024-03-04T06:38:15.080699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:18:16.919063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887725+0000","last_change":"2024-03-04T06:38:12.892619+0000","last_active":"2024-03-04T06:38:13.887725+0000","last_peered":"2024-03-04T06:38:13.887725+0000","last_clean":"2024-03-04T06:38:13.887725+0000","last_became_active":"2024-03-04T06:38:12.892261+0000","last_became_peered":"2024-03-04T06:38:12.892261+0000","last_unstale":"2024-03-04T06:38:13.887725+0000","last_undegraded":"2024-03-04T06:38:13.887725+0000","last_fullsized":"2024-03-04T06:38:13.887725+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:19:13.957414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407319+0000","last_change":"2024-03-04T06:38:12.899301+0000","last_active":"2024-03-04T06:38:15.407319+0000","last_peered":"2024-03-04T06:38:15.407319+0000","last_clean":"2024-03-04T06:38:15.407319+0000","last_became_active":"2024-03-04T06:38:12.898002+0000","last_became_peered":"2024-03-04T06:38:12.898002+0000","last_unstale":"2024-03-04T06:38:15.407319+0000","last_undegraded":"2024-03-04T06:38:15.407319+0000","last_fullsized":"2024-03-04T06:38:15.407319+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:46.969732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407709+0000","last_change":"2024-03-04T06:38:12.906536+0000","last_active":"2024-03-04T06:38:15.407709+0000","last_peered":"2024-03-04T06:38:15.407709+0000","last_clean":"2024-03-04T06:38:15.407709+0000","last_became_active":"2024-03-04T06:38:12.906183+0000","last_became_peered":"2024-03-04T06:38:12.906183+0000","last_unstale":"2024-03-04T06:38:15.407709+0000","last_undegraded":"2024-03-04T06:38:15.407709+0000","last_fullsized":"2024-03-04T06:38:15.407709+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:15:13.559021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.900563+0000","last_change":"2024-03-04T06:38:12.899871+0000","last_active":"2024-03-04T06:38:12.900563+0000","last_peered":"2024-03-04T06:38:12.900563+0000","last_clean":"2024-03-04T06:38:12.900563+0000","last_became_active":"2024-03-04T06:38:12.899583+0000","last_became_peered":"2024-03-04T06:38:12.899583+0000","last_unstale":"2024-03-04T06:38:12.900563+0000","last_undegraded":"2024-03-04T06:38:12.900563+0000","last_fullsized":"2024-03-04T06:38:12.900563+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:51.628806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.081246+0000","last_change":"2024-03-04T06:38:12.914660+0000","last_active":"2024-03-04T06:38:15.081246+0000","last_peered":"2024-03-04T06:38:15.081246+0000","last_clean":"2024-03-04T06:38:15.081246+0000","last_became_active":"2024-03-04T06:38:12.914354+0000","last_became_peered":"2024-03-04T06:38:12.914354+0000","last_unstale":"2024-03-04T06:38:15.081246+0000","last_undegraded":"2024-03-04T06:38:15.081246+0000","last_fullsized":"2024-03-04T06:38:15.081246+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:28.750455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407699+0000","last_change":"2024-03-04T06:38:12.906752+0000","last_active":"2024-03-04T06:38:15.407699+0000","last_peered":"2024-03-04T06:38:15.407699+0000","last_clean":"2024-03-04T06:38:15.407699+0000","last_became_active":"2024-03-04T06:38:12.906492+0000","last_became_peered":"2024-03-04T06:38:12.906492+0000","last_unstale":"2024-03-04T06:38:15.407699+0000","last_undegraded":"2024-03-04T06:38:15.407699+0000","last_fullsized":"2024-03-04T06:38:15.407699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:24.841196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407045+0000","last_change":"2024-03-04T06:38:12.897151+0000","last_active":"2024-03-04T06:38:15.407045+0000","last_peered":"2024-03-04T06:38:15.407045+0000","last_clean":"2024-03-04T06:38:15.407045+0000","last_became_active":"2024-03-04T06:38:12.896787+0000","last_became_peered":"2024-03-04T06:38:12.896787+0000","last_unstale":"2024-03-04T06:38:15.407045+0000","last_undegraded":"2024-03-04T06:38:15.407045+0000","last_fullsized":"2024-03-04T06:38:15.407045+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:12:22.562737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407449+0000","last_change":"2024-03-04T06:38:12.908348+0000","last_active":"2024-03-04T06:38:15.407449+0000","last_peered":"2024-03-04T06:38:15.407449+0000","last_clean":"2024-03-04T06:38:15.407449+0000","last_became_active":"2024-03-04T06:38:12.908021+0000","last_became_peered":"2024-03-04T06:38:12.908021+0000","last_unstale":"2024-03-04T06:38:15.407449+0000","last_undegraded":"2024-03-04T06:38:15.407449+0000","last_fullsized":"2024-03-04T06:38:15.407449+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:16:36.050910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407299+0000","last_change":"2024-03-04T06:38:12.898994+0000","last_active":"2024-03-04T06:38:15.407299+0000","last_peered":"2024-03-04T06:38:15.407299+0000","last_clean":"2024-03-04T06:38:15.407299+0000","last_became_active":"2024-03-04T06:38:12.898693+0000","last_became_peered":"2024-03-04T06:38:12.898693+0000","last_unstale":"2024-03-04T06:38:15.407299+0000","last_undegraded":"2024-03-04T06:38:15.407299+0000","last_fullsized":"2024-03-04T06:38:15.407299+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:40:01.173992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T06:38:12.520695+0000","last_change":"2024-03-04T06:38:12.520695+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:38:12.520695+0000","last_undegraded":"2024-03-04T06:38:12.520695+0000","last_fullsized":"2024-03-04T06:38:12.520695+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.081021+0000","last_change":"2024-03-04T06:38:12.915624+0000","last_active":"2024-03-04T06:38:15.081021+0000","last_peered":"2024-03-04T06:38:15.081021+0000","last_clean":"2024-03-04T06:38:15.081021+0000","last_became_active":"2024-03-04T06:38:12.915335+0000","last_became_peered":"2024-03-04T06:38:12.915335+0000","last_unstale":"2024-03-04T06:38:15.081021+0000","last_undegraded":"2024-03-04T06:38:15.081021+0000","last_fullsized":"2024-03-04T06:38:15.081021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:52:58.038264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":147,"acting":147,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1724,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28212,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716940,"statfs":{"total":95995035648,"available":95966146560,"internally_reserved":0,"allocated":1220608,"data_stored":850082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495627,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28216,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716936,"statfs":{"total":95995035648,"available":95966142464,"internally_reserved":0,"allocated":1216512,"data_stored":844643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717524,"statfs":{"total":95995035648,"available":95966744576,"internally_reserved":0,"allocated":618496,"data_stored":252871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:35 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.31900000000000001,"15min":0.313},"min":{"1min":0.254,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.35599999999999998}]},{"osd":2,"last update":"Mon Mar 4 06:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.311},{"interface":"front","average":{"1min":0.441,"5min":0.375,"15min":0.36399999999999999},"min":{"1min":0.32300000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.378}]},{"osd":3,"last update":"Mon Mar 4 06:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Mar 4 06:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716980,"statfs":{"total":95995035648,"available":95966187520,"internally_reserved":0,"allocated":1179648,"data_stored":829169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 4 06:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.27700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.28799999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.38700000000000001}]},{"osd":2,"last update":"Mon Mar 4 06:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.38800000000000001},"min":{"1min":0.30499999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57399999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63200000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.34000000000000002}]},{"osd":3,"last update":"Mon Mar 4 06:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.37},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.27200000000000002}]},{"osd":4,"last update":"Mon Mar 4 06:37:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411358,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717532,"statfs":{"total":95995035648,"available":95966752768,"internally_reserved":0,"allocated":610304,"data_stored":252711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.33700000000000002,"15min":0.32100000000000001},"min":{"1min":0.308,"5min":0.221,"15min":0.221},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.373,"15min":0.36299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.25800000000000001}]},{"osd":1,"last update":"Mon Mar 4 06:37:55 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.378,"15min":0.36599999999999999},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.32500000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.30299999999999999}]},{"osd":3,"last update":"Mon Mar 4 06:37:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.28899999999999998}]},{"osd":4,"last update":"Mon Mar 4 06:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60899999999999999}]},{"osd":5,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182426,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717508,"statfs":{"total":95995035648,"available":95966728192,"internally_reserved":0,"allocated":630784,"data_stored":254379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36099999999999999}]},{"osd":1,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.374}]},{"osd":2,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.307}]},{"osd":4,"last update":"Mon Mar 4 06:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.433},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Mar 4 06:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":4,"up_from":30,"seq":128849018900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717560,"statfs":{"total":95995035648,"available":95966781440,"internally_reserved":0,"allocated":585728,"data_stored":238801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42699999999999999}]},{"osd":1,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.377},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.38500000000000001}]},{"osd":5,"last update":"Mon Mar 4 06:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757264,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27644,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717508,"statfs":{"total":95995035648,"available":95966728192,"internally_reserved":0,"allocated":634880,"data_stored":260764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.41099999999999998}]},{"osd":1,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.436},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.34599999999999997}]},{"osd":3,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":6.6180000000000003,"5min":6.6180000000000003,"15min":6.6180000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:38:17.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:16 smithi203 ceph-mon[30756]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:18.163 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:17 smithi203 ceph-mon[30756]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:18.163 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:17 smithi203 ceph-mon[30756]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:18.163 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:17 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1126587538' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-03-04T06:38:18.163 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:17 smithi203 ceph-mon[30756]: pgmap v189: 97 pgs: 79 active+clean, 3 creating+peering, 15 unknown; 578 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 937 B/s wr, 6 op/s 2024-03-04T06:38:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:17 smithi137 ceph-mon[26846]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:17 smithi137 ceph-mon[26846]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:17 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1126587538' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-03-04T06:38:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:17 smithi137 ceph-mon[26846]: pgmap v189: 97 pgs: 79 active+clean, 3 creating+peering, 15 unknown; 578 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 937 B/s wr, 6 op/s 2024-03-04T06:38:18.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:17 smithi137 ceph-mon[37364]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:18.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:17 smithi137 ceph-mon[37364]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:18.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:17 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1126587538' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-03-04T06:38:18.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:17 smithi137 ceph-mon[37364]: pgmap v189: 97 pgs: 79 active+clean, 3 creating+peering, 15 unknown; 578 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 937 B/s wr, 6 op/s 2024-03-04T06:38:18.596 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:38:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b[57861]: 2024-03-04T06:38:18.162+0000 7fd3389bc700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-04T06:38:19.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:18 smithi137 ceph-mon[26846]: from='client.14571 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:19.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:18 smithi137 ceph-mon[37364]: from='client.14571 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:19.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:18 smithi203 ceph-mon[30756]: from='client.14571 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:20.219 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T06:38:20.248 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:19 smithi137 ceph-mon[26846]: pgmap v190: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s wr, 6 op/s 2024-03-04T06:38:20.248 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:19 smithi137 ceph-mon[37364]: pgmap v190: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s wr, 6 op/s 2024-03-04T06:38:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:19 smithi203 ceph-mon[30756]: pgmap v190: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s wr, 6 op/s 2024-03-04T06:38:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:20.525 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:38:20.534 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-03-04T06:38:18.983280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":241,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":222844,"kb_used_data":6644,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":749738372,"statfs":{"total":767960285184,"available":767732092928,"internally_reserved":0,"allocated":6803456,"data_stored":3826136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.452616"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889794+0000","last_change":"2024-03-04T06:38:12.919238+0000","last_active":"2024-03-04T06:38:13.889794+0000","last_peered":"2024-03-04T06:38:13.889794+0000","last_clean":"2024-03-04T06:38:13.889794+0000","last_became_active":"2024-03-04T06:38:12.918941+0000","last_became_peered":"2024-03-04T06:38:12.918941+0000","last_unstale":"2024-03-04T06:38:13.889794+0000","last_undegraded":"2024-03-04T06:38:13.889794+0000","last_fullsized":"2024-03-04T06:38:13.889794+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:10:03.122262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.915161+0000","last_change":"2024-03-04T06:38:12.914740+0000","last_active":"2024-03-04T06:38:12.915161+0000","last_peered":"2024-03-04T06:38:12.915161+0000","last_clean":"2024-03-04T06:38:12.915161+0000","last_became_active":"2024-03-04T06:38:12.914436+0000","last_became_peered":"2024-03-04T06:38:12.914436+0000","last_unstale":"2024-03-04T06:38:12.915161+0000","last_undegraded":"2024-03-04T06:38:12.915161+0000","last_fullsized":"2024-03-04T06:38:12.915161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:58.781088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888113+0000","last_change":"2024-03-04T06:38:12.895666+0000","last_active":"2024-03-04T06:38:13.888113+0000","last_peered":"2024-03-04T06:38:13.888113+0000","last_clean":"2024-03-04T06:38:13.888113+0000","last_became_active":"2024-03-04T06:38:12.895398+0000","last_became_peered":"2024-03-04T06:38:12.895398+0000","last_unstale":"2024-03-04T06:38:13.888113+0000","last_undegraded":"2024-03-04T06:38:13.888113+0000","last_fullsized":"2024-03-04T06:38:13.888113+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:10.744216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407489+0000","last_change":"2024-03-04T06:38:12.902256+0000","last_active":"2024-03-04T06:38:15.407489+0000","last_peered":"2024-03-04T06:38:15.407489+0000","last_clean":"2024-03-04T06:38:15.407489+0000","last_became_active":"2024-03-04T06:38:12.901792+0000","last_became_peered":"2024-03-04T06:38:12.901792+0000","last_unstale":"2024-03-04T06:38:15.407489+0000","last_undegraded":"2024-03-04T06:38:15.407489+0000","last_fullsized":"2024-03-04T06:38:15.407489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:45.163241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889213+0000","last_change":"2024-03-04T06:38:12.913797+0000","last_active":"2024-03-04T06:38:13.889213+0000","last_peered":"2024-03-04T06:38:13.889213+0000","last_clean":"2024-03-04T06:38:13.889213+0000","last_became_active":"2024-03-04T06:38:12.913517+0000","last_became_peered":"2024-03-04T06:38:12.913517+0000","last_unstale":"2024-03-04T06:38:13.889213+0000","last_undegraded":"2024-03-04T06:38:13.889213+0000","last_fullsized":"2024-03-04T06:38:13.889213+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:24.837813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407453+0000","last_change":"2024-03-04T06:38:12.904787+0000","last_active":"2024-03-04T06:38:15.407453+0000","last_peered":"2024-03-04T06:38:15.407453+0000","last_clean":"2024-03-04T06:38:15.407453+0000","last_became_active":"2024-03-04T06:38:12.904484+0000","last_became_peered":"2024-03-04T06:38:12.904484+0000","last_unstale":"2024-03-04T06:38:15.407453+0000","last_undegraded":"2024-03-04T06:38:15.407453+0000","last_fullsized":"2024-03-04T06:38:15.407453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:03:28.898688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888865+0000","last_change":"2024-03-04T06:38:12.913825+0000","last_active":"2024-03-04T06:38:13.888865+0000","last_peered":"2024-03-04T06:38:13.888865+0000","last_clean":"2024-03-04T06:38:13.888865+0000","last_became_active":"2024-03-04T06:38:12.913553+0000","last_became_peered":"2024-03-04T06:38:12.913553+0000","last_unstale":"2024-03-04T06:38:13.888865+0000","last_undegraded":"2024-03-04T06:38:13.888865+0000","last_fullsized":"2024-03-04T06:38:13.888865+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:23:17.322436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.406773+0000","last_change":"2024-03-04T06:38:12.902309+0000","last_active":"2024-03-04T06:38:15.406773+0000","last_peered":"2024-03-04T06:38:15.406773+0000","last_clean":"2024-03-04T06:38:15.406773+0000","last_became_active":"2024-03-04T06:38:12.902009+0000","last_became_peered":"2024-03-04T06:38:12.902009+0000","last_unstale":"2024-03-04T06:38:15.406773+0000","last_undegraded":"2024-03-04T06:38:15.406773+0000","last_fullsized":"2024-03-04T06:38:15.406773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:36:04.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889777+0000","last_change":"2024-03-04T06:38:12.916933+0000","last_active":"2024-03-04T06:38:13.889777+0000","last_peered":"2024-03-04T06:38:13.889777+0000","last_clean":"2024-03-04T06:38:13.889777+0000","last_became_active":"2024-03-04T06:38:12.913922+0000","last_became_peered":"2024-03-04T06:38:12.913922+0000","last_unstale":"2024-03-04T06:38:13.889777+0000","last_undegraded":"2024-03-04T06:38:13.889777+0000","last_fullsized":"2024-03-04T06:38:13.889777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:08:21.342061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.081175+0000","last_change":"2024-03-04T06:38:12.911185+0000","last_active":"2024-03-04T06:38:15.081175+0000","last_peered":"2024-03-04T06:38:15.081175+0000","last_clean":"2024-03-04T06:38:15.081175+0000","last_became_active":"2024-03-04T06:38:12.910906+0000","last_became_peered":"2024-03-04T06:38:12.910906+0000","last_unstale":"2024-03-04T06:38:15.081175+0000","last_undegraded":"2024-03-04T06:38:15.081175+0000","last_fullsized":"2024-03-04T06:38:15.081175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:45.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.081084+0000","last_change":"2024-03-04T06:38:12.916277+0000","last_active":"2024-03-04T06:38:15.081084+0000","last_peered":"2024-03-04T06:38:15.081084+0000","last_clean":"2024-03-04T06:38:15.081084+0000","last_became_active":"2024-03-04T06:38:12.915998+0000","last_became_peered":"2024-03-04T06:38:12.915998+0000","last_unstale":"2024-03-04T06:38:15.081084+0000","last_undegraded":"2024-03-04T06:38:15.081084+0000","last_fullsized":"2024-03-04T06:38:15.081084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:22:53.166929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:14.907102+0000","last_change":"2024-03-04T06:38:12.907393+0000","last_active":"2024-03-04T06:38:14.907102+0000","last_peered":"2024-03-04T06:38:14.907102+0000","last_clean":"2024-03-04T06:38:14.907102+0000","last_became_active":"2024-03-04T06:38:12.907111+0000","last_became_peered":"2024-03-04T06:38:12.907111+0000","last_unstale":"2024-03-04T06:38:14.907102+0000","last_undegraded":"2024-03-04T06:38:14.907102+0000","last_fullsized":"2024-03-04T06:38:14.907102+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:18.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407288+0000","last_change":"2024-03-04T06:38:12.897003+0000","last_active":"2024-03-04T06:38:15.407288+0000","last_peered":"2024-03-04T06:38:15.407288+0000","last_clean":"2024-03-04T06:38:15.407288+0000","last_became_active":"2024-03-04T06:38:12.896729+0000","last_became_peered":"2024-03-04T06:38:12.896729+0000","last_unstale":"2024-03-04T06:38:15.407288+0000","last_undegraded":"2024-03-04T06:38:15.407288+0000","last_fullsized":"2024-03-04T06:38:15.407288+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:01:03.497642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887817+0000","last_change":"2024-03-04T06:38:12.896652+0000","last_active":"2024-03-04T06:38:13.887817+0000","last_peered":"2024-03-04T06:38:13.887817+0000","last_clean":"2024-03-04T06:38:13.887817+0000","last_became_active":"2024-03-04T06:38:12.896300+0000","last_became_peered":"2024-03-04T06:38:12.896300+0000","last_unstale":"2024-03-04T06:38:13.887817+0000","last_undegraded":"2024-03-04T06:38:13.887817+0000","last_fullsized":"2024-03-04T06:38:13.887817+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:32.026507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.909063+0000","last_change":"2024-03-04T06:38:12.907997+0000","last_active":"2024-03-04T06:38:12.909063+0000","last_peered":"2024-03-04T06:38:12.909063+0000","last_clean":"2024-03-04T06:38:12.909063+0000","last_became_active":"2024-03-04T06:38:12.907720+0000","last_became_peered":"2024-03-04T06:38:12.907720+0000","last_unstale":"2024-03-04T06:38:12.909063+0000","last_undegraded":"2024-03-04T06:38:12.909063+0000","last_fullsized":"2024-03-04T06:38:12.909063+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:46:55.140847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.406923+0000","last_change":"2024-03-04T06:38:12.899219+0000","last_active":"2024-03-04T06:38:15.406923+0000","last_peered":"2024-03-04T06:38:15.406923+0000","last_clean":"2024-03-04T06:38:15.406923+0000","last_became_active":"2024-03-04T06:38:12.898928+0000","last_became_peered":"2024-03-04T06:38:12.898928+0000","last_unstale":"2024-03-04T06:38:15.406923+0000","last_undegraded":"2024-03-04T06:38:15.406923+0000","last_fullsized":"2024-03-04T06:38:15.406923+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:13.412822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407624+0000","last_change":"2024-03-04T06:38:12.908332+0000","last_active":"2024-03-04T06:38:15.407624+0000","last_peered":"2024-03-04T06:38:15.407624+0000","last_clean":"2024-03-04T06:38:15.407624+0000","last_became_active":"2024-03-04T06:38:12.908038+0000","last_became_peered":"2024-03-04T06:38:12.908038+0000","last_unstale":"2024-03-04T06:38:15.407624+0000","last_undegraded":"2024-03-04T06:38:15.407624+0000","last_fullsized":"2024-03-04T06:38:15.407624+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:05:49.146138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888473+0000","last_change":"2024-03-04T06:38:12.899134+0000","last_active":"2024-03-04T06:38:13.888473+0000","last_peered":"2024-03-04T06:38:13.888473+0000","last_clean":"2024-03-04T06:38:13.888473+0000","last_became_active":"2024-03-04T06:38:12.898801+0000","last_became_peered":"2024-03-04T06:38:12.898801+0000","last_unstale":"2024-03-04T06:38:13.888473+0000","last_undegraded":"2024-03-04T06:38:13.888473+0000","last_fullsized":"2024-03-04T06:38:13.888473+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:21:48.465552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889197+0000","last_change":"2024-03-04T06:38:12.918000+0000","last_active":"2024-03-04T06:38:13.889197+0000","last_peered":"2024-03-04T06:38:13.889197+0000","last_clean":"2024-03-04T06:38:13.889197+0000","last_became_active":"2024-03-04T06:38:12.914159+0000","last_became_peered":"2024-03-04T06:38:12.914159+0000","last_unstale":"2024-03-04T06:38:13.889197+0000","last_undegraded":"2024-03-04T06:38:13.889197+0000","last_fullsized":"2024-03-04T06:38:13.889197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:24.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.921942+0000","last_change":"2024-03-04T06:38:12.550843+0000","last_active":"2024-03-04T06:38:12.921942+0000","last_peered":"2024-03-04T06:38:12.921942+0000","last_clean":"2024-03-04T06:38:12.921942+0000","last_became_active":"2024-03-04T06:38:12.550141+0000","last_became_peered":"2024-03-04T06:38:12.550141+0000","last_unstale":"2024-03-04T06:38:12.921942+0000","last_undegraded":"2024-03-04T06:38:12.921942+0000","last_fullsized":"2024-03-04T06:38:12.921942+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:01.969570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407408+0000","last_change":"2024-03-04T06:38:12.896389+0000","last_active":"2024-03-04T06:38:15.407408+0000","last_peered":"2024-03-04T06:38:15.407408+0000","last_clean":"2024-03-04T06:38:15.407408+0000","last_became_active":"2024-03-04T06:38:12.896120+0000","last_became_peered":"2024-03-04T06:38:12.896120+0000","last_unstale":"2024-03-04T06:38:15.407408+0000","last_undegraded":"2024-03-04T06:38:15.407408+0000","last_fullsized":"2024-03-04T06:38:15.407408+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:57.729499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"61'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407220+0000","last_change":"2024-03-04T06:38:12.550800+0000","last_active":"2024-03-04T06:38:15.407220+0000","last_peered":"2024-03-04T06:38:15.407220+0000","last_clean":"2024-03-04T06:38:15.407220+0000","last_became_active":"2024-03-04T06:38:12.550444+0000","last_became_peered":"2024-03-04T06:38:12.550444+0000","last_unstale":"2024-03-04T06:38:15.407220+0000","last_undegraded":"2024-03-04T06:38:15.407220+0000","last_fullsized":"2024-03-04T06:38:15.407220+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:42.209194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888225+0000","last_change":"2024-03-04T06:38:12.903258+0000","last_active":"2024-03-04T06:38:13.888225+0000","last_peered":"2024-03-04T06:38:13.888225+0000","last_clean":"2024-03-04T06:38:13.888225+0000","last_became_active":"2024-03-04T06:38:12.902982+0000","last_became_peered":"2024-03-04T06:38:12.902982+0000","last_unstale":"2024-03-04T06:38:13.888225+0000","last_undegraded":"2024-03-04T06:38:13.888225+0000","last_fullsized":"2024-03-04T06:38:13.888225+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:31:23.228035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889631+0000","last_change":"2024-03-04T06:38:12.557057+0000","last_active":"2024-03-04T06:38:13.889631+0000","last_peered":"2024-03-04T06:38:13.889631+0000","last_clean":"2024-03-04T06:38:13.889631+0000","last_became_active":"2024-03-04T06:38:12.556733+0000","last_became_peered":"2024-03-04T06:38:12.556733+0000","last_unstale":"2024-03-04T06:38:13.889631+0000","last_undegraded":"2024-03-04T06:38:13.889631+0000","last_fullsized":"2024-03-04T06:38:13.889631+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:15.847471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407644+0000","last_change":"2024-03-04T06:38:12.907223+0000","last_active":"2024-03-04T06:38:15.407644+0000","last_peered":"2024-03-04T06:38:15.407644+0000","last_clean":"2024-03-04T06:38:15.407644+0000","last_became_active":"2024-03-04T06:38:12.906911+0000","last_became_peered":"2024-03-04T06:38:12.906911+0000","last_unstale":"2024-03-04T06:38:15.407644+0000","last_undegraded":"2024-03-04T06:38:15.407644+0000","last_fullsized":"2024-03-04T06:38:15.407644+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:29.474153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889309+0000","last_change":"2024-03-04T06:38:12.556246+0000","last_active":"2024-03-04T06:38:13.889309+0000","last_peered":"2024-03-04T06:38:13.889309+0000","last_clean":"2024-03-04T06:38:13.889309+0000","last_became_active":"2024-03-04T06:38:12.555860+0000","last_became_peered":"2024-03-04T06:38:12.555860+0000","last_unstale":"2024-03-04T06:38:13.889309+0000","last_undegraded":"2024-03-04T06:38:13.889309+0000","last_fullsized":"2024-03-04T06:38:13.889309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:41.910480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407434+0000","last_change":"2024-03-04T06:38:12.906907+0000","last_active":"2024-03-04T06:38:15.407434+0000","last_peered":"2024-03-04T06:38:15.407434+0000","last_clean":"2024-03-04T06:38:15.407434+0000","last_became_active":"2024-03-04T06:38:12.906615+0000","last_became_peered":"2024-03-04T06:38:12.906615+0000","last_unstale":"2024-03-04T06:38:15.407434+0000","last_undegraded":"2024-03-04T06:38:15.407434+0000","last_fullsized":"2024-03-04T06:38:15.407434+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:21:15.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"61'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407782+0000","last_change":"2024-03-04T06:38:12.546234+0000","last_active":"2024-03-04T06:38:15.407782+0000","last_peered":"2024-03-04T06:38:15.407782+0000","last_clean":"2024-03-04T06:38:15.407782+0000","last_became_active":"2024-03-04T06:38:12.545975+0000","last_became_peered":"2024-03-04T06:38:12.545975+0000","last_unstale":"2024-03-04T06:38:15.407782+0000","last_undegraded":"2024-03-04T06:38:15.407782+0000","last_fullsized":"2024-03-04T06:38:15.407782+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:04.341190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:14.906685+0000","last_change":"2024-03-04T06:38:12.908256+0000","last_active":"2024-03-04T06:38:14.906685+0000","last_peered":"2024-03-04T06:38:14.906685+0000","last_clean":"2024-03-04T06:38:14.906685+0000","last_became_active":"2024-03-04T06:38:12.907953+0000","last_became_peered":"2024-03-04T06:38:12.907953+0000","last_unstale":"2024-03-04T06:38:14.906685+0000","last_undegraded":"2024-03-04T06:38:14.906685+0000","last_fullsized":"2024-03-04T06:38:14.906685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:03:03.291025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.080840+0000","last_change":"2024-03-04T06:38:12.554332+0000","last_active":"2024-03-04T06:38:15.080840+0000","last_peered":"2024-03-04T06:38:15.080840+0000","last_clean":"2024-03-04T06:38:15.080840+0000","last_became_active":"2024-03-04T06:38:12.554044+0000","last_became_peered":"2024-03-04T06:38:12.554044+0000","last_unstale":"2024-03-04T06:38:15.080840+0000","last_undegraded":"2024-03-04T06:38:15.080840+0000","last_fullsized":"2024-03-04T06:38:15.080840+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:28:40.250342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887829+0000","last_change":"2024-03-04T06:38:12.910445+0000","last_active":"2024-03-04T06:38:13.887829+0000","last_peered":"2024-03-04T06:38:13.887829+0000","last_clean":"2024-03-04T06:38:13.887829+0000","last_became_active":"2024-03-04T06:38:12.909974+0000","last_became_peered":"2024-03-04T06:38:12.909974+0000","last_unstale":"2024-03-04T06:38:13.887829+0000","last_undegraded":"2024-03-04T06:38:13.887829+0000","last_fullsized":"2024-03-04T06:38:13.887829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:42:52.372021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407591+0000","last_change":"2024-03-04T06:38:12.543180+0000","last_active":"2024-03-04T06:38:15.407591+0000","last_peered":"2024-03-04T06:38:15.407591+0000","last_clean":"2024-03-04T06:38:15.407591+0000","last_became_active":"2024-03-04T06:38:12.542896+0000","last_became_peered":"2024-03-04T06:38:12.542896+0000","last_unstale":"2024-03-04T06:38:15.407591+0000","last_undegraded":"2024-03-04T06:38:15.407591+0000","last_fullsized":"2024-03-04T06:38:15.407591+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:15:09.816539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.406884+0000","last_change":"2024-03-04T06:38:12.895735+0000","last_active":"2024-03-04T06:38:15.406884+0000","last_peered":"2024-03-04T06:38:15.406884+0000","last_clean":"2024-03-04T06:38:15.406884+0000","last_became_active":"2024-03-04T06:38:12.895201+0000","last_became_peered":"2024-03-04T06:38:12.895201+0000","last_unstale":"2024-03-04T06:38:15.406884+0000","last_undegraded":"2024-03-04T06:38:15.406884+0000","last_fullsized":"2024-03-04T06:38:15.406884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:12:35.373175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.406999+0000","last_change":"2024-03-04T06:38:12.551089+0000","last_active":"2024-03-04T06:38:15.406999+0000","last_peered":"2024-03-04T06:38:15.406999+0000","last_clean":"2024-03-04T06:38:15.406999+0000","last_became_active":"2024-03-04T06:38:12.550791+0000","last_became_peered":"2024-03-04T06:38:12.550791+0000","last_unstale":"2024-03-04T06:38:15.406999+0000","last_undegraded":"2024-03-04T06:38:15.406999+0000","last_fullsized":"2024-03-04T06:38:15.406999+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:49.576267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.911990+0000","last_change":"2024-03-04T06:38:12.909194+0000","last_active":"2024-03-04T06:38:12.911990+0000","last_peered":"2024-03-04T06:38:12.911990+0000","last_clean":"2024-03-04T06:38:12.911990+0000","last_became_active":"2024-03-04T06:38:12.908879+0000","last_became_peered":"2024-03-04T06:38:12.908879+0000","last_unstale":"2024-03-04T06:38:12.911990+0000","last_undegraded":"2024-03-04T06:38:12.911990+0000","last_fullsized":"2024-03-04T06:38:12.911990+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:23.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.081282+0000","last_change":"2024-03-04T06:38:12.544023+0000","last_active":"2024-03-04T06:38:15.081282+0000","last_peered":"2024-03-04T06:38:15.081282+0000","last_clean":"2024-03-04T06:38:15.081282+0000","last_became_active":"2024-03-04T06:38:12.543699+0000","last_became_peered":"2024-03-04T06:38:12.543699+0000","last_unstale":"2024-03-04T06:38:15.081282+0000","last_undegraded":"2024-03-04T06:38:15.081282+0000","last_fullsized":"2024-03-04T06:38:15.081282+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:19.418372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407428+0000","last_change":"2024-03-04T06:38:12.903510+0000","last_active":"2024-03-04T06:38:15.407428+0000","last_peered":"2024-03-04T06:38:15.407428+0000","last_clean":"2024-03-04T06:38:15.407428+0000","last_became_active":"2024-03-04T06:38:12.903226+0000","last_became_peered":"2024-03-04T06:38:12.903226+0000","last_unstale":"2024-03-04T06:38:15.407428+0000","last_undegraded":"2024-03-04T06:38:15.407428+0000","last_fullsized":"2024-03-04T06:38:15.407428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:49:29.474747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407368+0000","last_change":"2024-03-04T06:38:12.550879+0000","last_active":"2024-03-04T06:38:15.407368+0000","last_peered":"2024-03-04T06:38:15.407368+0000","last_clean":"2024-03-04T06:38:15.407368+0000","last_became_active":"2024-03-04T06:38:12.549931+0000","last_became_peered":"2024-03-04T06:38:12.549931+0000","last_unstale":"2024-03-04T06:38:15.407368+0000","last_undegraded":"2024-03-04T06:38:15.407368+0000","last_fullsized":"2024-03-04T06:38:15.407368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:33.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888192+0000","last_change":"2024-03-04T06:38:12.903875+0000","last_active":"2024-03-04T06:38:13.888192+0000","last_peered":"2024-03-04T06:38:13.888192+0000","last_clean":"2024-03-04T06:38:13.888192+0000","last_became_active":"2024-03-04T06:38:12.903600+0000","last_became_peered":"2024-03-04T06:38:12.903600+0000","last_unstale":"2024-03-04T06:38:13.888192+0000","last_undegraded":"2024-03-04T06:38:13.888192+0000","last_fullsized":"2024-03-04T06:38:13.888192+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:32.774333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.908729+0000","last_change":"2024-03-04T06:38:12.551496+0000","last_active":"2024-03-04T06:38:12.908729+0000","last_peered":"2024-03-04T06:38:12.908729+0000","last_clean":"2024-03-04T06:38:12.908729+0000","last_became_active":"2024-03-04T06:38:12.551202+0000","last_became_peered":"2024-03-04T06:38:12.551202+0000","last_unstale":"2024-03-04T06:38:12.908729+0000","last_undegraded":"2024-03-04T06:38:12.908729+0000","last_fullsized":"2024-03-04T06:38:12.908729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:19.526762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:14.907037+0000","last_change":"2024-03-04T06:38:12.911735+0000","last_active":"2024-03-04T06:38:14.907037+0000","last_peered":"2024-03-04T06:38:14.907037+0000","last_clean":"2024-03-04T06:38:14.907037+0000","last_became_active":"2024-03-04T06:38:12.911389+0000","last_became_peered":"2024-03-04T06:38:12.911389+0000","last_unstale":"2024-03-04T06:38:14.907037+0000","last_undegraded":"2024-03-04T06:38:14.907037+0000","last_fullsized":"2024-03-04T06:38:14.907037+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:25.284425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"61'6","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.080905+0000","last_change":"2024-03-04T06:38:12.546352+0000","last_active":"2024-03-04T06:38:15.080905+0000","last_peered":"2024-03-04T06:38:15.080905+0000","last_clean":"2024-03-04T06:38:15.080905+0000","last_became_active":"2024-03-04T06:38:12.545863+0000","last_became_peered":"2024-03-04T06:38:12.545863+0000","last_unstale":"2024-03-04T06:38:15.080905+0000","last_undegraded":"2024-03-04T06:38:15.080905+0000","last_fullsized":"2024-03-04T06:38:15.080905+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:08.181131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889396+0000","last_change":"2024-03-04T06:38:12.919415+0000","last_active":"2024-03-04T06:38:13.889396+0000","last_peered":"2024-03-04T06:38:13.889396+0000","last_clean":"2024-03-04T06:38:13.889396+0000","last_became_active":"2024-03-04T06:38:12.918269+0000","last_became_peered":"2024-03-04T06:38:12.918269+0000","last_unstale":"2024-03-04T06:38:13.889396+0000","last_undegraded":"2024-03-04T06:38:13.889396+0000","last_fullsized":"2024-03-04T06:38:13.889396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:26:56.067995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.917021+0000","last_change":"2024-03-04T06:38:12.547028+0000","last_active":"2024-03-04T06:38:12.917021+0000","last_peered":"2024-03-04T06:38:12.917021+0000","last_clean":"2024-03-04T06:38:12.917021+0000","last_became_active":"2024-03-04T06:38:12.546672+0000","last_became_peered":"2024-03-04T06:38:12.546672+0000","last_unstale":"2024-03-04T06:38:12.917021+0000","last_undegraded":"2024-03-04T06:38:12.917021+0000","last_fullsized":"2024-03-04T06:38:12.917021+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:21:00.773241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887733+0000","last_change":"2024-03-04T06:38:12.896676+0000","last_active":"2024-03-04T06:38:13.887733+0000","last_peered":"2024-03-04T06:38:13.887733+0000","last_clean":"2024-03-04T06:38:13.887733+0000","last_became_active":"2024-03-04T06:38:12.893498+0000","last_became_peered":"2024-03-04T06:38:12.893498+0000","last_unstale":"2024-03-04T06:38:13.887733+0000","last_undegraded":"2024-03-04T06:38:13.887733+0000","last_fullsized":"2024-03-04T06:38:13.887733+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:57.293340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407057+0000","last_change":"2024-03-04T06:38:12.549608+0000","last_active":"2024-03-04T06:38:15.407057+0000","last_peered":"2024-03-04T06:38:15.407057+0000","last_clean":"2024-03-04T06:38:15.407057+0000","last_became_active":"2024-03-04T06:38:12.549299+0000","last_became_peered":"2024-03-04T06:38:12.549299+0000","last_unstale":"2024-03-04T06:38:15.407057+0000","last_undegraded":"2024-03-04T06:38:15.407057+0000","last_fullsized":"2024-03-04T06:38:15.407057+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:12:23.543702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889084+0000","last_change":"2024-03-04T06:38:12.913767+0000","last_active":"2024-03-04T06:38:13.889084+0000","last_peered":"2024-03-04T06:38:13.889084+0000","last_clean":"2024-03-04T06:38:13.889084+0000","last_became_active":"2024-03-04T06:38:12.913476+0000","last_became_peered":"2024-03-04T06:38:12.913476+0000","last_unstale":"2024-03-04T06:38:13.889084+0000","last_undegraded":"2024-03-04T06:38:13.889084+0000","last_fullsized":"2024-03-04T06:38:13.889084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:44:53.483514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.080514+0000","last_change":"2024-03-04T06:38:12.549514+0000","last_active":"2024-03-04T06:38:15.080514+0000","last_peered":"2024-03-04T06:38:15.080514+0000","last_clean":"2024-03-04T06:38:15.080514+0000","last_became_active":"2024-03-04T06:38:12.549222+0000","last_became_peered":"2024-03-04T06:38:12.549222+0000","last_unstale":"2024-03-04T06:38:15.080514+0000","last_undegraded":"2024-03-04T06:38:15.080514+0000","last_fullsized":"2024-03-04T06:38:15.080514+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:54:24.051519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.080747+0000","last_change":"2024-03-04T06:38:12.909428+0000","last_active":"2024-03-04T06:38:15.080747+0000","last_peered":"2024-03-04T06:38:15.080747+0000","last_clean":"2024-03-04T06:38:15.080747+0000","last_became_active":"2024-03-04T06:38:12.909146+0000","last_became_peered":"2024-03-04T06:38:12.909146+0000","last_unstale":"2024-03-04T06:38:15.080747+0000","last_undegraded":"2024-03-04T06:38:15.080747+0000","last_fullsized":"2024-03-04T06:38:15.080747+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:44.391084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887301+0000","last_change":"2024-03-04T06:38:12.544896+0000","last_active":"2024-03-04T06:38:13.887301+0000","last_peered":"2024-03-04T06:38:13.887301+0000","last_clean":"2024-03-04T06:38:13.887301+0000","last_became_active":"2024-03-04T06:38:12.543579+0000","last_became_peered":"2024-03-04T06:38:12.543579+0000","last_unstale":"2024-03-04T06:38:13.887301+0000","last_undegraded":"2024-03-04T06:38:13.887301+0000","last_fullsized":"2024-03-04T06:38:13.887301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:39.451118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888937+0000","last_change":"2024-03-04T06:38:12.919018+0000","last_active":"2024-03-04T06:38:13.888937+0000","last_peered":"2024-03-04T06:38:13.888937+0000","last_clean":"2024-03-04T06:38:13.888937+0000","last_became_active":"2024-03-04T06:38:12.918716+0000","last_became_peered":"2024-03-04T06:38:12.918716+0000","last_unstale":"2024-03-04T06:38:13.888937+0000","last_undegraded":"2024-03-04T06:38:13.888937+0000","last_fullsized":"2024-03-04T06:38:13.888937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:06:47.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.919619+0000","last_change":"2024-03-04T06:38:12.550559+0000","last_active":"2024-03-04T06:38:12.919619+0000","last_peered":"2024-03-04T06:38:12.919619+0000","last_clean":"2024-03-04T06:38:12.919619+0000","last_became_active":"2024-03-04T06:38:12.547867+0000","last_became_peered":"2024-03-04T06:38:12.547867+0000","last_unstale":"2024-03-04T06:38:12.919619+0000","last_undegraded":"2024-03-04T06:38:12.919619+0000","last_fullsized":"2024-03-04T06:38:12.919619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:04.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889815+0000","last_change":"2024-03-04T06:38:12.913566+0000","last_active":"2024-03-04T06:38:13.889815+0000","last_peered":"2024-03-04T06:38:13.889815+0000","last_clean":"2024-03-04T06:38:13.889815+0000","last_became_active":"2024-03-04T06:38:12.910660+0000","last_became_peered":"2024-03-04T06:38:12.910660+0000","last_unstale":"2024-03-04T06:38:13.889815+0000","last_undegraded":"2024-03-04T06:38:13.889815+0000","last_fullsized":"2024-03-04T06:38:13.889815+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:16:42.862745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.894002+0000","last_change":"2024-03-04T06:38:12.554795+0000","last_active":"2024-03-04T06:38:12.894002+0000","last_peered":"2024-03-04T06:38:12.894002+0000","last_clean":"2024-03-04T06:38:12.894002+0000","last_became_active":"2024-03-04T06:38:12.554461+0000","last_became_peered":"2024-03-04T06:38:12.554461+0000","last_unstale":"2024-03-04T06:38:12.894002+0000","last_undegraded":"2024-03-04T06:38:12.894002+0000","last_fullsized":"2024-03-04T06:38:12.894002+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:03:44.989709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407470+0000","last_change":"2024-03-04T06:38:12.897411+0000","last_active":"2024-03-04T06:38:15.407470+0000","last_peered":"2024-03-04T06:38:15.407470+0000","last_clean":"2024-03-04T06:38:15.407470+0000","last_became_active":"2024-03-04T06:38:12.896742+0000","last_became_peered":"2024-03-04T06:38:12.896742+0000","last_unstale":"2024-03-04T06:38:15.407470+0000","last_undegraded":"2024-03-04T06:38:15.407470+0000","last_fullsized":"2024-03-04T06:38:15.407470+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:14:21.032038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407036+0000","last_change":"2024-03-04T06:38:12.548860+0000","last_active":"2024-03-04T06:38:15.407036+0000","last_peered":"2024-03-04T06:38:15.407036+0000","last_clean":"2024-03-04T06:38:15.407036+0000","last_became_active":"2024-03-04T06:38:12.548550+0000","last_became_peered":"2024-03-04T06:38:12.548550+0000","last_unstale":"2024-03-04T06:38:15.407036+0000","last_undegraded":"2024-03-04T06:38:15.407036+0000","last_fullsized":"2024-03-04T06:38:15.407036+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:47:43.188556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:14.907041+0000","last_change":"2024-03-04T06:38:12.908558+0000","last_active":"2024-03-04T06:38:14.907041+0000","last_peered":"2024-03-04T06:38:14.907041+0000","last_clean":"2024-03-04T06:38:14.907041+0000","last_became_active":"2024-03-04T06:38:12.908227+0000","last_became_peered":"2024-03-04T06:38:12.908227+0000","last_unstale":"2024-03-04T06:38:14.907041+0000","last_undegraded":"2024-03-04T06:38:14.907041+0000","last_fullsized":"2024-03-04T06:38:14.907041+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:39:27.394161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.914724+0000","last_change":"2024-03-04T06:38:12.914172+0000","last_active":"2024-03-04T06:38:12.914724+0000","last_peered":"2024-03-04T06:38:12.914724+0000","last_clean":"2024-03-04T06:38:12.914724+0000","last_became_active":"2024-03-04T06:38:12.913896+0000","last_became_peered":"2024-03-04T06:38:12.913896+0000","last_unstale":"2024-03-04T06:38:12.914724+0000","last_undegraded":"2024-03-04T06:38:12.914724+0000","last_fullsized":"2024-03-04T06:38:12.914724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:53.141176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887360+0000","last_change":"2024-03-04T06:38:12.540510+0000","last_active":"2024-03-04T06:38:13.887360+0000","last_peered":"2024-03-04T06:38:13.887360+0000","last_clean":"2024-03-04T06:38:13.887360+0000","last_became_active":"2024-03-04T06:38:12.540155+0000","last_became_peered":"2024-03-04T06:38:12.540155+0000","last_unstale":"2024-03-04T06:38:13.887360+0000","last_undegraded":"2024-03-04T06:38:13.887360+0000","last_fullsized":"2024-03-04T06:38:13.887360+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:39.660282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407172+0000","last_change":"2024-03-04T06:38:12.903488+0000","last_active":"2024-03-04T06:38:15.407172+0000","last_peered":"2024-03-04T06:38:15.407172+0000","last_clean":"2024-03-04T06:38:15.407172+0000","last_became_active":"2024-03-04T06:38:12.903235+0000","last_became_peered":"2024-03-04T06:38:12.903235+0000","last_unstale":"2024-03-04T06:38:15.407172+0000","last_undegraded":"2024-03-04T06:38:15.407172+0000","last_fullsized":"2024-03-04T06:38:15.407172+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:43.099957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407160+0000","last_change":"2024-03-04T06:38:12.550672+0000","last_active":"2024-03-04T06:38:15.407160+0000","last_peered":"2024-03-04T06:38:15.407160+0000","last_clean":"2024-03-04T06:38:15.407160+0000","last_became_active":"2024-03-04T06:38:12.550367+0000","last_became_peered":"2024-03-04T06:38:12.550367+0000","last_unstale":"2024-03-04T06:38:15.407160+0000","last_undegraded":"2024-03-04T06:38:15.407160+0000","last_fullsized":"2024-03-04T06:38:15.407160+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:57:27.060139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"21'117","reported_seq":218,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.894459+0000","last_change":"2024-03-04T06:37:58.310255+0000","last_active":"2024-03-04T06:38:12.894459+0000","last_peered":"2024-03-04T06:38:12.894459+0000","last_clean":"2024-03-04T06:38:12.894459+0000","last_became_active":"2024-03-04T06:37:58.309800+0000","last_became_peered":"2024-03-04T06:37:58.309800+0000","last_unstale":"2024-03-04T06:38:12.894459+0000","last_undegraded":"2024-03-04T06:38:12.894459+0000","last_fullsized":"2024-03-04T06:38:12.894459+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:38.185918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887442+0000","last_change":"2024-03-04T06:38:12.910415+0000","last_active":"2024-03-04T06:38:13.887442+0000","last_peered":"2024-03-04T06:38:13.887442+0000","last_clean":"2024-03-04T06:38:13.887442+0000","last_became_active":"2024-03-04T06:38:12.910158+0000","last_became_peered":"2024-03-04T06:38:12.910158+0000","last_unstale":"2024-03-04T06:38:13.887442+0000","last_undegraded":"2024-03-04T06:38:13.887442+0000","last_fullsized":"2024-03-04T06:38:13.887442+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:34.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888963+0000","last_change":"2024-03-04T06:38:12.556986+0000","last_active":"2024-03-04T06:38:13.888963+0000","last_peered":"2024-03-04T06:38:13.888963+0000","last_clean":"2024-03-04T06:38:13.888963+0000","last_became_active":"2024-03-04T06:38:12.556594+0000","last_became_peered":"2024-03-04T06:38:12.556594+0000","last_unstale":"2024-03-04T06:38:13.888963+0000","last_undegraded":"2024-03-04T06:38:13.888963+0000","last_fullsized":"2024-03-04T06:38:13.888963+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:52.669745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889491+0000","last_change":"2024-03-04T06:38:12.557967+0000","last_active":"2024-03-04T06:38:13.889491+0000","last_peered":"2024-03-04T06:38:13.889491+0000","last_clean":"2024-03-04T06:38:13.889491+0000","last_became_active":"2024-03-04T06:38:12.557397+0000","last_became_peered":"2024-03-04T06:38:12.557397+0000","last_unstale":"2024-03-04T06:38:13.889491+0000","last_undegraded":"2024-03-04T06:38:13.889491+0000","last_fullsized":"2024-03-04T06:38:13.889491+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.366465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.906403+0000","last_change":"2024-03-04T06:38:12.905517+0000","last_active":"2024-03-04T06:38:12.906403+0000","last_peered":"2024-03-04T06:38:12.906403+0000","last_clean":"2024-03-04T06:38:12.906403+0000","last_became_active":"2024-03-04T06:38:12.905234+0000","last_became_peered":"2024-03-04T06:38:12.905234+0000","last_unstale":"2024-03-04T06:38:12.906403+0000","last_undegraded":"2024-03-04T06:38:12.906403+0000","last_fullsized":"2024-03-04T06:38:12.906403+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:32:58.487468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.896097+0000","last_change":"2024-03-04T06:38:12.542943+0000","last_active":"2024-03-04T06:38:12.896097+0000","last_peered":"2024-03-04T06:38:12.896097+0000","last_clean":"2024-03-04T06:38:12.896097+0000","last_became_active":"2024-03-04T06:38:12.542663+0000","last_became_peered":"2024-03-04T06:38:12.542663+0000","last_unstale":"2024-03-04T06:38:12.896097+0000","last_undegraded":"2024-03-04T06:38:12.896097+0000","last_fullsized":"2024-03-04T06:38:12.896097+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:11.583290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407622+0000","last_change":"2024-03-04T06:38:12.898034+0000","last_active":"2024-03-04T06:38:15.407622+0000","last_peered":"2024-03-04T06:38:15.407622+0000","last_clean":"2024-03-04T06:38:15.407622+0000","last_became_active":"2024-03-04T06:38:12.897766+0000","last_became_peered":"2024-03-04T06:38:12.897766+0000","last_unstale":"2024-03-04T06:38:15.407622+0000","last_undegraded":"2024-03-04T06:38:15.407622+0000","last_fullsized":"2024-03-04T06:38:15.407622+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:56.085588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.081184+0000","last_change":"2024-03-04T06:38:12.554846+0000","last_active":"2024-03-04T06:38:15.081184+0000","last_peered":"2024-03-04T06:38:15.081184+0000","last_clean":"2024-03-04T06:38:15.081184+0000","last_became_active":"2024-03-04T06:38:12.554544+0000","last_became_peered":"2024-03-04T06:38:12.554544+0000","last_unstale":"2024-03-04T06:38:15.081184+0000","last_undegraded":"2024-03-04T06:38:15.081184+0000","last_fullsized":"2024-03-04T06:38:15.081184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:44.524183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888290+0000","last_change":"2024-03-04T06:38:12.903163+0000","last_active":"2024-03-04T06:38:13.888290+0000","last_peered":"2024-03-04T06:38:13.888290+0000","last_clean":"2024-03-04T06:38:13.888290+0000","last_became_active":"2024-03-04T06:38:12.902896+0000","last_became_peered":"2024-03-04T06:38:12.902896+0000","last_unstale":"2024-03-04T06:38:13.888290+0000","last_undegraded":"2024-03-04T06:38:13.888290+0000","last_fullsized":"2024-03-04T06:38:13.888290+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:45:59.166463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888779+0000","last_change":"2024-03-04T06:38:12.556654+0000","last_active":"2024-03-04T06:38:13.888779+0000","last_peered":"2024-03-04T06:38:13.888779+0000","last_clean":"2024-03-04T06:38:13.888779+0000","last_became_active":"2024-03-04T06:38:12.556014+0000","last_became_peered":"2024-03-04T06:38:12.556014+0000","last_unstale":"2024-03-04T06:38:13.888779+0000","last_undegraded":"2024-03-04T06:38:13.888779+0000","last_fullsized":"2024-03-04T06:38:13.888779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:45.975559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:14.906826+0000","last_change":"2024-03-04T06:38:12.906674+0000","last_active":"2024-03-04T06:38:14.906826+0000","last_peered":"2024-03-04T06:38:14.906826+0000","last_clean":"2024-03-04T06:38:14.906826+0000","last_became_active":"2024-03-04T06:38:12.906385+0000","last_became_peered":"2024-03-04T06:38:12.906385+0000","last_unstale":"2024-03-04T06:38:14.906826+0000","last_undegraded":"2024-03-04T06:38:14.906826+0000","last_fullsized":"2024-03-04T06:38:14.906826+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:29:56.436800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.892560+0000","last_change":"2024-03-04T06:38:12.555463+0000","last_active":"2024-03-04T06:38:12.892560+0000","last_peered":"2024-03-04T06:38:12.892560+0000","last_clean":"2024-03-04T06:38:12.892560+0000","last_became_active":"2024-03-04T06:38:12.555150+0000","last_became_peered":"2024-03-04T06:38:12.555150+0000","last_unstale":"2024-03-04T06:38:12.892560+0000","last_undegraded":"2024-03-04T06:38:12.892560+0000","last_fullsized":"2024-03-04T06:38:12.892560+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:30.714863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.406835+0000","last_change":"2024-03-04T06:38:12.897860+0000","last_active":"2024-03-04T06:38:15.406835+0000","last_peered":"2024-03-04T06:38:15.406835+0000","last_clean":"2024-03-04T06:38:15.406835+0000","last_became_active":"2024-03-04T06:38:12.897568+0000","last_became_peered":"2024-03-04T06:38:12.897568+0000","last_unstale":"2024-03-04T06:38:15.406835+0000","last_undegraded":"2024-03-04T06:38:15.406835+0000","last_fullsized":"2024-03-04T06:38:15.406835+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:22:30.116519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.894505+0000","last_change":"2024-03-04T06:38:12.556223+0000","last_active":"2024-03-04T06:38:12.894505+0000","last_peered":"2024-03-04T06:38:12.894505+0000","last_clean":"2024-03-04T06:38:12.894505+0000","last_became_active":"2024-03-04T06:38:12.555948+0000","last_became_peered":"2024-03-04T06:38:12.555948+0000","last_unstale":"2024-03-04T06:38:12.894505+0000","last_undegraded":"2024-03-04T06:38:12.894505+0000","last_fullsized":"2024-03-04T06:38:12.894505+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:19:51.659542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407827+0000","last_change":"2024-03-04T06:38:12.908686+0000","last_active":"2024-03-04T06:38:15.407827+0000","last_peered":"2024-03-04T06:38:15.407827+0000","last_clean":"2024-03-04T06:38:15.407827+0000","last_became_active":"2024-03-04T06:38:12.907114+0000","last_became_peered":"2024-03-04T06:38:12.907114+0000","last_unstale":"2024-03-04T06:38:15.407827+0000","last_undegraded":"2024-03-04T06:38:15.407827+0000","last_fullsized":"2024-03-04T06:38:15.407827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:08:03.009115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889065+0000","last_change":"2024-03-04T06:38:12.558399+0000","last_active":"2024-03-04T06:38:13.889065+0000","last_peered":"2024-03-04T06:38:13.889065+0000","last_clean":"2024-03-04T06:38:13.889065+0000","last_became_active":"2024-03-04T06:38:12.558068+0000","last_became_peered":"2024-03-04T06:38:12.558068+0000","last_unstale":"2024-03-04T06:38:13.889065+0000","last_undegraded":"2024-03-04T06:38:13.889065+0000","last_fullsized":"2024-03-04T06:38:13.889065+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:00.895079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.080878+0000","last_change":"2024-03-04T06:38:12.904212+0000","last_active":"2024-03-04T06:38:15.080878+0000","last_peered":"2024-03-04T06:38:15.080878+0000","last_clean":"2024-03-04T06:38:15.080878+0000","last_became_active":"2024-03-04T06:38:12.903906+0000","last_became_peered":"2024-03-04T06:38:12.903906+0000","last_unstale":"2024-03-04T06:38:15.080878+0000","last_undegraded":"2024-03-04T06:38:15.080878+0000","last_fullsized":"2024-03-04T06:38:15.080878+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:27:10.766546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887826+0000","last_change":"2024-03-04T06:38:12.548200+0000","last_active":"2024-03-04T06:38:13.887826+0000","last_peered":"2024-03-04T06:38:13.887826+0000","last_clean":"2024-03-04T06:38:13.887826+0000","last_became_active":"2024-03-04T06:38:12.547906+0000","last_became_peered":"2024-03-04T06:38:12.547906+0000","last_unstale":"2024-03-04T06:38:13.887826+0000","last_undegraded":"2024-03-04T06:38:13.887826+0000","last_fullsized":"2024-03-04T06:38:13.887826+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:11:39.491360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889452+0000","last_change":"2024-03-04T06:38:12.918955+0000","last_active":"2024-03-04T06:38:13.889452+0000","last_peered":"2024-03-04T06:38:13.889452+0000","last_clean":"2024-03-04T06:38:13.889452+0000","last_became_active":"2024-03-04T06:38:12.918684+0000","last_became_peered":"2024-03-04T06:38:12.918684+0000","last_unstale":"2024-03-04T06:38:13.889452+0000","last_undegraded":"2024-03-04T06:38:13.889452+0000","last_fullsized":"2024-03-04T06:38:13.889452+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:47:29.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.908932+0000","last_change":"2024-03-04T06:38:12.547660+0000","last_active":"2024-03-04T06:38:12.908932+0000","last_peered":"2024-03-04T06:38:12.908932+0000","last_clean":"2024-03-04T06:38:12.908932+0000","last_became_active":"2024-03-04T06:38:12.547358+0000","last_became_peered":"2024-03-04T06:38:12.547358+0000","last_unstale":"2024-03-04T06:38:12.908932+0000","last_undegraded":"2024-03-04T06:38:12.908932+0000","last_fullsized":"2024-03-04T06:38:12.908932+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:10.370020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407342+0000","last_change":"2024-03-04T06:38:12.902066+0000","last_active":"2024-03-04T06:38:15.407342+0000","last_peered":"2024-03-04T06:38:15.407342+0000","last_clean":"2024-03-04T06:38:15.407342+0000","last_became_active":"2024-03-04T06:38:12.901331+0000","last_became_peered":"2024-03-04T06:38:12.901331+0000","last_unstale":"2024-03-04T06:38:15.407342+0000","last_undegraded":"2024-03-04T06:38:15.407342+0000","last_fullsized":"2024-03-04T06:38:15.407342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:46:51.413734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.888468+0000","last_change":"2024-03-04T06:38:12.547376+0000","last_active":"2024-03-04T06:38:13.888468+0000","last_peered":"2024-03-04T06:38:13.888468+0000","last_clean":"2024-03-04T06:38:13.888468+0000","last_became_active":"2024-03-04T06:38:12.547108+0000","last_became_peered":"2024-03-04T06:38:12.547108+0000","last_unstale":"2024-03-04T06:38:13.888468+0000","last_undegraded":"2024-03-04T06:38:13.888468+0000","last_fullsized":"2024-03-04T06:38:13.888468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:34:14.300865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.889848+0000","last_change":"2024-03-04T06:38:12.917263+0000","last_active":"2024-03-04T06:38:13.889848+0000","last_peered":"2024-03-04T06:38:13.889848+0000","last_clean":"2024-03-04T06:38:13.889848+0000","last_became_active":"2024-03-04T06:38:12.917001+0000","last_became_peered":"2024-03-04T06:38:12.917001+0000","last_unstale":"2024-03-04T06:38:13.889848+0000","last_undegraded":"2024-03-04T06:38:13.889848+0000","last_fullsized":"2024-03-04T06:38:13.889848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:54.912481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.080699+0000","last_change":"2024-03-04T06:38:12.916968+0000","last_active":"2024-03-04T06:38:15.080699+0000","last_peered":"2024-03-04T06:38:15.080699+0000","last_clean":"2024-03-04T06:38:15.080699+0000","last_became_active":"2024-03-04T06:38:12.916669+0000","last_became_peered":"2024-03-04T06:38:12.916669+0000","last_unstale":"2024-03-04T06:38:15.080699+0000","last_undegraded":"2024-03-04T06:38:15.080699+0000","last_fullsized":"2024-03-04T06:38:15.080699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:18:16.919063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887725+0000","last_change":"2024-03-04T06:38:12.892619+0000","last_active":"2024-03-04T06:38:13.887725+0000","last_peered":"2024-03-04T06:38:13.887725+0000","last_clean":"2024-03-04T06:38:13.887725+0000","last_became_active":"2024-03-04T06:38:12.892261+0000","last_became_peered":"2024-03-04T06:38:12.892261+0000","last_unstale":"2024-03-04T06:38:13.887725+0000","last_undegraded":"2024-03-04T06:38:13.887725+0000","last_fullsized":"2024-03-04T06:38:13.887725+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:19:13.957414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407319+0000","last_change":"2024-03-04T06:38:12.899301+0000","last_active":"2024-03-04T06:38:15.407319+0000","last_peered":"2024-03-04T06:38:15.407319+0000","last_clean":"2024-03-04T06:38:15.407319+0000","last_became_active":"2024-03-04T06:38:12.898002+0000","last_became_peered":"2024-03-04T06:38:12.898002+0000","last_unstale":"2024-03-04T06:38:15.407319+0000","last_undegraded":"2024-03-04T06:38:15.407319+0000","last_fullsized":"2024-03-04T06:38:15.407319+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:46.969732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887748+0000","last_change":"2024-03-04T06:38:12.908610+0000","last_active":"2024-03-04T06:38:13.887748+0000","last_peered":"2024-03-04T06:38:13.887748+0000","last_clean":"2024-03-04T06:38:13.887748+0000","last_became_active":"2024-03-04T06:38:12.907578+0000","last_became_peered":"2024-03-04T06:38:12.907578+0000","last_unstale":"2024-03-04T06:38:13.887748+0000","last_undegraded":"2024-03-04T06:38:13.887748+0000","last_fullsized":"2024-03-04T06:38:13.887748+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:52.078874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407709+0000","last_change":"2024-03-04T06:38:12.906536+0000","last_active":"2024-03-04T06:38:15.407709+0000","last_peered":"2024-03-04T06:38:15.407709+0000","last_clean":"2024-03-04T06:38:15.407709+0000","last_became_active":"2024-03-04T06:38:12.906183+0000","last_became_peered":"2024-03-04T06:38:12.906183+0000","last_unstale":"2024-03-04T06:38:15.407709+0000","last_undegraded":"2024-03-04T06:38:15.407709+0000","last_fullsized":"2024-03-04T06:38:15.407709+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:15:13.559021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-04T06:38:12.900563+0000","last_change":"2024-03-04T06:38:12.899871+0000","last_active":"2024-03-04T06:38:12.900563+0000","last_peered":"2024-03-04T06:38:12.900563+0000","last_clean":"2024-03-04T06:38:12.900563+0000","last_became_active":"2024-03-04T06:38:12.899583+0000","last_became_peered":"2024-03-04T06:38:12.899583+0000","last_unstale":"2024-03-04T06:38:12.900563+0000","last_undegraded":"2024-03-04T06:38:12.900563+0000","last_fullsized":"2024-03-04T06:38:12.900563+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:51.628806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.081246+0000","last_change":"2024-03-04T06:38:12.914660+0000","last_active":"2024-03-04T06:38:15.081246+0000","last_peered":"2024-03-04T06:38:15.081246+0000","last_clean":"2024-03-04T06:38:15.081246+0000","last_became_active":"2024-03-04T06:38:12.914354+0000","last_became_peered":"2024-03-04T06:38:12.914354+0000","last_unstale":"2024-03-04T06:38:15.081246+0000","last_undegraded":"2024-03-04T06:38:15.081246+0000","last_fullsized":"2024-03-04T06:38:15.081246+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:28.750455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407699+0000","last_change":"2024-03-04T06:38:12.906752+0000","last_active":"2024-03-04T06:38:15.407699+0000","last_peered":"2024-03-04T06:38:15.407699+0000","last_clean":"2024-03-04T06:38:15.407699+0000","last_became_active":"2024-03-04T06:38:12.906492+0000","last_became_peered":"2024-03-04T06:38:12.906492+0000","last_unstale":"2024-03-04T06:38:15.407699+0000","last_undegraded":"2024-03-04T06:38:15.407699+0000","last_fullsized":"2024-03-04T06:38:15.407699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:24.841196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407045+0000","last_change":"2024-03-04T06:38:12.897151+0000","last_active":"2024-03-04T06:38:15.407045+0000","last_peered":"2024-03-04T06:38:15.407045+0000","last_clean":"2024-03-04T06:38:15.407045+0000","last_became_active":"2024-03-04T06:38:12.896787+0000","last_became_peered":"2024-03-04T06:38:12.896787+0000","last_unstale":"2024-03-04T06:38:15.407045+0000","last_undegraded":"2024-03-04T06:38:15.407045+0000","last_fullsized":"2024-03-04T06:38:15.407045+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:12:22.562737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407449+0000","last_change":"2024-03-04T06:38:12.908348+0000","last_active":"2024-03-04T06:38:15.407449+0000","last_peered":"2024-03-04T06:38:15.407449+0000","last_clean":"2024-03-04T06:38:15.407449+0000","last_became_active":"2024-03-04T06:38:12.908021+0000","last_became_peered":"2024-03-04T06:38:12.908021+0000","last_unstale":"2024-03-04T06:38:15.407449+0000","last_undegraded":"2024-03-04T06:38:15.407449+0000","last_fullsized":"2024-03-04T06:38:15.407449+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:16:36.050910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.407299+0000","last_change":"2024-03-04T06:38:12.898994+0000","last_active":"2024-03-04T06:38:15.407299+0000","last_peered":"2024-03-04T06:38:15.407299+0000","last_clean":"2024-03-04T06:38:15.407299+0000","last_became_active":"2024-03-04T06:38:12.898693+0000","last_became_peered":"2024-03-04T06:38:12.898693+0000","last_unstale":"2024-03-04T06:38:15.407299+0000","last_undegraded":"2024-03-04T06:38:15.407299+0000","last_fullsized":"2024-03-04T06:38:15.407299+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:40:01.173992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:13.887664+0000","last_change":"2024-03-04T06:38:12.898036+0000","last_active":"2024-03-04T06:38:13.887664+0000","last_peered":"2024-03-04T06:38:13.887664+0000","last_clean":"2024-03-04T06:38:13.887664+0000","last_became_active":"2024-03-04T06:38:12.897717+0000","last_became_peered":"2024-03-04T06:38:12.897717+0000","last_unstale":"2024-03-04T06:38:13.887664+0000","last_undegraded":"2024-03-04T06:38:13.887664+0000","last_fullsized":"2024-03-04T06:38:13.887664+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:58:02.821482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-04T06:38:15.081021+0000","last_change":"2024-03-04T06:38:12.915624+0000","last_active":"2024-03-04T06:38:15.081021+0000","last_peered":"2024-03-04T06:38:15.081021+0000","last_clean":"2024-03-04T06:38:15.081021+0000","last_became_active":"2024-03-04T06:38:12.915335+0000","last_became_peered":"2024-03-04T06:38:12.915335+0000","last_unstale":"2024-03-04T06:38:15.081021+0000","last_undegraded":"2024-03-04T06:38:15.081021+0000","last_fullsized":"2024-03-04T06:38:15.081021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:52:58.038264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":7086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28212,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716940,"statfs":{"total":95995035648,"available":95966146560,"internally_reserved":0,"allocated":1220608,"data_stored":850082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495627,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28216,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716936,"statfs":{"total":95995035648,"available":95966142464,"internally_reserved":0,"allocated":1216512,"data_stored":844643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717524,"statfs":{"total":95995035648,"available":95966744576,"internally_reserved":0,"allocated":618496,"data_stored":252871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:35 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.31900000000000001,"15min":0.313},"min":{"1min":0.254,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.35599999999999998}]},{"osd":2,"last update":"Mon Mar 4 06:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.311},{"interface":"front","average":{"1min":0.441,"5min":0.375,"15min":0.36399999999999999},"min":{"1min":0.32300000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.378}]},{"osd":3,"last update":"Mon Mar 4 06:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Mar 4 06:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28232,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716920,"statfs":{"total":95995035648,"available":95966126080,"internally_reserved":0,"allocated":1232896,"data_stored":850537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 4 06:37:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.27700000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.28799999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.28599999999999998}]},{"osd":2,"last update":"Mon Mar 4 06:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.38800000000000001},"min":{"1min":0.30499999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57399999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63200000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.32100000000000001}]},{"osd":3,"last update":"Mon Mar 4 06:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.34200000000000003}]},{"osd":4,"last update":"Mon Mar 4 06:37:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65400000000000003}]},{"osd":5,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411358,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717532,"statfs":{"total":95995035648,"available":95966752768,"internally_reserved":0,"allocated":610304,"data_stored":252711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.33700000000000002,"15min":0.32100000000000001},"min":{"1min":0.308,"5min":0.221,"15min":0.221},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.373,"15min":0.36299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.25800000000000001}]},{"osd":1,"last update":"Mon Mar 4 06:37:55 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.378,"15min":0.36599999999999999},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.32500000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.30299999999999999}]},{"osd":3,"last update":"Mon Mar 4 06:37:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.28899999999999998}]},{"osd":4,"last update":"Mon Mar 4 06:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60899999999999999}]},{"osd":5,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182426,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717508,"statfs":{"total":95995035648,"available":95966728192,"internally_reserved":0,"allocated":630784,"data_stored":254379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36099999999999999}]},{"osd":1,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.374}]},{"osd":2,"last update":"Mon Mar 4 06:37:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.307}]},{"osd":4,"last update":"Mon Mar 4 06:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.433},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Mar 4 06:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":4,"up_from":30,"seq":128849018901,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717504,"statfs":{"total":95995035648,"available":95966724096,"internally_reserved":0,"allocated":638976,"data_stored":260149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.61099999999999999}]},{"osd":1,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.626},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.56299999999999994}]},{"osd":3,"last update":"Mon Mar 4 06:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.498}]},{"osd":5,"last update":"Mon Mar 4 06:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.433},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757264,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27644,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717508,"statfs":{"total":95995035648,"available":95966728192,"internally_reserved":0,"allocated":634880,"data_stored":260764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.41099999999999998}]},{"osd":1,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.436},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.34599999999999997}]},{"osd":3,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":6.6180000000000003,"5min":6.6180000000000003,"15min":6.6180000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Mar 4 06:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:38:20.539 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-04T06:38:20.539 INFO:tasks.cephadm:Adding prometheus.a on smithi203 2024-03-04T06:38:20.540 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch apply prometheus '1;smithi203=a' 2024-03-04T06:38:20.756 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:38:21.526 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:21 smithi203 ceph-mon[30756]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:21.618 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:21 smithi203 ceph-mon[30756]: pgmap v191: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-03-04T06:38:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:21 smithi137 ceph-mon[37364]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:21 smithi137 ceph-mon[37364]: pgmap v191: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-03-04T06:38:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:21 smithi137 ceph-mon[26846]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:38:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:21 smithi137 ceph-mon[26846]: pgmap v191: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-03-04T06:38:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled prometheus update... 2024-03-04T06:38:23.087 DEBUG:teuthology.orchestra.run.smithi203:prometheus.a> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@prometheus.a.service 2024-03-04T06:38:23.090 INFO:tasks.cephadm:Adding node-exporter.a on smithi137 2024-03-04T06:38:23.090 INFO:tasks.cephadm:Adding node-exporter.b on smithi203 2024-03-04T06:38:23.090 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch apply node-exporter '2;smithi137=a;smithi203=b' 2024-03-04T06:38:23.360 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:38:23.703 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:23 smithi203 ceph-mon[30756]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi203=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:23.703 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:23 smithi203 ceph-mon[30756]: Saving service prometheus spec with placement smithi203=a;count:1 2024-03-04T06:38:23.703 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:23 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:23.703 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:23 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:23.703 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:23 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:23.703 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:23 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:23.704 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:23 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:23.704 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:23 smithi203 ceph-mon[30756]: Deploying daemon prometheus.a on smithi203 2024-03-04T06:38:23.704 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:23 smithi203 ceph-mon[30756]: pgmap v192: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-03-04T06:38:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[37364]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi203=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[37364]: Saving service prometheus spec with placement smithi203=a;count:1 2024-03-04T06:38:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[37364]: Deploying daemon prometheus.a on smithi203 2024-03-04T06:38:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[37364]: pgmap v192: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-03-04T06:38:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[26846]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi203=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[26846]: Saving service prometheus spec with placement smithi203=a;count:1 2024-03-04T06:38:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[26846]: Deploying daemon prometheus.a on smithi203 2024-03-04T06:38:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:23 smithi137 ceph-mon[26846]: pgmap v192: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-03-04T06:38:25.627 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled node-exporter update... 2024-03-04T06:38:26.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:26 smithi137 ceph-mon[26846]: pgmap v193: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-03-04T06:38:26.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:26 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:26.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:26 smithi137 ceph-mon[37364]: pgmap v193: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-03-04T06:38:26.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:26 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:26.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:26 smithi203 ceph-mon[30756]: pgmap v193: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-03-04T06:38:26.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:26 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:26.593 DEBUG:teuthology.orchestra.run.smithi137:node-exporter.a> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.a.service 2024-03-04T06:38:26.595 DEBUG:teuthology.orchestra.run.smithi203:node-exporter.b> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.b.service 2024-03-04T06:38:26.598 INFO:tasks.cephadm:Adding alertmanager.a on smithi137 2024-03-04T06:38:26.598 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch apply alertmanager '1;smithi137=a' 2024-03-04T06:38:26.839 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:38:27.285 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:27 smithi203 ceph-mon[30756]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi137=a;smithi203=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:27.285 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:27 smithi203 ceph-mon[30756]: Saving service node-exporter spec with placement smithi137=a;smithi203=b;count:2 2024-03-04T06:38:27.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:27 smithi137 ceph-mon[26846]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi137=a;smithi203=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:27.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:27 smithi137 ceph-mon[26846]: Saving service node-exporter spec with placement smithi137=a;smithi203=b;count:2 2024-03-04T06:38:27.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:27 smithi137 ceph-mon[37364]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi137=a;smithi203=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:27 smithi137 ceph-mon[37364]: Saving service node-exporter spec with placement smithi137=a;smithi203=b;count:2 2024-03-04T06:38:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:28 smithi203 ceph-mon[30756]: pgmap v194: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-03-04T06:38:28.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:28 smithi137 ceph-mon[26846]: pgmap v194: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-03-04T06:38:28.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:28 smithi137 ceph-mon[37364]: pgmap v194: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-03-04T06:38:29.327 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled alertmanager update... 2024-03-04T06:38:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:30 smithi203 ceph-mon[30756]: pgmap v195: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 767 B/s wr, 0 op/s 2024-03-04T06:38:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:30 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:30.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:30 smithi137 ceph-mon[26846]: pgmap v195: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 767 B/s wr, 0 op/s 2024-03-04T06:38:30.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:30 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:30.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:30 smithi137 ceph-mon[37364]: pgmap v195: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 767 B/s wr, 0 op/s 2024-03-04T06:38:30.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:30 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:30.817 DEBUG:teuthology.orchestra.run.smithi137:alertmanager.a> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@alertmanager.a.service 2024-03-04T06:38:30.820 INFO:tasks.cephadm:Adding grafana.a on smithi203 2024-03-04T06:38:30.820 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph orch apply grafana '1;smithi203=a' 2024-03-04T06:38:31.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:31 smithi137 ceph-mon[26846]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi137=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:31.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:31 smithi137 ceph-mon[26846]: Saving service alertmanager spec with placement smithi137=a;count:1 2024-03-04T06:38:31.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:31 smithi137 ceph-mon[37364]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi137=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:31.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:31 smithi137 ceph-mon[37364]: Saving service alertmanager spec with placement smithi137=a;count:1 2024-03-04T06:38:31.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:31 smithi203 ceph-mon[30756]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi137=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:31.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:31 smithi203 ceph-mon[30756]: Saving service alertmanager spec with placement smithi137=a;count:1 2024-03-04T06:38:31.351 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:38:32.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:32 smithi203 ceph-mon[30756]: pgmap v196: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-04T06:38:32.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:32 smithi137 ceph-mon[26846]: pgmap v196: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-04T06:38:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:32 smithi137 ceph-mon[37364]: pgmap v196: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-04T06:38:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:34 smithi203 ceph-mon[30756]: pgmap v197: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:34.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:34 smithi137 ceph-mon[26846]: pgmap v197: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:34.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:34 smithi137 ceph-mon[37364]: pgmap v197: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:36.296 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:36 smithi203 ceph-mon[30756]: pgmap v198: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:36.331 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled grafana update... 2024-03-04T06:38:36.345 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:36 smithi137 ceph-mon[26846]: pgmap v198: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:36.345 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:36 smithi137 ceph-mon[37364]: pgmap v198: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:36.918 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:38:36 smithi203 systemd[1]: Started Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:38:37.205 DEBUG:teuthology.orchestra.run.smithi203:grafana.a> sudo journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@grafana.a.service 2024-03-04T06:38:37.207 INFO:tasks.cephadm:Setting up client nodes... 2024-03-04T06:38:37.208 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-04T06:38:37.426 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:37.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[26846]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi203=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:37.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[26846]: Saving service grafana spec with placement smithi203=a;count:1 2024-03-04T06:38:37.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:37.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:37.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:37.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:37.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-04T06:38:37.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[26846]: pgmap v199: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:37.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[37364]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi203=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:37.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[37364]: Saving service grafana spec with placement smithi203=a;count:1 2024-03-04T06:38:37.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:37.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:37.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:37.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:37.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-04T06:38:37.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-mon[37364]: pgmap v199: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:37.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:37 smithi203 ceph-mon[30756]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi203=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:38:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:37 smithi203 ceph-mon[30756]: Saving service grafana spec with placement smithi203=a;count:1 2024-03-04T06:38:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:37 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:37 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:37 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:37 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' 2024-03-04T06:38:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:37 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-04T06:38:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:37 smithi203 ceph-mon[30756]: pgmap v199: 97 pgs: 97 active+clean; 579 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:38.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ignoring --setuser ceph since I am not root 2024-03-04T06:38:38.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ignoring --setgroup ceph since I am not root 2024-03-04T06:38:38.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: ignoring --setuser ceph since I am not root 2024-03-04T06:38:38.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: ignoring --setgroup ceph since I am not root 2024-03-04T06:38:38.709 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:38.400+0000 7fdb63512200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T06:38:38.709 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:38.496+0000 7fdb63512200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T06:38:38.833 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:38.389+0000 7fb923093200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T06:38:38.833 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:38.482+0000 7fb923093200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T06:38:38.988 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:38 smithi137 ceph-mon[26846]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-04T06:38:38.988 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:38 smithi137 ceph-mon[26846]: mgrmap e16: y(active, since 4m), standbys: x 2024-03-04T06:38:38.989 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:38 smithi137 ceph-mon[37364]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-04T06:38:38.989 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:38 smithi137 ceph-mon[37364]: mgrmap e16: y(active, since 4m), standbys: x 2024-03-04T06:38:39.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:38 smithi203 ceph-mon[30756]: from='mgr.14152 172.21.15.137:0/3743245075' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-04T06:38:39.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:38 smithi203 ceph-mon[30756]: mgrmap e16: y(active, since 4m), standbys: x 2024-03-04T06:38:39.241 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:39.146+0000 7fdb63512200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T06:38:39.241 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:39.240+0000 7fdb63512200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T06:38:39.450 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:39.119+0000 7fb923093200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T06:38:39.450 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:39.210+0000 7fb923093200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T06:38:39.450 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:39.353+0000 7fb923093200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T06:38:39.450 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:39.448+0000 7fb923093200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T06:38:39.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:39.394+0000 7fdb63512200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T06:38:39.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:39.490+0000 7fdb63512200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T06:38:39.557 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-03-04T06:38:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBvbOVl88nyIBAACYeK6FJO3X3+AFPSEQpICw== 2024-03-04T06:38:39.795 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:39.531+0000 7fb923093200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T06:38:39.835 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:39.577+0000 7fdb63512200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T06:38:40.085 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:39 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1431769086' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-04T06:38:40.085 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:39 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1431769086' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-04T06:38:40.085 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:39.795+0000 7fb923093200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T06:38:40.085 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:39.906+0000 7fb923093200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T06:38:40.085 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:39.991+0000 7fb923093200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T06:38:40.085 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:40.084+0000 7fb923093200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T06:38:40.135 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:39 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1431769086' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-04T06:38:40.135 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:39 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1431769086' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-04T06:38:40.135 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:39 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1431769086' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-04T06:38:40.136 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:39 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1431769086' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-04T06:38:40.136 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:39.844+0000 7fdb63512200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T06:38:40.136 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:39.954+0000 7fdb63512200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T06:38:40.136 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:40.040+0000 7fdb63512200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T06:38:40.136 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:40.135+0000 7fdb63512200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T06:38:40.215 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:38:40.215 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-04T06:38:40.216 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-04T06:38:40.261 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-04T06:38:40.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:40.261+0000 7fb923093200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T06:38:40.471 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T06:38:40.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:40.316+0000 7fdb63512200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T06:38:41.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:41.262+0000 7fdb63512200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T06:38:41.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:41.392+0000 7fdb63512200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T06:38:41.575 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:41.253+0000 7fb923093200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T06:38:41.575 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:41.387+0000 7fb923093200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T06:38:41.845 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:41.730+0000 7fb923093200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T06:38:41.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:41.822+0000 7fb923093200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T06:38:42.011 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:41.727+0000 7fdb63512200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T06:38:42.011 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:41.816+0000 7fdb63512200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T06:38:42.291 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:42.032+0000 7fb923093200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:38:42.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:42.010+0000 7fdb63512200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:38:42.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:42.194+0000 7fdb63512200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T06:38:42.499 INFO:teuthology.orchestra.run.smithi203.stdout:[client.1] 2024-03-04T06:38:42.499 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBybOVlhO2HHRAAy7nGUzsBVPb1qA+OaPPRkg== 2024-03-04T06:38:42.549 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:42.290+0000 7fb923093200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T06:38:42.742 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:42.480+0000 7fdb63512200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:38:42.743 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:42 smithi137 ceph-mon[26846]: from='client.? 172.21.15.203:0/1512004353' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-04T06:38:42.743 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:42 smithi137 ceph-mon[26846]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-04T06:38:42.743 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:42 smithi137 ceph-mon[26846]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-04T06:38:42.743 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:42 smithi137 ceph-mon[37364]: from='client.? 172.21.15.203:0/1512004353' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-04T06:38:42.743 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:42 smithi137 ceph-mon[37364]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-04T06:38:42.743 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:42 smithi137 ceph-mon[37364]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-04T06:38:42.808 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:42 smithi203 ceph-mon[30756]: from='client.? 172.21.15.203:0/1512004353' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-04T06:38:42.808 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:42 smithi203 ceph-mon[30756]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-04T06:38:42.808 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:42 smithi203 ceph-mon[30756]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-04T06:38:42.808 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:42.595+0000 7fb923093200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:38:43.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:42.742+0000 7fdb63512200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T06:38:43.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:42.975+0000 7fdb63512200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T06:38:43.095 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:42.865+0000 7fb923093200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T06:38:43.165 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-04T06:38:43.165 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-03-04T06:38:43.165 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-04T06:38:43.208 INFO:tasks.cephadm:Waiting for OSDs to come up 2024-03-04T06:38:43.208 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-04T06:38:43.493 INFO:teuthology.misc.health.smithi137.stdout: 2024-03-04T06:38:43.493 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":62,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:38:13.881442+0000","last_up_change":"2024-03-04T06:37:54.799220+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T06:38:11.049505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T06:38:12.066145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6803","nonce":120753079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6805","nonce":120753079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6809","nonce":120753079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6807","nonce":120753079}]},"public_addr":"172.21.15.137:6803/120753079","cluster_addr":"172.21.15.137:6805/120753079","heartbeat_back_addr":"172.21.15.137:6809/120753079","heartbeat_front_addr":"172.21.15.137:6807/120753079","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6811","nonce":2976801936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6813","nonce":2976801936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6817","nonce":2976801936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6815","nonce":2976801936}]},"public_addr":"172.21.15.137:6811/2976801936","cluster_addr":"172.21.15.137:6813/2976801936","heartbeat_back_addr":"172.21.15.137:6817/2976801936","heartbeat_front_addr":"172.21.15.137:6815/2976801936","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6819","nonce":788153355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6821","nonce":788153355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6825","nonce":788153355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6823","nonce":788153355}]},"public_addr":"172.21.15.137:6819/788153355","cluster_addr":"172.21.15.137:6821/788153355","heartbeat_back_addr":"172.21.15.137:6825/788153355","heartbeat_front_addr":"172.21.15.137:6823/788153355","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6827","nonce":1906308615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6829","nonce":1906308615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6833","nonce":1906308615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6831","nonce":1906308615}]},"public_addr":"172.21.15.137:6827/1906308615","cluster_addr":"172.21.15.137:6829/1906308615","heartbeat_back_addr":"172.21.15.137:6833/1906308615","heartbeat_front_addr":"172.21.15.137:6831/1906308615","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6801","nonce":483489448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6803","nonce":483489448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6807","nonce":483489448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6805","nonce":483489448}]},"public_addr":"172.21.15.203:6801/483489448","cluster_addr":"172.21.15.203:6803/483489448","heartbeat_back_addr":"172.21.15.203:6807/483489448","heartbeat_front_addr":"172.21.15.203:6805/483489448","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6809","nonce":1227714102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6811","nonce":1227714102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6815","nonce":1227714102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6813","nonce":1227714102}]},"public_addr":"172.21.15.203:6809/1227714102","cluster_addr":"172.21.15.203:6811/1227714102","heartbeat_back_addr":"172.21.15.203:6815/1227714102","heartbeat_front_addr":"172.21.15.203:6813/1227714102","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6817","nonce":593999121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6819","nonce":593999121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6823","nonce":593999121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6821","nonce":593999121}]},"public_addr":"172.21.15.203:6817/593999121","cluster_addr":"172.21.15.203:6819/593999121","heartbeat_back_addr":"172.21.15.203:6823/593999121","heartbeat_front_addr":"172.21.15.203:6821/593999121","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6825","nonce":4089764819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6827","nonce":4089764819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6831","nonce":4089764819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6829","nonce":4089764819}]},"public_addr":"172.21.15.203:6825/4089764819","cluster_addr":"172.21.15.203:6827/4089764819","heartbeat_back_addr":"172.21.15.203:6831/4089764819","heartbeat_front_addr":"172.21.15.203:6829/4089764819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T06:38:43.504 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-04T06:38:43.504 INFO:tasks.cephadm:Creating RBD pool 2024-03-04T06:38:43.505 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- sudo ceph --cluster ceph osd pool create rbd 8 2024-03-04T06:38:43.549 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:43.103+0000 7fb923093200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T06:38:43.715 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:43.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:43 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2736469943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:43.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:43 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2736469943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:43.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:43 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2736469943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:44.095 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:43.814+0000 7fdb63512200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T06:38:44.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:43.911+0000 7fb923093200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T06:38:44.710 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:44.394+0000 7fdb63512200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T06:38:44.710 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:44.493+0000 7fdb63512200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T06:38:44.775 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:44.482+0000 7fb923093200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T06:38:44.776 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:44.581+0000 7fb923093200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T06:38:45.006 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: Active manager daemon y restarted 2024-03-04T06:38:45.006 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: Activating manager daemon y 2024-03-04T06:38:45.006 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: osdmap e63: 8 total, 8 up, 8 in 2024-03-04T06:38:45.006 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: mgrmap e17: y(active, starting, since 0.0101478s), standbys: x 2024-03-04T06:38:45.006 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:38:45.006 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:38:45.006 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:38:45.006 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:38:45.007 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[26846]: Manager daemon y is now available 2024-03-04T06:38:45.008 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:44.709+0000 7fdb63512200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T06:38:45.008 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:38:44] ENGINE Bus STARTING 2024-03-04T06:38:45.008 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:44.863+0000 7fdac1383700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:38:45.008 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:44.863+0000 7fdac1383700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:38:45.008 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:44.863+0000 7fdac1383700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:38:45.008 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:44.863+0000 7fdac1383700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:38:45.008 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:44.863+0000 7fdac1383700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:38:45.008 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:44.863+0000 7fdac4b8a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:38:45.008 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:44.863+0000 7fdac4b8a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:38:45.009 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:44.863+0000 7fdac4b8a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:38:45.009 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:44.863+0000 7fdac4b8a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:38:45.009 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:44.863+0000 7fdac4b8a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:38:45.009 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: CherryPy Checker: 2024-03-04T06:38:45.009 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: The Application mounted at '' has an empty config. 2024-03-04T06:38:45.009 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:38:45.009 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:38:44] ENGINE Serving on http://:::9283 2024-03-04T06:38:45.009 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:38:44] ENGINE Bus STARTED 2024-03-04T06:38:45.009 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: Active manager daemon y restarted 2024-03-04T06:38:45.009 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: Activating manager daemon y 2024-03-04T06:38:45.009 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: osdmap e63: 8 total, 8 up, 8 in 2024-03-04T06:38:45.009 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: mgrmap e17: y(active, starting, since 0.0101478s), standbys: x 2024-03-04T06:38:45.010 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:38:45.010 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:38:45.010 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:38:45.010 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:38:45.010 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:38:45.010 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:38:45.010 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:38:45.010 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:38:45.010 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:38:45.010 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:38:45.010 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:38:45.010 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:38:45.010 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:38:45.011 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:38:45.011 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:38:45.011 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:38:45.011 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:38:45.011 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:38:45.011 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:44 smithi137 ceph-mon[37364]: Manager daemon y is now available 2024-03-04T06:38:45.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:44.803+0000 7fb923093200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T06:38:45.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: [04/Mar/2024:06:38:44] ENGINE Bus STARTING 2024-03-04T06:38:45.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: CherryPy Checker: 2024-03-04T06:38:45.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: The Application mounted at '' has an empty config. 2024-03-04T06:38:45.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: 2024-03-04T06:38:45.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: [04/Mar/2024:06:38:44] ENGINE Serving on http://:::9283 2024-03-04T06:38:45.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[32654]: [04/Mar/2024:06:38:44] ENGINE Bus STARTED 2024-03-04T06:38:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: Active manager daemon y restarted 2024-03-04T06:38:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: Activating manager daemon y 2024-03-04T06:38:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: osdmap e63: 8 total, 8 up, 8 in 2024-03-04T06:38:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: mgrmap e17: y(active, starting, since 0.0101478s), standbys: x 2024-03-04T06:38:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:38:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:38:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:38:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:38:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:38:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:38:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:38:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:38:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:38:45.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:38:45.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:38:45.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:38:45.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:38:45.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:38:45.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:38:45.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:38:45.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:38:45.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:38:45.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:44 smithi203 ceph-mon[30756]: Manager daemon y is now available 2024-03-04T06:38:45.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:38:45] "GET /metrics HTTP/1.1" 200 28767 "" "Prometheus/2.43.0" 2024-03-04T06:38:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:38:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:38:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:38:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: Standby manager daemon x restarted 2024-03-04T06:38:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: Standby manager daemon x started 2024-03-04T06:38:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/2376121028' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:38:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/2376121028' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:38:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/2376121028' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:38:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/2376121028' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:38:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:38:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:45 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:38:46.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:46.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:46.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:46.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:38:46.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:38:46.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:38:46.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: Standby manager daemon x restarted 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: Standby manager daemon x started 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/2376121028' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/2376121028' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/2376121028' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/2376121028' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:38:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: Standby manager daemon x restarted 2024-03-04T06:38:46.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: Standby manager daemon x started 2024-03-04T06:38:46.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/2376121028' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:38:46.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/2376121028' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:38:46.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/2376121028' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:38:46.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/2376121028' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:38:46.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:38:46.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:45 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:38:46.312 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'rbd' created 2024-03-04T06:38:47.115 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-03-04T06:38:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[26846]: [04/Mar/2024:06:38:44] ENGINE Bus STARTING 2024-03-04T06:38:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[26846]: [04/Mar/2024:06:38:45] ENGINE Serving on https://172.21.15.137:7150 2024-03-04T06:38:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[26846]: [04/Mar/2024:06:38:45] ENGINE Serving on http://172.21.15.137:8765 2024-03-04T06:38:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[26846]: [04/Mar/2024:06:38:45] ENGINE Bus STARTED 2024-03-04T06:38:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/671722682' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-03-04T06:38:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[26846]: mgrmap e18: y(active, since 1.20412s), standbys: x 2024-03-04T06:38:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[26846]: pgmap v3: 97 pgs: 97 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/671722682' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2024-03-04T06:38:47.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[26846]: osdmap e64: 8 total, 8 up, 8 in 2024-03-04T06:38:47.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[26846]: pgmap v5: 105 pgs: 8 unknown, 97 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[37364]: [04/Mar/2024:06:38:44] ENGINE Bus STARTING 2024-03-04T06:38:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[37364]: [04/Mar/2024:06:38:45] ENGINE Serving on https://172.21.15.137:7150 2024-03-04T06:38:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[37364]: [04/Mar/2024:06:38:45] ENGINE Serving on http://172.21.15.137:8765 2024-03-04T06:38:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[37364]: [04/Mar/2024:06:38:45] ENGINE Bus STARTED 2024-03-04T06:38:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/671722682' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-03-04T06:38:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[37364]: mgrmap e18: y(active, since 1.20412s), standbys: x 2024-03-04T06:38:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[37364]: pgmap v3: 97 pgs: 97 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/671722682' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2024-03-04T06:38:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[37364]: osdmap e64: 8 total, 8 up, 8 in 2024-03-04T06:38:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:46 smithi137 ceph-mon[37364]: pgmap v5: 105 pgs: 8 unknown, 97 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:46 smithi203 ceph-mon[30756]: [04/Mar/2024:06:38:44] ENGINE Bus STARTING 2024-03-04T06:38:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:46 smithi203 ceph-mon[30756]: [04/Mar/2024:06:38:45] ENGINE Serving on https://172.21.15.137:7150 2024-03-04T06:38:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:46 smithi203 ceph-mon[30756]: [04/Mar/2024:06:38:45] ENGINE Serving on http://172.21.15.137:8765 2024-03-04T06:38:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:46 smithi203 ceph-mon[30756]: [04/Mar/2024:06:38:45] ENGINE Bus STARTED 2024-03-04T06:38:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:46 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/671722682' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-03-04T06:38:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:46 smithi203 ceph-mon[30756]: mgrmap e18: y(active, since 1.20412s), standbys: x 2024-03-04T06:38:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:46 smithi203 ceph-mon[30756]: pgmap v3: 97 pgs: 97 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:46 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/671722682' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2024-03-04T06:38:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:46 smithi203 ceph-mon[30756]: osdmap e64: 8 total, 8 up, 8 in 2024-03-04T06:38:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:46 smithi203 ceph-mon[30756]: pgmap v5: 105 pgs: 8 unknown, 97 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:47.386 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:48.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-04T06:38:48.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: osdmap e65: 8 total, 8 up, 8 in 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: mgrmap e19: y(active, since 2s), standbys: x 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-04T06:38:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: osdmap e65: 8 total, 8 up, 8 in 2024-03-04T06:38:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: mgrmap e19: y(active, since 2s), standbys: x 2024-03-04T06:38:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:47 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-04T06:38:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: osdmap e65: 8 total, 8 up, 8 in 2024-03-04T06:38:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: mgrmap e19: y(active, since 2s), standbys: x 2024-03-04T06:38:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:48.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:47 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: Adjusting osd_memory_target on smithi203 to 2992M 2024-03-04T06:38:49.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:49.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: osdmap e66: 8 total, 8 up, 8 in 2024-03-04T06:38:49.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:49.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:49.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: Adjusting osd_memory_target on smithi137 to 2992M 2024-03-04T06:38:49.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:49.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:49.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:49.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:38:49.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:38:49.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: pgmap v8: 105 pgs: 8 unknown, 97 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:49.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:38:49.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[26846]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:38:49.067 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: Adjusting osd_memory_target on smithi203 to 2992M 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: osdmap e66: 8 total, 8 up, 8 in 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: Adjusting osd_memory_target on smithi137 to 2992M 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:49.068 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:49.069 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:49.069 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:38:49.069 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:38:49.069 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: pgmap v8: 105 pgs: 8 unknown, 97 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:49.069 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:38:49.069 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:48 smithi137 ceph-mon[37364]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:38:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: Adjusting osd_memory_target on smithi203 to 2992M 2024-03-04T06:38:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: osdmap e66: 8 total, 8 up, 8 in 2024-03-04T06:38:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:38:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: Adjusting osd_memory_target on smithi137 to 2992M 2024-03-04T06:38:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:38:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:38:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:38:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:38:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: pgmap v8: 105 pgs: 8 unknown, 97 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:38:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:48 smithi203 ceph-mon[30756]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:38:49.958 INFO:teuthology.orchestra.run.smithi137.stderr:enabled application 'rbd' on pool 'rbd' 2024-03-04T06:38:50.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[37364]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:38:50.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[37364]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:38:50.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[37364]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:38:50.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[37364]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:38:50.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2669590210' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T06:38:50.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[37364]: Deploying daemon alertmanager.a on smithi137 2024-03-04T06:38:50.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[37364]: mgrmap e20: y(active, since 4s), standbys: x 2024-03-04T06:38:50.288 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[26846]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:38:50.288 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[26846]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:38:50.288 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[26846]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:38:50.288 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[26846]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:38:50.288 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2669590210' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T06:38:50.288 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.288 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.288 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.288 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.288 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.288 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[26846]: Deploying daemon alertmanager.a on smithi137 2024-03-04T06:38:50.288 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:49 smithi137 ceph-mon[26846]: mgrmap e20: y(active, since 4s), standbys: x 2024-03-04T06:38:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:49 smithi203 ceph-mon[30756]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:38:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:49 smithi203 ceph-mon[30756]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:38:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:49 smithi203 ceph-mon[30756]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:38:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:49 smithi203 ceph-mon[30756]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:38:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:49 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2669590210' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T06:38:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:49 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:49 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:49 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:49 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:49 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:38:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:49 smithi203 ceph-mon[30756]: Deploying daemon alertmanager.a on smithi137 2024-03-04T06:38:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:49 smithi203 ceph-mon[30756]: mgrmap e20: y(active, since 4s), standbys: x 2024-03-04T06:38:50.692 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-04T06:38:50.692 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-04T06:38:50.692 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph mgr dump --format=json 2024-03-04T06:38:50.894 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:51.240 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:50 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2669590210' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]': finished 2024-03-04T06:38:51.240 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:50 smithi137 ceph-mon[26846]: osdmap e67: 8 total, 8 up, 8 in 2024-03-04T06:38:51.240 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:50 smithi137 ceph-mon[26846]: pgmap v10: 105 pgs: 8 unknown, 97 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:51.241 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:50 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2669590210' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]': finished 2024-03-04T06:38:51.241 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:50 smithi137 ceph-mon[37364]: osdmap e67: 8 total, 8 up, 8 in 2024-03-04T06:38:51.241 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:50 smithi137 ceph-mon[37364]: pgmap v10: 105 pgs: 8 unknown, 97 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:51.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:50 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2669590210' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]': finished 2024-03-04T06:38:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:50 smithi203 ceph-mon[30756]: osdmap e67: 8 total, 8 up, 8 in 2024-03-04T06:38:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:50 smithi203 ceph-mon[30756]: pgmap v10: 105 pgs: 8 unknown, 97 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:38:52.247 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:51 smithi203 ceph-mon[30756]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-04T06:38:52.247 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:51 smithi203 ceph-mon[30756]: Cluster is now healthy 2024-03-04T06:38:52.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:51 smithi137 ceph-mon[37364]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-04T06:38:52.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:51 smithi137 ceph-mon[37364]: Cluster is now healthy 2024-03-04T06:38:52.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:51 smithi137 ceph-mon[26846]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-04T06:38:52.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:51 smithi137 ceph-mon[26846]: Cluster is now healthy 2024-03-04T06:38:52.803 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:53.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:52 smithi137 ceph-mon[26846]: pgmap v11: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 0 B/s wr, 19 op/s 2024-03-04T06:38:53.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:52 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2349750417' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-04T06:38:53.151 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:52 smithi137 ceph-mon[37364]: pgmap v11: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 0 B/s wr, 19 op/s 2024-03-04T06:38:53.151 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:52 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2349750417' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-04T06:38:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:52 smithi203 ceph-mon[30756]: pgmap v11: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 0 B/s wr, 19 op/s 2024-03-04T06:38:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:52 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2349750417' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-04T06:38:53.574 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"active_gid":14604,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":3917348362},{"type":"v1","addr":"172.21.15.137:6801","nonce":3917348362}]},"active_addr":"172.21.15.137:6801/3917348362","active_change":"2024-03-04T06:38:44.723762+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24448,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.137:8443/","prometheus":"http://172.21.15.137:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":63,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":424246608}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":1807684977}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":95681481}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":79102074}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":2824581155}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":2691855411}]}]} 2024-03-04T06:38:53.579 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-04T06:38:53.579 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-04T06:38:53.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd dump --format=json 2024-03-04T06:38:53.782 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:55.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:38:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:38:55] "GET /metrics HTTP/1.1" 200 28767 "" "Prometheus/2.43.0" 2024-03-04T06:38:55.591 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:55.591 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":67,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:38:49.943377+0000","last_up_change":"2024-03-04T06:37:54.799220+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T06:38:11.049505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T06:38:12.066145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-04T06:38:45.908437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6803","nonce":120753079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6805","nonce":120753079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6809","nonce":120753079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6807","nonce":120753079}]},"public_addr":"172.21.15.137:6803/120753079","cluster_addr":"172.21.15.137:6805/120753079","heartbeat_back_addr":"172.21.15.137:6809/120753079","heartbeat_front_addr":"172.21.15.137:6807/120753079","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6811","nonce":2976801936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6813","nonce":2976801936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6817","nonce":2976801936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6815","nonce":2976801936}]},"public_addr":"172.21.15.137:6811/2976801936","cluster_addr":"172.21.15.137:6813/2976801936","heartbeat_back_addr":"172.21.15.137:6817/2976801936","heartbeat_front_addr":"172.21.15.137:6815/2976801936","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6819","nonce":788153355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6821","nonce":788153355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6825","nonce":788153355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6823","nonce":788153355}]},"public_addr":"172.21.15.137:6819/788153355","cluster_addr":"172.21.15.137:6821/788153355","heartbeat_back_addr":"172.21.15.137:6825/788153355","heartbeat_front_addr":"172.21.15.137:6823/788153355","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6827","nonce":1906308615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6829","nonce":1906308615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6833","nonce":1906308615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6831","nonce":1906308615}]},"public_addr":"172.21.15.137:6827/1906308615","cluster_addr":"172.21.15.137:6829/1906308615","heartbeat_back_addr":"172.21.15.137:6833/1906308615","heartbeat_front_addr":"172.21.15.137:6831/1906308615","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6801","nonce":483489448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6803","nonce":483489448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6807","nonce":483489448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6805","nonce":483489448}]},"public_addr":"172.21.15.203:6801/483489448","cluster_addr":"172.21.15.203:6803/483489448","heartbeat_back_addr":"172.21.15.203:6807/483489448","heartbeat_front_addr":"172.21.15.203:6805/483489448","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6809","nonce":1227714102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6811","nonce":1227714102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6815","nonce":1227714102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6813","nonce":1227714102}]},"public_addr":"172.21.15.203:6809/1227714102","cluster_addr":"172.21.15.203:6811/1227714102","heartbeat_back_addr":"172.21.15.203:6815/1227714102","heartbeat_front_addr":"172.21.15.203:6813/1227714102","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6817","nonce":593999121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6819","nonce":593999121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6823","nonce":593999121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6821","nonce":593999121}]},"public_addr":"172.21.15.203:6817/593999121","cluster_addr":"172.21.15.203:6819/593999121","heartbeat_back_addr":"172.21.15.203:6823/593999121","heartbeat_front_addr":"172.21.15.203:6821/593999121","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6825","nonce":4089764819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6827","nonce":4089764819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6831","nonce":4089764819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6829","nonce":4089764819}]},"public_addr":"172.21.15.203:6825/4089764819","cluster_addr":"172.21.15.203:6827/4089764819","heartbeat_back_addr":"172.21.15.203:6831/4089764819","heartbeat_front_addr":"172.21.15.203:6829/4089764819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/3119089659":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/1351645377":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/2769280127":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6801/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3274678870":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6800/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T06:38:56.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:55 smithi137 ceph-mon[26846]: pgmap v12: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 15 op/s 2024-03-04T06:38:56.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:55 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1936708074' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:56.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:55 smithi137 ceph-mon[37364]: pgmap v12: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 15 op/s 2024-03-04T06:38:56.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:55 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1936708074' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:56.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:55 smithi203 ceph-mon[30756]: pgmap v12: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 15 op/s 2024-03-04T06:38:56.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:55 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1936708074' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:56.347 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-04T06:38:56.347 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd dump --format=json 2024-03-04T06:38:56.552 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:57.908 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:57 smithi137 ceph-mon[26846]: pgmap v13: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-04T06:38:57.909 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:57 smithi137 ceph-mon[37364]: pgmap v13: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-04T06:38:58.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:57 smithi203 ceph-mon[30756]: pgmap v13: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-04T06:38:58.371 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:38:58.371 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":67,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:38:49.943377+0000","last_up_change":"2024-03-04T06:37:54.799220+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T06:38:11.049505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T06:38:12.066145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-04T06:38:45.908437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6803","nonce":120753079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6805","nonce":120753079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6809","nonce":120753079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6807","nonce":120753079}]},"public_addr":"172.21.15.137:6803/120753079","cluster_addr":"172.21.15.137:6805/120753079","heartbeat_back_addr":"172.21.15.137:6809/120753079","heartbeat_front_addr":"172.21.15.137:6807/120753079","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6811","nonce":2976801936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6813","nonce":2976801936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6817","nonce":2976801936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6815","nonce":2976801936}]},"public_addr":"172.21.15.137:6811/2976801936","cluster_addr":"172.21.15.137:6813/2976801936","heartbeat_back_addr":"172.21.15.137:6817/2976801936","heartbeat_front_addr":"172.21.15.137:6815/2976801936","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6819","nonce":788153355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6821","nonce":788153355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6825","nonce":788153355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6823","nonce":788153355}]},"public_addr":"172.21.15.137:6819/788153355","cluster_addr":"172.21.15.137:6821/788153355","heartbeat_back_addr":"172.21.15.137:6825/788153355","heartbeat_front_addr":"172.21.15.137:6823/788153355","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6827","nonce":1906308615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6829","nonce":1906308615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6833","nonce":1906308615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6831","nonce":1906308615}]},"public_addr":"172.21.15.137:6827/1906308615","cluster_addr":"172.21.15.137:6829/1906308615","heartbeat_back_addr":"172.21.15.137:6833/1906308615","heartbeat_front_addr":"172.21.15.137:6831/1906308615","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6801","nonce":483489448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6803","nonce":483489448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6807","nonce":483489448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6805","nonce":483489448}]},"public_addr":"172.21.15.203:6801/483489448","cluster_addr":"172.21.15.203:6803/483489448","heartbeat_back_addr":"172.21.15.203:6807/483489448","heartbeat_front_addr":"172.21.15.203:6805/483489448","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6809","nonce":1227714102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6811","nonce":1227714102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6815","nonce":1227714102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6813","nonce":1227714102}]},"public_addr":"172.21.15.203:6809/1227714102","cluster_addr":"172.21.15.203:6811/1227714102","heartbeat_back_addr":"172.21.15.203:6815/1227714102","heartbeat_front_addr":"172.21.15.203:6813/1227714102","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6817","nonce":593999121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6819","nonce":593999121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6823","nonce":593999121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6821","nonce":593999121}]},"public_addr":"172.21.15.203:6817/593999121","cluster_addr":"172.21.15.203:6819/593999121","heartbeat_back_addr":"172.21.15.203:6823/593999121","heartbeat_front_addr":"172.21.15.203:6821/593999121","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6825","nonce":4089764819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6827","nonce":4089764819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6831","nonce":4089764819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6829","nonce":4089764819}]},"public_addr":"172.21.15.203:6825/4089764819","cluster_addr":"172.21.15.203:6827/4089764819","heartbeat_back_addr":"172.21.15.203:6831/4089764819","heartbeat_front_addr":"172.21.15.203:6829/4089764819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/3119089659":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/1351645377":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/2769280127":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6801/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3274678870":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6800/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T06:38:59.020 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:58 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1662690344' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:59.020 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:58 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1662690344' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:59.042 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-04T06:38:59.042 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-04T06:38:59.043 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-04T06:38:59.043 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-04T06:38:59.044 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-04T06:38:59.044 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-04T06:38:59.045 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-03-04T06:38:59.045 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-03-04T06:38:59.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:58 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1662690344' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:38:59.508 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:59.508 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:59.509 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:59.509 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:59.512 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:59.513 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:59.513 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:59.516 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:38:59.925 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:38:59 smithi137 ceph-mon[26846]: pgmap v14: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-04T06:38:59.925 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:38:59 smithi137 ceph-mon[37364]: pgmap v14: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-04T06:39:00.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:38:59 smithi203 ceph-mon[30756]: pgmap v14: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-04T06:39:00.963 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:00 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:00.964 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:00 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:39:00.964 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:00 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:00.964 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:00 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:39:01.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:00 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:01.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:00 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:39:02.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:01 smithi203 ceph-mon[30756]: pgmap v15: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T06:39:02.121 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:01 smithi137 ceph-mon[26846]: pgmap v15: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T06:39:02.122 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:01 smithi137 ceph-mon[37364]: pgmap v15: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T06:39:04.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:03 smithi203 ceph-mon[30756]: pgmap v16: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-04T06:39:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:03 smithi137 ceph-mon[26846]: pgmap v16: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-04T06:39:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:03 smithi137 ceph-mon[37364]: pgmap v16: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-04T06:39:05.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:39:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:39:05] "GET /metrics HTTP/1.1" 200 33649 "" "Prometheus/2.43.0" 2024-03-04T06:39:06.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:05 smithi137 ceph-mon[26846]: pgmap v17: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:06.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:05 smithi137 ceph-mon[37364]: pgmap v17: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:06.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:05 smithi203 ceph-mon[30756]: pgmap v17: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:08.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:07 smithi203 ceph-mon[30756]: pgmap v18: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:08.258 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:07 smithi137 ceph-mon[26846]: pgmap v18: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:08.259 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:07 smithi137 ceph-mon[37364]: pgmap v18: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:08.281 INFO:teuthology.orchestra.run.smithi137.stdout:128849018911 2024-03-04T06:39:08.281 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-04T06:39:08.927 INFO:teuthology.orchestra.run.smithi137.stdout:197568495637 2024-03-04T06:39:08.927 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-03-04T06:39:10.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:09 smithi137 ceph-mon[26846]: pgmap v19: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:10.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:09 smithi137 ceph-mon[37364]: pgmap v19: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:10.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:09 smithi203 ceph-mon[30756]: pgmap v19: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:11.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:11 smithi203 ceph-mon[30756]: pgmap v20: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:11.743 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:11 smithi137 ceph-mon[26846]: pgmap v20: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:11.744 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:11 smithi137 ceph-mon[37364]: pgmap v20: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:13.720 INFO:teuthology.orchestra.run.smithi137.stdout:231928234001 2024-03-04T06:39:13.721 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-03-04T06:39:13.995 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:13 smithi137 ceph-mon[26846]: pgmap v21: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:13.995 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:13 smithi137 ceph-mon[37364]: pgmap v21: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:14.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:13 smithi203 ceph-mon[30756]: pgmap v21: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:15.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:39:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:39:15] "GET /metrics HTTP/1.1" 200 33652 "" "Prometheus/2.43.0" 2024-03-04T06:39:16.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:15 smithi203 ceph-mon[30756]: pgmap v22: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:16.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:15 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:39:16.175 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:15 smithi137 ceph-mon[26846]: pgmap v22: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:16.175 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:15 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:39:16.175 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:15 smithi137 ceph-mon[37364]: pgmap v22: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:16.175 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:15 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:39:17.441 INFO:teuthology.orchestra.run.smithi137.stdout:163208757275 2024-03-04T06:39:17.441 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-04T06:39:18.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:17 smithi203 ceph-mon[30756]: pgmap v23: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:18.201 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:17 smithi137 ceph-mon[26846]: pgmap v23: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:18.202 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:17 smithi137 ceph-mon[37364]: pgmap v23: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:18.222 INFO:teuthology.orchestra.run.smithi137.stdout:34359738418 2024-03-04T06:39:18.223 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-04T06:39:18.743 INFO:teuthology.orchestra.run.smithi137.stdout:107374182438 2024-03-04T06:39:18.743 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-04T06:39:19.989 INFO:teuthology.orchestra.run.smithi137.stdout:55834574894 2024-03-04T06:39:19.989 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-04T06:39:20.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:19 smithi203 ceph-mon[30756]: pgmap v24: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:20.122 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:19 smithi137 ceph-mon[26846]: pgmap v24: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:20.122 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:19 smithi137 ceph-mon[37364]: pgmap v24: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:21.448 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:39:21.453 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:39:21.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:21 smithi203 ceph-mon[30756]: pgmap v25: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:21 smithi137 ceph-mon[26846]: pgmap v25: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:21 smithi137 ceph-mon[37364]: pgmap v25: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:22.060 INFO:teuthology.orchestra.run.smithi137.stdout:77309411369 2024-03-04T06:39:22.061 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-04T06:39:22.767 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:39:22.767 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:39:22.768 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:39:22.768 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:39:23.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[26846]: pgmap v26: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:23.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:23.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:23.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:23.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:23.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:23.999 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:23.999 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-04T06:39:23.999 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:23.999 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:39:23] ENGINE Bus STOPPING 2024-03-04T06:39:23.999 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:39:23] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T06:39:23.999 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:39:23] ENGINE Bus STOPPED 2024-03-04T06:39:23.999 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:39:23] ENGINE Bus STARTING 2024-03-04T06:39:23.999 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:39:23] ENGINE Serving on http://:::9283 2024-03-04T06:39:23.999 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:39:23] ENGINE Bus STARTED 2024-03-04T06:39:24.000 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[37364]: pgmap v26: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:24.000 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:24.000 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:24.000 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:24.000 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:24.000 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:24.000 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:24.000 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-04T06:39:24.000 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:23 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:24.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:23 smithi203 ceph-mon[30756]: pgmap v26: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:24.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:23 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:24.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:23 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:24.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:23 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:24.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:23 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:24.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:23 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:24.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:23 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:24.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:23 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-04T06:39:24.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:23 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:25.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:24 smithi137 ceph-mon[37364]: Regenerating cephadm self-signed grafana TLS certificates 2024-03-04T06:39:25.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:24 smithi137 ceph-mon[37364]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-04T06:39:25.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:24 smithi137 ceph-mon[37364]: Deploying daemon grafana.a on smithi203 2024-03-04T06:39:25.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:24 smithi137 ceph-mon[26846]: Regenerating cephadm self-signed grafana TLS certificates 2024-03-04T06:39:25.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:24 smithi137 ceph-mon[26846]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-04T06:39:25.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:24 smithi137 ceph-mon[26846]: Deploying daemon grafana.a on smithi203 2024-03-04T06:39:25.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:24 smithi203 ceph-mon[30756]: Regenerating cephadm self-signed grafana TLS certificates 2024-03-04T06:39:25.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:24 smithi203 ceph-mon[30756]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-04T06:39:25.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:24 smithi203 ceph-mon[30756]: Deploying daemon grafana.a on smithi203 2024-03-04T06:39:25.367 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:39:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:39:25] "GET /metrics HTTP/1.1" 200 33652 "" "Prometheus/2.43.0" 2024-03-04T06:39:25.368 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:39:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[70349]: ts=2024-03-04T06:39:25.323Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000686024s 2024-03-04T06:39:25.920 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:25 smithi137 ceph-mon[26846]: pgmap v27: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:25.920 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:25 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:25.921 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:25 smithi137 ceph-mon[37364]: pgmap v27: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:25.921 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:25 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:26.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:25 smithi203 ceph-mon[30756]: pgmap v27: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:26.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:25 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:26.153 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:39:27.971 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:27 smithi137 ceph-mon[26846]: pgmap v28: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:27.971 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:27 smithi137 ceph-mon[37364]: pgmap v28: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:28.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:27 smithi203 ceph-mon[30756]: pgmap v28: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:29.175 INFO:teuthology.orchestra.run.smithi137.stdout:163208757278 2024-03-04T06:39:29.390 INFO:teuthology.orchestra.run.smithi137.stdout:197568495641 2024-03-04T06:39:30.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:29 smithi137 ceph-mon[26846]: pgmap v29: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:30.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:29 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1585499422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-04T06:39:30.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:29 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1786486351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-04T06:39:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:29 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:39:30.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:29 smithi137 ceph-mon[37364]: pgmap v29: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:30.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:29 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1585499422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-04T06:39:30.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:29 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1786486351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-04T06:39:30.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:29 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:39:30.069 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757275 got 163208757278 for osd.5 2024-03-04T06:39:30.070 DEBUG:teuthology.parallel:result is None 2024-03-04T06:39:30.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:29 smithi203 ceph-mon[30756]: pgmap v29: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:30.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:29 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1585499422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-04T06:39:30.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:29 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1786486351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-04T06:39:30.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:29 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:39:30.707 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:39:31.372 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:31 smithi137 ceph-mon[26846]: pgmap v30: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:31.373 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:31 smithi137 ceph-mon[37364]: pgmap v30: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:31.486 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495637 got 197568495641 for osd.6 2024-03-04T06:39:31.486 DEBUG:teuthology.parallel:result is None 2024-03-04T06:39:31.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:31 smithi203 ceph-mon[30756]: pgmap v30: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:31.896 INFO:teuthology.orchestra.run.smithi137.stdout:231928234004 2024-03-04T06:39:32.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:32 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3531430540' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-04T06:39:32.748 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:32 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3531430540' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-04T06:39:32.748 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:32 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3531430540' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-04T06:39:32.770 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234001 got 231928234004 for osd.7 2024-03-04T06:39:32.770 DEBUG:teuthology.parallel:result is None 2024-03-04T06:39:33.406 INFO:teuthology.orchestra.run.smithi137.stdout:55834574898 2024-03-04T06:39:33.406 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:33 smithi137 ceph-mon[26846]: pgmap v31: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:33.407 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:33 smithi137 ceph-mon[37364]: pgmap v31: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:33.407 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:39:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[70349]: ts=2024-03-04T06:39:33.325Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002928532s 2024-03-04T06:39:33.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:33 smithi203 ceph-mon[30756]: pgmap v31: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:34.386 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:34 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2781830429' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-04T06:39:34.387 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:34 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2781830429' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-04T06:39:34.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:34 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2781830429' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-04T06:39:35.071 INFO:teuthology.orchestra.run.smithi137.stdout:128849018916 2024-03-04T06:39:35.324 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:39:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:39:35] "GET /metrics HTTP/1.1" 200 33646 "" "Prometheus/2.43.0" 2024-03-04T06:39:35.455 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574894 got 55834574898 for osd.1 2024-03-04T06:39:35.455 DEBUG:teuthology.parallel:result is None 2024-03-04T06:39:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:35 smithi203 ceph-mon[30756]: pgmap v32: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:35 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3249983863' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-04T06:39:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:35 smithi137 ceph-mon[26846]: pgmap v32: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:35 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3249983863' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-04T06:39:35.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:35 smithi137 ceph-mon[37364]: pgmap v32: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:35.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:35 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3249983863' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-04T06:39:36.267 INFO:teuthology.orchestra.run.smithi137.stdout:34359738422 2024-03-04T06:39:36.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:36 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/675774761' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-04T06:39:36.507 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:36 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/675774761' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-04T06:39:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:36 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/675774761' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-04T06:39:36.711 INFO:teuthology.orchestra.run.smithi137.stdout:107374182441 2024-03-04T06:39:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:37 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2908013190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-04T06:39:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:37 smithi203 ceph-mon[30756]: pgmap v33: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:37.622 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:37 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2908013190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-04T06:39:37.622 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:37 smithi137 ceph-mon[26846]: pgmap v33: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:37.623 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:37 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2908013190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-04T06:39:37.623 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:37 smithi137 ceph-mon[37364]: pgmap v33: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:37.912 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738418 got 34359738422 for osd.0 2024-03-04T06:39:37.912 DEBUG:teuthology.parallel:result is None 2024-03-04T06:39:38.724 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018911 got 128849018916 for osd.4 2024-03-04T06:39:38.725 DEBUG:teuthology.parallel:result is None 2024-03-04T06:39:39.438 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182438 got 107374182441 for osd.3 2024-03-04T06:39:39.438 DEBUG:teuthology.parallel:result is None 2024-03-04T06:39:39.805 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:39 smithi203 systemd[1]: Starting Ceph grafana.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:39:39.827 INFO:teuthology.orchestra.run.smithi137.stdout:77309411374 2024-03-04T06:39:40.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:39 smithi203 ceph-mon[30756]: pgmap v34: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:40.096 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:39 smithi203 podman[61469]: 2024-03-04 06:39:39.776415836 +0000 UTC m=+0.017747842 image pull 954c08fa618887fe9a6fe572ae541197c77e625b05f4193df7898f5ac649ada9 quay.io/ceph/ceph-grafana:9.4.7 2024-03-04T06:39:40.096 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:39 smithi203 podman[61469]: 2024-03-04 06:39:39.902095185 +0000 UTC m=+0.143427186 container create eb19bfb589d8f89746907c5d4c93880b681b536cac93664a5210986924d14a8e (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=ubi8-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.tags=base rhel8, description=Ceph Grafana Container, version=8.5, io.buildah.version=1.32.0, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.display-name=Red Hat Universal Base Image 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, maintainer=Paul Cuzner , vendor=Red Hat, Inc., build-date=2022-04-29T11:48:11.055897, release=239.1651231664, io.openshift.expose-services=, distribution-scope=public, architecture=x86_64, vcs-type=git, name=ubi8) 2024-03-04T06:39:40.187 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:39 smithi137 ceph-mon[26846]: pgmap v34: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:40.187 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:39 smithi137 ceph-mon[37364]: pgmap v34: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:40.347 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 podman[61469]: 2024-03-04 06:39:40.121154103 +0000 UTC m=+0.362486108 container init eb19bfb589d8f89746907c5d4c93880b681b536cac93664a5210986924d14a8e (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a, vcs-type=git, version=8.5, maintainer=Paul Cuzner , build-date=2022-04-29T11:48:11.055897, io.buildah.version=1.32.0, description=Ceph Grafana Container, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, summary=Grafana Container configured for Ceph mgr/dashboard integration, release=239.1651231664, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=ubi8-container, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, name=ubi8, io.k8s.display-name=Red Hat Universal Base Image 8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vendor=Red Hat, Inc., io.openshift.tags=base rhel8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56) 2024-03-04T06:39:40.347 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 podman[61469]: 2024-03-04 06:39:40.123800259 +0000 UTC m=+0.365132261 container start eb19bfb589d8f89746907c5d4c93880b681b536cac93664a5210986924d14a8e (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a, maintainer=Paul Cuzner , architecture=x86_64, io.openshift.expose-services=, distribution-scope=public, summary=Grafana Container configured for Ceph mgr/dashboard integration, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, vcs-type=git, description=Ceph Grafana Container, name=ubi8, version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vendor=Red Hat, Inc., build-date=2022-04-29T11:48:11.055897, io.buildah.version=1.32.0, io.openshift.tags=base rhel8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.k8s.display-name=Red Hat Universal Base Image 8, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=ubi8-container, release=239.1651231664, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-03-04T06:39:40.347 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 bash[61469]: eb19bfb589d8f89746907c5d4c93880b681b536cac93664a5210986924d14a8e 2024-03-04T06:39:40.347 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 systemd[1]: Started Ceph grafana.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:39:40.347 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.281184632Z level=info msg="Starting Grafana" version=9.4.7 commit=4add91f03d branch=HEAD compiled=2023-03-16T23:56:52Z 2024-03-04T06:39:40.347 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.281379197Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-03-04T06:39:40.347 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.281400973Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-03-04T06:39:40.347 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.281409088Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-03-04T06:39:40.348 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.281415068Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-03-04T06:39:40.348 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.281420993Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-03-04T06:39:40.348 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.281427263Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-03-04T06:39:40.348 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.281433301Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-03-04T06:39:40.348 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.281439211Z level=info msg="Path Home" path=/usr/share/grafana 2024-03-04T06:39:40.348 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.281444862Z level=info msg="Path Data" path=/var/lib/grafana 2024-03-04T06:39:40.348 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.281450295Z level=info msg="Path Logs" path=/var/log/grafana 2024-03-04T06:39:40.348 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.281456586Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.28146229Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=settings t=2024-03-04T06:39:40.281468037Z level=info msg="App mode production" 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=sqlstore t=2024-03-04T06:39:40.281524325Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=sqlstore t=2024-03-04T06:39:40.281545869Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.282433688Z level=info msg="Starting DB migrations" 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.28251403Z level=info msg="Executing migration" id="create migration_log table" 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.283040193Z level=info msg="Executing migration" id="create user table" 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.283542248Z level=info msg="Executing migration" id="add unique index user.login" 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.28419505Z level=info msg="Executing migration" id="add unique index user.email" 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.284660736Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.285188143Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.285549973Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.286294203Z level=info msg="Executing migration" id="create user table v2" 2024-03-04T06:39:40.349 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.28670352Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.287094233Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.287507854Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.287853322Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.288191972Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.288654674Z level=info msg="Executing migration" id="Update user table charset" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.288953056Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.289348823Z level=info msg="Executing migration" id="Add missing user data" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.289713217Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.290136538Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.290519323Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.290997216Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.292169873Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.292627968Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-03-04T06:39:40.350 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.293099819Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-03-04T06:39:40.351 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.293527818Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-03-04T06:39:40.351 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.293951445Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-03-04T06:39:40.351 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.294412669Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-03-04T06:39:40.351 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.294739268Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-03-04T06:39:40.352 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.295158102Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-03-04T06:39:40.352 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.295542714Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-03-04T06:39:40.352 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.295960854Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-03-04T06:39:40.352 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.296338114Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-03-04T06:39:40.352 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.297021693Z level=info msg="Executing migration" id="create temp_user v2" 2024-03-04T06:39:40.352 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.297454607Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-03-04T06:39:40.352 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.297878147Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-03-04T06:39:40.352 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.298261166Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-03-04T06:39:40.352 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.298682268Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-03-04T06:39:40.352 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.299108477Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-03-04T06:39:40.352 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.299437386Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-03-04T06:39:40.352 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.299838848Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-03-04T06:39:40.352 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.300187027Z level=info msg="Executing migration" id="create star table" 2024-03-04T06:39:40.353 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.300553362Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-03-04T06:39:40.353 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.300993243Z level=info msg="Executing migration" id="create org table v1" 2024-03-04T06:39:40.353 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.301428679Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-03-04T06:39:40.353 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.301881559Z level=info msg="Executing migration" id="create org_user table v1" 2024-03-04T06:39:40.353 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.302302382Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-03-04T06:39:40.353 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.302740759Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-03-04T06:39:40.353 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.303198322Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-03-04T06:39:40.353 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.303629297Z level=info msg="Executing migration" id="Update org table charset" 2024-03-04T06:39:40.353 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.303939541Z level=info msg="Executing migration" id="Update org_user table charset" 2024-03-04T06:39:40.353 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.304226945Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-03-04T06:39:40.353 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.304543964Z level=info msg="Executing migration" id="create dashboard table" 2024-03-04T06:39:40.353 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.304970597Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-03-04T06:39:40.353 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.307123536Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.307786968Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.308226231Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.308646553Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.309072512Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.31193145Z level=info msg="Executing migration" id="create dashboard v2" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.312348984Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.315176564Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.315635958Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.315999245Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.316833088Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.317192769Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.317710069Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.318692852Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.319409088Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-03-04T06:39:40.354 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.320377722Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-03-04T06:39:40.355 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.321099253Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-03-04T06:39:40.355 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.321930813Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-03-04T06:39:40.355 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.322645988Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-03-04T06:39:40.355 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.323516348Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-03-04T06:39:40.355 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.32427059Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-03-04T06:39:40.355 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.325111478Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-03-04T06:39:40.355 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.326014132Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-03-04T06:39:40.355 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.326823422Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-03-04T06:39:40.355 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.3273888Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-03-04T06:39:40.355 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.327745085Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-03-04T06:39:40.355 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.32861032Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-03-04T06:39:40.355 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.329457145Z level=info msg="Executing migration" id="Update dashboard title length" 2024-03-04T06:39:40.355 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.32981382Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.330630569Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.331059527Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.33203326Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.332889625Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.333378081Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.334235271Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.335071007Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.335920012Z level=info msg="Executing migration" id="Add check_sum column" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.336492478Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.337419889Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.338285058Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.340999416Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.341449232Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-03-04T06:39:40.356 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.344200028Z level=info msg="Executing migration" id="create data_source table" 2024-03-04T06:39:40.357 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.347126066Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-03-04T06:39:40.357 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.349905016Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-03-04T06:39:40.357 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.350357681Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-03-04T06:39:40.493 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411369 got 77309411374 for osd.2 2024-03-04T06:39:40.493 DEBUG:teuthology.parallel:result is None 2024-03-04T06:39:40.493 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-04T06:39:40.494 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:39:40.597 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.353019056Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-03-04T06:39:40.597 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.355746805Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-03-04T06:39:40.597 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.358520526Z level=info msg="Executing migration" id="create data_source table v2" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.358963398Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.361822244Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.362331226Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.364528903Z level=info msg="Executing migration" id="Add column with_credentials" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.367314366Z level=info msg="Executing migration" id="Add secure json data column" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.367910107Z level=info msg="Executing migration" id="Update data_source table charset" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.370693158Z level=info msg="Executing migration" id="Update initial version to 1" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.373524367Z level=info msg="Executing migration" id="Add read_only data column" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.37629505Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.376665606Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.379520939Z level=info msg="Executing migration" id="Add uid column" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.382166854Z level=info msg="Executing migration" id="Update uid value" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.384880492Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-03-04T06:39:40.598 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.38535477Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-03-04T06:39:40.599 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.388096482Z level=info msg="Executing migration" id="create api_key table" 2024-03-04T06:39:40.599 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.390806998Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-03-04T06:39:40.599 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.393468647Z level=info msg="Executing migration" id="add index api_key.key" 2024-03-04T06:39:40.599 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.39393526Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-03-04T06:39:40.599 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.396653248Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-03-04T06:39:40.600 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.399564185Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-03-04T06:39:40.600 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.402313065Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-03-04T06:39:40.600 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.40495744Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-03-04T06:39:40.600 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.40759285Z level=info msg="Executing migration" id="create api_key table v2" 2024-03-04T06:39:40.600 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.410464162Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-03-04T06:39:40.600 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.413133246Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-03-04T06:39:40.600 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.415867416Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-03-04T06:39:40.600 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.41674801Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-03-04T06:39:40.600 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.417436237Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-03-04T06:39:40.600 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.418337293Z level=info msg="Executing migration" id="Update api_key table charset" 2024-03-04T06:39:40.600 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.419008639Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-03-04T06:39:40.600 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.419848408Z level=info msg="Executing migration" id="Add service account foreign key" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.420457633Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.420856905Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.421707823Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.422534844Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.422953956Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.423896998Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.424555282Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.425001002Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.425790003Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.426645197Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.427558944Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.42825122Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.42911178Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.429989775Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-03-04T06:39:40.601 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.431012843Z level=info msg="Executing migration" id="create quota table v1" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.431716582Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.432688446Z level=info msg="Executing migration" id="Update quota table charset" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.43343482Z level=info msg="Executing migration" id="create plugin_setting table" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.434281745Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.435098883Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.435965816Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.436815338Z level=info msg="Executing migration" id="create session table" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.437657963Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.438516976Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.43958078Z level=info msg="Executing migration" id="create playlist table v2" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.440383151Z level=info msg="Executing migration" id="create playlist item table v2" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.441101975Z level=info msg="Executing migration" id="Update playlist table charset" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.441922516Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.442267088Z level=info msg="Executing migration" id="drop preferences table v2" 2024-03-04T06:39:40.602 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.442862189Z level=info msg="Executing migration" id="drop preferences table v3" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.44334631Z level=info msg="Executing migration" id="create preferences table v3" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.445582428Z level=info msg="Executing migration" id="Update preferences table charset" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.448344082Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.451205027Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.454198407Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.456851509Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.460386817Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.463089658Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.465878709Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.468654083Z level=info msg="Executing migration" id="create alert table v1" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.471470638Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.47433265Z level=info msg="Executing migration" id="add index alert state" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.477099728Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.479642787Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-03-04T06:39:40.603 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.482615678Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-03-04T06:39:40.604 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.485343556Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-03-04T06:39:40.604 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.487944085Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-03-04T06:39:40.604 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.490553025Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-03-04T06:39:40.604 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.493379733Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-03-04T06:39:40.604 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.496073735Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-03-04T06:39:40.604 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.498722392Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-03-04T06:39:40.604 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.50154652Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-03-04T06:39:40.604 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.504202319Z level=info msg="Executing migration" id="Add column is_default" 2024-03-04T06:39:40.604 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.506844527Z level=info msg="Executing migration" id="Add column frequency" 2024-03-04T06:39:40.604 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.509372796Z level=info msg="Executing migration" id="Add column send_reminder" 2024-03-04T06:39:40.604 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.512235279Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-03-04T06:39:40.604 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.514990554Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-03-04T06:39:40.604 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.517745752Z level=info msg="Executing migration" id="Update alert table charset" 2024-03-04T06:39:40.605 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.520294119Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-03-04T06:39:40.605 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.522969013Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-03-04T06:39:40.605 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.525704857Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-03-04T06:39:40.605 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.528542176Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.530991131Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.531416771Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.531883347Z level=info msg="Executing migration" id="Add for to alert table" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.532556845Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.533235173Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.533538411Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.534002224Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.534385982Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.535048258Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.535383742Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.535865986Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.536322358Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.536646459Z level=info msg="Executing migration" id="create annotation table v5" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.537119757Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-03-04T06:39:40.606 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.537576706Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.538037009Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.538466858Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.539759845Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.542580944Z level=info msg="Executing migration" id="Update annotation table charset" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.545095642Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.545888885Z level=info msg="Executing migration" id="Drop category_id index" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.546314785Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.546998802Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.547448159Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.547986004Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.5484089Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.550181298Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.550594693Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.551079627Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-03-04T06:39:40.607 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.551430383Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.551854588Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.552187852Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.552978383Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.55367715Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.554146716Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.554580389Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.554983747Z level=info msg="Executing migration" id="Add epoch_end column" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.555685047Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.556218227Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.556567269Z level=info msg="Executing migration" id="Move region to single row" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.556990008Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.557369891Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.557903366Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.558370968Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-03-04T06:39:40.608 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.558856217Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-03-04T06:39:40.609 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.559316712Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-03-04T06:39:40.609 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.562082025Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-03-04T06:39:40.609 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.56242282Z level=info msg="Executing migration" id="create test_data table" 2024-03-04T06:39:40.609 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.562870927Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-03-04T06:39:40.609 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.563293031Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-03-04T06:39:40.609 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.564144978Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-03-04T06:39:40.609 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.56499653Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-03-04T06:39:40.609 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.565894465Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-03-04T06:39:40.609 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.566689796Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-03-04T06:39:40.609 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.567667686Z level=info msg="Executing migration" id="create team table" 2024-03-04T06:39:40.609 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.56841027Z level=info msg="Executing migration" id="add index team.org_id" 2024-03-04T06:39:40.609 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.569380183Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-03-04T06:39:40.609 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.570085067Z level=info msg="Executing migration" id="create team member table" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.570930106Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.571802926Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.572593841Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.57357912Z level=info msg="Executing migration" id="Add column email to team table" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.574447776Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.575503688Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.5762324Z level=info msg="Executing migration" id="create dashboard acl table" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.577244833Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.577950006Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.578395851Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.578855524Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.579729639Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.580702148Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.581173241Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.582162296Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-03-04T06:39:40.610 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.582854356Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.583693367Z level=info msg="Executing migration" id="create tag table" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.584179146Z level=info msg="Executing migration" id="add index tag.key_value" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.585053495Z level=info msg="Executing migration" id="create login attempt table" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.585919037Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.586746582Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.587187487Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.589135247Z level=info msg="Executing migration" id="create login_attempt v2" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.590006855Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.590824391Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.591182988Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.592042887Z level=info msg="Executing migration" id="create user auth table" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.592486489Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.594915984Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.597745432Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-03-04T06:39:40.611 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.598534886Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-03-04T06:39:40.612 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.601343551Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-03-04T06:39:40.716 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:39:40.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3805273607' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-04T06:39:40.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:40.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:40.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:40.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:40.851 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.604360045Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-03-04T06:39:40.851 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.607137012Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-03-04T06:39:40.852 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.607615878Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-03-04T06:39:40.852 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.610401734Z level=info msg="Executing migration" id="create server_lock table" 2024-03-04T06:39:40.852 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.613301709Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-03-04T06:39:40.852 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.616105999Z level=info msg="Executing migration" id="create user auth token table" 2024-03-04T06:39:40.852 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.616636846Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-03-04T06:39:40.853 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.619590888Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-03-04T06:39:40.853 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.622355024Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-03-04T06:39:40.853 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.625058781Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-03-04T06:39:40.853 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.625936143Z level=info msg="Executing migration" id="create cache_data table" 2024-03-04T06:39:40.853 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.628823742Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-03-04T06:39:40.853 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.631674564Z level=info msg="Executing migration" id="create short_url table v1" 2024-03-04T06:39:40.854 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.634243788Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-03-04T06:39:40.854 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.637103185Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-03-04T06:39:40.854 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.639677038Z level=info msg="Executing migration" id="delete alert_definition table" 2024-03-04T06:39:40.854 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.642433096Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-03-04T06:39:40.854 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.645007415Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-03-04T06:39:40.855 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.645517084Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-03-04T06:39:40.855 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.648162084Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-03-04T06:39:40.855 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.65085906Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-03-04T06:39:40.855 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.653363445Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-03-04T06:39:40.855 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.653818294Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-03-04T06:39:40.856 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.656421034Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-03-04T06:39:40.856 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.656901247Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-03-04T06:39:40.856 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.657730303Z level=info msg="Executing migration" id="drop alert_definition table" 2024-03-04T06:39:40.856 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.658183151Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-03-04T06:39:40.856 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.658484495Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-03-04T06:39:40.856 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.658923107Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-03-04T06:39:40.857 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.659350682Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-03-04T06:39:40.857 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.659803903Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-03-04T06:39:40.857 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.660117101Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-03-04T06:39:40.857 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.66053517Z level=info msg="Executing migration" id="create alert_instance table" 2024-03-04T06:39:40.857 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.660942198Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-03-04T06:39:40.857 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.661331846Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-03-04T06:39:40.858 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.661756742Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-03-04T06:39:40.858 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.662546642Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-03-04T06:39:40.858 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.662956718Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-03-04T06:39:40.858 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.663329708Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-03-04T06:39:40.858 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.666663313Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-03-04T06:39:40.859 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.670032204Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-03-04T06:39:40.859 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.670475923Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-03-04T06:39:40.859 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.670929878Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-03-04T06:39:40.859 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.671742833Z level=info msg="Executing migration" id="create alert_rule table" 2024-03-04T06:39:40.859 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.672150534Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-03-04T06:39:40.859 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.672569316Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-03-04T06:39:40.860 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.672990251Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-03-04T06:39:40.860 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.67339603Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-03-04T06:39:40.860 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.673687399Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-03-04T06:39:40.860 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.674485716Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-03-04T06:39:40.860 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.675298178Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-03-04T06:39:40.861 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.676188733Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-03-04T06:39:40.861 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.678970649Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-03-04T06:39:40.861 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.679759684Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-03-04T06:39:40.861 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.680575804Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-03-04T06:39:40.861 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.681367941Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-03-04T06:39:40.862 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.682175177Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-03-04T06:39:40.862 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.683049015Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-03-04T06:39:40.862 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.683890045Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-03-04T06:39:40.862 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.684852465Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-03-04T06:39:40.862 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.685504553Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-03-04T06:39:40.863 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.686449367Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-03-04T06:39:40.863 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.687237686Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-03-04T06:39:40.863 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.687554387Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-03-04T06:39:40.863 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.688459332Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-03-04T06:39:40.863 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.689305688Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-03-04T06:39:40.863 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.690182694Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-03-04T06:39:40.864 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.691066501Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-03-04T06:39:40.864 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.691994953Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-03-04T06:39:40.864 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.692846413Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-03-04T06:39:40.864 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.693837902Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-03-04T06:39:40.864 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.694762519Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-03-04T06:39:40.865 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.69508685Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-03-04T06:39:40.865 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.696042957Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-03-04T06:39:40.865 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.696902437Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-03-04T06:39:40.865 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.697816647Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-03-04T06:39:40.865 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.698233043Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-03-04T06:39:40.865 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.699077766Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-03-04T06:39:40.866 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.700006662Z level=info msg="Executing migration" id="create provenance_type table" 2024-03-04T06:39:40.866 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.700854555Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-03-04T06:39:40.866 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.70132579Z level=info msg="Executing migration" id="create alert_image table" 2024-03-04T06:39:40.866 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.702167461Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-03-04T06:39:40.866 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.703043634Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-03-04T06:39:40.866 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.703986485Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-03-04T06:39:40.867 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.704618575Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-03-04T06:39:40.867 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.705460221Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-03-04T06:39:40.867 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.70558544Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-03-04T06:39:40.867 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.706368892Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-03-04T06:39:40.867 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.707217883Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-03-04T06:39:40.867 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.70772601Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-03-04T06:39:40.868 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.707867673Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-03-04T06:39:40.868 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.708000086Z level=info msg="alerts found to migrate" alerts=0 2024-03-04T06:39:40.868 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.710442067Z level=info msg="Executing migration" id="create library_element table v1" 2024-03-04T06:39:40.868 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.713409035Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-03-04T06:39:40.868 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.716220322Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-03-04T06:39:40.869 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.716733203Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-03-04T06:39:40.869 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.719620469Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-03-04T06:39:40.869 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.722368442Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-03-04T06:39:40.869 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.7253263Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-03-04T06:39:40.869 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.725946082Z level=info msg="Executing migration" id="create data_keys table" 2024-03-04T06:39:40.869 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.728748698Z level=info msg="Executing migration" id="create secrets table" 2024-03-04T06:39:40.870 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.731715475Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-03-04T06:39:40.870 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.736034568Z level=info msg="Executing migration" id="add name column into data_keys" 2024-03-04T06:39:40.870 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.737016285Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-03-04T06:39:40.870 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.739805007Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-03-04T06:39:40.870 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.744043367Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-03-04T06:39:40.871 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.748124544Z level=info msg="Executing migration" id="create kv_store table v1" 2024-03-04T06:39:40.871 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.748590939Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-03-04T06:39:40.871 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.751494127Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-03-04T06:39:40.872 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.754276571Z level=info msg="Executing migration" id="create permission table" 2024-03-04T06:39:40.872 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.75699147Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-03-04T06:39:40.873 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.757465165Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-03-04T06:39:40.873 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.760222394Z level=info msg="Executing migration" id="create role table" 2024-03-04T06:39:40.873 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.762887434Z level=info msg="Executing migration" id="add column display_name" 2024-03-04T06:39:40.873 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.765419544Z level=info msg="Executing migration" id="add column group_name" 2024-03-04T06:39:40.873 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.768009293Z level=info msg="Executing migration" id="add index role.org_id" 2024-03-04T06:39:40.873 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.770658636Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-03-04T06:39:40.874 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.773414289Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-03-04T06:39:40.874 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.77611797Z level=info msg="Executing migration" id="create team role table" 2024-03-04T06:39:40.874 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.776572011Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-03-04T06:39:40.874 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.779206477Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-03-04T06:39:40.874 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.781871057Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-03-04T06:39:40.874 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.784415792Z level=info msg="Executing migration" id="create user role table" 2024-03-04T06:39:40.875 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.78489538Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-03-04T06:39:40.875 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.787611035Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-03-04T06:39:40.875 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.790350384Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-03-04T06:39:40.875 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.79121237Z level=info msg="Executing migration" id="create builtin role table" 2024-03-04T06:39:40.875 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.79186402Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-03-04T06:39:40.875 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.792611327Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-03-04T06:39:40.876 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.793618859Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-03-04T06:39:40.876 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.794825449Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-03-04T06:39:40.876 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.795368383Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-03-04T06:39:40.876 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.796097934Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-03-04T06:39:40.876 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.79692285Z level=info msg="Executing migration" id="add unique index role.uid" 2024-03-04T06:39:40.877 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.79777141Z level=info msg="Executing migration" id="create seed assignment table" 2024-03-04T06:39:40.877 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.798157018Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-03-04T06:39:40.877 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.798939622Z level=info msg="Executing migration" id="add column hidden to role table" 2024-03-04T06:39:40.877 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.799973582Z level=info msg="Executing migration" id="create query_history table v1" 2024-03-04T06:39:40.877 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.800764999Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-03-04T06:39:40.877 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.801216082Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-03-04T06:39:40.877 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.802089995Z level=info msg="Executing migration" id="teams permissions migration" 2024-03-04T06:39:40.878 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.802553523Z level=info msg="Executing migration" id="dashboard permissions" 2024-03-04T06:39:40.878 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.803012422Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-03-04T06:39:40.878 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.803834754Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-03-04T06:39:40.878 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.804149654Z level=info msg="Executing migration" id="alerting notification permissions" 2024-03-04T06:39:40.878 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.804469108Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-03-04T06:39:40.878 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.804880887Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-03-04T06:39:40.879 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.80535004Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-03-04T06:39:40.879 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.806460793Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-03-04T06:39:40.879 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.806778857Z level=info msg="Executing migration" id="create correlation table v1" 2024-03-04T06:39:40.879 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.807797107Z level=info msg="Executing migration" id="add index correlations.uid" 2024-03-04T06:39:40.879 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.808635687Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-03-04T06:39:40.879 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.809377032Z level=info msg="Executing migration" id="add correlation config column" 2024-03-04T06:39:40.880 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.810510007Z level=info msg="Executing migration" id="create entity_events table" 2024-03-04T06:39:40.880 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.811098684Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-03-04T06:39:40.880 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.811951019Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-03-04T06:39:40.880 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.812072328Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-03-04T06:39:40.880 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.812786261Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-04T06:39:40.880 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.812899109Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-04T06:39:40.881 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.813207211Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-03-04T06:39:40.881 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.814089899Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-03-04T06:39:40.881 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.814924128Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-03-04T06:39:40.881 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.815794371Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-04T06:39:40.881 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.816283531Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-03-04T06:39:40.881 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.819090886Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-03-04T06:39:40.882 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.8219958Z level=info msg="Executing migration" id="Drop public config table" 2024-03-04T06:39:40.882 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.827474341Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-03-04T06:39:40.882 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.828125755Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-03-04T06:39:40.882 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.830944502Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-03-04T06:39:40.882 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.831545716Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-03-04T06:39:40.882 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.833632255Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-03-04T06:39:40.883 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.836671998Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-03-04T06:39:40.883 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.83769706Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-03-04T06:39:40.883 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.840534291Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-03-04T06:39:40.883 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.843171795Z level=info msg="Executing migration" id="add share column" 2024-03-04T06:39:40.883 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.845845296Z level=info msg="Executing migration" id="create default alerting folders" 2024-03-04T06:39:40.883 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.84633676Z level=info msg="Executing migration" id="create file table" 2024-03-04T06:39:40.884 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.849288538Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-03-04T06:39:40.884 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.851916626Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-03-04T06:39:41.225 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:40 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3805273607' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-04T06:39:41.225 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:40 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:41.225 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:40 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:41.225 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:40 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:41.225 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:40 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:41.225 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:40 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3805273607' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-04T06:39:41.225 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:40 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:41.225 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:40 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:41.225 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:40 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:41.225 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:40 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:41.289 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.854615129Z level=info msg="Executing migration" id="create file_meta table" 2024-03-04T06:39:41.289 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.855020432Z level=info msg="Executing migration" id="file table idx: path key" 2024-03-04T06:39:41.289 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.85545858Z level=info msg="Executing migration" id="set path collation in file table" 2024-03-04T06:39:41.289 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.855764265Z level=info msg="Executing migration" id="managed permissions migration" 2024-03-04T06:39:41.289 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.856122212Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-03-04T06:39:41.289 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.856424486Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-03-04T06:39:41.289 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.856867326Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-03-04T06:39:41.289 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.85789687Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-03-04T06:39:41.289 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.858222223Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-03-04T06:39:41.289 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.858678447Z level=info msg="Executing migration" id="update group index for alert rules" 2024-03-04T06:39:41.289 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.859070235Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-03-04T06:39:41.289 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.859377639Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-03-04T06:39:41.290 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.859772601Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-03-04T06:39:41.290 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.860814344Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-03-04T06:39:41.290 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.86183073Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-03-04T06:39:41.290 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.862261973Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-03-04T06:39:41.290 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.8721057Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-03-04T06:39:41.290 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.872573703Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-03-04T06:39:41.290 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.873046441Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-03-04T06:39:41.290 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.876548515Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-03-04T06:39:41.290 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.876879437Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-03-04T06:39:41.290 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.877203785Z level=info msg="Executing migration" id="create folder table" 2024-03-04T06:39:41.290 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.877599164Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-03-04T06:39:41.291 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.878046329Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-03-04T06:39:41.291 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.880395718Z level=info msg="Executing migration" id="Update folder title length" 2024-03-04T06:39:41.291 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.880729371Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-03-04T06:39:41.291 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=migrator t=2024-03-04T06:39:40.88115721Z level=info msg="migrations completed" performed=485 skipped=0 duration=598.662781ms 2024-03-04T06:39:41.291 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=sqlstore t=2024-03-04T06:39:40.881550607Z level=info msg="Created default organization" 2024-03-04T06:39:41.291 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=plugin.loader t=2024-03-04T06:39:40.942320154Z level=info msg="Plugin registered" pluginID=input 2024-03-04T06:39:41.291 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=plugin.loader t=2024-03-04T06:39:40.970005881Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-03-04T06:39:41.291 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=plugin.loader t=2024-03-04T06:39:40.970022738Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-03-04T06:39:41.291 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=secrets t=2024-03-04T06:39:40.970055232Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-03-04T06:39:41.291 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=query_data t=2024-03-04T06:39:40.971713735Z level=info msg="Query Service initialization" 2024-03-04T06:39:41.291 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=live.push_http t=2024-03-04T06:39:40.973934408Z level=info msg="Live Push Gateway initialization" 2024-03-04T06:39:41.814 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-mon[30756]: Deploying daemon node-exporter.a on smithi137 2024-03-04T06:39:41.814 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-mon[30756]: pgmap v35: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:41.814 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=infra.usagestats.collector t=2024-03-04T06:39:41.75872919Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-03-04T06:39:41.814 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=provisioning.datasources t=2024-03-04T06:39:41.813760182Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-03-04T06:39:42.096 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=provisioning.datasources t=2024-03-04T06:39:41.855877309Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-03-04T06:39:42.096 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=provisioning.alerting t=2024-03-04T06:39:41.877427844Z level=info msg="starting to provision alerting" 2024-03-04T06:39:42.096 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=provisioning.alerting t=2024-03-04T06:39:41.877455078Z level=info msg="finished to provision alerting" 2024-03-04T06:39:42.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=grafanaStorageLogger t=2024-03-04T06:39:41.877676635Z level=info msg="storage starting" 2024-03-04T06:39:42.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=ngalert.state.manager t=2024-03-04T06:39:41.877685697Z level=info msg="Warming state cache for startup" 2024-03-04T06:39:42.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=http.server t=2024-03-04T06:39:41.879596967Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-03-04T06:39:42.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=sqlstore.transactions t=2024-03-04T06:39:41.888630375Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-03-04T06:39:42.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=ngalert.state.manager t=2024-03-04T06:39:41.888713861Z level=info msg="State cache has been initialized" states=0 duration=11.027179ms 2024-03-04T06:39:42.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=ticker t=2024-03-04T06:39:41.888793094Z level=info msg=starting first_tick=2024-03-04T06:39:50Z 2024-03-04T06:39:42.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=ngalert.multiorg.alertmanager t=2024-03-04T06:39:41.888802789Z level=info msg="starting MultiOrg Alertmanager" 2024-03-04T06:39:42.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=sqlstore.transactions t=2024-03-04T06:39:41.932752988Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-03-04T06:39:42.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=sqlstore.transactions t=2024-03-04T06:39:41.973871916Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-03-04T06:39:42.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:39:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=sqlstore.transactions t=2024-03-04T06:39:41.984738433Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-03-04T06:39:42.171 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:41 smithi137 ceph-mon[26846]: Deploying daemon node-exporter.a on smithi137 2024-03-04T06:39:42.171 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:41 smithi137 ceph-mon[26846]: pgmap v35: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:42.171 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:41 smithi137 ceph-mon[37364]: Deploying daemon node-exporter.a on smithi137 2024-03-04T06:39:42.171 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:41 smithi137 ceph-mon[37364]: pgmap v35: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:42.949 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:39:42.951 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:39:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:43 smithi203 ceph-mon[30756]: pgmap v36: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:44.172 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:43 smithi137 ceph-mon[26846]: pgmap v36: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:44.173 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:43 smithi137 ceph-mon[37364]: pgmap v36: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:44.192 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-03-04T06:39:42.751421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593514,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":227,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":315,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":223340,"kb_used_data":7172,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":749737876,"statfs":{"total":767960285184,"available":767731585024,"internally_reserved":0,"allocated":7344128,"data_stored":4140920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002772"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.671513+0000","last_change":"2024-03-04T06:38:12.919238+0000","last_active":"2024-03-04T06:38:48.671513+0000","last_peered":"2024-03-04T06:38:48.671513+0000","last_clean":"2024-03-04T06:38:48.671513+0000","last_became_active":"2024-03-04T06:38:12.918941+0000","last_became_peered":"2024-03-04T06:38:12.918941+0000","last_unstale":"2024-03-04T06:38:48.671513+0000","last_undegraded":"2024-03-04T06:38:48.671513+0000","last_fullsized":"2024-03-04T06:38:48.671513+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:10:03.122262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669975+0000","last_change":"2024-03-04T06:38:12.914740+0000","last_active":"2024-03-04T06:38:48.669975+0000","last_peered":"2024-03-04T06:38:48.669975+0000","last_clean":"2024-03-04T06:38:48.669975+0000","last_became_active":"2024-03-04T06:38:12.914436+0000","last_became_peered":"2024-03-04T06:38:12.914436+0000","last_unstale":"2024-03-04T06:38:48.669975+0000","last_undegraded":"2024-03-04T06:38:48.669975+0000","last_fullsized":"2024-03-04T06:38:48.669975+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:58.781088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.308418+0000","last_change":"2024-03-04T06:38:12.895666+0000","last_active":"2024-03-04T06:38:48.308418+0000","last_peered":"2024-03-04T06:38:48.308418+0000","last_clean":"2024-03-04T06:38:48.308418+0000","last_became_active":"2024-03-04T06:38:12.895398+0000","last_became_peered":"2024-03-04T06:38:12.895398+0000","last_unstale":"2024-03-04T06:38:48.308418+0000","last_undegraded":"2024-03-04T06:38:48.308418+0000","last_fullsized":"2024-03-04T06:38:48.308418+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:10.744216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670738+0000","last_change":"2024-03-04T06:38:12.902256+0000","last_active":"2024-03-04T06:38:48.670738+0000","last_peered":"2024-03-04T06:38:48.670738+0000","last_clean":"2024-03-04T06:38:48.670738+0000","last_became_active":"2024-03-04T06:38:12.901792+0000","last_became_peered":"2024-03-04T06:38:12.901792+0000","last_unstale":"2024-03-04T06:38:48.670738+0000","last_undegraded":"2024-03-04T06:38:48.670738+0000","last_fullsized":"2024-03-04T06:38:48.670738+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:45.163241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.671404+0000","last_change":"2024-03-04T06:38:12.913797+0000","last_active":"2024-03-04T06:38:48.671404+0000","last_peered":"2024-03-04T06:38:48.671404+0000","last_clean":"2024-03-04T06:38:48.671404+0000","last_became_active":"2024-03-04T06:38:12.913517+0000","last_became_peered":"2024-03-04T06:38:12.913517+0000","last_unstale":"2024-03-04T06:38:48.671404+0000","last_undegraded":"2024-03-04T06:38:48.671404+0000","last_fullsized":"2024-03-04T06:38:48.671404+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:24.837813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670649+0000","last_change":"2024-03-04T06:38:12.904787+0000","last_active":"2024-03-04T06:38:48.670649+0000","last_peered":"2024-03-04T06:38:48.670649+0000","last_clean":"2024-03-04T06:38:48.670649+0000","last_became_active":"2024-03-04T06:38:12.904484+0000","last_became_peered":"2024-03-04T06:38:12.904484+0000","last_unstale":"2024-03-04T06:38:48.670649+0000","last_undegraded":"2024-03-04T06:38:48.670649+0000","last_fullsized":"2024-03-04T06:38:48.670649+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:03:28.898688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669618+0000","last_change":"2024-03-04T06:38:12.913825+0000","last_active":"2024-03-04T06:38:48.669618+0000","last_peered":"2024-03-04T06:38:48.669618+0000","last_clean":"2024-03-04T06:38:48.669618+0000","last_became_active":"2024-03-04T06:38:12.913553+0000","last_became_peered":"2024-03-04T06:38:12.913553+0000","last_unstale":"2024-03-04T06:38:48.669618+0000","last_undegraded":"2024-03-04T06:38:48.669618+0000","last_fullsized":"2024-03-04T06:38:48.669618+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:23:17.322436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.668832+0000","last_change":"2024-03-04T06:38:12.902309+0000","last_active":"2024-03-04T06:38:48.668832+0000","last_peered":"2024-03-04T06:38:48.668832+0000","last_clean":"2024-03-04T06:38:48.668832+0000","last_became_active":"2024-03-04T06:38:12.902009+0000","last_became_peered":"2024-03-04T06:38:12.902009+0000","last_unstale":"2024-03-04T06:38:48.668832+0000","last_undegraded":"2024-03-04T06:38:48.668832+0000","last_fullsized":"2024-03-04T06:38:48.668832+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:36:04.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.671468+0000","last_change":"2024-03-04T06:38:12.916933+0000","last_active":"2024-03-04T06:38:48.671468+0000","last_peered":"2024-03-04T06:38:48.671468+0000","last_clean":"2024-03-04T06:38:48.671468+0000","last_became_active":"2024-03-04T06:38:12.913922+0000","last_became_peered":"2024-03-04T06:38:12.913922+0000","last_unstale":"2024-03-04T06:38:48.671468+0000","last_undegraded":"2024-03-04T06:38:48.671468+0000","last_fullsized":"2024-03-04T06:38:48.671468+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:08:21.342061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670742+0000","last_change":"2024-03-04T06:38:12.911185+0000","last_active":"2024-03-04T06:38:48.670742+0000","last_peered":"2024-03-04T06:38:48.670742+0000","last_clean":"2024-03-04T06:38:48.670742+0000","last_became_active":"2024-03-04T06:38:12.910906+0000","last_became_peered":"2024-03-04T06:38:12.910906+0000","last_unstale":"2024-03-04T06:38:48.670742+0000","last_undegraded":"2024-03-04T06:38:48.670742+0000","last_fullsized":"2024-03-04T06:38:48.670742+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:45.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.671297+0000","last_change":"2024-03-04T06:38:12.916277+0000","last_active":"2024-03-04T06:38:48.671297+0000","last_peered":"2024-03-04T06:38:48.671297+0000","last_clean":"2024-03-04T06:38:48.671297+0000","last_became_active":"2024-03-04T06:38:12.915998+0000","last_became_peered":"2024-03-04T06:38:12.915998+0000","last_unstale":"2024-03-04T06:38:48.671297+0000","last_undegraded":"2024-03-04T06:38:48.671297+0000","last_fullsized":"2024-03-04T06:38:48.671297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:22:53.166929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.307546+0000","last_change":"2024-03-04T06:38:12.907393+0000","last_active":"2024-03-04T06:38:48.307546+0000","last_peered":"2024-03-04T06:38:48.307546+0000","last_clean":"2024-03-04T06:38:48.307546+0000","last_became_active":"2024-03-04T06:38:12.907111+0000","last_became_peered":"2024-03-04T06:38:12.907111+0000","last_unstale":"2024-03-04T06:38:48.307546+0000","last_undegraded":"2024-03-04T06:38:48.307546+0000","last_fullsized":"2024-03-04T06:38:48.307546+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:18.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669157+0000","last_change":"2024-03-04T06:38:12.897003+0000","last_active":"2024-03-04T06:38:48.669157+0000","last_peered":"2024-03-04T06:38:48.669157+0000","last_clean":"2024-03-04T06:38:48.669157+0000","last_became_active":"2024-03-04T06:38:12.896729+0000","last_became_peered":"2024-03-04T06:38:12.896729+0000","last_unstale":"2024-03-04T06:38:48.669157+0000","last_undegraded":"2024-03-04T06:38:48.669157+0000","last_fullsized":"2024-03-04T06:38:48.669157+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:01:03.497642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.307567+0000","last_change":"2024-03-04T06:38:12.896652+0000","last_active":"2024-03-04T06:38:48.307567+0000","last_peered":"2024-03-04T06:38:48.307567+0000","last_clean":"2024-03-04T06:38:48.307567+0000","last_became_active":"2024-03-04T06:38:12.896300+0000","last_became_peered":"2024-03-04T06:38:12.896300+0000","last_unstale":"2024-03-04T06:38:48.307567+0000","last_undegraded":"2024-03-04T06:38:48.307567+0000","last_fullsized":"2024-03-04T06:38:48.307567+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:32.026507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669487+0000","last_change":"2024-03-04T06:38:12.907997+0000","last_active":"2024-03-04T06:38:48.669487+0000","last_peered":"2024-03-04T06:38:48.669487+0000","last_clean":"2024-03-04T06:38:48.669487+0000","last_became_active":"2024-03-04T06:38:12.907720+0000","last_became_peered":"2024-03-04T06:38:12.907720+0000","last_unstale":"2024-03-04T06:38:48.669487+0000","last_undegraded":"2024-03-04T06:38:48.669487+0000","last_fullsized":"2024-03-04T06:38:48.669487+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:46:55.140847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669338+0000","last_change":"2024-03-04T06:38:12.899219+0000","last_active":"2024-03-04T06:38:48.669338+0000","last_peered":"2024-03-04T06:38:48.669338+0000","last_clean":"2024-03-04T06:38:48.669338+0000","last_became_active":"2024-03-04T06:38:12.898928+0000","last_became_peered":"2024-03-04T06:38:12.898928+0000","last_unstale":"2024-03-04T06:38:48.669338+0000","last_undegraded":"2024-03-04T06:38:48.669338+0000","last_fullsized":"2024-03-04T06:38:48.669338+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:13.412822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669985+0000","last_change":"2024-03-04T06:38:12.908332+0000","last_active":"2024-03-04T06:38:48.669985+0000","last_peered":"2024-03-04T06:38:48.669985+0000","last_clean":"2024-03-04T06:38:48.669985+0000","last_became_active":"2024-03-04T06:38:12.908038+0000","last_became_peered":"2024-03-04T06:38:12.908038+0000","last_unstale":"2024-03-04T06:38:48.669985+0000","last_undegraded":"2024-03-04T06:38:48.669985+0000","last_fullsized":"2024-03-04T06:38:48.669985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:05:49.146138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.309047+0000","last_change":"2024-03-04T06:38:12.899134+0000","last_active":"2024-03-04T06:38:48.309047+0000","last_peered":"2024-03-04T06:38:48.309047+0000","last_clean":"2024-03-04T06:38:48.309047+0000","last_became_active":"2024-03-04T06:38:12.898801+0000","last_became_peered":"2024-03-04T06:38:12.898801+0000","last_unstale":"2024-03-04T06:38:48.309047+0000","last_undegraded":"2024-03-04T06:38:48.309047+0000","last_fullsized":"2024-03-04T06:38:48.309047+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:21:48.465552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670457+0000","last_change":"2024-03-04T06:38:12.918000+0000","last_active":"2024-03-04T06:38:48.670457+0000","last_peered":"2024-03-04T06:38:48.670457+0000","last_clean":"2024-03-04T06:38:48.670457+0000","last_became_active":"2024-03-04T06:38:12.914159+0000","last_became_peered":"2024-03-04T06:38:12.914159+0000","last_unstale":"2024-03-04T06:38:48.670457+0000","last_undegraded":"2024-03-04T06:38:48.670457+0000","last_fullsized":"2024-03-04T06:38:48.670457+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:24.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.308668+0000","last_change":"2024-03-04T06:38:12.550843+0000","last_active":"2024-03-04T06:38:48.308668+0000","last_peered":"2024-03-04T06:38:48.308668+0000","last_clean":"2024-03-04T06:38:48.308668+0000","last_became_active":"2024-03-04T06:38:12.550141+0000","last_became_peered":"2024-03-04T06:38:12.550141+0000","last_unstale":"2024-03-04T06:38:48.308668+0000","last_undegraded":"2024-03-04T06:38:48.308668+0000","last_fullsized":"2024-03-04T06:38:48.308668+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:01.969570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669158+0000","last_change":"2024-03-04T06:38:12.896389+0000","last_active":"2024-03-04T06:38:48.669158+0000","last_peered":"2024-03-04T06:38:48.669158+0000","last_clean":"2024-03-04T06:38:48.669158+0000","last_became_active":"2024-03-04T06:38:12.896120+0000","last_became_peered":"2024-03-04T06:38:12.896120+0000","last_unstale":"2024-03-04T06:38:48.669158+0000","last_undegraded":"2024-03-04T06:38:48.669158+0000","last_fullsized":"2024-03-04T06:38:48.669158+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:57.729499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"61'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669239+0000","last_change":"2024-03-04T06:38:12.550800+0000","last_active":"2024-03-04T06:38:48.669239+0000","last_peered":"2024-03-04T06:38:48.669239+0000","last_clean":"2024-03-04T06:38:48.669239+0000","last_became_active":"2024-03-04T06:38:12.550444+0000","last_became_peered":"2024-03-04T06:38:12.550444+0000","last_unstale":"2024-03-04T06:38:48.669239+0000","last_undegraded":"2024-03-04T06:38:48.669239+0000","last_fullsized":"2024-03-04T06:38:48.669239+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:42.209194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.308518+0000","last_change":"2024-03-04T06:38:12.903258+0000","last_active":"2024-03-04T06:38:48.308518+0000","last_peered":"2024-03-04T06:38:48.308518+0000","last_clean":"2024-03-04T06:38:48.308518+0000","last_became_active":"2024-03-04T06:38:12.902982+0000","last_became_peered":"2024-03-04T06:38:12.902982+0000","last_unstale":"2024-03-04T06:38:48.308518+0000","last_undegraded":"2024-03-04T06:38:48.308518+0000","last_fullsized":"2024-03-04T06:38:48.308518+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:31:23.228035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670848+0000","last_change":"2024-03-04T06:38:12.557057+0000","last_active":"2024-03-04T06:38:48.670848+0000","last_peered":"2024-03-04T06:38:48.670848+0000","last_clean":"2024-03-04T06:38:48.670848+0000","last_became_active":"2024-03-04T06:38:12.556733+0000","last_became_peered":"2024-03-04T06:38:12.556733+0000","last_unstale":"2024-03-04T06:38:48.670848+0000","last_undegraded":"2024-03-04T06:38:48.670848+0000","last_fullsized":"2024-03-04T06:38:48.670848+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:15.847471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670818+0000","last_change":"2024-03-04T06:38:12.907223+0000","last_active":"2024-03-04T06:38:48.670818+0000","last_peered":"2024-03-04T06:38:48.670818+0000","last_clean":"2024-03-04T06:38:48.670818+0000","last_became_active":"2024-03-04T06:38:12.906911+0000","last_became_peered":"2024-03-04T06:38:12.906911+0000","last_unstale":"2024-03-04T06:38:48.670818+0000","last_undegraded":"2024-03-04T06:38:48.670818+0000","last_fullsized":"2024-03-04T06:38:48.670818+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:29.474153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670356+0000","last_change":"2024-03-04T06:38:12.556246+0000","last_active":"2024-03-04T06:38:48.670356+0000","last_peered":"2024-03-04T06:38:48.670356+0000","last_clean":"2024-03-04T06:38:48.670356+0000","last_became_active":"2024-03-04T06:38:12.555860+0000","last_became_peered":"2024-03-04T06:38:12.555860+0000","last_unstale":"2024-03-04T06:38:48.670356+0000","last_undegraded":"2024-03-04T06:38:48.670356+0000","last_fullsized":"2024-03-04T06:38:48.670356+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:41.910480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669635+0000","last_change":"2024-03-04T06:38:12.906907+0000","last_active":"2024-03-04T06:38:48.669635+0000","last_peered":"2024-03-04T06:38:48.669635+0000","last_clean":"2024-03-04T06:38:48.669635+0000","last_became_active":"2024-03-04T06:38:12.906615+0000","last_became_peered":"2024-03-04T06:38:12.906615+0000","last_unstale":"2024-03-04T06:38:48.669635+0000","last_undegraded":"2024-03-04T06:38:48.669635+0000","last_fullsized":"2024-03-04T06:38:48.669635+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:21:15.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"61'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669300+0000","last_change":"2024-03-04T06:38:12.546234+0000","last_active":"2024-03-04T06:38:48.669300+0000","last_peered":"2024-03-04T06:38:48.669300+0000","last_clean":"2024-03-04T06:38:48.669300+0000","last_became_active":"2024-03-04T06:38:12.545975+0000","last_became_peered":"2024-03-04T06:38:12.545975+0000","last_unstale":"2024-03-04T06:38:48.669300+0000","last_undegraded":"2024-03-04T06:38:48.669300+0000","last_fullsized":"2024-03-04T06:38:48.669300+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:04.341190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.307316+0000","last_change":"2024-03-04T06:38:12.908256+0000","last_active":"2024-03-04T06:38:48.307316+0000","last_peered":"2024-03-04T06:38:48.307316+0000","last_clean":"2024-03-04T06:38:48.307316+0000","last_became_active":"2024-03-04T06:38:12.907953+0000","last_became_peered":"2024-03-04T06:38:12.907953+0000","last_unstale":"2024-03-04T06:38:48.307316+0000","last_undegraded":"2024-03-04T06:38:48.307316+0000","last_fullsized":"2024-03-04T06:38:48.307316+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:03:03.291025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669727+0000","last_change":"2024-03-04T06:38:12.554332+0000","last_active":"2024-03-04T06:38:48.669727+0000","last_peered":"2024-03-04T06:38:48.669727+0000","last_clean":"2024-03-04T06:38:48.669727+0000","last_became_active":"2024-03-04T06:38:12.554044+0000","last_became_peered":"2024-03-04T06:38:12.554044+0000","last_unstale":"2024-03-04T06:38:48.669727+0000","last_undegraded":"2024-03-04T06:38:48.669727+0000","last_fullsized":"2024-03-04T06:38:48.669727+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:28:40.250342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.307395+0000","last_change":"2024-03-04T06:38:12.910445+0000","last_active":"2024-03-04T06:38:48.307395+0000","last_peered":"2024-03-04T06:38:48.307395+0000","last_clean":"2024-03-04T06:38:48.307395+0000","last_became_active":"2024-03-04T06:38:12.909974+0000","last_became_peered":"2024-03-04T06:38:12.909974+0000","last_unstale":"2024-03-04T06:38:48.307395+0000","last_undegraded":"2024-03-04T06:38:48.307395+0000","last_fullsized":"2024-03-04T06:38:48.307395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:42:52.372021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669967+0000","last_change":"2024-03-04T06:38:12.543180+0000","last_active":"2024-03-04T06:38:48.669967+0000","last_peered":"2024-03-04T06:38:48.669967+0000","last_clean":"2024-03-04T06:38:48.669967+0000","last_became_active":"2024-03-04T06:38:12.542896+0000","last_became_peered":"2024-03-04T06:38:12.542896+0000","last_unstale":"2024-03-04T06:38:48.669967+0000","last_undegraded":"2024-03-04T06:38:48.669967+0000","last_fullsized":"2024-03-04T06:38:48.669967+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:15:09.816539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.668995+0000","last_change":"2024-03-04T06:38:12.895735+0000","last_active":"2024-03-04T06:38:48.668995+0000","last_peered":"2024-03-04T06:38:48.668995+0000","last_clean":"2024-03-04T06:38:48.668995+0000","last_became_active":"2024-03-04T06:38:12.895201+0000","last_became_peered":"2024-03-04T06:38:12.895201+0000","last_unstale":"2024-03-04T06:38:48.668995+0000","last_undegraded":"2024-03-04T06:38:48.668995+0000","last_fullsized":"2024-03-04T06:38:48.668995+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:12:35.373175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669491+0000","last_change":"2024-03-04T06:38:12.551089+0000","last_active":"2024-03-04T06:38:48.669491+0000","last_peered":"2024-03-04T06:38:48.669491+0000","last_clean":"2024-03-04T06:38:48.669491+0000","last_became_active":"2024-03-04T06:38:12.550791+0000","last_became_peered":"2024-03-04T06:38:12.550791+0000","last_unstale":"2024-03-04T06:38:48.669491+0000","last_undegraded":"2024-03-04T06:38:48.669491+0000","last_fullsized":"2024-03-04T06:38:48.669491+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:49.576267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669569+0000","last_change":"2024-03-04T06:38:12.909194+0000","last_active":"2024-03-04T06:38:48.669569+0000","last_peered":"2024-03-04T06:38:48.669569+0000","last_clean":"2024-03-04T06:38:48.669569+0000","last_became_active":"2024-03-04T06:38:12.908879+0000","last_became_peered":"2024-03-04T06:38:12.908879+0000","last_unstale":"2024-03-04T06:38:48.669569+0000","last_undegraded":"2024-03-04T06:38:48.669569+0000","last_fullsized":"2024-03-04T06:38:48.669569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:23.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670495+0000","last_change":"2024-03-04T06:38:12.544023+0000","last_active":"2024-03-04T06:38:48.670495+0000","last_peered":"2024-03-04T06:38:48.670495+0000","last_clean":"2024-03-04T06:38:48.670495+0000","last_became_active":"2024-03-04T06:38:12.543699+0000","last_became_peered":"2024-03-04T06:38:12.543699+0000","last_unstale":"2024-03-04T06:38:48.670495+0000","last_undegraded":"2024-03-04T06:38:48.670495+0000","last_fullsized":"2024-03-04T06:38:48.670495+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:19.418372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670989+0000","last_change":"2024-03-04T06:38:12.903510+0000","last_active":"2024-03-04T06:38:48.670989+0000","last_peered":"2024-03-04T06:38:48.670989+0000","last_clean":"2024-03-04T06:38:48.670989+0000","last_became_active":"2024-03-04T06:38:12.903226+0000","last_became_peered":"2024-03-04T06:38:12.903226+0000","last_unstale":"2024-03-04T06:38:48.670989+0000","last_undegraded":"2024-03-04T06:38:48.670989+0000","last_fullsized":"2024-03-04T06:38:48.670989+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:49:29.474747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670935+0000","last_change":"2024-03-04T06:38:12.550879+0000","last_active":"2024-03-04T06:38:48.670935+0000","last_peered":"2024-03-04T06:38:48.670935+0000","last_clean":"2024-03-04T06:38:48.670935+0000","last_became_active":"2024-03-04T06:38:12.549931+0000","last_became_peered":"2024-03-04T06:38:12.549931+0000","last_unstale":"2024-03-04T06:38:48.670935+0000","last_undegraded":"2024-03-04T06:38:48.670935+0000","last_fullsized":"2024-03-04T06:38:48.670935+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:33.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.308986+0000","last_change":"2024-03-04T06:38:12.903875+0000","last_active":"2024-03-04T06:38:48.308986+0000","last_peered":"2024-03-04T06:38:48.308986+0000","last_clean":"2024-03-04T06:38:48.308986+0000","last_became_active":"2024-03-04T06:38:12.903600+0000","last_became_peered":"2024-03-04T06:38:12.903600+0000","last_unstale":"2024-03-04T06:38:48.308986+0000","last_undegraded":"2024-03-04T06:38:48.308986+0000","last_fullsized":"2024-03-04T06:38:48.308986+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:32.774333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669540+0000","last_change":"2024-03-04T06:38:12.551496+0000","last_active":"2024-03-04T06:38:48.669540+0000","last_peered":"2024-03-04T06:38:48.669540+0000","last_clean":"2024-03-04T06:38:48.669540+0000","last_became_active":"2024-03-04T06:38:12.551202+0000","last_became_peered":"2024-03-04T06:38:12.551202+0000","last_unstale":"2024-03-04T06:38:48.669540+0000","last_undegraded":"2024-03-04T06:38:48.669540+0000","last_fullsized":"2024-03-04T06:38:48.669540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:19.526762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.307502+0000","last_change":"2024-03-04T06:38:12.911735+0000","last_active":"2024-03-04T06:38:48.307502+0000","last_peered":"2024-03-04T06:38:48.307502+0000","last_clean":"2024-03-04T06:38:48.307502+0000","last_became_active":"2024-03-04T06:38:12.911389+0000","last_became_peered":"2024-03-04T06:38:12.911389+0000","last_unstale":"2024-03-04T06:38:48.307502+0000","last_undegraded":"2024-03-04T06:38:48.307502+0000","last_fullsized":"2024-03-04T06:38:48.307502+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:25.284425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"63'9","reported_seq":26,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670170+0000","last_change":"2024-03-04T06:38:12.546352+0000","last_active":"2024-03-04T06:38:48.670170+0000","last_peered":"2024-03-04T06:38:48.670170+0000","last_clean":"2024-03-04T06:38:48.670170+0000","last_became_active":"2024-03-04T06:38:12.545863+0000","last_became_peered":"2024-03-04T06:38:12.545863+0000","last_unstale":"2024-03-04T06:38:48.670170+0000","last_undegraded":"2024-03-04T06:38:48.670170+0000","last_fullsized":"2024-03-04T06:38:48.670170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:08.181131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2348,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670604+0000","last_change":"2024-03-04T06:38:12.919415+0000","last_active":"2024-03-04T06:38:48.670604+0000","last_peered":"2024-03-04T06:38:48.670604+0000","last_clean":"2024-03-04T06:38:48.670604+0000","last_became_active":"2024-03-04T06:38:12.918269+0000","last_became_peered":"2024-03-04T06:38:12.918269+0000","last_unstale":"2024-03-04T06:38:48.670604+0000","last_undegraded":"2024-03-04T06:38:48.670604+0000","last_fullsized":"2024-03-04T06:38:48.670604+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:26:56.067995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.307680+0000","last_change":"2024-03-04T06:38:12.547028+0000","last_active":"2024-03-04T06:38:48.307680+0000","last_peered":"2024-03-04T06:38:48.307680+0000","last_clean":"2024-03-04T06:38:48.307680+0000","last_became_active":"2024-03-04T06:38:12.546672+0000","last_became_peered":"2024-03-04T06:38:12.546672+0000","last_unstale":"2024-03-04T06:38:48.307680+0000","last_undegraded":"2024-03-04T06:38:48.307680+0000","last_fullsized":"2024-03-04T06:38:48.307680+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:21:00.773241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.307484+0000","last_change":"2024-03-04T06:38:12.896676+0000","last_active":"2024-03-04T06:38:48.307484+0000","last_peered":"2024-03-04T06:38:48.307484+0000","last_clean":"2024-03-04T06:38:48.307484+0000","last_became_active":"2024-03-04T06:38:12.893498+0000","last_became_peered":"2024-03-04T06:38:12.893498+0000","last_unstale":"2024-03-04T06:38:48.307484+0000","last_undegraded":"2024-03-04T06:38:48.307484+0000","last_fullsized":"2024-03-04T06:38:48.307484+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:57.293340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670326+0000","last_change":"2024-03-04T06:38:12.549608+0000","last_active":"2024-03-04T06:38:48.670326+0000","last_peered":"2024-03-04T06:38:48.670326+0000","last_clean":"2024-03-04T06:38:48.670326+0000","last_became_active":"2024-03-04T06:38:12.549299+0000","last_became_peered":"2024-03-04T06:38:12.549299+0000","last_unstale":"2024-03-04T06:38:48.670326+0000","last_undegraded":"2024-03-04T06:38:48.670326+0000","last_fullsized":"2024-03-04T06:38:48.670326+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:12:23.543702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.671328+0000","last_change":"2024-03-04T06:38:12.913767+0000","last_active":"2024-03-04T06:38:48.671328+0000","last_peered":"2024-03-04T06:38:48.671328+0000","last_clean":"2024-03-04T06:38:48.671328+0000","last_became_active":"2024-03-04T06:38:12.913476+0000","last_became_peered":"2024-03-04T06:38:12.913476+0000","last_unstale":"2024-03-04T06:38:48.671328+0000","last_undegraded":"2024-03-04T06:38:48.671328+0000","last_fullsized":"2024-03-04T06:38:48.671328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:44:53.483514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670535+0000","last_change":"2024-03-04T06:38:12.549514+0000","last_active":"2024-03-04T06:38:48.670535+0000","last_peered":"2024-03-04T06:38:48.670535+0000","last_clean":"2024-03-04T06:38:48.670535+0000","last_became_active":"2024-03-04T06:38:12.549222+0000","last_became_peered":"2024-03-04T06:38:12.549222+0000","last_unstale":"2024-03-04T06:38:48.670535+0000","last_undegraded":"2024-03-04T06:38:48.670535+0000","last_fullsized":"2024-03-04T06:38:48.670535+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:54:24.051519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669472+0000","last_change":"2024-03-04T06:38:12.909428+0000","last_active":"2024-03-04T06:38:48.669472+0000","last_peered":"2024-03-04T06:38:48.669472+0000","last_clean":"2024-03-04T06:38:48.669472+0000","last_became_active":"2024-03-04T06:38:12.909146+0000","last_became_peered":"2024-03-04T06:38:12.909146+0000","last_unstale":"2024-03-04T06:38:48.669472+0000","last_undegraded":"2024-03-04T06:38:48.669472+0000","last_fullsized":"2024-03-04T06:38:48.669472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:44.391084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":25,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.308020+0000","last_change":"2024-03-04T06:38:12.544896+0000","last_active":"2024-03-04T06:38:48.308020+0000","last_peered":"2024-03-04T06:38:48.308020+0000","last_clean":"2024-03-04T06:38:48.308020+0000","last_became_active":"2024-03-04T06:38:12.543579+0000","last_became_peered":"2024-03-04T06:38:12.543579+0000","last_unstale":"2024-03-04T06:38:48.308020+0000","last_undegraded":"2024-03-04T06:38:48.308020+0000","last_fullsized":"2024-03-04T06:38:48.308020+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:39.451118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669778+0000","last_change":"2024-03-04T06:38:12.919018+0000","last_active":"2024-03-04T06:38:48.669778+0000","last_peered":"2024-03-04T06:38:48.669778+0000","last_clean":"2024-03-04T06:38:48.669778+0000","last_became_active":"2024-03-04T06:38:12.918716+0000","last_became_peered":"2024-03-04T06:38:12.918716+0000","last_unstale":"2024-03-04T06:38:48.669778+0000","last_undegraded":"2024-03-04T06:38:48.669778+0000","last_fullsized":"2024-03-04T06:38:48.669778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:06:47.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.307853+0000","last_change":"2024-03-04T06:38:12.550559+0000","last_active":"2024-03-04T06:38:48.307853+0000","last_peered":"2024-03-04T06:38:48.307853+0000","last_clean":"2024-03-04T06:38:48.307853+0000","last_became_active":"2024-03-04T06:38:12.547867+0000","last_became_peered":"2024-03-04T06:38:12.547867+0000","last_unstale":"2024-03-04T06:38:48.307853+0000","last_undegraded":"2024-03-04T06:38:48.307853+0000","last_fullsized":"2024-03-04T06:38:48.307853+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:04.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.671173+0000","last_change":"2024-03-04T06:38:12.913566+0000","last_active":"2024-03-04T06:38:48.671173+0000","last_peered":"2024-03-04T06:38:48.671173+0000","last_clean":"2024-03-04T06:38:48.671173+0000","last_became_active":"2024-03-04T06:38:12.910660+0000","last_became_peered":"2024-03-04T06:38:12.910660+0000","last_unstale":"2024-03-04T06:38:48.671173+0000","last_undegraded":"2024-03-04T06:38:48.671173+0000","last_fullsized":"2024-03-04T06:38:48.671173+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:16:42.862745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:49.953517+0000","last_change":"2024-03-04T06:38:47.376732+0000","last_active":"2024-03-04T06:38:49.953517+0000","last_peered":"2024-03-04T06:38:49.953517+0000","last_clean":"2024-03-04T06:38:49.953517+0000","last_became_active":"2024-03-04T06:38:47.376476+0000","last_became_peered":"2024-03-04T06:38:47.376476+0000","last_unstale":"2024-03-04T06:38:49.953517+0000","last_undegraded":"2024-03-04T06:38:49.953517+0000","last_fullsized":"2024-03-04T06:38:49.953517+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:21:52.679530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669583+0000","last_change":"2024-03-04T06:38:12.554795+0000","last_active":"2024-03-04T06:38:48.669583+0000","last_peered":"2024-03-04T06:38:48.669583+0000","last_clean":"2024-03-04T06:38:48.669583+0000","last_became_active":"2024-03-04T06:38:12.554461+0000","last_became_peered":"2024-03-04T06:38:12.554461+0000","last_unstale":"2024-03-04T06:38:48.669583+0000","last_undegraded":"2024-03-04T06:38:48.669583+0000","last_fullsized":"2024-03-04T06:38:48.669583+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:03:44.989709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669715+0000","last_change":"2024-03-04T06:38:12.897411+0000","last_active":"2024-03-04T06:38:48.669715+0000","last_peered":"2024-03-04T06:38:48.669715+0000","last_clean":"2024-03-04T06:38:48.669715+0000","last_became_active":"2024-03-04T06:38:12.896742+0000","last_became_peered":"2024-03-04T06:38:12.896742+0000","last_unstale":"2024-03-04T06:38:48.669715+0000","last_undegraded":"2024-03-04T06:38:48.669715+0000","last_fullsized":"2024-03-04T06:38:48.669715+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:14:21.032038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:49.954929+0000","last_change":"2024-03-04T06:38:47.318044+0000","last_active":"2024-03-04T06:38:49.954929+0000","last_peered":"2024-03-04T06:38:49.954929+0000","last_clean":"2024-03-04T06:38:49.954929+0000","last_became_active":"2024-03-04T06:38:47.317763+0000","last_became_peered":"2024-03-04T06:38:47.317763+0000","last_unstale":"2024-03-04T06:38:49.954929+0000","last_undegraded":"2024-03-04T06:38:49.954929+0000","last_fullsized":"2024-03-04T06:38:49.954929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:04.059027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670239+0000","last_change":"2024-03-04T06:38:12.548860+0000","last_active":"2024-03-04T06:38:48.670239+0000","last_peered":"2024-03-04T06:38:48.670239+0000","last_clean":"2024-03-04T06:38:48.670239+0000","last_became_active":"2024-03-04T06:38:12.548550+0000","last_became_peered":"2024-03-04T06:38:12.548550+0000","last_unstale":"2024-03-04T06:38:48.670239+0000","last_undegraded":"2024-03-04T06:38:48.670239+0000","last_fullsized":"2024-03-04T06:38:48.670239+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:47:43.188556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.307431+0000","last_change":"2024-03-04T06:38:12.908558+0000","last_active":"2024-03-04T06:38:48.307431+0000","last_peered":"2024-03-04T06:38:48.307431+0000","last_clean":"2024-03-04T06:38:48.307431+0000","last_became_active":"2024-03-04T06:38:12.908227+0000","last_became_peered":"2024-03-04T06:38:12.908227+0000","last_unstale":"2024-03-04T06:38:48.307431+0000","last_undegraded":"2024-03-04T06:38:48.307431+0000","last_fullsized":"2024-03-04T06:38:48.307431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:39:27.394161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:49.955081+0000","last_change":"2024-03-04T06:38:47.376856+0000","last_active":"2024-03-04T06:38:49.955081+0000","last_peered":"2024-03-04T06:38:49.955081+0000","last_clean":"2024-03-04T06:38:49.955081+0000","last_became_active":"2024-03-04T06:38:47.376418+0000","last_became_peered":"2024-03-04T06:38:47.376418+0000","last_unstale":"2024-03-04T06:38:49.955081+0000","last_undegraded":"2024-03-04T06:38:49.955081+0000","last_fullsized":"2024-03-04T06:38:49.955081+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:18:43.241370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669105+0000","last_change":"2024-03-04T06:38:12.914172+0000","last_active":"2024-03-04T06:38:48.669105+0000","last_peered":"2024-03-04T06:38:48.669105+0000","last_clean":"2024-03-04T06:38:48.669105+0000","last_became_active":"2024-03-04T06:38:12.913896+0000","last_became_peered":"2024-03-04T06:38:12.913896+0000","last_unstale":"2024-03-04T06:38:48.669105+0000","last_undegraded":"2024-03-04T06:38:48.669105+0000","last_fullsized":"2024-03-04T06:38:48.669105+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:53.141176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.308224+0000","last_change":"2024-03-04T06:38:12.540510+0000","last_active":"2024-03-04T06:38:48.308224+0000","last_peered":"2024-03-04T06:38:48.308224+0000","last_clean":"2024-03-04T06:38:48.308224+0000","last_became_active":"2024-03-04T06:38:12.540155+0000","last_became_peered":"2024-03-04T06:38:12.540155+0000","last_unstale":"2024-03-04T06:38:48.308224+0000","last_undegraded":"2024-03-04T06:38:48.308224+0000","last_fullsized":"2024-03-04T06:38:48.308224+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:39.660282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.930522+0000","last_change":"2024-03-04T06:38:47.317126+0000","last_active":"2024-03-04T06:38:50.930522+0000","last_peered":"2024-03-04T06:38:50.930522+0000","last_clean":"2024-03-04T06:38:50.930522+0000","last_became_active":"2024-03-04T06:38:47.316821+0000","last_became_peered":"2024-03-04T06:38:47.316821+0000","last_unstale":"2024-03-04T06:38:50.930522+0000","last_undegraded":"2024-03-04T06:38:50.930522+0000","last_fullsized":"2024-03-04T06:38:50.930522+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:38:44.635838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669076+0000","last_change":"2024-03-04T06:38:12.903488+0000","last_active":"2024-03-04T06:38:48.669076+0000","last_peered":"2024-03-04T06:38:48.669076+0000","last_clean":"2024-03-04T06:38:48.669076+0000","last_became_active":"2024-03-04T06:38:12.903235+0000","last_became_peered":"2024-03-04T06:38:12.903235+0000","last_unstale":"2024-03-04T06:38:48.669076+0000","last_undegraded":"2024-03-04T06:38:48.669076+0000","last_fullsized":"2024-03-04T06:38:48.669076+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:43.099957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670268+0000","last_change":"2024-03-04T06:38:12.550672+0000","last_active":"2024-03-04T06:38:48.670268+0000","last_peered":"2024-03-04T06:38:48.670268+0000","last_clean":"2024-03-04T06:38:48.670268+0000","last_became_active":"2024-03-04T06:38:12.550367+0000","last_became_peered":"2024-03-04T06:38:12.550367+0000","last_unstale":"2024-03-04T06:38:48.670268+0000","last_undegraded":"2024-03-04T06:38:48.670268+0000","last_fullsized":"2024-03-04T06:38:48.670268+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:57:27.060139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"64'128","reported_seq":262,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669764+0000","last_change":"2024-03-04T06:37:58.310255+0000","last_active":"2024-03-04T06:38:48.669764+0000","last_peered":"2024-03-04T06:38:48.669764+0000","last_clean":"2024-03-04T06:38:48.669764+0000","last_became_active":"2024-03-04T06:37:58.309800+0000","last_became_peered":"2024-03-04T06:37:58.309800+0000","last_unstale":"2024-03-04T06:38:48.669764+0000","last_undegraded":"2024-03-04T06:38:48.669764+0000","last_fullsized":"2024-03-04T06:38:48.669764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:38.185918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.923521+0000","last_change":"2024-03-04T06:38:47.321870+0000","last_active":"2024-03-04T06:38:50.923521+0000","last_peered":"2024-03-04T06:38:50.923521+0000","last_clean":"2024-03-04T06:38:50.923521+0000","last_became_active":"2024-03-04T06:38:47.321560+0000","last_became_peered":"2024-03-04T06:38:47.321560+0000","last_unstale":"2024-03-04T06:38:50.923521+0000","last_undegraded":"2024-03-04T06:38:50.923521+0000","last_fullsized":"2024-03-04T06:38:50.923521+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:40:27.719672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.307297+0000","last_change":"2024-03-04T06:38:12.910415+0000","last_active":"2024-03-04T06:38:48.307297+0000","last_peered":"2024-03-04T06:38:48.307297+0000","last_clean":"2024-03-04T06:38:48.307297+0000","last_became_active":"2024-03-04T06:38:12.910158+0000","last_became_peered":"2024-03-04T06:38:12.910158+0000","last_unstale":"2024-03-04T06:38:48.307297+0000","last_undegraded":"2024-03-04T06:38:48.307297+0000","last_fullsized":"2024-03-04T06:38:48.307297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:34.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669609+0000","last_change":"2024-03-04T06:38:12.556986+0000","last_active":"2024-03-04T06:38:48.669609+0000","last_peered":"2024-03-04T06:38:48.669609+0000","last_clean":"2024-03-04T06:38:48.669609+0000","last_became_active":"2024-03-04T06:38:12.556594+0000","last_became_peered":"2024-03-04T06:38:12.556594+0000","last_unstale":"2024-03-04T06:38:48.669609+0000","last_undegraded":"2024-03-04T06:38:48.669609+0000","last_fullsized":"2024-03-04T06:38:48.669609+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:52.669745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.923462+0000","last_change":"2024-03-04T06:38:47.376856+0000","last_active":"2024-03-04T06:38:50.923462+0000","last_peered":"2024-03-04T06:38:50.923462+0000","last_clean":"2024-03-04T06:38:50.923462+0000","last_became_active":"2024-03-04T06:38:47.376532+0000","last_became_peered":"2024-03-04T06:38:47.376532+0000","last_unstale":"2024-03-04T06:38:50.923462+0000","last_undegraded":"2024-03-04T06:38:50.923462+0000","last_fullsized":"2024-03-04T06:38:50.923462+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:21.206296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670762+0000","last_change":"2024-03-04T06:38:12.557967+0000","last_active":"2024-03-04T06:38:48.670762+0000","last_peered":"2024-03-04T06:38:48.670762+0000","last_clean":"2024-03-04T06:38:48.670762+0000","last_became_active":"2024-03-04T06:38:12.557397+0000","last_became_peered":"2024-03-04T06:38:12.557397+0000","last_unstale":"2024-03-04T06:38:48.670762+0000","last_undegraded":"2024-03-04T06:38:48.670762+0000","last_fullsized":"2024-03-04T06:38:48.670762+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.366465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669675+0000","last_change":"2024-03-04T06:38:12.905517+0000","last_active":"2024-03-04T06:38:48.669675+0000","last_peered":"2024-03-04T06:38:48.669675+0000","last_clean":"2024-03-04T06:38:48.669675+0000","last_became_active":"2024-03-04T06:38:12.905234+0000","last_became_peered":"2024-03-04T06:38:12.905234+0000","last_unstale":"2024-03-04T06:38:48.669675+0000","last_undegraded":"2024-03-04T06:38:48.669675+0000","last_fullsized":"2024-03-04T06:38:48.669675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:32:58.487468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.928057+0000","last_change":"2024-03-04T06:38:47.316978+0000","last_active":"2024-03-04T06:38:50.928057+0000","last_peered":"2024-03-04T06:38:50.928057+0000","last_clean":"2024-03-04T06:38:50.928057+0000","last_became_active":"2024-03-04T06:38:47.316666+0000","last_became_peered":"2024-03-04T06:38:47.316666+0000","last_unstale":"2024-03-04T06:38:50.928057+0000","last_undegraded":"2024-03-04T06:38:50.928057+0000","last_fullsized":"2024-03-04T06:38:50.928057+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:22.840327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670058+0000","last_change":"2024-03-04T06:38:12.542943+0000","last_active":"2024-03-04T06:38:48.670058+0000","last_peered":"2024-03-04T06:38:48.670058+0000","last_clean":"2024-03-04T06:38:48.670058+0000","last_became_active":"2024-03-04T06:38:12.542663+0000","last_became_peered":"2024-03-04T06:38:12.542663+0000","last_unstale":"2024-03-04T06:38:48.670058+0000","last_undegraded":"2024-03-04T06:38:48.670058+0000","last_fullsized":"2024-03-04T06:38:48.670058+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:11.583290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669777+0000","last_change":"2024-03-04T06:38:12.898034+0000","last_active":"2024-03-04T06:38:48.669777+0000","last_peered":"2024-03-04T06:38:48.669777+0000","last_clean":"2024-03-04T06:38:48.669777+0000","last_became_active":"2024-03-04T06:38:12.897766+0000","last_became_peered":"2024-03-04T06:38:12.897766+0000","last_unstale":"2024-03-04T06:38:48.669777+0000","last_undegraded":"2024-03-04T06:38:48.669777+0000","last_fullsized":"2024-03-04T06:38:48.669777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:56.085588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.712261+0000","last_change":"2024-03-04T06:38:47.376747+0000","last_active":"2024-03-04T06:38:50.712261+0000","last_peered":"2024-03-04T06:38:50.712261+0000","last_clean":"2024-03-04T06:38:50.712261+0000","last_became_active":"2024-03-04T06:38:47.376407+0000","last_became_peered":"2024-03-04T06:38:47.376407+0000","last_unstale":"2024-03-04T06:38:50.712261+0000","last_undegraded":"2024-03-04T06:38:50.712261+0000","last_fullsized":"2024-03-04T06:38:50.712261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:44.463155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670402+0000","last_change":"2024-03-04T06:38:12.554846+0000","last_active":"2024-03-04T06:38:48.670402+0000","last_peered":"2024-03-04T06:38:48.670402+0000","last_clean":"2024-03-04T06:38:48.670402+0000","last_became_active":"2024-03-04T06:38:12.554544+0000","last_became_peered":"2024-03-04T06:38:12.554544+0000","last_unstale":"2024-03-04T06:38:48.670402+0000","last_undegraded":"2024-03-04T06:38:48.670402+0000","last_fullsized":"2024-03-04T06:38:48.670402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:44.524183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.309066+0000","last_change":"2024-03-04T06:38:12.903163+0000","last_active":"2024-03-04T06:38:48.309066+0000","last_peered":"2024-03-04T06:38:48.309066+0000","last_clean":"2024-03-04T06:38:48.309066+0000","last_became_active":"2024-03-04T06:38:12.902896+0000","last_became_peered":"2024-03-04T06:38:12.902896+0000","last_unstale":"2024-03-04T06:38:48.309066+0000","last_undegraded":"2024-03-04T06:38:48.309066+0000","last_fullsized":"2024-03-04T06:38:48.309066+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:45:59.166463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669852+0000","last_change":"2024-03-04T06:38:12.556654+0000","last_active":"2024-03-04T06:38:48.669852+0000","last_peered":"2024-03-04T06:38:48.669852+0000","last_clean":"2024-03-04T06:38:48.669852+0000","last_became_active":"2024-03-04T06:38:12.556014+0000","last_became_peered":"2024-03-04T06:38:12.556014+0000","last_unstale":"2024-03-04T06:38:48.669852+0000","last_undegraded":"2024-03-04T06:38:48.669852+0000","last_fullsized":"2024-03-04T06:38:48.669852+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:45.975559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.307345+0000","last_change":"2024-03-04T06:38:12.906674+0000","last_active":"2024-03-04T06:38:48.307345+0000","last_peered":"2024-03-04T06:38:48.307345+0000","last_clean":"2024-03-04T06:38:48.307345+0000","last_became_active":"2024-03-04T06:38:12.906385+0000","last_became_peered":"2024-03-04T06:38:12.906385+0000","last_unstale":"2024-03-04T06:38:48.307345+0000","last_undegraded":"2024-03-04T06:38:48.307345+0000","last_fullsized":"2024-03-04T06:38:48.307345+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:29:56.436800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669750+0000","last_change":"2024-03-04T06:38:12.555463+0000","last_active":"2024-03-04T06:38:48.669750+0000","last_peered":"2024-03-04T06:38:48.669750+0000","last_clean":"2024-03-04T06:38:48.669750+0000","last_became_active":"2024-03-04T06:38:12.555150+0000","last_became_peered":"2024-03-04T06:38:12.555150+0000","last_unstale":"2024-03-04T06:38:48.669750+0000","last_undegraded":"2024-03-04T06:38:48.669750+0000","last_fullsized":"2024-03-04T06:38:48.669750+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:30.714863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.668914+0000","last_change":"2024-03-04T06:38:12.897860+0000","last_active":"2024-03-04T06:38:48.668914+0000","last_peered":"2024-03-04T06:38:48.668914+0000","last_clean":"2024-03-04T06:38:48.668914+0000","last_became_active":"2024-03-04T06:38:12.897568+0000","last_became_peered":"2024-03-04T06:38:12.897568+0000","last_unstale":"2024-03-04T06:38:48.668914+0000","last_undegraded":"2024-03-04T06:38:48.668914+0000","last_fullsized":"2024-03-04T06:38:48.668914+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:22:30.116519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669262+0000","last_change":"2024-03-04T06:38:12.556223+0000","last_active":"2024-03-04T06:38:48.669262+0000","last_peered":"2024-03-04T06:38:48.669262+0000","last_clean":"2024-03-04T06:38:48.669262+0000","last_became_active":"2024-03-04T06:38:12.555948+0000","last_became_peered":"2024-03-04T06:38:12.555948+0000","last_unstale":"2024-03-04T06:38:48.669262+0000","last_undegraded":"2024-03-04T06:38:48.669262+0000","last_fullsized":"2024-03-04T06:38:48.669262+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:19:51.659542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669378+0000","last_change":"2024-03-04T06:38:12.908686+0000","last_active":"2024-03-04T06:38:48.669378+0000","last_peered":"2024-03-04T06:38:48.669378+0000","last_clean":"2024-03-04T06:38:48.669378+0000","last_became_active":"2024-03-04T06:38:12.907114+0000","last_became_peered":"2024-03-04T06:38:12.907114+0000","last_unstale":"2024-03-04T06:38:48.669378+0000","last_undegraded":"2024-03-04T06:38:48.669378+0000","last_fullsized":"2024-03-04T06:38:48.669378+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:08:03.009115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.671300+0000","last_change":"2024-03-04T06:38:12.558399+0000","last_active":"2024-03-04T06:38:48.671300+0000","last_peered":"2024-03-04T06:38:48.671300+0000","last_clean":"2024-03-04T06:38:48.671300+0000","last_became_active":"2024-03-04T06:38:12.558068+0000","last_became_peered":"2024-03-04T06:38:12.558068+0000","last_unstale":"2024-03-04T06:38:48.671300+0000","last_undegraded":"2024-03-04T06:38:48.671300+0000","last_fullsized":"2024-03-04T06:38:48.671300+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:00.895079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669640+0000","last_change":"2024-03-04T06:38:12.904212+0000","last_active":"2024-03-04T06:38:48.669640+0000","last_peered":"2024-03-04T06:38:48.669640+0000","last_clean":"2024-03-04T06:38:48.669640+0000","last_became_active":"2024-03-04T06:38:12.903906+0000","last_became_peered":"2024-03-04T06:38:12.903906+0000","last_unstale":"2024-03-04T06:38:48.669640+0000","last_undegraded":"2024-03-04T06:38:48.669640+0000","last_fullsized":"2024-03-04T06:38:48.669640+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:27:10.766546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.308311+0000","last_change":"2024-03-04T06:38:12.548200+0000","last_active":"2024-03-04T06:38:48.308311+0000","last_peered":"2024-03-04T06:38:48.308311+0000","last_clean":"2024-03-04T06:38:48.308311+0000","last_became_active":"2024-03-04T06:38:12.547906+0000","last_became_peered":"2024-03-04T06:38:12.547906+0000","last_unstale":"2024-03-04T06:38:48.308311+0000","last_undegraded":"2024-03-04T06:38:48.308311+0000","last_fullsized":"2024-03-04T06:38:48.308311+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:11:39.491360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670684+0000","last_change":"2024-03-04T06:38:12.918955+0000","last_active":"2024-03-04T06:38:48.670684+0000","last_peered":"2024-03-04T06:38:48.670684+0000","last_clean":"2024-03-04T06:38:48.670684+0000","last_became_active":"2024-03-04T06:38:12.918684+0000","last_became_peered":"2024-03-04T06:38:12.918684+0000","last_unstale":"2024-03-04T06:38:48.670684+0000","last_undegraded":"2024-03-04T06:38:48.670684+0000","last_fullsized":"2024-03-04T06:38:48.670684+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:47:29.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669450+0000","last_change":"2024-03-04T06:38:12.547660+0000","last_active":"2024-03-04T06:38:48.669450+0000","last_peered":"2024-03-04T06:38:48.669450+0000","last_clean":"2024-03-04T06:38:48.669450+0000","last_became_active":"2024-03-04T06:38:12.547358+0000","last_became_peered":"2024-03-04T06:38:12.547358+0000","last_unstale":"2024-03-04T06:38:48.669450+0000","last_undegraded":"2024-03-04T06:38:48.669450+0000","last_fullsized":"2024-03-04T06:38:48.669450+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:10.370020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670657+0000","last_change":"2024-03-04T06:38:12.902066+0000","last_active":"2024-03-04T06:38:48.670657+0000","last_peered":"2024-03-04T06:38:48.670657+0000","last_clean":"2024-03-04T06:38:48.670657+0000","last_became_active":"2024-03-04T06:38:12.901331+0000","last_became_peered":"2024-03-04T06:38:12.901331+0000","last_unstale":"2024-03-04T06:38:48.670657+0000","last_undegraded":"2024-03-04T06:38:48.670657+0000","last_fullsized":"2024-03-04T06:38:48.670657+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:46:51.413734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.309069+0000","last_change":"2024-03-04T06:38:12.547376+0000","last_active":"2024-03-04T06:38:48.309069+0000","last_peered":"2024-03-04T06:38:48.309069+0000","last_clean":"2024-03-04T06:38:48.309069+0000","last_became_active":"2024-03-04T06:38:12.547108+0000","last_became_peered":"2024-03-04T06:38:12.547108+0000","last_unstale":"2024-03-04T06:38:48.309069+0000","last_undegraded":"2024-03-04T06:38:48.309069+0000","last_fullsized":"2024-03-04T06:38:48.309069+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:34:14.300865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.671544+0000","last_change":"2024-03-04T06:38:12.917263+0000","last_active":"2024-03-04T06:38:48.671544+0000","last_peered":"2024-03-04T06:38:48.671544+0000","last_clean":"2024-03-04T06:38:48.671544+0000","last_became_active":"2024-03-04T06:38:12.917001+0000","last_became_peered":"2024-03-04T06:38:12.917001+0000","last_unstale":"2024-03-04T06:38:48.671544+0000","last_undegraded":"2024-03-04T06:38:48.671544+0000","last_fullsized":"2024-03-04T06:38:48.671544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:54.912481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669333+0000","last_change":"2024-03-04T06:38:12.916968+0000","last_active":"2024-03-04T06:38:48.669333+0000","last_peered":"2024-03-04T06:38:48.669333+0000","last_clean":"2024-03-04T06:38:48.669333+0000","last_became_active":"2024-03-04T06:38:12.916669+0000","last_became_peered":"2024-03-04T06:38:12.916669+0000","last_unstale":"2024-03-04T06:38:48.669333+0000","last_undegraded":"2024-03-04T06:38:48.669333+0000","last_fullsized":"2024-03-04T06:38:48.669333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:18:16.919063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.308302+0000","last_change":"2024-03-04T06:38:12.892619+0000","last_active":"2024-03-04T06:38:48.308302+0000","last_peered":"2024-03-04T06:38:48.308302+0000","last_clean":"2024-03-04T06:38:48.308302+0000","last_became_active":"2024-03-04T06:38:12.892261+0000","last_became_peered":"2024-03-04T06:38:12.892261+0000","last_unstale":"2024-03-04T06:38:48.308302+0000","last_undegraded":"2024-03-04T06:38:48.308302+0000","last_fullsized":"2024-03-04T06:38:48.308302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:19:13.957414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670410+0000","last_change":"2024-03-04T06:38:12.899301+0000","last_active":"2024-03-04T06:38:48.670410+0000","last_peered":"2024-03-04T06:38:48.670410+0000","last_clean":"2024-03-04T06:38:48.670410+0000","last_became_active":"2024-03-04T06:38:12.898002+0000","last_became_peered":"2024-03-04T06:38:12.898002+0000","last_unstale":"2024-03-04T06:38:48.670410+0000","last_undegraded":"2024-03-04T06:38:48.670410+0000","last_fullsized":"2024-03-04T06:38:48.670410+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:46.969732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.307479+0000","last_change":"2024-03-04T06:38:12.908610+0000","last_active":"2024-03-04T06:38:48.307479+0000","last_peered":"2024-03-04T06:38:48.307479+0000","last_clean":"2024-03-04T06:38:48.307479+0000","last_became_active":"2024-03-04T06:38:12.907578+0000","last_became_peered":"2024-03-04T06:38:12.907578+0000","last_unstale":"2024-03-04T06:38:48.307479+0000","last_undegraded":"2024-03-04T06:38:48.307479+0000","last_fullsized":"2024-03-04T06:38:48.307479+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:52.078874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669386+0000","last_change":"2024-03-04T06:38:12.906536+0000","last_active":"2024-03-04T06:38:48.669386+0000","last_peered":"2024-03-04T06:38:48.669386+0000","last_clean":"2024-03-04T06:38:48.669386+0000","last_became_active":"2024-03-04T06:38:12.906183+0000","last_became_peered":"2024-03-04T06:38:12.906183+0000","last_unstale":"2024-03-04T06:38:48.669386+0000","last_undegraded":"2024-03-04T06:38:48.669386+0000","last_fullsized":"2024-03-04T06:38:48.669386+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:15:13.559021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669365+0000","last_change":"2024-03-04T06:38:12.899871+0000","last_active":"2024-03-04T06:38:48.669365+0000","last_peered":"2024-03-04T06:38:48.669365+0000","last_clean":"2024-03-04T06:38:48.669365+0000","last_became_active":"2024-03-04T06:38:12.899583+0000","last_became_peered":"2024-03-04T06:38:12.899583+0000","last_unstale":"2024-03-04T06:38:48.669365+0000","last_undegraded":"2024-03-04T06:38:48.669365+0000","last_fullsized":"2024-03-04T06:38:48.669365+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:51.628806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670932+0000","last_change":"2024-03-04T06:38:12.914660+0000","last_active":"2024-03-04T06:38:48.670932+0000","last_peered":"2024-03-04T06:38:48.670932+0000","last_clean":"2024-03-04T06:38:48.670932+0000","last_became_active":"2024-03-04T06:38:12.914354+0000","last_became_peered":"2024-03-04T06:38:12.914354+0000","last_unstale":"2024-03-04T06:38:48.670932+0000","last_undegraded":"2024-03-04T06:38:48.670932+0000","last_fullsized":"2024-03-04T06:38:48.670932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:28.750455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669848+0000","last_change":"2024-03-04T06:38:12.906752+0000","last_active":"2024-03-04T06:38:48.669848+0000","last_peered":"2024-03-04T06:38:48.669848+0000","last_clean":"2024-03-04T06:38:48.669848+0000","last_became_active":"2024-03-04T06:38:12.906492+0000","last_became_peered":"2024-03-04T06:38:12.906492+0000","last_unstale":"2024-03-04T06:38:48.669848+0000","last_undegraded":"2024-03-04T06:38:48.669848+0000","last_fullsized":"2024-03-04T06:38:48.669848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:24.841196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669571+0000","last_change":"2024-03-04T06:38:12.897151+0000","last_active":"2024-03-04T06:38:48.669571+0000","last_peered":"2024-03-04T06:38:48.669571+0000","last_clean":"2024-03-04T06:38:48.669571+0000","last_became_active":"2024-03-04T06:38:12.896787+0000","last_became_peered":"2024-03-04T06:38:12.896787+0000","last_unstale":"2024-03-04T06:38:48.669571+0000","last_undegraded":"2024-03-04T06:38:48.669571+0000","last_fullsized":"2024-03-04T06:38:48.669571+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:12:22.562737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.669956+0000","last_change":"2024-03-04T06:38:12.908348+0000","last_active":"2024-03-04T06:38:48.669956+0000","last_peered":"2024-03-04T06:38:48.669956+0000","last_clean":"2024-03-04T06:38:48.669956+0000","last_became_active":"2024-03-04T06:38:12.908021+0000","last_became_peered":"2024-03-04T06:38:12.908021+0000","last_unstale":"2024-03-04T06:38:48.669956+0000","last_undegraded":"2024-03-04T06:38:48.669956+0000","last_fullsized":"2024-03-04T06:38:48.669956+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:16:36.050910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670497+0000","last_change":"2024-03-04T06:38:12.898994+0000","last_active":"2024-03-04T06:38:48.670497+0000","last_peered":"2024-03-04T06:38:48.670497+0000","last_clean":"2024-03-04T06:38:48.670497+0000","last_became_active":"2024-03-04T06:38:12.898693+0000","last_became_peered":"2024-03-04T06:38:12.898693+0000","last_unstale":"2024-03-04T06:38:48.670497+0000","last_undegraded":"2024-03-04T06:38:48.670497+0000","last_fullsized":"2024-03-04T06:38:48.670497+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:40:01.173992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.307579+0000","last_change":"2024-03-04T06:38:12.898036+0000","last_active":"2024-03-04T06:38:48.307579+0000","last_peered":"2024-03-04T06:38:48.307579+0000","last_clean":"2024-03-04T06:38:48.307579+0000","last_became_active":"2024-03-04T06:38:12.897717+0000","last_became_peered":"2024-03-04T06:38:12.897717+0000","last_unstale":"2024-03-04T06:38:48.307579+0000","last_undegraded":"2024-03-04T06:38:48.307579+0000","last_fullsized":"2024-03-04T06:38:48.307579+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:58:02.821482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-04T06:38:48.670250+0000","last_change":"2024-03-04T06:38:12.915624+0000","last_active":"2024-03-04T06:38:48.670250+0000","last_peered":"2024-03-04T06:38:48.670250+0000","last_clean":"2024-03-04T06:38:48.670250+0000","last_became_active":"2024-03-04T06:38:12.915335+0000","last_became_peered":"2024-03-04T06:38:12.915335+0000","last_unstale":"2024-03-04T06:38:48.670250+0000","last_undegraded":"2024-03-04T06:38:48.670250+0000","last_fullsized":"2024-03-04T06:38:48.670250+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:52:58.038264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3146,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234007,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28272,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716880,"statfs":{"total":95995035648,"available":95966085120,"internally_reserved":0,"allocated":1282048,"data_stored":885771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56399999999999995}]},{"osd":1,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.53000000000000003}]},{"osd":2,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.57599999999999996}]},{"osd":4,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34000000000000002}]},{"osd":5,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.376},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.39700000000000002}]},{"osd":6,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.43099999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495644,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28280,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716872,"statfs":{"total":95995035648,"available":95966076928,"internally_reserved":0,"allocated":1290240,"data_stored":887846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.5},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.495,"15min":0.496},"min":{"1min":0.36899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.53800000000000003}]},{"osd":1,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68999999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57599999999999996}]},{"osd":2,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.753,"15min":0.753},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64700000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.441,"15min":0.435},"min":{"1min":0.34399999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.39800000000000002}]},{"osd":5,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.432,"15min":0.42199999999999999},"min":{"1min":0.35099999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.46200000000000002,"15min":0.45400000000000001},"min":{"1min":0.371,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42399999999999999}]},{"osd":7,"last update":"Mon Mar 4 06:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.44},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717452,"statfs":{"total":95995035648,"available":95966670848,"internally_reserved":0,"allocated":692224,"data_stored":295290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.32000000000000001},"min":{"1min":0.23300000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.376},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.33800000000000002},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.255}]},{"osd":2,"last update":"Mon Mar 4 06:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.36499999999999999},"min":{"1min":0.25800000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.55100000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.30399999999999999}]},{"osd":3,"last update":"Mon Mar 4 06:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.434,"15min":0.433},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.32400000000000001}]},{"osd":4,"last update":"Mon Mar 4 06:38:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48799999999999999}]},{"osd":5,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.747,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81799999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46800000000000003}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76400000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83299999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47399999999999998}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.45800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28288,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716864,"statfs":{"total":95995035648,"available":95966068736,"internally_reserved":0,"allocated":1294336,"data_stored":886226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 4 06:38:42 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.23200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51200000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.36599999999999999},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.31900000000000001}]},{"osd":2,"last update":"Mon Mar 4 06:38:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.379},{"interface":"front","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64600000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.35999999999999999}]},{"osd":3,"last update":"Mon Mar 4 06:39:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28899999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.40600000000000003}]},{"osd":4,"last update":"Mon Mar 4 06:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65600000000000003,"5min":0.877,"15min":0.877},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75800000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.55900000000000005}]},{"osd":5,"last update":"Mon Mar 4 06:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.80400000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.70099999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59099999999999997}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72899999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":1.2629999999999999,"15min":1.3759999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84599999999999997,"5min":11.987,"15min":11.987},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Mar 4 06:38:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65100000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411375,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":684032,"data_stored":295130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.32400000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.376,"15min":0.36399999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.217}]},{"osd":1,"last update":"Mon Mar 4 06:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.5,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.56499999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.28199999999999997}]},{"osd":3,"last update":"Mon Mar 4 06:39:23 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60099999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.248}]},{"osd":4,"last update":"Mon Mar 4 06:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.496},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.38500000000000001}]},{"osd":5,"last update":"Mon Mar 4 06:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.376},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61899999999999999,"15min":0.62},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84699999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.45100000000000001}]},{"osd":6,"last update":"Mon Mar 4 06:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85099999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.439}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.46800000000000003}]}]},{"osd":3,"up_from":25,"seq":107374182443,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717444,"statfs":{"total":95995035648,"available":95966662656,"internally_reserved":0,"allocated":704512,"data_stored":297582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.38900000000000001,"15min":0.39700000000000002},"min":{"1min":0.25600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.45400000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41499999999999998,"15min":0.42499999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.50700000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.318}]},{"osd":1,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41599999999999998,"15min":0.42399999999999999},"min":{"1min":0.27200000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.53500000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41999999999999998,"15min":0.42399999999999999},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52300000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.33500000000000002}]},{"osd":2,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70199999999999996,"5min":0.749,"15min":0.749},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.438,"15min":0.44800000000000001},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34699999999999998}]},{"osd":4,"last update":"Mon Mar 4 06:38:42 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.443},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.41999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81000000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.42499999999999999}]},{"osd":5,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79200000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77900000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45300000000000001}]},{"osd":6,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47999999999999998}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.51100000000000001}]}]},{"osd":4,"up_from":30,"seq":128849018918,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717448,"statfs":{"total":95995035648,"available":95966666752,"internally_reserved":0,"allocated":700416,"data_stored":295838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:38:47 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.76400000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":1.7310000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":1.131}]},{"osd":1,"last update":"Mon Mar 4 06:38:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66700000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.622},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67400000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":1.673}]},{"osd":2,"last update":"Mon Mar 4 06:38:47 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":1.706},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":1.155}]},{"osd":3,"last update":"Mon Mar 4 06:38:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.66400000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":1.179},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Mar 4 06:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.42199999999999999,"15min":0.40799999999999997},"min":{"1min":0.375,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":1.7549999999999999}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":1.7649999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.45400000000000001,"15min":0.442},"min":{"1min":0.36799999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":1.802}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":1.778},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47299999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757281,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27700,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717452,"statfs":{"total":95995035648,"available":95966670848,"internally_reserved":0,"allocated":696320,"data_stored":297237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.625,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42099999999999999}]},{"osd":1,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68899999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55400000000000005}]},{"osd":2,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64600000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.58899999999999997}]},{"osd":3,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.78900000000000003,"15min":0.83799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.63700000000000001,"5min":6.6180000000000003,"15min":6.6180000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.27800000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.39500000000000002,"15min":0.38100000000000001},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.61299999999999999}]},{"osd":6,"last update":"Mon Mar 4 06:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.46300000000000002},"min":{"1min":0.33000000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.624},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.32900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.65000000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.67700000000000005}]},{"osd":7,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:39:44.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:39:44.838 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:39:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='client.24698 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:39:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2024-03-04T06:39:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2024-03-04T06:39:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [0, 2]}]: dispatch 2024-03-04T06:39:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [0, 2]}]: dispatch 2024-03-04T06:39:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [0, 2]}]: dispatch 2024-03-04T06:39:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [0, 2]}]: dispatch 2024-03-04T06:39:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 3]}]: dispatch 2024-03-04T06:39:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 3]}]: dispatch 2024-03-04T06:39:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 1]}]: dispatch 2024-03-04T06:39:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [5, 2]}]: dispatch 2024-03-04T06:39:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 1]}]: dispatch 2024-03-04T06:39:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [5, 2]}]: dispatch 2024-03-04T06:39:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:39:45.150 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='client.24698 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:39:45.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2024-03-04T06:39:45.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2024-03-04T06:39:45.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [0, 2]}]: dispatch 2024-03-04T06:39:45.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [0, 2]}]: dispatch 2024-03-04T06:39:45.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [0, 2]}]: dispatch 2024-03-04T06:39:45.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [0, 2]}]: dispatch 2024-03-04T06:39:45.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 3]}]: dispatch 2024-03-04T06:39:45.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 3]}]: dispatch 2024-03-04T06:39:45.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 1]}]: dispatch 2024-03-04T06:39:45.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [5, 2]}]: dispatch 2024-03-04T06:39:45.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 1]}]: dispatch 2024-03-04T06:39:45.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [5, 2]}]: dispatch 2024-03-04T06:39:45.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:39:45.152 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='client.24698 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:39:45.152 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2024-03-04T06:39:45.152 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2024-03-04T06:39:45.152 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [0, 2]}]: dispatch 2024-03-04T06:39:45.152 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [0, 2]}]: dispatch 2024-03-04T06:39:45.152 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [0, 2]}]: dispatch 2024-03-04T06:39:45.152 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [0, 2]}]: dispatch 2024-03-04T06:39:45.152 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 3]}]: dispatch 2024-03-04T06:39:45.152 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 3]}]: dispatch 2024-03-04T06:39:45.152 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 1]}]: dispatch 2024-03-04T06:39:45.152 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [5, 2]}]: dispatch 2024-03-04T06:39:45.152 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 1]}]: dispatch 2024-03-04T06:39:45.152 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [5, 2]}]: dispatch 2024-03-04T06:39:45.153 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:39:45.530 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:39:45] "GET /metrics HTTP/1.1" 200 33648 "" "Prometheus/2.43.0" 2024-03-04T06:39:46.091 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[26846]: pgmap v37: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:46.091 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]': finished 2024-03-04T06:39:46.091 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [0, 2]}]': finished 2024-03-04T06:39:46.091 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [0, 2]}]': finished 2024-03-04T06:39:46.091 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 3]}]': finished 2024-03-04T06:39:46.091 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 1]}]': finished 2024-03-04T06:39:46.091 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [5, 2]}]': finished 2024-03-04T06:39:46.091 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[26846]: osdmap e68: 8 total, 8 up, 8 in 2024-03-04T06:39:46.091 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:46.092 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[37364]: pgmap v37: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:46.092 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]': finished 2024-03-04T06:39:46.092 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [0, 2]}]': finished 2024-03-04T06:39:46.092 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [0, 2]}]': finished 2024-03-04T06:39:46.092 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 3]}]': finished 2024-03-04T06:39:46.092 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 1]}]': finished 2024-03-04T06:39:46.092 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [5, 2]}]': finished 2024-03-04T06:39:46.092 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[37364]: osdmap e68: 8 total, 8 up, 8 in 2024-03-04T06:39:46.092 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:45 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:46.093 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:45 smithi137 podman[71560]: 2024-03-04 06:39:45.858711783 +0000 UTC m=+3.104829979 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-03-04T06:39:46.093 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 podman[71560]: 2024-03-04 06:39:46.091099184 +0000 UTC m=+3.337217423 container create f011a698fd197a9742cd547860f2303805933e76be0f5c013cf03038869d4345 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-04T06:39:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:45 smithi203 ceph-mon[30756]: pgmap v37: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:45 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]': finished 2024-03-04T06:39:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:45 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [0, 2]}]': finished 2024-03-04T06:39:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:45 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [0, 2]}]': finished 2024-03-04T06:39:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:45 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 3]}]': finished 2024-03-04T06:39:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:45 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 1]}]': finished 2024-03-04T06:39:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:45 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [5, 2]}]': finished 2024-03-04T06:39:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:45 smithi203 ceph-mon[30756]: osdmap e68: 8 total, 8 up, 8 in 2024-03-04T06:39:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:45 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:46.402 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 podman[71560]: 2024-03-04 06:39:46.318417141 +0000 UTC m=+3.564535343 container init f011a698fd197a9742cd547860f2303805933e76be0f5c013cf03038869d4345 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-04T06:39:46.402 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 podman[71560]: 2024-03-04 06:39:46.321705858 +0000 UTC m=+3.567824056 container start f011a698fd197a9742cd547860f2303805933e76be0f5c013cf03038869d4345 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-04T06:39:46.402 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.326Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-04T06:39:46.402 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.326Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-04T06:39:46.402 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-04T06:39:46.402 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-04T06:39:46.402 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-04T06:39:46.402 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-04T06:39:46.402 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-04T06:39:46.402 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=arp 2024-03-04T06:39:46.403 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-04T06:39:46.403 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-04T06:39:46.403 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-04T06:39:46.403 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-04T06:39:46.403 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-04T06:39:46.403 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-04T06:39:46.403 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-04T06:39:46.403 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=edac 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-04T06:39:46.404 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=os 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=stat 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-04T06:39:46.405 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=time 2024-03-04T06:39:46.406 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-04T06:39:46.406 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=uname 2024-03-04T06:39:46.406 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-04T06:39:46.406 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.327Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-04T06:39:46.406 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.328Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-04T06:39:46.406 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.328Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-04T06:39:46.406 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[71721]: ts=2024-03-04T06:39:46.328Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-04T06:39:46.406 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 bash[71560]: f011a698fd197a9742cd547860f2303805933e76be0f5c013cf03038869d4345 2024-03-04T06:39:46.793 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:39:46 smithi137 systemd[1]: Started Ceph node-exporter.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:39:47.091 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-mon[37364]: osdmap e69: 8 total, 8 up, 8 in 2024-03-04T06:39:47.091 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:47.091 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:47.091 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:47.091 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-mon[26846]: osdmap e69: 8 total, 8 up, 8 in 2024-03-04T06:39:47.091 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:47.091 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:47.091 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:46 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:47.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:46 smithi203 ceph-mon[30756]: osdmap e69: 8 total, 8 up, 8 in 2024-03-04T06:39:47.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:46 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:47.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:46 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:47.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:46 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:47.548 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:47 smithi203 systemd[1]: Starting Ceph node-exporter.b for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:39:47.661 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:39:47.663 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:39:47.836 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:47 smithi203 bash[61754]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-03-04T06:39:48.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:47 smithi137 ceph-mon[26846]: Deploying daemon node-exporter.b on smithi203 2024-03-04T06:39:48.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:47 smithi137 ceph-mon[26846]: pgmap v40: 105 pgs: 5 activating, 100 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:48.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:47 smithi137 ceph-mon[26846]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-03-04T06:39:48.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:47 smithi137 ceph-mon[37364]: Deploying daemon node-exporter.b on smithi203 2024-03-04T06:39:48.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:47 smithi137 ceph-mon[37364]: pgmap v40: 105 pgs: 5 activating, 100 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:48.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:47 smithi137 ceph-mon[37364]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-03-04T06:39:48.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:47 smithi203 ceph-mon[30756]: Deploying daemon node-exporter.b on smithi203 2024-03-04T06:39:48.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:47 smithi203 ceph-mon[30756]: pgmap v40: 105 pgs: 5 activating, 100 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:48.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:47 smithi203 ceph-mon[30756]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-03-04T06:39:48.096 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:47 smithi203 bash[61754]: Getting image source signatures 2024-03-04T06:39:48.096 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:47 smithi203 bash[61754]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-03-04T06:39:48.096 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:47 smithi203 bash[61754]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-03-04T06:39:48.096 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:47 smithi203 bash[61754]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-03-04T06:39:48.650 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-03-04T06:39:46.752324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593514,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":227,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":319,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":223440,"kb_used_data":7280,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":749737776,"statfs":{"total":767960285184,"available":767731482624,"internally_reserved":0,"allocated":7454720,"data_stored":4206444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001761"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830673+0000","last_change":"2024-03-04T06:38:12.919238+0000","last_active":"2024-03-04T06:39:44.830673+0000","last_peered":"2024-03-04T06:39:44.830673+0000","last_clean":"2024-03-04T06:39:44.830673+0000","last_became_active":"2024-03-04T06:38:12.918941+0000","last_became_peered":"2024-03-04T06:38:12.918941+0000","last_unstale":"2024-03-04T06:39:44.830673+0000","last_undegraded":"2024-03-04T06:39:44.830673+0000","last_fullsized":"2024-03-04T06:39:44.830673+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:10:03.122262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826566+0000","last_change":"2024-03-04T06:38:12.914740+0000","last_active":"2024-03-04T06:39:44.826566+0000","last_peered":"2024-03-04T06:39:44.826566+0000","last_clean":"2024-03-04T06:39:44.826566+0000","last_became_active":"2024-03-04T06:38:12.914436+0000","last_became_peered":"2024-03-04T06:38:12.914436+0000","last_unstale":"2024-03-04T06:39:44.826566+0000","last_undegraded":"2024-03-04T06:39:44.826566+0000","last_fullsized":"2024-03-04T06:39:44.826566+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:58.781088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.835674+0000","last_change":"2024-03-04T06:38:12.895666+0000","last_active":"2024-03-04T06:39:44.835674+0000","last_peered":"2024-03-04T06:39:44.835674+0000","last_clean":"2024-03-04T06:39:44.835674+0000","last_became_active":"2024-03-04T06:38:12.895398+0000","last_became_peered":"2024-03-04T06:38:12.895398+0000","last_unstale":"2024-03-04T06:39:44.835674+0000","last_undegraded":"2024-03-04T06:39:44.835674+0000","last_fullsized":"2024-03-04T06:39:44.835674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:10.744216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825411+0000","last_change":"2024-03-04T06:38:12.902256+0000","last_active":"2024-03-04T06:39:44.825411+0000","last_peered":"2024-03-04T06:39:44.825411+0000","last_clean":"2024-03-04T06:39:44.825411+0000","last_became_active":"2024-03-04T06:38:12.901792+0000","last_became_peered":"2024-03-04T06:38:12.901792+0000","last_unstale":"2024-03-04T06:39:44.825411+0000","last_undegraded":"2024-03-04T06:39:44.825411+0000","last_fullsized":"2024-03-04T06:39:44.825411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:45.163241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831292+0000","last_change":"2024-03-04T06:38:12.913797+0000","last_active":"2024-03-04T06:39:44.831292+0000","last_peered":"2024-03-04T06:39:44.831292+0000","last_clean":"2024-03-04T06:39:44.831292+0000","last_became_active":"2024-03-04T06:38:12.913517+0000","last_became_peered":"2024-03-04T06:38:12.913517+0000","last_unstale":"2024-03-04T06:39:44.831292+0000","last_undegraded":"2024-03-04T06:39:44.831292+0000","last_fullsized":"2024-03-04T06:39:44.831292+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:24.837813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825374+0000","last_change":"2024-03-04T06:38:12.904787+0000","last_active":"2024-03-04T06:39:44.825374+0000","last_peered":"2024-03-04T06:39:44.825374+0000","last_clean":"2024-03-04T06:39:44.825374+0000","last_became_active":"2024-03-04T06:38:12.904484+0000","last_became_peered":"2024-03-04T06:38:12.904484+0000","last_unstale":"2024-03-04T06:39:44.825374+0000","last_undegraded":"2024-03-04T06:39:44.825374+0000","last_fullsized":"2024-03-04T06:39:44.825374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:03:28.898688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829238+0000","last_change":"2024-03-04T06:38:12.913825+0000","last_active":"2024-03-04T06:39:44.829238+0000","last_peered":"2024-03-04T06:39:44.829238+0000","last_clean":"2024-03-04T06:39:44.829238+0000","last_became_active":"2024-03-04T06:38:12.913553+0000","last_became_peered":"2024-03-04T06:38:12.913553+0000","last_unstale":"2024-03-04T06:39:44.829238+0000","last_undegraded":"2024-03-04T06:39:44.829238+0000","last_fullsized":"2024-03-04T06:39:44.829238+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:23:17.322436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.442788+0000","last_change":"2024-03-04T06:38:12.902309+0000","last_active":"2024-03-04T06:38:51.442788+0000","last_peered":"2024-03-04T06:38:51.442788+0000","last_clean":"2024-03-04T06:38:51.442788+0000","last_became_active":"2024-03-04T06:38:12.902009+0000","last_became_peered":"2024-03-04T06:38:12.902009+0000","last_unstale":"2024-03-04T06:38:51.442788+0000","last_undegraded":"2024-03-04T06:38:51.442788+0000","last_fullsized":"2024-03-04T06:38:51.442788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:36:04.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830956+0000","last_change":"2024-03-04T06:38:12.916933+0000","last_active":"2024-03-04T06:39:44.830956+0000","last_peered":"2024-03-04T06:39:44.830956+0000","last_clean":"2024-03-04T06:39:44.830956+0000","last_became_active":"2024-03-04T06:38:12.913922+0000","last_became_peered":"2024-03-04T06:38:12.913922+0000","last_unstale":"2024-03-04T06:39:44.830956+0000","last_undegraded":"2024-03-04T06:39:44.830956+0000","last_fullsized":"2024-03-04T06:39:44.830956+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:08:21.342061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834690+0000","last_change":"2024-03-04T06:38:12.911185+0000","last_active":"2024-03-04T06:39:44.834690+0000","last_peered":"2024-03-04T06:39:44.834690+0000","last_clean":"2024-03-04T06:39:44.834690+0000","last_became_active":"2024-03-04T06:38:12.910906+0000","last_became_peered":"2024-03-04T06:38:12.910906+0000","last_unstale":"2024-03-04T06:39:44.834690+0000","last_undegraded":"2024-03-04T06:39:44.834690+0000","last_fullsized":"2024-03-04T06:39:44.834690+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:45.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834569+0000","last_change":"2024-03-04T06:38:12.916277+0000","last_active":"2024-03-04T06:39:44.834569+0000","last_peered":"2024-03-04T06:39:44.834569+0000","last_clean":"2024-03-04T06:39:44.834569+0000","last_became_active":"2024-03-04T06:38:12.915998+0000","last_became_peered":"2024-03-04T06:38:12.915998+0000","last_unstale":"2024-03-04T06:39:44.834569+0000","last_undegraded":"2024-03-04T06:39:44.834569+0000","last_fullsized":"2024-03-04T06:39:44.834569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:22:53.166929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.712735+0000","last_change":"2024-03-04T06:38:12.907393+0000","last_active":"2024-03-04T06:38:50.712735+0000","last_peered":"2024-03-04T06:38:50.712735+0000","last_clean":"2024-03-04T06:38:50.712735+0000","last_became_active":"2024-03-04T06:38:12.907111+0000","last_became_peered":"2024-03-04T06:38:12.907111+0000","last_unstale":"2024-03-04T06:38:50.712735+0000","last_undegraded":"2024-03-04T06:38:50.712735+0000","last_fullsized":"2024-03-04T06:38:50.712735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:18.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443080+0000","last_change":"2024-03-04T06:38:12.897003+0000","last_active":"2024-03-04T06:38:51.443080+0000","last_peered":"2024-03-04T06:38:51.443080+0000","last_clean":"2024-03-04T06:38:51.443080+0000","last_became_active":"2024-03-04T06:38:12.896729+0000","last_became_peered":"2024-03-04T06:38:12.896729+0000","last_unstale":"2024-03-04T06:38:51.443080+0000","last_undegraded":"2024-03-04T06:38:51.443080+0000","last_fullsized":"2024-03-04T06:38:51.443080+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:01:03.497642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834893+0000","last_change":"2024-03-04T06:38:12.896652+0000","last_active":"2024-03-04T06:39:44.834893+0000","last_peered":"2024-03-04T06:39:44.834893+0000","last_clean":"2024-03-04T06:39:44.834893+0000","last_became_active":"2024-03-04T06:38:12.896300+0000","last_became_peered":"2024-03-04T06:38:12.896300+0000","last_unstale":"2024-03-04T06:39:44.834893+0000","last_undegraded":"2024-03-04T06:39:44.834893+0000","last_fullsized":"2024-03-04T06:39:44.834893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:32.026507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825545+0000","last_change":"2024-03-04T06:38:12.907997+0000","last_active":"2024-03-04T06:39:44.825545+0000","last_peered":"2024-03-04T06:39:44.825545+0000","last_clean":"2024-03-04T06:39:44.825545+0000","last_became_active":"2024-03-04T06:38:12.907720+0000","last_became_peered":"2024-03-04T06:38:12.907720+0000","last_unstale":"2024-03-04T06:39:44.825545+0000","last_undegraded":"2024-03-04T06:39:44.825545+0000","last_fullsized":"2024-03-04T06:39:44.825545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:46:55.140847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825032+0000","last_change":"2024-03-04T06:38:12.899219+0000","last_active":"2024-03-04T06:39:44.825032+0000","last_peered":"2024-03-04T06:39:44.825032+0000","last_clean":"2024-03-04T06:39:44.825032+0000","last_became_active":"2024-03-04T06:38:12.898928+0000","last_became_peered":"2024-03-04T06:38:12.898928+0000","last_unstale":"2024-03-04T06:39:44.825032+0000","last_undegraded":"2024-03-04T06:39:44.825032+0000","last_fullsized":"2024-03-04T06:39:44.825032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:13.412822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825758+0000","last_change":"2024-03-04T06:38:12.908332+0000","last_active":"2024-03-04T06:39:44.825758+0000","last_peered":"2024-03-04T06:39:44.825758+0000","last_clean":"2024-03-04T06:39:44.825758+0000","last_became_active":"2024-03-04T06:38:12.908038+0000","last_became_peered":"2024-03-04T06:38:12.908038+0000","last_unstale":"2024-03-04T06:39:44.825758+0000","last_undegraded":"2024-03-04T06:39:44.825758+0000","last_fullsized":"2024-03-04T06:39:44.825758+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:05:49.146138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826759+0000","last_change":"2024-03-04T06:38:12.899134+0000","last_active":"2024-03-04T06:39:44.826759+0000","last_peered":"2024-03-04T06:39:44.826759+0000","last_clean":"2024-03-04T06:39:44.826759+0000","last_became_active":"2024-03-04T06:38:12.898801+0000","last_became_peered":"2024-03-04T06:38:12.898801+0000","last_unstale":"2024-03-04T06:39:44.826759+0000","last_undegraded":"2024-03-04T06:39:44.826759+0000","last_fullsized":"2024-03-04T06:39:44.826759+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:21:48.465552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829127+0000","last_change":"2024-03-04T06:38:12.918000+0000","last_active":"2024-03-04T06:39:44.829127+0000","last_peered":"2024-03-04T06:39:44.829127+0000","last_clean":"2024-03-04T06:39:44.829127+0000","last_became_active":"2024-03-04T06:38:12.914159+0000","last_became_peered":"2024-03-04T06:38:12.914159+0000","last_unstale":"2024-03-04T06:39:44.829127+0000","last_undegraded":"2024-03-04T06:39:44.829127+0000","last_fullsized":"2024-03-04T06:39:44.829127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:24.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834743+0000","last_change":"2024-03-04T06:38:12.550843+0000","last_active":"2024-03-04T06:39:44.834743+0000","last_peered":"2024-03-04T06:39:44.834743+0000","last_clean":"2024-03-04T06:39:44.834743+0000","last_became_active":"2024-03-04T06:38:12.550141+0000","last_became_peered":"2024-03-04T06:38:12.550141+0000","last_unstale":"2024-03-04T06:39:44.834743+0000","last_undegraded":"2024-03-04T06:39:44.834743+0000","last_fullsized":"2024-03-04T06:39:44.834743+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:01.969570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443236+0000","last_change":"2024-03-04T06:38:12.896389+0000","last_active":"2024-03-04T06:38:51.443236+0000","last_peered":"2024-03-04T06:38:51.443236+0000","last_clean":"2024-03-04T06:38:51.443236+0000","last_became_active":"2024-03-04T06:38:12.896120+0000","last_became_peered":"2024-03-04T06:38:12.896120+0000","last_unstale":"2024-03-04T06:38:51.443236+0000","last_undegraded":"2024-03-04T06:38:51.443236+0000","last_fullsized":"2024-03-04T06:38:51.443236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:57.729499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443310+0000","last_change":"2024-03-04T06:38:12.550800+0000","last_active":"2024-03-04T06:38:51.443310+0000","last_peered":"2024-03-04T06:38:51.443310+0000","last_clean":"2024-03-04T06:38:51.443310+0000","last_became_active":"2024-03-04T06:38:12.550444+0000","last_became_peered":"2024-03-04T06:38:12.550444+0000","last_unstale":"2024-03-04T06:38:51.443310+0000","last_undegraded":"2024-03-04T06:38:51.443310+0000","last_fullsized":"2024-03-04T06:38:51.443310+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:42.209194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834447+0000","last_change":"2024-03-04T06:38:12.903258+0000","last_active":"2024-03-04T06:39:44.834447+0000","last_peered":"2024-03-04T06:39:44.834447+0000","last_clean":"2024-03-04T06:39:44.834447+0000","last_became_active":"2024-03-04T06:38:12.902982+0000","last_became_peered":"2024-03-04T06:38:12.902982+0000","last_unstale":"2024-03-04T06:39:44.834447+0000","last_undegraded":"2024-03-04T06:39:44.834447+0000","last_fullsized":"2024-03-04T06:39:44.834447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:31:23.228035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:45.834266+0000","last_change":"2024-03-04T06:39:45.833985+0000","last_active":"2024-03-04T06:39:45.834266+0000","last_peered":"2024-03-04T06:39:45.834266+0000","last_clean":"2024-03-04T06:39:45.834266+0000","last_became_active":"2024-03-04T06:39:45.831328+0000","last_became_peered":"2024-03-04T06:39:45.831328+0000","last_unstale":"2024-03-04T06:39:45.834266+0000","last_undegraded":"2024-03-04T06:39:45.834266+0000","last_fullsized":"2024-03-04T06:39:45.834266+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:31.095064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":5,"reported_epoch":69,"state":"activating","last_fresh":"2024-03-04T06:39:45.827885+0000","last_change":"2024-03-04T06:39:45.826136+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:39:45.827885+0000","last_undegraded":"2024-03-04T06:39:45.827885+0000","last_fullsized":"2024-03-04T06:39:45.827885+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:51.404998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":["2","1","4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830161+0000","last_change":"2024-03-04T06:38:12.556246+0000","last_active":"2024-03-04T06:39:44.830161+0000","last_peered":"2024-03-04T06:39:44.830161+0000","last_clean":"2024-03-04T06:39:44.830161+0000","last_became_active":"2024-03-04T06:38:12.555860+0000","last_became_peered":"2024-03-04T06:38:12.555860+0000","last_unstale":"2024-03-04T06:39:44.830161+0000","last_undegraded":"2024-03-04T06:39:44.830161+0000","last_fullsized":"2024-03-04T06:39:44.830161+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:41.910480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825545+0000","last_change":"2024-03-04T06:38:12.906907+0000","last_active":"2024-03-04T06:39:44.825545+0000","last_peered":"2024-03-04T06:39:44.825545+0000","last_clean":"2024-03-04T06:39:44.825545+0000","last_became_active":"2024-03-04T06:38:12.906615+0000","last_became_peered":"2024-03-04T06:38:12.906615+0000","last_unstale":"2024-03-04T06:39:44.825545+0000","last_undegraded":"2024-03-04T06:39:44.825545+0000","last_fullsized":"2024-03-04T06:39:44.825545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:21:15.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443148+0000","last_change":"2024-03-04T06:38:12.546234+0000","last_active":"2024-03-04T06:38:51.443148+0000","last_peered":"2024-03-04T06:38:51.443148+0000","last_clean":"2024-03-04T06:38:51.443148+0000","last_became_active":"2024-03-04T06:38:12.545975+0000","last_became_peered":"2024-03-04T06:38:12.545975+0000","last_unstale":"2024-03-04T06:38:51.443148+0000","last_undegraded":"2024-03-04T06:38:51.443148+0000","last_fullsized":"2024-03-04T06:38:51.443148+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:04.341190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.712429+0000","last_change":"2024-03-04T06:38:12.908256+0000","last_active":"2024-03-04T06:38:50.712429+0000","last_peered":"2024-03-04T06:38:50.712429+0000","last_clean":"2024-03-04T06:38:50.712429+0000","last_became_active":"2024-03-04T06:38:12.907953+0000","last_became_peered":"2024-03-04T06:38:12.907953+0000","last_unstale":"2024-03-04T06:38:50.712429+0000","last_undegraded":"2024-03-04T06:38:50.712429+0000","last_fullsized":"2024-03-04T06:38:50.712429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:03:03.291025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834226+0000","last_change":"2024-03-04T06:38:12.554332+0000","last_active":"2024-03-04T06:39:44.834226+0000","last_peered":"2024-03-04T06:39:44.834226+0000","last_clean":"2024-03-04T06:39:44.834226+0000","last_became_active":"2024-03-04T06:38:12.554044+0000","last_became_peered":"2024-03-04T06:38:12.554044+0000","last_unstale":"2024-03-04T06:39:44.834226+0000","last_undegraded":"2024-03-04T06:39:44.834226+0000","last_fullsized":"2024-03-04T06:39:44.834226+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:28:40.250342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834286+0000","last_change":"2024-03-04T06:38:12.910445+0000","last_active":"2024-03-04T06:39:44.834286+0000","last_peered":"2024-03-04T06:39:44.834286+0000","last_clean":"2024-03-04T06:39:44.834286+0000","last_became_active":"2024-03-04T06:38:12.909974+0000","last_became_peered":"2024-03-04T06:38:12.909974+0000","last_unstale":"2024-03-04T06:39:44.834286+0000","last_undegraded":"2024-03-04T06:39:44.834286+0000","last_fullsized":"2024-03-04T06:39:44.834286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:42:52.372021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443037+0000","last_change":"2024-03-04T06:38:12.543180+0000","last_active":"2024-03-04T06:38:51.443037+0000","last_peered":"2024-03-04T06:38:51.443037+0000","last_clean":"2024-03-04T06:38:51.443037+0000","last_became_active":"2024-03-04T06:38:12.542896+0000","last_became_peered":"2024-03-04T06:38:12.542896+0000","last_unstale":"2024-03-04T06:38:51.443037+0000","last_undegraded":"2024-03-04T06:38:51.443037+0000","last_fullsized":"2024-03-04T06:38:51.443037+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:15:09.816539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.442987+0000","last_change":"2024-03-04T06:38:12.895735+0000","last_active":"2024-03-04T06:38:51.442987+0000","last_peered":"2024-03-04T06:38:51.442987+0000","last_clean":"2024-03-04T06:38:51.442987+0000","last_became_active":"2024-03-04T06:38:12.895201+0000","last_became_peered":"2024-03-04T06:38:12.895201+0000","last_unstale":"2024-03-04T06:38:51.442987+0000","last_undegraded":"2024-03-04T06:38:51.442987+0000","last_fullsized":"2024-03-04T06:38:51.442987+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:12:35.373175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825037+0000","last_change":"2024-03-04T06:38:12.551089+0000","last_active":"2024-03-04T06:39:44.825037+0000","last_peered":"2024-03-04T06:39:44.825037+0000","last_clean":"2024-03-04T06:39:44.825037+0000","last_became_active":"2024-03-04T06:38:12.550791+0000","last_became_peered":"2024-03-04T06:38:12.550791+0000","last_unstale":"2024-03-04T06:39:44.825037+0000","last_undegraded":"2024-03-04T06:39:44.825037+0000","last_fullsized":"2024-03-04T06:39:44.825037+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:49.576267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825638+0000","last_change":"2024-03-04T06:38:12.909194+0000","last_active":"2024-03-04T06:39:44.825638+0000","last_peered":"2024-03-04T06:39:44.825638+0000","last_clean":"2024-03-04T06:39:44.825638+0000","last_became_active":"2024-03-04T06:38:12.908879+0000","last_became_peered":"2024-03-04T06:38:12.908879+0000","last_unstale":"2024-03-04T06:39:44.825638+0000","last_undegraded":"2024-03-04T06:39:44.825638+0000","last_fullsized":"2024-03-04T06:39:44.825638+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:23.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834767+0000","last_change":"2024-03-04T06:38:12.544023+0000","last_active":"2024-03-04T06:39:44.834767+0000","last_peered":"2024-03-04T06:39:44.834767+0000","last_clean":"2024-03-04T06:39:44.834767+0000","last_became_active":"2024-03-04T06:38:12.543699+0000","last_became_peered":"2024-03-04T06:38:12.543699+0000","last_unstale":"2024-03-04T06:39:44.834767+0000","last_undegraded":"2024-03-04T06:39:44.834767+0000","last_fullsized":"2024-03-04T06:39:44.834767+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:19.418372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825706+0000","last_change":"2024-03-04T06:38:12.903510+0000","last_active":"2024-03-04T06:39:44.825706+0000","last_peered":"2024-03-04T06:39:44.825706+0000","last_clean":"2024-03-04T06:39:44.825706+0000","last_became_active":"2024-03-04T06:38:12.903226+0000","last_became_peered":"2024-03-04T06:38:12.903226+0000","last_unstale":"2024-03-04T06:39:44.825706+0000","last_undegraded":"2024-03-04T06:39:44.825706+0000","last_fullsized":"2024-03-04T06:39:44.825706+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:49:29.474747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825656+0000","last_change":"2024-03-04T06:38:12.550879+0000","last_active":"2024-03-04T06:39:44.825656+0000","last_peered":"2024-03-04T06:39:44.825656+0000","last_clean":"2024-03-04T06:39:44.825656+0000","last_became_active":"2024-03-04T06:38:12.549931+0000","last_became_peered":"2024-03-04T06:38:12.549931+0000","last_unstale":"2024-03-04T06:39:44.825656+0000","last_undegraded":"2024-03-04T06:39:44.825656+0000","last_fullsized":"2024-03-04T06:39:44.825656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:33.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834364+0000","last_change":"2024-03-04T06:38:12.903875+0000","last_active":"2024-03-04T06:39:44.834364+0000","last_peered":"2024-03-04T06:39:44.834364+0000","last_clean":"2024-03-04T06:39:44.834364+0000","last_became_active":"2024-03-04T06:38:12.903600+0000","last_became_peered":"2024-03-04T06:38:12.903600+0000","last_unstale":"2024-03-04T06:39:44.834364+0000","last_undegraded":"2024-03-04T06:39:44.834364+0000","last_fullsized":"2024-03-04T06:39:44.834364+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:32.774333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826349+0000","last_change":"2024-03-04T06:38:12.551496+0000","last_active":"2024-03-04T06:39:44.826349+0000","last_peered":"2024-03-04T06:39:44.826349+0000","last_clean":"2024-03-04T06:39:44.826349+0000","last_became_active":"2024-03-04T06:38:12.551202+0000","last_became_peered":"2024-03-04T06:38:12.551202+0000","last_unstale":"2024-03-04T06:39:44.826349+0000","last_undegraded":"2024-03-04T06:39:44.826349+0000","last_fullsized":"2024-03-04T06:39:44.826349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:19.526762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.712655+0000","last_change":"2024-03-04T06:38:12.911735+0000","last_active":"2024-03-04T06:38:50.712655+0000","last_peered":"2024-03-04T06:38:50.712655+0000","last_clean":"2024-03-04T06:38:50.712655+0000","last_became_active":"2024-03-04T06:38:12.911389+0000","last_became_peered":"2024-03-04T06:38:12.911389+0000","last_unstale":"2024-03-04T06:38:50.712655+0000","last_undegraded":"2024-03-04T06:38:50.712655+0000","last_fullsized":"2024-03-04T06:38:50.712655+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:25.284425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"63'9","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834399+0000","last_change":"2024-03-04T06:38:12.546352+0000","last_active":"2024-03-04T06:39:44.834399+0000","last_peered":"2024-03-04T06:39:44.834399+0000","last_clean":"2024-03-04T06:39:44.834399+0000","last_became_active":"2024-03-04T06:38:12.545863+0000","last_became_peered":"2024-03-04T06:38:12.545863+0000","last_unstale":"2024-03-04T06:39:44.834399+0000","last_undegraded":"2024-03-04T06:39:44.834399+0000","last_fullsized":"2024-03-04T06:39:44.834399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:08.181131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2348,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":69,"state":"activating","last_fresh":"2024-03-04T06:39:45.830603+0000","last_change":"2024-03-04T06:39:45.830603+0000","last_active":"2024-03-04T06:39:44.831302+0000","last_peered":"2024-03-04T06:38:51.444042+0000","last_clean":"2024-03-04T06:38:51.444042+0000","last_became_active":"2024-03-04T06:38:12.918269+0000","last_became_peered":"2024-03-04T06:38:12.918269+0000","last_unstale":"2024-03-04T06:39:45.830603+0000","last_undegraded":"2024-03-04T06:39:45.830603+0000","last_fullsized":"2024-03-04T06:39:45.830603+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:58:41.826266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":["7","1","3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834537+0000","last_change":"2024-03-04T06:38:12.547028+0000","last_active":"2024-03-04T06:39:44.834537+0000","last_peered":"2024-03-04T06:39:44.834537+0000","last_clean":"2024-03-04T06:39:44.834537+0000","last_became_active":"2024-03-04T06:38:12.546672+0000","last_became_peered":"2024-03-04T06:38:12.546672+0000","last_unstale":"2024-03-04T06:39:44.834537+0000","last_undegraded":"2024-03-04T06:39:44.834537+0000","last_fullsized":"2024-03-04T06:39:44.834537+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:21:00.773241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":5,"reported_epoch":69,"state":"activating","last_fresh":"2024-03-04T06:39:45.829974+0000","last_change":"2024-03-04T06:39:45.826574+0000","last_active":"2024-03-04T06:39:45.826375+0000","last_peered":"2024-03-04T06:38:50.932439+0000","last_clean":"2024-03-04T06:38:50.932439+0000","last_became_active":"2024-03-04T06:38:12.893498+0000","last_became_peered":"2024-03-04T06:38:12.893498+0000","last_unstale":"2024-03-04T06:39:45.829974+0000","last_undegraded":"2024-03-04T06:39:45.829974+0000","last_fullsized":"2024-03-04T06:39:45.829974+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:47:17.558117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":["2","0","3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825121+0000","last_change":"2024-03-04T06:38:12.549608+0000","last_active":"2024-03-04T06:39:44.825121+0000","last_peered":"2024-03-04T06:39:44.825121+0000","last_clean":"2024-03-04T06:39:44.825121+0000","last_became_active":"2024-03-04T06:38:12.549299+0000","last_became_peered":"2024-03-04T06:38:12.549299+0000","last_unstale":"2024-03-04T06:39:44.825121+0000","last_undegraded":"2024-03-04T06:39:44.825121+0000","last_fullsized":"2024-03-04T06:39:44.825121+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:12:23.543702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":69,"state":"activating","last_fresh":"2024-03-04T06:39:45.830502+0000","last_change":"2024-03-04T06:39:45.830502+0000","last_active":"2024-03-04T06:39:44.830633+0000","last_peered":"2024-03-04T06:38:51.443819+0000","last_clean":"2024-03-04T06:38:51.443819+0000","last_became_active":"2024-03-04T06:38:12.913476+0000","last_became_peered":"2024-03-04T06:38:12.913476+0000","last_unstale":"2024-03-04T06:39:45.830502+0000","last_undegraded":"2024-03-04T06:39:45.830502+0000","last_fullsized":"2024-03-04T06:39:45.830502+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:08:21.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":["7","2","3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833855+0000","last_change":"2024-03-04T06:38:12.549514+0000","last_active":"2024-03-04T06:39:44.833855+0000","last_peered":"2024-03-04T06:39:44.833855+0000","last_clean":"2024-03-04T06:39:44.833855+0000","last_became_active":"2024-03-04T06:38:12.549222+0000","last_became_peered":"2024-03-04T06:38:12.549222+0000","last_unstale":"2024-03-04T06:39:44.833855+0000","last_undegraded":"2024-03-04T06:39:44.833855+0000","last_fullsized":"2024-03-04T06:39:44.833855+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:54:24.051519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833859+0000","last_change":"2024-03-04T06:38:12.909428+0000","last_active":"2024-03-04T06:39:44.833859+0000","last_peered":"2024-03-04T06:39:44.833859+0000","last_clean":"2024-03-04T06:39:44.833859+0000","last_became_active":"2024-03-04T06:38:12.909146+0000","last_became_peered":"2024-03-04T06:38:12.909146+0000","last_unstale":"2024-03-04T06:39:44.833859+0000","last_undegraded":"2024-03-04T06:39:44.833859+0000","last_fullsized":"2024-03-04T06:39:44.833859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:44.391084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826021+0000","last_change":"2024-03-04T06:38:12.544896+0000","last_active":"2024-03-04T06:39:44.826021+0000","last_peered":"2024-03-04T06:39:44.826021+0000","last_clean":"2024-03-04T06:39:44.826021+0000","last_became_active":"2024-03-04T06:38:12.543579+0000","last_became_peered":"2024-03-04T06:38:12.543579+0000","last_unstale":"2024-03-04T06:39:44.826021+0000","last_undegraded":"2024-03-04T06:39:44.826021+0000","last_fullsized":"2024-03-04T06:39:44.826021+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:39.451118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831230+0000","last_change":"2024-03-04T06:38:12.919018+0000","last_active":"2024-03-04T06:39:44.831230+0000","last_peered":"2024-03-04T06:39:44.831230+0000","last_clean":"2024-03-04T06:39:44.831230+0000","last_became_active":"2024-03-04T06:38:12.918716+0000","last_became_peered":"2024-03-04T06:38:12.918716+0000","last_unstale":"2024-03-04T06:39:44.831230+0000","last_undegraded":"2024-03-04T06:39:44.831230+0000","last_fullsized":"2024-03-04T06:39:44.831230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:06:47.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.713017+0000","last_change":"2024-03-04T06:38:12.550559+0000","last_active":"2024-03-04T06:38:50.713017+0000","last_peered":"2024-03-04T06:38:50.713017+0000","last_clean":"2024-03-04T06:38:50.713017+0000","last_became_active":"2024-03-04T06:38:12.547867+0000","last_became_peered":"2024-03-04T06:38:12.547867+0000","last_unstale":"2024-03-04T06:38:50.713017+0000","last_undegraded":"2024-03-04T06:38:50.713017+0000","last_fullsized":"2024-03-04T06:38:50.713017+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:04.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829952+0000","last_change":"2024-03-04T06:38:12.913566+0000","last_active":"2024-03-04T06:39:44.829952+0000","last_peered":"2024-03-04T06:39:44.829952+0000","last_clean":"2024-03-04T06:39:44.829952+0000","last_became_active":"2024-03-04T06:38:12.910660+0000","last_became_peered":"2024-03-04T06:38:12.910660+0000","last_unstale":"2024-03-04T06:39:44.829952+0000","last_undegraded":"2024-03-04T06:39:44.829952+0000","last_fullsized":"2024-03-04T06:39:44.829952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:16:42.862745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825457+0000","last_change":"2024-03-04T06:38:47.376732+0000","last_active":"2024-03-04T06:39:44.825457+0000","last_peered":"2024-03-04T06:39:44.825457+0000","last_clean":"2024-03-04T06:39:44.825457+0000","last_became_active":"2024-03-04T06:38:47.376476+0000","last_became_peered":"2024-03-04T06:38:47.376476+0000","last_unstale":"2024-03-04T06:39:44.825457+0000","last_undegraded":"2024-03-04T06:39:44.825457+0000","last_fullsized":"2024-03-04T06:39:44.825457+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:21:52.679530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825893+0000","last_change":"2024-03-04T06:38:12.554795+0000","last_active":"2024-03-04T06:39:44.825893+0000","last_peered":"2024-03-04T06:39:44.825893+0000","last_clean":"2024-03-04T06:39:44.825893+0000","last_became_active":"2024-03-04T06:38:12.554461+0000","last_became_peered":"2024-03-04T06:38:12.554461+0000","last_unstale":"2024-03-04T06:39:44.825893+0000","last_undegraded":"2024-03-04T06:39:44.825893+0000","last_fullsized":"2024-03-04T06:39:44.825893+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:03:44.989709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825607+0000","last_change":"2024-03-04T06:38:12.897411+0000","last_active":"2024-03-04T06:39:44.825607+0000","last_peered":"2024-03-04T06:39:44.825607+0000","last_clean":"2024-03-04T06:39:44.825607+0000","last_became_active":"2024-03-04T06:38:12.896742+0000","last_became_peered":"2024-03-04T06:38:12.896742+0000","last_unstale":"2024-03-04T06:39:44.825607+0000","last_undegraded":"2024-03-04T06:39:44.825607+0000","last_fullsized":"2024-03-04T06:39:44.825607+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:14:21.032038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825967+0000","last_change":"2024-03-04T06:38:47.318044+0000","last_active":"2024-03-04T06:39:44.825967+0000","last_peered":"2024-03-04T06:39:44.825967+0000","last_clean":"2024-03-04T06:39:44.825967+0000","last_became_active":"2024-03-04T06:38:47.317763+0000","last_became_peered":"2024-03-04T06:38:47.317763+0000","last_unstale":"2024-03-04T06:39:44.825967+0000","last_undegraded":"2024-03-04T06:39:44.825967+0000","last_fullsized":"2024-03-04T06:39:44.825967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:04.059027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825073+0000","last_change":"2024-03-04T06:38:12.548860+0000","last_active":"2024-03-04T06:39:44.825073+0000","last_peered":"2024-03-04T06:39:44.825073+0000","last_clean":"2024-03-04T06:39:44.825073+0000","last_became_active":"2024-03-04T06:38:12.548550+0000","last_became_peered":"2024-03-04T06:38:12.548550+0000","last_unstale":"2024-03-04T06:39:44.825073+0000","last_undegraded":"2024-03-04T06:39:44.825073+0000","last_fullsized":"2024-03-04T06:39:44.825073+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:47:43.188556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.712707+0000","last_change":"2024-03-04T06:38:12.908558+0000","last_active":"2024-03-04T06:38:50.712707+0000","last_peered":"2024-03-04T06:38:50.712707+0000","last_clean":"2024-03-04T06:38:50.712707+0000","last_became_active":"2024-03-04T06:38:12.908227+0000","last_became_peered":"2024-03-04T06:38:12.908227+0000","last_unstale":"2024-03-04T06:38:50.712707+0000","last_undegraded":"2024-03-04T06:38:50.712707+0000","last_fullsized":"2024-03-04T06:38:50.712707+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:39:27.394161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826882+0000","last_change":"2024-03-04T06:38:47.376856+0000","last_active":"2024-03-04T06:39:44.826882+0000","last_peered":"2024-03-04T06:39:44.826882+0000","last_clean":"2024-03-04T06:39:44.826882+0000","last_became_active":"2024-03-04T06:38:47.376418+0000","last_became_peered":"2024-03-04T06:38:47.376418+0000","last_unstale":"2024-03-04T06:39:44.826882+0000","last_undegraded":"2024-03-04T06:39:44.826882+0000","last_fullsized":"2024-03-04T06:39:44.826882+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:18:43.241370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825346+0000","last_change":"2024-03-04T06:38:12.914172+0000","last_active":"2024-03-04T06:39:44.825346+0000","last_peered":"2024-03-04T06:39:44.825346+0000","last_clean":"2024-03-04T06:39:44.825346+0000","last_became_active":"2024-03-04T06:38:12.913896+0000","last_became_peered":"2024-03-04T06:38:12.913896+0000","last_unstale":"2024-03-04T06:39:44.825346+0000","last_undegraded":"2024-03-04T06:39:44.825346+0000","last_fullsized":"2024-03-04T06:39:44.825346+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:53.141176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826097+0000","last_change":"2024-03-04T06:38:12.540510+0000","last_active":"2024-03-04T06:39:44.826097+0000","last_peered":"2024-03-04T06:39:44.826097+0000","last_clean":"2024-03-04T06:39:44.826097+0000","last_became_active":"2024-03-04T06:38:12.540155+0000","last_became_peered":"2024-03-04T06:38:12.540155+0000","last_unstale":"2024-03-04T06:39:44.826097+0000","last_undegraded":"2024-03-04T06:39:44.826097+0000","last_fullsized":"2024-03-04T06:39:44.826097+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:39.660282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834384+0000","last_change":"2024-03-04T06:38:47.317126+0000","last_active":"2024-03-04T06:39:44.834384+0000","last_peered":"2024-03-04T06:39:44.834384+0000","last_clean":"2024-03-04T06:39:44.834384+0000","last_became_active":"2024-03-04T06:38:47.316821+0000","last_became_peered":"2024-03-04T06:38:47.316821+0000","last_unstale":"2024-03-04T06:39:44.834384+0000","last_undegraded":"2024-03-04T06:39:44.834384+0000","last_fullsized":"2024-03-04T06:39:44.834384+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:38:44.635838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443039+0000","last_change":"2024-03-04T06:38:12.903488+0000","last_active":"2024-03-04T06:38:51.443039+0000","last_peered":"2024-03-04T06:38:51.443039+0000","last_clean":"2024-03-04T06:38:51.443039+0000","last_became_active":"2024-03-04T06:38:12.903235+0000","last_became_peered":"2024-03-04T06:38:12.903235+0000","last_unstale":"2024-03-04T06:38:51.443039+0000","last_undegraded":"2024-03-04T06:38:51.443039+0000","last_fullsized":"2024-03-04T06:38:51.443039+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:43.099957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825213+0000","last_change":"2024-03-04T06:38:12.550672+0000","last_active":"2024-03-04T06:39:44.825213+0000","last_peered":"2024-03-04T06:39:44.825213+0000","last_clean":"2024-03-04T06:39:44.825213+0000","last_became_active":"2024-03-04T06:38:12.550367+0000","last_became_peered":"2024-03-04T06:38:12.550367+0000","last_unstale":"2024-03-04T06:39:44.825213+0000","last_undegraded":"2024-03-04T06:39:44.825213+0000","last_fullsized":"2024-03-04T06:39:44.825213+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:57:27.060139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"64'128","reported_seq":264,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830190+0000","last_change":"2024-03-04T06:37:58.310255+0000","last_active":"2024-03-04T06:39:44.830190+0000","last_peered":"2024-03-04T06:39:44.830190+0000","last_clean":"2024-03-04T06:39:44.830190+0000","last_became_active":"2024-03-04T06:37:58.309800+0000","last_became_peered":"2024-03-04T06:37:58.309800+0000","last_unstale":"2024-03-04T06:39:44.830190+0000","last_undegraded":"2024-03-04T06:39:44.830190+0000","last_fullsized":"2024-03-04T06:39:44.830190+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:38.185918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833479+0000","last_change":"2024-03-04T06:38:47.321870+0000","last_active":"2024-03-04T06:39:44.833479+0000","last_peered":"2024-03-04T06:39:44.833479+0000","last_clean":"2024-03-04T06:39:44.833479+0000","last_became_active":"2024-03-04T06:38:47.321560+0000","last_became_peered":"2024-03-04T06:38:47.321560+0000","last_unstale":"2024-03-04T06:39:44.833479+0000","last_undegraded":"2024-03-04T06:39:44.833479+0000","last_fullsized":"2024-03-04T06:39:44.833479+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:40:27.719672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":4,"reported_epoch":69,"state":"activating","last_fresh":"2024-03-04T06:39:45.826371+0000","last_change":"2024-03-04T06:39:45.826371+0000","last_active":"2024-03-04T06:39:45.826074+0000","last_peered":"2024-03-04T06:38:50.932358+0000","last_clean":"2024-03-04T06:38:50.932358+0000","last_became_active":"2024-03-04T06:38:12.910158+0000","last_became_peered":"2024-03-04T06:38:12.910158+0000","last_unstale":"2024-03-04T06:39:45.826371+0000","last_undegraded":"2024-03-04T06:39:45.826371+0000","last_fullsized":"2024-03-04T06:39:45.826371+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:08.818871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":["2","0","3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829032+0000","last_change":"2024-03-04T06:38:12.556986+0000","last_active":"2024-03-04T06:39:44.829032+0000","last_peered":"2024-03-04T06:39:44.829032+0000","last_clean":"2024-03-04T06:39:44.829032+0000","last_became_active":"2024-03-04T06:38:12.556594+0000","last_became_peered":"2024-03-04T06:38:12.556594+0000","last_unstale":"2024-03-04T06:39:44.829032+0000","last_undegraded":"2024-03-04T06:39:44.829032+0000","last_fullsized":"2024-03-04T06:39:44.829032+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:52.669745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834213+0000","last_change":"2024-03-04T06:38:47.376856+0000","last_active":"2024-03-04T06:39:44.834213+0000","last_peered":"2024-03-04T06:39:44.834213+0000","last_clean":"2024-03-04T06:39:44.834213+0000","last_became_active":"2024-03-04T06:38:47.376532+0000","last_became_peered":"2024-03-04T06:38:47.376532+0000","last_unstale":"2024-03-04T06:39:44.834213+0000","last_undegraded":"2024-03-04T06:39:44.834213+0000","last_fullsized":"2024-03-04T06:39:44.834213+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:21.206296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829433+0000","last_change":"2024-03-04T06:38:12.557967+0000","last_active":"2024-03-04T06:39:44.829433+0000","last_peered":"2024-03-04T06:39:44.829433+0000","last_clean":"2024-03-04T06:39:44.829433+0000","last_became_active":"2024-03-04T06:38:12.557397+0000","last_became_peered":"2024-03-04T06:38:12.557397+0000","last_unstale":"2024-03-04T06:39:44.829433+0000","last_undegraded":"2024-03-04T06:39:44.829433+0000","last_fullsized":"2024-03-04T06:39:44.829433+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.366465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826044+0000","last_change":"2024-03-04T06:38:12.905517+0000","last_active":"2024-03-04T06:39:44.826044+0000","last_peered":"2024-03-04T06:39:44.826044+0000","last_clean":"2024-03-04T06:39:44.826044+0000","last_became_active":"2024-03-04T06:38:12.905234+0000","last_became_peered":"2024-03-04T06:38:12.905234+0000","last_unstale":"2024-03-04T06:39:44.826044+0000","last_undegraded":"2024-03-04T06:39:44.826044+0000","last_fullsized":"2024-03-04T06:39:44.826044+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:32:58.487468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.442868+0000","last_change":"2024-03-04T06:38:47.316978+0000","last_active":"2024-03-04T06:38:51.442868+0000","last_peered":"2024-03-04T06:38:51.442868+0000","last_clean":"2024-03-04T06:38:51.442868+0000","last_became_active":"2024-03-04T06:38:47.316666+0000","last_became_peered":"2024-03-04T06:38:47.316666+0000","last_unstale":"2024-03-04T06:38:51.442868+0000","last_undegraded":"2024-03-04T06:38:51.442868+0000","last_fullsized":"2024-03-04T06:38:51.442868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:22.840327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826725+0000","last_change":"2024-03-04T06:38:12.542943+0000","last_active":"2024-03-04T06:39:44.826725+0000","last_peered":"2024-03-04T06:39:44.826725+0000","last_clean":"2024-03-04T06:39:44.826725+0000","last_became_active":"2024-03-04T06:38:12.542663+0000","last_became_peered":"2024-03-04T06:38:12.542663+0000","last_unstale":"2024-03-04T06:39:44.826725+0000","last_undegraded":"2024-03-04T06:39:44.826725+0000","last_fullsized":"2024-03-04T06:39:44.826725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:11.583290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443314+0000","last_change":"2024-03-04T06:38:12.898034+0000","last_active":"2024-03-04T06:38:51.443314+0000","last_peered":"2024-03-04T06:38:51.443314+0000","last_clean":"2024-03-04T06:38:51.443314+0000","last_became_active":"2024-03-04T06:38:12.897766+0000","last_became_peered":"2024-03-04T06:38:12.897766+0000","last_unstale":"2024-03-04T06:38:51.443314+0000","last_undegraded":"2024-03-04T06:38:51.443314+0000","last_fullsized":"2024-03-04T06:38:51.443314+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:56.085588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.930111+0000","last_change":"2024-03-04T06:38:47.376747+0000","last_active":"2024-03-04T06:38:50.930111+0000","last_peered":"2024-03-04T06:38:50.930111+0000","last_clean":"2024-03-04T06:38:50.930111+0000","last_became_active":"2024-03-04T06:38:47.376407+0000","last_became_peered":"2024-03-04T06:38:47.376407+0000","last_unstale":"2024-03-04T06:38:50.930111+0000","last_undegraded":"2024-03-04T06:38:50.930111+0000","last_fullsized":"2024-03-04T06:38:50.930111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:44.463155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834701+0000","last_change":"2024-03-04T06:38:12.554846+0000","last_active":"2024-03-04T06:39:44.834701+0000","last_peered":"2024-03-04T06:39:44.834701+0000","last_clean":"2024-03-04T06:39:44.834701+0000","last_became_active":"2024-03-04T06:38:12.554544+0000","last_became_peered":"2024-03-04T06:38:12.554544+0000","last_unstale":"2024-03-04T06:39:44.834701+0000","last_undegraded":"2024-03-04T06:39:44.834701+0000","last_fullsized":"2024-03-04T06:39:44.834701+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:44.524183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833734+0000","last_change":"2024-03-04T06:38:12.903163+0000","last_active":"2024-03-04T06:39:44.833734+0000","last_peered":"2024-03-04T06:39:44.833734+0000","last_clean":"2024-03-04T06:39:44.833734+0000","last_became_active":"2024-03-04T06:38:12.902896+0000","last_became_peered":"2024-03-04T06:38:12.902896+0000","last_unstale":"2024-03-04T06:39:44.833734+0000","last_undegraded":"2024-03-04T06:39:44.833734+0000","last_fullsized":"2024-03-04T06:39:44.833734+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:45:59.166463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829163+0000","last_change":"2024-03-04T06:38:12.556654+0000","last_active":"2024-03-04T06:39:44.829163+0000","last_peered":"2024-03-04T06:39:44.829163+0000","last_clean":"2024-03-04T06:39:44.829163+0000","last_became_active":"2024-03-04T06:38:12.556014+0000","last_became_peered":"2024-03-04T06:38:12.556014+0000","last_unstale":"2024-03-04T06:39:44.829163+0000","last_undegraded":"2024-03-04T06:39:44.829163+0000","last_fullsized":"2024-03-04T06:39:44.829163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:45.975559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.712552+0000","last_change":"2024-03-04T06:38:12.906674+0000","last_active":"2024-03-04T06:38:50.712552+0000","last_peered":"2024-03-04T06:38:50.712552+0000","last_clean":"2024-03-04T06:38:50.712552+0000","last_became_active":"2024-03-04T06:38:12.906385+0000","last_became_peered":"2024-03-04T06:38:12.906385+0000","last_unstale":"2024-03-04T06:38:50.712552+0000","last_undegraded":"2024-03-04T06:38:50.712552+0000","last_fullsized":"2024-03-04T06:38:50.712552+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:29:56.436800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825787+0000","last_change":"2024-03-04T06:38:12.555463+0000","last_active":"2024-03-04T06:39:44.825787+0000","last_peered":"2024-03-04T06:39:44.825787+0000","last_clean":"2024-03-04T06:39:44.825787+0000","last_became_active":"2024-03-04T06:38:12.555150+0000","last_became_peered":"2024-03-04T06:38:12.555150+0000","last_unstale":"2024-03-04T06:39:44.825787+0000","last_undegraded":"2024-03-04T06:39:44.825787+0000","last_fullsized":"2024-03-04T06:39:44.825787+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:30.714863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.442877+0000","last_change":"2024-03-04T06:38:12.897860+0000","last_active":"2024-03-04T06:38:51.442877+0000","last_peered":"2024-03-04T06:38:51.442877+0000","last_clean":"2024-03-04T06:38:51.442877+0000","last_became_active":"2024-03-04T06:38:12.897568+0000","last_became_peered":"2024-03-04T06:38:12.897568+0000","last_unstale":"2024-03-04T06:38:51.442877+0000","last_undegraded":"2024-03-04T06:38:51.442877+0000","last_fullsized":"2024-03-04T06:38:51.442877+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:22:30.116519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825765+0000","last_change":"2024-03-04T06:38:12.556223+0000","last_active":"2024-03-04T06:39:44.825765+0000","last_peered":"2024-03-04T06:39:44.825765+0000","last_clean":"2024-03-04T06:39:44.825765+0000","last_became_active":"2024-03-04T06:38:12.555948+0000","last_became_peered":"2024-03-04T06:38:12.555948+0000","last_unstale":"2024-03-04T06:39:44.825765+0000","last_undegraded":"2024-03-04T06:39:44.825765+0000","last_fullsized":"2024-03-04T06:39:44.825765+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:19:51.659542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443156+0000","last_change":"2024-03-04T06:38:12.908686+0000","last_active":"2024-03-04T06:38:51.443156+0000","last_peered":"2024-03-04T06:38:51.443156+0000","last_clean":"2024-03-04T06:38:51.443156+0000","last_became_active":"2024-03-04T06:38:12.907114+0000","last_became_peered":"2024-03-04T06:38:12.907114+0000","last_unstale":"2024-03-04T06:38:51.443156+0000","last_undegraded":"2024-03-04T06:38:51.443156+0000","last_fullsized":"2024-03-04T06:38:51.443156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:08:03.009115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831276+0000","last_change":"2024-03-04T06:38:12.558399+0000","last_active":"2024-03-04T06:39:44.831276+0000","last_peered":"2024-03-04T06:39:44.831276+0000","last_clean":"2024-03-04T06:39:44.831276+0000","last_became_active":"2024-03-04T06:38:12.558068+0000","last_became_peered":"2024-03-04T06:38:12.558068+0000","last_unstale":"2024-03-04T06:39:44.831276+0000","last_undegraded":"2024-03-04T06:39:44.831276+0000","last_fullsized":"2024-03-04T06:39:44.831276+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:00.895079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834188+0000","last_change":"2024-03-04T06:38:12.904212+0000","last_active":"2024-03-04T06:39:44.834188+0000","last_peered":"2024-03-04T06:39:44.834188+0000","last_clean":"2024-03-04T06:39:44.834188+0000","last_became_active":"2024-03-04T06:38:12.903906+0000","last_became_peered":"2024-03-04T06:38:12.903906+0000","last_unstale":"2024-03-04T06:39:44.834188+0000","last_undegraded":"2024-03-04T06:39:44.834188+0000","last_fullsized":"2024-03-04T06:39:44.834188+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:27:10.766546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826396+0000","last_change":"2024-03-04T06:38:12.548200+0000","last_active":"2024-03-04T06:39:44.826396+0000","last_peered":"2024-03-04T06:39:44.826396+0000","last_clean":"2024-03-04T06:39:44.826396+0000","last_became_active":"2024-03-04T06:38:12.547906+0000","last_became_peered":"2024-03-04T06:38:12.547906+0000","last_unstale":"2024-03-04T06:39:44.826396+0000","last_undegraded":"2024-03-04T06:39:44.826396+0000","last_fullsized":"2024-03-04T06:39:44.826396+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:11:39.491360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829355+0000","last_change":"2024-03-04T06:38:12.918955+0000","last_active":"2024-03-04T06:39:44.829355+0000","last_peered":"2024-03-04T06:39:44.829355+0000","last_clean":"2024-03-04T06:39:44.829355+0000","last_became_active":"2024-03-04T06:38:12.918684+0000","last_became_peered":"2024-03-04T06:38:12.918684+0000","last_unstale":"2024-03-04T06:39:44.829355+0000","last_undegraded":"2024-03-04T06:39:44.829355+0000","last_fullsized":"2024-03-04T06:39:44.829355+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:47:29.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826269+0000","last_change":"2024-03-04T06:38:12.547660+0000","last_active":"2024-03-04T06:39:44.826269+0000","last_peered":"2024-03-04T06:39:44.826269+0000","last_clean":"2024-03-04T06:39:44.826269+0000","last_became_active":"2024-03-04T06:38:12.547358+0000","last_became_peered":"2024-03-04T06:38:12.547358+0000","last_unstale":"2024-03-04T06:39:44.826269+0000","last_undegraded":"2024-03-04T06:39:44.826269+0000","last_fullsized":"2024-03-04T06:39:44.826269+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:10.370020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825389+0000","last_change":"2024-03-04T06:38:12.902066+0000","last_active":"2024-03-04T06:39:44.825389+0000","last_peered":"2024-03-04T06:39:44.825389+0000","last_clean":"2024-03-04T06:39:44.825389+0000","last_became_active":"2024-03-04T06:38:12.901331+0000","last_became_peered":"2024-03-04T06:38:12.901331+0000","last_unstale":"2024-03-04T06:39:44.825389+0000","last_undegraded":"2024-03-04T06:39:44.825389+0000","last_fullsized":"2024-03-04T06:39:44.825389+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:46:51.413734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826848+0000","last_change":"2024-03-04T06:38:12.547376+0000","last_active":"2024-03-04T06:39:44.826848+0000","last_peered":"2024-03-04T06:39:44.826848+0000","last_clean":"2024-03-04T06:39:44.826848+0000","last_became_active":"2024-03-04T06:38:12.547108+0000","last_became_peered":"2024-03-04T06:38:12.547108+0000","last_unstale":"2024-03-04T06:39:44.826848+0000","last_undegraded":"2024-03-04T06:39:44.826848+0000","last_fullsized":"2024-03-04T06:39:44.826848+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:34:14.300865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830796+0000","last_change":"2024-03-04T06:38:12.917263+0000","last_active":"2024-03-04T06:39:44.830796+0000","last_peered":"2024-03-04T06:39:44.830796+0000","last_clean":"2024-03-04T06:39:44.830796+0000","last_became_active":"2024-03-04T06:38:12.917001+0000","last_became_peered":"2024-03-04T06:38:12.917001+0000","last_unstale":"2024-03-04T06:39:44.830796+0000","last_undegraded":"2024-03-04T06:39:44.830796+0000","last_fullsized":"2024-03-04T06:39:44.830796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:54.912481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833760+0000","last_change":"2024-03-04T06:38:12.916968+0000","last_active":"2024-03-04T06:39:44.833760+0000","last_peered":"2024-03-04T06:39:44.833760+0000","last_clean":"2024-03-04T06:39:44.833760+0000","last_became_active":"2024-03-04T06:38:12.916669+0000","last_became_peered":"2024-03-04T06:38:12.916669+0000","last_unstale":"2024-03-04T06:39:44.833760+0000","last_undegraded":"2024-03-04T06:39:44.833760+0000","last_fullsized":"2024-03-04T06:39:44.833760+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:18:16.919063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826181+0000","last_change":"2024-03-04T06:38:12.892619+0000","last_active":"2024-03-04T06:39:44.826181+0000","last_peered":"2024-03-04T06:39:44.826181+0000","last_clean":"2024-03-04T06:39:44.826181+0000","last_became_active":"2024-03-04T06:38:12.892261+0000","last_became_peered":"2024-03-04T06:38:12.892261+0000","last_unstale":"2024-03-04T06:39:44.826181+0000","last_undegraded":"2024-03-04T06:39:44.826181+0000","last_fullsized":"2024-03-04T06:39:44.826181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:19:13.957414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825192+0000","last_change":"2024-03-04T06:38:12.899301+0000","last_active":"2024-03-04T06:39:44.825192+0000","last_peered":"2024-03-04T06:39:44.825192+0000","last_clean":"2024-03-04T06:39:44.825192+0000","last_became_active":"2024-03-04T06:38:12.898002+0000","last_became_peered":"2024-03-04T06:38:12.898002+0000","last_unstale":"2024-03-04T06:39:44.825192+0000","last_undegraded":"2024-03-04T06:39:44.825192+0000","last_fullsized":"2024-03-04T06:39:44.825192+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:46.969732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834361+0000","last_change":"2024-03-04T06:38:12.908610+0000","last_active":"2024-03-04T06:39:44.834361+0000","last_peered":"2024-03-04T06:39:44.834361+0000","last_clean":"2024-03-04T06:39:44.834361+0000","last_became_active":"2024-03-04T06:38:12.907578+0000","last_became_peered":"2024-03-04T06:38:12.907578+0000","last_unstale":"2024-03-04T06:39:44.834361+0000","last_undegraded":"2024-03-04T06:39:44.834361+0000","last_fullsized":"2024-03-04T06:39:44.834361+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:52.078874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443207+0000","last_change":"2024-03-04T06:38:12.906536+0000","last_active":"2024-03-04T06:38:51.443207+0000","last_peered":"2024-03-04T06:38:51.443207+0000","last_clean":"2024-03-04T06:38:51.443207+0000","last_became_active":"2024-03-04T06:38:12.906183+0000","last_became_peered":"2024-03-04T06:38:12.906183+0000","last_unstale":"2024-03-04T06:38:51.443207+0000","last_undegraded":"2024-03-04T06:38:51.443207+0000","last_fullsized":"2024-03-04T06:38:51.443207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:15:13.559021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826187+0000","last_change":"2024-03-04T06:38:12.899871+0000","last_active":"2024-03-04T06:39:44.826187+0000","last_peered":"2024-03-04T06:39:44.826187+0000","last_clean":"2024-03-04T06:39:44.826187+0000","last_became_active":"2024-03-04T06:38:12.899583+0000","last_became_peered":"2024-03-04T06:38:12.899583+0000","last_unstale":"2024-03-04T06:39:44.826187+0000","last_undegraded":"2024-03-04T06:39:44.826187+0000","last_fullsized":"2024-03-04T06:39:44.826187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:51.628806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834765+0000","last_change":"2024-03-04T06:38:12.914660+0000","last_active":"2024-03-04T06:39:44.834765+0000","last_peered":"2024-03-04T06:39:44.834765+0000","last_clean":"2024-03-04T06:39:44.834765+0000","last_became_active":"2024-03-04T06:38:12.914354+0000","last_became_peered":"2024-03-04T06:38:12.914354+0000","last_unstale":"2024-03-04T06:39:44.834765+0000","last_undegraded":"2024-03-04T06:39:44.834765+0000","last_fullsized":"2024-03-04T06:39:44.834765+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:28.750455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443344+0000","last_change":"2024-03-04T06:38:12.906752+0000","last_active":"2024-03-04T06:38:51.443344+0000","last_peered":"2024-03-04T06:38:51.443344+0000","last_clean":"2024-03-04T06:38:51.443344+0000","last_became_active":"2024-03-04T06:38:12.906492+0000","last_became_peered":"2024-03-04T06:38:12.906492+0000","last_unstale":"2024-03-04T06:38:51.443344+0000","last_undegraded":"2024-03-04T06:38:51.443344+0000","last_fullsized":"2024-03-04T06:38:51.443344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:24.841196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825148+0000","last_change":"2024-03-04T06:38:12.897151+0000","last_active":"2024-03-04T06:39:44.825148+0000","last_peered":"2024-03-04T06:39:44.825148+0000","last_clean":"2024-03-04T06:39:44.825148+0000","last_became_active":"2024-03-04T06:38:12.896787+0000","last_became_peered":"2024-03-04T06:38:12.896787+0000","last_unstale":"2024-03-04T06:39:44.825148+0000","last_undegraded":"2024-03-04T06:39:44.825148+0000","last_fullsized":"2024-03-04T06:39:44.825148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:12:22.562737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.442915+0000","last_change":"2024-03-04T06:38:12.908348+0000","last_active":"2024-03-04T06:38:51.442915+0000","last_peered":"2024-03-04T06:38:51.442915+0000","last_clean":"2024-03-04T06:38:51.442915+0000","last_became_active":"2024-03-04T06:38:12.908021+0000","last_became_peered":"2024-03-04T06:38:12.908021+0000","last_unstale":"2024-03-04T06:38:51.442915+0000","last_undegraded":"2024-03-04T06:38:51.442915+0000","last_fullsized":"2024-03-04T06:38:51.442915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:16:36.050910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825276+0000","last_change":"2024-03-04T06:38:12.898994+0000","last_active":"2024-03-04T06:39:44.825276+0000","last_peered":"2024-03-04T06:39:44.825276+0000","last_clean":"2024-03-04T06:39:44.825276+0000","last_became_active":"2024-03-04T06:38:12.898693+0000","last_became_peered":"2024-03-04T06:38:12.898693+0000","last_unstale":"2024-03-04T06:39:44.825276+0000","last_undegraded":"2024-03-04T06:39:44.825276+0000","last_fullsized":"2024-03-04T06:39:44.825276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:40:01.173992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834403+0000","last_change":"2024-03-04T06:38:12.898036+0000","last_active":"2024-03-04T06:39:44.834403+0000","last_peered":"2024-03-04T06:39:44.834403+0000","last_clean":"2024-03-04T06:39:44.834403+0000","last_became_active":"2024-03-04T06:38:12.897717+0000","last_became_peered":"2024-03-04T06:38:12.897717+0000","last_unstale":"2024-03-04T06:39:44.834403+0000","last_undegraded":"2024-03-04T06:39:44.834403+0000","last_fullsized":"2024-03-04T06:39:44.834403+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:58:02.821482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834420+0000","last_change":"2024-03-04T06:38:12.915624+0000","last_active":"2024-03-04T06:39:44.834420+0000","last_peered":"2024-03-04T06:39:44.834420+0000","last_clean":"2024-03-04T06:39:44.834420+0000","last_became_active":"2024-03-04T06:38:12.915335+0000","last_became_peered":"2024-03-04T06:38:12.915335+0000","last_unstale":"2024-03-04T06:39:44.834420+0000","last_undegraded":"2024-03-04T06:39:44.834420+0000","last_fullsized":"2024-03-04T06:39:44.834420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:52:58.038264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3146,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234008,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28284,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716868,"statfs":{"total":95995035648,"available":95966072832,"internally_reserved":0,"allocated":1294336,"data_stored":893069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47499999999999998}]},{"osd":1,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.439},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51800000000000002}]},{"osd":2,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.53200000000000003}]},{"osd":3,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.46400000000000002}]},{"osd":4,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.378}]},{"osd":5,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.56299999999999994}]},{"osd":6,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.49299999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495645,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28292,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716860,"statfs":{"total":95995035648,"available":95966064640,"internally_reserved":0,"allocated":1302528,"data_stored":895144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.495,"15min":0.496},"min":{"1min":0.36899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.76100000000000001}]},{"osd":1,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68999999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.753,"15min":0.753},"last":0.80200000000000005}]},{"osd":3,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64700000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.74299999999999999}]},{"osd":4,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.441,"15min":0.435},"min":{"1min":0.34399999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.46899999999999997}]},{"osd":5,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.432,"15min":0.42199999999999999},"min":{"1min":0.35099999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.46200000000000002,"15min":0.45400000000000001},"min":{"1min":0.371,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.57399999999999995}]},{"osd":7,"last update":"Mon Mar 4 06:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.61699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717444,"statfs":{"total":95995035648,"available":95966662656,"internally_reserved":0,"allocated":704512,"data_stored":302588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.32000000000000001},"min":{"1min":0.23300000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.33800000000000002},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.246}]},{"osd":2,"last update":"Mon Mar 4 06:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.36499999999999999},"min":{"1min":0.25800000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.55100000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.28899999999999998}]},{"osd":3,"last update":"Mon Mar 4 06:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.315},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.434,"15min":0.433},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.37}]},{"osd":4,"last update":"Mon Mar 4 06:38:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.747,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81799999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76400000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83299999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61599999999999999}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28296,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716856,"statfs":{"total":95995035648,"available":95966060544,"internally_reserved":0,"allocated":1306624,"data_stored":893524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 4 06:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38200000000000001,"15min":0.36599999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.29599999999999999}]},{"osd":2,"last update":"Mon Mar 4 06:38:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.312},{"interface":"front","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64600000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.26600000000000001}]},{"osd":3,"last update":"Mon Mar 4 06:39:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28899999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Mar 4 06:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65600000000000003,"5min":0.877,"15min":0.877},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75800000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.52200000000000002}]},{"osd":5,"last update":"Mon Mar 4 06:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.80400000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.70099999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.63800000000000001}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72899999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":1.2629999999999999,"15min":1.3759999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84599999999999997,"5min":11.987,"15min":11.987},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Mar 4 06:38:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55700000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411376,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717440,"statfs":{"total":95995035648,"available":95966658560,"internally_reserved":0,"allocated":708608,"data_stored":309568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.32400000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.376,"15min":0.36399999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33700000000000002}]},{"osd":1,"last update":"Mon Mar 4 06:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.5,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.56499999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.30199999999999999}]},{"osd":3,"last update":"Mon Mar 4 06:39:23 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60099999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Mar 4 06:39:44 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Mon Mar 4 06:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61899999999999999,"15min":0.62},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84699999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.85099999999999998}]},{"osd":6,"last update":"Mon Mar 4 06:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85099999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.745}]}]},{"osd":3,"up_from":25,"seq":107374182444,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717432,"statfs":{"total":95995035648,"available":95966650368,"internally_reserved":0,"allocated":716800,"data_stored":304880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.38900000000000001,"15min":0.39700000000000002},"min":{"1min":0.25600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.45400000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41499999999999998,"15min":0.42499999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.50700000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.47199999999999998}]},{"osd":1,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41599999999999998,"15min":0.42399999999999999},"min":{"1min":0.27200000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.53500000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41999999999999998,"15min":0.42399999999999999},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52300000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46000000000000002}]},{"osd":2,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70199999999999996,"5min":0.749,"15min":0.749},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.438,"15min":0.44800000000000001},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.52500000000000002}]},{"osd":4,"last update":"Mon Mar 4 06:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.68100000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69299999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.53700000000000003}]},{"osd":5,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79200000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77900000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55000000000000004}]},{"osd":6,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.58399999999999996}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.622}]}]},{"osd":4,"up_from":30,"seq":128849018919,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27716,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717436,"statfs":{"total":95995035648,"available":95966654464,"internally_reserved":0,"allocated":712704,"data_stored":303136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:38:47 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.76400000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.436}]},{"osd":1,"last update":"Mon Mar 4 06:38:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66700000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67400000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56499999999999995}]},{"osd":2,"last update":"Mon Mar 4 06:38:47 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Mon Mar 4 06:38:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.66400000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Mar 4 06:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.42199999999999999,"15min":0.40799999999999997},"min":{"1min":0.375,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59699999999999998}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.45400000000000001,"15min":0.442},"min":{"1min":0.36799999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.62}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53300000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757282,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717440,"statfs":{"total":95995035648,"available":95966658560,"internally_reserved":0,"allocated":708608,"data_stored":304535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.625,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42699999999999999}]},{"osd":1,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68899999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.627},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64600000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.59399999999999997}]},{"osd":3,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.78900000000000003,"15min":0.83799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.63700000000000001,"5min":6.6180000000000003,"15min":6.6180000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.27800000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.39500000000000002,"15min":0.38100000000000001},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.70499999999999996}]},{"osd":6,"last update":"Mon Mar 4 06:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.46300000000000002},"min":{"1min":0.33000000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.32900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.65000000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:39:48.655 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:39:48.872 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:39:48.994 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:48 smithi137 ceph-mon[26846]: from='client.24704 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:39:48.994 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:48 smithi137 ceph-mon[37364]: from='client.24704 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:39:49.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:48 smithi203 ceph-mon[30756]: from='client.24704 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:39:49.841 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:49 smithi203 bash[61754]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-03-04T06:39:49.841 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:49 smithi203 bash[61754]: Writing manifest to image destination 2024-03-04T06:39:49.970 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:49 smithi137 ceph-mon[26846]: pgmap v41: 105 pgs: 5 activating, 100 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:49.970 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:49 smithi137 ceph-mon[37364]: pgmap v41: 105 pgs: 5 activating, 100 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:50.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:49 smithi203 ceph-mon[30756]: pgmap v41: 105 pgs: 5 activating, 100 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:50.096 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:49 smithi203 podman[61754]: 2024-03-04 06:39:49.801560171 +0000 UTC m=+2.347793019 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-03-04T06:39:50.096 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:49 smithi203 podman[61754]: 2024-03-04 06:39:49.90010385 +0000 UTC m=+2.446336698 container create 927137a7bb60ce80bd333decbee17b9e8366d047f34b9fd831c5b7fb0ec80604 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-04T06:39:50.596 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 podman[61754]: 2024-03-04 06:39:50.15217867 +0000 UTC m=+2.698411518 container init 927137a7bb60ce80bd333decbee17b9e8366d047f34b9fd831c5b7fb0ec80604 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-04T06:39:50.596 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 podman[61754]: 2024-03-04 06:39:50.154973725 +0000 UTC m=+2.701206572 container start 927137a7bb60ce80bd333decbee17b9e8366d047f34b9fd831c5b7fb0ec80604 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-04T06:39:50.596 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.159Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-04T06:39:50.597 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.159Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-04T06:39:50.597 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.159Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-04T06:39:50.597 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.159Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-04T06:39:50.597 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.159Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-04T06:39:50.597 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.159Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-04T06:39:50.597 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-04T06:39:50.597 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=arp 2024-03-04T06:39:50.597 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-04T06:39:50.597 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-04T06:39:50.597 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-04T06:39:50.597 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-04T06:39:50.597 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-04T06:39:50.597 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-04T06:39:50.598 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-04T06:39:50.598 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-04T06:39:50.598 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=edac 2024-03-04T06:39:50.598 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-04T06:39:50.598 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-04T06:39:50.598 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-04T06:39:50.598 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=os 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-04T06:39:50.599 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-04T06:39:50.600 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-04T06:39:50.600 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-04T06:39:50.600 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-04T06:39:50.600 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-04T06:39:50.600 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-04T06:39:50.600 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=stat 2024-03-04T06:39:50.600 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-04T06:39:50.600 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-04T06:39:50.600 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-04T06:39:50.600 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=time 2024-03-04T06:39:50.600 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-04T06:39:50.600 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=uname 2024-03-04T06:39:50.600 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-04T06:39:50.601 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-04T06:39:50.601 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-04T06:39:50.601 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-04T06:39:50.601 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[61803]: ts=2024-03-04T06:39:50.160Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-04T06:39:50.601 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 bash[61754]: 927137a7bb60ce80bd333decbee17b9e8366d047f34b9fd831c5b7fb0ec80604 2024-03-04T06:39:50.601 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:39:50 smithi203 systemd[1]: Started Ceph node-exporter.b for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:39:50.705 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:39:50.706 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:39:51.460 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.461 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.461 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.461 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.461 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.461 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:39:51.461 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[26846]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:39:51.461 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[26846]: pgmap v42: 105 pgs: 5 activating, 100 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:51.461 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.461 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.462 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.462 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.462 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.462 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:39:51.462 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[37364]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:39:51.462 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:51 smithi137 ceph-mon[37364]: pgmap v42: 105 pgs: 5 activating, 100 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:51.483 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-03-04T06:39:48.753209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593514,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":227,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":319,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":223440,"kb_used_data":7280,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":749737776,"statfs":{"total":767960285184,"available":767731482624,"internally_reserved":0,"allocated":7454720,"data_stored":4206444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002107"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830673+0000","last_change":"2024-03-04T06:38:12.919238+0000","last_active":"2024-03-04T06:39:44.830673+0000","last_peered":"2024-03-04T06:39:44.830673+0000","last_clean":"2024-03-04T06:39:44.830673+0000","last_became_active":"2024-03-04T06:38:12.918941+0000","last_became_peered":"2024-03-04T06:38:12.918941+0000","last_unstale":"2024-03-04T06:39:44.830673+0000","last_undegraded":"2024-03-04T06:39:44.830673+0000","last_fullsized":"2024-03-04T06:39:44.830673+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:10:03.122262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826566+0000","last_change":"2024-03-04T06:38:12.914740+0000","last_active":"2024-03-04T06:39:44.826566+0000","last_peered":"2024-03-04T06:39:44.826566+0000","last_clean":"2024-03-04T06:39:44.826566+0000","last_became_active":"2024-03-04T06:38:12.914436+0000","last_became_peered":"2024-03-04T06:38:12.914436+0000","last_unstale":"2024-03-04T06:39:44.826566+0000","last_undegraded":"2024-03-04T06:39:44.826566+0000","last_fullsized":"2024-03-04T06:39:44.826566+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:58.781088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.835674+0000","last_change":"2024-03-04T06:38:12.895666+0000","last_active":"2024-03-04T06:39:44.835674+0000","last_peered":"2024-03-04T06:39:44.835674+0000","last_clean":"2024-03-04T06:39:44.835674+0000","last_became_active":"2024-03-04T06:38:12.895398+0000","last_became_peered":"2024-03-04T06:38:12.895398+0000","last_unstale":"2024-03-04T06:39:44.835674+0000","last_undegraded":"2024-03-04T06:39:44.835674+0000","last_fullsized":"2024-03-04T06:39:44.835674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:10.744216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825411+0000","last_change":"2024-03-04T06:38:12.902256+0000","last_active":"2024-03-04T06:39:44.825411+0000","last_peered":"2024-03-04T06:39:44.825411+0000","last_clean":"2024-03-04T06:39:44.825411+0000","last_became_active":"2024-03-04T06:38:12.901792+0000","last_became_peered":"2024-03-04T06:38:12.901792+0000","last_unstale":"2024-03-04T06:39:44.825411+0000","last_undegraded":"2024-03-04T06:39:44.825411+0000","last_fullsized":"2024-03-04T06:39:44.825411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:45.163241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831292+0000","last_change":"2024-03-04T06:38:12.913797+0000","last_active":"2024-03-04T06:39:44.831292+0000","last_peered":"2024-03-04T06:39:44.831292+0000","last_clean":"2024-03-04T06:39:44.831292+0000","last_became_active":"2024-03-04T06:38:12.913517+0000","last_became_peered":"2024-03-04T06:38:12.913517+0000","last_unstale":"2024-03-04T06:39:44.831292+0000","last_undegraded":"2024-03-04T06:39:44.831292+0000","last_fullsized":"2024-03-04T06:39:44.831292+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:24.837813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825374+0000","last_change":"2024-03-04T06:38:12.904787+0000","last_active":"2024-03-04T06:39:44.825374+0000","last_peered":"2024-03-04T06:39:44.825374+0000","last_clean":"2024-03-04T06:39:44.825374+0000","last_became_active":"2024-03-04T06:38:12.904484+0000","last_became_peered":"2024-03-04T06:38:12.904484+0000","last_unstale":"2024-03-04T06:39:44.825374+0000","last_undegraded":"2024-03-04T06:39:44.825374+0000","last_fullsized":"2024-03-04T06:39:44.825374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:03:28.898688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829238+0000","last_change":"2024-03-04T06:38:12.913825+0000","last_active":"2024-03-04T06:39:44.829238+0000","last_peered":"2024-03-04T06:39:44.829238+0000","last_clean":"2024-03-04T06:39:44.829238+0000","last_became_active":"2024-03-04T06:38:12.913553+0000","last_became_peered":"2024-03-04T06:38:12.913553+0000","last_unstale":"2024-03-04T06:39:44.829238+0000","last_undegraded":"2024-03-04T06:39:44.829238+0000","last_fullsized":"2024-03-04T06:39:44.829238+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:23:17.322436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.442788+0000","last_change":"2024-03-04T06:38:12.902309+0000","last_active":"2024-03-04T06:38:51.442788+0000","last_peered":"2024-03-04T06:38:51.442788+0000","last_clean":"2024-03-04T06:38:51.442788+0000","last_became_active":"2024-03-04T06:38:12.902009+0000","last_became_peered":"2024-03-04T06:38:12.902009+0000","last_unstale":"2024-03-04T06:38:51.442788+0000","last_undegraded":"2024-03-04T06:38:51.442788+0000","last_fullsized":"2024-03-04T06:38:51.442788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:36:04.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830956+0000","last_change":"2024-03-04T06:38:12.916933+0000","last_active":"2024-03-04T06:39:44.830956+0000","last_peered":"2024-03-04T06:39:44.830956+0000","last_clean":"2024-03-04T06:39:44.830956+0000","last_became_active":"2024-03-04T06:38:12.913922+0000","last_became_peered":"2024-03-04T06:38:12.913922+0000","last_unstale":"2024-03-04T06:39:44.830956+0000","last_undegraded":"2024-03-04T06:39:44.830956+0000","last_fullsized":"2024-03-04T06:39:44.830956+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:08:21.342061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834690+0000","last_change":"2024-03-04T06:38:12.911185+0000","last_active":"2024-03-04T06:39:44.834690+0000","last_peered":"2024-03-04T06:39:44.834690+0000","last_clean":"2024-03-04T06:39:44.834690+0000","last_became_active":"2024-03-04T06:38:12.910906+0000","last_became_peered":"2024-03-04T06:38:12.910906+0000","last_unstale":"2024-03-04T06:39:44.834690+0000","last_undegraded":"2024-03-04T06:39:44.834690+0000","last_fullsized":"2024-03-04T06:39:44.834690+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:45.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834569+0000","last_change":"2024-03-04T06:38:12.916277+0000","last_active":"2024-03-04T06:39:44.834569+0000","last_peered":"2024-03-04T06:39:44.834569+0000","last_clean":"2024-03-04T06:39:44.834569+0000","last_became_active":"2024-03-04T06:38:12.915998+0000","last_became_peered":"2024-03-04T06:38:12.915998+0000","last_unstale":"2024-03-04T06:39:44.834569+0000","last_undegraded":"2024-03-04T06:39:44.834569+0000","last_fullsized":"2024-03-04T06:39:44.834569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:22:53.166929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.712735+0000","last_change":"2024-03-04T06:38:12.907393+0000","last_active":"2024-03-04T06:38:50.712735+0000","last_peered":"2024-03-04T06:38:50.712735+0000","last_clean":"2024-03-04T06:38:50.712735+0000","last_became_active":"2024-03-04T06:38:12.907111+0000","last_became_peered":"2024-03-04T06:38:12.907111+0000","last_unstale":"2024-03-04T06:38:50.712735+0000","last_undegraded":"2024-03-04T06:38:50.712735+0000","last_fullsized":"2024-03-04T06:38:50.712735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:18.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443080+0000","last_change":"2024-03-04T06:38:12.897003+0000","last_active":"2024-03-04T06:38:51.443080+0000","last_peered":"2024-03-04T06:38:51.443080+0000","last_clean":"2024-03-04T06:38:51.443080+0000","last_became_active":"2024-03-04T06:38:12.896729+0000","last_became_peered":"2024-03-04T06:38:12.896729+0000","last_unstale":"2024-03-04T06:38:51.443080+0000","last_undegraded":"2024-03-04T06:38:51.443080+0000","last_fullsized":"2024-03-04T06:38:51.443080+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:01:03.497642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834893+0000","last_change":"2024-03-04T06:38:12.896652+0000","last_active":"2024-03-04T06:39:44.834893+0000","last_peered":"2024-03-04T06:39:44.834893+0000","last_clean":"2024-03-04T06:39:44.834893+0000","last_became_active":"2024-03-04T06:38:12.896300+0000","last_became_peered":"2024-03-04T06:38:12.896300+0000","last_unstale":"2024-03-04T06:39:44.834893+0000","last_undegraded":"2024-03-04T06:39:44.834893+0000","last_fullsized":"2024-03-04T06:39:44.834893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:32.026507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825545+0000","last_change":"2024-03-04T06:38:12.907997+0000","last_active":"2024-03-04T06:39:44.825545+0000","last_peered":"2024-03-04T06:39:44.825545+0000","last_clean":"2024-03-04T06:39:44.825545+0000","last_became_active":"2024-03-04T06:38:12.907720+0000","last_became_peered":"2024-03-04T06:38:12.907720+0000","last_unstale":"2024-03-04T06:39:44.825545+0000","last_undegraded":"2024-03-04T06:39:44.825545+0000","last_fullsized":"2024-03-04T06:39:44.825545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:46:55.140847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825032+0000","last_change":"2024-03-04T06:38:12.899219+0000","last_active":"2024-03-04T06:39:44.825032+0000","last_peered":"2024-03-04T06:39:44.825032+0000","last_clean":"2024-03-04T06:39:44.825032+0000","last_became_active":"2024-03-04T06:38:12.898928+0000","last_became_peered":"2024-03-04T06:38:12.898928+0000","last_unstale":"2024-03-04T06:39:44.825032+0000","last_undegraded":"2024-03-04T06:39:44.825032+0000","last_fullsized":"2024-03-04T06:39:44.825032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:13.412822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825758+0000","last_change":"2024-03-04T06:38:12.908332+0000","last_active":"2024-03-04T06:39:44.825758+0000","last_peered":"2024-03-04T06:39:44.825758+0000","last_clean":"2024-03-04T06:39:44.825758+0000","last_became_active":"2024-03-04T06:38:12.908038+0000","last_became_peered":"2024-03-04T06:38:12.908038+0000","last_unstale":"2024-03-04T06:39:44.825758+0000","last_undegraded":"2024-03-04T06:39:44.825758+0000","last_fullsized":"2024-03-04T06:39:44.825758+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:05:49.146138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826759+0000","last_change":"2024-03-04T06:38:12.899134+0000","last_active":"2024-03-04T06:39:44.826759+0000","last_peered":"2024-03-04T06:39:44.826759+0000","last_clean":"2024-03-04T06:39:44.826759+0000","last_became_active":"2024-03-04T06:38:12.898801+0000","last_became_peered":"2024-03-04T06:38:12.898801+0000","last_unstale":"2024-03-04T06:39:44.826759+0000","last_undegraded":"2024-03-04T06:39:44.826759+0000","last_fullsized":"2024-03-04T06:39:44.826759+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:21:48.465552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829127+0000","last_change":"2024-03-04T06:38:12.918000+0000","last_active":"2024-03-04T06:39:44.829127+0000","last_peered":"2024-03-04T06:39:44.829127+0000","last_clean":"2024-03-04T06:39:44.829127+0000","last_became_active":"2024-03-04T06:38:12.914159+0000","last_became_peered":"2024-03-04T06:38:12.914159+0000","last_unstale":"2024-03-04T06:39:44.829127+0000","last_undegraded":"2024-03-04T06:39:44.829127+0000","last_fullsized":"2024-03-04T06:39:44.829127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:24.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834743+0000","last_change":"2024-03-04T06:38:12.550843+0000","last_active":"2024-03-04T06:39:44.834743+0000","last_peered":"2024-03-04T06:39:44.834743+0000","last_clean":"2024-03-04T06:39:44.834743+0000","last_became_active":"2024-03-04T06:38:12.550141+0000","last_became_peered":"2024-03-04T06:38:12.550141+0000","last_unstale":"2024-03-04T06:39:44.834743+0000","last_undegraded":"2024-03-04T06:39:44.834743+0000","last_fullsized":"2024-03-04T06:39:44.834743+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:01.969570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443236+0000","last_change":"2024-03-04T06:38:12.896389+0000","last_active":"2024-03-04T06:38:51.443236+0000","last_peered":"2024-03-04T06:38:51.443236+0000","last_clean":"2024-03-04T06:38:51.443236+0000","last_became_active":"2024-03-04T06:38:12.896120+0000","last_became_peered":"2024-03-04T06:38:12.896120+0000","last_unstale":"2024-03-04T06:38:51.443236+0000","last_undegraded":"2024-03-04T06:38:51.443236+0000","last_fullsized":"2024-03-04T06:38:51.443236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:57.729499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443310+0000","last_change":"2024-03-04T06:38:12.550800+0000","last_active":"2024-03-04T06:38:51.443310+0000","last_peered":"2024-03-04T06:38:51.443310+0000","last_clean":"2024-03-04T06:38:51.443310+0000","last_became_active":"2024-03-04T06:38:12.550444+0000","last_became_peered":"2024-03-04T06:38:12.550444+0000","last_unstale":"2024-03-04T06:38:51.443310+0000","last_undegraded":"2024-03-04T06:38:51.443310+0000","last_fullsized":"2024-03-04T06:38:51.443310+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:42.209194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834447+0000","last_change":"2024-03-04T06:38:12.903258+0000","last_active":"2024-03-04T06:39:44.834447+0000","last_peered":"2024-03-04T06:39:44.834447+0000","last_clean":"2024-03-04T06:39:44.834447+0000","last_became_active":"2024-03-04T06:38:12.902982+0000","last_became_peered":"2024-03-04T06:38:12.902982+0000","last_unstale":"2024-03-04T06:39:44.834447+0000","last_undegraded":"2024-03-04T06:39:44.834447+0000","last_fullsized":"2024-03-04T06:39:44.834447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:31:23.228035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:45.834266+0000","last_change":"2024-03-04T06:39:45.833985+0000","last_active":"2024-03-04T06:39:45.834266+0000","last_peered":"2024-03-04T06:39:45.834266+0000","last_clean":"2024-03-04T06:39:45.834266+0000","last_became_active":"2024-03-04T06:39:45.831328+0000","last_became_peered":"2024-03-04T06:39:45.831328+0000","last_unstale":"2024-03-04T06:39:45.834266+0000","last_undegraded":"2024-03-04T06:39:45.834266+0000","last_fullsized":"2024-03-04T06:39:45.834266+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:31.095064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":5,"reported_epoch":69,"state":"activating","last_fresh":"2024-03-04T06:39:45.827885+0000","last_change":"2024-03-04T06:39:45.826136+0000","last_active":"2024-03-04T06:38:12.520695+0000","last_peered":"2024-03-04T06:38:12.520695+0000","last_clean":"2024-03-04T06:38:12.520695+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T06:39:45.827885+0000","last_undegraded":"2024-03-04T06:39:45.827885+0000","last_fullsized":"2024-03-04T06:39:45.827885+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:51.404998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":["2","1","4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830161+0000","last_change":"2024-03-04T06:38:12.556246+0000","last_active":"2024-03-04T06:39:44.830161+0000","last_peered":"2024-03-04T06:39:44.830161+0000","last_clean":"2024-03-04T06:39:44.830161+0000","last_became_active":"2024-03-04T06:38:12.555860+0000","last_became_peered":"2024-03-04T06:38:12.555860+0000","last_unstale":"2024-03-04T06:39:44.830161+0000","last_undegraded":"2024-03-04T06:39:44.830161+0000","last_fullsized":"2024-03-04T06:39:44.830161+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:41.910480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825545+0000","last_change":"2024-03-04T06:38:12.906907+0000","last_active":"2024-03-04T06:39:44.825545+0000","last_peered":"2024-03-04T06:39:44.825545+0000","last_clean":"2024-03-04T06:39:44.825545+0000","last_became_active":"2024-03-04T06:38:12.906615+0000","last_became_peered":"2024-03-04T06:38:12.906615+0000","last_unstale":"2024-03-04T06:39:44.825545+0000","last_undegraded":"2024-03-04T06:39:44.825545+0000","last_fullsized":"2024-03-04T06:39:44.825545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:21:15.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443148+0000","last_change":"2024-03-04T06:38:12.546234+0000","last_active":"2024-03-04T06:38:51.443148+0000","last_peered":"2024-03-04T06:38:51.443148+0000","last_clean":"2024-03-04T06:38:51.443148+0000","last_became_active":"2024-03-04T06:38:12.545975+0000","last_became_peered":"2024-03-04T06:38:12.545975+0000","last_unstale":"2024-03-04T06:38:51.443148+0000","last_undegraded":"2024-03-04T06:38:51.443148+0000","last_fullsized":"2024-03-04T06:38:51.443148+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:04.341190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.712429+0000","last_change":"2024-03-04T06:38:12.908256+0000","last_active":"2024-03-04T06:38:50.712429+0000","last_peered":"2024-03-04T06:38:50.712429+0000","last_clean":"2024-03-04T06:38:50.712429+0000","last_became_active":"2024-03-04T06:38:12.907953+0000","last_became_peered":"2024-03-04T06:38:12.907953+0000","last_unstale":"2024-03-04T06:38:50.712429+0000","last_undegraded":"2024-03-04T06:38:50.712429+0000","last_fullsized":"2024-03-04T06:38:50.712429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:03:03.291025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834226+0000","last_change":"2024-03-04T06:38:12.554332+0000","last_active":"2024-03-04T06:39:44.834226+0000","last_peered":"2024-03-04T06:39:44.834226+0000","last_clean":"2024-03-04T06:39:44.834226+0000","last_became_active":"2024-03-04T06:38:12.554044+0000","last_became_peered":"2024-03-04T06:38:12.554044+0000","last_unstale":"2024-03-04T06:39:44.834226+0000","last_undegraded":"2024-03-04T06:39:44.834226+0000","last_fullsized":"2024-03-04T06:39:44.834226+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:28:40.250342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834286+0000","last_change":"2024-03-04T06:38:12.910445+0000","last_active":"2024-03-04T06:39:44.834286+0000","last_peered":"2024-03-04T06:39:44.834286+0000","last_clean":"2024-03-04T06:39:44.834286+0000","last_became_active":"2024-03-04T06:38:12.909974+0000","last_became_peered":"2024-03-04T06:38:12.909974+0000","last_unstale":"2024-03-04T06:39:44.834286+0000","last_undegraded":"2024-03-04T06:39:44.834286+0000","last_fullsized":"2024-03-04T06:39:44.834286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:42:52.372021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443037+0000","last_change":"2024-03-04T06:38:12.543180+0000","last_active":"2024-03-04T06:38:51.443037+0000","last_peered":"2024-03-04T06:38:51.443037+0000","last_clean":"2024-03-04T06:38:51.443037+0000","last_became_active":"2024-03-04T06:38:12.542896+0000","last_became_peered":"2024-03-04T06:38:12.542896+0000","last_unstale":"2024-03-04T06:38:51.443037+0000","last_undegraded":"2024-03-04T06:38:51.443037+0000","last_fullsized":"2024-03-04T06:38:51.443037+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:15:09.816539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.442987+0000","last_change":"2024-03-04T06:38:12.895735+0000","last_active":"2024-03-04T06:38:51.442987+0000","last_peered":"2024-03-04T06:38:51.442987+0000","last_clean":"2024-03-04T06:38:51.442987+0000","last_became_active":"2024-03-04T06:38:12.895201+0000","last_became_peered":"2024-03-04T06:38:12.895201+0000","last_unstale":"2024-03-04T06:38:51.442987+0000","last_undegraded":"2024-03-04T06:38:51.442987+0000","last_fullsized":"2024-03-04T06:38:51.442987+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:12:35.373175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825037+0000","last_change":"2024-03-04T06:38:12.551089+0000","last_active":"2024-03-04T06:39:44.825037+0000","last_peered":"2024-03-04T06:39:44.825037+0000","last_clean":"2024-03-04T06:39:44.825037+0000","last_became_active":"2024-03-04T06:38:12.550791+0000","last_became_peered":"2024-03-04T06:38:12.550791+0000","last_unstale":"2024-03-04T06:39:44.825037+0000","last_undegraded":"2024-03-04T06:39:44.825037+0000","last_fullsized":"2024-03-04T06:39:44.825037+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:49.576267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825638+0000","last_change":"2024-03-04T06:38:12.909194+0000","last_active":"2024-03-04T06:39:44.825638+0000","last_peered":"2024-03-04T06:39:44.825638+0000","last_clean":"2024-03-04T06:39:44.825638+0000","last_became_active":"2024-03-04T06:38:12.908879+0000","last_became_peered":"2024-03-04T06:38:12.908879+0000","last_unstale":"2024-03-04T06:39:44.825638+0000","last_undegraded":"2024-03-04T06:39:44.825638+0000","last_fullsized":"2024-03-04T06:39:44.825638+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:23.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834767+0000","last_change":"2024-03-04T06:38:12.544023+0000","last_active":"2024-03-04T06:39:44.834767+0000","last_peered":"2024-03-04T06:39:44.834767+0000","last_clean":"2024-03-04T06:39:44.834767+0000","last_became_active":"2024-03-04T06:38:12.543699+0000","last_became_peered":"2024-03-04T06:38:12.543699+0000","last_unstale":"2024-03-04T06:39:44.834767+0000","last_undegraded":"2024-03-04T06:39:44.834767+0000","last_fullsized":"2024-03-04T06:39:44.834767+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:19.418372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825706+0000","last_change":"2024-03-04T06:38:12.903510+0000","last_active":"2024-03-04T06:39:44.825706+0000","last_peered":"2024-03-04T06:39:44.825706+0000","last_clean":"2024-03-04T06:39:44.825706+0000","last_became_active":"2024-03-04T06:38:12.903226+0000","last_became_peered":"2024-03-04T06:38:12.903226+0000","last_unstale":"2024-03-04T06:39:44.825706+0000","last_undegraded":"2024-03-04T06:39:44.825706+0000","last_fullsized":"2024-03-04T06:39:44.825706+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:49:29.474747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825656+0000","last_change":"2024-03-04T06:38:12.550879+0000","last_active":"2024-03-04T06:39:44.825656+0000","last_peered":"2024-03-04T06:39:44.825656+0000","last_clean":"2024-03-04T06:39:44.825656+0000","last_became_active":"2024-03-04T06:38:12.549931+0000","last_became_peered":"2024-03-04T06:38:12.549931+0000","last_unstale":"2024-03-04T06:39:44.825656+0000","last_undegraded":"2024-03-04T06:39:44.825656+0000","last_fullsized":"2024-03-04T06:39:44.825656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:33.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834364+0000","last_change":"2024-03-04T06:38:12.903875+0000","last_active":"2024-03-04T06:39:44.834364+0000","last_peered":"2024-03-04T06:39:44.834364+0000","last_clean":"2024-03-04T06:39:44.834364+0000","last_became_active":"2024-03-04T06:38:12.903600+0000","last_became_peered":"2024-03-04T06:38:12.903600+0000","last_unstale":"2024-03-04T06:39:44.834364+0000","last_undegraded":"2024-03-04T06:39:44.834364+0000","last_fullsized":"2024-03-04T06:39:44.834364+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:32.774333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826349+0000","last_change":"2024-03-04T06:38:12.551496+0000","last_active":"2024-03-04T06:39:44.826349+0000","last_peered":"2024-03-04T06:39:44.826349+0000","last_clean":"2024-03-04T06:39:44.826349+0000","last_became_active":"2024-03-04T06:38:12.551202+0000","last_became_peered":"2024-03-04T06:38:12.551202+0000","last_unstale":"2024-03-04T06:39:44.826349+0000","last_undegraded":"2024-03-04T06:39:44.826349+0000","last_fullsized":"2024-03-04T06:39:44.826349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:19.526762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.712655+0000","last_change":"2024-03-04T06:38:12.911735+0000","last_active":"2024-03-04T06:38:50.712655+0000","last_peered":"2024-03-04T06:38:50.712655+0000","last_clean":"2024-03-04T06:38:50.712655+0000","last_became_active":"2024-03-04T06:38:12.911389+0000","last_became_peered":"2024-03-04T06:38:12.911389+0000","last_unstale":"2024-03-04T06:38:50.712655+0000","last_undegraded":"2024-03-04T06:38:50.712655+0000","last_fullsized":"2024-03-04T06:38:50.712655+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:25.284425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"63'9","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834399+0000","last_change":"2024-03-04T06:38:12.546352+0000","last_active":"2024-03-04T06:39:44.834399+0000","last_peered":"2024-03-04T06:39:44.834399+0000","last_clean":"2024-03-04T06:39:44.834399+0000","last_became_active":"2024-03-04T06:38:12.545863+0000","last_became_peered":"2024-03-04T06:38:12.545863+0000","last_unstale":"2024-03-04T06:39:44.834399+0000","last_undegraded":"2024-03-04T06:39:44.834399+0000","last_fullsized":"2024-03-04T06:39:44.834399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:08.181131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2348,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":69,"state":"activating","last_fresh":"2024-03-04T06:39:45.830603+0000","last_change":"2024-03-04T06:39:45.830603+0000","last_active":"2024-03-04T06:39:44.831302+0000","last_peered":"2024-03-04T06:38:51.444042+0000","last_clean":"2024-03-04T06:38:51.444042+0000","last_became_active":"2024-03-04T06:38:12.918269+0000","last_became_peered":"2024-03-04T06:38:12.918269+0000","last_unstale":"2024-03-04T06:39:45.830603+0000","last_undegraded":"2024-03-04T06:39:45.830603+0000","last_fullsized":"2024-03-04T06:39:45.830603+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:58:41.826266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":["7","1","3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834537+0000","last_change":"2024-03-04T06:38:12.547028+0000","last_active":"2024-03-04T06:39:44.834537+0000","last_peered":"2024-03-04T06:39:44.834537+0000","last_clean":"2024-03-04T06:39:44.834537+0000","last_became_active":"2024-03-04T06:38:12.546672+0000","last_became_peered":"2024-03-04T06:38:12.546672+0000","last_unstale":"2024-03-04T06:39:44.834537+0000","last_undegraded":"2024-03-04T06:39:44.834537+0000","last_fullsized":"2024-03-04T06:39:44.834537+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:21:00.773241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":5,"reported_epoch":69,"state":"activating","last_fresh":"2024-03-04T06:39:45.829974+0000","last_change":"2024-03-04T06:39:45.826574+0000","last_active":"2024-03-04T06:39:45.826375+0000","last_peered":"2024-03-04T06:38:50.932439+0000","last_clean":"2024-03-04T06:38:50.932439+0000","last_became_active":"2024-03-04T06:38:12.893498+0000","last_became_peered":"2024-03-04T06:38:12.893498+0000","last_unstale":"2024-03-04T06:39:45.829974+0000","last_undegraded":"2024-03-04T06:39:45.829974+0000","last_fullsized":"2024-03-04T06:39:45.829974+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:47:17.558117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":["2","0","3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825121+0000","last_change":"2024-03-04T06:38:12.549608+0000","last_active":"2024-03-04T06:39:44.825121+0000","last_peered":"2024-03-04T06:39:44.825121+0000","last_clean":"2024-03-04T06:39:44.825121+0000","last_became_active":"2024-03-04T06:38:12.549299+0000","last_became_peered":"2024-03-04T06:38:12.549299+0000","last_unstale":"2024-03-04T06:39:44.825121+0000","last_undegraded":"2024-03-04T06:39:44.825121+0000","last_fullsized":"2024-03-04T06:39:44.825121+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:12:23.543702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":69,"state":"activating","last_fresh":"2024-03-04T06:39:45.830502+0000","last_change":"2024-03-04T06:39:45.830502+0000","last_active":"2024-03-04T06:39:44.830633+0000","last_peered":"2024-03-04T06:38:51.443819+0000","last_clean":"2024-03-04T06:38:51.443819+0000","last_became_active":"2024-03-04T06:38:12.913476+0000","last_became_peered":"2024-03-04T06:38:12.913476+0000","last_unstale":"2024-03-04T06:39:45.830502+0000","last_undegraded":"2024-03-04T06:39:45.830502+0000","last_fullsized":"2024-03-04T06:39:45.830502+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:08:21.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":["7","2","3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833855+0000","last_change":"2024-03-04T06:38:12.549514+0000","last_active":"2024-03-04T06:39:44.833855+0000","last_peered":"2024-03-04T06:39:44.833855+0000","last_clean":"2024-03-04T06:39:44.833855+0000","last_became_active":"2024-03-04T06:38:12.549222+0000","last_became_peered":"2024-03-04T06:38:12.549222+0000","last_unstale":"2024-03-04T06:39:44.833855+0000","last_undegraded":"2024-03-04T06:39:44.833855+0000","last_fullsized":"2024-03-04T06:39:44.833855+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:54:24.051519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833859+0000","last_change":"2024-03-04T06:38:12.909428+0000","last_active":"2024-03-04T06:39:44.833859+0000","last_peered":"2024-03-04T06:39:44.833859+0000","last_clean":"2024-03-04T06:39:44.833859+0000","last_became_active":"2024-03-04T06:38:12.909146+0000","last_became_peered":"2024-03-04T06:38:12.909146+0000","last_unstale":"2024-03-04T06:39:44.833859+0000","last_undegraded":"2024-03-04T06:39:44.833859+0000","last_fullsized":"2024-03-04T06:39:44.833859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:44.391084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826021+0000","last_change":"2024-03-04T06:38:12.544896+0000","last_active":"2024-03-04T06:39:44.826021+0000","last_peered":"2024-03-04T06:39:44.826021+0000","last_clean":"2024-03-04T06:39:44.826021+0000","last_became_active":"2024-03-04T06:38:12.543579+0000","last_became_peered":"2024-03-04T06:38:12.543579+0000","last_unstale":"2024-03-04T06:39:44.826021+0000","last_undegraded":"2024-03-04T06:39:44.826021+0000","last_fullsized":"2024-03-04T06:39:44.826021+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:39.451118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831230+0000","last_change":"2024-03-04T06:38:12.919018+0000","last_active":"2024-03-04T06:39:44.831230+0000","last_peered":"2024-03-04T06:39:44.831230+0000","last_clean":"2024-03-04T06:39:44.831230+0000","last_became_active":"2024-03-04T06:38:12.918716+0000","last_became_peered":"2024-03-04T06:38:12.918716+0000","last_unstale":"2024-03-04T06:39:44.831230+0000","last_undegraded":"2024-03-04T06:39:44.831230+0000","last_fullsized":"2024-03-04T06:39:44.831230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:06:47.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.713017+0000","last_change":"2024-03-04T06:38:12.550559+0000","last_active":"2024-03-04T06:38:50.713017+0000","last_peered":"2024-03-04T06:38:50.713017+0000","last_clean":"2024-03-04T06:38:50.713017+0000","last_became_active":"2024-03-04T06:38:12.547867+0000","last_became_peered":"2024-03-04T06:38:12.547867+0000","last_unstale":"2024-03-04T06:38:50.713017+0000","last_undegraded":"2024-03-04T06:38:50.713017+0000","last_fullsized":"2024-03-04T06:38:50.713017+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:04.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829952+0000","last_change":"2024-03-04T06:38:12.913566+0000","last_active":"2024-03-04T06:39:44.829952+0000","last_peered":"2024-03-04T06:39:44.829952+0000","last_clean":"2024-03-04T06:39:44.829952+0000","last_became_active":"2024-03-04T06:38:12.910660+0000","last_became_peered":"2024-03-04T06:38:12.910660+0000","last_unstale":"2024-03-04T06:39:44.829952+0000","last_undegraded":"2024-03-04T06:39:44.829952+0000","last_fullsized":"2024-03-04T06:39:44.829952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:16:42.862745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825457+0000","last_change":"2024-03-04T06:38:47.376732+0000","last_active":"2024-03-04T06:39:44.825457+0000","last_peered":"2024-03-04T06:39:44.825457+0000","last_clean":"2024-03-04T06:39:44.825457+0000","last_became_active":"2024-03-04T06:38:47.376476+0000","last_became_peered":"2024-03-04T06:38:47.376476+0000","last_unstale":"2024-03-04T06:39:44.825457+0000","last_undegraded":"2024-03-04T06:39:44.825457+0000","last_fullsized":"2024-03-04T06:39:44.825457+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:21:52.679530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825893+0000","last_change":"2024-03-04T06:38:12.554795+0000","last_active":"2024-03-04T06:39:44.825893+0000","last_peered":"2024-03-04T06:39:44.825893+0000","last_clean":"2024-03-04T06:39:44.825893+0000","last_became_active":"2024-03-04T06:38:12.554461+0000","last_became_peered":"2024-03-04T06:38:12.554461+0000","last_unstale":"2024-03-04T06:39:44.825893+0000","last_undegraded":"2024-03-04T06:39:44.825893+0000","last_fullsized":"2024-03-04T06:39:44.825893+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:03:44.989709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825607+0000","last_change":"2024-03-04T06:38:12.897411+0000","last_active":"2024-03-04T06:39:44.825607+0000","last_peered":"2024-03-04T06:39:44.825607+0000","last_clean":"2024-03-04T06:39:44.825607+0000","last_became_active":"2024-03-04T06:38:12.896742+0000","last_became_peered":"2024-03-04T06:38:12.896742+0000","last_unstale":"2024-03-04T06:39:44.825607+0000","last_undegraded":"2024-03-04T06:39:44.825607+0000","last_fullsized":"2024-03-04T06:39:44.825607+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:14:21.032038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825967+0000","last_change":"2024-03-04T06:38:47.318044+0000","last_active":"2024-03-04T06:39:44.825967+0000","last_peered":"2024-03-04T06:39:44.825967+0000","last_clean":"2024-03-04T06:39:44.825967+0000","last_became_active":"2024-03-04T06:38:47.317763+0000","last_became_peered":"2024-03-04T06:38:47.317763+0000","last_unstale":"2024-03-04T06:39:44.825967+0000","last_undegraded":"2024-03-04T06:39:44.825967+0000","last_fullsized":"2024-03-04T06:39:44.825967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:04.059027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825073+0000","last_change":"2024-03-04T06:38:12.548860+0000","last_active":"2024-03-04T06:39:44.825073+0000","last_peered":"2024-03-04T06:39:44.825073+0000","last_clean":"2024-03-04T06:39:44.825073+0000","last_became_active":"2024-03-04T06:38:12.548550+0000","last_became_peered":"2024-03-04T06:38:12.548550+0000","last_unstale":"2024-03-04T06:39:44.825073+0000","last_undegraded":"2024-03-04T06:39:44.825073+0000","last_fullsized":"2024-03-04T06:39:44.825073+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:47:43.188556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.712707+0000","last_change":"2024-03-04T06:38:12.908558+0000","last_active":"2024-03-04T06:38:50.712707+0000","last_peered":"2024-03-04T06:38:50.712707+0000","last_clean":"2024-03-04T06:38:50.712707+0000","last_became_active":"2024-03-04T06:38:12.908227+0000","last_became_peered":"2024-03-04T06:38:12.908227+0000","last_unstale":"2024-03-04T06:38:50.712707+0000","last_undegraded":"2024-03-04T06:38:50.712707+0000","last_fullsized":"2024-03-04T06:38:50.712707+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:39:27.394161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826882+0000","last_change":"2024-03-04T06:38:47.376856+0000","last_active":"2024-03-04T06:39:44.826882+0000","last_peered":"2024-03-04T06:39:44.826882+0000","last_clean":"2024-03-04T06:39:44.826882+0000","last_became_active":"2024-03-04T06:38:47.376418+0000","last_became_peered":"2024-03-04T06:38:47.376418+0000","last_unstale":"2024-03-04T06:39:44.826882+0000","last_undegraded":"2024-03-04T06:39:44.826882+0000","last_fullsized":"2024-03-04T06:39:44.826882+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:18:43.241370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825346+0000","last_change":"2024-03-04T06:38:12.914172+0000","last_active":"2024-03-04T06:39:44.825346+0000","last_peered":"2024-03-04T06:39:44.825346+0000","last_clean":"2024-03-04T06:39:44.825346+0000","last_became_active":"2024-03-04T06:38:12.913896+0000","last_became_peered":"2024-03-04T06:38:12.913896+0000","last_unstale":"2024-03-04T06:39:44.825346+0000","last_undegraded":"2024-03-04T06:39:44.825346+0000","last_fullsized":"2024-03-04T06:39:44.825346+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:53.141176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826097+0000","last_change":"2024-03-04T06:38:12.540510+0000","last_active":"2024-03-04T06:39:44.826097+0000","last_peered":"2024-03-04T06:39:44.826097+0000","last_clean":"2024-03-04T06:39:44.826097+0000","last_became_active":"2024-03-04T06:38:12.540155+0000","last_became_peered":"2024-03-04T06:38:12.540155+0000","last_unstale":"2024-03-04T06:39:44.826097+0000","last_undegraded":"2024-03-04T06:39:44.826097+0000","last_fullsized":"2024-03-04T06:39:44.826097+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:39.660282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834384+0000","last_change":"2024-03-04T06:38:47.317126+0000","last_active":"2024-03-04T06:39:44.834384+0000","last_peered":"2024-03-04T06:39:44.834384+0000","last_clean":"2024-03-04T06:39:44.834384+0000","last_became_active":"2024-03-04T06:38:47.316821+0000","last_became_peered":"2024-03-04T06:38:47.316821+0000","last_unstale":"2024-03-04T06:39:44.834384+0000","last_undegraded":"2024-03-04T06:39:44.834384+0000","last_fullsized":"2024-03-04T06:39:44.834384+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:38:44.635838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443039+0000","last_change":"2024-03-04T06:38:12.903488+0000","last_active":"2024-03-04T06:38:51.443039+0000","last_peered":"2024-03-04T06:38:51.443039+0000","last_clean":"2024-03-04T06:38:51.443039+0000","last_became_active":"2024-03-04T06:38:12.903235+0000","last_became_peered":"2024-03-04T06:38:12.903235+0000","last_unstale":"2024-03-04T06:38:51.443039+0000","last_undegraded":"2024-03-04T06:38:51.443039+0000","last_fullsized":"2024-03-04T06:38:51.443039+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:43.099957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825213+0000","last_change":"2024-03-04T06:38:12.550672+0000","last_active":"2024-03-04T06:39:44.825213+0000","last_peered":"2024-03-04T06:39:44.825213+0000","last_clean":"2024-03-04T06:39:44.825213+0000","last_became_active":"2024-03-04T06:38:12.550367+0000","last_became_peered":"2024-03-04T06:38:12.550367+0000","last_unstale":"2024-03-04T06:39:44.825213+0000","last_undegraded":"2024-03-04T06:39:44.825213+0000","last_fullsized":"2024-03-04T06:39:44.825213+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:57:27.060139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"64'128","reported_seq":264,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830190+0000","last_change":"2024-03-04T06:37:58.310255+0000","last_active":"2024-03-04T06:39:44.830190+0000","last_peered":"2024-03-04T06:39:44.830190+0000","last_clean":"2024-03-04T06:39:44.830190+0000","last_became_active":"2024-03-04T06:37:58.309800+0000","last_became_peered":"2024-03-04T06:37:58.309800+0000","last_unstale":"2024-03-04T06:39:44.830190+0000","last_undegraded":"2024-03-04T06:39:44.830190+0000","last_fullsized":"2024-03-04T06:39:44.830190+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:38.185918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833479+0000","last_change":"2024-03-04T06:38:47.321870+0000","last_active":"2024-03-04T06:39:44.833479+0000","last_peered":"2024-03-04T06:39:44.833479+0000","last_clean":"2024-03-04T06:39:44.833479+0000","last_became_active":"2024-03-04T06:38:47.321560+0000","last_became_peered":"2024-03-04T06:38:47.321560+0000","last_unstale":"2024-03-04T06:39:44.833479+0000","last_undegraded":"2024-03-04T06:39:44.833479+0000","last_fullsized":"2024-03-04T06:39:44.833479+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:40:27.719672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":4,"reported_epoch":69,"state":"activating","last_fresh":"2024-03-04T06:39:45.826371+0000","last_change":"2024-03-04T06:39:45.826371+0000","last_active":"2024-03-04T06:39:45.826074+0000","last_peered":"2024-03-04T06:38:50.932358+0000","last_clean":"2024-03-04T06:38:50.932358+0000","last_became_active":"2024-03-04T06:38:12.910158+0000","last_became_peered":"2024-03-04T06:38:12.910158+0000","last_unstale":"2024-03-04T06:39:45.826371+0000","last_undegraded":"2024-03-04T06:39:45.826371+0000","last_fullsized":"2024-03-04T06:39:45.826371+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:08.818871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":["2","0","3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829032+0000","last_change":"2024-03-04T06:38:12.556986+0000","last_active":"2024-03-04T06:39:44.829032+0000","last_peered":"2024-03-04T06:39:44.829032+0000","last_clean":"2024-03-04T06:39:44.829032+0000","last_became_active":"2024-03-04T06:38:12.556594+0000","last_became_peered":"2024-03-04T06:38:12.556594+0000","last_unstale":"2024-03-04T06:39:44.829032+0000","last_undegraded":"2024-03-04T06:39:44.829032+0000","last_fullsized":"2024-03-04T06:39:44.829032+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:52.669745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834213+0000","last_change":"2024-03-04T06:38:47.376856+0000","last_active":"2024-03-04T06:39:44.834213+0000","last_peered":"2024-03-04T06:39:44.834213+0000","last_clean":"2024-03-04T06:39:44.834213+0000","last_became_active":"2024-03-04T06:38:47.376532+0000","last_became_peered":"2024-03-04T06:38:47.376532+0000","last_unstale":"2024-03-04T06:39:44.834213+0000","last_undegraded":"2024-03-04T06:39:44.834213+0000","last_fullsized":"2024-03-04T06:39:44.834213+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:21.206296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829433+0000","last_change":"2024-03-04T06:38:12.557967+0000","last_active":"2024-03-04T06:39:44.829433+0000","last_peered":"2024-03-04T06:39:44.829433+0000","last_clean":"2024-03-04T06:39:44.829433+0000","last_became_active":"2024-03-04T06:38:12.557397+0000","last_became_peered":"2024-03-04T06:38:12.557397+0000","last_unstale":"2024-03-04T06:39:44.829433+0000","last_undegraded":"2024-03-04T06:39:44.829433+0000","last_fullsized":"2024-03-04T06:39:44.829433+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.366465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826044+0000","last_change":"2024-03-04T06:38:12.905517+0000","last_active":"2024-03-04T06:39:44.826044+0000","last_peered":"2024-03-04T06:39:44.826044+0000","last_clean":"2024-03-04T06:39:44.826044+0000","last_became_active":"2024-03-04T06:38:12.905234+0000","last_became_peered":"2024-03-04T06:38:12.905234+0000","last_unstale":"2024-03-04T06:39:44.826044+0000","last_undegraded":"2024-03-04T06:39:44.826044+0000","last_fullsized":"2024-03-04T06:39:44.826044+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:32:58.487468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.442868+0000","last_change":"2024-03-04T06:38:47.316978+0000","last_active":"2024-03-04T06:38:51.442868+0000","last_peered":"2024-03-04T06:38:51.442868+0000","last_clean":"2024-03-04T06:38:51.442868+0000","last_became_active":"2024-03-04T06:38:47.316666+0000","last_became_peered":"2024-03-04T06:38:47.316666+0000","last_unstale":"2024-03-04T06:38:51.442868+0000","last_undegraded":"2024-03-04T06:38:51.442868+0000","last_fullsized":"2024-03-04T06:38:51.442868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:22.840327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826725+0000","last_change":"2024-03-04T06:38:12.542943+0000","last_active":"2024-03-04T06:39:44.826725+0000","last_peered":"2024-03-04T06:39:44.826725+0000","last_clean":"2024-03-04T06:39:44.826725+0000","last_became_active":"2024-03-04T06:38:12.542663+0000","last_became_peered":"2024-03-04T06:38:12.542663+0000","last_unstale":"2024-03-04T06:39:44.826725+0000","last_undegraded":"2024-03-04T06:39:44.826725+0000","last_fullsized":"2024-03-04T06:39:44.826725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:11.583290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443314+0000","last_change":"2024-03-04T06:38:12.898034+0000","last_active":"2024-03-04T06:38:51.443314+0000","last_peered":"2024-03-04T06:38:51.443314+0000","last_clean":"2024-03-04T06:38:51.443314+0000","last_became_active":"2024-03-04T06:38:12.897766+0000","last_became_peered":"2024-03-04T06:38:12.897766+0000","last_unstale":"2024-03-04T06:38:51.443314+0000","last_undegraded":"2024-03-04T06:38:51.443314+0000","last_fullsized":"2024-03-04T06:38:51.443314+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:56.085588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.930111+0000","last_change":"2024-03-04T06:38:47.376747+0000","last_active":"2024-03-04T06:38:50.930111+0000","last_peered":"2024-03-04T06:38:50.930111+0000","last_clean":"2024-03-04T06:38:50.930111+0000","last_became_active":"2024-03-04T06:38:47.376407+0000","last_became_peered":"2024-03-04T06:38:47.376407+0000","last_unstale":"2024-03-04T06:38:50.930111+0000","last_undegraded":"2024-03-04T06:38:50.930111+0000","last_fullsized":"2024-03-04T06:38:50.930111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:44.463155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834701+0000","last_change":"2024-03-04T06:38:12.554846+0000","last_active":"2024-03-04T06:39:44.834701+0000","last_peered":"2024-03-04T06:39:44.834701+0000","last_clean":"2024-03-04T06:39:44.834701+0000","last_became_active":"2024-03-04T06:38:12.554544+0000","last_became_peered":"2024-03-04T06:38:12.554544+0000","last_unstale":"2024-03-04T06:39:44.834701+0000","last_undegraded":"2024-03-04T06:39:44.834701+0000","last_fullsized":"2024-03-04T06:39:44.834701+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:44.524183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833734+0000","last_change":"2024-03-04T06:38:12.903163+0000","last_active":"2024-03-04T06:39:44.833734+0000","last_peered":"2024-03-04T06:39:44.833734+0000","last_clean":"2024-03-04T06:39:44.833734+0000","last_became_active":"2024-03-04T06:38:12.902896+0000","last_became_peered":"2024-03-04T06:38:12.902896+0000","last_unstale":"2024-03-04T06:39:44.833734+0000","last_undegraded":"2024-03-04T06:39:44.833734+0000","last_fullsized":"2024-03-04T06:39:44.833734+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:45:59.166463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829163+0000","last_change":"2024-03-04T06:38:12.556654+0000","last_active":"2024-03-04T06:39:44.829163+0000","last_peered":"2024-03-04T06:39:44.829163+0000","last_clean":"2024-03-04T06:39:44.829163+0000","last_became_active":"2024-03-04T06:38:12.556014+0000","last_became_peered":"2024-03-04T06:38:12.556014+0000","last_unstale":"2024-03-04T06:39:44.829163+0000","last_undegraded":"2024-03-04T06:39:44.829163+0000","last_fullsized":"2024-03-04T06:39:44.829163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:45.975559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:50.712552+0000","last_change":"2024-03-04T06:38:12.906674+0000","last_active":"2024-03-04T06:38:50.712552+0000","last_peered":"2024-03-04T06:38:50.712552+0000","last_clean":"2024-03-04T06:38:50.712552+0000","last_became_active":"2024-03-04T06:38:12.906385+0000","last_became_peered":"2024-03-04T06:38:12.906385+0000","last_unstale":"2024-03-04T06:38:50.712552+0000","last_undegraded":"2024-03-04T06:38:50.712552+0000","last_fullsized":"2024-03-04T06:38:50.712552+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:29:56.436800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825787+0000","last_change":"2024-03-04T06:38:12.555463+0000","last_active":"2024-03-04T06:39:44.825787+0000","last_peered":"2024-03-04T06:39:44.825787+0000","last_clean":"2024-03-04T06:39:44.825787+0000","last_became_active":"2024-03-04T06:38:12.555150+0000","last_became_peered":"2024-03-04T06:38:12.555150+0000","last_unstale":"2024-03-04T06:39:44.825787+0000","last_undegraded":"2024-03-04T06:39:44.825787+0000","last_fullsized":"2024-03-04T06:39:44.825787+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:30.714863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.442877+0000","last_change":"2024-03-04T06:38:12.897860+0000","last_active":"2024-03-04T06:38:51.442877+0000","last_peered":"2024-03-04T06:38:51.442877+0000","last_clean":"2024-03-04T06:38:51.442877+0000","last_became_active":"2024-03-04T06:38:12.897568+0000","last_became_peered":"2024-03-04T06:38:12.897568+0000","last_unstale":"2024-03-04T06:38:51.442877+0000","last_undegraded":"2024-03-04T06:38:51.442877+0000","last_fullsized":"2024-03-04T06:38:51.442877+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:22:30.116519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825765+0000","last_change":"2024-03-04T06:38:12.556223+0000","last_active":"2024-03-04T06:39:44.825765+0000","last_peered":"2024-03-04T06:39:44.825765+0000","last_clean":"2024-03-04T06:39:44.825765+0000","last_became_active":"2024-03-04T06:38:12.555948+0000","last_became_peered":"2024-03-04T06:38:12.555948+0000","last_unstale":"2024-03-04T06:39:44.825765+0000","last_undegraded":"2024-03-04T06:39:44.825765+0000","last_fullsized":"2024-03-04T06:39:44.825765+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:19:51.659542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443156+0000","last_change":"2024-03-04T06:38:12.908686+0000","last_active":"2024-03-04T06:38:51.443156+0000","last_peered":"2024-03-04T06:38:51.443156+0000","last_clean":"2024-03-04T06:38:51.443156+0000","last_became_active":"2024-03-04T06:38:12.907114+0000","last_became_peered":"2024-03-04T06:38:12.907114+0000","last_unstale":"2024-03-04T06:38:51.443156+0000","last_undegraded":"2024-03-04T06:38:51.443156+0000","last_fullsized":"2024-03-04T06:38:51.443156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:08:03.009115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831276+0000","last_change":"2024-03-04T06:38:12.558399+0000","last_active":"2024-03-04T06:39:44.831276+0000","last_peered":"2024-03-04T06:39:44.831276+0000","last_clean":"2024-03-04T06:39:44.831276+0000","last_became_active":"2024-03-04T06:38:12.558068+0000","last_became_peered":"2024-03-04T06:38:12.558068+0000","last_unstale":"2024-03-04T06:39:44.831276+0000","last_undegraded":"2024-03-04T06:39:44.831276+0000","last_fullsized":"2024-03-04T06:39:44.831276+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:00.895079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834188+0000","last_change":"2024-03-04T06:38:12.904212+0000","last_active":"2024-03-04T06:39:44.834188+0000","last_peered":"2024-03-04T06:39:44.834188+0000","last_clean":"2024-03-04T06:39:44.834188+0000","last_became_active":"2024-03-04T06:38:12.903906+0000","last_became_peered":"2024-03-04T06:38:12.903906+0000","last_unstale":"2024-03-04T06:39:44.834188+0000","last_undegraded":"2024-03-04T06:39:44.834188+0000","last_fullsized":"2024-03-04T06:39:44.834188+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:27:10.766546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826396+0000","last_change":"2024-03-04T06:38:12.548200+0000","last_active":"2024-03-04T06:39:44.826396+0000","last_peered":"2024-03-04T06:39:44.826396+0000","last_clean":"2024-03-04T06:39:44.826396+0000","last_became_active":"2024-03-04T06:38:12.547906+0000","last_became_peered":"2024-03-04T06:38:12.547906+0000","last_unstale":"2024-03-04T06:39:44.826396+0000","last_undegraded":"2024-03-04T06:39:44.826396+0000","last_fullsized":"2024-03-04T06:39:44.826396+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:11:39.491360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829355+0000","last_change":"2024-03-04T06:38:12.918955+0000","last_active":"2024-03-04T06:39:44.829355+0000","last_peered":"2024-03-04T06:39:44.829355+0000","last_clean":"2024-03-04T06:39:44.829355+0000","last_became_active":"2024-03-04T06:38:12.918684+0000","last_became_peered":"2024-03-04T06:38:12.918684+0000","last_unstale":"2024-03-04T06:39:44.829355+0000","last_undegraded":"2024-03-04T06:39:44.829355+0000","last_fullsized":"2024-03-04T06:39:44.829355+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:47:29.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826269+0000","last_change":"2024-03-04T06:38:12.547660+0000","last_active":"2024-03-04T06:39:44.826269+0000","last_peered":"2024-03-04T06:39:44.826269+0000","last_clean":"2024-03-04T06:39:44.826269+0000","last_became_active":"2024-03-04T06:38:12.547358+0000","last_became_peered":"2024-03-04T06:38:12.547358+0000","last_unstale":"2024-03-04T06:39:44.826269+0000","last_undegraded":"2024-03-04T06:39:44.826269+0000","last_fullsized":"2024-03-04T06:39:44.826269+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:10.370020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825389+0000","last_change":"2024-03-04T06:38:12.902066+0000","last_active":"2024-03-04T06:39:44.825389+0000","last_peered":"2024-03-04T06:39:44.825389+0000","last_clean":"2024-03-04T06:39:44.825389+0000","last_became_active":"2024-03-04T06:38:12.901331+0000","last_became_peered":"2024-03-04T06:38:12.901331+0000","last_unstale":"2024-03-04T06:39:44.825389+0000","last_undegraded":"2024-03-04T06:39:44.825389+0000","last_fullsized":"2024-03-04T06:39:44.825389+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:46:51.413734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826848+0000","last_change":"2024-03-04T06:38:12.547376+0000","last_active":"2024-03-04T06:39:44.826848+0000","last_peered":"2024-03-04T06:39:44.826848+0000","last_clean":"2024-03-04T06:39:44.826848+0000","last_became_active":"2024-03-04T06:38:12.547108+0000","last_became_peered":"2024-03-04T06:38:12.547108+0000","last_unstale":"2024-03-04T06:39:44.826848+0000","last_undegraded":"2024-03-04T06:39:44.826848+0000","last_fullsized":"2024-03-04T06:39:44.826848+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:34:14.300865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830796+0000","last_change":"2024-03-04T06:38:12.917263+0000","last_active":"2024-03-04T06:39:44.830796+0000","last_peered":"2024-03-04T06:39:44.830796+0000","last_clean":"2024-03-04T06:39:44.830796+0000","last_became_active":"2024-03-04T06:38:12.917001+0000","last_became_peered":"2024-03-04T06:38:12.917001+0000","last_unstale":"2024-03-04T06:39:44.830796+0000","last_undegraded":"2024-03-04T06:39:44.830796+0000","last_fullsized":"2024-03-04T06:39:44.830796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:54.912481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833760+0000","last_change":"2024-03-04T06:38:12.916968+0000","last_active":"2024-03-04T06:39:44.833760+0000","last_peered":"2024-03-04T06:39:44.833760+0000","last_clean":"2024-03-04T06:39:44.833760+0000","last_became_active":"2024-03-04T06:38:12.916669+0000","last_became_peered":"2024-03-04T06:38:12.916669+0000","last_unstale":"2024-03-04T06:39:44.833760+0000","last_undegraded":"2024-03-04T06:39:44.833760+0000","last_fullsized":"2024-03-04T06:39:44.833760+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:18:16.919063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826181+0000","last_change":"2024-03-04T06:38:12.892619+0000","last_active":"2024-03-04T06:39:44.826181+0000","last_peered":"2024-03-04T06:39:44.826181+0000","last_clean":"2024-03-04T06:39:44.826181+0000","last_became_active":"2024-03-04T06:38:12.892261+0000","last_became_peered":"2024-03-04T06:38:12.892261+0000","last_unstale":"2024-03-04T06:39:44.826181+0000","last_undegraded":"2024-03-04T06:39:44.826181+0000","last_fullsized":"2024-03-04T06:39:44.826181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:19:13.957414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825192+0000","last_change":"2024-03-04T06:38:12.899301+0000","last_active":"2024-03-04T06:39:44.825192+0000","last_peered":"2024-03-04T06:39:44.825192+0000","last_clean":"2024-03-04T06:39:44.825192+0000","last_became_active":"2024-03-04T06:38:12.898002+0000","last_became_peered":"2024-03-04T06:38:12.898002+0000","last_unstale":"2024-03-04T06:39:44.825192+0000","last_undegraded":"2024-03-04T06:39:44.825192+0000","last_fullsized":"2024-03-04T06:39:44.825192+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:46.969732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834361+0000","last_change":"2024-03-04T06:38:12.908610+0000","last_active":"2024-03-04T06:39:44.834361+0000","last_peered":"2024-03-04T06:39:44.834361+0000","last_clean":"2024-03-04T06:39:44.834361+0000","last_became_active":"2024-03-04T06:38:12.907578+0000","last_became_peered":"2024-03-04T06:38:12.907578+0000","last_unstale":"2024-03-04T06:39:44.834361+0000","last_undegraded":"2024-03-04T06:39:44.834361+0000","last_fullsized":"2024-03-04T06:39:44.834361+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:52.078874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443207+0000","last_change":"2024-03-04T06:38:12.906536+0000","last_active":"2024-03-04T06:38:51.443207+0000","last_peered":"2024-03-04T06:38:51.443207+0000","last_clean":"2024-03-04T06:38:51.443207+0000","last_became_active":"2024-03-04T06:38:12.906183+0000","last_became_peered":"2024-03-04T06:38:12.906183+0000","last_unstale":"2024-03-04T06:38:51.443207+0000","last_undegraded":"2024-03-04T06:38:51.443207+0000","last_fullsized":"2024-03-04T06:38:51.443207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:15:13.559021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826187+0000","last_change":"2024-03-04T06:38:12.899871+0000","last_active":"2024-03-04T06:39:44.826187+0000","last_peered":"2024-03-04T06:39:44.826187+0000","last_clean":"2024-03-04T06:39:44.826187+0000","last_became_active":"2024-03-04T06:38:12.899583+0000","last_became_peered":"2024-03-04T06:38:12.899583+0000","last_unstale":"2024-03-04T06:39:44.826187+0000","last_undegraded":"2024-03-04T06:39:44.826187+0000","last_fullsized":"2024-03-04T06:39:44.826187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:51.628806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834765+0000","last_change":"2024-03-04T06:38:12.914660+0000","last_active":"2024-03-04T06:39:44.834765+0000","last_peered":"2024-03-04T06:39:44.834765+0000","last_clean":"2024-03-04T06:39:44.834765+0000","last_became_active":"2024-03-04T06:38:12.914354+0000","last_became_peered":"2024-03-04T06:38:12.914354+0000","last_unstale":"2024-03-04T06:39:44.834765+0000","last_undegraded":"2024-03-04T06:39:44.834765+0000","last_fullsized":"2024-03-04T06:39:44.834765+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:28.750455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.443344+0000","last_change":"2024-03-04T06:38:12.906752+0000","last_active":"2024-03-04T06:38:51.443344+0000","last_peered":"2024-03-04T06:38:51.443344+0000","last_clean":"2024-03-04T06:38:51.443344+0000","last_became_active":"2024-03-04T06:38:12.906492+0000","last_became_peered":"2024-03-04T06:38:12.906492+0000","last_unstale":"2024-03-04T06:38:51.443344+0000","last_undegraded":"2024-03-04T06:38:51.443344+0000","last_fullsized":"2024-03-04T06:38:51.443344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:24.841196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825148+0000","last_change":"2024-03-04T06:38:12.897151+0000","last_active":"2024-03-04T06:39:44.825148+0000","last_peered":"2024-03-04T06:39:44.825148+0000","last_clean":"2024-03-04T06:39:44.825148+0000","last_became_active":"2024-03-04T06:38:12.896787+0000","last_became_peered":"2024-03-04T06:38:12.896787+0000","last_unstale":"2024-03-04T06:39:44.825148+0000","last_undegraded":"2024-03-04T06:39:44.825148+0000","last_fullsized":"2024-03-04T06:39:44.825148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:12:22.562737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-04T06:38:51.442915+0000","last_change":"2024-03-04T06:38:12.908348+0000","last_active":"2024-03-04T06:38:51.442915+0000","last_peered":"2024-03-04T06:38:51.442915+0000","last_clean":"2024-03-04T06:38:51.442915+0000","last_became_active":"2024-03-04T06:38:12.908021+0000","last_became_peered":"2024-03-04T06:38:12.908021+0000","last_unstale":"2024-03-04T06:38:51.442915+0000","last_undegraded":"2024-03-04T06:38:51.442915+0000","last_fullsized":"2024-03-04T06:38:51.442915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:16:36.050910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825276+0000","last_change":"2024-03-04T06:38:12.898994+0000","last_active":"2024-03-04T06:39:44.825276+0000","last_peered":"2024-03-04T06:39:44.825276+0000","last_clean":"2024-03-04T06:39:44.825276+0000","last_became_active":"2024-03-04T06:38:12.898693+0000","last_became_peered":"2024-03-04T06:38:12.898693+0000","last_unstale":"2024-03-04T06:39:44.825276+0000","last_undegraded":"2024-03-04T06:39:44.825276+0000","last_fullsized":"2024-03-04T06:39:44.825276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:40:01.173992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834403+0000","last_change":"2024-03-04T06:38:12.898036+0000","last_active":"2024-03-04T06:39:44.834403+0000","last_peered":"2024-03-04T06:39:44.834403+0000","last_clean":"2024-03-04T06:39:44.834403+0000","last_became_active":"2024-03-04T06:38:12.897717+0000","last_became_peered":"2024-03-04T06:38:12.897717+0000","last_unstale":"2024-03-04T06:39:44.834403+0000","last_undegraded":"2024-03-04T06:39:44.834403+0000","last_fullsized":"2024-03-04T06:39:44.834403+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:58:02.821482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834420+0000","last_change":"2024-03-04T06:38:12.915624+0000","last_active":"2024-03-04T06:39:44.834420+0000","last_peered":"2024-03-04T06:39:44.834420+0000","last_clean":"2024-03-04T06:39:44.834420+0000","last_became_active":"2024-03-04T06:38:12.915335+0000","last_became_peered":"2024-03-04T06:38:12.915335+0000","last_unstale":"2024-03-04T06:39:44.834420+0000","last_undegraded":"2024-03-04T06:39:44.834420+0000","last_fullsized":"2024-03-04T06:39:44.834420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:52:58.038264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3146,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234008,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28284,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716868,"statfs":{"total":95995035648,"available":95966072832,"internally_reserved":0,"allocated":1294336,"data_stored":893069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47499999999999998}]},{"osd":1,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.439},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51800000000000002}]},{"osd":2,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.53200000000000003}]},{"osd":3,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.46400000000000002}]},{"osd":4,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.378}]},{"osd":5,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.56299999999999994}]},{"osd":6,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.49299999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495645,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28292,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716860,"statfs":{"total":95995035648,"available":95966064640,"internally_reserved":0,"allocated":1302528,"data_stored":895144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.495,"15min":0.496},"min":{"1min":0.36899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.76100000000000001}]},{"osd":1,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68999999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.753,"15min":0.753},"last":0.80200000000000005}]},{"osd":3,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64700000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.74299999999999999}]},{"osd":4,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.441,"15min":0.435},"min":{"1min":0.34399999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.46899999999999997}]},{"osd":5,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.432,"15min":0.42199999999999999},"min":{"1min":0.35099999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.46200000000000002,"15min":0.45400000000000001},"min":{"1min":0.371,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.57399999999999995}]},{"osd":7,"last update":"Mon Mar 4 06:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.61699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717444,"statfs":{"total":95995035648,"available":95966662656,"internally_reserved":0,"allocated":704512,"data_stored":302588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.32000000000000001},"min":{"1min":0.23300000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.33800000000000002},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.246}]},{"osd":2,"last update":"Mon Mar 4 06:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.36499999999999999},"min":{"1min":0.25800000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.55100000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.28899999999999998}]},{"osd":3,"last update":"Mon Mar 4 06:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.315},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.434,"15min":0.433},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.37}]},{"osd":4,"last update":"Mon Mar 4 06:38:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.747,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81799999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76400000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83299999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61599999999999999}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28296,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716856,"statfs":{"total":95995035648,"available":95966060544,"internally_reserved":0,"allocated":1306624,"data_stored":893524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 4 06:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38200000000000001,"15min":0.36599999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.29599999999999999}]},{"osd":2,"last update":"Mon Mar 4 06:38:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.312},{"interface":"front","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64600000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.26600000000000001}]},{"osd":3,"last update":"Mon Mar 4 06:39:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28899999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Mar 4 06:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65600000000000003,"5min":0.877,"15min":0.877},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75800000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.52200000000000002}]},{"osd":5,"last update":"Mon Mar 4 06:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.80400000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.70099999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.63800000000000001}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72899999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":1.2629999999999999,"15min":1.3759999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84599999999999997,"5min":11.987,"15min":11.987},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Mar 4 06:38:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55700000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411376,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717440,"statfs":{"total":95995035648,"available":95966658560,"internally_reserved":0,"allocated":708608,"data_stored":309568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.32400000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.376,"15min":0.36399999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33700000000000002}]},{"osd":1,"last update":"Mon Mar 4 06:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.5,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.56499999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.30199999999999999}]},{"osd":3,"last update":"Mon Mar 4 06:39:23 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60099999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Mar 4 06:39:44 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Mon Mar 4 06:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61899999999999999,"15min":0.62},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84699999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.85099999999999998}]},{"osd":6,"last update":"Mon Mar 4 06:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85099999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.745}]}]},{"osd":3,"up_from":25,"seq":107374182444,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717432,"statfs":{"total":95995035648,"available":95966650368,"internally_reserved":0,"allocated":716800,"data_stored":304880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.38900000000000001,"15min":0.39700000000000002},"min":{"1min":0.25600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.45400000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41499999999999998,"15min":0.42499999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.50700000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.47199999999999998}]},{"osd":1,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41599999999999998,"15min":0.42399999999999999},"min":{"1min":0.27200000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.53500000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41999999999999998,"15min":0.42399999999999999},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52300000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46000000000000002}]},{"osd":2,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70199999999999996,"5min":0.749,"15min":0.749},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.438,"15min":0.44800000000000001},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.52500000000000002}]},{"osd":4,"last update":"Mon Mar 4 06:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.68100000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69299999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.53700000000000003}]},{"osd":5,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79200000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77900000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55000000000000004}]},{"osd":6,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.58399999999999996}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.622}]}]},{"osd":4,"up_from":30,"seq":128849018919,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27716,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717436,"statfs":{"total":95995035648,"available":95966654464,"internally_reserved":0,"allocated":712704,"data_stored":303136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:38:47 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.76400000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.436}]},{"osd":1,"last update":"Mon Mar 4 06:38:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66700000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67400000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56499999999999995}]},{"osd":2,"last update":"Mon Mar 4 06:38:47 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Mon Mar 4 06:38:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.66400000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Mar 4 06:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.42199999999999999,"15min":0.40799999999999997},"min":{"1min":0.375,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59699999999999998}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.45400000000000001,"15min":0.442},"min":{"1min":0.36799999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.62}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53300000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757282,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717440,"statfs":{"total":95995035648,"available":95966658560,"internally_reserved":0,"allocated":708608,"data_stored":304535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.625,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42699999999999999}]},{"osd":1,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68899999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.627},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64600000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.59399999999999997}]},{"osd":3,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.78900000000000003,"15min":0.83799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.63700000000000001,"5min":6.6180000000000003,"15min":6.6180000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.27800000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.39500000000000002,"15min":0.38100000000000001},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.70499999999999996}]},{"osd":6,"last update":"Mon Mar 4 06:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.46300000000000002},"min":{"1min":0.33000000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.32900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.65000000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:39:51.488 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.1c is not active+clean 2024-03-04T06:39:51.488 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 5, 'reported_epoch': 69, 'state': 'activating', 'last_fresh': '2024-03-04T06:39:45.827885+0000', 'last_change': '2024-03-04T06:39:45.826136+0000', 'last_active': '2024-03-04T06:38:12.520695+0000', 'last_peered': '2024-03-04T06:38:12.520695+0000', 'last_clean': '2024-03-04T06:38:12.520695+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T06:39:45.827885+0000', 'last_undegraded': '2024-03-04T06:39:45.827885+0000', 'last_fullsized': '2024-03-04T06:39:45.827885+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 61, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-05T09:10:51.404998+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4, 1], 'acting': [2, 4, 1], 'avail_no_missing': ['2', '1', '4', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T06:39:51.488 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.15 is not active+clean 2024-03-04T06:39:51.488 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 21, 'reported_epoch': 69, 'state': 'activating', 'last_fresh': '2024-03-04T06:39:45.830603+0000', 'last_change': '2024-03-04T06:39:45.830603+0000', 'last_active': '2024-03-04T06:39:44.831302+0000', 'last_peered': '2024-03-04T06:38:51.444042+0000', 'last_clean': '2024-03-04T06:38:51.444042+0000', 'last_became_active': '2024-03-04T06:38:12.918269+0000', 'last_became_peered': '2024-03-04T06:38:12.918269+0000', 'last_unstale': '2024-03-04T06:39:45.830603+0000', 'last_undegraded': '2024-03-04T06:39:45.830603+0000', 'last_fullsized': '2024-03-04T06:39:45.830603+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 61, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-05T14:58:41.826266+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3, 1], 'acting': [7, 3, 1], 'avail_no_missing': ['7', '1', '3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T06:39:51.488 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.12 is not active+clean 2024-03-04T06:39:51.488 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 5, 'reported_epoch': 69, 'state': 'activating', 'last_fresh': '2024-03-04T06:39:45.829974+0000', 'last_change': '2024-03-04T06:39:45.826574+0000', 'last_active': '2024-03-04T06:39:45.826375+0000', 'last_peered': '2024-03-04T06:38:50.932439+0000', 'last_clean': '2024-03-04T06:38:50.932439+0000', 'last_became_active': '2024-03-04T06:38:12.893498+0000', 'last_became_peered': '2024-03-04T06:38:12.893498+0000', 'last_unstale': '2024-03-04T06:39:45.829974+0000', 'last_undegraded': '2024-03-04T06:39:45.829974+0000', 'last_fullsized': '2024-03-04T06:39:45.829974+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 61, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-05T16:47:17.558117+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7, 3], 'acting': [2, 7, 3], 'avail_no_missing': ['2', '0', '3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T06:39:51.489 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.13 is not active+clean 2024-03-04T06:39:51.489 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 21, 'reported_epoch': 69, 'state': 'activating', 'last_fresh': '2024-03-04T06:39:45.830502+0000', 'last_change': '2024-03-04T06:39:45.830502+0000', 'last_active': '2024-03-04T06:39:44.830633+0000', 'last_peered': '2024-03-04T06:38:51.443819+0000', 'last_clean': '2024-03-04T06:38:51.443819+0000', 'last_became_active': '2024-03-04T06:38:12.913476+0000', 'last_became_peered': '2024-03-04T06:38:12.913476+0000', 'last_unstale': '2024-03-04T06:39:45.830502+0000', 'last_undegraded': '2024-03-04T06:39:45.830502+0000', 'last_fullsized': '2024-03-04T06:39:45.830502+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 61, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-05T07:08:21.823113+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3, 2], 'acting': [7, 3, 2], 'avail_no_missing': ['7', '2', '3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T06:39:51.489 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.1 is not active+clean 2024-03-04T06:39:51.489 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 69, 'state': 'activating', 'last_fresh': '2024-03-04T06:39:45.826371+0000', 'last_change': '2024-03-04T06:39:45.826371+0000', 'last_active': '2024-03-04T06:39:45.826074+0000', 'last_peered': '2024-03-04T06:38:50.932358+0000', 'last_clean': '2024-03-04T06:38:50.932358+0000', 'last_became_active': '2024-03-04T06:38:12.910158+0000', 'last_became_peered': '2024-03-04T06:38:12.910158+0000', 'last_unstale': '2024-03-04T06:39:45.826371+0000', 'last_undegraded': '2024-03-04T06:39:45.826371+0000', 'last_fullsized': '2024-03-04T06:39:45.826371+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 61, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'last_clean_scrub_stamp': '2024-03-04T06:38:12.520695+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-05T09:15:08.818871+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4, 3], 'acting': [2, 4, 3], 'avail_no_missing': ['2', '0', '3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T06:39:51.489 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph status --format=json 2024-03-04T06:39:51.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:51 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:51 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:51 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:51 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:51 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:51 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:39:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:51 smithi203 ceph-mon[30756]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:39:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:51 smithi203 ceph-mon[30756]: pgmap v42: 105 pgs: 5 activating, 100 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:52.227 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:39:53.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:52 smithi137 ceph-mon[26846]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-03-04T06:39:53.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:52 smithi137 ceph-mon[26846]: Cluster is now healthy 2024-03-04T06:39:53.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:52 smithi137 ceph-mon[37364]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-03-04T06:39:53.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:52 smithi137 ceph-mon[37364]: Cluster is now healthy 2024-03-04T06:39:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:52 smithi203 ceph-mon[30756]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-03-04T06:39:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:52 smithi203 ceph-mon[30756]: Cluster is now healthy 2024-03-04T06:39:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:39:53.965 INFO:teuthology.orchestra.run.smithi137.stdout:{"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":323,"monmap":{"epoch":3,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":69,"num_osds":8,"num_up_osds":8,"osd_up_since":1709534274,"num_in_osds":8,"osd_in_since":1709534257,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":593514,"bytes_used":228896768,"bytes_avail":767731388416,"bytes_total":767960285184,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24352}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"services":{"dashboard":"https://172.21.15.137:8443/","prometheus":"http://172.21.15.137:9283/"}},"servicemap":{"epoch":13,"modified":"2024-03-04T06:39:46.752865+0000","services":{}},"progress_events":{"6773cd2b-19b0-4533-8e08-09ce2d05d2c8":{"message":"Global Recovery Event (0s)\n [............................] ","progress":0,"add_to_ceph_s":true}}} 2024-03-04T06:39:54.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:53 smithi137 ceph-mon[26846]: pgmap v43: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:54.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:53 smithi137 ceph-mon[37364]: pgmap v43: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:54.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:53 smithi203 ceph-mon[30756]: pgmap v43: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:55.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:54 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2297954333' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-03-04T06:39:55.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:54 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:55.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:54 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:55.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:54 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:55.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:54 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2297954333' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-03-04T06:39:55.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:54 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:55.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:54 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:55.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:54 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:55.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:54 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2297954333' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-03-04T06:39:55.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:54 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:55.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:54 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:55.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:54 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:55.194 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-03-04T06:39:55.194 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:39:55.441 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:39:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:39:55] "GET /metrics HTTP/1.1" 200 33648 "" "Prometheus/2.43.0" 2024-03-04T06:39:55.950 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:39:56.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:55 smithi137 ceph-mon[26846]: pgmap v44: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:56.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:55 smithi137 ceph-mon[37364]: pgmap v44: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:56.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:55 smithi203 ceph-mon[30756]: pgmap v44: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:57.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:56 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:57.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:56 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:57.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:56 smithi137 ceph-mon[26846]: pgmap v45: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:57.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:56 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:57.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:56 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:57.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:56 smithi137 ceph-mon[37364]: pgmap v45: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:57.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:56 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:56 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:56 smithi203 ceph-mon[30756]: pgmap v45: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-04T06:39:57.915 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:39:57.917 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:39:58.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:57 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:39:58.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:57 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:39:58.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:57 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:58.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:57 smithi137 ceph-mon[26846]: Reconfiguring alertmanager.a (dependencies changed)... 2024-03-04T06:39:58.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:57 smithi137 ceph-mon[26846]: Reconfiguring daemon alertmanager.a on smithi137 2024-03-04T06:39:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:57 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:39:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:57 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:39:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:57 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:57 smithi137 ceph-mon[37364]: Reconfiguring alertmanager.a (dependencies changed)... 2024-03-04T06:39:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:57 smithi137 ceph-mon[37364]: Reconfiguring daemon alertmanager.a on smithi137 2024-03-04T06:39:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:57 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:39:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:57 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:39:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:57 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:39:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:57 smithi203 ceph-mon[30756]: Reconfiguring alertmanager.a (dependencies changed)... 2024-03-04T06:39:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:57 smithi203 ceph-mon[30756]: Reconfiguring daemon alertmanager.a on smithi137 2024-03-04T06:39:59.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:58 smithi137 ceph-mon[26846]: from='client.24722 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:39:59.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:58 smithi137 ceph-mon[26846]: pgmap v46: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:59.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:58 smithi137 ceph-mon[37364]: from='client.24722 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:39:59.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:58 smithi137 ceph-mon[37364]: pgmap v46: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:59.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:58 smithi203 ceph-mon[30756]: from='client.24722 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:39:59.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:58 smithi203 ceph-mon[30756]: pgmap v46: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:39:59.433 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-03-04T06:39:56.754782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593514,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":227,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":315,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":223532,"kb_used_data":7364,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":749737684,"statfs":{"total":767960285184,"available":767731388416,"internally_reserved":0,"allocated":7540736,"data_stored":4256424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.929363"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830673+0000","last_change":"2024-03-04T06:38:12.919238+0000","last_active":"2024-03-04T06:39:44.830673+0000","last_peered":"2024-03-04T06:39:44.830673+0000","last_clean":"2024-03-04T06:39:44.830673+0000","last_became_active":"2024-03-04T06:38:12.918941+0000","last_became_peered":"2024-03-04T06:38:12.918941+0000","last_unstale":"2024-03-04T06:39:44.830673+0000","last_undegraded":"2024-03-04T06:39:44.830673+0000","last_fullsized":"2024-03-04T06:39:44.830673+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:10:03.122262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826566+0000","last_change":"2024-03-04T06:38:12.914740+0000","last_active":"2024-03-04T06:39:44.826566+0000","last_peered":"2024-03-04T06:39:44.826566+0000","last_clean":"2024-03-04T06:39:44.826566+0000","last_became_active":"2024-03-04T06:38:12.914436+0000","last_became_peered":"2024-03-04T06:38:12.914436+0000","last_unstale":"2024-03-04T06:39:44.826566+0000","last_undegraded":"2024-03-04T06:39:44.826566+0000","last_fullsized":"2024-03-04T06:39:44.826566+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:58.781088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.835674+0000","last_change":"2024-03-04T06:38:12.895666+0000","last_active":"2024-03-04T06:39:44.835674+0000","last_peered":"2024-03-04T06:39:44.835674+0000","last_clean":"2024-03-04T06:39:44.835674+0000","last_became_active":"2024-03-04T06:38:12.895398+0000","last_became_peered":"2024-03-04T06:38:12.895398+0000","last_unstale":"2024-03-04T06:39:44.835674+0000","last_undegraded":"2024-03-04T06:39:44.835674+0000","last_fullsized":"2024-03-04T06:39:44.835674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:10.744216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825411+0000","last_change":"2024-03-04T06:38:12.902256+0000","last_active":"2024-03-04T06:39:44.825411+0000","last_peered":"2024-03-04T06:39:44.825411+0000","last_clean":"2024-03-04T06:39:44.825411+0000","last_became_active":"2024-03-04T06:38:12.901792+0000","last_became_peered":"2024-03-04T06:38:12.901792+0000","last_unstale":"2024-03-04T06:39:44.825411+0000","last_undegraded":"2024-03-04T06:39:44.825411+0000","last_fullsized":"2024-03-04T06:39:44.825411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:45.163241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831292+0000","last_change":"2024-03-04T06:38:12.913797+0000","last_active":"2024-03-04T06:39:44.831292+0000","last_peered":"2024-03-04T06:39:44.831292+0000","last_clean":"2024-03-04T06:39:44.831292+0000","last_became_active":"2024-03-04T06:38:12.913517+0000","last_became_peered":"2024-03-04T06:38:12.913517+0000","last_unstale":"2024-03-04T06:39:44.831292+0000","last_undegraded":"2024-03-04T06:39:44.831292+0000","last_fullsized":"2024-03-04T06:39:44.831292+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:24.837813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825374+0000","last_change":"2024-03-04T06:38:12.904787+0000","last_active":"2024-03-04T06:39:44.825374+0000","last_peered":"2024-03-04T06:39:44.825374+0000","last_clean":"2024-03-04T06:39:44.825374+0000","last_became_active":"2024-03-04T06:38:12.904484+0000","last_became_peered":"2024-03-04T06:38:12.904484+0000","last_unstale":"2024-03-04T06:39:44.825374+0000","last_undegraded":"2024-03-04T06:39:44.825374+0000","last_fullsized":"2024-03-04T06:39:44.825374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:03:28.898688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829238+0000","last_change":"2024-03-04T06:38:12.913825+0000","last_active":"2024-03-04T06:39:44.829238+0000","last_peered":"2024-03-04T06:39:44.829238+0000","last_clean":"2024-03-04T06:39:44.829238+0000","last_became_active":"2024-03-04T06:38:12.913553+0000","last_became_peered":"2024-03-04T06:38:12.913553+0000","last_unstale":"2024-03-04T06:39:44.829238+0000","last_undegraded":"2024-03-04T06:39:44.829238+0000","last_fullsized":"2024-03-04T06:39:44.829238+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:23:17.322436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831954+0000","last_change":"2024-03-04T06:38:12.902309+0000","last_active":"2024-03-04T06:39:44.831954+0000","last_peered":"2024-03-04T06:39:44.831954+0000","last_clean":"2024-03-04T06:39:44.831954+0000","last_became_active":"2024-03-04T06:38:12.902009+0000","last_became_peered":"2024-03-04T06:38:12.902009+0000","last_unstale":"2024-03-04T06:39:44.831954+0000","last_undegraded":"2024-03-04T06:39:44.831954+0000","last_fullsized":"2024-03-04T06:39:44.831954+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:36:04.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830956+0000","last_change":"2024-03-04T06:38:12.916933+0000","last_active":"2024-03-04T06:39:44.830956+0000","last_peered":"2024-03-04T06:39:44.830956+0000","last_clean":"2024-03-04T06:39:44.830956+0000","last_became_active":"2024-03-04T06:38:12.913922+0000","last_became_peered":"2024-03-04T06:38:12.913922+0000","last_unstale":"2024-03-04T06:39:44.830956+0000","last_undegraded":"2024-03-04T06:39:44.830956+0000","last_fullsized":"2024-03-04T06:39:44.830956+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:08:21.342061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834690+0000","last_change":"2024-03-04T06:38:12.911185+0000","last_active":"2024-03-04T06:39:44.834690+0000","last_peered":"2024-03-04T06:39:44.834690+0000","last_clean":"2024-03-04T06:39:44.834690+0000","last_became_active":"2024-03-04T06:38:12.910906+0000","last_became_peered":"2024-03-04T06:38:12.910906+0000","last_unstale":"2024-03-04T06:39:44.834690+0000","last_undegraded":"2024-03-04T06:39:44.834690+0000","last_fullsized":"2024-03-04T06:39:44.834690+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:45.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834569+0000","last_change":"2024-03-04T06:38:12.916277+0000","last_active":"2024-03-04T06:39:44.834569+0000","last_peered":"2024-03-04T06:39:44.834569+0000","last_clean":"2024-03-04T06:39:44.834569+0000","last_became_active":"2024-03-04T06:38:12.915998+0000","last_became_peered":"2024-03-04T06:38:12.915998+0000","last_unstale":"2024-03-04T06:39:44.834569+0000","last_undegraded":"2024-03-04T06:39:44.834569+0000","last_fullsized":"2024-03-04T06:39:44.834569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:22:53.166929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830301+0000","last_change":"2024-03-04T06:38:12.907393+0000","last_active":"2024-03-04T06:39:44.830301+0000","last_peered":"2024-03-04T06:39:44.830301+0000","last_clean":"2024-03-04T06:39:44.830301+0000","last_became_active":"2024-03-04T06:38:12.907111+0000","last_became_peered":"2024-03-04T06:38:12.907111+0000","last_unstale":"2024-03-04T06:39:44.830301+0000","last_undegraded":"2024-03-04T06:39:44.830301+0000","last_fullsized":"2024-03-04T06:39:44.830301+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:18.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832736+0000","last_change":"2024-03-04T06:38:12.897003+0000","last_active":"2024-03-04T06:39:44.832736+0000","last_peered":"2024-03-04T06:39:44.832736+0000","last_clean":"2024-03-04T06:39:44.832736+0000","last_became_active":"2024-03-04T06:38:12.896729+0000","last_became_peered":"2024-03-04T06:38:12.896729+0000","last_unstale":"2024-03-04T06:39:44.832736+0000","last_undegraded":"2024-03-04T06:39:44.832736+0000","last_fullsized":"2024-03-04T06:39:44.832736+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:01:03.497642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834893+0000","last_change":"2024-03-04T06:38:12.896652+0000","last_active":"2024-03-04T06:39:44.834893+0000","last_peered":"2024-03-04T06:39:44.834893+0000","last_clean":"2024-03-04T06:39:44.834893+0000","last_became_active":"2024-03-04T06:38:12.896300+0000","last_became_peered":"2024-03-04T06:38:12.896300+0000","last_unstale":"2024-03-04T06:39:44.834893+0000","last_undegraded":"2024-03-04T06:39:44.834893+0000","last_fullsized":"2024-03-04T06:39:44.834893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:32.026507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825545+0000","last_change":"2024-03-04T06:38:12.907997+0000","last_active":"2024-03-04T06:39:44.825545+0000","last_peered":"2024-03-04T06:39:44.825545+0000","last_clean":"2024-03-04T06:39:44.825545+0000","last_became_active":"2024-03-04T06:38:12.907720+0000","last_became_peered":"2024-03-04T06:38:12.907720+0000","last_unstale":"2024-03-04T06:39:44.825545+0000","last_undegraded":"2024-03-04T06:39:44.825545+0000","last_fullsized":"2024-03-04T06:39:44.825545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:46:55.140847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825032+0000","last_change":"2024-03-04T06:38:12.899219+0000","last_active":"2024-03-04T06:39:44.825032+0000","last_peered":"2024-03-04T06:39:44.825032+0000","last_clean":"2024-03-04T06:39:44.825032+0000","last_became_active":"2024-03-04T06:38:12.898928+0000","last_became_peered":"2024-03-04T06:38:12.898928+0000","last_unstale":"2024-03-04T06:39:44.825032+0000","last_undegraded":"2024-03-04T06:39:44.825032+0000","last_fullsized":"2024-03-04T06:39:44.825032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:13.412822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825758+0000","last_change":"2024-03-04T06:38:12.908332+0000","last_active":"2024-03-04T06:39:44.825758+0000","last_peered":"2024-03-04T06:39:44.825758+0000","last_clean":"2024-03-04T06:39:44.825758+0000","last_became_active":"2024-03-04T06:38:12.908038+0000","last_became_peered":"2024-03-04T06:38:12.908038+0000","last_unstale":"2024-03-04T06:39:44.825758+0000","last_undegraded":"2024-03-04T06:39:44.825758+0000","last_fullsized":"2024-03-04T06:39:44.825758+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:05:49.146138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826759+0000","last_change":"2024-03-04T06:38:12.899134+0000","last_active":"2024-03-04T06:39:44.826759+0000","last_peered":"2024-03-04T06:39:44.826759+0000","last_clean":"2024-03-04T06:39:44.826759+0000","last_became_active":"2024-03-04T06:38:12.898801+0000","last_became_peered":"2024-03-04T06:38:12.898801+0000","last_unstale":"2024-03-04T06:39:44.826759+0000","last_undegraded":"2024-03-04T06:39:44.826759+0000","last_fullsized":"2024-03-04T06:39:44.826759+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:21:48.465552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829127+0000","last_change":"2024-03-04T06:38:12.918000+0000","last_active":"2024-03-04T06:39:44.829127+0000","last_peered":"2024-03-04T06:39:44.829127+0000","last_clean":"2024-03-04T06:39:44.829127+0000","last_became_active":"2024-03-04T06:38:12.914159+0000","last_became_peered":"2024-03-04T06:38:12.914159+0000","last_unstale":"2024-03-04T06:39:44.829127+0000","last_undegraded":"2024-03-04T06:39:44.829127+0000","last_fullsized":"2024-03-04T06:39:44.829127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:24.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834743+0000","last_change":"2024-03-04T06:38:12.550843+0000","last_active":"2024-03-04T06:39:44.834743+0000","last_peered":"2024-03-04T06:39:44.834743+0000","last_clean":"2024-03-04T06:39:44.834743+0000","last_became_active":"2024-03-04T06:38:12.550141+0000","last_became_peered":"2024-03-04T06:38:12.550141+0000","last_unstale":"2024-03-04T06:39:44.834743+0000","last_undegraded":"2024-03-04T06:39:44.834743+0000","last_fullsized":"2024-03-04T06:39:44.834743+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:01.969570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833097+0000","last_change":"2024-03-04T06:38:12.896389+0000","last_active":"2024-03-04T06:39:44.833097+0000","last_peered":"2024-03-04T06:39:44.833097+0000","last_clean":"2024-03-04T06:39:44.833097+0000","last_became_active":"2024-03-04T06:38:12.896120+0000","last_became_peered":"2024-03-04T06:38:12.896120+0000","last_unstale":"2024-03-04T06:39:44.833097+0000","last_undegraded":"2024-03-04T06:39:44.833097+0000","last_fullsized":"2024-03-04T06:39:44.833097+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:57.729499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833163+0000","last_change":"2024-03-04T06:38:12.550800+0000","last_active":"2024-03-04T06:39:44.833163+0000","last_peered":"2024-03-04T06:39:44.833163+0000","last_clean":"2024-03-04T06:39:44.833163+0000","last_became_active":"2024-03-04T06:38:12.550444+0000","last_became_peered":"2024-03-04T06:38:12.550444+0000","last_unstale":"2024-03-04T06:39:44.833163+0000","last_undegraded":"2024-03-04T06:39:44.833163+0000","last_fullsized":"2024-03-04T06:39:44.833163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:42.209194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834447+0000","last_change":"2024-03-04T06:38:12.903258+0000","last_active":"2024-03-04T06:39:44.834447+0000","last_peered":"2024-03-04T06:39:44.834447+0000","last_clean":"2024-03-04T06:39:44.834447+0000","last_became_active":"2024-03-04T06:38:12.902982+0000","last_became_peered":"2024-03-04T06:38:12.902982+0000","last_unstale":"2024-03-04T06:39:44.834447+0000","last_undegraded":"2024-03-04T06:39:44.834447+0000","last_fullsized":"2024-03-04T06:39:44.834447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:31:23.228035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:45.834266+0000","last_change":"2024-03-04T06:39:45.833985+0000","last_active":"2024-03-04T06:39:45.834266+0000","last_peered":"2024-03-04T06:39:45.834266+0000","last_clean":"2024-03-04T06:39:45.834266+0000","last_became_active":"2024-03-04T06:39:45.831328+0000","last_became_peered":"2024-03-04T06:39:45.831328+0000","last_unstale":"2024-03-04T06:39:45.834266+0000","last_undegraded":"2024-03-04T06:39:45.834266+0000","last_fullsized":"2024-03-04T06:39:45.834266+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:31.095064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:46.422444+0000","last_change":"2024-03-04T06:39:46.422444+0000","last_active":"2024-03-04T06:39:46.422444+0000","last_peered":"2024-03-04T06:39:46.422444+0000","last_clean":"2024-03-04T06:39:46.422444+0000","last_became_active":"2024-03-04T06:39:46.421792+0000","last_became_peered":"2024-03-04T06:39:46.421792+0000","last_unstale":"2024-03-04T06:39:46.422444+0000","last_undegraded":"2024-03-04T06:39:46.422444+0000","last_fullsized":"2024-03-04T06:39:46.422444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:51.404998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830161+0000","last_change":"2024-03-04T06:38:12.556246+0000","last_active":"2024-03-04T06:39:44.830161+0000","last_peered":"2024-03-04T06:39:44.830161+0000","last_clean":"2024-03-04T06:39:44.830161+0000","last_became_active":"2024-03-04T06:38:12.555860+0000","last_became_peered":"2024-03-04T06:38:12.555860+0000","last_unstale":"2024-03-04T06:39:44.830161+0000","last_undegraded":"2024-03-04T06:39:44.830161+0000","last_fullsized":"2024-03-04T06:39:44.830161+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:41.910480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825545+0000","last_change":"2024-03-04T06:38:12.906907+0000","last_active":"2024-03-04T06:39:44.825545+0000","last_peered":"2024-03-04T06:39:44.825545+0000","last_clean":"2024-03-04T06:39:44.825545+0000","last_became_active":"2024-03-04T06:38:12.906615+0000","last_became_peered":"2024-03-04T06:38:12.906615+0000","last_unstale":"2024-03-04T06:39:44.825545+0000","last_undegraded":"2024-03-04T06:39:44.825545+0000","last_fullsized":"2024-03-04T06:39:44.825545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:21:15.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832856+0000","last_change":"2024-03-04T06:38:12.546234+0000","last_active":"2024-03-04T06:39:44.832856+0000","last_peered":"2024-03-04T06:39:44.832856+0000","last_clean":"2024-03-04T06:39:44.832856+0000","last_became_active":"2024-03-04T06:38:12.545975+0000","last_became_peered":"2024-03-04T06:38:12.545975+0000","last_unstale":"2024-03-04T06:39:44.832856+0000","last_undegraded":"2024-03-04T06:39:44.832856+0000","last_fullsized":"2024-03-04T06:39:44.832856+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:04.341190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829725+0000","last_change":"2024-03-04T06:38:12.908256+0000","last_active":"2024-03-04T06:39:44.829725+0000","last_peered":"2024-03-04T06:39:44.829725+0000","last_clean":"2024-03-04T06:39:44.829725+0000","last_became_active":"2024-03-04T06:38:12.907953+0000","last_became_peered":"2024-03-04T06:38:12.907953+0000","last_unstale":"2024-03-04T06:39:44.829725+0000","last_undegraded":"2024-03-04T06:39:44.829725+0000","last_fullsized":"2024-03-04T06:39:44.829725+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:03:03.291025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834226+0000","last_change":"2024-03-04T06:38:12.554332+0000","last_active":"2024-03-04T06:39:44.834226+0000","last_peered":"2024-03-04T06:39:44.834226+0000","last_clean":"2024-03-04T06:39:44.834226+0000","last_became_active":"2024-03-04T06:38:12.554044+0000","last_became_peered":"2024-03-04T06:38:12.554044+0000","last_unstale":"2024-03-04T06:39:44.834226+0000","last_undegraded":"2024-03-04T06:39:44.834226+0000","last_fullsized":"2024-03-04T06:39:44.834226+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:28:40.250342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834286+0000","last_change":"2024-03-04T06:38:12.910445+0000","last_active":"2024-03-04T06:39:44.834286+0000","last_peered":"2024-03-04T06:39:44.834286+0000","last_clean":"2024-03-04T06:39:44.834286+0000","last_became_active":"2024-03-04T06:38:12.909974+0000","last_became_peered":"2024-03-04T06:38:12.909974+0000","last_unstale":"2024-03-04T06:39:44.834286+0000","last_undegraded":"2024-03-04T06:39:44.834286+0000","last_fullsized":"2024-03-04T06:39:44.834286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:42:52.372021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832853+0000","last_change":"2024-03-04T06:38:12.543180+0000","last_active":"2024-03-04T06:39:44.832853+0000","last_peered":"2024-03-04T06:39:44.832853+0000","last_clean":"2024-03-04T06:39:44.832853+0000","last_became_active":"2024-03-04T06:38:12.542896+0000","last_became_peered":"2024-03-04T06:38:12.542896+0000","last_unstale":"2024-03-04T06:39:44.832853+0000","last_undegraded":"2024-03-04T06:39:44.832853+0000","last_fullsized":"2024-03-04T06:39:44.832853+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:15:09.816539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832220+0000","last_change":"2024-03-04T06:38:12.895735+0000","last_active":"2024-03-04T06:39:44.832220+0000","last_peered":"2024-03-04T06:39:44.832220+0000","last_clean":"2024-03-04T06:39:44.832220+0000","last_became_active":"2024-03-04T06:38:12.895201+0000","last_became_peered":"2024-03-04T06:38:12.895201+0000","last_unstale":"2024-03-04T06:39:44.832220+0000","last_undegraded":"2024-03-04T06:39:44.832220+0000","last_fullsized":"2024-03-04T06:39:44.832220+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:12:35.373175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825037+0000","last_change":"2024-03-04T06:38:12.551089+0000","last_active":"2024-03-04T06:39:44.825037+0000","last_peered":"2024-03-04T06:39:44.825037+0000","last_clean":"2024-03-04T06:39:44.825037+0000","last_became_active":"2024-03-04T06:38:12.550791+0000","last_became_peered":"2024-03-04T06:38:12.550791+0000","last_unstale":"2024-03-04T06:39:44.825037+0000","last_undegraded":"2024-03-04T06:39:44.825037+0000","last_fullsized":"2024-03-04T06:39:44.825037+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:49.576267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825638+0000","last_change":"2024-03-04T06:38:12.909194+0000","last_active":"2024-03-04T06:39:44.825638+0000","last_peered":"2024-03-04T06:39:44.825638+0000","last_clean":"2024-03-04T06:39:44.825638+0000","last_became_active":"2024-03-04T06:38:12.908879+0000","last_became_peered":"2024-03-04T06:38:12.908879+0000","last_unstale":"2024-03-04T06:39:44.825638+0000","last_undegraded":"2024-03-04T06:39:44.825638+0000","last_fullsized":"2024-03-04T06:39:44.825638+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:23.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834767+0000","last_change":"2024-03-04T06:38:12.544023+0000","last_active":"2024-03-04T06:39:44.834767+0000","last_peered":"2024-03-04T06:39:44.834767+0000","last_clean":"2024-03-04T06:39:44.834767+0000","last_became_active":"2024-03-04T06:38:12.543699+0000","last_became_peered":"2024-03-04T06:38:12.543699+0000","last_unstale":"2024-03-04T06:39:44.834767+0000","last_undegraded":"2024-03-04T06:39:44.834767+0000","last_fullsized":"2024-03-04T06:39:44.834767+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:19.418372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825706+0000","last_change":"2024-03-04T06:38:12.903510+0000","last_active":"2024-03-04T06:39:44.825706+0000","last_peered":"2024-03-04T06:39:44.825706+0000","last_clean":"2024-03-04T06:39:44.825706+0000","last_became_active":"2024-03-04T06:38:12.903226+0000","last_became_peered":"2024-03-04T06:38:12.903226+0000","last_unstale":"2024-03-04T06:39:44.825706+0000","last_undegraded":"2024-03-04T06:39:44.825706+0000","last_fullsized":"2024-03-04T06:39:44.825706+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:49:29.474747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825656+0000","last_change":"2024-03-04T06:38:12.550879+0000","last_active":"2024-03-04T06:39:44.825656+0000","last_peered":"2024-03-04T06:39:44.825656+0000","last_clean":"2024-03-04T06:39:44.825656+0000","last_became_active":"2024-03-04T06:38:12.549931+0000","last_became_peered":"2024-03-04T06:38:12.549931+0000","last_unstale":"2024-03-04T06:39:44.825656+0000","last_undegraded":"2024-03-04T06:39:44.825656+0000","last_fullsized":"2024-03-04T06:39:44.825656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:33.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834364+0000","last_change":"2024-03-04T06:38:12.903875+0000","last_active":"2024-03-04T06:39:44.834364+0000","last_peered":"2024-03-04T06:39:44.834364+0000","last_clean":"2024-03-04T06:39:44.834364+0000","last_became_active":"2024-03-04T06:38:12.903600+0000","last_became_peered":"2024-03-04T06:38:12.903600+0000","last_unstale":"2024-03-04T06:39:44.834364+0000","last_undegraded":"2024-03-04T06:39:44.834364+0000","last_fullsized":"2024-03-04T06:39:44.834364+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:32.774333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826349+0000","last_change":"2024-03-04T06:38:12.551496+0000","last_active":"2024-03-04T06:39:44.826349+0000","last_peered":"2024-03-04T06:39:44.826349+0000","last_clean":"2024-03-04T06:39:44.826349+0000","last_became_active":"2024-03-04T06:38:12.551202+0000","last_became_peered":"2024-03-04T06:38:12.551202+0000","last_unstale":"2024-03-04T06:39:44.826349+0000","last_undegraded":"2024-03-04T06:39:44.826349+0000","last_fullsized":"2024-03-04T06:39:44.826349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:19.526762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830214+0000","last_change":"2024-03-04T06:38:12.911735+0000","last_active":"2024-03-04T06:39:44.830214+0000","last_peered":"2024-03-04T06:39:44.830214+0000","last_clean":"2024-03-04T06:39:44.830214+0000","last_became_active":"2024-03-04T06:38:12.911389+0000","last_became_peered":"2024-03-04T06:38:12.911389+0000","last_unstale":"2024-03-04T06:39:44.830214+0000","last_undegraded":"2024-03-04T06:39:44.830214+0000","last_fullsized":"2024-03-04T06:39:44.830214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:25.284425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"63'9","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834399+0000","last_change":"2024-03-04T06:38:12.546352+0000","last_active":"2024-03-04T06:39:44.834399+0000","last_peered":"2024-03-04T06:39:44.834399+0000","last_clean":"2024-03-04T06:39:44.834399+0000","last_became_active":"2024-03-04T06:38:12.545863+0000","last_became_peered":"2024-03-04T06:38:12.545863+0000","last_unstale":"2024-03-04T06:39:44.834399+0000","last_undegraded":"2024-03-04T06:39:44.834399+0000","last_fullsized":"2024-03-04T06:39:44.834399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:08.181131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2348,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":27,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:46.287331+0000","last_change":"2024-03-04T06:39:46.287331+0000","last_active":"2024-03-04T06:39:46.287331+0000","last_peered":"2024-03-04T06:39:46.287331+0000","last_clean":"2024-03-04T06:39:46.287331+0000","last_became_active":"2024-03-04T06:39:46.286914+0000","last_became_peered":"2024-03-04T06:39:46.286914+0000","last_unstale":"2024-03-04T06:39:46.287331+0000","last_undegraded":"2024-03-04T06:39:46.287331+0000","last_fullsized":"2024-03-04T06:39:46.287331+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:58:41.826266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834537+0000","last_change":"2024-03-04T06:38:12.547028+0000","last_active":"2024-03-04T06:39:44.834537+0000","last_peered":"2024-03-04T06:39:44.834537+0000","last_clean":"2024-03-04T06:39:44.834537+0000","last_became_active":"2024-03-04T06:38:12.546672+0000","last_became_peered":"2024-03-04T06:38:12.546672+0000","last_unstale":"2024-03-04T06:39:44.834537+0000","last_undegraded":"2024-03-04T06:39:44.834537+0000","last_fullsized":"2024-03-04T06:39:44.834537+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:21:00.773241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:46.287294+0000","last_change":"2024-03-04T06:39:46.287294+0000","last_active":"2024-03-04T06:39:46.287294+0000","last_peered":"2024-03-04T06:39:46.287294+0000","last_clean":"2024-03-04T06:39:46.287294+0000","last_became_active":"2024-03-04T06:39:46.286900+0000","last_became_peered":"2024-03-04T06:39:46.286900+0000","last_unstale":"2024-03-04T06:39:46.287294+0000","last_undegraded":"2024-03-04T06:39:46.287294+0000","last_fullsized":"2024-03-04T06:39:46.287294+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:47:17.558117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825121+0000","last_change":"2024-03-04T06:38:12.549608+0000","last_active":"2024-03-04T06:39:44.825121+0000","last_peered":"2024-03-04T06:39:44.825121+0000","last_clean":"2024-03-04T06:39:44.825121+0000","last_became_active":"2024-03-04T06:38:12.549299+0000","last_became_peered":"2024-03-04T06:38:12.549299+0000","last_unstale":"2024-03-04T06:39:44.825121+0000","last_undegraded":"2024-03-04T06:39:44.825121+0000","last_fullsized":"2024-03-04T06:39:44.825121+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:12:23.543702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":27,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:46.287912+0000","last_change":"2024-03-04T06:39:46.287912+0000","last_active":"2024-03-04T06:39:46.287912+0000","last_peered":"2024-03-04T06:39:46.287912+0000","last_clean":"2024-03-04T06:39:46.287912+0000","last_became_active":"2024-03-04T06:39:46.287549+0000","last_became_peered":"2024-03-04T06:39:46.287549+0000","last_unstale":"2024-03-04T06:39:46.287912+0000","last_undegraded":"2024-03-04T06:39:46.287912+0000","last_fullsized":"2024-03-04T06:39:46.287912+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:08:21.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833855+0000","last_change":"2024-03-04T06:38:12.549514+0000","last_active":"2024-03-04T06:39:44.833855+0000","last_peered":"2024-03-04T06:39:44.833855+0000","last_clean":"2024-03-04T06:39:44.833855+0000","last_became_active":"2024-03-04T06:38:12.549222+0000","last_became_peered":"2024-03-04T06:38:12.549222+0000","last_unstale":"2024-03-04T06:39:44.833855+0000","last_undegraded":"2024-03-04T06:39:44.833855+0000","last_fullsized":"2024-03-04T06:39:44.833855+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:54:24.051519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833859+0000","last_change":"2024-03-04T06:38:12.909428+0000","last_active":"2024-03-04T06:39:44.833859+0000","last_peered":"2024-03-04T06:39:44.833859+0000","last_clean":"2024-03-04T06:39:44.833859+0000","last_became_active":"2024-03-04T06:38:12.909146+0000","last_became_peered":"2024-03-04T06:38:12.909146+0000","last_unstale":"2024-03-04T06:39:44.833859+0000","last_undegraded":"2024-03-04T06:39:44.833859+0000","last_fullsized":"2024-03-04T06:39:44.833859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:44.391084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826021+0000","last_change":"2024-03-04T06:38:12.544896+0000","last_active":"2024-03-04T06:39:44.826021+0000","last_peered":"2024-03-04T06:39:44.826021+0000","last_clean":"2024-03-04T06:39:44.826021+0000","last_became_active":"2024-03-04T06:38:12.543579+0000","last_became_peered":"2024-03-04T06:38:12.543579+0000","last_unstale":"2024-03-04T06:39:44.826021+0000","last_undegraded":"2024-03-04T06:39:44.826021+0000","last_fullsized":"2024-03-04T06:39:44.826021+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:39.451118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831230+0000","last_change":"2024-03-04T06:38:12.919018+0000","last_active":"2024-03-04T06:39:44.831230+0000","last_peered":"2024-03-04T06:39:44.831230+0000","last_clean":"2024-03-04T06:39:44.831230+0000","last_became_active":"2024-03-04T06:38:12.918716+0000","last_became_peered":"2024-03-04T06:38:12.918716+0000","last_unstale":"2024-03-04T06:39:44.831230+0000","last_undegraded":"2024-03-04T06:39:44.831230+0000","last_fullsized":"2024-03-04T06:39:44.831230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:06:47.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829929+0000","last_change":"2024-03-04T06:38:12.550559+0000","last_active":"2024-03-04T06:39:44.829929+0000","last_peered":"2024-03-04T06:39:44.829929+0000","last_clean":"2024-03-04T06:39:44.829929+0000","last_became_active":"2024-03-04T06:38:12.547867+0000","last_became_peered":"2024-03-04T06:38:12.547867+0000","last_unstale":"2024-03-04T06:39:44.829929+0000","last_undegraded":"2024-03-04T06:39:44.829929+0000","last_fullsized":"2024-03-04T06:39:44.829929+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:04.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829952+0000","last_change":"2024-03-04T06:38:12.913566+0000","last_active":"2024-03-04T06:39:44.829952+0000","last_peered":"2024-03-04T06:39:44.829952+0000","last_clean":"2024-03-04T06:39:44.829952+0000","last_became_active":"2024-03-04T06:38:12.910660+0000","last_became_peered":"2024-03-04T06:38:12.910660+0000","last_unstale":"2024-03-04T06:39:44.829952+0000","last_undegraded":"2024-03-04T06:39:44.829952+0000","last_fullsized":"2024-03-04T06:39:44.829952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:16:42.862745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825457+0000","last_change":"2024-03-04T06:38:47.376732+0000","last_active":"2024-03-04T06:39:44.825457+0000","last_peered":"2024-03-04T06:39:44.825457+0000","last_clean":"2024-03-04T06:39:44.825457+0000","last_became_active":"2024-03-04T06:38:47.376476+0000","last_became_peered":"2024-03-04T06:38:47.376476+0000","last_unstale":"2024-03-04T06:39:44.825457+0000","last_undegraded":"2024-03-04T06:39:44.825457+0000","last_fullsized":"2024-03-04T06:39:44.825457+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:21:52.679530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825893+0000","last_change":"2024-03-04T06:38:12.554795+0000","last_active":"2024-03-04T06:39:44.825893+0000","last_peered":"2024-03-04T06:39:44.825893+0000","last_clean":"2024-03-04T06:39:44.825893+0000","last_became_active":"2024-03-04T06:38:12.554461+0000","last_became_peered":"2024-03-04T06:38:12.554461+0000","last_unstale":"2024-03-04T06:39:44.825893+0000","last_undegraded":"2024-03-04T06:39:44.825893+0000","last_fullsized":"2024-03-04T06:39:44.825893+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:03:44.989709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825607+0000","last_change":"2024-03-04T06:38:12.897411+0000","last_active":"2024-03-04T06:39:44.825607+0000","last_peered":"2024-03-04T06:39:44.825607+0000","last_clean":"2024-03-04T06:39:44.825607+0000","last_became_active":"2024-03-04T06:38:12.896742+0000","last_became_peered":"2024-03-04T06:38:12.896742+0000","last_unstale":"2024-03-04T06:39:44.825607+0000","last_undegraded":"2024-03-04T06:39:44.825607+0000","last_fullsized":"2024-03-04T06:39:44.825607+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:14:21.032038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825967+0000","last_change":"2024-03-04T06:38:47.318044+0000","last_active":"2024-03-04T06:39:44.825967+0000","last_peered":"2024-03-04T06:39:44.825967+0000","last_clean":"2024-03-04T06:39:44.825967+0000","last_became_active":"2024-03-04T06:38:47.317763+0000","last_became_peered":"2024-03-04T06:38:47.317763+0000","last_unstale":"2024-03-04T06:39:44.825967+0000","last_undegraded":"2024-03-04T06:39:44.825967+0000","last_fullsized":"2024-03-04T06:39:44.825967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:04.059027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825073+0000","last_change":"2024-03-04T06:38:12.548860+0000","last_active":"2024-03-04T06:39:44.825073+0000","last_peered":"2024-03-04T06:39:44.825073+0000","last_clean":"2024-03-04T06:39:44.825073+0000","last_became_active":"2024-03-04T06:38:12.548550+0000","last_became_peered":"2024-03-04T06:38:12.548550+0000","last_unstale":"2024-03-04T06:39:44.825073+0000","last_undegraded":"2024-03-04T06:39:44.825073+0000","last_fullsized":"2024-03-04T06:39:44.825073+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:47:43.188556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830763+0000","last_change":"2024-03-04T06:38:12.908558+0000","last_active":"2024-03-04T06:39:44.830763+0000","last_peered":"2024-03-04T06:39:44.830763+0000","last_clean":"2024-03-04T06:39:44.830763+0000","last_became_active":"2024-03-04T06:38:12.908227+0000","last_became_peered":"2024-03-04T06:38:12.908227+0000","last_unstale":"2024-03-04T06:39:44.830763+0000","last_undegraded":"2024-03-04T06:39:44.830763+0000","last_fullsized":"2024-03-04T06:39:44.830763+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:39:27.394161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826882+0000","last_change":"2024-03-04T06:38:47.376856+0000","last_active":"2024-03-04T06:39:44.826882+0000","last_peered":"2024-03-04T06:39:44.826882+0000","last_clean":"2024-03-04T06:39:44.826882+0000","last_became_active":"2024-03-04T06:38:47.376418+0000","last_became_peered":"2024-03-04T06:38:47.376418+0000","last_unstale":"2024-03-04T06:39:44.826882+0000","last_undegraded":"2024-03-04T06:39:44.826882+0000","last_fullsized":"2024-03-04T06:39:44.826882+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:18:43.241370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825346+0000","last_change":"2024-03-04T06:38:12.914172+0000","last_active":"2024-03-04T06:39:44.825346+0000","last_peered":"2024-03-04T06:39:44.825346+0000","last_clean":"2024-03-04T06:39:44.825346+0000","last_became_active":"2024-03-04T06:38:12.913896+0000","last_became_peered":"2024-03-04T06:38:12.913896+0000","last_unstale":"2024-03-04T06:39:44.825346+0000","last_undegraded":"2024-03-04T06:39:44.825346+0000","last_fullsized":"2024-03-04T06:39:44.825346+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:53.141176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826097+0000","last_change":"2024-03-04T06:38:12.540510+0000","last_active":"2024-03-04T06:39:44.826097+0000","last_peered":"2024-03-04T06:39:44.826097+0000","last_clean":"2024-03-04T06:39:44.826097+0000","last_became_active":"2024-03-04T06:38:12.540155+0000","last_became_peered":"2024-03-04T06:38:12.540155+0000","last_unstale":"2024-03-04T06:39:44.826097+0000","last_undegraded":"2024-03-04T06:39:44.826097+0000","last_fullsized":"2024-03-04T06:39:44.826097+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:39.660282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834384+0000","last_change":"2024-03-04T06:38:47.317126+0000","last_active":"2024-03-04T06:39:44.834384+0000","last_peered":"2024-03-04T06:39:44.834384+0000","last_clean":"2024-03-04T06:39:44.834384+0000","last_became_active":"2024-03-04T06:38:47.316821+0000","last_became_peered":"2024-03-04T06:38:47.316821+0000","last_unstale":"2024-03-04T06:39:44.834384+0000","last_undegraded":"2024-03-04T06:39:44.834384+0000","last_fullsized":"2024-03-04T06:39:44.834384+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:38:44.635838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832483+0000","last_change":"2024-03-04T06:38:12.903488+0000","last_active":"2024-03-04T06:39:44.832483+0000","last_peered":"2024-03-04T06:39:44.832483+0000","last_clean":"2024-03-04T06:39:44.832483+0000","last_became_active":"2024-03-04T06:38:12.903235+0000","last_became_peered":"2024-03-04T06:38:12.903235+0000","last_unstale":"2024-03-04T06:39:44.832483+0000","last_undegraded":"2024-03-04T06:39:44.832483+0000","last_fullsized":"2024-03-04T06:39:44.832483+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:43.099957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825213+0000","last_change":"2024-03-04T06:38:12.550672+0000","last_active":"2024-03-04T06:39:44.825213+0000","last_peered":"2024-03-04T06:39:44.825213+0000","last_clean":"2024-03-04T06:39:44.825213+0000","last_became_active":"2024-03-04T06:38:12.550367+0000","last_became_peered":"2024-03-04T06:38:12.550367+0000","last_unstale":"2024-03-04T06:39:44.825213+0000","last_undegraded":"2024-03-04T06:39:44.825213+0000","last_fullsized":"2024-03-04T06:39:44.825213+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:57:27.060139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"64'128","reported_seq":264,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830190+0000","last_change":"2024-03-04T06:37:58.310255+0000","last_active":"2024-03-04T06:39:44.830190+0000","last_peered":"2024-03-04T06:39:44.830190+0000","last_clean":"2024-03-04T06:39:44.830190+0000","last_became_active":"2024-03-04T06:37:58.309800+0000","last_became_peered":"2024-03-04T06:37:58.309800+0000","last_unstale":"2024-03-04T06:39:44.830190+0000","last_undegraded":"2024-03-04T06:39:44.830190+0000","last_fullsized":"2024-03-04T06:39:44.830190+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:38.185918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833479+0000","last_change":"2024-03-04T06:38:47.321870+0000","last_active":"2024-03-04T06:39:44.833479+0000","last_peered":"2024-03-04T06:39:44.833479+0000","last_clean":"2024-03-04T06:39:44.833479+0000","last_became_active":"2024-03-04T06:38:47.321560+0000","last_became_peered":"2024-03-04T06:38:47.321560+0000","last_unstale":"2024-03-04T06:39:44.833479+0000","last_undegraded":"2024-03-04T06:39:44.833479+0000","last_fullsized":"2024-03-04T06:39:44.833479+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:40:27.719672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:46.422207+0000","last_change":"2024-03-04T06:39:46.422207+0000","last_active":"2024-03-04T06:39:46.422207+0000","last_peered":"2024-03-04T06:39:46.422207+0000","last_clean":"2024-03-04T06:39:46.422207+0000","last_became_active":"2024-03-04T06:39:46.421792+0000","last_became_peered":"2024-03-04T06:39:46.421792+0000","last_unstale":"2024-03-04T06:39:46.422207+0000","last_undegraded":"2024-03-04T06:39:46.422207+0000","last_fullsized":"2024-03-04T06:39:46.422207+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:08.818871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829032+0000","last_change":"2024-03-04T06:38:12.556986+0000","last_active":"2024-03-04T06:39:44.829032+0000","last_peered":"2024-03-04T06:39:44.829032+0000","last_clean":"2024-03-04T06:39:44.829032+0000","last_became_active":"2024-03-04T06:38:12.556594+0000","last_became_peered":"2024-03-04T06:38:12.556594+0000","last_unstale":"2024-03-04T06:39:44.829032+0000","last_undegraded":"2024-03-04T06:39:44.829032+0000","last_fullsized":"2024-03-04T06:39:44.829032+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:52.669745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834213+0000","last_change":"2024-03-04T06:38:47.376856+0000","last_active":"2024-03-04T06:39:44.834213+0000","last_peered":"2024-03-04T06:39:44.834213+0000","last_clean":"2024-03-04T06:39:44.834213+0000","last_became_active":"2024-03-04T06:38:47.376532+0000","last_became_peered":"2024-03-04T06:38:47.376532+0000","last_unstale":"2024-03-04T06:39:44.834213+0000","last_undegraded":"2024-03-04T06:39:44.834213+0000","last_fullsized":"2024-03-04T06:39:44.834213+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:21.206296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829433+0000","last_change":"2024-03-04T06:38:12.557967+0000","last_active":"2024-03-04T06:39:44.829433+0000","last_peered":"2024-03-04T06:39:44.829433+0000","last_clean":"2024-03-04T06:39:44.829433+0000","last_became_active":"2024-03-04T06:38:12.557397+0000","last_became_peered":"2024-03-04T06:38:12.557397+0000","last_unstale":"2024-03-04T06:39:44.829433+0000","last_undegraded":"2024-03-04T06:39:44.829433+0000","last_fullsized":"2024-03-04T06:39:44.829433+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.366465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826044+0000","last_change":"2024-03-04T06:38:12.905517+0000","last_active":"2024-03-04T06:39:44.826044+0000","last_peered":"2024-03-04T06:39:44.826044+0000","last_clean":"2024-03-04T06:39:44.826044+0000","last_became_active":"2024-03-04T06:38:12.905234+0000","last_became_peered":"2024-03-04T06:38:12.905234+0000","last_unstale":"2024-03-04T06:39:44.826044+0000","last_undegraded":"2024-03-04T06:39:44.826044+0000","last_fullsized":"2024-03-04T06:39:44.826044+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:32:58.487468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832046+0000","last_change":"2024-03-04T06:38:47.316978+0000","last_active":"2024-03-04T06:39:44.832046+0000","last_peered":"2024-03-04T06:39:44.832046+0000","last_clean":"2024-03-04T06:39:44.832046+0000","last_became_active":"2024-03-04T06:38:47.316666+0000","last_became_peered":"2024-03-04T06:38:47.316666+0000","last_unstale":"2024-03-04T06:39:44.832046+0000","last_undegraded":"2024-03-04T06:39:44.832046+0000","last_fullsized":"2024-03-04T06:39:44.832046+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:22.840327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826725+0000","last_change":"2024-03-04T06:38:12.542943+0000","last_active":"2024-03-04T06:39:44.826725+0000","last_peered":"2024-03-04T06:39:44.826725+0000","last_clean":"2024-03-04T06:39:44.826725+0000","last_became_active":"2024-03-04T06:38:12.542663+0000","last_became_peered":"2024-03-04T06:38:12.542663+0000","last_unstale":"2024-03-04T06:39:44.826725+0000","last_undegraded":"2024-03-04T06:39:44.826725+0000","last_fullsized":"2024-03-04T06:39:44.826725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:11.583290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833254+0000","last_change":"2024-03-04T06:38:12.898034+0000","last_active":"2024-03-04T06:39:44.833254+0000","last_peered":"2024-03-04T06:39:44.833254+0000","last_clean":"2024-03-04T06:39:44.833254+0000","last_became_active":"2024-03-04T06:38:12.897766+0000","last_became_peered":"2024-03-04T06:38:12.897766+0000","last_unstale":"2024-03-04T06:39:44.833254+0000","last_undegraded":"2024-03-04T06:39:44.833254+0000","last_fullsized":"2024-03-04T06:39:44.833254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:56.085588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.828879+0000","last_change":"2024-03-04T06:38:47.376747+0000","last_active":"2024-03-04T06:39:44.828879+0000","last_peered":"2024-03-04T06:39:44.828879+0000","last_clean":"2024-03-04T06:39:44.828879+0000","last_became_active":"2024-03-04T06:38:47.376407+0000","last_became_peered":"2024-03-04T06:38:47.376407+0000","last_unstale":"2024-03-04T06:39:44.828879+0000","last_undegraded":"2024-03-04T06:39:44.828879+0000","last_fullsized":"2024-03-04T06:39:44.828879+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:44.463155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834701+0000","last_change":"2024-03-04T06:38:12.554846+0000","last_active":"2024-03-04T06:39:44.834701+0000","last_peered":"2024-03-04T06:39:44.834701+0000","last_clean":"2024-03-04T06:39:44.834701+0000","last_became_active":"2024-03-04T06:38:12.554544+0000","last_became_peered":"2024-03-04T06:38:12.554544+0000","last_unstale":"2024-03-04T06:39:44.834701+0000","last_undegraded":"2024-03-04T06:39:44.834701+0000","last_fullsized":"2024-03-04T06:39:44.834701+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:44.524183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833734+0000","last_change":"2024-03-04T06:38:12.903163+0000","last_active":"2024-03-04T06:39:44.833734+0000","last_peered":"2024-03-04T06:39:44.833734+0000","last_clean":"2024-03-04T06:39:44.833734+0000","last_became_active":"2024-03-04T06:38:12.902896+0000","last_became_peered":"2024-03-04T06:38:12.902896+0000","last_unstale":"2024-03-04T06:39:44.833734+0000","last_undegraded":"2024-03-04T06:39:44.833734+0000","last_fullsized":"2024-03-04T06:39:44.833734+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:45:59.166463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829163+0000","last_change":"2024-03-04T06:38:12.556654+0000","last_active":"2024-03-04T06:39:44.829163+0000","last_peered":"2024-03-04T06:39:44.829163+0000","last_clean":"2024-03-04T06:39:44.829163+0000","last_became_active":"2024-03-04T06:38:12.556014+0000","last_became_peered":"2024-03-04T06:38:12.556014+0000","last_unstale":"2024-03-04T06:39:44.829163+0000","last_undegraded":"2024-03-04T06:39:44.829163+0000","last_fullsized":"2024-03-04T06:39:44.829163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:45.975559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829223+0000","last_change":"2024-03-04T06:38:12.906674+0000","last_active":"2024-03-04T06:39:44.829223+0000","last_peered":"2024-03-04T06:39:44.829223+0000","last_clean":"2024-03-04T06:39:44.829223+0000","last_became_active":"2024-03-04T06:38:12.906385+0000","last_became_peered":"2024-03-04T06:38:12.906385+0000","last_unstale":"2024-03-04T06:39:44.829223+0000","last_undegraded":"2024-03-04T06:39:44.829223+0000","last_fullsized":"2024-03-04T06:39:44.829223+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:29:56.436800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825787+0000","last_change":"2024-03-04T06:38:12.555463+0000","last_active":"2024-03-04T06:39:44.825787+0000","last_peered":"2024-03-04T06:39:44.825787+0000","last_clean":"2024-03-04T06:39:44.825787+0000","last_became_active":"2024-03-04T06:38:12.555150+0000","last_became_peered":"2024-03-04T06:38:12.555150+0000","last_unstale":"2024-03-04T06:39:44.825787+0000","last_undegraded":"2024-03-04T06:39:44.825787+0000","last_fullsized":"2024-03-04T06:39:44.825787+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:30.714863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832142+0000","last_change":"2024-03-04T06:38:12.897860+0000","last_active":"2024-03-04T06:39:44.832142+0000","last_peered":"2024-03-04T06:39:44.832142+0000","last_clean":"2024-03-04T06:39:44.832142+0000","last_became_active":"2024-03-04T06:38:12.897568+0000","last_became_peered":"2024-03-04T06:38:12.897568+0000","last_unstale":"2024-03-04T06:39:44.832142+0000","last_undegraded":"2024-03-04T06:39:44.832142+0000","last_fullsized":"2024-03-04T06:39:44.832142+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:22:30.116519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825765+0000","last_change":"2024-03-04T06:38:12.556223+0000","last_active":"2024-03-04T06:39:44.825765+0000","last_peered":"2024-03-04T06:39:44.825765+0000","last_clean":"2024-03-04T06:39:44.825765+0000","last_became_active":"2024-03-04T06:38:12.555948+0000","last_became_peered":"2024-03-04T06:38:12.555948+0000","last_unstale":"2024-03-04T06:39:44.825765+0000","last_undegraded":"2024-03-04T06:39:44.825765+0000","last_fullsized":"2024-03-04T06:39:44.825765+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:19:51.659542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832874+0000","last_change":"2024-03-04T06:38:12.908686+0000","last_active":"2024-03-04T06:39:44.832874+0000","last_peered":"2024-03-04T06:39:44.832874+0000","last_clean":"2024-03-04T06:39:44.832874+0000","last_became_active":"2024-03-04T06:38:12.907114+0000","last_became_peered":"2024-03-04T06:38:12.907114+0000","last_unstale":"2024-03-04T06:39:44.832874+0000","last_undegraded":"2024-03-04T06:39:44.832874+0000","last_fullsized":"2024-03-04T06:39:44.832874+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:08:03.009115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831276+0000","last_change":"2024-03-04T06:38:12.558399+0000","last_active":"2024-03-04T06:39:44.831276+0000","last_peered":"2024-03-04T06:39:44.831276+0000","last_clean":"2024-03-04T06:39:44.831276+0000","last_became_active":"2024-03-04T06:38:12.558068+0000","last_became_peered":"2024-03-04T06:38:12.558068+0000","last_unstale":"2024-03-04T06:39:44.831276+0000","last_undegraded":"2024-03-04T06:39:44.831276+0000","last_fullsized":"2024-03-04T06:39:44.831276+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:00.895079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834188+0000","last_change":"2024-03-04T06:38:12.904212+0000","last_active":"2024-03-04T06:39:44.834188+0000","last_peered":"2024-03-04T06:39:44.834188+0000","last_clean":"2024-03-04T06:39:44.834188+0000","last_became_active":"2024-03-04T06:38:12.903906+0000","last_became_peered":"2024-03-04T06:38:12.903906+0000","last_unstale":"2024-03-04T06:39:44.834188+0000","last_undegraded":"2024-03-04T06:39:44.834188+0000","last_fullsized":"2024-03-04T06:39:44.834188+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:27:10.766546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826396+0000","last_change":"2024-03-04T06:38:12.548200+0000","last_active":"2024-03-04T06:39:44.826396+0000","last_peered":"2024-03-04T06:39:44.826396+0000","last_clean":"2024-03-04T06:39:44.826396+0000","last_became_active":"2024-03-04T06:38:12.547906+0000","last_became_peered":"2024-03-04T06:38:12.547906+0000","last_unstale":"2024-03-04T06:39:44.826396+0000","last_undegraded":"2024-03-04T06:39:44.826396+0000","last_fullsized":"2024-03-04T06:39:44.826396+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:11:39.491360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829355+0000","last_change":"2024-03-04T06:38:12.918955+0000","last_active":"2024-03-04T06:39:44.829355+0000","last_peered":"2024-03-04T06:39:44.829355+0000","last_clean":"2024-03-04T06:39:44.829355+0000","last_became_active":"2024-03-04T06:38:12.918684+0000","last_became_peered":"2024-03-04T06:38:12.918684+0000","last_unstale":"2024-03-04T06:39:44.829355+0000","last_undegraded":"2024-03-04T06:39:44.829355+0000","last_fullsized":"2024-03-04T06:39:44.829355+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:47:29.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826269+0000","last_change":"2024-03-04T06:38:12.547660+0000","last_active":"2024-03-04T06:39:44.826269+0000","last_peered":"2024-03-04T06:39:44.826269+0000","last_clean":"2024-03-04T06:39:44.826269+0000","last_became_active":"2024-03-04T06:38:12.547358+0000","last_became_peered":"2024-03-04T06:38:12.547358+0000","last_unstale":"2024-03-04T06:39:44.826269+0000","last_undegraded":"2024-03-04T06:39:44.826269+0000","last_fullsized":"2024-03-04T06:39:44.826269+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:10.370020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825389+0000","last_change":"2024-03-04T06:38:12.902066+0000","last_active":"2024-03-04T06:39:44.825389+0000","last_peered":"2024-03-04T06:39:44.825389+0000","last_clean":"2024-03-04T06:39:44.825389+0000","last_became_active":"2024-03-04T06:38:12.901331+0000","last_became_peered":"2024-03-04T06:38:12.901331+0000","last_unstale":"2024-03-04T06:39:44.825389+0000","last_undegraded":"2024-03-04T06:39:44.825389+0000","last_fullsized":"2024-03-04T06:39:44.825389+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:46:51.413734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826848+0000","last_change":"2024-03-04T06:38:12.547376+0000","last_active":"2024-03-04T06:39:44.826848+0000","last_peered":"2024-03-04T06:39:44.826848+0000","last_clean":"2024-03-04T06:39:44.826848+0000","last_became_active":"2024-03-04T06:38:12.547108+0000","last_became_peered":"2024-03-04T06:38:12.547108+0000","last_unstale":"2024-03-04T06:39:44.826848+0000","last_undegraded":"2024-03-04T06:39:44.826848+0000","last_fullsized":"2024-03-04T06:39:44.826848+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:34:14.300865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830796+0000","last_change":"2024-03-04T06:38:12.917263+0000","last_active":"2024-03-04T06:39:44.830796+0000","last_peered":"2024-03-04T06:39:44.830796+0000","last_clean":"2024-03-04T06:39:44.830796+0000","last_became_active":"2024-03-04T06:38:12.917001+0000","last_became_peered":"2024-03-04T06:38:12.917001+0000","last_unstale":"2024-03-04T06:39:44.830796+0000","last_undegraded":"2024-03-04T06:39:44.830796+0000","last_fullsized":"2024-03-04T06:39:44.830796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:54.912481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833760+0000","last_change":"2024-03-04T06:38:12.916968+0000","last_active":"2024-03-04T06:39:44.833760+0000","last_peered":"2024-03-04T06:39:44.833760+0000","last_clean":"2024-03-04T06:39:44.833760+0000","last_became_active":"2024-03-04T06:38:12.916669+0000","last_became_peered":"2024-03-04T06:38:12.916669+0000","last_unstale":"2024-03-04T06:39:44.833760+0000","last_undegraded":"2024-03-04T06:39:44.833760+0000","last_fullsized":"2024-03-04T06:39:44.833760+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:18:16.919063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826181+0000","last_change":"2024-03-04T06:38:12.892619+0000","last_active":"2024-03-04T06:39:44.826181+0000","last_peered":"2024-03-04T06:39:44.826181+0000","last_clean":"2024-03-04T06:39:44.826181+0000","last_became_active":"2024-03-04T06:38:12.892261+0000","last_became_peered":"2024-03-04T06:38:12.892261+0000","last_unstale":"2024-03-04T06:39:44.826181+0000","last_undegraded":"2024-03-04T06:39:44.826181+0000","last_fullsized":"2024-03-04T06:39:44.826181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:19:13.957414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825192+0000","last_change":"2024-03-04T06:38:12.899301+0000","last_active":"2024-03-04T06:39:44.825192+0000","last_peered":"2024-03-04T06:39:44.825192+0000","last_clean":"2024-03-04T06:39:44.825192+0000","last_became_active":"2024-03-04T06:38:12.898002+0000","last_became_peered":"2024-03-04T06:38:12.898002+0000","last_unstale":"2024-03-04T06:39:44.825192+0000","last_undegraded":"2024-03-04T06:39:44.825192+0000","last_fullsized":"2024-03-04T06:39:44.825192+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:46.969732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834361+0000","last_change":"2024-03-04T06:38:12.908610+0000","last_active":"2024-03-04T06:39:44.834361+0000","last_peered":"2024-03-04T06:39:44.834361+0000","last_clean":"2024-03-04T06:39:44.834361+0000","last_became_active":"2024-03-04T06:38:12.907578+0000","last_became_peered":"2024-03-04T06:38:12.907578+0000","last_unstale":"2024-03-04T06:39:44.834361+0000","last_undegraded":"2024-03-04T06:39:44.834361+0000","last_fullsized":"2024-03-04T06:39:44.834361+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:52.078874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833071+0000","last_change":"2024-03-04T06:38:12.906536+0000","last_active":"2024-03-04T06:39:44.833071+0000","last_peered":"2024-03-04T06:39:44.833071+0000","last_clean":"2024-03-04T06:39:44.833071+0000","last_became_active":"2024-03-04T06:38:12.906183+0000","last_became_peered":"2024-03-04T06:38:12.906183+0000","last_unstale":"2024-03-04T06:39:44.833071+0000","last_undegraded":"2024-03-04T06:39:44.833071+0000","last_fullsized":"2024-03-04T06:39:44.833071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:15:13.559021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826187+0000","last_change":"2024-03-04T06:38:12.899871+0000","last_active":"2024-03-04T06:39:44.826187+0000","last_peered":"2024-03-04T06:39:44.826187+0000","last_clean":"2024-03-04T06:39:44.826187+0000","last_became_active":"2024-03-04T06:38:12.899583+0000","last_became_peered":"2024-03-04T06:38:12.899583+0000","last_unstale":"2024-03-04T06:39:44.826187+0000","last_undegraded":"2024-03-04T06:39:44.826187+0000","last_fullsized":"2024-03-04T06:39:44.826187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:51.628806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834765+0000","last_change":"2024-03-04T06:38:12.914660+0000","last_active":"2024-03-04T06:39:44.834765+0000","last_peered":"2024-03-04T06:39:44.834765+0000","last_clean":"2024-03-04T06:39:44.834765+0000","last_became_active":"2024-03-04T06:38:12.914354+0000","last_became_peered":"2024-03-04T06:38:12.914354+0000","last_unstale":"2024-03-04T06:39:44.834765+0000","last_undegraded":"2024-03-04T06:39:44.834765+0000","last_fullsized":"2024-03-04T06:39:44.834765+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:28.750455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833335+0000","last_change":"2024-03-04T06:38:12.906752+0000","last_active":"2024-03-04T06:39:44.833335+0000","last_peered":"2024-03-04T06:39:44.833335+0000","last_clean":"2024-03-04T06:39:44.833335+0000","last_became_active":"2024-03-04T06:38:12.906492+0000","last_became_peered":"2024-03-04T06:38:12.906492+0000","last_unstale":"2024-03-04T06:39:44.833335+0000","last_undegraded":"2024-03-04T06:39:44.833335+0000","last_fullsized":"2024-03-04T06:39:44.833335+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:24.841196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825148+0000","last_change":"2024-03-04T06:38:12.897151+0000","last_active":"2024-03-04T06:39:44.825148+0000","last_peered":"2024-03-04T06:39:44.825148+0000","last_clean":"2024-03-04T06:39:44.825148+0000","last_became_active":"2024-03-04T06:38:12.896787+0000","last_became_peered":"2024-03-04T06:38:12.896787+0000","last_unstale":"2024-03-04T06:39:44.825148+0000","last_undegraded":"2024-03-04T06:39:44.825148+0000","last_fullsized":"2024-03-04T06:39:44.825148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:12:22.562737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832707+0000","last_change":"2024-03-04T06:38:12.908348+0000","last_active":"2024-03-04T06:39:44.832707+0000","last_peered":"2024-03-04T06:39:44.832707+0000","last_clean":"2024-03-04T06:39:44.832707+0000","last_became_active":"2024-03-04T06:38:12.908021+0000","last_became_peered":"2024-03-04T06:38:12.908021+0000","last_unstale":"2024-03-04T06:39:44.832707+0000","last_undegraded":"2024-03-04T06:39:44.832707+0000","last_fullsized":"2024-03-04T06:39:44.832707+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:16:36.050910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825276+0000","last_change":"2024-03-04T06:38:12.898994+0000","last_active":"2024-03-04T06:39:44.825276+0000","last_peered":"2024-03-04T06:39:44.825276+0000","last_clean":"2024-03-04T06:39:44.825276+0000","last_became_active":"2024-03-04T06:38:12.898693+0000","last_became_peered":"2024-03-04T06:38:12.898693+0000","last_unstale":"2024-03-04T06:39:44.825276+0000","last_undegraded":"2024-03-04T06:39:44.825276+0000","last_fullsized":"2024-03-04T06:39:44.825276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:40:01.173992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834403+0000","last_change":"2024-03-04T06:38:12.898036+0000","last_active":"2024-03-04T06:39:44.834403+0000","last_peered":"2024-03-04T06:39:44.834403+0000","last_clean":"2024-03-04T06:39:44.834403+0000","last_became_active":"2024-03-04T06:38:12.897717+0000","last_became_peered":"2024-03-04T06:38:12.897717+0000","last_unstale":"2024-03-04T06:39:44.834403+0000","last_undegraded":"2024-03-04T06:39:44.834403+0000","last_fullsized":"2024-03-04T06:39:44.834403+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:58:02.821482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834420+0000","last_change":"2024-03-04T06:38:12.915624+0000","last_active":"2024-03-04T06:39:44.834420+0000","last_peered":"2024-03-04T06:39:44.834420+0000","last_clean":"2024-03-04T06:39:44.834420+0000","last_became_active":"2024-03-04T06:38:12.915335+0000","last_became_peered":"2024-03-04T06:38:12.915335+0000","last_unstale":"2024-03-04T06:39:44.834420+0000","last_undegraded":"2024-03-04T06:39:44.834420+0000","last_fullsized":"2024-03-04T06:39:44.834420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:52:58.038264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3146,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234010,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28300,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716852,"statfs":{"total":95995035648,"available":95966056448,"internally_reserved":0,"allocated":1306624,"data_stored":900209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.314},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.42399999999999999}]},{"osd":1,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.39100000000000001}]},{"osd":2,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.39900000000000002}]},{"osd":3,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.443},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.28399999999999997}]},{"osd":4,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.40899999999999997}]},{"osd":5,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.37}]},{"osd":6,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.46800000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495647,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28308,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716844,"statfs":{"total":95995035648,"available":95966048256,"internally_reserved":0,"allocated":1314816,"data_stored":902284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.495,"15min":0.496},"min":{"1min":0.36899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.59899999999999998}]},{"osd":1,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68999999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56599999999999995}]},{"osd":2,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.753,"15min":0.753},"last":0.61199999999999999}]},{"osd":3,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64700000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.57899999999999996}]},{"osd":4,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.441,"15min":0.435},"min":{"1min":0.34399999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.38300000000000001}]},{"osd":5,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.432,"15min":0.42199999999999999},"min":{"1min":0.35099999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.46200000000000002,"15min":0.45400000000000001},"min":{"1min":0.371,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.35999999999999999}]},{"osd":7,"last update":"Mon Mar 4 06:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.375},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.40999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717432,"statfs":{"total":95995035648,"available":95966650368,"internally_reserved":0,"allocated":716800,"data_stored":309728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.32000000000000001},"min":{"1min":0.23300000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.33800000000000002},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.32700000000000001}]},{"osd":2,"last update":"Mon Mar 4 06:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.36499999999999999},"min":{"1min":0.25800000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.55100000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.29899999999999999}]},{"osd":3,"last update":"Mon Mar 4 06:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.434,"15min":0.433},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.34300000000000003}]},{"osd":4,"last update":"Mon Mar 4 06:39:48 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76600000000000001,"5min":0.87,"15min":0.87},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78000000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.747,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81799999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.51800000000000002}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76400000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83299999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52900000000000003}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.5}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28308,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716844,"statfs":{"total":95995035648,"available":95966048256,"internally_reserved":0,"allocated":1318912,"data_stored":900664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 4 06:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38200000000000001,"15min":0.36599999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.24099999999999999}]},{"osd":2,"last update":"Mon Mar 4 06:38:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64600000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.28799999999999998}]},{"osd":3,"last update":"Mon Mar 4 06:39:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28899999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.32000000000000001}]},{"osd":4,"last update":"Mon Mar 4 06:39:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.69699999999999995,"5min":0.877,"15min":0.877},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69999999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.504}]},{"osd":5,"last update":"Mon Mar 4 06:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.80400000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.70099999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72899999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":1.2629999999999999,"15min":1.3759999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84599999999999997,"5min":11.987,"15min":11.987},"last":0.56299999999999994}]},{"osd":7,"last update":"Mon Mar 4 06:38:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53200000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411378,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717440,"statfs":{"total":95995035648,"available":95966658560,"internally_reserved":0,"allocated":708608,"data_stored":309568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.32400000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.376,"15min":0.36399999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.39800000000000002}]},{"osd":1,"last update":"Mon Mar 4 06:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.5,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.378},{"interface":"front","average":{"1min":0.375,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.56499999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.308}]},{"osd":3,"last update":"Mon Mar 4 06:39:23 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60099999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.36299999999999999}]},{"osd":4,"last update":"Mon Mar 4 06:39:44 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.436}]},{"osd":5,"last update":"Mon Mar 4 06:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61899999999999999,"15min":0.62},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84699999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Mar 4 06:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.504},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85099999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42499999999999999}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.47499999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182446,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717416,"statfs":{"total":95995035648,"available":95966633984,"internally_reserved":0,"allocated":729088,"data_stored":312020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.38900000000000001,"15min":0.39700000000000002},"min":{"1min":0.25600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.45400000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41499999999999998,"15min":0.42499999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.50700000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.223}]},{"osd":1,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41599999999999998,"15min":0.42399999999999999},"min":{"1min":0.27200000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.53500000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41999999999999998,"15min":0.42399999999999999},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52300000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.29699999999999999}]},{"osd":2,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70199999999999996,"5min":0.749,"15min":0.749},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.438,"15min":0.44800000000000001},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.28599999999999998}]},{"osd":4,"last update":"Mon Mar 4 06:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.68100000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69299999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.42399999999999999}]},{"osd":5,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79200000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77900000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.437}]},{"osd":6,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46500000000000002}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.38500000000000001}]}]},{"osd":4,"up_from":30,"seq":128849018921,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717424,"statfs":{"total":95995035648,"available":95966642176,"internally_reserved":0,"allocated":724992,"data_stored":310276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.40400000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.32300000000000001}]},{"osd":1,"last update":"Mon Mar 4 06:39:49 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64500000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.34000000000000002}]},{"osd":2,"last update":"Mon Mar 4 06:39:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.34999999999999998}]},{"osd":3,"last update":"Mon Mar 4 06:39:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.375},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.39700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.35699999999999998}]},{"osd":5,"last update":"Mon Mar 4 06:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.42199999999999999,"15min":0.40799999999999997},"min":{"1min":0.375,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.40400000000000003}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.45400000000000001,"15min":0.442},"min":{"1min":0.36799999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.42399999999999999}]},{"osd":7,"last update":"Mon Mar 4 06:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.39300000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757284,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27720,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717432,"statfs":{"total":95995035648,"available":95966650368,"internally_reserved":0,"allocated":720896,"data_stored":311675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.625,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42399999999999999}]},{"osd":1,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68899999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64600000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.434}]},{"osd":3,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.78900000000000003,"15min":0.83799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.63700000000000001,"5min":6.6180000000000003,"15min":6.6180000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.39500000000000002}]},{"osd":4,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.27800000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.39500000000000002,"15min":0.38100000000000001},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.33500000000000002}]},{"osd":6,"last update":"Mon Mar 4 06:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.46300000000000002},"min":{"1min":0.33000000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.499},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.32900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.65000000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.371}]},{"osd":7,"last update":"Mon Mar 4 06:38:56 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.38500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:40:00.149 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:59 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:40:00.149 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:39:59 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:00.149 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:59 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:40:00.149 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:39:59 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:59 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:40:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:39:59 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:00 smithi137 ceph-mon[26846]: overall HEALTH_OK 2024-03-04T06:40:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:00 smithi137 ceph-mon[26846]: pgmap v47: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:01.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:00 smithi137 ceph-mon[37364]: overall HEALTH_OK 2024-03-04T06:40:01.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:00 smithi137 ceph-mon[37364]: pgmap v47: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:01.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:00 smithi203 ceph-mon[30756]: overall HEALTH_OK 2024-03-04T06:40:01.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:00 smithi203 ceph-mon[30756]: pgmap v47: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:01.737 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:01 smithi137 systemd[1]: Stopping Ceph alertmanager.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:40:02.043 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[70349]: ts=2024-03-04T06:40:01.736Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-03-04T06:40:02.043 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:01 smithi137 podman[73077]: 2024-03-04 06:40:01.767748184 +0000 UTC m=+0.129624681 container died 821fbb74b39d9701dfd92e3b6811a2c007fe59c130d6baef6137c1f4e9e23e66 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T06:40:02.439 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:40:02.465 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:02 smithi137 podman[73077]: 2024-03-04 06:40:02.237118224 +0000 UTC m=+0.598994772 container cleanup 821fbb74b39d9701dfd92e3b6811a2c007fe59c130d6baef6137c1f4e9e23e66 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T06:40:02.465 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:02 smithi137 bash[73077]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a 2024-03-04T06:40:02.702 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:40:02.793 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:02 smithi137 podman[73091]: 2024-03-04 06:40:02.538383382 +0000 UTC m=+0.768591851 container remove 821fbb74b39d9701dfd92e3b6811a2c007fe59c130d6baef6137c1f4e9e23e66 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T06:40:02.793 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:02 smithi137 podman[73091]: 2024-03-04 06:40:02.630741836 +0000 UTC m=+0.860950314 volume remove 61e9978b5643f1c78207a3da7c51e4859a3bef02cda41b219243cbcd29c5b529 2024-03-04T06:40:03.150 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:02 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@alertmanager.a.service: Deactivated successfully. 2024-03-04T06:40:03.150 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:02 smithi137 systemd[1]: Stopped Ceph alertmanager.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:40:03.150 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:02 smithi137 systemd[1]: Starting Ceph alertmanager.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:40:04.087 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:03 smithi137 ceph-mon[26846]: pgmap v48: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:04.088 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:03 smithi137 ceph-mon[37364]: pgmap v48: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:04.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:03 smithi203 ceph-mon[30756]: pgmap v48: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:04.638 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:40:04.640 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:40:04.682 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:04 smithi137 podman[73308]: 2024-03-04 06:40:04.439206336 +0000 UTC m=+0.021750101 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-03-04T06:40:04.683 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:04 smithi137 podman[73308]: 2024-03-04 06:40:04.541069064 +0000 UTC m=+0.123612829 volume create 2a615738034a7670ed79dc9f9a7713981a9a4fbb5a0cf22551788317ff77a2ce 2024-03-04T06:40:04.683 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:04 smithi137 podman[73308]: 2024-03-04 06:40:04.683246138 +0000 UTC m=+0.265789902 container create 0e16db7824eb443c958b1c9925e3748875e240eae394047864166ab2c0ed2e01 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T06:40:05.506 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:40:05] "GET /metrics HTTP/1.1" 200 33647 "" "Prometheus/2.43.0" 2024-03-04T06:40:05.507 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:05 smithi137 podman[73308]: 2024-03-04 06:40:05.287541271 +0000 UTC m=+0.870085049 container init 0e16db7824eb443c958b1c9925e3748875e240eae394047864166ab2c0ed2e01 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T06:40:05.507 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:05 smithi137 podman[73308]: 2024-03-04 06:40:05.290127658 +0000 UTC m=+0.872671424 container start 0e16db7824eb443c958b1c9925e3748875e240eae394047864166ab2c0ed2e01 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T06:40:05.507 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[73354]: ts=2024-03-04T06:40:05.302Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-03-04T06:40:05.507 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[73354]: ts=2024-03-04T06:40:05.302Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-03-04T06:40:05.507 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[73354]: ts=2024-03-04T06:40:05.303Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.137 port=9094 2024-03-04T06:40:05.507 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[73354]: ts=2024-03-04T06:40:05.304Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-04T06:40:05.507 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[73354]: ts=2024-03-04T06:40:05.327Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-04T06:40:05.507 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[73354]: ts=2024-03-04T06:40:05.328Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-04T06:40:05.507 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[73354]: ts=2024-03-04T06:40:05.330Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-03-04T06:40:05.507 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[73354]: ts=2024-03-04T06:40:05.330Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-03-04T06:40:05.507 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:05 smithi137 bash[73308]: 0e16db7824eb443c958b1c9925e3748875e240eae394047864166ab2c0ed2e01 2024-03-04T06:40:05.507 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:05 smithi137 systemd[1]: Started Ceph alertmanager.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:40:05.887 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-03-04T06:40:02.756040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593514,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":227,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":315,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":223532,"kb_used_data":7364,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":749737684,"statfs":{"total":767960285184,"available":767731388416,"internally_reserved":0,"allocated":7540736,"data_stored":4256424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002471"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830673+0000","last_change":"2024-03-04T06:38:12.919238+0000","last_active":"2024-03-04T06:39:44.830673+0000","last_peered":"2024-03-04T06:39:44.830673+0000","last_clean":"2024-03-04T06:39:44.830673+0000","last_became_active":"2024-03-04T06:38:12.918941+0000","last_became_peered":"2024-03-04T06:38:12.918941+0000","last_unstale":"2024-03-04T06:39:44.830673+0000","last_undegraded":"2024-03-04T06:39:44.830673+0000","last_fullsized":"2024-03-04T06:39:44.830673+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:10:03.122262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826566+0000","last_change":"2024-03-04T06:38:12.914740+0000","last_active":"2024-03-04T06:39:44.826566+0000","last_peered":"2024-03-04T06:39:44.826566+0000","last_clean":"2024-03-04T06:39:44.826566+0000","last_became_active":"2024-03-04T06:38:12.914436+0000","last_became_peered":"2024-03-04T06:38:12.914436+0000","last_unstale":"2024-03-04T06:39:44.826566+0000","last_undegraded":"2024-03-04T06:39:44.826566+0000","last_fullsized":"2024-03-04T06:39:44.826566+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:58.781088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.835674+0000","last_change":"2024-03-04T06:38:12.895666+0000","last_active":"2024-03-04T06:39:44.835674+0000","last_peered":"2024-03-04T06:39:44.835674+0000","last_clean":"2024-03-04T06:39:44.835674+0000","last_became_active":"2024-03-04T06:38:12.895398+0000","last_became_peered":"2024-03-04T06:38:12.895398+0000","last_unstale":"2024-03-04T06:39:44.835674+0000","last_undegraded":"2024-03-04T06:39:44.835674+0000","last_fullsized":"2024-03-04T06:39:44.835674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:10.744216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825411+0000","last_change":"2024-03-04T06:38:12.902256+0000","last_active":"2024-03-04T06:39:44.825411+0000","last_peered":"2024-03-04T06:39:44.825411+0000","last_clean":"2024-03-04T06:39:44.825411+0000","last_became_active":"2024-03-04T06:38:12.901792+0000","last_became_peered":"2024-03-04T06:38:12.901792+0000","last_unstale":"2024-03-04T06:39:44.825411+0000","last_undegraded":"2024-03-04T06:39:44.825411+0000","last_fullsized":"2024-03-04T06:39:44.825411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:45.163241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831292+0000","last_change":"2024-03-04T06:38:12.913797+0000","last_active":"2024-03-04T06:39:44.831292+0000","last_peered":"2024-03-04T06:39:44.831292+0000","last_clean":"2024-03-04T06:39:44.831292+0000","last_became_active":"2024-03-04T06:38:12.913517+0000","last_became_peered":"2024-03-04T06:38:12.913517+0000","last_unstale":"2024-03-04T06:39:44.831292+0000","last_undegraded":"2024-03-04T06:39:44.831292+0000","last_fullsized":"2024-03-04T06:39:44.831292+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:04:24.837813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825374+0000","last_change":"2024-03-04T06:38:12.904787+0000","last_active":"2024-03-04T06:39:44.825374+0000","last_peered":"2024-03-04T06:39:44.825374+0000","last_clean":"2024-03-04T06:39:44.825374+0000","last_became_active":"2024-03-04T06:38:12.904484+0000","last_became_peered":"2024-03-04T06:38:12.904484+0000","last_unstale":"2024-03-04T06:39:44.825374+0000","last_undegraded":"2024-03-04T06:39:44.825374+0000","last_fullsized":"2024-03-04T06:39:44.825374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:03:28.898688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829238+0000","last_change":"2024-03-04T06:38:12.913825+0000","last_active":"2024-03-04T06:39:44.829238+0000","last_peered":"2024-03-04T06:39:44.829238+0000","last_clean":"2024-03-04T06:39:44.829238+0000","last_became_active":"2024-03-04T06:38:12.913553+0000","last_became_peered":"2024-03-04T06:38:12.913553+0000","last_unstale":"2024-03-04T06:39:44.829238+0000","last_undegraded":"2024-03-04T06:39:44.829238+0000","last_fullsized":"2024-03-04T06:39:44.829238+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:23:17.322436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831954+0000","last_change":"2024-03-04T06:38:12.902309+0000","last_active":"2024-03-04T06:39:44.831954+0000","last_peered":"2024-03-04T06:39:44.831954+0000","last_clean":"2024-03-04T06:39:44.831954+0000","last_became_active":"2024-03-04T06:38:12.902009+0000","last_became_peered":"2024-03-04T06:38:12.902009+0000","last_unstale":"2024-03-04T06:39:44.831954+0000","last_undegraded":"2024-03-04T06:39:44.831954+0000","last_fullsized":"2024-03-04T06:39:44.831954+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:36:04.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830956+0000","last_change":"2024-03-04T06:38:12.916933+0000","last_active":"2024-03-04T06:39:44.830956+0000","last_peered":"2024-03-04T06:39:44.830956+0000","last_clean":"2024-03-04T06:39:44.830956+0000","last_became_active":"2024-03-04T06:38:12.913922+0000","last_became_peered":"2024-03-04T06:38:12.913922+0000","last_unstale":"2024-03-04T06:39:44.830956+0000","last_undegraded":"2024-03-04T06:39:44.830956+0000","last_fullsized":"2024-03-04T06:39:44.830956+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:08:21.342061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834690+0000","last_change":"2024-03-04T06:38:12.911185+0000","last_active":"2024-03-04T06:39:44.834690+0000","last_peered":"2024-03-04T06:39:44.834690+0000","last_clean":"2024-03-04T06:39:44.834690+0000","last_became_active":"2024-03-04T06:38:12.910906+0000","last_became_peered":"2024-03-04T06:38:12.910906+0000","last_unstale":"2024-03-04T06:39:44.834690+0000","last_undegraded":"2024-03-04T06:39:44.834690+0000","last_fullsized":"2024-03-04T06:39:44.834690+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:45.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834569+0000","last_change":"2024-03-04T06:38:12.916277+0000","last_active":"2024-03-04T06:39:44.834569+0000","last_peered":"2024-03-04T06:39:44.834569+0000","last_clean":"2024-03-04T06:39:44.834569+0000","last_became_active":"2024-03-04T06:38:12.915998+0000","last_became_peered":"2024-03-04T06:38:12.915998+0000","last_unstale":"2024-03-04T06:39:44.834569+0000","last_undegraded":"2024-03-04T06:39:44.834569+0000","last_fullsized":"2024-03-04T06:39:44.834569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:22:53.166929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830301+0000","last_change":"2024-03-04T06:38:12.907393+0000","last_active":"2024-03-04T06:39:44.830301+0000","last_peered":"2024-03-04T06:39:44.830301+0000","last_clean":"2024-03-04T06:39:44.830301+0000","last_became_active":"2024-03-04T06:38:12.907111+0000","last_became_peered":"2024-03-04T06:38:12.907111+0000","last_unstale":"2024-03-04T06:39:44.830301+0000","last_undegraded":"2024-03-04T06:39:44.830301+0000","last_fullsized":"2024-03-04T06:39:44.830301+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:18.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832736+0000","last_change":"2024-03-04T06:38:12.897003+0000","last_active":"2024-03-04T06:39:44.832736+0000","last_peered":"2024-03-04T06:39:44.832736+0000","last_clean":"2024-03-04T06:39:44.832736+0000","last_became_active":"2024-03-04T06:38:12.896729+0000","last_became_peered":"2024-03-04T06:38:12.896729+0000","last_unstale":"2024-03-04T06:39:44.832736+0000","last_undegraded":"2024-03-04T06:39:44.832736+0000","last_fullsized":"2024-03-04T06:39:44.832736+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:01:03.497642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834893+0000","last_change":"2024-03-04T06:38:12.896652+0000","last_active":"2024-03-04T06:39:44.834893+0000","last_peered":"2024-03-04T06:39:44.834893+0000","last_clean":"2024-03-04T06:39:44.834893+0000","last_became_active":"2024-03-04T06:38:12.896300+0000","last_became_peered":"2024-03-04T06:38:12.896300+0000","last_unstale":"2024-03-04T06:39:44.834893+0000","last_undegraded":"2024-03-04T06:39:44.834893+0000","last_fullsized":"2024-03-04T06:39:44.834893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:32.026507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825545+0000","last_change":"2024-03-04T06:38:12.907997+0000","last_active":"2024-03-04T06:39:44.825545+0000","last_peered":"2024-03-04T06:39:44.825545+0000","last_clean":"2024-03-04T06:39:44.825545+0000","last_became_active":"2024-03-04T06:38:12.907720+0000","last_became_peered":"2024-03-04T06:38:12.907720+0000","last_unstale":"2024-03-04T06:39:44.825545+0000","last_undegraded":"2024-03-04T06:39:44.825545+0000","last_fullsized":"2024-03-04T06:39:44.825545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:46:55.140847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825032+0000","last_change":"2024-03-04T06:38:12.899219+0000","last_active":"2024-03-04T06:39:44.825032+0000","last_peered":"2024-03-04T06:39:44.825032+0000","last_clean":"2024-03-04T06:39:44.825032+0000","last_became_active":"2024-03-04T06:38:12.898928+0000","last_became_peered":"2024-03-04T06:38:12.898928+0000","last_unstale":"2024-03-04T06:39:44.825032+0000","last_undegraded":"2024-03-04T06:39:44.825032+0000","last_fullsized":"2024-03-04T06:39:44.825032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:13.412822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825758+0000","last_change":"2024-03-04T06:38:12.908332+0000","last_active":"2024-03-04T06:39:44.825758+0000","last_peered":"2024-03-04T06:39:44.825758+0000","last_clean":"2024-03-04T06:39:44.825758+0000","last_became_active":"2024-03-04T06:38:12.908038+0000","last_became_peered":"2024-03-04T06:38:12.908038+0000","last_unstale":"2024-03-04T06:39:44.825758+0000","last_undegraded":"2024-03-04T06:39:44.825758+0000","last_fullsized":"2024-03-04T06:39:44.825758+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:05:49.146138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826759+0000","last_change":"2024-03-04T06:38:12.899134+0000","last_active":"2024-03-04T06:39:44.826759+0000","last_peered":"2024-03-04T06:39:44.826759+0000","last_clean":"2024-03-04T06:39:44.826759+0000","last_became_active":"2024-03-04T06:38:12.898801+0000","last_became_peered":"2024-03-04T06:38:12.898801+0000","last_unstale":"2024-03-04T06:39:44.826759+0000","last_undegraded":"2024-03-04T06:39:44.826759+0000","last_fullsized":"2024-03-04T06:39:44.826759+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:21:48.465552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829127+0000","last_change":"2024-03-04T06:38:12.918000+0000","last_active":"2024-03-04T06:39:44.829127+0000","last_peered":"2024-03-04T06:39:44.829127+0000","last_clean":"2024-03-04T06:39:44.829127+0000","last_became_active":"2024-03-04T06:38:12.914159+0000","last_became_peered":"2024-03-04T06:38:12.914159+0000","last_unstale":"2024-03-04T06:39:44.829127+0000","last_undegraded":"2024-03-04T06:39:44.829127+0000","last_fullsized":"2024-03-04T06:39:44.829127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:24.026090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834743+0000","last_change":"2024-03-04T06:38:12.550843+0000","last_active":"2024-03-04T06:39:44.834743+0000","last_peered":"2024-03-04T06:39:44.834743+0000","last_clean":"2024-03-04T06:39:44.834743+0000","last_became_active":"2024-03-04T06:38:12.550141+0000","last_became_peered":"2024-03-04T06:38:12.550141+0000","last_unstale":"2024-03-04T06:39:44.834743+0000","last_undegraded":"2024-03-04T06:39:44.834743+0000","last_fullsized":"2024-03-04T06:39:44.834743+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:01.969570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833097+0000","last_change":"2024-03-04T06:38:12.896389+0000","last_active":"2024-03-04T06:39:44.833097+0000","last_peered":"2024-03-04T06:39:44.833097+0000","last_clean":"2024-03-04T06:39:44.833097+0000","last_became_active":"2024-03-04T06:38:12.896120+0000","last_became_peered":"2024-03-04T06:38:12.896120+0000","last_unstale":"2024-03-04T06:39:44.833097+0000","last_undegraded":"2024-03-04T06:39:44.833097+0000","last_fullsized":"2024-03-04T06:39:44.833097+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:57.729499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833163+0000","last_change":"2024-03-04T06:38:12.550800+0000","last_active":"2024-03-04T06:39:44.833163+0000","last_peered":"2024-03-04T06:39:44.833163+0000","last_clean":"2024-03-04T06:39:44.833163+0000","last_became_active":"2024-03-04T06:38:12.550444+0000","last_became_peered":"2024-03-04T06:38:12.550444+0000","last_unstale":"2024-03-04T06:39:44.833163+0000","last_undegraded":"2024-03-04T06:39:44.833163+0000","last_fullsized":"2024-03-04T06:39:44.833163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:42.209194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834447+0000","last_change":"2024-03-04T06:38:12.903258+0000","last_active":"2024-03-04T06:39:44.834447+0000","last_peered":"2024-03-04T06:39:44.834447+0000","last_clean":"2024-03-04T06:39:44.834447+0000","last_became_active":"2024-03-04T06:38:12.902982+0000","last_became_peered":"2024-03-04T06:38:12.902982+0000","last_unstale":"2024-03-04T06:39:44.834447+0000","last_undegraded":"2024-03-04T06:39:44.834447+0000","last_fullsized":"2024-03-04T06:39:44.834447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:31:23.228035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:45.834266+0000","last_change":"2024-03-04T06:39:45.833985+0000","last_active":"2024-03-04T06:39:45.834266+0000","last_peered":"2024-03-04T06:39:45.834266+0000","last_clean":"2024-03-04T06:39:45.834266+0000","last_became_active":"2024-03-04T06:39:45.831328+0000","last_became_peered":"2024-03-04T06:39:45.831328+0000","last_unstale":"2024-03-04T06:39:45.834266+0000","last_undegraded":"2024-03-04T06:39:45.834266+0000","last_fullsized":"2024-03-04T06:39:45.834266+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:31.095064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:46.422444+0000","last_change":"2024-03-04T06:39:46.422444+0000","last_active":"2024-03-04T06:39:46.422444+0000","last_peered":"2024-03-04T06:39:46.422444+0000","last_clean":"2024-03-04T06:39:46.422444+0000","last_became_active":"2024-03-04T06:39:46.421792+0000","last_became_peered":"2024-03-04T06:39:46.421792+0000","last_unstale":"2024-03-04T06:39:46.422444+0000","last_undegraded":"2024-03-04T06:39:46.422444+0000","last_fullsized":"2024-03-04T06:39:46.422444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:51.404998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830161+0000","last_change":"2024-03-04T06:38:12.556246+0000","last_active":"2024-03-04T06:39:44.830161+0000","last_peered":"2024-03-04T06:39:44.830161+0000","last_clean":"2024-03-04T06:39:44.830161+0000","last_became_active":"2024-03-04T06:38:12.555860+0000","last_became_peered":"2024-03-04T06:38:12.555860+0000","last_unstale":"2024-03-04T06:39:44.830161+0000","last_undegraded":"2024-03-04T06:39:44.830161+0000","last_fullsized":"2024-03-04T06:39:44.830161+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:41.910480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825545+0000","last_change":"2024-03-04T06:38:12.906907+0000","last_active":"2024-03-04T06:39:44.825545+0000","last_peered":"2024-03-04T06:39:44.825545+0000","last_clean":"2024-03-04T06:39:44.825545+0000","last_became_active":"2024-03-04T06:38:12.906615+0000","last_became_peered":"2024-03-04T06:38:12.906615+0000","last_unstale":"2024-03-04T06:39:44.825545+0000","last_undegraded":"2024-03-04T06:39:44.825545+0000","last_fullsized":"2024-03-04T06:39:44.825545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:21:15.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832856+0000","last_change":"2024-03-04T06:38:12.546234+0000","last_active":"2024-03-04T06:39:44.832856+0000","last_peered":"2024-03-04T06:39:44.832856+0000","last_clean":"2024-03-04T06:39:44.832856+0000","last_became_active":"2024-03-04T06:38:12.545975+0000","last_became_peered":"2024-03-04T06:38:12.545975+0000","last_unstale":"2024-03-04T06:39:44.832856+0000","last_undegraded":"2024-03-04T06:39:44.832856+0000","last_fullsized":"2024-03-04T06:39:44.832856+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:04.341190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829725+0000","last_change":"2024-03-04T06:38:12.908256+0000","last_active":"2024-03-04T06:39:44.829725+0000","last_peered":"2024-03-04T06:39:44.829725+0000","last_clean":"2024-03-04T06:39:44.829725+0000","last_became_active":"2024-03-04T06:38:12.907953+0000","last_became_peered":"2024-03-04T06:38:12.907953+0000","last_unstale":"2024-03-04T06:39:44.829725+0000","last_undegraded":"2024-03-04T06:39:44.829725+0000","last_fullsized":"2024-03-04T06:39:44.829725+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:03:03.291025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834226+0000","last_change":"2024-03-04T06:38:12.554332+0000","last_active":"2024-03-04T06:39:44.834226+0000","last_peered":"2024-03-04T06:39:44.834226+0000","last_clean":"2024-03-04T06:39:44.834226+0000","last_became_active":"2024-03-04T06:38:12.554044+0000","last_became_peered":"2024-03-04T06:38:12.554044+0000","last_unstale":"2024-03-04T06:39:44.834226+0000","last_undegraded":"2024-03-04T06:39:44.834226+0000","last_fullsized":"2024-03-04T06:39:44.834226+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:28:40.250342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834286+0000","last_change":"2024-03-04T06:38:12.910445+0000","last_active":"2024-03-04T06:39:44.834286+0000","last_peered":"2024-03-04T06:39:44.834286+0000","last_clean":"2024-03-04T06:39:44.834286+0000","last_became_active":"2024-03-04T06:38:12.909974+0000","last_became_peered":"2024-03-04T06:38:12.909974+0000","last_unstale":"2024-03-04T06:39:44.834286+0000","last_undegraded":"2024-03-04T06:39:44.834286+0000","last_fullsized":"2024-03-04T06:39:44.834286+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:42:52.372021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832853+0000","last_change":"2024-03-04T06:38:12.543180+0000","last_active":"2024-03-04T06:39:44.832853+0000","last_peered":"2024-03-04T06:39:44.832853+0000","last_clean":"2024-03-04T06:39:44.832853+0000","last_became_active":"2024-03-04T06:38:12.542896+0000","last_became_peered":"2024-03-04T06:38:12.542896+0000","last_unstale":"2024-03-04T06:39:44.832853+0000","last_undegraded":"2024-03-04T06:39:44.832853+0000","last_fullsized":"2024-03-04T06:39:44.832853+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:15:09.816539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832220+0000","last_change":"2024-03-04T06:38:12.895735+0000","last_active":"2024-03-04T06:39:44.832220+0000","last_peered":"2024-03-04T06:39:44.832220+0000","last_clean":"2024-03-04T06:39:44.832220+0000","last_became_active":"2024-03-04T06:38:12.895201+0000","last_became_peered":"2024-03-04T06:38:12.895201+0000","last_unstale":"2024-03-04T06:39:44.832220+0000","last_undegraded":"2024-03-04T06:39:44.832220+0000","last_fullsized":"2024-03-04T06:39:44.832220+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:12:35.373175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825037+0000","last_change":"2024-03-04T06:38:12.551089+0000","last_active":"2024-03-04T06:39:44.825037+0000","last_peered":"2024-03-04T06:39:44.825037+0000","last_clean":"2024-03-04T06:39:44.825037+0000","last_became_active":"2024-03-04T06:38:12.550791+0000","last_became_peered":"2024-03-04T06:38:12.550791+0000","last_unstale":"2024-03-04T06:39:44.825037+0000","last_undegraded":"2024-03-04T06:39:44.825037+0000","last_fullsized":"2024-03-04T06:39:44.825037+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:49.576267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825638+0000","last_change":"2024-03-04T06:38:12.909194+0000","last_active":"2024-03-04T06:39:44.825638+0000","last_peered":"2024-03-04T06:39:44.825638+0000","last_clean":"2024-03-04T06:39:44.825638+0000","last_became_active":"2024-03-04T06:38:12.908879+0000","last_became_peered":"2024-03-04T06:38:12.908879+0000","last_unstale":"2024-03-04T06:39:44.825638+0000","last_undegraded":"2024-03-04T06:39:44.825638+0000","last_fullsized":"2024-03-04T06:39:44.825638+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:23.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834767+0000","last_change":"2024-03-04T06:38:12.544023+0000","last_active":"2024-03-04T06:39:44.834767+0000","last_peered":"2024-03-04T06:39:44.834767+0000","last_clean":"2024-03-04T06:39:44.834767+0000","last_became_active":"2024-03-04T06:38:12.543699+0000","last_became_peered":"2024-03-04T06:38:12.543699+0000","last_unstale":"2024-03-04T06:39:44.834767+0000","last_undegraded":"2024-03-04T06:39:44.834767+0000","last_fullsized":"2024-03-04T06:39:44.834767+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:19.418372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825706+0000","last_change":"2024-03-04T06:38:12.903510+0000","last_active":"2024-03-04T06:39:44.825706+0000","last_peered":"2024-03-04T06:39:44.825706+0000","last_clean":"2024-03-04T06:39:44.825706+0000","last_became_active":"2024-03-04T06:38:12.903226+0000","last_became_peered":"2024-03-04T06:38:12.903226+0000","last_unstale":"2024-03-04T06:39:44.825706+0000","last_undegraded":"2024-03-04T06:39:44.825706+0000","last_fullsized":"2024-03-04T06:39:44.825706+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:49:29.474747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825656+0000","last_change":"2024-03-04T06:38:12.550879+0000","last_active":"2024-03-04T06:39:44.825656+0000","last_peered":"2024-03-04T06:39:44.825656+0000","last_clean":"2024-03-04T06:39:44.825656+0000","last_became_active":"2024-03-04T06:38:12.549931+0000","last_became_peered":"2024-03-04T06:38:12.549931+0000","last_unstale":"2024-03-04T06:39:44.825656+0000","last_undegraded":"2024-03-04T06:39:44.825656+0000","last_fullsized":"2024-03-04T06:39:44.825656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:33.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834364+0000","last_change":"2024-03-04T06:38:12.903875+0000","last_active":"2024-03-04T06:39:44.834364+0000","last_peered":"2024-03-04T06:39:44.834364+0000","last_clean":"2024-03-04T06:39:44.834364+0000","last_became_active":"2024-03-04T06:38:12.903600+0000","last_became_peered":"2024-03-04T06:38:12.903600+0000","last_unstale":"2024-03-04T06:39:44.834364+0000","last_undegraded":"2024-03-04T06:39:44.834364+0000","last_fullsized":"2024-03-04T06:39:44.834364+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:32.774333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826349+0000","last_change":"2024-03-04T06:38:12.551496+0000","last_active":"2024-03-04T06:39:44.826349+0000","last_peered":"2024-03-04T06:39:44.826349+0000","last_clean":"2024-03-04T06:39:44.826349+0000","last_became_active":"2024-03-04T06:38:12.551202+0000","last_became_peered":"2024-03-04T06:38:12.551202+0000","last_unstale":"2024-03-04T06:39:44.826349+0000","last_undegraded":"2024-03-04T06:39:44.826349+0000","last_fullsized":"2024-03-04T06:39:44.826349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:19.526762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830214+0000","last_change":"2024-03-04T06:38:12.911735+0000","last_active":"2024-03-04T06:39:44.830214+0000","last_peered":"2024-03-04T06:39:44.830214+0000","last_clean":"2024-03-04T06:39:44.830214+0000","last_became_active":"2024-03-04T06:38:12.911389+0000","last_became_peered":"2024-03-04T06:38:12.911389+0000","last_unstale":"2024-03-04T06:39:44.830214+0000","last_undegraded":"2024-03-04T06:39:44.830214+0000","last_fullsized":"2024-03-04T06:39:44.830214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:25.284425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"63'9","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834399+0000","last_change":"2024-03-04T06:38:12.546352+0000","last_active":"2024-03-04T06:39:44.834399+0000","last_peered":"2024-03-04T06:39:44.834399+0000","last_clean":"2024-03-04T06:39:44.834399+0000","last_became_active":"2024-03-04T06:38:12.545863+0000","last_became_peered":"2024-03-04T06:38:12.545863+0000","last_unstale":"2024-03-04T06:39:44.834399+0000","last_undegraded":"2024-03-04T06:39:44.834399+0000","last_fullsized":"2024-03-04T06:39:44.834399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:08.181131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2348,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":27,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:46.287331+0000","last_change":"2024-03-04T06:39:46.287331+0000","last_active":"2024-03-04T06:39:46.287331+0000","last_peered":"2024-03-04T06:39:46.287331+0000","last_clean":"2024-03-04T06:39:46.287331+0000","last_became_active":"2024-03-04T06:39:46.286914+0000","last_became_peered":"2024-03-04T06:39:46.286914+0000","last_unstale":"2024-03-04T06:39:46.287331+0000","last_undegraded":"2024-03-04T06:39:46.287331+0000","last_fullsized":"2024-03-04T06:39:46.287331+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:58:41.826266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834537+0000","last_change":"2024-03-04T06:38:12.547028+0000","last_active":"2024-03-04T06:39:44.834537+0000","last_peered":"2024-03-04T06:39:44.834537+0000","last_clean":"2024-03-04T06:39:44.834537+0000","last_became_active":"2024-03-04T06:38:12.546672+0000","last_became_peered":"2024-03-04T06:38:12.546672+0000","last_unstale":"2024-03-04T06:39:44.834537+0000","last_undegraded":"2024-03-04T06:39:44.834537+0000","last_fullsized":"2024-03-04T06:39:44.834537+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:21:00.773241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:46.287294+0000","last_change":"2024-03-04T06:39:46.287294+0000","last_active":"2024-03-04T06:39:46.287294+0000","last_peered":"2024-03-04T06:39:46.287294+0000","last_clean":"2024-03-04T06:39:46.287294+0000","last_became_active":"2024-03-04T06:39:46.286900+0000","last_became_peered":"2024-03-04T06:39:46.286900+0000","last_unstale":"2024-03-04T06:39:46.287294+0000","last_undegraded":"2024-03-04T06:39:46.287294+0000","last_fullsized":"2024-03-04T06:39:46.287294+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:47:17.558117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825121+0000","last_change":"2024-03-04T06:38:12.549608+0000","last_active":"2024-03-04T06:39:44.825121+0000","last_peered":"2024-03-04T06:39:44.825121+0000","last_clean":"2024-03-04T06:39:44.825121+0000","last_became_active":"2024-03-04T06:38:12.549299+0000","last_became_peered":"2024-03-04T06:38:12.549299+0000","last_unstale":"2024-03-04T06:39:44.825121+0000","last_undegraded":"2024-03-04T06:39:44.825121+0000","last_fullsized":"2024-03-04T06:39:44.825121+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:12:23.543702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":27,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:46.287912+0000","last_change":"2024-03-04T06:39:46.287912+0000","last_active":"2024-03-04T06:39:46.287912+0000","last_peered":"2024-03-04T06:39:46.287912+0000","last_clean":"2024-03-04T06:39:46.287912+0000","last_became_active":"2024-03-04T06:39:46.287549+0000","last_became_peered":"2024-03-04T06:39:46.287549+0000","last_unstale":"2024-03-04T06:39:46.287912+0000","last_undegraded":"2024-03-04T06:39:46.287912+0000","last_fullsized":"2024-03-04T06:39:46.287912+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:08:21.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833855+0000","last_change":"2024-03-04T06:38:12.549514+0000","last_active":"2024-03-04T06:39:44.833855+0000","last_peered":"2024-03-04T06:39:44.833855+0000","last_clean":"2024-03-04T06:39:44.833855+0000","last_became_active":"2024-03-04T06:38:12.549222+0000","last_became_peered":"2024-03-04T06:38:12.549222+0000","last_unstale":"2024-03-04T06:39:44.833855+0000","last_undegraded":"2024-03-04T06:39:44.833855+0000","last_fullsized":"2024-03-04T06:39:44.833855+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:54:24.051519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833859+0000","last_change":"2024-03-04T06:38:12.909428+0000","last_active":"2024-03-04T06:39:44.833859+0000","last_peered":"2024-03-04T06:39:44.833859+0000","last_clean":"2024-03-04T06:39:44.833859+0000","last_became_active":"2024-03-04T06:38:12.909146+0000","last_became_peered":"2024-03-04T06:38:12.909146+0000","last_unstale":"2024-03-04T06:39:44.833859+0000","last_undegraded":"2024-03-04T06:39:44.833859+0000","last_fullsized":"2024-03-04T06:39:44.833859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:44.391084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826021+0000","last_change":"2024-03-04T06:38:12.544896+0000","last_active":"2024-03-04T06:39:44.826021+0000","last_peered":"2024-03-04T06:39:44.826021+0000","last_clean":"2024-03-04T06:39:44.826021+0000","last_became_active":"2024-03-04T06:38:12.543579+0000","last_became_peered":"2024-03-04T06:38:12.543579+0000","last_unstale":"2024-03-04T06:39:44.826021+0000","last_undegraded":"2024-03-04T06:39:44.826021+0000","last_fullsized":"2024-03-04T06:39:44.826021+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:39.451118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831230+0000","last_change":"2024-03-04T06:38:12.919018+0000","last_active":"2024-03-04T06:39:44.831230+0000","last_peered":"2024-03-04T06:39:44.831230+0000","last_clean":"2024-03-04T06:39:44.831230+0000","last_became_active":"2024-03-04T06:38:12.918716+0000","last_became_peered":"2024-03-04T06:38:12.918716+0000","last_unstale":"2024-03-04T06:39:44.831230+0000","last_undegraded":"2024-03-04T06:39:44.831230+0000","last_fullsized":"2024-03-04T06:39:44.831230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:06:47.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829929+0000","last_change":"2024-03-04T06:38:12.550559+0000","last_active":"2024-03-04T06:39:44.829929+0000","last_peered":"2024-03-04T06:39:44.829929+0000","last_clean":"2024-03-04T06:39:44.829929+0000","last_became_active":"2024-03-04T06:38:12.547867+0000","last_became_peered":"2024-03-04T06:38:12.547867+0000","last_unstale":"2024-03-04T06:39:44.829929+0000","last_undegraded":"2024-03-04T06:39:44.829929+0000","last_fullsized":"2024-03-04T06:39:44.829929+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:04.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829952+0000","last_change":"2024-03-04T06:38:12.913566+0000","last_active":"2024-03-04T06:39:44.829952+0000","last_peered":"2024-03-04T06:39:44.829952+0000","last_clean":"2024-03-04T06:39:44.829952+0000","last_became_active":"2024-03-04T06:38:12.910660+0000","last_became_peered":"2024-03-04T06:38:12.910660+0000","last_unstale":"2024-03-04T06:39:44.829952+0000","last_undegraded":"2024-03-04T06:39:44.829952+0000","last_fullsized":"2024-03-04T06:39:44.829952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:16:42.862745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825457+0000","last_change":"2024-03-04T06:38:47.376732+0000","last_active":"2024-03-04T06:39:44.825457+0000","last_peered":"2024-03-04T06:39:44.825457+0000","last_clean":"2024-03-04T06:39:44.825457+0000","last_became_active":"2024-03-04T06:38:47.376476+0000","last_became_peered":"2024-03-04T06:38:47.376476+0000","last_unstale":"2024-03-04T06:39:44.825457+0000","last_undegraded":"2024-03-04T06:39:44.825457+0000","last_fullsized":"2024-03-04T06:39:44.825457+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:21:52.679530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825893+0000","last_change":"2024-03-04T06:38:12.554795+0000","last_active":"2024-03-04T06:39:44.825893+0000","last_peered":"2024-03-04T06:39:44.825893+0000","last_clean":"2024-03-04T06:39:44.825893+0000","last_became_active":"2024-03-04T06:38:12.554461+0000","last_became_peered":"2024-03-04T06:38:12.554461+0000","last_unstale":"2024-03-04T06:39:44.825893+0000","last_undegraded":"2024-03-04T06:39:44.825893+0000","last_fullsized":"2024-03-04T06:39:44.825893+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:03:44.989709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825607+0000","last_change":"2024-03-04T06:38:12.897411+0000","last_active":"2024-03-04T06:39:44.825607+0000","last_peered":"2024-03-04T06:39:44.825607+0000","last_clean":"2024-03-04T06:39:44.825607+0000","last_became_active":"2024-03-04T06:38:12.896742+0000","last_became_peered":"2024-03-04T06:38:12.896742+0000","last_unstale":"2024-03-04T06:39:44.825607+0000","last_undegraded":"2024-03-04T06:39:44.825607+0000","last_fullsized":"2024-03-04T06:39:44.825607+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:14:21.032038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825967+0000","last_change":"2024-03-04T06:38:47.318044+0000","last_active":"2024-03-04T06:39:44.825967+0000","last_peered":"2024-03-04T06:39:44.825967+0000","last_clean":"2024-03-04T06:39:44.825967+0000","last_became_active":"2024-03-04T06:38:47.317763+0000","last_became_peered":"2024-03-04T06:38:47.317763+0000","last_unstale":"2024-03-04T06:39:44.825967+0000","last_undegraded":"2024-03-04T06:39:44.825967+0000","last_fullsized":"2024-03-04T06:39:44.825967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:04.059027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825073+0000","last_change":"2024-03-04T06:38:12.548860+0000","last_active":"2024-03-04T06:39:44.825073+0000","last_peered":"2024-03-04T06:39:44.825073+0000","last_clean":"2024-03-04T06:39:44.825073+0000","last_became_active":"2024-03-04T06:38:12.548550+0000","last_became_peered":"2024-03-04T06:38:12.548550+0000","last_unstale":"2024-03-04T06:39:44.825073+0000","last_undegraded":"2024-03-04T06:39:44.825073+0000","last_fullsized":"2024-03-04T06:39:44.825073+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:47:43.188556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830763+0000","last_change":"2024-03-04T06:38:12.908558+0000","last_active":"2024-03-04T06:39:44.830763+0000","last_peered":"2024-03-04T06:39:44.830763+0000","last_clean":"2024-03-04T06:39:44.830763+0000","last_became_active":"2024-03-04T06:38:12.908227+0000","last_became_peered":"2024-03-04T06:38:12.908227+0000","last_unstale":"2024-03-04T06:39:44.830763+0000","last_undegraded":"2024-03-04T06:39:44.830763+0000","last_fullsized":"2024-03-04T06:39:44.830763+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:39:27.394161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826882+0000","last_change":"2024-03-04T06:38:47.376856+0000","last_active":"2024-03-04T06:39:44.826882+0000","last_peered":"2024-03-04T06:39:44.826882+0000","last_clean":"2024-03-04T06:39:44.826882+0000","last_became_active":"2024-03-04T06:38:47.376418+0000","last_became_peered":"2024-03-04T06:38:47.376418+0000","last_unstale":"2024-03-04T06:39:44.826882+0000","last_undegraded":"2024-03-04T06:39:44.826882+0000","last_fullsized":"2024-03-04T06:39:44.826882+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:18:43.241370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825346+0000","last_change":"2024-03-04T06:38:12.914172+0000","last_active":"2024-03-04T06:39:44.825346+0000","last_peered":"2024-03-04T06:39:44.825346+0000","last_clean":"2024-03-04T06:39:44.825346+0000","last_became_active":"2024-03-04T06:38:12.913896+0000","last_became_peered":"2024-03-04T06:38:12.913896+0000","last_unstale":"2024-03-04T06:39:44.825346+0000","last_undegraded":"2024-03-04T06:39:44.825346+0000","last_fullsized":"2024-03-04T06:39:44.825346+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:53.141176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826097+0000","last_change":"2024-03-04T06:38:12.540510+0000","last_active":"2024-03-04T06:39:44.826097+0000","last_peered":"2024-03-04T06:39:44.826097+0000","last_clean":"2024-03-04T06:39:44.826097+0000","last_became_active":"2024-03-04T06:38:12.540155+0000","last_became_peered":"2024-03-04T06:38:12.540155+0000","last_unstale":"2024-03-04T06:39:44.826097+0000","last_undegraded":"2024-03-04T06:39:44.826097+0000","last_fullsized":"2024-03-04T06:39:44.826097+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:39.660282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834384+0000","last_change":"2024-03-04T06:38:47.317126+0000","last_active":"2024-03-04T06:39:44.834384+0000","last_peered":"2024-03-04T06:39:44.834384+0000","last_clean":"2024-03-04T06:39:44.834384+0000","last_became_active":"2024-03-04T06:38:47.316821+0000","last_became_peered":"2024-03-04T06:38:47.316821+0000","last_unstale":"2024-03-04T06:39:44.834384+0000","last_undegraded":"2024-03-04T06:39:44.834384+0000","last_fullsized":"2024-03-04T06:39:44.834384+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:38:44.635838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832483+0000","last_change":"2024-03-04T06:38:12.903488+0000","last_active":"2024-03-04T06:39:44.832483+0000","last_peered":"2024-03-04T06:39:44.832483+0000","last_clean":"2024-03-04T06:39:44.832483+0000","last_became_active":"2024-03-04T06:38:12.903235+0000","last_became_peered":"2024-03-04T06:38:12.903235+0000","last_unstale":"2024-03-04T06:39:44.832483+0000","last_undegraded":"2024-03-04T06:39:44.832483+0000","last_fullsized":"2024-03-04T06:39:44.832483+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:48:43.099957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825213+0000","last_change":"2024-03-04T06:38:12.550672+0000","last_active":"2024-03-04T06:39:44.825213+0000","last_peered":"2024-03-04T06:39:44.825213+0000","last_clean":"2024-03-04T06:39:44.825213+0000","last_became_active":"2024-03-04T06:38:12.550367+0000","last_became_peered":"2024-03-04T06:38:12.550367+0000","last_unstale":"2024-03-04T06:39:44.825213+0000","last_undegraded":"2024-03-04T06:39:44.825213+0000","last_fullsized":"2024-03-04T06:39:44.825213+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:57:27.060139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"64'128","reported_seq":265,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:45.828673+0000","last_change":"2024-03-04T06:37:58.310255+0000","last_active":"2024-03-04T06:39:45.828673+0000","last_peered":"2024-03-04T06:39:45.828673+0000","last_clean":"2024-03-04T06:39:45.828673+0000","last_became_active":"2024-03-04T06:37:58.309800+0000","last_became_peered":"2024-03-04T06:37:58.309800+0000","last_unstale":"2024-03-04T06:39:45.828673+0000","last_undegraded":"2024-03-04T06:39:45.828673+0000","last_fullsized":"2024-03-04T06:39:45.828673+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:38.185918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833479+0000","last_change":"2024-03-04T06:38:47.321870+0000","last_active":"2024-03-04T06:39:44.833479+0000","last_peered":"2024-03-04T06:39:44.833479+0000","last_clean":"2024-03-04T06:39:44.833479+0000","last_became_active":"2024-03-04T06:38:47.321560+0000","last_became_peered":"2024-03-04T06:38:47.321560+0000","last_unstale":"2024-03-04T06:39:44.833479+0000","last_undegraded":"2024-03-04T06:39:44.833479+0000","last_fullsized":"2024-03-04T06:39:44.833479+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:40:27.719672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-03-04T06:39:46.422207+0000","last_change":"2024-03-04T06:39:46.422207+0000","last_active":"2024-03-04T06:39:46.422207+0000","last_peered":"2024-03-04T06:39:46.422207+0000","last_clean":"2024-03-04T06:39:46.422207+0000","last_became_active":"2024-03-04T06:39:46.421792+0000","last_became_peered":"2024-03-04T06:39:46.421792+0000","last_unstale":"2024-03-04T06:39:46.422207+0000","last_undegraded":"2024-03-04T06:39:46.422207+0000","last_fullsized":"2024-03-04T06:39:46.422207+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:08.818871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829032+0000","last_change":"2024-03-04T06:38:12.556986+0000","last_active":"2024-03-04T06:39:44.829032+0000","last_peered":"2024-03-04T06:39:44.829032+0000","last_clean":"2024-03-04T06:39:44.829032+0000","last_became_active":"2024-03-04T06:38:12.556594+0000","last_became_peered":"2024-03-04T06:38:12.556594+0000","last_unstale":"2024-03-04T06:39:44.829032+0000","last_undegraded":"2024-03-04T06:39:44.829032+0000","last_fullsized":"2024-03-04T06:39:44.829032+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:52.669745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834213+0000","last_change":"2024-03-04T06:38:47.376856+0000","last_active":"2024-03-04T06:39:44.834213+0000","last_peered":"2024-03-04T06:39:44.834213+0000","last_clean":"2024-03-04T06:39:44.834213+0000","last_became_active":"2024-03-04T06:38:47.376532+0000","last_became_peered":"2024-03-04T06:38:47.376532+0000","last_unstale":"2024-03-04T06:39:44.834213+0000","last_undegraded":"2024-03-04T06:39:44.834213+0000","last_fullsized":"2024-03-04T06:39:44.834213+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:21.206296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829433+0000","last_change":"2024-03-04T06:38:12.557967+0000","last_active":"2024-03-04T06:39:44.829433+0000","last_peered":"2024-03-04T06:39:44.829433+0000","last_clean":"2024-03-04T06:39:44.829433+0000","last_became_active":"2024-03-04T06:38:12.557397+0000","last_became_peered":"2024-03-04T06:38:12.557397+0000","last_unstale":"2024-03-04T06:39:44.829433+0000","last_undegraded":"2024-03-04T06:39:44.829433+0000","last_fullsized":"2024-03-04T06:39:44.829433+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.366465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826044+0000","last_change":"2024-03-04T06:38:12.905517+0000","last_active":"2024-03-04T06:39:44.826044+0000","last_peered":"2024-03-04T06:39:44.826044+0000","last_clean":"2024-03-04T06:39:44.826044+0000","last_became_active":"2024-03-04T06:38:12.905234+0000","last_became_peered":"2024-03-04T06:38:12.905234+0000","last_unstale":"2024-03-04T06:39:44.826044+0000","last_undegraded":"2024-03-04T06:39:44.826044+0000","last_fullsized":"2024-03-04T06:39:44.826044+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:32:58.487468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832046+0000","last_change":"2024-03-04T06:38:47.316978+0000","last_active":"2024-03-04T06:39:44.832046+0000","last_peered":"2024-03-04T06:39:44.832046+0000","last_clean":"2024-03-04T06:39:44.832046+0000","last_became_active":"2024-03-04T06:38:47.316666+0000","last_became_peered":"2024-03-04T06:38:47.316666+0000","last_unstale":"2024-03-04T06:39:44.832046+0000","last_undegraded":"2024-03-04T06:39:44.832046+0000","last_fullsized":"2024-03-04T06:39:44.832046+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:22.840327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826725+0000","last_change":"2024-03-04T06:38:12.542943+0000","last_active":"2024-03-04T06:39:44.826725+0000","last_peered":"2024-03-04T06:39:44.826725+0000","last_clean":"2024-03-04T06:39:44.826725+0000","last_became_active":"2024-03-04T06:38:12.542663+0000","last_became_peered":"2024-03-04T06:38:12.542663+0000","last_unstale":"2024-03-04T06:39:44.826725+0000","last_undegraded":"2024-03-04T06:39:44.826725+0000","last_fullsized":"2024-03-04T06:39:44.826725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:11.583290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833254+0000","last_change":"2024-03-04T06:38:12.898034+0000","last_active":"2024-03-04T06:39:44.833254+0000","last_peered":"2024-03-04T06:39:44.833254+0000","last_clean":"2024-03-04T06:39:44.833254+0000","last_became_active":"2024-03-04T06:38:12.897766+0000","last_became_peered":"2024-03-04T06:38:12.897766+0000","last_unstale":"2024-03-04T06:39:44.833254+0000","last_undegraded":"2024-03-04T06:39:44.833254+0000","last_fullsized":"2024-03-04T06:39:44.833254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:56.085588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.828879+0000","last_change":"2024-03-04T06:38:47.376747+0000","last_active":"2024-03-04T06:39:44.828879+0000","last_peered":"2024-03-04T06:39:44.828879+0000","last_clean":"2024-03-04T06:39:44.828879+0000","last_became_active":"2024-03-04T06:38:47.376407+0000","last_became_peered":"2024-03-04T06:38:47.376407+0000","last_unstale":"2024-03-04T06:39:44.828879+0000","last_undegraded":"2024-03-04T06:39:44.828879+0000","last_fullsized":"2024-03-04T06:39:44.828879+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:44.463155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834701+0000","last_change":"2024-03-04T06:38:12.554846+0000","last_active":"2024-03-04T06:39:44.834701+0000","last_peered":"2024-03-04T06:39:44.834701+0000","last_clean":"2024-03-04T06:39:44.834701+0000","last_became_active":"2024-03-04T06:38:12.554544+0000","last_became_peered":"2024-03-04T06:38:12.554544+0000","last_unstale":"2024-03-04T06:39:44.834701+0000","last_undegraded":"2024-03-04T06:39:44.834701+0000","last_fullsized":"2024-03-04T06:39:44.834701+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:44.524183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833734+0000","last_change":"2024-03-04T06:38:12.903163+0000","last_active":"2024-03-04T06:39:44.833734+0000","last_peered":"2024-03-04T06:39:44.833734+0000","last_clean":"2024-03-04T06:39:44.833734+0000","last_became_active":"2024-03-04T06:38:12.902896+0000","last_became_peered":"2024-03-04T06:38:12.902896+0000","last_unstale":"2024-03-04T06:39:44.833734+0000","last_undegraded":"2024-03-04T06:39:44.833734+0000","last_fullsized":"2024-03-04T06:39:44.833734+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:45:59.166463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829163+0000","last_change":"2024-03-04T06:38:12.556654+0000","last_active":"2024-03-04T06:39:44.829163+0000","last_peered":"2024-03-04T06:39:44.829163+0000","last_clean":"2024-03-04T06:39:44.829163+0000","last_became_active":"2024-03-04T06:38:12.556014+0000","last_became_peered":"2024-03-04T06:38:12.556014+0000","last_unstale":"2024-03-04T06:39:44.829163+0000","last_undegraded":"2024-03-04T06:39:44.829163+0000","last_fullsized":"2024-03-04T06:39:44.829163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:45.975559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829223+0000","last_change":"2024-03-04T06:38:12.906674+0000","last_active":"2024-03-04T06:39:44.829223+0000","last_peered":"2024-03-04T06:39:44.829223+0000","last_clean":"2024-03-04T06:39:44.829223+0000","last_became_active":"2024-03-04T06:38:12.906385+0000","last_became_peered":"2024-03-04T06:38:12.906385+0000","last_unstale":"2024-03-04T06:39:44.829223+0000","last_undegraded":"2024-03-04T06:39:44.829223+0000","last_fullsized":"2024-03-04T06:39:44.829223+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:29:56.436800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825787+0000","last_change":"2024-03-04T06:38:12.555463+0000","last_active":"2024-03-04T06:39:44.825787+0000","last_peered":"2024-03-04T06:39:44.825787+0000","last_clean":"2024-03-04T06:39:44.825787+0000","last_became_active":"2024-03-04T06:38:12.555150+0000","last_became_peered":"2024-03-04T06:38:12.555150+0000","last_unstale":"2024-03-04T06:39:44.825787+0000","last_undegraded":"2024-03-04T06:39:44.825787+0000","last_fullsized":"2024-03-04T06:39:44.825787+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:30.714863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832142+0000","last_change":"2024-03-04T06:38:12.897860+0000","last_active":"2024-03-04T06:39:44.832142+0000","last_peered":"2024-03-04T06:39:44.832142+0000","last_clean":"2024-03-04T06:39:44.832142+0000","last_became_active":"2024-03-04T06:38:12.897568+0000","last_became_peered":"2024-03-04T06:38:12.897568+0000","last_unstale":"2024-03-04T06:39:44.832142+0000","last_undegraded":"2024-03-04T06:39:44.832142+0000","last_fullsized":"2024-03-04T06:39:44.832142+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:22:30.116519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825765+0000","last_change":"2024-03-04T06:38:12.556223+0000","last_active":"2024-03-04T06:39:44.825765+0000","last_peered":"2024-03-04T06:39:44.825765+0000","last_clean":"2024-03-04T06:39:44.825765+0000","last_became_active":"2024-03-04T06:38:12.555948+0000","last_became_peered":"2024-03-04T06:38:12.555948+0000","last_unstale":"2024-03-04T06:39:44.825765+0000","last_undegraded":"2024-03-04T06:39:44.825765+0000","last_fullsized":"2024-03-04T06:39:44.825765+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:19:51.659542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832874+0000","last_change":"2024-03-04T06:38:12.908686+0000","last_active":"2024-03-04T06:39:44.832874+0000","last_peered":"2024-03-04T06:39:44.832874+0000","last_clean":"2024-03-04T06:39:44.832874+0000","last_became_active":"2024-03-04T06:38:12.907114+0000","last_became_peered":"2024-03-04T06:38:12.907114+0000","last_unstale":"2024-03-04T06:39:44.832874+0000","last_undegraded":"2024-03-04T06:39:44.832874+0000","last_fullsized":"2024-03-04T06:39:44.832874+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:08:03.009115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.831276+0000","last_change":"2024-03-04T06:38:12.558399+0000","last_active":"2024-03-04T06:39:44.831276+0000","last_peered":"2024-03-04T06:39:44.831276+0000","last_clean":"2024-03-04T06:39:44.831276+0000","last_became_active":"2024-03-04T06:38:12.558068+0000","last_became_peered":"2024-03-04T06:38:12.558068+0000","last_unstale":"2024-03-04T06:39:44.831276+0000","last_undegraded":"2024-03-04T06:39:44.831276+0000","last_fullsized":"2024-03-04T06:39:44.831276+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:00.895079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834188+0000","last_change":"2024-03-04T06:38:12.904212+0000","last_active":"2024-03-04T06:39:44.834188+0000","last_peered":"2024-03-04T06:39:44.834188+0000","last_clean":"2024-03-04T06:39:44.834188+0000","last_became_active":"2024-03-04T06:38:12.903906+0000","last_became_peered":"2024-03-04T06:38:12.903906+0000","last_unstale":"2024-03-04T06:39:44.834188+0000","last_undegraded":"2024-03-04T06:39:44.834188+0000","last_fullsized":"2024-03-04T06:39:44.834188+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:27:10.766546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826396+0000","last_change":"2024-03-04T06:38:12.548200+0000","last_active":"2024-03-04T06:39:44.826396+0000","last_peered":"2024-03-04T06:39:44.826396+0000","last_clean":"2024-03-04T06:39:44.826396+0000","last_became_active":"2024-03-04T06:38:12.547906+0000","last_became_peered":"2024-03-04T06:38:12.547906+0000","last_unstale":"2024-03-04T06:39:44.826396+0000","last_undegraded":"2024-03-04T06:39:44.826396+0000","last_fullsized":"2024-03-04T06:39:44.826396+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:11:39.491360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.829355+0000","last_change":"2024-03-04T06:38:12.918955+0000","last_active":"2024-03-04T06:39:44.829355+0000","last_peered":"2024-03-04T06:39:44.829355+0000","last_clean":"2024-03-04T06:39:44.829355+0000","last_became_active":"2024-03-04T06:38:12.918684+0000","last_became_peered":"2024-03-04T06:38:12.918684+0000","last_unstale":"2024-03-04T06:39:44.829355+0000","last_undegraded":"2024-03-04T06:39:44.829355+0000","last_fullsized":"2024-03-04T06:39:44.829355+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:47:29.169416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826269+0000","last_change":"2024-03-04T06:38:12.547660+0000","last_active":"2024-03-04T06:39:44.826269+0000","last_peered":"2024-03-04T06:39:44.826269+0000","last_clean":"2024-03-04T06:39:44.826269+0000","last_became_active":"2024-03-04T06:38:12.547358+0000","last_became_peered":"2024-03-04T06:38:12.547358+0000","last_unstale":"2024-03-04T06:39:44.826269+0000","last_undegraded":"2024-03-04T06:39:44.826269+0000","last_fullsized":"2024-03-04T06:39:44.826269+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:10.370020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825389+0000","last_change":"2024-03-04T06:38:12.902066+0000","last_active":"2024-03-04T06:39:44.825389+0000","last_peered":"2024-03-04T06:39:44.825389+0000","last_clean":"2024-03-04T06:39:44.825389+0000","last_became_active":"2024-03-04T06:38:12.901331+0000","last_became_peered":"2024-03-04T06:38:12.901331+0000","last_unstale":"2024-03-04T06:39:44.825389+0000","last_undegraded":"2024-03-04T06:39:44.825389+0000","last_fullsized":"2024-03-04T06:39:44.825389+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:46:51.413734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826848+0000","last_change":"2024-03-04T06:38:12.547376+0000","last_active":"2024-03-04T06:39:44.826848+0000","last_peered":"2024-03-04T06:39:44.826848+0000","last_clean":"2024-03-04T06:39:44.826848+0000","last_became_active":"2024-03-04T06:38:12.547108+0000","last_became_peered":"2024-03-04T06:38:12.547108+0000","last_unstale":"2024-03-04T06:39:44.826848+0000","last_undegraded":"2024-03-04T06:39:44.826848+0000","last_fullsized":"2024-03-04T06:39:44.826848+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:34:14.300865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.830796+0000","last_change":"2024-03-04T06:38:12.917263+0000","last_active":"2024-03-04T06:39:44.830796+0000","last_peered":"2024-03-04T06:39:44.830796+0000","last_clean":"2024-03-04T06:39:44.830796+0000","last_became_active":"2024-03-04T06:38:12.917001+0000","last_became_peered":"2024-03-04T06:38:12.917001+0000","last_unstale":"2024-03-04T06:39:44.830796+0000","last_undegraded":"2024-03-04T06:39:44.830796+0000","last_fullsized":"2024-03-04T06:39:44.830796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:54.912481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833760+0000","last_change":"2024-03-04T06:38:12.916968+0000","last_active":"2024-03-04T06:39:44.833760+0000","last_peered":"2024-03-04T06:39:44.833760+0000","last_clean":"2024-03-04T06:39:44.833760+0000","last_became_active":"2024-03-04T06:38:12.916669+0000","last_became_peered":"2024-03-04T06:38:12.916669+0000","last_unstale":"2024-03-04T06:39:44.833760+0000","last_undegraded":"2024-03-04T06:39:44.833760+0000","last_fullsized":"2024-03-04T06:39:44.833760+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:18:16.919063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826181+0000","last_change":"2024-03-04T06:38:12.892619+0000","last_active":"2024-03-04T06:39:44.826181+0000","last_peered":"2024-03-04T06:39:44.826181+0000","last_clean":"2024-03-04T06:39:44.826181+0000","last_became_active":"2024-03-04T06:38:12.892261+0000","last_became_peered":"2024-03-04T06:38:12.892261+0000","last_unstale":"2024-03-04T06:39:44.826181+0000","last_undegraded":"2024-03-04T06:39:44.826181+0000","last_fullsized":"2024-03-04T06:39:44.826181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:19:13.957414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825192+0000","last_change":"2024-03-04T06:38:12.899301+0000","last_active":"2024-03-04T06:39:44.825192+0000","last_peered":"2024-03-04T06:39:44.825192+0000","last_clean":"2024-03-04T06:39:44.825192+0000","last_became_active":"2024-03-04T06:38:12.898002+0000","last_became_peered":"2024-03-04T06:38:12.898002+0000","last_unstale":"2024-03-04T06:39:44.825192+0000","last_undegraded":"2024-03-04T06:39:44.825192+0000","last_fullsized":"2024-03-04T06:39:44.825192+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:46.969732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834361+0000","last_change":"2024-03-04T06:38:12.908610+0000","last_active":"2024-03-04T06:39:44.834361+0000","last_peered":"2024-03-04T06:39:44.834361+0000","last_clean":"2024-03-04T06:39:44.834361+0000","last_became_active":"2024-03-04T06:38:12.907578+0000","last_became_peered":"2024-03-04T06:38:12.907578+0000","last_unstale":"2024-03-04T06:39:44.834361+0000","last_undegraded":"2024-03-04T06:39:44.834361+0000","last_fullsized":"2024-03-04T06:39:44.834361+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:52.078874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833071+0000","last_change":"2024-03-04T06:38:12.906536+0000","last_active":"2024-03-04T06:39:44.833071+0000","last_peered":"2024-03-04T06:39:44.833071+0000","last_clean":"2024-03-04T06:39:44.833071+0000","last_became_active":"2024-03-04T06:38:12.906183+0000","last_became_peered":"2024-03-04T06:38:12.906183+0000","last_unstale":"2024-03-04T06:39:44.833071+0000","last_undegraded":"2024-03-04T06:39:44.833071+0000","last_fullsized":"2024-03-04T06:39:44.833071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:15:13.559021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.826187+0000","last_change":"2024-03-04T06:38:12.899871+0000","last_active":"2024-03-04T06:39:44.826187+0000","last_peered":"2024-03-04T06:39:44.826187+0000","last_clean":"2024-03-04T06:39:44.826187+0000","last_became_active":"2024-03-04T06:38:12.899583+0000","last_became_peered":"2024-03-04T06:38:12.899583+0000","last_unstale":"2024-03-04T06:39:44.826187+0000","last_undegraded":"2024-03-04T06:39:44.826187+0000","last_fullsized":"2024-03-04T06:39:44.826187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:51.628806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834765+0000","last_change":"2024-03-04T06:38:12.914660+0000","last_active":"2024-03-04T06:39:44.834765+0000","last_peered":"2024-03-04T06:39:44.834765+0000","last_clean":"2024-03-04T06:39:44.834765+0000","last_became_active":"2024-03-04T06:38:12.914354+0000","last_became_peered":"2024-03-04T06:38:12.914354+0000","last_unstale":"2024-03-04T06:39:44.834765+0000","last_undegraded":"2024-03-04T06:39:44.834765+0000","last_fullsized":"2024-03-04T06:39:44.834765+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:28.750455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.833335+0000","last_change":"2024-03-04T06:38:12.906752+0000","last_active":"2024-03-04T06:39:44.833335+0000","last_peered":"2024-03-04T06:39:44.833335+0000","last_clean":"2024-03-04T06:39:44.833335+0000","last_became_active":"2024-03-04T06:38:12.906492+0000","last_became_peered":"2024-03-04T06:38:12.906492+0000","last_unstale":"2024-03-04T06:39:44.833335+0000","last_undegraded":"2024-03-04T06:39:44.833335+0000","last_fullsized":"2024-03-04T06:39:44.833335+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:24.841196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825148+0000","last_change":"2024-03-04T06:38:12.897151+0000","last_active":"2024-03-04T06:39:44.825148+0000","last_peered":"2024-03-04T06:39:44.825148+0000","last_clean":"2024-03-04T06:39:44.825148+0000","last_became_active":"2024-03-04T06:38:12.896787+0000","last_became_peered":"2024-03-04T06:38:12.896787+0000","last_unstale":"2024-03-04T06:39:44.825148+0000","last_undegraded":"2024-03-04T06:39:44.825148+0000","last_fullsized":"2024-03-04T06:39:44.825148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:12:22.562737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.832707+0000","last_change":"2024-03-04T06:38:12.908348+0000","last_active":"2024-03-04T06:39:44.832707+0000","last_peered":"2024-03-04T06:39:44.832707+0000","last_clean":"2024-03-04T06:39:44.832707+0000","last_became_active":"2024-03-04T06:38:12.908021+0000","last_became_peered":"2024-03-04T06:38:12.908021+0000","last_unstale":"2024-03-04T06:39:44.832707+0000","last_undegraded":"2024-03-04T06:39:44.832707+0000","last_fullsized":"2024-03-04T06:39:44.832707+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:16:36.050910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.825276+0000","last_change":"2024-03-04T06:38:12.898994+0000","last_active":"2024-03-04T06:39:44.825276+0000","last_peered":"2024-03-04T06:39:44.825276+0000","last_clean":"2024-03-04T06:39:44.825276+0000","last_became_active":"2024-03-04T06:38:12.898693+0000","last_became_peered":"2024-03-04T06:38:12.898693+0000","last_unstale":"2024-03-04T06:39:44.825276+0000","last_undegraded":"2024-03-04T06:39:44.825276+0000","last_fullsized":"2024-03-04T06:39:44.825276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:40:01.173992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834403+0000","last_change":"2024-03-04T06:38:12.898036+0000","last_active":"2024-03-04T06:39:44.834403+0000","last_peered":"2024-03-04T06:39:44.834403+0000","last_clean":"2024-03-04T06:39:44.834403+0000","last_became_active":"2024-03-04T06:38:12.897717+0000","last_became_peered":"2024-03-04T06:38:12.897717+0000","last_unstale":"2024-03-04T06:39:44.834403+0000","last_undegraded":"2024-03-04T06:39:44.834403+0000","last_fullsized":"2024-03-04T06:39:44.834403+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:58:02.821482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-04T06:39:44.834420+0000","last_change":"2024-03-04T06:38:12.915624+0000","last_active":"2024-03-04T06:39:44.834420+0000","last_peered":"2024-03-04T06:39:44.834420+0000","last_clean":"2024-03-04T06:39:44.834420+0000","last_became_active":"2024-03-04T06:38:12.915335+0000","last_became_peered":"2024-03-04T06:38:12.915335+0000","last_unstale":"2024-03-04T06:39:44.834420+0000","last_undegraded":"2024-03-04T06:39:44.834420+0000","last_fullsized":"2024-03-04T06:39:44.834420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:52:58.038264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3146,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234011,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28300,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716852,"statfs":{"total":95995035648,"available":95966056448,"internally_reserved":0,"allocated":1306624,"data_stored":900209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.29699999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.64200000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.503,"15min":0.502},"min":{"1min":0.35999999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68500000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.59199999999999997}]},{"osd":1,"last update":"Mon Mar 4 06:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.33400000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.69099999999999995,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Mar 4 06:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51800000000000002,"15min":0.52100000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70999999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70799999999999996,"5min":0.748,"15min":0.748},"last":0.57299999999999995}]},{"osd":3,"last update":"Mon Mar 4 06:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64300000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.5},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Mar 4 06:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68100000000000005,"5min":0.749,"15min":0.749},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.44700000000000001,"15min":0.441},"min":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.40400000000000003}]},{"osd":5,"last update":"Mon Mar 4 06:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.34200000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.505,"15min":0.499},"min":{"1min":0.37,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.63500000000000001}]},{"osd":6,"last update":"Mon Mar 4 06:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34599999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.41999999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55400000000000005}]}]},{"osd":6,"up_from":46,"seq":197568495648,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28308,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716844,"statfs":{"total":95995035648,"available":95966048256,"internally_reserved":0,"allocated":1314816,"data_stored":902284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.495,"15min":0.496},"min":{"1min":0.36899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.59899999999999998}]},{"osd":1,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68999999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56599999999999995}]},{"osd":2,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35199999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.753,"15min":0.753},"last":0.61199999999999999}]},{"osd":3,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64700000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.57899999999999996}]},{"osd":4,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41099999999999998,"15min":0.40500000000000003},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.441,"15min":0.435},"min":{"1min":0.34399999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.38300000000000001}]},{"osd":5,"last update":"Mon Mar 4 06:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.432,"15min":0.42199999999999999},"min":{"1min":0.35099999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.46200000000000002,"15min":0.45400000000000001},"min":{"1min":0.371,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.35999999999999999}]},{"osd":7,"last update":"Mon Mar 4 06:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.375},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.40999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717432,"statfs":{"total":95995035648,"available":95966650368,"internally_reserved":0,"allocated":716800,"data_stored":309728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.32000000000000001},"min":{"1min":0.23300000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.373},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.33800000000000002},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.33400000000000002}]},{"osd":2,"last update":"Mon Mar 4 06:39:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35799999999999998,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.441},{"interface":"front","average":{"1min":0.374,"5min":0.378,"15min":0.36499999999999999},"min":{"1min":0.25800000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.55100000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Mon Mar 4 06:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.434,"15min":0.433},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40699999999999997}]},{"osd":4,"last update":"Mon Mar 4 06:39:48 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76600000000000001,"5min":0.87,"15min":0.87},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.36799999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78000000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48699999999999999}]},{"osd":5,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.747,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81799999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76400000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.505},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83299999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58799999999999997}]},{"osd":7,"last update":"Mon Mar 4 06:39:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.623,"15min":0.628},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75900000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.51800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28308,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716844,"statfs":{"total":95995035648,"available":95966048256,"internally_reserved":0,"allocated":1318912,"data_stored":900664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 4 06:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38200000000000001,"15min":0.36599999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.312}]},{"osd":2,"last update":"Mon Mar 4 06:38:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64600000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.33300000000000002}]},{"osd":3,"last update":"Mon Mar 4 06:39:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28899999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.37},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.29699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.28299999999999997}]},{"osd":4,"last update":"Mon Mar 4 06:39:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.69699999999999995,"5min":0.877,"15min":0.877},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69999999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.48699999999999999}]},{"osd":5,"last update":"Mon Mar 4 06:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.80400000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.438},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.70099999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.57499999999999996}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72899999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":1.2629999999999999,"15min":1.3759999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84599999999999997,"5min":11.987,"15min":11.987},"last":0.47099999999999997}]},{"osd":7,"last update":"Mon Mar 4 06:38:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.45400000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411379,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717440,"statfs":{"total":95995035648,"available":95966658560,"internally_reserved":0,"allocated":708608,"data_stored":309568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.32400000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.376,"15min":0.36399999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.28599999999999998}]},{"osd":1,"last update":"Mon Mar 4 06:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.5,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.56499999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.32500000000000001}]},{"osd":3,"last update":"Mon Mar 4 06:39:23 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60099999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Mon Mar 4 06:39:44 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Mon Mar 4 06:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61899999999999999,"15min":0.62},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84699999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.626}]},{"osd":6,"last update":"Mon Mar 4 06:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85099999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Mon Mar 4 06:39:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.745,"5min":0.873,"15min":0.873},"last":0.69199999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717416,"statfs":{"total":95995035648,"available":95966633984,"internally_reserved":0,"allocated":729088,"data_stored":312020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.38900000000000001,"15min":0.39700000000000002},"min":{"1min":0.25600000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.45400000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41499999999999998,"15min":0.42499999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.50700000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.215}]},{"osd":1,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41599999999999998,"15min":0.42399999999999999},"min":{"1min":0.27200000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.53500000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41999999999999998,"15min":0.42399999999999999},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52300000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.23200000000000001}]},{"osd":2,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70199999999999996,"5min":0.749,"15min":0.749},"last":0.379},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.438,"15min":0.44800000000000001},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.27900000000000003}]},{"osd":4,"last update":"Mon Mar 4 06:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.68100000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69299999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.68200000000000005}]},{"osd":5,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79200000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77900000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Mon Mar 4 06:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.66900000000000004}]},{"osd":7,"last update":"Mon Mar 4 06:39:56 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65600000000000003,"5min":0.871,"15min":0.871},"last":0.57199999999999995}]}]},{"osd":4,"up_from":30,"seq":128849018922,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717424,"statfs":{"total":95995035648,"available":95966642176,"internally_reserved":0,"allocated":724992,"data_stored":310276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.40400000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.56299999999999994}]},{"osd":1,"last update":"Mon Mar 4 06:39:49 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64500000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.63}]},{"osd":2,"last update":"Mon Mar 4 06:39:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.53200000000000003}]},{"osd":3,"last update":"Mon Mar 4 06:39:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.39700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51900000000000002}]},{"osd":5,"last update":"Mon Mar 4 06:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.42199999999999999,"15min":0.40799999999999997},"min":{"1min":0.375,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon Mar 4 06:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.45400000000000001,"15min":0.442},"min":{"1min":0.36799999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.53900000000000003}]},{"osd":7,"last update":"Mon Mar 4 06:39:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.51300000000000001,"15min":0.51400000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64200000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757285,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27720,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717432,"statfs":{"total":95995035648,"available":95966650368,"internally_reserved":0,"allocated":720896,"data_stored":311675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.625,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64600000000000002}]},{"osd":1,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68899999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.628},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59099999999999997}]},{"osd":2,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64600000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.70699999999999996}]},{"osd":3,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.78900000000000003,"15min":0.83799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.63700000000000001,"5min":6.6180000000000003,"15min":6.6180000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.57699999999999996}]},{"osd":4,"last update":"Mon Mar 4 06:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.27800000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.39500000000000002,"15min":0.38100000000000001},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.45300000000000001}]},{"osd":6,"last update":"Mon Mar 4 06:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.46300000000000002},"min":{"1min":0.33000000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.433},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.32900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.65000000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.55700000000000005}]},{"osd":7,"last update":"Mon Mar 4 06:39:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.503,"15min":0.502},"min":{"1min":0.315,"5min":0.309,"15min":0.309},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.54100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:40:05.892 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-04T06:40:05.892 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-04T06:40:05.892 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-04T06:40:05.892 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph health --format=json 2024-03-04T06:40:06.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:05 smithi203 ceph-mon[30756]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:40:06.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:05 smithi203 ceph-mon[30756]: pgmap v49: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:06.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:05 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:06.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:05 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:06.100 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:40:06.223 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-mon[37364]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:40:06.223 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-mon[37364]: pgmap v49: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:06.223 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:06.223 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:06.223 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-mon[26846]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:40:06.223 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-mon[26846]: pgmap v49: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:06.223 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:06.223 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:05 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:07.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:06 smithi203 ceph-mon[30756]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-04T06:40:07.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:06 smithi203 ceph-mon[30756]: Reconfiguring daemon prometheus.a on smithi203 2024-03-04T06:40:07.246 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:06 smithi137 ceph-mon[26846]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-04T06:40:07.246 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:06 smithi137 ceph-mon[26846]: Reconfiguring daemon prometheus.a on smithi203 2024-03-04T06:40:07.246 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:06 smithi137 ceph-mon[37364]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-04T06:40:07.246 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:06 smithi137 ceph-mon[37364]: Reconfiguring daemon prometheus.a on smithi203 2024-03-04T06:40:07.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[73354]: ts=2024-03-04T06:40:07.304Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000201276s 2024-03-04T06:40:08.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:07 smithi137 ceph-mon[26846]: pgmap v50: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:08.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:07 smithi137 ceph-mon[37364]: pgmap v50: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:08.052 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:40:08.052 INFO:teuthology.orchestra.run.smithi137.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-04T06:40:08.073 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:07 smithi203 ceph-mon[30756]: pgmap v50: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:08.813 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-04T06:40:08.814 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T06:40:09.003 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:08 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/366950330' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-04T06:40:09.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:08 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/366950330' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-04T06:40:09.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:08 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/366950330' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-04T06:40:09.105 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:40:09.105 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":69,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:39:45.822007+0000","last_up_change":"2024-03-04T06:37:54.799220+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T06:38:11.049505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T06:38:12.066145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-04T06:38:45.908437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6803","nonce":120753079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6805","nonce":120753079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6809","nonce":120753079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6807","nonce":120753079}]},"public_addr":"172.21.15.137:6803/120753079","cluster_addr":"172.21.15.137:6805/120753079","heartbeat_back_addr":"172.21.15.137:6809/120753079","heartbeat_front_addr":"172.21.15.137:6807/120753079","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6811","nonce":2976801936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6813","nonce":2976801936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6817","nonce":2976801936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6815","nonce":2976801936}]},"public_addr":"172.21.15.137:6811/2976801936","cluster_addr":"172.21.15.137:6813/2976801936","heartbeat_back_addr":"172.21.15.137:6817/2976801936","heartbeat_front_addr":"172.21.15.137:6815/2976801936","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6819","nonce":788153355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6821","nonce":788153355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6825","nonce":788153355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6823","nonce":788153355}]},"public_addr":"172.21.15.137:6819/788153355","cluster_addr":"172.21.15.137:6821/788153355","heartbeat_back_addr":"172.21.15.137:6825/788153355","heartbeat_front_addr":"172.21.15.137:6823/788153355","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6827","nonce":1906308615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6829","nonce":1906308615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6833","nonce":1906308615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6831","nonce":1906308615}]},"public_addr":"172.21.15.137:6827/1906308615","cluster_addr":"172.21.15.137:6829/1906308615","heartbeat_back_addr":"172.21.15.137:6833/1906308615","heartbeat_front_addr":"172.21.15.137:6831/1906308615","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6801","nonce":483489448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6803","nonce":483489448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6807","nonce":483489448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6805","nonce":483489448}]},"public_addr":"172.21.15.203:6801/483489448","cluster_addr":"172.21.15.203:6803/483489448","heartbeat_back_addr":"172.21.15.203:6807/483489448","heartbeat_front_addr":"172.21.15.203:6805/483489448","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6809","nonce":1227714102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6811","nonce":1227714102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6815","nonce":1227714102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6813","nonce":1227714102}]},"public_addr":"172.21.15.203:6809/1227714102","cluster_addr":"172.21.15.203:6811/1227714102","heartbeat_back_addr":"172.21.15.203:6815/1227714102","heartbeat_front_addr":"172.21.15.203:6813/1227714102","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6817","nonce":593999121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6819","nonce":593999121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6823","nonce":593999121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6821","nonce":593999121}]},"public_addr":"172.21.15.203:6817/593999121","cluster_addr":"172.21.15.203:6819/593999121","heartbeat_back_addr":"172.21.15.203:6823/593999121","heartbeat_front_addr":"172.21.15.203:6821/593999121","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6825","nonce":4089764819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6827","nonce":4089764819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6831","nonce":4089764819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6829","nonce":4089764819}]},"public_addr":"172.21.15.203:6825/4089764819","cluster_addr":"172.21.15.203:6827/4089764819","heartbeat_back_addr":"172.21.15.203:6831/4089764819","heartbeat_front_addr":"172.21.15.203:6829/4089764819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1","mappings":[{"from":0,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.13","mappings":[{"from":4,"to":3}]},{"pgid":"3.15","mappings":[{"from":4,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/3119089659":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/1351645377":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/2769280127":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6801/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3274678870":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6800/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T06:40:09.119 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T06:35:55.259476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T06:38:11.049505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T06:38:12.066145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'rbd', 'create_time': '2024-03-04T06:38:45.908437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 3, 'score_stable': 3, 'optimal_score': 1, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T06:40:09.119 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T06:40:09.400 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-03-04T06:40:09.413 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T06:40:09.696 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-03-04T06:40:09.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T06:40:09.826 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:09 smithi203 systemd[1]: Stopping Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:40:09.993 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-03-04T06:40:10.005 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:09 smithi137 ceph-mon[26846]: pgmap v51: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:10.005 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:09 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3410474596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:40:10.005 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:09 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1907951067' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:40:10.005 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:09 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2954910728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T06:40:10.005 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:09 smithi137 ceph-mon[37364]: pgmap v51: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:10.005 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:09 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3410474596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:40:10.005 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:09 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1907951067' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:40:10.006 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:09 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2954910728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T06:40:10.006 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-04T06:40:10.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-mon[30756]: pgmap v51: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:10.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3410474596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:40:10.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1907951067' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:40:10.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2954910728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T06:40:10.096 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[59418]: ts=2024-03-04T06:40:09.994Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-04T06:40:10.096 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[59418]: ts=2024-03-04T06:40:09.994Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-04T06:40:10.096 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[59418]: ts=2024-03-04T06:40:09.994Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-04T06:40:10.096 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[59418]: ts=2024-03-04T06:40:09.994Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-04T06:40:10.096 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[59418]: ts=2024-03-04T06:40:09.994Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-04T06:40:10.097 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[59418]: ts=2024-03-04T06:40:09.994Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-04T06:40:10.097 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[59418]: ts=2024-03-04T06:40:09.994Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-04T06:40:10.097 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[59418]: ts=2024-03-04T06:40:09.994Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-04T06:40:10.097 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[59418]: ts=2024-03-04T06:40:09.994Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-04T06:40:10.097 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[59418]: ts=2024-03-04T06:40:09.994Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-04T06:40:10.097 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[59418]: ts=2024-03-04T06:40:09.994Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-04T06:40:10.097 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[59418]: ts=2024-03-04T06:40:09.994Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-04T06:40:10.097 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:10 smithi203 podman[62693]: 2024-03-04 06:40:10.004606472 +0000 UTC m=+0.124352940 container died a7342e496e8bb77a80fa60cda852588352b077aba09358f4b6a920e0cf0ccc71 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:40:10.287 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 8 2024-03-04T06:40:10.300 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T06:40:10.595 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:10 smithi203 podman[62693]: 2024-03-04 06:40:10.410245715 +0000 UTC m=+0.529992182 container cleanup a7342e496e8bb77a80fa60cda852588352b077aba09358f4b6a920e0cf0ccc71 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:40:10.596 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:10 smithi203 bash[62693]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a 2024-03-04T06:40:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:40:10.618 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3869447426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3869447426},{"type":"v1","addr":"172.21.15.137:6835","nonce":3869447426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T06:38:12.879589+0000","modified":"2024-03-04T06:38:14.885821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24352":{"gid":24352,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6833/3636376444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3636376444},{"type":"v1","addr":"172.21.15.203:6833","nonce":3636376444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-04T06:40:10.618 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 6 2024-03-04T06:40:10.631 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T06:40:10.916 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:40:10.917 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":69,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:39:45.822007+0000","last_up_change":"2024-03-04T06:37:54.799220+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T06:38:11.049505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T06:38:12.066145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-04T06:38:45.908437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6803","nonce":120753079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6805","nonce":120753079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6809","nonce":120753079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6807","nonce":120753079}]},"public_addr":"172.21.15.137:6803/120753079","cluster_addr":"172.21.15.137:6805/120753079","heartbeat_back_addr":"172.21.15.137:6809/120753079","heartbeat_front_addr":"172.21.15.137:6807/120753079","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6811","nonce":2976801936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6813","nonce":2976801936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6817","nonce":2976801936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6815","nonce":2976801936}]},"public_addr":"172.21.15.137:6811/2976801936","cluster_addr":"172.21.15.137:6813/2976801936","heartbeat_back_addr":"172.21.15.137:6817/2976801936","heartbeat_front_addr":"172.21.15.137:6815/2976801936","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6819","nonce":788153355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6821","nonce":788153355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6825","nonce":788153355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6823","nonce":788153355}]},"public_addr":"172.21.15.137:6819/788153355","cluster_addr":"172.21.15.137:6821/788153355","heartbeat_back_addr":"172.21.15.137:6825/788153355","heartbeat_front_addr":"172.21.15.137:6823/788153355","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6827","nonce":1906308615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6829","nonce":1906308615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6833","nonce":1906308615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6831","nonce":1906308615}]},"public_addr":"172.21.15.137:6827/1906308615","cluster_addr":"172.21.15.137:6829/1906308615","heartbeat_back_addr":"172.21.15.137:6833/1906308615","heartbeat_front_addr":"172.21.15.137:6831/1906308615","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6801","nonce":483489448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6803","nonce":483489448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6807","nonce":483489448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6805","nonce":483489448}]},"public_addr":"172.21.15.203:6801/483489448","cluster_addr":"172.21.15.203:6803/483489448","heartbeat_back_addr":"172.21.15.203:6807/483489448","heartbeat_front_addr":"172.21.15.203:6805/483489448","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6809","nonce":1227714102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6811","nonce":1227714102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6815","nonce":1227714102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6813","nonce":1227714102}]},"public_addr":"172.21.15.203:6809/1227714102","cluster_addr":"172.21.15.203:6811/1227714102","heartbeat_back_addr":"172.21.15.203:6815/1227714102","heartbeat_front_addr":"172.21.15.203:6813/1227714102","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6817","nonce":593999121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6819","nonce":593999121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6823","nonce":593999121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6821","nonce":593999121}]},"public_addr":"172.21.15.203:6817/593999121","cluster_addr":"172.21.15.203:6819/593999121","heartbeat_back_addr":"172.21.15.203:6823/593999121","heartbeat_front_addr":"172.21.15.203:6821/593999121","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6825","nonce":4089764819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6827","nonce":4089764819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6831","nonce":4089764819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6829","nonce":4089764819}]},"public_addr":"172.21.15.203:6825/4089764819","cluster_addr":"172.21.15.203:6827/4089764819","heartbeat_back_addr":"172.21.15.203:6831/4089764819","heartbeat_front_addr":"172.21.15.203:6829/4089764819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1","mappings":[{"from":0,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.13","mappings":[{"from":4,"to":3}]},{"pgid":"3.15","mappings":[{"from":4,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/3119089659":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/1351645377":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/2769280127":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6801/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3274678870":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6800/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T06:40:10.928 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:10 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1383029662' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T06:40:10.928 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:10 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2299228867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-03-04T06:40:10.928 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:10 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3254681109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:40:10.928 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:10 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1383029662' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T06:40:10.929 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:10 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2299228867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-03-04T06:40:10.929 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:10 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3254681109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:40:10.930 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T06:35:55.259476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T06:38:11.049505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T06:38:12.066145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'rbd', 'create_time': '2024-03-04T06:38:45.908437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 3, 'score_stable': 3, 'optimal_score': 1, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T06:40:10.930 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T06:40:10.992 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:10 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1383029662' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T06:40:10.992 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:10 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2299228867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-03-04T06:40:10.992 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:10 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3254681109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:40:10.992 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:10 smithi203 podman[62708]: 2024-03-04 06:40:10.645163647 +0000 UTC m=+0.640550390 container remove a7342e496e8bb77a80fa60cda852588352b077aba09358f4b6a920e0cf0ccc71 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:40:10.993 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:10 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@prometheus.a.service: Deactivated successfully. 2024-03-04T06:40:10.993 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:10 smithi203 systemd[1]: Stopped Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:40:10.993 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:10 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@prometheus.a.service: Consumed 1.075s CPU time. 2024-03-04T06:40:10.993 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:10 smithi203 systemd[1]: Starting Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:40:11.214 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-03-04T06:40:11.227 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T06:40:11.256 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:10 smithi203 podman[62806]: 2024-03-04 06:40:10.896047726 +0000 UTC m=+0.018909615 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-03-04T06:40:11.256 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:10 smithi203 podman[62806]: 2024-03-04 06:40:10.996137141 +0000 UTC m=+0.118999021 container create 80efb24031c2e622c9f7f61e69fb402173797b12935b2f01fc9fcf460aef8c21 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:40:11.256 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 podman[62806]: 2024-03-04 06:40:11.206690588 +0000 UTC m=+0.329552476 container init 80efb24031c2e622c9f7f61e69fb402173797b12935b2f01fc9fcf460aef8c21 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:40:11.256 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 podman[62806]: 2024-03-04 06:40:11.20954192 +0000 UTC m=+0.332403802 container start 80efb24031c2e622c9f7f61e69fb402173797b12935b2f01fc9fcf460aef8c21 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:40:11.256 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.232Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-04T06:40:11.256 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.232Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-04T06:40:11.256 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.232Z caller=main.go:570 level=info host_details="(Linux 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 x86_64 smithi203 (none))" 2024-03-04T06:40:11.256 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.232Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-04T06:40:11.256 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.232Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-04T06:40:11.256 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.233Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-04T06:40:11.256 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.234Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-04T06:40:11.256 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.235Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-04T06:40:11.257 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.235Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-04T06:40:11.257 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.237Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-04T06:40:11.257 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.237Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.381µs 2024-03-04T06:40:11.257 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.237Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-04T06:40:11.257 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.238Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-03-04T06:40:11.257 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.238Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-03-04T06:40:11.257 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.238Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=17.9µs wal_replay_duration=1.599057ms wbl_replay_duration=89ns total_replay_duration=1.633961ms 2024-03-04T06:40:11.257 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.239Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-04T06:40:11.257 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.239Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-04T06:40:11.257 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.239Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-04T06:40:11.257 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.255Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=16.2982ms db_storage=836ns remote_storage=1.085µs web_handler=427ns query_engine=467ns scrape=360.558µs scrape_sd=83.695µs notify=9.174µs notify_sd=7.767µs rules=15.636438ms tracing=5.285µs 2024-03-04T06:40:11.257 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.255Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-04T06:40:11.257 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:40:11.255Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-04T06:40:11.526 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Bus STOPPING 2024-03-04T06:40:11.526 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T06:40:11.526 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Bus STOPPED 2024-03-04T06:40:11.526 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Bus STARTING 2024-03-04T06:40:11.527 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Serving on http://:::9283 2024-03-04T06:40:11.559 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-03-04T06:40:11.572 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T06:40:11.595 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 bash[62806]: 80efb24031c2e622c9f7f61e69fb402173797b12935b2f01fc9fcf460aef8c21 2024-03-04T06:40:11.596 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:40:11 smithi203 systemd[1]: Started Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:40:11.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Bus STARTED 2024-03-04T06:40:11.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Bus STOPPING 2024-03-04T06:40:11.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T06:40:11.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Bus STOPPED 2024-03-04T06:40:11.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Bus STARTING 2024-03-04T06:40:11.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Serving on http://:::9283 2024-03-04T06:40:11.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Bus STARTED 2024-03-04T06:40:11.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Bus STOPPING 2024-03-04T06:40:11.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T06:40:11.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Bus STOPPED 2024-03-04T06:40:11.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Bus STARTING 2024-03-04T06:40:11.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Serving on http://:::9283 2024-03-04T06:40:11.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:11] ENGINE Bus STARTED 2024-03-04T06:40:11.881 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-03-04T06:40:11.895 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-04T06:40:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: pgmap v52: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1713323472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:40:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/83539781' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:40:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-04T06:40:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi137.front.sepia.ceph.com:9093"}]: dispatch 2024-03-04T06:40:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:40:12.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi203.front.sepia.ceph.com:9095"}]: dispatch 2024-03-04T06:40:12.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-04T06:40:12.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi203.front.sepia.ceph.com:3000"}]: dispatch 2024-03-04T06:40:12.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:40:12.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:11 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1413382448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T06:40:12.118 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: pgmap v52: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:12.118 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1713323472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:40:12.118 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/83539781' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:40:12.118 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.118 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.118 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-04T06:40:12.118 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi137.front.sepia.ceph.com:9093"}]: dispatch 2024-03-04T06:40:12.118 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.118 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:40:12.118 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi203.front.sepia.ceph.com:9095"}]: dispatch 2024-03-04T06:40:12.118 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.118 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-04T06:40:12.118 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi203.front.sepia.ceph.com:3000"}]: dispatch 2024-03-04T06:40:12.119 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.119 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:40:12.119 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1413382448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T06:40:12.119 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: pgmap v52: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:12.119 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1713323472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:40:12.119 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/83539781' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T06:40:12.119 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.119 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.119 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-04T06:40:12.119 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi137.front.sepia.ceph.com:9093"}]: dispatch 2024-03-04T06:40:12.119 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.119 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:40:12.119 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi203.front.sepia.ceph.com:9095"}]: dispatch 2024-03-04T06:40:12.120 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.120 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-04T06:40:12.120 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi203.front.sepia.ceph.com:3000"}]: dispatch 2024-03-04T06:40:12.120 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:12.120 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:40:12.120 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:11 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1413382448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T06:40:12.189 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 8 2024-03-04T06:40:12.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T06:40:12.529 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:40:12.529 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3869447426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3869447426},{"type":"v1","addr":"172.21.15.137:6835","nonce":3869447426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T06:38:12.879589+0000","modified":"2024-03-04T06:38:14.885821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24352":{"gid":24352,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6833/3636376444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3636376444},{"type":"v1","addr":"172.21.15.203:6833","nonce":3636376444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-04T06:40:12.529 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 6 2024-03-04T06:40:12.542 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T06:40:12.878 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:40:12.879 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":69,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:39:45.822007+0000","last_up_change":"2024-03-04T06:37:54.799220+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T06:38:11.049505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T06:38:12.066145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-04T06:38:45.908437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6803","nonce":120753079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6805","nonce":120753079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6809","nonce":120753079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":120753079},{"type":"v1","addr":"172.21.15.137:6807","nonce":120753079}]},"public_addr":"172.21.15.137:6803/120753079","cluster_addr":"172.21.15.137:6805/120753079","heartbeat_back_addr":"172.21.15.137:6809/120753079","heartbeat_front_addr":"172.21.15.137:6807/120753079","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6811","nonce":2976801936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6813","nonce":2976801936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6817","nonce":2976801936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2976801936},{"type":"v1","addr":"172.21.15.137:6815","nonce":2976801936}]},"public_addr":"172.21.15.137:6811/2976801936","cluster_addr":"172.21.15.137:6813/2976801936","heartbeat_back_addr":"172.21.15.137:6817/2976801936","heartbeat_front_addr":"172.21.15.137:6815/2976801936","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6819","nonce":788153355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6821","nonce":788153355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6825","nonce":788153355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":788153355},{"type":"v1","addr":"172.21.15.137:6823","nonce":788153355}]},"public_addr":"172.21.15.137:6819/788153355","cluster_addr":"172.21.15.137:6821/788153355","heartbeat_back_addr":"172.21.15.137:6825/788153355","heartbeat_front_addr":"172.21.15.137:6823/788153355","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6827","nonce":1906308615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6829","nonce":1906308615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6833","nonce":1906308615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1906308615},{"type":"v1","addr":"172.21.15.137:6831","nonce":1906308615}]},"public_addr":"172.21.15.137:6827/1906308615","cluster_addr":"172.21.15.137:6829/1906308615","heartbeat_back_addr":"172.21.15.137:6833/1906308615","heartbeat_front_addr":"172.21.15.137:6831/1906308615","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6801","nonce":483489448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6803","nonce":483489448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6807","nonce":483489448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":483489448},{"type":"v1","addr":"172.21.15.203:6805","nonce":483489448}]},"public_addr":"172.21.15.203:6801/483489448","cluster_addr":"172.21.15.203:6803/483489448","heartbeat_back_addr":"172.21.15.203:6807/483489448","heartbeat_front_addr":"172.21.15.203:6805/483489448","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6809","nonce":1227714102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6811","nonce":1227714102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6815","nonce":1227714102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1227714102},{"type":"v1","addr":"172.21.15.203:6813","nonce":1227714102}]},"public_addr":"172.21.15.203:6809/1227714102","cluster_addr":"172.21.15.203:6811/1227714102","heartbeat_back_addr":"172.21.15.203:6815/1227714102","heartbeat_front_addr":"172.21.15.203:6813/1227714102","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6817","nonce":593999121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6819","nonce":593999121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6823","nonce":593999121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":593999121},{"type":"v1","addr":"172.21.15.203:6821","nonce":593999121}]},"public_addr":"172.21.15.203:6817/593999121","cluster_addr":"172.21.15.203:6819/593999121","heartbeat_back_addr":"172.21.15.203:6823/593999121","heartbeat_front_addr":"172.21.15.203:6821/593999121","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6825","nonce":4089764819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6827","nonce":4089764819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6831","nonce":4089764819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":4089764819},{"type":"v1","addr":"172.21.15.203:6829","nonce":4089764819}]},"public_addr":"172.21.15.203:6825/4089764819","cluster_addr":"172.21.15.203:6827/4089764819","heartbeat_back_addr":"172.21.15.203:6831/4089764819","heartbeat_front_addr":"172.21.15.203:6829/4089764819","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1","mappings":[{"from":0,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.13","mappings":[{"from":4,"to":3}]},{"pgid":"3.15","mappings":[{"from":4,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/3119089659":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/1351645377":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/2769280127":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6801/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3274678870":"2024-03-05T06:38:44.723555+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6800/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T06:40:12.894 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T06:40:13.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:12 smithi203 ceph-mon[30756]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-04T06:40:13.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:12 smithi203 ceph-mon[30756]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi137.front.sepia.ceph.com:9093"}]: dispatch 2024-03-04T06:40:13.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:12 smithi203 ceph-mon[30756]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:40:13.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:12 smithi203 ceph-mon[30756]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi203.front.sepia.ceph.com:9095"}]: dispatch 2024-03-04T06:40:13.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:12 smithi203 ceph-mon[30756]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-04T06:40:13.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:12 smithi203 ceph-mon[30756]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi203.front.sepia.ceph.com:3000"}]: dispatch 2024-03-04T06:40:13.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:12 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1111000533' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T06:40:13.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:12 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3765126040' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-03-04T06:40:13.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:12 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3550983350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:40:13.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[26846]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-04T06:40:13.195 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[26846]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi137.front.sepia.ceph.com:9093"}]: dispatch 2024-03-04T06:40:13.195 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[26846]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:40:13.195 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[26846]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi203.front.sepia.ceph.com:9095"}]: dispatch 2024-03-04T06:40:13.195 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[26846]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-04T06:40:13.195 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[26846]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi203.front.sepia.ceph.com:3000"}]: dispatch 2024-03-04T06:40:13.195 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1111000533' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T06:40:13.195 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3765126040' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-03-04T06:40:13.195 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3550983350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:40:13.195 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[37364]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-04T06:40:13.195 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[37364]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi137.front.sepia.ceph.com:9093"}]: dispatch 2024-03-04T06:40:13.195 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[37364]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:40:13.195 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[37364]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi203.front.sepia.ceph.com:9095"}]: dispatch 2024-03-04T06:40:13.195 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[37364]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-04T06:40:13.196 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[37364]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi203.front.sepia.ceph.com:3000"}]: dispatch 2024-03-04T06:40:13.196 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1111000533' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T06:40:13.196 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3765126040' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-03-04T06:40:13.196 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:12 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3550983350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:40:13.232 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:40:13.232 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3869447426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3869447426},{"type":"v1","addr":"172.21.15.137:6835","nonce":3869447426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T06:38:12.879589+0000","modified":"2024-03-04T06:38:14.885821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24352":{"gid":24352,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6833/3636376444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3636376444},{"type":"v1","addr":"172.21.15.203:6833","nonce":3636376444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-04T06:40:13.232 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 6 2024-03-04T06:40:13.245 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-04T06:38:12.879589+0000', 'modified': '2024-03-04T06:38:14.885821+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24352}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24352': {'gid': 24352, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.203:6833/3636376444', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6832', 'nonce': 3636376444}, {'type': 'v1', 'addr': '172.21.15.203:6833', 'nonce': 3636376444}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-04T06:40:13.245 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-04T06:40:13.245 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-04T06:40:13.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-04T06:40:13.357+0000 7fa9eaffd640 0 client.24830 ms_handle_reset on v2:172.21.15.203:6832/3636376444 2024-03-04T06:40:13.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-03-04T06:40:13.375+0000 7fa9eaffd640 0 client.24836 ms_handle_reset on v2:172.21.15.203:6832/3636376444 2024-03-04T06:40:13.377 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:40:13.377 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "d83bc156-d9f0-11ee-95c6-87774f69a715", 2024-03-04T06:40:13.377 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-03-04T06:40:13.377 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 24352, 2024-03-04T06:40:13.377 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-03-04T06:40:13.377 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-03-04T06:40:13.377 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-03-04T06:40:13.377 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 120.494798024, 2024-03-04T06:40:13.377 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 6, 2024-03-04T06:40:13.377 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 69, 2024-03-04T06:40:13.378 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 62, 2024-03-04T06:40:13.378 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 125.377760091 2024-03-04T06:40:13.378 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:40:13.388 INFO:tasks.cephadm:Setup complete, yielding 2024-03-04T06:40:13.388 INFO:teuthology.run_tasks:Running task print... 2024-03-04T06:40:13.397 INFO:teuthology.task.print:**** done end installing reef cephadm ... 2024-03-04T06:40:13.397 INFO:teuthology.run_tasks:Running task print... 2024-03-04T06:40:13.432 INFO:teuthology.task.print:**** done start cephadm.shell ceph config set mgr... 2024-03-04T06:40:13.432 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-04T06:40:13.485 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi137.front.sepia.ceph.com 2024-03-04T06:40:13.486 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-03-04T06:40:13.725 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:40:14.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:13 smithi203 ceph-mon[30756]: pgmap v53: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:14.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:13 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1596451297' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:40:14.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:13 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1664981285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:40:14.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:13 smithi137 ceph-mon[26846]: pgmap v53: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:14.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:13 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1596451297' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:40:14.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:13 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1664981285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:40:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:13 smithi137 ceph-mon[37364]: pgmap v53: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:13 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1596451297' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:40:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:13 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1664981285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T06:40:15.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:15 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:15 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:15 smithi203 ceph-mon[30756]: pgmap v54: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:15.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:15 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:40:15.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:15 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:15 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:15 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:40:15.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:15 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:40:15.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:15 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.638 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[73354]: ts=2024-03-04T06:40:15.307Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003712762s 2024-03-04T06:40:15.638 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.638 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.638 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[26846]: pgmap v54: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:15.638 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:40:15.639 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.639 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.639 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:40:15.639 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:40:15.639 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.639 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.639 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.639 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[37364]: pgmap v54: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:15.639 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:40:15.639 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.639 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:15.639 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:40:15.640 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:40:15.640 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:15 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:16.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:16] ENGINE Bus STOPPING 2024-03-04T06:40:16.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:16] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T06:40:16.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:16] ENGINE Bus STOPPED 2024-03-04T06:40:16.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:16] ENGINE Bus STARTING 2024-03-04T06:40:16.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:16] ENGINE Serving on http://:::9283 2024-03-04T06:40:16.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:40:16] ENGINE Bus STARTED 2024-03-04T06:40:17.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-mon[26846]: mgrmap e21: y(active, since 91s), standbys: x 2024-03-04T06:40:17.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/137974269' entity='client.admin' 2024-03-04T06:40:17.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:40:17.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-mon[26846]: pgmap v55: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:17.031 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-mon[37364]: mgrmap e21: y(active, since 91s), standbys: x 2024-03-04T06:40:17.031 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/137974269' entity='client.admin' 2024-03-04T06:40:17.031 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:40:17.031 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:16 smithi137 ceph-mon[37364]: pgmap v55: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:17.052 INFO:teuthology.run_tasks:Running task print... 2024-03-04T06:40:17.061 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-03-04T06:40:17.061 INFO:teuthology.run_tasks:Running task print... 2024-03-04T06:40:17.107 INFO:teuthology.task.print:**** done start telemetry reef... 2024-03-04T06:40:17.107 INFO:teuthology.run_tasks:Running task workunit... 2024-03-04T06:40:17.161 INFO:tasks.workunit:Pulling workunits from ref efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:40:17.161 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-04T06:40:17.162 DEBUG:teuthology.orchestra.run.smithi137:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-04T06:40:17.163 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:16 smithi203 ceph-mon[30756]: mgrmap e21: y(active, since 91s), standbys: x 2024-03-04T06:40:17.163 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:16 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/137974269' entity='client.admin' 2024-03-04T06:40:17.163 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:16 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:40:17.163 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:16 smithi203 ceph-mon[30756]: pgmap v55: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:17.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T06:40:17.176 INFO:teuthology.orchestra.run.smithi137.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-04T06:40:17.177 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T06:40:17.231 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-04T06:40:17.232 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-04T06:40:17.286 INFO:tasks.workunit:timeout=3h 2024-03-04T06:40:17.286 INFO:tasks.workunit:cleanup=True 2024-03-04T06:40:17.287 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:40:17.342 INFO:tasks.workunit.client.0.smithi137.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-04T06:40:20.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:19 smithi203 ceph-mon[30756]: pgmap v56: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:20.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:19 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:19 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:19 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:19 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:19 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:40:20.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:19 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:40:20.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:19 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[26846]: pgmap v56: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:40:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:40:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[37364]: pgmap v56: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:40:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:40:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:19 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:40:21.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:21 smithi203 ceph-mon[30756]: pgmap v57: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:21 smithi137 ceph-mon[26846]: pgmap v57: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:21 smithi137 ceph-mon[37364]: pgmap v57: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:24.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:23 smithi203 ceph-mon[30756]: pgmap v58: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:24.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:23 smithi137 ceph-mon[26846]: pgmap v58: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:24.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:23 smithi137 ceph-mon[37364]: pgmap v58: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:25.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:40:25] "GET /metrics HTTP/1.1" 200 33649 "" "Prometheus/2.43.0" 2024-03-04T06:40:26.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:25 smithi203 ceph-mon[30756]: pgmap v59: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:26.289 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:25 smithi137 ceph-mon[26846]: pgmap v59: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:26.290 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:25 smithi137 ceph-mon[37364]: pgmap v59: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:28.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:27 smithi203 ceph-mon[30756]: pgmap v60: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:28.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:27 smithi137 ceph-mon[26846]: pgmap v60: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:28.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:27 smithi137 ceph-mon[37364]: pgmap v60: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-04T06:40:30.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:29 smithi203 ceph-mon[30756]: pgmap v61: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:30.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:29 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:40:30.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:29 smithi137 ceph-mon[26846]: pgmap v61: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:30.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:29 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:40:30.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:29 smithi137 ceph-mon[37364]: pgmap v61: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:30.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:29 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:40:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:31 smithi203 ceph-mon[30756]: pgmap v62: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:31.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:31 smithi137 ceph-mon[26846]: pgmap v62: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:31.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:31 smithi137 ceph-mon[37364]: pgmap v62: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:34.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:33 smithi203 ceph-mon[30756]: pgmap v63: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:34.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:33 smithi137 ceph-mon[26846]: pgmap v63: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:34.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:33 smithi137 ceph-mon[37364]: pgmap v63: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:35.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:40:35] "GET /metrics HTTP/1.1" 200 33643 "" "Prometheus/2.43.0" 2024-03-04T06:40:36.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:35 smithi203 ceph-mon[30756]: pgmap v64: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:36.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:35 smithi137 ceph-mon[26846]: pgmap v64: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:36.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:35 smithi137 ceph-mon[37364]: pgmap v64: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:38.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:37 smithi203 ceph-mon[30756]: pgmap v65: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:38.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:37 smithi137 ceph-mon[26846]: pgmap v65: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:38.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:37 smithi137 ceph-mon[37364]: pgmap v65: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:40.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:39 smithi203 ceph-mon[30756]: pgmap v66: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:40.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:39 smithi137 ceph-mon[26846]: pgmap v66: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:40.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:39 smithi137 ceph-mon[37364]: pgmap v66: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:41 smithi203 ceph-mon[30756]: pgmap v67: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:41 smithi137 ceph-mon[26846]: pgmap v67: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:41.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:41 smithi137 ceph-mon[37364]: pgmap v67: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:43 smithi203 ceph-mon[30756]: pgmap v68: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:43 smithi137 ceph-mon[26846]: pgmap v68: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:44.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:43 smithi137 ceph-mon[37364]: pgmap v68: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:40:45.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:40:45.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:40:45.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:40:45] "GET /metrics HTTP/1.1" 200 33646 "" "Prometheus/2.43.0" 2024-03-04T06:40:46.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:45 smithi203 ceph-mon[30756]: pgmap v69: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:46.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:45 smithi137 ceph-mon[26846]: pgmap v69: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:46.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:45 smithi137 ceph-mon[37364]: pgmap v69: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:48.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:47 smithi203 ceph-mon[30756]: pgmap v70: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:48.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:47 smithi137 ceph-mon[26846]: pgmap v70: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:48.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:47 smithi137 ceph-mon[37364]: pgmap v70: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:50.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:49 smithi203 ceph-mon[30756]: pgmap v71: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:49 smithi137 ceph-mon[26846]: pgmap v71: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:50.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:49 smithi137 ceph-mon[37364]: pgmap v71: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:51 smithi203 ceph-mon[30756]: pgmap v72: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:51.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:51 smithi137 ceph-mon[26846]: pgmap v72: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:51 smithi137 ceph-mon[37364]: pgmap v72: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:54.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:53 smithi203 ceph-mon[30756]: pgmap v73: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:54.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:53 smithi137 ceph-mon[26846]: pgmap v73: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:54.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:53 smithi137 ceph-mon[37364]: pgmap v73: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:55.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:40:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:40:55] "GET /metrics HTTP/1.1" 200 33646 "" "Prometheus/2.43.0" 2024-03-04T06:40:56.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:55 smithi203 ceph-mon[30756]: pgmap v74: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:56.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:55 smithi137 ceph-mon[26846]: pgmap v74: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:56.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:55 smithi137 ceph-mon[37364]: pgmap v74: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:58.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:57 smithi203 ceph-mon[30756]: pgmap v75: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:58.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:57 smithi137 ceph-mon[26846]: pgmap v75: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:40:58.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:57 smithi137 ceph-mon[37364]: pgmap v75: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:00.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:59 smithi203 ceph-mon[30756]: pgmap v76: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:00.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:40:59 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:41:00.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:59 smithi137 ceph-mon[26846]: pgmap v76: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:00.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:40:59 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:41:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:59 smithi137 ceph-mon[37364]: pgmap v76: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:40:59 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:41:01.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:01 smithi203 ceph-mon[30756]: pgmap v77: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:01.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:01 smithi137 ceph-mon[26846]: pgmap v77: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:01.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:01 smithi137 ceph-mon[37364]: pgmap v77: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:04.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:03 smithi203 ceph-mon[30756]: pgmap v78: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:03 smithi137 ceph-mon[26846]: pgmap v78: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:03 smithi137 ceph-mon[37364]: pgmap v78: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:05.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:41:05] "GET /metrics HTTP/1.1" 200 33656 "" "Prometheus/2.43.0" 2024-03-04T06:41:06.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:05 smithi203 ceph-mon[30756]: pgmap v79: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:06.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:05 smithi137 ceph-mon[26846]: pgmap v79: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:05 smithi137 ceph-mon[37364]: pgmap v79: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:08.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:07 smithi203 ceph-mon[30756]: pgmap v80: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:08.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:07 smithi137 ceph-mon[26846]: pgmap v80: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:08.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:07 smithi137 ceph-mon[37364]: pgmap v80: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:10.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:09 smithi203 ceph-mon[30756]: pgmap v81: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:09 smithi137 ceph-mon[26846]: pgmap v81: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:10.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:09 smithi137 ceph-mon[37364]: pgmap v81: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:11.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:11 smithi203 ceph-mon[30756]: pgmap v82: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:11 smithi137 ceph-mon[26846]: pgmap v82: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:11.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:11 smithi137 ceph-mon[37364]: pgmap v82: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:14.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:13 smithi203 ceph-mon[30756]: pgmap v83: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:14.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:13 smithi137 ceph-mon[26846]: pgmap v83: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:13 smithi137 ceph-mon[37364]: pgmap v83: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:15.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:14 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:41:15.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:14 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:41:15.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:14 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:41:15.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:41:15] "GET /metrics HTTP/1.1" 200 33657 "" "Prometheus/2.43.0" 2024-03-04T06:41:16.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:15 smithi203 ceph-mon[30756]: pgmap v84: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:16.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:15 smithi137 ceph-mon[26846]: pgmap v84: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:16.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:15 smithi137 ceph-mon[37364]: pgmap v84: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:18.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:17 smithi203 ceph-mon[30756]: pgmap v85: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:17 smithi137 ceph-mon[26846]: pgmap v85: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:18.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:17 smithi137 ceph-mon[37364]: pgmap v85: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:20.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:19 smithi203 ceph-mon[30756]: pgmap v86: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:20.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:19 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:19 smithi137 ceph-mon[26846]: pgmap v86: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:19 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:20.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:19 smithi137 ceph-mon[37364]: pgmap v86: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:20.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:19 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:21.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:20 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:21.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:20 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:21.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:20 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:21.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:20 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:21.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:20 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:21.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:20 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:21.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:20 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:21.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:20 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:21.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:20 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:22.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:21 smithi203 ceph-mon[30756]: pgmap v87: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:22.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:21 smithi137 ceph-mon[37364]: pgmap v87: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:22.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:21 smithi137 ceph-mon[26846]: pgmap v87: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:24.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:23 smithi137 ceph-mon[26846]: pgmap v88: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:24.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:23 smithi137 ceph-mon[37364]: pgmap v88: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:24.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:23 smithi203 ceph-mon[30756]: pgmap v88: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:25.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:41:25] "GET /metrics HTTP/1.1" 200 33657 "" "Prometheus/2.43.0" 2024-03-04T06:41:26.148 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:25 smithi203 ceph-mon[30756]: pgmap v89: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:26.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:25 smithi137 ceph-mon[26846]: pgmap v89: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:26.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:25 smithi137 ceph-mon[37364]: pgmap v89: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:28.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:27 smithi137 ceph-mon[26846]: pgmap v90: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:28.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:27 smithi137 ceph-mon[37364]: pgmap v90: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:28.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:27 smithi203 ceph-mon[30756]: pgmap v90: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:30.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:29 smithi137 ceph-mon[26846]: pgmap v91: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:30.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:29 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:41:30.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:29 smithi137 ceph-mon[37364]: pgmap v91: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:30.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:29 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:41:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:29 smithi203 ceph-mon[30756]: pgmap v91: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:29 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:41:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:31 smithi203 ceph-mon[30756]: pgmap v92: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:31.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:31 smithi137 ceph-mon[26846]: pgmap v92: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:31.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:31 smithi137 ceph-mon[37364]: pgmap v92: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:34.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:33 smithi203 ceph-mon[30756]: pgmap v93: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:34.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:33 smithi137 ceph-mon[26846]: pgmap v93: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:34.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:33 smithi137 ceph-mon[37364]: pgmap v93: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:35.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:41:35] "GET /metrics HTTP/1.1" 200 33656 "" "Prometheus/2.43.0" 2024-03-04T06:41:36.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:35 smithi203 ceph-mon[30756]: pgmap v94: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:36.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:35 smithi137 ceph-mon[26846]: pgmap v94: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:36.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:35 smithi137 ceph-mon[37364]: pgmap v94: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:38.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:37 smithi203 ceph-mon[30756]: pgmap v95: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:38.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:37 smithi137 ceph-mon[26846]: pgmap v95: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:38.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:37 smithi137 ceph-mon[37364]: pgmap v95: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:40.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:39 smithi203 ceph-mon[30756]: pgmap v96: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:40.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:39 smithi137 ceph-mon[26846]: pgmap v96: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:40.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:39 smithi137 ceph-mon[37364]: pgmap v96: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:41 smithi203 ceph-mon[30756]: pgmap v97: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:41 smithi137 ceph-mon[26846]: pgmap v97: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:41.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:41 smithi137 ceph-mon[37364]: pgmap v97: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:43 smithi203 ceph-mon[30756]: pgmap v98: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:43 smithi137 ceph-mon[26846]: pgmap v98: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:44.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:43 smithi137 ceph-mon[37364]: pgmap v98: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:44 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:41:45.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:44 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:41:45.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:44 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:41:45.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:41:45] "GET /metrics HTTP/1.1" 200 33657 "" "Prometheus/2.43.0" 2024-03-04T06:41:46.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:45 smithi203 ceph-mon[30756]: pgmap v99: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:46.231 INFO:tasks.workunit.client.0.smithi137.stderr:Note: switching to 'efb04e5e69d058b0c47e511cb7e10d57a92f59ae'. 2024-03-04T06:41:46.231 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-03-04T06:41:46.231 INFO:tasks.workunit.client.0.smithi137.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-04T06:41:46.232 INFO:tasks.workunit.client.0.smithi137.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-04T06:41:46.232 INFO:tasks.workunit.client.0.smithi137.stderr:state without impacting any branches by switching back to a branch. 2024-03-04T06:41:46.232 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-03-04T06:41:46.232 INFO:tasks.workunit.client.0.smithi137.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-04T06:41:46.232 INFO:tasks.workunit.client.0.smithi137.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-04T06:41:46.232 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-03-04T06:41:46.232 INFO:tasks.workunit.client.0.smithi137.stderr: git switch -c 2024-03-04T06:41:46.232 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-03-04T06:41:46.232 INFO:tasks.workunit.client.0.smithi137.stderr:Or undo this operation with: 2024-03-04T06:41:46.232 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-03-04T06:41:46.232 INFO:tasks.workunit.client.0.smithi137.stderr: git switch - 2024-03-04T06:41:46.232 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-03-04T06:41:46.233 INFO:tasks.workunit.client.0.smithi137.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-04T06:41:46.233 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-03-04T06:41:46.233 INFO:tasks.workunit.client.0.smithi137.stderr:HEAD is now at efb04e5e69d Merge branch 'wip-mgr-optracker' of https://github.com/pdvian/ceph into wip-yuri-testing-2024-03-01-0756 2024-03-04T06:41:46.235 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-04T06:41:46.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:45 smithi137 ceph-mon[26846]: pgmap v99: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:46.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:45 smithi137 ceph-mon[37364]: pgmap v99: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:46.301 INFO:tasks.workunit.client.0.smithi137.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-04T06:41:46.304 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T06:41:46.304 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-04T06:41:47.078 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-04T06:41:47.143 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-04T06:41:47.182 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T06:41:47.184 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T06:41:47.184 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-04T06:41:47.222 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T06:41:47.225 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-03-04T06:41:47.225 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-04T06:41:47.280 INFO:tasks.workunit:Running workunits matching test_telemetry_reef.sh on client.0... 2024-03-04T06:41:47.281 INFO:tasks.workunit:Running workunit test_telemetry_reef.sh... 2024-03-04T06:41:47.281 DEBUG:teuthology.orchestra.run.smithi137:workunit test test_telemetry_reef.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=efb04e5e69d058b0c47e511cb7e10d57a92f59ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/test_telemetry_reef.sh 2024-03-04T06:41:47.338 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph config set mgr mgr/telemetry/channel_ident true 2024-03-04T06:41:47.726 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph config set mgr mgr/telemetry/organization ceph-qa 2024-03-04T06:41:48.003 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-mon[26846]: pgmap v100: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:48.003 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-mon[26846]: from='client.? ' entity='client.admin' 2024-03-04T06:41:48.003 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:48.003 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:48.003 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:48.003 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:48.003 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-mon[37364]: pgmap v100: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:48.004 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-mon[37364]: from='client.? ' entity='client.admin' 2024-03-04T06:41:48.004 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:48.004 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:48.004 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:48.004 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:48.004 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:47] ENGINE Bus STOPPING 2024-03-04T06:41:48.004 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:47] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T06:41:48.004 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:47] ENGINE Bus STOPPED 2024-03-04T06:41:48.004 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:47] ENGINE Bus STARTING 2024-03-04T06:41:48.004 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:47] ENGINE Serving on http://:::9283 2024-03-04T06:41:48.004 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:47] ENGINE Bus STARTED 2024-03-04T06:41:48.005 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:48] ENGINE Bus STOPPING 2024-03-04T06:41:48.121 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph config set mgr mgr/telemetry/description 'upgrade test cluster' 2024-03-04T06:41:48.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:48] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T06:41:48.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:48] ENGINE Bus STOPPED 2024-03-04T06:41:48.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:48] ENGINE Bus STARTING 2024-03-04T06:41:48.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:48] ENGINE Serving on http://:::9283 2024-03-04T06:41:48.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:48] ENGINE Bus STARTED 2024-03-04T06:41:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:47 smithi203 ceph-mon[30756]: pgmap v100: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:47 smithi203 ceph-mon[30756]: from='client.? ' entity='client.admin' 2024-03-04T06:41:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:47 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:47 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:47 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:47 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:48.509 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph telemetry preview 2024-03-04T06:41:48.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:48] ENGINE Bus STOPPING 2024-03-04T06:41:48.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:48] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T06:41:48.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:48] ENGINE Bus STOPPED 2024-03-04T06:41:48.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:48] ENGINE Bus STARTING 2024-03-04T06:41:48.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:48] ENGINE Serving on http://:::9283 2024-03-04T06:41:48.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:48] ENGINE Bus STARTED 2024-03-04T06:41:49.007 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-03-04T06:41:49.007 INFO:tasks.workunit.client.0.smithi137.stdout: "balancer": { 2024-03-04T06:41:49.007 INFO:tasks.workunit.client.0.smithi137.stdout: "active": true, 2024-03-04T06:41:49.007 INFO:tasks.workunit.client.0.smithi137.stdout: "mode": "" 2024-03-04T06:41:49.007 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.007 INFO:tasks.workunit.client.0.smithi137.stdout: "channels": [ 2024-03-04T06:41:49.007 INFO:tasks.workunit.client.0.smithi137.stdout: "basic", 2024-03-04T06:41:49.008 INFO:tasks.workunit.client.0.smithi137.stdout: "crash", 2024-03-04T06:41:49.008 INFO:tasks.workunit.client.0.smithi137.stdout: "device", 2024-03-04T06:41:49.008 INFO:tasks.workunit.client.0.smithi137.stdout: "ident" 2024-03-04T06:41:49.008 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.008 INFO:tasks.workunit.client.0.smithi137.stdout: "channels_available": [ 2024-03-04T06:41:49.008 INFO:tasks.workunit.client.0.smithi137.stdout: "basic", 2024-03-04T06:41:49.008 INFO:tasks.workunit.client.0.smithi137.stdout: "ident", 2024-03-04T06:41:49.008 INFO:tasks.workunit.client.0.smithi137.stdout: "crash", 2024-03-04T06:41:49.008 INFO:tasks.workunit.client.0.smithi137.stdout: "device", 2024-03-04T06:41:49.008 INFO:tasks.workunit.client.0.smithi137.stdout: "perf" 2024-03-04T06:41:49.008 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.008 INFO:tasks.workunit.client.0.smithi137.stdout: "collections_available": [ 2024-03-04T06:41:49.008 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_base", 2024-03-04T06:41:49.009 INFO:tasks.workunit.client.0.smithi137.stdout: "device_base", 2024-03-04T06:41:49.009 INFO:tasks.workunit.client.0.smithi137.stdout: "crash_base", 2024-03-04T06:41:49.009 INFO:tasks.workunit.client.0.smithi137.stdout: "ident_base", 2024-03-04T06:41:49.009 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_perf", 2024-03-04T06:41:49.009 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_mds_metadata", 2024-03-04T06:41:49.009 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_usage", 2024-03-04T06:41:49.009 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_usage_by_class", 2024-03-04T06:41:49.009 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_rook_v01", 2024-03-04T06:41:49.009 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_memory_metrics", 2024-03-04T06:41:49.009 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_options_bluestore" 2024-03-04T06:41:49.009 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.009 INFO:tasks.workunit.client.0.smithi137.stdout: "collections_opted_in": [ 2024-03-04T06:41:49.009 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_base", 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: "device_base", 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: "crash_base", 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: "ident_base", 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_perf", 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_mds_metadata", 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_usage", 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_usage_by_class", 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_rook_v01", 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_memory_metrics", 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_options_bluestore" 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: "config": { 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: "active_changed": [ 2024-03-04T06:41:49.010 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_debug", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_mon_ticket_ttl", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_service_ticket_ttl", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "bdev_debug_aio", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "client_check_pool_perm", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "client_mount_gid", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "client_mount_uid", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "client_quota", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "container_image", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "daemonize", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_asserts_on_shutdown", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mgr", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mon", 2024-03-04T06:41:49.011 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_ms", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_osd", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_paxos", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "keyring", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_block_size", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_cache_size", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_compression", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_log", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_write_buffer_size", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_file", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_journald", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_stderr", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_allow_pool_delete", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_clock_drift_allowed", 2024-03-04T06:41:49.012 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_file_level", 2024-03-04T06:41:49.013 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_file", 2024-03-04T06:41:49.013 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_journald", 2024-03-04T06:41:49.013 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_stderr", 2024-03-04T06:41:49.013 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_data_avail_warn", 2024-03-04T06:41:49.013 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_election_default_strategy", 2024-03-04T06:41:49.013 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_host", 2024-03-04T06:41:49.013 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_max_pg_per_osd", 2024-03-04T06:41:49.013 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_mgr_mkfs_grace", 2024-03-04T06:41:49.013 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_prime_pg_temp", 2024-03-04T06:41:49.013 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_reporter_subtree_level", 2024-03-04T06:41:49.013 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_pg_warn_max_object_skew", 2024-03-04T06:41:49.013 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-04T06:41:49.013 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-04T06:41:49.014 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-04T06:41:49.014 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-04T06:41:49.014 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-04T06:41:49.014 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-04T06:41:49.014 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-04T06:41:49.014 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-04T06:41:49.014 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_too_few_osds", 2024-03-04T06:41:49.014 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_bug", 2024-03-04T06:41:49.014 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_old_message", 2024-03-04T06:41:49.014 INFO:tasks.workunit.client.0.smithi137.stdout: "no_config_file", 2024-03-04T06:41:49.014 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_default_list", 2024-03-04T06:41:49.014 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_load_list", 2024-03-04T06:41:49.014 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_crush_chooseleaf_type", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_misdirected_ops", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_op_order", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_pg_log_writeout", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_shutdown", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_cached_snaps", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_missing_on_start", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_stray_on_activate", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_profile", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-03-04T06:41:49.015 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-03-04T06:41:49.016 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-03-04T06:41:49.016 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_client_lim", 2024-03-04T06:41:49.016 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_client_res", 2024-03-04T06:41:49.016 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_client_wgt", 2024-03-04T06:41:49.016 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target", 2024-03-04T06:41:49.016 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target_autotune", 2024-03-04T06:41:49.016 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue", 2024-03-04T06:41:49.016 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue_cut_off", 2024-03-04T06:41:49.016 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_erasure_code_profile", 2024-03-04T06:41:49.016 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-04T06:41:49.016 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recover_clone_overlap", 2024-03-04T06:41:49.016 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recovery_max_chunk", 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_load_threshold", 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_max_interval", 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_shutdown_pgref_assert", 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: "public_addr", 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: "public_addrv", 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: "public_network", 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd_default_features", 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd_qos_exclude_ops", 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: "setgroup", 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: "setuser" 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: "cluster_changed": [ 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-04T06:41:49.017 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_debug", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_mon_ticket_ttl", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_service_ticket_ttl", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "bdev_debug_aio", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "container_image", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_asserts_on_shutdown", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mgr", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mon", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_ms", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_osd", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_paxos", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_file", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_journald", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_stderr", 2024-03-04T06:41:49.018 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_join_fs", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/allow_ptrace", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/container_init", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/migration_current", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/use_repo_digest", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/ssl_server_port", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/orchestrator/orchestrator", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/channel_ident", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/description", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/organization", 2024-03-04T06:41:49.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_allow_pool_delete", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_clock_drift_allowed", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_file_level", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_file", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_data_avail_warn", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_election_default_strategy", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_max_pg_per_osd", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_mgr_mkfs_grace", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_prime_pg_temp", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_reporter_subtree_level", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_pg_warn_max_object_skew", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-04T06:41:49.020 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_too_few_osds", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_bug", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_old_message", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_default_list", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_load_list", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_misdirected_ops", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_op_order", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_pg_log_writeout", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_shutdown", 2024-03-04T06:41:49.021 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_cached_snaps", 2024-03-04T06:41:49.022 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_missing_on_start", 2024-03-04T06:41:49.022 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_stray_on_activate", 2024-03-04T06:41:49.022 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-04T06:41:49.022 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_profile", 2024-03-04T06:41:49.022 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target", 2024-03-04T06:41:49.022 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target_autotune", 2024-03-04T06:41:49.022 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue", 2024-03-04T06:41:49.022 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue_cut_off", 2024-03-04T06:41:49.022 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_erasure_code_profile", 2024-03-04T06:41:49.022 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-04T06:41:49.022 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recover_clone_overlap", 2024-03-04T06:41:49.022 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recovery_max_chunk", 2024-03-04T06:41:49.022 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_load_threshold", 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_max_interval", 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_shutdown_pgref_assert", 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: "public_network", 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: "rgw_cache_enabled", 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: "rgw_enable_ops_log", 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: "rgw_enable_usage_log" 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: "contact": null, 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: "crashes": [], 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: "created": "2024-03-04T06:32:42.596028Z", 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: "crush": { 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_algs": { 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: "straw2": 3 2024-03-04T06:41:49.023 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_sizes": { 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: "2": 1, 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: "4": 2 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_types": { 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: "1": 2, 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: "11": 1 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: "compat_weight_set": false, 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: "device_classes": [ 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: 8 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: "num_buckets": 6, 2024-03-04T06:41:49.024 INFO:tasks.workunit.client.0.smithi137.stdout: "num_devices": 8, 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_rules": 1, 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_types": 12, 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_weight_sets": 0, 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "tunables": { 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "allowed_bucket_algs": 54, 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "choose_local_fallback_tries": 0, 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "choose_local_tries": 0, 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "choose_total_tries": 50, 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "chooseleaf_descend_once": 1, 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "chooseleaf_stable": 1, 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "chooseleaf_vary_r": 1, 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v2_rules": 0, 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v3_rules": 0, 2024-03-04T06:41:49.025 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v4_buckets": 1, 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v5_rules": 0, 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: "legacy_tunables": 0, 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: "minimum_required_version": "jewel", 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: "optimal_tunables": 1, 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: "profile": "jewel", 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables": 1, 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables2": 1, 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables3": 1, 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables5": 1, 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: "straw_calc_version": 1 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: "description": "upgrade test cluster", 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: "fs": { 2024-03-04T06:41:49.026 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: "feature_flags": { 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: "enable_multiple": true, 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: "ever_enabled_multiple": true 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: "filesystems": [ 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: "approx_ctime": "2024-03", 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: "balancer_enabled": false, 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_caps": 0, 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_dns": 10, 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_inos": 13, 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_subtrees": 2, 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: "ever_allowed_features": 0, 2024-03-04T06:41:49.027 INFO:tasks.workunit.client.0.smithi137.stdout: "explicitly_allowed_features": 0, 2024-03-04T06:41:49.028 INFO:tasks.workunit.client.0.smithi137.stdout: "files": 0, 2024-03-04T06:41:49.028 INFO:tasks.workunit.client.0.smithi137.stdout: "max_mds": 1, 2024-03-04T06:41:49.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_data_pools": 1, 2024-03-04T06:41:49.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_in": 1, 2024-03-04T06:41:49.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_mds": 1, 2024-03-04T06:41:49.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_sessions": 0, 2024-03-04T06:41:49.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_standby_replay": 0, 2024-03-04T06:41:49.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_up": 1, 2024-03-04T06:41:49.028 INFO:tasks.workunit.client.0.smithi137.stdout: "snaps": 0, 2024-03-04T06:41:49.028 INFO:tasks.workunit.client.0.smithi137.stdout: "standby_count_wanted": 0 2024-03-04T06:41:49.028 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.028 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_standby_mds": 1, 2024-03-04T06:41:49.029 INFO:tasks.workunit.client.0.smithi137.stdout: "total_num_mds": 2 2024-03-04T06:41:49.029 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.029 INFO:tasks.workunit.client.0.smithi137.stdout: "hosts": { 2024-03-04T06:41:49.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num": 2, 2024-03-04T06:41:49.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_mds": 2, 2024-03-04T06:41:49.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_mgr": 2, 2024-03-04T06:41:49.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_mon": 2, 2024-03-04T06:41:49.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_osd": 2 2024-03-04T06:41:49.029 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.029 INFO:tasks.workunit.client.0.smithi137.stdout: "leaderboard": false, 2024-03-04T06:41:49.029 INFO:tasks.workunit.client.0.smithi137.stdout: "leaderboard_description": null, 2024-03-04T06:41:49.029 INFO:tasks.workunit.client.0.smithi137.stdout: "license": "sharing-1-0", 2024-03-04T06:41:49.029 INFO:tasks.workunit.client.0.smithi137.stdout: "metadata": { 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: "mds": { 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: "arch": { 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: "x86_64": 2 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_version": { 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: "cpu": { 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 2 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: "distro": { 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: "centos": 2 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: "distro_description": { 2024-03-04T06:41:49.030 INFO:tasks.workunit.client.0.smithi137.stdout: "CentOS Stream 8": 2 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_description": { 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: "#1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024": 2 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_version": { 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: "5.14.0-427.el9.x86_64": 2 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: "os": { 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: "Linux": 2 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: "arch": { 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: "x86_64": 3 2024-03-04T06:41:49.031 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.032 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_version": { 2024-03-04T06:41:49.032 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 3 2024-03-04T06:41:49.032 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.032 INFO:tasks.workunit.client.0.smithi137.stdout: "cpu": { 2024-03-04T06:41:49.032 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 3 2024-03-04T06:41:49.032 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.032 INFO:tasks.workunit.client.0.smithi137.stdout: "distro": { 2024-03-04T06:41:49.032 INFO:tasks.workunit.client.0.smithi137.stdout: "centos": 3 2024-03-04T06:41:49.032 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.032 INFO:tasks.workunit.client.0.smithi137.stdout: "distro_description": { 2024-03-04T06:41:49.032 INFO:tasks.workunit.client.0.smithi137.stdout: "CentOS Stream 8": 3 2024-03-04T06:41:49.032 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.032 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_description": { 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: "#1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024": 3 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_version": { 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: "5.14.0-427.el9.x86_64": 3 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: "os": { 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: "Linux": 3 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: "arch": { 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: "x86_64": 8 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_version": { 2024-03-04T06:41:49.033 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 8 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: "cpu": { 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 8 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: "distro": { 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: "centos": 8 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: "distro_description": { 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: "CentOS Stream 8": 8 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_description": { 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: "#1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024": 8 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.034 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_version": { 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: "5.14.0-427.el9.x86_64": 8 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: "os": { 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: "Linux": 8 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_objectstore": { 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": 8 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: "rotational": { 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: "0": 8 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:49.035 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: "features": { 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: "optional": [], 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: "persistent": [ 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: "kraken", 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: "luminous", 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: "mimic", 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap-prune", 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: "nautilus", 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: "octopus", 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: "pacific", 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: "elector-pinging", 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: "quincy", 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: "reef" 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:49.036 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: "ipv4_addr_mons": 6, 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: "ipv6_addr_mons": 0, 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: "min_mon_release": 18, 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: "v1_addr_mons": 3, 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: "v2_addr_mons": 3 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: "organization": "ceph-qa", 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: "cluster_network": false, 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 8, 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: "require_min_compat_client": "luminous", 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: "require_osd_release": "reef" 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: "pools": [ 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:49.037 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr" 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 1, 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 1, 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 1, 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330362634, 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 1781760, 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:49.038 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 1781760, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110117376, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 2, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 2.443002131258254e-06, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 212, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 313344, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 590368, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 590368, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 1771104, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 179, 2024-03-04T06:41:49.039 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 2473984 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs" 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:49.040 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 32, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 32, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 2, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330362634, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 98304, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 98304, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110117376, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 22, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 1.3478663163368765e-07, 2024-03-04T06:41:49.041 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 0, 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 0, 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 3428, 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 3428, 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 10284, 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 51, 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 20480 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.042 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs" 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 64, 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 64, 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 3, 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330362634, 2024-03-04T06:41:49.043 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 0, 2024-03-04T06:41:49.044 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:49.044 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:49.044 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 0, 2024-03-04T06:41:49.044 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:49.044 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110117376, 2024-03-04T06:41:49.044 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 0, 2024-03-04T06:41:49.044 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:49.044 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 0.0, 2024-03-04T06:41:49.044 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:49.044 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:49.044 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 0, 2024-03-04T06:41:49.044 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 0, 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 0, 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 0, 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 0, 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 0, 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 0 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd" 2024-03-04T06:41:49.045 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 8, 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 8, 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 4, 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330362634, 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 0, 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:49.046 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110117376, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 0.0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 0, 2024-03-04T06:41:49.047 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 0, 2024-03-04T06:41:49.048 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 0 2024-03-04T06:41:49.048 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.048 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:49.048 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:49.048 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:49.048 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.048 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.048 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd": { 2024-03-04T06:41:49.048 INFO:tasks.workunit.client.0.smithi137.stdout: "mirroring_by_pool": [ 2024-03-04T06:41:49.048 INFO:tasks.workunit.client.0.smithi137.stdout: false 2024-03-04T06:41:49.048 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.048 INFO:tasks.workunit.client.0.smithi137.stdout: "num_images_by_pool": [ 2024-03-04T06:41:49.048 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_pools": 1 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: "report_id": "f1e8dce2-c416-4290-9187-6dc0e467ffee", 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: "report_timestamp": "2024-03-04T06:41:48.994126", 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: "report_version": 1, 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: "rook": { 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: "cluster": { 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: "external-mode": null, 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: "allow-multiple-per-node": null, 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: "count": null, 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: "max-id": null, 2024-03-04T06:41:49.049 INFO:tasks.workunit.client.0.smithi137.stdout: "pvc": { 2024-03-04T06:41:49.050 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": null 2024-03-04T06:41:49.050 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.050 INFO:tasks.workunit.client.0.smithi137.stdout: "stretch": { 2024-03-04T06:41:49.050 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": null 2024-03-04T06:41:49.050 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.050 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.050 INFO:tasks.workunit.client.0.smithi137.stdout: "network": { 2024-03-04T06:41:49.050 INFO:tasks.workunit.client.0.smithi137.stdout: "provider": null 2024-03-04T06:41:49.050 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.050 INFO:tasks.workunit.client.0.smithi137.stdout: "storage": { 2024-03-04T06:41:49.050 INFO:tasks.workunit.client.0.smithi137.stdout: "device-set": { 2024-03-04T06:41:49.050 INFO:tasks.workunit.client.0.smithi137.stdout: "count": { 2024-03-04T06:41:49.050 INFO:tasks.workunit.client.0.smithi137.stdout: "non-portable": null, 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: "portable": null, 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: "total": null 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: "csi": { 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: "version": null 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: "kubernetes": { 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: "version": null 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: "node": { 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: "count": { 2024-03-04T06:41:49.051 INFO:tasks.workunit.client.0.smithi137.stdout: "kubernetes-total": null, 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: "with-ceph-daemons": null, 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: "with-csi-cephfs-plugin": null, 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: "with-csi-nfs-plugin": null, 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: "with-csi-rbd-plugin": null 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: "usage": { 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: "storage-class": { 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: "count": { 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": null, 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs": null, 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: "nfs": null, 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd": null, 2024-03-04T06:41:49.052 INFO:tasks.workunit.client.0.smithi137.stdout: "total": null 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: "version": null 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: "services": {}, 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: "usage": { 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 105, 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: "pools": 4, 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_by_class": { 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: "ssd": { 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: "total_avail_bytes": 767731404800, 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: "total_bytes": 767960285184, 2024-03-04T06:41:49.053 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_bytes": 228880384, 2024-03-04T06:41:49.054 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_raw_bytes": 228880384, 2024-03-04T06:41:49.054 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_raw_ratio": 0.0002980367571581155 2024-03-04T06:41:49.054 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.054 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.054 INFO:tasks.workunit.client.0.smithi137.stdout: "total_avail_bytes": 767731404800, 2024-03-04T06:41:49.054 INFO:tasks.workunit.client.0.smithi137.stdout: "total_bytes": 767960285184, 2024-03-04T06:41:49.054 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_bytes": 228880384 2024-03-04T06:41:49.054 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.054 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-03-04T06:41:49.054 INFO:tasks.workunit.client.0.smithi137.stdout:Device report is generated separately. To see it run 'ceph telemetry preview-device'. 2024-03-04T06:41:49.055 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph telemetry preview-device 2024-03-04T06:41:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/35021642' entity='client.admin' 2024-03-04T06:41:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/2735098877' entity='client.admin' 2024-03-04T06:41:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: pgmap v101: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: from='client.24866 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/35021642' entity='client.admin' 2024-03-04T06:41:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/2735098877' entity='client.admin' 2024-03-04T06:41:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: pgmap v101: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: from='client.24866 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:48 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/35021642' entity='client.admin' 2024-03-04T06:41:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/2735098877' entity='client.admin' 2024-03-04T06:41:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: pgmap v101: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: from='client.24866 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:48 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:49.530 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: "471b33ee-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: "INTEL_SSDPEDMD400G4_471bfd2e-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: "20240304-063556": { 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: "device": { 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: "info_name": "/dev/nvme0n1", 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "/dev/nvme0n1", 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: "protocol": "NVMe", 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "nvme" 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: "firmware_version": "8DV101H0", 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: "host_id": "471b33ee-d9f2-11ee-948b-0cc47a888137", 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: "json_format_version": [ 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:49.531 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: "local_time": { 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: "asctime": "Mon Mar 4 06:35:56 2024 UTC", 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: "time_t": 1709534156 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: "logical_block_size": 512, 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_controller_id": 0, 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_namespaces": [ 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: "capacity": { 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:49.532 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: "formatted_lba_size": 512, 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 1, 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: "size": { 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: "utilization": { 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_number_of_namespaces": 1, 2024-03-04T06:41:49.533 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_pci_vendor": { 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 32902, 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: "subsystem_id": 32902 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_add_log": { 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: "Device stats": { 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_fw_downgrades": { 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: "crc_error_count": { 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: "end_to_end_error_detection_count": { 2024-03-04T06:41:49.534 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: "erase_fail_count": { 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: "host_bytes_written": { 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 25068809 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: "host_ctx_wear_used": { 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 1 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.535 INFO:tasks.workunit.client.0.smithi137.stdout: "media_bytes_read": { 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: "nand_bytes_written": { 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 43199564 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_stat_indicator": { 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: "pll_lock_loss_count": { 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.536 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: "program_fail_count": { 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: "re_alloc_sectr_cnt": { 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: "retry_buffer_overflow_count": { 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: "soft_ecc_err_rate": { 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.537 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: "thermal_throttle_status": { 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: "cnt": 0, 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: "pct": 0 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_host_reads": { 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_media_wear": { 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 64 2024-03-04T06:41:49.538 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_timer": { 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: "unexp_power_loss": { 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: "wear_leveling": { 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 91, 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: "avg": 2922, 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: "max": 2935, 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 2910 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.539 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel Smart log": "nvme0n1" 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_log": { 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare": 100, 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare_threshold": 10, 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: "controller_busy_time": 0, 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: "critical_warning": 0, 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_read": 312551289, 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_written": 1642909475, 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: "host_reads": 5196511061, 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: "host_writes": 29305537614, 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: "media_errors": 0, 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_err_log_entries": 0, 2024-03-04T06:41:49.540 INFO:tasks.workunit.client.0.smithi137.stdout: "percentage_used": 9, 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycles": 47342, 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_hours": 52496, 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": 24, 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: "unsafe_shutdowns": 16 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_vendor": "intel", 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycle_count": 47342, 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_time": { 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: "hours": 52496 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: "serial_number": "deleted", 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: "smart_status": { 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme": { 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:49.541 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: "passed": true 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl": { 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: "argv": [ 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl", 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: "-x", 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: "--json=o", 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: "/dev/nvme0n1" 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: "build_info": "(local build)", 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: "exit_status": 0, 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: "output": [ 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-427.el9.x86_64] (local build)", 2024-03-04T06:41:49.542 INFO:tasks.workunit.client.0.smithi137.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "Serial Number: deleted", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Version: 8DV101H0", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller ID: 0", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "Number of Namespaces: 1", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "Local Time is: Mon Mar 4 06:35:56 2024 UTC", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-04T06:41:49.543 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported Power States", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 512 0 2", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: " 1 - 512 8 2", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: " 2 - 512 16 2", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: " 3 - 4096 0 0", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: " 4 - 4096 8 0", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: " 5 - 4096 64 0", 2024-03-04T06:41:49.544 INFO:tasks.workunit.client.0.smithi137.stdout: " 6 - 4096 128 0", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "Critical Warning: 0x00", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "Temperature: 24 Celsius", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare: 100%", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare Threshold: 10%", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "Percentage Used: 9%", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Read: 312,551,289 [160 TB]", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Written: 1,642,909,475 [841 TB]", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Read Commands: 5,196,511,061", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Write Commands: 29,305,537,614", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller Busy Time: 0", 2024-03-04T06:41:49.545 INFO:tasks.workunit.client.0.smithi137.stdout: "Power Cycles: 47,342", 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: "Power On Hours: 52,496", 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: "Unsafe Shutdowns: 16", 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: "Media and Data Integrity Errors: 0", 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information Log Entries: 0", 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: "No Errors Logged", 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: "" 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: "platform_info": "x86_64-linux-5.14.0-427.el9.x86_64", 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: "svn_revision": "5022", 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: "version": [ 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:49.546 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": { 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: "current": 24 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: "user_capacity": { 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: "471daafc-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: "INTEL_SSDPEDMD400G4_471e7446-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: "20240304-063558": { 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: "device": { 2024-03-04T06:41:49.547 INFO:tasks.workunit.client.0.smithi137.stdout: "info_name": "/dev/nvme0n1", 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "/dev/nvme0n1", 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: "protocol": "NVMe", 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "nvme" 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: "firmware_version": "8DV101H0", 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: "host_id": "471daafc-d9f2-11ee-948b-0cc47a888137", 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: "json_format_version": [ 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: "local_time": { 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: "asctime": "Mon Mar 4 06:35:58 2024 UTC", 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: "time_t": 1709534158 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.548 INFO:tasks.workunit.client.0.smithi137.stdout: "logical_block_size": 512, 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_controller_id": 0, 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_namespaces": [ 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: "capacity": { 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: "formatted_lba_size": 512, 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 1, 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: "size": { 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.549 INFO:tasks.workunit.client.0.smithi137.stdout: "utilization": { 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_number_of_namespaces": 1, 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_pci_vendor": { 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 32902, 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: "subsystem_id": 32902 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_add_log": { 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: "Device stats": { 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_fw_downgrades": { 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:49.550 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: "crc_error_count": { 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: "end_to_end_error_detection_count": { 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: "erase_fail_count": { 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: "host_bytes_written": { 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.551 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 23838260 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: "host_ctx_wear_used": { 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 1 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: "media_bytes_read": { 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: "nand_bytes_written": { 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 40894317 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_stat_indicator": { 2024-03-04T06:41:49.552 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: "pll_lock_loss_count": { 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: "program_fail_count": { 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: "re_alloc_sectr_cnt": { 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.553 INFO:tasks.workunit.client.0.smithi137.stdout: "retry_buffer_overflow_count": { 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: "soft_ecc_err_rate": { 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: "thermal_throttle_status": { 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: "cnt": 0, 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: "pct": 0 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_host_reads": { 2024-03-04T06:41:49.554 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_media_wear": { 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 64 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_timer": { 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: "unexp_power_loss": { 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: "wear_leveling": { 2024-03-04T06:41:49.555 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 91, 2024-03-04T06:41:49.556 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:49.556 INFO:tasks.workunit.client.0.smithi137.stdout: "avg": 2774, 2024-03-04T06:41:49.556 INFO:tasks.workunit.client.0.smithi137.stdout: "max": 2782, 2024-03-04T06:41:49.556 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 2767 2024-03-04T06:41:49.556 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.556 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.556 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.556 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel Smart log": "nvme0n1" 2024-03-04T06:41:49.556 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.556 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_log": { 2024-03-04T06:41:49.556 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare": 100, 2024-03-04T06:41:49.556 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare_threshold": 10, 2024-03-04T06:41:49.556 INFO:tasks.workunit.client.0.smithi137.stdout: "controller_busy_time": 102, 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: "critical_warning": 0, 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_read": 339428325, 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_written": 1562264215, 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: "host_reads": 5284568753, 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: "host_writes": 26762941906, 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: "media_errors": 0, 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_err_log_entries": 0, 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: "percentage_used": 9, 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycles": 46320, 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_hours": 53497, 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": 25, 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: "unsafe_shutdowns": 9334 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.557 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_vendor": "intel", 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycle_count": 46320, 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_time": { 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: "hours": 53497 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: "serial_number": "deleted", 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: "smart_status": { 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme": { 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: "passed": true 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl": { 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: "argv": [ 2024-03-04T06:41:49.558 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl", 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "-x", 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "--json=o", 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "/dev/nvme0n1" 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "build_info": "(local build)", 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "exit_status": 0, 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "output": [ 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-427.el9.x86_64] (local build)", 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "Serial Number: deleted", 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Version: 8DV101H0", 2024-03-04T06:41:49.559 INFO:tasks.workunit.client.0.smithi137.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-04T06:41:49.560 INFO:tasks.workunit.client.0.smithi137.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-04T06:41:49.560 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller ID: 0", 2024-03-04T06:41:49.560 INFO:tasks.workunit.client.0.smithi137.stdout: "Number of Namespaces: 1", 2024-03-04T06:41:49.560 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-04T06:41:49.560 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-04T06:41:49.560 INFO:tasks.workunit.client.0.smithi137.stdout: "Local Time is: Mon Mar 4 06:35:58 2024 UTC", 2024-03-04T06:41:49.560 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-04T06:41:49.560 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-04T06:41:49.560 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-04T06:41:49.560 INFO:tasks.workunit.client.0.smithi137.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-04T06:41:49.560 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:49.560 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported Power States", 2024-03-04T06:41:49.560 INFO:tasks.workunit.client.0.smithi137.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 512 0 2", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: " 1 - 512 8 2", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: " 2 - 512 16 2", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: " 3 - 4096 0 0", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: " 4 - 4096 8 0", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: " 5 - 4096 64 0", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: " 6 - 4096 128 0", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-04T06:41:49.561 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "Critical Warning: 0x00", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "Temperature: 25 Celsius", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare: 100%", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare Threshold: 10%", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "Percentage Used: 9%", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Read: 339,428,325 [173 TB]", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Written: 1,562,264,215 [799 TB]", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Read Commands: 5,284,568,753", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Write Commands: 26,762,941,906", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller Busy Time: 102", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "Power Cycles: 46,320", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "Power On Hours: 53,497", 2024-03-04T06:41:49.562 INFO:tasks.workunit.client.0.smithi137.stdout: "Unsafe Shutdowns: 9,334", 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: "Media and Data Integrity Errors: 0", 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information Log Entries: 0", 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: "No Errors Logged", 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: "" 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: "platform_info": "x86_64-linux-5.14.0-427.el9.x86_64", 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: "svn_revision": "5022", 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: "version": [ 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.563 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": { 2024-03-04T06:41:49.564 INFO:tasks.workunit.client.0.smithi137.stdout: "current": 25 2024-03-04T06:41:49.564 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:49.564 INFO:tasks.workunit.client.0.smithi137.stdout: "user_capacity": { 2024-03-04T06:41:49.564 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:49.564 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:49.564 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.564 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.564 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.564 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:49.564 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-03-04T06:41:49.565 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph telemetry preview-all 2024-03-04T06:41:50.052 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-03-04T06:41:50.052 INFO:tasks.workunit.client.0.smithi137.stdout: "device_report": { 2024-03-04T06:41:50.052 INFO:tasks.workunit.client.0.smithi137.stdout: "471b33ee-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:50.052 INFO:tasks.workunit.client.0.smithi137.stdout: "INTEL_SSDPEDMD400G4_471bfd2e-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:50.052 INFO:tasks.workunit.client.0.smithi137.stdout: "20240304-063556": { 2024-03-04T06:41:50.052 INFO:tasks.workunit.client.0.smithi137.stdout: "device": { 2024-03-04T06:41:50.052 INFO:tasks.workunit.client.0.smithi137.stdout: "info_name": "/dev/nvme0n1", 2024-03-04T06:41:50.052 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "/dev/nvme0n1", 2024-03-04T06:41:50.052 INFO:tasks.workunit.client.0.smithi137.stdout: "protocol": "NVMe", 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "nvme" 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: "firmware_version": "8DV101H0", 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: "host_id": "471b33ee-d9f2-11ee-948b-0cc47a888137", 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: "json_format_version": [ 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: "local_time": { 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: "asctime": "Mon Mar 4 06:35:56 2024 UTC", 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: "time_t": 1709534156 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: "logical_block_size": 512, 2024-03-04T06:41:50.053 INFO:tasks.workunit.client.0.smithi137.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_controller_id": 0, 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_namespaces": [ 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: "capacity": { 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: "formatted_lba_size": 512, 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 1, 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: "size": { 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.054 INFO:tasks.workunit.client.0.smithi137.stdout: "utilization": { 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_number_of_namespaces": 1, 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_pci_vendor": { 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 32902, 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: "subsystem_id": 32902 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_add_log": { 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: "Device stats": { 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_fw_downgrades": { 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:50.055 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: "crc_error_count": { 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: "end_to_end_error_detection_count": { 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: "erase_fail_count": { 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: "host_bytes_written": { 2024-03-04T06:41:50.056 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 25068809 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: "host_ctx_wear_used": { 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 1 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: "media_bytes_read": { 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: "nand_bytes_written": { 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 43199564 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.057 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_stat_indicator": { 2024-03-04T06:41:50.058 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:50.058 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.058 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.058 INFO:tasks.workunit.client.0.smithi137.stdout: "pll_lock_loss_count": { 2024-03-04T06:41:50.058 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.058 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.058 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.058 INFO:tasks.workunit.client.0.smithi137.stdout: "program_fail_count": { 2024-03-04T06:41:50.058 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.058 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.058 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.058 INFO:tasks.workunit.client.0.smithi137.stdout: "re_alloc_sectr_cnt": { 2024-03-04T06:41:50.058 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:50.059 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.059 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.059 INFO:tasks.workunit.client.0.smithi137.stdout: "retry_buffer_overflow_count": { 2024-03-04T06:41:50.059 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.059 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.059 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.059 INFO:tasks.workunit.client.0.smithi137.stdout: "soft_ecc_err_rate": { 2024-03-04T06:41:50.059 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:50.059 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.059 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.059 INFO:tasks.workunit.client.0.smithi137.stdout: "thermal_throttle_status": { 2024-03-04T06:41:50.059 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.059 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: "cnt": 0, 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: "pct": 0 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_host_reads": { 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_media_wear": { 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 64 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_timer": { 2024-03-04T06:41:50.060 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: "unexp_power_loss": { 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: "wear_leveling": { 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 91, 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: "avg": 2922, 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: "max": 2935, 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 2910 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.061 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.062 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel Smart log": "nvme0n1" 2024-03-04T06:41:50.062 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.062 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_log": { 2024-03-04T06:41:50.062 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare": 100, 2024-03-04T06:41:50.062 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare_threshold": 10, 2024-03-04T06:41:50.062 INFO:tasks.workunit.client.0.smithi137.stdout: "controller_busy_time": 0, 2024-03-04T06:41:50.062 INFO:tasks.workunit.client.0.smithi137.stdout: "critical_warning": 0, 2024-03-04T06:41:50.062 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_read": 312551289, 2024-03-04T06:41:50.062 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_written": 1642909475, 2024-03-04T06:41:50.062 INFO:tasks.workunit.client.0.smithi137.stdout: "host_reads": 5196511061, 2024-03-04T06:41:50.062 INFO:tasks.workunit.client.0.smithi137.stdout: "host_writes": 29305537614, 2024-03-04T06:41:50.062 INFO:tasks.workunit.client.0.smithi137.stdout: "media_errors": 0, 2024-03-04T06:41:50.062 INFO:tasks.workunit.client.0.smithi137.stdout: "num_err_log_entries": 0, 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: "percentage_used": 9, 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycles": 47342, 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_hours": 52496, 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": 24, 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: "unsafe_shutdowns": 16 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_vendor": "intel", 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycle_count": 47342, 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_time": { 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: "hours": 52496 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: "serial_number": "deleted", 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: "smart_status": { 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme": { 2024-03-04T06:41:50.063 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:50.064 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.064 INFO:tasks.workunit.client.0.smithi137.stdout: "passed": true 2024-03-04T06:41:50.064 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.064 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl": { 2024-03-04T06:41:50.064 INFO:tasks.workunit.client.0.smithi137.stdout: "argv": [ 2024-03-04T06:41:50.064 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl", 2024-03-04T06:41:50.064 INFO:tasks.workunit.client.0.smithi137.stdout: "-x", 2024-03-04T06:41:50.064 INFO:tasks.workunit.client.0.smithi137.stdout: "--json=o", 2024-03-04T06:41:50.064 INFO:tasks.workunit.client.0.smithi137.stdout: "/dev/nvme0n1" 2024-03-04T06:41:50.064 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.064 INFO:tasks.workunit.client.0.smithi137.stdout: "build_info": "(local build)", 2024-03-04T06:41:50.064 INFO:tasks.workunit.client.0.smithi137.stdout: "exit_status": 0, 2024-03-04T06:41:50.064 INFO:tasks.workunit.client.0.smithi137.stdout: "output": [ 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-427.el9.x86_64] (local build)", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "Serial Number: deleted", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Version: 8DV101H0", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller ID: 0", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "Number of Namespaces: 1", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "Local Time is: Mon Mar 4 06:35:56 2024 UTC", 2024-03-04T06:41:50.065 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported Power States", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 512 0 2", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: " 1 - 512 8 2", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: " 2 - 512 16 2", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: " 3 - 4096 0 0", 2024-03-04T06:41:50.066 INFO:tasks.workunit.client.0.smithi137.stdout: " 4 - 4096 8 0", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: " 5 - 4096 64 0", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: " 6 - 4096 128 0", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "Critical Warning: 0x00", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "Temperature: 24 Celsius", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare: 100%", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare Threshold: 10%", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "Percentage Used: 9%", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Read: 312,551,289 [160 TB]", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Written: 1,642,909,475 [841 TB]", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Read Commands: 5,196,511,061", 2024-03-04T06:41:50.067 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Write Commands: 29,305,537,614", 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller Busy Time: 0", 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: "Power Cycles: 47,342", 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: "Power On Hours: 52,496", 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: "Unsafe Shutdowns: 16", 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: "Media and Data Integrity Errors: 0", 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information Log Entries: 0", 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: "No Errors Logged", 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: "" 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: "platform_info": "x86_64-linux-5.14.0-427.el9.x86_64", 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: "svn_revision": "5022", 2024-03-04T06:41:50.068 INFO:tasks.workunit.client.0.smithi137.stdout: "version": [ 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": { 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: "current": 24 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: "user_capacity": { 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.069 INFO:tasks.workunit.client.0.smithi137.stdout: "471daafc-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: "INTEL_SSDPEDMD400G4_471e7446-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: "20240304-063558": { 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: "device": { 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: "info_name": "/dev/nvme0n1", 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "/dev/nvme0n1", 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: "protocol": "NVMe", 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "nvme" 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: "firmware_version": "8DV101H0", 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: "host_id": "471daafc-d9f2-11ee-948b-0cc47a888137", 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: "json_format_version": [ 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: "local_time": { 2024-03-04T06:41:50.070 INFO:tasks.workunit.client.0.smithi137.stdout: "asctime": "Mon Mar 4 06:35:58 2024 UTC", 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "time_t": 1709534158 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "logical_block_size": 512, 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_controller_id": 0, 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_namespaces": [ 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "capacity": { 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "formatted_lba_size": 512, 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 1, 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "size": { 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:50.071 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: "utilization": { 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_number_of_namespaces": 1, 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_pci_vendor": { 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 32902, 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: "subsystem_id": 32902 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_add_log": { 2024-03-04T06:41:50.072 INFO:tasks.workunit.client.0.smithi137.stdout: "Device stats": { 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_fw_downgrades": { 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: "crc_error_count": { 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: "end_to_end_error_detection_count": { 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: "erase_fail_count": { 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.073 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: "host_bytes_written": { 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 23838260 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: "host_ctx_wear_used": { 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 1 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: "media_bytes_read": { 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: "nand_bytes_written": { 2024-03-04T06:41:50.074 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 40894317 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_stat_indicator": { 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: "pll_lock_loss_count": { 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: "program_fail_count": { 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: "re_alloc_sectr_cnt": { 2024-03-04T06:41:50.075 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: "retry_buffer_overflow_count": { 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: "soft_ecc_err_rate": { 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: "thermal_throttle_status": { 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:50.076 INFO:tasks.workunit.client.0.smithi137.stdout: "cnt": 0, 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: "pct": 0 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_host_reads": { 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_media_wear": { 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 64 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_timer": { 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.077 INFO:tasks.workunit.client.0.smithi137.stdout: "unexp_power_loss": { 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: "wear_leveling": { 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 91, 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: "avg": 2774, 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: "max": 2782, 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 2767 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel Smart log": "nvme0n1" 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.078 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_log": { 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare": 100, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare_threshold": 10, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "controller_busy_time": 102, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "critical_warning": 0, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_read": 339428325, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_written": 1562264215, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "host_reads": 5284568753, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "host_writes": 26762941906, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "media_errors": 0, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "num_err_log_entries": 0, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "percentage_used": 9, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycles": 46320, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_hours": 53497, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": 25, 2024-03-04T06:41:50.079 INFO:tasks.workunit.client.0.smithi137.stdout: "unsafe_shutdowns": 9334 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_vendor": "intel", 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycle_count": 46320, 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_time": { 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: "hours": 53497 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: "serial_number": "deleted", 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: "smart_status": { 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme": { 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: "passed": true 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.080 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl": { 2024-03-04T06:41:50.081 INFO:tasks.workunit.client.0.smithi137.stdout: "argv": [ 2024-03-04T06:41:50.081 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl", 2024-03-04T06:41:50.081 INFO:tasks.workunit.client.0.smithi137.stdout: "-x", 2024-03-04T06:41:50.081 INFO:tasks.workunit.client.0.smithi137.stdout: "--json=o", 2024-03-04T06:41:50.081 INFO:tasks.workunit.client.0.smithi137.stdout: "/dev/nvme0n1" 2024-03-04T06:41:50.081 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.081 INFO:tasks.workunit.client.0.smithi137.stdout: "build_info": "(local build)", 2024-03-04T06:41:50.081 INFO:tasks.workunit.client.0.smithi137.stdout: "exit_status": 0, 2024-03-04T06:41:50.081 INFO:tasks.workunit.client.0.smithi137.stdout: "output": [ 2024-03-04T06:41:50.081 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-427.el9.x86_64] (local build)", 2024-03-04T06:41:50.081 INFO:tasks.workunit.client.0.smithi137.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-04T06:41:50.081 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:50.081 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "Serial Number: deleted", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Version: 8DV101H0", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller ID: 0", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "Number of Namespaces: 1", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "Local Time is: Mon Mar 4 06:35:58 2024 UTC", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-04T06:41:50.082 INFO:tasks.workunit.client.0.smithi137.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported Power States", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 512 0 2", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: " 1 - 512 8 2", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: " 2 - 512 16 2", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: " 3 - 4096 0 0", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: " 4 - 4096 8 0", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: " 5 - 4096 64 0", 2024-03-04T06:41:50.083 INFO:tasks.workunit.client.0.smithi137.stdout: " 6 - 4096 128 0", 2024-03-04T06:41:50.084 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:50.084 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-04T06:41:50.084 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-04T06:41:50.084 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:50.084 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-04T06:41:50.084 INFO:tasks.workunit.client.0.smithi137.stdout: "Critical Warning: 0x00", 2024-03-04T06:41:50.084 INFO:tasks.workunit.client.0.smithi137.stdout: "Temperature: 25 Celsius", 2024-03-04T06:41:50.084 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare: 100%", 2024-03-04T06:41:50.084 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare Threshold: 10%", 2024-03-04T06:41:50.084 INFO:tasks.workunit.client.0.smithi137.stdout: "Percentage Used: 9%", 2024-03-04T06:41:50.084 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Read: 339,428,325 [173 TB]", 2024-03-04T06:41:50.084 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Written: 1,562,264,215 [799 TB]", 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Read Commands: 5,284,568,753", 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Write Commands: 26,762,941,906", 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller Busy Time: 102", 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "Power Cycles: 46,320", 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "Power On Hours: 53,497", 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "Unsafe Shutdowns: 9,334", 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "Media and Data Integrity Errors: 0", 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information Log Entries: 0", 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "No Errors Logged", 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "" 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "platform_info": "x86_64-linux-5.14.0-427.el9.x86_64", 2024-03-04T06:41:50.085 INFO:tasks.workunit.client.0.smithi137.stdout: "svn_revision": "5022", 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: "version": [ 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": { 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: "current": 25 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: "user_capacity": { 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.086 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: "report": { 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: "balancer": { 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: "active": true, 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: "mode": "" 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: "channels": [ 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: "basic", 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: "crash", 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: "device", 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: "ident" 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: "channels_available": [ 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: "basic", 2024-03-04T06:41:50.087 INFO:tasks.workunit.client.0.smithi137.stdout: "ident", 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: "crash", 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: "device", 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: "perf" 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: "collections_available": [ 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_base", 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: "device_base", 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: "crash_base", 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: "ident_base", 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_perf", 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_mds_metadata", 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_usage", 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_usage_by_class", 2024-03-04T06:41:50.088 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_rook_v01", 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_memory_metrics", 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_options_bluestore" 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "collections_opted_in": [ 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_base", 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "device_base", 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "crash_base", 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "ident_base", 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_perf", 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_mds_metadata", 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_usage", 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_usage_by_class", 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_rook_v01", 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_memory_metrics", 2024-03-04T06:41:50.089 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_options_bluestore" 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "config": { 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "active_changed": [ 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_debug", 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_mon_ticket_ttl", 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_service_ticket_ttl", 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "bdev_debug_aio", 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "client_check_pool_perm", 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "client_mount_gid", 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "client_mount_uid", 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "client_quota", 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "container_image", 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "daemonize", 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_asserts_on_shutdown", 2024-03-04T06:41:50.090 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mgr", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mon", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_ms", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_osd", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_paxos", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "keyring", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_block_size", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_cache_size", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_compression", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_log", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_write_buffer_size", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_file", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_journald", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_stderr", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_allow_pool_delete", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_clock_drift_allowed", 2024-03-04T06:41:50.091 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_file_level", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_file", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_journald", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_stderr", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_data_avail_warn", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_election_default_strategy", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_host", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_max_pg_per_osd", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_mgr_mkfs_grace", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_prime_pg_temp", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_reporter_subtree_level", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_pg_warn_max_object_skew", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-04T06:41:50.092 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_too_few_osds", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_bug", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_old_message", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "no_config_file", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_default_list", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_load_list", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_crush_chooseleaf_type", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_misdirected_ops", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_op_order", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_pg_log_writeout", 2024-03-04T06:41:50.093 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_shutdown", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_cached_snaps", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_missing_on_start", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_stray_on_activate", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_profile", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_client_lim", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_client_res", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_client_wgt", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target", 2024-03-04T06:41:50.094 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target_autotune", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue_cut_off", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_erasure_code_profile", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recover_clone_overlap", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recovery_max_chunk", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_load_threshold", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_max_interval", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_shutdown_pgref_assert", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "public_addr", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "public_addrv", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "public_network", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd_default_features", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd_qos_exclude_ops", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "setgroup", 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: "setuser" 2024-03-04T06:41:50.095 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.096 INFO:tasks.workunit.client.0.smithi137.stdout: "cluster_changed": [ 2024-03-04T06:41:50.096 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-04T06:41:50.096 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_debug", 2024-03-04T06:41:50.096 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_mon_ticket_ttl", 2024-03-04T06:41:50.096 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_service_ticket_ttl", 2024-03-04T06:41:50.096 INFO:tasks.workunit.client.0.smithi137.stdout: "bdev_debug_aio", 2024-03-04T06:41:50.096 INFO:tasks.workunit.client.0.smithi137.stdout: "container_image", 2024-03-04T06:41:50.096 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_asserts_on_shutdown", 2024-03-04T06:41:50.096 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mgr", 2024-03-04T06:41:50.096 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mon", 2024-03-04T06:41:50.096 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_ms", 2024-03-04T06:41:50.096 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_osd", 2024-03-04T06:41:50.096 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_paxos", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_file", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_journald", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_stderr", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_join_fs", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/allow_ptrace", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/container_init", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/migration_current", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/use_repo_digest", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/ssl_server_port", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/orchestrator/orchestrator", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/channel_ident", 2024-03-04T06:41:50.097 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/description", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/organization", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_allow_pool_delete", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_clock_drift_allowed", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_file_level", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_file", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_data_avail_warn", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_election_default_strategy", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_max_pg_per_osd", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_mgr_mkfs_grace", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_prime_pg_temp", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_reporter_subtree_level", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_pg_warn_max_object_skew", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-04T06:41:50.098 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_too_few_osds", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_bug", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_old_message", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_default_list", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_load_list", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_misdirected_ops", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_op_order", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_pg_log_writeout", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_shutdown", 2024-03-04T06:41:50.099 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_cached_snaps", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_missing_on_start", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_stray_on_activate", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_profile", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target_autotune", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue_cut_off", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_erasure_code_profile", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recover_clone_overlap", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recovery_max_chunk", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_load_threshold", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_max_interval", 2024-03-04T06:41:50.100 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_shutdown_pgref_assert", 2024-03-04T06:41:50.101 INFO:tasks.workunit.client.0.smithi137.stdout: "public_network", 2024-03-04T06:41:50.101 INFO:tasks.workunit.client.0.smithi137.stdout: "rgw_cache_enabled", 2024-03-04T06:41:50.101 INFO:tasks.workunit.client.0.smithi137.stdout: "rgw_enable_ops_log", 2024-03-04T06:41:50.101 INFO:tasks.workunit.client.0.smithi137.stdout: "rgw_enable_usage_log" 2024-03-04T06:41:50.101 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:50.101 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.101 INFO:tasks.workunit.client.0.smithi137.stdout: "contact": null, 2024-03-04T06:41:50.101 INFO:tasks.workunit.client.0.smithi137.stdout: "crashes": [], 2024-03-04T06:41:50.101 INFO:tasks.workunit.client.0.smithi137.stdout: "created": "2024-03-04T06:32:42.596028Z", 2024-03-04T06:41:50.101 INFO:tasks.workunit.client.0.smithi137.stdout: "crush": { 2024-03-04T06:41:50.101 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_algs": { 2024-03-04T06:41:50.101 INFO:tasks.workunit.client.0.smithi137.stdout: "straw2": 3 2024-03-04T06:41:50.101 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_sizes": { 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: "2": 1, 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: "4": 2 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_types": { 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: "1": 2, 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: "11": 1 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: "compat_weight_set": false, 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: "device_classes": [ 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: 8 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_buckets": 6, 2024-03-04T06:41:50.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_devices": 8, 2024-03-04T06:41:50.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_rules": 1, 2024-03-04T06:41:50.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_types": 12, 2024-03-04T06:41:50.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_weight_sets": 0, 2024-03-04T06:41:50.103 INFO:tasks.workunit.client.0.smithi137.stdout: "tunables": { 2024-03-04T06:41:50.103 INFO:tasks.workunit.client.0.smithi137.stdout: "allowed_bucket_algs": 54, 2024-03-04T06:41:50.103 INFO:tasks.workunit.client.0.smithi137.stdout: "choose_local_fallback_tries": 0, 2024-03-04T06:41:50.103 INFO:tasks.workunit.client.0.smithi137.stdout: "choose_local_tries": 0, 2024-03-04T06:41:50.103 INFO:tasks.workunit.client.0.smithi137.stdout: "choose_total_tries": 50, 2024-03-04T06:41:50.103 INFO:tasks.workunit.client.0.smithi137.stdout: "chooseleaf_descend_once": 1, 2024-03-04T06:41:50.103 INFO:tasks.workunit.client.0.smithi137.stdout: "chooseleaf_stable": 1, 2024-03-04T06:41:50.103 INFO:tasks.workunit.client.0.smithi137.stdout: "chooseleaf_vary_r": 1, 2024-03-04T06:41:50.103 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v2_rules": 0, 2024-03-04T06:41:50.103 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v3_rules": 0, 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v4_buckets": 1, 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v5_rules": 0, 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: "legacy_tunables": 0, 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: "minimum_required_version": "jewel", 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: "optimal_tunables": 1, 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: "profile": "jewel", 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables": 1, 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables2": 1, 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables3": 1, 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables5": 1, 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: "straw_calc_version": 1 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.104 INFO:tasks.workunit.client.0.smithi137.stdout: "description": "upgrade test cluster", 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "fs": { 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "feature_flags": { 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "enable_multiple": true, 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "ever_enabled_multiple": true 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "filesystems": [ 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "approx_ctime": "2024-03", 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "balancer_enabled": false, 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_caps": 0, 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_dns": 10, 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_inos": 13, 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_subtrees": 2, 2024-03-04T06:41:50.105 INFO:tasks.workunit.client.0.smithi137.stdout: "ever_allowed_features": 0, 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: "explicitly_allowed_features": 0, 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: "files": 0, 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: "max_mds": 1, 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: "num_data_pools": 1, 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: "num_in": 1, 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: "num_mds": 1, 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: "num_sessions": 0, 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: "num_standby_replay": 0, 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: "num_up": 1, 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: "snaps": 0, 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: "standby_count_wanted": 0 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: "num_standby_mds": 1, 2024-03-04T06:41:50.106 INFO:tasks.workunit.client.0.smithi137.stdout: "total_num_mds": 2 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: "hosts": { 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: "num": 2, 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_mds": 2, 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_mgr": 2, 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_mon": 2, 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_osd": 2 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: "leaderboard": false, 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: "leaderboard_description": null, 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: "license": "sharing-1-0", 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: "metadata": { 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: "mds": { 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: "arch": { 2024-03-04T06:41:50.107 INFO:tasks.workunit.client.0.smithi137.stdout: "x86_64": 2 2024-03-04T06:41:50.108 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.108 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_version": { 2024-03-04T06:41:50.108 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:41:50.108 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.108 INFO:tasks.workunit.client.0.smithi137.stdout: "cpu": { 2024-03-04T06:41:50.108 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 2 2024-03-04T06:41:50.108 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.108 INFO:tasks.workunit.client.0.smithi137.stdout: "distro": { 2024-03-04T06:41:50.108 INFO:tasks.workunit.client.0.smithi137.stdout: "centos": 2 2024-03-04T06:41:50.108 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.108 INFO:tasks.workunit.client.0.smithi137.stdout: "distro_description": { 2024-03-04T06:41:50.108 INFO:tasks.workunit.client.0.smithi137.stdout: "CentOS Stream 8": 2 2024-03-04T06:41:50.108 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_description": { 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: "#1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024": 2 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_version": { 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: "5.14.0-427.el9.x86_64": 2 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: "os": { 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: "Linux": 2 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: "arch": { 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: "x86_64": 3 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.109 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_version": { 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 3 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: "cpu": { 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 3 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: "distro": { 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: "centos": 3 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: "distro_description": { 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: "CentOS Stream 8": 3 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_description": { 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: "#1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024": 3 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.110 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_version": { 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: "5.14.0-427.el9.x86_64": 3 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: "os": { 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: "Linux": 3 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: "arch": { 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: "x86_64": 8 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_version": { 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 8 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.111 INFO:tasks.workunit.client.0.smithi137.stdout: "cpu": { 2024-03-04T06:41:50.112 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 8 2024-03-04T06:41:50.112 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.112 INFO:tasks.workunit.client.0.smithi137.stdout: "distro": { 2024-03-04T06:41:50.112 INFO:tasks.workunit.client.0.smithi137.stdout: "centos": 8 2024-03-04T06:41:50.112 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.112 INFO:tasks.workunit.client.0.smithi137.stdout: "distro_description": { 2024-03-04T06:41:50.112 INFO:tasks.workunit.client.0.smithi137.stdout: "CentOS Stream 8": 8 2024-03-04T06:41:50.112 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.112 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_description": { 2024-03-04T06:41:50.112 INFO:tasks.workunit.client.0.smithi137.stdout: "#1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024": 8 2024-03-04T06:41:50.112 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.112 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_version": { 2024-03-04T06:41:50.112 INFO:tasks.workunit.client.0.smithi137.stdout: "5.14.0-427.el9.x86_64": 8 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: "os": { 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: "Linux": 8 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_objectstore": { 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": 8 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: "rotational": { 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: "0": 8 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:50.113 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: "features": { 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: "optional": [], 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: "persistent": [ 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: "kraken", 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: "luminous", 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: "mimic", 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap-prune", 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: "nautilus", 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: "octopus", 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: "pacific", 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: "elector-pinging", 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: "quincy", 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: "reef" 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:50.114 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: "ipv4_addr_mons": 6, 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: "ipv6_addr_mons": 0, 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: "min_mon_release": 18, 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: "v1_addr_mons": 3, 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: "v2_addr_mons": 3 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: "organization": "ceph-qa", 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: "cluster_network": false, 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 8, 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: "require_min_compat_client": "luminous", 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: "require_osd_release": "reef" 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: "pools": [ 2024-03-04T06:41:50.115 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr" 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 1, 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 1, 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 1, 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:50.116 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330362634, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 1781760, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 1781760, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110117376, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 2, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 2.443002131258254e-06, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 212, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 313344, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 590368, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 590368, 2024-03-04T06:41:50.117 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 1771104, 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 179, 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 2473984 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs" 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:50.118 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 32, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 32, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 2, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330362634, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 98304, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 98304, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110117376, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 22, 2024-03-04T06:41:50.119 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 1.3478663163368765e-07, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 0, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 0, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 3428, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 3428, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 10284, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 51, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 20480 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:50.120 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs" 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 64, 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 64, 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 3, 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330362634, 2024-03-04T06:41:50.121 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110117376, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 0.0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 0, 2024-03-04T06:41:50.122 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 0, 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 0, 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 0 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd" 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:50.123 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 8, 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 8, 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 4, 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330362634, 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 0, 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 0, 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110117376, 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 0, 2024-03-04T06:41:50.124 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:50.125 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 0.0, 2024-03-04T06:41:50.125 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:50.125 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:50.125 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 0, 2024-03-04T06:41:50.125 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 0, 2024-03-04T06:41:50.125 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 0, 2024-03-04T06:41:50.125 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 0, 2024-03-04T06:41:50.125 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:50.125 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 0, 2024-03-04T06:41:50.125 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 0, 2024-03-04T06:41:50.125 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 0 2024-03-04T06:41:50.125 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.125 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd": { 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: "mirroring_by_pool": [ 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: false 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_images_by_pool": [ 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_pools": 1 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: "report_id": "f1e8dce2-c416-4290-9187-6dc0e467ffee", 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: "report_timestamp": "2024-03-04T06:41:50.033455", 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: "report_version": 1, 2024-03-04T06:41:50.126 INFO:tasks.workunit.client.0.smithi137.stdout: "rook": { 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: "cluster": { 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: "external-mode": null, 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: "allow-multiple-per-node": null, 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: "count": null, 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: "max-id": null, 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: "pvc": { 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": null 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: "stretch": { 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": null 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: "network": { 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: "provider": null 2024-03-04T06:41:50.127 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: "storage": { 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: "device-set": { 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: "count": { 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: "non-portable": null, 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: "portable": null, 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: "total": null 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: "csi": { 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: "version": null 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: "kubernetes": { 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: "version": null 2024-03-04T06:41:50.128 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "node": { 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "count": { 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "kubernetes-total": null, 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "with-ceph-daemons": null, 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "with-csi-cephfs-plugin": null, 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "with-csi-nfs-plugin": null, 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "with-csi-rbd-plugin": null 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "usage": { 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "storage-class": { 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "count": { 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": null, 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs": null, 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "nfs": null, 2024-03-04T06:41:50.129 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd": null, 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: "total": null 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: "version": null 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: "services": {}, 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: "usage": { 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 105, 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: "pools": 4, 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_by_class": { 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: "ssd": { 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: "total_avail_bytes": 767731404800, 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: "total_bytes": 767960285184, 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_bytes": 228880384, 2024-03-04T06:41:50.130 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_raw_bytes": 228880384, 2024-03-04T06:41:50.131 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_raw_ratio": 0.0002980367571581155 2024-03-04T06:41:50.131 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.131 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:50.131 INFO:tasks.workunit.client.0.smithi137.stdout: "total_avail_bytes": 767731404800, 2024-03-04T06:41:50.131 INFO:tasks.workunit.client.0.smithi137.stdout: "total_bytes": 767960285184, 2024-03-04T06:41:50.131 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_bytes": 228880384 2024-03-04T06:41:50.131 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.131 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:50.131 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-03-04T06:41:50.131 INFO:tasks.workunit.client.0.smithi137.stderr:++ ceph telemetry collection ls 2024-03-04T06:41:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[26846]: from='client.24866 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[26846]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[26846]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[26846]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[37364]: from='client.24866 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[37364]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[37364]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[37364]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:50.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:49 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:49 smithi203 ceph-mon[30756]: from='client.24866 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:49 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:49 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:49 smithi203 ceph-mon[30756]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:49 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:49 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:49 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:49 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:49 smithi203 ceph-mon[30756]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:49 smithi203 ceph-mon[30756]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:49 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:49 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:50.547 INFO:tasks.workunit.client.0.smithi137.stderr:+ COLLECTIONS='New collections are available: 2024-03-04T06:41:50.547 INFO:tasks.workunit.client.0.smithi137.stderr:['\''basic_base'\'', '\''basic_mds_metadata'\'', '\''basic_pool_options_bluestore'\'', '\''basic_pool_usage'\'', '\''basic_rook_v01'\'', '\''basic_usage_by_class'\'', '\''crash_base'\'', '\''device_base'\'', '\''ident_base'\'', '\''perf_memory_metrics'\'', '\''perf_perf'\''] 2024-03-04T06:41:50.547 INFO:tasks.workunit.client.0.smithi137.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-03-04T06:41:50.547 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-03-04T06:41:50.547 INFO:tasks.workunit.client.0.smithi137.stderr:NAME STATUS DESC 2024-03-04T06:41:50.547 INFO:tasks.workunit.client.0.smithi137.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-03-04T06:41:50.547 INFO:tasks.workunit.client.0.smithi137.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-03-04T06:41:50.547 INFO:tasks.workunit.client.0.smithi137.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-03-04T06:41:50.547 INFO:tasks.workunit.client.0.smithi137.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-03-04T06:41:50.548 INFO:tasks.workunit.client.0.smithi137.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-03-04T06:41:50.548 INFO:tasks.workunit.client.0.smithi137.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-03-04T06:41:50.548 INFO:tasks.workunit.client.0.smithi137.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-03-04T06:41:50.548 INFO:tasks.workunit.client.0.smithi137.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-03-04T06:41:50.548 INFO:tasks.workunit.client.0.smithi137.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-03-04T06:41:50.548 INFO:tasks.workunit.client.0.smithi137.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-03-04T06:41:50.548 INFO:tasks.workunit.client.0.smithi137.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster ' 2024-03-04T06:41:50.548 INFO:tasks.workunit.client.0.smithi137.stderr:+ NEW_COLLECTIONS=("perf_perf" "basic_mds_metadata" "basic_pool_usage" "basic_rook_v01" "perf_memory_metrics") 2024-03-04T06:41:50.548 INFO:tasks.workunit.client.0.smithi137.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-03-04T06:41:50.548 INFO:tasks.workunit.client.0.smithi137.stderr:+ [[ New collections are available: 2024-03-04T06:41:50.549 INFO:tasks.workunit.client.0.smithi137.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-03-04T06:41:50.549 INFO:tasks.workunit.client.0.smithi137.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-03-04T06:41:50.549 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-03-04T06:41:50.549 INFO:tasks.workunit.client.0.smithi137.stderr:NAME STATUS DESC 2024-03-04T06:41:50.549 INFO:tasks.workunit.client.0.smithi137.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-03-04T06:41:50.549 INFO:tasks.workunit.client.0.smithi137.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-03-04T06:41:50.549 INFO:tasks.workunit.client.0.smithi137.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-03-04T06:41:50.549 INFO:tasks.workunit.client.0.smithi137.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-03-04T06:41:50.549 INFO:tasks.workunit.client.0.smithi137.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-03-04T06:41:50.549 INFO:tasks.workunit.client.0.smithi137.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-03-04T06:41:50.549 INFO:tasks.workunit.client.0.smithi137.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-03-04T06:41:50.549 INFO:tasks.workunit.client.0.smithi137.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-03-04T06:41:50.549 INFO:tasks.workunit.client.0.smithi137.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *perf_perf* ]] 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:+ [[ New collections are available: 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:NAME STATUS DESC 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-03-04T06:41:50.550 INFO:tasks.workunit.client.0.smithi137.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *basic_mds_metadata* ]] 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:+ [[ New collections are available: 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:NAME STATUS DESC 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-03-04T06:41:50.551 INFO:tasks.workunit.client.0.smithi137.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *basic_pool_usage* ]] 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr:+ [[ New collections are available: 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr:NAME STATUS DESC 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-03-04T06:41:50.552 INFO:tasks.workunit.client.0.smithi137.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *basic_rook_v01* ]] 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:+ [[ New collections are available: 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-03-04T06:41:50.553 INFO:tasks.workunit.client.0.smithi137.stderr:NAME STATUS DESC 2024-03-04T06:41:50.554 INFO:tasks.workunit.client.0.smithi137.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-03-04T06:41:50.554 INFO:tasks.workunit.client.0.smithi137.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-03-04T06:41:50.554 INFO:tasks.workunit.client.0.smithi137.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-03-04T06:41:50.554 INFO:tasks.workunit.client.0.smithi137.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-03-04T06:41:50.554 INFO:tasks.workunit.client.0.smithi137.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-03-04T06:41:50.554 INFO:tasks.workunit.client.0.smithi137.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-03-04T06:41:50.554 INFO:tasks.workunit.client.0.smithi137.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-03-04T06:41:50.554 INFO:tasks.workunit.client.0.smithi137.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-03-04T06:41:50.554 INFO:tasks.workunit.client.0.smithi137.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-03-04T06:41:50.554 INFO:tasks.workunit.client.0.smithi137.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-03-04T06:41:50.554 INFO:tasks.workunit.client.0.smithi137.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *perf_memory_metrics* ]] 2024-03-04T06:41:50.554 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph telemetry on --license sharing-1-0 2024-03-04T06:41:51.050 INFO:tasks.workunit.client.0.smithi137.stdout:Telemetry is on. 2024-03-04T06:41:51.050 INFO:tasks.workunit.client.0.smithi137.stdout:Some channels are disabled, please enable with: 2024-03-04T06:41:51.050 INFO:tasks.workunit.client.0.smithi137.stdout:`ceph telemetry enable channel perf` 2024-03-04T06:41:51.061 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph telemetry enable channel perf 2024-03-04T06:41:51.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:51.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: from='client.24890 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: mgrmap e22: y(active, since 3m), standbys: x 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: from='client.24890 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: pgmap v102: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:51 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:51 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:51 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.295 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:50] ENGINE Bus STOPPING 2024-03-04T06:41:51.295 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:50] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T06:41:51.295 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:50] ENGINE Bus STOPPED 2024-03-04T06:41:51.295 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:50] ENGINE Bus STARTING 2024-03-04T06:41:51.295 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:50] ENGINE Serving on http://:::9283 2024-03-04T06:41:51.295 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:50] ENGINE Bus STARTED 2024-03-04T06:41:51.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:51.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='client.24890 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:51.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: mgrmap e22: y(active, since 3m), standbys: x 2024-03-04T06:41:51.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='client.24890 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:51.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: pgmap v102: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:51.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:51.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:51.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:51.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:50 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='client.24890 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: mgrmap e22: y(active, since 3m), standbys: x 2024-03-04T06:41:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='client.24890 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: pgmap v102: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:41:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:51.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:51.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:51.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:50 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:51.547 INFO:tasks.workunit.client.0.smithi137.stdout:channel_perf is enabled 2024-03-04T06:41:51.559 INFO:tasks.workunit.client.0.smithi137.stderr:++ ceph config get mgr mgr/telemetry/last_opt_revision 2024-03-04T06:41:51.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:51] ENGINE Bus STOPPING 2024-03-04T06:41:51.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:51] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T06:41:51.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:51] ENGINE Bus STOPPED 2024-03-04T06:41:51.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:51] ENGINE Bus STARTING 2024-03-04T06:41:51.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:51] ENGINE Serving on http://:::9283 2024-03-04T06:41:51.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:41:51] ENGINE Bus STARTED 2024-03-04T06:41:51.936 INFO:tasks.workunit.client.0.smithi137.stderr:+ LAST_OPT_REVISION=1 2024-03-04T06:41:51.936 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 1 -ne 1 ']' 2024-03-04T06:41:51.936 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph telemetry show 2024-03-04T06:41:52.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[26846]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:52.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:52.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:52.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[26846]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:52.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:52.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:52.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:52.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:52.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:52.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[26846]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:52.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/779920953' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-03-04T06:41:52.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/779920953' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-03-04T06:41:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[37364]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[37364]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:52.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:52.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[37364]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:52.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/779920953' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-03-04T06:41:52.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:52 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/779920953' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-03-04T06:41:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:52 smithi203 ceph-mon[30756]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:52 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:52 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:52 smithi203 ceph-mon[30756]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:52 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:52 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:52 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:41:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:52 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:41:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:52 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:41:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:52 smithi203 ceph-mon[30756]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:52 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/779920953' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-03-04T06:41:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:52 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/779920953' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-03-04T06:41:52.650 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-03-04T06:41:52.650 INFO:tasks.workunit.client.0.smithi137.stdout: "balancer": { 2024-03-04T06:41:52.650 INFO:tasks.workunit.client.0.smithi137.stdout: "active": true, 2024-03-04T06:41:52.650 INFO:tasks.workunit.client.0.smithi137.stdout: "mode": "" 2024-03-04T06:41:52.650 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.650 INFO:tasks.workunit.client.0.smithi137.stdout: "channels": [ 2024-03-04T06:41:52.650 INFO:tasks.workunit.client.0.smithi137.stdout: "basic", 2024-03-04T06:41:52.650 INFO:tasks.workunit.client.0.smithi137.stdout: "crash", 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: "device", 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: "ident", 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: "perf" 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: "channels_available": [ 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: "basic", 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: "ident", 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: "crash", 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: "device", 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: "perf" 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: "collections_available": [ 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_base", 2024-03-04T06:41:52.651 INFO:tasks.workunit.client.0.smithi137.stdout: "device_base", 2024-03-04T06:41:52.652 INFO:tasks.workunit.client.0.smithi137.stdout: "crash_base", 2024-03-04T06:41:52.652 INFO:tasks.workunit.client.0.smithi137.stdout: "ident_base", 2024-03-04T06:41:52.652 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_perf", 2024-03-04T06:41:52.652 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_mds_metadata", 2024-03-04T06:41:52.652 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_usage", 2024-03-04T06:41:52.652 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_usage_by_class", 2024-03-04T06:41:52.652 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_rook_v01", 2024-03-04T06:41:52.652 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_memory_metrics", 2024-03-04T06:41:52.652 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_options_bluestore" 2024-03-04T06:41:52.652 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.652 INFO:tasks.workunit.client.0.smithi137.stdout: "collections_opted_in": [ 2024-03-04T06:41:52.652 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_base", 2024-03-04T06:41:52.653 INFO:tasks.workunit.client.0.smithi137.stdout: "device_base", 2024-03-04T06:41:52.653 INFO:tasks.workunit.client.0.smithi137.stdout: "crash_base", 2024-03-04T06:41:52.653 INFO:tasks.workunit.client.0.smithi137.stdout: "ident_base", 2024-03-04T06:41:52.653 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_perf", 2024-03-04T06:41:52.653 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_mds_metadata", 2024-03-04T06:41:52.653 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_usage", 2024-03-04T06:41:52.653 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_usage_by_class", 2024-03-04T06:41:52.653 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_rook_v01", 2024-03-04T06:41:52.653 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_memory_metrics", 2024-03-04T06:41:52.653 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_options_bluestore" 2024-03-04T06:41:52.653 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.653 INFO:tasks.workunit.client.0.smithi137.stdout: "config": { 2024-03-04T06:41:52.654 INFO:tasks.workunit.client.0.smithi137.stdout: "active_changed": [ 2024-03-04T06:41:52.654 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-04T06:41:52.654 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_debug", 2024-03-04T06:41:52.654 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_mon_ticket_ttl", 2024-03-04T06:41:52.654 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_service_ticket_ttl", 2024-03-04T06:41:52.654 INFO:tasks.workunit.client.0.smithi137.stdout: "bdev_debug_aio", 2024-03-04T06:41:52.654 INFO:tasks.workunit.client.0.smithi137.stdout: "client_check_pool_perm", 2024-03-04T06:41:52.654 INFO:tasks.workunit.client.0.smithi137.stdout: "client_mount_gid", 2024-03-04T06:41:52.654 INFO:tasks.workunit.client.0.smithi137.stdout: "client_mount_uid", 2024-03-04T06:41:52.654 INFO:tasks.workunit.client.0.smithi137.stdout: "client_quota", 2024-03-04T06:41:52.654 INFO:tasks.workunit.client.0.smithi137.stdout: "container_image", 2024-03-04T06:41:52.654 INFO:tasks.workunit.client.0.smithi137.stdout: "daemonize", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_asserts_on_shutdown", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mgr", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mon", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_ms", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_osd", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_paxos", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "keyring", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_block_size", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_cache_size", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_compression", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_log", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_write_buffer_size", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_file", 2024-03-04T06:41:52.655 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_journald", 2024-03-04T06:41:52.656 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_stderr", 2024-03-04T06:41:52.656 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_allow_pool_delete", 2024-03-04T06:41:52.656 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_clock_drift_allowed", 2024-03-04T06:41:52.656 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_file_level", 2024-03-04T06:41:52.656 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_file", 2024-03-04T06:41:52.656 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_journald", 2024-03-04T06:41:52.656 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_stderr", 2024-03-04T06:41:52.656 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_data_avail_warn", 2024-03-04T06:41:52.656 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_election_default_strategy", 2024-03-04T06:41:52.656 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_host", 2024-03-04T06:41:52.656 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_max_pg_per_osd", 2024-03-04T06:41:52.657 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_mgr_mkfs_grace", 2024-03-04T06:41:52.657 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_prime_pg_temp", 2024-03-04T06:41:52.657 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_reporter_subtree_level", 2024-03-04T06:41:52.657 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_pg_warn_max_object_skew", 2024-03-04T06:41:52.657 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-04T06:41:52.657 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-04T06:41:52.657 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-04T06:41:52.657 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-04T06:41:52.657 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-04T06:41:52.657 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-04T06:41:52.657 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-04T06:41:52.657 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-04T06:41:52.657 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_too_few_osds", 2024-03-04T06:41:52.658 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_bug", 2024-03-04T06:41:52.658 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_old_message", 2024-03-04T06:41:52.658 INFO:tasks.workunit.client.0.smithi137.stdout: "no_config_file", 2024-03-04T06:41:52.658 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_default_list", 2024-03-04T06:41:52.658 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_load_list", 2024-03-04T06:41:52.658 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_crush_chooseleaf_type", 2024-03-04T06:41:52.658 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_misdirected_ops", 2024-03-04T06:41:52.658 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_op_order", 2024-03-04T06:41:52.658 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_pg_log_writeout", 2024-03-04T06:41:52.658 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_shutdown", 2024-03-04T06:41:52.658 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_cached_snaps", 2024-03-04T06:41:52.659 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_missing_on_start", 2024-03-04T06:41:52.659 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_stray_on_activate", 2024-03-04T06:41:52.659 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-04T06:41:52.659 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_profile", 2024-03-04T06:41:52.659 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-03-04T06:41:52.659 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-03-04T06:41:52.659 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-03-04T06:41:52.659 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-03-04T06:41:52.659 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-03-04T06:41:52.659 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-03-04T06:41:52.659 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_client_lim", 2024-03-04T06:41:52.659 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_client_res", 2024-03-04T06:41:52.660 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_client_wgt", 2024-03-04T06:41:52.660 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target", 2024-03-04T06:41:52.660 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target_autotune", 2024-03-04T06:41:52.660 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue", 2024-03-04T06:41:52.660 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue_cut_off", 2024-03-04T06:41:52.660 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_erasure_code_profile", 2024-03-04T06:41:52.660 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-04T06:41:52.660 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recover_clone_overlap", 2024-03-04T06:41:52.660 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recovery_max_chunk", 2024-03-04T06:41:52.660 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_load_threshold", 2024-03-04T06:41:52.660 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_max_interval", 2024-03-04T06:41:52.660 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_shutdown_pgref_assert", 2024-03-04T06:41:52.661 INFO:tasks.workunit.client.0.smithi137.stdout: "public_addr", 2024-03-04T06:41:52.661 INFO:tasks.workunit.client.0.smithi137.stdout: "public_addrv", 2024-03-04T06:41:52.661 INFO:tasks.workunit.client.0.smithi137.stdout: "public_network", 2024-03-04T06:41:52.661 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd_default_features", 2024-03-04T06:41:52.661 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd_qos_exclude_ops", 2024-03-04T06:41:52.661 INFO:tasks.workunit.client.0.smithi137.stdout: "setgroup", 2024-03-04T06:41:52.661 INFO:tasks.workunit.client.0.smithi137.stdout: "setuser" 2024-03-04T06:41:52.661 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.661 INFO:tasks.workunit.client.0.smithi137.stdout: "cluster_changed": [ 2024-03-04T06:41:52.661 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-04T06:41:52.661 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_debug", 2024-03-04T06:41:52.662 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_mon_ticket_ttl", 2024-03-04T06:41:52.662 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_service_ticket_ttl", 2024-03-04T06:41:52.662 INFO:tasks.workunit.client.0.smithi137.stdout: "bdev_debug_aio", 2024-03-04T06:41:52.662 INFO:tasks.workunit.client.0.smithi137.stdout: "container_image", 2024-03-04T06:41:52.662 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_asserts_on_shutdown", 2024-03-04T06:41:52.662 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mgr", 2024-03-04T06:41:52.662 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mon", 2024-03-04T06:41:52.662 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_ms", 2024-03-04T06:41:52.662 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_osd", 2024-03-04T06:41:52.662 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_paxos", 2024-03-04T06:41:52.662 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_file", 2024-03-04T06:41:52.662 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_journald", 2024-03-04T06:41:52.663 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_stderr", 2024-03-04T06:41:52.663 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_join_fs", 2024-03-04T06:41:52.663 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/allow_ptrace", 2024-03-04T06:41:52.663 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/container_init", 2024-03-04T06:41:52.663 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/migration_current", 2024-03-04T06:41:52.663 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/use_repo_digest", 2024-03-04T06:41:52.663 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-03-04T06:41:52.663 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-03-04T06:41:52.663 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-03-04T06:41:52.663 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-03-04T06:41:52.663 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/ssl_server_port", 2024-03-04T06:41:52.663 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/orchestrator/orchestrator", 2024-03-04T06:41:52.663 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/channel_ident", 2024-03-04T06:41:52.664 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/channel_perf", 2024-03-04T06:41:52.664 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/description", 2024-03-04T06:41:52.664 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/enabled", 2024-03-04T06:41:52.664 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/organization", 2024-03-04T06:41:52.664 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_allow_pool_delete", 2024-03-04T06:41:52.664 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_clock_drift_allowed", 2024-03-04T06:41:52.664 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_file_level", 2024-03-04T06:41:52.664 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_file", 2024-03-04T06:41:52.664 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_data_avail_warn", 2024-03-04T06:41:52.664 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_election_default_strategy", 2024-03-04T06:41:52.664 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_max_pg_per_osd", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_mgr_mkfs_grace", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_prime_pg_temp", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_reporter_subtree_level", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_pg_warn_max_object_skew", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_too_few_osds", 2024-03-04T06:41:52.665 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_bug", 2024-03-04T06:41:52.666 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_old_message", 2024-03-04T06:41:52.666 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_default_list", 2024-03-04T06:41:52.666 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_load_list", 2024-03-04T06:41:52.666 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_misdirected_ops", 2024-03-04T06:41:52.666 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_op_order", 2024-03-04T06:41:52.666 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_pg_log_writeout", 2024-03-04T06:41:52.666 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_shutdown", 2024-03-04T06:41:52.666 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_cached_snaps", 2024-03-04T06:41:52.666 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_missing_on_start", 2024-03-04T06:41:52.666 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_stray_on_activate", 2024-03-04T06:41:52.666 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-04T06:41:52.666 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_profile", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target_autotune", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue_cut_off", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_erasure_code_profile", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recover_clone_overlap", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recovery_max_chunk", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_load_threshold", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_max_interval", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_shutdown_pgref_assert", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "public_network", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "rgw_cache_enabled", 2024-03-04T06:41:52.667 INFO:tasks.workunit.client.0.smithi137.stdout: "rgw_enable_ops_log", 2024-03-04T06:41:52.668 INFO:tasks.workunit.client.0.smithi137.stdout: "rgw_enable_usage_log" 2024-03-04T06:41:52.668 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.668 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.668 INFO:tasks.workunit.client.0.smithi137.stdout: "contact": null, 2024-03-04T06:41:52.668 INFO:tasks.workunit.client.0.smithi137.stdout: "crashes": [], 2024-03-04T06:41:52.668 INFO:tasks.workunit.client.0.smithi137.stdout: "created": "2024-03-04T06:32:42.596028Z", 2024-03-04T06:41:52.668 INFO:tasks.workunit.client.0.smithi137.stdout: "crush": { 2024-03-04T06:41:52.668 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_algs": { 2024-03-04T06:41:52.668 INFO:tasks.workunit.client.0.smithi137.stdout: "straw2": 3 2024-03-04T06:41:52.668 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.668 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_sizes": { 2024-03-04T06:41:52.668 INFO:tasks.workunit.client.0.smithi137.stdout: "2": 1, 2024-03-04T06:41:52.668 INFO:tasks.workunit.client.0.smithi137.stdout: "4": 2 2024-03-04T06:41:52.669 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.669 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_types": { 2024-03-04T06:41:52.669 INFO:tasks.workunit.client.0.smithi137.stdout: "1": 2, 2024-03-04T06:41:52.669 INFO:tasks.workunit.client.0.smithi137.stdout: "11": 1 2024-03-04T06:41:52.669 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.669 INFO:tasks.workunit.client.0.smithi137.stdout: "compat_weight_set": false, 2024-03-04T06:41:52.669 INFO:tasks.workunit.client.0.smithi137.stdout: "device_classes": [ 2024-03-04T06:41:52.669 INFO:tasks.workunit.client.0.smithi137.stdout: 8 2024-03-04T06:41:52.669 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_buckets": 6, 2024-03-04T06:41:52.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_devices": 8, 2024-03-04T06:41:52.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_rules": 1, 2024-03-04T06:41:52.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_types": 12, 2024-03-04T06:41:52.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_weight_sets": 0, 2024-03-04T06:41:52.670 INFO:tasks.workunit.client.0.smithi137.stdout: "tunables": { 2024-03-04T06:41:52.670 INFO:tasks.workunit.client.0.smithi137.stdout: "allowed_bucket_algs": 54, 2024-03-04T06:41:52.670 INFO:tasks.workunit.client.0.smithi137.stdout: "choose_local_fallback_tries": 0, 2024-03-04T06:41:52.670 INFO:tasks.workunit.client.0.smithi137.stdout: "choose_local_tries": 0, 2024-03-04T06:41:52.670 INFO:tasks.workunit.client.0.smithi137.stdout: "choose_total_tries": 50, 2024-03-04T06:41:52.670 INFO:tasks.workunit.client.0.smithi137.stdout: "chooseleaf_descend_once": 1, 2024-03-04T06:41:52.670 INFO:tasks.workunit.client.0.smithi137.stdout: "chooseleaf_stable": 1, 2024-03-04T06:41:52.670 INFO:tasks.workunit.client.0.smithi137.stdout: "chooseleaf_vary_r": 1, 2024-03-04T06:41:52.670 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v2_rules": 0, 2024-03-04T06:41:52.670 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v3_rules": 0, 2024-03-04T06:41:52.670 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v4_buckets": 1, 2024-03-04T06:41:52.670 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v5_rules": 0, 2024-03-04T06:41:52.671 INFO:tasks.workunit.client.0.smithi137.stdout: "legacy_tunables": 0, 2024-03-04T06:41:52.671 INFO:tasks.workunit.client.0.smithi137.stdout: "minimum_required_version": "jewel", 2024-03-04T06:41:52.671 INFO:tasks.workunit.client.0.smithi137.stdout: "optimal_tunables": 1, 2024-03-04T06:41:52.671 INFO:tasks.workunit.client.0.smithi137.stdout: "profile": "jewel", 2024-03-04T06:41:52.671 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables": 1, 2024-03-04T06:41:52.671 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables2": 1, 2024-03-04T06:41:52.671 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables3": 1, 2024-03-04T06:41:52.671 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables5": 1, 2024-03-04T06:41:52.671 INFO:tasks.workunit.client.0.smithi137.stdout: "straw_calc_version": 1 2024-03-04T06:41:52.671 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.671 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.671 INFO:tasks.workunit.client.0.smithi137.stdout: "description": "upgrade test cluster", 2024-03-04T06:41:52.672 INFO:tasks.workunit.client.0.smithi137.stdout: "fs": { 2024-03-04T06:41:52.672 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:52.672 INFO:tasks.workunit.client.0.smithi137.stdout: "feature_flags": { 2024-03-04T06:41:52.672 INFO:tasks.workunit.client.0.smithi137.stdout: "enable_multiple": true, 2024-03-04T06:41:52.672 INFO:tasks.workunit.client.0.smithi137.stdout: "ever_enabled_multiple": true 2024-03-04T06:41:52.672 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.672 INFO:tasks.workunit.client.0.smithi137.stdout: "filesystems": [ 2024-03-04T06:41:52.672 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.672 INFO:tasks.workunit.client.0.smithi137.stdout: "approx_ctime": "2024-03", 2024-03-04T06:41:52.672 INFO:tasks.workunit.client.0.smithi137.stdout: "balancer_enabled": false, 2024-03-04T06:41:52.672 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.672 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_caps": 0, 2024-03-04T06:41:52.672 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_dns": 10, 2024-03-04T06:41:52.673 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_inos": 13, 2024-03-04T06:41:52.673 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_subtrees": 2, 2024-03-04T06:41:52.673 INFO:tasks.workunit.client.0.smithi137.stdout: "ever_allowed_features": 0, 2024-03-04T06:41:52.673 INFO:tasks.workunit.client.0.smithi137.stdout: "explicitly_allowed_features": 0, 2024-03-04T06:41:52.673 INFO:tasks.workunit.client.0.smithi137.stdout: "files": 0, 2024-03-04T06:41:52.673 INFO:tasks.workunit.client.0.smithi137.stdout: "max_mds": 1, 2024-03-04T06:41:52.673 INFO:tasks.workunit.client.0.smithi137.stdout: "num_data_pools": 1, 2024-03-04T06:41:52.673 INFO:tasks.workunit.client.0.smithi137.stdout: "num_in": 1, 2024-03-04T06:41:52.673 INFO:tasks.workunit.client.0.smithi137.stdout: "num_mds": 1, 2024-03-04T06:41:52.673 INFO:tasks.workunit.client.0.smithi137.stdout: "num_sessions": 0, 2024-03-04T06:41:52.673 INFO:tasks.workunit.client.0.smithi137.stdout: "num_standby_replay": 0, 2024-03-04T06:41:52.673 INFO:tasks.workunit.client.0.smithi137.stdout: "num_up": 1, 2024-03-04T06:41:52.673 INFO:tasks.workunit.client.0.smithi137.stdout: "snaps": 0, 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: "standby_count_wanted": 0 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: "num_standby_mds": 1, 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: "total_num_mds": 2 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_stats": { 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: "mds": { 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: "mds.8ac76538560e2a49997c4cba61f942431c1ec214": { 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 20537344, 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 425144, 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2752512, 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 114688, 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 778240, 2024-03-04T06:41:52.674 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 406, 2024-03-04T06:41:52.675 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:52.675 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 1350648, 2024-03-04T06:41:52.675 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 20, 2024-03-04T06:41:52.675 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 1014784, 2024-03-04T06:41:52.675 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 14879568, 2024-03-04T06:41:52.675 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 21315584 2024-03-04T06:41:52.675 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.675 INFO:tasks.workunit.client.0.smithi137.stdout: "mds.e1b16a9a7a0ba72344e1af0e17524b2e886c9ba9": { 2024-03-04T06:41:52.675 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 20267008, 2024-03-04T06:41:52.675 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 372872, 2024-03-04T06:41:52.675 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2752512, 2024-03-04T06:41:52.675 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 1048576, 2024-03-04T06:41:52.675 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 0, 2024-03-04T06:41:52.676 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 321, 2024-03-04T06:41:52.676 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:52.676 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 995248, 2024-03-04T06:41:52.676 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 12, 2024-03-04T06:41:52.676 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 641024, 2024-03-04T06:41:52.676 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 14456776, 2024-03-04T06:41:52.676 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 20267008 2024-03-04T06:41:52.676 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.676 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.676 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:52.676 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.367540c6d8636e8ade040b6791ecc93ab23e3392": { 2024-03-04T06:41:52.676 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 35627008, 2024-03-04T06:41:52.677 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 721360, 2024-03-04T06:41:52.677 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 4849664, 2024-03-04T06:41:52.677 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 573440, 2024-03-04T06:41:52.677 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 8871936, 2024-03-04T06:41:52.677 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 951, 2024-03-04T06:41:52.677 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:52.677 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 8031856, 2024-03-04T06:41:52.677 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 21, 2024-03-04T06:41:52.677 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 1123840, 2024-03-04T06:41:52.677 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 20326848, 2024-03-04T06:41:52.677 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 44498944 2024-03-04T06:41:52.677 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.678 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.8ac76538560e2a49997c4cba61f942431c1ec214": { 2024-03-04T06:41:52.678 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 34955264, 2024-03-04T06:41:52.678 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 1043792, 2024-03-04T06:41:52.678 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2752512, 2024-03-04T06:41:52.678 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 0, 2024-03-04T06:41:52.678 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 9543680, 2024-03-04T06:41:52.678 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1221, 2024-03-04T06:41:52.678 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:52.678 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 8475872, 2024-03-04T06:41:52.678 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 22, 2024-03-04T06:41:52.678 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 1457920, 2024-03-04T06:41:52.678 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 21225168, 2024-03-04T06:41:52.678 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 44498944 2024-03-04T06:41:52.679 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.679 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.e1b16a9a7a0ba72344e1af0e17524b2e886c9ba9": { 2024-03-04T06:41:52.679 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 44515328, 2024-03-04T06:41:52.679 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 1310544, 2024-03-04T06:41:52.679 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2752512, 2024-03-04T06:41:52.679 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 581632, 2024-03-04T06:41:52.679 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 4079616, 2024-03-04T06:41:52.679 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1842, 2024-03-04T06:41:52.679 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:52.679 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 12720184, 2024-03-04T06:41:52.679 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 22, 2024-03-04T06:41:52.680 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 2546432, 2024-03-04T06:41:52.680 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 24604024, 2024-03-04T06:41:52.680 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 48594944 2024-03-04T06:41:52.680 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.680 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.680 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.680 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.0": { 2024-03-04T06:41:52.680 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 47005696, 2024-03-04T06:41:52.680 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 1013408, 2024-03-04T06:41:52.680 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:52.680 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 0, 2024-03-04T06:41:52.680 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 360448, 2024-03-04T06:41:52.680 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1387, 2024-03-04T06:41:52.681 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:52.681 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 4851728, 2024-03-04T06:41:52.681 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 46, 2024-03-04T06:41:52.681 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 2659584, 2024-03-04T06:41:52.681 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 35597392, 2024-03-04T06:41:52.681 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 47366144 2024-03-04T06:41:52.681 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.681 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.1": { 2024-03-04T06:41:52.681 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 45473792, 2024-03-04T06:41:52.681 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 646408, 2024-03-04T06:41:52.681 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:52.681 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 0, 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 712704, 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1337, 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 5863176, 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 47, 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 2070016, 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 34010608, 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 46186496 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.2": { 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 43696128, 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 699360, 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:52.682 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 0, 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 393216, 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1234, 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 4753696, 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 47, 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 2213120, 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 33146368, 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 44089344 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.3": { 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 44032000, 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 801200, 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:52.683 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 24576, 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 188416, 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1221, 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 4294960, 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 45, 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 1739008, 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 34288672, 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 44220416 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.4": { 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 43909120, 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 734096, 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:52.684 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 57344, 2024-03-04T06:41:52.685 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 180224, 2024-03-04T06:41:52.685 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1227, 2024-03-04T06:41:52.685 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:52.685 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 4430304, 2024-03-04T06:41:52.685 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 47, 2024-03-04T06:41:52.685 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 2035968, 2024-03-04T06:41:52.685 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 33767824, 2024-03-04T06:41:52.685 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 44089344 2024-03-04T06:41:52.685 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.685 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.5": { 2024-03-04T06:41:52.685 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 44982272, 2024-03-04T06:41:52.685 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 818624, 2024-03-04T06:41:52.685 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 0, 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 286720, 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1228, 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 4306464, 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 48, 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 2157568, 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 34816032, 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 45268992 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.6": { 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 45481984, 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 971712, 2024-03-04T06:41:52.686 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 65536, 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 770048, 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1256, 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 5117896, 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 46, 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 1711616, 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 34731640, 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 46252032 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.7": { 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 45088768, 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 1331608, 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:52.687 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 0, 2024-03-04T06:41:52.688 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 114688, 2024-03-04T06:41:52.688 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1273, 2024-03-04T06:41:52.688 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:52.688 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 4489120, 2024-03-04T06:41:52.688 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 48, 2024-03-04T06:41:52.688 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 1916672, 2024-03-04T06:41:52.688 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 34467784, 2024-03-04T06:41:52.688 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 45203456 2024-03-04T06:41:52.688 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.688 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.688 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.688 INFO:tasks.workunit.client.0.smithi137.stdout: "hosts": { 2024-03-04T06:41:52.688 INFO:tasks.workunit.client.0.smithi137.stdout: "num": 2, 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_mds": 2, 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_mgr": 2, 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_mon": 2, 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_osd": 2 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: "io_rate": { 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_stats_delta": { 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": 0, 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_store_stats": 0, 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: "stamp_delta": "12.002662", 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:52.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:52.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:52.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:52.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:52.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:52.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:52.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:52.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:52.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:52.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:52.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:52.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:52.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:52.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:52.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:52.692 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:52.692 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:52.692 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:52.692 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:52.692 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:52.692 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:52.692 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:52.692 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:52.692 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:52.692 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:52.692 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:52.692 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: "store_stats": { 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": 0, 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: "available": 0, 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed": 0, 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_allocated": 0, 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_original": 0, 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: "data_stored": 0, 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: "internal_metadata": 0, 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: "internally_reserved": 0, 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_allocated": 0, 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: "total": 0 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.693 INFO:tasks.workunit.client.0.smithi137.stdout: "up": 0 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: "leaderboard": false, 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: "leaderboard_description": null, 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: "license": "sharing-1-0", 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: "mempool": { 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: "mds": { 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: "mds.8ac76538560e2a49997c4cba61f942431c1ec214": { 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:52.694 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.695 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:52.696 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.697 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.698 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 222439, 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 68 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.699 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 51416, 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 208 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.700 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 7912, 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:52.701 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: "mds.e1b16a9a7a0ba72344e1af0e17524b2e886c9ba9": { 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.702 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.703 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.703 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:52.703 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.703 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.703 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.703 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:52.703 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.703 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.703 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.703 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:52.703 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.703 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.704 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.704 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:52.704 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.704 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.704 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.704 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:52.704 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.704 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.704 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.704 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:52.704 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.704 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.704 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.705 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:52.705 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.705 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.705 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.705 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:52.705 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.705 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.705 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.705 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:52.705 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.705 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.705 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.705 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.706 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.707 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:52.707 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.707 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.707 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.707 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:52.707 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.707 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.707 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.707 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:52.707 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.707 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.707 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.708 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:52.708 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.708 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.708 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.708 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:52.708 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 149137, 2024-03-04T06:41:52.708 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 32 2024-03-04T06:41:52.708 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.708 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:52.708 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.708 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.708 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.708 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 928, 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 2 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.709 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.710 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.367540c6d8636e8ade040b6791ecc93ab23e3392": { 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.711 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.712 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.713 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.714 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.715 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1136179, 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 350 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.716 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6488, 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 122 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.717 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12744, 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 1546 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 5152, 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 83 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.718 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.8ac76538560e2a49997c4cba61f942431c1ec214": { 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.719 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:52.720 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.720 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.720 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.720 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:52.720 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.720 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.720 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.720 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:52.720 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.720 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.720 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.720 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:52.720 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.721 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:52.722 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.722 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.722 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.722 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:52.722 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.722 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.722 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.722 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:52.722 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.722 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.722 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.722 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.723 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1334547, 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 411 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.724 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6488, 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 122 2024-03-04T06:41:52.725 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12744, 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 1546 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 5152, 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 83 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.726 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.e1b16a9a7a0ba72344e1af0e17524b2e886c9ba9": { 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.727 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:52.728 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:52.729 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:52.730 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:52.731 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1152603, 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 362 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 352, 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 4 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.732 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6488, 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 122 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12744, 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 1546 2024-03-04T06:41:52.733 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 10304, 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 166 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.734 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.0": { 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:52.735 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 5520, 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 69 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 20944, 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 187 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1600, 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 44 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:52.736 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 602112, 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 16 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 50926, 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 9466 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 136936, 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 233 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 11372, 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 742 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:52.737 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8976, 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 187 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 31702, 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 201 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 20944, 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 187 2024-03-04T06:41:52.738 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 414076, 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 92 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2436246, 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 192 2024-03-04T06:41:52.739 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6776, 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 77 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 521640, 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 45 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:52.740 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 88400, 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 174 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225128, 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3418 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.741 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.1": { 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:52.742 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:52.743 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4960, 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 62 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19600, 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 175 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1152, 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 40 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12288, 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.744 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 44978, 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8516 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 127416, 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 219 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 9328, 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 567 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8400, 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 175 2024-03-04T06:41:52.745 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.746 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:52.746 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.746 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.746 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.746 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:52.746 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 27514, 2024-03-04T06:41:52.746 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 187 2024-03-04T06:41:52.746 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.746 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:52.746 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19600, 2024-03-04T06:41:52.746 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 175 2024-03-04T06:41:52.746 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.746 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 736, 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 1 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 422511, 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 94 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12112, 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2427107, 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 173 2024-03-04T06:41:52.747 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4840, 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 55 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 428904, 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 37 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.748 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 7280, 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 18 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225128, 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3418 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.749 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:52.750 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.750 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.750 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.750 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:52.750 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.750 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.750 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.750 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:52.750 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.750 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.750 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.750 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.750 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.2": { 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.751 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4480, 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 56 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19376, 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 173 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1040, 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 39 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:52.752 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8192, 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 2 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 43808, 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8284 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 123336, 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 213 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8280, 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 515 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.753 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:52.754 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8304, 2024-03-04T06:41:52.754 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 173 2024-03-04T06:41:52.754 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.754 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:52.754 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.754 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.754 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.754 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:52.754 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 26314, 2024-03-04T06:41:52.754 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 181 2024-03-04T06:41:52.754 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.754 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:52.754 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19376, 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 173 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 736, 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 1 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 369263, 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 81 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12112, 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.755 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2446288, 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 187 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4400, 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 50 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 359352, 2024-03-04T06:41:52.756 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 31 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 9360, 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 26 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225640, 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3442 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.757 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.758 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.759 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.3": { 2024-03-04T06:41:52.759 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:52.759 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.759 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.759 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.759 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:52.759 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:52.759 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:52.759 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.759 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:52.759 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:52.759 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:52.759 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 3520, 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 44 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19936, 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 178 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:52.760 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 480, 2024-03-04T06:41:52.761 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 34 2024-03-04T06:41:52.761 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.761 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:52.761 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.761 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.761 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.761 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:52.761 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 44416, 2024-03-04T06:41:52.761 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8505 2024-03-04T06:41:52.761 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.761 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:52.761 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 127416, 2024-03-04T06:41:52.761 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 219 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 9420, 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 575 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8544, 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 178 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.762 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:52.763 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 27010, 2024-03-04T06:41:52.763 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 187 2024-03-04T06:41:52.763 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.763 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:52.763 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19936, 2024-03-04T06:41:52.763 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 178 2024-03-04T06:41:52.763 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.763 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:52.763 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2208, 2024-03-04T06:41:52.763 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.763 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.763 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:52.764 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 236330, 2024-03-04T06:41:52.764 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 49 2024-03-04T06:41:52.764 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.764 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:52.764 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 26565, 2024-03-04T06:41:52.764 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 9 2024-03-04T06:41:52.764 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.764 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:52.764 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2468427, 2024-03-04T06:41:52.764 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 193 2024-03-04T06:41:52.764 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.764 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:52.764 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4752, 2024-03-04T06:41:52.765 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 54 2024-03-04T06:41:52.765 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.765 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:52.765 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.765 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.765 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.765 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.765 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 428904, 2024-03-04T06:41:52.765 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 37 2024-03-04T06:41:52.765 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.765 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:52.765 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.765 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 10400, 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 20 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225128, 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3418 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:52.766 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.4": { 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.767 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.768 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 3440, 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 43 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19824, 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 177 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 816, 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 37 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.769 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 44902, 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8589 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 128776, 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 221 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 9592, 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 573 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8496, 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 177 2024-03-04T06:41:52.770 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 27690, 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 189 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19824, 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 177 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 736, 2024-03-04T06:41:52.771 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 1 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 916463, 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 72 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12112, 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2419714, 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 175 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.772 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4752, 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 54 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 452088, 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 39 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.773 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.774 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.774 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:52.774 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 7904, 2024-03-04T06:41:52.774 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 16 2024-03-04T06:41:52.774 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.774 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:52.774 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225384, 2024-03-04T06:41:52.774 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3430 2024-03-04T06:41:52.774 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.774 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:52.774 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.774 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.774 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.5": { 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:52.775 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.776 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2800, 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 35 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19712, 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 176 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 480, 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 34 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.777 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 45199, 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8612 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 129456, 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 222 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 9828, 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 575 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.778 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8448, 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 176 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 28114, 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 190 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19712, 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 176 2024-03-04T06:41:52.779 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2208, 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 834656, 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 52 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 26565, 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 9 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:52.780 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2431304, 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 177 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 5368, 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 61 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 475272, 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 41 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:52.781 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 11960, 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 23 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225640, 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3442 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:52.782 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.783 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.783 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.783 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:52.783 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.783 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.783 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.783 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:52.783 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.783 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.783 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.783 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.6": { 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:52.784 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:52.785 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.785 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.785 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:52.785 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2400, 2024-03-04T06:41:52.785 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 30 2024-03-04T06:41:52.785 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.785 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:52.785 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 20832, 2024-03-04T06:41:52.785 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 186 2024-03-04T06:41:52.785 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.785 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:52.785 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 256, 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 32 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 45988, 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8964 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 129456, 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 222 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:52.786 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 10872, 2024-03-04T06:41:52.787 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 734 2024-03-04T06:41:52.787 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.787 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:52.787 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8928, 2024-03-04T06:41:52.787 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 186 2024-03-04T06:41:52.787 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.787 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:52.787 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.787 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.787 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.787 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:52.787 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 28974, 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 190 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 20832, 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 186 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 808996, 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 46 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.788 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:52.789 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.789 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.789 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.789 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:52.789 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2428684, 2024-03-04T06:41:52.789 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 175 2024-03-04T06:41:52.789 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.789 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:52.789 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4664, 2024-03-04T06:41:52.789 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 53 2024-03-04T06:41:52.789 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.789 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:52.789 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 452088, 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 39 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 88712, 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 181 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:52.790 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225896, 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3454 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:52.791 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.7": { 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:52.792 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1760, 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 22 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 20608, 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 184 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.793 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1152, 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 40 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 274432, 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 47797, 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 9191 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 133536, 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 228 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:52.794 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 11616, 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 737 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8832, 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 184 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 30846, 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 196 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:52.795 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 20608, 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 184 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 149871, 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 29 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.796 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2396716, 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 191 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 5896, 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 67 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 533232, 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 46 2024-03-04T06:41:52.797 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.798 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:52.798 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.798 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.798 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.798 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:52.798 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 89232, 2024-03-04T06:41:52.798 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 198 2024-03-04T06:41:52.798 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.798 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:52.798 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225128, 2024-03-04T06:41:52.798 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3418 2024-03-04T06:41:52.798 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:52.799 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:52.800 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:52.800 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.800 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.800 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.800 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.800 INFO:tasks.workunit.client.0.smithi137.stdout: "metadata": { 2024-03-04T06:41:52.800 INFO:tasks.workunit.client.0.smithi137.stdout: "mds": { 2024-03-04T06:41:52.800 INFO:tasks.workunit.client.0.smithi137.stdout: "arch": { 2024-03-04T06:41:52.800 INFO:tasks.workunit.client.0.smithi137.stdout: "x86_64": 2 2024-03-04T06:41:52.800 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.800 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_version": { 2024-03-04T06:41:52.800 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:41:52.800 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: "cpu": { 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 2 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: "distro": { 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: "centos": 2 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: "distro_description": { 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: "CentOS Stream 8": 2 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_description": { 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: "#1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024": 2 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_version": { 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: "5.14.0-427.el9.x86_64": 2 2024-03-04T06:41:52.801 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: "os": { 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: "Linux": 2 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: "arch": { 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: "x86_64": 3 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_version": { 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 3 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: "cpu": { 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 3 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.802 INFO:tasks.workunit.client.0.smithi137.stdout: "distro": { 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: "centos": 3 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: "distro_description": { 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: "CentOS Stream 8": 3 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_description": { 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: "#1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024": 3 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_version": { 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: "5.14.0-427.el9.x86_64": 3 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: "os": { 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: "Linux": 3 2024-03-04T06:41:52.803 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: "arch": { 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: "x86_64": 8 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_version": { 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 8 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: "cpu": { 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 8 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: "distro": { 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: "centos": 8 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.804 INFO:tasks.workunit.client.0.smithi137.stdout: "distro_description": { 2024-03-04T06:41:52.805 INFO:tasks.workunit.client.0.smithi137.stdout: "CentOS Stream 8": 8 2024-03-04T06:41:52.805 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.805 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_description": { 2024-03-04T06:41:52.805 INFO:tasks.workunit.client.0.smithi137.stdout: "#1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024": 8 2024-03-04T06:41:52.805 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.805 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_version": { 2024-03-04T06:41:52.805 INFO:tasks.workunit.client.0.smithi137.stdout: "5.14.0-427.el9.x86_64": 8 2024-03-04T06:41:52.805 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.805 INFO:tasks.workunit.client.0.smithi137.stdout: "os": { 2024-03-04T06:41:52.805 INFO:tasks.workunit.client.0.smithi137.stdout: "Linux": 8 2024-03-04T06:41:52.805 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.805 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_objectstore": { 2024-03-04T06:41:52.806 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": 8 2024-03-04T06:41:52.806 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.806 INFO:tasks.workunit.client.0.smithi137.stdout: "rotational": { 2024-03-04T06:41:52.806 INFO:tasks.workunit.client.0.smithi137.stdout: "0": 8 2024-03-04T06:41:52.806 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.806 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.806 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.806 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:52.806 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:52.806 INFO:tasks.workunit.client.0.smithi137.stdout: "features": { 2024-03-04T06:41:52.806 INFO:tasks.workunit.client.0.smithi137.stdout: "optional": [], 2024-03-04T06:41:52.806 INFO:tasks.workunit.client.0.smithi137.stdout: "persistent": [ 2024-03-04T06:41:52.807 INFO:tasks.workunit.client.0.smithi137.stdout: "kraken", 2024-03-04T06:41:52.807 INFO:tasks.workunit.client.0.smithi137.stdout: "luminous", 2024-03-04T06:41:52.807 INFO:tasks.workunit.client.0.smithi137.stdout: "mimic", 2024-03-04T06:41:52.807 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap-prune", 2024-03-04T06:41:52.807 INFO:tasks.workunit.client.0.smithi137.stdout: "nautilus", 2024-03-04T06:41:52.807 INFO:tasks.workunit.client.0.smithi137.stdout: "octopus", 2024-03-04T06:41:52.807 INFO:tasks.workunit.client.0.smithi137.stdout: "pacific", 2024-03-04T06:41:52.807 INFO:tasks.workunit.client.0.smithi137.stdout: "elector-pinging", 2024-03-04T06:41:52.807 INFO:tasks.workunit.client.0.smithi137.stdout: "quincy", 2024-03-04T06:41:52.807 INFO:tasks.workunit.client.0.smithi137.stdout: "reef" 2024-03-04T06:41:52.807 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.807 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.808 INFO:tasks.workunit.client.0.smithi137.stdout: "ipv4_addr_mons": 6, 2024-03-04T06:41:52.808 INFO:tasks.workunit.client.0.smithi137.stdout: "ipv6_addr_mons": 0, 2024-03-04T06:41:52.808 INFO:tasks.workunit.client.0.smithi137.stdout: "min_mon_release": 18, 2024-03-04T06:41:52.808 INFO:tasks.workunit.client.0.smithi137.stdout: "v1_addr_mons": 3, 2024-03-04T06:41:52.808 INFO:tasks.workunit.client.0.smithi137.stdout: "v2_addr_mons": 3 2024-03-04T06:41:52.808 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.808 INFO:tasks.workunit.client.0.smithi137.stdout: "organization": "ceph-qa", 2024-03-04T06:41:52.808 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:52.808 INFO:tasks.workunit.client.0.smithi137.stdout: "cluster_network": false, 2024-03-04T06:41:52.808 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 8, 2024-03-04T06:41:52.808 INFO:tasks.workunit.client.0.smithi137.stdout: "require_min_compat_client": "luminous", 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: "require_osd_release": "reef" 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_perf_histograms": [ 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: "axes": [ 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Latency (usec)", 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 100000, 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:52.809 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 99999]", 2024-03-04T06:41:52.810 INFO:tasks.workunit.client.0.smithi137.stdout: "[100000, 199999]", 2024-03-04T06:41:52.810 INFO:tasks.workunit.client.0.smithi137.stdout: "[200000, 399999]", 2024-03-04T06:41:52.810 INFO:tasks.workunit.client.0.smithi137.stdout: "[400000, 799999]", 2024-03-04T06:41:52.810 INFO:tasks.workunit.client.0.smithi137.stdout: "[800000, 1599999]", 2024-03-04T06:41:52.810 INFO:tasks.workunit.client.0.smithi137.stdout: "[1600000, 3199999]", 2024-03-04T06:41:52.810 INFO:tasks.workunit.client.0.smithi137.stdout: "[3200000, 6399999]", 2024-03-04T06:41:52.810 INFO:tasks.workunit.client.0.smithi137.stdout: "[6400000, 12799999]", 2024-03-04T06:41:52.810 INFO:tasks.workunit.client.0.smithi137.stdout: "[12800000, 25599999]", 2024-03-04T06:41:52.810 INFO:tasks.workunit.client.0.smithi137.stdout: "[25600000, 51199999]", 2024-03-04T06:41:52.810 INFO:tasks.workunit.client.0.smithi137.stdout: "[51200000, 102399999]", 2024-03-04T06:41:52.810 INFO:tasks.workunit.client.0.smithi137.stdout: "[102400000, 204799999]", 2024-03-04T06:41:52.810 INFO:tasks.workunit.client.0.smithi137.stdout: "[204800000, 409599999]", 2024-03-04T06:41:52.810 INFO:tasks.workunit.client.0.smithi137.stdout: "[409600000, 819199999]", 2024-03-04T06:41:52.811 INFO:tasks.workunit.client.0.smithi137.stdout: "[819200000, 1638399999]", 2024-03-04T06:41:52.811 INFO:tasks.workunit.client.0.smithi137.stdout: "[1638400000, 3276799999]", 2024-03-04T06:41:52.811 INFO:tasks.workunit.client.0.smithi137.stdout: "[3276800000, 6553599999]", 2024-03-04T06:41:52.811 INFO:tasks.workunit.client.0.smithi137.stdout: "[6553600000, 13107199999]", 2024-03-04T06:41:52.811 INFO:tasks.workunit.client.0.smithi137.stdout: "[13107200000, 26214399999]", 2024-03-04T06:41:52.811 INFO:tasks.workunit.client.0.smithi137.stdout: "[26214400000, 52428799999]", 2024-03-04T06:41:52.811 INFO:tasks.workunit.client.0.smithi137.stdout: "[52428800000, 104857599999]", 2024-03-04T06:41:52.811 INFO:tasks.workunit.client.0.smithi137.stdout: "[104857600000, 209715199999]", 2024-03-04T06:41:52.811 INFO:tasks.workunit.client.0.smithi137.stdout: "[209715200000, 419430399999]", 2024-03-04T06:41:52.811 INFO:tasks.workunit.client.0.smithi137.stdout: "[419430400000, 838860799999]", 2024-03-04T06:41:52.811 INFO:tasks.workunit.client.0.smithi137.stdout: "[838860800000, 1677721599999]", 2024-03-04T06:41:52.811 INFO:tasks.workunit.client.0.smithi137.stdout: "[1677721600000, 3355443199999]", 2024-03-04T06:41:52.811 INFO:tasks.workunit.client.0.smithi137.stdout: "[3355443200000, 6710886399999]", 2024-03-04T06:41:52.812 INFO:tasks.workunit.client.0.smithi137.stdout: "[6710886400000, 13421772799999]", 2024-03-04T06:41:52.812 INFO:tasks.workunit.client.0.smithi137.stdout: "[13421772800000, 26843545599999]", 2024-03-04T06:41:52.812 INFO:tasks.workunit.client.0.smithi137.stdout: "[26843545600000, 53687091199999]", 2024-03-04T06:41:52.812 INFO:tasks.workunit.client.0.smithi137.stdout: "[53687091200000, None]" 2024-03-04T06:41:52.812 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.812 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:52.812 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.812 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.812 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:52.812 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:52.812 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Request size (bytes)", 2024-03-04T06:41:52.812 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 512, 2024-03-04T06:41:52.812 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 511]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[512, 1023]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[1024, 2047]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[2048, 4095]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[4096, 8191]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[8192, 16383]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[16384, 32767]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[32768, 65535]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[65536, 131071]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[131072, 262143]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[262144, 524287]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[524288, 1048575]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[1048576, 2097151]", 2024-03-04T06:41:52.813 INFO:tasks.workunit.client.0.smithi137.stdout: "[2097152, 4194303]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[4194304, 8388607]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[8388608, 16777215]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[16777216, 33554431]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[33554432, 67108863]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[67108864, 134217727]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[134217728, 268435455]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[268435456, 536870911]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[536870912, 1073741823]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[1073741824, 2147483647]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[2147483648, 4294967295]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[4294967296, 8589934591]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[8589934592, 17179869183]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[17179869184, 34359738367]", 2024-03-04T06:41:52.814 INFO:tasks.workunit.client.0.smithi137.stdout: "[34359738368, 68719476735]", 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: "[68719476736, 137438953471]", 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: "[137438953472, 274877906943]", 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: "[274877906944, None]" 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: "osds": [ 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 0, 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.815 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.816 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.817 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 1, 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.818 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.819 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 2, 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.820 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.821 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.822 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.822 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.822 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.822 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.822 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.822 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.822 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.822 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.822 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.822 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.822 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.822 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.822 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.823 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.823 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.823 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.823 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.823 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 3, 2024-03-04T06:41:52.823 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.823 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.823 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.823 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.823 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.823 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.823 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.823 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.824 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.825 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.825 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.825 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.825 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.825 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.825 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.825 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.825 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.825 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.825 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.825 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.825 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.825 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 4, 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.826 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.827 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.828 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.828 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.828 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.828 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.828 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.828 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.828 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.828 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.828 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.828 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 5, 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.829 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.830 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.830 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.830 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.830 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.830 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.830 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.830 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.830 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.830 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.830 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.830 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 6, 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.831 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.832 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.832 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.832 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.832 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.832 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.832 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.832 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.832 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.832 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.832 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.832 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.832 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.832 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.833 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 7, 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 68, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.834 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.835 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.835 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.835 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.835 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.835 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.835 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.835 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.835 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.835 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.835 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.835 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.835 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.836 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "axes": [ 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Latency (usec)", 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 100000, 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 99999]", 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "[100000, 199999]", 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "[200000, 399999]", 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "[400000, 799999]", 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "[800000, 1599999]", 2024-03-04T06:41:52.837 INFO:tasks.workunit.client.0.smithi137.stdout: "[1600000, 3199999]", 2024-03-04T06:41:52.838 INFO:tasks.workunit.client.0.smithi137.stdout: "[3200000, 6399999]", 2024-03-04T06:41:52.838 INFO:tasks.workunit.client.0.smithi137.stdout: "[6400000, 12799999]", 2024-03-04T06:41:52.838 INFO:tasks.workunit.client.0.smithi137.stdout: "[12800000, 25599999]", 2024-03-04T06:41:52.838 INFO:tasks.workunit.client.0.smithi137.stdout: "[25600000, 51199999]", 2024-03-04T06:41:52.838 INFO:tasks.workunit.client.0.smithi137.stdout: "[51200000, 102399999]", 2024-03-04T06:41:52.838 INFO:tasks.workunit.client.0.smithi137.stdout: "[102400000, 204799999]", 2024-03-04T06:41:52.838 INFO:tasks.workunit.client.0.smithi137.stdout: "[204800000, 409599999]", 2024-03-04T06:41:52.838 INFO:tasks.workunit.client.0.smithi137.stdout: "[409600000, 819199999]", 2024-03-04T06:41:52.838 INFO:tasks.workunit.client.0.smithi137.stdout: "[819200000, 1638399999]", 2024-03-04T06:41:52.838 INFO:tasks.workunit.client.0.smithi137.stdout: "[1638400000, 3276799999]", 2024-03-04T06:41:52.838 INFO:tasks.workunit.client.0.smithi137.stdout: "[3276800000, 6553599999]", 2024-03-04T06:41:52.838 INFO:tasks.workunit.client.0.smithi137.stdout: "[6553600000, 13107199999]", 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: "[13107200000, 26214399999]", 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: "[26214400000, 52428799999]", 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: "[52428800000, 104857599999]", 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: "[104857600000, 209715199999]", 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: "[209715200000, 419430399999]", 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: "[419430400000, 838860799999]", 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: "[838860800000, 1677721599999]", 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: "[1677721600000, 3355443199999]", 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: "[3355443200000, 6710886399999]", 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: "[6710886400000, 13421772799999]", 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: "[13421772800000, 26843545599999]", 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: "[26843545600000, 53687091199999]", 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: "[53687091200000, None]" 2024-03-04T06:41:52.839 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Request size (bytes)", 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 512, 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 511]", 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: "[512, 1023]", 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: "[1024, 2047]", 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: "[2048, 4095]", 2024-03-04T06:41:52.840 INFO:tasks.workunit.client.0.smithi137.stdout: "[4096, 8191]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[8192, 16383]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[16384, 32767]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[32768, 65535]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[65536, 131071]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[131072, 262143]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[262144, 524287]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[524288, 1048575]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[1048576, 2097151]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[2097152, 4194303]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[4194304, 8388607]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[8388608, 16777215]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[16777216, 33554431]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[33554432, 67108863]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[67108864, 134217727]", 2024-03-04T06:41:52.841 INFO:tasks.workunit.client.0.smithi137.stdout: "[134217728, 268435455]", 2024-03-04T06:41:52.842 INFO:tasks.workunit.client.0.smithi137.stdout: "[268435456, 536870911]", 2024-03-04T06:41:52.842 INFO:tasks.workunit.client.0.smithi137.stdout: "[536870912, 1073741823]", 2024-03-04T06:41:52.842 INFO:tasks.workunit.client.0.smithi137.stdout: "[1073741824, 2147483647]", 2024-03-04T06:41:52.842 INFO:tasks.workunit.client.0.smithi137.stdout: "[2147483648, 4294967295]", 2024-03-04T06:41:52.842 INFO:tasks.workunit.client.0.smithi137.stdout: "[4294967296, 8589934591]", 2024-03-04T06:41:52.842 INFO:tasks.workunit.client.0.smithi137.stdout: "[8589934592, 17179869183]", 2024-03-04T06:41:52.842 INFO:tasks.workunit.client.0.smithi137.stdout: "[17179869184, 34359738367]", 2024-03-04T06:41:52.842 INFO:tasks.workunit.client.0.smithi137.stdout: "[34359738368, 68719476735]", 2024-03-04T06:41:52.842 INFO:tasks.workunit.client.0.smithi137.stdout: "[68719476736, 137438953471]", 2024-03-04T06:41:52.842 INFO:tasks.workunit.client.0.smithi137.stdout: "[137438953472, 274877906943]", 2024-03-04T06:41:52.842 INFO:tasks.workunit.client.0.smithi137.stdout: "[274877906944, None]" 2024-03-04T06:41:52.842 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.842 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: "osds": [ 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 0, 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.843 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.844 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.844 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.844 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.844 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.844 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.844 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.844 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.844 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.844 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.844 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.844 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.844 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.844 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 1, 2024-03-04T06:41:52.845 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.846 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.847 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 2, 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.848 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.849 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.850 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.850 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.850 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.850 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.850 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.850 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.850 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.850 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.850 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.850 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.850 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.850 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 3, 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.851 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.852 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.852 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.852 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.852 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.852 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.852 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.852 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.852 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.852 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.852 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.852 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.852 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.852 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 4, 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.853 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.854 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.854 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.854 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.854 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.854 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.854 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.854 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.854 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.854 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.854 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.854 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.854 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.855 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 5, 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.856 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.857 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.858 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 6, 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.859 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.860 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 7, 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.861 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.862 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.863 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: "axes": [ 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Latency (usec)", 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 100000, 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:52.864 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 99999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[100000, 199999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[200000, 399999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[400000, 799999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[800000, 1599999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[1600000, 3199999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[3200000, 6399999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[6400000, 12799999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[12800000, 25599999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[25600000, 51199999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[51200000, 102399999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[102400000, 204799999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[204800000, 409599999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[409600000, 819199999]", 2024-03-04T06:41:52.865 INFO:tasks.workunit.client.0.smithi137.stdout: "[819200000, 1638399999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[1638400000, 3276799999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[3276800000, 6553599999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[6553600000, 13107199999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[13107200000, 26214399999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[26214400000, 52428799999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[52428800000, 104857599999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[104857600000, 209715199999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[209715200000, 419430399999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[419430400000, 838860799999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[838860800000, 1677721599999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[1677721600000, 3355443199999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[3355443200000, 6710886399999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[6710886400000, 13421772799999]", 2024-03-04T06:41:52.866 INFO:tasks.workunit.client.0.smithi137.stdout: "[13421772800000, 26843545599999]", 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: "[26843545600000, 53687091199999]", 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: "[53687091200000, None]" 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Request size (bytes)", 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 512, 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 511]", 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: "[512, 1023]", 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: "[1024, 2047]", 2024-03-04T06:41:52.867 INFO:tasks.workunit.client.0.smithi137.stdout: "[2048, 4095]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[4096, 8191]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[8192, 16383]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[16384, 32767]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[32768, 65535]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[65536, 131071]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[131072, 262143]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[262144, 524287]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[524288, 1048575]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[1048576, 2097151]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[2097152, 4194303]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[4194304, 8388607]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[8388608, 16777215]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[16777216, 33554431]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[33554432, 67108863]", 2024-03-04T06:41:52.868 INFO:tasks.workunit.client.0.smithi137.stdout: "[67108864, 134217727]", 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: "[134217728, 268435455]", 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: "[268435456, 536870911]", 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: "[536870912, 1073741823]", 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: "[1073741824, 2147483647]", 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: "[2147483648, 4294967295]", 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: "[4294967296, 8589934591]", 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: "[8589934592, 17179869183]", 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: "[17179869184, 34359738367]", 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: "[34359738368, 68719476735]", 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: "[68719476736, 137438953471]", 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: "[137438953472, 274877906943]", 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: "[274877906944, None]" 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:52.869 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "osds": [ 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 0, 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.870 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.871 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.872 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.872 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.872 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.872 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.872 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.872 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.872 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.872 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.872 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 1, 2024-03-04T06:41:52.872 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.872 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.872 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.872 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.873 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.874 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.874 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.874 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.874 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.874 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.874 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.874 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.874 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.874 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.874 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.874 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.874 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.874 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 2, 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.875 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.876 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 3, 2024-03-04T06:41:52.877 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.878 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.879 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 4, 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.880 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.881 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.881 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.881 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.881 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.881 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.881 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.881 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.881 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.881 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.881 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.881 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.881 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.881 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.882 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 5, 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.883 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.884 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.884 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.884 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.884 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.884 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.884 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.884 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.884 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.884 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.884 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.884 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.884 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.884 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 6, 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.885 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.886 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.887 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 7, 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.888 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.889 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: "axes": [ 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Latency (usec)", 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 100000, 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:52.890 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 99999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[100000, 199999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[200000, 399999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[400000, 799999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[800000, 1599999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[1600000, 3199999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[3200000, 6399999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[6400000, 12799999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[12800000, 25599999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[25600000, 51199999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[51200000, 102399999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[102400000, 204799999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[204800000, 409599999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[409600000, 819199999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[819200000, 1638399999]", 2024-03-04T06:41:52.891 INFO:tasks.workunit.client.0.smithi137.stdout: "[1638400000, 3276799999]", 2024-03-04T06:41:52.892 INFO:tasks.workunit.client.0.smithi137.stdout: "[3276800000, 6553599999]", 2024-03-04T06:41:52.892 INFO:tasks.workunit.client.0.smithi137.stdout: "[6553600000, 13107199999]", 2024-03-04T06:41:52.892 INFO:tasks.workunit.client.0.smithi137.stdout: "[13107200000, 26214399999]", 2024-03-04T06:41:52.892 INFO:tasks.workunit.client.0.smithi137.stdout: "[26214400000, 52428799999]", 2024-03-04T06:41:52.892 INFO:tasks.workunit.client.0.smithi137.stdout: "[52428800000, 104857599999]", 2024-03-04T06:41:52.892 INFO:tasks.workunit.client.0.smithi137.stdout: "[104857600000, 209715199999]", 2024-03-04T06:41:52.892 INFO:tasks.workunit.client.0.smithi137.stdout: "[209715200000, 419430399999]", 2024-03-04T06:41:52.892 INFO:tasks.workunit.client.0.smithi137.stdout: "[419430400000, 838860799999]", 2024-03-04T06:41:52.892 INFO:tasks.workunit.client.0.smithi137.stdout: "[838860800000, 1677721599999]", 2024-03-04T06:41:52.892 INFO:tasks.workunit.client.0.smithi137.stdout: "[1677721600000, 3355443199999]", 2024-03-04T06:41:52.892 INFO:tasks.workunit.client.0.smithi137.stdout: "[3355443200000, 6710886399999]", 2024-03-04T06:41:52.892 INFO:tasks.workunit.client.0.smithi137.stdout: "[6710886400000, 13421772799999]", 2024-03-04T06:41:52.892 INFO:tasks.workunit.client.0.smithi137.stdout: "[13421772800000, 26843545599999]", 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: "[26843545600000, 53687091199999]", 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: "[53687091200000, None]" 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Request size (bytes)", 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 512, 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 511]", 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: "[512, 1023]", 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: "[1024, 2047]", 2024-03-04T06:41:52.893 INFO:tasks.workunit.client.0.smithi137.stdout: "[2048, 4095]", 2024-03-04T06:41:52.894 INFO:tasks.workunit.client.0.smithi137.stdout: "[4096, 8191]", 2024-03-04T06:41:52.894 INFO:tasks.workunit.client.0.smithi137.stdout: "[8192, 16383]", 2024-03-04T06:41:52.894 INFO:tasks.workunit.client.0.smithi137.stdout: "[16384, 32767]", 2024-03-04T06:41:52.894 INFO:tasks.workunit.client.0.smithi137.stdout: "[32768, 65535]", 2024-03-04T06:41:52.894 INFO:tasks.workunit.client.0.smithi137.stdout: "[65536, 131071]", 2024-03-04T06:41:52.894 INFO:tasks.workunit.client.0.smithi137.stdout: "[131072, 262143]", 2024-03-04T06:41:52.894 INFO:tasks.workunit.client.0.smithi137.stdout: "[262144, 524287]", 2024-03-04T06:41:52.894 INFO:tasks.workunit.client.0.smithi137.stdout: "[524288, 1048575]", 2024-03-04T06:41:52.894 INFO:tasks.workunit.client.0.smithi137.stdout: "[1048576, 2097151]", 2024-03-04T06:41:52.894 INFO:tasks.workunit.client.0.smithi137.stdout: "[2097152, 4194303]", 2024-03-04T06:41:52.894 INFO:tasks.workunit.client.0.smithi137.stdout: "[4194304, 8388607]", 2024-03-04T06:41:52.894 INFO:tasks.workunit.client.0.smithi137.stdout: "[8388608, 16777215]", 2024-03-04T06:41:52.894 INFO:tasks.workunit.client.0.smithi137.stdout: "[16777216, 33554431]", 2024-03-04T06:41:52.895 INFO:tasks.workunit.client.0.smithi137.stdout: "[33554432, 67108863]", 2024-03-04T06:41:52.895 INFO:tasks.workunit.client.0.smithi137.stdout: "[67108864, 134217727]", 2024-03-04T06:41:52.895 INFO:tasks.workunit.client.0.smithi137.stdout: "[134217728, 268435455]", 2024-03-04T06:41:52.895 INFO:tasks.workunit.client.0.smithi137.stdout: "[268435456, 536870911]", 2024-03-04T06:41:52.895 INFO:tasks.workunit.client.0.smithi137.stdout: "[536870912, 1073741823]", 2024-03-04T06:41:52.895 INFO:tasks.workunit.client.0.smithi137.stdout: "[1073741824, 2147483647]", 2024-03-04T06:41:52.895 INFO:tasks.workunit.client.0.smithi137.stdout: "[2147483648, 4294967295]", 2024-03-04T06:41:52.895 INFO:tasks.workunit.client.0.smithi137.stdout: "[4294967296, 8589934591]", 2024-03-04T06:41:52.895 INFO:tasks.workunit.client.0.smithi137.stdout: "[8589934592, 17179869183]", 2024-03-04T06:41:52.895 INFO:tasks.workunit.client.0.smithi137.stdout: "[17179869184, 34359738367]", 2024-03-04T06:41:52.895 INFO:tasks.workunit.client.0.smithi137.stdout: "[34359738368, 68719476735]", 2024-03-04T06:41:52.895 INFO:tasks.workunit.client.0.smithi137.stdout: "[68719476736, 137438953471]", 2024-03-04T06:41:52.895 INFO:tasks.workunit.client.0.smithi137.stdout: "[137438953472, 274877906943]", 2024-03-04T06:41:52.896 INFO:tasks.workunit.client.0.smithi137.stdout: "[274877906944, None]" 2024-03-04T06:41:52.896 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.896 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:52.896 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.896 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.896 INFO:tasks.workunit.client.0.smithi137.stdout: "osds": [ 2024-03-04T06:41:52.896 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.896 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 0, 2024-03-04T06:41:52.896 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.896 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.896 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.896 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.897 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.897 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.897 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.897 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.897 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.897 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.897 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.897 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.897 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.897 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.897 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.897 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.897 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.898 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.898 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.898 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.898 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.898 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.898 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.898 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.898 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.898 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.898 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.898 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.898 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.898 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 1, 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 8, 3, 0, 0, 0, 0, 0, 0, 11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.899 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 13, 5, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.900 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 15, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.900 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 13, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.900 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.900 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.900 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.900 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.900 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.900 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.900 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.900 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.900 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.900 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.900 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.901 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.902 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 2, 2024-03-04T06:41:52.902 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.902 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.902 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.902 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.902 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.902 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.902 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.902 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.902 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.902 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.902 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.902 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.903 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 3, 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.904 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.905 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.906 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 4, 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.907 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.908 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 5, 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.909 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.910 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 6, 2024-03-04T06:41:52.911 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 5, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.912 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.913 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 7, 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.914 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.915 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.916 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.916 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.916 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.916 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.916 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.916 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.916 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.916 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:52.916 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:52.916 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.916 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.916 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:52.916 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.917 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.917 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:52.917 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_counters": { 2024-03-04T06:41:52.917 INFO:tasks.workunit.client.0.smithi137.stdout: "mds.8ac76538560e2a49997c4cba61f942431c1ec214": { 2024-03-04T06:41:52.917 INFO:tasks.workunit.client.0.smithi137.stdout: "mds": { 2024-03-04T06:41:52.917 INFO:tasks.workunit.client.0.smithi137.stdout: "caps": { 2024-03-04T06:41:52.917 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.917 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.917 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_cap_op_flush_ack": { 2024-03-04T06:41:52.917 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.917 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.917 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_cap_op_flushsnap_ack": { 2024-03-04T06:41:52.917 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.918 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.918 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_cap_op_grant": { 2024-03-04T06:41:52.918 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.918 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.918 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_cap_op_revoke": { 2024-03-04T06:41:52.918 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.918 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.918 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_cap_op_trunc": { 2024-03-04T06:41:52.918 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.918 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.918 INFO:tasks.workunit.client.0.smithi137.stdout: "dir_commit": { 2024-03-04T06:41:52.918 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: "dir_fetch_complete": { 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: "dir_fetch_keys": { 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: "dir_merge": { 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: "dir_split": { 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: "exported_inodes": { 2024-03-04T06:41:52.919 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: "forward": { 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_client_cap_release": { 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_client_caps": { 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_client_caps_dirty": { 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_inode_file_caps": { 2024-03-04T06:41:52.920 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: "imported_inodes": { 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: "inodes": { 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: "inodes_expired": { 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: "inodes_pinned": { 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: "inodes_with_caps": { 2024-03-04T06:41:52.921 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: "load_cent": { 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: "openino_dir_fetch": { 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: "process_request_cap_release": { 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: "reply_latency": { 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 78814 2024-03-04T06:41:52.922 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: "request": { 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: "root_rbytes": { 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: "root_rfiles": { 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: "root_rsnaps": { 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_reply": { 2024-03-04T06:41:52.923 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: "subtrees": { 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_cache": { 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: "ireq_enqueue_scrub": { 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: "ireq_exportdir": { 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: "ireq_flush": { 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.924 INFO:tasks.workunit.client.0.smithi137.stdout: "ireq_fragmentdir": { 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: "ireq_fragstats": { 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: "ireq_inodestats": { 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: "num_recovering_enqueued": { 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: "num_recovering_prioritized": { 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.925 INFO:tasks.workunit.client.0.smithi137.stdout: "num_recovering_processing": { 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: "num_strays": { 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: "num_strays_delayed": { 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: "num_strays_enqueuing": { 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_completed": { 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_started": { 2024-03-04T06:41:52.926 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: "strays_created": { 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: "strays_enqueued": { 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: "strays_migrated": { 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: "strays_reintegrated": { 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_log": { 2024-03-04T06:41:52.927 INFO:tasks.workunit.client.0.smithi137.stdout: "ev": { 2024-03-04T06:41:52.928 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5 2024-03-04T06:41:52.928 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.928 INFO:tasks.workunit.client.0.smithi137.stdout: "evadd": { 2024-03-04T06:41:52.928 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5 2024-03-04T06:41:52.928 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.928 INFO:tasks.workunit.client.0.smithi137.stdout: "evex": { 2024-03-04T06:41:52.928 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.928 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.928 INFO:tasks.workunit.client.0.smithi137.stdout: "evexd": { 2024-03-04T06:41:52.928 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.928 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.928 INFO:tasks.workunit.client.0.smithi137.stdout: "evexg": { 2024-03-04T06:41:52.928 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: "evtrm": { 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: "jlat": { 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 17108867 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: "replayed": { 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: "seg": { 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.929 INFO:tasks.workunit.client.0.smithi137.stdout: "segadd": { 2024-03-04T06:41:52.930 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:52.930 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.930 INFO:tasks.workunit.client.0.smithi137.stdout: "segex": { 2024-03-04T06:41:52.930 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.930 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.930 INFO:tasks.workunit.client.0.smithi137.stdout: "segexd": { 2024-03-04T06:41:52.930 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.930 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.930 INFO:tasks.workunit.client.0.smithi137.stdout: "segexg": { 2024-03-04T06:41:52.930 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.930 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: "segtrm": { 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_mem": { 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: "cap": { 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: "cap+": { 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: "cap-": { 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.931 INFO:tasks.workunit.client.0.smithi137.stdout: "dir": { 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: "dir+": { 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: "dir-": { 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: "dn": { 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: "dn+": { 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:52.932 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: "dn-": { 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: "heap": { 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 207156 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: "ino": { 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: "ino+": { 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: "ino-": { 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.933 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: "rss": { 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40964 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_server": { 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: "cap_acquisition_throttle": { 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: "cap_revoke_eviction": { 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_client_request": { 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.934 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_client_session": { 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 16 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_peer_request": { 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: "req_create_latency": { 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: "req_getattr_latency": { 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 78814 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.935 INFO:tasks.workunit.client.0.smithi137.stdout: "req_getfilelock_latency": { 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: "req_getvxattr_latency": { 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: "req_link_latency": { 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lookup_latency": { 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.936 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lookuphash_latency": { 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lookupino_latency": { 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lookupname_latency": { 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lookupparent_latency": { 2024-03-04T06:41:52.937 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.938 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.938 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.938 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lookupsnap_latency": { 2024-03-04T06:41:52.938 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.938 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.938 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.938 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lssnap_latency": { 2024-03-04T06:41:52.938 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.938 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.938 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.938 INFO:tasks.workunit.client.0.smithi137.stdout: "req_mkdir_latency": { 2024-03-04T06:41:52.938 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.938 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.939 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.939 INFO:tasks.workunit.client.0.smithi137.stdout: "req_mknod_latency": { 2024-03-04T06:41:52.939 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.939 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.939 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.939 INFO:tasks.workunit.client.0.smithi137.stdout: "req_mksnap_latency": { 2024-03-04T06:41:52.939 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.939 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.939 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.939 INFO:tasks.workunit.client.0.smithi137.stdout: "req_open_latency": { 2024-03-04T06:41:52.939 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.939 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.939 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: "req_readdir_latency": { 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: "req_rename_latency": { 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: "req_renamesnap_latency": { 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: "req_rmdir_latency": { 2024-03-04T06:41:52.940 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: "req_rmsnap_latency": { 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: "req_rmxattr_latency": { 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: "req_setattr_latency": { 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.941 INFO:tasks.workunit.client.0.smithi137.stdout: "req_setdirlayout_latency": { 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: "req_setfilelock_latency": { 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: "req_setlayout_latency": { 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: "req_setxattr_latency": { 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.942 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: "req_snapdiff_latency": { 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: "req_symlink_latency": { 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: "req_unlink_latency": { 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_sessions": { 2024-03-04T06:41:52.943 INFO:tasks.workunit.client.0.smithi137.stdout: "average_load": { 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: "avg_session_uptime": { 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 88 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: "mdthresh_evicted": { 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: "session_add": { 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: "session_count": { 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.944 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: "session_remove": { 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: "sessions_open": { 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: "sessions_stale": { 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: "total_load": { 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:52.945 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 45 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: "purge_queue": { 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: "pq_executed": { 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.946 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: "pq_executing": { 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: "pq_executing_high_water": { 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: "pq_executing_ops": { 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: "pq_executing_ops_high_water": { 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: "pq_item_in_journal": { 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.947 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.948 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.948 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.367540c6d8636e8ade040b6791ecc93ab23e3392": { 2024-03-04T06:41:52.948 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:52.948 INFO:tasks.workunit.client.0.smithi137.stdout: "election_call": { 2024-03-04T06:41:52.948 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:52.948 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.948 INFO:tasks.workunit.client.0.smithi137.stdout: "election_lose": { 2024-03-04T06:41:52.948 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:52.948 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.948 INFO:tasks.workunit.client.0.smithi137.stdout: "election_win": { 2024-03-04T06:41:52.948 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.948 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.948 INFO:tasks.workunit.client.0.smithi137.stdout: "num_elections": { 2024-03-04T06:41:52.949 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3 2024-03-04T06:41:52.949 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.949 INFO:tasks.workunit.client.0.smithi137.stdout: "num_sessions": { 2024-03-04T06:41:52.949 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8 2024-03-04T06:41:52.949 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.949 INFO:tasks.workunit.client.0.smithi137.stdout: "session_add": { 2024-03-04T06:41:52.949 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5 2024-03-04T06:41:52.949 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.949 INFO:tasks.workunit.client.0.smithi137.stdout: "session_rm": { 2024-03-04T06:41:52.949 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 103 2024-03-04T06:41:52.949 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.950 INFO:tasks.workunit.client.0.smithi137.stdout: "session_trim": { 2024-03-04T06:41:52.950 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.950 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.950 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.950 INFO:tasks.workunit.client.0.smithi137.stdout: "paxos": { 2024-03-04T06:41:52.950 INFO:tasks.workunit.client.0.smithi137.stdout: "accept_timeout": { 2024-03-04T06:41:52.950 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.950 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.950 INFO:tasks.workunit.client.0.smithi137.stdout: "begin": { 2024-03-04T06:41:52.950 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 914 2024-03-04T06:41:52.950 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.951 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_bytes": { 2024-03-04T06:41:52.951 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 914, 2024-03-04T06:41:52.951 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4062914 2024-03-04T06:41:52.951 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.951 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_keys": { 2024-03-04T06:41:52.951 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.951 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.951 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.951 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_latency": { 2024-03-04T06:41:52.951 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 914, 2024-03-04T06:41:52.951 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 249995699 2024-03-04T06:41:52.951 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.951 INFO:tasks.workunit.client.0.smithi137.stdout: "collect": { 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_bytes": { 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_keys": { 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_latency": { 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.952 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_timeout": { 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_uncommitted": { 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: "commit": { 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 915 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_bytes": { 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_keys": { 2024-03-04T06:41:52.953 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_latency": { 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: "lease_ack_timeout": { 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: "lease_timeout": { 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: "new_pn": { 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.954 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: "new_pn_latency": { 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: "refresh": { 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 915 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: "refresh_latency": { 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 915, 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2186962317 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: "restart": { 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8 2024-03-04T06:41:52.955 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state": { 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state_bytes": { 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state_keys": { 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: "start_leader": { 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.956 INFO:tasks.workunit.client.0.smithi137.stdout: "start_peon": { 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state": { 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 915 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_bytes": { 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 915, 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 7954169 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_keys": { 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 915, 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6452 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_latency": { 2024-03-04T06:41:52.957 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 915, 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 510991201 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache": { 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1020054731 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 39649280 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 29310976 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:52.958 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2147483648 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10338304 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:full": { 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 348127232 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.959 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 277021476 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 271033 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.960 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.961 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 70834723 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:inc": { 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 348127232 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:52.962 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 277021476 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41393 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:52.963 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:52.964 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71064363 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:kv": { 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 322961408 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 184680984 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.965 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.966 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71171560 2024-03-04T06:41:52.967 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.968 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.968 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb": { 2024-03-04T06:41:52.968 INFO:tasks.workunit.client.0.smithi137.stdout: "compact": { 2024-03-04T06:41:52.968 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.968 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.968 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_queue_len": { 2024-03-04T06:41:52.968 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.968 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.968 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_queue_merge": { 2024-03-04T06:41:52.968 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.968 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.968 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_range": { 2024-03-04T06:41:52.968 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: "get_latency": { 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 38827, 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 101566145 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_delay_time": { 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_memtable_time": { 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.969 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_pre_and_post_time": { 2024-03-04T06:41:52.970 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.970 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.970 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.970 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_wal_time": { 2024-03-04T06:41:52.970 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.970 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.970 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.970 INFO:tasks.workunit.client.0.smithi137.stdout: "submit_latency": { 2024-03-04T06:41:52.970 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.970 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.970 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.970 INFO:tasks.workunit.client.0.smithi137.stdout: "submit_sync_latency": { 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1951, 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 819878703 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.8ac76538560e2a49997c4cba61f942431c1ec214": { 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: "election_call": { 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: "election_lose": { 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: "election_win": { 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.971 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_elections": { 2024-03-04T06:41:52.972 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 7 2024-03-04T06:41:52.972 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_sessions": { 2024-03-04T06:41:52.972 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 11 2024-03-04T06:41:52.972 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.972 INFO:tasks.workunit.client.0.smithi137.stdout: "session_add": { 2024-03-04T06:41:52.972 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:52.972 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.972 INFO:tasks.workunit.client.0.smithi137.stdout: "session_rm": { 2024-03-04T06:41:52.972 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 54 2024-03-04T06:41:52.973 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.973 INFO:tasks.workunit.client.0.smithi137.stdout: "session_trim": { 2024-03-04T06:41:52.973 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.973 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.973 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.973 INFO:tasks.workunit.client.0.smithi137.stdout: "paxos": { 2024-03-04T06:41:52.973 INFO:tasks.workunit.client.0.smithi137.stdout: "accept_timeout": { 2024-03-04T06:41:52.973 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.973 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.973 INFO:tasks.workunit.client.0.smithi137.stdout: "begin": { 2024-03-04T06:41:52.973 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 924 2024-03-04T06:41:52.974 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.974 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_bytes": { 2024-03-04T06:41:52.974 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 924, 2024-03-04T06:41:52.974 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4088527 2024-03-04T06:41:52.974 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.974 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_keys": { 2024-03-04T06:41:52.974 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.974 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.974 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.974 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_latency": { 2024-03-04T06:41:52.974 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 924, 2024-03-04T06:41:52.975 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 142996603 2024-03-04T06:41:52.975 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.975 INFO:tasks.workunit.client.0.smithi137.stdout: "collect": { 2024-03-04T06:41:52.975 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.975 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.975 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_bytes": { 2024-03-04T06:41:52.975 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:52.975 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 146 2024-03-04T06:41:52.975 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.975 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_keys": { 2024-03-04T06:41:52.975 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:52.975 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.975 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.976 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_latency": { 2024-03-04T06:41:52.976 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:52.976 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.976 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.976 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_timeout": { 2024-03-04T06:41:52.976 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.976 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.976 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_uncommitted": { 2024-03-04T06:41:52.976 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.976 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.976 INFO:tasks.workunit.client.0.smithi137.stdout: "commit": { 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 925 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_bytes": { 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_keys": { 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_latency": { 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.977 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.978 INFO:tasks.workunit.client.0.smithi137.stdout: "lease_ack_timeout": { 2024-03-04T06:41:52.978 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.978 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.978 INFO:tasks.workunit.client.0.smithi137.stdout: "lease_timeout": { 2024-03-04T06:41:52.978 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.978 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.978 INFO:tasks.workunit.client.0.smithi137.stdout: "new_pn": { 2024-03-04T06:41:52.978 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.978 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.978 INFO:tasks.workunit.client.0.smithi137.stdout: "new_pn_latency": { 2024-03-04T06:41:52.978 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.978 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: "refresh": { 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 925 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: "refresh_latency": { 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 925, 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2143948928 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: "restart": { 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state": { 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.979 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.980 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state_bytes": { 2024-03-04T06:41:52.980 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.980 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.980 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.980 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state_keys": { 2024-03-04T06:41:52.980 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.980 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.980 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.980 INFO:tasks.workunit.client.0.smithi137.stdout: "start_leader": { 2024-03-04T06:41:52.980 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.980 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.980 INFO:tasks.workunit.client.0.smithi137.stdout: "start_peon": { 2024-03-04T06:41:52.980 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state": { 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 925 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_bytes": { 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 925, 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8003297 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_keys": { 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 925, 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6529 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_latency": { 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 925, 2024-03-04T06:41:52.981 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 326992223 2024-03-04T06:41:52.982 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.982 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.982 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache": { 2024-03-04T06:41:52.982 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:52.982 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1020054731 2024-03-04T06:41:52.982 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.982 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:52.982 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41746432 2024-03-04T06:41:52.982 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.982 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:52.982 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31662080 2024-03-04T06:41:52.982 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2147483648 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10084352 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:full": { 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 348127232 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:52.983 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 277021476 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 271033 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:52.984 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:52.985 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 70834723 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:inc": { 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 348127232 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.986 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 277021476 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41393 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:52.987 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.988 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71064363 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:kv": { 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 322961408 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:52.989 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 184680984 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.990 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71171560 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.991 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb": { 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: "compact": { 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_queue_len": { 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_queue_merge": { 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_range": { 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: "get_latency": { 2024-03-04T06:41:52.992 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 39617, 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 103740933 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_delay_time": { 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_memtable_time": { 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_pre_and_post_time": { 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.993 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_wal_time": { 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: "submit_latency": { 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: "submit_sync_latency": { 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1998, 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 588717517 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.994 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.e1b16a9a7a0ba72344e1af0e17524b2e886c9ba9": { 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: "election_call": { 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: "election_lose": { 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: "election_win": { 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: "num_elections": { 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 9 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: "num_sessions": { 2024-03-04T06:41:52.995 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: "session_add": { 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: "session_rm": { 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 204 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: "session_trim": { 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: "paxos": { 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: "accept_timeout": { 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.996 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: "begin": { 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1066 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_bytes": { 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1066, 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5140230 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_keys": { 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1066, 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3198 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_latency": { 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1066, 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 201996520 2024-03-04T06:41:52.997 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: "collect": { 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_bytes": { 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_keys": { 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_latency": { 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.998 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_timeout": { 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_uncommitted": { 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: "commit": { 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1066 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_bytes": { 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1066, 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5063426 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_keys": { 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1066, 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6388 2024-03-04T06:41:52.999 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_latency": { 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1066, 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 456075775 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: "lease_ack_timeout": { 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: "lease_timeout": { 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: "new_pn": { 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.000 INFO:tasks.workunit.client.0.smithi137.stdout: "new_pn_latency": { 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: "refresh": { 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1068 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: "refresh_latency": { 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1068, 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2847950964 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: "restart": { 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state": { 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:53.001 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state_bytes": { 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1050 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state_keys": { 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: "start_leader": { 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: "start_peon": { 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.002 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state": { 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_bytes": { 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_keys": { 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_latency": { 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.003 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.004 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.004 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache": { 2024-03-04T06:41:53.004 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:53.004 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1020054731 2024-03-04T06:41:53.004 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.004 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:53.004 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 45842432 2024-03-04T06:41:53.004 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.004 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:53.004 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40501248 2024-03-04T06:41:53.004 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.004 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:53.004 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2147483648 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5341184 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:full": { 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 348127232 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.005 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 277022552 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 270603 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.006 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.007 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 70834077 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:inc": { 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 348127232 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.008 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 277022552 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 38954 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.009 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.010 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71065726 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:kv": { 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 322961408 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 184681701 2024-03-04T06:41:53.011 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.012 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.013 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.013 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.013 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.013 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.013 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.013 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.013 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.013 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.013 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.013 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.013 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.013 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71170843 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb": { 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: "compact": { 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_queue_len": { 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_queue_merge": { 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.014 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_range": { 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: "get_latency": { 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 47322, 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 188534781 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_delay_time": { 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_memtable_time": { 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.015 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_pre_and_post_time": { 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_wal_time": { 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: "submit_latency": { 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: "submit_sync_latency": { 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2301, 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 710884669 2024-03-04T06:41:53.016 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.0": { 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.017 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2670592 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.018 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1667072 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:53.019 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1527808 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.020 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:53.021 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.022 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.023 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:53.024 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.025 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.025 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:53.025 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.025 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.025 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:53.025 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4276224 2024-03-04T06:41:53.025 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.025 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.025 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:53.025 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:53.025 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:53.025 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1318912 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 4, 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 167504 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.026 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.027 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:53.027 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.027 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.027 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:53.027 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.027 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.027 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:53.027 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 22, 2024-03-04T06:41:53.027 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 56539 2024-03-04T06:41:53.027 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.027 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:53.027 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.027 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 360, 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 102497606 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 358, 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6054518 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 360, 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 336558 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.028 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 360, 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 102834164 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 34199 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 6, 2024-03-04T06:41:53.029 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 16603 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5538 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 828 2024-03-04T06:41:53.030 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 228 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 120, 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2682202 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 324, 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 332042 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 204, 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4998443 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.031 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 45730 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10357469 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 124, 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 7651111 2024-03-04T06:41:53.032 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 124, 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 483960736868 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 124, 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 131635758496 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 33531358631 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 43141 2024-03-04T06:41:53.033 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 482007 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 182166106 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 162121 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 154424421 2024-03-04T06:41:53.034 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 26306992 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 900664 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 58, 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 260018 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 373804965 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.035 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 30086173 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2970864 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861619251 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 44482560 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.036 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 44064768 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137559552 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 417792 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.037 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85471362 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.038 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 602112 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.039 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73310078 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.040 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641035221 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.041 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.042 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71994331 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.043 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 56980908 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.044 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.045 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68847748 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641035221 2024-03-04T06:41:53.046 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.047 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 242742 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.048 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71753717 2024-03-04T06:41:53.049 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.049 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.049 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:53.049 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:53.049 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.049 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.049 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.049 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.049 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.049 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:53.049 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.049 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.049 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 47 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:53.050 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.051 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.051 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:53.051 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.051 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.051 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:53.051 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 616 2024-03-04T06:41:53.051 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.051 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:53.051 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:53.051 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40151922 2024-03-04T06:41:53.051 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.051 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:53.051 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.052 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.052 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:53.052 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 6, 2024-03-04T06:41:53.052 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2293349 2024-03-04T06:41:53.052 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.052 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:53.052 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:53.052 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 39701634 2024-03-04T06:41:53.052 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.052 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.052 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.052 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.052 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.053 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:53.054 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.055 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 616 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40151922 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:53.056 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 6, 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2293349 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 39701634 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1771104 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.057 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28983296 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.1": { 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.058 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.059 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2433024 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:53.060 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1548288 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1409024 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.061 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.062 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:53.063 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.064 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.065 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3919872 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:53.066 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 716800 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 217957 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.067 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.068 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:53.068 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.068 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.068 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:53.068 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.068 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.068 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:53.068 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 31, 2024-03-04T06:41:53.068 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 82783 2024-03-04T06:41:53.068 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.068 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 331, 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 82352080 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 326, 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8531559 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 331, 2024-03-04T06:41:53.069 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 353365 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 331, 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 82705445 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 38549 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:53.070 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6728 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 9479 2024-03-04T06:41:53.071 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.072 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:53.072 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 815 2024-03-04T06:41:53.072 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.072 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:53.072 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 233 2024-03-04T06:41:53.072 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.072 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:53.072 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 133, 2024-03-04T06:41:53.072 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5297884 2024-03-04T06:41:53.072 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.072 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:53.072 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 349, 2024-03-04T06:41:53.072 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 259616 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 216, 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6537921 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 122884 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:53.073 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:53.074 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 9871763 2024-03-04T06:41:53.074 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.074 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:53.074 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 123, 2024-03-04T06:41:53.074 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 7175414 2024-03-04T06:41:53.074 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.074 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:53.074 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 122, 2024-03-04T06:41:53.074 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 315131137550 2024-03-04T06:41:53.074 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.074 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:53.074 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 123, 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 130694996745 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 403, 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 76334327528 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 403, 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 36575 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 441769 2024-03-04T06:41:53.075 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.076 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:53.076 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:53.076 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 135711644 2024-03-04T06:41:53.076 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.076 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:53.076 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:53.076 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 132098 2024-03-04T06:41:53.076 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.076 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:53.076 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:53.076 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 69174999 2024-03-04T06:41:53.076 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.076 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 21208876 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 309728 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 57, 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 291252 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 236464339 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.077 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 25006769 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2411496 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861619251 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:53.078 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 43302912 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42549248 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137559552 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 753664 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.079 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:53.080 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.080 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.080 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.080 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.080 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.080 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.080 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.080 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.080 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85508326 2024-03-04T06:41:53.080 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.080 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.080 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.081 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73862938 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.082 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641312445 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.083 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.084 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.084 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.084 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.084 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.084 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.084 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.084 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.084 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.084 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.084 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.084 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.084 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.084 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.085 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71717107 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.086 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 57005550 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.087 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.088 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.088 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.088 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.088 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.088 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.088 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.088 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.088 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.088 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.088 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.088 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.088 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.089 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.089 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.089 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68823106 2024-03-04T06:41:53.089 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.089 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.089 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:53.089 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.089 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:53.089 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.089 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.089 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.089 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.089 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641312445 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.090 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 217935 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.091 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71501300 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.092 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 36 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.093 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 155 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2429440 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 155, 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 356612381 2024-03-04T06:41:53.094 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.095 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:53.095 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1063 2024-03-04T06:41:53.095 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.095 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:53.095 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 155, 2024-03-04T06:41:53.095 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 55889113 2024-03-04T06:41:53.095 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.095 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:53.095 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 155, 2024-03-04T06:41:53.095 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 212135495 2024-03-04T06:41:53.095 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.095 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.095 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 33 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 33, 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5880899 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1063 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 33, 2024-03-04T06:41:53.096 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5353383 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 33, 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4614796 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 22 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 22, 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 18806609 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.097 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 22, 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8803586 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:53.098 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 22, 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 17777358 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 100 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2429440 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 100, 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 331924873 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.099 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 100, 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41732144 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 100, 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 189743341 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 590368 2024-03-04T06:41:53.100 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28385280 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.2": { 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:53.101 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:53.102 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2215936 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.103 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1413120 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1273856 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:53.104 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:53.105 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.105 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:53.105 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.105 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.105 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:53.105 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.105 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:53.105 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:53.105 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.105 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:53.105 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:53.105 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.106 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.107 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:53.107 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:53.107 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.107 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:53.107 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:53.107 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.107 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:53.107 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:53.107 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.107 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:53.107 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.107 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.107 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:53.108 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.108 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.108 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:53.108 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.108 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.108 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:53.108 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.108 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.108 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:53.108 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.108 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.108 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:53.108 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.109 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.109 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:53.109 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.109 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.109 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:53.109 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.109 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.109 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:53.109 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.109 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3567616 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.110 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 708608 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 4, 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 225538 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.111 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 13, 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14009 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.112 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:53.113 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.113 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.113 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.113 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:53.113 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.113 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 72289506 2024-03-04T06:41:53.113 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.113 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:53.113 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 294, 2024-03-04T06:41:53.113 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5658121 2024-03-04T06:41:53.113 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.113 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:53.113 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 301885 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 72591391 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 59969 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:53.114 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4227 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.115 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 615 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 212 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 99, 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1266297 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 276, 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 253284 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:53.116 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 177, 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5719472 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 103044 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4963516 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 118, 2024-03-04T06:41:53.117 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6873751 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 117, 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 294314134524 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 118, 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 126756671464 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 340, 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 76333232154 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.118 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 340, 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 34247 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 438472 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 112369182 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 123964 2024-03-04T06:41:53.119 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 78676480 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23724167 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 309568 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 53, 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 248599 2024-03-04T06:41:53.120 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 220226947 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27270322 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2240858 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:53.121 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861619251 2024-03-04T06:41:53.122 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.122 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:53.122 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41205760 2024-03-04T06:41:53.122 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.122 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:53.122 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40771584 2024-03-04T06:41:53.122 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.122 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:53.122 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137559552 2024-03-04T06:41:53.122 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.122 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:53.122 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 434176 2024-03-04T06:41:53.122 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85509061 2024-03-04T06:41:53.123 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.124 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.124 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.124 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.124 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.124 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.124 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.124 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.124 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.124 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.124 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.124 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.124 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8192 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.125 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73866299 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.126 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641317957 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.127 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.128 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.128 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.128 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.128 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.128 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.128 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.128 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:53.128 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.128 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.128 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.128 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.129 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.129 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.129 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.129 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.129 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.129 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.129 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.129 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71711595 2024-03-04T06:41:53.129 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.129 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.129 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:53.129 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.129 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:53.130 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.130 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.130 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.130 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.130 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.130 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:53.130 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.130 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.130 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 57006040 2024-03-04T06:41:53.130 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.130 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.130 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.131 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.132 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.132 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.132 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.132 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.132 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.132 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.132 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.132 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.132 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.132 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68822616 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.133 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641317957 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.134 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 209954 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.135 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71503769 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.136 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:53.137 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:53.138 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.138 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:53.138 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.138 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.138 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:53.138 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.138 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.138 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:53.138 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.138 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.138 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:53.138 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 10, 2024-03-04T06:41:53.138 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 121885274 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 10, 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6200457 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 10, 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 99420985 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.139 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.140 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.141 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.142 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:53.142 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.142 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.142 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:53.142 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.142 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.142 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:53.142 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.142 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.142 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:53.142 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.142 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.142 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 10, 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 121885274 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.143 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 10, 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6200457 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 10, 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 99420985 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.144 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28377088 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.3": { 2024-03-04T06:41:53.145 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.146 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1085440 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.147 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.148 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.148 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:53.148 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.148 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.148 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:53.148 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:53.148 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.148 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:53.148 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 798720 2024-03-04T06:41:53.148 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.148 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:53.148 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 659456 2024-03-04T06:41:53.148 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:53.149 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.150 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:53.151 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.152 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:53.153 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.153 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.153 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:53.153 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.153 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.153 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:53.153 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.153 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.153 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:53.153 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.153 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.153 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:53.153 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1822720 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 729088 2024-03-04T06:41:53.154 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.155 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:53.155 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.155 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.155 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.155 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:53.155 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.155 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.155 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.155 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:53.155 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.155 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.155 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:53.155 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5477 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:53.156 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 148, 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 48104299 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 133, 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8410869 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 148, 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 430890 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 148, 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 48535189 2024-03-04T06:41:53.157 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 35651 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:53.158 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3761 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 323 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:53.159 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 223 2024-03-04T06:41:53.160 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.160 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:53.160 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 80, 2024-03-04T06:41:53.160 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 888400 2024-03-04T06:41:53.160 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.160 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:53.160 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 134, 2024-03-04T06:41:53.160 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 340194 2024-03-04T06:41:53.160 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.160 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:53.160 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 54, 2024-03-04T06:41:53.160 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 382996 2024-03-04T06:41:53.160 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 11835610 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 48, 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10416859 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.161 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:53.162 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 45, 2024-03-04T06:41:53.162 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 276077873952 2024-03-04T06:41:53.162 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.162 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:53.162 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 48, 2024-03-04T06:41:53.162 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 76817310148 2024-03-04T06:41:53.162 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.162 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:53.162 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 236, 2024-03-04T06:41:53.162 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 573725 2024-03-04T06:41:53.162 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.162 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 236, 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 21562 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 252367 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 195639058 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73143 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.163 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 89424147 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14723078 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 312302 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 39, 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 185827 2024-03-04T06:41:53.164 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 311901261 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 17633688 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2189412 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:53.165 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861619251 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41336832 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41099264 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137559552 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 237568 2024-03-04T06:41:53.166 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85509113 2024-03-04T06:41:53.167 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.168 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.169 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.169 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.169 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.169 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.169 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.169 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.169 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.169 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.169 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.169 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.169 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.169 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.169 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73874439 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.170 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.171 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.171 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641318348 2024-03-04T06:41:53.171 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.171 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.171 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.171 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.171 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.171 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.171 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.171 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.171 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.171 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.171 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.172 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.172 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.172 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.172 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.172 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.172 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.172 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:53.172 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.172 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.172 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.172 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.172 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.172 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71711204 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.173 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.174 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.174 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:53.174 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.174 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.174 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 57006075 2024-03-04T06:41:53.174 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.174 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.174 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.174 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.174 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.174 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.174 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.175 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68822581 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.176 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641318348 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.177 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8219 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 211362 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.178 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71493751 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.179 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 36 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.180 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.181 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 673949 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.182 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:53.183 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.184 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.185 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 673949 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.186 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.187 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28393472 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.4": { 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:53.188 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1196032 2024-03-04T06:41:53.189 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:53.190 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 868352 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 729088 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:53.191 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.192 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:53.193 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.194 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.195 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2002944 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 724992 2024-03-04T06:41:53.196 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 8, 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 300400 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:53.197 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2135 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 165, 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 47361194 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:53.198 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 158, 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12256867 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 165, 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 163331 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 165, 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 47524525 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:53.199 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 51099 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:53.200 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5621 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 363 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 236 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 97, 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 930794 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 164, 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 262331 2024-03-04T06:41:53.201 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 67, 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 146875 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 201752 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2846838 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.202 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 42, 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2960769 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 41, 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 195612395968 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 42, 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 66087057804 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 259, 2024-03-04T06:41:53.203 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 552746 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 259, 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24097 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 261094 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 208622769 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:53.204 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73441 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 133748299 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13451452 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 310276 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 41, 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 196412 2024-03-04T06:41:53.205 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.206 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:53.206 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:53.206 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 358960625 2024-03-04T06:41:53.206 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.206 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:53.206 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:53.206 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15593256 2024-03-04T06:41:53.206 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.206 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:53.206 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:53.206 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1787288 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861610720 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41205760 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40894464 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:53.207 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137549516 2024-03-04T06:41:53.208 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.208 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:53.208 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 311296 2024-03-04T06:41:53.208 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.208 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.208 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:53.208 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.208 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:53.208 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.208 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85508435 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.209 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.210 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73875117 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:53.211 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641313266 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.212 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.213 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71716286 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.214 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 57005623 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.215 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.216 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68823033 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.217 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641313266 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.218 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 217580 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.219 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71500834 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.220 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.221 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 22 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 22747453 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:53.222 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 729042 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 18384543 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:53.223 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.224 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.225 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.226 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 22 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 22747453 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 729042 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.227 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 18384543 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:53.228 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28393472 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.5": { 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.229 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:53.230 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1155072 2024-03-04T06:41:53.231 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.231 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:53.231 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.231 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.231 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.231 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:53.231 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.231 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.231 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.231 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:53.231 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.231 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.231 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 847872 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 708608 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.232 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.233 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:53.233 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.233 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.233 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:53.233 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:53.233 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.233 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:53.233 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:53.233 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.233 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:53.233 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:53.234 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:53.235 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.236 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.237 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1941504 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 720896 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 6, 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 178553 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.238 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:53.239 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3485 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 160, 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40519017 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 143, 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6721358 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 160, 2024-03-04T06:41:53.240 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 137566 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 160, 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40656583 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 43548 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.241 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.242 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 9120 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 328 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 242 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 90, 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 724936 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 144, 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 244691 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.243 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:53.244 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 54, 2024-03-04T06:41:53.244 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 359558 2024-03-04T06:41:53.244 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.244 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:53.244 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.244 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.244 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:53.244 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 4, 2024-03-04T06:41:53.244 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 97059 2024-03-04T06:41:53.244 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.244 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:53.244 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.244 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3623433 2024-03-04T06:41:53.245 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.245 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:53.245 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 39, 2024-03-04T06:41:53.245 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2973345 2024-03-04T06:41:53.245 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.245 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:53.245 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 36, 2024-03-04T06:41:53.245 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 184410114358 2024-03-04T06:41:53.245 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.245 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:53.245 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 39, 2024-03-04T06:41:53.245 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 50206698024 2024-03-04T06:41:53.245 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.246 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:53.246 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 261, 2024-03-04T06:41:53.247 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1096422 2024-03-04T06:41:53.247 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.247 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:53.247 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 261, 2024-03-04T06:41:53.247 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23881 2024-03-04T06:41:53.247 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.247 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:53.247 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.247 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 227577 2024-03-04T06:41:53.247 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.247 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:53.247 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 118347680 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 86517 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 70112142 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12005445 2024-03-04T06:41:53.248 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.249 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:53.249 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 311957 2024-03-04T06:41:53.249 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.249 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:53.249 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 32, 2024-03-04T06:41:53.249 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 132567 2024-03-04T06:41:53.249 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.249 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:53.249 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.249 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 204357876 2024-03-04T06:41:53.249 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.249 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:53.249 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.250 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15180628 2024-03-04T06:41:53.250 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.250 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:53.250 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.250 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1776160 2024-03-04T06:41:53.250 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.250 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.250 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:53.250 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:53.250 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861610720 2024-03-04T06:41:53.250 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.250 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42385408 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42000384 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137549516 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 385024 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.251 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:53.252 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.252 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.252 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.252 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.252 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.252 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.252 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.252 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.252 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85508373 2024-03-04T06:41:53.252 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.252 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.252 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.252 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.253 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73875179 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:53.254 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641312803 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.255 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.256 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71716749 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:53.257 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 57005582 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.258 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.259 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68823074 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.260 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641312803 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.261 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.262 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.262 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.262 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.262 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.262 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.262 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.262 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.262 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.262 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 223334 2024-03-04T06:41:53.262 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.262 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.262 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71495543 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.263 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:53.264 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.265 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.266 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:53.267 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.268 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.269 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.270 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:53.271 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.271 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.271 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.271 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:53.271 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.271 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.271 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:53.271 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.271 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.271 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:53.271 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.271 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.271 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28385280 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.6": { 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:53.272 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.273 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1224704 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:53.274 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 913408 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 774144 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.275 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:53.276 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.277 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.278 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.279 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:53.279 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.279 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.279 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:53.279 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.279 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.279 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:53.279 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.279 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.279 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:53.279 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.279 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.279 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.280 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2076672 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1314816 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.281 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.282 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4422 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 176, 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 44500365 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 166, 2024-03-04T06:41:53.283 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5799126 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 176, 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 109416 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 176, 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 44609781 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:53.284 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 35268 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 460 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:53.285 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5410 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 347 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 248 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 90, 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 678669 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 139, 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 254526 2024-03-04T06:41:53.286 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 49, 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 402655 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 9181390 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.287 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 34, 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2514193 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 34, 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 456950750314 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 34, 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 51213613791 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 511522 2024-03-04T06:41:53.288 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28066 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2864327 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 128241132 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.289 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 81059 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 66921727 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 19484156 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 902566 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 27, 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 106791 2024-03-04T06:41:53.290 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 226727217 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 21417259 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1625298 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:53.291 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861610720 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 43368448 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42483712 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137549516 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 884736 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:53.292 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85508040 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.293 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.294 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.294 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.294 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.294 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.294 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.294 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.294 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.294 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.294 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.294 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.294 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.294 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73875512 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.295 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641310302 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.296 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:53.297 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.298 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.298 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.298 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.298 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.298 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.298 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.298 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.298 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.298 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.298 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.298 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71719250 2024-03-04T06:41:53.298 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.298 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 57005360 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.299 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.300 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68823296 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.301 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641310302 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.302 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.303 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.303 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.303 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.303 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.303 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.303 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.303 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.303 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.303 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.303 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.303 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8403 2024-03-04T06:41:53.303 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 219687 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.304 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71493288 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.305 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 39 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.306 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2810 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 13, 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 114787633 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 15, 2024-03-04T06:41:53.307 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6798630 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 13, 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 105391673 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.308 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.309 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.310 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:53.310 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.310 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.310 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:53.310 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.310 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.310 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.310 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:53.310 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.310 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.310 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:53.310 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.310 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.311 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:53.311 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.311 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.311 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:53.311 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.311 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.311 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.311 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:53.311 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.311 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.311 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.311 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.312 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13 2024-03-04T06:41:53.312 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.312 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:53.312 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2810 2024-03-04T06:41:53.312 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.312 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:53.312 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 13, 2024-03-04T06:41:53.312 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 114787633 2024-03-04T06:41:53.312 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.312 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:53.312 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.312 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 15, 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6798630 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 13, 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 105391673 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.313 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28979200 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.7": { 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.314 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.315 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1269760 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.316 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 983040 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 843776 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.317 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.318 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:53.319 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:53.320 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.321 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2191360 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:53.322 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1306624 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 253071 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.323 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 9, 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 45012 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.324 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 193, 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 49759756 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 182, 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10818431 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 193, 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 128338 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 193, 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 49888094 2024-03-04T06:41:53.325 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 55224 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.326 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 7352 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 576 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 276 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:53.327 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 114, 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2658941 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 175, 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 282314 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 61, 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1924790 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:53.328 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 66190 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2441432 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 20, 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1317903 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 20, 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 349582546287 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.329 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 20, 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 29136821074 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 701781 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27590 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 253616 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:53.330 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 124784269 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 96118 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 46581981 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 11388993 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:53.331 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 900209 2024-03-04T06:41:53.332 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.332 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:53.332 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 19, 2024-03-04T06:41:53.332 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 78303 2024-03-04T06:41:53.332 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.332 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:53.332 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.332 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 185491884 2024-03-04T06:41:53.332 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.332 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:53.332 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.332 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13419847 2024-03-04T06:41:53.332 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1827723 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861610720 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42319872 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42090496 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.333 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137549516 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 229376 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.334 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85499373 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.335 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 135168 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.336 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73749011 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.337 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641245304 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.338 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.339 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71784248 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.340 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 56999582 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.341 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.342 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68829074 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641245304 2024-03-04T06:41:53.343 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.344 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:53.345 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 229815 2024-03-04T06:41:53.345 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.345 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:53.345 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.345 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.345 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:53.345 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.345 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.345 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:53.345 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.345 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.345 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:53.345 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71556561 2024-03-04T06:41:53.346 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.346 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.346 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:53.346 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:53.346 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.346 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.346 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.346 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.346 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.346 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:53.346 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.346 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 47 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 101 2024-03-04T06:41:53.347 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 101, 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 155296945 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.348 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:53.349 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 264707 2024-03-04T06:41:53.349 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.349 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:53.349 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 103, 2024-03-04T06:41:53.349 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24761325 2024-03-04T06:41:53.349 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.349 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:53.349 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 101, 2024-03-04T06:41:53.349 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 118546885 2024-03-04T06:41:53.349 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.349 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:53.349 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 70 2024-03-04T06:41:53.349 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 70, 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 11649451 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 264707 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 70, 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10467327 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.350 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 70, 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8627887 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 26 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 26, 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 25730715 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.351 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 26, 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 11303466 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:53.352 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 26, 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24189331 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 117916779 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:53.353 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.354 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.354 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:53.354 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 7, 2024-03-04T06:41:53.354 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2990532 2024-03-04T06:41:53.354 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.354 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:53.354 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:53.354 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85729667 2024-03-04T06:41:53.354 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.354 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:53.354 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.355 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.355 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:53.355 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.355 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.355 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:53.355 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:53.355 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.355 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:53.355 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:53.355 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.355 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:53.355 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28971008 2024-03-04T06:41:53.355 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.356 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.356 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.356 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.356 INFO:tasks.workunit.client.0.smithi137.stdout: "pools": [ 2024-03-04T06:41:53.356 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.356 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:53.356 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr" 2024-03-04T06:41:53.356 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.356 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:53.356 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:53.356 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:53.356 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:53.356 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 1, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 1, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 1, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330362634, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 1781760, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 1781760, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110117376, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 2, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 2.443002131258254e-06, 2024-03-04T06:41:53.357 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 212, 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 313344, 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 590368, 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 590368, 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 1771104, 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 179, 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 2473984 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:53.358 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs" 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 32, 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 32, 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 2, 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:53.359 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330362634, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 98304, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 98304, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110117376, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 22, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 1.3478663163368765e-07, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 0, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 0, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 3428, 2024-03-04T06:41:53.360 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 3428, 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 10284, 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 51, 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 20480 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs" 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:53.361 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 64, 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 64, 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 3, 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330362634, 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 0, 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 0, 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110117376, 2024-03-04T06:41:53.362 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 0, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 0.0, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 0, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 0, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 0, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 0, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 0, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 0, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 0 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:53.363 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd" 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 8, 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 8, 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 4, 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:53.364 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330362634, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 0, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 0, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110117376, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 0, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 0.0, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 0, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 0, 2024-03-04T06:41:53.365 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 0, 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 0, 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 0, 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 0, 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 0 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd": { 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: "mirroring_by_pool": [ 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: false 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_images_by_pool": [ 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: "num_pools": 1 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: "report_id": "f1e8dce2-c416-4290-9187-6dc0e467ffee", 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: "report_timestamp": "2024-03-04T06:41:52.523586", 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: "report_version": 1, 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_stats": { 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "7.9.2" 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: "rook": { 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: "cluster": { 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: "external-mode": null, 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: "allow-multiple-per-node": null, 2024-03-04T06:41:53.367 INFO:tasks.workunit.client.0.smithi137.stdout: "count": null, 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: "max-id": null, 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: "pvc": { 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": null 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: "stretch": { 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": null 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: "network": { 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: "provider": null 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: "storage": { 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: "device-set": { 2024-03-04T06:41:53.368 INFO:tasks.workunit.client.0.smithi137.stdout: "count": { 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: "non-portable": null, 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: "portable": null, 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: "total": null 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: "csi": { 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: "version": null 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: "kubernetes": { 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: "version": null 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.369 INFO:tasks.workunit.client.0.smithi137.stdout: "node": { 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: "count": { 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: "kubernetes-total": null, 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: "with-ceph-daemons": null, 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: "with-csi-cephfs-plugin": null, 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: "with-csi-nfs-plugin": null, 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: "with-csi-rbd-plugin": null 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: "usage": { 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: "storage-class": { 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: "count": { 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": null, 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs": null, 2024-03-04T06:41:53.370 INFO:tasks.workunit.client.0.smithi137.stdout: "nfs": null, 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd": null, 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: "total": null 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: "version": null 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: "services": {}, 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_per_pg": [ 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.371 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.918941+0000", 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.918941+0000", 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.919238+0000", 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.372 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.373 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.373 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:53.373 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:53.373 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:53.373 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.373 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.373 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.373 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:53.373 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:53.373 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.373 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.373 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.373 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.374 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.374 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.374 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.374 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.374 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.374 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.374 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.374 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.374 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.374 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3f", 2024-03-04T06:41:53.374 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.374 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.375 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.375 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.375 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.375 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:10:03.122262+0000", 2024-03-04T06:41:53.375 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.375 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.375 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.375 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.375 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.375 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.375 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.375 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.376 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.376 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.376 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.376 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.376 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.376 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.376 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.376 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.376 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.376 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.376 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.376 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.377 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.377 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.377 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.377 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.377 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.377 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.377 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.377 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.377 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.377 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.377 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.377 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.378 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.379 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.379 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.379 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.379 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.379 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.379 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.379 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.379 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.379 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.379 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.379 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.379 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.914436+0000", 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.914436+0000", 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.914740+0000", 2024-03-04T06:41:53.380 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.381 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3e", 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.382 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:39:58.781088+0000", 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.383 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.384 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.384 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.384 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.384 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.384 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.384 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.384 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.384 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.384 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.384 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.384 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.384 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.384 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.385 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.386 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.895398+0000", 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.895398+0000", 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.895666+0000", 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.387 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.388 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3d", 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.389 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:37:10.744216+0000", 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.390 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.391 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.392 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.393 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.393 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.393 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.393 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.393 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.393 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:53.393 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.393 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.393 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.393 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.393 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.393 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.393 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.901792+0000", 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.901792+0000", 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.902256+0000", 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:53.394 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.395 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3c", 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.396 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:04:45.163241+0000", 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.397 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.398 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.399 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.400 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.913517+0000", 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.913517+0000", 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.913797+0000", 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:53.401 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.402 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3b", 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.403 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.404 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:04:24.837813+0000", 2024-03-04T06:41:53.404 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.404 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.404 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.404 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.404 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.404 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.404 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.404 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.404 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.404 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.404 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.404 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.405 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.406 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.407 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.408 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.408 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.408 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.408 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.408 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:53.408 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.408 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.408 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.408 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.408 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.408 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.408 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:53.408 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.904484+0000", 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.904484+0000", 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.904787+0000", 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:53.409 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:53.410 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.410 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.410 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.410 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.410 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.410 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.410 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.410 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.410 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.410 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.410 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.410 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.411 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.411 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3a", 2024-03-04T06:41:53.411 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.411 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.411 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.411 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.411 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.411 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:03:28.898688+0000", 2024-03-04T06:41:53.411 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.411 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.411 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.411 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.412 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.412 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.412 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.412 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.412 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.412 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.412 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.412 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.412 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.412 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.412 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.412 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.413 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.414 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.414 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.414 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.414 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.414 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.414 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.414 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.414 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.414 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.414 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.414 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.414 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.415 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.416 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.416 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.416 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.416 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.416 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.416 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.416 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.416 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.416 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.416 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.416 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.913553+0000", 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.913553+0000", 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.913825+0000", 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.417 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.418 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:53.418 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:53.418 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.418 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.418 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.418 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.418 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.418 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.418 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.418 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.418 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.419 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.419 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.419 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.419 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.419 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.39", 2024-03-04T06:41:53.419 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.419 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.419 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.419 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.419 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.419 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:23:17.322436+0000", 2024-03-04T06:41:53.419 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.419 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.420 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.420 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.420 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.420 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.420 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.420 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.420 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.420 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.420 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.420 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.420 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.420 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.423 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.424 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.424 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.424 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.424 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.424 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.424 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:53.424 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.424 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.424 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.424 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.424 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.424 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.902009+0000", 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.902009+0000", 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.902309+0000", 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.425 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.426 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.38", 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:36:04.048236+0000", 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.427 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.428 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.430 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.431 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.913922+0000", 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.913922+0000", 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.916933+0000", 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.432 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:53.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:53.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:53.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:53.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:53.433 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.433 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.433 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.433 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.433 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.434 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.434 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.434 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.434 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.434 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.434 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.434 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.434 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.434 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.37", 2024-03-04T06:41:53.434 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.434 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.434 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:08:21.342061+0000", 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.438 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.439 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.910906+0000", 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.910906+0000", 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.911185+0000", 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.441 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.36", 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:38:45.134957+0000", 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.445 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.915998+0000", 2024-03-04T06:41:53.446 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.915998+0000", 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.916277+0000", 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:53.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.35", 2024-03-04T06:41:53.448 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.449 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.451 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.451 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.451 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.451 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:22:53.166929+0000", 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.452 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.453 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.454 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.455 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.456 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.456 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:53.456 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.456 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.456 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.456 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.456 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.456 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.456 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:53.456 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.907111+0000", 2024-03-04T06:41:53.456 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.907111+0000", 2024-03-04T06:41:53.456 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.907393+0000", 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.457 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.34", 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.458 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.459 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.459 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.459 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.459 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:47:18.641488+0000", 2024-03-04T06:41:53.459 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.459 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.459 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.459 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.459 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.459 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.459 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.459 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.459 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.460 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.461 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.462 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.896729+0000", 2024-03-04T06:41:53.463 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.896729+0000", 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.897003+0000", 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:53.464 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.33", 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.465 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T11:01:03.497642+0000", 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.468 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.468 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.468 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.468 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.468 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.468 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.468 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.468 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.468 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.468 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.468 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.468 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.468 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.469 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.469 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.469 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.469 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.469 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.469 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.469 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.469 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.469 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.469 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.469 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.469 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.469 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.470 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.896300+0000", 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.896300+0000", 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.896652+0000", 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.471 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.472 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.32", 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T18:20:32.026507+0000", 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.475 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.476 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.476 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.476 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.476 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.476 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.476 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.476 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.476 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.476 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.476 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.476 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.476 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.477 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.477 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.477 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.477 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.477 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.477 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.477 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.477 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:53.477 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.477 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.477 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.477 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.477 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.478 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.478 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.478 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.478 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:53.478 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.478 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.478 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.478 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.478 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.478 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.478 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:53.478 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.907720+0000", 2024-03-04T06:41:53.478 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.907720+0000", 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.907997+0000", 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:53.479 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.480 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.31", 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T10:46:55.140847+0000", 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.481 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.482 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.483 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.483 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.483 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.483 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.483 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.483 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.483 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.483 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.483 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.483 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.483 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.483 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.483 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.484 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.485 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.898928+0000", 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.898928+0000", 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.899219+0000", 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.486 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.487 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.488 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.30", 2024-03-04T06:41:53.488 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.488 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.488 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.488 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.488 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.488 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:08:13.412822+0000", 2024-03-04T06:41:53.488 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.488 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.488 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.488 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.488 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.488 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.489 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.490 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.491 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.491 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.491 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.491 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.491 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.491 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.491 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.491 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.491 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.491 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.491 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.491 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.491 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.492 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.492 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.492 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.492 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.492 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:53.492 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.492 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.492 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.492 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.492 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.492 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.492 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.492 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.493 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:53.493 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.493 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.493 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.493 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.493 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.493 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.493 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:53.493 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.908038+0000", 2024-03-04T06:41:53.493 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.908038+0000", 2024-03-04T06:41:53.493 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.908332+0000", 2024-03-04T06:41:53.493 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:53.493 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.494 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2f", 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.495 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.496 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.496 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:05:49.146138+0000", 2024-03-04T06:41:53.496 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.496 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.496 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.496 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.496 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.496 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.496 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.496 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.496 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.497 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.499 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.500 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.500 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:53.500 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.500 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.500 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.500 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.500 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.500 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.500 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.500 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.500 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.898801+0000", 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.898801+0000", 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.899134+0000", 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.501 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.502 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2e", 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.503 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:21:48.465552+0000", 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.504 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.507 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.914159+0000", 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.914159+0000", 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.918000+0000", 2024-03-04T06:41:53.508 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.509 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2d", 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.510 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.511 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.511 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:21:24.026090+0000", 2024-03-04T06:41:53.511 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.511 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.511 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.511 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.511 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.511 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.511 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.511 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.511 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.511 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.511 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.514 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.515 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.550141+0000", 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.550141+0000", 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.550843+0000", 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 4, 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 4, 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.517 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1f", 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 24, 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:45:01.969570+0000", 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 582, 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.518 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 6, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 2, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 2, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 4, 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 1 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.521 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'4" 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.522 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.896120+0000", 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.896120+0000", 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.896389+0000", 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:53.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.524 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1e", 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:49:57.729499+0000", 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.525 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.528 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:53.529 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.550444+0000", 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.550444+0000", 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.550800+0000", 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 1, 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.531 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 1, 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1e", 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 21, 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:53:42.209194+0000", 2024-03-04T06:41:53.532 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.535 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.536 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.536 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.536 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.536 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.536 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.536 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.536 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.536 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:53.536 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'1" 2024-03-04T06:41:53.536 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.536 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.536 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.537 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.537 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.537 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.537 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.537 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:53.537 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.537 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.537 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.537 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.537 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.537 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:53.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.902982+0000", 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.902982+0000", 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.903258+0000", 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.539 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1f", 2024-03-04T06:41:53.540 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.540 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.540 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.540 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.540 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.540 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:31:23.228035+0000", 2024-03-04T06:41:53.540 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.540 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.540 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.543 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.543 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.543 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.543 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.543 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.543 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.543 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.543 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.543 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.543 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.543 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.543 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.543 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.544 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.544 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.544 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.544 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:53.544 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.544 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.544 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.544 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.544 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.544 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.544 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.544 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:39:45.831328+0000", 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:39:45.831328+0000", 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:39:45.833985+0000", 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.545 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 69, 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 2, 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.546 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 68, 2024-03-04T06:41:53.547 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.547 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.547 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.547 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.547 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 2, 2024-03-04T06:41:53.547 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.547 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.547 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.547 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1d", 2024-03-04T06:41:53.547 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.547 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.547 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.547 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:53.548 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.548 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:27:31.095064+0000", 2024-03-04T06:41:53.548 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.548 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.548 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 1, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 3, 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'2" 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.551 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.552 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.552 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.552 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.552 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.552 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.552 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:53.552 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.552 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.552 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.552 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.552 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.552 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.552 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:39:46.421792+0000", 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:39:46.421792+0000", 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 69, 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.553 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 68, 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.554 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1c", 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 11, 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:10:51.404998+0000", 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.556 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.556 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.556 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.556 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.556 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.556 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.556 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.556 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.556 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.556 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.556 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.556 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.556 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.557 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.558 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.559 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.555860+0000", 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.555860+0000", 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.556246+0000", 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:53.560 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:53.561 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:53.561 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.561 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.561 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.561 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:53.561 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:53.561 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.561 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 2, 2024-03-04T06:41:53.561 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.561 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.561 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.561 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.561 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 2, 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1c", 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 22, 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T18:36:41.910480+0000", 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.562 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.563 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:53.564 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.565 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.565 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.565 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.565 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.565 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.565 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.565 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.565 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.565 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.565 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.565 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.565 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 3, 2024-03-04T06:41:53.565 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'2" 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.566 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.567 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.567 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.567 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:53.567 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.567 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.567 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.567 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.567 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.567 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.567 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:53.567 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.906615+0000", 2024-03-04T06:41:53.567 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.906615+0000", 2024-03-04T06:41:53.568 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.906907+0000", 2024-03-04T06:41:53.568 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:53.568 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.568 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.568 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.568 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.568 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:53.568 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:53.568 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:53.568 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.568 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.568 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.568 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:53.569 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:53.569 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.569 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.569 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.569 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.569 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.569 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.569 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.569 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.569 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.569 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.569 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1d", 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:21:15.889709+0000", 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.570 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.571 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.571 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.571 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.571 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.571 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.571 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.571 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.571 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.573 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.574 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.545975+0000", 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.545975+0000", 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.546234+0000", 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:53.575 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.576 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.576 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.576 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.576 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:53.576 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:53.576 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:53.576 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.576 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.576 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.576 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:53.576 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 1, 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 1, 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1b", 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.577 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.578 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.578 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 21, 2024-03-04T06:41:53.578 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.578 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:50:04.341190+0000", 2024-03-04T06:41:53.578 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.578 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.578 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.578 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.578 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.578 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.578 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.578 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.579 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.579 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.579 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.579 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.579 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.579 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.579 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.579 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.579 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.579 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.579 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.579 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.579 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.580 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.581 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'1" 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.582 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.907953+0000", 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.907953+0000", 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.908256+0000", 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.583 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.584 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.584 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:53.584 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:53.584 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.584 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.584 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.584 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.584 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.584 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.584 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.584 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.584 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.584 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1a", 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:03:03.291025+0000", 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.585 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.586 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.587 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.588 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.588 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.588 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.588 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.589 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.554044+0000", 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.554044+0000", 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.554332+0000", 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.590 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 1, 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.591 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.592 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.592 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.592 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.592 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.592 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 1, 2024-03-04T06:41:53.592 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.592 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.592 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.592 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1a", 2024-03-04T06:41:53.592 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.592 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.592 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.592 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 21, 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T10:28:40.250342+0000", 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.593 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:53.596 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'1" 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:53.597 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.909974+0000", 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.909974+0000", 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.910445+0000", 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:53.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1b", 2024-03-04T06:41:53.599 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.600 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.600 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.600 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.600 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.600 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:42:52.372021+0000", 2024-03-04T06:41:53.600 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.600 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.600 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.600 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.600 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.600 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.600 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.603 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.604 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.542896+0000", 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.542896+0000", 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.543180+0000", 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.606 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.19", 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:15:09.816539+0000", 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.607 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.610 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.611 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.612 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.612 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.612 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.612 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:53.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.895201+0000", 2024-03-04T06:41:53.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.895201+0000", 2024-03-04T06:41:53.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.895735+0000", 2024-03-04T06:41:53.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:53.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.613 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:53.613 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:53.613 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:53.613 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.613 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.613 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.613 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:53.613 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:53.613 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.613 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.613 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.613 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.613 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.18", 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.614 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:12:35.373175+0000", 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.618 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.619 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:53.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.550791+0000", 2024-03-04T06:41:53.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.550791+0000", 2024-03-04T06:41:53.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.551089+0000", 2024-03-04T06:41:53.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:53.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:53.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:53.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.621 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.18", 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:36:49.576267+0000", 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.625 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.626 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.908879+0000", 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.908879+0000", 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.909194+0000", 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.627 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.628 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.628 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:53.628 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:53.628 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:53.628 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.628 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.628 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.628 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:53.628 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:53.628 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.628 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.628 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.628 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.19", 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.629 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:33:23.733425+0000", 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.632 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.633 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.634 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.634 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:53.634 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.634 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.634 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.634 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.634 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.634 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.634 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:53.634 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.543699+0000", 2024-03-04T06:41:53.634 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.543699+0000", 2024-03-04T06:41:53.634 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.544023+0000", 2024-03-04T06:41:53.634 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:53.635 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.635 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.635 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.635 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.635 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:53.635 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:53.635 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:53.635 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.635 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.635 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.635 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:53.635 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:53.635 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.636 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.636 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.636 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.636 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.636 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.636 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.636 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.636 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.636 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.636 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.636 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.636 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.637 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.17", 2024-03-04T06:41:53.637 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.637 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.637 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.637 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.637 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.637 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:04:19.418372+0000", 2024-03-04T06:41:53.637 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.637 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.637 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.639 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.640 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:53.641 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.903226+0000", 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.903226+0000", 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.903510+0000", 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:53.642 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.643 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.16", 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:49:29.474747+0000", 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.645 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.646 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.646 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.646 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.646 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.646 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.646 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.646 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.646 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.646 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.646 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.646 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.646 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.646 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.647 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.648 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.549931+0000", 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.549931+0000", 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.550879+0000", 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:53.649 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.650 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.16", 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:12:33.138651+0000", 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.651 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.652 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.652 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.652 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.652 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.652 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.652 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.652 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.652 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.652 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.652 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.652 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.652 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.653 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.653 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.653 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.653 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.653 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.653 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.653 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.653 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.653 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.653 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.654 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.656 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.656 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.656 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.656 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.656 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.656 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.656 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.656 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.656 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:53.656 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.656 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.657 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.903600+0000", 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.903600+0000", 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.903875+0000", 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.658 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.659 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.17", 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:24:32.774333+0000", 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.660 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.661 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.663 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.663 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.664 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.664 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.664 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.664 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.664 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:53.664 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.664 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:53.664 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.664 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.664 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.664 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.664 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.664 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.551202+0000", 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.551202+0000", 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.551496+0000", 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:53.665 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 3, 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.666 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 3, 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.15", 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 23, 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.667 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:27:19.526762+0000", 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 90, 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.668 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 6, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 2, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 2, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 4, 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 1 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'3" 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.671 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.672 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.672 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.672 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:53.672 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.672 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.672 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.672 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.672 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.672 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.672 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:53.672 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.911389+0000", 2024-03-04T06:41:53.672 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.911389+0000", 2024-03-04T06:41:53.672 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.911735+0000", 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:53.673 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.14", 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.674 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:50:25.284425+0000", 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.678 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.545863+0000", 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.545863+0000", 2024-03-04T06:41:53.679 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.546352+0000", 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.680 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 12, 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 12, 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.14", 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.681 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 32, 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T18:08:08.181131+0000", 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 2630, 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 12, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 4, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 4, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:53.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 12, 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 9 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "69'12" 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.685 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:39:46.286914+0000", 2024-03-04T06:41:53.686 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:39:46.286914+0000", 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:39:46.287331+0000", 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 69, 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.687 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 68, 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.15", 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.688 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 28, 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:58:41.826266+0000", 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.692 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.546672+0000", 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.546672+0000", 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.547028+0000", 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:53.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 2, 2024-03-04T06:41:53.694 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 2, 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.13", 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.695 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 22, 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T11:21:00.773241+0000", 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 34, 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 6, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 2, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 2, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.698 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 3, 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 7 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'2" 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.699 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.700 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.700 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.700 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:53.700 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.700 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:53.700 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.700 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.700 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.700 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.700 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.700 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.700 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:53.700 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:39:46.286900+0000", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:39:46.286900+0000", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 69, 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:53.701 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 68, 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.12", 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.702 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 11, 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:47:17.558117+0000", 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.706 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.549299+0000", 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.549299+0000", 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.549608+0000", 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.708 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.12", 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:12:23.543702+0000", 2024-03-04T06:41:53.709 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.712 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.713 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:39:46.287549+0000", 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:39:46.287549+0000", 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:39:46.287912+0000", 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 69, 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:53.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 68, 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.715 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.13", 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 28, 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:08:21.823113+0000", 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.716 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.719 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.720 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.549222+0000", 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.549222+0000", 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.549514+0000", 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.722 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.11", 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:54:24.051519+0000", 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.723 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.726 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.727 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.909146+0000", 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.909146+0000", 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.909428+0000", 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.729 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.10", 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:34:44.391084+0000", 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.730 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.733 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.733 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.733 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.733 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.733 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.733 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.733 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.733 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.733 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.733 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.733 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.733 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.733 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.734 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.543579+0000", 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.543579+0000", 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.544896+0000", 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:53.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 8, 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.736 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 8, 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.10", 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 28, 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:50:39.451118+0000", 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.737 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 12, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 4, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 4, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 4, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 12, 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.740 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'8" 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.741 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.918716+0000", 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.918716+0000", 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.919018+0000", 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:53.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.743 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.11", 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:06:47.029429+0000", 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.744 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.747 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.748 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.547867+0000", 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.547867+0000", 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.550559+0000", 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 1, 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 1, 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.750 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.f", 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 21, 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:07:04.949081+0000", 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 22, 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:53.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:53.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 1, 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 1 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.754 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'1" 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.755 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.910660+0000", 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.910660+0000", 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.913566+0000", 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:53.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.757 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.e", 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:16:42.862745+0000", 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.761 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.761 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.761 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.761 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.761 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.761 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.761 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.761 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.761 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.761 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.761 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.761 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.761 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.762 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.762 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.762 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.762 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.762 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.762 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.762 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.762 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.762 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.762 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.762 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.762 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.762 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:53.763 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.763 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.763 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:53.763 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.763 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.763 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:53.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.376476+0000", 2024-03-04T06:41:53.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.376476+0000", 2024-03-04T06:41:53.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.376732+0000", 2024-03-04T06:41:53.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:53.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.764 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.2", 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:53.765 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:21:52.679530+0000", 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.768 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.768 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.768 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.768 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.768 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.768 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.768 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.768 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.768 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.768 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.768 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.768 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.768 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.769 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.554461+0000", 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.554461+0000", 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.554795+0000", 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:53.770 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.771 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.771 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.771 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.771 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:53.771 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:53.771 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:53.771 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.771 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.771 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.771 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:53.771 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:53.771 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.771 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.772 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.772 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.772 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.772 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.772 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.772 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.772 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.772 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.772 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.772 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.772 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.4", 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:03:44.989709+0000", 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.773 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.776 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:53.777 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.896742+0000", 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.896742+0000", 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.897411+0000", 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.778 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.779 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.780 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.780 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.780 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.780 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.780 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.780 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.5", 2024-03-04T06:41:53.780 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.780 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.780 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.780 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.780 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.780 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:14:21.032038+0000", 2024-03-04T06:41:53.780 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.781 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.781 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.781 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.781 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.781 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.781 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.781 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.781 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.781 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.781 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.781 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.781 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.784 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.317763+0000", 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.317763+0000", 2024-03-04T06:41:53.785 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.318044+0000", 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.786 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.4", 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:53.787 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:54:04.059027+0000", 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.788 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.789 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.790 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.791 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.792 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:53.792 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.792 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.792 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.792 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.792 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.792 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.792 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:53.792 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.548550+0000", 2024-03-04T06:41:53.792 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.548550+0000", 2024-03-04T06:41:53.792 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.548860+0000", 2024-03-04T06:41:53.792 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.793 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.2", 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.794 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.795 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.795 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:47:43.188556+0000", 2024-03-04T06:41:53.795 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.795 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.795 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.795 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.795 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.795 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.795 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.795 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.795 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.795 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.795 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.796 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.797 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.798 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.908227+0000", 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.908227+0000", 2024-03-04T06:41:53.799 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.908558+0000", 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.800 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3", 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.801 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:39:27.394161+0000", 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.802 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.803 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.804 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.804 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.804 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.804 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.804 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.804 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.804 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.804 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.804 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.804 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.804 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.804 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.804 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.805 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:53.806 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.376418+0000", 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.376418+0000", 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.376856+0000", 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:53.807 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:53.808 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.808 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.808 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.808 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.808 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:53.808 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.808 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.808 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.808 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.808 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.808 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.808 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.808 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.7", 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:18:43.241370+0000", 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.809 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.810 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.811 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.812 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.812 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.812 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.812 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.812 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.812 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.812 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.812 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.812 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.812 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.812 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.812 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.812 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.813 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.913896+0000", 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.913896+0000", 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.914172+0000", 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.814 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.815 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.0", 2024-03-04T06:41:53.816 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.816 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.816 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.816 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.816 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.816 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:52:53.141176+0000", 2024-03-04T06:41:53.816 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.816 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.816 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.816 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.816 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.816 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.817 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.817 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.817 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.817 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.817 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.817 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.817 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.817 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.817 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.817 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.817 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.817 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.817 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.818 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.819 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.820 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.820 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.820 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.820 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.820 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:53.820 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.820 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.820 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.820 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.820 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.820 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.820 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.820 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.540155+0000", 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.540155+0000", 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.540510+0000", 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.821 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.822 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1", 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:56:39.660282+0000", 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.823 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.824 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.825 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.826 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.827 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.316821+0000", 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.316821+0000", 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.317126+0000", 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.828 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.829 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.830 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:53.830 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.830 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.830 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.830 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.830 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.830 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.830 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.830 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.830 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.5", 2024-03-04T06:41:53.830 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.830 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.830 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:38:44.635838+0000", 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.831 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.832 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.833 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.834 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.903235+0000", 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.903235+0000", 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.903488+0000", 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:53.835 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.836 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.837 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.837 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.837 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.837 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.837 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.837 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.837 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.837 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.837 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.837 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.837 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2", 2024-03-04T06:41:53.837 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.838 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.838 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.838 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.838 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.838 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T11:48:43.099957+0000", 2024-03-04T06:41:53.838 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.838 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.838 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.838 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.838 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.838 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.839 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.839 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.839 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.839 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.839 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.839 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.839 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.839 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.839 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.839 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.839 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.839 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.839 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.840 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.841 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:53.842 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.843 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.843 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.843 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.843 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.843 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.843 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:53.843 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.550367+0000", 2024-03-04T06:41:53.843 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.550367+0000", 2024-03-04T06:41:53.843 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.550672+0000", 2024-03-04T06:41:53.843 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:53.843 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.843 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.843 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.844 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.845 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.845 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.845 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.845 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.845 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.845 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.845 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.845 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.845 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.3", 2024-03-04T06:41:53.845 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.845 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.845 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.845 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:57:27.060139+0000", 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.846 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.847 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.848 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.849 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 19, 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.828673+0000", 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:37:58.309800+0000", 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:37:58.309800+0000", 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:37:58.310255+0000", 2024-03-04T06:41:53.850 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.828673+0000", 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:35:55.260752+0000", 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:35:55.260752+0000", 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 58, 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.828673+0000", 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.828673+0000", 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.828673+0000", 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:35:55.260752+0000", 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.828673+0000", 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.828673+0000", 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 128, 2024-03-04T06:41:53.851 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 57, 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 128, 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "1.0", 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.852 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 265, 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:29:38.185918+0000", 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 590368, 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 1771104, 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.853 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 6, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 2, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 2, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.854 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 6, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 212, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 306, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.856 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 179, 2024-03-04T06:41:53.856 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 2416 2024-03-04T06:41:53.856 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.856 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.856 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.856 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.856 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.856 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.856 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.856 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.856 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.856 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "64'128" 2024-03-04T06:41:53.856 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:53.857 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.321560+0000", 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.321560+0000", 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.321870+0000", 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.858 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.859 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.860 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.6", 2024-03-04T06:41:53.860 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.860 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.860 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.860 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:53.860 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.860 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:40:27.719672+0000", 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.863 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.864 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.865 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.866 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.867 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:53.867 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.867 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:53.867 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.867 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.867 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.867 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.867 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.867 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.867 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.422207+0000", 2024-03-04T06:41:53.867 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:39:46.421792+0000", 2024-03-04T06:41:53.867 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:39:46.421792+0000", 2024-03-04T06:41:53.867 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:39:46.422207+0000", 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.422207+0000", 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 69, 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.422207+0000", 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.422207+0000", 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.422207+0000", 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.422207+0000", 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.422207+0000", 2024-03-04T06:41:53.868 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.869 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.869 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.869 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.869 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 68, 2024-03-04T06:41:53.869 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.869 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.869 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.869 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.869 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.869 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.869 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.869 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.869 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1", 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 11, 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:15:08.818871+0000", 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.870 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.871 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.872 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.872 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.872 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.872 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.872 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.872 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.872 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.872 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.872 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.872 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.872 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.872 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.872 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.873 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.874 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.556594+0000", 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.556594+0000", 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.556986+0000", 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:53.875 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.876 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.877 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.877 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.877 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.877 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.877 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.877 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.0", 2024-03-04T06:41:53.877 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.877 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.877 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.877 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.877 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.877 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T10:23:52.669745+0000", 2024-03-04T06:41:53.877 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.878 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.879 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.880 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.881 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:53.882 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.882 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.882 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:53.882 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.882 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.882 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.882 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:53.882 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.376532+0000", 2024-03-04T06:41:53.882 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.376532+0000", 2024-03-04T06:41:53.882 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.376856+0000", 2024-03-04T06:41:53.882 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:53.882 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.882 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:53.883 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.884 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.884 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.884 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.884 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.884 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.884 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.884 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.884 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.3", 2024-03-04T06:41:53.884 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.884 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.884 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.884 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:53.884 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.885 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:33:21.206296+0000", 2024-03-04T06:41:53.885 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.885 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.885 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.885 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.885 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.885 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.885 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.885 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.885 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.885 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.885 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.885 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.886 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.887 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.888 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.557397+0000", 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.557397+0000", 2024-03-04T06:41:53.889 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.557967+0000", 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.890 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.5", 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.891 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:09:35.366465+0000", 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.892 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.893 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.894 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.895 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.905234+0000", 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.905234+0000", 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.905517+0000", 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.896 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.897 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.4", 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:32:58.487468+0000", 2024-03-04T06:41:53.898 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.899 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.900 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.901 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.902 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.316666+0000", 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.316666+0000", 2024-03-04T06:41:53.903 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.316978+0000", 2024-03-04T06:41:53.904 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:53.904 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.904 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.904 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.904 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:53.904 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:53.904 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:53.904 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:53.904 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.904 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.904 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.904 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:53.904 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.0", 2024-03-04T06:41:53.905 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:36:22.840327+0000", 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.906 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.907 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.908 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.909 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.909 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.909 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.909 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.909 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.909 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.909 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.909 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.909 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.909 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.909 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.909 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.909 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.910 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.542663+0000", 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.542663+0000", 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.542943+0000", 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.911 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 1, 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 1, 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.912 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.6", 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 21, 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:14:11.583290+0000", 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.913 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.914 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.914 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.914 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.914 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.914 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.914 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.914 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.914 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.914 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.914 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.914 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.914 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:53.914 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.915 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 1, 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.916 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.917 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.917 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:53.917 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "62'1" 2024-03-04T06:41:53.917 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.917 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.917 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.917 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.917 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.917 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.917 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.917 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:53.917 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.917 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.918 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.918 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.918 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.918 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.918 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:53.918 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.897766+0000", 2024-03-04T06:41:53.918 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.897766+0000", 2024-03-04T06:41:53.918 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.898034+0000", 2024-03-04T06:41:53.918 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:53.918 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.918 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.918 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.918 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.919 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.7", 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:13:56.085588+0000", 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.920 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.921 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.922 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.922 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.922 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.922 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.922 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.922 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.922 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.922 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.922 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.922 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.922 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.922 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.922 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.923 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.924 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.924 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:53.924 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.924 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:53.924 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.924 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.924 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.924 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.924 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.924 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.924 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.924 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.376407+0000", 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.376407+0000", 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.376747+0000", 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.925 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.926 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.1", 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T10:01:44.463155+0000", 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.927 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.928 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.928 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.928 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.928 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.928 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.928 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.928 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.928 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.928 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.928 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.928 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.928 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.928 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.929 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.929 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.929 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.929 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.929 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.929 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.929 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.929 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.929 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.929 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.929 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.929 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.929 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.930 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:53.931 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.932 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.932 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.932 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.932 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.932 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.932 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:53.932 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.554544+0000", 2024-03-04T06:41:53.932 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.554544+0000", 2024-03-04T06:41:53.932 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.554846+0000", 2024-03-04T06:41:53.932 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:53.932 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.932 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.932 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 2, 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.933 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 2, 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.7", 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 22, 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:57:44.524183+0000", 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.934 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.935 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.936 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.937 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.937 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.937 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.937 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.937 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.937 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.937 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.937 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 3, 2024-03-04T06:41:53.937 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.937 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.937 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.937 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.937 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'2" 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.938 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:53.939 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.939 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.939 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.939 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.939 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.939 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.939 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:53.939 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.902896+0000", 2024-03-04T06:41:53.939 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.902896+0000", 2024-03-04T06:41:53.939 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.903163+0000", 2024-03-04T06:41:53.939 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:53.939 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.939 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.940 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.6", 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.941 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:45:59.166463+0000", 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.942 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.943 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.944 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.945 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.556014+0000", 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.556014+0000", 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.556654+0000", 2024-03-04T06:41:53.946 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.947 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.8", 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.948 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:44:45.975559+0000", 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.949 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.950 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.951 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.952 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.906385+0000", 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.906385+0000", 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.906674+0000", 2024-03-04T06:41:53.953 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:53.954 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.954 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.954 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.954 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.954 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:53.954 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:53.954 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:53.954 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.954 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.954 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.955 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.9", 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:29:56.436800+0000", 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.956 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.957 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.958 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.958 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.958 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.958 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.958 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.958 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.958 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.958 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.958 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.958 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.958 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.958 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.958 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.959 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.959 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.959 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.959 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.959 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.959 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.959 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.959 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.959 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.959 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.959 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.959 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.960 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.555150+0000", 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.555150+0000", 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.555463+0000", 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.961 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.962 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.9", 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.963 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:59:30.714863+0000", 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.964 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.965 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.966 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.967 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.897568+0000", 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.897568+0000", 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.897860+0000", 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.968 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.969 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:53.969 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:53.969 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:53.969 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.969 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.969 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.969 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:53.969 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:53.969 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.969 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.969 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.969 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.969 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.8", 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:22:30.116519+0000", 2024-03-04T06:41:53.970 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.971 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.972 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.973 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.973 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.973 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.973 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.973 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.973 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.973 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.973 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.973 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.973 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.973 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.973 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.974 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.555948+0000", 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.555948+0000", 2024-03-04T06:41:53.975 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.556223+0000", 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.976 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.a", 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.977 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:19:51.659542+0000", 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.978 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.979 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.980 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.981 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.907114+0000", 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.907114+0000", 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.908686+0000", 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.982 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.983 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:53.983 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:53.983 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:53.983 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.983 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.983 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.983 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:53.983 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:53.983 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.983 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.983 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.983 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.b", 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.984 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:08:03.009115+0000", 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.985 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:53.986 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.987 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.988 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.558068+0000", 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.558068+0000", 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.558399+0000", 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.989 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 2, 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.990 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 2, 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.b", 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 22, 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:10:00.895079+0000", 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.991 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.992 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.992 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.992 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.992 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.992 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.992 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.992 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.992 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.992 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.992 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.992 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.992 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.992 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:53.993 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 1, 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:53.994 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'2" 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:53.995 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.903906+0000", 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.903906+0000", 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.904212+0000", 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:53.996 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:53.997 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.a", 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:27:10.766546+0000", 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:53.998 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:53.999 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.000 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.000 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.000 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.000 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.000 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.000 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.000 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.000 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.000 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.000 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.000 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.000 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.001 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.002 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.547906+0000", 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.547906+0000", 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.548200+0000", 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.003 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.004 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:54.005 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.005 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.005 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.005 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.005 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.005 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.005 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.005 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.005 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.c", 2024-03-04T06:41:54.005 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.005 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.005 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.005 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:11:39.491360+0000", 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.008 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.008 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.008 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.008 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.008 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.008 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.008 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.008 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.008 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.008 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.008 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.008 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.008 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.009 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.918684+0000", 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.918684+0000", 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.918955+0000", 2024-03-04T06:41:54.010 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.011 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.d", 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.012 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T06:47:29.169416+0000", 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.014 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.015 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:54.016 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.547358+0000", 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.547358+0000", 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.547660+0000", 2024-03-04T06:41:54.017 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 1, 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.018 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 1, 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.d", 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 21, 2024-03-04T06:41:54.019 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:40:10.370020+0000", 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 70, 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.021 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 1, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 1 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.022 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'1" 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.023 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.901331+0000", 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.901331+0000", 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.902066+0000", 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:54.024 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:54.025 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:54.025 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.025 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.025 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.025 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:54.025 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:54.025 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.025 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.025 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.025 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.025 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.025 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.c", 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.026 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:46:51.413734+0000", 2024-03-04T06:41:54.027 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.027 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.027 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.027 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.027 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.027 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.027 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.027 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.027 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.027 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.027 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.027 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.027 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.028 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.029 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.030 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.547108+0000", 2024-03-04T06:41:54.031 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.547108+0000", 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.547376+0000", 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:54.032 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 2, 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 2, 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.e", 2024-03-04T06:41:54.033 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 22, 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:34:14.300865+0000", 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.034 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 3, 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'2" 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.037 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.917001+0000", 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.917001+0000", 2024-03-04T06:41:54.038 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.917263+0000", 2024-03-04T06:41:54.039 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:54.039 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.039 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.039 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.039 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.039 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:54.039 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:54.039 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:54.039 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.039 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.039 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.039 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:54.039 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.040 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.f", 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:02:54.912481+0000", 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.042 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.043 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.043 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.043 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.043 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.043 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.043 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.043 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.043 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.043 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.043 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.043 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.043 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.043 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.044 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.045 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.916669+0000", 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.916669+0000", 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.916968+0000", 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.047 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.20", 2024-03-04T06:41:54.048 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.048 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.048 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.048 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.048 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.048 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:18:16.919063+0000", 2024-03-04T06:41:54.048 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.048 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.048 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.048 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.048 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.048 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.048 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.049 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.050 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.051 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.051 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.051 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.051 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.051 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.051 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.051 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.051 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.051 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.051 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.051 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.051 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.051 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.052 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.892261+0000", 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.892261+0000", 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.892619+0000", 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.053 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.054 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.21", 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.055 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.056 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:19:13.957414+0000", 2024-03-04T06:41:54.056 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.056 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.056 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:54.059 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.060 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.060 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.060 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.060 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.060 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.060 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.063 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.063 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:54.063 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.063 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.063 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.063 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.063 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.063 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.063 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:54.063 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.898002+0000", 2024-03-04T06:41:54.063 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.898002+0000", 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.899301+0000", 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:54.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.065 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.22", 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T18:16:46.969732+0000", 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.066 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.067 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.069 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.070 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.907578+0000", 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.907578+0000", 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.908610+0000", 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.071 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.072 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.23", 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T11:40:52.078874+0000", 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.073 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.075 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.076 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:54.077 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.906183+0000", 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.906183+0000", 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.906536+0000", 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.078 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.079 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.080 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.080 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.080 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.080 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.080 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.080 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.080 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.080 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.24", 2024-03-04T06:41:54.080 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.080 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.080 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.080 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.080 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:15:13.559021+0000", 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.081 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.082 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.083 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.084 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.084 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.084 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.084 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.084 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:54.084 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.084 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.084 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:54.084 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.084 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.084 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.084 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.084 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.899583+0000", 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.899583+0000", 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.899871+0000", 2024-03-04T06:41:54.085 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.086 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.087 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.087 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.087 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.087 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.087 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.087 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.087 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.087 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.087 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.087 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.087 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.25", 2024-03-04T06:41:54.087 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.087 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:05:51.628806+0000", 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.090 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.091 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.092 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.914354+0000", 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.914354+0000", 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.914660+0000", 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:54.093 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.094 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.26", 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:29:28.750455+0000", 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.098 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.098 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.098 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.098 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.098 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.098 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.098 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.098 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.098 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.098 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.098 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.098 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.098 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.099 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.099 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:54.099 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.099 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:54.099 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.099 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:54.099 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.099 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.099 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.099 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.099 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.099 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:54.099 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.906492+0000", 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.906492+0000", 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.906752+0000", 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:54.100 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.101 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.27", 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.102 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.103 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.103 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:48:24.841196+0000", 2024-03-04T06:41:54.103 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.103 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.103 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.105 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.106 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.107 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.896787+0000", 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.896787+0000", 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.897151+0000", 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:54.108 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.109 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.109 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.109 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:54.109 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:54.109 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.109 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.109 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.109 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.109 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.109 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.109 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.109 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.109 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.28", 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T18:12:22.562737+0000", 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.110 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.112 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.113 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.114 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.908021+0000", 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.908021+0000", 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.908348+0000", 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.115 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.116 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.29", 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.117 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:16:36.050910+0000", 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.119 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.120 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.120 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.120 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.120 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.120 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.120 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.120 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.120 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.120 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.120 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.120 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.120 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.121 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.898693+0000", 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.898693+0000", 2024-03-04T06:41:54.122 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.898994+0000", 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:54.123 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2a", 2024-03-04T06:41:54.124 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T10:40:01.173992+0000", 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.127 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:54.128 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.129 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.897717+0000", 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.897717+0000", 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.898036+0000", 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.130 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.131 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2b", 2024-03-04T06:41:54.132 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.132 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.132 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.132 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.132 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.132 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T06:58:02.821482+0000", 2024-03-04T06:41:54.132 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.132 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.132 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.134 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:54.135 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.136 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:54.136 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.136 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:54.136 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.136 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.136 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.136 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:54.136 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:54.136 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:54.136 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.136 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.136 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:54.136 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.915335+0000", 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.915335+0000", 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.915624+0000", 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:54.137 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:54.138 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:54.139 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:54.139 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:54.139 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.139 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:54.139 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:54.139 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:54.139 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2c", 2024-03-04T06:41:54.139 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:54.139 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:54.139 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:54.139 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:54.139 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:54.139 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T11:52:58.038264+0000", 2024-03-04T06:41:54.140 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:54.140 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:54.140 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.141 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.142 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:54.143 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.144 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.144 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_per_pool": [ 2024-03-04T06:41:54.144 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.144 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": 24, 2024-03-04T06:41:54.144 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:54.144 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd" 2024-03-04T06:41:54.144 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.144 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.144 INFO:tasks.workunit.client.0.smithi137.stdout: "num_pg": 8, 2024-03-04T06:41:54.144 INFO:tasks.workunit.client.0.smithi137.stdout: "num_store_stats": 8, 2024-03-04T06:41:54.144 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.144 INFO:tasks.workunit.client.0.smithi137.stdout: "poolid": 4, 2024-03-04T06:41:54.144 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "store_stats": { 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": 0, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "available": 0, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed": 0, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_allocated": 0, 2024-03-04T06:41:54.147 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_original": 0, 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: "data_stored": 0, 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: "internal_metadata": 0, 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: "internally_reserved": 0, 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_allocated": 0, 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: "total": 0 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: "up": 24 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": 192, 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs" 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.148 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "num_pg": 64, 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "num_store_stats": 8, 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "poolid": 3, 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.149 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.150 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:54.151 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: "store_stats": { 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": 0, 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: "available": 0, 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed": 0, 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_allocated": 0, 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_original": 0, 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: "data_stored": 0, 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: "internal_metadata": 0, 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: "internally_reserved": 0, 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_allocated": 0, 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: "total": 0 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: "up": 192 2024-03-04T06:41:54.152 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": 3, 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr" 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 128, 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_pg": 1, 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_store_stats": 3, 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 128, 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: "poolid": 1, 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 590368, 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 1771104, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 6, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 2, 2024-03-04T06:41:54.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 2, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 6, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 212, 2024-03-04T06:41:54.155 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 306, 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 179, 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 2416 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "store_stats": { 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": 1781760, 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "available": 0, 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed": 0, 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_allocated": 0, 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_original": 0, 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "data_stored": 1771104, 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "internal_metadata": 0, 2024-03-04T06:41:54.156 INFO:tasks.workunit.client.0.smithi137.stdout: "internally_reserved": 0, 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_allocated": 0, 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: "total": 0 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: "up": 3 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": 96, 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs" 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 45, 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: "num_pg": 32, 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: "num_store_stats": 8, 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 45, 2024-03-04T06:41:54.157 INFO:tasks.workunit.client.0.smithi137.stdout: "poolid": 2, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 3428, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.158 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 66, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 22, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 22, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 14, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 1, 2024-03-04T06:41:54.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 51, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 20 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "store_stats": { 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": 98304, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "available": 0, 2024-03-04T06:41:54.160 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed": 0, 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_allocated": 0, 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_original": 0, 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: "data_stored": 10284, 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: "internal_metadata": 0, 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: "internally_reserved": 0, 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_allocated": 0, 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: "total": 0 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: "up": 96 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: "usage": { 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 105, 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: "pools": 4, 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_by_class": { 2024-03-04T06:41:54.161 INFO:tasks.workunit.client.0.smithi137.stdout: "ssd": { 2024-03-04T06:41:54.162 INFO:tasks.workunit.client.0.smithi137.stdout: "total_avail_bytes": 767731404800, 2024-03-04T06:41:54.162 INFO:tasks.workunit.client.0.smithi137.stdout: "total_bytes": 767960285184, 2024-03-04T06:41:54.162 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_bytes": 228880384, 2024-03-04T06:41:54.162 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_raw_bytes": 228880384, 2024-03-04T06:41:54.162 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_raw_ratio": 0.0002980367571581155 2024-03-04T06:41:54.162 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.162 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.162 INFO:tasks.workunit.client.0.smithi137.stdout: "total_avail_bytes": 767731404800, 2024-03-04T06:41:54.162 INFO:tasks.workunit.client.0.smithi137.stdout: "total_bytes": 767960285184, 2024-03-04T06:41:54.162 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_bytes": 228880384 2024-03-04T06:41:54.162 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.162 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-03-04T06:41:54.162 INFO:tasks.workunit.client.0.smithi137.stdout:Device report is generated separately. To see it run 'ceph telemetry show-device'. 2024-03-04T06:41:54.163 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph telemetry show-device 2024-03-04T06:41:54.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:54.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:54.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:54.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.165 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.166 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.167 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.168 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:53 smithi203 ceph-mon[30756]: pgmap v103: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T06:41:54.168 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-03-04T06:41:54.168 INFO:tasks.workunit.client.0.smithi137.stdout: "471b33ee-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:54.168 INFO:tasks.workunit.client.0.smithi137.stdout: "INTEL_SSDPEDMD400G4_471bfd2e-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:54.168 INFO:tasks.workunit.client.0.smithi137.stdout: "20240304-063556": { 2024-03-04T06:41:54.168 INFO:tasks.workunit.client.0.smithi137.stdout: "device": { 2024-03-04T06:41:54.168 INFO:tasks.workunit.client.0.smithi137.stdout: "info_name": "/dev/nvme0n1", 2024-03-04T06:41:54.168 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "/dev/nvme0n1", 2024-03-04T06:41:54.168 INFO:tasks.workunit.client.0.smithi137.stdout: "protocol": "NVMe", 2024-03-04T06:41:54.168 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "nvme" 2024-03-04T06:41:54.168 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.168 INFO:tasks.workunit.client.0.smithi137.stdout: "firmware_version": "8DV101H0", 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: "host_id": "471b33ee-d9f2-11ee-948b-0cc47a888137", 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: "json_format_version": [ 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: "local_time": { 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: "asctime": "Mon Mar 4 06:35:56 2024 UTC", 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: "time_t": 1709534156 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: "logical_block_size": 512, 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_controller_id": 0, 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_namespaces": [ 2024-03-04T06:41:54.169 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: "capacity": { 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: "formatted_lba_size": 512, 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 1, 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: "size": { 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: "utilization": { 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.170 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_number_of_namespaces": 1, 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_pci_vendor": { 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 32902, 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: "subsystem_id": 32902 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_add_log": { 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: "Device stats": { 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_fw_downgrades": { 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: "crc_error_count": { 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.171 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.172 INFO:tasks.workunit.client.0.smithi137.stdout: "end_to_end_error_detection_count": { 2024-03-04T06:41:54.172 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.172 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.172 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.172 INFO:tasks.workunit.client.0.smithi137.stdout: "erase_fail_count": { 2024-03-04T06:41:54.172 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.172 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.172 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.172 INFO:tasks.workunit.client.0.smithi137.stdout: "host_bytes_written": { 2024-03-04T06:41:54.172 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.172 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 25068809 2024-03-04T06:41:54.172 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.172 INFO:tasks.workunit.client.0.smithi137.stdout: "host_ctx_wear_used": { 2024-03-04T06:41:54.173 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.173 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 1 2024-03-04T06:41:54.173 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.173 INFO:tasks.workunit.client.0.smithi137.stdout: "media_bytes_read": { 2024-03-04T06:41:54.173 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.173 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.173 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.173 INFO:tasks.workunit.client.0.smithi137.stdout: "nand_bytes_written": { 2024-03-04T06:41:54.173 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.173 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 43199564 2024-03-04T06:41:54.173 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.173 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_stat_indicator": { 2024-03-04T06:41:54.174 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.174 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.174 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.174 INFO:tasks.workunit.client.0.smithi137.stdout: "pll_lock_loss_count": { 2024-03-04T06:41:54.174 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.174 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.174 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.174 INFO:tasks.workunit.client.0.smithi137.stdout: "program_fail_count": { 2024-03-04T06:41:54.174 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.174 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.174 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.174 INFO:tasks.workunit.client.0.smithi137.stdout: "re_alloc_sectr_cnt": { 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: "retry_buffer_overflow_count": { 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: "soft_ecc_err_rate": { 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: "thermal_throttle_status": { 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:54.175 INFO:tasks.workunit.client.0.smithi137.stdout: "cnt": 0, 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: "pct": 0 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_host_reads": { 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_media_wear": { 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 64 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_timer": { 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.176 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:54.177 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.177 INFO:tasks.workunit.client.0.smithi137.stdout: "unexp_power_loss": { 2024-03-04T06:41:54.177 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.177 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.177 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.177 INFO:tasks.workunit.client.0.smithi137.stdout: "wear_leveling": { 2024-03-04T06:41:54.177 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 91, 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: "avg": 2922, 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: "max": 2935, 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 2910 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel Smart log": "nvme0n1" 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_log": { 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare": 100, 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare_threshold": 10, 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: "controller_busy_time": 0, 2024-03-04T06:41:54.178 INFO:tasks.workunit.client.0.smithi137.stdout: "critical_warning": 0, 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_read": 312551289, 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_written": 1642909475, 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "host_reads": 5196511061, 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "host_writes": 29305537614, 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "media_errors": 0, 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "num_err_log_entries": 0, 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "percentage_used": 9, 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycles": 47342, 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_hours": 52496, 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": 24, 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "unsafe_shutdowns": 16 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_vendor": "intel", 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycle_count": 47342, 2024-03-04T06:41:54.179 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_time": { 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: "hours": 52496 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: "serial_number": "deleted", 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: "smart_status": { 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme": { 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: "passed": true 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl": { 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: "argv": [ 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl", 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: "-x", 2024-03-04T06:41:54.180 INFO:tasks.workunit.client.0.smithi137.stdout: "--json=o", 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "/dev/nvme0n1" 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "build_info": "(local build)", 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "exit_status": 0, 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "output": [ 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-427.el9.x86_64] (local build)", 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "Serial Number: deleted", 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Version: 8DV101H0", 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-04T06:41:54.181 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller ID: 0", 2024-03-04T06:41:54.182 INFO:tasks.workunit.client.0.smithi137.stdout: "Number of Namespaces: 1", 2024-03-04T06:41:54.182 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-04T06:41:54.182 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-04T06:41:54.182 INFO:tasks.workunit.client.0.smithi137.stdout: "Local Time is: Mon Mar 4 06:35:56 2024 UTC", 2024-03-04T06:41:54.182 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-04T06:41:54.182 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-04T06:41:54.182 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-04T06:41:54.182 INFO:tasks.workunit.client.0.smithi137.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-04T06:41:54.182 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.182 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported Power States", 2024-03-04T06:41:54.182 INFO:tasks.workunit.client.0.smithi137.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 512 0 2", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: " 1 - 512 8 2", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: " 2 - 512 16 2", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: " 3 - 4096 0 0", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: " 4 - 4096 8 0", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: " 5 - 4096 64 0", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: " 6 - 4096 128 0", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-04T06:41:54.183 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "Critical Warning: 0x00", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "Temperature: 24 Celsius", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare: 100%", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare Threshold: 10%", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "Percentage Used: 9%", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Read: 312,551,289 [160 TB]", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Written: 1,642,909,475 [841 TB]", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Read Commands: 5,196,511,061", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Write Commands: 29,305,537,614", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller Busy Time: 0", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "Power Cycles: 47,342", 2024-03-04T06:41:54.184 INFO:tasks.workunit.client.0.smithi137.stdout: "Power On Hours: 52,496", 2024-03-04T06:41:54.185 INFO:tasks.workunit.client.0.smithi137.stdout: "Unsafe Shutdowns: 16", 2024-03-04T06:41:54.185 INFO:tasks.workunit.client.0.smithi137.stdout: "Media and Data Integrity Errors: 0", 2024-03-04T06:41:54.185 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information Log Entries: 0", 2024-03-04T06:41:54.185 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.185 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-04T06:41:54.185 INFO:tasks.workunit.client.0.smithi137.stdout: "No Errors Logged", 2024-03-04T06:41:54.185 INFO:tasks.workunit.client.0.smithi137.stdout: "" 2024-03-04T06:41:54.185 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.185 INFO:tasks.workunit.client.0.smithi137.stdout: "platform_info": "x86_64-linux-5.14.0-427.el9.x86_64", 2024-03-04T06:41:54.185 INFO:tasks.workunit.client.0.smithi137.stdout: "svn_revision": "5022", 2024-03-04T06:41:54.185 INFO:tasks.workunit.client.0.smithi137.stdout: "version": [ 2024-03-04T06:41:54.185 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.185 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": { 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: "current": 24 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: "user_capacity": { 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: "471daafc-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:54.186 INFO:tasks.workunit.client.0.smithi137.stdout: "INTEL_SSDPEDMD400G4_471e7446-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: "20240304-063558": { 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: "device": { 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: "info_name": "/dev/nvme0n1", 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "/dev/nvme0n1", 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: "protocol": "NVMe", 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "nvme" 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: "firmware_version": "8DV101H0", 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: "host_id": "471daafc-d9f2-11ee-948b-0cc47a888137", 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: "json_format_version": [ 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.187 INFO:tasks.workunit.client.0.smithi137.stdout: "local_time": { 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: "asctime": "Mon Mar 4 06:35:58 2024 UTC", 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: "time_t": 1709534158 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: "logical_block_size": 512, 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_controller_id": 0, 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_namespaces": [ 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: "capacity": { 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.188 INFO:tasks.workunit.client.0.smithi137.stdout: "formatted_lba_size": 512, 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 1, 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: "size": { 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: "utilization": { 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_number_of_namespaces": 1, 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_pci_vendor": { 2024-03-04T06:41:54.189 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 32902, 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: "subsystem_id": 32902 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_add_log": { 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: "Device stats": { 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_fw_downgrades": { 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: "crc_error_count": { 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: "end_to_end_error_detection_count": { 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.190 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: "erase_fail_count": { 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: "host_bytes_written": { 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 23838260 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: "host_ctx_wear_used": { 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 1 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.191 INFO:tasks.workunit.client.0.smithi137.stdout: "media_bytes_read": { 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: "nand_bytes_written": { 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 40894317 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_stat_indicator": { 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: "pll_lock_loss_count": { 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.192 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: "program_fail_count": { 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: "re_alloc_sectr_cnt": { 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: "retry_buffer_overflow_count": { 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: "soft_ecc_err_rate": { 2024-03-04T06:41:54.193 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: "thermal_throttle_status": { 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: "cnt": 0, 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: "pct": 0 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_host_reads": { 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_media_wear": { 2024-03-04T06:41:54.194 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 64 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_timer": { 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: "unexp_power_loss": { 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: "wear_leveling": { 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 91, 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: "avg": 2774, 2024-03-04T06:41:54.195 INFO:tasks.workunit.client.0.smithi137.stdout: "max": 2782, 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 2767 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel Smart log": "nvme0n1" 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_log": { 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare": 100, 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare_threshold": 10, 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: "controller_busy_time": 102, 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: "critical_warning": 0, 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_read": 339428325, 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_written": 1562264215, 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: "host_reads": 5284568753, 2024-03-04T06:41:54.196 INFO:tasks.workunit.client.0.smithi137.stdout: "host_writes": 26762941906, 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: "media_errors": 0, 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: "num_err_log_entries": 0, 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: "percentage_used": 9, 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycles": 46320, 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_hours": 53497, 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": 25, 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: "unsafe_shutdowns": 9334 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_vendor": "intel", 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycle_count": 46320, 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_time": { 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: "hours": 53497 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.197 INFO:tasks.workunit.client.0.smithi137.stdout: "serial_number": "deleted", 2024-03-04T06:41:54.198 INFO:tasks.workunit.client.0.smithi137.stdout: "smart_status": { 2024-03-04T06:41:54.198 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme": { 2024-03-04T06:41:54.198 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.198 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.198 INFO:tasks.workunit.client.0.smithi137.stdout: "passed": true 2024-03-04T06:41:54.198 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.198 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl": { 2024-03-04T06:41:54.198 INFO:tasks.workunit.client.0.smithi137.stdout: "argv": [ 2024-03-04T06:41:54.198 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl", 2024-03-04T06:41:54.198 INFO:tasks.workunit.client.0.smithi137.stdout: "-x", 2024-03-04T06:41:54.198 INFO:tasks.workunit.client.0.smithi137.stdout: "--json=o", 2024-03-04T06:41:54.198 INFO:tasks.workunit.client.0.smithi137.stdout: "/dev/nvme0n1" 2024-03-04T06:41:54.199 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.199 INFO:tasks.workunit.client.0.smithi137.stdout: "build_info": "(local build)", 2024-03-04T06:41:54.199 INFO:tasks.workunit.client.0.smithi137.stdout: "exit_status": 0, 2024-03-04T06:41:54.199 INFO:tasks.workunit.client.0.smithi137.stdout: "output": [ 2024-03-04T06:41:54.199 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-427.el9.x86_64] (local build)", 2024-03-04T06:41:54.199 INFO:tasks.workunit.client.0.smithi137.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-04T06:41:54.199 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.199 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-04T06:41:54.199 INFO:tasks.workunit.client.0.smithi137.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-04T06:41:54.199 INFO:tasks.workunit.client.0.smithi137.stdout: "Serial Number: deleted", 2024-03-04T06:41:54.199 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Version: 8DV101H0", 2024-03-04T06:41:54.199 INFO:tasks.workunit.client.0.smithi137.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-04T06:41:54.199 INFO:tasks.workunit.client.0.smithi137.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-04T06:41:54.200 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller ID: 0", 2024-03-04T06:41:54.200 INFO:tasks.workunit.client.0.smithi137.stdout: "Number of Namespaces: 1", 2024-03-04T06:41:54.200 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-04T06:41:54.200 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-04T06:41:54.200 INFO:tasks.workunit.client.0.smithi137.stdout: "Local Time is: Mon Mar 4 06:35:58 2024 UTC", 2024-03-04T06:41:54.200 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-04T06:41:54.200 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-04T06:41:54.200 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-04T06:41:54.200 INFO:tasks.workunit.client.0.smithi137.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-04T06:41:54.200 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.200 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported Power States", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 512 0 2", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: " 1 - 512 8 2", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: " 2 - 512 16 2", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: " 3 - 4096 0 0", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: " 4 - 4096 8 0", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: " 5 - 4096 64 0", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: " 6 - 4096 128 0", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.201 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "Critical Warning: 0x00", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "Temperature: 25 Celsius", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare: 100%", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare Threshold: 10%", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "Percentage Used: 9%", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Read: 339,428,325 [173 TB]", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Written: 1,562,264,215 [799 TB]", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Read Commands: 5,284,568,753", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Write Commands: 26,762,941,906", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller Busy Time: 102", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "Power Cycles: 46,320", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "Power On Hours: 53,497", 2024-03-04T06:41:54.202 INFO:tasks.workunit.client.0.smithi137.stdout: "Unsafe Shutdowns: 9,334", 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: "Media and Data Integrity Errors: 0", 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information Log Entries: 0", 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: "No Errors Logged", 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: "" 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: "platform_info": "x86_64-linux-5.14.0-427.el9.x86_64", 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: "svn_revision": "5022", 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: "version": [ 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": { 2024-03-04T06:41:54.203 INFO:tasks.workunit.client.0.smithi137.stdout: "current": 25 2024-03-04T06:41:54.204 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.204 INFO:tasks.workunit.client.0.smithi137.stdout: "user_capacity": { 2024-03-04T06:41:54.204 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.204 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.204 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.204 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.204 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.204 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.204 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-03-04T06:41:54.205 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph telemetry show-all 2024-03-04T06:41:54.205 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:54.205 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:54.205 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:54.205 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.205 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.205 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.205 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.205 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.205 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.205 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.207 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.207 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:54.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:54.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:54.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.208 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.209 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.209 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:54.209 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:54.209 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:54.209 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.209 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.209 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.209 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.209 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.209 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.210 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.211 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.211 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.211 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.211 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.211 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.211 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.211 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[26846]: pgmap v103: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T06:41:54.211 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:54.211 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:54.211 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:54.211 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.213 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.213 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.213 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.213 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.213 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.213 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.213 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:54.213 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:54.213 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:54.213 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:54.213 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:54.213 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:53 smithi137 ceph-mon[37364]: pgmap v103: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T06:41:54.221 INFO:tasks.workunit.client.0.smithi137.stdout:{ 2024-03-04T06:41:54.221 INFO:tasks.workunit.client.0.smithi137.stdout: "device_report": { 2024-03-04T06:41:54.221 INFO:tasks.workunit.client.0.smithi137.stdout: "471b33ee-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:54.221 INFO:tasks.workunit.client.0.smithi137.stdout: "INTEL_SSDPEDMD400G4_471bfd2e-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:54.221 INFO:tasks.workunit.client.0.smithi137.stdout: "20240304-063556": { 2024-03-04T06:41:54.221 INFO:tasks.workunit.client.0.smithi137.stdout: "device": { 2024-03-04T06:41:54.221 INFO:tasks.workunit.client.0.smithi137.stdout: "info_name": "/dev/nvme0n1", 2024-03-04T06:41:54.221 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "/dev/nvme0n1", 2024-03-04T06:41:54.221 INFO:tasks.workunit.client.0.smithi137.stdout: "protocol": "NVMe", 2024-03-04T06:41:54.221 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "nvme" 2024-03-04T06:41:54.221 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.221 INFO:tasks.workunit.client.0.smithi137.stdout: "firmware_version": "8DV101H0", 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: "host_id": "471b33ee-d9f2-11ee-948b-0cc47a888137", 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: "json_format_version": [ 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: "local_time": { 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: "asctime": "Mon Mar 4 06:35:56 2024 UTC", 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: "time_t": 1709534156 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: "logical_block_size": 512, 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_controller_id": 0, 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_namespaces": [ 2024-03-04T06:41:54.222 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: "capacity": { 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: "formatted_lba_size": 512, 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 1, 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: "size": { 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: "utilization": { 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.223 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.224 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.224 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_number_of_namespaces": 1, 2024-03-04T06:41:54.224 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_pci_vendor": { 2024-03-04T06:41:54.224 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 32902, 2024-03-04T06:41:54.224 INFO:tasks.workunit.client.0.smithi137.stdout: "subsystem_id": 32902 2024-03-04T06:41:54.224 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.224 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_add_log": { 2024-03-04T06:41:54.224 INFO:tasks.workunit.client.0.smithi137.stdout: "Device stats": { 2024-03-04T06:41:54.224 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_fw_downgrades": { 2024-03-04T06:41:54.224 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: "crc_error_count": { 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: "end_to_end_error_detection_count": { 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: "erase_fail_count": { 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: "host_bytes_written": { 2024-03-04T06:41:54.225 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 25068809 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: "host_ctx_wear_used": { 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 1 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: "media_bytes_read": { 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: "nand_bytes_written": { 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 43199564 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_stat_indicator": { 2024-03-04T06:41:54.226 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: "pll_lock_loss_count": { 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: "program_fail_count": { 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: "re_alloc_sectr_cnt": { 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: "retry_buffer_overflow_count": { 2024-03-04T06:41:54.227 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: "soft_ecc_err_rate": { 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: "thermal_throttle_status": { 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: "cnt": 0, 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: "pct": 0 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_host_reads": { 2024-03-04T06:41:54.228 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_media_wear": { 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 64 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_timer": { 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: "unexp_power_loss": { 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.229 INFO:tasks.workunit.client.0.smithi137.stdout: "wear_leveling": { 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 91, 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: "avg": 2922, 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: "max": 2935, 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 2910 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel Smart log": "nvme0n1" 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_log": { 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare": 100, 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare_threshold": 10, 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: "controller_busy_time": 0, 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: "critical_warning": 0, 2024-03-04T06:41:54.230 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_read": 312551289, 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_written": 1642909475, 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "host_reads": 5196511061, 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "host_writes": 29305537614, 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "media_errors": 0, 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "num_err_log_entries": 0, 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "percentage_used": 9, 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycles": 47342, 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_hours": 52496, 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": 24, 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "unsafe_shutdowns": 16 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_vendor": "intel", 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycle_count": 47342, 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_time": { 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: "hours": 52496 2024-03-04T06:41:54.231 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: "serial_number": "deleted", 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: "smart_status": { 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme": { 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: "passed": true 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl": { 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: "argv": [ 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl", 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: "-x", 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: "--json=o", 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: "/dev/nvme0n1" 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: "build_info": "(local build)", 2024-03-04T06:41:54.232 INFO:tasks.workunit.client.0.smithi137.stdout: "exit_status": 0, 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "output": [ 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-427.el9.x86_64] (local build)", 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "Serial Number: deleted", 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Version: 8DV101H0", 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller ID: 0", 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "Number of Namespaces: 1", 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-04T06:41:54.233 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: "Local Time is: Mon Mar 4 06:35:56 2024 UTC", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported Power States", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 512 0 2", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: " 1 - 512 8 2", 2024-03-04T06:41:54.234 INFO:tasks.workunit.client.0.smithi137.stdout: " 2 - 512 16 2", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: " 3 - 4096 0 0", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: " 4 - 4096 8 0", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: " 5 - 4096 64 0", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: " 6 - 4096 128 0", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: "Critical Warning: 0x00", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: "Temperature: 24 Celsius", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare: 100%", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare Threshold: 10%", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: "Percentage Used: 9%", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Read: 312,551,289 [160 TB]", 2024-03-04T06:41:54.235 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Written: 1,642,909,475 [841 TB]", 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Read Commands: 5,196,511,061", 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Write Commands: 29,305,537,614", 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller Busy Time: 0", 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "Power Cycles: 47,342", 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "Power On Hours: 52,496", 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "Unsafe Shutdowns: 16", 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "Media and Data Integrity Errors: 0", 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information Log Entries: 0", 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "No Errors Logged", 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "" 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "platform_info": "x86_64-linux-5.14.0-427.el9.x86_64", 2024-03-04T06:41:54.236 INFO:tasks.workunit.client.0.smithi137.stdout: "svn_revision": "5022", 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: "version": [ 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": { 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: "current": 24 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: "user_capacity": { 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: "471daafc-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:54.237 INFO:tasks.workunit.client.0.smithi137.stdout: "INTEL_SSDPEDMD400G4_471e7446-d9f2-11ee-948b-0cc47a888137": { 2024-03-04T06:41:54.238 INFO:tasks.workunit.client.0.smithi137.stdout: "20240304-063558": { 2024-03-04T06:41:54.238 INFO:tasks.workunit.client.0.smithi137.stdout: "device": { 2024-03-04T06:41:54.238 INFO:tasks.workunit.client.0.smithi137.stdout: "info_name": "/dev/nvme0n1", 2024-03-04T06:41:54.238 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "/dev/nvme0n1", 2024-03-04T06:41:54.238 INFO:tasks.workunit.client.0.smithi137.stdout: "protocol": "NVMe", 2024-03-04T06:41:54.238 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "nvme" 2024-03-04T06:41:54.238 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.238 INFO:tasks.workunit.client.0.smithi137.stdout: "firmware_version": "8DV101H0", 2024-03-04T06:41:54.238 INFO:tasks.workunit.client.0.smithi137.stdout: "host_id": "471daafc-d9f2-11ee-948b-0cc47a888137", 2024-03-04T06:41:54.238 INFO:tasks.workunit.client.0.smithi137.stdout: "json_format_version": [ 2024-03-04T06:41:54.238 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:54.238 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: "local_time": { 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: "asctime": "Mon Mar 4 06:35:58 2024 UTC", 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: "time_t": 1709534158 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: "logical_block_size": 512, 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_controller_id": 0, 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_namespaces": [ 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: "capacity": { 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.239 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.240 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.240 INFO:tasks.workunit.client.0.smithi137.stdout: "formatted_lba_size": 512, 2024-03-04T06:41:54.240 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 1, 2024-03-04T06:41:54.240 INFO:tasks.workunit.client.0.smithi137.stdout: "size": { 2024-03-04T06:41:54.240 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.240 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.240 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.240 INFO:tasks.workunit.client.0.smithi137.stdout: "utilization": { 2024-03-04T06:41:54.240 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.240 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.240 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.240 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.240 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_number_of_namespaces": 1, 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_pci_vendor": { 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: "id": 32902, 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: "subsystem_id": 32902 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_add_log": { 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: "Device stats": { 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_fw_downgrades": { 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: "crc_error_count": { 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.241 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: "end_to_end_error_detection_count": { 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: "erase_fail_count": { 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: "host_bytes_written": { 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 23838260 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: "host_ctx_wear_used": { 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 1 2024-03-04T06:41:54.242 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: "media_bytes_read": { 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: "nand_bytes_written": { 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 40894317 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_stat_indicator": { 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: "pll_lock_loss_count": { 2024-03-04T06:41:54.243 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.244 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.244 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.244 INFO:tasks.workunit.client.0.smithi137.stdout: "program_fail_count": { 2024-03-04T06:41:54.244 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.244 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.244 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.244 INFO:tasks.workunit.client.0.smithi137.stdout: "re_alloc_sectr_cnt": { 2024-03-04T06:41:54.244 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.244 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.244 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.244 INFO:tasks.workunit.client.0.smithi137.stdout: "retry_buffer_overflow_count": { 2024-03-04T06:41:54.244 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.244 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: "soft_ecc_err_rate": { 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: "thermal_throttle_status": { 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: "cnt": 0, 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: "pct": 0 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_host_reads": { 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.245 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:54.246 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.246 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_media_wear": { 2024-03-04T06:41:54.246 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.246 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 64 2024-03-04T06:41:54.246 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.246 INFO:tasks.workunit.client.0.smithi137.stdout: "timed_workload_timer": { 2024-03-04T06:41:54.246 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 100, 2024-03-04T06:41:54.246 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 65535 2024-03-04T06:41:54.246 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.246 INFO:tasks.workunit.client.0.smithi137.stdout: "unexp_power_loss": { 2024-03-04T06:41:54.246 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 0, 2024-03-04T06:41:54.246 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": 0 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: "wear_leveling": { 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: "normalized": 91, 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: "raw": { 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: "avg": 2774, 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: "max": 2782, 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 2767 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel Smart log": "nvme0n1" 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_smart_health_information_log": { 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare": 100, 2024-03-04T06:41:54.247 INFO:tasks.workunit.client.0.smithi137.stdout: "available_spare_threshold": 10, 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: "controller_busy_time": 102, 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: "critical_warning": 0, 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_read": 339428325, 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: "data_units_written": 1562264215, 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: "host_reads": 5284568753, 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: "host_writes": 26762941906, 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: "media_errors": 0, 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: "num_err_log_entries": 0, 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: "percentage_used": 9, 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycles": 46320, 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_hours": 53497, 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": 25, 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: "unsafe_shutdowns": 9334 2024-03-04T06:41:54.248 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme_vendor": "intel", 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: "power_cycle_count": 46320, 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: "power_on_time": { 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: "hours": 53497 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: "serial_number": "deleted", 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: "smart_status": { 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: "nvme": { 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: "passed": true 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl": { 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: "argv": [ 2024-03-04T06:41:54.249 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl", 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "-x", 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "--json=o", 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "/dev/nvme0n1" 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "build_info": "(local build)", 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "exit_status": 0, 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "output": [ 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-427.el9.x86_64] (local build)", 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "Serial Number: deleted", 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Version: 8DV101H0", 2024-03-04T06:41:54.250 INFO:tasks.workunit.client.0.smithi137.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller ID: 0", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "Number of Namespaces: 1", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "Local Time is: Mon Mar 4 06:35:58 2024 UTC", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported Power States", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-04T06:41:54.251 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: " 0 + 512 0 2", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: " 1 - 512 8 2", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: " 2 - 512 16 2", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: " 3 - 4096 0 0", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: " 4 - 4096 8 0", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: " 5 - 4096 64 0", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: " 6 - 4096 128 0", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-04T06:41:54.252 INFO:tasks.workunit.client.0.smithi137.stdout: "Critical Warning: 0x00", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Temperature: 25 Celsius", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare: 100%", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Available Spare Threshold: 10%", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Percentage Used: 9%", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Read: 339,428,325 [173 TB]", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Data Units Written: 1,562,264,215 [799 TB]", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Read Commands: 5,284,568,753", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Host Write Commands: 26,762,941,906", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Controller Busy Time: 102", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Power Cycles: 46,320", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Power On Hours: 53,497", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Unsafe Shutdowns: 9,334", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Media and Data Integrity Errors: 0", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information Log Entries: 0", 2024-03-04T06:41:54.253 INFO:tasks.workunit.client.0.smithi137.stdout: "", 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: "No Errors Logged", 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: "" 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: "platform_info": "x86_64-linux-5.14.0-427.el9.x86_64", 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: "svn_revision": "5022", 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: "version": [ 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: "temperature": { 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: "current": 25 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.254 INFO:tasks.workunit.client.0.smithi137.stdout: "user_capacity": { 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: "blocks": 781422768, 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 400088457216 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: "report": { 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: "balancer": { 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: "active": true, 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: "mode": "" 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: "channels": [ 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: "basic", 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: "crash", 2024-03-04T06:41:54.255 INFO:tasks.workunit.client.0.smithi137.stdout: "device", 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: "ident", 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: "perf" 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: "channels_available": [ 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: "basic", 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: "ident", 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: "crash", 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: "device", 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: "perf" 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: "collections_available": [ 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_base", 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: "device_base", 2024-03-04T06:41:54.256 INFO:tasks.workunit.client.0.smithi137.stdout: "crash_base", 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "ident_base", 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_perf", 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_mds_metadata", 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_usage", 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_usage_by_class", 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_rook_v01", 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_memory_metrics", 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_options_bluestore" 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "collections_opted_in": [ 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_base", 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "device_base", 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "crash_base", 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "ident_base", 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_perf", 2024-03-04T06:41:54.257 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_mds_metadata", 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_usage", 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_usage_by_class", 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_rook_v01", 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_memory_metrics", 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: "basic_pool_options_bluestore" 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: "config": { 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: "active_changed": [ 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_debug", 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_mon_ticket_ttl", 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_service_ticket_ttl", 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: "bdev_debug_aio", 2024-03-04T06:41:54.258 INFO:tasks.workunit.client.0.smithi137.stdout: "client_check_pool_perm", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "client_mount_gid", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "client_mount_uid", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "client_quota", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "container_image", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "daemonize", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_asserts_on_shutdown", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mgr", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mon", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_ms", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_osd", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_paxos", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "keyring", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_block_size", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_cache_size", 2024-03-04T06:41:54.259 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_compression", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_log", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "leveldb_write_buffer_size", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_file", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_journald", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_stderr", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_allow_pool_delete", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_clock_drift_allowed", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_file_level", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_file", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_journald", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_stderr", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_data_avail_warn", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_election_default_strategy", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_host", 2024-03-04T06:41:54.260 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_max_pg_per_osd", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_mgr_mkfs_grace", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_prime_pg_temp", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_reporter_subtree_level", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_pg_warn_max_object_skew", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_too_few_osds", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_bug", 2024-03-04T06:41:54.261 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_old_message", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "no_config_file", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_default_list", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_load_list", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_crush_chooseleaf_type", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_misdirected_ops", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_op_order", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_pg_log_writeout", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_shutdown", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_cached_snaps", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_missing_on_start", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_stray_on_activate", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_profile", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-03-04T06:41:54.262 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_client_lim", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_client_res", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_scheduler_client_wgt", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target_autotune", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue_cut_off", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_erasure_code_profile", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recover_clone_overlap", 2024-03-04T06:41:54.263 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recovery_max_chunk", 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_load_threshold", 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_max_interval", 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_shutdown_pgref_assert", 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: "public_addr", 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: "public_addrv", 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: "public_network", 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd_default_features", 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd_qos_exclude_ops", 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: "setgroup", 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: "setuser" 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: "cluster_changed": [ 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-04T06:41:54.264 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_debug", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_mon_ticket_ttl", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "auth_service_ticket_ttl", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "bdev_debug_aio", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "container_image", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_asserts_on_shutdown", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mgr", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_mon", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_ms", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_osd", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "debug_paxos", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_file", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_journald", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "log_to_stderr", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_join_fs", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/allow_ptrace", 2024-03-04T06:41:54.265 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/container_init", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/migration_current", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/cephadm/use_repo_digest", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/dashboard/ssl_server_port", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/orchestrator/orchestrator", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/channel_ident", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/channel_perf", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/description", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/enabled", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr/telemetry/organization", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_allow_pool_delete", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_clock_drift_allowed", 2024-03-04T06:41:54.266 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_file_level", 2024-03-04T06:41:54.267 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_cluster_log_to_file", 2024-03-04T06:41:54.267 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_data_avail_warn", 2024-03-04T06:41:54.267 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_election_default_strategy", 2024-03-04T06:41:54.267 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_max_pg_per_osd", 2024-03-04T06:41:54.267 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_mgr_mkfs_grace", 2024-03-04T06:41:54.267 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_prime_pg_temp", 2024-03-04T06:41:54.267 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_osd_reporter_subtree_level", 2024-03-04T06:41:54.267 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_pg_warn_max_object_skew", 2024-03-04T06:41:54.267 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-04T06:41:54.267 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-04T06:41:54.267 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-04T06:41:54.267 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-04T06:41:54.268 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-04T06:41:54.268 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-04T06:41:54.268 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-04T06:41:54.268 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-04T06:41:54.268 INFO:tasks.workunit.client.0.smithi137.stdout: "mon_warn_on_too_few_osds", 2024-03-04T06:41:54.268 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_bug", 2024-03-04T06:41:54.268 INFO:tasks.workunit.client.0.smithi137.stdout: "ms_die_on_old_message", 2024-03-04T06:41:54.268 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_default_list", 2024-03-04T06:41:54.268 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_class_load_list", 2024-03-04T06:41:54.268 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_misdirected_ops", 2024-03-04T06:41:54.268 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_op_order", 2024-03-04T06:41:54.268 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_pg_log_writeout", 2024-03-04T06:41:54.268 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_shutdown", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_cached_snaps", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_missing_on_start", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_debug_verify_stray_on_activate", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mclock_profile", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_memory_target_autotune", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_op_queue_cut_off", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_erasure_code_profile", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recover_clone_overlap", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_recovery_max_chunk", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_load_threshold", 2024-03-04T06:41:54.269 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_scrub_max_interval", 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_shutdown_pgref_assert", 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: "public_network", 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: "rgw_cache_enabled", 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: "rgw_enable_ops_log", 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: "rgw_enable_usage_log" 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: "contact": null, 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: "crashes": [], 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: "created": "2024-03-04T06:32:42.596028Z", 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: "crush": { 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_algs": { 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: "straw2": 3 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_sizes": { 2024-03-04T06:41:54.270 INFO:tasks.workunit.client.0.smithi137.stdout: "2": 1, 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: "4": 2 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket_types": { 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: "1": 2, 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: "11": 1 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: "compat_weight_set": false, 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: "device_classes": [ 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: 8 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_buckets": 6, 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_devices": 8, 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_rules": 1, 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_types": 12, 2024-03-04T06:41:54.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_weight_sets": 0, 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "tunables": { 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "allowed_bucket_algs": 54, 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "choose_local_fallback_tries": 0, 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "choose_local_tries": 0, 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "choose_total_tries": 50, 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "chooseleaf_descend_once": 1, 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "chooseleaf_stable": 1, 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "chooseleaf_vary_r": 1, 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v2_rules": 0, 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v3_rules": 0, 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v4_buckets": 1, 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "has_v5_rules": 0, 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "legacy_tunables": 0, 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "minimum_required_version": "jewel", 2024-03-04T06:41:54.272 INFO:tasks.workunit.client.0.smithi137.stdout: "optimal_tunables": 1, 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: "profile": "jewel", 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables": 1, 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables2": 1, 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables3": 1, 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: "require_feature_tunables5": 1, 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: "straw_calc_version": 1 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: "description": "upgrade test cluster", 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: "fs": { 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: "feature_flags": { 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: "enable_multiple": true, 2024-03-04T06:41:54.273 INFO:tasks.workunit.client.0.smithi137.stdout: "ever_enabled_multiple": true 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: "filesystems": [ 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: "approx_ctime": "2024-03", 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: "balancer_enabled": false, 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_caps": 0, 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_dns": 10, 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_inos": 13, 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: "cached_subtrees": 2, 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: "ever_allowed_features": 0, 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: "explicitly_allowed_features": 0, 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: "files": 0, 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: "max_mds": 1, 2024-03-04T06:41:54.274 INFO:tasks.workunit.client.0.smithi137.stdout: "num_data_pools": 1, 2024-03-04T06:41:54.275 INFO:tasks.workunit.client.0.smithi137.stdout: "num_in": 1, 2024-03-04T06:41:54.275 INFO:tasks.workunit.client.0.smithi137.stdout: "num_mds": 1, 2024-03-04T06:41:54.275 INFO:tasks.workunit.client.0.smithi137.stdout: "num_sessions": 0, 2024-03-04T06:41:54.275 INFO:tasks.workunit.client.0.smithi137.stdout: "num_standby_replay": 0, 2024-03-04T06:41:54.275 INFO:tasks.workunit.client.0.smithi137.stdout: "num_up": 1, 2024-03-04T06:41:54.275 INFO:tasks.workunit.client.0.smithi137.stdout: "snaps": 0, 2024-03-04T06:41:54.275 INFO:tasks.workunit.client.0.smithi137.stdout: "standby_count_wanted": 0 2024-03-04T06:41:54.275 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.275 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.275 INFO:tasks.workunit.client.0.smithi137.stdout: "num_standby_mds": 1, 2024-03-04T06:41:54.275 INFO:tasks.workunit.client.0.smithi137.stdout: "total_num_mds": 2 2024-03-04T06:41:54.275 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.275 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_stats": { 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "mds": { 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "mds.8ac76538560e2a49997c4cba61f942431c1ec214": { 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 20537344, 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 424328, 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2752512, 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 98304, 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 778240, 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 406, 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 1372456, 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 20, 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 1010176, 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 14879568, 2024-03-04T06:41:54.276 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 21315584 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: "mds.e1b16a9a7a0ba72344e1af0e17524b2e886c9ba9": { 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 20267008, 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 370040, 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2752512, 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 1032192, 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 0, 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 322, 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 1014464, 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 12, 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 641024, 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 14456776, 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 20267008 2024-03-04T06:41:54.277 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.278 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.278 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:54.278 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.367540c6d8636e8ade040b6791ecc93ab23e3392": { 2024-03-04T06:41:54.278 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 35684352, 2024-03-04T06:41:54.278 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 773536, 2024-03-04T06:41:54.278 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 4849664, 2024-03-04T06:41:54.278 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 524288, 2024-03-04T06:41:54.278 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 8814592, 2024-03-04T06:41:54.278 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 953, 2024-03-04T06:41:54.278 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:54.278 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 7858784, 2024-03-04T06:41:54.278 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 21, 2024-03-04T06:41:54.278 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 1372672, 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 20305408, 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 44498944 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.8ac76538560e2a49997c4cba61f942431c1ec214": { 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 35184640, 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 962912, 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2752512, 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 0, 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 9314304, 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1228, 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 8909032, 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 22, 2024-03-04T06:41:54.279 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 1358592, 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 21201592, 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 44498944 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.e1b16a9a7a0ba72344e1af0e17524b2e886c9ba9": { 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 44687360, 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 1346752, 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2752512, 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 540672, 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 3907584, 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1854, 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 12391144, 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 22, 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 3064064, 2024-03-04T06:41:54.280 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 24592216, 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 48594944 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.0": { 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 47054848, 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 1011400, 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 8192, 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 311296, 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1389, 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 4992680, 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 46, 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 2549504, 2024-03-04T06:41:54.281 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 35609488, 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 47366144 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.1": { 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 45514752, 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 646064, 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 0, 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 671744, 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1338, 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 5925472, 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 47, 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 2045952, 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 34013680, 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 46186496 2024-03-04T06:41:54.282 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.2": { 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 43696128, 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 681552, 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 0, 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 393216, 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1234, 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 4769968, 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 47, 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 2208512, 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 33152512, 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 44089344 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.283 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.3": { 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 44056576, 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 787168, 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 0, 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 163840, 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1222, 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 4353536, 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 45, 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 1737472, 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 34294816, 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 44220416 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.4": { 2024-03-04T06:41:54.284 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 43892736, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 783104, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 0, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 196608, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1228, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 4488304, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 47, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 1966848, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 33770896, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 44089344 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.5": { 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 44982272, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 766992, 2024-03-04T06:41:54.285 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 16384, 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 286720, 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1229, 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 4392912, 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 48, 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 2103296, 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 34819104, 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 45268992 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.6": { 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 45457408, 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 912880, 2024-03-04T06:41:54.286 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 0, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 794624, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1260, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 5272920, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 46, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 1640448, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 34747576, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 46252032 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.7": { 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "actual_memory_used": 45096960, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "central_cache_freelist": 1240280, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "malloc_metadata": 2883584, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "page_heap_freelist": 0, 2024-03-04T06:41:54.287 INFO:tasks.workunit.client.0.smithi137.stdout: "released_to_os": 106496, 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: "spans_in_use": 1275, 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: "tcmalloc_page_size": 8192, 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_cache_freelists": 4647072, 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: "thread_heaps_in_use": 48, 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: "transfer_cache_freelist": 1839872, 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: "use_by_application": 34486152, 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: "virtual_address_space_used": 45203456 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: "hosts": { 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: "num": 2, 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_mds": 2, 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_mgr": 2, 2024-03-04T06:41:54.288 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_mon": 2, 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "num_with_osd": 2 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "io_rate": { 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_stats_delta": { 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": 0, 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "num_store_stats": 0, 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "stamp_delta": "12.002605", 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:54.289 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:54.290 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 146, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 248, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:54.291 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 32, 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "store_stats": { 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": 0, 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "available": 0, 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed": 0, 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_allocated": 0, 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_original": 0, 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "data_stored": 0, 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "internal_metadata": 0, 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "internally_reserved": 0, 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_allocated": 0, 2024-03-04T06:41:54.292 INFO:tasks.workunit.client.0.smithi137.stdout: "total": 0 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: "up": 0 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: "leaderboard": false, 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: "leaderboard_description": null, 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: "license": "sharing-1-0", 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: "mempool": { 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: "mds": { 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: "mds.8ac76538560e2a49997c4cba61f942431c1ec214": { 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.293 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.294 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.295 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:54.296 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.297 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.297 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.297 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:54.297 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.297 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.297 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.297 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:54.297 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.297 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.297 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.297 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:54.297 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 222439, 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 68 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.298 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:54.299 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.299 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.299 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.299 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:54.299 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 51416, 2024-03-04T06:41:54.299 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 208 2024-03-04T06:41:54.299 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.299 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.299 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.299 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.299 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.299 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:54.299 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.300 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.300 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.300 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:54.300 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.300 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.300 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.300 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:54.300 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 7912, 2024-03-04T06:41:54.300 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:54.300 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.300 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:54.300 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.301 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: "mds.e1b16a9a7a0ba72344e1af0e17524b2e886c9ba9": { 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.302 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:54.303 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.304 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.304 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.304 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:54.304 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.304 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.304 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.304 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:54.304 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.304 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.304 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.304 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:54.304 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.304 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:54.305 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.306 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 149137, 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 32 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 928, 2024-03-04T06:41:54.307 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 2 2024-03-04T06:41:54.308 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.308 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.308 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.308 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.308 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.308 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:54.308 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.308 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.308 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.308 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:54.308 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.308 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.308 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:54.309 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.367540c6d8636e8ade040b6791ecc93ab23e3392": { 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.310 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:54.311 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.312 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.313 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.314 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1140219, 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 352 2024-03-04T06:41:54.315 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.316 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6488, 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 122 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12744, 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 1546 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:54.317 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 5152, 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 83 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.8ac76538560e2a49997c4cba61f942431c1ec214": { 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.318 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:54.319 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.320 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.321 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.322 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1334419, 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 409 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.323 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.324 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6488, 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 122 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12744, 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 1546 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 5152, 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 83 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.325 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.e1b16a9a7a0ba72344e1af0e17524b2e886c9ba9": { 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:54.326 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:54.327 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:54.328 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.329 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.330 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1151931, 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 358 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 352, 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 4 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.331 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6488, 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 122 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12744, 2024-03-04T06:41:54.332 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 1546 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 10304, 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 166 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.333 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.0": { 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:54.334 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 5520, 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 69 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 20944, 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 187 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1600, 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 44 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:54.335 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 602112, 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 16 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 50926, 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 9466 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 136936, 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 233 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 11372, 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 742 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:54.336 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8976, 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 187 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 31702, 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 201 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 20944, 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 187 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:54.337 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 414076, 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 92 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2436246, 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 192 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:54.338 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6776, 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 77 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 521640, 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 45 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.339 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 94640, 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 186 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225128, 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3418 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.340 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.341 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:54.341 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.341 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.341 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.341 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:54.341 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.341 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.341 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.341 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.341 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.1": { 2024-03-04T06:41:54.341 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:54.341 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.341 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.342 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:54.343 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4960, 2024-03-04T06:41:54.343 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 62 2024-03-04T06:41:54.343 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.343 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:54.343 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19600, 2024-03-04T06:41:54.343 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 175 2024-03-04T06:41:54.343 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.343 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:54.343 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1152, 2024-03-04T06:41:54.343 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 40 2024-03-04T06:41:54.343 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.343 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:54.343 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12288, 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 44978, 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8516 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 127416, 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 219 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 9328, 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 567 2024-03-04T06:41:54.344 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.345 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:54.345 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8400, 2024-03-04T06:41:54.345 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 175 2024-03-04T06:41:54.345 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.345 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:54.345 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.345 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.345 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.345 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:54.345 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 27514, 2024-03-04T06:41:54.345 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 187 2024-03-04T06:41:54.345 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.346 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:54.346 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19600, 2024-03-04T06:41:54.346 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 175 2024-03-04T06:41:54.346 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.346 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:54.346 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 736, 2024-03-04T06:41:54.346 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 1 2024-03-04T06:41:54.346 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.346 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:54.346 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 422511, 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 94 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12112, 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2427107, 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 173 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4840, 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 55 2024-03-04T06:41:54.347 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 428904, 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 37 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:54.348 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 7280, 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 18 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225128, 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3418 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.349 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.2": { 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.350 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4480, 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 56 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.351 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:54.352 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19376, 2024-03-04T06:41:54.352 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 173 2024-03-04T06:41:54.352 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.352 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:54.352 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1040, 2024-03-04T06:41:54.352 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 39 2024-03-04T06:41:54.352 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.352 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:54.352 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8192, 2024-03-04T06:41:54.352 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 2 2024-03-04T06:41:54.352 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.352 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 43808, 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8284 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 123336, 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 213 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8280, 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 515 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8304, 2024-03-04T06:41:54.353 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 173 2024-03-04T06:41:54.354 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.354 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:54.354 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.354 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.354 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.354 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:54.354 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 26314, 2024-03-04T06:41:54.354 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 181 2024-03-04T06:41:54.354 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.354 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:54.354 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19376, 2024-03-04T06:41:54.354 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 173 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 736, 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 1 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 369263, 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 81 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12112, 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2446288, 2024-03-04T06:41:54.355 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 187 2024-03-04T06:41:54.356 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.356 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:54.356 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4400, 2024-03-04T06:41:54.356 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 50 2024-03-04T06:41:54.356 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.356 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:54.356 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.356 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.356 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.356 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.356 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 359352, 2024-03-04T06:41:54.356 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 31 2024-03-04T06:41:54.356 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 9360, 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 26 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225640, 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3442 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.357 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.358 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.3": { 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.359 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 3520, 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 44 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19936, 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 178 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 480, 2024-03-04T06:41:54.360 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 34 2024-03-04T06:41:54.361 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.361 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:54.361 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.361 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.361 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.361 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:54.361 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 44416, 2024-03-04T06:41:54.361 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8505 2024-03-04T06:41:54.361 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.361 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:54.361 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 127416, 2024-03-04T06:41:54.361 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 219 2024-03-04T06:41:54.362 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.362 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:54.362 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 9420, 2024-03-04T06:41:54.362 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 575 2024-03-04T06:41:54.362 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.362 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:54.362 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8544, 2024-03-04T06:41:54.362 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 178 2024-03-04T06:41:54.362 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.362 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:54.362 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.362 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.362 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.363 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:54.363 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 27010, 2024-03-04T06:41:54.363 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 187 2024-03-04T06:41:54.363 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.363 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:54.363 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19936, 2024-03-04T06:41:54.363 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 178 2024-03-04T06:41:54.363 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.363 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:54.363 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2208, 2024-03-04T06:41:54.363 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.363 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.364 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:54.364 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 236330, 2024-03-04T06:41:54.364 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 49 2024-03-04T06:41:54.364 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.364 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:54.364 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 26565, 2024-03-04T06:41:54.364 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 9 2024-03-04T06:41:54.364 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.364 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:54.364 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2468427, 2024-03-04T06:41:54.364 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 193 2024-03-04T06:41:54.364 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.365 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:54.365 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4752, 2024-03-04T06:41:54.365 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 54 2024-03-04T06:41:54.365 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.365 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:54.365 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.365 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.365 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.365 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.365 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 428904, 2024-03-04T06:41:54.365 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 37 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 10400, 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 20 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225128, 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3418 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.366 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.367 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.4": { 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:54.368 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 3440, 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 43 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19824, 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 177 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.369 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 816, 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 37 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 44902, 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8589 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 128776, 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 221 2024-03-04T06:41:54.370 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.371 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:54.371 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 9592, 2024-03-04T06:41:54.371 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 573 2024-03-04T06:41:54.371 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.371 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:54.371 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8496, 2024-03-04T06:41:54.371 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 177 2024-03-04T06:41:54.371 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.371 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:54.371 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.371 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.371 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.371 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 27690, 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 189 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19824, 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 177 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 736, 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 1 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 916463, 2024-03-04T06:41:54.372 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 72 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 12112, 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2419714, 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 175 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4752, 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 54 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.373 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 452088, 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 39 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 7904, 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 16 2024-03-04T06:41:54.374 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225384, 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3430 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.375 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.5": { 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:54.376 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2800, 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 35 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:54.377 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19712, 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 176 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 480, 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 34 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 45199, 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8612 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:54.378 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 129456, 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 222 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 9828, 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 575 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8448, 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 176 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.379 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 28114, 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 190 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 19712, 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 176 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2208, 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:54.380 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 834656, 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 52 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 26565, 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 9 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2431304, 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 177 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 5368, 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 61 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.381 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 475272, 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 41 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 11960, 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 23 2024-03-04T06:41:54.382 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225640, 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3442 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.383 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.6": { 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:54.384 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2400, 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 30 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 20832, 2024-03-04T06:41:54.385 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 186 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 256, 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 32 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 45988, 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8964 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:54.386 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 129456, 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 222 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 10872, 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 734 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8928, 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 186 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.387 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 28974, 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 190 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 20832, 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 186 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 808996, 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 46 2024-03-04T06:41:54.388 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2428684, 2024-03-04T06:41:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 175 2024-03-04T06:41:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 4664, 2024-03-04T06:41:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 53 2024-03-04T06:41:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.389 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 452088, 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 39 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 94952, 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 193 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.390 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225896, 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3454 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.391 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.7": { 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: "bloom_filter": { 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 6368, 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 123 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.392 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_reader": { 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 16896, 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs_file_writer": { 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 576, 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_alloc": { 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1760, 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 22 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_blob": { 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 20608, 2024-03-04T06:41:54.393 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 184 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_buffer": { 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 1152, 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 40 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_data": { 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 274432, 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 8 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_meta": { 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 47797, 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 9191 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_onode": { 2024-03-04T06:41:54.394 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 133536, 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 228 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_cache_other": { 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 11616, 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 737 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_extent": { 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 8832, 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 184 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_fsck": { 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.395 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.396 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_inline_bl": { 2024-03-04T06:41:54.396 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 30846, 2024-03-04T06:41:54.396 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 196 2024-03-04T06:41:54.396 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.396 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_shared_blob": { 2024-03-04T06:41:54.396 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 20608, 2024-03-04T06:41:54.396 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 184 2024-03-04T06:41:54.396 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.396 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_txc": { 2024-03-04T06:41:54.396 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.396 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.396 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.396 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing": { 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 149871, 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 29 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore_writing_deferred": { 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_anon": { 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 2396716, 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 191 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: "buffer_meta": { 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 5896, 2024-03-04T06:41:54.397 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 67 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_co": { 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 533232, 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 46 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_mapbl": { 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_pglog": { 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 96720, 2024-03-04T06:41:54.398 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 222 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap": { 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 225128, 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 3418 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap_mapping": { 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: "pgmap": { 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_1": { 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.399 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: "unittest_2": { 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes": 0, 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: "items": 0 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: "metadata": { 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: "mds": { 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: "arch": { 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: "x86_64": 2 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_version": { 2024-03-04T06:41:54.400 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: "cpu": { 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 2 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: "distro": { 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: "centos": 2 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: "distro_description": { 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: "CentOS Stream 8": 2 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_description": { 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: "#1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024": 2 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_version": { 2024-03-04T06:41:54.401 INFO:tasks.workunit.client.0.smithi137.stdout: "5.14.0-427.el9.x86_64": 2 2024-03-04T06:41:54.402 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.402 INFO:tasks.workunit.client.0.smithi137.stdout: "os": { 2024-03-04T06:41:54.402 INFO:tasks.workunit.client.0.smithi137.stdout: "Linux": 2 2024-03-04T06:41:54.402 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.402 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.402 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:54.402 INFO:tasks.workunit.client.0.smithi137.stdout: "arch": { 2024-03-04T06:41:54.402 INFO:tasks.workunit.client.0.smithi137.stdout: "x86_64": 3 2024-03-04T06:41:54.402 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.402 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_version": { 2024-03-04T06:41:54.402 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 3 2024-03-04T06:41:54.402 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.402 INFO:tasks.workunit.client.0.smithi137.stdout: "cpu": { 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 3 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: "distro": { 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: "centos": 3 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: "distro_description": { 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: "CentOS Stream 8": 3 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_description": { 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: "#1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024": 3 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_version": { 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: "5.14.0-427.el9.x86_64": 3 2024-03-04T06:41:54.403 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.404 INFO:tasks.workunit.client.0.smithi137.stdout: "os": { 2024-03-04T06:41:54.404 INFO:tasks.workunit.client.0.smithi137.stdout: "Linux": 3 2024-03-04T06:41:54.404 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.404 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.404 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.404 INFO:tasks.workunit.client.0.smithi137.stdout: "arch": { 2024-03-04T06:41:54.404 INFO:tasks.workunit.client.0.smithi137.stdout: "x86_64": 8 2024-03-04T06:41:54.404 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.404 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_version": { 2024-03-04T06:41:54.404 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 8 2024-03-04T06:41:54.404 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.404 INFO:tasks.workunit.client.0.smithi137.stdout: "cpu": { 2024-03-04T06:41:54.404 INFO:tasks.workunit.client.0.smithi137.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 8 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: "distro": { 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: "centos": 8 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: "distro_description": { 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: "CentOS Stream 8": 8 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_description": { 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: "#1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024": 8 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: "kernel_version": { 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: "5.14.0-427.el9.x86_64": 8 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: "os": { 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: "Linux": 8 2024-03-04T06:41:54.405 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_objectstore": { 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": 8 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: "rotational": { 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: "0": 8 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: "features": { 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: "optional": [], 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: "persistent": [ 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: "kraken", 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: "luminous", 2024-03-04T06:41:54.406 INFO:tasks.workunit.client.0.smithi137.stdout: "mimic", 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: "osdmap-prune", 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: "nautilus", 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: "octopus", 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: "pacific", 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: "elector-pinging", 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: "quincy", 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: "reef" 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: "ipv4_addr_mons": 6, 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: "ipv6_addr_mons": 0, 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: "min_mon_release": 18, 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: "v1_addr_mons": 3, 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: "v2_addr_mons": 3 2024-03-04T06:41:54.407 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.408 INFO:tasks.workunit.client.0.smithi137.stdout: "organization": "ceph-qa", 2024-03-04T06:41:54.408 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.408 INFO:tasks.workunit.client.0.smithi137.stdout: "cluster_network": false, 2024-03-04T06:41:54.408 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 8, 2024-03-04T06:41:54.408 INFO:tasks.workunit.client.0.smithi137.stdout: "require_min_compat_client": "luminous", 2024-03-04T06:41:54.408 INFO:tasks.workunit.client.0.smithi137.stdout: "require_osd_release": "reef" 2024-03-04T06:41:54.408 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.408 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_perf_histograms": [ 2024-03-04T06:41:54.408 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.408 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:54.408 INFO:tasks.workunit.client.0.smithi137.stdout: "axes": [ 2024-03-04T06:41:54.408 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.408 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Latency (usec)", 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 100000, 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 99999]", 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "[100000, 199999]", 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "[200000, 399999]", 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "[400000, 799999]", 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "[800000, 1599999]", 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "[1600000, 3199999]", 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "[3200000, 6399999]", 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "[6400000, 12799999]", 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "[12800000, 25599999]", 2024-03-04T06:41:54.409 INFO:tasks.workunit.client.0.smithi137.stdout: "[25600000, 51199999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[51200000, 102399999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[102400000, 204799999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[204800000, 409599999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[409600000, 819199999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[819200000, 1638399999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[1638400000, 3276799999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[3276800000, 6553599999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[6553600000, 13107199999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[13107200000, 26214399999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[26214400000, 52428799999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[52428800000, 104857599999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[104857600000, 209715199999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[209715200000, 419430399999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[419430400000, 838860799999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[838860800000, 1677721599999]", 2024-03-04T06:41:54.410 INFO:tasks.workunit.client.0.smithi137.stdout: "[1677721600000, 3355443199999]", 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: "[3355443200000, 6710886399999]", 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: "[6710886400000, 13421772799999]", 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: "[13421772800000, 26843545599999]", 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: "[26843545600000, 53687091199999]", 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: "[53687091200000, None]" 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Request size (bytes)", 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 512, 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:54.411 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:54.412 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 511]", 2024-03-04T06:41:54.412 INFO:tasks.workunit.client.0.smithi137.stdout: "[512, 1023]", 2024-03-04T06:41:54.412 INFO:tasks.workunit.client.0.smithi137.stdout: "[1024, 2047]", 2024-03-04T06:41:54.412 INFO:tasks.workunit.client.0.smithi137.stdout: "[2048, 4095]", 2024-03-04T06:41:54.412 INFO:tasks.workunit.client.0.smithi137.stdout: "[4096, 8191]", 2024-03-04T06:41:54.412 INFO:tasks.workunit.client.0.smithi137.stdout: "[8192, 16383]", 2024-03-04T06:41:54.412 INFO:tasks.workunit.client.0.smithi137.stdout: "[16384, 32767]", 2024-03-04T06:41:54.412 INFO:tasks.workunit.client.0.smithi137.stdout: "[32768, 65535]", 2024-03-04T06:41:54.412 INFO:tasks.workunit.client.0.smithi137.stdout: "[65536, 131071]", 2024-03-04T06:41:54.412 INFO:tasks.workunit.client.0.smithi137.stdout: "[131072, 262143]", 2024-03-04T06:41:54.412 INFO:tasks.workunit.client.0.smithi137.stdout: "[262144, 524287]", 2024-03-04T06:41:54.412 INFO:tasks.workunit.client.0.smithi137.stdout: "[524288, 1048575]", 2024-03-04T06:41:54.412 INFO:tasks.workunit.client.0.smithi137.stdout: "[1048576, 2097151]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[2097152, 4194303]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[4194304, 8388607]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[8388608, 16777215]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[16777216, 33554431]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[33554432, 67108863]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[67108864, 134217727]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[134217728, 268435455]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[268435456, 536870911]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[536870912, 1073741823]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[1073741824, 2147483647]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[2147483648, 4294967295]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[4294967296, 8589934591]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[8589934592, 17179869183]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[17179869184, 34359738367]", 2024-03-04T06:41:54.413 INFO:tasks.workunit.client.0.smithi137.stdout: "[34359738368, 68719476735]", 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: "[68719476736, 137438953471]", 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: "[137438953472, 274877906943]", 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: "[274877906944, None]" 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: "osds": [ 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 0, 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.414 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.415 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.416 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 1, 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.417 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.418 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 2, 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.419 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.420 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.421 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 3, 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.422 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.423 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.423 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.423 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.423 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.423 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.423 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.423 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.423 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.423 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.423 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.423 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 4, 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.424 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.425 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.426 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 5, 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.427 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.428 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.428 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.428 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.428 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.428 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.428 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.428 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.428 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.428 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.428 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.428 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.428 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.428 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.429 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 6, 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.430 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.431 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 7, 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 95, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.432 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.433 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.434 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: "axes": [ 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Latency (usec)", 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 100000, 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 99999]", 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: "[100000, 199999]", 2024-03-04T06:41:54.435 INFO:tasks.workunit.client.0.smithi137.stdout: "[200000, 399999]", 2024-03-04T06:41:54.436 INFO:tasks.workunit.client.0.smithi137.stdout: "[400000, 799999]", 2024-03-04T06:41:54.436 INFO:tasks.workunit.client.0.smithi137.stdout: "[800000, 1599999]", 2024-03-04T06:41:54.436 INFO:tasks.workunit.client.0.smithi137.stdout: "[1600000, 3199999]", 2024-03-04T06:41:54.436 INFO:tasks.workunit.client.0.smithi137.stdout: "[3200000, 6399999]", 2024-03-04T06:41:54.436 INFO:tasks.workunit.client.0.smithi137.stdout: "[6400000, 12799999]", 2024-03-04T06:41:54.436 INFO:tasks.workunit.client.0.smithi137.stdout: "[12800000, 25599999]", 2024-03-04T06:41:54.436 INFO:tasks.workunit.client.0.smithi137.stdout: "[25600000, 51199999]", 2024-03-04T06:41:54.436 INFO:tasks.workunit.client.0.smithi137.stdout: "[51200000, 102399999]", 2024-03-04T06:41:54.436 INFO:tasks.workunit.client.0.smithi137.stdout: "[102400000, 204799999]", 2024-03-04T06:41:54.436 INFO:tasks.workunit.client.0.smithi137.stdout: "[204800000, 409599999]", 2024-03-04T06:41:54.436 INFO:tasks.workunit.client.0.smithi137.stdout: "[409600000, 819199999]", 2024-03-04T06:41:54.436 INFO:tasks.workunit.client.0.smithi137.stdout: "[819200000, 1638399999]", 2024-03-04T06:41:54.436 INFO:tasks.workunit.client.0.smithi137.stdout: "[1638400000, 3276799999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[3276800000, 6553599999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[6553600000, 13107199999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[13107200000, 26214399999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[26214400000, 52428799999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[52428800000, 104857599999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[104857600000, 209715199999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[209715200000, 419430399999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[419430400000, 838860799999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[838860800000, 1677721599999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[1677721600000, 3355443199999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[3355443200000, 6710886399999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[6710886400000, 13421772799999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[13421772800000, 26843545599999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[26843545600000, 53687091199999]", 2024-03-04T06:41:54.437 INFO:tasks.workunit.client.0.smithi137.stdout: "[53687091200000, None]" 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Request size (bytes)", 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 512, 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 511]", 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: "[512, 1023]", 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: "[1024, 2047]", 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: "[2048, 4095]", 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: "[4096, 8191]", 2024-03-04T06:41:54.438 INFO:tasks.workunit.client.0.smithi137.stdout: "[8192, 16383]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[16384, 32767]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[32768, 65535]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[65536, 131071]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[131072, 262143]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[262144, 524287]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[524288, 1048575]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[1048576, 2097151]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[2097152, 4194303]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[4194304, 8388607]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[8388608, 16777215]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[16777216, 33554431]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[33554432, 67108863]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[67108864, 134217727]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[134217728, 268435455]", 2024-03-04T06:41:54.439 INFO:tasks.workunit.client.0.smithi137.stdout: "[268435456, 536870911]", 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: "[536870912, 1073741823]", 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: "[1073741824, 2147483647]", 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: "[2147483648, 4294967295]", 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: "[4294967296, 8589934591]", 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: "[8589934592, 17179869183]", 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: "[17179869184, 34359738367]", 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: "[34359738368, 68719476735]", 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: "[68719476736, 137438953471]", 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: "[137438953472, 274877906943]", 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: "[274877906944, None]" 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.440 INFO:tasks.workunit.client.0.smithi137.stdout: "osds": [ 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 0, 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.441 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.442 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.442 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.442 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.442 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.442 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.442 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.442 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.442 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.442 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.442 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.442 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.442 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 1, 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.443 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.444 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.444 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.444 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.444 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.444 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.444 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.444 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.444 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.444 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.444 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.444 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.444 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.444 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.445 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 2, 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.446 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.447 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.448 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.448 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.448 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.448 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.448 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.448 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.448 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.448 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.448 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.448 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.448 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.448 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.448 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 3, 2024-03-04T06:41:54.449 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.449 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.449 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.449 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.449 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.449 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.449 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.449 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.449 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.449 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.449 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.449 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.450 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 4, 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.451 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.452 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.453 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.454 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.454 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.454 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.454 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 5, 2024-03-04T06:41:54.454 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.454 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.454 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.454 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.454 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.454 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.454 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.454 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.454 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.455 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 6, 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.456 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.457 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.457 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.457 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.457 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.457 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.457 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.457 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.457 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.457 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.457 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.457 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.458 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 7, 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.459 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.460 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.460 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.460 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 34, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.460 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.460 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.460 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.460 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.460 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.460 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.460 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.460 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.460 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.460 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.461 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: "axes": [ 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Latency (usec)", 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 100000, 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:54.462 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 99999]", 2024-03-04T06:41:54.463 INFO:tasks.workunit.client.0.smithi137.stdout: "[100000, 199999]", 2024-03-04T06:41:54.463 INFO:tasks.workunit.client.0.smithi137.stdout: "[200000, 399999]", 2024-03-04T06:41:54.463 INFO:tasks.workunit.client.0.smithi137.stdout: "[400000, 799999]", 2024-03-04T06:41:54.463 INFO:tasks.workunit.client.0.smithi137.stdout: "[800000, 1599999]", 2024-03-04T06:41:54.463 INFO:tasks.workunit.client.0.smithi137.stdout: "[1600000, 3199999]", 2024-03-04T06:41:54.463 INFO:tasks.workunit.client.0.smithi137.stdout: "[3200000, 6399999]", 2024-03-04T06:41:54.463 INFO:tasks.workunit.client.0.smithi137.stdout: "[6400000, 12799999]", 2024-03-04T06:41:54.463 INFO:tasks.workunit.client.0.smithi137.stdout: "[12800000, 25599999]", 2024-03-04T06:41:54.463 INFO:tasks.workunit.client.0.smithi137.stdout: "[25600000, 51199999]", 2024-03-04T06:41:54.463 INFO:tasks.workunit.client.0.smithi137.stdout: "[51200000, 102399999]", 2024-03-04T06:41:54.463 INFO:tasks.workunit.client.0.smithi137.stdout: "[102400000, 204799999]", 2024-03-04T06:41:54.463 INFO:tasks.workunit.client.0.smithi137.stdout: "[204800000, 409599999]", 2024-03-04T06:41:54.463 INFO:tasks.workunit.client.0.smithi137.stdout: "[409600000, 819199999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[819200000, 1638399999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[1638400000, 3276799999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[3276800000, 6553599999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[6553600000, 13107199999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[13107200000, 26214399999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[26214400000, 52428799999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[52428800000, 104857599999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[104857600000, 209715199999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[209715200000, 419430399999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[419430400000, 838860799999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[838860800000, 1677721599999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[1677721600000, 3355443199999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[3355443200000, 6710886399999]", 2024-03-04T06:41:54.464 INFO:tasks.workunit.client.0.smithi137.stdout: "[6710886400000, 13421772799999]", 2024-03-04T06:41:54.465 INFO:tasks.workunit.client.0.smithi137.stdout: "[13421772800000, 26843545599999]", 2024-03-04T06:41:54.465 INFO:tasks.workunit.client.0.smithi137.stdout: "[26843545600000, 53687091199999]", 2024-03-04T06:41:54.465 INFO:tasks.workunit.client.0.smithi137.stdout: "[53687091200000, None]" 2024-03-04T06:41:54.465 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.465 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:54.465 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.465 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.465 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:54.465 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:54.465 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Request size (bytes)", 2024-03-04T06:41:54.465 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 512, 2024-03-04T06:41:54.465 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:54.465 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 511]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[512, 1023]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[1024, 2047]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[2048, 4095]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[4096, 8191]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[8192, 16383]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[16384, 32767]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[32768, 65535]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[65536, 131071]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[131072, 262143]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[262144, 524287]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[524288, 1048575]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[1048576, 2097151]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[2097152, 4194303]", 2024-03-04T06:41:54.466 INFO:tasks.workunit.client.0.smithi137.stdout: "[4194304, 8388607]", 2024-03-04T06:41:54.467 INFO:tasks.workunit.client.0.smithi137.stdout: "[8388608, 16777215]", 2024-03-04T06:41:54.467 INFO:tasks.workunit.client.0.smithi137.stdout: "[16777216, 33554431]", 2024-03-04T06:41:54.467 INFO:tasks.workunit.client.0.smithi137.stdout: "[33554432, 67108863]", 2024-03-04T06:41:54.467 INFO:tasks.workunit.client.0.smithi137.stdout: "[67108864, 134217727]", 2024-03-04T06:41:54.467 INFO:tasks.workunit.client.0.smithi137.stdout: "[134217728, 268435455]", 2024-03-04T06:41:54.467 INFO:tasks.workunit.client.0.smithi137.stdout: "[268435456, 536870911]", 2024-03-04T06:41:54.467 INFO:tasks.workunit.client.0.smithi137.stdout: "[536870912, 1073741823]", 2024-03-04T06:41:54.467 INFO:tasks.workunit.client.0.smithi137.stdout: "[1073741824, 2147483647]", 2024-03-04T06:41:54.467 INFO:tasks.workunit.client.0.smithi137.stdout: "[2147483648, 4294967295]", 2024-03-04T06:41:54.467 INFO:tasks.workunit.client.0.smithi137.stdout: "[4294967296, 8589934591]", 2024-03-04T06:41:54.467 INFO:tasks.workunit.client.0.smithi137.stdout: "[8589934592, 17179869183]", 2024-03-04T06:41:54.467 INFO:tasks.workunit.client.0.smithi137.stdout: "[17179869184, 34359738367]", 2024-03-04T06:41:54.467 INFO:tasks.workunit.client.0.smithi137.stdout: "[34359738368, 68719476735]", 2024-03-04T06:41:54.468 INFO:tasks.workunit.client.0.smithi137.stdout: "[68719476736, 137438953471]", 2024-03-04T06:41:54.468 INFO:tasks.workunit.client.0.smithi137.stdout: "[137438953472, 274877906943]", 2024-03-04T06:41:54.468 INFO:tasks.workunit.client.0.smithi137.stdout: "[274877906944, None]" 2024-03-04T06:41:54.468 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.468 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:54.468 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.468 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.468 INFO:tasks.workunit.client.0.smithi137.stdout: "osds": [ 2024-03-04T06:41:54.468 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.468 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 0, 2024-03-04T06:41:54.468 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.468 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.468 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.469 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.469 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.469 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.469 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.469 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.469 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.469 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.469 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.469 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.469 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.469 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.469 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.470 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 1, 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.471 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.472 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.472 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.472 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.472 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.472 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.472 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.472 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.472 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.472 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.472 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.472 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.472 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.472 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.473 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.474 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.474 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.474 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.474 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 2, 2024-03-04T06:41:54.474 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.474 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.474 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.474 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.474 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.474 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.474 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.474 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.474 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.475 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.475 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.475 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.475 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.475 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.475 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.475 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.475 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.475 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.475 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.475 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.475 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.476 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.476 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.476 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.476 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.476 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.476 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.476 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.476 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.476 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.476 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.476 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.476 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.476 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 3, 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.477 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.478 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.479 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.479 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.479 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.479 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.479 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.479 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.479 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.479 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.479 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.479 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.479 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.479 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 4, 2024-03-04T06:41:54.479 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.480 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.481 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.481 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.481 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.481 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.481 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.481 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.481 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.481 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.481 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.481 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.481 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.481 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.481 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.482 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.482 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.482 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.482 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.482 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.482 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.482 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.482 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.482 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 5, 2024-03-04T06:41:54.482 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.482 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.482 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.482 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.483 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.484 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 6, 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.485 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.486 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.487 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.487 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.487 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.487 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.487 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.487 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.487 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.487 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.487 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.487 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.487 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.487 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 7, 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 34, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.488 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.489 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.489 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.489 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.489 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.489 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.489 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.489 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.489 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.489 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.489 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.489 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.489 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.489 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: "axes": [ 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.490 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Latency (usec)", 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 100000, 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 99999]", 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "[100000, 199999]", 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "[200000, 399999]", 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "[400000, 799999]", 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "[800000, 1599999]", 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "[1600000, 3199999]", 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "[3200000, 6399999]", 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "[6400000, 12799999]", 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "[12800000, 25599999]", 2024-03-04T06:41:54.491 INFO:tasks.workunit.client.0.smithi137.stdout: "[25600000, 51199999]", 2024-03-04T06:41:54.492 INFO:tasks.workunit.client.0.smithi137.stdout: "[51200000, 102399999]", 2024-03-04T06:41:54.492 INFO:tasks.workunit.client.0.smithi137.stdout: "[102400000, 204799999]", 2024-03-04T06:41:54.492 INFO:tasks.workunit.client.0.smithi137.stdout: "[204800000, 409599999]", 2024-03-04T06:41:54.492 INFO:tasks.workunit.client.0.smithi137.stdout: "[409600000, 819199999]", 2024-03-04T06:41:54.492 INFO:tasks.workunit.client.0.smithi137.stdout: "[819200000, 1638399999]", 2024-03-04T06:41:54.492 INFO:tasks.workunit.client.0.smithi137.stdout: "[1638400000, 3276799999]", 2024-03-04T06:41:54.492 INFO:tasks.workunit.client.0.smithi137.stdout: "[3276800000, 6553599999]", 2024-03-04T06:41:54.492 INFO:tasks.workunit.client.0.smithi137.stdout: "[6553600000, 13107199999]", 2024-03-04T06:41:54.492 INFO:tasks.workunit.client.0.smithi137.stdout: "[13107200000, 26214399999]", 2024-03-04T06:41:54.492 INFO:tasks.workunit.client.0.smithi137.stdout: "[26214400000, 52428799999]", 2024-03-04T06:41:54.492 INFO:tasks.workunit.client.0.smithi137.stdout: "[52428800000, 104857599999]", 2024-03-04T06:41:54.492 INFO:tasks.workunit.client.0.smithi137.stdout: "[104857600000, 209715199999]", 2024-03-04T06:41:54.492 INFO:tasks.workunit.client.0.smithi137.stdout: "[209715200000, 419430399999]", 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: "[419430400000, 838860799999]", 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: "[838860800000, 1677721599999]", 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: "[1677721600000, 3355443199999]", 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: "[3355443200000, 6710886399999]", 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: "[6710886400000, 13421772799999]", 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: "[13421772800000, 26843545599999]", 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: "[26843545600000, 53687091199999]", 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: "[53687091200000, None]" 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: "buckets": 32, 2024-03-04T06:41:54.493 INFO:tasks.workunit.client.0.smithi137.stdout: "min": 0, 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "name": "Request size (bytes)", 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "quant_size": 512, 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "ranges": [ 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "[None, -1]", 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 511]", 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "[512, 1023]", 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "[1024, 2047]", 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "[2048, 4095]", 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "[4096, 8191]", 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "[8192, 16383]", 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "[16384, 32767]", 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "[32768, 65535]", 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "[65536, 131071]", 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "[131072, 262143]", 2024-03-04T06:41:54.494 INFO:tasks.workunit.client.0.smithi137.stdout: "[262144, 524287]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[524288, 1048575]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[1048576, 2097151]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[2097152, 4194303]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[4194304, 8388607]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[8388608, 16777215]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[16777216, 33554431]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[33554432, 67108863]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[67108864, 134217727]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[134217728, 268435455]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[268435456, 536870911]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[536870912, 1073741823]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[1073741824, 2147483647]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[2147483648, 4294967295]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[4294967296, 8589934591]", 2024-03-04T06:41:54.495 INFO:tasks.workunit.client.0.smithi137.stdout: "[8589934592, 17179869183]", 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: "[17179869184, 34359738367]", 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: "[34359738368, 68719476735]", 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: "[68719476736, 137438953471]", 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: "[137438953472, 274877906943]", 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: "[274877906944, None]" 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: "scale_type": "log2" 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: "osds": [ 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 0, 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.496 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.497 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.498 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.499 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.499 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.499 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.499 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.499 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 1, 2024-03-04T06:41:54.499 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.499 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.499 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.499 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.499 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.499 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.499 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 8, 3, 0, 0, 0, 0, 0, 0, 11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.499 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 13, 5, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 15, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 13, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.500 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.501 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 2, 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.502 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.503 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.503 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.503 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.503 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.503 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.503 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.503 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.503 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.503 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.503 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.503 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.504 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.504 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.504 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.504 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.504 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.504 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.504 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.504 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.504 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.504 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.504 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.504 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.504 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 3, 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.505 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.506 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 4, 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.507 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.508 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.508 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.508 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.508 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.508 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.508 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.508 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.508 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.508 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.508 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.508 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.509 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 5, 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.510 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.511 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.512 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.512 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.512 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.512 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.512 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.512 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.512 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.512 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.512 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.512 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.512 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.512 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.512 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.513 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.513 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.513 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 6, 2024-03-04T06:41:54.513 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.513 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.513 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.513 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.513 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.513 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.513 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.513 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.513 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.513 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.514 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 5, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.514 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.514 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.514 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.514 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.514 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.514 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.514 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.514 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.514 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.514 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.514 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.514 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: "osd_id": 7, 2024-03-04T06:41:54.515 INFO:tasks.workunit.client.0.smithi137.stdout: "values": [ 2024-03-04T06:41:54.516 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.516 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.516 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.516 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.516 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.516 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.516 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.516 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.516 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.516 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.516 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.516 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.517 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: ] 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: "perf_counters": { 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: "mds.8ac76538560e2a49997c4cba61f942431c1ec214": { 2024-03-04T06:41:54.518 INFO:tasks.workunit.client.0.smithi137.stdout: "mds": { 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: "caps": { 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_cap_op_flush_ack": { 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_cap_op_flushsnap_ack": { 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_cap_op_grant": { 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_cap_op_revoke": { 2024-03-04T06:41:54.519 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: "ceph_cap_op_trunc": { 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: "dir_commit": { 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: "dir_fetch_complete": { 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: "dir_fetch_keys": { 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.520 INFO:tasks.workunit.client.0.smithi137.stdout: "dir_merge": { 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: "dir_split": { 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: "exported_inodes": { 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: "forward": { 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_client_cap_release": { 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_client_caps": { 2024-03-04T06:41:54.521 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_client_caps_dirty": { 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_inode_file_caps": { 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: "imported_inodes": { 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: "inodes": { 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: "inodes_expired": { 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.522 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: "inodes_pinned": { 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: "inodes_with_caps": { 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: "load_cent": { 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: "openino_dir_fetch": { 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: "process_request_cap_release": { 2024-03-04T06:41:54.523 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: "reply_latency": { 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 78814 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: "request": { 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: "root_rbytes": { 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: "root_rfiles": { 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.524 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: "root_rsnaps": { 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_reply": { 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: "subtrees": { 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_cache": { 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: "ireq_enqueue_scrub": { 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.525 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: "ireq_exportdir": { 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: "ireq_flush": { 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: "ireq_fragmentdir": { 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: "ireq_fragstats": { 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: "ireq_inodestats": { 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.526 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_recovering_enqueued": { 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_recovering_prioritized": { 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_recovering_processing": { 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_strays": { 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_strays_delayed": { 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_strays_enqueuing": { 2024-03-04T06:41:54.528 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.528 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.528 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_completed": { 2024-03-04T06:41:54.528 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.528 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.528 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_started": { 2024-03-04T06:41:54.528 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.528 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.528 INFO:tasks.workunit.client.0.smithi137.stdout: "strays_created": { 2024-03-04T06:41:54.528 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.528 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.528 INFO:tasks.workunit.client.0.smithi137.stdout: "strays_enqueued": { 2024-03-04T06:41:54.528 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: "strays_migrated": { 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: "strays_reintegrated": { 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_log": { 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: "ev": { 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: "evadd": { 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.529 INFO:tasks.workunit.client.0.smithi137.stdout: "evex": { 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: "evexd": { 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: "evexg": { 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: "evtrm": { 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: "jlat": { 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 17108867 2024-03-04T06:41:54.530 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: "replayed": { 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: "seg": { 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: "segadd": { 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: "segex": { 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: "segexd": { 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.531 INFO:tasks.workunit.client.0.smithi137.stdout: "segexg": { 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: "segtrm": { 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_mem": { 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: "cap": { 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: "cap+": { 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: "cap-": { 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.532 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: "dir": { 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: "dir+": { 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: "dir-": { 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: "dn": { 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: "dn+": { 2024-03-04T06:41:54.533 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: "dn-": { 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: "heap": { 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 207156 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: "ino": { 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: "ino+": { 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.534 INFO:tasks.workunit.client.0.smithi137.stdout: "ino-": { 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: "rss": { 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40964 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_server": { 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: "cap_acquisition_throttle": { 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: "cap_revoke_eviction": { 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.535 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_client_request": { 2024-03-04T06:41:54.536 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.536 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.536 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_client_session": { 2024-03-04T06:41:54.536 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 16 2024-03-04T06:41:54.536 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.536 INFO:tasks.workunit.client.0.smithi137.stdout: "handle_peer_request": { 2024-03-04T06:41:54.536 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.536 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.536 INFO:tasks.workunit.client.0.smithi137.stdout: "req_create_latency": { 2024-03-04T06:41:54.536 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.536 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.536 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.536 INFO:tasks.workunit.client.0.smithi137.stdout: "req_getattr_latency": { 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 78814 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: "req_getfilelock_latency": { 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: "req_getvxattr_latency": { 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: "req_link_latency": { 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.537 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lookup_latency": { 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lookuphash_latency": { 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lookupino_latency": { 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lookupname_latency": { 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.538 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lookupparent_latency": { 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lookupsnap_latency": { 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: "req_lssnap_latency": { 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.539 INFO:tasks.workunit.client.0.smithi137.stdout: "req_mkdir_latency": { 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: "req_mknod_latency": { 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: "req_mksnap_latency": { 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: "req_open_latency": { 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.540 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: "req_readdir_latency": { 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: "req_rename_latency": { 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: "req_renamesnap_latency": { 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: "req_rmdir_latency": { 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.541 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.542 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.542 INFO:tasks.workunit.client.0.smithi137.stdout: "req_rmsnap_latency": { 2024-03-04T06:41:54.542 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.542 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.542 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.542 INFO:tasks.workunit.client.0.smithi137.stdout: "req_rmxattr_latency": { 2024-03-04T06:41:54.542 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.542 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.542 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.542 INFO:tasks.workunit.client.0.smithi137.stdout: "req_setattr_latency": { 2024-03-04T06:41:54.542 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.542 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.542 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.543 INFO:tasks.workunit.client.0.smithi137.stdout: "req_setdirlayout_latency": { 2024-03-04T06:41:54.543 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.543 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.543 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.543 INFO:tasks.workunit.client.0.smithi137.stdout: "req_setfilelock_latency": { 2024-03-04T06:41:54.543 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.543 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.543 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.543 INFO:tasks.workunit.client.0.smithi137.stdout: "req_setlayout_latency": { 2024-03-04T06:41:54.543 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.543 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: "req_setxattr_latency": { 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: "req_snapdiff_latency": { 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: "req_symlink_latency": { 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: "req_unlink_latency": { 2024-03-04T06:41:54.544 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: "mds_sessions": { 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: "average_load": { 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: "avg_session_uptime": { 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 88 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: "mdthresh_evicted": { 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: "session_add": { 2024-03-04T06:41:54.545 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: "session_count": { 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: "session_remove": { 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: "sessions_open": { 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: "sessions_stale": { 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: "total_load": { 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.546 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 45 2024-03-04T06:41:54.547 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: "purge_queue": { 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: "pq_executed": { 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: "pq_executing": { 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: "pq_executing_high_water": { 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: "pq_executing_ops": { 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.548 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: "pq_executing_ops_high_water": { 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: "pq_item_in_journal": { 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.367540c6d8636e8ade040b6791ecc93ab23e3392": { 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: "election_call": { 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.549 INFO:tasks.workunit.client.0.smithi137.stdout: "election_lose": { 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: "election_win": { 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_elections": { 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: "num_sessions": { 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: "session_add": { 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: "session_rm": { 2024-03-04T06:41:54.550 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 103 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: "session_trim": { 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: "paxos": { 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: "accept_timeout": { 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: "begin": { 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 914 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_bytes": { 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 914, 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4062914 2024-03-04T06:41:54.551 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_keys": { 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_latency": { 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 914, 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 249995699 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: "collect": { 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_bytes": { 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.552 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_keys": { 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_latency": { 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_timeout": { 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_uncommitted": { 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.553 INFO:tasks.workunit.client.0.smithi137.stdout: "commit": { 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 915 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_bytes": { 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_keys": { 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_latency": { 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.554 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: "lease_ack_timeout": { 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: "lease_timeout": { 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: "new_pn": { 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: "new_pn_latency": { 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: "refresh": { 2024-03-04T06:41:54.555 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 915 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: "refresh_latency": { 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 915, 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2186962317 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: "restart": { 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state": { 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state_bytes": { 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.556 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state_keys": { 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: "start_leader": { 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: "start_peon": { 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state": { 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 915 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_bytes": { 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 915, 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 7954169 2024-03-04T06:41:54.557 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_keys": { 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 915, 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6452 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_latency": { 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 915, 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 510991201 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache": { 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1020054731 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:54.558 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 39649280 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 29310976 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2147483648 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10338304 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:full": { 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 348127232 2024-03-04T06:41:54.559 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 277021476 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 271033 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.560 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.561 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 70834723 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:inc": { 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 348127232 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.562 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 277021476 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41393 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.563 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.564 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71064363 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:kv": { 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 322961408 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.565 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 184680984 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.566 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.567 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71171560 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb": { 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: "compact": { 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_queue_len": { 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_queue_merge": { 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_range": { 2024-03-04T06:41:54.568 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.569 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.569 INFO:tasks.workunit.client.0.smithi137.stdout: "get_latency": { 2024-03-04T06:41:54.569 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 38827, 2024-03-04T06:41:54.569 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 101566145 2024-03-04T06:41:54.569 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.569 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_delay_time": { 2024-03-04T06:41:54.569 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.569 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.569 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.569 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_memtable_time": { 2024-03-04T06:41:54.569 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_pre_and_post_time": { 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_wal_time": { 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: "submit_latency": { 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.570 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: "submit_sync_latency": { 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1951, 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 819878703 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.8ac76538560e2a49997c4cba61f942431c1ec214": { 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: "election_call": { 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: "election_lose": { 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: "election_win": { 2024-03-04T06:41:54.571 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.572 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_elections": { 2024-03-04T06:41:54.572 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 7 2024-03-04T06:41:54.572 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.572 INFO:tasks.workunit.client.0.smithi137.stdout: "num_sessions": { 2024-03-04T06:41:54.572 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 11 2024-03-04T06:41:54.572 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.572 INFO:tasks.workunit.client.0.smithi137.stdout: "session_add": { 2024-03-04T06:41:54.572 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:54.572 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.572 INFO:tasks.workunit.client.0.smithi137.stdout: "session_rm": { 2024-03-04T06:41:54.572 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 54 2024-03-04T06:41:54.572 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: "session_trim": { 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: "paxos": { 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: "accept_timeout": { 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: "begin": { 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 924 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_bytes": { 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 924, 2024-03-04T06:41:54.573 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4088527 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_keys": { 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_latency": { 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 924, 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 142996603 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: "collect": { 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_bytes": { 2024-03-04T06:41:54.574 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 146 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_keys": { 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_latency": { 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_timeout": { 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_uncommitted": { 2024-03-04T06:41:54.575 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: "commit": { 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 925 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_bytes": { 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_keys": { 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_latency": { 2024-03-04T06:41:54.576 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: "lease_ack_timeout": { 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: "lease_timeout": { 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: "new_pn": { 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: "new_pn_latency": { 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.577 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: "refresh": { 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 925 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: "refresh_latency": { 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 925, 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2143948928 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: "restart": { 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state": { 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state_bytes": { 2024-03-04T06:41:54.578 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state_keys": { 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: "start_leader": { 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: "start_peon": { 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state": { 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 925 2024-03-04T06:41:54.579 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_bytes": { 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 925, 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8003297 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_keys": { 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 925, 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6529 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_latency": { 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 925, 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 326992223 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache": { 2024-03-04T06:41:54.580 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1020054731 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41746432 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31662080 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2147483648 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10084352 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.581 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:full": { 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 348127232 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 277021476 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 271033 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.582 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.583 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 70834723 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:inc": { 2024-03-04T06:41:54.584 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 348127232 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 277021476 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41393 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.585 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.586 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71064363 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:kv": { 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 322961408 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.587 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 184680984 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.588 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.589 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71171560 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb": { 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: "compact": { 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.590 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_queue_len": { 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_queue_merge": { 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_range": { 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: "get_latency": { 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 39617, 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 103740933 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_delay_time": { 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.591 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.592 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.592 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_memtable_time": { 2024-03-04T06:41:54.592 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.592 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.592 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.592 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_pre_and_post_time": { 2024-03-04T06:41:54.592 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.592 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.592 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.592 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_wal_time": { 2024-03-04T06:41:54.592 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.592 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.592 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: "submit_latency": { 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: "submit_sync_latency": { 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1998, 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 588717517 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: "mon.e1b16a9a7a0ba72344e1af0e17524b2e886c9ba9": { 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: "election_call": { 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.593 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: "election_lose": { 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: "election_win": { 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_elections": { 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 9 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_sessions": { 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: "session_add": { 2024-03-04T06:41:54.594 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: "session_rm": { 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 204 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: "session_trim": { 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: "paxos": { 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: "accept_timeout": { 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: "begin": { 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1066 2024-03-04T06:41:54.595 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_bytes": { 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1066, 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5140230 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_keys": { 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1066, 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3198 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: "begin_latency": { 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1066, 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 201996520 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: "collect": { 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.596 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_bytes": { 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_keys": { 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_latency": { 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_timeout": { 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: "collect_uncommitted": { 2024-03-04T06:41:54.597 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: "commit": { 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1066 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_bytes": { 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1066, 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5063426 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_keys": { 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1066, 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6388 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: "commit_latency": { 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1066, 2024-03-04T06:41:54.598 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 456075775 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: "lease_ack_timeout": { 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: "lease_timeout": { 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: "new_pn": { 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: "new_pn_latency": { 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.599 INFO:tasks.workunit.client.0.smithi137.stdout: "refresh": { 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1068 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: "refresh_latency": { 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1068, 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2847950964 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: "restart": { 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state": { 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state_bytes": { 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.600 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1050 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: "share_state_keys": { 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: "start_leader": { 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: "start_peon": { 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state": { 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_bytes": { 2024-03-04T06:41:54.601 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_keys": { 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: "store_state_latency": { 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache": { 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1020054731 2024-03-04T06:41:54.602 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 45842432 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40501248 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2147483648 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5341184 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.603 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:full": { 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 348127232 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 277022552 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 270603 2024-03-04T06:41:54.604 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.605 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 70834077 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:inc": { 2024-03-04T06:41:54.606 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.607 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 348127232 2024-03-04T06:41:54.607 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.607 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.607 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.607 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.607 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.607 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.607 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.607 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.607 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 277022552 2024-03-04T06:41:54.607 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.607 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.608 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 38954 2024-03-04T06:41:54.608 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.608 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.608 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.608 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.608 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.608 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.608 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.608 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.608 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.608 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.608 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.608 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.609 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.609 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.609 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.609 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.609 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.609 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.609 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.609 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.609 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.609 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.609 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.609 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.609 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71065726 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: "prioritycache:kv": { 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 322961408 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.610 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 184681701 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.611 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71170843 2024-03-04T06:41:54.612 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb": { 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: "compact": { 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_queue_len": { 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_queue_merge": { 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_range": { 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.613 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: "get_latency": { 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 47322, 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 188534781 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_delay_time": { 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_memtable_time": { 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_pre_and_post_time": { 2024-03-04T06:41:54.614 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_write_wal_time": { 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: "submit_latency": { 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: "submit_sync_latency": { 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2301, 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 710884669 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.615 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.616 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.616 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.0": { 2024-03-04T06:41:54.616 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.616 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:54.616 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.616 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.616 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:54.616 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.616 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.616 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:54.616 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.617 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:54.618 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2670592 2024-03-04T06:41:54.618 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.618 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:54.618 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.618 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.618 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.618 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:54.618 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.618 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.618 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.618 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:54.618 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.618 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.619 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:54.619 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:54.619 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.619 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:54.619 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1667072 2024-03-04T06:41:54.619 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.619 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:54.619 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1527808 2024-03-04T06:41:54.619 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.619 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:54.619 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:54.619 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.619 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:54.620 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.620 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.620 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:54.620 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.620 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.620 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:54.620 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:54.620 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.620 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:54.620 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:54.620 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.620 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:54.620 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:54.621 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.621 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:54.621 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:54.621 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.621 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:54.621 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:54.621 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.621 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:54.621 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.621 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.621 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:54.621 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:54.622 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.623 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.623 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:54.623 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.623 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.623 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:54.623 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.623 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.623 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:54.623 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.623 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.623 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:54.623 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.623 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.624 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:54.624 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.624 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.624 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:54.624 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.624 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.624 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:54.624 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.624 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.624 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:54.624 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.624 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.624 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4276224 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:54.625 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1318912 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 4, 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 167504 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.626 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 22, 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 56539 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:54.627 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.628 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.628 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.628 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:54.628 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 360, 2024-03-04T06:41:54.628 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 102497606 2024-03-04T06:41:54.628 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.628 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:54.628 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 358, 2024-03-04T06:41:54.628 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6054518 2024-03-04T06:41:54.628 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.628 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:54.628 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 360, 2024-03-04T06:41:54.628 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 336558 2024-03-04T06:41:54.629 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.629 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:54.629 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 360, 2024-03-04T06:41:54.629 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 102834164 2024-03-04T06:41:54.629 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.629 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:54.629 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.629 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.629 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.629 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:54.629 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.629 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 34199 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 6, 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 16603 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.630 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5538 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 828 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 228 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 120, 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2682202 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:54.631 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 324, 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 332042 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 204, 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4998443 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 45730 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.632 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10357469 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 124, 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 7651111 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 124, 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 483960736868 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 124, 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 131635758496 2024-03-04T06:41:54.633 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 33531358631 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 43141 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 482007 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:54.634 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 182166106 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 162121 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 154424421 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 26306992 2024-03-04T06:41:54.635 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.636 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:54.636 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 900664 2024-03-04T06:41:54.636 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.636 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:54.636 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 58, 2024-03-04T06:41:54.636 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 260018 2024-03-04T06:41:54.636 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.636 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:54.636 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:54.636 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 373804965 2024-03-04T06:41:54.636 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.636 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:54.637 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:54.637 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 30086173 2024-03-04T06:41:54.637 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.637 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:54.637 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 481, 2024-03-04T06:41:54.637 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2970864 2024-03-04T06:41:54.637 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.637 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.637 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:54.637 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:54.637 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861619251 2024-03-04T06:41:54.637 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.637 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:54.638 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 44482560 2024-03-04T06:41:54.638 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.638 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:54.638 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 44064768 2024-03-04T06:41:54.638 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.638 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:54.638 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137559552 2024-03-04T06:41:54.638 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.638 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:54.638 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 417792 2024-03-04T06:41:54.638 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.638 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.638 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85471362 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.639 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.640 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.641 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 602112 2024-03-04T06:41:54.641 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.641 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.641 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.641 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.641 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.641 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.641 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.641 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.641 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.641 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.641 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.641 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73310078 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641035221 2024-03-04T06:41:54.642 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.643 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.644 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71994331 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.645 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 56980908 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.646 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.647 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.648 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.648 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68847748 2024-03-04T06:41:54.648 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.648 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.648 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:54.648 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.648 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:54.648 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.648 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.648 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.648 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.648 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.648 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641035221 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.649 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 242742 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.650 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71753717 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.651 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 47 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.652 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 616 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:54.653 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40151922 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 6, 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2293349 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 39701634 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.654 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.655 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.656 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.657 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 616 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40151922 2024-03-04T06:41:54.658 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 6, 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2293349 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 39701634 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.659 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1771104 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28983296 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.660 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.1": { 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.661 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2433024 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:54.662 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:54.663 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1548288 2024-03-04T06:41:54.664 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.664 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:54.664 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1409024 2024-03-04T06:41:54.664 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.664 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:54.664 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:54.664 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.664 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:54.664 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.664 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.664 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:54.664 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.664 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:54.665 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:54.666 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.667 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:54.668 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3919872 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.669 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 716800 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 217957 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.670 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 31, 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 82783 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.671 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 331, 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 82352080 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 326, 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8531559 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 331, 2024-03-04T06:41:54.672 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 353365 2024-03-04T06:41:54.673 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.673 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:54.673 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 331, 2024-03-04T06:41:54.673 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 82705445 2024-03-04T06:41:54.673 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.673 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:54.673 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.673 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.673 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.673 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:54.673 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:54.673 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 38549 2024-03-04T06:41:54.673 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6728 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:54.674 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 9479 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 815 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 233 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 133, 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5297884 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 349, 2024-03-04T06:41:54.675 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 259616 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 216, 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6537921 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 122884 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:54.676 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 9871763 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 123, 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 7175414 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 122, 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 315131137550 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 123, 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 130694996745 2024-03-04T06:41:54.677 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 403, 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 76334327528 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 403, 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 36575 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 441769 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:54.678 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 135711644 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 132098 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 69174999 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 21208876 2024-03-04T06:41:54.679 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 309728 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 57, 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 291252 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 236464339 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:54.680 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 25006769 2024-03-04T06:41:54.681 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.681 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:54.681 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 404, 2024-03-04T06:41:54.681 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2411496 2024-03-04T06:41:54.681 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.681 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.681 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:54.681 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:54.681 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861619251 2024-03-04T06:41:54.681 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.681 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:54.681 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 43302912 2024-03-04T06:41:54.681 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42549248 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137559552 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 753664 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.682 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.683 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.683 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.683 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.683 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.683 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.683 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.683 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85508326 2024-03-04T06:41:54.683 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.683 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.683 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.683 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.683 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.683 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.684 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73862938 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.685 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641312445 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.686 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.687 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71717107 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:54.688 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 57005550 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.689 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.690 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68823106 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:54.691 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641312445 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.692 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.693 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.693 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.693 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.693 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.693 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.693 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.693 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.693 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.693 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.693 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.693 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.693 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.693 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 217935 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71501300 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.694 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.695 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:54.696 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 36 2024-03-04T06:41:54.696 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.696 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:54.696 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.696 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.696 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:54.696 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 155 2024-03-04T06:41:54.696 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.696 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:54.696 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.696 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.696 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:54.696 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.697 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.697 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:54.697 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2429440 2024-03-04T06:41:54.697 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.697 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:54.697 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 155, 2024-03-04T06:41:54.697 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 356612381 2024-03-04T06:41:54.697 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.697 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:54.697 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1063 2024-03-04T06:41:54.697 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.697 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:54.697 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 155, 2024-03-04T06:41:54.698 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 55889113 2024-03-04T06:41:54.698 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.698 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:54.698 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 155, 2024-03-04T06:41:54.698 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 212135495 2024-03-04T06:41:54.698 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.698 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.698 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 33 2024-03-04T06:41:54.698 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.698 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:54.698 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 33, 2024-03-04T06:41:54.698 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5880899 2024-03-04T06:41:54.698 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.699 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:54.699 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.699 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.699 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:54.699 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1063 2024-03-04T06:41:54.699 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.699 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:54.699 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 33, 2024-03-04T06:41:54.699 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5353383 2024-03-04T06:41:54.699 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.699 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:54.699 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 33, 2024-03-04T06:41:54.699 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4614796 2024-03-04T06:41:54.700 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.700 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:54.700 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 22 2024-03-04T06:41:54.700 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.700 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:54.700 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.700 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.700 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:54.700 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 22, 2024-03-04T06:41:54.700 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 18806609 2024-03-04T06:41:54.700 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.700 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:54.701 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.701 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.701 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:54.701 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.701 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.701 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:54.701 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.701 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.701 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:54.701 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 22, 2024-03-04T06:41:54.701 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8803586 2024-03-04T06:41:54.701 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.701 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:54.702 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 22, 2024-03-04T06:41:54.702 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 17777358 2024-03-04T06:41:54.702 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.702 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.702 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 100 2024-03-04T06:41:54.702 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.702 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:54.702 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2429440 2024-03-04T06:41:54.702 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.702 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:54.702 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 100, 2024-03-04T06:41:54.702 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 331924873 2024-03-04T06:41:54.702 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 100, 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41732144 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 100, 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 189743341 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.703 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.704 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:54.704 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 590368 2024-03-04T06:41:54.704 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.704 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:54.704 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2 2024-03-04T06:41:54.704 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.704 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:54.704 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.704 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.704 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:54.704 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28385280 2024-03-04T06:41:54.704 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.705 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.705 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.705 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.2": { 2024-03-04T06:41:54.705 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.705 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:54.705 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.705 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.705 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:54.705 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.705 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.706 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:54.706 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:54.706 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.706 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:54.706 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.706 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.706 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:54.706 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.706 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.706 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:54.706 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.706 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2215936 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.707 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.708 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:54.708 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.708 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.708 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:54.708 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:54.708 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.708 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:54.708 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1413120 2024-03-04T06:41:54.708 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.708 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:54.708 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1273856 2024-03-04T06:41:54.708 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.708 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:54.709 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:54.709 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.709 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:54.709 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.709 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.709 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:54.709 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.709 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.709 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:54.709 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:54.709 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.709 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:54.709 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:54.710 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.710 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:54.710 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:54.710 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.710 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:54.710 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:54.710 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.710 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:54.710 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:54.710 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.710 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:54.710 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.710 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.711 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:54.711 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.711 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.711 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:54.711 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:54.711 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.711 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:54.711 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:54.711 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.711 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:54.711 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:54.711 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.712 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:54.712 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.712 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.712 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:54.712 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.712 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.712 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:54.712 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.712 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.712 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:54.713 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.713 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.713 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:54.713 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.713 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.713 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:54.713 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.713 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.713 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:54.713 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.713 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.713 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:54.713 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.714 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.714 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:54.714 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.714 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.714 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:54.714 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.714 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.714 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:54.714 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.714 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.714 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:54.714 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.714 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.715 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:54.715 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.715 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.715 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:54.715 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3567616 2024-03-04T06:41:54.715 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.715 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.715 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:54.715 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:54.715 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:54.715 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.715 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:54.715 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 708608 2024-03-04T06:41:54.716 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.716 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:54.716 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 4, 2024-03-04T06:41:54.716 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 225538 2024-03-04T06:41:54.716 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.716 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:54.716 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.716 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.716 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.716 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:54.716 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.716 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.716 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 13, 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14009 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.717 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 72289506 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 294, 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5658121 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 301885 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.718 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 72591391 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 59969 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.719 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4227 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 615 2024-03-04T06:41:54.720 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 212 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 99, 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1266297 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 276, 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 253284 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 177, 2024-03-04T06:41:54.721 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5719472 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 103044 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4963516 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:54.722 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 118, 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6873751 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 117, 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 294314134524 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 118, 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 126756671464 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 340, 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 76333232154 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.723 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:54.724 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 340, 2024-03-04T06:41:54.724 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 34247 2024-03-04T06:41:54.724 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.724 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:54.724 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:54.724 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 438472 2024-03-04T06:41:54.724 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.724 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:54.724 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:54.724 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 112369182 2024-03-04T06:41:54.724 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.724 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:54.724 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 123964 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 78676480 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23724167 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 309568 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.725 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 53, 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 248599 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 220226947 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27270322 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 341, 2024-03-04T06:41:54.726 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2240858 2024-03-04T06:41:54.727 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.727 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.727 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:54.727 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:54.727 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861619251 2024-03-04T06:41:54.727 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.727 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:54.727 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41205760 2024-03-04T06:41:54.727 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.727 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40771584 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137559552 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 434176 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.728 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85509061 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.729 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.730 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.730 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.730 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.730 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.730 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.730 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.730 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.730 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.730 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.730 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.730 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8192 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73866299 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.731 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641317957 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.732 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.733 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.734 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71711595 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.735 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 57006040 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.736 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.737 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.738 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68822616 2024-03-04T06:41:54.738 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.738 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.738 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:54.738 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.738 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:54.738 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.738 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.738 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.738 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.738 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.738 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.739 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.739 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.739 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641317957 2024-03-04T06:41:54.739 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.739 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.739 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.739 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.739 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.739 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.739 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.739 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.739 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.739 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.740 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.740 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.740 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.740 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.740 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.740 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.740 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.740 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 209954 2024-03-04T06:41:54.740 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.740 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.740 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.741 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.741 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.741 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.741 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.741 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.741 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.741 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.741 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.741 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71503769 2024-03-04T06:41:54.741 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.741 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.741 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.742 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.743 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:54.743 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31 2024-03-04T06:41:54.743 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.743 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:54.743 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.743 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.743 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:54.743 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:54.743 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.743 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:54.743 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.743 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.743 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:54.744 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.744 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.744 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:54.744 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.744 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.744 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:54.744 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 10, 2024-03-04T06:41:54.744 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 121885274 2024-03-04T06:41:54.744 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.744 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:54.744 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.744 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 10, 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6200457 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 10, 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 99420985 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.745 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.746 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.746 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:54.746 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.746 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.746 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:54.746 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.746 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.746 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:54.746 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.747 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.747 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.747 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:54.747 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.747 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.747 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.747 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:54.747 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.747 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.747 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:54.747 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.748 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.748 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:54.748 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.748 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.748 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.748 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:54.748 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.748 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.748 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:54.748 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.748 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.748 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:54.748 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.749 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.749 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:54.749 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.749 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.749 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.749 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:54.749 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.749 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.749 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.749 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.749 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10 2024-03-04T06:41:54.749 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.750 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:54.750 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.750 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.750 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:54.750 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 10, 2024-03-04T06:41:54.750 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 121885274 2024-03-04T06:41:54.750 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.750 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:54.750 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.750 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 10, 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6200457 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 10, 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 99420985 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.751 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.752 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:54.752 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:54.752 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.752 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:54.752 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.752 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.752 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:54.752 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28377088 2024-03-04T06:41:54.752 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.752 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.752 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.753 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.3": { 2024-03-04T06:41:54.753 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.753 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:54.753 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.753 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.753 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:54.753 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.753 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.753 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:54.753 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:54.753 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.754 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:54.754 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.754 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.754 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:54.754 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.754 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.754 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:54.754 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.754 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.754 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:54.755 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:54.755 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.755 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:54.755 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1085440 2024-03-04T06:41:54.755 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.755 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:54.755 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.755 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.755 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.755 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:54.756 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.756 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.756 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.756 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:54.756 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.756 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.756 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:54.756 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:54.756 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.756 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:54.756 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 798720 2024-03-04T06:41:54.757 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.757 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:54.757 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 659456 2024-03-04T06:41:54.757 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.757 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:54.757 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:54.757 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.757 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:54.757 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.757 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.757 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:54.758 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.758 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:54.758 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:54.758 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.758 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:54.758 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:54.758 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.758 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:54.758 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:54.758 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.759 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:54.759 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:54.759 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.759 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:54.759 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:54.759 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.759 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:54.759 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.759 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.759 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:54.759 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.760 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.760 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:54.760 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:54.760 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.760 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:54.760 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:54.760 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.760 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:54.760 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:54.760 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.761 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:54.761 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.761 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.761 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:54.761 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.761 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.761 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:54.761 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.761 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.761 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:54.762 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.762 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.762 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:54.762 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.762 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.762 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:54.762 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.762 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.762 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:54.762 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.763 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.763 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:54.763 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.763 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.763 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:54.763 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.763 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.763 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:54.763 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.763 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.763 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:54.763 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.763 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.764 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:54.764 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.764 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.764 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:54.764 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.764 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.764 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:54.764 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1822720 2024-03-04T06:41:54.764 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.764 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.764 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:54.764 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:54.764 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:54.765 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.765 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:54.765 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 729088 2024-03-04T06:41:54.765 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.765 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:54.765 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.765 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.765 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.765 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:54.765 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.765 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.765 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.765 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:54.766 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.766 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.766 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:54.766 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.766 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.766 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:54.766 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.766 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.766 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:54.766 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:54.766 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5477 2024-03-04T06:41:54.766 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.766 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:54.767 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.767 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.767 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.767 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:54.767 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 148, 2024-03-04T06:41:54.767 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 48104299 2024-03-04T06:41:54.767 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.767 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:54.767 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 133, 2024-03-04T06:41:54.767 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8410869 2024-03-04T06:41:54.767 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.767 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 148, 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 430890 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 148, 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 48535189 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.768 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 35651 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.769 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3761 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 323 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 223 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 80, 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 888400 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.770 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:54.771 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 134, 2024-03-04T06:41:54.771 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 340194 2024-03-04T06:41:54.771 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.771 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:54.771 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 54, 2024-03-04T06:41:54.771 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 382996 2024-03-04T06:41:54.771 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.771 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:54.771 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.771 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.771 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:54.772 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.772 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.772 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.772 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:54.772 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:54.772 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 11835610 2024-03-04T06:41:54.772 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.772 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:54.772 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 48, 2024-03-04T06:41:54.772 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10416859 2024-03-04T06:41:54.772 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.772 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 45, 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 276077873952 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 48, 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 76817310148 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 236, 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 573725 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 236, 2024-03-04T06:41:54.773 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 21562 2024-03-04T06:41:54.774 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.774 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:54.774 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:54.774 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 252367 2024-03-04T06:41:54.774 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.774 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:54.774 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:54.774 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 195639058 2024-03-04T06:41:54.774 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.774 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:54.774 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:54.774 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73143 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 89424147 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14723078 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 312302 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 39, 2024-03-04T06:41:54.775 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 185827 2024-03-04T06:41:54.776 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.776 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:54.776 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:54.776 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 311901261 2024-03-04T06:41:54.776 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.776 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:54.776 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:54.776 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 17633688 2024-03-04T06:41:54.776 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.776 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:54.776 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 239, 2024-03-04T06:41:54.776 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2189412 2024-03-04T06:41:54.776 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861619251 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41336832 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41099264 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137559552 2024-03-04T06:41:54.777 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 237568 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.778 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85509113 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.779 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.780 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.780 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.780 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.780 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.780 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.780 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.780 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.780 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.780 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.780 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73874439 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:54.781 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641318348 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.782 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.783 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.784 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.784 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.784 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.784 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.784 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.784 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.784 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.784 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71711204 2024-03-04T06:41:54.784 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.784 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.784 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:54.784 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.784 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:54.785 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.785 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.785 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.785 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.785 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.785 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:54.785 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.785 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.785 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 57006075 2024-03-04T06:41:54.785 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.785 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.786 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.787 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68822581 2024-03-04T06:41:54.788 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.788 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.788 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:54.788 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.788 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:54.788 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.788 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.788 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.788 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.788 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.788 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.788 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.788 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641318348 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.789 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.790 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8219 2024-03-04T06:41:54.790 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.790 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.790 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 211362 2024-03-04T06:41:54.790 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.790 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.790 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.790 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.790 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.790 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.790 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.790 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.790 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.791 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.791 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.791 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71493751 2024-03-04T06:41:54.791 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.791 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.791 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:54.791 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:54.791 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.791 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.791 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.792 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.792 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.792 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:54.792 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.792 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.792 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.793 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.793 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.793 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.793 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.793 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:54.794 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 36 2024-03-04T06:41:54.794 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.794 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:54.794 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.794 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.794 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:54.795 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.795 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.795 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:54.795 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.795 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.795 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:54.795 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.795 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.795 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:54.795 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.795 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.796 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:54.796 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.796 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.796 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.796 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:54.796 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.796 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.796 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:54.796 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.796 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 673949 2024-03-04T06:41:54.796 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.796 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.797 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:54.798 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.798 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.798 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:54.798 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.798 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.798 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.798 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:54.798 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.798 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.799 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:54.800 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.800 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.800 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:54.800 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.800 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.800 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:54.800 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.800 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.801 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 673949 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.802 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28393472 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.4": { 2024-03-04T06:41:54.803 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:54.804 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1196032 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.805 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.806 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:54.806 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.806 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.806 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.806 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:54.806 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.806 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.806 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:54.806 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 868352 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 729088 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.807 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:54.808 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.808 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.808 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:54.808 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:54.808 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.808 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:54.808 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:54.808 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.808 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:54.808 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:54.808 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.808 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:54.808 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:54.809 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:54.810 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.810 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:54.810 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:54.810 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.810 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:54.810 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.810 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.810 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:54.810 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.810 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.810 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:54.810 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.810 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.811 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:54.811 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.811 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.811 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:54.811 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.811 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.811 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:54.812 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.812 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.812 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:54.812 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.812 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.813 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:54.813 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.813 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.813 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:54.813 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.813 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.814 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:54.814 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.814 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.814 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:54.814 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.814 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.815 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:54.815 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.815 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.815 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:54.815 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.815 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.815 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:54.816 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2002944 2024-03-04T06:41:54.816 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.816 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.816 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:54.816 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:54.816 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:54.816 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.816 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:54.816 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 724992 2024-03-04T06:41:54.816 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.816 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:54.816 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 8, 2024-03-04T06:41:54.816 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 300400 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.817 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:54.818 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.818 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2135 2024-03-04T06:41:54.818 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.818 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:54.818 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.818 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.818 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.818 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:54.818 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 165, 2024-03-04T06:41:54.818 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 47361194 2024-03-04T06:41:54.818 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.818 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:54.818 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 158, 2024-03-04T06:41:54.819 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12256867 2024-03-04T06:41:54.819 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.819 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:54.819 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 165, 2024-03-04T06:41:54.819 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 163331 2024-03-04T06:41:54.819 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.819 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:54.819 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 165, 2024-03-04T06:41:54.819 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 47524525 2024-03-04T06:41:54.820 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.820 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:54.820 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.820 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.820 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.820 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:54.820 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:54.820 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 51099 2024-03-04T06:41:54.820 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.820 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:54.820 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.820 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.820 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5621 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 363 2024-03-04T06:41:54.821 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 236 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 97, 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 930794 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 164, 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 262331 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 67, 2024-03-04T06:41:54.822 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 146875 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 201752 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2846838 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:54.823 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 42, 2024-03-04T06:41:54.824 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2960769 2024-03-04T06:41:54.824 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.824 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:54.824 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 41, 2024-03-04T06:41:54.824 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 195612395968 2024-03-04T06:41:54.824 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.824 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:54.824 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 42, 2024-03-04T06:41:54.824 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 66087057804 2024-03-04T06:41:54.824 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.824 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:54.824 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 259, 2024-03-04T06:41:54.824 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 552746 2024-03-04T06:41:54.825 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.825 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:54.825 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 259, 2024-03-04T06:41:54.825 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24097 2024-03-04T06:41:54.825 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.825 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:54.825 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:54.825 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 261094 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 208622769 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73441 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 133748299 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.826 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13451452 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 310276 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 41, 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 196412 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 358960625 2024-03-04T06:41:54.827 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.828 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:54.828 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:54.828 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15593256 2024-03-04T06:41:54.828 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.828 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:54.828 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 260, 2024-03-04T06:41:54.828 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1787288 2024-03-04T06:41:54.828 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.828 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.828 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:54.828 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:54.828 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861610720 2024-03-04T06:41:54.828 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41205760 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40894464 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137549516 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 311296 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.829 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:54.830 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.830 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:54.830 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.830 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.830 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.830 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.830 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.830 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.830 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.830 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.830 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85508435 2024-03-04T06:41:54.830 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.831 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.831 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.831 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.831 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.831 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.831 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.831 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.831 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.831 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.832 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.832 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.832 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.832 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.832 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.832 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.832 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.832 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.832 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.832 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.832 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.832 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.832 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.833 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.833 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.833 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.833 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.833 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.833 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.833 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73875117 2024-03-04T06:41:54.833 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.833 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.833 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:54.833 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.833 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:54.833 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641313266 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.834 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.835 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.836 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.836 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.836 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.836 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.836 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.836 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.836 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.836 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.836 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.836 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71716286 2024-03-04T06:41:54.836 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.836 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.836 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 57005623 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.837 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.838 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68823033 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.839 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641313266 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.840 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 217580 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.841 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71500834 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:54.842 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 41 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.843 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 22 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.844 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:54.845 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.845 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 22747453 2024-03-04T06:41:54.845 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.845 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:54.845 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.845 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.845 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:54.845 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.845 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 729042 2024-03-04T06:41:54.845 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.845 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:54.846 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.846 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 18384543 2024-03-04T06:41:54.846 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.846 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.846 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.846 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.846 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:54.846 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.846 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.846 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.846 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:54.846 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.846 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:54.847 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.848 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 22 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:54.849 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 22747453 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 729042 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 18384543 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:54.850 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28393472 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.851 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.5": { 2024-03-04T06:41:54.852 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.852 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:54.852 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.852 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.852 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:54.852 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.852 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.852 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:54.852 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:54.852 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.852 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:54.852 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.852 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1155072 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.853 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 847872 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:54.854 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 708608 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:54.855 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.856 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:54.857 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.858 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:54.859 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1941504 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 720896 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 6, 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 178553 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.860 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3485 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:54.861 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 160, 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40519017 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 143, 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6721358 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 160, 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 137566 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:54.862 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 160, 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 40656583 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 43548 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.863 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 9120 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 328 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.864 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 242 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 90, 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 724936 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 144, 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 244691 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 54, 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 359558 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.865 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 4, 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 97059 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3623433 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 39, 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2973345 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 36, 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 184410114358 2024-03-04T06:41:54.866 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 39, 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 50206698024 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 261, 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1096422 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 261, 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23881 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 227577 2024-03-04T06:41:54.867 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.868 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:54.868 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.868 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 118347680 2024-03-04T06:41:54.868 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.868 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:54.868 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.868 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 86517 2024-03-04T06:41:54.869 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.869 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:54.869 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.869 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 70112142 2024-03-04T06:41:54.869 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.869 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:54.869 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.869 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12005445 2024-03-04T06:41:54.869 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.869 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:54.869 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 311957 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 32, 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 132567 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 204357876 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15180628 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.870 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1776160 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861610720 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42385408 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42000384 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137549516 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.871 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 385024 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85508373 2024-03-04T06:41:54.872 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.873 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73875179 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.874 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641312803 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.875 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.876 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.877 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.877 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.877 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.877 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.877 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.877 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.878 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.878 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.878 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.878 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71716749 2024-03-04T06:41:54.878 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.878 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.878 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:54.878 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 57005582 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.879 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.880 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68823074 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:54.881 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641312803 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.882 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 223334 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.883 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71495543 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.884 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.885 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.886 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:54.887 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.888 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:54.889 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.890 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.891 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:54.892 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28385280 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.6": { 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.893 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1224704 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.894 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 913408 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:54.895 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 774144 2024-03-04T06:41:54.896 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.896 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:54.896 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:54.896 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.896 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:54.896 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.896 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.896 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:54.896 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.896 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.896 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:54.896 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:54.896 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.897 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.898 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:54.899 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.900 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2076672 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1314816 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:54.901 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.902 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 3, 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4422 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 176, 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 44500365 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 166, 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5799126 2024-03-04T06:41:54.903 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 176, 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 109416 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 176, 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 44609781 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:54.904 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 35268 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 1, 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 460 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:54.905 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5410 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 347 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 248 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 90, 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 678669 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 139, 2024-03-04T06:41:54.906 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 254526 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 49, 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 402655 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.907 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 9181390 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 34, 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2514193 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 34, 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 456950750314 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 34, 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 51213613791 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:54.908 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 511522 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28066 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2864327 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 128241132 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:54.909 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 81059 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 66921727 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 19484156 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 902566 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 27, 2024-03-04T06:41:54.910 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 106791 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 226727217 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 21417259 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 264, 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1625298 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:54.911 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861610720 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 43368448 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42483712 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137549516 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 884736 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.912 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85508040 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.913 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.914 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73875512 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.915 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641310302 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.916 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.917 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71719250 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.918 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.919 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:54.919 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.919 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.919 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 57005360 2024-03-04T06:41:54.919 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.919 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.919 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.920 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.920 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.920 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.920 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.920 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.920 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.920 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.920 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.920 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.921 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.921 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.921 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.921 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.921 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.921 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.921 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.921 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68823296 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:54.922 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641310302 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.923 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8403 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 219687 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.924 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71493288 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.925 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 39 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13 2024-03-04T06:41:54.926 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2810 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 13, 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 114787633 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.927 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 15, 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6798630 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 13, 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 105391673 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.928 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.929 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.930 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:54.931 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.931 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.931 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:54.931 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.931 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.931 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:54.931 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.931 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.931 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.932 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:54.932 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.932 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.932 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.932 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.932 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13 2024-03-04T06:41:54.933 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.933 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:54.933 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2810 2024-03-04T06:41:54.933 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.933 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:54.933 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 13, 2024-03-04T06:41:54.934 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 114787633 2024-03-04T06:41:54.934 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.934 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:54.934 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.934 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.935 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:54.935 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 15, 2024-03-04T06:41:54.935 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 6798630 2024-03-04T06:41:54.935 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.935 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:54.935 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 13, 2024-03-04T06:41:54.935 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 105391673 2024-03-04T06:41:54.936 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.936 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:54.936 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.936 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.936 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:54.936 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.936 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.936 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:54.936 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.936 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.936 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:54.936 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.936 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28979200 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: "osd.7": { 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: "bluefs": { 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_fallback": { 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_slow_size_fallback": { 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.937 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_db": { 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 65536 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_main": { 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit_wal": { 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_slow": { 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_sst": { 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 12288 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.938 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_written_wal": { 2024-03-04T06:41:54.939 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1269760 2024-03-04T06:41:54.939 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.939 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lat": { 2024-03-04T06:41:54.939 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.939 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.939 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.939 INFO:tasks.workunit.client.0.smithi137.stdout: "compact_lock_lat": { 2024-03-04T06:41:54.939 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.939 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.939 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.939 INFO:tasks.workunit.client.0.smithi137.stdout: "db_total_bytes": { 2024-03-04T06:41:54.939 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.940 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.940 INFO:tasks.workunit.client.0.smithi137.stdout: "db_used_bytes": { 2024-03-04T06:41:54.940 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27656192 2024-03-04T06:41:54.940 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.940 INFO:tasks.workunit.client.0.smithi137.stdout: "log_bytes": { 2024-03-04T06:41:54.940 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 983040 2024-03-04T06:41:54.940 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.940 INFO:tasks.workunit.client.0.smithi137.stdout: "logged_bytes": { 2024-03-04T06:41:54.940 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 843776 2024-03-04T06:41:54.940 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.940 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_db": { 2024-03-04T06:41:54.940 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 31850496 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_slow": { 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: "max_bytes_wal": { 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: "num_files": { 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 14 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: "read_bytes": { 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 206366 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: "read_count": { 2024-03-04T06:41:54.941 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 23 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes": { 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1282048 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_db": { 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1286144 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_slow": { 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_bytes_wal": { 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: "read_disk_count": { 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 15 2024-03-04T06:41:54.942 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_bytes": { 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5019 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: "read_prefetch_count": { 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_bytes": { 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_buffer_count": { 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_bytes": { 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5845 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.943 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_count": { 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes": { 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_db": { 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_slow": { 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_bytes_wal": { 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: "read_random_disk_count": { 2024-03-04T06:41:54.944 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_total_bytes": { 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: "slow_used_bytes": { 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_total_bytes": { 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: "wal_used_bytes": { 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: "write_bytes": { 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2191360 2024-03-04T06:41:54.945 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.946 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.946 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore": { 2024-03-04T06:41:54.946 INFO:tasks.workunit.client.0.smithi137.stdout: "alloc_unit": { 2024-03-04T06:41:54.946 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 4096 2024-03-04T06:41:54.946 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.946 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": { 2024-03-04T06:41:54.946 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1306624 2024-03-04T06:41:54.946 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.946 INFO:tasks.workunit.client.0.smithi137.stdout: "clist_lat": { 2024-03-04T06:41:54.946 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:54.946 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 253071 2024-03-04T06:41:54.946 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.946 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_lat": { 2024-03-04T06:41:54.947 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.947 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.947 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.947 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed": { 2024-03-04T06:41:54.947 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.947 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.947 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_allocated": { 2024-03-04T06:41:54.947 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.947 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.947 INFO:tasks.workunit.client.0.smithi137.stdout: "compressed_original": { 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: "csum_lat": { 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 9, 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 45012 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: "decompress_lat": { 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_commit_lat": { 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 193, 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 49759756 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.948 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_final_lat": { 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 182, 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10818431 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_flush_lat": { 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 193, 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 128338 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: "kv_sync_lat": { 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 193, 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 49888094 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_keys_lat": { 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.949 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_get_values_lat": { 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 55224 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_lower_bound_lat": { 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_next_lat": { 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_seek_to_first_lat": { 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 0, 2024-03-04T06:41:54.950 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.951 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.951 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_upper_bound_lat": { 2024-03-04T06:41:54.951 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.951 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 7352 2024-03-04T06:41:54.951 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.951 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_hits": { 2024-03-04T06:41:54.952 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 576 2024-03-04T06:41:54.952 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.952 INFO:tasks.workunit.client.0.smithi137.stdout: "onode_misses": { 2024-03-04T06:41:54.952 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 276 2024-03-04T06:41:54.952 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.952 INFO:tasks.workunit.client.0.smithi137.stdout: "read_lat": { 2024-03-04T06:41:54.953 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 114, 2024-03-04T06:41:54.953 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2658941 2024-03-04T06:41:54.953 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.953 INFO:tasks.workunit.client.0.smithi137.stdout: "read_onode_meta_lat": { 2024-03-04T06:41:54.953 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 175, 2024-03-04T06:41:54.953 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 282314 2024-03-04T06:41:54.954 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.954 INFO:tasks.workunit.client.0.smithi137.stdout: "read_wait_aio_lat": { 2024-03-04T06:41:54.954 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 61, 2024-03-04T06:41:54.954 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1924790 2024-03-04T06:41:54.954 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.954 INFO:tasks.workunit.client.0.smithi137.stdout: "reads_with_retries": { 2024-03-04T06:41:54.954 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.955 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.955 INFO:tasks.workunit.client.0.smithi137.stdout: "remove_lat": { 2024-03-04T06:41:54.955 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 2, 2024-03-04T06:41:54.955 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 66190 2024-03-04T06:41:54.955 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.955 INFO:tasks.workunit.client.0.smithi137.stdout: "state_aio_wait_lat": { 2024-03-04T06:41:54.955 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.956 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2441432 2024-03-04T06:41:54.956 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.956 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_aio_wait_lat": { 2024-03-04T06:41:54.956 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 20, 2024-03-04T06:41:54.956 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1317903 2024-03-04T06:41:54.956 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.957 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_cleanup_lat": { 2024-03-04T06:41:54.957 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 20, 2024-03-04T06:41:54.957 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 349582546287 2024-03-04T06:41:54.957 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.957 INFO:tasks.workunit.client.0.smithi137.stdout: "state_deferred_queued_lat": { 2024-03-04T06:41:54.957 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 20, 2024-03-04T06:41:54.957 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 29136821074 2024-03-04T06:41:54.957 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.957 INFO:tasks.workunit.client.0.smithi137.stdout: "state_done_lat": { 2024-03-04T06:41:54.957 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.957 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 701781 2024-03-04T06:41:54.957 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.957 INFO:tasks.workunit.client.0.smithi137.stdout: "state_finishing_lat": { 2024-03-04T06:41:54.958 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.958 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 27590 2024-03-04T06:41:54.958 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.958 INFO:tasks.workunit.client.0.smithi137.stdout: "state_io_done_lat": { 2024-03-04T06:41:54.958 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.958 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 253616 2024-03-04T06:41:54.958 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.958 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_commiting_lat": { 2024-03-04T06:41:54.958 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.958 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 124784269 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_done_lat": { 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 96118 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: "state_kv_queued_lat": { 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 46581981 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: "state_prepare_lat": { 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 11388993 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": { 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 900209 2024-03-04T06:41:54.959 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: "truncate_lat": { 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 19, 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 78303 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_commit_lat": { 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 185491884 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_submit_lat": { 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 13419847 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: "txc_throttle_lat": { 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 298, 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1827723 2024-03-04T06:41:54.960 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache": { 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_bytes": { 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 1861610720 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: "heap_bytes": { 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42319872 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: "mapped_bytes": { 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 42090496 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: "target_bytes": { 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 3137549516 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.961 INFO:tasks.workunit.client.0.smithi137.stdout: "unmapped_bytes": { 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 229376 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:data": { 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 159383552 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85499373 2024-03-04T06:41:54.962 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.963 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.963 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.963 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.963 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.963 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.963 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.963 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.963 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.963 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.963 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 135168 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.964 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 73749011 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv": { 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 780140544 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.965 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641245304 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.966 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2128 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.967 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71784248 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:kv_onode": { 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 192937984 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 67108864 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 464 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.968 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 56999582 2024-03-04T06:41:54.969 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.969 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.969 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.969 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.969 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.969 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.970 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.970 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.970 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.970 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.970 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.970 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.970 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.970 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.971 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 68829074 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: "bluestore-pricache:meta": { 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: "committed_bytes": { 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 713031680 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: "pri0_bytes": { 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: "pri10_bytes": { 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.972 INFO:tasks.workunit.client.0.smithi137.stdout: "pri11_bytes": { 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 641245304 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: "pri1_bytes": { 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: "pri2_bytes": { 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: "pri3_bytes": { 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: "pri4_bytes": { 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.973 INFO:tasks.workunit.client.0.smithi137.stdout: "pri5_bytes": { 2024-03-04T06:41:54.974 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.974 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.974 INFO:tasks.workunit.client.0.smithi137.stdout: "pri6_bytes": { 2024-03-04T06:41:54.974 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 229815 2024-03-04T06:41:54.974 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.974 INFO:tasks.workunit.client.0.smithi137.stdout: "pri7_bytes": { 2024-03-04T06:41:54.974 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.974 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.974 INFO:tasks.workunit.client.0.smithi137.stdout: "pri8_bytes": { 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: "pri9_bytes": { 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: "reserved_bytes": { 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 71556561 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: "objecter": { 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: "op_active": { 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.975 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rmw": { 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: "osd": { 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg": { 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 47 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: "numpg_removing": { 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.976 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: "op": { 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 101 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_degraded": { 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: "op_delayed_unreadable": { 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: "op_in_bytes": { 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: "op_latency": { 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 101, 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 155296945 2024-03-04T06:41:54.977 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: "op_out_bytes": { 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 264707 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: "op_prepare_latency": { 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 103, 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24761325 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: "op_process_latency": { 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 101, 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 118546885 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r": { 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 70 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency": { 2024-03-04T06:41:54.978 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 70, 2024-03-04T06:41:54.979 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 11649451 2024-03-04T06:41:54.979 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.979 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-04T06:41:54.979 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.979 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.979 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_out_bytes": { 2024-03-04T06:41:54.979 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 264707 2024-03-04T06:41:54.979 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.979 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_prepare_latency": { 2024-03-04T06:41:54.979 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 70, 2024-03-04T06:41:54.979 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 10467327 2024-03-04T06:41:54.979 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.979 INFO:tasks.workunit.client.0.smithi137.stdout: "op_r_process_latency": { 2024-03-04T06:41:54.980 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 70, 2024-03-04T06:41:54.980 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 8627887 2024-03-04T06:41:54.980 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.980 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw": { 2024-03-04T06:41:54.980 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 26 2024-03-04T06:41:54.980 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.980 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_in_bytes": { 2024-03-04T06:41:54.980 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.980 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.980 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency": { 2024-03-04T06:41:54.980 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 26, 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 25730715 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_out_bytes": { 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_prepare_latency": { 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 26, 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 11303466 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.981 INFO:tasks.workunit.client.0.smithi137.stdout: "op_rw_process_latency": { 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 26, 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 24189331 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w": { 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 5 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_in_bytes": { 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency": { 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 117916779 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.982 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_prepare_latency": { 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 7, 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 2990532 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: "op_w_process_latency": { 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: "count": 5, 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 85729667 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: "op_wip": { 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_bytes": { 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: "recovery_ops": { 2024-03-04T06:41:54.983 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 0 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes": { 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 95995035648 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_bytes_used": { 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: "value": 28971008 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: "pools": [ 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr" 2024-03-04T06:41:54.984 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 1, 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 1, 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 1, 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330395402, 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 1781760, 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:54.985 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 1781760, 2024-03-04T06:41:54.986 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:54.986 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110133760, 2024-03-04T06:41:54.986 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 2, 2024-03-04T06:41:54.986 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:54.986 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 2.4430019038845785e-06, 2024-03-04T06:41:54.986 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:54.986 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:54.986 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 358, 2024-03-04T06:41:54.986 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 567296, 2024-03-04T06:41:54.986 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 590368, 2024-03-04T06:41:54.987 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 590368, 2024-03-04T06:41:54.987 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:54.987 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 1771104, 2024-03-04T06:41:54.987 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 211, 2024-03-04T06:41:54.987 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 2473984 2024-03-04T06:41:54.987 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.987 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:54.987 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs" 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 32, 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 32, 2024-03-04T06:41:54.988 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 2, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330395402, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 98304, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 98304, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110133760, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 22, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 1.3478663163368765e-07, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 0, 2024-03-04T06:41:54.989 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 0, 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 3428, 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 3428, 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 10284, 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 51, 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 20480 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs" 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.990 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 64, 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 64, 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 3, 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330395402, 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 0, 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 0, 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:54.991 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110133760, 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 0, 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 0.0, 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 0, 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 0, 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 0, 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 0, 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 0, 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 0, 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 0 2024-03-04T06:41:54.992 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd" 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: "cache_mode": "none", 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: "erasure_code_profile": {}, 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: "min_size": 2, 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: "options": {}, 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_autoscale_mode": "off", 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 8, 2024-03-04T06:41:54.993 INFO:tasks.workunit.client.0.smithi137.stdout: "pgp_num": 8, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "pool": 4, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "size": 3, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "stats": { 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_raw": 729330395402, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "bytes_used": 0, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_bytes_used": 0, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "compress_under_bytes": 0, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "data_bytes_used": 0, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty": 0, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "max_avail": 243110133760, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "objects": 0, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_bytes_used": 0, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "percent_used": 0.0, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_bytes": 0, 2024-03-04T06:41:54.994 INFO:tasks.workunit.client.0.smithi137.stdout: "quota_objects": 0, 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: "rd": 0, 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: "rd_bytes": 0, 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: "stored": 0, 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_data": 0, 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_omap": 0, 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: "stored_raw": 0, 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: "wr": 0, 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: "wr_bytes": 0 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_bytes": 0, 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: "target_max_objects": 0, 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: "type": "replicated" 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd": { 2024-03-04T06:41:54.995 INFO:tasks.workunit.client.0.smithi137.stdout: "mirroring_by_pool": [ 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: false 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: "num_images_by_pool": [ 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: "num_pools": 1 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: "report_id": "f1e8dce2-c416-4290-9187-6dc0e467ffee", 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: "report_timestamp": "2024-03-04T06:41:53.756951", 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: "report_version": 1, 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: "rocksdb_stats": { 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "7.9.2" 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: "rook": { 2024-03-04T06:41:54.996 INFO:tasks.workunit.client.0.smithi137.stdout: "cluster": { 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: "external-mode": null, 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: "mon": { 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: "allow-multiple-per-node": null, 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: "count": null, 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: "max-id": null, 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: "pvc": { 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": null 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: "stretch": { 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: "enabled": null 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: "network": { 2024-03-04T06:41:54.997 INFO:tasks.workunit.client.0.smithi137.stdout: "provider": null 2024-03-04T06:41:54.998 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.998 INFO:tasks.workunit.client.0.smithi137.stdout: "storage": { 2024-03-04T06:41:54.998 INFO:tasks.workunit.client.0.smithi137.stdout: "device-set": { 2024-03-04T06:41:54.998 INFO:tasks.workunit.client.0.smithi137.stdout: "count": { 2024-03-04T06:41:54.998 INFO:tasks.workunit.client.0.smithi137.stdout: "non-portable": null, 2024-03-04T06:41:54.998 INFO:tasks.workunit.client.0.smithi137.stdout: "portable": null, 2024-03-04T06:41:54.998 INFO:tasks.workunit.client.0.smithi137.stdout: "total": null 2024-03-04T06:41:54.998 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.998 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: "csi": { 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: "version": null 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: "kubernetes": { 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: "version": null 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: "node": { 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: "count": { 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: "kubernetes-total": null, 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: "with-ceph-daemons": null, 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: "with-csi-cephfs-plugin": null, 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: "with-csi-nfs-plugin": null, 2024-03-04T06:41:54.999 INFO:tasks.workunit.client.0.smithi137.stdout: "with-csi-rbd-plugin": null 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: "usage": { 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: "storage-class": { 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: "count": { 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: "bucket": null, 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs": null, 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: "nfs": null, 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd": null, 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: "total": null 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: "version": null 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.000 INFO:tasks.workunit.client.0.smithi137.stdout: "services": {}, 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_per_pg": [ 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:55.001 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.918941+0000", 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.918941+0000", 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.919238+0000", 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:55.002 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.831052+0000", 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3f", 2024-03-04T06:41:55.003 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:10:03.122262+0000", 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.004 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.005 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.006 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.007 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.914436+0000", 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.914436+0000", 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.914740+0000", 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:55.008 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825753+0000", 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.009 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3e", 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:39:58.781088+0000", 2024-03-04T06:41:55.010 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.011 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.012 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.013 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.014 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.895398+0000", 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.895398+0000", 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.895666+0000", 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:55.015 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829328+0000", 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.016 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3d", 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:37:10.744216+0000", 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.017 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.018 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.019 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:55.020 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:55.021 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.901792+0000", 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.901792+0000", 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.902256+0000", 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:55.022 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827016+0000", 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3c", 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.023 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:04:45.163241+0000", 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.024 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.025 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.026 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.026 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.026 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.026 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.026 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.026 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.026 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.026 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.026 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.026 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.026 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.026 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.026 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.027 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.027 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.027 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.027 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.027 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.027 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.027 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.027 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.027 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.027 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.027 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.028 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.029 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.029 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:55.029 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.913517+0000", 2024-03-04T06:41:55.029 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.913517+0000", 2024-03-04T06:41:55.029 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.913797+0000", 2024-03-04T06:41:55.029 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:55.029 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.029 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.030 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.030 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.030 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:55.030 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:55.030 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:55.030 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.031 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.031 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.031 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:55.031 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830838+0000", 2024-03-04T06:41:55.031 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.031 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.032 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.032 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.032 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.032 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.032 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.032 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.033 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.033 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.033 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.033 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.033 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.033 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3b", 2024-03-04T06:41:55.034 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.034 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.034 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.034 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.034 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.034 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:04:24.837813+0000", 2024-03-04T06:41:55.035 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.035 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.035 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.035 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.036 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.037 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.037 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.037 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.037 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.037 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.037 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.038 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.038 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.038 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.038 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.038 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.038 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.039 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.039 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.039 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.039 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.039 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.039 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.039 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.040 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.040 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.040 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.040 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.040 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.040 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.041 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.042 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.042 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.042 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.042 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.042 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.042 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.043 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.043 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.043 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.043 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.043 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.043 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.044 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.044 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.044 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.044 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.044 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.044 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.045 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.045 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.045 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.045 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.045 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.045 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:55.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.904484+0000", 2024-03-04T06:41:55.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.904484+0000", 2024-03-04T06:41:55.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.904787+0000", 2024-03-04T06:41:55.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:55.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.046 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.047 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.047 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.047 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:55.047 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:55.047 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:55.047 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.047 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.048 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.048 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:55.048 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827006+0000", 2024-03-04T06:41:55.048 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.048 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.048 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.049 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.049 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.049 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.049 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.049 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.049 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.050 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.050 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.050 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.050 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.050 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3a", 2024-03-04T06:41:55.050 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.050 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.051 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.051 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.051 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.051 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:03:28.898688+0000", 2024-03-04T06:41:55.051 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.051 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.052 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.052 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.052 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.052 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.052 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.052 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.052 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.053 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.053 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.053 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.053 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.053 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.053 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.054 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.054 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.054 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.054 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.054 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.054 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.054 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.055 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.055 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.055 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.055 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.055 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.055 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.056 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.057 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.058 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.058 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.058 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.058 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.059 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.059 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.059 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.059 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.059 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.059 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.059 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.060 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.060 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.060 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.060 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.060 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.060 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.061 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.061 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.061 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.061 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.061 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.061 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.061 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.062 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.062 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:55.062 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.913553+0000", 2024-03-04T06:41:55.062 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.913553+0000", 2024-03-04T06:41:55.062 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.913825+0000", 2024-03-04T06:41:55.062 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:55.063 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.063 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.063 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.063 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.063 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:55.063 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:55.063 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:55.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:55.064 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829072+0000", 2024-03-04T06:41:55.064 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.065 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.065 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.065 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.065 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.065 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.065 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.065 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.066 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.066 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.066 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.066 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.066 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.066 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.39", 2024-03-04T06:41:55.067 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.067 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.067 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.067 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.067 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.067 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:23:17.322436+0000", 2024-03-04T06:41:55.067 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.068 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.068 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.068 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.069 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.069 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.069 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.069 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.069 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.069 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.070 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.070 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.070 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.070 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.070 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.070 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.071 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.071 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.071 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.071 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.071 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.071 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.071 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.072 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.072 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.072 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.072 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.072 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.072 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.073 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.073 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.073 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.073 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.073 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.073 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.074 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.074 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.075 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.075 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.075 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.075 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.075 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.075 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.076 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.076 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.076 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.076 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.076 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.077 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.077 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.077 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.077 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.077 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.077 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.077 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.078 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.078 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.078 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.078 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.078 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.078 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:55.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.902009+0000", 2024-03-04T06:41:55.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.902009+0000", 2024-03-04T06:41:55.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.902309+0000", 2024-03-04T06:41:55.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:55.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.079 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.080 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.080 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.080 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:55.080 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:55.083 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:55.083 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.083 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.083 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.083 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:55.084 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286016+0000", 2024-03-04T06:41:55.084 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.084 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.084 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.084 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.084 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.085 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.085 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.085 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.085 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.085 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.086 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.086 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.086 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.086 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.38", 2024-03-04T06:41:55.086 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.086 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.086 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.086 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.086 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.086 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:36:04.048236+0000", 2024-03-04T06:41:55.086 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.086 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.086 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.087 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.087 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.087 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.087 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.087 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.087 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.087 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.087 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.087 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.087 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.087 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.087 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.087 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.088 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.089 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.090 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.913922+0000", 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.913922+0000", 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.916933+0000", 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:55.091 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.092 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.092 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.092 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.092 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:55.092 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:55.092 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:55.092 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.092 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.092 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.092 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:55.092 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830191+0000", 2024-03-04T06:41:55.092 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.092 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.37", 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.093 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.094 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.094 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.094 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.094 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:08:21.342061+0000", 2024-03-04T06:41:55.094 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.094 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.094 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.094 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.094 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.094 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.094 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.094 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.094 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.095 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.096 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.097 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.098 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.910906+0000", 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.910906+0000", 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.911185+0000", 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:55.099 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830702+0000", 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.100 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.36", 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:38:45.134957+0000", 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.101 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.102 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.103 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.104 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.105 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.915998+0000", 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.915998+0000", 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.916277+0000", 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.106 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830414+0000", 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.107 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.108 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.108 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.108 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.108 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.108 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.108 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.108 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.108 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.108 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.35", 2024-03-04T06:41:55.108 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.108 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.108 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.108 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:22:53.166929+0000", 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.109 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.110 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.111 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.112 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.907111+0000", 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.907111+0000", 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.907393+0000", 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:55.113 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.421127+0000", 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.114 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.34", 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.115 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:47:18.641488+0000", 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.116 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.117 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.118 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.119 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.896729+0000", 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.896729+0000", 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.897003+0000", 2024-03-04T06:41:55.120 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286284+0000", 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.121 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.33", 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.122 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T11:01:03.497642+0000", 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.123 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.124 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.125 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.126 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.896300+0000", 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.896300+0000", 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.896652+0000", 2024-03-04T06:41:55.127 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:55.128 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.128 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.128 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.128 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.128 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:55.128 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:55.128 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:55.128 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.128 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.128 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.128 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:55.128 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.828801+0000", 2024-03-04T06:41:55.129 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.129 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.129 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.129 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.129 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.129 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.129 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.129 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.129 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.129 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.129 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.129 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.129 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.32", 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T18:20:32.026507+0000", 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.130 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.131 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.132 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.133 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.134 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.907720+0000", 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.907720+0000", 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.907997+0000", 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:55.135 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:55.136 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.136 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.136 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.136 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:55.136 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825155+0000", 2024-03-04T06:41:55.136 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.136 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.136 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.136 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.136 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.136 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.31", 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T10:46:55.140847+0000", 2024-03-04T06:41:55.137 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.138 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.139 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.140 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.141 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.898928+0000", 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.898928+0000", 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.899219+0000", 2024-03-04T06:41:55.142 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826567+0000", 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.143 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.144 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.144 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.144 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.144 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.144 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.144 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.144 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.144 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.144 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.144 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.144 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.30", 2024-03-04T06:41:55.144 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.144 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:08:13.412822+0000", 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.145 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.146 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.147 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.148 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.908038+0000", 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.908038+0000", 2024-03-04T06:41:55.149 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.908332+0000", 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827568+0000", 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.150 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2f", 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.151 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:05:49.146138+0000", 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.152 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.153 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.154 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.155 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.898801+0000", 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.898801+0000", 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.899134+0000", 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.156 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827471+0000", 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.157 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2e", 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:21:48.465552+0000", 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.158 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.159 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.160 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.161 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.162 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.914159+0000", 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.914159+0000", 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.918000+0000", 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:55.163 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829472+0000", 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.164 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2d", 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:21:24.026090+0000", 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.165 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.166 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.167 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.168 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.169 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.550141+0000", 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.550141+0000", 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.550843+0000", 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.170 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829967+0000", 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 4, 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 4, 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.171 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1f", 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 24, 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:45:01.969570+0000", 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 582, 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.172 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 6, 2024-03-04T06:41:55.173 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 2, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 2, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.174 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 4, 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 1 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:55.175 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'4" 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.176 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.896120+0000", 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.896120+0000", 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.896389+0000", 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.177 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286570+0000", 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.178 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1e", 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:49:57.729499+0000", 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.179 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.180 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.181 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.182 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.550444+0000", 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.550444+0000", 2024-03-04T06:41:55.183 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.550800+0000", 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286702+0000", 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 1, 2024-03-04T06:41:55.184 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 1, 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1e", 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.185 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 21, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:53:42.209194+0000", 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.186 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.187 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.188 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'1" 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.189 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.902982+0000", 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.902982+0000", 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.903258+0000", 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.190 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829818+0000", 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.191 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1f", 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:31:23.228035+0000", 2024-03-04T06:41:55.192 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.193 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.194 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.195 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:55.196 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:39:45.831328+0000", 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:39:45.831328+0000", 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:39:45.833985+0000", 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 69, 2024-03-04T06:41:55.197 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.834266+0000", 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 2, 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 68, 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.198 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 2, 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1d", 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:27:31.095064+0000", 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.199 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.200 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 1, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.201 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 3, 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.202 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'2" 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.203 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:39:46.421792+0000", 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:39:46.421792+0000", 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 69, 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:55.204 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.422444+0000", 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 68, 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.205 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1c", 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 11, 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:10:51.404998+0000", 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.206 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.207 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.208 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:55.209 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.210 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.211 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:55.211 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.555860+0000", 2024-03-04T06:41:55.211 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.555860+0000", 2024-03-04T06:41:55.211 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.556246+0000", 2024-03-04T06:41:55.211 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:55.211 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.211 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.211 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.211 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.211 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:55.211 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:55.211 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:55.211 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829317+0000", 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 2, 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 2, 2024-03-04T06:41:55.212 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1c", 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 22, 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T18:36:41.910480+0000", 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.213 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.214 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.215 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 3, 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.216 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'2" 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:55.217 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.906615+0000", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.906615+0000", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.906907+0000", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827266+0000", 2024-03-04T06:41:55.218 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1d", 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.219 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:21:15.889709+0000", 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.220 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.221 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.222 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.223 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.223 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.223 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.223 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.223 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.223 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.223 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.223 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.223 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.223 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.223 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.223 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.223 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.224 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.545975+0000", 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.545975+0000", 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.546234+0000", 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.225 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286732+0000", 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 1, 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 1, 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.226 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1b", 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 21, 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:50:04.341190+0000", 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.227 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.228 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.229 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.229 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.229 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.229 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.229 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.229 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.229 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.229 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.229 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.229 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.229 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.229 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.229 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.230 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'1" 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.231 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.907953+0000", 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.907953+0000", 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.908256+0000", 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:55.232 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.420623+0000", 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.233 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1a", 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:03:03.291025+0000", 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.234 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.235 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.236 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.236 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.236 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.236 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.236 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.236 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.236 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.236 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.236 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.236 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.236 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.236 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.236 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.237 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.238 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.554044+0000", 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.554044+0000", 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.554332+0000", 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.239 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829350+0000", 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 1, 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.240 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 1, 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1a", 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 21, 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.241 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T10:28:40.250342+0000", 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.242 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.243 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.244 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'1" 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.245 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.246 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:55.246 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.246 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.246 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.246 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.246 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.246 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.246 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:55.246 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.909974+0000", 2024-03-04T06:41:55.246 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.909974+0000", 2024-03-04T06:41:55.246 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.910445+0000", 2024-03-04T06:41:55.246 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.828709+0000", 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.247 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1b", 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.248 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.249 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.249 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:42:52.372021+0000", 2024-03-04T06:41:55.249 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.249 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.249 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.249 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.249 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.249 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.249 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.249 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.249 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.249 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.249 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.250 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.251 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.252 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.542896+0000", 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.542896+0000", 2024-03-04T06:41:55.253 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.543180+0000", 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286310+0000", 2024-03-04T06:41:55.254 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.19", 2024-03-04T06:41:55.255 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:15:09.816539+0000", 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.256 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.257 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.258 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.259 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.260 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.895201+0000", 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.895201+0000", 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.895735+0000", 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.261 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286149+0000", 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.262 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.18", 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:12:35.373175+0000", 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.263 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.264 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.265 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.266 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.267 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.268 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:55.268 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.550791+0000", 2024-03-04T06:41:55.268 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.550791+0000", 2024-03-04T06:41:55.268 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.551089+0000", 2024-03-04T06:41:55.268 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:55.268 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.268 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.268 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.268 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.268 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:55.268 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:55.268 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:55.268 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826665+0000", 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.269 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.18", 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:36:49.576267+0000", 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.270 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.271 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.272 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.272 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.272 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.272 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.272 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.272 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.272 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.272 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.272 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.272 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.272 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.272 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.272 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.273 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.273 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.273 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.273 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.273 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.273 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.273 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.273 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.273 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.273 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.273 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.273 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.273 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.274 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.908879+0000", 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.908879+0000", 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.909194+0000", 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.275 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.276 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.276 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.276 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:55.276 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:55.276 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:55.276 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.276 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.276 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.276 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:55.276 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825377+0000", 2024-03-04T06:41:55.276 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.276 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.276 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.19", 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.277 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:33:23.733425+0000", 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.278 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.279 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.280 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.281 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.543699+0000", 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.543699+0000", 2024-03-04T06:41:55.282 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.544023+0000", 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830527+0000", 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.283 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.17", 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.284 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:04:19.418372+0000", 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.285 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.286 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.287 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.288 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.903226+0000", 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.903226+0000", 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.903510+0000", 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.289 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827440+0000", 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.290 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.16", 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:49:29.474747+0000", 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.291 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.292 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.293 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.294 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.295 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.549931+0000", 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.549931+0000", 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.550879+0000", 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.296 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827349+0000", 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.297 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.16", 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:12:33.138651+0000", 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.298 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.299 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.299 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.299 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.299 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.299 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.299 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.299 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.299 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.299 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.299 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.299 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.299 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.299 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.300 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.301 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.302 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.903600+0000", 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.903600+0000", 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.903875+0000", 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:55.303 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829739+0000", 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.304 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.17", 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:24:32.774333+0000", 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.305 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.306 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.307 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.308 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.309 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.551202+0000", 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.551202+0000", 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.551496+0000", 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:55.310 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825471+0000", 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 3, 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.311 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.312 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.312 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.312 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.312 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.312 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.312 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 3, 2024-03-04T06:41:55.312 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.312 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.312 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.312 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.15", 2024-03-04T06:41:55.312 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.312 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 23, 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:27:19.526762+0000", 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 90, 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.313 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 6, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 2, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 2, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.314 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.315 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 4, 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 1 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'3" 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.316 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.911389+0000", 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.911389+0000", 2024-03-04T06:41:55.317 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.911735+0000", 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.421056+0000", 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.318 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.14", 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.319 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:50:25.284425+0000", 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.320 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.321 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.322 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.323 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.324 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.545863+0000", 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.545863+0000", 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.546352+0000", 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.325 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:40:14.857549+0000", 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 12, 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 12, 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.326 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.14", 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 32, 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T18:08:08.181131+0000", 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 2630, 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.327 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 12, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 4, 2024-03-04T06:41:55.328 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 4, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.329 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 12, 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 9 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.330 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "69'12" 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.331 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:39:46.286914+0000", 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:39:46.286914+0000", 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:39:46.287331+0000", 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 69, 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.332 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.287787+0000", 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 68, 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.333 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.15", 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 28, 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:58:41.826266+0000", 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.334 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.335 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.336 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.337 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:55.338 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.546672+0000", 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.546672+0000", 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.547028+0000", 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.339 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829162+0000", 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 2, 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.340 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 2, 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.13", 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 22, 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T11:21:00.773241+0000", 2024-03-04T06:41:55.341 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 34, 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.342 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 6, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 2, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 2, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.343 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 3, 2024-03-04T06:41:55.344 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 7 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'2" 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.345 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:39:46.286900+0000", 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:39:46.286900+0000", 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:55.346 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 69, 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.287294+0000", 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.347 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.348 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.348 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.348 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 68, 2024-03-04T06:41:55.348 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.348 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.348 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.348 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.348 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.348 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.348 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.348 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.348 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.12", 2024-03-04T06:41:55.348 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 11, 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:47:17.558117+0000", 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.349 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.350 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.351 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.352 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.353 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.549299+0000", 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.549299+0000", 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.549608+0000", 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.354 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826713+0000", 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.355 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.356 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.356 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.12", 2024-03-04T06:41:55.356 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.356 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.356 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.356 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.356 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.356 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:12:23.543702+0000", 2024-03-04T06:41:55.356 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.356 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.356 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.356 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.356 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.357 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.358 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.359 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.360 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:39:46.287549+0000", 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:39:46.287549+0000", 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:39:46.287912+0000", 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.361 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 69, 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.288214+0000", 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 68, 2024-03-04T06:41:55.362 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.13", 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 28, 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:08:21.823113+0000", 2024-03-04T06:41:55.363 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.364 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.365 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.366 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.367 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.368 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.368 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.368 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:55.368 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.368 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.368 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.368 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.368 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.368 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.368 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:55.368 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.549222+0000", 2024-03-04T06:41:55.368 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.549222+0000", 2024-03-04T06:41:55.368 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.549514+0000", 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829320+0000", 2024-03-04T06:41:55.369 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.11", 2024-03-04T06:41:55.370 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:54:24.051519+0000", 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.371 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.372 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.373 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.374 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.375 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.909146+0000", 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.909146+0000", 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.909428+0000", 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:55.376 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829229+0000", 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.377 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.10", 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:34:44.391084+0000", 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.378 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.379 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.380 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.381 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:55.382 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.543579+0000", 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.543579+0000", 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.544896+0000", 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.383 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.384 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:55.384 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:55.384 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:55.384 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.384 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.384 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.384 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:55.384 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826176+0000", 2024-03-04T06:41:55.384 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.384 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 8, 2024-03-04T06:41:55.384 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.384 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.384 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 8, 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.10", 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 28, 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.385 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:50:39.451118+0000", 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.386 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 12, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 4, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 4, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.387 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 4, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 12, 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.388 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.389 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.389 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.389 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.389 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.389 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.389 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.389 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.389 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:55.389 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'8" 2024-03-04T06:41:55.389 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.389 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.389 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.389 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.918716+0000", 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.918716+0000", 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.919018+0000", 2024-03-04T06:41:55.390 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829269+0000", 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.391 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.11", 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.392 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:06:47.029429+0000", 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.393 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.394 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.395 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.396 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:55.397 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.547867+0000", 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.547867+0000", 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.550559+0000", 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:55.398 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.421325+0000", 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 1, 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 1, 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.399 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.f", 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 21, 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:07:04.949081+0000", 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 22, 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.400 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.401 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.401 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.401 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.401 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.401 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.401 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.401 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.401 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.401 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.401 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.401 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.402 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 1, 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 1 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.403 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'1" 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.404 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.910660+0000", 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.910660+0000", 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.913566+0000", 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:55.405 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830075+0000", 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.406 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.e", 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:16:42.862745+0000", 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.407 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.408 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.408 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.408 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.408 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.408 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.408 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.408 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.408 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.408 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.408 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.408 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.408 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.408 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.409 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.410 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.411 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.376476+0000", 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.376476+0000", 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.376732+0000", 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.412 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825183+0000", 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.413 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.2", 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:21:52.679530+0000", 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.414 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.415 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.416 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.417 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.418 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.554461+0000", 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.554461+0000", 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.554795+0000", 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:55.419 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825556+0000", 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.420 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.4", 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:03:44.989709+0000", 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.421 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.422 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.423 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.424 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.425 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.896742+0000", 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.896742+0000", 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.897411+0000", 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.426 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827333+0000", 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.427 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.5", 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:14:21.032038+0000", 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.428 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.429 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.430 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.431 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.432 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.317763+0000", 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.317763+0000", 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.318044+0000", 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.433 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825618+0000", 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.434 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.4", 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:54:04.059027+0000", 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.435 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.436 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.437 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.438 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:55.439 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.548550+0000", 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.548550+0000", 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.548860+0000", 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:55.440 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826668+0000", 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.2", 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.441 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:47:43.188556+0000", 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.442 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.443 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.444 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.445 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.908227+0000", 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.908227+0000", 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.908558+0000", 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.446 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.420825+0000", 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.447 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.3", 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:39:27.394161+0000", 2024-03-04T06:41:55.448 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.449 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.449 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.449 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.449 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.449 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.449 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.449 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.449 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.449 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.449 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.449 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.449 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.449 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.450 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.451 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.452 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.376418+0000", 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.376418+0000", 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.376856+0000", 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:55.453 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825754+0000", 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.454 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.7", 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:18:43.241370+0000", 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.455 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.456 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.457 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.458 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.459 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.913896+0000", 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.913896+0000", 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.914172+0000", 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.460 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825137+0000", 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.461 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.0", 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:52:53.141176+0000", 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.462 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.463 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.464 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo OK 2024-03-04T06:41:55.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.466 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.467 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.468 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.540155+0000", 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.540155+0000", 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.540510+0000", 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:55.469 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826193+0000", 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.470 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.1", 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:56:39.660282+0000", 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.471 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.472 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.473 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:55.474 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:55.475 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.316821+0000", 2024-03-04T06:41:55.476 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.316821+0000", 2024-03-04T06:41:55.476 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.317126+0000", 2024-03-04T06:41:55.476 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:55.476 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.476 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.476 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.476 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:55.476 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:55.476 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:55.476 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:55.476 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.476 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.476 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830417+0000", 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.477 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.5", 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:38:44.635838+0000", 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.478 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.479 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.480 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.481 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.903235+0000", 2024-03-04T06:41:55.482 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.903235+0000", 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.903488+0000", 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286325+0000", 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.483 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2", 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.484 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T11:48:43.099957+0000", 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.485 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.486 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.487 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.488 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.550367+0000", 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.550367+0000", 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.550672+0000", 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.489 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826854+0000", 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.490 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.3", 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:57:27.060139+0000", 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.491 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.492 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.493 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.494 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 19, 2024-03-04T06:41:55.495 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:41:50.048606+0000", 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:37:58.309800+0000", 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:37:58.309800+0000", 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:37:58.310255+0000", 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:41:50.048606+0000", 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:35:55.260752+0000", 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:35:55.260752+0000", 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 58, 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:41:50.048606+0000", 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:41:50.048606+0000", 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:41:50.048606+0000", 2024-03-04T06:41:55.496 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:35:55.260752+0000", 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:41:50.048606+0000", 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:41:50.048606+0000", 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 144, 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 57, 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 144, 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.497 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "1.0", 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 323, 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:29:38.185918+0000", 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 590368, 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 1771104, 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.498 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 6, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 2, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 2, 2024-03-04T06:41:55.499 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 6, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 358, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 554, 2024-03-04T06:41:55.500 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 211, 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 2416 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "69'144" 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.501 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.321560+0000", 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.321560+0000", 2024-03-04T06:41:55.502 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.321870+0000", 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829334+0000", 2024-03-04T06:41:55.503 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.6", 2024-03-04T06:41:55.504 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:40:27.719672+0000", 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.505 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.506 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.507 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.508 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.508 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.508 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.508 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.508 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.508 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.508 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.508 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.508 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:55.508 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.508 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.508 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.508 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.422718+0000", 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:39:46.421792+0000", 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:39:46.421792+0000", 2024-03-04T06:41:55.509 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:39:46.422207+0000", 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.422718+0000", 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 69, 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.422718+0000", 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.422718+0000", 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.422718+0000", 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.422718+0000", 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.422718+0000", 2024-03-04T06:41:55.510 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 68, 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.1", 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.511 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 12, 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:15:08.818871+0000", 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.512 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.513 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.514 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.515 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.556594+0000", 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.556594+0000", 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.556986+0000", 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.516 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.828499+0000", 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.517 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.0", 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T10:23:52.669745+0000", 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.518 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.519 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.520 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.521 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.522 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.376532+0000", 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.376532+0000", 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.376856+0000", 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.523 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.828608+0000", 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.524 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.3", 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:33:21.206296+0000", 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.525 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.526 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.527 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.528 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.529 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.557397+0000", 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.557397+0000", 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.557967+0000", 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:55.530 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830676+0000", 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.531 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.5", 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:09:35.366465+0000", 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.532 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.533 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.534 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.535 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.536 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.905234+0000", 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.905234+0000", 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.905517+0000", 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.537 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825664+0000", 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.538 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.4", 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:32:58.487468+0000", 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.539 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.540 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.541 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.542 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.543 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.316666+0000", 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.316666+0000", 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.316978+0000", 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.544 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286049+0000", 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.545 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.0", 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:36:22.840327+0000", 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.546 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.547 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.548 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.549 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.542663+0000", 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.542663+0000", 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.542943+0000", 2024-03-04T06:41:55.550 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825891+0000", 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 1, 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.551 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 1, 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.6", 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 21, 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.552 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:14:11.583290+0000", 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.553 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.554 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 1, 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.555 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "62'1" 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.556 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.897766+0000", 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.897766+0000", 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.898034+0000", 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.557 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286968+0000", 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.558 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.7", 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:13:56.085588+0000", 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.559 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.560 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.561 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.562 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.563 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 64, 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:47.376407+0000", 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:47.376407+0000", 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:47.376747+0000", 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.564 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 65, 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:46.297983+0000", 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.420474+0000", 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 64, 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.565 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "4.1", 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 15, 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T10:01:44.463155+0000", 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.566 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.567 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.568 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.569 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.570 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.570 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.570 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.570 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.570 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.570 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.570 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:55.570 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.570 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.570 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.570 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.570 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.570 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.554544+0000", 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.554544+0000", 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.554846+0000", 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:55.571 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.572 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.572 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.572 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.572 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:55.572 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:55.572 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:55.572 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.572 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.572 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.572 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:55.572 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830437+0000", 2024-03-04T06:41:55.572 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.572 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 2, 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 2, 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.7", 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.573 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 22, 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:57:44.524183+0000", 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.574 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.575 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.576 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 3, 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'2" 2024-03-04T06:41:55.577 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.578 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.902896+0000", 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.902896+0000", 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.903163+0000", 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.579 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829433+0000", 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.580 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.6", 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:45:59.166463+0000", 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.581 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.582 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.583 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.584 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.556014+0000", 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.556014+0000", 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.556654+0000", 2024-03-04T06:41:55.585 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.828740+0000", 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.586 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.8", 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T17:44:45.975559+0000", 2024-03-04T06:41:55.587 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.588 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.589 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.590 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 4, 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.591 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.906385+0000", 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.906385+0000", 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.906674+0000", 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:55.592 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.421141+0000", 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.593 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.9", 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:29:56.436800+0000", 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.594 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.595 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.596 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 4, 2024-03-04T06:41:55.597 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:55.598 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.555150+0000", 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.555150+0000", 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.555463+0000", 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.599 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825515+0000", 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.9", 2024-03-04T06:41:55.600 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:59:30.714863+0000", 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.601 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.602 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.603 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.604 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.897568+0000", 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.897568+0000", 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.897860+0000", 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.605 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286122+0000", 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.606 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.8", 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:22:30.116519+0000", 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.607 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.608 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.609 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.610 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.611 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.555948+0000", 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.555948+0000", 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.556223+0000", 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:55.612 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825367+0000", 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.613 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.a", 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:19:51.659542+0000", 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.614 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.615 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.616 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.617 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.618 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.619 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:55.619 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.907114+0000", 2024-03-04T06:41:55.619 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.907114+0000", 2024-03-04T06:41:55.619 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.908686+0000", 2024-03-04T06:41:55.619 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:55.619 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.619 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.619 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.619 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.619 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:55.619 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:55.619 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:55.619 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286759+0000", 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.620 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.b", 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:08:03.009115+0000", 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.621 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.622 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.623 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.624 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.625 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.558068+0000", 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.558068+0000", 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.558399+0000", 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.626 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829684+0000", 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 2, 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 2, 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.627 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.b", 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 22, 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:10:00.895079+0000", 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.628 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:55.629 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.630 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 1, 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'2" 2024-03-04T06:41:55.631 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.903906+0000", 2024-03-04T06:41:55.632 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.903906+0000", 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.904212+0000", 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829249+0000", 2024-03-04T06:41:55.633 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.a", 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.634 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:27:10.766546+0000", 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.635 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.636 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.637 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.638 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.547906+0000", 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.547906+0000", 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.548200+0000", 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:55.639 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826535+0000", 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.640 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.c", 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 20, 2024-03-04T06:41:55.641 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:11:39.491360+0000", 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.642 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.643 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.644 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.645 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.918684+0000", 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.918684+0000", 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.918955+0000", 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.646 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829631+0000", 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.647 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.d", 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T06:47:29.169416+0000", 2024-03-04T06:41:55.648 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.649 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.650 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.651 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.652 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.547358+0000", 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.547358+0000", 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.547660+0000", 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.653 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825388+0000", 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 1, 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 1, 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.654 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.d", 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 21, 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:40:10.370020+0000", 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 70, 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.655 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.656 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.657 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 1, 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 1 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: 3 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'1" 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.658 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.901331+0000", 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.901331+0000", 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.902066+0000", 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:55.659 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827095+0000", 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.660 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.c", 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.661 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T08:46:51.413734+0000", 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.662 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.663 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.664 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.665 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 59, 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.547108+0000", 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.547108+0000", 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.547376+0000", 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.666 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 60, 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:11.515848+0000", 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.827564+0000", 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 2, 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 59, 2024-03-04T06:41:55.667 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 2, 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "2.e", 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 22, 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T09:34:14.300865+0000", 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.668 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.669 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 3, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 1, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 1, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 1, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.670 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 3, 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.671 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: 7 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "61'2" 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 7, 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.672 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.917001+0000", 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.917001+0000", 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.917263+0000", 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.673 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830930+0000", 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.674 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.f", 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T15:02:54.912481+0000", 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.675 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.676 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.677 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 7, 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.678 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.916669+0000", 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.916669+0000", 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.916968+0000", 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:55.679 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829629+0000", 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.680 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.20", 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.681 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T12:18:16.919063+0000", 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.682 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.683 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.684 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: 5 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.685 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 2, 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.892261+0000", 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.892261+0000", 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.892619+0000", 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.686 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826277+0000", 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.687 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.21", 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T14:19:13.957414+0000", 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.688 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.689 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.690 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: 2, 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.691 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 2, 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.692 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.898002+0000", 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.898002+0000", 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.899301+0000", 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.693 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826770+0000", 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.22", 2024-03-04T06:41:55.694 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T18:16:46.969732+0000", 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.695 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.696 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.697 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.698 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.907578+0000", 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.907578+0000", 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.908610+0000", 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.699 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.700 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:55.700 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:55.700 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:55.700 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.700 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.700 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.700 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:55.700 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.828962+0000", 2024-03-04T06:41:55.700 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.700 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.700 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.700 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.700 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.23", 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.701 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T11:40:52.078874+0000", 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.702 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.703 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.704 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.705 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.906183+0000", 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.906183+0000", 2024-03-04T06:41:55.706 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.906536+0000", 2024-03-04T06:41:55.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:55.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:55.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:55.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:55.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:55.707 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286662+0000", 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.708 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.24", 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:15:13.559021+0000", 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.709 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.710 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.711 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.712 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.712 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.712 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.712 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.712 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.713 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.713 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.713 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.713 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.713 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.713 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.713 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.713 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.713 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.713 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.713 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.713 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 1, 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.899583+0000", 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.899583+0000", 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.899871+0000", 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:55.714 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.825305+0000", 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.715 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.716 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.716 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.716 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.716 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.716 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.716 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.716 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.716 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.716 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.716 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.716 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.25", 2024-03-04T06:41:55.716 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.716 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T13:05:51.628806+0000", 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.717 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.718 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.719 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: 1, 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 1, 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.720 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.914354+0000", 2024-03-04T06:41:55.721 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.914354+0000", 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.914660+0000", 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830864+0000", 2024-03-04T06:41:55.722 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.26", 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.723 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:29:28.750455+0000", 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.724 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.725 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.726 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: 4 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.727 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.906492+0000", 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.906492+0000", 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.906752+0000", 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:55.728 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286907+0000", 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.729 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.27", 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T16:48:24.841196+0000", 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.730 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.731 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.732 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.733 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.734 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.896787+0000", 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.896787+0000", 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.897151+0000", 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.735 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.736 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.736 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:55.736 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826686+0000", 2024-03-04T06:41:55.736 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.736 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.736 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.736 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.736 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.736 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.736 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.736 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.736 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.736 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.28", 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T18:12:22.562737+0000", 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.737 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.738 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.739 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: 2 2024-03-04T06:41:55.740 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 3, 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.741 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.908021+0000", 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.908021+0000", 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.908348+0000", 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.742 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:46.286214+0000", 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.743 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.29", 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T07:16:36.050910+0000", 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.744 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.745 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.746 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: 3, 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 3, 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.747 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 5, 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.898693+0000", 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.898693+0000", 2024-03-04T06:41:55.748 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.898994+0000", 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.826842+0000", 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.749 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2a", 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.750 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T10:40:01.173992+0000", 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.751 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.752 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.753 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: 5, 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: 6 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 5, 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.754 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 0, 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.897717+0000", 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.897717+0000", 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.898036+0000", 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:55.755 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.829033+0000", 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.756 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2b", 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T06:58:02.821482+0000", 2024-03-04T06:41:55.757 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.758 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.759 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.760 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: 0, 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: 7, 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: 1 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 0, 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": [ 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.761 INFO:tasks.workunit.client.0.smithi137.stdout: "acting_primary": 6, 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "avail_no_missing": [], 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "blocked_by": [], 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "created": 60, 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "dirty_stats_invalid": false, 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_bytes_stats_invalid": false, 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "hitset_stats_invalid": false, 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "last_active": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_active": "2024-03-04T06:38:12.915335+0000", 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "last_became_peered": "2024-03-04T06:38:12.915335+0000", 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "last_change": "2024-03-04T06:38:12.915624+0000", 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "last_clean_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub": "0'0", 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "last_deep_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "last_epoch_clean": 61, 2024-03-04T06:41:55.762 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fresh": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_fullsized": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_peered": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub": "0'0", 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_duration": 0, 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_scrub_stamp": "2024-03-04T06:38:12.520695+0000", 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_undegraded": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "last_unstale": "2024-03-04T06:39:45.830126+0000", 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "log_dups_size": 0, 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "log_start": "0'0", 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "manifest_stats_invalid": false, 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "mapping_epoch": 60, 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "object_location_counts": [], 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_scrubbed": 0, 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "objects_trimmed": 0, 2024-03-04T06:41:55.763 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_stats_invalid": false, 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_start": "0'0", 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "parent": "0.0", 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "parent_split_bits": 0, 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "pgid": "3.2c", 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "pin_stats_invalid": false, 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "purged_snaps": [], 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_epoch": 69, 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "reported_seq": 19, 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_duration": 0.0, 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-05T11:52:58.038264+0000", 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrim_duration": 0.0, 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "snaptrimq_len": 0, 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.764 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.765 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.766 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.767 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.767 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.767 INFO:tasks.workunit.client.0.smithi137.stdout: "state": "active+clean", 2024-03-04T06:41:55.767 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_invalid": false, 2024-03-04T06:41:55.767 INFO:tasks.workunit.client.0.smithi137.stdout: "up": [ 2024-03-04T06:41:55.767 INFO:tasks.workunit.client.0.smithi137.stdout: 6, 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: 4, 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: 0 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: "up_primary": 6, 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: "version": "0'0" 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_per_pool": [ 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": 24, 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: "rbd" 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.768 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.769 INFO:tasks.workunit.client.0.smithi137.stdout: "num_pg": 8, 2024-03-04T06:41:55.769 INFO:tasks.workunit.client.0.smithi137.stdout: "num_store_stats": 8, 2024-03-04T06:41:55.769 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.769 INFO:tasks.workunit.client.0.smithi137.stdout: "poolid": 4, 2024-03-04T06:41:55.769 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.769 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.769 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.769 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.769 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.769 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.769 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.769 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.769 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.770 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.771 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.772 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.772 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.772 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.772 INFO:tasks.workunit.client.0.smithi137.stdout: "store_stats": { 2024-03-04T06:41:55.772 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": 0, 2024-03-04T06:41:55.772 INFO:tasks.workunit.client.0.smithi137.stdout: "available": 0, 2024-03-04T06:41:55.772 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed": 0, 2024-03-04T06:41:55.772 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_allocated": 0, 2024-03-04T06:41:55.772 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_original": 0, 2024-03-04T06:41:55.772 INFO:tasks.workunit.client.0.smithi137.stdout: "data_stored": 0, 2024-03-04T06:41:55.772 INFO:tasks.workunit.client.0.smithi137.stdout: "internal_metadata": 0, 2024-03-04T06:41:55.772 INFO:tasks.workunit.client.0.smithi137.stdout: "internally_reserved": 0, 2024-03-04T06:41:55.772 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_allocated": 0, 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: "total": 0 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: "up": 24 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": 192, 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs" 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 0, 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: "num_pg": 64, 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: "num_store_stats": 8, 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 0, 2024-03-04T06:41:55.773 INFO:tasks.workunit.client.0.smithi137.stdout: "poolid": 3, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.774 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.775 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 0, 2024-03-04T06:41:55.776 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 0 2024-03-04T06:41:55.776 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.776 INFO:tasks.workunit.client.0.smithi137.stdout: "store_stats": { 2024-03-04T06:41:55.776 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": 0, 2024-03-04T06:41:55.776 INFO:tasks.workunit.client.0.smithi137.stdout: "available": 0, 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed": 0, 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_allocated": 0, 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_original": 0, 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: "data_stored": 0, 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: "internal_metadata": 0, 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: "internally_reserved": 0, 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_allocated": 0, 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: "total": 0 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: "up": 192 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": 3, 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:55.777 INFO:tasks.workunit.client.0.smithi137.stdout: "mgr" 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 144, 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "num_pg": 1, 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "num_store_stats": 3, 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 144, 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "poolid": 1, 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 590368, 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 1771104, 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.778 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 6, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 2, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 2, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.779 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 0, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 6, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 358, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 554, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 211, 2024-03-04T06:41:55.780 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 2416 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: "store_stats": { 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": 1781760, 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: "available": 0, 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed": 0, 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_allocated": 0, 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_original": 0, 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: "data_stored": 1771104, 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: "internal_metadata": 0, 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: "internally_reserved": 0, 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_allocated": 0, 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: "total": 0 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.781 INFO:tasks.workunit.client.0.smithi137.stdout: "up": 3 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: { 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: "acting": 96, 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: "application": [ 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: "cephfs" 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: "log_size": 45, 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_pg": 32, 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_store_stats": 8, 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: "ondisk_log_size": 45, 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: "poolid": 2, 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: "stat_sum": { 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes": 3428, 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_hit_set_archive": 0, 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_bytes_recovered": 0, 2024-03-04T06:41:55.782 INFO:tasks.workunit.client.0.smithi137.stdout: "num_deep_scrub_errors": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_kb": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_full": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_evict_mode_some": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_kb": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_high": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_flush_mode_low": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_keys_recovered": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_large_omap_objects": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_legacy_snapsets": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_clones": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_object_copies": 66, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects": 22, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_degraded": 0, 2024-03-04T06:41:55.783 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_dirty": 22, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_hit_set_archive": 0, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_manifest": 0, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_misplaced": 0, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing": 0, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_missing_on_primary": 0, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_omap": 14, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_pinned": 0, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_recovered": 1, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_repaired": 0, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_objects_unfound": 0, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_bytes": 0, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_omap_keys": 0, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_promote": 0, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read": 0, 2024-03-04T06:41:55.784 INFO:tasks.workunit.client.0.smithi137.stdout: "num_read_kb": 0, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "num_scrub_errors": 0, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "num_shallow_scrub_errors": 0, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "num_whiteouts": 0, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write": 51, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "num_write_kb": 20 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "store_stats": { 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "allocated": 98304, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "available": 0, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed": 0, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_allocated": 0, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "data_compressed_original": 0, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "data_stored": 10284, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "internal_metadata": 0, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "internally_reserved": 0, 2024-03-04T06:41:55.785 INFO:tasks.workunit.client.0.smithi137.stdout: "omap_allocated": 0, 2024-03-04T06:41:55.786 INFO:tasks.workunit.client.0.smithi137.stdout: "total": 0 2024-03-04T06:41:55.786 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.786 INFO:tasks.workunit.client.0.smithi137.stdout: "up": 96 2024-03-04T06:41:55.786 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:55.786 INFO:tasks.workunit.client.0.smithi137.stdout: ], 2024-03-04T06:41:55.786 INFO:tasks.workunit.client.0.smithi137.stdout: "usage": { 2024-03-04T06:41:55.786 INFO:tasks.workunit.client.0.smithi137.stdout: "pg_num": 105, 2024-03-04T06:41:55.786 INFO:tasks.workunit.client.0.smithi137.stdout: "pools": 4, 2024-03-04T06:41:55.786 INFO:tasks.workunit.client.0.smithi137.stdout: "stats_by_class": { 2024-03-04T06:41:55.786 INFO:tasks.workunit.client.0.smithi137.stdout: "ssd": { 2024-03-04T06:41:55.786 INFO:tasks.workunit.client.0.smithi137.stdout: "total_avail_bytes": 767731417088, 2024-03-04T06:41:55.786 INFO:tasks.workunit.client.0.smithi137.stdout: "total_bytes": 767960285184, 2024-03-04T06:41:55.787 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_bytes": 228868096, 2024-03-04T06:41:55.787 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_raw_bytes": 228868096, 2024-03-04T06:41:55.787 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_raw_ratio": 0.0002980207500513643 2024-03-04T06:41:55.787 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:55.787 INFO:tasks.workunit.client.0.smithi137.stdout: }, 2024-03-04T06:41:55.787 INFO:tasks.workunit.client.0.smithi137.stdout: "total_avail_bytes": 767731417088, 2024-03-04T06:41:55.787 INFO:tasks.workunit.client.0.smithi137.stdout: "total_bytes": 767960285184, 2024-03-04T06:41:55.787 INFO:tasks.workunit.client.0.smithi137.stdout: "total_used_bytes": 228868096 2024-03-04T06:41:55.787 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:55.787 INFO:tasks.workunit.client.0.smithi137.stdout: } 2024-03-04T06:41:55.787 INFO:tasks.workunit.client.0.smithi137.stdout:} 2024-03-04T06:41:55.787 INFO:tasks.workunit.client.0.smithi137.stdout:OK 2024-03-04T06:41:55.788 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T06:41:55.788 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T06:41:55.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='client.24932 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:55.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='client.24932 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:55.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:55.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:55.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:55.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.790 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.791 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='client.24932 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:55.791 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='client.24932 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:55.791 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:55.791 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:55.791 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:55.791 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.791 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.791 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.791 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.791 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.791 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='client.24932 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:55.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='client.24932 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:55.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:55.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:55.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:55.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.794 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.796 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.796 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.796 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.796 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.796 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.796 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.796 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.796 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.796 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.796 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.796 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.796 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.796 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:54 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:55 smithi203 ceph-mon[30756]: pgmap v104: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:41:55.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:41:55.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-04T06:41:55.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.801 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.801 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-04T06:41:55.801 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-04T06:41:55.801 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:41:55.801 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:41:55.801 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:54 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:41:55.801 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:55 smithi137 ceph-mon[26846]: pgmap v104: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T06:41:55.801 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:55 smithi137 ceph-mon[37364]: pgmap v104: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T06:41:55.802 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:41:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:41:55] "GET /metrics HTTP/1.1" 200 33657 "" "Prometheus/2.43.0" 2024-03-04T06:41:55.835 INFO:tasks.workunit:Stopping ['test_telemetry_reef.sh'] on client.0... 2024-03-04T06:41:55.835 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-04T06:41:56.123 DEBUG:teuthology.parallel:result is None 2024-03-04T06:41:56.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T06:41:56.150 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T06:41:56.150 DEBUG:teuthology.orchestra.run.smithi137:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T06:41:56.216 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T06:41:56.216 INFO:teuthology.run_tasks:Running task print... 2024-03-04T06:41:56.226 INFO:teuthology.task.print:**** done end telemetry reef... 2024-03-04T06:41:56.226 INFO:teuthology.run_tasks:Running task print... 2024-03-04T06:41:56.259 INFO:teuthology.task.print:**** done start parallel 2024-03-04T06:41:56.259 INFO:teuthology.run_tasks:Running task parallel... 2024-03-04T06:41:56.310 INFO:teuthology.task.parallel:starting parallel... 2024-03-04T06:41:56.310 INFO:teuthology.task.parallel:In parallel, running task full_sequential... 2024-03-04T06:41:56.311 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-03-04T06:41:56.311 INFO:teuthology.task.print:**** done start ec-rados-default.yaml 2024-03-04T06:41:56.311 INFO:teuthology.task.full_sequential:In full_sequential, running task rados... 2024-03-04T06:41:56.313 INFO:tasks.rados:Beginning rados... 2024-03-04T06:41:56.313 INFO:tasks.rados:config is {'clients': ['client.0'], 'ec_pool': True, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 4000, 'write_append_excl': False} 2024-03-04T06:41:56.313 INFO:tasks.rados:overrides is {'admin_socket': {'branch': 'wip-yuri-testing-2024-03-01-0756'}, 'ceph': {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'create_rbd_pool': True, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'efb04e5e69d058b0c47e511cb7e10d57a92f59ae'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'default', 'sha1': 'efb04e5e69d058b0c47e511cb7e10d57a92f59ae'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'branch': 'wip-yuri-testing-2024-03-01-0756', 'sha1': 'efb04e5e69d058b0c47e511cb7e10d57a92f59ae'}} 2024-03-04T06:41:56.313 INFO:tasks.rados:config is {'clients': ['client.0'], 'ec_pool': True, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 4000, 'write_append_excl': False} 2024-03-04T06:41:56.313 INFO:tasks.rados:joining rados 2024-03-04T06:41:56.314 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-03-04T06:41:56.314 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-04T06:41:56.314 INFO:teuthology.task.print:**** done start upgrade, wait 2024-03-04T06:41:56.314 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-03-04T06:41:56.315 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi137.front.sepia.ceph.com 2024-03-04T06:41:56.315 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -e sha1=efb04e5e69d058b0c47e511cb7e10d57a92f59ae -- bash -c 'ceph config set global log_to_journald false --force' 2024-03-04T06:41:56.315 INFO:tasks.rados:clients are ['client.0', 'client.1'] 2024-03-04T06:41:56.316 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd erasure-code-profile set teuthologyprofile k=2 m=1 crush-failure-domain=osd 2024-03-04T06:41:56.530 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:41:56.536 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:41:58.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:57 smithi203 ceph-mon[30756]: pgmap v105: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 33 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-04T06:41:58.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:57 smithi137 ceph-mon[26846]: pgmap v105: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 33 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-04T06:41:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:57 smithi137 ceph-mon[37364]: pgmap v105: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 33 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-04T06:42:00.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:59 smithi203 ceph-mon[30756]: pgmap v106: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 33 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-04T06:42:00.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:59 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1303128574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-04T06:42:00.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:41:59 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:42:00.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:59 smithi137 ceph-mon[26846]: pgmap v106: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 33 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-04T06:42:00.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:59 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1303128574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-04T06:42:00.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:41:59 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:42:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:59 smithi137 ceph-mon[37364]: pgmap v106: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 33 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-04T06:42:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:59 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1303128574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-04T06:42:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:41:59 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:42:00.660 INFO:tasks.rados:starting run 0 out of 1 2024-03-04T06:42:00.660 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2024-03-04T06:42:00.660 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd pool create unique_pool_0 16 16 erasure teuthologyprofile 2024-03-04T06:42:01.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:00 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1303128574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-04T06:42:01.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:00 smithi137 ceph-mon[26846]: osdmap e70: 8 total, 8 up, 8 in 2024-03-04T06:42:01.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:00 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1303128574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-04T06:42:01.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:00 smithi137 ceph-mon[37364]: osdmap e70: 8 total, 8 up, 8 in 2024-03-04T06:42:01.116 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -e sha1=efb04e5e69d058b0c47e511cb7e10d57a92f59ae -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-03-04T06:42:01.202 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:42:01.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:00 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1303128574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-04T06:42:01.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:00 smithi203 ceph-mon[30756]: osdmap e70: 8 total, 8 up, 8 in 2024-03-04T06:42:02.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:01 smithi137 ceph-mon[26846]: pgmap v108: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 0 B/s wr, 39 op/s 2024-03-04T06:42:02.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:01 smithi137 ceph-mon[37364]: pgmap v108: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 0 B/s wr, 39 op/s 2024-03-04T06:42:02.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:01 smithi203 ceph-mon[30756]: pgmap v108: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 0 B/s wr, 39 op/s 2024-03-04T06:42:02.367 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:42:04.164 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:03 smithi137 ceph-mon[37364]: pgmap v109: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 21 op/s 2024-03-04T06:42:04.165 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:03 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1262752247' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2024-03-04T06:42:04.165 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:03 smithi137 ceph-mon[26846]: pgmap v109: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 21 op/s 2024-03-04T06:42:04.165 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:03 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1262752247' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2024-03-04T06:42:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:03 smithi203 ceph-mon[30756]: pgmap v109: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 21 op/s 2024-03-04T06:42:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:03 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1262752247' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2024-03-04T06:42:04.614 INFO:teuthology.orchestra.run.smithi137.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:42:04.878 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_0' created 2024-03-04T06:42:04.878 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:04 smithi137 ceph-mon[37364]: osdmap e71: 8 total, 8 up, 8 in 2024-03-04T06:42:04.878 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:04 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:42:04.878 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:04 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:42:04.878 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:04 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:42:04.878 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:04 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:42:04.879 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:04 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:42:04.879 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:04 smithi137 ceph-mon[26846]: osdmap e71: 8 total, 8 up, 8 in 2024-03-04T06:42:04.879 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:04 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:42:04.879 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:04 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:42:04.879 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:04 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:42:04.879 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:04 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:42:04.879 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:04 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:42:05.324 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -e sha1=efb04e5e69d058b0c47e511cb7e10d57a92f59ae -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done' 2024-03-04T06:42:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:04 smithi203 ceph-mon[30756]: osdmap e71: 8 total, 8 up, 8 in 2024-03-04T06:42:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:04 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:42:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:04 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:42:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:04 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:42:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:04 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:42:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:04 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:42:05.657 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:42:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:42:05] "GET /metrics HTTP/1.1" 200 33657 "" "Prometheus/2.43.0" 2024-03-04T06:42:05.982 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:05 smithi137 ceph-mon[26846]: from='client.24974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:efb04e5e69d058b0c47e511cb7e10d57a92f59ae", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:05.982 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:05 smithi137 ceph-mon[26846]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:42:05.982 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:05 smithi137 ceph-mon[26846]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:42:05.982 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:05 smithi137 ceph-mon[26846]: pgmap v111: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:05.983 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:05 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1262752247' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2024-03-04T06:42:05.983 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:05 smithi137 ceph-mon[26846]: osdmap e72: 8 total, 8 up, 8 in 2024-03-04T06:42:05.983 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:05 smithi137 ceph-mon[37364]: from='client.24974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:efb04e5e69d058b0c47e511cb7e10d57a92f59ae", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:05.983 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:05 smithi137 ceph-mon[37364]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:42:05.983 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:05 smithi137 ceph-mon[37364]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:42:05.983 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:05 smithi137 ceph-mon[37364]: pgmap v111: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:05.983 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:05 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1262752247' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2024-03-04T06:42:05.983 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:05 smithi137 ceph-mon[37364]: osdmap e72: 8 total, 8 up, 8 in 2024-03-04T06:42:06.004 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-03-04T06:42:06.039 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:42:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:05 smithi203 ceph-mon[30756]: from='client.24974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:efb04e5e69d058b0c47e511cb7e10d57a92f59ae", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:05 smithi203 ceph-mon[30756]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:42:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:05 smithi203 ceph-mon[30756]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:efb04e5e69d058b0c47e511cb7e10d57a92f59ae 2024-03-04T06:42:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:05 smithi203 ceph-mon[30756]: pgmap v111: 105 pgs: 105 active+clean; 580 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:05 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1262752247' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2024-03-04T06:42:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:05 smithi203 ceph-mon[30756]: osdmap e72: 8 total, 8 up, 8 in 2024-03-04T06:42:07.223 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:06 smithi137 ceph-mon[26846]: osdmap e73: 8 total, 8 up, 8 in 2024-03-04T06:42:07.223 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:06 smithi137 ceph-mon[37364]: osdmap e73: 8 total, 8 up, 8 in 2024-03-04T06:42:07.293 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:42:07.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:06 smithi203 ceph-mon[30756]: osdmap e73: 8 total, 8 up, 8 in 2024-03-04T06:42:08.119 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:42:08.120 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:07 smithi137 ceph-mon[26846]: pgmap v114: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:08.120 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:07 smithi137 ceph-mon[26846]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-04T06:42:08.120 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:07 smithi137 ceph-mon[26846]: osdmap e74: 8 total, 8 up, 8 in 2024-03-04T06:42:08.120 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:07 smithi137 ceph-mon[37364]: pgmap v114: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:08.120 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:07 smithi137 ceph-mon[37364]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-04T06:42:08.120 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:07 smithi137 ceph-mon[37364]: osdmap e74: 8 total, 8 up, 8 in 2024-03-04T06:42:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:07 smithi203 ceph-mon[30756]: pgmap v114: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:07 smithi203 ceph-mon[30756]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-04T06:42:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:07 smithi203 ceph-mon[30756]: osdmap e74: 8 total, 8 up, 8 in 2024-03-04T06:42:08.461 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:42:08.461 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (2m) 108s ago 2m 16.1M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:42:08.461 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (2m) 108s ago 2m 80.0M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:42:08.461 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (4m) 108s ago 4m 16.0M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:42:08.461 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (4m) 108s ago 4m 15.4M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:42:08.461 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,8765 running (7m) 108s ago 7m 448M - 18.2.1-696-g5cc7a767 540557f94930 994a02c2e1ef 2024-03-04T06:42:08.461 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:9283,8765 running (9m) 108s ago 9m 495M - 18.2.1-696-g5cc7a767 540557f94930 d360a32fa2a3 2024-03-04T06:42:08.461 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (9m) 108s ago 9m 50.3M 2048M 18.2.1-696-g5cc7a767 540557f94930 0279ece55dcc 2024-03-04T06:42:08.461 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (7m) 108s ago 7m 42.8M 2048M 18.2.1-696-g5cc7a767 540557f94930 c1087568a246 2024-03-04T06:42:08.461 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (7m) 108s ago 7m 39.4M 2048M 18.2.1-696-g5cc7a767 540557f94930 63f51a40232d 2024-03-04T06:42:08.461 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (2m) 108s ago 2m 11.3M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:42:08.461 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (2m) 108s ago 2m 5444k - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:42:08.461 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (7m) 108s ago 7m 43.8M 2992M 18.2.1-696-g5cc7a767 540557f94930 732ea50ff558 2024-03-04T06:42:08.462 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (6m) 108s ago 6m 44.0M 2992M 18.2.1-696-g5cc7a767 540557f94930 708139c858a7 2024-03-04T06:42:08.462 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (6m) 108s ago 6m 41.4M 2992M 18.2.1-696-g5cc7a767 540557f94930 b247adf81a73 2024-03-04T06:42:08.462 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (5m) 108s ago 5m 40.7M 2992M 18.2.1-696-g5cc7a767 540557f94930 afdbc25c9fba 2024-03-04T06:42:08.462 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (5m) 108s ago 5m 44.0M 2992M 18.2.1-696-g5cc7a767 540557f94930 d4841ffd0747 2024-03-04T06:42:08.462 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (5m) 108s ago 5m 41.1M 2992M 18.2.1-696-g5cc7a767 540557f94930 81d21771e157 2024-03-04T06:42:08.462 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (4m) 108s ago 4m 41.4M 2992M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:42:08.462 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (4m) 108s ago 4m 44.4M 2992M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:42:08.462 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (117s) 108s ago 3m 28.3M - 2.43.0 a07b618ecd1d 80efb24031c2 2024-03-04T06:42:08.919 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:42:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:42:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 3 2024-03-04T06:42:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:42:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:42:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:42:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:42:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:42:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 8 2024-03-04T06:42:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:42:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:42:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:42:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:42:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:42:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 15 2024-03-04T06:42:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:42:08.920 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:42:09.888 INFO:teuthology.orchestra.run.smithi137.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-03-04T06:42:10.218 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:09 smithi137 ceph-mon[26846]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:10.219 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:09 smithi137 ceph-mon[26846]: from='client.24986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:10.219 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:09 smithi137 ceph-mon[26846]: pgmap v116: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:10.219 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:09 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3626941672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:42:10.219 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:09 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3497608095' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T06:42:10.219 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:09 smithi137 ceph-mon[37364]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:10.219 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:09 smithi137 ceph-mon[37364]: from='client.24986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:10.219 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:09 smithi137 ceph-mon[37364]: pgmap v116: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:10.219 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:09 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3626941672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:42:10.219 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:09 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3497608095' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T06:42:10.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:09 smithi203 ceph-mon[30756]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:09 smithi203 ceph-mon[30756]: from='client.24986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:09 smithi203 ceph-mon[30756]: pgmap v116: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:09 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3626941672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:42:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:09 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3497608095' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T06:42:11.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:10 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3497608095' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-03-04T06:42:11.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:10 smithi137 ceph-mon[26846]: osdmap e75: 8 total, 8 up, 8 in 2024-03-04T06:42:11.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:10 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3497608095' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-03-04T06:42:11.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:10 smithi137 ceph-mon[37364]: osdmap e75: 8 total, 8 up, 8 in 2024-03-04T06:42:11.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:10 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3497608095' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-03-04T06:42:11.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:10 smithi203 ceph-mon[30756]: osdmap e75: 8 total, 8 up, 8 in 2024-03-04T06:42:11.608 DEBUG:teuthology.orchestra.run.smithi137:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0 2024-03-04T06:42:11.635 INFO:tasks.rados.rados.0.smithi137.stdout:adding op weight read -> 100 2024-03-04T06:42:11.636 INFO:tasks.rados.rados.0.smithi137.stdout:adding op weight delete -> 50 2024-03-04T06:42:11.636 INFO:tasks.rados.rados.0.smithi137.stdout:adding op weight snap_create -> 50 2024-03-04T06:42:11.636 INFO:tasks.rados.rados.0.smithi137.stdout:adding op weight snap_remove -> 50 2024-03-04T06:42:11.636 INFO:tasks.rados.rados.0.smithi137.stdout:adding op weight rollback -> 50 2024-03-04T06:42:11.636 INFO:tasks.rados.rados.0.smithi137.stdout:adding op weight setattr -> 25 2024-03-04T06:42:11.636 INFO:tasks.rados.rados.0.smithi137.stdout:adding op weight rmattr -> 25 2024-03-04T06:42:11.636 INFO:tasks.rados.rados.0.smithi137.stdout:adding op weight copy_from -> 50 2024-03-04T06:42:11.636 INFO:tasks.rados.rados.0.smithi137.stdout:adding op weight append -> 100 2024-03-04T06:42:11.636 INFO:tasks.rados.rados.0.smithi137.stdout:ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable) 2024-03-04T06:42:11.636 INFO:tasks.rados.rados.0.smithi137.stdout:Configuration: 2024-03-04T06:42:11.636 INFO:tasks.rados.rados.0.smithi137.stdout: Number of operations: 4000 2024-03-04T06:42:11.636 INFO:tasks.rados.rados.0.smithi137.stdout: Number of objects: 50 2024-03-04T06:42:11.636 INFO:tasks.rados.rados.0.smithi137.stdout: Max in flight operations: 16 2024-03-04T06:42:11.637 INFO:tasks.rados.rados.0.smithi137.stdout: Object size (in bytes): 4000000 2024-03-04T06:42:11.637 INFO:tasks.rados.rados.0.smithi137.stdout: Write stride min: 400000 2024-03-04T06:42:11.637 INFO:tasks.rados.rados.0.smithi137.stdout: Write stride max: 800000 2024-03-04T06:42:12.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:11 smithi137 ceph-mon[26846]: pgmap v118: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:11 smithi137 ceph-mon[26846]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-04T06:42:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:11 smithi137 ceph-mon[26846]: Cluster is now healthy 2024-03-04T06:42:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:11 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1224025142' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-03-04T06:42:12.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:11 smithi137 ceph-mon[37364]: pgmap v118: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:12.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:11 smithi137 ceph-mon[37364]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-04T06:42:12.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:11 smithi137 ceph-mon[37364]: Cluster is now healthy 2024-03-04T06:42:12.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:11 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1224025142' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-03-04T06:42:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:11 smithi203 ceph-mon[30756]: pgmap v118: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:11 smithi203 ceph-mon[30756]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-04T06:42:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:11 smithi203 ceph-mon[30756]: Cluster is now healthy 2024-03-04T06:42:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:11 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1224025142' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-03-04T06:42:12.348 INFO:tasks.rados.rados.0.smithi137.stdout:1: write initial oid 1 2024-03-04T06:42:12.348 INFO:tasks.rados.rados.0.smithi137.stdout:1: seq_num 0 ranges {0=24576} 2024-03-04T06:42:12.348 INFO:tasks.rados.rados.0.smithi137.stdout:1: writing smithi13777483-1 from 0 to 24576 tid 1 2024-03-04T06:42:12.348 INFO:tasks.rados.rados.0.smithi137.stdout:2: write initial oid 2 2024-03-04T06:42:12.348 INFO:tasks.rados.rados.0.smithi137.stdout:2: seq_num 1 ranges {0=24576} 2024-03-04T06:42:12.348 INFO:tasks.rados.rados.0.smithi137.stdout:2: writing smithi13777483-2 from 0 to 24576 tid 1 2024-03-04T06:42:12.348 INFO:tasks.rados.rados.0.smithi137.stdout:3: write initial oid 3 2024-03-04T06:42:12.348 INFO:tasks.rados.rados.0.smithi137.stdout:3: seq_num 2 ranges {0=40960} 2024-03-04T06:42:12.348 INFO:tasks.rados.rados.0.smithi137.stdout:3: writing smithi13777483-3 from 0 to 40960 tid 1 2024-03-04T06:42:12.348 INFO:tasks.rados.rados.0.smithi137.stdout:4: write initial oid 4 2024-03-04T06:42:12.349 INFO:tasks.rados.rados.0.smithi137.stdout:4: seq_num 3 ranges {0=57344} 2024-03-04T06:42:12.349 INFO:tasks.rados.rados.0.smithi137.stdout:4: writing smithi13777483-4 from 0 to 57344 tid 1 2024-03-04T06:42:12.349 INFO:tasks.rados.rados.0.smithi137.stdout:5: write initial oid 5 2024-03-04T06:42:12.349 INFO:tasks.rados.rados.0.smithi137.stdout:5: seq_num 4 ranges {0=73728} 2024-03-04T06:42:12.349 INFO:tasks.rados.rados.0.smithi137.stdout:5: writing smithi13777483-5 from 0 to 73728 tid 1 2024-03-04T06:42:12.350 INFO:tasks.rados.rados.0.smithi137.stdout:6: write initial oid 6 2024-03-04T06:42:12.350 INFO:tasks.rados.rados.0.smithi137.stdout:6: seq_num 5 ranges {0=90112} 2024-03-04T06:42:12.350 INFO:tasks.rados.rados.0.smithi137.stdout:6: writing smithi13777483-6 from 0 to 90112 tid 1 2024-03-04T06:42:12.350 INFO:tasks.rados.rados.0.smithi137.stdout:7: write initial oid 7 2024-03-04T06:42:12.350 INFO:tasks.rados.rados.0.smithi137.stdout:7: seq_num 6 ranges {0=106496} 2024-03-04T06:42:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:7: writing smithi13777483-7 from 0 to 106496 tid 1 2024-03-04T06:42:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:8: write initial oid 8 2024-03-04T06:42:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:8: seq_num 7 ranges {0=122880} 2024-03-04T06:42:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:8: writing smithi13777483-8 from 0 to 122880 tid 1 2024-03-04T06:42:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:9: write initial oid 9 2024-03-04T06:42:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:9: seq_num 8 ranges {0=139264} 2024-03-04T06:42:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:9: writing smithi13777483-9 from 0 to 139264 tid 1 2024-03-04T06:42:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:10: write initial oid 10 2024-03-04T06:42:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:10: seq_num 9 ranges {0=155648} 2024-03-04T06:42:12.356 INFO:tasks.rados.rados.0.smithi137.stdout:10: writing smithi13777483-10 from 0 to 155648 tid 1 2024-03-04T06:42:12.356 INFO:tasks.rados.rados.0.smithi137.stdout:11: write initial oid 11 2024-03-04T06:42:12.356 INFO:tasks.rados.rados.0.smithi137.stdout:11: seq_num 10 ranges {0=172032} 2024-03-04T06:42:12.357 INFO:tasks.rados.rados.0.smithi137.stdout:11: writing smithi13777483-11 from 0 to 172032 tid 1 2024-03-04T06:42:12.357 INFO:tasks.rados.rados.0.smithi137.stdout:12: write initial oid 12 2024-03-04T06:42:12.357 INFO:tasks.rados.rados.0.smithi137.stdout:12: seq_num 11 ranges {0=188416} 2024-03-04T06:42:12.359 INFO:tasks.rados.rados.0.smithi137.stdout:12: writing smithi13777483-12 from 0 to 188416 tid 1 2024-03-04T06:42:12.359 INFO:tasks.rados.rados.0.smithi137.stdout:13: write initial oid 13 2024-03-04T06:42:12.359 INFO:tasks.rados.rados.0.smithi137.stdout:13: seq_num 12 ranges {0=204800} 2024-03-04T06:42:12.361 INFO:tasks.rados.rados.0.smithi137.stdout:13: writing smithi13777483-13 from 0 to 204800 tid 1 2024-03-04T06:42:12.361 INFO:tasks.rados.rados.0.smithi137.stdout:14: write initial oid 14 2024-03-04T06:42:12.361 INFO:tasks.rados.rados.0.smithi137.stdout:1: finishing write tid 1 to smithi13777483-1 2024-03-04T06:42:12.361 INFO:tasks.rados.rados.0.smithi137.stdout:4: finishing write tid 1 to smithi13777483-4 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:4: finishing write tid 2 to smithi13777483-4 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:4: finishing write tid 3 to smithi13777483-4 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:4: oid 4 updating version 0 to 1 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:4: oid 4 updating version 1 to 2 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 2 (ObjNum 3 snap 0 seq_num 3) dirty exists 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:3: finishing write tid 1 to smithi13777483-3 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:3: finishing write tid 2 to smithi13777483-3 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:1: finishing write tid 2 to smithi13777483-1 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:5: finishing write tid 1 to smithi13777483-5 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:5: finishing write tid 2 to smithi13777483-5 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:2: finishing write tid 1 to smithi13777483-2 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:2: finishing write tid 2 to smithi13777483-2 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:1: finishing write tid 3 to smithi13777483-1 2024-03-04T06:42:12.362 INFO:tasks.rados.rados.0.smithi137.stdout:1: oid 1 updating version 0 to 1 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:1: oid 1 updating version 1 to 2 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 2 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:2: finishing write tid 3 to smithi13777483-2 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:2: oid 2 updating version 0 to 3 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:2: oid 2 updating version 3 to 4 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 4 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:3: finishing write tid 3 to smithi13777483-3 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:3: oid 3 updating version 0 to 1 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:3: oid 3 updating version 1 to 2 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 2 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:5: finishing write tid 3 to smithi13777483-5 2024-03-04T06:42:12.363 INFO:tasks.rados.rados.0.smithi137.stdout:5: oid 5 updating version 0 to 3 2024-03-04T06:42:12.364 INFO:tasks.rados.rados.0.smithi137.stdout:5: oid 5 updating version 3 to 4 2024-03-04T06:42:12.364 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 4 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-03-04T06:42:12.364 INFO:tasks.rados.rados.0.smithi137.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2024-03-04T06:42:12.364 INFO:tasks.rados.rados.0.smithi137.stdout:9: finishing write tid 1 to smithi13777483-9 2024-03-04T06:42:12.364 INFO:tasks.rados.rados.0.smithi137.stdout:7: finishing write tid 1 to smithi13777483-7 2024-03-04T06:42:12.364 INFO:tasks.rados.rados.0.smithi137.stdout:14: seq_num 13 ranges {0=221184} 2024-03-04T06:42:12.365 INFO:tasks.rados.rados.0.smithi137.stdout:14: writing smithi13777483-14 from 0 to 221184 tid 1 2024-03-04T06:42:12.365 INFO:tasks.rados.rados.0.smithi137.stdout:7: finishing write tid 2 to smithi13777483-7 2024-03-04T06:42:12.365 INFO:tasks.rados.rados.0.smithi137.stdout:6: finishing write tid 1 to smithi13777483-6 2024-03-04T06:42:12.365 INFO:tasks.rados.rados.0.smithi137.stdout:6: finishing write tid 2 to smithi13777483-6 2024-03-04T06:42:12.365 INFO:tasks.rados.rados.0.smithi137.stdout:1: done (13 left) 2024-03-04T06:42:12.365 INFO:tasks.rados.rados.0.smithi137.stdout:2: done (12 left) 2024-03-04T06:42:12.365 INFO:tasks.rados.rados.0.smithi137.stdout:3: done (11 left) 2024-03-04T06:42:12.365 INFO:tasks.rados.rados.0.smithi137.stdout:4: done (10 left) 2024-03-04T06:42:12.365 INFO:tasks.rados.rados.0.smithi137.stdout:5: done (9 left) 2024-03-04T06:42:12.365 INFO:tasks.rados.rados.0.smithi137.stdout:15: write initial oid 15 2024-03-04T06:42:12.365 INFO:tasks.rados.rados.0.smithi137.stdout:15: seq_num 14 ranges {0=237568} 2024-03-04T06:42:12.365 INFO:tasks.rados.rados.0.smithi137.stdout:15: writing smithi13777483-15 from 0 to 237568 tid 1 2024-03-04T06:42:12.366 INFO:tasks.rados.rados.0.smithi137.stdout:16: write initial oid 16 2024-03-04T06:42:12.366 INFO:tasks.rados.rados.0.smithi137.stdout:16: seq_num 15 ranges {0=253952} 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:16: writing smithi13777483-16 from 0 to 253952 tid 1 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:6: finishing write tid 3 to smithi13777483-6 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:6: oid 6 updating version 0 to 1 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:6: oid 6 updating version 1 to 2 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 2 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:9: finishing write tid 2 to smithi13777483-9 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:10: finishing write tid 1 to smithi13777483-10 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:10: finishing write tid 2 to smithi13777483-10 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:7: finishing write tid 3 to smithi13777483-7 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:7: oid 7 updating version 0 to 1 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:7: oid 7 updating version 1 to 2 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-03-04T06:42:12.368 INFO:tasks.rados.rados.0.smithi137.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:8: finishing write tid 1 to smithi13777483-8 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:8: finishing write tid 2 to smithi13777483-8 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:13: finishing write tid 1 to smithi13777483-13 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:14: finishing write tid 1 to smithi13777483-14 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:14: finishing write tid 2 to smithi13777483-14 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:13: finishing write tid 2 to smithi13777483-13 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:9: finishing write tid 3 to smithi13777483-9 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:9: oid 9 updating version 0 to 5 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:9: oid 9 updating version 5 to 6 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 6 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:10: finishing write tid 3 to smithi13777483-10 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:10: oid 10 updating version 0 to 7 2024-03-04T06:42:12.369 INFO:tasks.rados.rados.0.smithi137.stdout:10: oid 10 updating version 7 to 8 2024-03-04T06:42:12.370 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 8 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-03-04T06:42:12.370 INFO:tasks.rados.rados.0.smithi137.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2024-03-04T06:42:12.370 INFO:tasks.rados.rados.0.smithi137.stdout:11: finishing write tid 1 to smithi13777483-11 2024-03-04T06:42:12.370 INFO:tasks.rados.rados.0.smithi137.stdout:8: finishing write tid 3 to smithi13777483-8 2024-03-04T06:42:12.370 INFO:tasks.rados.rados.0.smithi137.stdout:8: oid 8 updating version 0 to 3 2024-03-04T06:42:12.370 INFO:tasks.rados.rados.0.smithi137.stdout:8: oid 8 updating version 3 to 4 2024-03-04T06:42:12.370 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 4 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-03-04T06:42:12.370 INFO:tasks.rados.rados.0.smithi137.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2024-03-04T06:42:12.370 INFO:tasks.rados.rados.0.smithi137.stdout:11: finishing write tid 2 to smithi13777483-11 2024-03-04T06:42:12.370 INFO:tasks.rados.rados.0.smithi137.stdout:11: finishing write tid 3 to smithi13777483-11 2024-03-04T06:42:12.370 INFO:tasks.rados.rados.0.smithi137.stdout:11: oid 11 updating version 0 to 5 2024-03-04T06:42:12.370 INFO:tasks.rados.rados.0.smithi137.stdout:11: oid 11 updating version 5 to 6 2024-03-04T06:42:12.370 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 6 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:13: finishing write tid 3 to smithi13777483-13 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:13: oid 13 updating version 0 to 2 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:13: oid 13 version 2 is already newer than 1 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 2 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:12: finishing write tid 1 to smithi13777483-12 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:12: finishing write tid 2 to smithi13777483-12 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:6: done (10 left) 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:7: done (9 left) 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:8: done (8 left) 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:9: done (7 left) 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:10: done (6 left) 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:11: done (5 left) 2024-03-04T06:42:12.371 INFO:tasks.rados.rados.0.smithi137.stdout:13: done (4 left) 2024-03-04T06:42:12.372 INFO:tasks.rados.rados.0.smithi137.stdout:17: write initial oid 17 2024-03-04T06:42:12.372 INFO:tasks.rados.rados.0.smithi137.stdout:17: seq_num 16 ranges {0=270336} 2024-03-04T06:42:12.372 INFO:tasks.rados.rados.0.smithi137.stdout:17: writing smithi13777483-17 from 0 to 270336 tid 1 2024-03-04T06:42:12.373 INFO:tasks.rados.rados.0.smithi137.stdout:18: write initial oid 18 2024-03-04T06:42:12.373 INFO:tasks.rados.rados.0.smithi137.stdout:18: seq_num 17 ranges {0=286720} 2024-03-04T06:42:12.373 INFO:tasks.rados.rados.0.smithi137.stdout:18: writing smithi13777483-18 from 0 to 286720 tid 1 2024-03-04T06:42:12.373 INFO:tasks.rados.rados.0.smithi137.stdout:19: write initial oid 19 2024-03-04T06:42:12.373 INFO:tasks.rados.rados.0.smithi137.stdout:19: seq_num 18 ranges {0=303104} 2024-03-04T06:42:12.374 INFO:tasks.rados.rados.0.smithi137.stdout:19: writing smithi13777483-19 from 0 to 303104 tid 1 2024-03-04T06:42:12.374 INFO:tasks.rados.rados.0.smithi137.stdout:20: write initial oid 20 2024-03-04T06:42:12.374 INFO:tasks.rados.rados.0.smithi137.stdout:20: seq_num 19 ranges {0=319488} 2024-03-04T06:42:12.375 INFO:tasks.rados.rados.0.smithi137.stdout:20: writing smithi13777483-20 from 0 to 319488 tid 1 2024-03-04T06:42:12.375 INFO:tasks.rados.rados.0.smithi137.stdout:21: write initial oid 21 2024-03-04T06:42:12.375 INFO:tasks.rados.rados.0.smithi137.stdout:21: seq_num 20 ranges {0=344064} 2024-03-04T06:42:12.377 INFO:tasks.rados.rados.0.smithi137.stdout:21: writing smithi13777483-21 from 0 to 344064 tid 1 2024-03-04T06:42:12.377 INFO:tasks.rados.rados.0.smithi137.stdout:22: write initial oid 22 2024-03-04T06:42:12.377 INFO:tasks.rados.rados.0.smithi137.stdout:22: seq_num 21 ranges {0=360448} 2024-03-04T06:42:12.379 INFO:tasks.rados.rados.0.smithi137.stdout:22: writing smithi13777483-22 from 0 to 360448 tid 1 2024-03-04T06:42:12.379 INFO:tasks.rados.rados.0.smithi137.stdout:23: write initial oid 23 2024-03-04T06:42:12.380 INFO:tasks.rados.rados.0.smithi137.stdout:23: seq_num 22 ranges {0=376832} 2024-03-04T06:42:12.381 INFO:tasks.rados.rados.0.smithi137.stdout:23: writing smithi13777483-23 from 0 to 376832 tid 1 2024-03-04T06:42:12.382 INFO:tasks.rados.rados.0.smithi137.stdout:24: write initial oid 24 2024-03-04T06:42:12.382 INFO:tasks.rados.rados.0.smithi137.stdout:24: seq_num 23 ranges {0=393216} 2024-03-04T06:42:12.384 INFO:tasks.rados.rados.0.smithi137.stdout:24: writing smithi13777483-24 from 0 to 393216 tid 1 2024-03-04T06:42:12.384 INFO:tasks.rados.rados.0.smithi137.stdout:25: write initial oid 25 2024-03-04T06:42:12.384 INFO:tasks.rados.rados.0.smithi137.stdout:25: seq_num 24 ranges {0=409600} 2024-03-04T06:42:12.386 INFO:tasks.rados.rados.0.smithi137.stdout:25: writing smithi13777483-25 from 0 to 409600 tid 1 2024-03-04T06:42:12.386 INFO:tasks.rados.rados.0.smithi137.stdout:26: write initial oid 26 2024-03-04T06:42:12.386 INFO:tasks.rados.rados.0.smithi137.stdout:26: seq_num 25 ranges {0=425984} 2024-03-04T06:42:12.391 INFO:tasks.rados.rados.0.smithi137.stdout:26: writing smithi13777483-26 from 0 to 425984 tid 1 2024-03-04T06:42:12.391 INFO:tasks.rados.rados.0.smithi137.stdout:14: finishing write tid 3 to smithi13777483-14 2024-03-04T06:42:12.391 INFO:tasks.rados.rados.0.smithi137.stdout:14: oid 14 updating version 0 to 2 2024-03-04T06:42:12.391 INFO:tasks.rados.rados.0.smithi137.stdout:14: oid 14 version 2 is already newer than 1 2024-03-04T06:42:12.391 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 2 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-03-04T06:42:12.391 INFO:tasks.rados.rados.0.smithi137.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2024-03-04T06:42:12.391 INFO:tasks.rados.rados.0.smithi137.stdout:15: finishing write tid 1 to smithi13777483-15 2024-03-04T06:42:12.391 INFO:tasks.rados.rados.0.smithi137.stdout:12: finishing write tid 3 to smithi13777483-12 2024-03-04T06:42:12.391 INFO:tasks.rados.rados.0.smithi137.stdout:12: oid 12 updating version 0 to 1 2024-03-04T06:42:12.391 INFO:tasks.rados.rados.0.smithi137.stdout:12: oid 12 updating version 1 to 2 2024-03-04T06:42:12.391 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 2 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-03-04T06:42:12.391 INFO:tasks.rados.rados.0.smithi137.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2024-03-04T06:42:12.391 INFO:tasks.rados.rados.0.smithi137.stdout:15: finishing write tid 2 to smithi13777483-15 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:16: finishing write tid 1 to smithi13777483-16 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:16: finishing write tid 2 to smithi13777483-16 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:15: finishing write tid 3 to smithi13777483-15 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:15: oid 15 updating version 0 to 4 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:15: oid 15 version 4 is already newer than 3 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 4 (ObjNum 14 snap 0 seq_num 14) dirty exists 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:17: finishing write tid 1 to smithi13777483-17 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:17: finishing write tid 2 to smithi13777483-17 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:16: finishing write tid 3 to smithi13777483-16 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:16: oid 16 updating version 0 to 1 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:16: oid 16 updating version 1 to 2 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 2 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-03-04T06:42:12.392 INFO:tasks.rados.rados.0.smithi137.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:18: finishing write tid 1 to smithi13777483-18 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:18: finishing write tid 2 to smithi13777483-18 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:17: finishing write tid 3 to smithi13777483-17 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:17: oid 17 updating version 0 to 1 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:17: oid 17 updating version 1 to 2 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 2 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:19: finishing write tid 1 to smithi13777483-19 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:19: finishing write tid 2 to smithi13777483-19 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:18: finishing write tid 3 to smithi13777483-18 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:18: oid 18 updating version 0 to 1 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:18: oid 18 updating version 1 to 2 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 2 (ObjNum 17 snap 0 seq_num 17) dirty exists 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:19: finishing write tid 3 to smithi13777483-19 2024-03-04T06:42:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:19: oid 19 updating version 0 to 10 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:19: oid 19 version 10 is already newer than 9 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 10 (ObjNum 18 snap 0 seq_num 18) dirty exists 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:20: finishing write tid 1 to smithi13777483-20 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:20: finishing write tid 2 to smithi13777483-20 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:21: finishing write tid 1 to smithi13777483-21 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:21: finishing write tid 2 to smithi13777483-21 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:20: finishing write tid 3 to smithi13777483-20 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:20: oid 20 updating version 0 to 4 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:20: oid 20 version 4 is already newer than 3 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 4 (ObjNum 19 snap 0 seq_num 19) dirty exists 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:22: finishing write tid 1 to smithi13777483-22 2024-03-04T06:42:12.394 INFO:tasks.rados.rados.0.smithi137.stdout:22: finishing write tid 2 to smithi13777483-22 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:21: finishing write tid 3 to smithi13777483-21 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:21: oid 21 updating version 0 to 1 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:21: oid 21 updating version 1 to 2 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 2 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:23: finishing write tid 1 to smithi13777483-23 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:22: finishing write tid 3 to smithi13777483-22 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:22: oid 22 updating version 0 to 5 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:22: oid 22 updating version 5 to 6 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 6 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:23: finishing write tid 2 to smithi13777483-23 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:23: finishing write tid 3 to smithi13777483-23 2024-03-04T06:42:12.395 INFO:tasks.rados.rados.0.smithi137.stdout:23: oid 23 updating version 0 to 5 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:23: oid 23 updating version 5 to 6 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 6 (ObjNum 22 snap 0 seq_num 22) dirty exists 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:24: finishing write tid 1 to smithi13777483-24 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:24: finishing write tid 2 to smithi13777483-24 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:25: finishing write tid 1 to smithi13777483-25 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:25: finishing write tid 2 to smithi13777483-25 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:12: done (13 left) 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:14: done (12 left) 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:15: done (11 left) 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:16: done (10 left) 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:17: done (9 left) 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:18: done (8 left) 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:19: done (7 left) 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:20: done (6 left) 2024-03-04T06:42:12.396 INFO:tasks.rados.rados.0.smithi137.stdout:21: done (5 left) 2024-03-04T06:42:12.397 INFO:tasks.rados.rados.0.smithi137.stdout:22: done (4 left) 2024-03-04T06:42:12.397 INFO:tasks.rados.rados.0.smithi137.stdout:23: done (3 left) 2024-03-04T06:42:12.397 INFO:tasks.rados.rados.0.smithi137.stdout:27: write initial oid 27 2024-03-04T06:42:12.397 INFO:tasks.rados.rados.0.smithi137.stdout:27: seq_num 26 ranges {0=442368} 2024-03-04T06:42:12.398 INFO:tasks.rados.rados.0.smithi137.stdout:27: writing smithi13777483-27 from 0 to 442368 tid 1 2024-03-04T06:42:12.398 INFO:tasks.rados.rados.0.smithi137.stdout:24: finishing write tid 3 to smithi13777483-24 2024-03-04T06:42:12.398 INFO:tasks.rados.rados.0.smithi137.stdout:24: oid 24 updating version 0 to 2 2024-03-04T06:42:12.398 INFO:tasks.rados.rados.0.smithi137.stdout:24: oid 24 version 2 is already newer than 1 2024-03-04T06:42:12.398 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 2 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-03-04T06:42:12.398 INFO:tasks.rados.rados.0.smithi137.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2024-03-04T06:42:12.398 INFO:tasks.rados.rados.0.smithi137.stdout:25: finishing write tid 3 to smithi13777483-25 2024-03-04T06:42:12.398 INFO:tasks.rados.rados.0.smithi137.stdout:25: oid 25 updating version 0 to 4 2024-03-04T06:42:12.398 INFO:tasks.rados.rados.0.smithi137.stdout:25: oid 25 version 4 is already newer than 3 2024-03-04T06:42:12.398 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 4 (ObjNum 24 snap 0 seq_num 24) dirty exists 2024-03-04T06:42:12.398 INFO:tasks.rados.rados.0.smithi137.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2024-03-04T06:42:12.398 INFO:tasks.rados.rados.0.smithi137.stdout:26: finishing write tid 1 to smithi13777483-26 2024-03-04T06:42:12.398 INFO:tasks.rados.rados.0.smithi137.stdout:26: finishing write tid 2 to smithi13777483-26 2024-03-04T06:42:12.399 INFO:tasks.rados.rados.0.smithi137.stdout:24: done (3 left) 2024-03-04T06:42:12.399 INFO:tasks.rados.rados.0.smithi137.stdout:25: done (2 left) 2024-03-04T06:42:12.399 INFO:tasks.rados.rados.0.smithi137.stdout:28: write initial oid 28 2024-03-04T06:42:12.399 INFO:tasks.rados.rados.0.smithi137.stdout:28: seq_num 27 ranges {0=458752} 2024-03-04T06:42:12.399 INFO:tasks.rados.rados.0.smithi137.stdout:28: writing smithi13777483-28 from 0 to 458752 tid 1 2024-03-04T06:42:12.399 INFO:tasks.rados.rados.0.smithi137.stdout:29: write initial oid 29 2024-03-04T06:42:12.399 INFO:tasks.rados.rados.0.smithi137.stdout:29: seq_num 28 ranges {0=475136} 2024-03-04T06:42:12.399 INFO:tasks.rados.rados.0.smithi137.stdout:29: writing smithi13777483-29 from 0 to 475136 tid 1 2024-03-04T06:42:12.400 INFO:tasks.rados.rados.0.smithi137.stdout:30: write initial oid 30 2024-03-04T06:42:12.400 INFO:tasks.rados.rados.0.smithi137.stdout:30: seq_num 29 ranges {0=491520} 2024-03-04T06:42:12.402 INFO:tasks.rados.rados.0.smithi137.stdout:30: writing smithi13777483-30 from 0 to 491520 tid 1 2024-03-04T06:42:12.402 INFO:tasks.rados.rados.0.smithi137.stdout:31: write initial oid 31 2024-03-04T06:42:12.402 INFO:tasks.rados.rados.0.smithi137.stdout:31: seq_num 30 ranges {0=507904} 2024-03-04T06:42:12.405 INFO:tasks.rados.rados.0.smithi137.stdout:31: writing smithi13777483-31 from 0 to 507904 tid 1 2024-03-04T06:42:12.405 INFO:tasks.rados.rados.0.smithi137.stdout:32: write initial oid 32 2024-03-04T06:42:12.405 INFO:tasks.rados.rados.0.smithi137.stdout:32: seq_num 31 ranges {0=524288} 2024-03-04T06:42:12.408 INFO:tasks.rados.rados.0.smithi137.stdout:32: writing smithi13777483-32 from 0 to 524288 tid 1 2024-03-04T06:42:12.408 INFO:tasks.rados.rados.0.smithi137.stdout:33: write initial oid 33 2024-03-04T06:42:12.408 INFO:tasks.rados.rados.0.smithi137.stdout:33: seq_num 32 ranges {0=540672} 2024-03-04T06:42:12.411 INFO:tasks.rados.rados.0.smithi137.stdout:33: writing smithi13777483-33 from 0 to 540672 tid 1 2024-03-04T06:42:12.412 INFO:tasks.rados.rados.0.smithi137.stdout:34: write initial oid 34 2024-03-04T06:42:12.412 INFO:tasks.rados.rados.0.smithi137.stdout:34: seq_num 33 ranges {0=557056} 2024-03-04T06:42:12.415 INFO:tasks.rados.rados.0.smithi137.stdout:34: writing smithi13777483-34 from 0 to 557056 tid 1 2024-03-04T06:42:12.415 INFO:tasks.rados.rados.0.smithi137.stdout:35: write initial oid 35 2024-03-04T06:42:12.415 INFO:tasks.rados.rados.0.smithi137.stdout:35: seq_num 34 ranges {0=573440} 2024-03-04T06:42:12.419 INFO:tasks.rados.rados.0.smithi137.stdout:35: writing smithi13777483-35 from 0 to 573440 tid 1 2024-03-04T06:42:12.419 INFO:tasks.rados.rados.0.smithi137.stdout:36: write initial oid 36 2024-03-04T06:42:12.419 INFO:tasks.rados.rados.0.smithi137.stdout:36: seq_num 35 ranges {0=589824} 2024-03-04T06:42:12.422 INFO:tasks.rados.rados.0.smithi137.stdout:36: writing smithi13777483-36 from 0 to 589824 tid 1 2024-03-04T06:42:12.422 INFO:tasks.rados.rados.0.smithi137.stdout:37: write initial oid 37 2024-03-04T06:42:12.423 INFO:tasks.rados.rados.0.smithi137.stdout:37: seq_num 36 ranges {0=606208} 2024-03-04T06:42:12.426 INFO:tasks.rados.rados.0.smithi137.stdout:37: writing smithi13777483-37 from 0 to 606208 tid 1 2024-03-04T06:42:12.426 INFO:tasks.rados.rados.0.smithi137.stdout:38: write initial oid 38 2024-03-04T06:42:12.426 INFO:tasks.rados.rados.0.smithi137.stdout:38: seq_num 37 ranges {0=622592} 2024-03-04T06:42:12.430 INFO:tasks.rados.rados.0.smithi137.stdout:38: writing smithi13777483-38 from 0 to 622592 tid 1 2024-03-04T06:42:12.430 INFO:tasks.rados.rados.0.smithi137.stdout:39: write initial oid 39 2024-03-04T06:42:12.430 INFO:tasks.rados.rados.0.smithi137.stdout:39: seq_num 38 ranges {0=638976} 2024-03-04T06:42:12.434 INFO:tasks.rados.rados.0.smithi137.stdout:39: writing smithi13777483-39 from 0 to 638976 tid 1 2024-03-04T06:42:12.434 INFO:tasks.rados.rados.0.smithi137.stdout:40: write initial oid 40 2024-03-04T06:42:12.434 INFO:tasks.rados.rados.0.smithi137.stdout:40: seq_num 39 ranges {0=663552} 2024-03-04T06:42:12.438 INFO:tasks.rados.rados.0.smithi137.stdout:40: writing smithi13777483-40 from 0 to 663552 tid 1 2024-03-04T06:42:12.438 INFO:tasks.rados.rados.0.smithi137.stdout:26: finishing write tid 3 to smithi13777483-26 2024-03-04T06:42:12.438 INFO:tasks.rados.rados.0.smithi137.stdout:26: oid 26 updating version 0 to 3 2024-03-04T06:42:12.438 INFO:tasks.rados.rados.0.smithi137.stdout:26: oid 26 updating version 3 to 4 2024-03-04T06:42:12.438 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 4 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:27: finishing write tid 1 to smithi13777483-27 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:27: finishing write tid 2 to smithi13777483-27 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:27: finishing write tid 3 to smithi13777483-27 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:27: oid 27 updating version 0 to 3 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:27: oid 27 updating version 3 to 4 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 4 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:28: finishing write tid 1 to smithi13777483-28 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:28: finishing write tid 2 to smithi13777483-28 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:26: done (14 left) 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:27: done (13 left) 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:41: write initial oid 41 2024-03-04T06:42:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:41: seq_num 40 ranges {0=679936} 2024-03-04T06:42:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:41: writing smithi13777483-41 from 0 to 679936 tid 1 2024-03-04T06:42:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:42: write initial oid 42 2024-03-04T06:42:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:42: seq_num 41 ranges {0=696320} 2024-03-04T06:42:12.445 INFO:tasks.rados.rados.0.smithi137.stdout:42: writing smithi13777483-42 from 0 to 696320 tid 1 2024-03-04T06:42:12.446 INFO:tasks.rados.rados.0.smithi137.stdout:43: write initial oid 43 2024-03-04T06:42:12.446 INFO:tasks.rados.rados.0.smithi137.stdout:43: seq_num 42 ranges {0=712704} 2024-03-04T06:42:12.450 INFO:tasks.rados.rados.0.smithi137.stdout:43: writing smithi13777483-43 from 0 to 712704 tid 1 2024-03-04T06:42:12.450 INFO:tasks.rados.rados.0.smithi137.stdout: waiting on 16 2024-03-04T06:42:12.450 INFO:tasks.rados.rados.0.smithi137.stdout:28: finishing write tid 3 to smithi13777483-28 2024-03-04T06:42:12.450 INFO:tasks.rados.rados.0.smithi137.stdout:28: oid 28 updating version 0 to 6 2024-03-04T06:42:12.450 INFO:tasks.rados.rados.0.smithi137.stdout:28: oid 28 version 6 is already newer than 5 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 6 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:29: finishing write tid 1 to smithi13777483-29 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:29: finishing write tid 2 to smithi13777483-29 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:29: finishing write tid 3 to smithi13777483-29 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:29: oid 29 updating version 0 to 6 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:29: oid 29 version 6 is already newer than 5 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 6 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:30: finishing write tid 1 to smithi13777483-30 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:28: done (15 left) 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:29: done (14 left) 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:44: write initial oid 44 2024-03-04T06:42:12.451 INFO:tasks.rados.rados.0.smithi137.stdout:44: seq_num 43 ranges {0=729088} 2024-03-04T06:42:12.455 INFO:tasks.rados.rados.0.smithi137.stdout:44: writing smithi13777483-44 from 0 to 729088 tid 1 2024-03-04T06:42:12.456 INFO:tasks.rados.rados.0.smithi137.stdout:45: write initial oid 45 2024-03-04T06:42:12.456 INFO:tasks.rados.rados.0.smithi137.stdout:45: seq_num 44 ranges {0=745472} 2024-03-04T06:42:12.461 INFO:tasks.rados.rados.0.smithi137.stdout:45: writing smithi13777483-45 from 0 to 745472 tid 1 2024-03-04T06:42:12.461 INFO:tasks.rados.rados.0.smithi137.stdout: waiting on 16 2024-03-04T06:42:12.461 INFO:tasks.rados.rados.0.smithi137.stdout:30: finishing write tid 2 to smithi13777483-30 2024-03-04T06:42:12.461 INFO:tasks.rados.rados.0.smithi137.stdout:30: finishing write tid 3 to smithi13777483-30 2024-03-04T06:42:12.461 INFO:tasks.rados.rados.0.smithi137.stdout:30: oid 30 updating version 0 to 3 2024-03-04T06:42:12.461 INFO:tasks.rados.rados.0.smithi137.stdout:30: oid 30 updating version 3 to 4 2024-03-04T06:42:12.461 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 4 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-03-04T06:42:12.461 INFO:tasks.rados.rados.0.smithi137.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2024-03-04T06:42:12.461 INFO:tasks.rados.rados.0.smithi137.stdout:31: finishing write tid 1 to smithi13777483-31 2024-03-04T06:42:12.461 INFO:tasks.rados.rados.0.smithi137.stdout:31: finishing write tid 2 to smithi13777483-31 2024-03-04T06:42:12.462 INFO:tasks.rados.rados.0.smithi137.stdout:32: finishing write tid 1 to smithi13777483-32 2024-03-04T06:42:12.462 INFO:tasks.rados.rados.0.smithi137.stdout:30: done (15 left) 2024-03-04T06:42:12.462 INFO:tasks.rados.rados.0.smithi137.stdout:46: write initial oid 46 2024-03-04T06:42:12.462 INFO:tasks.rados.rados.0.smithi137.stdout:46: seq_num 45 ranges {0=761856} 2024-03-04T06:42:12.468 INFO:tasks.rados.rados.0.smithi137.stdout:46: writing smithi13777483-46 from 0 to 761856 tid 1 2024-03-04T06:42:12.468 INFO:tasks.rados.rados.0.smithi137.stdout: waiting on 16 2024-03-04T06:42:12.468 INFO:tasks.rados.rados.0.smithi137.stdout:32: finishing write tid 2 to smithi13777483-32 2024-03-04T06:42:12.468 INFO:tasks.rados.rados.0.smithi137.stdout:31: finishing write tid 3 to smithi13777483-31 2024-03-04T06:42:12.468 INFO:tasks.rados.rados.0.smithi137.stdout:31: oid 31 updating version 0 to 1 2024-03-04T06:42:12.468 INFO:tasks.rados.rados.0.smithi137.stdout:31: oid 31 updating version 1 to 2 2024-03-04T06:42:12.468 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 2 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-03-04T06:42:12.468 INFO:tasks.rados.rados.0.smithi137.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2024-03-04T06:42:12.468 INFO:tasks.rados.rados.0.smithi137.stdout:32: finishing write tid 3 to smithi13777483-32 2024-03-04T06:42:12.468 INFO:tasks.rados.rados.0.smithi137.stdout:32: oid 32 updating version 0 to 6 2024-03-04T06:42:12.468 INFO:tasks.rados.rados.0.smithi137.stdout:32: oid 32 version 6 is already newer than 5 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 6 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:33: finishing write tid 1 to smithi13777483-33 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:33: finishing write tid 2 to smithi13777483-33 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:33: finishing write tid 3 to smithi13777483-33 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:33: oid 33 updating version 0 to 4 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:33: oid 33 version 4 is already newer than 3 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 4 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:34: finishing write tid 1 to smithi13777483-34 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:34: finishing write tid 2 to smithi13777483-34 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:34: finishing write tid 3 to smithi13777483-34 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:34: oid 34 updating version 0 to 4 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:34: oid 34 version 4 is already newer than 3 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 4 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-03-04T06:42:12.469 INFO:tasks.rados.rados.0.smithi137.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:35: finishing write tid 1 to smithi13777483-35 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:35: finishing write tid 2 to smithi13777483-35 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:35: finishing write tid 3 to smithi13777483-35 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:35: oid 35 updating version 0 to 5 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:35: oid 35 updating version 5 to 6 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 6 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:36: finishing write tid 1 to smithi13777483-36 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:36: finishing write tid 2 to smithi13777483-36 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:36: finishing write tid 3 to smithi13777483-36 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:36: oid 36 updating version 0 to 1 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:36: oid 36 updating version 1 to 2 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 2 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2024-03-04T06:42:12.470 INFO:tasks.rados.rados.0.smithi137.stdout:37: finishing write tid 1 to smithi13777483-37 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:37: finishing write tid 2 to smithi13777483-37 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:37: finishing write tid 3 to smithi13777483-37 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:37: oid 37 updating version 0 to 8 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:37: oid 37 version 8 is already newer than 7 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 8 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:38: finishing write tid 1 to smithi13777483-38 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:38: finishing write tid 2 to smithi13777483-38 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:38: finishing write tid 3 to smithi13777483-38 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:38: oid 38 updating version 0 to 7 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:38: oid 38 updating version 7 to 8 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 8 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:39: finishing write tid 1 to smithi13777483-39 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:39: finishing write tid 2 to smithi13777483-39 2024-03-04T06:42:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:31: done (15 left) 2024-03-04T06:42:12.472 INFO:tasks.rados.rados.0.smithi137.stdout:32: done (14 left) 2024-03-04T06:42:12.472 INFO:tasks.rados.rados.0.smithi137.stdout:33: done (13 left) 2024-03-04T06:42:12.472 INFO:tasks.rados.rados.0.smithi137.stdout:34: done (12 left) 2024-03-04T06:42:12.472 INFO:tasks.rados.rados.0.smithi137.stdout:35: done (11 left) 2024-03-04T06:42:12.472 INFO:tasks.rados.rados.0.smithi137.stdout:36: done (10 left) 2024-03-04T06:42:12.472 INFO:tasks.rados.rados.0.smithi137.stdout:37: done (9 left) 2024-03-04T06:42:12.472 INFO:tasks.rados.rados.0.smithi137.stdout:38: done (8 left) 2024-03-04T06:42:12.472 INFO:tasks.rados.rados.0.smithi137.stdout:47: write initial oid 47 2024-03-04T06:42:12.472 INFO:tasks.rados.rados.0.smithi137.stdout:47: seq_num 46 ranges {0=778240} 2024-03-04T06:42:12.472 INFO:tasks.rados.rados.0.smithi137.stdout:47: writing smithi13777483-47 from 0 to 778240 tid 1 2024-03-04T06:42:12.473 INFO:tasks.rados.rados.0.smithi137.stdout:48: write initial oid 48 2024-03-04T06:42:12.473 INFO:tasks.rados.rados.0.smithi137.stdout:48: seq_num 47 ranges {0=794624} 2024-03-04T06:42:12.476 INFO:tasks.rados.rados.0.smithi137.stdout:48: writing smithi13777483-48 from 0 to 794624 tid 1 2024-03-04T06:42:12.476 INFO:tasks.rados.rados.0.smithi137.stdout:49: write initial oid 49 2024-03-04T06:42:12.476 INFO:tasks.rados.rados.0.smithi137.stdout:49: seq_num 48 ranges {0=409600,409600=401408} 2024-03-04T06:42:12.479 INFO:tasks.rados.rados.0.smithi137.stdout:49: writing smithi13777483-49 from 0 to 409600 tid 1 2024-03-04T06:42:12.481 INFO:tasks.rados.rados.0.smithi137.stdout:49: writing smithi13777483-49 from 409600 to 811008 tid 2 2024-03-04T06:42:12.481 INFO:tasks.rados.rados.0.smithi137.stdout:50: write initial oid 50 2024-03-04T06:42:12.481 INFO:tasks.rados.rados.0.smithi137.stdout:50: seq_num 49 ranges {0=425984,425984=401408} 2024-03-04T06:42:12.484 INFO:tasks.rados.rados.0.smithi137.stdout:50: writing smithi13777483-50 from 0 to 425984 tid 1 2024-03-04T06:42:12.487 INFO:tasks.rados.rados.0.smithi137.stdout:50: writing smithi13777483-50 from 425984 to 827392 tid 2 2024-03-04T06:42:12.487 INFO:tasks.rados.rados.0.smithi137.stdout:51: copy_from oid 6 from oid 12 current snap is 0 2024-03-04T06:42:12.487 INFO:tasks.rados.rados.0.smithi137.stdout:39: finishing write tid 3 to smithi13777483-39 2024-03-04T06:42:12.487 INFO:tasks.rados.rados.0.smithi137.stdout:39: oid 39 updating version 0 to 4 2024-03-04T06:42:12.487 INFO:tasks.rados.rados.0.smithi137.stdout:39: oid 39 version 4 is already newer than 3 2024-03-04T06:42:12.487 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 4 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-03-04T06:42:12.487 INFO:tasks.rados.rados.0.smithi137.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2024-03-04T06:42:12.487 INFO:tasks.rados.rados.0.smithi137.stdout:40: finishing write tid 1 to smithi13777483-40 2024-03-04T06:42:12.487 INFO:tasks.rados.rados.0.smithi137.stdout:39: done (12 left) 2024-03-04T06:42:12.487 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 28 current snap is 0 2024-03-04T06:42:12.487 INFO:tasks.rados.rados.0.smithi137.stdout:40: finishing write tid 2 to smithi13777483-40 2024-03-04T06:42:12.487 INFO:tasks.rados.rados.0.smithi137.stdout:40: finishing write tid 3 to smithi13777483-40 2024-03-04T06:42:12.487 INFO:tasks.rados.rados.0.smithi137.stdout:40: oid 40 updating version 0 to 10 2024-03-04T06:42:12.488 INFO:tasks.rados.rados.0.smithi137.stdout:40: oid 40 version 10 is already newer than 9 2024-03-04T06:42:12.488 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 10 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-03-04T06:42:12.488 INFO:tasks.rados.rados.0.smithi137.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2024-03-04T06:42:12.488 INFO:tasks.rados.rados.0.smithi137.stdout:41: finishing write tid 1 to smithi13777483-41 2024-03-04T06:42:12.488 INFO:tasks.rados.rados.0.smithi137.stdout:52: seq_num 50 ranges {458752=442368,901120=401408} 2024-03-04T06:42:12.492 INFO:tasks.rados.rados.0.smithi137.stdout:52: writing smithi13777483-28 from 458752 to 901120 tid 1 2024-03-04T06:42:12.497 INFO:tasks.rados.rados.0.smithi137.stdout:52: writing smithi13777483-28 from 901120 to 1302528 tid 2 2024-03-04T06:42:12.497 INFO:tasks.rados.rados.0.smithi137.stdout:40: done (12 left) 2024-03-04T06:42:12.497 INFO:tasks.rados.rados.0.smithi137.stdout:53: rmattr oid 38 current snap is 0 2024-03-04T06:42:12.497 INFO:tasks.rados.rados.0.smithi137.stdout:53: done (12 left) 2024-03-04T06:42:12.497 INFO:tasks.rados.rados.0.smithi137.stdout:54: delete oid 4 current snap is 0 2024-03-04T06:42:12.497 INFO:tasks.rados.rados.0.smithi137.stdout:41: finishing write tid 2 to smithi13777483-41 2024-03-04T06:42:12.497 INFO:tasks.rados.rados.0.smithi137.stdout:41: finishing write tid 3 to smithi13777483-41 2024-03-04T06:42:12.497 INFO:tasks.rados.rados.0.smithi137.stdout:41: oid 41 updating version 0 to 1 2024-03-04T06:42:12.497 INFO:tasks.rados.rados.0.smithi137.stdout:41: oid 41 updating version 1 to 2 2024-03-04T06:42:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 2 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-03-04T06:42:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2024-03-04T06:42:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:42: finishing write tid 1 to smithi13777483-42 2024-03-04T06:42:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:42: finishing write tid 2 to smithi13777483-42 2024-03-04T06:42:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:42: finishing write tid 3 to smithi13777483-42 2024-03-04T06:42:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:42: oid 42 updating version 0 to 7 2024-03-04T06:42:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:42: oid 42 updating version 7 to 8 2024-03-04T06:42:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 8 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-03-04T06:42:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2024-03-04T06:42:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:43: finishing write tid 1 to smithi13777483-43 2024-03-04T06:42:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:43: finishing write tid 2 to smithi13777483-43 2024-03-04T06:42:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:43: finishing write tid 3 to smithi13777483-43 2024-03-04T06:42:12.499 INFO:tasks.rados.rados.0.smithi137.stdout:43: oid 43 updating version 0 to 3 2024-03-04T06:42:12.499 INFO:tasks.rados.rados.0.smithi137.stdout:43: oid 43 updating version 3 to 4 2024-03-04T06:42:12.499 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 4 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-03-04T06:42:12.499 INFO:tasks.rados.rados.0.smithi137.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2024-03-04T06:42:12.499 INFO:tasks.rados.rados.0.smithi137.stdout:44: finishing write tid 1 to smithi13777483-44 2024-03-04T06:42:12.499 INFO:tasks.rados.rados.0.smithi137.stdout:44: finishing write tid 2 to smithi13777483-44 2024-03-04T06:42:12.499 INFO:tasks.rados.rados.0.smithi137.stdout:44: finishing write tid 3 to smithi13777483-44 2024-03-04T06:42:12.499 INFO:tasks.rados.rados.0.smithi137.stdout:44: oid 44 updating version 0 to 6 2024-03-04T06:42:12.499 INFO:tasks.rados.rados.0.smithi137.stdout:44: oid 44 version 6 is already newer than 5 2024-03-04T06:42:12.499 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 6 (ObjNum 43 snap 0 seq_num 43) dirty exists 2024-03-04T06:42:12.499 INFO:tasks.rados.rados.0.smithi137.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2024-03-04T06:42:12.499 INFO:tasks.rados.rados.0.smithi137.stdout:45: finishing write tid 1 to smithi13777483-45 2024-03-04T06:42:12.499 INFO:tasks.rados.rados.0.smithi137.stdout:45: finishing write tid 2 to smithi13777483-45 2024-03-04T06:42:12.500 INFO:tasks.rados.rados.0.smithi137.stdout:45: finishing write tid 3 to smithi13777483-45 2024-03-04T06:42:12.500 INFO:tasks.rados.rados.0.smithi137.stdout:45: oid 45 updating version 0 to 4 2024-03-04T06:42:12.500 INFO:tasks.rados.rados.0.smithi137.stdout:45: oid 45 version 4 is already newer than 3 2024-03-04T06:42:12.500 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 4 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-03-04T06:42:12.500 INFO:tasks.rados.rados.0.smithi137.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2024-03-04T06:42:12.500 INFO:tasks.rados.rados.0.smithi137.stdout:46: finishing write tid 1 to smithi13777483-46 2024-03-04T06:42:12.500 INFO:tasks.rados.rados.0.smithi137.stdout:46: finishing write tid 2 to smithi13777483-46 2024-03-04T06:42:12.500 INFO:tasks.rados.rados.0.smithi137.stdout:46: finishing write tid 3 to smithi13777483-46 2024-03-04T06:42:12.500 INFO:tasks.rados.rados.0.smithi137.stdout:46: oid 46 updating version 0 to 9 2024-03-04T06:42:12.500 INFO:tasks.rados.rados.0.smithi137.stdout:46: oid 46 updating version 9 to 10 2024-03-04T06:42:12.500 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 10 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-04T06:42:12.500 INFO:tasks.rados.rados.0.smithi137.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:42:12.500 INFO:tasks.rados.rados.0.smithi137.stdout:47: finishing write tid 1 to smithi13777483-47 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:47: finishing write tid 2 to smithi13777483-47 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:47: finishing write tid 3 to smithi13777483-47 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:47: oid 47 updating version 0 to 10 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:47: oid 47 version 10 is already newer than 9 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 10 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:48: finishing write tid 1 to smithi13777483-48 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:48: finishing write tid 2 to smithi13777483-48 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:48: finishing write tid 3 to smithi13777483-48 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:48: oid 48 updating version 0 to 6 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:48: oid 48 version 6 is already newer than 5 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 6 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:49: finishing write tid 1 to smithi13777483-49 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:49: finishing write tid 2 to smithi13777483-49 2024-03-04T06:42:12.501 INFO:tasks.rados.rados.0.smithi137.stdout:49: finishing write tid 3 to smithi13777483-49 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:50: finishing write tid 1 to smithi13777483-50 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:49: finishing write tid 4 to smithi13777483-49 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:49: oid 49 updating version 0 to 8 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:49: oid 49 updating version 8 to 9 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:49: oid 49 version 9 is already newer than 7 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 9 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:50: finishing write tid 2 to smithi13777483-50 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:50: finishing write tid 3 to smithi13777483-50 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:50: finishing write tid 4 to smithi13777483-50 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:50: oid 50 updating version 0 to 11 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:50: oid 50 updating version 11 to 13 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:50: oid 50 version 13 is already newer than 12 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 13 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-03-04T06:42:12.502 INFO:tasks.rados.rados.0.smithi137.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:51: finishing copy_from racing read to smithi13777483-6 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:51: finishing copy_from to smithi13777483-6 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 2 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:52: finishing write tid 1 to smithi13777483-28 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:41: done (12 left) 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:42: done (11 left) 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:43: done (10 left) 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:44: done (9 left) 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:45: done (8 left) 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:46: done (7 left) 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:47: done (6 left) 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:48: done (5 left) 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:49: done (4 left) 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:50: done (3 left) 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:51: done (2 left) 2024-03-04T06:42:12.503 INFO:tasks.rados.rados.0.smithi137.stdout:54: done (1 left) 2024-03-04T06:42:12.504 INFO:tasks.rados.rados.0.smithi137.stdout:55: read oid 15 snap -1 2024-03-04T06:42:12.504 INFO:tasks.rados.rados.0.smithi137.stdout:55: expect (ObjNum 14 snap 0 seq_num 14) 2024-03-04T06:42:12.504 INFO:tasks.rados.rados.0.smithi137.stdout:56: rollback oid 31 current snap is 0 2024-03-04T06:42:12.504 INFO:tasks.rados.rados.0.smithi137.stdout:56: done (2 left) 2024-03-04T06:42:12.504 INFO:tasks.rados.rados.0.smithi137.stdout:57: read oid 27 snap -1 2024-03-04T06:42:12.504 INFO:tasks.rados.rados.0.smithi137.stdout:57: expect (ObjNum 26 snap 0 seq_num 26) 2024-03-04T06:42:12.504 INFO:tasks.rados.rados.0.smithi137.stdout:58: copy_from oid 29 from oid 47 current snap is 0 2024-03-04T06:42:12.504 INFO:tasks.rados.rados.0.smithi137.stdout:59: rollback oid 45 current snap is 0 2024-03-04T06:42:12.504 INFO:tasks.rados.rados.0.smithi137.stdout:59: done (4 left) 2024-03-04T06:42:12.504 INFO:tasks.rados.rados.0.smithi137.stdout:60: copy_from oid 22 from oid 48 current snap is 0 2024-03-04T06:42:12.504 INFO:tasks.rados.rados.0.smithi137.stdout:61: delete oid 1 current snap is 0 2024-03-04T06:42:12.504 INFO:tasks.rados.rados.0.smithi137.stdout:52: finishing write tid 2 to smithi13777483-28 2024-03-04T06:42:12.505 INFO:tasks.rados.rados.0.smithi137.stdout:52: finishing write tid 3 to smithi13777483-28 2024-03-04T06:42:12.505 INFO:tasks.rados.rados.0.smithi137.stdout:52: finishing write tid 4 to smithi13777483-28 2024-03-04T06:42:12.505 INFO:tasks.rados.rados.0.smithi137.stdout:52: oid 28 updating version 0 to 13 2024-03-04T06:42:12.505 INFO:tasks.rados.rados.0.smithi137.stdout:52: oid 28 version 13 is already newer than 12 2024-03-04T06:42:12.505 INFO:tasks.rados.rados.0.smithi137.stdout:52: oid 28 version 13 is already newer than 11 2024-03-04T06:42:12.505 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 13 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-03-04T06:42:12.506 INFO:tasks.rados.rados.0.smithi137.stdout:52: left oid 28 (ObjNum 50 snap 0 seq_num 50) 2024-03-04T06:42:12.506 INFO:tasks.rados.rados.0.smithi137.stdout:52: done (5 left) 2024-03-04T06:42:12.506 INFO:tasks.rados.rados.0.smithi137.stdout:61: done (4 left) 2024-03-04T06:42:12.506 INFO:tasks.rados.rados.0.smithi137.stdout:62: read oid 24 snap -1 2024-03-04T06:42:12.506 INFO:tasks.rados.rados.0.smithi137.stdout:62: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-04T06:42:12.506 INFO:tasks.rados.rados.0.smithi137.stdout:63: snap_create 2024-03-04T06:42:12.506 INFO:tasks.rados.rados.0.smithi137.stdout:55: expect (ObjNum 14 snap 0 seq_num 14) 2024-03-04T06:42:12.509 INFO:tasks.rados.rados.0.smithi137.stdout:57: expect (ObjNum 26 snap 0 seq_num 26) 2024-03-04T06:42:12.521 INFO:tasks.rados.rados.0.smithi137.stdout:62: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-04T06:42:12.531 INFO:tasks.rados.rados.0.smithi137.stdout:58: finishing copy_from racing read to smithi13777483-29 2024-03-04T06:42:12.531 INFO:tasks.rados.rados.0.smithi137.stdout:58: finishing copy_from to smithi13777483-29 2024-03-04T06:42:12.531 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 10 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-04T06:42:12.531 INFO:tasks.rados.rados.0.smithi137.stdout:60: finishing copy_from racing read to smithi13777483-22 2024-03-04T06:42:12.531 INFO:tasks.rados.rados.0.smithi137.stdout:60: finishing copy_from to smithi13777483-22 2024-03-04T06:42:12.531 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 6 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-03-04T06:42:13.353 INFO:tasks.rados.rados.0.smithi137.stdout:55: done (5 left) 2024-03-04T06:42:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:57: done (4 left) 2024-03-04T06:42:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:58: done (3 left) 2024-03-04T06:42:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:60: done (2 left) 2024-03-04T06:42:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:62: done (1 left) 2024-03-04T06:42:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:63: done (0 left) 2024-03-04T06:42:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:64: copy_from oid 15 from oid 2 current snap is 1 2024-03-04T06:42:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:65: read oid 30 snap -1 2024-03-04T06:42:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:65: expect (ObjNum 29 snap 0 seq_num 29) 2024-03-04T06:42:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 1 2024-03-04T06:42:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:66: seq_num 53 ranges {376832=491520,868352=401408} 2024-03-04T06:42:13.358 INFO:tasks.rados.rados.0.smithi137.stdout:66: writing smithi13777483-23 from 376832 to 868352 tid 1 2024-03-04T06:42:13.361 INFO:tasks.rados.rados.0.smithi137.stdout:66: writing smithi13777483-23 from 868352 to 1269760 tid 2 2024-03-04T06:42:13.361 INFO:tasks.rados.rados.0.smithi137.stdout:67: rollback oid 10 current snap is 1 2024-03-04T06:42:13.361 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 10 to 0 2024-03-04T06:42:13.361 INFO:tasks.rados.rados.0.smithi137.stdout:65: expect (ObjNum 29 snap 0 seq_num 29) 2024-03-04T06:42:13.376 INFO:tasks.rados.rados.0.smithi137.stdout:64: finishing copy_from racing read to smithi13777483-15 2024-03-04T06:42:13.376 INFO:tasks.rados.rados.0.smithi137.stdout:64: finishing copy_from to smithi13777483-15 2024-03-04T06:42:13.376 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 4 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-03-04T06:42:13.376 INFO:tasks.rados.rados.0.smithi137.stdout:64: done (3 left) 2024-03-04T06:42:13.376 INFO:tasks.rados.rados.0.smithi137.stdout:65: done (2 left) 2024-03-04T06:42:13.376 INFO:tasks.rados.rados.0.smithi137.stdout:68: setattr oid 20 current snap is 1 2024-03-04T06:42:13.376 INFO:tasks.rados.rados.0.smithi137.stdout:67: finishing rollback tid 0 to smithi13777483-10 2024-03-04T06:42:13.377 INFO:tasks.rados.rados.0.smithi137.stdout:67: finishing rollback tid 1 to smithi13777483-10 2024-03-04T06:42:13.377 INFO:tasks.rados.rados.0.smithi137.stdout:66: finishing write tid 1 to smithi13777483-23 2024-03-04T06:42:13.377 INFO:tasks.rados.rados.0.smithi137.stdout:67: finishing rollback tid 2 to smithi13777483-10 2024-03-04T06:42:13.377 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 14 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-03-04T06:42:13.377 INFO:tasks.rados.rados.0.smithi137.stdout:66: finishing write tid 2 to smithi13777483-23 2024-03-04T06:42:13.377 INFO:tasks.rados.rados.0.smithi137.stdout:66: finishing write tid 3 to smithi13777483-23 2024-03-04T06:42:13.377 INFO:tasks.rados.rados.0.smithi137.stdout:66: finishing write tid 4 to smithi13777483-23 2024-03-04T06:42:13.377 INFO:tasks.rados.rados.0.smithi137.stdout:66: oid 23 updating version 0 to 8 2024-03-04T06:42:13.377 INFO:tasks.rados.rados.0.smithi137.stdout:66: oid 23 updating version 8 to 10 2024-03-04T06:42:13.377 INFO:tasks.rados.rados.0.smithi137.stdout:66: oid 23 version 10 is already newer than 9 2024-03-04T06:42:13.377 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 10 (ObjNum 53 snap 1 seq_num 53) dirty exists 2024-03-04T06:42:13.377 INFO:tasks.rados.rados.0.smithi137.stdout:66: left oid 23 (ObjNum 53 snap 1 seq_num 53) 2024-03-04T06:42:13.379 INFO:tasks.rados.rados.0.smithi137.stdout:66: done (2 left) 2024-03-04T06:42:13.379 INFO:tasks.rados.rados.0.smithi137.stdout:67: done (1 left) 2024-03-04T06:42:13.379 INFO:tasks.rados.rados.0.smithi137.stdout:69: copy_from oid 45 from oid 34 current snap is 1 2024-03-04T06:42:13.379 INFO:tasks.rados.rados.0.smithi137.stdout:70: read oid 24 snap 0 2024-03-04T06:42:13.379 INFO:tasks.rados.rados.0.smithi137.stdout:70: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-04T06:42:13.379 INFO:tasks.rados.rados.0.smithi137.stdout:71: copy_from oid 36 from oid 28 current snap is 1 2024-03-04T06:42:13.379 INFO:tasks.rados.rados.0.smithi137.stdout:72: rollback oid 49 current snap is 1 2024-03-04T06:42:13.379 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 49 to 0 2024-03-04T06:42:13.379 INFO:tasks.rados.rados.0.smithi137.stdout:73: read oid 4 snap 0 2024-03-04T06:42:13.380 INFO:tasks.rados.rados.0.smithi137.stdout:73: expect deleted 2024-03-04T06:42:13.380 INFO:tasks.rados.rados.0.smithi137.stdout:74: rmattr oid 7 current snap is 1 2024-03-04T06:42:13.380 INFO:tasks.rados.rados.0.smithi137.stdout:74: done (6 left) 2024-03-04T06:42:13.380 INFO:tasks.rados.rados.0.smithi137.stdout:75: copy_from oid 21 from oid 12 current snap is 1 2024-03-04T06:42:13.380 INFO:tasks.rados.rados.0.smithi137.stdout:76: read oid 39 snap -1 2024-03-04T06:42:13.380 INFO:tasks.rados.rados.0.smithi137.stdout:76: expect (ObjNum 38 snap 0 seq_num 38) 2024-03-04T06:42:13.380 INFO:tasks.rados.rados.0.smithi137.stdout:77: copy_from oid 6 from oid 37 current snap is 1 2024-03-04T06:42:13.380 INFO:tasks.rados.rados.0.smithi137.stdout:78: read oid 2 snap -1 2024-03-04T06:42:13.380 INFO:tasks.rados.rados.0.smithi137.stdout:78: expect (ObjNum 1 snap 0 seq_num 1) 2024-03-04T06:42:13.380 INFO:tasks.rados.rados.0.smithi137.stdout:79: setattr oid 41 current snap is 1 2024-03-04T06:42:13.380 INFO:tasks.rados.rados.0.smithi137.stdout:73: done (10 left) 2024-03-04T06:42:13.380 INFO:tasks.rados.rados.0.smithi137.stdout:80: snap_create 2024-03-04T06:42:13.381 INFO:tasks.rados.rados.0.smithi137.stdout:78: expect (ObjNum 1 snap 0 seq_num 1) 2024-03-04T06:42:13.381 INFO:tasks.rados.rados.0.smithi137.stdout:70: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-04T06:42:13.395 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 12 (ObjNum 19 snap 0 seq_num 19) dirty exists 2024-03-04T06:42:13.395 INFO:tasks.rados.rados.0.smithi137.stdout:75: finishing copy_from racing read to smithi13777483-21 2024-03-04T06:42:13.395 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 6 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-03-04T06:42:13.395 INFO:tasks.rados.rados.0.smithi137.stdout:72: finishing rollback tid 0 to smithi13777483-49 2024-03-04T06:42:13.395 INFO:tasks.rados.rados.0.smithi137.stdout:71: finishing copy_from racing read to smithi13777483-36 2024-03-04T06:42:13.395 INFO:tasks.rados.rados.0.smithi137.stdout:75: finishing copy_from to smithi13777483-21 2024-03-04T06:42:13.395 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 2 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-03-04T06:42:13.395 INFO:tasks.rados.rados.0.smithi137.stdout:76: expect (ObjNum 38 snap 0 seq_num 38) 2024-03-04T06:42:13.412 INFO:tasks.rados.rados.0.smithi137.stdout:72: finishing rollback tid 1 to smithi13777483-49 2024-03-04T06:42:13.412 INFO:tasks.rados.rados.0.smithi137.stdout:72: finishing rollback tid 2 to smithi13777483-49 2024-03-04T06:42:13.412 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 13 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-03-04T06:42:13.412 INFO:tasks.rados.rados.0.smithi137.stdout:71: finishing copy_from to smithi13777483-36 2024-03-04T06:42:13.412 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 13 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-03-04T06:42:13.412 INFO:tasks.rados.rados.0.smithi137.stdout:77: finishing copy_from racing read to smithi13777483-6 2024-03-04T06:42:13.412 INFO:tasks.rados.rados.0.smithi137.stdout:77: finishing copy_from to smithi13777483-6 2024-03-04T06:42:13.412 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 8 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-03-04T06:42:13.412 INFO:tasks.rados.rados.0.smithi137.stdout:69: finishing copy_from racing read to smithi13777483-45 2024-03-04T06:42:13.412 INFO:tasks.rados.rados.0.smithi137.stdout:69: finishing copy_from to smithi13777483-45 2024-03-04T06:42:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 4 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-03-04T06:42:13.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:13 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1224025142' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2024-03-04T06:42:13.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:13 smithi137 ceph-mon[26846]: osdmap e76: 8 total, 8 up, 8 in 2024-03-04T06:42:13.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:13 smithi137 ceph-mon[26846]: pgmap v120: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:13 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1224025142' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2024-03-04T06:42:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:13 smithi137 ceph-mon[37364]: osdmap e76: 8 total, 8 up, 8 in 2024-03-04T06:42:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:13 smithi137 ceph-mon[37364]: pgmap v120: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:13.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:13 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1224025142' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2024-03-04T06:42:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:13 smithi203 ceph-mon[30756]: osdmap e76: 8 total, 8 up, 8 in 2024-03-04T06:42:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:13 smithi203 ceph-mon[30756]: pgmap v120: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:14.360 INFO:tasks.rados.rados.0.smithi137.stdout:68: done (10 left) 2024-03-04T06:42:14.360 INFO:tasks.rados.rados.0.smithi137.stdout:69: done (9 left) 2024-03-04T06:42:14.360 INFO:tasks.rados.rados.0.smithi137.stdout:70: done (8 left) 2024-03-04T06:42:14.360 INFO:tasks.rados.rados.0.smithi137.stdout:71: done (7 left) 2024-03-04T06:42:14.360 INFO:tasks.rados.rados.0.smithi137.stdout:72: done (6 left) 2024-03-04T06:42:14.360 INFO:tasks.rados.rados.0.smithi137.stdout:75: done (5 left) 2024-03-04T06:42:14.361 INFO:tasks.rados.rados.0.smithi137.stdout:76: done (4 left) 2024-03-04T06:42:14.361 INFO:tasks.rados.rados.0.smithi137.stdout:77: done (3 left) 2024-03-04T06:42:14.361 INFO:tasks.rados.rados.0.smithi137.stdout:78: done (2 left) 2024-03-04T06:42:14.361 INFO:tasks.rados.rados.0.smithi137.stdout:79: done (1 left) 2024-03-04T06:42:14.361 INFO:tasks.rados.rados.0.smithi137.stdout:80: done (0 left) 2024-03-04T06:42:14.361 INFO:tasks.rados.rados.0.smithi137.stdout:81: rollback oid 40 current snap is 2 2024-03-04T06:42:14.361 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 40 to 1 2024-03-04T06:42:14.361 INFO:tasks.rados.rados.0.smithi137.stdout:82: snap_create 2024-03-04T06:42:14.367 INFO:tasks.rados.rados.0.smithi137.stdout:81: finishing rollback tid 0 to smithi13777483-40 2024-03-04T06:42:14.367 INFO:tasks.rados.rados.0.smithi137.stdout:81: finishing rollback tid 1 to smithi13777483-40 2024-03-04T06:42:14.368 INFO:tasks.rados.rados.0.smithi137.stdout:81: finishing rollback tid 2 to smithi13777483-40 2024-03-04T06:42:14.368 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 20 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-03-04T06:42:14.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:14 smithi137 ceph-mon[26846]: osdmap e77: 8 total, 8 up, 8 in 2024-03-04T06:42:14.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:14 smithi137 ceph-mon[37364]: osdmap e77: 8 total, 8 up, 8 in 2024-03-04T06:42:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:14 smithi203 ceph-mon[30756]: osdmap e77: 8 total, 8 up, 8 in 2024-03-04T06:42:15.364 INFO:tasks.rados.rados.0.smithi137.stdout:81: done (1 left) 2024-03-04T06:42:15.364 INFO:tasks.rados.rados.0.smithi137.stdout:82: done (0 left) 2024-03-04T06:42:15.364 INFO:tasks.rados.rados.0.smithi137.stdout:83: rollback oid 9 current snap is 3 2024-03-04T06:42:15.364 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 9 to 0 2024-03-04T06:42:15.364 INFO:tasks.rados.rados.0.smithi137.stdout:84: read oid 20 snap 1 2024-03-04T06:42:15.364 INFO:tasks.rados.rados.0.smithi137.stdout:84: expect (ObjNum 19 snap 0 seq_num 19) 2024-03-04T06:42:15.364 INFO:tasks.rados.rados.0.smithi137.stdout:85: read oid 25 snap -1 2024-03-04T06:42:15.364 INFO:tasks.rados.rados.0.smithi137.stdout:85: expect (ObjNum 24 snap 0 seq_num 24) 2024-03-04T06:42:15.364 INFO:tasks.rados.rados.0.smithi137.stdout:86: copy_from oid 34 from oid 28 current snap is 3 2024-03-04T06:42:15.365 INFO:tasks.rados.rados.0.smithi137.stdout:87: setattr oid 48 current snap is 3 2024-03-04T06:42:15.365 INFO:tasks.rados.rados.0.smithi137.stdout:88: snap_remove snap 2 2024-03-04T06:42:15.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:15 smithi137 ceph-mon[26846]: osdmap e78: 8 total, 8 up, 8 in 2024-03-04T06:42:15.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:15 smithi137 ceph-mon[26846]: pgmap v123: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:15.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:15 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:42:15.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:15 smithi137 ceph-mon[37364]: osdmap e78: 8 total, 8 up, 8 in 2024-03-04T06:42:15.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:15 smithi137 ceph-mon[37364]: pgmap v123: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:15 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:42:15.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:42:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:42:15] "GET /metrics HTTP/1.1" 200 35938 "" "Prometheus/2.43.0" 2024-03-04T06:42:15.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:15 smithi203 ceph-mon[30756]: osdmap e78: 8 total, 8 up, 8 in 2024-03-04T06:42:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:15 smithi203 ceph-mon[30756]: pgmap v123: 121 pgs: 121 active+clean; 580 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:15 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:42:16.366 INFO:tasks.rados.rados.0.smithi137.stdout:88: done (5 left) 2024-03-04T06:42:16.366 INFO:tasks.rados.rados.0.smithi137.stdout:89: read oid 38 snap 1 2024-03-04T06:42:16.366 INFO:tasks.rados.rados.0.smithi137.stdout:89: expect (ObjNum 37 snap 0 seq_num 37) 2024-03-04T06:42:16.366 INFO:tasks.rados.rados.0.smithi137.stdout:90: read oid 18 snap -1 2024-03-04T06:42:16.366 INFO:tasks.rados.rados.0.smithi137.stdout:90: expect (ObjNum 17 snap 0 seq_num 17) 2024-03-04T06:42:16.367 INFO:tasks.rados.rados.0.smithi137.stdout:91: copy_from oid 2 from oid 29 current snap is 3 2024-03-04T06:42:16.367 INFO:tasks.rados.rados.0.smithi137.stdout:92: rmattr oid 43 current snap is 3 2024-03-04T06:42:16.367 INFO:tasks.rados.rados.0.smithi137.stdout:92: done (8 left) 2024-03-04T06:42:16.367 INFO:tasks.rados.rados.0.smithi137.stdout:93: delete oid 14 current snap is 3 2024-03-04T06:42:16.367 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 9 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-03-04T06:42:16.367 INFO:tasks.rados.rados.0.smithi137.stdout:84: expect (ObjNum 19 snap 0 seq_num 19) 2024-03-04T06:42:16.382 INFO:tasks.rados.rados.0.smithi137.stdout:84: done (8 left) 2024-03-04T06:42:16.382 INFO:tasks.rados.rados.0.smithi137.stdout:87: done (7 left) 2024-03-04T06:42:16.382 INFO:tasks.rados.rados.0.smithi137.stdout:93: done (6 left) 2024-03-04T06:42:16.382 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 3 2024-03-04T06:42:16.382 INFO:tasks.rados.rados.0.smithi137.stdout:94: seq_num 55 ranges {638976=524288,1163264=401408} 2024-03-04T06:42:16.389 INFO:tasks.rados.rados.0.smithi137.stdout:94: writing smithi13777483-39 from 638976 to 1163264 tid 1 2024-03-04T06:42:16.392 INFO:tasks.rados.rados.0.smithi137.stdout:94: writing smithi13777483-39 from 1163264 to 1564672 tid 2 2024-03-04T06:42:16.392 INFO:tasks.rados.rados.0.smithi137.stdout:95: read oid 3 snap 0 2024-03-04T06:42:16.392 INFO:tasks.rados.rados.0.smithi137.stdout:95: expect (ObjNum 2 snap 0 seq_num 2) 2024-03-04T06:42:16.393 INFO:tasks.rados.rados.0.smithi137.stdout:83: finishing rollback tid 0 to smithi13777483-9 2024-03-04T06:42:16.393 INFO:tasks.rados.rados.0.smithi137.stdout:83: finishing rollback tid 1 to smithi13777483-9 2024-03-04T06:42:16.393 INFO:tasks.rados.rados.0.smithi137.stdout:83: finishing rollback tid 2 to smithi13777483-9 2024-03-04T06:42:16.393 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 18 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-03-04T06:42:16.393 INFO:tasks.rados.rados.0.smithi137.stdout:85: expect (ObjNum 24 snap 0 seq_num 24) 2024-03-04T06:42:16.409 INFO:tasks.rados.rados.0.smithi137.stdout:86: finishing copy_from racing read to smithi13777483-34 2024-03-04T06:42:16.409 INFO:tasks.rados.rados.0.smithi137.stdout:86: finishing copy_from to smithi13777483-34 2024-03-04T06:42:16.409 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 13 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-03-04T06:42:16.409 INFO:tasks.rados.rados.0.smithi137.stdout:83: done (7 left) 2024-03-04T06:42:16.409 INFO:tasks.rados.rados.0.smithi137.stdout:85: done (6 left) 2024-03-04T06:42:16.409 INFO:tasks.rados.rados.0.smithi137.stdout:86: done (5 left) 2024-03-04T06:42:16.409 INFO:tasks.rados.rados.0.smithi137.stdout:96: rmattr oid 28 current snap is 3 2024-03-04T06:42:16.409 INFO:tasks.rados.rados.0.smithi137.stdout:96: done (5 left) 2024-03-04T06:42:16.409 INFO:tasks.rados.rados.0.smithi137.stdout:97: read oid 33 snap 0 2024-03-04T06:42:16.409 INFO:tasks.rados.rados.0.smithi137.stdout:97: expect (ObjNum 32 snap 0 seq_num 32) 2024-03-04T06:42:16.410 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 3 2024-03-04T06:42:16.410 INFO:tasks.rados.rados.0.smithi137.stdout:90: expect (ObjNum 17 snap 0 seq_num 17) 2024-03-04T06:42:16.416 INFO:tasks.rados.rados.0.smithi137.stdout:89: expect (ObjNum 37 snap 0 seq_num 37) 2024-03-04T06:42:16.433 INFO:tasks.rados.rados.0.smithi137.stdout:91: finishing copy_from racing read to smithi13777483-2 2024-03-04T06:42:16.433 INFO:tasks.rados.rados.0.smithi137.stdout:91: finishing copy_from to smithi13777483-2 2024-03-04T06:42:16.433 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 10 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-04T06:42:16.433 INFO:tasks.rados.rados.0.smithi137.stdout:94: finishing write tid 1 to smithi13777483-39 2024-03-04T06:42:16.433 INFO:tasks.rados.rados.0.smithi137.stdout:98: seq_num 56 ranges {606208=540672,1146880=401408} 2024-03-04T06:42:16.439 INFO:tasks.rados.rados.0.smithi137.stdout:98: writing smithi13777483-6 from 606208 to 1146880 tid 1 2024-03-04T06:42:16.441 INFO:tasks.rados.rados.0.smithi137.stdout:98: writing smithi13777483-6 from 1146880 to 1548288 tid 2 2024-03-04T06:42:16.442 INFO:tasks.rados.rados.0.smithi137.stdout:89: done (6 left) 2024-03-04T06:42:16.442 INFO:tasks.rados.rados.0.smithi137.stdout:90: done (5 left) 2024-03-04T06:42:16.442 INFO:tasks.rados.rados.0.smithi137.stdout:91: done (4 left) 2024-03-04T06:42:16.442 INFO:tasks.rados.rados.0.smithi137.stdout:99: copy_from oid 16 from oid 5 current snap is 3 2024-03-04T06:42:16.442 INFO:tasks.rados.rados.0.smithi137.stdout:95: expect (ObjNum 2 snap 0 seq_num 2) 2024-03-04T06:42:16.442 INFO:tasks.rados.rados.0.smithi137.stdout:94: finishing write tid 2 to smithi13777483-39 2024-03-04T06:42:16.443 INFO:tasks.rados.rados.0.smithi137.stdout:94: finishing write tid 3 to smithi13777483-39 2024-03-04T06:42:16.443 INFO:tasks.rados.rados.0.smithi137.stdout:95: done (4 left) 2024-03-04T06:42:16.443 INFO:tasks.rados.rados.0.smithi137.stdout:100: snap_remove snap 1 2024-03-04T06:42:16.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:16 smithi137 ceph-mon[26846]: osdmap e79: 8 total, 8 up, 8 in 2024-03-04T06:42:16.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:16 smithi137 ceph-mon[37364]: osdmap e79: 8 total, 8 up, 8 in 2024-03-04T06:42:16.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:16 smithi203 ceph-mon[30756]: osdmap e79: 8 total, 8 up, 8 in 2024-03-04T06:42:17.382 INFO:tasks.rados.rados.0.smithi137.stdout:100: done (4 left) 2024-03-04T06:42:17.383 INFO:tasks.rados.rados.0.smithi137.stdout:101: copy_from oid 25 from oid 30 current snap is 3 2024-03-04T06:42:17.383 INFO:tasks.rados.rados.0.smithi137.stdout:102: read oid 35 snap 0 2024-03-04T06:42:17.383 INFO:tasks.rados.rados.0.smithi137.stdout:102: expect (ObjNum 34 snap 0 seq_num 34) 2024-03-04T06:42:17.383 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 3 2024-03-04T06:42:17.383 INFO:tasks.rados.rados.0.smithi137.stdout:103: seq_num 57 ranges {188416=557056,745472=401408} 2024-03-04T06:42:17.386 INFO:tasks.rados.rados.0.smithi137.stdout:103: writing smithi13777483-21 from 188416 to 745472 tid 1 2024-03-04T06:42:17.389 INFO:tasks.rados.rados.0.smithi137.stdout:103: writing smithi13777483-21 from 745472 to 1146880 tid 2 2024-03-04T06:42:17.390 INFO:tasks.rados.rados.0.smithi137.stdout:104: delete oid 47 current snap is 3 2024-03-04T06:42:17.390 INFO:tasks.rados.rados.0.smithi137.stdout:94: finishing write tid 4 to smithi13777483-39 2024-03-04T06:42:17.390 INFO:tasks.rados.rados.0.smithi137.stdout:94: oid 39 updating version 0 to 7 2024-03-04T06:42:17.390 INFO:tasks.rados.rados.0.smithi137.stdout:94: oid 39 updating version 7 to 8 2024-03-04T06:42:17.390 INFO:tasks.rados.rados.0.smithi137.stdout:94: oid 39 version 8 is already newer than 6 2024-03-04T06:42:17.390 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 8 (ObjNum 55 snap 3 seq_num 55) dirty exists 2024-03-04T06:42:17.390 INFO:tasks.rados.rados.0.smithi137.stdout:94: left oid 39 (ObjNum 55 snap 3 seq_num 55) 2024-03-04T06:42:17.390 INFO:tasks.rados.rados.0.smithi137.stdout:97: expect (ObjNum 32 snap 0 seq_num 32) 2024-03-04T06:42:17.408 INFO:tasks.rados.rados.0.smithi137.stdout:98: finishing write tid 1 to smithi13777483-6 2024-03-04T06:42:17.409 INFO:tasks.rados.rados.0.smithi137.stdout:98: finishing write tid 2 to smithi13777483-6 2024-03-04T06:42:17.409 INFO:tasks.rados.rados.0.smithi137.stdout:98: finishing write tid 3 to smithi13777483-6 2024-03-04T06:42:17.409 INFO:tasks.rados.rados.0.smithi137.stdout:94: done (7 left) 2024-03-04T06:42:17.409 INFO:tasks.rados.rados.0.smithi137.stdout:97: done (6 left) 2024-03-04T06:42:17.409 INFO:tasks.rados.rados.0.smithi137.stdout:104: done (5 left) 2024-03-04T06:42:17.409 INFO:tasks.rados.rados.0.smithi137.stdout:105: read oid 13 snap -1 2024-03-04T06:42:17.409 INFO:tasks.rados.rados.0.smithi137.stdout:105: expect (ObjNum 12 snap 0 seq_num 12) 2024-03-04T06:42:17.409 INFO:tasks.rados.rados.0.smithi137.stdout:106: rollback oid 50 current snap is 3 2024-03-04T06:42:17.409 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 50 to 0 2024-03-04T06:42:17.409 INFO:tasks.rados.rados.0.smithi137.stdout:99: finishing copy_from racing read to smithi13777483-16 2024-03-04T06:42:17.409 INFO:tasks.rados.rados.0.smithi137.stdout:99: finishing copy_from to smithi13777483-16 2024-03-04T06:42:17.409 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 4 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-03-04T06:42:17.409 INFO:tasks.rados.rados.0.smithi137.stdout:98: finishing write tid 4 to smithi13777483-6 2024-03-04T06:42:17.410 INFO:tasks.rados.rados.0.smithi137.stdout:98: oid 6 updating version 0 to 22 2024-03-04T06:42:17.410 INFO:tasks.rados.rados.0.smithi137.stdout:98: oid 6 updating version 22 to 24 2024-03-04T06:42:17.410 INFO:tasks.rados.rados.0.smithi137.stdout:98: oid 6 version 24 is already newer than 23 2024-03-04T06:42:17.410 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 24 (ObjNum 56 snap 3 seq_num 56) dirty exists 2024-03-04T06:42:17.410 INFO:tasks.rados.rados.0.smithi137.stdout:98: left oid 6 (ObjNum 56 snap 3 seq_num 56) 2024-03-04T06:42:17.410 INFO:tasks.rados.rados.0.smithi137.stdout:101: finishing copy_from racing read to smithi13777483-25 2024-03-04T06:42:17.410 INFO:tasks.rados.rados.0.smithi137.stdout:98: done (6 left) 2024-03-04T06:42:17.410 INFO:tasks.rados.rados.0.smithi137.stdout:99: done (5 left) 2024-03-04T06:42:17.410 INFO:tasks.rados.rados.0.smithi137.stdout:107: delete oid 17 current snap is 3 2024-03-04T06:42:17.410 INFO:tasks.rados.rados.0.smithi137.stdout:103: finishing write tid 1 to smithi13777483-21 2024-03-04T06:42:17.410 INFO:tasks.rados.rados.0.smithi137.stdout:102: expect (ObjNum 34 snap 0 seq_num 34) 2024-03-04T06:42:17.425 INFO:tasks.rados.rados.0.smithi137.stdout:101: finishing copy_from to smithi13777483-25 2024-03-04T06:42:17.425 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 4 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-03-04T06:42:17.425 INFO:tasks.rados.rados.0.smithi137.stdout:103: finishing write tid 2 to smithi13777483-21 2024-03-04T06:42:17.425 INFO:tasks.rados.rados.0.smithi137.stdout:103: finishing write tid 3 to smithi13777483-21 2024-03-04T06:42:17.425 INFO:tasks.rados.rados.0.smithi137.stdout:103: finishing write tid 4 to smithi13777483-21 2024-03-04T06:42:17.425 INFO:tasks.rados.rados.0.smithi137.stdout:103: oid 21 updating version 0 to 16 2024-03-04T06:42:17.426 INFO:tasks.rados.rados.0.smithi137.stdout:103: oid 21 updating version 16 to 20 2024-03-04T06:42:17.426 INFO:tasks.rados.rados.0.smithi137.stdout:103: oid 21 version 20 is already newer than 19 2024-03-04T06:42:17.426 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 20 (ObjNum 57 snap 3 seq_num 57) dirty exists 2024-03-04T06:42:17.426 INFO:tasks.rados.rados.0.smithi137.stdout:103: left oid 21 (ObjNum 57 snap 3 seq_num 57) 2024-03-04T06:42:17.426 INFO:tasks.rados.rados.0.smithi137.stdout:101: done (5 left) 2024-03-04T06:42:17.426 INFO:tasks.rados.rados.0.smithi137.stdout:102: done (4 left) 2024-03-04T06:42:17.426 INFO:tasks.rados.rados.0.smithi137.stdout:103: done (3 left) 2024-03-04T06:42:17.426 INFO:tasks.rados.rados.0.smithi137.stdout:107: done (2 left) 2024-03-04T06:42:17.426 INFO:tasks.rados.rados.0.smithi137.stdout:108: read oid 18 snap 0 2024-03-04T06:42:17.426 INFO:tasks.rados.rados.0.smithi137.stdout:108: expect (ObjNum 17 snap 0 seq_num 17) 2024-03-04T06:42:17.426 INFO:tasks.rados.rados.0.smithi137.stdout:109: rollback oid 40 current snap is 3 2024-03-04T06:42:17.426 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 40 to 0 2024-03-04T06:42:17.427 INFO:tasks.rados.rados.0.smithi137.stdout:105: expect (ObjNum 12 snap 0 seq_num 12) 2024-03-04T06:42:17.432 INFO:tasks.rados.rados.0.smithi137.stdout:106: finishing rollback tid 0 to smithi13777483-50 2024-03-04T06:42:17.432 INFO:tasks.rados.rados.0.smithi137.stdout:106: finishing rollback tid 1 to smithi13777483-50 2024-03-04T06:42:17.432 INFO:tasks.rados.rados.0.smithi137.stdout:106: finishing rollback tid 2 to smithi13777483-50 2024-03-04T06:42:17.432 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 17 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-03-04T06:42:17.432 INFO:tasks.rados.rados.0.smithi137.stdout:105: done (3 left) 2024-03-04T06:42:17.432 INFO:tasks.rados.rados.0.smithi137.stdout:106: done (2 left) 2024-03-04T06:42:17.432 INFO:tasks.rados.rados.0.smithi137.stdout:110: delete oid 48 current snap is 3 2024-03-04T06:42:17.433 INFO:tasks.rados.rados.0.smithi137.stdout:108: expect (ObjNum 17 snap 0 seq_num 17) 2024-03-04T06:42:17.440 INFO:tasks.rados.rados.0.smithi137.stdout:109: finishing rollback tid 0 to smithi13777483-40 2024-03-04T06:42:17.440 INFO:tasks.rados.rados.0.smithi137.stdout:109: finishing rollback tid 1 to smithi13777483-40 2024-03-04T06:42:17.440 INFO:tasks.rados.rados.0.smithi137.stdout:108: done (2 left) 2024-03-04T06:42:17.440 INFO:tasks.rados.rados.0.smithi137.stdout:110: done (1 left) 2024-03-04T06:42:17.440 INFO:tasks.rados.rados.0.smithi137.stdout:111: setattr oid 22 current snap is 3 2024-03-04T06:42:17.440 INFO:tasks.rados.rados.0.smithi137.stdout:109: finishing rollback tid 2 to smithi13777483-40 2024-03-04T06:42:17.440 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 31 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-03-04T06:42:17.441 INFO:tasks.rados.rados.0.smithi137.stdout:109: done (1 left) 2024-03-04T06:42:17.441 INFO:tasks.rados.rados.0.smithi137.stdout:112: snap_create 2024-03-04T06:42:17.443 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 33 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-03-04T06:42:17.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:17 smithi137 ceph-mon[26846]: osdmap e80: 8 total, 8 up, 8 in 2024-03-04T06:42:17.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:17 smithi137 ceph-mon[26846]: pgmap v126: 121 pgs: 121 active+clean; 27 MiB data, 258 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 83 op/s 2024-03-04T06:42:17.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:17 smithi137 ceph-mon[37364]: osdmap e80: 8 total, 8 up, 8 in 2024-03-04T06:42:17.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:17 smithi137 ceph-mon[37364]: pgmap v126: 121 pgs: 121 active+clean; 27 MiB data, 258 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 83 op/s 2024-03-04T06:42:17.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:17 smithi203 ceph-mon[30756]: osdmap e80: 8 total, 8 up, 8 in 2024-03-04T06:42:17.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:17 smithi203 ceph-mon[30756]: pgmap v126: 121 pgs: 121 active+clean; 27 MiB data, 258 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 83 op/s 2024-03-04T06:42:18.386 INFO:tasks.rados.rados.0.smithi137.stdout:111: done (1 left) 2024-03-04T06:42:18.386 INFO:tasks.rados.rados.0.smithi137.stdout:112: done (0 left) 2024-03-04T06:42:18.386 INFO:tasks.rados.rados.0.smithi137.stdout:113: copy_from oid 25 from oid 6 current snap is 4 2024-03-04T06:42:18.386 INFO:tasks.rados.rados.0.smithi137.stdout:114: setattr oid 23 current snap is 4 2024-03-04T06:42:18.388 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 4 2024-03-04T06:42:18.388 INFO:tasks.rados.rados.0.smithi137.stdout:115: seq_num 61 ranges {24576=630784,655360=401408} 2024-03-04T06:42:18.392 INFO:tasks.rados.rados.0.smithi137.stdout:115: writing smithi13777483-15 from 24576 to 655360 tid 1 2024-03-04T06:42:18.395 INFO:tasks.rados.rados.0.smithi137.stdout:115: writing smithi13777483-15 from 655360 to 1056768 tid 2 2024-03-04T06:42:18.395 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 4 2024-03-04T06:42:18.395 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 18 (ObjNum 53 snap 1 seq_num 53) dirty exists 2024-03-04T06:42:18.396 INFO:tasks.rados.rados.0.smithi137.stdout:116: seq_num 62 ranges {319488=647168,966656=401408} 2024-03-04T06:42:18.401 INFO:tasks.rados.rados.0.smithi137.stdout:116: writing smithi13777483-20 from 319488 to 966656 tid 1 2024-03-04T06:42:18.404 INFO:tasks.rados.rados.0.smithi137.stdout:116: writing smithi13777483-20 from 966656 to 1368064 tid 2 2024-03-04T06:42:18.404 INFO:tasks.rados.rados.0.smithi137.stdout:114: done (3 left) 2024-03-04T06:42:18.405 INFO:tasks.rados.rados.0.smithi137.stdout:117: rollback oid 14 current snap is 4 2024-03-04T06:42:18.405 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 14 to 0 2024-03-04T06:42:18.405 INFO:tasks.rados.rados.0.smithi137.stdout:115: finishing write tid 1 to smithi13777483-15 2024-03-04T06:42:18.405 INFO:tasks.rados.rados.0.smithi137.stdout:118: read oid 31 snap -1 2024-03-04T06:42:18.405 INFO:tasks.rados.rados.0.smithi137.stdout:118: expect (ObjNum 30 snap 0 seq_num 30) 2024-03-04T06:42:18.405 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 4 2024-03-04T06:42:18.405 INFO:tasks.rados.rados.0.smithi137.stdout:115: finishing write tid 2 to smithi13777483-15 2024-03-04T06:42:18.405 INFO:tasks.rados.rados.0.smithi137.stdout:119: seq_num 63 ranges {811008=663552,1474560=401408} 2024-03-04T06:42:18.412 INFO:tasks.rados.rados.0.smithi137.stdout:119: writing smithi13777483-49 from 811008 to 1474560 tid 1 2024-03-04T06:42:18.416 INFO:tasks.rados.rados.0.smithi137.stdout:119: writing smithi13777483-49 from 1474560 to 1875968 tid 2 2024-03-04T06:42:18.416 INFO:tasks.rados.rados.0.smithi137.stdout:120: snap_create 2024-03-04T06:42:18.416 INFO:tasks.rados.rados.0.smithi137.stdout:115: finishing write tid 3 to smithi13777483-15 2024-03-04T06:42:18.416 INFO:tasks.rados.rados.0.smithi137.stdout:115: finishing write tid 4 to smithi13777483-15 2024-03-04T06:42:18.416 INFO:tasks.rados.rados.0.smithi137.stdout:115: oid 15 updating version 0 to 36 2024-03-04T06:42:18.416 INFO:tasks.rados.rados.0.smithi137.stdout:115: oid 15 updating version 36 to 37 2024-03-04T06:42:18.416 INFO:tasks.rados.rados.0.smithi137.stdout:115: oid 15 version 37 is already newer than 35 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 37 (ObjNum 61 snap 4 seq_num 61) dirty exists 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:115: left oid 15 (ObjNum 61 snap 4 seq_num 61) 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:113: finishing copy_from racing read to smithi13777483-25 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:113: finishing copy_from to smithi13777483-25 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 24 (ObjNum 56 snap 3 seq_num 56) dirty exists 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:116: finishing write tid 1 to smithi13777483-20 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:116: finishing write tid 2 to smithi13777483-20 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:116: finishing write tid 3 to smithi13777483-20 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:117: finishing rollback tid 1 to smithi13777483-14 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:117: finishing rollback tid 2 to smithi13777483-14 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 24 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:116: finishing write tid 4 to smithi13777483-20 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:116: oid 20 updating version 0 to 20 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:116: oid 20 updating version 20 to 21 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:116: oid 20 updating version 21 to 22 2024-03-04T06:42:18.417 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 22 (ObjNum 62 snap 4 seq_num 62) dirty exists 2024-03-04T06:42:18.418 INFO:tasks.rados.rados.0.smithi137.stdout:116: left oid 20 (ObjNum 62 snap 4 seq_num 62) 2024-03-04T06:42:18.418 INFO:tasks.rados.rados.0.smithi137.stdout:118: expect (ObjNum 30 snap 0 seq_num 30) 2024-03-04T06:42:18.430 INFO:tasks.rados.rados.0.smithi137.stdout:119: finishing write tid 1 to smithi13777483-49 2024-03-04T06:42:18.430 INFO:tasks.rados.rados.0.smithi137.stdout:119: finishing write tid 2 to smithi13777483-49 2024-03-04T06:42:18.430 INFO:tasks.rados.rados.0.smithi137.stdout:119: finishing write tid 3 to smithi13777483-49 2024-03-04T06:42:18.430 INFO:tasks.rados.rados.0.smithi137.stdout:119: finishing write tid 4 to smithi13777483-49 2024-03-04T06:42:18.430 INFO:tasks.rados.rados.0.smithi137.stdout:119: oid 49 updating version 0 to 15 2024-03-04T06:42:18.430 INFO:tasks.rados.rados.0.smithi137.stdout:119: oid 49 updating version 15 to 16 2024-03-04T06:42:18.430 INFO:tasks.rados.rados.0.smithi137.stdout:119: oid 49 updating version 16 to 17 2024-03-04T06:42:18.430 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 17 (ObjNum 63 snap 4 seq_num 63) dirty exists 2024-03-04T06:42:18.430 INFO:tasks.rados.rados.0.smithi137.stdout:119: left oid 49 (ObjNum 63 snap 4 seq_num 63) 2024-03-04T06:42:18.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:18 smithi137 ceph-mon[26846]: osdmap e81: 8 total, 8 up, 8 in 2024-03-04T06:42:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:18 smithi137 ceph-mon[37364]: osdmap e81: 8 total, 8 up, 8 in 2024-03-04T06:42:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:18 smithi203 ceph-mon[30756]: osdmap e81: 8 total, 8 up, 8 in 2024-03-04T06:42:19.391 INFO:tasks.rados.rados.0.smithi137.stdout:113: done (6 left) 2024-03-04T06:42:19.391 INFO:tasks.rados.rados.0.smithi137.stdout:115: done (5 left) 2024-03-04T06:42:19.392 INFO:tasks.rados.rados.0.smithi137.stdout:116: done (4 left) 2024-03-04T06:42:19.392 INFO:tasks.rados.rados.0.smithi137.stdout:117: done (3 left) 2024-03-04T06:42:19.392 INFO:tasks.rados.rados.0.smithi137.stdout:118: done (2 left) 2024-03-04T06:42:19.392 INFO:tasks.rados.rados.0.smithi137.stdout:119: done (1 left) 2024-03-04T06:42:19.392 INFO:tasks.rados.rados.0.smithi137.stdout:120: done (0 left) 2024-03-04T06:42:19.392 INFO:tasks.rados.rados.0.smithi137.stdout:121: read oid 48 snap 3 2024-03-04T06:42:19.392 INFO:tasks.rados.rados.0.smithi137.stdout:121: expect deleted 2024-03-04T06:42:19.392 INFO:tasks.rados.rados.0.smithi137.stdout:122: read oid 49 snap 4 2024-03-04T06:42:19.392 INFO:tasks.rados.rados.0.smithi137.stdout:122: expect (ObjNum 63 snap 4 seq_num 63) 2024-03-04T06:42:19.392 INFO:tasks.rados.rados.0.smithi137.stdout:123: delete oid 44 current snap is 5 2024-03-04T06:42:19.397 INFO:tasks.rados.rados.0.smithi137.stdout:121: done (2 left) 2024-03-04T06:42:19.397 INFO:tasks.rados.rados.0.smithi137.stdout:123: done (1 left) 2024-03-04T06:42:19.397 INFO:tasks.rados.rados.0.smithi137.stdout:124: rollback oid 46 current snap is 5 2024-03-04T06:42:19.397 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 46 to 3 2024-03-04T06:42:19.397 INFO:tasks.rados.rados.0.smithi137.stdout:125: read oid 13 snap -1 2024-03-04T06:42:19.397 INFO:tasks.rados.rados.0.smithi137.stdout:125: expect (ObjNum 12 snap 0 seq_num 12) 2024-03-04T06:42:19.397 INFO:tasks.rados.rados.0.smithi137.stdout:126: setattr oid 47 current snap is 5 2024-03-04T06:42:19.399 INFO:tasks.rados.rados.0.smithi137.stdout:127: delete oid 20 current snap is 5 2024-03-04T06:42:19.399 INFO:tasks.rados.rados.0.smithi137.stdout:124: finishing rollback tid 0 to smithi13777483-46 2024-03-04T06:42:19.400 INFO:tasks.rados.rados.0.smithi137.stdout:124: finishing rollback tid 1 to smithi13777483-46 2024-03-04T06:42:19.400 INFO:tasks.rados.rados.0.smithi137.stdout:124: finishing rollback tid 2 to smithi13777483-46 2024-03-04T06:42:19.400 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 21 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-04T06:42:19.401 INFO:tasks.rados.rados.0.smithi137.stdout:124: done (4 left) 2024-03-04T06:42:19.401 INFO:tasks.rados.rados.0.smithi137.stdout:127: done (3 left) 2024-03-04T06:42:19.401 INFO:tasks.rados.rados.0.smithi137.stdout:128: snap_remove snap 3 2024-03-04T06:42:19.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:19 smithi137 ceph-mon[26846]: osdmap e82: 8 total, 8 up, 8 in 2024-03-04T06:42:19.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:19 smithi137 ceph-mon[26846]: pgmap v129: 121 pgs: 121 active+clean; 27 MiB data, 258 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 83 op/s 2024-03-04T06:42:19.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:19 smithi137 ceph-mon[37364]: osdmap e82: 8 total, 8 up, 8 in 2024-03-04T06:42:19.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:19 smithi137 ceph-mon[37364]: pgmap v129: 121 pgs: 121 active+clean; 27 MiB data, 258 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 83 op/s 2024-03-04T06:42:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:19 smithi203 ceph-mon[30756]: osdmap e82: 8 total, 8 up, 8 in 2024-03-04T06:42:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:19 smithi203 ceph-mon[30756]: pgmap v129: 121 pgs: 121 active+clean; 27 MiB data, 258 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 83 op/s 2024-03-04T06:42:20.394 INFO:tasks.rados.rados.0.smithi137.stdout:128: done (3 left) 2024-03-04T06:42:20.394 INFO:tasks.rados.rados.0.smithi137.stdout:129: setattr oid 5 current snap is 5 2024-03-04T06:42:20.394 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 25 (ObjNum 33 snap 0 seq_num 3130719520) dirty exists 2024-03-04T06:42:20.394 INFO:tasks.rados.rados.0.smithi137.stdout:125: expect (ObjNum 12 snap 0 seq_num 12) 2024-03-04T06:42:20.403 INFO:tasks.rados.rados.0.smithi137.stdout:122: expect (ObjNum 63 snap 4 seq_num 63) 2024-03-04T06:42:20.465 INFO:tasks.rados.rados.0.smithi137.stdout:122: done (3 left) 2024-03-04T06:42:20.465 INFO:tasks.rados.rados.0.smithi137.stdout:125: done (2 left) 2024-03-04T06:42:20.466 INFO:tasks.rados.rados.0.smithi137.stdout:126: done (1 left) 2024-03-04T06:42:20.466 INFO:tasks.rados.rados.0.smithi137.stdout:130: snap_remove snap 0 2024-03-04T06:42:20.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:20 smithi137 ceph-mon[26846]: osdmap e83: 8 total, 8 up, 8 in 2024-03-04T06:42:20.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:20 smithi137 ceph-mon[37364]: osdmap e83: 8 total, 8 up, 8 in 2024-03-04T06:42:20.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:20 smithi203 ceph-mon[30756]: osdmap e83: 8 total, 8 up, 8 in 2024-03-04T06:42:21.404 INFO:tasks.rados.rados.0.smithi137.stdout:130: done (1 left) 2024-03-04T06:42:21.404 INFO:tasks.rados.rados.0.smithi137.stdout:131: delete oid 6 current snap is 5 2024-03-04T06:42:21.404 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 24 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-03-04T06:42:21.416 INFO:tasks.rados.rados.0.smithi137.stdout:129: done (1 left) 2024-03-04T06:42:21.416 INFO:tasks.rados.rados.0.smithi137.stdout:131: done (0 left) 2024-03-04T06:42:21.416 INFO:tasks.rados.rados.0.smithi137.stdout:132: snap_remove snap 4 2024-03-04T06:42:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:21 smithi137 ceph-mon[26846]: osdmap e84: 8 total, 8 up, 8 in 2024-03-04T06:42:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:21 smithi137 ceph-mon[26846]: pgmap v132: 121 pgs: 121 active+clean; 27 MiB data, 258 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:21 smithi137 ceph-mon[37364]: osdmap e84: 8 total, 8 up, 8 in 2024-03-04T06:42:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:21 smithi137 ceph-mon[37364]: pgmap v132: 121 pgs: 121 active+clean; 27 MiB data, 258 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:21 smithi203 ceph-mon[30756]: osdmap e84: 8 total, 8 up, 8 in 2024-03-04T06:42:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:21 smithi203 ceph-mon[30756]: pgmap v132: 121 pgs: 121 active+clean; 27 MiB data, 258 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:22.403 INFO:tasks.rados.rados.0.smithi137.stdout:132: done (0 left) 2024-03-04T06:42:22.404 INFO:tasks.rados.rados.0.smithi137.stdout:133: rollback oid 17 current snap is 5 2024-03-04T06:42:22.404 INFO:tasks.rados.rados.0.smithi137.stdout:133: done (0 left) 2024-03-04T06:42:22.404 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 43 current snap is 5 2024-03-04T06:42:22.404 INFO:tasks.rados.rados.0.smithi137.stdout:134: seq_num 67 ranges {712704=729088,1441792=401408} 2024-03-04T06:42:22.412 INFO:tasks.rados.rados.0.smithi137.stdout:134: writing smithi13777483-43 from 712704 to 1441792 tid 1 2024-03-04T06:42:22.416 INFO:tasks.rados.rados.0.smithi137.stdout:134: writing smithi13777483-43 from 1441792 to 1843200 tid 2 2024-03-04T06:42:22.416 INFO:tasks.rados.rados.0.smithi137.stdout:135: read oid 11 snap -1 2024-03-04T06:42:22.416 INFO:tasks.rados.rados.0.smithi137.stdout:135: expect (ObjNum 10 snap 0 seq_num 10) 2024-03-04T06:42:22.417 INFO:tasks.rados.rados.0.smithi137.stdout:136: read oid 6 snap -1 2024-03-04T06:42:22.417 INFO:tasks.rados.rados.0.smithi137.stdout:136: expect deleted 2024-03-04T06:42:22.417 INFO:tasks.rados.rados.0.smithi137.stdout:137: copy_from oid 18 from oid 46 current snap is 5 2024-03-04T06:42:22.417 INFO:tasks.rados.rados.0.smithi137.stdout:138: read oid 41 snap -1 2024-03-04T06:42:22.417 INFO:tasks.rados.rados.0.smithi137.stdout:138: expect (ObjNum 40 snap 0 seq_num 40) 2024-03-04T06:42:22.417 INFO:tasks.rados.rados.0.smithi137.stdout:139: rmattr oid 37 current snap is 5 2024-03-04T06:42:22.417 INFO:tasks.rados.rados.0.smithi137.stdout:139: done (5 left) 2024-03-04T06:42:22.417 INFO:tasks.rados.rados.0.smithi137.stdout:140: read oid 1 snap -1 2024-03-04T06:42:22.417 INFO:tasks.rados.rados.0.smithi137.stdout:140: expect deleted 2024-03-04T06:42:22.417 INFO:tasks.rados.rados.0.smithi137.stdout:141: rmattr oid 30 current snap is 5 2024-03-04T06:42:22.417 INFO:tasks.rados.rados.0.smithi137.stdout:141: done (6 left) 2024-03-04T06:42:22.417 INFO:tasks.rados.rados.0.smithi137.stdout:142: setattr oid 47 current snap is 5 2024-03-04T06:42:22.418 INFO:tasks.rados.rados.0.smithi137.stdout:136: done (6 left) 2024-03-04T06:42:22.418 INFO:tasks.rados.rados.0.smithi137.stdout:140: done (5 left) 2024-03-04T06:42:22.419 INFO:tasks.rados.rados.0.smithi137.stdout:143: copy_from oid 23 from oid 25 current snap is 5 2024-03-04T06:42:22.419 INFO:tasks.rados.rados.0.smithi137.stdout:144: setattr oid 24 current snap is 5 2024-03-04T06:42:22.419 INFO:tasks.rados.rados.0.smithi137.stdout:134: finishing write tid 1 to smithi13777483-43 2024-03-04T06:42:22.419 INFO:tasks.rados.rados.0.smithi137.stdout:134: finishing write tid 2 to smithi13777483-43 2024-03-04T06:42:22.419 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 5 2024-03-04T06:42:22.420 INFO:tasks.rados.rados.0.smithi137.stdout:134: finishing write tid 3 to smithi13777483-43 2024-03-04T06:42:22.420 INFO:tasks.rados.rados.0.smithi137.stdout:145: seq_num 68 ranges {303104=745472,1048576=401408} 2024-03-04T06:42:22.426 INFO:tasks.rados.rados.0.smithi137.stdout:145: writing smithi13777483-19 from 303104 to 1048576 tid 1 2024-03-04T06:42:22.429 INFO:tasks.rados.rados.0.smithi137.stdout:145: writing smithi13777483-19 from 1048576 to 1449984 tid 2 2024-03-04T06:42:22.429 INFO:tasks.rados.rados.0.smithi137.stdout:135: expect (ObjNum 10 snap 0 seq_num 10) 2024-03-04T06:42:22.434 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 34 (ObjNum 33 snap 0 seq_num 3130719520) dirty exists 2024-03-04T06:42:22.435 INFO:tasks.rados.rados.0.smithi137.stdout:134: finishing write tid 4 to smithi13777483-43 2024-03-04T06:42:22.435 INFO:tasks.rados.rados.0.smithi137.stdout:134: oid 43 updating version 0 to 11 2024-03-04T06:42:22.435 INFO:tasks.rados.rados.0.smithi137.stdout:134: oid 43 version 11 is already newer than 9 2024-03-04T06:42:22.435 INFO:tasks.rados.rados.0.smithi137.stdout:134: oid 43 version 11 is already newer than 10 2024-03-04T06:42:22.435 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 11 (ObjNum 67 snap 5 seq_num 67) dirty exists 2024-03-04T06:42:22.435 INFO:tasks.rados.rados.0.smithi137.stdout:134: left oid 43 (ObjNum 67 snap 5 seq_num 67) 2024-03-04T06:42:22.435 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 13 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-03-04T06:42:22.435 INFO:tasks.rados.rados.0.smithi137.stdout:134: done (7 left) 2024-03-04T06:42:22.435 INFO:tasks.rados.rados.0.smithi137.stdout:135: done (6 left) 2024-03-04T06:42:22.435 INFO:tasks.rados.rados.0.smithi137.stdout:142: done (5 left) 2024-03-04T06:42:22.435 INFO:tasks.rados.rados.0.smithi137.stdout:144: done (4 left) 2024-03-04T06:42:22.435 INFO:tasks.rados.rados.0.smithi137.stdout:146: setattr oid 35 current snap is 5 2024-03-04T06:42:22.436 INFO:tasks.rados.rados.0.smithi137.stdout:137: finishing copy_from racing read to smithi13777483-18 2024-03-04T06:42:22.436 INFO:tasks.rados.rados.0.smithi137.stdout:138: expect (ObjNum 40 snap 0 seq_num 40) 2024-03-04T06:42:22.456 INFO:tasks.rados.rados.0.smithi137.stdout:137: finishing copy_from to smithi13777483-18 2024-03-04T06:42:22.456 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 21 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-04T06:42:22.456 INFO:tasks.rados.rados.0.smithi137.stdout:145: finishing write tid 1 to smithi13777483-19 2024-03-04T06:42:22.456 INFO:tasks.rados.rados.0.smithi137.stdout:145: finishing write tid 2 to smithi13777483-19 2024-03-04T06:42:22.456 INFO:tasks.rados.rados.0.smithi137.stdout:145: finishing write tid 3 to smithi13777483-19 2024-03-04T06:42:22.456 INFO:tasks.rados.rados.0.smithi137.stdout:143: finishing copy_from racing read to smithi13777483-23 2024-03-04T06:42:22.456 INFO:tasks.rados.rados.0.smithi137.stdout:145: finishing write tid 4 to smithi13777483-19 2024-03-04T06:42:22.456 INFO:tasks.rados.rados.0.smithi137.stdout:145: oid 19 updating version 0 to 34 2024-03-04T06:42:22.456 INFO:tasks.rados.rados.0.smithi137.stdout:145: oid 19 version 34 is already newer than 33 2024-03-04T06:42:22.456 INFO:tasks.rados.rados.0.smithi137.stdout:145: oid 19 updating version 34 to 35 2024-03-04T06:42:22.457 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 35 (ObjNum 68 snap 5 seq_num 68) dirty exists 2024-03-04T06:42:22.457 INFO:tasks.rados.rados.0.smithi137.stdout:145: left oid 19 (ObjNum 68 snap 5 seq_num 68) 2024-03-04T06:42:22.457 INFO:tasks.rados.rados.0.smithi137.stdout:143: finishing copy_from to smithi13777483-23 2024-03-04T06:42:22.457 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 24 (ObjNum 56 snap 3 seq_num 56) dirty exists 2024-03-04T06:42:22.457 INFO:tasks.rados.rados.0.smithi137.stdout:137: done (4 left) 2024-03-04T06:42:22.457 INFO:tasks.rados.rados.0.smithi137.stdout:138: done (3 left) 2024-03-04T06:42:22.457 INFO:tasks.rados.rados.0.smithi137.stdout:143: done (2 left) 2024-03-04T06:42:22.457 INFO:tasks.rados.rados.0.smithi137.stdout:145: done (1 left) 2024-03-04T06:42:22.457 INFO:tasks.rados.rados.0.smithi137.stdout:147: snap_create 2024-03-04T06:42:22.458 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 22 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-03-04T06:42:22.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:22 smithi137 ceph-mon[26846]: osdmap e85: 8 total, 8 up, 8 in 2024-03-04T06:42:22.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:22 smithi137 ceph-mon[37364]: osdmap e85: 8 total, 8 up, 8 in 2024-03-04T06:42:22.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:22 smithi203 ceph-mon[30756]: osdmap e85: 8 total, 8 up, 8 in 2024-03-04T06:42:23.412 INFO:tasks.rados.rados.0.smithi137.stdout:146: done (1 left) 2024-03-04T06:42:23.412 INFO:tasks.rados.rados.0.smithi137.stdout:147: done (0 left) 2024-03-04T06:42:23.412 INFO:tasks.rados.rados.0.smithi137.stdout:148: snap_remove snap 5 2024-03-04T06:42:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:23 smithi137 ceph-mon[37364]: osdmap e86: 8 total, 8 up, 8 in 2024-03-04T06:42:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:23 smithi137 ceph-mon[37364]: pgmap v135: 121 pgs: 121 active+clean; 35 MiB data, 271 MiB used, 715 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.1 MiB/s wr, 41 op/s 2024-03-04T06:42:23.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:23 smithi137 ceph-mon[26846]: osdmap e86: 8 total, 8 up, 8 in 2024-03-04T06:42:23.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:23 smithi137 ceph-mon[26846]: pgmap v135: 121 pgs: 121 active+clean; 35 MiB data, 271 MiB used, 715 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.1 MiB/s wr, 41 op/s 2024-03-04T06:42:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:23 smithi203 ceph-mon[30756]: osdmap e86: 8 total, 8 up, 8 in 2024-03-04T06:42:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:23 smithi203 ceph-mon[30756]: pgmap v135: 121 pgs: 121 active+clean; 35 MiB data, 271 MiB used, 715 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.1 MiB/s wr, 41 op/s 2024-03-04T06:42:24.418 INFO:tasks.rados.rados.0.smithi137.stdout:148: done (0 left) 2024-03-04T06:42:24.418 INFO:tasks.rados.rados.0.smithi137.stdout:149: delete oid 1 current snap is 6 2024-03-04T06:42:24.420 INFO:tasks.rados.rados.0.smithi137.stdout:149: done (0 left) 2024-03-04T06:42:24.420 INFO:tasks.rados.rados.0.smithi137.stdout:150: snap_create 2024-03-04T06:42:24.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:24 smithi137 ceph-mon[26846]: osdmap e87: 8 total, 8 up, 8 in 2024-03-04T06:42:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:24 smithi137 ceph-mon[37364]: osdmap e87: 8 total, 8 up, 8 in 2024-03-04T06:42:24.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:24 smithi203 ceph-mon[30756]: osdmap e87: 8 total, 8 up, 8 in 2024-03-04T06:42:25.350 INFO:tasks.rados.rados.0.smithi137.stdout:150: done (0 left) 2024-03-04T06:42:25.350 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 7 2024-03-04T06:42:25.350 INFO:tasks.rados.rados.0.smithi137.stdout:151: seq_num 70 ranges {507904=778240,1286144=401408} 2024-03-04T06:42:25.357 INFO:tasks.rados.rados.0.smithi137.stdout:151: writing smithi13777483-31 from 507904 to 1286144 tid 1 2024-03-04T06:42:25.360 INFO:tasks.rados.rados.0.smithi137.stdout:151: writing smithi13777483-31 from 1286144 to 1687552 tid 2 2024-03-04T06:42:25.360 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 7 2024-03-04T06:42:25.360 INFO:tasks.rados.rados.0.smithi137.stdout:152: seq_num 71 ranges {73728=794624,868352=401408} 2024-03-04T06:42:25.365 INFO:tasks.rados.rados.0.smithi137.stdout:152: writing smithi13777483-16 from 73728 to 868352 tid 1 2024-03-04T06:42:25.369 INFO:tasks.rados.rados.0.smithi137.stdout:152: writing smithi13777483-16 from 868352 to 1269760 tid 2 2024-03-04T06:42:25.369 INFO:tasks.rados.rados.0.smithi137.stdout:153: copy_from oid 10 from oid 39 current snap is 7 2024-03-04T06:42:25.369 INFO:tasks.rados.rados.0.smithi137.stdout:151: finishing write tid 1 to smithi13777483-31 2024-03-04T06:42:25.369 INFO:tasks.rados.rados.0.smithi137.stdout:151: finishing write tid 2 to smithi13777483-31 2024-03-04T06:42:25.369 INFO:tasks.rados.rados.0.smithi137.stdout:151: finishing write tid 3 to smithi13777483-31 2024-03-04T06:42:25.369 INFO:tasks.rados.rados.0.smithi137.stdout:151: finishing write tid 4 to smithi13777483-31 2024-03-04T06:42:25.369 INFO:tasks.rados.rados.0.smithi137.stdout:151: oid 31 updating version 0 to 25 2024-03-04T06:42:25.369 INFO:tasks.rados.rados.0.smithi137.stdout:151: oid 31 updating version 25 to 26 2024-03-04T06:42:25.369 INFO:tasks.rados.rados.0.smithi137.stdout:151: oid 31 version 26 is already newer than 24 2024-03-04T06:42:25.369 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 26 (ObjNum 70 snap 7 seq_num 70) dirty exists 2024-03-04T06:42:25.370 INFO:tasks.rados.rados.0.smithi137.stdout:151: left oid 31 (ObjNum 70 snap 7 seq_num 70) 2024-03-04T06:42:25.370 INFO:tasks.rados.rados.0.smithi137.stdout:151: done (2 left) 2024-03-04T06:42:25.370 INFO:tasks.rados.rados.0.smithi137.stdout:154: read oid 25 snap 6 2024-03-04T06:42:25.370 INFO:tasks.rados.rados.0.smithi137.stdout:154: expect (ObjNum 56 snap 3 seq_num 56) 2024-03-04T06:42:25.370 INFO:tasks.rados.rados.0.smithi137.stdout:155: copy_from oid 21 from oid 35 current snap is 7 2024-03-04T06:42:25.370 INFO:tasks.rados.rados.0.smithi137.stdout:156: rollback oid 19 current snap is 7 2024-03-04T06:42:25.370 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 19 to 6 2024-03-04T06:42:25.370 INFO:tasks.rados.rados.0.smithi137.stdout:157: copy_from oid 38 from oid 24 current snap is 7 2024-03-04T06:42:25.370 INFO:tasks.rados.rados.0.smithi137.stdout:152: finishing write tid 1 to smithi13777483-16 2024-03-04T06:42:25.370 INFO:tasks.rados.rados.0.smithi137.stdout:158: snap_create 2024-03-04T06:42:25.372 INFO:tasks.rados.rados.0.smithi137.stdout:152: finishing write tid 2 to smithi13777483-16 2024-03-04T06:42:25.372 INFO:tasks.rados.rados.0.smithi137.stdout:152: finishing write tid 3 to smithi13777483-16 2024-03-04T06:42:25.374 INFO:tasks.rados.rados.0.smithi137.stdout:156: finishing rollback tid 0 to smithi13777483-19 2024-03-04T06:42:25.374 INFO:tasks.rados.rados.0.smithi137.stdout:156: finishing rollback tid 1 to smithi13777483-19 2024-03-04T06:42:25.374 INFO:tasks.rados.rados.0.smithi137.stdout:156: finishing rollback tid 2 to smithi13777483-19 2024-03-04T06:42:25.374 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 39 (ObjNum 68 snap 5 seq_num 68) dirty exists 2024-03-04T06:42:25.374 INFO:tasks.rados.rados.0.smithi137.stdout:152: finishing write tid 4 to smithi13777483-16 2024-03-04T06:42:25.374 INFO:tasks.rados.rados.0.smithi137.stdout:152: oid 16 updating version 0 to 30 2024-03-04T06:42:25.375 INFO:tasks.rados.rados.0.smithi137.stdout:152: oid 16 updating version 30 to 32 2024-03-04T06:42:25.375 INFO:tasks.rados.rados.0.smithi137.stdout:152: oid 16 version 32 is already newer than 31 2024-03-04T06:42:25.375 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 32 (ObjNum 71 snap 7 seq_num 71) dirty exists 2024-03-04T06:42:25.375 INFO:tasks.rados.rados.0.smithi137.stdout:152: left oid 16 (ObjNum 71 snap 7 seq_num 71) 2024-03-04T06:42:25.376 INFO:tasks.rados.rados.0.smithi137.stdout:154: expect (ObjNum 56 snap 3 seq_num 56) 2024-03-04T06:42:25.433 INFO:tasks.rados.rados.0.smithi137.stdout:155: finishing copy_from racing read to smithi13777483-21 2024-03-04T06:42:25.433 INFO:tasks.rados.rados.0.smithi137.stdout:157: finishing copy_from racing read to smithi13777483-38 2024-03-04T06:42:25.433 INFO:tasks.rados.rados.0.smithi137.stdout:155: finishing copy_from to smithi13777483-21 2024-03-04T06:42:25.433 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 22 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-03-04T06:42:25.433 INFO:tasks.rados.rados.0.smithi137.stdout:157: finishing copy_from to smithi13777483-38 2024-03-04T06:42:25.433 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 13 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-03-04T06:42:25.433 INFO:tasks.rados.rados.0.smithi137.stdout:153: finishing copy_from racing read to smithi13777483-10 2024-03-04T06:42:25.433 INFO:tasks.rados.rados.0.smithi137.stdout:153: finishing copy_from to smithi13777483-10 2024-03-04T06:42:25.433 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 8 (ObjNum 55 snap 3 seq_num 55) dirty exists 2024-03-04T06:42:25.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:42:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:42:25] "GET /metrics HTTP/1.1" 200 35938 "" "Prometheus/2.43.0" 2024-03-04T06:42:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:25 smithi137 ceph-mon[26846]: osdmap e88: 8 total, 8 up, 8 in 2024-03-04T06:42:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:25 smithi137 ceph-mon[26846]: pgmap v138: 121 pgs: 121 active+clean; 35 MiB data, 271 MiB used, 715 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.1 MiB/s wr, 41 op/s 2024-03-04T06:42:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:25 smithi137 ceph-mon[26846]: osdmap e89: 8 total, 8 up, 8 in 2024-03-04T06:42:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:25 smithi137 ceph-mon[37364]: osdmap e88: 8 total, 8 up, 8 in 2024-03-04T06:42:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:25 smithi137 ceph-mon[37364]: pgmap v138: 121 pgs: 121 active+clean; 35 MiB data, 271 MiB used, 715 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.1 MiB/s wr, 41 op/s 2024-03-04T06:42:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:25 smithi137 ceph-mon[37364]: osdmap e89: 8 total, 8 up, 8 in 2024-03-04T06:42:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:25 smithi203 ceph-mon[30756]: osdmap e88: 8 total, 8 up, 8 in 2024-03-04T06:42:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:25 smithi203 ceph-mon[30756]: pgmap v138: 121 pgs: 121 active+clean; 35 MiB data, 271 MiB used, 715 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.1 MiB/s wr, 41 op/s 2024-03-04T06:42:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:25 smithi203 ceph-mon[30756]: osdmap e89: 8 total, 8 up, 8 in 2024-03-04T06:42:26.357 INFO:tasks.rados.rados.0.smithi137.stdout:152: done (6 left) 2024-03-04T06:42:26.357 INFO:tasks.rados.rados.0.smithi137.stdout:153: done (5 left) 2024-03-04T06:42:26.357 INFO:tasks.rados.rados.0.smithi137.stdout:154: done (4 left) 2024-03-04T06:42:26.357 INFO:tasks.rados.rados.0.smithi137.stdout:155: done (3 left) 2024-03-04T06:42:26.358 INFO:tasks.rados.rados.0.smithi137.stdout:156: done (2 left) 2024-03-04T06:42:26.358 INFO:tasks.rados.rados.0.smithi137.stdout:157: done (1 left) 2024-03-04T06:42:26.358 INFO:tasks.rados.rados.0.smithi137.stdout:158: done (0 left) 2024-03-04T06:42:26.358 INFO:tasks.rados.rados.0.smithi137.stdout:159: read oid 46 snap -1 2024-03-04T06:42:26.358 INFO:tasks.rados.rados.0.smithi137.stdout:159: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:42:26.358 INFO:tasks.rados.rados.0.smithi137.stdout:160: read oid 7 snap 6 2024-03-04T06:42:26.358 INFO:tasks.rados.rados.0.smithi137.stdout:160: expect (ObjNum 6 snap 0 seq_num 6) 2024-03-04T06:42:26.358 INFO:tasks.rados.rados.0.smithi137.stdout:161: snap_create 2024-03-04T06:42:26.364 INFO:tasks.rados.rados.0.smithi137.stdout:159: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:42:26.387 INFO:tasks.rados.rados.0.smithi137.stdout:160: expect (ObjNum 6 snap 0 seq_num 6) 2024-03-04T06:42:27.364 INFO:tasks.rados.rados.0.smithi137.stdout:159: done (2 left) 2024-03-04T06:42:27.364 INFO:tasks.rados.rados.0.smithi137.stdout:160: done (1 left) 2024-03-04T06:42:27.364 INFO:tasks.rados.rados.0.smithi137.stdout:161: done (0 left) 2024-03-04T06:42:27.364 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 9 2024-03-04T06:42:27.364 INFO:tasks.rados.rados.0.smithi137.stdout:162: seq_num 72 ranges {204800=409600,614400=524288,1138688=278528} 2024-03-04T06:42:27.366 INFO:tasks.rados.rados.0.smithi137.stdout:162: writing smithi13777483-13 from 204800 to 614400 tid 1 2024-03-04T06:42:27.370 INFO:tasks.rados.rados.0.smithi137.stdout:162: writing smithi13777483-13 from 614400 to 1138688 tid 2 2024-03-04T06:42:27.372 INFO:tasks.rados.rados.0.smithi137.stdout:162: writing smithi13777483-13 from 1138688 to 1417216 tid 3 2024-03-04T06:42:27.373 INFO:tasks.rados.rados.0.smithi137.stdout:162: finishing write tid 1 to smithi13777483-13 2024-03-04T06:42:27.373 INFO:tasks.rados.rados.0.smithi137.stdout:163: copy_from oid 15 from oid 5 current snap is 9 2024-03-04T06:42:27.373 INFO:tasks.rados.rados.0.smithi137.stdout:164: rollback oid 19 current snap is 9 2024-03-04T06:42:27.373 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 19 to 7 2024-03-04T06:42:27.373 INFO:tasks.rados.rados.0.smithi137.stdout:165: copy_from oid 21 from oid 24 current snap is 9 2024-03-04T06:42:27.373 INFO:tasks.rados.rados.0.smithi137.stdout:166: copy_from oid 3 from oid 7 current snap is 9 2024-03-04T06:42:27.373 INFO:tasks.rados.rados.0.smithi137.stdout:167: read oid 33 snap -1 2024-03-04T06:42:27.373 INFO:tasks.rados.rados.0.smithi137.stdout:167: expect (ObjNum 32 snap 0 seq_num 32) 2024-03-04T06:42:27.373 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 9 2024-03-04T06:42:27.373 INFO:tasks.rados.rados.0.smithi137.stdout:168: seq_num 73 ranges {1269760=425984,1695744=409600,2105344=393216} 2024-03-04T06:42:27.382 INFO:tasks.rados.rados.0.smithi137.stdout:168: writing smithi13777483-16 from 1269760 to 1695744 tid 1 2024-03-04T06:42:27.384 INFO:tasks.rados.rados.0.smithi137.stdout:168: writing smithi13777483-16 from 1695744 to 2105344 tid 2 2024-03-04T06:42:27.387 INFO:tasks.rados.rados.0.smithi137.stdout:168: writing smithi13777483-16 from 2105344 to 2498560 tid 3 2024-03-04T06:42:27.387 INFO:tasks.rados.rados.0.smithi137.stdout:169: rmattr oid 34 current snap is 9 2024-03-04T06:42:27.387 INFO:tasks.rados.rados.0.smithi137.stdout:169: done (7 left) 2024-03-04T06:42:27.387 INFO:tasks.rados.rados.0.smithi137.stdout:170: snap_remove snap 8 2024-03-04T06:42:27.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:27 smithi137 ceph-mon[26846]: osdmap e90: 8 total, 8 up, 8 in 2024-03-04T06:42:27.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:27 smithi137 ceph-mon[26846]: pgmap v141: 121 pgs: 121 active+clean; 34 MiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 25 op/s 2024-03-04T06:42:27.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:27 smithi137 ceph-mon[37364]: osdmap e90: 8 total, 8 up, 8 in 2024-03-04T06:42:27.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:27 smithi137 ceph-mon[37364]: pgmap v141: 121 pgs: 121 active+clean; 34 MiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 25 op/s 2024-03-04T06:42:27.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:27 smithi203 ceph-mon[30756]: osdmap e90: 8 total, 8 up, 8 in 2024-03-04T06:42:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:27 smithi203 ceph-mon[30756]: pgmap v141: 121 pgs: 121 active+clean; 34 MiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 25 op/s 2024-03-04T06:42:28.371 INFO:tasks.rados.rados.0.smithi137.stdout:170: done (7 left) 2024-03-04T06:42:28.372 INFO:tasks.rados.rados.0.smithi137.stdout:171: rollback oid 36 current snap is 9 2024-03-04T06:42:28.372 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 36 to 6 2024-03-04T06:42:28.372 INFO:tasks.rados.rados.0.smithi137.stdout:172: copy_from oid 48 from oid 8 current snap is 9 2024-03-04T06:42:28.372 INFO:tasks.rados.rados.0.smithi137.stdout:173: copy_from oid 50 from oid 27 current snap is 9 2024-03-04T06:42:28.372 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 9 2024-03-04T06:42:28.372 INFO:tasks.rados.rados.0.smithi137.stdout:174: seq_num 74 ranges {0=442368,442368=696320,1138688=106496} 2024-03-04T06:42:28.373 INFO:tasks.rados.rados.0.smithi137.stdout:174: writing smithi13777483-47 from 0 to 442368 tid 1 2024-03-04T06:42:28.378 INFO:tasks.rados.rados.0.smithi137.stdout:174: writing smithi13777483-47 from 442368 to 1138688 tid 2 2024-03-04T06:42:28.380 INFO:tasks.rados.rados.0.smithi137.stdout:174: writing smithi13777483-47 from 1138688 to 1245184 tid 3 2024-03-04T06:42:28.380 INFO:tasks.rados.rados.0.smithi137.stdout:162: finishing write tid 2 to smithi13777483-13 2024-03-04T06:42:28.380 INFO:tasks.rados.rados.0.smithi137.stdout:162: finishing write tid 3 to smithi13777483-13 2024-03-04T06:42:28.380 INFO:tasks.rados.rados.0.smithi137.stdout:164: finishing rollback tid 0 to smithi13777483-19 2024-03-04T06:42:28.380 INFO:tasks.rados.rados.0.smithi137.stdout:164: finishing rollback tid 1 to smithi13777483-19 2024-03-04T06:42:28.380 INFO:tasks.rados.rados.0.smithi137.stdout:163: finishing copy_from racing read to smithi13777483-15 2024-03-04T06:42:28.380 INFO:tasks.rados.rados.0.smithi137.stdout:164: finishing rollback tid 2 to smithi13777483-19 2024-03-04T06:42:28.380 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 45 (ObjNum 68 snap 5 seq_num 68) dirty exists 2024-03-04T06:42:28.380 INFO:tasks.rados.rados.0.smithi137.stdout:162: finishing write tid 4 to smithi13777483-13 2024-03-04T06:42:28.380 INFO:tasks.rados.rados.0.smithi137.stdout:166: finishing copy_from racing read to smithi13777483-3 2024-03-04T06:42:28.380 INFO:tasks.rados.rados.0.smithi137.stdout:163: finishing copy_from to smithi13777483-15 2024-03-04T06:42:28.381 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 24 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-03-04T06:42:28.381 INFO:tasks.rados.rados.0.smithi137.stdout:162: finishing write tid 5 to smithi13777483-13 2024-03-04T06:42:28.381 INFO:tasks.rados.rados.0.smithi137.stdout:162: oid 13 updating version 0 to 31 2024-03-04T06:42:28.381 INFO:tasks.rados.rados.0.smithi137.stdout:162: oid 13 updating version 31 to 33 2024-03-04T06:42:28.381 INFO:tasks.rados.rados.0.smithi137.stdout:162: oid 13 version 33 is already newer than 32 2024-03-04T06:42:28.381 INFO:tasks.rados.rados.0.smithi137.stdout:162: oid 13 updating version 33 to 34 2024-03-04T06:42:28.381 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 34 (ObjNum 72 snap 9 seq_num 72) dirty exists 2024-03-04T06:42:28.381 INFO:tasks.rados.rados.0.smithi137.stdout:162: left oid 13 (ObjNum 72 snap 9 seq_num 72) 2024-03-04T06:42:28.381 INFO:tasks.rados.rados.0.smithi137.stdout:166: finishing copy_from to smithi13777483-3 2024-03-04T06:42:28.381 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-03-04T06:42:28.381 INFO:tasks.rados.rados.0.smithi137.stdout:167: expect (ObjNum 32 snap 0 seq_num 32) 2024-03-04T06:42:28.398 INFO:tasks.rados.rados.0.smithi137.stdout:165: finishing copy_from racing read to smithi13777483-21 2024-03-04T06:42:28.398 INFO:tasks.rados.rados.0.smithi137.stdout:165: finishing copy_from to smithi13777483-21 2024-03-04T06:42:28.398 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 13 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-03-04T06:42:28.398 INFO:tasks.rados.rados.0.smithi137.stdout:168: finishing write tid 1 to smithi13777483-16 2024-03-04T06:42:28.398 INFO:tasks.rados.rados.0.smithi137.stdout:168: finishing write tid 2 to smithi13777483-16 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:162: done (10 left) 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:163: done (9 left) 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:164: done (8 left) 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:165: done (7 left) 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:166: done (6 left) 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:167: done (5 left) 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:175: setattr oid 13 current snap is 9 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:168: finishing write tid 3 to smithi13777483-16 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:168: finishing write tid 4 to smithi13777483-16 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:168: finishing write tid 5 to smithi13777483-16 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:168: oid 16 updating version 0 to 35 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:168: oid 16 updating version 35 to 36 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:168: oid 16 version 36 is already newer than 34 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:168: oid 16 updating version 36 to 37 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 37 (ObjNum 73 snap 9 seq_num 73) dirty exists 2024-03-04T06:42:28.399 INFO:tasks.rados.rados.0.smithi137.stdout:168: left oid 16 (ObjNum 73 snap 9 seq_num 73) 2024-03-04T06:42:28.400 INFO:tasks.rados.rados.0.smithi137.stdout:171: finishing rollback tid 0 to smithi13777483-36 2024-03-04T06:42:28.400 INFO:tasks.rados.rados.0.smithi137.stdout:171: finishing rollback tid 1 to smithi13777483-36 2024-03-04T06:42:28.400 INFO:tasks.rados.rados.0.smithi137.stdout:171: finishing rollback tid 2 to smithi13777483-36 2024-03-04T06:42:28.400 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 16 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-03-04T06:42:28.400 INFO:tasks.rados.rados.0.smithi137.stdout:172: finishing copy_from racing read to smithi13777483-48 2024-03-04T06:42:28.400 INFO:tasks.rados.rados.0.smithi137.stdout:173: finishing copy_from racing read to smithi13777483-50 2024-03-04T06:42:28.400 INFO:tasks.rados.rados.0.smithi137.stdout:174: finishing write tid 1 to smithi13777483-47 2024-03-04T06:42:28.400 INFO:tasks.rados.rados.0.smithi137.stdout:174: finishing write tid 2 to smithi13777483-47 2024-03-04T06:42:28.400 INFO:tasks.rados.rados.0.smithi137.stdout:173: finishing copy_from to smithi13777483-50 2024-03-04T06:42:28.400 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 4 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-03-04T06:42:28.400 INFO:tasks.rados.rados.0.smithi137.stdout:172: finishing copy_from to smithi13777483-48 2024-03-04T06:42:28.400 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 4 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-03-04T06:42:28.401 INFO:tasks.rados.rados.0.smithi137.stdout:174: finishing write tid 3 to smithi13777483-47 2024-03-04T06:42:28.401 INFO:tasks.rados.rados.0.smithi137.stdout:174: finishing write tid 4 to smithi13777483-47 2024-03-04T06:42:28.401 INFO:tasks.rados.rados.0.smithi137.stdout:174: finishing write tid 5 to smithi13777483-47 2024-03-04T06:42:28.401 INFO:tasks.rados.rados.0.smithi137.stdout:174: oid 47 updating version 0 to 46 2024-03-04T06:42:28.401 INFO:tasks.rados.rados.0.smithi137.stdout:174: oid 47 version 46 is already newer than 44 2024-03-04T06:42:28.401 INFO:tasks.rados.rados.0.smithi137.stdout:174: oid 47 version 46 is already newer than 45 2024-03-04T06:42:28.401 INFO:tasks.rados.rados.0.smithi137.stdout:174: oid 47 updating version 46 to 47 2024-03-04T06:42:28.401 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 47 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:42:28.401 INFO:tasks.rados.rados.0.smithi137.stdout:174: left oid 47 (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:42:28.401 INFO:tasks.rados.rados.0.smithi137.stdout:168: done (5 left) 2024-03-04T06:42:28.401 INFO:tasks.rados.rados.0.smithi137.stdout:171: done (4 left) 2024-03-04T06:42:28.401 INFO:tasks.rados.rados.0.smithi137.stdout:172: done (3 left) 2024-03-04T06:42:28.402 INFO:tasks.rados.rados.0.smithi137.stdout:173: done (2 left) 2024-03-04T06:42:28.402 INFO:tasks.rados.rados.0.smithi137.stdout:174: done (1 left) 2024-03-04T06:42:28.402 INFO:tasks.rados.rados.0.smithi137.stdout:176: snap_remove snap 7 2024-03-04T06:42:28.747 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:28 smithi203 ceph-mon[30756]: osdmap e91: 8 total, 8 up, 8 in 2024-03-04T06:42:28.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:28 smithi137 ceph-mon[26846]: osdmap e91: 8 total, 8 up, 8 in 2024-03-04T06:42:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:28 smithi137 ceph-mon[37364]: osdmap e91: 8 total, 8 up, 8 in 2024-03-04T06:42:29.382 INFO:tasks.rados.rados.0.smithi137.stdout:176: done (1 left) 2024-03-04T06:42:29.382 INFO:tasks.rados.rados.0.smithi137.stdout:177: rmattr oid 36 current snap is 9 2024-03-04T06:42:29.382 INFO:tasks.rados.rados.0.smithi137.stdout:177: done (1 left) 2024-03-04T06:42:29.382 INFO:tasks.rados.rados.0.smithi137.stdout:178: copy_from oid 6 from oid 14 current snap is 9 2024-03-04T06:42:29.382 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 39 (ObjNum 72 snap 9 seq_num 72) dirty exists 2024-03-04T06:42:29.382 INFO:tasks.rados.rados.0.smithi137.stdout:175: done (1 left) 2024-03-04T06:42:29.382 INFO:tasks.rados.rados.0.smithi137.stdout:179: snap_remove snap 6 2024-03-04T06:42:29.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:29 smithi137 ceph-mon[26846]: osdmap e92: 8 total, 8 up, 8 in 2024-03-04T06:42:29.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:29 smithi137 ceph-mon[26846]: pgmap v144: 121 pgs: 121 active+clean; 34 MiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 25 op/s 2024-03-04T06:42:29.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:29 smithi137 ceph-mon[37364]: osdmap e92: 8 total, 8 up, 8 in 2024-03-04T06:42:29.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:29 smithi137 ceph-mon[37364]: pgmap v144: 121 pgs: 121 active+clean; 34 MiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 25 op/s 2024-03-04T06:42:29.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:29 smithi203 ceph-mon[30756]: osdmap e92: 8 total, 8 up, 8 in 2024-03-04T06:42:29.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:29 smithi203 ceph-mon[30756]: pgmap v144: 121 pgs: 121 active+clean; 34 MiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 25 op/s 2024-03-04T06:42:30.348 INFO:tasks.rados.rados.0.smithi137.stdout:179: done (1 left) 2024-03-04T06:42:30.348 INFO:tasks.rados.rados.0.smithi137.stdout:180: read oid 29 snap -1 2024-03-04T06:42:30.348 INFO:tasks.rados.rados.0.smithi137.stdout:180: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-04T06:42:30.349 INFO:tasks.rados.rados.0.smithi137.stdout:181: rollback oid 35 current snap is 9 2024-03-04T06:42:30.349 INFO:tasks.rados.rados.0.smithi137.stdout:181: done (2 left) 2024-03-04T06:42:30.349 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 9 2024-03-04T06:42:30.349 INFO:tasks.rados.rados.0.smithi137.stdout:182: seq_num 75 ranges {778240=458752,1236992=581632,1818624=221184} 2024-03-04T06:42:30.360 INFO:tasks.rados.rados.0.smithi137.stdout:182: writing smithi13777483-2 from 778240 to 1236992 tid 1 2024-03-04T06:42:30.365 INFO:tasks.rados.rados.0.smithi137.stdout:182: writing smithi13777483-2 from 1236992 to 1818624 tid 2 2024-03-04T06:42:30.366 INFO:tasks.rados.rados.0.smithi137.stdout:182: writing smithi13777483-2 from 1818624 to 2039808 tid 3 2024-03-04T06:42:30.366 INFO:tasks.rados.rados.0.smithi137.stdout:183: read oid 42 snap -1 2024-03-04T06:42:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:183: expect (ObjNum 41 snap 0 seq_num 41) 2024-03-04T06:42:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:184: rollback oid 32 current snap is 9 2024-03-04T06:42:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:184: done (4 left) 2024-03-04T06:42:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:185: snap_create 2024-03-04T06:42:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:178: finishing copy_from racing read to smithi13777483-6 2024-03-04T06:42:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:178: finishing copy_from to smithi13777483-6 2024-03-04T06:42:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 24 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-03-04T06:42:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:180: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-04T06:42:30.391 INFO:tasks.rados.rados.0.smithi137.stdout:182: finishing write tid 1 to smithi13777483-2 2024-03-04T06:42:30.391 INFO:tasks.rados.rados.0.smithi137.stdout:182: finishing write tid 2 to smithi13777483-2 2024-03-04T06:42:30.391 INFO:tasks.rados.rados.0.smithi137.stdout:182: finishing write tid 3 to smithi13777483-2 2024-03-04T06:42:30.391 INFO:tasks.rados.rados.0.smithi137.stdout:182: finishing write tid 4 to smithi13777483-2 2024-03-04T06:42:30.391 INFO:tasks.rados.rados.0.smithi137.stdout:182: finishing write tid 5 to smithi13777483-2 2024-03-04T06:42:30.391 INFO:tasks.rados.rados.0.smithi137.stdout:182: oid 2 updating version 0 to 26 2024-03-04T06:42:30.391 INFO:tasks.rados.rados.0.smithi137.stdout:182: oid 2 updating version 26 to 27 2024-03-04T06:42:30.391 INFO:tasks.rados.rados.0.smithi137.stdout:182: oid 2 version 27 is already newer than 25 2024-03-04T06:42:30.391 INFO:tasks.rados.rados.0.smithi137.stdout:182: oid 2 updating version 27 to 28 2024-03-04T06:42:30.391 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 28 (ObjNum 75 snap 9 seq_num 75) dirty exists 2024-03-04T06:42:30.392 INFO:tasks.rados.rados.0.smithi137.stdout:182: left oid 2 (ObjNum 75 snap 9 seq_num 75) 2024-03-04T06:42:30.392 INFO:tasks.rados.rados.0.smithi137.stdout:183: expect (ObjNum 41 snap 0 seq_num 41) 2024-03-04T06:42:30.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:30 smithi137 ceph-mon[26846]: osdmap e93: 8 total, 8 up, 8 in 2024-03-04T06:42:30.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:30 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:42:30.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:30 smithi137 ceph-mon[26846]: osdmap e94: 8 total, 8 up, 8 in 2024-03-04T06:42:30.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:30 smithi137 ceph-mon[37364]: osdmap e93: 8 total, 8 up, 8 in 2024-03-04T06:42:30.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:30 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:42:30.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:30 smithi137 ceph-mon[37364]: osdmap e94: 8 total, 8 up, 8 in 2024-03-04T06:42:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:30 smithi203 ceph-mon[30756]: osdmap e93: 8 total, 8 up, 8 in 2024-03-04T06:42:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:30 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:42:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:30 smithi203 ceph-mon[30756]: osdmap e94: 8 total, 8 up, 8 in 2024-03-04T06:42:31.353 INFO:tasks.rados.rados.0.smithi137.stdout:178: done (4 left) 2024-03-04T06:42:31.353 INFO:tasks.rados.rados.0.smithi137.stdout:180: done (3 left) 2024-03-04T06:42:31.353 INFO:tasks.rados.rados.0.smithi137.stdout:182: done (2 left) 2024-03-04T06:42:31.353 INFO:tasks.rados.rados.0.smithi137.stdout:183: done (1 left) 2024-03-04T06:42:31.353 INFO:tasks.rados.rados.0.smithi137.stdout:185: done (0 left) 2024-03-04T06:42:31.353 INFO:tasks.rados.rados.0.smithi137.stdout:186: delete oid 11 current snap is 10 2024-03-04T06:42:31.354 INFO:tasks.rados.rados.0.smithi137.stdout:186: done (0 left) 2024-03-04T06:42:31.354 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 10 2024-03-04T06:42:31.354 INFO:tasks.rados.rados.0.smithi137.stdout:187: seq_num 77 ranges {0=491520,491520=794624,1286144=8192} 2024-03-04T06:42:31.357 INFO:tasks.rados.rados.0.smithi137.stdout:187: writing smithi13777483-44 from 0 to 491520 tid 1 2024-03-04T06:42:31.363 INFO:tasks.rados.rados.0.smithi137.stdout:187: writing smithi13777483-44 from 491520 to 1286144 tid 2 2024-03-04T06:42:31.363 INFO:tasks.rados.rados.0.smithi137.stdout:187: writing smithi13777483-44 from 1286144 to 1294336 tid 3 2024-03-04T06:42:31.363 INFO:tasks.rados.rados.0.smithi137.stdout:188: snap_create 2024-03-04T06:42:31.363 INFO:tasks.rados.rados.0.smithi137.stdout:187: finishing write tid 1 to smithi13777483-44 2024-03-04T06:42:31.365 INFO:tasks.rados.rados.0.smithi137.stdout:187: finishing write tid 2 to smithi13777483-44 2024-03-04T06:42:31.365 INFO:tasks.rados.rados.0.smithi137.stdout:187: finishing write tid 3 to smithi13777483-44 2024-03-04T06:42:31.365 INFO:tasks.rados.rados.0.smithi137.stdout:187: finishing write tid 4 to smithi13777483-44 2024-03-04T06:42:31.366 INFO:tasks.rados.rados.0.smithi137.stdout:187: finishing write tid 5 to smithi13777483-44 2024-03-04T06:42:31.366 INFO:tasks.rados.rados.0.smithi137.stdout:187: oid 44 updating version 0 to 47 2024-03-04T06:42:31.366 INFO:tasks.rados.rados.0.smithi137.stdout:187: oid 44 version 47 is already newer than 46 2024-03-04T06:42:31.367 INFO:tasks.rados.rados.0.smithi137.stdout:187: oid 44 version 47 is already newer than 44 2024-03-04T06:42:31.367 INFO:tasks.rados.rados.0.smithi137.stdout:187: oid 44 version 47 is already newer than 45 2024-03-04T06:42:31.367 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 47 (ObjNum 77 snap 10 seq_num 77) dirty exists 2024-03-04T06:42:31.367 INFO:tasks.rados.rados.0.smithi137.stdout:187: left oid 44 (ObjNum 77 snap 10 seq_num 77) 2024-03-04T06:42:31.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:31 smithi137 ceph-mon[26846]: pgmap v147: 121 pgs: 121 active+clean; 34 MiB data, 268 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:31.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:31 smithi137 ceph-mon[26846]: osdmap e95: 8 total, 8 up, 8 in 2024-03-04T06:42:31.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:31 smithi137 ceph-mon[37364]: pgmap v147: 121 pgs: 121 active+clean; 34 MiB data, 268 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:31.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:31 smithi137 ceph-mon[37364]: osdmap e95: 8 total, 8 up, 8 in 2024-03-04T06:42:31.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:31 smithi203 ceph-mon[30756]: pgmap v147: 121 pgs: 121 active+clean; 34 MiB data, 268 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:31.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:31 smithi203 ceph-mon[30756]: osdmap e95: 8 total, 8 up, 8 in 2024-03-04T06:42:32.354 INFO:tasks.rados.rados.0.smithi137.stdout:187: done (1 left) 2024-03-04T06:42:32.355 INFO:tasks.rados.rados.0.smithi137.stdout:188: done (0 left) 2024-03-04T06:42:32.355 INFO:tasks.rados.rados.0.smithi137.stdout:189: snap_remove snap 9 2024-03-04T06:42:33.362 INFO:tasks.rados.rados.0.smithi137.stdout:189: done (0 left) 2024-03-04T06:42:33.362 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 11 2024-03-04T06:42:33.362 INFO:tasks.rados.rados.0.smithi137.stdout:190: seq_num 78 ranges {794624=516096,1310720=679936,1990656=122880} 2024-03-04T06:42:33.369 INFO:tasks.rados.rados.0.smithi137.stdout:190: writing smithi13777483-22 from 794624 to 1310720 tid 1 2024-03-04T06:42:33.373 INFO:tasks.rados.rados.0.smithi137.stdout:190: writing smithi13777483-22 from 1310720 to 1990656 tid 2 2024-03-04T06:42:33.374 INFO:tasks.rados.rados.0.smithi137.stdout:190: writing smithi13777483-22 from 1990656 to 2113536 tid 3 2024-03-04T06:42:33.375 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 11 2024-03-04T06:42:33.375 INFO:tasks.rados.rados.0.smithi137.stdout:190: finishing write tid 1 to smithi13777483-22 2024-03-04T06:42:33.375 INFO:tasks.rados.rados.0.smithi137.stdout:191: seq_num 79 ranges {1564672=532480,2097152=565248,2662400=237568} 2024-03-04T06:42:33.386 INFO:tasks.rados.rados.0.smithi137.stdout:191: writing smithi13777483-10 from 1564672 to 2097152 tid 1 2024-03-04T06:42:33.389 INFO:tasks.rados.rados.0.smithi137.stdout:191: writing smithi13777483-10 from 2097152 to 2662400 tid 2 2024-03-04T06:42:33.391 INFO:tasks.rados.rados.0.smithi137.stdout:191: writing smithi13777483-10 from 2662400 to 2899968 tid 3 2024-03-04T06:42:33.391 INFO:tasks.rados.rados.0.smithi137.stdout:192: setattr oid 6 current snap is 11 2024-03-04T06:42:33.391 INFO:tasks.rados.rados.0.smithi137.stdout:190: finishing write tid 2 to smithi13777483-22 2024-03-04T06:42:33.391 INFO:tasks.rados.rados.0.smithi137.stdout:190: finishing write tid 3 to smithi13777483-22 2024-03-04T06:42:33.391 INFO:tasks.rados.rados.0.smithi137.stdout:190: finishing write tid 4 to smithi13777483-22 2024-03-04T06:42:33.391 INFO:tasks.rados.rados.0.smithi137.stdout:190: finishing write tid 5 to smithi13777483-22 2024-03-04T06:42:33.391 INFO:tasks.rados.rados.0.smithi137.stdout:190: oid 22 updating version 0 to 65 2024-03-04T06:42:33.391 INFO:tasks.rados.rados.0.smithi137.stdout:190: oid 22 version 65 is already newer than 63 2024-03-04T06:42:33.391 INFO:tasks.rados.rados.0.smithi137.stdout:190: oid 22 version 65 is already newer than 64 2024-03-04T06:42:33.391 INFO:tasks.rados.rados.0.smithi137.stdout:190: oid 22 version 65 is already newer than 62 2024-03-04T06:42:33.391 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 65 (ObjNum 78 snap 11 seq_num 78) dirty exists 2024-03-04T06:42:33.391 INFO:tasks.rados.rados.0.smithi137.stdout:190: left oid 22 (ObjNum 78 snap 11 seq_num 78) 2024-03-04T06:42:33.391 INFO:tasks.rados.rados.0.smithi137.stdout:191: finishing write tid 1 to smithi13777483-10 2024-03-04T06:42:33.392 INFO:tasks.rados.rados.0.smithi137.stdout:191: finishing write tid 2 to smithi13777483-10 2024-03-04T06:42:33.392 INFO:tasks.rados.rados.0.smithi137.stdout:191: finishing write tid 3 to smithi13777483-10 2024-03-04T06:42:33.393 INFO:tasks.rados.rados.0.smithi137.stdout:191: finishing write tid 4 to smithi13777483-10 2024-03-04T06:42:33.393 INFO:tasks.rados.rados.0.smithi137.stdout:190: done (2 left) 2024-03-04T06:42:33.393 INFO:tasks.rados.rados.0.smithi137.stdout:193: read oid 12 snap 10 2024-03-04T06:42:33.393 INFO:tasks.rados.rados.0.smithi137.stdout:193: expect (ObjNum 11 snap 0 seq_num 11) 2024-03-04T06:42:33.393 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 11 2024-03-04T06:42:33.393 INFO:tasks.rados.rados.0.smithi137.stdout:194: seq_num 80 ranges {106496=548864,655360=450560,1105920=352256} 2024-03-04T06:42:33.396 INFO:tasks.rados.rados.0.smithi137.stdout:194: writing smithi13777483-3 from 106496 to 655360 tid 1 2024-03-04T06:42:33.399 INFO:tasks.rados.rados.0.smithi137.stdout:194: writing smithi13777483-3 from 655360 to 1105920 tid 2 2024-03-04T06:42:33.402 INFO:tasks.rados.rados.0.smithi137.stdout:194: writing smithi13777483-3 from 1105920 to 1458176 tid 3 2024-03-04T06:42:33.402 INFO:tasks.rados.rados.0.smithi137.stdout:195: snap_create 2024-03-04T06:42:33.402 INFO:tasks.rados.rados.0.smithi137.stdout:191: finishing write tid 5 to smithi13777483-10 2024-03-04T06:42:33.402 INFO:tasks.rados.rados.0.smithi137.stdout:191: oid 10 updating version 0 to 65 2024-03-04T06:42:33.402 INFO:tasks.rados.rados.0.smithi137.stdout:191: oid 10 version 65 is already newer than 64 2024-03-04T06:42:33.402 INFO:tasks.rados.rados.0.smithi137.stdout:191: oid 10 version 65 is already newer than 63 2024-03-04T06:42:33.402 INFO:tasks.rados.rados.0.smithi137.stdout:191: oid 10 updating version 65 to 66 2024-03-04T06:42:33.402 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 66 (ObjNum 79 snap 11 seq_num 79) dirty exists 2024-03-04T06:42:33.402 INFO:tasks.rados.rados.0.smithi137.stdout:191: left oid 10 (ObjNum 79 snap 11 seq_num 79) 2024-03-04T06:42:33.402 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 67 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-03-04T06:42:33.402 INFO:tasks.rados.rados.0.smithi137.stdout:193: expect (ObjNum 11 snap 0 seq_num 11) 2024-03-04T06:42:33.407 INFO:tasks.rados.rados.0.smithi137.stdout:194: finishing write tid 1 to smithi13777483-3 2024-03-04T06:42:33.407 INFO:tasks.rados.rados.0.smithi137.stdout:194: finishing write tid 2 to smithi13777483-3 2024-03-04T06:42:33.407 INFO:tasks.rados.rados.0.smithi137.stdout:194: finishing write tid 3 to smithi13777483-3 2024-03-04T06:42:33.407 INFO:tasks.rados.rados.0.smithi137.stdout:194: finishing write tid 4 to smithi13777483-3 2024-03-04T06:42:33.407 INFO:tasks.rados.rados.0.smithi137.stdout:194: finishing write tid 5 to smithi13777483-3 2024-03-04T06:42:33.407 INFO:tasks.rados.rados.0.smithi137.stdout:194: oid 3 updating version 0 to 70 2024-03-04T06:42:33.407 INFO:tasks.rados.rados.0.smithi137.stdout:194: oid 3 updating version 70 to 71 2024-03-04T06:42:33.407 INFO:tasks.rados.rados.0.smithi137.stdout:194: oid 3 version 71 is already newer than 68 2024-03-04T06:42:33.407 INFO:tasks.rados.rados.0.smithi137.stdout:194: oid 3 version 71 is already newer than 69 2024-03-04T06:42:33.407 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 71 (ObjNum 80 snap 11 seq_num 80) dirty exists 2024-03-04T06:42:33.408 INFO:tasks.rados.rados.0.smithi137.stdout:194: left oid 3 (ObjNum 80 snap 11 seq_num 80) 2024-03-04T06:42:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:33 smithi137 ceph-mon[26846]: osdmap e96: 8 total, 8 up, 8 in 2024-03-04T06:42:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:33 smithi137 ceph-mon[26846]: pgmap v150: 121 pgs: 121 active+clean; 36 MiB data, 273 MiB used, 715 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 18 op/s 2024-03-04T06:42:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:33 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:42:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:33 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:42:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:33 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:42:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:33 smithi137 ceph-mon[37364]: osdmap e96: 8 total, 8 up, 8 in 2024-03-04T06:42:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:33 smithi137 ceph-mon[37364]: pgmap v150: 121 pgs: 121 active+clean; 36 MiB data, 273 MiB used, 715 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 18 op/s 2024-03-04T06:42:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:33 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:42:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:33 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:42:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:33 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:42:33.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:33 smithi203 ceph-mon[30756]: osdmap e96: 8 total, 8 up, 8 in 2024-03-04T06:42:33.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:33 smithi203 ceph-mon[30756]: pgmap v150: 121 pgs: 121 active+clean; 36 MiB data, 273 MiB used, 715 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 18 op/s 2024-03-04T06:42:33.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:33 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:42:33.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:33 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:42:33.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:33 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:42:34.367 INFO:tasks.rados.rados.0.smithi137.stdout:191: done (4 left) 2024-03-04T06:42:34.367 INFO:tasks.rados.rados.0.smithi137.stdout:192: done (3 left) 2024-03-04T06:42:34.368 INFO:tasks.rados.rados.0.smithi137.stdout:193: done (2 left) 2024-03-04T06:42:34.368 INFO:tasks.rados.rados.0.smithi137.stdout:194: done (1 left) 2024-03-04T06:42:34.368 INFO:tasks.rados.rados.0.smithi137.stdout:195: done (0 left) 2024-03-04T06:42:34.368 INFO:tasks.rados.rados.0.smithi137.stdout:196: snap_create 2024-03-04T06:42:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:34 smithi137 ceph-mon[26846]: Upgrade: Target is version 19.0.0-1791-gefb04e5e (unknown) 2024-03-04T06:42:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:34 smithi137 ceph-mon[26846]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f'] 2024-03-04T06:42:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:34 smithi137 ceph-mon[26846]: Upgrade: Need to upgrade myself (mgr.y) 2024-03-04T06:42:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:34 smithi137 ceph-mon[26846]: osdmap e97: 8 total, 8 up, 8 in 2024-03-04T06:42:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:34 smithi137 ceph-mon[26846]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f on smithi203 2024-03-04T06:42:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:34 smithi137 ceph-mon[37364]: Upgrade: Target is version 19.0.0-1791-gefb04e5e (unknown) 2024-03-04T06:42:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:34 smithi137 ceph-mon[37364]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f'] 2024-03-04T06:42:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:34 smithi137 ceph-mon[37364]: Upgrade: Need to upgrade myself (mgr.y) 2024-03-04T06:42:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:34 smithi137 ceph-mon[37364]: osdmap e97: 8 total, 8 up, 8 in 2024-03-04T06:42:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:34 smithi137 ceph-mon[37364]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f on smithi203 2024-03-04T06:42:34.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:34 smithi203 ceph-mon[30756]: Upgrade: Target is version 19.0.0-1791-gefb04e5e (unknown) 2024-03-04T06:42:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:34 smithi203 ceph-mon[30756]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f'] 2024-03-04T06:42:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:34 smithi203 ceph-mon[30756]: Upgrade: Need to upgrade myself (mgr.y) 2024-03-04T06:42:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:34 smithi203 ceph-mon[30756]: osdmap e97: 8 total, 8 up, 8 in 2024-03-04T06:42:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:34 smithi203 ceph-mon[30756]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f on smithi203 2024-03-04T06:42:35.350 INFO:tasks.rados.rados.0.smithi137.stdout:196: done (0 left) 2024-03-04T06:42:35.350 INFO:tasks.rados.rados.0.smithi137.stdout:197: read oid 45 snap -1 2024-03-04T06:42:35.350 INFO:tasks.rados.rados.0.smithi137.stdout:197: expect (ObjNum 33 snap 0 seq_num 33) 2024-03-04T06:42:35.350 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 13 2024-03-04T06:42:35.351 INFO:tasks.rados.rados.0.smithi137.stdout:198: seq_num 81 ranges {1687552=565248,2252800=737280,2990080=65536} 2024-03-04T06:42:35.363 INFO:tasks.rados.rados.0.smithi137.stdout:198: writing smithi13777483-31 from 1687552 to 2252800 tid 1 2024-03-04T06:42:35.367 INFO:tasks.rados.rados.0.smithi137.stdout:198: writing smithi13777483-31 from 2252800 to 2990080 tid 2 2024-03-04T06:42:35.368 INFO:tasks.rados.rados.0.smithi137.stdout:198: writing smithi13777483-31 from 2990080 to 3055616 tid 3 2024-03-04T06:42:35.368 INFO:tasks.rados.rados.0.smithi137.stdout:199: read oid 49 snap -1 2024-03-04T06:42:35.368 INFO:tasks.rados.rados.0.smithi137.stdout:199: expect (ObjNum 63 snap 4 seq_num 63) 2024-03-04T06:42:35.369 INFO:tasks.rados.rados.0.smithi137.stdout:200: read oid 38 snap -1 2024-03-04T06:42:35.369 INFO:tasks.rados.rados.0.smithi137.stdout:200: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-04T06:42:35.369 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 13 2024-03-04T06:42:35.369 INFO:tasks.rados.rados.0.smithi137.stdout:201: seq_num 82 ranges {1564672=581632,2146304=622592,2768896=180224} 2024-03-04T06:42:35.380 INFO:tasks.rados.rados.0.smithi137.stdout:201: writing smithi13777483-39 from 1564672 to 2146304 tid 1 2024-03-04T06:42:35.383 INFO:tasks.rados.rados.0.smithi137.stdout:201: writing smithi13777483-39 from 2146304 to 2768896 tid 2 2024-03-04T06:42:35.385 INFO:tasks.rados.rados.0.smithi137.stdout:201: writing smithi13777483-39 from 2768896 to 2949120 tid 3 2024-03-04T06:42:35.385 INFO:tasks.rados.rados.0.smithi137.stdout:202: copy_from oid 41 from oid 32 current snap is 13 2024-03-04T06:42:35.385 INFO:tasks.rados.rados.0.smithi137.stdout:197: expect (ObjNum 33 snap 0 seq_num 33) 2024-03-04T06:42:35.400 INFO:tasks.rados.rados.0.smithi137.stdout:198: finishing write tid 1 to smithi13777483-31 2024-03-04T06:42:35.400 INFO:tasks.rados.rados.0.smithi137.stdout:200: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-04T06:42:35.412 INFO:tasks.rados.rados.0.smithi137.stdout:198: finishing write tid 2 to smithi13777483-31 2024-03-04T06:42:35.412 INFO:tasks.rados.rados.0.smithi137.stdout:198: finishing write tid 3 to smithi13777483-31 2024-03-04T06:42:35.412 INFO:tasks.rados.rados.0.smithi137.stdout:198: finishing write tid 4 to smithi13777483-31 2024-03-04T06:42:35.412 INFO:tasks.rados.rados.0.smithi137.stdout:198: finishing write tid 5 to smithi13777483-31 2024-03-04T06:42:35.412 INFO:tasks.rados.rados.0.smithi137.stdout:198: oid 31 updating version 0 to 30 2024-03-04T06:42:35.412 INFO:tasks.rados.rados.0.smithi137.stdout:198: oid 31 updating version 30 to 32 2024-03-04T06:42:35.412 INFO:tasks.rados.rados.0.smithi137.stdout:198: oid 31 version 32 is already newer than 31 2024-03-04T06:42:35.413 INFO:tasks.rados.rados.0.smithi137.stdout:198: oid 31 updating version 32 to 33 2024-03-04T06:42:35.413 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 33 (ObjNum 81 snap 13 seq_num 81) dirty exists 2024-03-04T06:42:35.413 INFO:tasks.rados.rados.0.smithi137.stdout:198: left oid 31 (ObjNum 81 snap 13 seq_num 81) 2024-03-04T06:42:35.413 INFO:tasks.rados.rados.0.smithi137.stdout:199: expect (ObjNum 63 snap 4 seq_num 63) 2024-03-04T06:42:35.473 INFO:tasks.rados.rados.0.smithi137.stdout:201: finishing write tid 1 to smithi13777483-39 2024-03-04T06:42:35.473 INFO:tasks.rados.rados.0.smithi137.stdout:201: finishing write tid 2 to smithi13777483-39 2024-03-04T06:42:35.473 INFO:tasks.rados.rados.0.smithi137.stdout:201: finishing write tid 3 to smithi13777483-39 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:201: finishing write tid 4 to smithi13777483-39 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:201: finishing write tid 5 to smithi13777483-39 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:201: oid 39 updating version 0 to 18 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:201: oid 39 version 18 is already newer than 16 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:201: oid 39 version 18 is already newer than 15 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:201: oid 39 version 18 is already newer than 17 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 18 (ObjNum 82 snap 13 seq_num 82) dirty exists 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:201: left oid 39 (ObjNum 82 snap 13 seq_num 82) 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:202: finishing copy_from racing read to smithi13777483-41 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:202: finishing copy_from to smithi13777483-41 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 6 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:197: done (5 left) 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:198: done (4 left) 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:199: done (3 left) 2024-03-04T06:42:35.474 INFO:tasks.rados.rados.0.smithi137.stdout:200: done (2 left) 2024-03-04T06:42:35.475 INFO:tasks.rados.rados.0.smithi137.stdout:201: done (1 left) 2024-03-04T06:42:35.475 INFO:tasks.rados.rados.0.smithi137.stdout:202: done (0 left) 2024-03-04T06:42:35.475 INFO:tasks.rados.rados.0.smithi137.stdout:203: snap_create 2024-03-04T06:42:35.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:42:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:42:35] "GET /metrics HTTP/1.1" 200 35997 "" "Prometheus/2.43.0" 2024-03-04T06:42:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:35 smithi137 ceph-mon[26846]: osdmap e98: 8 total, 8 up, 8 in 2024-03-04T06:42:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:35 smithi137 ceph-mon[26846]: pgmap v153: 121 pgs: 121 active+clean; 36 MiB data, 273 MiB used, 715 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 18 op/s 2024-03-04T06:42:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:35 smithi137 ceph-mon[26846]: osdmap e99: 8 total, 8 up, 8 in 2024-03-04T06:42:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:35 smithi137 ceph-mon[37364]: osdmap e98: 8 total, 8 up, 8 in 2024-03-04T06:42:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:35 smithi137 ceph-mon[37364]: pgmap v153: 121 pgs: 121 active+clean; 36 MiB data, 273 MiB used, 715 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 18 op/s 2024-03-04T06:42:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:35 smithi137 ceph-mon[37364]: osdmap e99: 8 total, 8 up, 8 in 2024-03-04T06:42:35.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:35 smithi203 ceph-mon[30756]: osdmap e98: 8 total, 8 up, 8 in 2024-03-04T06:42:35.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:35 smithi203 ceph-mon[30756]: pgmap v153: 121 pgs: 121 active+clean; 36 MiB data, 273 MiB used, 715 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 18 op/s 2024-03-04T06:42:35.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:35 smithi203 ceph-mon[30756]: osdmap e99: 8 total, 8 up, 8 in 2024-03-04T06:42:36.379 INFO:tasks.rados.rados.0.smithi137.stdout:203: done (0 left) 2024-03-04T06:42:36.380 INFO:tasks.rados.rados.0.smithi137.stdout:204: delete oid 31 current snap is 14 2024-03-04T06:42:36.383 INFO:tasks.rados.rados.0.smithi137.stdout:204: done (0 left) 2024-03-04T06:42:36.383 INFO:tasks.rados.rados.0.smithi137.stdout:205: delete oid 26 current snap is 14 2024-03-04T06:42:36.385 INFO:tasks.rados.rados.0.smithi137.stdout:205: done (0 left) 2024-03-04T06:42:36.385 INFO:tasks.rados.rados.0.smithi137.stdout:206: copy_from oid 20 from oid 42 current snap is 14 2024-03-04T06:42:36.386 INFO:tasks.rados.rados.0.smithi137.stdout:207: delete oid 5 current snap is 14 2024-03-04T06:42:36.387 INFO:tasks.rados.rados.0.smithi137.stdout:207: done (1 left) 2024-03-04T06:42:36.388 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 14 2024-03-04T06:42:36.388 INFO:tasks.rados.rados.0.smithi137.stdout:208: seq_num 86 ranges {1417216=647168,2064384=606208,2670592=196608} 2024-03-04T06:42:36.399 INFO:tasks.rados.rados.0.smithi137.stdout:208: writing smithi13777483-13 from 1417216 to 2064384 tid 1 2024-03-04T06:42:36.402 INFO:tasks.rados.rados.0.smithi137.stdout:208: writing smithi13777483-13 from 2064384 to 2670592 tid 2 2024-03-04T06:42:36.404 INFO:tasks.rados.rados.0.smithi137.stdout:208: writing smithi13777483-13 from 2670592 to 2867200 tid 3 2024-03-04T06:42:36.404 INFO:tasks.rados.rados.0.smithi137.stdout:206: finishing copy_from racing read to smithi13777483-20 2024-03-04T06:42:36.404 INFO:tasks.rados.rados.0.smithi137.stdout:209: read oid 19 snap -1 2024-03-04T06:42:36.404 INFO:tasks.rados.rados.0.smithi137.stdout:209: expect (ObjNum 68 snap 5 seq_num 68) 2024-03-04T06:42:36.404 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 14 2024-03-04T06:42:36.404 INFO:tasks.rados.rados.0.smithi137.stdout:206: finishing copy_from to smithi13777483-20 2024-03-04T06:42:36.404 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 8 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-03-04T06:42:36.404 INFO:tasks.rados.rados.0.smithi137.stdout:208: finishing write tid 1 to smithi13777483-13 2024-03-04T06:42:36.405 INFO:tasks.rados.rados.0.smithi137.stdout:210: seq_num 87 ranges {393216=663552,1056768=491520,1548288=311296} 2024-03-04T06:42:36.410 INFO:tasks.rados.rados.0.smithi137.stdout:210: writing smithi13777483-21 from 393216 to 1056768 tid 1 2024-03-04T06:42:36.413 INFO:tasks.rados.rados.0.smithi137.stdout:210: writing smithi13777483-21 from 1056768 to 1548288 tid 2 2024-03-04T06:42:36.416 INFO:tasks.rados.rados.0.smithi137.stdout:210: writing smithi13777483-21 from 1548288 to 1859584 tid 3 2024-03-04T06:42:36.416 INFO:tasks.rados.rados.0.smithi137.stdout:206: done (3 left) 2024-03-04T06:42:36.416 INFO:tasks.rados.rados.0.smithi137.stdout:211: delete oid 11 current snap is 14 2024-03-04T06:42:36.416 INFO:tasks.rados.rados.0.smithi137.stdout:208: finishing write tid 2 to smithi13777483-13 2024-03-04T06:42:36.416 INFO:tasks.rados.rados.0.smithi137.stdout:208: finishing write tid 3 to smithi13777483-13 2024-03-04T06:42:36.416 INFO:tasks.rados.rados.0.smithi137.stdout:208: finishing write tid 4 to smithi13777483-13 2024-03-04T06:42:36.416 INFO:tasks.rados.rados.0.smithi137.stdout:208: finishing write tid 5 to smithi13777483-13 2024-03-04T06:42:36.416 INFO:tasks.rados.rados.0.smithi137.stdout:208: oid 13 updating version 0 to 50 2024-03-04T06:42:36.416 INFO:tasks.rados.rados.0.smithi137.stdout:208: oid 13 updating version 50 to 52 2024-03-04T06:42:36.416 INFO:tasks.rados.rados.0.smithi137.stdout:208: oid 13 version 52 is already newer than 51 2024-03-04T06:42:36.416 INFO:tasks.rados.rados.0.smithi137.stdout:208: oid 13 version 52 is already newer than 49 2024-03-04T06:42:36.416 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 52 (ObjNum 86 snap 14 seq_num 86) dirty exists 2024-03-04T06:42:36.417 INFO:tasks.rados.rados.0.smithi137.stdout:208: left oid 13 (ObjNum 86 snap 14 seq_num 86) 2024-03-04T06:42:36.417 INFO:tasks.rados.rados.0.smithi137.stdout:209: expect (ObjNum 68 snap 5 seq_num 68) 2024-03-04T06:42:36.460 INFO:tasks.rados.rados.0.smithi137.stdout:210: finishing write tid 1 to smithi13777483-21 2024-03-04T06:42:36.460 INFO:tasks.rados.rados.0.smithi137.stdout:210: finishing write tid 2 to smithi13777483-21 2024-03-04T06:42:36.460 INFO:tasks.rados.rados.0.smithi137.stdout:210: finishing write tid 3 to smithi13777483-21 2024-03-04T06:42:36.460 INFO:tasks.rados.rados.0.smithi137.stdout:210: finishing write tid 4 to smithi13777483-21 2024-03-04T06:42:36.460 INFO:tasks.rados.rados.0.smithi137.stdout:210: finishing write tid 5 to smithi13777483-21 2024-03-04T06:42:36.460 INFO:tasks.rados.rados.0.smithi137.stdout:210: oid 21 updating version 0 to 62 2024-03-04T06:42:36.460 INFO:tasks.rados.rados.0.smithi137.stdout:210: oid 21 version 62 is already newer than 60 2024-03-04T06:42:36.460 INFO:tasks.rados.rados.0.smithi137.stdout:210: oid 21 version 62 is already newer than 61 2024-03-04T06:42:36.460 INFO:tasks.rados.rados.0.smithi137.stdout:210: oid 21 version 62 is already newer than 59 2024-03-04T06:42:36.460 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 62 (ObjNum 87 snap 14 seq_num 87) dirty exists 2024-03-04T06:42:36.460 INFO:tasks.rados.rados.0.smithi137.stdout:210: left oid 21 (ObjNum 87 snap 14 seq_num 87) 2024-03-04T06:42:36.460 INFO:tasks.rados.rados.0.smithi137.stdout:208: done (3 left) 2024-03-04T06:42:36.461 INFO:tasks.rados.rados.0.smithi137.stdout:209: done (2 left) 2024-03-04T06:42:36.461 INFO:tasks.rados.rados.0.smithi137.stdout:210: done (1 left) 2024-03-04T06:42:36.461 INFO:tasks.rados.rados.0.smithi137.stdout:211: done (0 left) 2024-03-04T06:42:36.461 INFO:tasks.rados.rados.0.smithi137.stdout:212: read oid 38 snap -1 2024-03-04T06:42:36.461 INFO:tasks.rados.rados.0.smithi137.stdout:212: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-04T06:42:36.461 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 14 2024-03-04T06:42:36.461 INFO:tasks.rados.rados.0.smithi137.stdout:213: seq_num 89 ranges {2039808=696320,2736128=655360,3391488=147456} 2024-03-04T06:42:36.474 INFO:tasks.rados.rados.0.smithi137.stdout:213: writing smithi13777483-2 from 2039808 to 2736128 tid 1 2024-03-04T06:42:36.478 INFO:tasks.rados.rados.0.smithi137.stdout:213: writing smithi13777483-2 from 2736128 to 3391488 tid 2 2024-03-04T06:42:36.479 INFO:tasks.rados.rados.0.smithi137.stdout:213: writing smithi13777483-2 from 3391488 to 3538944 tid 3 2024-03-04T06:42:36.479 INFO:tasks.rados.rados.0.smithi137.stdout:214: delete oid 41 current snap is 14 2024-03-04T06:42:36.479 INFO:tasks.rados.rados.0.smithi137.stdout:212: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-04T06:42:36.492 INFO:tasks.rados.rados.0.smithi137.stdout:213: finishing write tid 1 to smithi13777483-2 2024-03-04T06:42:36.492 INFO:tasks.rados.rados.0.smithi137.stdout:213: finishing write tid 2 to smithi13777483-2 2024-03-04T06:42:36.492 INFO:tasks.rados.rados.0.smithi137.stdout:213: finishing write tid 3 to smithi13777483-2 2024-03-04T06:42:36.492 INFO:tasks.rados.rados.0.smithi137.stdout:213: finishing write tid 4 to smithi13777483-2 2024-03-04T06:42:36.492 INFO:tasks.rados.rados.0.smithi137.stdout:213: finishing write tid 5 to smithi13777483-2 2024-03-04T06:42:36.492 INFO:tasks.rados.rados.0.smithi137.stdout:213: oid 2 updating version 0 to 33 2024-03-04T06:42:36.493 INFO:tasks.rados.rados.0.smithi137.stdout:213: oid 2 version 33 is already newer than 31 2024-03-04T06:42:36.493 INFO:tasks.rados.rados.0.smithi137.stdout:213: oid 2 version 33 is already newer than 32 2024-03-04T06:42:36.493 INFO:tasks.rados.rados.0.smithi137.stdout:213: oid 2 version 33 is already newer than 30 2024-03-04T06:42:36.493 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 33 (ObjNum 89 snap 14 seq_num 89) dirty exists 2024-03-04T06:42:36.493 INFO:tasks.rados.rados.0.smithi137.stdout:213: left oid 2 (ObjNum 89 snap 14 seq_num 89) 2024-03-04T06:42:36.493 INFO:tasks.rados.rados.0.smithi137.stdout:212: done (2 left) 2024-03-04T06:42:36.493 INFO:tasks.rados.rados.0.smithi137.stdout:213: done (1 left) 2024-03-04T06:42:36.493 INFO:tasks.rados.rados.0.smithi137.stdout:214: done (0 left) 2024-03-04T06:42:36.493 INFO:tasks.rados.rados.0.smithi137.stdout:215: delete oid 35 current snap is 14 2024-03-04T06:42:36.494 INFO:tasks.rados.rados.0.smithi137.stdout:215: done (0 left) 2024-03-04T06:42:36.494 INFO:tasks.rados.rados.0.smithi137.stdout:216: setattr oid 29 current snap is 14 2024-03-04T06:42:36.496 INFO:tasks.rados.rados.0.smithi137.stdout:217: snap_remove snap 10 2024-03-04T06:42:37.381 INFO:tasks.rados.rados.0.smithi137.stdout:217: done (1 left) 2024-03-04T06:42:37.381 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 14 2024-03-04T06:42:37.381 INFO:tasks.rados.rados.0.smithi137.stdout:218: seq_num 92 ranges {393216=745472,1138688=761856,1900544=40960} 2024-03-04T06:42:37.388 INFO:tasks.rados.rados.0.smithi137.stdout:218: writing smithi13777483-38 from 393216 to 1138688 tid 1 2024-03-04T06:42:37.393 INFO:tasks.rados.rados.0.smithi137.stdout:218: writing smithi13777483-38 from 1138688 to 1900544 tid 2 2024-03-04T06:42:37.394 INFO:tasks.rados.rados.0.smithi137.stdout:218: writing smithi13777483-38 from 1900544 to 1941504 tid 3 2024-03-04T06:42:37.394 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 23 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-04T06:42:37.394 INFO:tasks.rados.rados.0.smithi137.stdout:218: finishing write tid 1 to smithi13777483-38 2024-03-04T06:42:37.394 INFO:tasks.rados.rados.0.smithi137.stdout:216: done (1 left) 2024-03-04T06:42:37.394 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 14 2024-03-04T06:42:37.394 INFO:tasks.rados.rados.0.smithi137.stdout:219: seq_num 93 ranges {3538944=761856,4300800=647168,4947968=155648} 2024-03-04T06:42:37.416 INFO:tasks.rados.rados.0.smithi137.stdout:219: writing smithi13777483-2 from 3538944 to 4300800 tid 1 2024-03-04T06:42:37.420 INFO:tasks.rados.rados.0.smithi137.stdout:219: writing smithi13777483-2 from 4300800 to 4947968 tid 2 2024-03-04T06:42:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:219: writing smithi13777483-2 from 4947968 to 5103616 tid 3 2024-03-04T06:42:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:220: copy_from oid 27 from oid 26 current snap is 14 2024-03-04T06:42:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:218: finishing write tid 2 to smithi13777483-38 2024-03-04T06:42:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:218: finishing write tid 3 to smithi13777483-38 2024-03-04T06:42:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:218: finishing write tid 4 to smithi13777483-38 2024-03-04T06:42:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:218: finishing write tid 5 to smithi13777483-38 2024-03-04T06:42:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:218: oid 38 updating version 0 to 68 2024-03-04T06:42:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:218: oid 38 updating version 68 to 69 2024-03-04T06:42:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:218: oid 38 version 69 is already newer than 66 2024-03-04T06:42:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:218: oid 38 version 69 is already newer than 67 2024-03-04T06:42:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 69 (ObjNum 92 snap 14 seq_num 92) dirty exists 2024-03-04T06:42:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:218: left oid 38 (ObjNum 92 snap 14 seq_num 92) 2024-03-04T06:42:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:219: finishing write tid 1 to smithi13777483-2 2024-03-04T06:42:37.423 INFO:tasks.rados.rados.0.smithi137.stdout:218: done (2 left) 2024-03-04T06:42:37.423 INFO:tasks.rados.rados.0.smithi137.stdout:221: snap_create 2024-03-04T06:42:37.423 INFO:tasks.rados.rados.0.smithi137.stdout:220: finishing copy_from to smithi13777483-27 2024-03-04T06:42:37.423 INFO:tasks.rados.rados.0.smithi137.stdout:220: got expected ENOENT (src dne) 2024-03-04T06:42:37.424 INFO:tasks.rados.rados.0.smithi137.stdout:220: finishing copy_from racing read to smithi13777483-27 2024-03-04T06:42:37.424 INFO:tasks.rados.rados.0.smithi137.stdout:219: finishing write tid 2 to smithi13777483-2 2024-03-04T06:42:37.424 INFO:tasks.rados.rados.0.smithi137.stdout:219: finishing write tid 3 to smithi13777483-2 2024-03-04T06:42:37.424 INFO:tasks.rados.rados.0.smithi137.stdout:219: finishing write tid 4 to smithi13777483-2 2024-03-04T06:42:37.424 INFO:tasks.rados.rados.0.smithi137.stdout:219: finishing write tid 5 to smithi13777483-2 2024-03-04T06:42:37.424 INFO:tasks.rados.rados.0.smithi137.stdout:219: oid 2 updating version 0 to 37 2024-03-04T06:42:37.425 INFO:tasks.rados.rados.0.smithi137.stdout:219: oid 2 updating version 37 to 38 2024-03-04T06:42:37.425 INFO:tasks.rados.rados.0.smithi137.stdout:219: oid 2 version 38 is already newer than 36 2024-03-04T06:42:37.425 INFO:tasks.rados.rados.0.smithi137.stdout:219: oid 2 updating version 38 to 39 2024-03-04T06:42:37.425 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 39 (ObjNum 93 snap 14 seq_num 93) dirty exists 2024-03-04T06:42:37.425 INFO:tasks.rados.rados.0.smithi137.stdout:219: left oid 2 (ObjNum 93 snap 14 seq_num 93) 2024-03-04T06:42:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:37 smithi137 ceph-mon[26846]: osdmap e100: 8 total, 8 up, 8 in 2024-03-04T06:42:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:37 smithi137 ceph-mon[26846]: pgmap v156: 121 pgs: 121 active+clean; 44 MiB data, 287 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2024-03-04T06:42:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:37 smithi137 ceph-mon[37364]: osdmap e100: 8 total, 8 up, 8 in 2024-03-04T06:42:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:37 smithi137 ceph-mon[37364]: pgmap v156: 121 pgs: 121 active+clean; 44 MiB data, 287 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2024-03-04T06:42:37.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:37 smithi203 ceph-mon[30756]: osdmap e100: 8 total, 8 up, 8 in 2024-03-04T06:42:37.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:37 smithi203 ceph-mon[30756]: pgmap v156: 121 pgs: 121 active+clean; 44 MiB data, 287 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2024-03-04T06:42:38.385 INFO:tasks.rados.rados.0.smithi137.stdout:219: done (2 left) 2024-03-04T06:42:38.385 INFO:tasks.rados.rados.0.smithi137.stdout:220: done (1 left) 2024-03-04T06:42:38.385 INFO:tasks.rados.rados.0.smithi137.stdout:221: done (0 left) 2024-03-04T06:42:38.386 INFO:tasks.rados.rados.0.smithi137.stdout:222: snap_create 2024-03-04T06:42:38.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:38 smithi137 ceph-mon[26846]: osdmap e101: 8 total, 8 up, 8 in 2024-03-04T06:42:38.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:38 smithi137 ceph-mon[37364]: osdmap e101: 8 total, 8 up, 8 in 2024-03-04T06:42:38.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:38 smithi203 ceph-mon[30756]: osdmap e101: 8 total, 8 up, 8 in 2024-03-04T06:42:39.261 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:42:39.391 INFO:tasks.rados.rados.0.smithi137.stdout:222: done (0 left) 2024-03-04T06:42:39.391 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 16 2024-03-04T06:42:39.391 INFO:tasks.rados.rados.0.smithi137.stdout:223: seq_num 94 ranges {0=778240,778240=532480,1310720=270336} 2024-03-04T06:42:39.395 INFO:tasks.rados.rados.0.smithi137.stdout:223: writing smithi13777483-17 from 0 to 778240 tid 1 2024-03-04T06:42:39.398 INFO:tasks.rados.rados.0.smithi137.stdout:223: writing smithi13777483-17 from 778240 to 1310720 tid 2 2024-03-04T06:42:39.401 INFO:tasks.rados.rados.0.smithi137.stdout:223: writing smithi13777483-17 from 1310720 to 1581056 tid 3 2024-03-04T06:42:39.401 INFO:tasks.rados.rados.0.smithi137.stdout:224: rollback oid 8 current snap is 16 2024-03-04T06:42:39.401 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 8 to 13 2024-03-04T06:42:39.401 INFO:tasks.rados.rados.0.smithi137.stdout:223: finishing write tid 1 to smithi13777483-17 2024-03-04T06:42:39.401 INFO:tasks.rados.rados.0.smithi137.stdout:225: rmattr oid 26 current snap is 16 2024-03-04T06:42:39.401 INFO:tasks.rados.rados.0.smithi137.stdout:225: done (2 left) 2024-03-04T06:42:39.401 INFO:tasks.rados.rados.0.smithi137.stdout:226: delete oid 2 current snap is 16 2024-03-04T06:42:39.402 INFO:tasks.rados.rados.0.smithi137.stdout:223: finishing write tid 2 to smithi13777483-17 2024-03-04T06:42:39.403 INFO:tasks.rados.rados.0.smithi137.stdout:224: finishing rollback tid 0 to smithi13777483-8 2024-03-04T06:42:39.403 INFO:tasks.rados.rados.0.smithi137.stdout:223: finishing write tid 3 to smithi13777483-17 2024-03-04T06:42:39.403 INFO:tasks.rados.rados.0.smithi137.stdout:223: finishing write tid 4 to smithi13777483-17 2024-03-04T06:42:39.404 INFO:tasks.rados.rados.0.smithi137.stdout:226: done (2 left) 2024-03-04T06:42:39.404 INFO:tasks.rados.rados.0.smithi137.stdout:227: rmattr oid 24 current snap is 16 2024-03-04T06:42:39.404 INFO:tasks.rados.rados.0.smithi137.stdout:224: finishing rollback tid 1 to smithi13777483-8 2024-03-04T06:42:39.404 INFO:tasks.rados.rados.0.smithi137.stdout:228: snap_create 2024-03-04T06:42:39.404 INFO:tasks.rados.rados.0.smithi137.stdout:224: finishing rollback tid 2 to smithi13777483-8 2024-03-04T06:42:39.404 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 15 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-03-04T06:42:39.405 INFO:tasks.rados.rados.0.smithi137.stdout:223: finishing write tid 5 to smithi13777483-17 2024-03-04T06:42:39.405 INFO:tasks.rados.rados.0.smithi137.stdout:223: oid 17 updating version 0 to 13 2024-03-04T06:42:39.405 INFO:tasks.rados.rados.0.smithi137.stdout:223: oid 17 updating version 13 to 15 2024-03-04T06:42:39.405 INFO:tasks.rados.rados.0.smithi137.stdout:223: oid 17 version 15 is already newer than 14 2024-03-04T06:42:39.405 INFO:tasks.rados.rados.0.smithi137.stdout:223: oid 17 version 15 is already newer than 12 2024-03-04T06:42:39.405 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 15 (ObjNum 94 snap 16 seq_num 94) dirty exists 2024-03-04T06:42:39.405 INFO:tasks.rados.rados.0.smithi137.stdout:223: left oid 17 (ObjNum 94 snap 16 seq_num 94) 2024-03-04T06:42:39.408 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 22 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-03-04T06:42:39.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:39 smithi137 ceph-mon[26846]: osdmap e102: 8 total, 8 up, 8 in 2024-03-04T06:42:39.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:39 smithi137 ceph-mon[26846]: pgmap v159: 121 pgs: 121 active+clean; 44 MiB data, 287 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2024-03-04T06:42:39.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:39 smithi137 ceph-mon[37364]: osdmap e102: 8 total, 8 up, 8 in 2024-03-04T06:42:39.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:39 smithi137 ceph-mon[37364]: pgmap v159: 121 pgs: 121 active+clean; 44 MiB data, 287 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2024-03-04T06:42:39.581 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (2m) 2m ago 3m 16.1M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (2m) 2m ago 2m 80.0M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (4m) 2m ago 4m 16.0M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (4m) 2m ago 4m 15.4M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,8765 running (7m) 2m ago 7m 448M - 18.2.1-696-g5cc7a767 540557f94930 994a02c2e1ef 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:9283,8765 running (9m) 2m ago 9m 495M - 18.2.1-696-g5cc7a767 540557f94930 d360a32fa2a3 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (9m) 2m ago 9m 50.3M 2048M 18.2.1-696-g5cc7a767 540557f94930 0279ece55dcc 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (8m) 2m ago 8m 42.8M 2048M 18.2.1-696-g5cc7a767 540557f94930 c1087568a246 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (8m) 2m ago 8m 39.4M 2048M 18.2.1-696-g5cc7a767 540557f94930 63f51a40232d 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (2m) 2m ago 2m 11.3M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (2m) 2m ago 2m 5444k - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (7m) 2m ago 7m 43.8M 2992M 18.2.1-696-g5cc7a767 540557f94930 732ea50ff558 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (7m) 2m ago 7m 44.0M 2992M 18.2.1-696-g5cc7a767 540557f94930 708139c858a7 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (6m) 2m ago 6m 41.4M 2992M 18.2.1-696-g5cc7a767 540557f94930 b247adf81a73 2024-03-04T06:42:39.582 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (6m) 2m ago 6m 40.7M 2992M 18.2.1-696-g5cc7a767 540557f94930 afdbc25c9fba 2024-03-04T06:42:39.583 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (6m) 2m ago 6m 44.0M 2992M 18.2.1-696-g5cc7a767 540557f94930 d4841ffd0747 2024-03-04T06:42:39.583 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (5m) 2m ago 5m 41.1M 2992M 18.2.1-696-g5cc7a767 540557f94930 81d21771e157 2024-03-04T06:42:39.583 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (5m) 2m ago 5m 41.4M 2992M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:42:39.583 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (4m) 2m ago 4m 44.4M 2992M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:42:39.583 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (2m) 2m ago 4m 28.3M - 2.43.0 a07b618ecd1d 80efb24031c2 2024-03-04T06:42:39.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:39 smithi203 ceph-mon[30756]: osdmap e102: 8 total, 8 up, 8 in 2024-03-04T06:42:39.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:39 smithi203 ceph-mon[30756]: pgmap v159: 121 pgs: 121 active+clean; 44 MiB data, 287 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2024-03-04T06:42:39.971 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:42:39.971 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:42:39.971 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 3 2024-03-04T06:42:39.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:42:39.971 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:42:39.971 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:42:39.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:42:39.971 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:42:39.971 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 8 2024-03-04T06:42:39.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:42:39.972 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:42:39.972 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:42:39.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:42:39.972 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:42:39.972 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 15 2024-03-04T06:42:39.972 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:42:39.972 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:42:40.353 INFO:tasks.rados.rados.0.smithi137.stdout:223: done (3 left) 2024-03-04T06:42:40.353 INFO:tasks.rados.rados.0.smithi137.stdout:224: done (2 left) 2024-03-04T06:42:40.353 INFO:tasks.rados.rados.0.smithi137.stdout:227: done (1 left) 2024-03-04T06:42:40.353 INFO:tasks.rados.rados.0.smithi137.stdout:228: done (0 left) 2024-03-04T06:42:40.353 INFO:tasks.rados.rados.0.smithi137.stdout:229: copy_from oid 48 from oid 47 current snap is 17 2024-03-04T06:42:40.353 INFO:tasks.rados.rados.0.smithi137.stdout:230: read oid 34 snap -1 2024-03-04T06:42:40.353 INFO:tasks.rados.rados.0.smithi137.stdout:230: expect (ObjNum 50 snap 0 seq_num 50) 2024-03-04T06:42:40.353 INFO:tasks.rados.rados.0.smithi137.stdout:231: snap_create 2024-03-04T06:42:40.363 INFO:tasks.rados.rados.0.smithi137.stdout:230: expect (ObjNum 50 snap 0 seq_num 50) 2024-03-04T06:42:40.405 INFO:tasks.rados.rados.0.smithi137.stdout:229: finishing copy_from racing read to smithi13777483-48 2024-03-04T06:42:40.405 INFO:tasks.rados.rados.0.smithi137.stdout:229: finishing copy_from to smithi13777483-48 2024-03-04T06:42:40.406 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 47 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:42:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:40 smithi137 ceph-mon[26846]: from='client.25010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:40 smithi137 ceph-mon[26846]: osdmap e103: 8 total, 8 up, 8 in 2024-03-04T06:42:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:40 smithi137 ceph-mon[26846]: from='client.25016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:40 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/742413654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:42:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:40 smithi137 ceph-mon[26846]: osdmap e104: 8 total, 8 up, 8 in 2024-03-04T06:42:40.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:40 smithi137 ceph-mon[37364]: from='client.25010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:40.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:40 smithi137 ceph-mon[37364]: osdmap e103: 8 total, 8 up, 8 in 2024-03-04T06:42:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:40 smithi137 ceph-mon[37364]: from='client.25016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:40 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/742413654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:42:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:40 smithi137 ceph-mon[37364]: osdmap e104: 8 total, 8 up, 8 in 2024-03-04T06:42:40.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:40 smithi203 ceph-mon[30756]: from='client.25010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:40.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:40 smithi203 ceph-mon[30756]: osdmap e103: 8 total, 8 up, 8 in 2024-03-04T06:42:40.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:40 smithi203 ceph-mon[30756]: from='client.25016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:42:40.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:40 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/742413654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:42:40.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:40 smithi203 ceph-mon[30756]: osdmap e104: 8 total, 8 up, 8 in 2024-03-04T06:42:41.353 INFO:tasks.rados.rados.0.smithi137.stdout:229: done (2 left) 2024-03-04T06:42:41.353 INFO:tasks.rados.rados.0.smithi137.stdout:230: done (1 left) 2024-03-04T06:42:41.353 INFO:tasks.rados.rados.0.smithi137.stdout:231: done (0 left) 2024-03-04T06:42:41.353 INFO:tasks.rados.rados.0.smithi137.stdout:232: read oid 47 snap -1 2024-03-04T06:42:41.354 INFO:tasks.rados.rados.0.smithi137.stdout:232: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:42:41.354 INFO:tasks.rados.rados.0.smithi137.stdout:233: read oid 6 snap -1 2024-03-04T06:42:41.354 INFO:tasks.rados.rados.0.smithi137.stdout:233: expect (ObjNum 13 snap 0 seq_num 13) 2024-03-04T06:42:41.354 INFO:tasks.rados.rados.0.smithi137.stdout:234: snap_create 2024-03-04T06:42:41.357 INFO:tasks.rados.rados.0.smithi137.stdout:233: expect (ObjNum 13 snap 0 seq_num 13) 2024-03-04T06:42:41.366 INFO:tasks.rados.rados.0.smithi137.stdout:232: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:42:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:41 smithi137 ceph-mon[26846]: pgmap v162: 121 pgs: 121 active+clean; 44 MiB data, 287 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:41 smithi137 ceph-mon[26846]: osdmap e105: 8 total, 8 up, 8 in 2024-03-04T06:42:41.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:41 smithi137 ceph-mon[37364]: pgmap v162: 121 pgs: 121 active+clean; 44 MiB data, 287 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:41.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:41 smithi137 ceph-mon[37364]: osdmap e105: 8 total, 8 up, 8 in 2024-03-04T06:42:41.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:41 smithi203 ceph-mon[30756]: pgmap v162: 121 pgs: 121 active+clean; 44 MiB data, 287 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:41.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:41 smithi203 ceph-mon[30756]: osdmap e105: 8 total, 8 up, 8 in 2024-03-04T06:42:42.354 INFO:tasks.rados.rados.0.smithi137.stdout:232: done (2 left) 2024-03-04T06:42:42.354 INFO:tasks.rados.rados.0.smithi137.stdout:233: done (1 left) 2024-03-04T06:42:42.354 INFO:tasks.rados.rados.0.smithi137.stdout:234: done (0 left) 2024-03-04T06:42:42.354 INFO:tasks.rados.rados.0.smithi137.stdout:235: rollback oid 30 current snap is 19 2024-03-04T06:42:42.354 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 30 to 15 2024-03-04T06:42:42.354 INFO:tasks.rados.rados.0.smithi137.stdout:236: copy_from oid 9 from oid 25 current snap is 19 2024-03-04T06:42:42.354 INFO:tasks.rados.rados.0.smithi137.stdout:237: copy_from oid 12 from oid 28 current snap is 19 2024-03-04T06:42:42.354 INFO:tasks.rados.rados.0.smithi137.stdout:238: read oid 1 snap -1 2024-03-04T06:42:42.354 INFO:tasks.rados.rados.0.smithi137.stdout:238: expect deleted 2024-03-04T06:42:42.354 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 19 2024-03-04T06:42:42.354 INFO:tasks.rados.rados.0.smithi137.stdout:239: seq_num 96 ranges {524288=409600,933888=696320,1630208=507904} 2024-03-04T06:42:42.359 INFO:tasks.rados.rados.0.smithi137.stdout:239: writing smithi13777483-32 from 524288 to 933888 tid 1 2024-03-04T06:42:42.363 INFO:tasks.rados.rados.0.smithi137.stdout:239: writing smithi13777483-32 from 933888 to 1630208 tid 2 2024-03-04T06:42:42.367 INFO:tasks.rados.rados.0.smithi137.stdout:239: writing smithi13777483-32 from 1630208 to 2138112 tid 3 2024-03-04T06:42:42.367 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 36 current snap is 19 2024-03-04T06:42:42.367 INFO:tasks.rados.rados.0.smithi137.stdout:240: seq_num 97 ranges {1302528=434176,1736704=581632,2318336=540672,2859008=81920} 2024-03-04T06:42:42.376 INFO:tasks.rados.rados.0.smithi137.stdout:240: writing smithi13777483-36 from 1302528 to 1736704 tid 1 2024-03-04T06:42:42.380 INFO:tasks.rados.rados.0.smithi137.stdout:240: writing smithi13777483-36 from 1736704 to 2318336 tid 2 2024-03-04T06:42:42.383 INFO:tasks.rados.rados.0.smithi137.stdout:240: writing smithi13777483-36 from 2318336 to 2859008 tid 3 2024-03-04T06:42:42.384 INFO:tasks.rados.rados.0.smithi137.stdout:240: writing smithi13777483-36 from 2859008 to 2940928 tid 4 2024-03-04T06:42:42.384 INFO:tasks.rados.rados.0.smithi137.stdout:241: rollback oid 2 current snap is 19 2024-03-04T06:42:42.384 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 2 to 15 2024-03-04T06:42:42.384 INFO:tasks.rados.rados.0.smithi137.stdout:235: finishing rollback tid 0 to smithi13777483-30 2024-03-04T06:42:42.384 INFO:tasks.rados.rados.0.smithi137.stdout:235: finishing rollback tid 1 to smithi13777483-30 2024-03-04T06:42:42.384 INFO:tasks.rados.rados.0.smithi137.stdout:235: finishing rollback tid 2 to smithi13777483-30 2024-03-04T06:42:42.384 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 8 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:239: finishing write tid 1 to smithi13777483-32 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:236: finishing copy_from racing read to smithi13777483-9 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:237: finishing copy_from racing read to smithi13777483-12 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:236: finishing copy_from to smithi13777483-9 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 24 (ObjNum 56 snap 3 seq_num 56) dirty exists 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:239: finishing write tid 2 to smithi13777483-32 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:235: done (6 left) 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:236: done (5 left) 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:238: done (4 left) 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 19 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:237: finishing copy_from to smithi13777483-12 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 13 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:239: finishing write tid 3 to smithi13777483-32 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:239: finishing write tid 4 to smithi13777483-32 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:239: finishing write tid 5 to smithi13777483-32 2024-03-04T06:42:42.385 INFO:tasks.rados.rados.0.smithi137.stdout:239: oid 32 updating version 0 to 58 2024-03-04T06:42:42.386 INFO:tasks.rados.rados.0.smithi137.stdout:239: oid 32 updating version 58 to 59 2024-03-04T06:42:42.386 INFO:tasks.rados.rados.0.smithi137.stdout:239: oid 32 version 59 is already newer than 56 2024-03-04T06:42:42.386 INFO:tasks.rados.rados.0.smithi137.stdout:239: oid 32 version 59 is already newer than 57 2024-03-04T06:42:42.386 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 59 (ObjNum 96 snap 19 seq_num 96) dirty exists 2024-03-04T06:42:42.386 INFO:tasks.rados.rados.0.smithi137.stdout:239: left oid 32 (ObjNum 96 snap 19 seq_num 96) 2024-03-04T06:42:42.386 INFO:tasks.rados.rados.0.smithi137.stdout:240: finishing write tid 1 to smithi13777483-36 2024-03-04T06:42:42.386 INFO:tasks.rados.rados.0.smithi137.stdout:240: finishing write tid 2 to smithi13777483-36 2024-03-04T06:42:42.386 INFO:tasks.rados.rados.0.smithi137.stdout:242: seq_num 98 ranges {696320=450560,1146880=466944,1613824=737280} 2024-03-04T06:42:42.390 INFO:tasks.rados.rados.0.smithi137.stdout:242: writing smithi13777483-20 from 696320 to 1146880 tid 1 2024-03-04T06:42:42.392 INFO:tasks.rados.rados.0.smithi137.stdout:242: writing smithi13777483-20 from 1146880 to 1613824 tid 2 2024-03-04T06:42:42.397 INFO:tasks.rados.rados.0.smithi137.stdout:242: writing smithi13777483-20 from 1613824 to 2351104 tid 3 2024-03-04T06:42:42.397 INFO:tasks.rados.rados.0.smithi137.stdout:237: done (4 left) 2024-03-04T06:42:42.397 INFO:tasks.rados.rados.0.smithi137.stdout:239: done (3 left) 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:243: read oid 12 snap -1 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:243: expect (ObjNum 50 snap 0 seq_num 50) 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:244: rollback oid 27 current snap is 19 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 27 to 14 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:241: finishing rollback tid 1 to smithi13777483-2 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:240: finishing write tid 3 to smithi13777483-36 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:241: finishing rollback tid 2 to smithi13777483-2 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 49 (ObjNum 93 snap 14 seq_num 93) dirty exists 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:240: finishing write tid 4 to smithi13777483-36 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:240: finishing write tid 5 to smithi13777483-36 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:240: finishing write tid 6 to smithi13777483-36 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:240: oid 36 updating version 0 to 19 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:240: oid 36 version 19 is already newer than 17 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:240: oid 36 updating version 19 to 20 2024-03-04T06:42:42.398 INFO:tasks.rados.rados.0.smithi137.stdout:240: oid 36 version 20 is already newer than 18 2024-03-04T06:42:42.399 INFO:tasks.rados.rados.0.smithi137.stdout:240: oid 36 updating version 20 to 21 2024-03-04T06:42:42.399 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 21 (ObjNum 97 snap 19 seq_num 97) dirty exists 2024-03-04T06:42:42.399 INFO:tasks.rados.rados.0.smithi137.stdout:240: left oid 36 (ObjNum 97 snap 19 seq_num 97) 2024-03-04T06:42:42.399 INFO:tasks.rados.rados.0.smithi137.stdout:242: finishing write tid 1 to smithi13777483-20 2024-03-04T06:42:42.399 INFO:tasks.rados.rados.0.smithi137.stdout:242: finishing write tid 2 to smithi13777483-20 2024-03-04T06:42:42.399 INFO:tasks.rados.rados.0.smithi137.stdout:240: done (4 left) 2024-03-04T06:42:42.399 INFO:tasks.rados.rados.0.smithi137.stdout:241: done (3 left) 2024-03-04T06:42:42.399 INFO:tasks.rados.rados.0.smithi137.stdout:245: rmattr oid 24 current snap is 19 2024-03-04T06:42:42.399 INFO:tasks.rados.rados.0.smithi137.stdout:246: copy_from oid 30 from oid 18 current snap is 19 2024-03-04T06:42:42.399 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 19 2024-03-04T06:42:42.399 INFO:tasks.rados.rados.0.smithi137.stdout:247: seq_num 99 ranges {221184=466944,688128=802816,1490944=401408} 2024-03-04T06:42:42.401 INFO:tasks.rados.rados.0.smithi137.stdout:247: writing smithi13777483-14 from 221184 to 688128 tid 1 2024-03-04T06:42:42.405 INFO:tasks.rados.rados.0.smithi137.stdout:247: writing smithi13777483-14 from 688128 to 1490944 tid 2 2024-03-04T06:42:42.408 INFO:tasks.rados.rados.0.smithi137.stdout:247: writing smithi13777483-14 from 1490944 to 1892352 tid 3 2024-03-04T06:42:42.408 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 19 2024-03-04T06:42:42.408 INFO:tasks.rados.rados.0.smithi137.stdout:244: finishing rollback tid 0 to smithi13777483-27 2024-03-04T06:42:42.408 INFO:tasks.rados.rados.0.smithi137.stdout:248: seq_num 100 ranges {1458176=483328,1941504=688128,2629632=516096} 2024-03-04T06:42:42.418 INFO:tasks.rados.rados.0.smithi137.stdout:248: writing smithi13777483-3 from 1458176 to 1941504 tid 1 2024-03-04T06:42:42.422 INFO:tasks.rados.rados.0.smithi137.stdout:248: writing smithi13777483-3 from 1941504 to 2629632 tid 2 2024-03-04T06:42:42.425 INFO:tasks.rados.rados.0.smithi137.stdout:248: writing smithi13777483-3 from 2629632 to 3145728 tid 3 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:249: read oid 13 snap 17 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:249: expect (ObjNum 86 snap 14 seq_num 86) 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:250: snap_create 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 24 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:244: finishing rollback tid 1 to smithi13777483-27 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:244: finishing rollback tid 2 to smithi13777483-27 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 63 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:242: finishing write tid 3 to smithi13777483-20 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:242: finishing write tid 4 to smithi13777483-20 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:242: finishing write tid 5 to smithi13777483-20 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:242: oid 20 updating version 0 to 43 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:242: oid 20 updating version 43 to 45 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:242: oid 20 version 45 is already newer than 44 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:242: oid 20 version 45 is already newer than 42 2024-03-04T06:42:42.426 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 45 (ObjNum 98 snap 19 seq_num 98) dirty exists 2024-03-04T06:42:42.427 INFO:tasks.rados.rados.0.smithi137.stdout:242: left oid 20 (ObjNum 98 snap 19 seq_num 98) 2024-03-04T06:42:42.427 INFO:tasks.rados.rados.0.smithi137.stdout:243: expect (ObjNum 50 snap 0 seq_num 50) 2024-03-04T06:42:42.468 INFO:tasks.rados.rados.0.smithi137.stdout:247: finishing write tid 1 to smithi13777483-14 2024-03-04T06:42:42.468 INFO:tasks.rados.rados.0.smithi137.stdout:247: finishing write tid 2 to smithi13777483-14 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:247: finishing write tid 3 to smithi13777483-14 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:246: finishing copy_from racing read to smithi13777483-30 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:247: finishing write tid 4 to smithi13777483-14 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:246: finishing copy_from to smithi13777483-30 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 21 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:247: finishing write tid 5 to smithi13777483-14 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:247: oid 14 updating version 0 to 49 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:247: oid 14 version 49 is already newer than 48 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:247: oid 14 version 49 is already newer than 47 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:247: oid 14 updating version 49 to 50 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 50 (ObjNum 99 snap 19 seq_num 99) dirty exists 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:247: left oid 14 (ObjNum 99 snap 19 seq_num 99) 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:248: finishing write tid 1 to smithi13777483-3 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:248: finishing write tid 2 to smithi13777483-3 2024-03-04T06:42:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:248: finishing write tid 3 to smithi13777483-3 2024-03-04T06:42:42.470 INFO:tasks.rados.rados.0.smithi137.stdout:248: finishing write tid 4 to smithi13777483-3 2024-03-04T06:42:42.470 INFO:tasks.rados.rados.0.smithi137.stdout:248: finishing write tid 5 to smithi13777483-3 2024-03-04T06:42:42.470 INFO:tasks.rados.rados.0.smithi137.stdout:248: oid 3 updating version 0 to 84 2024-03-04T06:42:42.470 INFO:tasks.rados.rados.0.smithi137.stdout:248: oid 3 version 84 is already newer than 83 2024-03-04T06:42:42.470 INFO:tasks.rados.rados.0.smithi137.stdout:248: oid 3 updating version 84 to 86 2024-03-04T06:42:42.470 INFO:tasks.rados.rados.0.smithi137.stdout:248: oid 3 version 86 is already newer than 85 2024-03-04T06:42:42.470 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 86 (ObjNum 100 snap 19 seq_num 100) dirty exists 2024-03-04T06:42:42.470 INFO:tasks.rados.rados.0.smithi137.stdout:248: left oid 3 (ObjNum 100 snap 19 seq_num 100) 2024-03-04T06:42:42.470 INFO:tasks.rados.rados.0.smithi137.stdout:249: expect (ObjNum 86 snap 14 seq_num 86) 2024-03-04T06:42:43.364 INFO:tasks.rados.rados.0.smithi137.stdout:242: done (8 left) 2024-03-04T06:42:43.364 INFO:tasks.rados.rados.0.smithi137.stdout:243: done (7 left) 2024-03-04T06:42:43.364 INFO:tasks.rados.rados.0.smithi137.stdout:244: done (6 left) 2024-03-04T06:42:43.364 INFO:tasks.rados.rados.0.smithi137.stdout:245: done (5 left) 2024-03-04T06:42:43.364 INFO:tasks.rados.rados.0.smithi137.stdout:246: done (4 left) 2024-03-04T06:42:43.364 INFO:tasks.rados.rados.0.smithi137.stdout:247: done (3 left) 2024-03-04T06:42:43.365 INFO:tasks.rados.rados.0.smithi137.stdout:248: done (2 left) 2024-03-04T06:42:43.365 INFO:tasks.rados.rados.0.smithi137.stdout:249: done (1 left) 2024-03-04T06:42:43.365 INFO:tasks.rados.rados.0.smithi137.stdout:250: done (0 left) 2024-03-04T06:42:43.365 INFO:tasks.rados.rados.0.smithi137.stdout:251: rmattr oid 29 current snap is 20 2024-03-04T06:42:43.365 INFO:tasks.rados.rados.0.smithi137.stdout:252: copy_from oid 18 from oid 3 current snap is 20 2024-03-04T06:42:43.365 INFO:tasks.rados.rados.0.smithi137.stdout:253: rollback oid 38 current snap is 20 2024-03-04T06:42:43.365 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 38 to 15 2024-03-04T06:42:43.365 INFO:tasks.rados.rados.0.smithi137.stdout:254: snap_remove snap 12 2024-03-04T06:42:43.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:43 smithi137 ceph-mon[26846]: osdmap e106: 8 total, 8 up, 8 in 2024-03-04T06:42:43.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:43 smithi137 ceph-mon[26846]: pgmap v165: 121 pgs: 121 active+clean; 54 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 21 op/s 2024-03-04T06:42:43.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:43 smithi137 ceph-mon[37364]: osdmap e106: 8 total, 8 up, 8 in 2024-03-04T06:42:43.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:43 smithi137 ceph-mon[37364]: pgmap v165: 121 pgs: 121 active+clean; 54 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 21 op/s 2024-03-04T06:42:43.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:43 smithi203 ceph-mon[30756]: osdmap e106: 8 total, 8 up, 8 in 2024-03-04T06:42:43.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:43 smithi203 ceph-mon[30756]: pgmap v165: 121 pgs: 121 active+clean; 54 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 21 op/s 2024-03-04T06:42:44.363 INFO:tasks.rados.rados.0.smithi137.stdout:254: done (3 left) 2024-03-04T06:42:44.363 INFO:tasks.rados.rados.0.smithi137.stdout:255: snap_create 2024-03-04T06:42:44.363 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 24 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-04T06:42:44.363 INFO:tasks.rados.rados.0.smithi137.stdout:253: finishing rollback tid 0 to smithi13777483-38 2024-03-04T06:42:44.363 INFO:tasks.rados.rados.0.smithi137.stdout:253: finishing rollback tid 1 to smithi13777483-38 2024-03-04T06:42:44.363 INFO:tasks.rados.rados.0.smithi137.stdout:253: finishing rollback tid 2 to smithi13777483-38 2024-03-04T06:42:44.363 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 73 (ObjNum 92 snap 14 seq_num 92) dirty exists 2024-03-04T06:42:44.363 INFO:tasks.rados.rados.0.smithi137.stdout:252: finishing copy_from racing read to smithi13777483-18 2024-03-04T06:42:44.364 INFO:tasks.rados.rados.0.smithi137.stdout:252: finishing copy_from to smithi13777483-18 2024-03-04T06:42:44.364 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 86 (ObjNum 100 snap 19 seq_num 100) dirty exists 2024-03-04T06:42:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:44 smithi137 ceph-mon[26846]: osdmap e107: 8 total, 8 up, 8 in 2024-03-04T06:42:44.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:44 smithi137 ceph-mon[37364]: osdmap e107: 8 total, 8 up, 8 in 2024-03-04T06:42:44.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:44 smithi203 ceph-mon[30756]: osdmap e107: 8 total, 8 up, 8 in 2024-03-04T06:42:45.355 INFO:tasks.rados.rados.0.smithi137.stdout:251: done (3 left) 2024-03-04T06:42:45.355 INFO:tasks.rados.rados.0.smithi137.stdout:252: done (2 left) 2024-03-04T06:42:45.355 INFO:tasks.rados.rados.0.smithi137.stdout:253: done (1 left) 2024-03-04T06:42:45.355 INFO:tasks.rados.rados.0.smithi137.stdout:255: done (0 left) 2024-03-04T06:42:45.355 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 21 2024-03-04T06:42:45.355 INFO:tasks.rados.rados.0.smithi137.stdout:256: seq_num 101 ranges {2498560=499712,2998272=573440,3571712=524288,4096000=106496} 2024-03-04T06:42:45.371 INFO:tasks.rados.rados.0.smithi137.stdout:256: writing smithi13777483-16 from 2498560 to 2998272 tid 1 2024-03-04T06:42:45.375 INFO:tasks.rados.rados.0.smithi137.stdout:256: writing smithi13777483-16 from 2998272 to 3571712 tid 2 2024-03-04T06:42:45.378 INFO:tasks.rados.rados.0.smithi137.stdout:256: writing smithi13777483-16 from 3571712 to 4096000 tid 3 2024-03-04T06:42:45.379 INFO:tasks.rados.rados.0.smithi137.stdout:256: writing smithi13777483-16 from 4096000 to 4202496 tid 4 2024-03-04T06:42:45.379 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 21 2024-03-04T06:42:45.379 INFO:tasks.rados.rados.0.smithi137.stdout:257: seq_num 102 ranges {3145728=516096,3661824=450560,4112384=729088,4841472=24576} 2024-03-04T06:42:45.399 INFO:tasks.rados.rados.0.smithi137.stdout:257: writing smithi13777483-18 from 3145728 to 3661824 tid 1 2024-03-04T06:42:45.401 INFO:tasks.rados.rados.0.smithi137.stdout:257: writing smithi13777483-18 from 3661824 to 4112384 tid 2 2024-03-04T06:42:45.406 INFO:tasks.rados.rados.0.smithi137.stdout:257: writing smithi13777483-18 from 4112384 to 4841472 tid 3 2024-03-04T06:42:45.406 INFO:tasks.rados.rados.0.smithi137.stdout:257: writing smithi13777483-18 from 4841472 to 4866048 tid 4 2024-03-04T06:42:45.406 INFO:tasks.rados.rados.0.smithi137.stdout:258: setattr oid 45 current snap is 21 2024-03-04T06:42:45.406 INFO:tasks.rados.rados.0.smithi137.stdout:256: finishing write tid 1 to smithi13777483-16 2024-03-04T06:42:45.406 INFO:tasks.rados.rados.0.smithi137.stdout:256: finishing write tid 2 to smithi13777483-16 2024-03-04T06:42:45.406 INFO:tasks.rados.rados.0.smithi137.stdout:256: finishing write tid 3 to smithi13777483-16 2024-03-04T06:42:45.406 INFO:tasks.rados.rados.0.smithi137.stdout:256: finishing write tid 4 to smithi13777483-16 2024-03-04T06:42:45.406 INFO:tasks.rados.rados.0.smithi137.stdout:256: finishing write tid 5 to smithi13777483-16 2024-03-04T06:42:45.406 INFO:tasks.rados.rados.0.smithi137.stdout:256: finishing write tid 6 to smithi13777483-16 2024-03-04T06:42:45.407 INFO:tasks.rados.rados.0.smithi137.stdout:256: oid 16 updating version 0 to 49 2024-03-04T06:42:45.407 INFO:tasks.rados.rados.0.smithi137.stdout:256: oid 16 updating version 49 to 52 2024-03-04T06:42:45.407 INFO:tasks.rados.rados.0.smithi137.stdout:256: oid 16 version 52 is already newer than 50 2024-03-04T06:42:45.407 INFO:tasks.rados.rados.0.smithi137.stdout:256: oid 16 updating version 52 to 53 2024-03-04T06:42:45.407 INFO:tasks.rados.rados.0.smithi137.stdout:256: oid 16 version 53 is already newer than 51 2024-03-04T06:42:45.407 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 53 (ObjNum 101 snap 21 seq_num 101) dirty exists 2024-03-04T06:42:45.407 INFO:tasks.rados.rados.0.smithi137.stdout:256: left oid 16 (ObjNum 101 snap 21 seq_num 101) 2024-03-04T06:42:45.407 INFO:tasks.rados.rados.0.smithi137.stdout:257: finishing write tid 1 to smithi13777483-18 2024-03-04T06:42:45.407 INFO:tasks.rados.rados.0.smithi137.stdout:257: finishing write tid 2 to smithi13777483-18 2024-03-04T06:42:45.408 INFO:tasks.rados.rados.0.smithi137.stdout:256: done (2 left) 2024-03-04T06:42:45.408 INFO:tasks.rados.rados.0.smithi137.stdout:259: snap_remove snap 15 2024-03-04T06:42:45.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:42:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:42:45] "GET /metrics HTTP/1.1" 200 35997 "" "Prometheus/2.43.0" 2024-03-04T06:42:45.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:45 smithi137 ceph-mon[26846]: osdmap e108: 8 total, 8 up, 8 in 2024-03-04T06:42:45.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:45 smithi137 ceph-mon[26846]: pgmap v168: 121 pgs: 121 active+clean; 54 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 21 op/s 2024-03-04T06:42:45.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:45 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:42:45.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:45 smithi137 ceph-mon[26846]: osdmap e109: 8 total, 8 up, 8 in 2024-03-04T06:42:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:45 smithi137 ceph-mon[37364]: osdmap e108: 8 total, 8 up, 8 in 2024-03-04T06:42:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:45 smithi137 ceph-mon[37364]: pgmap v168: 121 pgs: 121 active+clean; 54 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 21 op/s 2024-03-04T06:42:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:45 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:42:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:45 smithi137 ceph-mon[37364]: osdmap e109: 8 total, 8 up, 8 in 2024-03-04T06:42:45.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:45 smithi203 ceph-mon[30756]: osdmap e108: 8 total, 8 up, 8 in 2024-03-04T06:42:45.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:45 smithi203 ceph-mon[30756]: pgmap v168: 121 pgs: 121 active+clean; 54 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 21 op/s 2024-03-04T06:42:45.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:45 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:42:45.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:45 smithi203 ceph-mon[30756]: osdmap e109: 8 total, 8 up, 8 in 2024-03-04T06:42:46.381 INFO:tasks.rados.rados.0.smithi137.stdout:257: finishing write tid 3 to smithi13777483-18 2024-03-04T06:42:46.381 INFO:tasks.rados.rados.0.smithi137.stdout:257: finishing write tid 4 to smithi13777483-18 2024-03-04T06:42:46.381 INFO:tasks.rados.rados.0.smithi137.stdout:257: finishing write tid 5 to smithi13777483-18 2024-03-04T06:42:46.382 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 22 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-03-04T06:42:46.382 INFO:tasks.rados.rados.0.smithi137.stdout:257: finishing write tid 6 to smithi13777483-18 2024-03-04T06:42:46.382 INFO:tasks.rados.rados.0.smithi137.stdout:257: oid 18 updating version 0 to 91 2024-03-04T06:42:46.382 INFO:tasks.rados.rados.0.smithi137.stdout:257: oid 18 version 91 is already newer than 87 2024-03-04T06:42:46.382 INFO:tasks.rados.rados.0.smithi137.stdout:257: oid 18 version 91 is already newer than 89 2024-03-04T06:42:46.382 INFO:tasks.rados.rados.0.smithi137.stdout:257: oid 18 version 91 is already newer than 90 2024-03-04T06:42:46.382 INFO:tasks.rados.rados.0.smithi137.stdout:257: oid 18 version 91 is already newer than 88 2024-03-04T06:42:46.382 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 91 (ObjNum 102 snap 21 seq_num 102) dirty exists 2024-03-04T06:42:46.382 INFO:tasks.rados.rados.0.smithi137.stdout:257: left oid 18 (ObjNum 102 snap 21 seq_num 102) 2024-03-04T06:42:46.382 INFO:tasks.rados.rados.0.smithi137.stdout:257: done (2 left) 2024-03-04T06:42:46.382 INFO:tasks.rados.rados.0.smithi137.stdout:258: done (1 left) 2024-03-04T06:42:46.382 INFO:tasks.rados.rados.0.smithi137.stdout:259: done (0 left) 2024-03-04T06:42:46.382 INFO:tasks.rados.rados.0.smithi137.stdout:260: setattr oid 40 current snap is 21 2024-03-04T06:42:46.384 INFO:tasks.rados.rados.0.smithi137.stdout:261: snap_create 2024-03-04T06:42:46.389 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 73 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-03-04T06:42:47.392 INFO:tasks.rados.rados.0.smithi137.stdout:260: done (1 left) 2024-03-04T06:42:47.392 INFO:tasks.rados.rados.0.smithi137.stdout:261: done (0 left) 2024-03-04T06:42:47.392 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 33 current snap is 22 2024-03-04T06:42:47.392 INFO:tasks.rados.rados.0.smithi137.stdout:262: seq_num 103 ranges {540672=532480,1073152=737280,1810432=466944} 2024-03-04T06:42:47.398 INFO:tasks.rados.rados.0.smithi137.stdout:262: writing smithi13777483-33 from 540672 to 1073152 tid 1 2024-03-04T06:42:47.402 INFO:tasks.rados.rados.0.smithi137.stdout:262: writing smithi13777483-33 from 1073152 to 1810432 tid 2 2024-03-04T06:42:47.405 INFO:tasks.rados.rados.0.smithi137.stdout:262: writing smithi13777483-33 from 1810432 to 2277376 tid 3 2024-03-04T06:42:47.405 INFO:tasks.rados.rados.0.smithi137.stdout:263: copy_from oid 18 from oid 13 current snap is 22 2024-03-04T06:42:47.405 INFO:tasks.rados.rados.0.smithi137.stdout:262: finishing write tid 1 to smithi13777483-33 2024-03-04T06:42:47.405 INFO:tasks.rados.rados.0.smithi137.stdout:264: snap_create 2024-03-04T06:42:47.405 INFO:tasks.rados.rados.0.smithi137.stdout:262: finishing write tid 2 to smithi13777483-33 2024-03-04T06:42:47.408 INFO:tasks.rados.rados.0.smithi137.stdout:262: finishing write tid 3 to smithi13777483-33 2024-03-04T06:42:47.408 INFO:tasks.rados.rados.0.smithi137.stdout:262: finishing write tid 4 to smithi13777483-33 2024-03-04T06:42:47.410 INFO:tasks.rados.rados.0.smithi137.stdout:262: finishing write tid 5 to smithi13777483-33 2024-03-04T06:42:47.410 INFO:tasks.rados.rados.0.smithi137.stdout:262: oid 33 updating version 0 to 49 2024-03-04T06:42:47.410 INFO:tasks.rados.rados.0.smithi137.stdout:262: oid 33 version 49 is already newer than 48 2024-03-04T06:42:47.410 INFO:tasks.rados.rados.0.smithi137.stdout:262: oid 33 version 49 is already newer than 47 2024-03-04T06:42:47.410 INFO:tasks.rados.rados.0.smithi137.stdout:262: oid 33 updating version 49 to 50 2024-03-04T06:42:47.410 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 50 (ObjNum 103 snap 22 seq_num 103) dirty exists 2024-03-04T06:42:47.410 INFO:tasks.rados.rados.0.smithi137.stdout:262: left oid 33 (ObjNum 103 snap 22 seq_num 103) 2024-03-04T06:42:47.416 INFO:tasks.rados.rados.0.smithi137.stdout:263: finishing copy_from racing read to smithi13777483-18 2024-03-04T06:42:47.419 INFO:tasks.rados.rados.0.smithi137.stdout:263: finishing copy_from to smithi13777483-18 2024-03-04T06:42:47.419 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 52 (ObjNum 86 snap 14 seq_num 86) dirty exists 2024-03-04T06:42:47.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:47 smithi137 ceph-mon[26846]: osdmap e110: 8 total, 8 up, 8 in 2024-03-04T06:42:47.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:47 smithi137 ceph-mon[26846]: pgmap v171: 121 pgs: 121 active+clean; 77 MiB data, 330 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 23 op/s 2024-03-04T06:42:47.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:47 smithi137 ceph-mon[37364]: osdmap e110: 8 total, 8 up, 8 in 2024-03-04T06:42:47.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:47 smithi137 ceph-mon[37364]: pgmap v171: 121 pgs: 121 active+clean; 77 MiB data, 330 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 23 op/s 2024-03-04T06:42:47.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:47 smithi203 ceph-mon[30756]: osdmap e110: 8 total, 8 up, 8 in 2024-03-04T06:42:47.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:47 smithi203 ceph-mon[30756]: pgmap v171: 121 pgs: 121 active+clean; 77 MiB data, 330 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 23 op/s 2024-03-04T06:42:48.396 INFO:tasks.rados.rados.0.smithi137.stdout:262: done (2 left) 2024-03-04T06:42:48.397 INFO:tasks.rados.rados.0.smithi137.stdout:263: done (1 left) 2024-03-04T06:42:48.397 INFO:tasks.rados.rados.0.smithi137.stdout:264: done (0 left) 2024-03-04T06:42:48.397 INFO:tasks.rados.rados.0.smithi137.stdout:265: snap_create 2024-03-04T06:42:48.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:48 smithi137 ceph-mon[26846]: osdmap e111: 8 total, 8 up, 8 in 2024-03-04T06:42:48.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:48 smithi137 ceph-mon[37364]: osdmap e111: 8 total, 8 up, 8 in 2024-03-04T06:42:48.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:48 smithi203 ceph-mon[30756]: osdmap e111: 8 total, 8 up, 8 in 2024-03-04T06:42:49.408 INFO:tasks.rados.rados.0.smithi137.stdout:265: done (0 left) 2024-03-04T06:42:49.408 INFO:tasks.rados.rados.0.smithi137.stdout:266: read oid 15 snap -1 2024-03-04T06:42:49.408 INFO:tasks.rados.rados.0.smithi137.stdout:266: expect (ObjNum 4 snap 0 seq_num 4) 2024-03-04T06:42:49.409 INFO:tasks.rados.rados.0.smithi137.stdout:267: snap_create 2024-03-04T06:42:49.413 INFO:tasks.rados.rados.0.smithi137.stdout:266: expect (ObjNum 4 snap 0 seq_num 4) 2024-03-04T06:42:49.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:49 smithi137 ceph-mon[26846]: osdmap e112: 8 total, 8 up, 8 in 2024-03-04T06:42:49.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:49 smithi137 ceph-mon[26846]: pgmap v174: 121 pgs: 121 active+clean; 77 MiB data, 330 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 23 op/s 2024-03-04T06:42:49.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:49 smithi137 ceph-mon[37364]: osdmap e112: 8 total, 8 up, 8 in 2024-03-04T06:42:49.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:49 smithi137 ceph-mon[37364]: pgmap v174: 121 pgs: 121 active+clean; 77 MiB data, 330 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 23 op/s 2024-03-04T06:42:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:49 smithi203 ceph-mon[30756]: osdmap e112: 8 total, 8 up, 8 in 2024-03-04T06:42:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:49 smithi203 ceph-mon[30756]: pgmap v174: 121 pgs: 121 active+clean; 77 MiB data, 330 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 23 op/s 2024-03-04T06:42:50.355 INFO:tasks.rados.rados.0.smithi137.stdout:266: done (1 left) 2024-03-04T06:42:50.355 INFO:tasks.rados.rados.0.smithi137.stdout:267: done (0 left) 2024-03-04T06:42:50.355 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 25 2024-03-04T06:42:50.355 INFO:tasks.rados.rados.0.smithi137.stdout:268: seq_num 104 ranges {1548288=548864,2097152=622592,2719744=581632} 2024-03-04T06:42:50.367 INFO:tasks.rados.rados.0.smithi137.stdout:268: writing smithi13777483-23 from 1548288 to 2097152 tid 1 2024-03-04T06:42:50.370 INFO:tasks.rados.rados.0.smithi137.stdout:268: writing smithi13777483-23 from 2097152 to 2719744 tid 2 2024-03-04T06:42:50.374 INFO:tasks.rados.rados.0.smithi137.stdout:268: writing smithi13777483-23 from 2719744 to 3301376 tid 3 2024-03-04T06:42:50.375 INFO:tasks.rados.rados.0.smithi137.stdout:269: rollback oid 9 current snap is 25 2024-03-04T06:42:50.375 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 9 to 17 2024-03-04T06:42:50.375 INFO:tasks.rados.rados.0.smithi137.stdout:270: snap_remove snap 16 2024-03-04T06:42:50.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:50 smithi137 ceph-mon[26846]: osdmap e113: 8 total, 8 up, 8 in 2024-03-04T06:42:50.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:50 smithi137 ceph-mon[26846]: osdmap e114: 8 total, 8 up, 8 in 2024-03-04T06:42:50.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:50 smithi137 ceph-mon[37364]: osdmap e113: 8 total, 8 up, 8 in 2024-03-04T06:42:50.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:50 smithi137 ceph-mon[37364]: osdmap e114: 8 total, 8 up, 8 in 2024-03-04T06:42:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:50 smithi203 ceph-mon[30756]: osdmap e113: 8 total, 8 up, 8 in 2024-03-04T06:42:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:50 smithi203 ceph-mon[30756]: osdmap e114: 8 total, 8 up, 8 in 2024-03-04T06:42:51.362 INFO:tasks.rados.rados.0.smithi137.stdout:270: done (2 left) 2024-03-04T06:42:51.362 INFO:tasks.rados.rados.0.smithi137.stdout:271: rollback oid 25 current snap is 25 2024-03-04T06:42:51.362 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 25 to 21 2024-03-04T06:42:51.362 INFO:tasks.rados.rados.0.smithi137.stdout:268: finishing write tid 1 to smithi13777483-23 2024-03-04T06:42:51.362 INFO:tasks.rados.rados.0.smithi137.stdout:268: finishing write tid 2 to smithi13777483-23 2024-03-04T06:42:51.362 INFO:tasks.rados.rados.0.smithi137.stdout:268: finishing write tid 3 to smithi13777483-23 2024-03-04T06:42:51.362 INFO:tasks.rados.rados.0.smithi137.stdout:268: finishing write tid 4 to smithi13777483-23 2024-03-04T06:42:51.362 INFO:tasks.rados.rados.0.smithi137.stdout:268: finishing write tid 5 to smithi13777483-23 2024-03-04T06:42:51.363 INFO:tasks.rados.rados.0.smithi137.stdout:268: oid 23 updating version 0 to 58 2024-03-04T06:42:51.363 INFO:tasks.rados.rados.0.smithi137.stdout:268: oid 23 updating version 58 to 60 2024-03-04T06:42:51.363 INFO:tasks.rados.rados.0.smithi137.stdout:268: oid 23 updating version 60 to 61 2024-03-04T06:42:51.363 INFO:tasks.rados.rados.0.smithi137.stdout:268: oid 23 version 61 is already newer than 59 2024-03-04T06:42:51.363 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 61 (ObjNum 104 snap 25 seq_num 104) dirty exists 2024-03-04T06:42:51.363 INFO:tasks.rados.rados.0.smithi137.stdout:268: left oid 23 (ObjNum 104 snap 25 seq_num 104) 2024-03-04T06:42:51.363 INFO:tasks.rados.rados.0.smithi137.stdout:269: finishing rollback tid 0 to smithi13777483-9 2024-03-04T06:42:51.363 INFO:tasks.rados.rados.0.smithi137.stdout:269: finishing rollback tid 1 to smithi13777483-9 2024-03-04T06:42:51.363 INFO:tasks.rados.rados.0.smithi137.stdout:269: finishing rollback tid 2 to smithi13777483-9 2024-03-04T06:42:51.363 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 100 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-03-04T06:42:51.363 INFO:tasks.rados.rados.0.smithi137.stdout:268: done (2 left) 2024-03-04T06:42:51.363 INFO:tasks.rados.rados.0.smithi137.stdout:269: done (1 left) 2024-03-04T06:42:51.363 INFO:tasks.rados.rados.0.smithi137.stdout:272: snap_create 2024-03-04T06:42:51.370 INFO:tasks.rados.rados.0.smithi137.stdout:271: finishing rollback tid 0 to smithi13777483-25 2024-03-04T06:42:51.371 INFO:tasks.rados.rados.0.smithi137.stdout:271: finishing rollback tid 1 to smithi13777483-25 2024-03-04T06:42:51.371 INFO:tasks.rados.rados.0.smithi137.stdout:271: finishing rollback tid 2 to smithi13777483-25 2024-03-04T06:42:51.372 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 83 (ObjNum 56 snap 3 seq_num 56) dirty exists 2024-03-04T06:42:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:51 smithi137 ceph-mon[37364]: pgmap v177: 121 pgs: 121 active+clean; 77 MiB data, 330 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:51 smithi137 ceph-mon[37364]: osdmap e115: 8 total, 8 up, 8 in 2024-03-04T06:42:51.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:51 smithi137 ceph-mon[26846]: pgmap v177: 121 pgs: 121 active+clean; 77 MiB data, 330 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:51.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:51 smithi137 ceph-mon[26846]: osdmap e115: 8 total, 8 up, 8 in 2024-03-04T06:42:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:51 smithi203 ceph-mon[30756]: pgmap v177: 121 pgs: 121 active+clean; 77 MiB data, 330 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:42:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:51 smithi203 ceph-mon[30756]: osdmap e115: 8 total, 8 up, 8 in 2024-03-04T06:42:52.363 INFO:tasks.rados.rados.0.smithi137.stdout:271: done (1 left) 2024-03-04T06:42:52.363 INFO:tasks.rados.rados.0.smithi137.stdout:272: done (0 left) 2024-03-04T06:42:52.364 INFO:tasks.rados.rados.0.smithi137.stdout:273: read oid 23 snap -1 2024-03-04T06:42:52.364 INFO:tasks.rados.rados.0.smithi137.stdout:273: expect (ObjNum 104 snap 25 seq_num 104) 2024-03-04T06:42:52.364 INFO:tasks.rados.rados.0.smithi137.stdout:274: snap_remove snap 17 2024-03-04T06:42:53.380 INFO:tasks.rados.rados.0.smithi137.stdout:273: expect (ObjNum 104 snap 25 seq_num 104) 2024-03-04T06:42:53.496 INFO:tasks.rados.rados.0.smithi137.stdout:273: done (1 left) 2024-03-04T06:42:53.496 INFO:tasks.rados.rados.0.smithi137.stdout:274: done (0 left) 2024-03-04T06:42:53.496 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 26 2024-03-04T06:42:53.496 INFO:tasks.rados.rados.0.smithi137.stdout:275: seq_num 105 ranges {2351104=565248,2916352=507904,3424256=507904,3932160=188416} 2024-03-04T06:42:53.511 INFO:tasks.rados.rados.0.smithi137.stdout:275: writing smithi13777483-20 from 2351104 to 2916352 tid 1 2024-03-04T06:42:53.514 INFO:tasks.rados.rados.0.smithi137.stdout:275: writing smithi13777483-20 from 2916352 to 3424256 tid 2 2024-03-04T06:42:53.516 INFO:tasks.rados.rados.0.smithi137.stdout:275: writing smithi13777483-20 from 3424256 to 3932160 tid 3 2024-03-04T06:42:53.518 INFO:tasks.rados.rados.0.smithi137.stdout:275: writing smithi13777483-20 from 3932160 to 4120576 tid 4 2024-03-04T06:42:53.518 INFO:tasks.rados.rados.0.smithi137.stdout:276: rollback oid 48 current snap is 26 2024-03-04T06:42:53.518 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 48 to 13 2024-03-04T06:42:53.518 INFO:tasks.rados.rados.0.smithi137.stdout:275: finishing write tid 1 to smithi13777483-20 2024-03-04T06:42:53.518 INFO:tasks.rados.rados.0.smithi137.stdout:275: finishing write tid 2 to smithi13777483-20 2024-03-04T06:42:53.518 INFO:tasks.rados.rados.0.smithi137.stdout:277: snap_create 2024-03-04T06:42:53.520 INFO:tasks.rados.rados.0.smithi137.stdout:275: finishing write tid 3 to smithi13777483-20 2024-03-04T06:42:53.520 INFO:tasks.rados.rados.0.smithi137.stdout:275: finishing write tid 4 to smithi13777483-20 2024-03-04T06:42:53.520 INFO:tasks.rados.rados.0.smithi137.stdout:276: finishing rollback tid 0 to smithi13777483-48 2024-03-04T06:42:53.521 INFO:tasks.rados.rados.0.smithi137.stdout:275: finishing write tid 5 to smithi13777483-20 2024-03-04T06:42:53.521 INFO:tasks.rados.rados.0.smithi137.stdout:276: finishing rollback tid 1 to smithi13777483-48 2024-03-04T06:42:53.521 INFO:tasks.rados.rados.0.smithi137.stdout:276: finishing rollback tid 2 to smithi13777483-48 2024-03-04T06:42:53.521 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 59 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-03-04T06:42:53.521 INFO:tasks.rados.rados.0.smithi137.stdout:275: finishing write tid 6 to smithi13777483-20 2024-03-04T06:42:53.522 INFO:tasks.rados.rados.0.smithi137.stdout:275: oid 20 updating version 0 to 77 2024-03-04T06:42:53.522 INFO:tasks.rados.rados.0.smithi137.stdout:275: oid 20 version 77 is already newer than 76 2024-03-04T06:42:53.522 INFO:tasks.rados.rados.0.smithi137.stdout:275: oid 20 updating version 77 to 78 2024-03-04T06:42:53.522 INFO:tasks.rados.rados.0.smithi137.stdout:275: oid 20 version 78 is already newer than 75 2024-03-04T06:42:53.522 INFO:tasks.rados.rados.0.smithi137.stdout:275: oid 20 updating version 78 to 79 2024-03-04T06:42:53.522 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 79 (ObjNum 105 snap 26 seq_num 105) dirty exists 2024-03-04T06:42:53.522 INFO:tasks.rados.rados.0.smithi137.stdout:275: left oid 20 (ObjNum 105 snap 26 seq_num 105) 2024-03-04T06:42:53.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:53 smithi137 ceph-mon[37364]: osdmap e116: 8 total, 8 up, 8 in 2024-03-04T06:42:53.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:53 smithi137 ceph-mon[37364]: pgmap v180: 121 pgs: 121 active+clean; 83 MiB data, 349 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-03-04T06:42:53.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:53 smithi137 ceph-mon[26846]: osdmap e116: 8 total, 8 up, 8 in 2024-03-04T06:42:53.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:53 smithi137 ceph-mon[26846]: pgmap v180: 121 pgs: 121 active+clean; 83 MiB data, 349 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-03-04T06:42:53.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:53 smithi203 ceph-mon[30756]: osdmap e116: 8 total, 8 up, 8 in 2024-03-04T06:42:53.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:53 smithi203 ceph-mon[30756]: pgmap v180: 121 pgs: 121 active+clean; 83 MiB data, 349 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-03-04T06:42:54.376 INFO:tasks.rados.rados.0.smithi137.stdout:275: done (2 left) 2024-03-04T06:42:54.376 INFO:tasks.rados.rados.0.smithi137.stdout:276: done (1 left) 2024-03-04T06:42:54.376 INFO:tasks.rados.rados.0.smithi137.stdout:277: done (0 left) 2024-03-04T06:42:54.376 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 27 2024-03-04T06:42:54.376 INFO:tasks.rados.rados.0.smithi137.stdout:278: seq_num 106 ranges {2867200=581632,3448832=794624,4243456=409600} 2024-03-04T06:42:54.393 INFO:tasks.rados.rados.0.smithi137.stdout:278: writing smithi13777483-18 from 2867200 to 3448832 tid 1 2024-03-04T06:42:54.398 INFO:tasks.rados.rados.0.smithi137.stdout:278: writing smithi13777483-18 from 3448832 to 4243456 tid 2 2024-03-04T06:42:54.401 INFO:tasks.rados.rados.0.smithi137.stdout:278: writing smithi13777483-18 from 4243456 to 4653056 tid 3 2024-03-04T06:42:54.401 INFO:tasks.rados.rados.0.smithi137.stdout:279: read oid 31 snap -1 2024-03-04T06:42:54.401 INFO:tasks.rados.rados.0.smithi137.stdout:279: expect deleted 2024-03-04T06:42:54.401 INFO:tasks.rados.rados.0.smithi137.stdout:280: read oid 5 snap -1 2024-03-04T06:42:54.401 INFO:tasks.rados.rados.0.smithi137.stdout:280: expect deleted 2024-03-04T06:42:54.401 INFO:tasks.rados.rados.0.smithi137.stdout:281: copy_from oid 21 from oid 32 current snap is 27 2024-03-04T06:42:54.401 INFO:tasks.rados.rados.0.smithi137.stdout:278: finishing write tid 1 to smithi13777483-18 2024-03-04T06:42:54.401 INFO:tasks.rados.rados.0.smithi137.stdout:282: snap_create 2024-03-04T06:42:54.403 INFO:tasks.rados.rados.0.smithi137.stdout:278: finishing write tid 2 to smithi13777483-18 2024-03-04T06:42:54.403 INFO:tasks.rados.rados.0.smithi137.stdout:278: finishing write tid 3 to smithi13777483-18 2024-03-04T06:42:54.403 INFO:tasks.rados.rados.0.smithi137.stdout:278: finishing write tid 4 to smithi13777483-18 2024-03-04T06:42:54.405 INFO:tasks.rados.rados.0.smithi137.stdout:278: finishing write tid 5 to smithi13777483-18 2024-03-04T06:42:54.405 INFO:tasks.rados.rados.0.smithi137.stdout:278: oid 18 updating version 0 to 92 2024-03-04T06:42:54.405 INFO:tasks.rados.rados.0.smithi137.stdout:278: oid 18 updating version 92 to 95 2024-03-04T06:42:54.405 INFO:tasks.rados.rados.0.smithi137.stdout:278: oid 18 version 95 is already newer than 94 2024-03-04T06:42:54.405 INFO:tasks.rados.rados.0.smithi137.stdout:278: oid 18 version 95 is already newer than 93 2024-03-04T06:42:54.405 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 95 (ObjNum 106 snap 27 seq_num 106) dirty exists 2024-03-04T06:42:54.405 INFO:tasks.rados.rados.0.smithi137.stdout:278: left oid 18 (ObjNum 106 snap 27 seq_num 106) 2024-03-04T06:42:54.415 INFO:tasks.rados.rados.0.smithi137.stdout:281: finishing copy_from racing read to smithi13777483-21 2024-03-04T06:42:54.416 INFO:tasks.rados.rados.0.smithi137.stdout:281: finishing copy_from to smithi13777483-21 2024-03-04T06:42:54.416 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 59 (ObjNum 96 snap 19 seq_num 96) dirty exists 2024-03-04T06:42:54.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:54 smithi137 ceph-mon[26846]: osdmap e117: 8 total, 8 up, 8 in 2024-03-04T06:42:54.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:54 smithi137 ceph-mon[37364]: osdmap e117: 8 total, 8 up, 8 in 2024-03-04T06:42:54.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:54 smithi203 ceph-mon[30756]: osdmap e117: 8 total, 8 up, 8 in 2024-03-04T06:42:55.357 INFO:tasks.rados.rados.0.smithi137.stdout:278: done (4 left) 2024-03-04T06:42:55.357 INFO:tasks.rados.rados.0.smithi137.stdout:279: done (3 left) 2024-03-04T06:42:55.357 INFO:tasks.rados.rados.0.smithi137.stdout:280: done (2 left) 2024-03-04T06:42:55.357 INFO:tasks.rados.rados.0.smithi137.stdout:281: done (1 left) 2024-03-04T06:42:55.357 INFO:tasks.rados.rados.0.smithi137.stdout:282: done (0 left) 2024-03-04T06:42:55.357 INFO:tasks.rados.rados.0.smithi137.stdout:283: read oid 41 snap -1 2024-03-04T06:42:55.358 INFO:tasks.rados.rados.0.smithi137.stdout:283: expect deleted 2024-03-04T06:42:55.358 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 28 2024-03-04T06:42:55.358 INFO:tasks.rados.rados.0.smithi137.stdout:284: seq_num 107 ranges {4202496=598016,4800512=729088,5529600=466944,5996544=8192} 2024-03-04T06:42:55.383 INFO:tasks.rados.rados.0.smithi137.stdout:284: writing smithi13777483-16 from 4202496 to 4800512 tid 1 2024-03-04T06:42:55.387 INFO:tasks.rados.rados.0.smithi137.stdout:284: writing smithi13777483-16 from 4800512 to 5529600 tid 2 2024-03-04T06:42:55.391 INFO:tasks.rados.rados.0.smithi137.stdout:284: writing smithi13777483-16 from 5529600 to 5996544 tid 3 2024-03-04T06:42:55.391 INFO:tasks.rados.rados.0.smithi137.stdout:284: writing smithi13777483-16 from 5996544 to 6004736 tid 4 2024-03-04T06:42:55.391 INFO:tasks.rados.rados.0.smithi137.stdout:285: setattr oid 13 current snap is 28 2024-03-04T06:42:55.391 INFO:tasks.rados.rados.0.smithi137.stdout:284: finishing write tid 1 to smithi13777483-16 2024-03-04T06:42:55.391 INFO:tasks.rados.rados.0.smithi137.stdout:284: finishing write tid 2 to smithi13777483-16 2024-03-04T06:42:55.393 INFO:tasks.rados.rados.0.smithi137.stdout:284: finishing write tid 3 to smithi13777483-16 2024-03-04T06:42:55.393 INFO:tasks.rados.rados.0.smithi137.stdout:284: finishing write tid 4 to smithi13777483-16 2024-03-04T06:42:55.393 INFO:tasks.rados.rados.0.smithi137.stdout:284: finishing write tid 5 to smithi13777483-16 2024-03-04T06:42:55.394 INFO:tasks.rados.rados.0.smithi137.stdout:283: done (2 left) 2024-03-04T06:42:55.394 INFO:tasks.rados.rados.0.smithi137.stdout:286: delete oid 37 current snap is 28 2024-03-04T06:42:55.395 INFO:tasks.rados.rados.0.smithi137.stdout:284: finishing write tid 6 to smithi13777483-16 2024-03-04T06:42:55.395 INFO:tasks.rados.rados.0.smithi137.stdout:284: oid 16 updating version 0 to 64 2024-03-04T06:42:55.395 INFO:tasks.rados.rados.0.smithi137.stdout:284: oid 16 version 64 is already newer than 61 2024-03-04T06:42:55.395 INFO:tasks.rados.rados.0.smithi137.stdout:284: oid 16 updating version 64 to 65 2024-03-04T06:42:55.395 INFO:tasks.rados.rados.0.smithi137.stdout:284: oid 16 version 65 is already newer than 62 2024-03-04T06:42:55.395 INFO:tasks.rados.rados.0.smithi137.stdout:284: oid 16 version 65 is already newer than 63 2024-03-04T06:42:55.395 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 65 (ObjNum 107 snap 28 seq_num 107) dirty exists 2024-03-04T06:42:55.395 INFO:tasks.rados.rados.0.smithi137.stdout:284: left oid 16 (ObjNum 107 snap 28 seq_num 107) 2024-03-04T06:42:55.397 INFO:tasks.rados.rados.0.smithi137.stdout:284: done (2 left) 2024-03-04T06:42:55.397 INFO:tasks.rados.rados.0.smithi137.stdout:286: done (1 left) 2024-03-04T06:42:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:287: read oid 21 snap -1 2024-03-04T06:42:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:287: expect (ObjNum 96 snap 19 seq_num 96) 2024-03-04T06:42:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:288: read oid 28 snap 23 2024-03-04T06:42:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:288: expect (ObjNum 50 snap 0 seq_num 50) 2024-03-04T06:42:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:289: delete oid 8 current snap is 28 2024-03-04T06:42:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 83 (ObjNum 86 snap 14 seq_num 86) dirty exists 2024-03-04T06:42:55.400 INFO:tasks.rados.rados.0.smithi137.stdout:285: done (3 left) 2024-03-04T06:42:55.400 INFO:tasks.rados.rados.0.smithi137.stdout:289: done (2 left) 2024-03-04T06:42:55.400 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 28 2024-03-04T06:42:55.400 INFO:tasks.rados.rados.0.smithi137.stdout:290: seq_num 110 ranges {73728=647168,720896=778240,1499136=425984} 2024-03-04T06:42:55.405 INFO:tasks.rados.rados.0.smithi137.stdout:290: writing smithi13777483-15 from 73728 to 720896 tid 1 2024-03-04T06:42:55.410 INFO:tasks.rados.rados.0.smithi137.stdout:290: writing smithi13777483-15 from 720896 to 1499136 tid 2 2024-03-04T06:42:55.412 INFO:tasks.rados.rados.0.smithi137.stdout:290: writing smithi13777483-15 from 1499136 to 1925120 tid 3 2024-03-04T06:42:55.412 INFO:tasks.rados.rados.0.smithi137.stdout:291: delete oid 26 current snap is 28 2024-03-04T06:42:55.412 INFO:tasks.rados.rados.0.smithi137.stdout:287: expect (ObjNum 96 snap 19 seq_num 96) 2024-03-04T06:42:55.475 INFO:tasks.rados.rados.0.smithi137.stdout:290: finishing write tid 1 to smithi13777483-15 2024-03-04T06:42:55.475 INFO:tasks.rados.rados.0.smithi137.stdout:288: expect (ObjNum 50 snap 0 seq_num 50) 2024-03-04T06:42:55.516 INFO:tasks.rados.rados.0.smithi137.stdout:290: finishing write tid 2 to smithi13777483-15 2024-03-04T06:42:55.516 INFO:tasks.rados.rados.0.smithi137.stdout:290: finishing write tid 3 to smithi13777483-15 2024-03-04T06:42:55.516 INFO:tasks.rados.rados.0.smithi137.stdout:290: finishing write tid 4 to smithi13777483-15 2024-03-04T06:42:55.517 INFO:tasks.rados.rados.0.smithi137.stdout:290: finishing write tid 5 to smithi13777483-15 2024-03-04T06:42:55.517 INFO:tasks.rados.rados.0.smithi137.stdout:290: oid 15 updating version 0 to 84 2024-03-04T06:42:55.517 INFO:tasks.rados.rados.0.smithi137.stdout:290: oid 15 version 84 is already newer than 82 2024-03-04T06:42:55.518 INFO:tasks.rados.rados.0.smithi137.stdout:290: oid 15 version 84 is already newer than 81 2024-03-04T06:42:55.518 INFO:tasks.rados.rados.0.smithi137.stdout:290: oid 15 version 84 is already newer than 83 2024-03-04T06:42:55.519 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 84 (ObjNum 110 snap 28 seq_num 110) dirty exists 2024-03-04T06:42:55.519 INFO:tasks.rados.rados.0.smithi137.stdout:290: left oid 15 (ObjNum 110 snap 28 seq_num 110) 2024-03-04T06:42:55.519 INFO:tasks.rados.rados.0.smithi137.stdout:287: done (3 left) 2024-03-04T06:42:55.519 INFO:tasks.rados.rados.0.smithi137.stdout:288: done (2 left) 2024-03-04T06:42:55.519 INFO:tasks.rados.rados.0.smithi137.stdout:290: done (1 left) 2024-03-04T06:42:55.519 INFO:tasks.rados.rados.0.smithi137.stdout:291: done (0 left) 2024-03-04T06:42:55.519 INFO:tasks.rados.rados.0.smithi137.stdout:292: copy_from oid 32 from oid 23 current snap is 28 2024-03-04T06:42:55.519 INFO:tasks.rados.rados.0.smithi137.stdout:293: read oid 7 snap -1 2024-03-04T06:42:55.519 INFO:tasks.rados.rados.0.smithi137.stdout:293: expect (ObjNum 6 snap 0 seq_num 6) 2024-03-04T06:42:55.519 INFO:tasks.rados.rados.0.smithi137.stdout:294: read oid 19 snap -1 2024-03-04T06:42:55.519 INFO:tasks.rados.rados.0.smithi137.stdout:294: expect (ObjNum 68 snap 5 seq_num 68) 2024-03-04T06:42:55.519 INFO:tasks.rados.rados.0.smithi137.stdout:295: copy_from oid 5 from oid 44 current snap is 28 2024-03-04T06:42:55.519 INFO:tasks.rados.rados.0.smithi137.stdout:296: rmattr oid 36 current snap is 28 2024-03-04T06:42:55.520 INFO:tasks.rados.rados.0.smithi137.stdout:296: done (4 left) 2024-03-04T06:42:55.520 INFO:tasks.rados.rados.0.smithi137.stdout:297: read oid 45 snap -1 2024-03-04T06:42:55.520 INFO:tasks.rados.rados.0.smithi137.stdout:297: expect (ObjNum 33 snap 0 seq_num 33) 2024-03-04T06:42:55.520 INFO:tasks.rados.rados.0.smithi137.stdout:298: setattr oid 29 current snap is 28 2024-03-04T06:42:55.520 INFO:tasks.rados.rados.0.smithi137.stdout:299: rollback oid 31 current snap is 28 2024-03-04T06:42:55.521 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 31 to 11 2024-03-04T06:42:55.521 INFO:tasks.rados.rados.0.smithi137.stdout:300: snap_create 2024-03-04T06:42:55.521 INFO:tasks.rados.rados.0.smithi137.stdout:297: expect (ObjNum 33 snap 0 seq_num 33) 2024-03-04T06:42:55.539 INFO:tasks.rados.rados.0.smithi137.stdout:293: expect (ObjNum 6 snap 0 seq_num 6) 2024-03-04T06:42:55.541 INFO:tasks.rados.rados.0.smithi137.stdout:299: finishing rollback tid 1 to smithi13777483-31 2024-03-04T06:42:55.542 INFO:tasks.rados.rados.0.smithi137.stdout:299: finishing rollback tid 2 to smithi13777483-31 2024-03-04T06:42:55.542 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 56 (ObjNum 70 snap 7 seq_num 70) dirty exists 2024-03-04T06:42:55.542 INFO:tasks.rados.rados.0.smithi137.stdout:294: expect (ObjNum 68 snap 5 seq_num 68) 2024-03-04T06:42:55.583 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 96 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-04T06:42:55.583 INFO:tasks.rados.rados.0.smithi137.stdout:295: finishing copy_from racing read to smithi13777483-5 2024-03-04T06:42:55.584 INFO:tasks.rados.rados.0.smithi137.stdout:295: finishing copy_from to smithi13777483-5 2024-03-04T06:42:55.584 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 47 (ObjNum 77 snap 10 seq_num 77) dirty exists 2024-03-04T06:42:55.584 INFO:tasks.rados.rados.0.smithi137.stdout:292: finishing copy_from racing read to smithi13777483-32 2024-03-04T06:42:55.584 INFO:tasks.rados.rados.0.smithi137.stdout:292: finishing copy_from to smithi13777483-32 2024-03-04T06:42:55.584 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 61 (ObjNum 104 snap 25 seq_num 104) dirty exists 2024-03-04T06:42:55.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:55 smithi137 ceph-mon[26846]: osdmap e118: 8 total, 8 up, 8 in 2024-03-04T06:42:55.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:55 smithi137 ceph-mon[26846]: pgmap v183: 121 pgs: 121 active+clean; 83 MiB data, 349 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-03-04T06:42:55.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:55 smithi137 ceph-mon[26846]: osdmap e119: 8 total, 8 up, 8 in 2024-03-04T06:42:55.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:42:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:42:55] "GET /metrics HTTP/1.1" 200 35997 "" "Prometheus/2.43.0" 2024-03-04T06:42:55.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:55 smithi137 ceph-mon[37364]: osdmap e118: 8 total, 8 up, 8 in 2024-03-04T06:42:55.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:55 smithi137 ceph-mon[37364]: pgmap v183: 121 pgs: 121 active+clean; 83 MiB data, 349 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-03-04T06:42:55.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:55 smithi137 ceph-mon[37364]: osdmap e119: 8 total, 8 up, 8 in 2024-03-04T06:42:55.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:55 smithi203 ceph-mon[30756]: osdmap e118: 8 total, 8 up, 8 in 2024-03-04T06:42:55.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:55 smithi203 ceph-mon[30756]: pgmap v183: 121 pgs: 121 active+clean; 83 MiB data, 349 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-03-04T06:42:55.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:55 smithi203 ceph-mon[30756]: osdmap e119: 8 total, 8 up, 8 in 2024-03-04T06:42:56.382 INFO:tasks.rados.rados.0.smithi137.stdout:292: done (7 left) 2024-03-04T06:42:56.382 INFO:tasks.rados.rados.0.smithi137.stdout:293: done (6 left) 2024-03-04T06:42:56.382 INFO:tasks.rados.rados.0.smithi137.stdout:294: done (5 left) 2024-03-04T06:42:56.382 INFO:tasks.rados.rados.0.smithi137.stdout:295: done (4 left) 2024-03-04T06:42:56.382 INFO:tasks.rados.rados.0.smithi137.stdout:297: done (3 left) 2024-03-04T06:42:56.382 INFO:tasks.rados.rados.0.smithi137.stdout:298: done (2 left) 2024-03-04T06:42:56.382 INFO:tasks.rados.rados.0.smithi137.stdout:299: done (1 left) 2024-03-04T06:42:56.382 INFO:tasks.rados.rados.0.smithi137.stdout:300: done (0 left) 2024-03-04T06:42:56.383 INFO:tasks.rados.rados.0.smithi137.stdout:301: rollback oid 50 current snap is 29 2024-03-04T06:42:56.383 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 50 to 27 2024-03-04T06:42:56.383 INFO:tasks.rados.rados.0.smithi137.stdout:302: rmattr oid 38 current snap is 29 2024-03-04T06:42:56.383 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 29 2024-03-04T06:42:56.383 INFO:tasks.rados.rados.0.smithi137.stdout:303: seq_num 112 ranges {2949120=679936,3629056=548864,4177920=655360} 2024-03-04T06:42:56.401 INFO:tasks.rados.rados.0.smithi137.stdout:303: writing smithi13777483-39 from 2949120 to 3629056 tid 1 2024-03-04T06:42:56.404 INFO:tasks.rados.rados.0.smithi137.stdout:303: writing smithi13777483-39 from 3629056 to 4177920 tid 2 2024-03-04T06:42:56.408 INFO:tasks.rados.rados.0.smithi137.stdout:303: writing smithi13777483-39 from 4177920 to 4833280 tid 3 2024-03-04T06:42:56.409 INFO:tasks.rados.rados.0.smithi137.stdout:304: copy_from oid 17 from oid 9 current snap is 29 2024-03-04T06:42:56.409 INFO:tasks.rados.rados.0.smithi137.stdout:301: finishing rollback tid 0 to smithi13777483-50 2024-03-04T06:42:56.409 INFO:tasks.rados.rados.0.smithi137.stdout:305: rmattr oid 13 current snap is 29 2024-03-04T06:42:56.409 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 93 (ObjNum 92 snap 14 seq_num 92) dirty exists 2024-03-04T06:42:56.409 INFO:tasks.rados.rados.0.smithi137.stdout:301: finishing rollback tid 1 to smithi13777483-50 2024-03-04T06:42:56.409 INFO:tasks.rados.rados.0.smithi137.stdout:301: finishing rollback tid 2 to smithi13777483-50 2024-03-04T06:42:56.409 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 89 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-03-04T06:42:56.409 INFO:tasks.rados.rados.0.smithi137.stdout:303: finishing write tid 1 to smithi13777483-39 2024-03-04T06:42:56.409 INFO:tasks.rados.rados.0.smithi137.stdout:303: finishing write tid 2 to smithi13777483-39 2024-03-04T06:42:56.409 INFO:tasks.rados.rados.0.smithi137.stdout:301: done (4 left) 2024-03-04T06:42:56.409 INFO:tasks.rados.rados.0.smithi137.stdout:302: done (3 left) 2024-03-04T06:42:56.409 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 29 2024-03-04T06:42:56.409 INFO:tasks.rados.rados.0.smithi137.stdout:306: seq_num 113 ranges {1302528=696320,1998848=434176,2433024=466944,2899968=303104} 2024-03-04T06:42:56.419 INFO:tasks.rados.rados.0.smithi137.stdout:306: writing smithi13777483-12 from 1302528 to 1998848 tid 1 2024-03-04T06:42:56.422 INFO:tasks.rados.rados.0.smithi137.stdout:306: writing smithi13777483-12 from 1998848 to 2433024 tid 2 2024-03-04T06:42:56.424 INFO:tasks.rados.rados.0.smithi137.stdout:306: writing smithi13777483-12 from 2433024 to 2899968 tid 3 2024-03-04T06:42:56.427 INFO:tasks.rados.rados.0.smithi137.stdout:306: writing smithi13777483-12 from 2899968 to 3203072 tid 4 2024-03-04T06:42:56.427 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 37 current snap is 29 2024-03-04T06:42:56.427 INFO:tasks.rados.rados.0.smithi137.stdout:303: finishing write tid 3 to smithi13777483-39 2024-03-04T06:42:56.427 INFO:tasks.rados.rados.0.smithi137.stdout:307: seq_num 114 ranges {0=712704,712704=712704,1425408=491520} 2024-03-04T06:42:56.431 INFO:tasks.rados.rados.0.smithi137.stdout:307: writing smithi13777483-37 from 0 to 712704 tid 1 2024-03-04T06:42:56.435 INFO:tasks.rados.rados.0.smithi137.stdout:307: writing smithi13777483-37 from 712704 to 1425408 tid 2 2024-03-04T06:42:56.439 INFO:tasks.rados.rados.0.smithi137.stdout:307: writing smithi13777483-37 from 1425408 to 1916928 tid 3 2024-03-04T06:42:56.439 INFO:tasks.rados.rados.0.smithi137.stdout:308: copy_from oid 44 from oid 7 current snap is 29 2024-03-04T06:42:56.439 INFO:tasks.rados.rados.0.smithi137.stdout:303: finishing write tid 4 to smithi13777483-39 2024-03-04T06:42:56.439 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 91 (ObjNum 86 snap 14 seq_num 86) dirty exists 2024-03-04T06:42:56.439 INFO:tasks.rados.rados.0.smithi137.stdout:304: finishing copy_from racing read to smithi13777483-17 2024-03-04T06:42:56.439 INFO:tasks.rados.rados.0.smithi137.stdout:304: finishing copy_from to smithi13777483-17 2024-03-04T06:42:56.439 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 100 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-03-04T06:42:56.439 INFO:tasks.rados.rados.0.smithi137.stdout:303: finishing write tid 5 to smithi13777483-39 2024-03-04T06:42:56.439 INFO:tasks.rados.rados.0.smithi137.stdout:303: oid 39 updating version 0 to 37 2024-03-04T06:42:56.439 INFO:tasks.rados.rados.0.smithi137.stdout:303: oid 39 version 37 is already newer than 36 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:303: oid 39 updating version 37 to 39 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:303: oid 39 version 39 is already newer than 38 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 39 (ObjNum 112 snap 29 seq_num 112) dirty exists 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:303: left oid 39 (ObjNum 112 snap 29 seq_num 112) 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:306: finishing write tid 1 to smithi13777483-12 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:306: finishing write tid 2 to smithi13777483-12 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:303: done (5 left) 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:304: done (4 left) 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:305: done (3 left) 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 29 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:306: finishing write tid 3 to smithi13777483-12 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:306: finishing write tid 4 to smithi13777483-12 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:306: finishing write tid 5 to smithi13777483-12 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:306: finishing write tid 6 to smithi13777483-12 2024-03-04T06:42:56.440 INFO:tasks.rados.rados.0.smithi137.stdout:306: oid 12 updating version 0 to 31 2024-03-04T06:42:56.441 INFO:tasks.rados.rados.0.smithi137.stdout:306: oid 12 version 31 is already newer than 29 2024-03-04T06:42:56.441 INFO:tasks.rados.rados.0.smithi137.stdout:306: oid 12 updating version 31 to 32 2024-03-04T06:42:56.441 INFO:tasks.rados.rados.0.smithi137.stdout:306: oid 12 updating version 32 to 33 2024-03-04T06:42:56.441 INFO:tasks.rados.rados.0.smithi137.stdout:306: oid 12 version 33 is already newer than 30 2024-03-04T06:42:56.441 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 33 (ObjNum 113 snap 29 seq_num 113) dirty exists 2024-03-04T06:42:56.441 INFO:tasks.rados.rados.0.smithi137.stdout:306: left oid 12 (ObjNum 113 snap 29 seq_num 113) 2024-03-04T06:42:56.441 INFO:tasks.rados.rados.0.smithi137.stdout:307: finishing write tid 1 to smithi13777483-37 2024-03-04T06:42:56.441 INFO:tasks.rados.rados.0.smithi137.stdout:307: finishing write tid 2 to smithi13777483-37 2024-03-04T06:42:56.441 INFO:tasks.rados.rados.0.smithi137.stdout:309: seq_num 115 ranges {3145728=729088,3874816=647168,4521984=434176,4956160=122880} 2024-03-04T06:42:56.459 INFO:tasks.rados.rados.0.smithi137.stdout:309: writing smithi13777483-3 from 3145728 to 3874816 tid 1 2024-03-04T06:42:56.463 INFO:tasks.rados.rados.0.smithi137.stdout:309: writing smithi13777483-3 from 3874816 to 4521984 tid 2 2024-03-04T06:42:56.465 INFO:tasks.rados.rados.0.smithi137.stdout:309: writing smithi13777483-3 from 4521984 to 4956160 tid 3 2024-03-04T06:42:56.466 INFO:tasks.rados.rados.0.smithi137.stdout:309: writing smithi13777483-3 from 4956160 to 5079040 tid 4 2024-03-04T06:42:56.466 INFO:tasks.rados.rados.0.smithi137.stdout:306: done (3 left) 2024-03-04T06:42:56.467 INFO:tasks.rados.rados.0.smithi137.stdout:310: snap_remove snap 14 2024-03-04T06:42:57.394 INFO:tasks.rados.rados.0.smithi137.stdout:310: done (3 left) 2024-03-04T06:42:57.394 INFO:tasks.rados.rados.0.smithi137.stdout:311: copy_from oid 15 from oid 42 current snap is 29 2024-03-04T06:42:57.395 INFO:tasks.rados.rados.0.smithi137.stdout:307: finishing write tid 3 to smithi13777483-37 2024-03-04T06:42:57.395 INFO:tasks.rados.rados.0.smithi137.stdout:308: finishing copy_from racing read to smithi13777483-44 2024-03-04T06:42:57.395 INFO:tasks.rados.rados.0.smithi137.stdout:307: finishing write tid 4 to smithi13777483-37 2024-03-04T06:42:57.395 INFO:tasks.rados.rados.0.smithi137.stdout:308: finishing copy_from to smithi13777483-44 2024-03-04T06:42:57.395 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-03-04T06:42:57.395 INFO:tasks.rados.rados.0.smithi137.stdout:307: finishing write tid 5 to smithi13777483-37 2024-03-04T06:42:57.395 INFO:tasks.rados.rados.0.smithi137.stdout:307: oid 37 updating version 0 to 85 2024-03-04T06:42:57.395 INFO:tasks.rados.rados.0.smithi137.stdout:307: oid 37 updating version 85 to 86 2024-03-04T06:42:57.395 INFO:tasks.rados.rados.0.smithi137.stdout:307: oid 37 updating version 86 to 87 2024-03-04T06:42:57.395 INFO:tasks.rados.rados.0.smithi137.stdout:307: oid 37 updating version 87 to 88 2024-03-04T06:42:57.395 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 88 (ObjNum 114 snap 29 seq_num 114) dirty exists 2024-03-04T06:42:57.395 INFO:tasks.rados.rados.0.smithi137.stdout:307: left oid 37 (ObjNum 114 snap 29 seq_num 114) 2024-03-04T06:42:57.395 INFO:tasks.rados.rados.0.smithi137.stdout:309: finishing write tid 1 to smithi13777483-3 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:309: finishing write tid 2 to smithi13777483-3 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:309: finishing write tid 3 to smithi13777483-3 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:309: finishing write tid 4 to smithi13777483-3 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:309: finishing write tid 5 to smithi13777483-3 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:309: finishing write tid 6 to smithi13777483-3 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:309: oid 3 updating version 0 to 115 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:309: oid 3 version 115 is already newer than 111 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:309: oid 3 version 115 is already newer than 114 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:309: oid 3 version 115 is already newer than 113 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:309: oid 3 version 115 is already newer than 112 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 115 (ObjNum 115 snap 29 seq_num 115) dirty exists 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:309: left oid 3 (ObjNum 115 snap 29 seq_num 115) 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:307: done (3 left) 2024-03-04T06:42:57.396 INFO:tasks.rados.rados.0.smithi137.stdout:308: done (2 left) 2024-03-04T06:42:57.397 INFO:tasks.rados.rados.0.smithi137.stdout:309: done (1 left) 2024-03-04T06:42:57.397 INFO:tasks.rados.rados.0.smithi137.stdout:312: copy_from oid 19 from oid 27 current snap is 29 2024-03-04T06:42:57.397 INFO:tasks.rados.rados.0.smithi137.stdout:313: snap_create 2024-03-04T06:42:57.402 INFO:tasks.rados.rados.0.smithi137.stdout:311: finishing copy_from racing read to smithi13777483-15 2024-03-04T06:42:57.403 INFO:tasks.rados.rados.0.smithi137.stdout:312: finishing copy_from racing read to smithi13777483-19 2024-03-04T06:42:57.404 INFO:tasks.rados.rados.0.smithi137.stdout:311: finishing copy_from to smithi13777483-15 2024-03-04T06:42:57.404 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 8 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-03-04T06:42:57.405 INFO:tasks.rados.rados.0.smithi137.stdout:312: finishing copy_from to smithi13777483-19 2024-03-04T06:42:57.405 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 63 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-03-04T06:42:57.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:57 smithi137 ceph-mon[37364]: osdmap e120: 8 total, 8 up, 8 in 2024-03-04T06:42:57.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:57 smithi137 ceph-mon[37364]: pgmap v186: 121 pgs: 121 active+clean; 98 MiB data, 367 MiB used, 715 GiB / 715 GiB avail; 6.4 MiB/s rd, 3.3 MiB/s wr, 24 op/s 2024-03-04T06:42:57.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:57 smithi137 ceph-mon[26846]: osdmap e120: 8 total, 8 up, 8 in 2024-03-04T06:42:57.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:57 smithi137 ceph-mon[26846]: pgmap v186: 121 pgs: 121 active+clean; 98 MiB data, 367 MiB used, 715 GiB / 715 GiB avail; 6.4 MiB/s rd, 3.3 MiB/s wr, 24 op/s 2024-03-04T06:42:57.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:57 smithi203 ceph-mon[30756]: osdmap e120: 8 total, 8 up, 8 in 2024-03-04T06:42:57.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:57 smithi203 ceph-mon[30756]: pgmap v186: 121 pgs: 121 active+clean; 98 MiB data, 367 MiB used, 715 GiB / 715 GiB avail; 6.4 MiB/s rd, 3.3 MiB/s wr, 24 op/s 2024-03-04T06:42:58.394 INFO:tasks.rados.rados.0.smithi137.stdout:311: done (2 left) 2024-03-04T06:42:58.395 INFO:tasks.rados.rados.0.smithi137.stdout:312: done (1 left) 2024-03-04T06:42:58.395 INFO:tasks.rados.rados.0.smithi137.stdout:313: done (0 left) 2024-03-04T06:42:58.395 INFO:tasks.rados.rados.0.smithi137.stdout:314: read oid 15 snap -1 2024-03-04T06:42:58.395 INFO:tasks.rados.rados.0.smithi137.stdout:314: expect (ObjNum 41 snap 0 seq_num 41) 2024-03-04T06:42:58.395 INFO:tasks.rados.rados.0.smithi137.stdout:315: copy_from oid 3 from oid 47 current snap is 30 2024-03-04T06:42:58.395 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 30 2024-03-04T06:42:58.395 INFO:tasks.rados.rados.0.smithi137.stdout:316: seq_num 116 ranges {1941504=745472,2686976=532480,3219456=638976,3858432=32768} 2024-03-04T06:42:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:316: writing smithi13777483-38 from 1941504 to 2686976 tid 1 2024-03-04T06:42:58.412 INFO:tasks.rados.rados.0.smithi137.stdout:316: writing smithi13777483-38 from 2686976 to 3219456 tid 2 2024-03-04T06:42:58.416 INFO:tasks.rados.rados.0.smithi137.stdout:316: writing smithi13777483-38 from 3219456 to 3858432 tid 3 2024-03-04T06:42:58.416 INFO:tasks.rados.rados.0.smithi137.stdout:316: writing smithi13777483-38 from 3858432 to 3891200 tid 4 2024-03-04T06:42:58.416 INFO:tasks.rados.rados.0.smithi137.stdout:317: read oid 39 snap -1 2024-03-04T06:42:58.416 INFO:tasks.rados.rados.0.smithi137.stdout:317: expect (ObjNum 112 snap 29 seq_num 112) 2024-03-04T06:42:58.417 INFO:tasks.rados.rados.0.smithi137.stdout:318: rmattr oid 46 current snap is 30 2024-03-04T06:42:58.417 INFO:tasks.rados.rados.0.smithi137.stdout:318: done (4 left) 2024-03-04T06:42:58.417 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 35 current snap is 30 2024-03-04T06:42:58.417 INFO:tasks.rados.rados.0.smithi137.stdout:319: seq_num 117 ranges {0=770048,770048=417792,1187840=442368,1630208=344064} 2024-03-04T06:42:58.420 INFO:tasks.rados.rados.0.smithi137.stdout:319: writing smithi13777483-35 from 0 to 770048 tid 1 2024-03-04T06:42:58.423 INFO:tasks.rados.rados.0.smithi137.stdout:319: writing smithi13777483-35 from 770048 to 1187840 tid 2 2024-03-04T06:42:58.425 INFO:tasks.rados.rados.0.smithi137.stdout:319: writing smithi13777483-35 from 1187840 to 1630208 tid 3 2024-03-04T06:42:58.428 INFO:tasks.rados.rados.0.smithi137.stdout:319: writing smithi13777483-35 from 1630208 to 1974272 tid 4 2024-03-04T06:42:58.428 INFO:tasks.rados.rados.0.smithi137.stdout:320: read oid 10 snap -1 2024-03-04T06:42:58.428 INFO:tasks.rados.rados.0.smithi137.stdout:320: expect (ObjNum 79 snap 11 seq_num 79) 2024-03-04T06:42:58.428 INFO:tasks.rados.rados.0.smithi137.stdout:321: copy_from oid 41 from oid 16 current snap is 30 2024-03-04T06:42:58.429 INFO:tasks.rados.rados.0.smithi137.stdout:314: expect (ObjNum 41 snap 0 seq_num 41) 2024-03-04T06:42:58.452 INFO:tasks.rados.rados.0.smithi137.stdout:315: finishing copy_from racing read to smithi13777483-3 2024-03-04T06:42:58.452 INFO:tasks.rados.rados.0.smithi137.stdout:315: finishing copy_from to smithi13777483-3 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 47 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:316: finishing write tid 1 to smithi13777483-38 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:316: finishing write tid 2 to smithi13777483-38 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:316: finishing write tid 3 to smithi13777483-38 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:314: done (6 left) 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:315: done (5 left) 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:322: read oid 2 snap -1 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:322: expect (ObjNum 93 snap 14 seq_num 93) 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:323: read oid 30 snap 18 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:323: expect (ObjNum 29 snap 0 seq_num 29) 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:324: read oid 23 snap -1 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:324: expect (ObjNum 104 snap 25 seq_num 104) 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:325: copy_from oid 18 from oid 13 current snap is 30 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:316: finishing write tid 4 to smithi13777483-38 2024-03-04T06:42:58.453 INFO:tasks.rados.rados.0.smithi137.stdout:316: finishing write tid 5 to smithi13777483-38 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:316: finishing write tid 6 to smithi13777483-38 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:316: oid 38 updating version 0 to 104 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:316: oid 38 updating version 104 to 105 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:316: oid 38 version 105 is already newer than 101 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:316: oid 38 version 105 is already newer than 103 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:316: oid 38 version 105 is already newer than 102 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 105 (ObjNum 116 snap 30 seq_num 116) dirty exists 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:316: left oid 38 (ObjNum 116 snap 30 seq_num 116) 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:319: finishing write tid 1 to smithi13777483-35 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:316: done (8 left) 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:326: snap_create 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:319: finishing write tid 2 to smithi13777483-35 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:319: finishing write tid 3 to smithi13777483-35 2024-03-04T06:42:58.454 INFO:tasks.rados.rados.0.smithi137.stdout:319: finishing write tid 4 to smithi13777483-35 2024-03-04T06:42:58.455 INFO:tasks.rados.rados.0.smithi137.stdout:319: finishing write tid 5 to smithi13777483-35 2024-03-04T06:42:58.455 INFO:tasks.rados.rados.0.smithi137.stdout:319: finishing write tid 6 to smithi13777483-35 2024-03-04T06:42:58.455 INFO:tasks.rados.rados.0.smithi137.stdout:319: oid 35 updating version 0 to 61 2024-03-04T06:42:58.455 INFO:tasks.rados.rados.0.smithi137.stdout:319: oid 35 version 61 is already newer than 59 2024-03-04T06:42:58.455 INFO:tasks.rados.rados.0.smithi137.stdout:319: oid 35 version 61 is already newer than 60 2024-03-04T06:42:58.455 INFO:tasks.rados.rados.0.smithi137.stdout:319: oid 35 updating version 61 to 63 2024-03-04T06:42:58.455 INFO:tasks.rados.rados.0.smithi137.stdout:319: oid 35 version 63 is already newer than 62 2024-03-04T06:42:58.455 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 63 (ObjNum 117 snap 30 seq_num 117) dirty exists 2024-03-04T06:42:58.455 INFO:tasks.rados.rados.0.smithi137.stdout:319: left oid 35 (ObjNum 117 snap 30 seq_num 117) 2024-03-04T06:42:58.455 INFO:tasks.rados.rados.0.smithi137.stdout:320: expect (ObjNum 79 snap 11 seq_num 79) 2024-03-04T06:42:58.564 INFO:tasks.rados.rados.0.smithi137.stdout:317: expect (ObjNum 112 snap 29 seq_num 112) 2024-03-04T06:42:58.747 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:58 smithi203 ceph-mon[30756]: osdmap e121: 8 total, 8 up, 8 in 2024-03-04T06:42:58.768 INFO:tasks.rados.rados.0.smithi137.stdout:323: expect (ObjNum 29 snap 0 seq_num 29) 2024-03-04T06:42:58.780 INFO:tasks.rados.rados.0.smithi137.stdout:321: finishing copy_from racing read to smithi13777483-41 2024-03-04T06:42:58.780 INFO:tasks.rados.rados.0.smithi137.stdout:325: finishing copy_from racing read to smithi13777483-18 2024-03-04T06:42:58.780 INFO:tasks.rados.rados.0.smithi137.stdout:321: finishing copy_from to smithi13777483-41 2024-03-04T06:42:58.780 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 65 (ObjNum 107 snap 28 seq_num 107) dirty exists 2024-03-04T06:42:58.780 INFO:tasks.rados.rados.0.smithi137.stdout:325: finishing copy_from to smithi13777483-18 2024-03-04T06:42:58.781 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 91 (ObjNum 86 snap 14 seq_num 86) dirty exists 2024-03-04T06:42:58.781 INFO:tasks.rados.rados.0.smithi137.stdout:324: expect (ObjNum 104 snap 25 seq_num 104) 2024-03-04T06:42:58.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:58 smithi137 ceph-mon[26846]: osdmap e121: 8 total, 8 up, 8 in 2024-03-04T06:42:58.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:58 smithi137 ceph-mon[37364]: osdmap e121: 8 total, 8 up, 8 in 2024-03-04T06:42:58.897 INFO:tasks.rados.rados.0.smithi137.stdout:322: expect (ObjNum 93 snap 14 seq_num 93) 2024-03-04T06:42:59.401 INFO:tasks.rados.rados.0.smithi137.stdout:317: done (8 left) 2024-03-04T06:42:59.401 INFO:tasks.rados.rados.0.smithi137.stdout:319: done (7 left) 2024-03-04T06:42:59.401 INFO:tasks.rados.rados.0.smithi137.stdout:320: done (6 left) 2024-03-04T06:42:59.401 INFO:tasks.rados.rados.0.smithi137.stdout:321: done (5 left) 2024-03-04T06:42:59.401 INFO:tasks.rados.rados.0.smithi137.stdout:322: done (4 left) 2024-03-04T06:42:59.401 INFO:tasks.rados.rados.0.smithi137.stdout:323: done (3 left) 2024-03-04T06:42:59.401 INFO:tasks.rados.rados.0.smithi137.stdout:324: done (2 left) 2024-03-04T06:42:59.401 INFO:tasks.rados.rados.0.smithi137.stdout:325: done (1 left) 2024-03-04T06:42:59.401 INFO:tasks.rados.rados.0.smithi137.stdout:326: done (0 left) 2024-03-04T06:42:59.401 INFO:tasks.rados.rados.0.smithi137.stdout:327: delete oid 32 current snap is 31 2024-03-04T06:42:59.404 INFO:tasks.rados.rados.0.smithi137.stdout:327: done (0 left) 2024-03-04T06:42:59.404 INFO:tasks.rados.rados.0.smithi137.stdout:328: delete oid 20 current snap is 31 2024-03-04T06:42:59.406 INFO:tasks.rados.rados.0.smithi137.stdout:328: done (0 left) 2024-03-04T06:42:59.406 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 31 2024-03-04T06:42:59.406 INFO:tasks.rados.rados.0.smithi137.stdout:329: seq_num 120 ranges {696320=417792,1114112=475136,1589248=622592,2211840=507904} 2024-03-04T06:42:59.412 INFO:tasks.rados.rados.0.smithi137.stdout:329: writing smithi13777483-42 from 696320 to 1114112 tid 1 2024-03-04T06:42:59.414 INFO:tasks.rados.rados.0.smithi137.stdout:329: writing smithi13777483-42 from 1114112 to 1589248 tid 2 2024-03-04T06:42:59.418 INFO:tasks.rados.rados.0.smithi137.stdout:329: writing smithi13777483-42 from 1589248 to 2211840 tid 3 2024-03-04T06:42:59.421 INFO:tasks.rados.rados.0.smithi137.stdout:329: writing smithi13777483-42 from 2211840 to 2719744 tid 4 2024-03-04T06:42:59.421 INFO:tasks.rados.rados.0.smithi137.stdout:330: snap_create 2024-03-04T06:42:59.421 INFO:tasks.rados.rados.0.smithi137.stdout:329: finishing write tid 1 to smithi13777483-42 2024-03-04T06:42:59.422 INFO:tasks.rados.rados.0.smithi137.stdout:329: finishing write tid 2 to smithi13777483-42 2024-03-04T06:42:59.422 INFO:tasks.rados.rados.0.smithi137.stdout:329: finishing write tid 3 to smithi13777483-42 2024-03-04T06:42:59.423 INFO:tasks.rados.rados.0.smithi137.stdout:329: finishing write tid 4 to smithi13777483-42 2024-03-04T06:42:59.423 INFO:tasks.rados.rados.0.smithi137.stdout:329: finishing write tid 5 to smithi13777483-42 2024-03-04T06:42:59.424 INFO:tasks.rados.rados.0.smithi137.stdout:329: finishing write tid 6 to smithi13777483-42 2024-03-04T06:42:59.424 INFO:tasks.rados.rados.0.smithi137.stdout:329: oid 42 updating version 0 to 106 2024-03-04T06:42:59.424 INFO:tasks.rados.rados.0.smithi137.stdout:329: oid 42 version 106 is already newer than 104 2024-03-04T06:42:59.424 INFO:tasks.rados.rados.0.smithi137.stdout:329: oid 42 version 106 is already newer than 105 2024-03-04T06:42:59.424 INFO:tasks.rados.rados.0.smithi137.stdout:329: oid 42 updating version 106 to 107 2024-03-04T06:42:59.424 INFO:tasks.rados.rados.0.smithi137.stdout:329: oid 42 version 107 is already newer than 103 2024-03-04T06:42:59.425 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 107 (ObjNum 120 snap 31 seq_num 120) dirty exists 2024-03-04T06:42:59.425 INFO:tasks.rados.rados.0.smithi137.stdout:329: left oid 42 (ObjNum 120 snap 31 seq_num 120) 2024-03-04T06:42:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:59 smithi203 ceph-mon[30756]: osdmap e122: 8 total, 8 up, 8 in 2024-03-04T06:42:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:42:59 smithi203 ceph-mon[30756]: pgmap v189: 121 pgs: 121 active+clean; 98 MiB data, 367 MiB used, 715 GiB / 715 GiB avail; 6.4 MiB/s rd, 3.3 MiB/s wr, 24 op/s 2024-03-04T06:42:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:59 smithi137 ceph-mon[26846]: osdmap e122: 8 total, 8 up, 8 in 2024-03-04T06:42:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:42:59 smithi137 ceph-mon[26846]: pgmap v189: 121 pgs: 121 active+clean; 98 MiB data, 367 MiB used, 715 GiB / 715 GiB avail; 6.4 MiB/s rd, 3.3 MiB/s wr, 24 op/s 2024-03-04T06:42:59.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:59 smithi137 ceph-mon[37364]: osdmap e122: 8 total, 8 up, 8 in 2024-03-04T06:42:59.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:42:59 smithi137 ceph-mon[37364]: pgmap v189: 121 pgs: 121 active+clean; 98 MiB data, 367 MiB used, 715 GiB / 715 GiB avail; 6.4 MiB/s rd, 3.3 MiB/s wr, 24 op/s 2024-03-04T06:43:00.358 INFO:tasks.rados.rados.0.smithi137.stdout:329: done (1 left) 2024-03-04T06:43:00.359 INFO:tasks.rados.rados.0.smithi137.stdout:330: done (0 left) 2024-03-04T06:43:00.359 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 5 current snap is 32 2024-03-04T06:43:00.359 INFO:tasks.rados.rados.0.smithi137.stdout:331: seq_num 121 ranges {1294336=434176,1728512=753664,2482176=425984,2908160=425984} 2024-03-04T06:43:00.367 INFO:tasks.rados.rados.0.smithi137.stdout:331: writing smithi13777483-5 from 1294336 to 1728512 tid 1 2024-03-04T06:43:00.372 INFO:tasks.rados.rados.0.smithi137.stdout:331: writing smithi13777483-5 from 1728512 to 2482176 tid 2 2024-03-04T06:43:00.375 INFO:tasks.rados.rados.0.smithi137.stdout:331: writing smithi13777483-5 from 2482176 to 2908160 tid 3 2024-03-04T06:43:00.378 INFO:tasks.rados.rados.0.smithi137.stdout:331: writing smithi13777483-5 from 2908160 to 3334144 tid 4 2024-03-04T06:43:00.378 INFO:tasks.rados.rados.0.smithi137.stdout:332: rollback oid 31 current snap is 32 2024-03-04T06:43:00.378 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 31 to 30 2024-03-04T06:43:00.379 INFO:tasks.rados.rados.0.smithi137.stdout:331: finishing write tid 1 to smithi13777483-5 2024-03-04T06:43:00.379 INFO:tasks.rados.rados.0.smithi137.stdout:331: finishing write tid 2 to smithi13777483-5 2024-03-04T06:43:00.379 INFO:tasks.rados.rados.0.smithi137.stdout:331: finishing write tid 3 to smithi13777483-5 2024-03-04T06:43:00.379 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 32 2024-03-04T06:43:00.379 INFO:tasks.rados.rados.0.smithi137.stdout:333: seq_num 122 ranges {1875968=450560,2326528=688128,3014656=630784,3645440=286720} 2024-03-04T06:43:00.391 INFO:tasks.rados.rados.0.smithi137.stdout:333: writing smithi13777483-49 from 1875968 to 2326528 tid 1 2024-03-04T06:43:00.395 INFO:tasks.rados.rados.0.smithi137.stdout:333: writing smithi13777483-49 from 2326528 to 3014656 tid 2 2024-03-04T06:43:00.399 INFO:tasks.rados.rados.0.smithi137.stdout:333: writing smithi13777483-49 from 3014656 to 3645440 tid 3 2024-03-04T06:43:00.401 INFO:tasks.rados.rados.0.smithi137.stdout:333: writing smithi13777483-49 from 3645440 to 3932160 tid 4 2024-03-04T06:43:00.401 INFO:tasks.rados.rados.0.smithi137.stdout:334: rmattr oid 41 current snap is 32 2024-03-04T06:43:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:334: done (3 left) 2024-03-04T06:43:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:331: finishing write tid 4 to smithi13777483-5 2024-03-04T06:43:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:335: read oid 7 snap -1 2024-03-04T06:43:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:335: expect (ObjNum 6 snap 0 seq_num 6) 2024-03-04T06:43:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:336: snap_create 2024-03-04T06:43:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:331: finishing write tid 5 to smithi13777483-5 2024-03-04T06:43:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:331: finishing write tid 6 to smithi13777483-5 2024-03-04T06:43:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:331: oid 5 updating version 0 to 128 2024-03-04T06:43:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:331: oid 5 updating version 128 to 129 2024-03-04T06:43:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:331: oid 5 version 129 is already newer than 125 2024-03-04T06:43:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:331: oid 5 version 129 is already newer than 127 2024-03-04T06:43:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:331: oid 5 version 129 is already newer than 126 2024-03-04T06:43:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 129 (ObjNum 121 snap 32 seq_num 121) dirty exists 2024-03-04T06:43:00.403 INFO:tasks.rados.rados.0.smithi137.stdout:331: left oid 5 (ObjNum 121 snap 32 seq_num 121) 2024-03-04T06:43:00.403 INFO:tasks.rados.rados.0.smithi137.stdout:332: finishing rollback tid 0 to smithi13777483-31 2024-03-04T06:43:00.403 INFO:tasks.rados.rados.0.smithi137.stdout:332: finishing rollback tid 1 to smithi13777483-31 2024-03-04T06:43:00.403 INFO:tasks.rados.rados.0.smithi137.stdout:332: finishing rollback tid 2 to smithi13777483-31 2024-03-04T06:43:00.403 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 67 (ObjNum 70 snap 7 seq_num 70) dirty exists 2024-03-04T06:43:00.403 INFO:tasks.rados.rados.0.smithi137.stdout:333: finishing write tid 1 to smithi13777483-49 2024-03-04T06:43:00.403 INFO:tasks.rados.rados.0.smithi137.stdout:333: finishing write tid 2 to smithi13777483-49 2024-03-04T06:43:00.404 INFO:tasks.rados.rados.0.smithi137.stdout:333: finishing write tid 3 to smithi13777483-49 2024-03-04T06:43:00.404 INFO:tasks.rados.rados.0.smithi137.stdout:333: finishing write tid 4 to smithi13777483-49 2024-03-04T06:43:00.404 INFO:tasks.rados.rados.0.smithi137.stdout:333: finishing write tid 5 to smithi13777483-49 2024-03-04T06:43:00.404 INFO:tasks.rados.rados.0.smithi137.stdout:333: finishing write tid 6 to smithi13777483-49 2024-03-04T06:43:00.404 INFO:tasks.rados.rados.0.smithi137.stdout:333: oid 49 updating version 0 to 71 2024-03-04T06:43:00.404 INFO:tasks.rados.rados.0.smithi137.stdout:333: oid 49 version 71 is already newer than 70 2024-03-04T06:43:00.404 INFO:tasks.rados.rados.0.smithi137.stdout:333: oid 49 version 71 is already newer than 69 2024-03-04T06:43:00.404 INFO:tasks.rados.rados.0.smithi137.stdout:333: oid 49 updating version 71 to 72 2024-03-04T06:43:00.404 INFO:tasks.rados.rados.0.smithi137.stdout:333: oid 49 updating version 72 to 73 2024-03-04T06:43:00.405 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 73 (ObjNum 122 snap 32 seq_num 122) dirty exists 2024-03-04T06:43:00.405 INFO:tasks.rados.rados.0.smithi137.stdout:333: left oid 49 (ObjNum 122 snap 32 seq_num 122) 2024-03-04T06:43:00.405 INFO:tasks.rados.rados.0.smithi137.stdout:335: expect (ObjNum 6 snap 0 seq_num 6) 2024-03-04T06:43:00.701 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:00 smithi203 ceph-mon[30756]: osdmap e123: 8 total, 8 up, 8 in 2024-03-04T06:43:00.701 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:00 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:00.701 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:00 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:00.701 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:00 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:43:00.701 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:00 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:43:00.701 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:00 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:43:00.701 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:00 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:00.702 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:00 smithi203 ceph-mon[30756]: osdmap e124: 8 total, 8 up, 8 in 2024-03-04T06:43:00.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[26846]: osdmap e123: 8 total, 8 up, 8 in 2024-03-04T06:43:00.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:00.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:00.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:43:00.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:43:00.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:43:00.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[26846]: osdmap e124: 8 total, 8 up, 8 in 2024-03-04T06:43:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[37364]: osdmap e123: 8 total, 8 up, 8 in 2024-03-04T06:43:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:43:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:43:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:43:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:00 smithi137 ceph-mon[37364]: osdmap e124: 8 total, 8 up, 8 in 2024-03-04T06:43:01.406 INFO:tasks.rados.rados.0.smithi137.stdout:331: done (4 left) 2024-03-04T06:43:01.406 INFO:tasks.rados.rados.0.smithi137.stdout:332: done (3 left) 2024-03-04T06:43:01.406 INFO:tasks.rados.rados.0.smithi137.stdout:333: done (2 left) 2024-03-04T06:43:01.406 INFO:tasks.rados.rados.0.smithi137.stdout:335: done (1 left) 2024-03-04T06:43:01.406 INFO:tasks.rados.rados.0.smithi137.stdout:336: done (0 left) 2024-03-04T06:43:01.406 INFO:tasks.rados.rados.0.smithi137.stdout:337: delete oid 49 current snap is 33 2024-03-04T06:43:01.410 INFO:tasks.rados.rados.0.smithi137.stdout:337: done (0 left) 2024-03-04T06:43:01.410 INFO:tasks.rados.rados.0.smithi137.stdout:338: rollback oid 18 current snap is 33 2024-03-04T06:43:01.410 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 18 to 21 2024-03-04T06:43:01.410 INFO:tasks.rados.rados.0.smithi137.stdout:339: snap_create 2024-03-04T06:43:01.413 INFO:tasks.rados.rados.0.smithi137.stdout:338: finishing rollback tid 0 to smithi13777483-18 2024-03-04T06:43:01.413 INFO:tasks.rados.rados.0.smithi137.stdout:338: finishing rollback tid 1 to smithi13777483-18 2024-03-04T06:43:01.413 INFO:tasks.rados.rados.0.smithi137.stdout:338: finishing rollback tid 2 to smithi13777483-18 2024-03-04T06:43:01.414 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 99 (ObjNum 102 snap 21 seq_num 102) dirty exists 2024-03-04T06:43:01.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:01 smithi137 ceph-mon[26846]: Upgrade: Updating mgr.x 2024-03-04T06:43:01.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:01 smithi137 ceph-mon[26846]: Deploying daemon mgr.x on smithi203 2024-03-04T06:43:01.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:01 smithi137 ceph-mon[26846]: pgmap v192: 121 pgs: 121 active+clean; 98 MiB data, 367 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:01 smithi137 ceph-mon[37364]: Upgrade: Updating mgr.x 2024-03-04T06:43:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:01 smithi137 ceph-mon[37364]: Deploying daemon mgr.x on smithi203 2024-03-04T06:43:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:01 smithi137 ceph-mon[37364]: pgmap v192: 121 pgs: 121 active+clean; 98 MiB data, 367 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:01.827 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:01 smithi203 ceph-mon[30756]: Upgrade: Updating mgr.x 2024-03-04T06:43:01.827 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:01 smithi203 ceph-mon[30756]: Deploying daemon mgr.x on smithi203 2024-03-04T06:43:01.827 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:01 smithi203 ceph-mon[30756]: pgmap v192: 121 pgs: 121 active+clean; 98 MiB data, 367 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:02.095 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:01 smithi203 systemd[1]: Stopping Ceph mgr.x for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:43:02.403 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:02 smithi203 podman[64702]: 2024-03-04 06:43:02.128842349 +0000 UTC m=+0.156577420 container died 994a02c2e1ef0687a0e4a93f5549c6833b3257e9d97767c548b674ef9b11920b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=reef-5cc7a76) 2024-03-04T06:43:02.412 INFO:tasks.rados.rados.0.smithi137.stdout:338: done (1 left) 2024-03-04T06:43:02.412 INFO:tasks.rados.rados.0.smithi137.stdout:339: done (0 left) 2024-03-04T06:43:02.412 INFO:tasks.rados.rados.0.smithi137.stdout:340: rollback oid 41 current snap is 34 2024-03-04T06:43:02.412 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 41 to 20 2024-03-04T06:43:02.412 INFO:tasks.rados.rados.0.smithi137.stdout:341: rollback oid 18 current snap is 34 2024-03-04T06:43:02.412 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 18 to 21 2024-03-04T06:43:02.412 INFO:tasks.rados.rados.0.smithi137.stdout:342: rmattr oid 23 current snap is 34 2024-03-04T06:43:02.412 INFO:tasks.rados.rados.0.smithi137.stdout:342: done (2 left) 2024-03-04T06:43:02.413 INFO:tasks.rados.rados.0.smithi137.stdout:343: copy_from oid 43 from oid 10 current snap is 34 2024-03-04T06:43:02.413 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 34 2024-03-04T06:43:02.413 INFO:tasks.rados.rados.0.smithi137.stdout:344: seq_num 124 ranges {442368=483328,925696=458752,1384448=598016,1982464=548864} 2024-03-04T06:43:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:344: writing smithi13777483-19 from 442368 to 925696 tid 1 2024-03-04T06:43:02.419 INFO:tasks.rados.rados.0.smithi137.stdout:344: writing smithi13777483-19 from 925696 to 1384448 tid 2 2024-03-04T06:43:02.423 INFO:tasks.rados.rados.0.smithi137.stdout:344: writing smithi13777483-19 from 1384448 to 1982464 tid 3 2024-03-04T06:43:02.427 INFO:tasks.rados.rados.0.smithi137.stdout:344: writing smithi13777483-19 from 1982464 to 2531328 tid 4 2024-03-04T06:43:02.427 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 34 2024-03-04T06:43:02.427 INFO:tasks.rados.rados.0.smithi137.stdout:341: finishing rollback tid 0 to smithi13777483-18 2024-03-04T06:43:02.427 INFO:tasks.rados.rados.0.smithi137.stdout:345: seq_num 125 ranges {2867200=499712,3366912=745472,4112384=409600,4521984=450560} 2024-03-04T06:43:02.445 INFO:tasks.rados.rados.0.smithi137.stdout:345: writing smithi13777483-13 from 2867200 to 3366912 tid 1 2024-03-04T06:43:02.449 INFO:tasks.rados.rados.0.smithi137.stdout:345: writing smithi13777483-13 from 3366912 to 4112384 tid 2 2024-03-04T06:43:02.451 INFO:tasks.rados.rados.0.smithi137.stdout:345: writing smithi13777483-13 from 4112384 to 4521984 tid 3 2024-03-04T06:43:02.455 INFO:tasks.rados.rados.0.smithi137.stdout:345: writing smithi13777483-13 from 4521984 to 4972544 tid 4 2024-03-04T06:43:02.455 INFO:tasks.rados.rados.0.smithi137.stdout:346: setattr oid 26 current snap is 34 2024-03-04T06:43:02.455 INFO:tasks.rados.rados.0.smithi137.stdout:341: finishing rollback tid 1 to smithi13777483-18 2024-03-04T06:43:02.455 INFO:tasks.rados.rados.0.smithi137.stdout:341: finishing rollback tid 2 to smithi13777483-18 2024-03-04T06:43:02.455 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 102 (ObjNum 102 snap 21 seq_num 102) dirty exists 2024-03-04T06:43:02.455 INFO:tasks.rados.rados.0.smithi137.stdout:340: finishing rollback tid 0 to smithi13777483-41 2024-03-04T06:43:02.455 INFO:tasks.rados.rados.0.smithi137.stdout:340: finishing rollback tid 1 to smithi13777483-41 2024-03-04T06:43:02.455 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 67 (ObjNum 177 snap 0 seq_num 3130917984) dirty dne 2024-03-04T06:43:02.455 INFO:tasks.rados.rados.0.smithi137.stdout:344: finishing write tid 1 to smithi13777483-19 2024-03-04T06:43:02.455 INFO:tasks.rados.rados.0.smithi137.stdout:344: finishing write tid 2 to smithi13777483-19 2024-03-04T06:43:02.456 INFO:tasks.rados.rados.0.smithi137.stdout:343: finishing copy_from racing read to smithi13777483-43 2024-03-04T06:43:02.456 INFO:tasks.rados.rados.0.smithi137.stdout:344: finishing write tid 3 to smithi13777483-19 2024-03-04T06:43:02.456 INFO:tasks.rados.rados.0.smithi137.stdout:344: finishing write tid 4 to smithi13777483-19 2024-03-04T06:43:02.456 INFO:tasks.rados.rados.0.smithi137.stdout:343: finishing copy_from to smithi13777483-43 2024-03-04T06:43:02.456 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 66 (ObjNum 79 snap 11 seq_num 79) dirty exists 2024-03-04T06:43:02.456 INFO:tasks.rados.rados.0.smithi137.stdout:344: finishing write tid 5 to smithi13777483-19 2024-03-04T06:43:02.456 INFO:tasks.rados.rados.0.smithi137.stdout:344: finishing write tid 6 to smithi13777483-19 2024-03-04T06:43:02.456 INFO:tasks.rados.rados.0.smithi137.stdout:344: oid 19 updating version 0 to 135 2024-03-04T06:43:02.456 INFO:tasks.rados.rados.0.smithi137.stdout:344: oid 19 version 135 is already newer than 131 2024-03-04T06:43:02.456 INFO:tasks.rados.rados.0.smithi137.stdout:344: oid 19 version 135 is already newer than 132 2024-03-04T06:43:02.456 INFO:tasks.rados.rados.0.smithi137.stdout:344: oid 19 version 135 is already newer than 133 2024-03-04T06:43:02.456 INFO:tasks.rados.rados.0.smithi137.stdout:344: oid 19 version 135 is already newer than 134 2024-03-04T06:43:02.457 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 135 (ObjNum 124 snap 34 seq_num 124) dirty exists 2024-03-04T06:43:02.457 INFO:tasks.rados.rados.0.smithi137.stdout:344: left oid 19 (ObjNum 124 snap 34 seq_num 124) 2024-03-04T06:43:02.457 INFO:tasks.rados.rados.0.smithi137.stdout:345: finishing write tid 1 to smithi13777483-13 2024-03-04T06:43:02.457 INFO:tasks.rados.rados.0.smithi137.stdout:345: finishing write tid 2 to smithi13777483-13 2024-03-04T06:43:02.457 INFO:tasks.rados.rados.0.smithi137.stdout:345: finishing write tid 3 to smithi13777483-13 2024-03-04T06:43:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:340: done (5 left) 2024-03-04T06:43:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:341: done (4 left) 2024-03-04T06:43:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:343: done (3 left) 2024-03-04T06:43:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:344: done (2 left) 2024-03-04T06:43:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:347: snap_create 2024-03-04T06:43:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:345: finishing write tid 4 to smithi13777483-13 2024-03-04T06:43:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:345: finishing write tid 5 to smithi13777483-13 2024-03-04T06:43:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:345: finishing write tid 6 to smithi13777483-13 2024-03-04T06:43:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:345: oid 13 updating version 0 to 109 2024-03-04T06:43:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:345: oid 13 updating version 109 to 112 2024-03-04T06:43:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:345: oid 13 version 112 is already newer than 110 2024-03-04T06:43:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:345: oid 13 updating version 112 to 113 2024-03-04T06:43:02.459 INFO:tasks.rados.rados.0.smithi137.stdout:345: oid 13 version 113 is already newer than 111 2024-03-04T06:43:02.459 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 113 (ObjNum 125 snap 34 seq_num 125) dirty exists 2024-03-04T06:43:02.459 INFO:tasks.rados.rados.0.smithi137.stdout:345: left oid 13 (ObjNum 125 snap 34 seq_num 125) 2024-03-04T06:43:02.459 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 103 (ObjNum 689 snap 0 seq_num 3130782960) dirty exists 2024-03-04T06:43:02.757 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:02 smithi203 ceph-mon[30756]: osdmap e125: 8 total, 8 up, 8 in 2024-03-04T06:43:02.758 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:02 smithi203 podman[64702]: 2024-03-04 06:43:02.53969436 +0000 UTC m=+0.567429425 container cleanup 994a02c2e1ef0687a0e4a93f5549c6833b3257e9d97767c548b674ef9b11920b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_CLEAN=True, RELEASE=reef-5cc7a76, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-04T06:43:02.758 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:02 smithi203 bash[64702]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x 2024-03-04T06:43:02.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:02 smithi137 ceph-mon[26846]: osdmap e125: 8 total, 8 up, 8 in 2024-03-04T06:43:02.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:02 smithi137 ceph-mon[37364]: osdmap e125: 8 total, 8 up, 8 in 2024-03-04T06:43:03.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:02 smithi203 podman[64715]: 2024-03-04 06:43:02.758169418 +0000 UTC m=+0.633484735 container remove 994a02c2e1ef0687a0e4a93f5549c6833b3257e9d97767c548b674ef9b11920b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=reef-5cc7a76, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-03-04T06:43:03.097 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:02 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-03-04T06:43:03.097 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:02 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-03-04T06:43:03.097 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:02 smithi203 systemd[1]: Stopped Ceph mgr.x for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:43:03.097 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:02 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.x.service: Consumed 18.680s CPU time. 2024-03-04T06:43:03.419 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:03 smithi203 systemd[1]: Starting Ceph mgr.x for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:43:03.419 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:03 smithi203 podman[64847]: 2024-03-04 06:43:03.271021649 +0000 UTC m=+0.019153128 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:43:03.419 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:03 smithi203 podman[64847]: 2024-03-04 06:43:03.392760731 +0000 UTC m=+0.140892246 container create 8fd5e9ed1e809d346c935ac9af204f01e6734dd562603bb7c3417c2510aae936 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-04T06:43:03.419 INFO:tasks.rados.rados.0.smithi137.stdout:345: done (2 left) 2024-03-04T06:43:03.420 INFO:tasks.rados.rados.0.smithi137.stdout:346: done (1 left) 2024-03-04T06:43:03.420 INFO:tasks.rados.rados.0.smithi137.stdout:347: done (0 left) 2024-03-04T06:43:03.420 INFO:tasks.rados.rados.0.smithi137.stdout:348: copy_from oid 34 from oid 46 current snap is 35 2024-03-04T06:43:03.420 INFO:tasks.rados.rados.0.smithi137.stdout:349: snap_remove snap 28 2024-03-04T06:43:03.712 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:03 smithi203 ceph-mon[30756]: osdmap e126: 8 total, 8 up, 8 in 2024-03-04T06:43:03.712 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:03 smithi203 ceph-mon[30756]: pgmap v195: 121 pgs: 121 active+clean; 123 MiB data, 416 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 7.0 MiB/s wr, 31 op/s 2024-03-04T06:43:03.712 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:03 smithi203 podman[64847]: 2024-03-04 06:43:03.63751924 +0000 UTC m=+0.385650726 container init 8fd5e9ed1e809d346c935ac9af204f01e6734dd562603bb7c3417c2510aae936 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:43:03.712 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:03 smithi203 podman[64847]: 2024-03-04 06:43:03.640124942 +0000 UTC m=+0.388256414 container start 8fd5e9ed1e809d346c935ac9af204f01e6734dd562603bb7c3417c2510aae936 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-03-04T06:43:03.712 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:03 smithi203 ceph-mgr[64867]: -- 172.21.15.203:0/584437627 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e5621d85a0 con 0x55e5621ad000 2024-03-04T06:43:03.793 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:43:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[73354]: ts=2024-03-04T06:43:03.513Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T06:43:03.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:03 smithi137 ceph-mon[26846]: osdmap e126: 8 total, 8 up, 8 in 2024-03-04T06:43:03.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:03 smithi137 ceph-mon[26846]: pgmap v195: 121 pgs: 121 active+clean; 123 MiB data, 416 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 7.0 MiB/s wr, 31 op/s 2024-03-04T06:43:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:03 smithi137 ceph-mon[37364]: osdmap e126: 8 total, 8 up, 8 in 2024-03-04T06:43:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:03 smithi137 ceph-mon[37364]: pgmap v195: 121 pgs: 121 active+clean; 123 MiB data, 416 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 7.0 MiB/s wr, 31 op/s 2024-03-04T06:43:04.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:03 smithi203 bash[64847]: 8fd5e9ed1e809d346c935ac9af204f01e6734dd562603bb7c3417c2510aae936 2024-03-04T06:43:04.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:03 smithi203 systemd[1]: Started Ceph mgr.x for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:43:04.424 INFO:tasks.rados.rados.0.smithi137.stdout:349: done (1 left) 2024-03-04T06:43:04.424 INFO:tasks.rados.rados.0.smithi137.stdout:350: rollback oid 45 current snap is 35 2024-03-04T06:43:04.424 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 45 to 13 2024-03-04T06:43:04.425 INFO:tasks.rados.rados.0.smithi137.stdout:351: read oid 20 snap -1 2024-03-04T06:43:04.425 INFO:tasks.rados.rados.0.smithi137.stdout:351: expect deleted 2024-03-04T06:43:04.425 INFO:tasks.rados.rados.0.smithi137.stdout:352: read oid 37 snap -1 2024-03-04T06:43:04.425 INFO:tasks.rados.rados.0.smithi137.stdout:352: expect (ObjNum 114 snap 29 seq_num 114) 2024-03-04T06:43:04.425 INFO:tasks.rados.rados.0.smithi137.stdout:353: delete oid 28 current snap is 35 2024-03-04T06:43:04.425 INFO:tasks.rados.rados.0.smithi137.stdout:348: finishing copy_from racing read to smithi13777483-34 2024-03-04T06:43:04.425 INFO:tasks.rados.rados.0.smithi137.stdout:348: finishing copy_from to smithi13777483-34 2024-03-04T06:43:04.425 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 21 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-04T06:43:04.432 INFO:tasks.rados.rados.0.smithi137.stdout:348: done (4 left) 2024-03-04T06:43:04.432 INFO:tasks.rados.rados.0.smithi137.stdout:353: done (3 left) 2024-03-04T06:43:04.432 INFO:tasks.rados.rados.0.smithi137.stdout:354: rollback oid 46 current snap is 35 2024-03-04T06:43:04.432 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 46 to 32 2024-03-04T06:43:04.432 INFO:tasks.rados.rados.0.smithi137.stdout:355: snap_remove snap 23 2024-03-04T06:43:04.525 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:04 smithi203 ceph-mon[30756]: osdmap e127: 8 total, 8 up, 8 in 2024-03-04T06:43:04.525 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:04 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:04.525 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:04 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:04.525 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:04 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:04.525 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:04.232+0000 7f95f9863200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T06:43:04.525 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:04.350+0000 7f95f9863200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T06:43:04.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:04 smithi137 ceph-mon[26846]: osdmap e127: 8 total, 8 up, 8 in 2024-03-04T06:43:04.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:04 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:04.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:04 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:04.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:04 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:04.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:04 smithi137 ceph-mon[37364]: osdmap e127: 8 total, 8 up, 8 in 2024-03-04T06:43:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:04 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:04 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:04 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:05.293 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:05.014+0000 7f95f9863200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T06:43:05.294 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:05.122+0000 7f95f9863200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T06:43:05.294 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:05.263+0000 7f95f9863200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T06:43:05.362 INFO:tasks.rados.rados.0.smithi137.stdout:355: done (4 left) 2024-03-04T06:43:05.362 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 35 2024-03-04T06:43:05.362 INFO:tasks.rados.rados.0.smithi137.stdout:350: finishing rollback tid 0 to smithi13777483-45 2024-03-04T06:43:05.363 INFO:tasks.rados.rados.0.smithi137.stdout:350: finishing rollback tid 1 to smithi13777483-45 2024-03-04T06:43:05.363 INFO:tasks.rados.rados.0.smithi137.stdout:350: finishing rollback tid 2 to smithi13777483-45 2024-03-04T06:43:05.363 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 70 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-03-04T06:43:05.363 INFO:tasks.rados.rados.0.smithi137.stdout:354: finishing rollback tid 0 to smithi13777483-46 2024-03-04T06:43:05.363 INFO:tasks.rados.rados.0.smithi137.stdout:354: finishing rollback tid 1 to smithi13777483-46 2024-03-04T06:43:05.363 INFO:tasks.rados.rados.0.smithi137.stdout:354: finishing rollback tid 2 to smithi13777483-46 2024-03-04T06:43:05.363 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 121 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-04T06:43:05.363 INFO:tasks.rados.rados.0.smithi137.stdout:352: expect (ObjNum 114 snap 29 seq_num 114) 2024-03-04T06:43:05.419 INFO:tasks.rados.rados.0.smithi137.stdout:356: seq_num 127 ranges {1687552=532480,2220032=507904,2727936=778240,3506176=319488} 2024-03-04T06:43:05.431 INFO:tasks.rados.rados.0.smithi137.stdout:356: writing smithi13777483-31 from 1687552 to 2220032 tid 1 2024-03-04T06:43:05.434 INFO:tasks.rados.rados.0.smithi137.stdout:356: writing smithi13777483-31 from 2220032 to 2727936 tid 2 2024-03-04T06:43:05.438 INFO:tasks.rados.rados.0.smithi137.stdout:356: writing smithi13777483-31 from 2727936 to 3506176 tid 3 2024-03-04T06:43:05.441 INFO:tasks.rados.rados.0.smithi137.stdout:356: writing smithi13777483-31 from 3506176 to 3825664 tid 4 2024-03-04T06:43:05.441 INFO:tasks.rados.rados.0.smithi137.stdout:350: done (4 left) 2024-03-04T06:43:05.441 INFO:tasks.rados.rados.0.smithi137.stdout:351: done (3 left) 2024-03-04T06:43:05.441 INFO:tasks.rados.rados.0.smithi137.stdout:352: done (2 left) 2024-03-04T06:43:05.441 INFO:tasks.rados.rados.0.smithi137.stdout:354: done (1 left) 2024-03-04T06:43:05.441 INFO:tasks.rados.rados.0.smithi137.stdout:357: read oid 45 snap -1 2024-03-04T06:43:05.441 INFO:tasks.rados.rados.0.smithi137.stdout:357: expect (ObjNum 33 snap 0 seq_num 33) 2024-03-04T06:43:05.441 INFO:tasks.rados.rados.0.smithi137.stdout:358: setattr oid 13 current snap is 35 2024-03-04T06:43:05.441 INFO:tasks.rados.rados.0.smithi137.stdout:356: finishing write tid 1 to smithi13777483-31 2024-03-04T06:43:05.441 INFO:tasks.rados.rados.0.smithi137.stdout:356: finishing write tid 2 to smithi13777483-31 2024-03-04T06:43:05.443 INFO:tasks.rados.rados.0.smithi137.stdout:356: finishing write tid 3 to smithi13777483-31 2024-03-04T06:43:05.443 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 35 2024-03-04T06:43:05.443 INFO:tasks.rados.rados.0.smithi137.stdout:359: seq_num 128 ranges {1548288=548864,2097152=794624,2891776=581632,3473408=229376} 2024-03-04T06:43:05.454 INFO:tasks.rados.rados.0.smithi137.stdout:359: writing smithi13777483-25 from 1548288 to 2097152 tid 1 2024-03-04T06:43:05.458 INFO:tasks.rados.rados.0.smithi137.stdout:359: writing smithi13777483-25 from 2097152 to 2891776 tid 2 2024-03-04T06:43:05.462 INFO:tasks.rados.rados.0.smithi137.stdout:359: writing smithi13777483-25 from 2891776 to 3473408 tid 3 2024-03-04T06:43:05.463 INFO:tasks.rados.rados.0.smithi137.stdout:359: writing smithi13777483-25 from 3473408 to 3702784 tid 4 2024-03-04T06:43:05.463 INFO:tasks.rados.rados.0.smithi137.stdout:360: snap_create 2024-03-04T06:43:05.463 INFO:tasks.rados.rados.0.smithi137.stdout:356: finishing write tid 4 to smithi13777483-31 2024-03-04T06:43:05.463 INFO:tasks.rados.rados.0.smithi137.stdout:356: finishing write tid 5 to smithi13777483-31 2024-03-04T06:43:05.463 INFO:tasks.rados.rados.0.smithi137.stdout:357: expect (ObjNum 33 snap 0 seq_num 33) 2024-03-04T06:43:05.478 INFO:tasks.rados.rados.0.smithi137.stdout:356: finishing write tid 6 to smithi13777483-31 2024-03-04T06:43:05.478 INFO:tasks.rados.rados.0.smithi137.stdout:356: oid 31 updating version 0 to 83 2024-03-04T06:43:05.478 INFO:tasks.rados.rados.0.smithi137.stdout:356: oid 31 updating version 83 to 85 2024-03-04T06:43:05.478 INFO:tasks.rados.rados.0.smithi137.stdout:356: oid 31 updating version 85 to 86 2024-03-04T06:43:05.478 INFO:tasks.rados.rados.0.smithi137.stdout:356: oid 31 version 86 is already newer than 84 2024-03-04T06:43:05.478 INFO:tasks.rados.rados.0.smithi137.stdout:356: oid 31 updating version 86 to 87 2024-03-04T06:43:05.478 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 87 (ObjNum 127 snap 35 seq_num 127) dirty exists 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:356: left oid 31 (ObjNum 127 snap 35 seq_num 127) 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 137 (ObjNum 125 snap 34 seq_num 125) dirty exists 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:359: finishing write tid 1 to smithi13777483-25 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:359: finishing write tid 2 to smithi13777483-25 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:359: finishing write tid 3 to smithi13777483-25 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:359: finishing write tid 4 to smithi13777483-25 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:359: finishing write tid 5 to smithi13777483-25 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:359: finishing write tid 6 to smithi13777483-25 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:359: oid 25 updating version 0 to 121 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:359: oid 25 version 121 is already newer than 119 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:359: oid 25 updating version 121 to 123 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:359: oid 25 version 123 is already newer than 122 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:359: oid 25 version 123 is already newer than 120 2024-03-04T06:43:05.479 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 123 (ObjNum 128 snap 35 seq_num 128) dirty exists 2024-03-04T06:43:05.480 INFO:tasks.rados.rados.0.smithi137.stdout:359: left oid 25 (ObjNum 128 snap 35 seq_num 128) 2024-03-04T06:43:05.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:05 smithi203 ceph-mon[30756]: osdmap e128: 8 total, 8 up, 8 in 2024-03-04T06:43:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:05 smithi203 ceph-mon[30756]: pgmap v198: 121 pgs: 121 active+clean; 123 MiB data, 416 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 7.0 MiB/s wr, 31 op/s 2024-03-04T06:43:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:05 smithi203 ceph-mon[30756]: osdmap e129: 8 total, 8 up, 8 in 2024-03-04T06:43:05.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:05.369+0000 7f95f9863200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T06:43:05.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:05.465+0000 7f95f9863200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T06:43:05.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:43:05] "GET /metrics HTTP/1.1" 200 36001 "" "Prometheus/2.43.0" 2024-03-04T06:43:05.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:05 smithi137 ceph-mon[37364]: osdmap e128: 8 total, 8 up, 8 in 2024-03-04T06:43:05.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:05 smithi137 ceph-mon[37364]: pgmap v198: 121 pgs: 121 active+clean; 123 MiB data, 416 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 7.0 MiB/s wr, 31 op/s 2024-03-04T06:43:05.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:05 smithi137 ceph-mon[37364]: osdmap e129: 8 total, 8 up, 8 in 2024-03-04T06:43:05.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:05 smithi137 ceph-mon[26846]: osdmap e128: 8 total, 8 up, 8 in 2024-03-04T06:43:05.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:05 smithi137 ceph-mon[26846]: pgmap v198: 121 pgs: 121 active+clean; 123 MiB data, 416 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 7.0 MiB/s wr, 31 op/s 2024-03-04T06:43:05.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:05 smithi137 ceph-mon[26846]: osdmap e129: 8 total, 8 up, 8 in 2024-03-04T06:43:06.081 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:05.739+0000 7f95f9863200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T06:43:06.081 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:05.873+0000 7f95f9863200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T06:43:06.081 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:05.975+0000 7f95f9863200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T06:43:06.082 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:06.080+0000 7f95f9863200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T06:43:06.345 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:06.265+0000 7f95f9863200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T06:43:06.429 INFO:tasks.rados.rados.0.smithi137.stdout:356: done (4 left) 2024-03-04T06:43:06.429 INFO:tasks.rados.rados.0.smithi137.stdout:357: done (3 left) 2024-03-04T06:43:06.429 INFO:tasks.rados.rados.0.smithi137.stdout:358: done (2 left) 2024-03-04T06:43:06.429 INFO:tasks.rados.rados.0.smithi137.stdout:359: done (1 left) 2024-03-04T06:43:06.429 INFO:tasks.rados.rados.0.smithi137.stdout:360: done (0 left) 2024-03-04T06:43:06.429 INFO:tasks.rados.rados.0.smithi137.stdout:361: read oid 25 snap 18 2024-03-04T06:43:06.430 INFO:tasks.rados.rados.0.smithi137.stdout:361: expect (ObjNum 56 snap 3 seq_num 56) 2024-03-04T06:43:06.430 INFO:tasks.rados.rados.0.smithi137.stdout:362: snap_remove snap 11 2024-03-04T06:43:07.443 INFO:tasks.rados.rados.0.smithi137.stdout:362: done (1 left) 2024-03-04T06:43:07.443 INFO:tasks.rados.rados.0.smithi137.stdout:363: copy_from oid 9 from oid 36 current snap is 36 2024-03-04T06:43:07.443 INFO:tasks.rados.rados.0.smithi137.stdout:361: expect (ObjNum 56 snap 3 seq_num 56) 2024-03-04T06:43:07.470 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:07 smithi203 ceph-mon[30756]: osdmap e130: 8 total, 8 up, 8 in 2024-03-04T06:43:07.470 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:07 smithi203 ceph-mon[30756]: pgmap v201: 121 pgs: 121 active+clean; 142 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 22 op/s 2024-03-04T06:43:07.471 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:07.315+0000 7f95f9863200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T06:43:07.501 INFO:tasks.rados.rados.0.smithi137.stdout:363: finishing copy_from racing read to smithi13777483-9 2024-03-04T06:43:07.501 INFO:tasks.rados.rados.0.smithi137.stdout:363: finishing copy_from to smithi13777483-9 2024-03-04T06:43:07.501 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 21 (ObjNum 97 snap 19 seq_num 97) dirty exists 2024-03-04T06:43:07.501 INFO:tasks.rados.rados.0.smithi137.stdout:361: done (1 left) 2024-03-04T06:43:07.501 INFO:tasks.rados.rados.0.smithi137.stdout:363: done (0 left) 2024-03-04T06:43:07.501 INFO:tasks.rados.rados.0.smithi137.stdout:364: snap_create 2024-03-04T06:43:07.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:07 smithi137 ceph-mon[26846]: osdmap e130: 8 total, 8 up, 8 in 2024-03-04T06:43:07.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:07 smithi137 ceph-mon[26846]: pgmap v201: 121 pgs: 121 active+clean; 142 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 22 op/s 2024-03-04T06:43:07.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:07 smithi137 ceph-mon[37364]: osdmap e130: 8 total, 8 up, 8 in 2024-03-04T06:43:07.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:07 smithi137 ceph-mon[37364]: pgmap v201: 121 pgs: 121 active+clean; 142 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 22 op/s 2024-03-04T06:43:07.826 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:07.472+0000 7f95f9863200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T06:43:07.826 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:07.825+0000 7f95f9863200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T06:43:08.095 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:07.922+0000 7f95f9863200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T06:43:08.433 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:08.123+0000 7f95f9863200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:43:08.433 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:08.312+0000 7f95f9863200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T06:43:08.451 INFO:tasks.rados.rados.0.smithi137.stdout:364: done (0 left) 2024-03-04T06:43:08.451 INFO:tasks.rados.rados.0.smithi137.stdout:365: snap_remove snap 29 2024-03-04T06:43:08.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:08 smithi137 ceph-mon[26846]: osdmap e131: 8 total, 8 up, 8 in 2024-03-04T06:43:08.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:08 smithi137 ceph-mon[37364]: osdmap e131: 8 total, 8 up, 8 in 2024-03-04T06:43:08.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:08 smithi203 ceph-mon[30756]: osdmap e131: 8 total, 8 up, 8 in 2024-03-04T06:43:08.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:08.611+0000 7f95f9863200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:43:09.148 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:08.892+0000 7f95f9863200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T06:43:09.448 INFO:tasks.rados.rados.0.smithi137.stdout:365: done (0 left) 2024-03-04T06:43:09.448 INFO:tasks.rados.rados.0.smithi137.stdout:366: snap_remove snap 33 2024-03-04T06:43:09.449 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:09.147+0000 7f95f9863200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T06:43:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:09 smithi137 ceph-mon[26846]: osdmap e132: 8 total, 8 up, 8 in 2024-03-04T06:43:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:09 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:09 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:09 smithi137 ceph-mon[26846]: pgmap v204: 121 pgs: 121 active+clean; 142 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 22 op/s 2024-03-04T06:43:09.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:09 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:09.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:09 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:09 smithi137 ceph-mon[37364]: osdmap e132: 8 total, 8 up, 8 in 2024-03-04T06:43:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:09 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:09 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:09 smithi137 ceph-mon[37364]: pgmap v204: 121 pgs: 121 active+clean; 142 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 22 op/s 2024-03-04T06:43:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:09 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:09 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:09.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:09 smithi203 ceph-mon[30756]: osdmap e132: 8 total, 8 up, 8 in 2024-03-04T06:43:09.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:09 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:09.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:09 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:09.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:09 smithi203 ceph-mon[30756]: pgmap v204: 121 pgs: 121 active+clean; 142 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 22 op/s 2024-03-04T06:43:09.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:09 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:09.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:09 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:10.203 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:10.029+0000 7f95f9863200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T06:43:10.321 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:43:10.364 INFO:tasks.rados.rados.0.smithi137.stdout:366: done (0 left) 2024-03-04T06:43:10.364 INFO:tasks.rados.rados.0.smithi137.stdout:367: copy_from oid 43 from oid 3 current snap is 37 2024-03-04T06:43:10.364 INFO:tasks.rados.rados.0.smithi137.stdout:368: read oid 37 snap -1 2024-03-04T06:43:10.364 INFO:tasks.rados.rados.0.smithi137.stdout:368: expect (ObjNum 114 snap 29 seq_num 114) 2024-03-04T06:43:10.364 INFO:tasks.rados.rados.0.smithi137.stdout:369: delete oid 12 current snap is 37 2024-03-04T06:43:10.374 INFO:tasks.rados.rados.0.smithi137.stdout:369: done (2 left) 2024-03-04T06:43:10.374 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 37 2024-03-04T06:43:10.374 INFO:tasks.rados.rados.0.smithi137.stdout:370: seq_num 130 ranges {4972544=581632,5554176=614400,6168576=598016,6766592=393216} 2024-03-04T06:43:10.406 INFO:tasks.rados.rados.0.smithi137.stdout:370: writing smithi13777483-13 from 4972544 to 5554176 tid 1 2024-03-04T06:43:10.410 INFO:tasks.rados.rados.0.smithi137.stdout:370: writing smithi13777483-13 from 5554176 to 6168576 tid 2 2024-03-04T06:43:10.413 INFO:tasks.rados.rados.0.smithi137.stdout:370: writing smithi13777483-13 from 6168576 to 6766592 tid 3 2024-03-04T06:43:10.416 INFO:tasks.rados.rados.0.smithi137.stdout:370: writing smithi13777483-13 from 6766592 to 7159808 tid 4 2024-03-04T06:43:10.416 INFO:tasks.rados.rados.0.smithi137.stdout:371: delete oid 9 current snap is 37 2024-03-04T06:43:10.416 INFO:tasks.rados.rados.0.smithi137.stdout:368: expect (ObjNum 114 snap 29 seq_num 114) 2024-03-04T06:43:10.472 INFO:tasks.rados.rados.0.smithi137.stdout:367: finishing copy_from racing read to smithi13777483-43 2024-03-04T06:43:10.472 INFO:tasks.rados.rados.0.smithi137.stdout:367: finishing copy_from to smithi13777483-43 2024-03-04T06:43:10.472 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 47 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:43:10.473 INFO:tasks.rados.rados.0.smithi137.stdout:370: finishing write tid 1 to smithi13777483-13 2024-03-04T06:43:10.473 INFO:tasks.rados.rados.0.smithi137.stdout:367: done (3 left) 2024-03-04T06:43:10.473 INFO:tasks.rados.rados.0.smithi137.stdout:368: done (2 left) 2024-03-04T06:43:10.473 INFO:tasks.rados.rados.0.smithi137.stdout:371: done (1 left) 2024-03-04T06:43:10.473 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 37 current snap is 37 2024-03-04T06:43:10.473 INFO:tasks.rados.rados.0.smithi137.stdout:370: finishing write tid 2 to smithi13777483-13 2024-03-04T06:43:10.473 INFO:tasks.rados.rados.0.smithi137.stdout:372: seq_num 132 ranges {1916928=614400,2531328=786432,3317760=565248,3883008=253952} 2024-03-04T06:43:10.488 INFO:tasks.rados.rados.0.smithi137.stdout:372: writing smithi13777483-37 from 1916928 to 2531328 tid 1 2024-03-04T06:43:10.494 INFO:tasks.rados.rados.0.smithi137.stdout:372: writing smithi13777483-37 from 2531328 to 3317760 tid 2 2024-03-04T06:43:10.498 INFO:tasks.rados.rados.0.smithi137.stdout:372: writing smithi13777483-37 from 3317760 to 3883008 tid 3 2024-03-04T06:43:10.501 INFO:tasks.rados.rados.0.smithi137.stdout:372: writing smithi13777483-37 from 3883008 to 4136960 tid 4 2024-03-04T06:43:10.501 INFO:tasks.rados.rados.0.smithi137.stdout:373: copy_from oid 22 from oid 21 current snap is 37 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:370: finishing write tid 3 to smithi13777483-13 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:374: setattr oid 34 current snap is 37 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:370: finishing write tid 4 to smithi13777483-13 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:370: finishing write tid 5 to smithi13777483-13 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:370: finishing write tid 6 to smithi13777483-13 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:370: oid 13 updating version 0 to 163 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:370: oid 13 updating version 163 to 167 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:370: oid 13 version 167 is already newer than 164 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:370: oid 13 version 167 is already newer than 166 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:370: oid 13 version 167 is already newer than 165 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 167 (ObjNum 130 snap 37 seq_num 130) dirty exists 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:370: left oid 13 (ObjNum 130 snap 37 seq_num 130) 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:372: finishing write tid 1 to smithi13777483-37 2024-03-04T06:43:10.502 INFO:tasks.rados.rados.0.smithi137.stdout:372: finishing write tid 2 to smithi13777483-37 2024-03-04T06:43:10.503 INFO:tasks.rados.rados.0.smithi137.stdout:372: finishing write tid 3 to smithi13777483-37 2024-03-04T06:43:10.504 INFO:tasks.rados.rados.0.smithi137.stdout:372: finishing write tid 4 to smithi13777483-37 2024-03-04T06:43:10.504 INFO:tasks.rados.rados.0.smithi137.stdout:372: finishing write tid 5 to smithi13777483-37 2024-03-04T06:43:10.504 INFO:tasks.rados.rados.0.smithi137.stdout:370: done (3 left) 2024-03-04T06:43:10.504 INFO:tasks.rados.rados.0.smithi137.stdout:375: read oid 35 snap -1 2024-03-04T06:43:10.504 INFO:tasks.rados.rados.0.smithi137.stdout:375: expect (ObjNum 117 snap 30 seq_num 117) 2024-03-04T06:43:10.504 INFO:tasks.rados.rados.0.smithi137.stdout:376: snap_create 2024-03-04T06:43:10.505 INFO:tasks.rados.rados.0.smithi137.stdout:372: finishing write tid 6 to smithi13777483-37 2024-03-04T06:43:10.505 INFO:tasks.rados.rados.0.smithi137.stdout:372: oid 37 updating version 0 to 112 2024-03-04T06:43:10.505 INFO:tasks.rados.rados.0.smithi137.stdout:372: oid 37 updating version 112 to 114 2024-03-04T06:43:10.505 INFO:tasks.rados.rados.0.smithi137.stdout:372: oid 37 version 114 is already newer than 113 2024-03-04T06:43:10.505 INFO:tasks.rados.rados.0.smithi137.stdout:372: oid 37 version 114 is already newer than 111 2024-03-04T06:43:10.505 INFO:tasks.rados.rados.0.smithi137.stdout:372: oid 37 version 114 is already newer than 110 2024-03-04T06:43:10.505 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 114 (ObjNum 132 snap 37 seq_num 132) dirty exists 2024-03-04T06:43:10.505 INFO:tasks.rados.rados.0.smithi137.stdout:372: left oid 37 (ObjNum 132 snap 37 seq_num 132) 2024-03-04T06:43:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 95 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-04T06:43:10.512 INFO:tasks.rados.rados.0.smithi137.stdout:375: expect (ObjNum 117 snap 30 seq_num 117) 2024-03-04T06:43:10.582 INFO:tasks.rados.rados.0.smithi137.stdout:373: finishing copy_from racing read to smithi13777483-22 2024-03-04T06:43:10.582 INFO:tasks.rados.rados.0.smithi137.stdout:373: finishing copy_from to smithi13777483-22 2024-03-04T06:43:10.582 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 59 (ObjNum 96 snap 19 seq_num 96) dirty exists 2024-03-04T06:43:10.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:10 smithi203 ceph-mon[30756]: osdmap e133: 8 total, 8 up, 8 in 2024-03-04T06:43:10.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:10 smithi203 ceph-mon[30756]: osdmap e134: 8 total, 8 up, 8 in 2024-03-04T06:43:10.693 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:43:10.693 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (3m) 2m ago 3m 16.1M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:43:10.693 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (3m) 2s ago 3m 86.9M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:43:10.693 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (5m) 2m ago 5m 16.0M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:43:10.693 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (5m) 2s ago 5m 16.6M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:43:10.693 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (7s) 2s ago 8m 58.6M - 19.0.0-1791-gefb04e5e 0c401cd3e778 8fd5e9ed1e80 2024-03-04T06:43:10.693 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:9283,8765 running (10m) 2m ago 10m 495M - 18.2.1-696-g5cc7a767 540557f94930 d360a32fa2a3 2024-03-04T06:43:10.693 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (10m) 2m ago 10m 50.3M 2048M 18.2.1-696-g5cc7a767 540557f94930 0279ece55dcc 2024-03-04T06:43:10.693 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (8m) 2s ago 8m 42.6M 2048M 18.2.1-696-g5cc7a767 540557f94930 c1087568a246 2024-03-04T06:43:10.693 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (8m) 2m ago 8m 39.4M 2048M 18.2.1-696-g5cc7a767 540557f94930 63f51a40232d 2024-03-04T06:43:10.693 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (3m) 2m ago 3m 11.3M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:43:10.693 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (3m) 2s ago 3m 15.8M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:43:10.693 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (8m) 2m ago 8m 43.8M 2992M 18.2.1-696-g5cc7a767 540557f94930 732ea50ff558 2024-03-04T06:43:10.694 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (7m) 2m ago 7m 44.0M 2992M 18.2.1-696-g5cc7a767 540557f94930 708139c858a7 2024-03-04T06:43:10.694 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (7m) 2m ago 7m 41.4M 2992M 18.2.1-696-g5cc7a767 540557f94930 b247adf81a73 2024-03-04T06:43:10.694 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (6m) 2m ago 6m 40.7M 2992M 18.2.1-696-g5cc7a767 540557f94930 afdbc25c9fba 2024-03-04T06:43:10.694 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (6m) 2s ago 6m 80.2M 2992M 18.2.1-696-g5cc7a767 540557f94930 d4841ffd0747 2024-03-04T06:43:10.694 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (6m) 2s ago 6m 82.4M 2992M 18.2.1-696-g5cc7a767 540557f94930 81d21771e157 2024-03-04T06:43:10.694 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (5m) 2s ago 5m 59.0M 2992M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:43:10.694 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (5m) 2s ago 5m 70.3M 2992M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:43:10.694 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (2m) 2s ago 4m 45.2M - 2.43.0 a07b618ecd1d 80efb24031c2 2024-03-04T06:43:10.694 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:10 smithi137 ceph-mon[26846]: osdmap e133: 8 total, 8 up, 8 in 2024-03-04T06:43:10.694 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:10 smithi137 ceph-mon[26846]: osdmap e134: 8 total, 8 up, 8 in 2024-03-04T06:43:10.694 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:10 smithi137 ceph-mon[37364]: osdmap e133: 8 total, 8 up, 8 in 2024-03-04T06:43:10.695 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:10 smithi137 ceph-mon[37364]: osdmap e134: 8 total, 8 up, 8 in 2024-03-04T06:43:10.912 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:10.639+0000 7f95f9863200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T06:43:10.912 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:10.740+0000 7f95f9863200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 3 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 8 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:43:11.081 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:43:11.082 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 15 2024-03-04T06:43:11.082 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:43:11.082 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:43:11.226 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:10.967+0000 7f95f9863200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T06:43:11.226 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: [04/Mar/2024:06:43:10] ENGINE Bus STARTING 2024-03-04T06:43:11.226 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: CherryPy Checker: 2024-03-04T06:43:11.226 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: The Application mounted at '' has an empty config. 2024-03-04T06:43:11.226 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:11.227 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: [04/Mar/2024:06:43:11] ENGINE Serving on http://:::9283 2024-03-04T06:43:11.227 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: [04/Mar/2024:06:43:11] ENGINE Bus STARTED 2024-03-04T06:43:11.466 INFO:tasks.rados.rados.0.smithi137.stdout:372: done (4 left) 2024-03-04T06:43:11.466 INFO:tasks.rados.rados.0.smithi137.stdout:373: done (3 left) 2024-03-04T06:43:11.466 INFO:tasks.rados.rados.0.smithi137.stdout:374: done (2 left) 2024-03-04T06:43:11.467 INFO:tasks.rados.rados.0.smithi137.stdout:375: done (1 left) 2024-03-04T06:43:11.467 INFO:tasks.rados.rados.0.smithi137.stdout:376: done (0 left) 2024-03-04T06:43:11.467 INFO:tasks.rados.rados.0.smithi137.stdout:377: read oid 31 snap -1 2024-03-04T06:43:11.467 INFO:tasks.rados.rados.0.smithi137.stdout:377: expect (ObjNum 127 snap 35 seq_num 127) 2024-03-04T06:43:11.467 INFO:tasks.rados.rados.0.smithi137.stdout:378: rollback oid 22 current snap is 38 2024-03-04T06:43:11.467 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 22 to 31 2024-03-04T06:43:11.467 INFO:tasks.rados.rados.0.smithi137.stdout:379: read oid 48 snap -1 2024-03-04T06:43:11.467 INFO:tasks.rados.rados.0.smithi137.stdout:379: expect (ObjNum 7 snap 0 seq_num 7) 2024-03-04T06:43:11.467 INFO:tasks.rados.rados.0.smithi137.stdout:380: read oid 3 snap 19 2024-03-04T06:43:11.467 INFO:tasks.rados.rados.0.smithi137.stdout:380: expect (ObjNum 100 snap 19 seq_num 100) 2024-03-04T06:43:11.467 INFO:tasks.rados.rados.0.smithi137.stdout:381: snap_remove snap 32 2024-03-04T06:43:11.543 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-mon[30756]: from='client.25034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:43:11.543 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-mon[30756]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:43:11.543 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-mon[30756]: pgmap v207: 121 pgs: 121 active+clean; 142 MiB data, 432 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:11.543 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-mon[30756]: Standby manager daemon x restarted 2024-03-04T06:43:11.544 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-mon[30756]: Standby manager daemon x started 2024-03-04T06:43:11.544 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:43:11.544 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:43:11.544 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:43:11.544 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:43:11.544 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:11 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/1121035114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:43:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[26846]: from='client.25034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:43:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[26846]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:43:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[26846]: pgmap v207: 121 pgs: 121 active+clean; 142 MiB data, 432 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[26846]: Standby manager daemon x restarted 2024-03-04T06:43:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[26846]: Standby manager daemon x started 2024-03-04T06:43:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:43:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:43:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:43:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:43:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/1121035114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:43:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[37364]: from='client.25034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:43:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[37364]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:43:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[37364]: pgmap v207: 121 pgs: 121 active+clean; 142 MiB data, 432 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[37364]: Standby manager daemon x restarted 2024-03-04T06:43:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[37364]: Standby manager daemon x started 2024-03-04T06:43:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:43:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:43:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:43:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:43:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:11 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/1121035114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:43:12.465 INFO:tasks.rados.rados.0.smithi137.stdout:381: done (4 left) 2024-03-04T06:43:12.465 INFO:tasks.rados.rados.0.smithi137.stdout:382: read oid 18 snap -1 2024-03-04T06:43:12.465 INFO:tasks.rados.rados.0.smithi137.stdout:382: expect (ObjNum 102 snap 21 seq_num 102) 2024-03-04T06:43:12.465 INFO:tasks.rados.rados.0.smithi137.stdout:383: snap_remove snap 34 2024-03-04T06:43:12.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:12 smithi137 ceph-mon[26846]: mgrmap e23: y(active, since 4m), standbys: x 2024-03-04T06:43:12.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:12 smithi137 ceph-mon[26846]: osdmap e135: 8 total, 8 up, 8 in 2024-03-04T06:43:12.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:12 smithi137 ceph-mon[37364]: mgrmap e23: y(active, since 4m), standbys: x 2024-03-04T06:43:12.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:12 smithi137 ceph-mon[37364]: osdmap e135: 8 total, 8 up, 8 in 2024-03-04T06:43:12.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:12 smithi203 ceph-mon[30756]: mgrmap e23: y(active, since 4m), standbys: x 2024-03-04T06:43:12.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:12 smithi203 ceph-mon[30756]: osdmap e135: 8 total, 8 up, 8 in 2024-03-04T06:43:13.471 INFO:tasks.rados.rados.0.smithi137.stdout:383: done (5 left) 2024-03-04T06:43:13.471 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 38 2024-03-04T06:43:13.471 INFO:tasks.rados.rados.0.smithi137.stdout:384: seq_num 133 ranges {3702784=630784,4333568=663552,4997120=770048,5767168=172032} 2024-03-04T06:43:13.494 INFO:tasks.rados.rados.0.smithi137.stdout:384: writing smithi13777483-25 from 3702784 to 4333568 tid 1 2024-03-04T06:43:13.498 INFO:tasks.rados.rados.0.smithi137.stdout:384: writing smithi13777483-25 from 4333568 to 4997120 tid 2 2024-03-04T06:43:13.502 INFO:tasks.rados.rados.0.smithi137.stdout:384: writing smithi13777483-25 from 4997120 to 5767168 tid 3 2024-03-04T06:43:13.504 INFO:tasks.rados.rados.0.smithi137.stdout:384: writing smithi13777483-25 from 5767168 to 5939200 tid 4 2024-03-04T06:43:13.504 INFO:tasks.rados.rados.0.smithi137.stdout:385: delete oid 42 current snap is 38 2024-03-04T06:43:13.504 INFO:tasks.rados.rados.0.smithi137.stdout:379: expect (ObjNum 7 snap 0 seq_num 7) 2024-03-04T06:43:13.508 INFO:tasks.rados.rados.0.smithi137.stdout:378: finishing rollback tid 0 to smithi13777483-22 2024-03-04T06:43:13.509 INFO:tasks.rados.rados.0.smithi137.stdout:378: finishing rollback tid 1 to smithi13777483-22 2024-03-04T06:43:13.509 INFO:tasks.rados.rados.0.smithi137.stdout:378: finishing rollback tid 2 to smithi13777483-22 2024-03-04T06:43:13.509 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 120 (ObjNum 78 snap 11 seq_num 78) dirty exists 2024-03-04T06:43:13.509 INFO:tasks.rados.rados.0.smithi137.stdout:380: expect (ObjNum 100 snap 19 seq_num 100) 2024-03-04T06:43:13.613 INFO:tasks.rados.rados.0.smithi137.stdout:377: expect (ObjNum 127 snap 35 seq_num 127) 2024-03-04T06:43:13.745 INFO:tasks.rados.rados.0.smithi137.stdout:382: expect (ObjNum 102 snap 21 seq_num 102) 2024-03-04T06:43:13.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:13 smithi137 ceph-mon[26846]: osdmap e136: 8 total, 8 up, 8 in 2024-03-04T06:43:13.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:13 smithi137 ceph-mon[26846]: pgmap v210: 121 pgs: 121 active+clean; 145 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-03-04T06:43:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:13 smithi137 ceph-mon[37364]: osdmap e136: 8 total, 8 up, 8 in 2024-03-04T06:43:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:13 smithi137 ceph-mon[37364]: pgmap v210: 121 pgs: 121 active+clean; 145 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-03-04T06:43:13.793 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:43:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[73354]: ts=2024-03-04T06:43:13.458Z caller=notify.go:743 level=info component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify success" attempts=7 2024-03-04T06:43:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:13 smithi203 ceph-mon[30756]: osdmap e136: 8 total, 8 up, 8 in 2024-03-04T06:43:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:13 smithi203 ceph-mon[30756]: pgmap v210: 121 pgs: 121 active+clean; 145 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-03-04T06:43:13.942 INFO:tasks.rados.rados.0.smithi137.stdout:384: finishing write tid 1 to smithi13777483-25 2024-03-04T06:43:13.942 INFO:tasks.rados.rados.0.smithi137.stdout:384: finishing write tid 2 to smithi13777483-25 2024-03-04T06:43:13.942 INFO:tasks.rados.rados.0.smithi137.stdout:377: done (6 left) 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:378: done (5 left) 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:379: done (4 left) 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:380: done (3 left) 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:382: done (2 left) 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:385: done (1 left) 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:386: rollback oid 46 current snap is 38 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 46 to 35 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:384: finishing write tid 3 to smithi13777483-25 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:384: finishing write tid 4 to smithi13777483-25 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:384: finishing write tid 5 to smithi13777483-25 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:384: finishing write tid 6 to smithi13777483-25 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:384: oid 25 updating version 0 to 154 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:384: oid 25 version 154 is already newer than 152 2024-03-04T06:43:13.943 INFO:tasks.rados.rados.0.smithi137.stdout:384: oid 25 version 154 is already newer than 153 2024-03-04T06:43:13.944 INFO:tasks.rados.rados.0.smithi137.stdout:384: oid 25 version 154 is already newer than 151 2024-03-04T06:43:13.944 INFO:tasks.rados.rados.0.smithi137.stdout:384: oid 25 updating version 154 to 155 2024-03-04T06:43:13.944 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 155 (ObjNum 133 snap 38 seq_num 133) dirty exists 2024-03-04T06:43:13.944 INFO:tasks.rados.rados.0.smithi137.stdout:384: left oid 25 (ObjNum 133 snap 38 seq_num 133) 2024-03-04T06:43:13.944 INFO:tasks.rados.rados.0.smithi137.stdout:384: done (1 left) 2024-03-04T06:43:13.944 INFO:tasks.rados.rados.0.smithi137.stdout:387: rmattr oid 33 current snap is 38 2024-03-04T06:43:13.944 INFO:tasks.rados.rados.0.smithi137.stdout:388: snap_remove snap 13 2024-03-04T06:43:14.478 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 0 (ObjNum 103 snap 22 seq_num 103) dirty exists 2024-03-04T06:43:14.478 INFO:tasks.rados.rados.0.smithi137.stdout:386: finishing rollback tid 0 to smithi13777483-46 2024-03-04T06:43:14.478 INFO:tasks.rados.rados.0.smithi137.stdout:386: finishing rollback tid 1 to smithi13777483-46 2024-03-04T06:43:14.478 INFO:tasks.rados.rados.0.smithi137.stdout:386: finishing rollback tid 2 to smithi13777483-46 2024-03-04T06:43:14.478 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 181 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-04T06:43:14.478 INFO:tasks.rados.rados.0.smithi137.stdout:386: done (2 left) 2024-03-04T06:43:14.478 INFO:tasks.rados.rados.0.smithi137.stdout:387: done (1 left) 2024-03-04T06:43:14.478 INFO:tasks.rados.rados.0.smithi137.stdout:388: done (0 left) 2024-03-04T06:43:14.478 INFO:tasks.rados.rados.0.smithi137.stdout:389: copy_from oid 31 from oid 44 current snap is 38 2024-03-04T06:43:14.478 INFO:tasks.rados.rados.0.smithi137.stdout:390: snap_create 2024-03-04T06:43:14.523 INFO:tasks.rados.rados.0.smithi137.stdout:389: finishing copy_from racing read to smithi13777483-31 2024-03-04T06:43:14.526 INFO:tasks.rados.rados.0.smithi137.stdout:389: finishing copy_from to smithi13777483-31 2024-03-04T06:43:14.526 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-03-04T06:43:14.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:14 smithi137 ceph-mon[37364]: osdmap e137: 8 total, 8 up, 8 in 2024-03-04T06:43:14.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:14 smithi137 ceph-mon[26846]: osdmap e137: 8 total, 8 up, 8 in 2024-03-04T06:43:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:14 smithi203 ceph-mon[30756]: osdmap e137: 8 total, 8 up, 8 in 2024-03-04T06:43:15.367 INFO:tasks.rados.rados.0.smithi137.stdout:389: done (1 left) 2024-03-04T06:43:15.367 INFO:tasks.rados.rados.0.smithi137.stdout:390: done (0 left) 2024-03-04T06:43:15.367 INFO:tasks.rados.rados.0.smithi137.stdout:391: copy_from oid 27 from oid 39 current snap is 39 2024-03-04T06:43:15.367 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 39 2024-03-04T06:43:15.367 INFO:tasks.rados.rados.0.smithi137.stdout:392: seq_num 135 ranges {0=663552,663552=434176,1097728=786432,1884160=385024} 2024-03-04T06:43:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:392: writing smithi13777483-8 from 0 to 663552 tid 1 2024-03-04T06:43:15.374 INFO:tasks.rados.rados.0.smithi137.stdout:392: writing smithi13777483-8 from 663552 to 1097728 tid 2 2024-03-04T06:43:15.380 INFO:tasks.rados.rados.0.smithi137.stdout:392: writing smithi13777483-8 from 1097728 to 1884160 tid 3 2024-03-04T06:43:15.383 INFO:tasks.rados.rados.0.smithi137.stdout:392: writing smithi13777483-8 from 1884160 to 2269184 tid 4 2024-03-04T06:43:15.383 INFO:tasks.rados.rados.0.smithi137.stdout:393: copy_from oid 45 from oid 50 current snap is 39 2024-03-04T06:43:15.383 INFO:tasks.rados.rados.0.smithi137.stdout:392: finishing write tid 1 to smithi13777483-8 2024-03-04T06:43:15.383 INFO:tasks.rados.rados.0.smithi137.stdout:392: finishing write tid 2 to smithi13777483-8 2024-03-04T06:43:15.383 INFO:tasks.rados.rados.0.smithi137.stdout:394: snap_create 2024-03-04T06:43:15.383 INFO:tasks.rados.rados.0.smithi137.stdout:392: finishing write tid 3 to smithi13777483-8 2024-03-04T06:43:15.386 INFO:tasks.rados.rados.0.smithi137.stdout:392: finishing write tid 4 to smithi13777483-8 2024-03-04T06:43:15.386 INFO:tasks.rados.rados.0.smithi137.stdout:392: finishing write tid 5 to smithi13777483-8 2024-03-04T06:43:15.390 INFO:tasks.rados.rados.0.smithi137.stdout:392: finishing write tid 6 to smithi13777483-8 2024-03-04T06:43:15.390 INFO:tasks.rados.rados.0.smithi137.stdout:392: oid 8 updating version 0 to 31 2024-03-04T06:43:15.390 INFO:tasks.rados.rados.0.smithi137.stdout:392: oid 8 version 31 is already newer than 30 2024-03-04T06:43:15.390 INFO:tasks.rados.rados.0.smithi137.stdout:392: oid 8 updating version 31 to 32 2024-03-04T06:43:15.390 INFO:tasks.rados.rados.0.smithi137.stdout:392: oid 8 updating version 32 to 34 2024-03-04T06:43:15.390 INFO:tasks.rados.rados.0.smithi137.stdout:392: oid 8 version 34 is already newer than 33 2024-03-04T06:43:15.390 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 34 (ObjNum 135 snap 39 seq_num 135) dirty exists 2024-03-04T06:43:15.390 INFO:tasks.rados.rados.0.smithi137.stdout:392: left oid 8 (ObjNum 135 snap 39 seq_num 135) 2024-03-04T06:43:15.394 INFO:tasks.rados.rados.0.smithi137.stdout:391: finishing copy_from racing read to smithi13777483-27 2024-03-04T06:43:15.399 INFO:tasks.rados.rados.0.smithi137.stdout:391: finishing copy_from to smithi13777483-27 2024-03-04T06:43:15.399 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 39 (ObjNum 112 snap 29 seq_num 112) dirty exists 2024-03-04T06:43:15.402 INFO:tasks.rados.rados.0.smithi137.stdout:393: finishing copy_from racing read to smithi13777483-45 2024-03-04T06:43:15.402 INFO:tasks.rados.rados.0.smithi137.stdout:393: finishing copy_from to smithi13777483-45 2024-03-04T06:43:15.402 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 89 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-03-04T06:43:15.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:43:15] "GET /metrics HTTP/1.1" 200 36003 "" "Prometheus/2.43.0" 2024-03-04T06:43:15.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:15 smithi137 ceph-mon[26846]: osdmap e138: 8 total, 8 up, 8 in 2024-03-04T06:43:15.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:15 smithi137 ceph-mon[26846]: pgmap v213: 121 pgs: 121 active+clean; 145 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-03-04T06:43:15.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:15 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:15.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:15 smithi137 ceph-mon[26846]: osdmap e139: 8 total, 8 up, 8 in 2024-03-04T06:43:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:15 smithi137 ceph-mon[37364]: osdmap e138: 8 total, 8 up, 8 in 2024-03-04T06:43:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:15 smithi137 ceph-mon[37364]: pgmap v213: 121 pgs: 121 active+clean; 145 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-03-04T06:43:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:15 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:15 smithi137 ceph-mon[37364]: osdmap e139: 8 total, 8 up, 8 in 2024-03-04T06:43:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:15 smithi203 ceph-mon[30756]: osdmap e138: 8 total, 8 up, 8 in 2024-03-04T06:43:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:15 smithi203 ceph-mon[30756]: pgmap v213: 121 pgs: 121 active+clean; 145 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-03-04T06:43:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:15 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:15 smithi203 ceph-mon[30756]: osdmap e139: 8 total, 8 up, 8 in 2024-03-04T06:43:16.378 INFO:tasks.rados.rados.0.smithi137.stdout:391: done (3 left) 2024-03-04T06:43:16.379 INFO:tasks.rados.rados.0.smithi137.stdout:392: done (2 left) 2024-03-04T06:43:16.379 INFO:tasks.rados.rados.0.smithi137.stdout:393: done (1 left) 2024-03-04T06:43:16.379 INFO:tasks.rados.rados.0.smithi137.stdout:394: done (0 left) 2024-03-04T06:43:16.379 INFO:tasks.rados.rados.0.smithi137.stdout:395: read oid 36 snap -1 2024-03-04T06:43:16.379 INFO:tasks.rados.rados.0.smithi137.stdout:395: expect (ObjNum 97 snap 19 seq_num 97) 2024-03-04T06:43:16.379 INFO:tasks.rados.rados.0.smithi137.stdout:396: delete oid 21 current snap is 40 2024-03-04T06:43:16.383 INFO:tasks.rados.rados.0.smithi137.stdout:396: done (1 left) 2024-03-04T06:43:16.383 INFO:tasks.rados.rados.0.smithi137.stdout:397: rmattr oid 9 current snap is 40 2024-03-04T06:43:16.383 INFO:tasks.rados.rados.0.smithi137.stdout:397: done (1 left) 2024-03-04T06:43:16.383 INFO:tasks.rados.rados.0.smithi137.stdout:398: rmattr oid 32 current snap is 40 2024-03-04T06:43:16.383 INFO:tasks.rados.rados.0.smithi137.stdout:398: done (1 left) 2024-03-04T06:43:16.383 INFO:tasks.rados.rados.0.smithi137.stdout:399: rmattr oid 6 current snap is 40 2024-03-04T06:43:16.383 INFO:tasks.rados.rados.0.smithi137.stdout:400: copy_from oid 12 from oid 11 current snap is 40 2024-03-04T06:43:16.383 INFO:tasks.rados.rados.0.smithi137.stdout:401: delete oid 7 current snap is 40 2024-03-04T06:43:16.386 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 138 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-03-04T06:43:16.387 INFO:tasks.rados.rados.0.smithi137.stdout:399: done (3 left) 2024-03-04T06:43:16.387 INFO:tasks.rados.rados.0.smithi137.stdout:401: done (2 left) 2024-03-04T06:43:16.387 INFO:tasks.rados.rados.0.smithi137.stdout:402: rollback oid 49 current snap is 40 2024-03-04T06:43:16.387 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 49 to 35 2024-03-04T06:43:16.387 INFO:tasks.rados.rados.0.smithi137.stdout:403: read oid 45 snap -1 2024-03-04T06:43:16.387 INFO:tasks.rados.rados.0.smithi137.stdout:403: expect (ObjNum 26 snap 0 seq_num 26) 2024-03-04T06:43:16.387 INFO:tasks.rados.rados.0.smithi137.stdout:404: snap_remove snap 22 2024-03-04T06:43:17.386 INFO:tasks.rados.rados.0.smithi137.stdout:404: done (4 left) 2024-03-04T06:43:17.386 INFO:tasks.rados.rados.0.smithi137.stdout:405: delete oid 5 current snap is 40 2024-03-04T06:43:17.387 INFO:tasks.rados.rados.0.smithi137.stdout:400: finishing copy_from to smithi13777483-12 2024-03-04T06:43:17.387 INFO:tasks.rados.rados.0.smithi137.stdout:400: got expected ENOENT (src dne) 2024-03-04T06:43:17.387 INFO:tasks.rados.rados.0.smithi137.stdout:400: finishing copy_from racing read to smithi13777483-12 2024-03-04T06:43:17.387 INFO:tasks.rados.rados.0.smithi137.stdout:395: expect (ObjNum 97 snap 19 seq_num 97) 2024-03-04T06:43:17.496 INFO:tasks.rados.rados.0.smithi137.stdout:402: finishing rollback tid 1 to smithi13777483-49 2024-03-04T06:43:17.496 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 75 (ObjNum 97 snap 0 seq_num 3130644400) dirty dne 2024-03-04T06:43:17.496 INFO:tasks.rados.rados.0.smithi137.stdout:403: expect (ObjNum 26 snap 0 seq_num 26) 2024-03-04T06:43:17.508 INFO:tasks.rados.rados.0.smithi137.stdout:395: done (4 left) 2024-03-04T06:43:17.508 INFO:tasks.rados.rados.0.smithi137.stdout:400: done (3 left) 2024-03-04T06:43:17.508 INFO:tasks.rados.rados.0.smithi137.stdout:402: done (2 left) 2024-03-04T06:43:17.508 INFO:tasks.rados.rados.0.smithi137.stdout:403: done (1 left) 2024-03-04T06:43:17.508 INFO:tasks.rados.rados.0.smithi137.stdout:405: done (0 left) 2024-03-04T06:43:17.508 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 40 2024-03-04T06:43:17.508 INFO:tasks.rados.rados.0.smithi137.stdout:406: seq_num 139 ranges {0=737280,737280=425984,1163264=761856,1925120=417792} 2024-03-04T06:43:17.511 INFO:tasks.rados.rados.0.smithi137.stdout:406: writing smithi13777483-12 from 0 to 737280 tid 1 2024-03-04T06:43:17.514 INFO:tasks.rados.rados.0.smithi137.stdout:406: writing smithi13777483-12 from 737280 to 1163264 tid 2 2024-03-04T06:43:17.518 INFO:tasks.rados.rados.0.smithi137.stdout:406: writing smithi13777483-12 from 1163264 to 1925120 tid 3 2024-03-04T06:43:17.521 INFO:tasks.rados.rados.0.smithi137.stdout:406: writing smithi13777483-12 from 1925120 to 2342912 tid 4 2024-03-04T06:43:17.521 INFO:tasks.rados.rados.0.smithi137.stdout:407: snap_remove snap 24 2024-03-04T06:43:17.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:17 smithi137 ceph-mon[37364]: osdmap e140: 8 total, 8 up, 8 in 2024-03-04T06:43:17.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:17 smithi137 ceph-mon[37364]: pgmap v216: 121 pgs: 121 active+clean; 148 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 8.6 MiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-03-04T06:43:17.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:17 smithi137 ceph-mon[26846]: osdmap e140: 8 total, 8 up, 8 in 2024-03-04T06:43:17.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:17 smithi137 ceph-mon[26846]: pgmap v216: 121 pgs: 121 active+clean; 148 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 8.6 MiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-03-04T06:43:17.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:17 smithi203 ceph-mon[30756]: osdmap e140: 8 total, 8 up, 8 in 2024-03-04T06:43:17.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:17 smithi203 ceph-mon[30756]: pgmap v216: 121 pgs: 121 active+clean; 148 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 8.6 MiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-03-04T06:43:18.296 INFO:tasks.rados.rados.0.smithi137.stdout:407: done (1 left) 2024-03-04T06:43:18.296 INFO:tasks.rados.rados.0.smithi137.stdout:408: snap_remove snap 18 2024-03-04T06:43:18.381 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: [04/Mar/2024:06:43:18] ENGINE Bus STOPPING 2024-03-04T06:43:18.382 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: [04/Mar/2024:06:43:18] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T06:43:18.382 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: [04/Mar/2024:06:43:18] ENGINE Bus STOPPED 2024-03-04T06:43:18.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ignoring --setuser ceph since I am not root 2024-03-04T06:43:18.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ignoring --setgroup ceph since I am not root 2024-03-04T06:43:18.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: osdmap e141: 8 total, 8 up, 8 in 2024-03-04T06:43:18.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:18.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: osdmap e142: 8 total, 8 up, 8 in 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: mgrmap e24: x(active, starting, since 0.00732555s) 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:43:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:43:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:43:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:43:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:43:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:43:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:43:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:43:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:43:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:43:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:43:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:43:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:43:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:43:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[37364]: Manager daemon x is now available 2024-03-04T06:43:18.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: osdmap e141: 8 total, 8 up, 8 in 2024-03-04T06:43:18.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:18.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:18.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:18.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:43:18.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:18.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:18.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-03-04T06:43:18.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-03-04T06:43:18.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: osdmap e142: 8 total, 8 up, 8 in 2024-03-04T06:43:18.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-03-04T06:43:18.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: mgrmap e24: x(active, starting, since 0.00732555s) 2024-03-04T06:43:18.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:43:18.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:43:18.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-mon[26846]: Manager daemon x is now available 2024-03-04T06:43:18.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: [04/Mar/2024:06:43:18] ENGINE Bus STARTING 2024-03-04T06:43:18.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:18.451+0000 7f9554cfa700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:18.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:18.451+0000 7f9554cfa700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:18.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:18.451+0000 7f9554cfa700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:18.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:18.451+0000 7f9554cfa700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:18.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:18.451+0000 7f9554cfa700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:18.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:18.452+0000 7f9559503700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:18.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:18.452+0000 7f9559503700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:18.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:18.452+0000 7f9559503700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:18.847 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:18.452+0000 7f9559503700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:18.847 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:18.452+0000 7f9559503700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:18.847 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: [04/Mar/2024:06:43:18] ENGINE Serving on http://:::9283 2024-03-04T06:43:18.847 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: [04/Mar/2024:06:43:18] ENGINE Bus STARTED 2024-03-04T06:43:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: osdmap e141: 8 total, 8 up, 8 in 2024-03-04T06:43:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:43:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' 2024-03-04T06:43:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.14604 172.21.15.137:0/1677875326' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-03-04T06:43:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-03-04T06:43:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: osdmap e142: 8 total, 8 up, 8 in 2024-03-04T06:43:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.14604 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-03-04T06:43:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: mgrmap e24: x(active, starting, since 0.00732555s) 2024-03-04T06:43:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:43:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:43:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:43:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:43:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:43:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:43:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:43:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:43:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:43:18.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:43:18.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:43:18.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:43:18.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:43:18.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:43:18.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:43:18.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:43:18.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:43:18.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:18 smithi203 ceph-mon[30756]: Manager daemon x is now available 2024-03-04T06:43:19.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:18.883+0000 7fc0cf0ec200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T06:43:19.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:18.979+0000 7fc0cf0ec200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T06:43:19.296 INFO:tasks.rados.rados.0.smithi137.stdout:408: done (1 left) 2024-03-04T06:43:19.296 INFO:tasks.rados.rados.0.smithi137.stdout:409: snap_remove snap 36 2024-03-04T06:43:19.718 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:19.626+0000 7fc0cf0ec200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T06:43:19.719 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:19.719 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:19.719 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:19.719 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:43:19.719 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:43:19.719 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-04T06:43:19.719 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-04T06:43:19.719 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[37364]: osdmap e143: 8 total, 8 up, 8 in 2024-03-04T06:43:19.719 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[37364]: mgrmap e25: x(active, since 1.0163s) 2024-03-04T06:43:19.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:19.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:19.720 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:19.720 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:43:19.720 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:43:19.720 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-04T06:43:19.720 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-04T06:43:19.720 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[26846]: osdmap e143: 8 total, 8 up, 8 in 2024-03-04T06:43:19.720 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-mon[26846]: mgrmap e25: x(active, since 1.0163s) 2024-03-04T06:43:19.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:19 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:19 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:19 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:19 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:43:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:19 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:43:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:19 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-04T06:43:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:19 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-04T06:43:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:19 smithi203 ceph-mon[30756]: osdmap e143: 8 total, 8 up, 8 in 2024-03-04T06:43:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:19 smithi203 ceph-mon[30756]: mgrmap e25: x(active, since 1.0163s) 2024-03-04T06:43:20.037 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:19.717+0000 7fc0cf0ec200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T06:43:20.037 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:19.858+0000 7fc0cf0ec200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T06:43:20.037 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:19.953+0000 7fc0cf0ec200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T06:43:20.037 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:20.035+0000 7fc0cf0ec200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T06:43:20.295 INFO:tasks.rados.rados.0.smithi137.stdout:409: done (1 left) 2024-03-04T06:43:20.295 INFO:tasks.rados.rados.0.smithi137.stdout:410: snap_remove snap 31 2024-03-04T06:43:20.365 INFO:tasks.rados.rados.0.smithi137.stdout:410: done (1 left) 2024-03-04T06:43:20.365 INFO:tasks.rados.rados.0.smithi137.stdout:411: setattr oid 21 current snap is 40 2024-03-04T06:43:20.365 INFO:tasks.rados.rados.0.smithi137.stdout:406: finishing write tid 1 to smithi13777483-12 2024-03-04T06:43:20.365 INFO:tasks.rados.rados.0.smithi137.stdout:406: finishing write tid 2 to smithi13777483-12 2024-03-04T06:43:20.366 INFO:tasks.rados.rados.0.smithi137.stdout:406: finishing write tid 3 to smithi13777483-12 2024-03-04T06:43:20.366 INFO:tasks.rados.rados.0.smithi137.stdout:406: finishing write tid 4 to smithi13777483-12 2024-03-04T06:43:20.366 INFO:tasks.rados.rados.0.smithi137.stdout:406: finishing write tid 5 to smithi13777483-12 2024-03-04T06:43:20.366 INFO:tasks.rados.rados.0.smithi137.stdout:406: finishing write tid 6 to smithi13777483-12 2024-03-04T06:43:20.366 INFO:tasks.rados.rados.0.smithi137.stdout:406: oid 12 updating version 0 to 58 2024-03-04T06:43:20.366 INFO:tasks.rados.rados.0.smithi137.stdout:406: oid 12 updating version 58 to 62 2024-03-04T06:43:20.366 INFO:tasks.rados.rados.0.smithi137.stdout:406: oid 12 version 62 is already newer than 59 2024-03-04T06:43:20.366 INFO:tasks.rados.rados.0.smithi137.stdout:406: oid 12 version 62 is already newer than 60 2024-03-04T06:43:20.366 INFO:tasks.rados.rados.0.smithi137.stdout:406: oid 12 version 62 is already newer than 61 2024-03-04T06:43:20.366 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 62 (ObjNum 139 snap 40 seq_num 139) dirty exists 2024-03-04T06:43:20.366 INFO:tasks.rados.rados.0.smithi137.stdout:406: left oid 12 (ObjNum 139 snap 40 seq_num 139) 2024-03-04T06:43:20.370 INFO:tasks.rados.rados.0.smithi137.stdout:406: done (1 left) 2024-03-04T06:43:20.370 INFO:tasks.rados.rados.0.smithi137.stdout:412: read oid 27 snap -1 2024-03-04T06:43:20.370 INFO:tasks.rados.rados.0.smithi137.stdout:412: expect (ObjNum 112 snap 29 seq_num 112) 2024-03-04T06:43:20.370 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 40 2024-03-04T06:43:20.370 INFO:tasks.rados.rados.0.smithi137.stdout:413: seq_num 140 ranges {0=753664,753664=704512,1458176=524288,1982464=376832} 2024-03-04T06:43:20.374 INFO:tasks.rados.rados.0.smithi137.stdout:413: writing smithi13777483-32 from 0 to 753664 tid 1 2024-03-04T06:43:20.379 INFO:tasks.rados.rados.0.smithi137.stdout:413: writing smithi13777483-32 from 753664 to 1458176 tid 2 2024-03-04T06:43:20.383 INFO:tasks.rados.rados.0.smithi137.stdout:413: writing smithi13777483-32 from 1458176 to 1982464 tid 3 2024-03-04T06:43:20.385 INFO:tasks.rados.rados.0.smithi137.stdout:413: writing smithi13777483-32 from 1982464 to 2359296 tid 4 2024-03-04T06:43:20.385 INFO:tasks.rados.rados.0.smithi137.stdout:414: setattr oid 8 current snap is 40 2024-03-04T06:43:20.385 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 198 (ObjNum 129 snap 0 seq_num 3130984624) dirty exists 2024-03-04T06:43:20.388 INFO:tasks.rados.rados.0.smithi137.stdout:411: done (3 left) 2024-03-04T06:43:20.388 INFO:tasks.rados.rados.0.smithi137.stdout:415: read oid 26 snap -1 2024-03-04T06:43:20.388 INFO:tasks.rados.rados.0.smithi137.stdout:415: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:43:20.388 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 40 2024-03-04T06:43:20.388 INFO:tasks.rados.rados.0.smithi137.stdout:416: seq_num 141 ranges {106496=770048,876544=589824,1466368=729088,2195456=286720} 2024-03-04T06:43:20.394 INFO:tasks.rados.rados.0.smithi137.stdout:416: writing smithi13777483-31 from 106496 to 876544 tid 1 2024-03-04T06:43:20.398 INFO:tasks.rados.rados.0.smithi137.stdout:416: writing smithi13777483-31 from 876544 to 1466368 tid 2 2024-03-04T06:43:20.403 INFO:tasks.rados.rados.0.smithi137.stdout:416: writing smithi13777483-31 from 1466368 to 2195456 tid 3 2024-03-04T06:43:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:416: writing smithi13777483-31 from 2195456 to 2482176 tid 4 2024-03-04T06:43:20.406 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 40 2024-03-04T06:43:20.406 INFO:tasks.rados.rados.0.smithi137.stdout:417: seq_num 142 ranges {761856=786432,1548288=475136,2023424=540672,2564096=589824} 2024-03-04T06:43:20.415 INFO:tasks.rados.rados.0.smithi137.stdout:417: writing smithi13777483-30 from 761856 to 1548288 tid 1 2024-03-04T06:43:20.419 INFO:tasks.rados.rados.0.smithi137.stdout:417: writing smithi13777483-30 from 1548288 to 2023424 tid 2 2024-03-04T06:43:20.422 INFO:tasks.rados.rados.0.smithi137.stdout:417: writing smithi13777483-30 from 2023424 to 2564096 tid 3 2024-03-04T06:43:20.427 INFO:tasks.rados.rados.0.smithi137.stdout:417: writing smithi13777483-30 from 2564096 to 3153920 tid 4 2024-03-04T06:43:20.427 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 28 current snap is 40 2024-03-04T06:43:20.427 INFO:tasks.rados.rados.0.smithi137.stdout:413: finishing write tid 1 to smithi13777483-32 2024-03-04T06:43:20.427 INFO:tasks.rados.rados.0.smithi137.stdout:415: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:43:20.430 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 54 (ObjNum 135 snap 39 seq_num 135) dirty exists 2024-03-04T06:43:20.430 INFO:tasks.rados.rados.0.smithi137.stdout:413: finishing write tid 2 to smithi13777483-32 2024-03-04T06:43:20.430 INFO:tasks.rados.rados.0.smithi137.stdout:416: finishing write tid 1 to smithi13777483-31 2024-03-04T06:43:20.431 INFO:tasks.rados.rados.0.smithi137.stdout:418: seq_num 143 ranges {0=802816,802816=761856,1564672=745472,2310144=98304} 2024-03-04T06:43:20.436 INFO:tasks.rados.rados.0.smithi137.stdout:418: writing smithi13777483-28 from 0 to 802816 tid 1 2024-03-04T06:43:20.441 INFO:tasks.rados.rados.0.smithi137.stdout:418: writing smithi13777483-28 from 802816 to 1564672 tid 2 2024-03-04T06:43:20.446 INFO:tasks.rados.rados.0.smithi137.stdout:418: writing smithi13777483-28 from 1564672 to 2310144 tid 3 2024-03-04T06:43:20.447 INFO:tasks.rados.rados.0.smithi137.stdout:418: writing smithi13777483-28 from 2310144 to 2408448 tid 4 2024-03-04T06:43:20.447 INFO:tasks.rados.rados.0.smithi137.stdout:414: done (6 left) 2024-03-04T06:43:20.447 INFO:tasks.rados.rados.0.smithi137.stdout:415: done (5 left) 2024-03-04T06:43:20.447 INFO:tasks.rados.rados.0.smithi137.stdout:419: delete oid 25 current snap is 40 2024-03-04T06:43:20.447 INFO:tasks.rados.rados.0.smithi137.stdout:412: expect (ObjNum 112 snap 29 seq_num 112) 2024-03-04T06:43:20.644 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:20.308+0000 7fc0cf0ec200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T06:43:20.645 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:20.460+0000 7fc0cf0ec200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T06:43:20.645 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:20.548+0000 7fc0cf0ec200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T06:43:20.645 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[37364]: Deploying cephadm binary to smithi203 2024-03-04T06:43:20.645 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[37364]: Deploying cephadm binary to smithi137 2024-03-04T06:43:20.645 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[37364]: [04/Mar/2024:06:43:19] ENGINE Bus STARTING 2024-03-04T06:43:20.645 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[37364]: [04/Mar/2024:06:43:19] ENGINE Serving on http://172.21.15.203:8765 2024-03-04T06:43:20.645 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[37364]: pgmap v4: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 149 MiB data, 499 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:20.645 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[37364]: [04/Mar/2024:06:43:19] ENGINE Serving on https://172.21.15.203:7150 2024-03-04T06:43:20.646 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[37364]: [04/Mar/2024:06:43:19] ENGINE Bus STARTED 2024-03-04T06:43:20.646 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[37364]: osdmap e144: 8 total, 8 up, 8 in 2024-03-04T06:43:20.646 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[37364]: osdmap e145: 8 total, 8 up, 8 in 2024-03-04T06:43:20.646 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[26846]: Deploying cephadm binary to smithi203 2024-03-04T06:43:20.646 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[26846]: Deploying cephadm binary to smithi137 2024-03-04T06:43:20.646 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[26846]: [04/Mar/2024:06:43:19] ENGINE Bus STARTING 2024-03-04T06:43:20.646 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[26846]: [04/Mar/2024:06:43:19] ENGINE Serving on http://172.21.15.203:8765 2024-03-04T06:43:20.646 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[26846]: pgmap v4: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 149 MiB data, 499 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:20.646 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[26846]: [04/Mar/2024:06:43:19] ENGINE Serving on https://172.21.15.203:7150 2024-03-04T06:43:20.646 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[26846]: [04/Mar/2024:06:43:19] ENGINE Bus STARTED 2024-03-04T06:43:20.646 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[26846]: osdmap e144: 8 total, 8 up, 8 in 2024-03-04T06:43:20.646 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-mon[26846]: osdmap e145: 8 total, 8 up, 8 in 2024-03-04T06:43:20.659 INFO:tasks.rados.rados.0.smithi137.stdout:413: finishing write tid 3 to smithi13777483-32 2024-03-04T06:43:20.659 INFO:tasks.rados.rados.0.smithi137.stdout:413: finishing write tid 4 to smithi13777483-32 2024-03-04T06:43:20.659 INFO:tasks.rados.rados.0.smithi137.stdout:413: finishing write tid 5 to smithi13777483-32 2024-03-04T06:43:20.659 INFO:tasks.rados.rados.0.smithi137.stdout:412: done (5 left) 2024-03-04T06:43:20.659 INFO:tasks.rados.rados.0.smithi137.stdout:419: done (4 left) 2024-03-04T06:43:20.659 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 41 current snap is 40 2024-03-04T06:43:20.659 INFO:tasks.rados.rados.0.smithi137.stdout:416: finishing write tid 2 to smithi13777483-31 2024-03-04T06:43:20.659 INFO:tasks.rados.rados.0.smithi137.stdout:413: finishing write tid 6 to smithi13777483-32 2024-03-04T06:43:20.659 INFO:tasks.rados.rados.0.smithi137.stdout:413: oid 32 updating version 0 to 245 2024-03-04T06:43:20.659 INFO:tasks.rados.rados.0.smithi137.stdout:413: oid 32 version 245 is already newer than 240 2024-03-04T06:43:20.659 INFO:tasks.rados.rados.0.smithi137.stdout:413: oid 32 updating version 245 to 247 2024-03-04T06:43:20.659 INFO:tasks.rados.rados.0.smithi137.stdout:413: oid 32 version 247 is already newer than 246 2024-03-04T06:43:20.659 INFO:tasks.rados.rados.0.smithi137.stdout:413: oid 32 updating version 247 to 248 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 248 (ObjNum 140 snap 40 seq_num 140) dirty exists 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:413: left oid 32 (ObjNum 140 snap 40 seq_num 140) 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:420: seq_num 145 ranges {0=32768} 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:420: writing smithi13777483-41 from 0 to 32768 tid 1 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:413: done (4 left) 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:421: setattr oid 49 current snap is 40 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:416: finishing write tid 3 to smithi13777483-31 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:416: finishing write tid 4 to smithi13777483-31 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:416: finishing write tid 5 to smithi13777483-31 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:416: finishing write tid 6 to smithi13777483-31 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:416: oid 31 updating version 0 to 134 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:416: oid 31 updating version 134 to 138 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:416: oid 31 version 138 is already newer than 136 2024-03-04T06:43:20.660 INFO:tasks.rados.rados.0.smithi137.stdout:416: oid 31 version 138 is already newer than 135 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:416: oid 31 version 138 is already newer than 137 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 138 (ObjNum 141 snap 40 seq_num 141) dirty exists 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:416: left oid 31 (ObjNum 141 snap 40 seq_num 141) 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:417: finishing write tid 1 to smithi13777483-30 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:417: finishing write tid 2 to smithi13777483-30 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:417: finishing write tid 3 to smithi13777483-30 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:417: finishing write tid 4 to smithi13777483-30 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:417: finishing write tid 5 to smithi13777483-30 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:417: finishing write tid 6 to smithi13777483-30 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:417: oid 30 updating version 0 to 74 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:417: oid 30 updating version 74 to 76 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:417: oid 30 updating version 76 to 78 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:417: oid 30 version 78 is already newer than 75 2024-03-04T06:43:20.661 INFO:tasks.rados.rados.0.smithi137.stdout:417: oid 30 version 78 is already newer than 77 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 78 (ObjNum 142 snap 40 seq_num 142) dirty exists 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:417: left oid 30 (ObjNum 142 snap 40 seq_num 142) 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:418: finishing write tid 1 to smithi13777483-28 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:418: finishing write tid 2 to smithi13777483-28 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:418: finishing write tid 3 to smithi13777483-28 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:418: finishing write tid 4 to smithi13777483-28 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:418: finishing write tid 5 to smithi13777483-28 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:418: finishing write tid 6 to smithi13777483-28 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:418: oid 28 updating version 0 to 204 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:418: oid 28 version 204 is already newer than 203 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:418: oid 28 version 204 is already newer than 201 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:418: oid 28 version 204 is already newer than 202 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:418: oid 28 updating version 204 to 205 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 205 (ObjNum 143 snap 40 seq_num 143) dirty exists 2024-03-04T06:43:20.662 INFO:tasks.rados.rados.0.smithi137.stdout:418: left oid 28 (ObjNum 143 snap 40 seq_num 143) 2024-03-04T06:43:20.663 INFO:tasks.rados.rados.0.smithi137.stdout:416: done (4 left) 2024-03-04T06:43:20.663 INFO:tasks.rados.rados.0.smithi137.stdout:417: done (3 left) 2024-03-04T06:43:20.663 INFO:tasks.rados.rados.0.smithi137.stdout:418: done (2 left) 2024-03-04T06:43:20.663 INFO:tasks.rados.rados.0.smithi137.stdout:422: read oid 14 snap -1 2024-03-04T06:43:20.663 INFO:tasks.rados.rados.0.smithi137.stdout:422: expect (ObjNum 99 snap 19 seq_num 99) 2024-03-04T06:43:20.663 INFO:tasks.rados.rados.0.smithi137.stdout:423: snap_create 2024-03-04T06:43:20.664 INFO:tasks.rados.rados.0.smithi137.stdout:420: finishing write tid 1 to smithi13777483-41 2024-03-04T06:43:20.664 INFO:tasks.rados.rados.0.smithi137.stdout:420: finishing write tid 2 to smithi13777483-41 2024-03-04T06:43:20.664 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 139 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-03-04T06:43:20.664 INFO:tasks.rados.rados.0.smithi137.stdout:420: finishing write tid 3 to smithi13777483-41 2024-03-04T06:43:20.664 INFO:tasks.rados.rados.0.smithi137.stdout:420: oid 41 updating version 0 to 91 2024-03-04T06:43:20.664 INFO:tasks.rados.rados.0.smithi137.stdout:420: oid 41 version 91 is already newer than 90 2024-03-04T06:43:20.664 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 91 (ObjNum 145 snap 40 seq_num 145) dirty exists 2024-03-04T06:43:20.664 INFO:tasks.rados.rados.0.smithi137.stdout:420: left oid 41 (ObjNum 145 snap 40 seq_num 145) 2024-03-04T06:43:20.669 INFO:tasks.rados.rados.0.smithi137.stdout:422: expect (ObjNum 99 snap 19 seq_num 99) 2024-03-04T06:43:20.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:20 smithi203 ceph-mon[30756]: Deploying cephadm binary to smithi203 2024-03-04T06:43:20.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:20 smithi203 ceph-mon[30756]: Deploying cephadm binary to smithi137 2024-03-04T06:43:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:20 smithi203 ceph-mon[30756]: [04/Mar/2024:06:43:19] ENGINE Bus STARTING 2024-03-04T06:43:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:20 smithi203 ceph-mon[30756]: [04/Mar/2024:06:43:19] ENGINE Serving on http://172.21.15.203:8765 2024-03-04T06:43:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:20 smithi203 ceph-mon[30756]: pgmap v4: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 149 MiB data, 499 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:20 smithi203 ceph-mon[30756]: [04/Mar/2024:06:43:19] ENGINE Serving on https://172.21.15.203:7150 2024-03-04T06:43:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:20 smithi203 ceph-mon[30756]: [04/Mar/2024:06:43:19] ENGINE Bus STARTED 2024-03-04T06:43:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:20 smithi203 ceph-mon[30756]: osdmap e144: 8 total, 8 up, 8 in 2024-03-04T06:43:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:20 smithi203 ceph-mon[30756]: osdmap e145: 8 total, 8 up, 8 in 2024-03-04T06:43:21.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:20.643+0000 7fc0cf0ec200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T06:43:21.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:20.848+0000 7fc0cf0ec200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T06:43:21.394 INFO:tasks.rados.rados.0.smithi137.stdout:420: done (3 left) 2024-03-04T06:43:21.394 INFO:tasks.rados.rados.0.smithi137.stdout:421: done (2 left) 2024-03-04T06:43:21.394 INFO:tasks.rados.rados.0.smithi137.stdout:422: done (1 left) 2024-03-04T06:43:21.394 INFO:tasks.rados.rados.0.smithi137.stdout:423: done (0 left) 2024-03-04T06:43:21.395 INFO:tasks.rados.rados.0.smithi137.stdout:424: delete oid 27 current snap is 41 2024-03-04T06:43:21.397 INFO:tasks.rados.rados.0.smithi137.stdout:424: done (0 left) 2024-03-04T06:43:21.397 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 41 2024-03-04T06:43:21.397 INFO:tasks.rados.rados.0.smithi137.stdout:425: seq_num 147 ranges {1245184=65536} 2024-03-04T06:43:21.404 INFO:tasks.rados.rados.0.smithi137.stdout:425: writing smithi13777483-3 from 1245184 to 1310720 tid 1 2024-03-04T06:43:21.405 INFO:tasks.rados.rados.0.smithi137.stdout:426: snap_create 2024-03-04T06:43:21.408 INFO:tasks.rados.rados.0.smithi137.stdout:425: finishing write tid 1 to smithi13777483-3 2024-03-04T06:43:21.408 INFO:tasks.rados.rados.0.smithi137.stdout:425: finishing write tid 2 to smithi13777483-3 2024-03-04T06:43:21.409 INFO:tasks.rados.rados.0.smithi137.stdout:425: finishing write tid 3 to smithi13777483-3 2024-03-04T06:43:21.409 INFO:tasks.rados.rados.0.smithi137.stdout:425: oid 3 updating version 0 to 218 2024-03-04T06:43:21.409 INFO:tasks.rados.rados.0.smithi137.stdout:425: oid 3 version 218 is already newer than 217 2024-03-04T06:43:21.409 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 218 (ObjNum 147 snap 41 seq_num 147) dirty exists 2024-03-04T06:43:21.410 INFO:tasks.rados.rados.0.smithi137.stdout:425: left oid 3 (ObjNum 147 snap 41 seq_num 147) 2024-03-04T06:43:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:21 smithi137 ceph-mon[26846]: pgmap v6: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 149 MiB data, 499 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:21 smithi137 ceph-mon[37364]: pgmap v6: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 149 MiB data, 499 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:21.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:21 smithi203 ceph-mon[30756]: pgmap v6: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 149 MiB data, 499 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:22.274 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:21.809+0000 7fc0cf0ec200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T06:43:22.274 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:21.939+0000 7fc0cf0ec200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T06:43:22.402 INFO:tasks.rados.rados.0.smithi137.stdout:425: done (1 left) 2024-03-04T06:43:22.402 INFO:tasks.rados.rados.0.smithi137.stdout:426: done (0 left) 2024-03-04T06:43:22.402 INFO:tasks.rados.rados.0.smithi137.stdout:427: rollback oid 27 current snap is 42 2024-03-04T06:43:22.402 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 27 to 41 2024-03-04T06:43:22.403 INFO:tasks.rados.rados.0.smithi137.stdout:428: setattr oid 20 current snap is 42 2024-03-04T06:43:22.404 INFO:tasks.rados.rados.0.smithi137.stdout:427: finishing rollback tid 1 to smithi13777483-27 2024-03-04T06:43:22.404 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 254 (ObjNum -1164332336 snap 21906 seq_num 304) dirty dne 2024-03-04T06:43:22.406 INFO:tasks.rados.rados.0.smithi137.stdout:427: done (1 left) 2024-03-04T06:43:22.406 INFO:tasks.rados.rados.0.smithi137.stdout:429: snap_create 2024-03-04T06:43:22.409 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 118 (ObjNum 33 snap 0 seq_num 3130741264) dirty exists 2024-03-04T06:43:22.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:22 smithi137 ceph-mon[26846]: mgrmap e26: x(active, since 3s) 2024-03-04T06:43:22.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:22 smithi137 ceph-mon[26846]: osdmap e146: 8 total, 8 up, 8 in 2024-03-04T06:43:22.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:22 smithi137 ceph-mon[37364]: mgrmap e26: x(active, since 3s) 2024-03-04T06:43:22.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:22 smithi137 ceph-mon[37364]: osdmap e146: 8 total, 8 up, 8 in 2024-03-04T06:43:22.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:22.273+0000 7fc0cf0ec200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T06:43:22.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:22.364+0000 7fc0cf0ec200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T06:43:22.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:22 smithi203 ceph-mon[30756]: mgrmap e26: x(active, since 3s) 2024-03-04T06:43:22.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:22 smithi203 ceph-mon[30756]: osdmap e146: 8 total, 8 up, 8 in 2024-03-04T06:43:23.032 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:22.564+0000 7fc0cf0ec200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:43:23.032 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:22.748+0000 7fc0cf0ec200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T06:43:23.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:23.031+0000 7fc0cf0ec200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:43:23.403 INFO:tasks.rados.rados.0.smithi137.stdout:428: done (1 left) 2024-03-04T06:43:23.403 INFO:tasks.rados.rados.0.smithi137.stdout:429: done (0 left) 2024-03-04T06:43:23.403 INFO:tasks.rados.rados.0.smithi137.stdout:430: read oid 46 snap -1 2024-03-04T06:43:23.403 INFO:tasks.rados.rados.0.smithi137.stdout:430: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:43:23.404 INFO:tasks.rados.rados.0.smithi137.stdout:431: snap_remove snap 30 2024-03-04T06:43:23.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:23 smithi137 ceph-mon[26846]: pgmap v9: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 149 MiB data, 499 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:23.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:23 smithi137 ceph-mon[26846]: osdmap e147: 8 total, 8 up, 8 in 2024-03-04T06:43:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:23 smithi137 ceph-mon[37364]: pgmap v9: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 149 MiB data, 499 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:23 smithi137 ceph-mon[37364]: osdmap e147: 8 total, 8 up, 8 in 2024-03-04T06:43:23.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:23.293+0000 7fc0cf0ec200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T06:43:23.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:23.537+0000 7fc0cf0ec200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T06:43:23.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:23 smithi203 ceph-mon[30756]: pgmap v9: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 149 MiB data, 499 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:23 smithi203 ceph-mon[30756]: osdmap e147: 8 total, 8 up, 8 in 2024-03-04T06:43:24.408 INFO:tasks.rados.rados.0.smithi137.stdout:431: done (1 left) 2024-03-04T06:43:24.409 INFO:tasks.rados.rados.0.smithi137.stdout:432: read oid 12 snap -1 2024-03-04T06:43:24.409 INFO:tasks.rados.rados.0.smithi137.stdout:432: expect (ObjNum 139 snap 40 seq_num 139) 2024-03-04T06:43:24.409 INFO:tasks.rados.rados.0.smithi137.stdout:433: read oid 38 snap 42 2024-03-04T06:43:24.409 INFO:tasks.rados.rados.0.smithi137.stdout:433: expect (ObjNum 116 snap 30 seq_num 116) 2024-03-04T06:43:24.409 INFO:tasks.rados.rados.0.smithi137.stdout:434: rollback oid 16 current snap is 43 2024-03-04T06:43:24.409 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 16 to 27 2024-03-04T06:43:24.409 INFO:tasks.rados.rados.0.smithi137.stdout:435: rmattr oid 47 current snap is 43 2024-03-04T06:43:24.409 INFO:tasks.rados.rados.0.smithi137.stdout:436: snap_remove snap 19 2024-03-04T06:43:24.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:24 smithi203 ceph-mon[30756]: osdmap e148: 8 total, 8 up, 8 in 2024-03-04T06:43:24.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:24 smithi137 ceph-mon[26846]: osdmap e148: 8 total, 8 up, 8 in 2024-03-04T06:43:24.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:24.435+0000 7fc0cf0ec200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T06:43:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:24 smithi137 ceph-mon[37364]: osdmap e148: 8 total, 8 up, 8 in 2024-03-04T06:43:25.396 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:25.066+0000 7fc0cf0ec200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T06:43:25.396 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:25.173+0000 7fc0cf0ec200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T06:43:25.396 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:25.395+0000 7fc0cf0ec200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T06:43:25.422 INFO:tasks.rados.rados.0.smithi137.stdout:436: done (5 left) 2024-03-04T06:43:25.422 INFO:tasks.rados.rados.0.smithi137.stdout:437: read oid 10 snap 41 2024-03-04T06:43:25.422 INFO:tasks.rados.rados.0.smithi137.stdout:437: expect (ObjNum 79 snap 11 seq_num 79) 2024-03-04T06:43:25.423 INFO:tasks.rados.rados.0.smithi137.stdout:438: delete oid 44 current snap is 43 2024-03-04T06:43:25.423 INFO:tasks.rados.rados.0.smithi137.stdout:430: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:43:25.456 INFO:tasks.rados.rados.0.smithi137.stdout:434: finishing rollback tid 0 to smithi13777483-16 2024-03-04T06:43:25.456 INFO:tasks.rados.rados.0.smithi137.stdout:434: finishing rollback tid 1 to smithi13777483-16 2024-03-04T06:43:25.456 INFO:tasks.rados.rados.0.smithi137.stdout:430: done (6 left) 2024-03-04T06:43:25.456 INFO:tasks.rados.rados.0.smithi137.stdout:438: done (5 left) 2024-03-04T06:43:25.456 INFO:tasks.rados.rados.0.smithi137.stdout:439: copy_from oid 13 from oid 26 current snap is 43 2024-03-04T06:43:25.456 INFO:tasks.rados.rados.0.smithi137.stdout:434: finishing rollback tid 2 to smithi13777483-16 2024-03-04T06:43:25.456 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 131 (ObjNum 101 snap 21 seq_num 101) dirty exists 2024-03-04T06:43:25.456 INFO:tasks.rados.rados.0.smithi137.stdout:433: expect (ObjNum 116 snap 30 seq_num 116) 2024-03-04T06:43:25.597 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 213 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:43:25.597 INFO:tasks.rados.rados.0.smithi137.stdout:432: expect (ObjNum 139 snap 40 seq_num 139) 2024-03-04T06:43:25.655 INFO:tasks.rados.rados.0.smithi137.stdout:437: expect (ObjNum 79 snap 11 seq_num 79) 2024-03-04T06:43:25.767 INFO:tasks.rados.rados.0.smithi137.stdout:439: finishing copy_from racing read to smithi13777483-13 2024-03-04T06:43:25.768 INFO:tasks.rados.rados.0.smithi137.stdout:439: finishing copy_from to smithi13777483-13 2024-03-04T06:43:25.768 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 103 (ObjNum 129 snap 0 seq_num 3131263328) dirty exists 2024-03-04T06:43:25.768 INFO:tasks.rados.rados.0.smithi137.stdout:432: done (5 left) 2024-03-04T06:43:25.768 INFO:tasks.rados.rados.0.smithi137.stdout:433: done (4 left) 2024-03-04T06:43:25.768 INFO:tasks.rados.rados.0.smithi137.stdout:434: done (3 left) 2024-03-04T06:43:25.768 INFO:tasks.rados.rados.0.smithi137.stdout:435: done (2 left) 2024-03-04T06:43:25.768 INFO:tasks.rados.rados.0.smithi137.stdout:437: done (1 left) 2024-03-04T06:43:25.768 INFO:tasks.rados.rados.0.smithi137.stdout:439: done (0 left) 2024-03-04T06:43:25.768 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 43 2024-03-04T06:43:25.768 INFO:tasks.rados.rados.0.smithi137.stdout:440: seq_num 149 ranges {221184=98304} 2024-03-04T06:43:25.769 INFO:tasks.rados.rados.0.smithi137.stdout:440: writing smithi13777483-6 from 221184 to 319488 tid 1 2024-03-04T06:43:25.769 INFO:tasks.rados.rados.0.smithi137.stdout:441: rmattr oid 37 current snap is 43 2024-03-04T06:43:25.769 INFO:tasks.rados.rados.0.smithi137.stdout:441: done (1 left) 2024-03-04T06:43:25.769 INFO:tasks.rados.rados.0.smithi137.stdout:442: delete oid 3 current snap is 43 2024-03-04T06:43:25.772 INFO:tasks.rados.rados.0.smithi137.stdout:442: done (1 left) 2024-03-04T06:43:25.772 INFO:tasks.rados.rados.0.smithi137.stdout:443: read oid 29 snap -1 2024-03-04T06:43:25.772 INFO:tasks.rados.rados.0.smithi137.stdout:443: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-04T06:43:25.772 INFO:tasks.rados.rados.0.smithi137.stdout:444: delete oid 48 current snap is 43 2024-03-04T06:43:25.772 INFO:tasks.rados.rados.0.smithi137.stdout:440: finishing write tid 1 to smithi13777483-6 2024-03-04T06:43:25.772 INFO:tasks.rados.rados.0.smithi137.stdout:440: finishing write tid 2 to smithi13777483-6 2024-03-04T06:43:25.774 INFO:tasks.rados.rados.0.smithi137.stdout:440: finishing write tid 3 to smithi13777483-6 2024-03-04T06:43:25.774 INFO:tasks.rados.rados.0.smithi137.stdout:440: oid 6 updating version 0 to 194 2024-03-04T06:43:25.774 INFO:tasks.rados.rados.0.smithi137.stdout:440: oid 6 updating version 194 to 195 2024-03-04T06:43:25.774 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 195 (ObjNum 149 snap 43 seq_num 149) dirty exists 2024-03-04T06:43:25.774 INFO:tasks.rados.rados.0.smithi137.stdout:440: left oid 6 (ObjNum 149 snap 43 seq_num 149) 2024-03-04T06:43:25.774 INFO:tasks.rados.rados.0.smithi137.stdout:440: done (2 left) 2024-03-04T06:43:25.774 INFO:tasks.rados.rados.0.smithi137.stdout:444: done (1 left) 2024-03-04T06:43:25.774 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 43 2024-03-04T06:43:25.774 INFO:tasks.rados.rados.0.smithi137.stdout:445: seq_num 152 ranges {4833280=147456} 2024-03-04T06:43:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-mon[26846]: pgmap v12: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 149 MiB data, 499 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-mon[26846]: osdmap e149: 8 total, 8 up, 8 in 2024-03-04T06:43:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-mon[26846]: Standby manager daemon y started 2024-03-04T06:43:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.137:0/3032065030' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-04T06:43:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-mon[26846]: osdmap e150: 8 total, 8 up, 8 in 2024-03-04T06:43:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.137:0/3032065030' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:43:25.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:43:25] ENGINE Bus STARTING 2024-03-04T06:43:25.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: CherryPy Checker: 2024-03-04T06:43:25.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: The Application mounted at '' has an empty config. 2024-03-04T06:43:25.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: 2024-03-04T06:43:25.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:43:25] ENGINE Serving on http://:::9283 2024-03-04T06:43:25.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: [04/Mar/2024:06:43:25] ENGINE Bus STARTED 2024-03-04T06:43:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-mon[37364]: pgmap v12: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 149 MiB data, 499 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-mon[37364]: osdmap e149: 8 total, 8 up, 8 in 2024-03-04T06:43:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-mon[37364]: Standby manager daemon y started 2024-03-04T06:43:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.137:0/3032065030' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-04T06:43:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-mon[37364]: osdmap e150: 8 total, 8 up, 8 in 2024-03-04T06:43:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:25 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.137:0/3032065030' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:43:25.801 INFO:tasks.rados.rados.0.smithi137.stdout:445: writing smithi13777483-39 from 4833280 to 4980736 tid 1 2024-03-04T06:43:25.801 INFO:tasks.rados.rados.0.smithi137.stdout:446: read oid 35 snap -1 2024-03-04T06:43:25.802 INFO:tasks.rados.rados.0.smithi137.stdout:446: expect (ObjNum 117 snap 30 seq_num 117) 2024-03-04T06:43:25.802 INFO:tasks.rados.rados.0.smithi137.stdout:447: setattr oid 23 current snap is 43 2024-03-04T06:43:25.802 INFO:tasks.rados.rados.0.smithi137.stdout:443: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-04T06:43:25.833 INFO:tasks.rados.rados.0.smithi137.stdout:445: finishing write tid 1 to smithi13777483-39 2024-03-04T06:43:25.833 INFO:tasks.rados.rados.0.smithi137.stdout:445: finishing write tid 2 to smithi13777483-39 2024-03-04T06:43:25.833 INFO:tasks.rados.rados.0.smithi137.stdout:445: finishing write tid 3 to smithi13777483-39 2024-03-04T06:43:25.833 INFO:tasks.rados.rados.0.smithi137.stdout:445: oid 39 updating version 0 to 68 2024-03-04T06:43:25.833 INFO:tasks.rados.rados.0.smithi137.stdout:445: oid 39 version 68 is already newer than 67 2024-03-04T06:43:25.833 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 68 (ObjNum 152 snap 43 seq_num 152) dirty exists 2024-03-04T06:43:25.834 INFO:tasks.rados.rados.0.smithi137.stdout:445: left oid 39 (ObjNum 152 snap 43 seq_num 152) 2024-03-04T06:43:25.834 INFO:tasks.rados.rados.0.smithi137.stdout:446: expect (ObjNum 117 snap 30 seq_num 117) 2024-03-04T06:43:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:25 smithi203 ceph-mon[30756]: pgmap v12: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 149 MiB data, 499 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:25 smithi203 ceph-mon[30756]: osdmap e149: 8 total, 8 up, 8 in 2024-03-04T06:43:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:25 smithi203 ceph-mon[30756]: Standby manager daemon y started 2024-03-04T06:43:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:25 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.137:0/3032065030' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-04T06:43:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:25 smithi203 ceph-mon[30756]: osdmap e150: 8 total, 8 up, 8 in 2024-03-04T06:43:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:25 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.137:0/3032065030' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:43:25.888 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 126 (ObjNum 104 snap 25 seq_num 104) dirty exists 2024-03-04T06:43:25.888 INFO:tasks.rados.rados.0.smithi137.stdout:443: done (3 left) 2024-03-04T06:43:25.888 INFO:tasks.rados.rados.0.smithi137.stdout:445: done (2 left) 2024-03-04T06:43:25.889 INFO:tasks.rados.rados.0.smithi137.stdout:446: done (1 left) 2024-03-04T06:43:25.889 INFO:tasks.rados.rados.0.smithi137.stdout:447: done (0 left) 2024-03-04T06:43:25.889 INFO:tasks.rados.rados.0.smithi137.stdout:448: read oid 30 snap 26 2024-03-04T06:43:25.889 INFO:tasks.rados.rados.0.smithi137.stdout:448: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:43:25.889 INFO:tasks.rados.rados.0.smithi137.stdout:449: delete oid 4 current snap is 43 2024-03-04T06:43:25.889 INFO:tasks.rados.rados.0.smithi137.stdout:449: done (1 left) 2024-03-04T06:43:25.889 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 43 2024-03-04T06:43:25.889 INFO:tasks.rados.rados.0.smithi137.stdout:450: seq_num 154 ranges {0=180224} 2024-03-04T06:43:25.890 INFO:tasks.rados.rados.0.smithi137.stdout:450: writing smithi13777483-49 from 0 to 180224 tid 1 2024-03-04T06:43:25.890 INFO:tasks.rados.rados.0.smithi137.stdout:451: setattr oid 17 current snap is 43 2024-03-04T06:43:25.891 INFO:tasks.rados.rados.0.smithi137.stdout:452: read oid 38 snap -1 2024-03-04T06:43:25.891 INFO:tasks.rados.rados.0.smithi137.stdout:452: expect (ObjNum 116 snap 30 seq_num 116) 2024-03-04T06:43:25.892 INFO:tasks.rados.rados.0.smithi137.stdout:453: read oid 33 snap -1 2024-03-04T06:43:25.892 INFO:tasks.rados.rados.0.smithi137.stdout:453: expect (ObjNum 103 snap 22 seq_num 103) 2024-03-04T06:43:25.892 INFO:tasks.rados.rados.0.smithi137.stdout:454: copy_from oid 45 from oid 12 current snap is 43 2024-03-04T06:43:25.892 INFO:tasks.rados.rados.0.smithi137.stdout:455: snap_create 2024-03-04T06:43:25.893 INFO:tasks.rados.rados.0.smithi137.stdout:448: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:43:25.915 INFO:tasks.rados.rados.0.smithi137.stdout:450: finishing write tid 1 to smithi13777483-49 2024-03-04T06:43:25.915 INFO:tasks.rados.rados.0.smithi137.stdout:450: finishing write tid 2 to smithi13777483-49 2024-03-04T06:43:25.915 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 101 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-03-04T06:43:25.915 INFO:tasks.rados.rados.0.smithi137.stdout:450: finishing write tid 3 to smithi13777483-49 2024-03-04T06:43:25.915 INFO:tasks.rados.rados.0.smithi137.stdout:450: oid 49 updating version 0 to 150 2024-03-04T06:43:25.915 INFO:tasks.rados.rados.0.smithi137.stdout:450: oid 49 version 150 is already newer than 149 2024-03-04T06:43:25.915 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 150 (ObjNum 154 snap 43 seq_num 154) dirty exists 2024-03-04T06:43:25.916 INFO:tasks.rados.rados.0.smithi137.stdout:450: left oid 49 (ObjNum 154 snap 43 seq_num 154) 2024-03-04T06:43:25.916 INFO:tasks.rados.rados.0.smithi137.stdout:454: finishing copy_from racing read to smithi13777483-45 2024-03-04T06:43:25.916 INFO:tasks.rados.rados.0.smithi137.stdout:454: finishing copy_from to smithi13777483-45 2024-03-04T06:43:25.916 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 62 (ObjNum 139 snap 40 seq_num 139) dirty exists 2024-03-04T06:43:25.916 INFO:tasks.rados.rados.0.smithi137.stdout:452: expect (ObjNum 116 snap 30 seq_num 116) 2024-03-04T06:43:26.053 INFO:tasks.rados.rados.0.smithi137.stdout:453: expect (ObjNum 103 snap 22 seq_num 103) 2024-03-04T06:43:26.443 INFO:tasks.rados.rados.0.smithi137.stdout:448: done (6 left) 2024-03-04T06:43:26.443 INFO:tasks.rados.rados.0.smithi137.stdout:450: done (5 left) 2024-03-04T06:43:26.443 INFO:tasks.rados.rados.0.smithi137.stdout:451: done (4 left) 2024-03-04T06:43:26.443 INFO:tasks.rados.rados.0.smithi137.stdout:452: done (3 left) 2024-03-04T06:43:26.443 INFO:tasks.rados.rados.0.smithi137.stdout:453: done (2 left) 2024-03-04T06:43:26.444 INFO:tasks.rados.rados.0.smithi137.stdout:454: done (1 left) 2024-03-04T06:43:26.444 INFO:tasks.rados.rados.0.smithi137.stdout:455: done (0 left) 2024-03-04T06:43:26.444 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 44 2024-03-04T06:43:26.444 INFO:tasks.rados.rados.0.smithi137.stdout:456: seq_num 155 ranges {2342912=204800} 2024-03-04T06:43:26.457 INFO:tasks.rados.rados.0.smithi137.stdout:456: writing smithi13777483-12 from 2342912 to 2547712 tid 1 2024-03-04T06:43:26.457 INFO:tasks.rados.rados.0.smithi137.stdout:457: read oid 9 snap -1 2024-03-04T06:43:26.457 INFO:tasks.rados.rados.0.smithi137.stdout:457: expect deleted 2024-03-04T06:43:26.457 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 44 2024-03-04T06:43:26.457 INFO:tasks.rados.rados.0.smithi137.stdout:458: seq_num 156 ranges {0=221184} 2024-03-04T06:43:26.459 INFO:tasks.rados.rados.0.smithi137.stdout:458: writing smithi13777483-26 from 0 to 221184 tid 1 2024-03-04T06:43:26.459 INFO:tasks.rados.rados.0.smithi137.stdout:459: snap_create 2024-03-04T06:43:26.462 INFO:tasks.rados.rados.0.smithi137.stdout:458: finishing write tid 1 to smithi13777483-26 2024-03-04T06:43:26.463 INFO:tasks.rados.rados.0.smithi137.stdout:458: finishing write tid 2 to smithi13777483-26 2024-03-04T06:43:26.465 INFO:tasks.rados.rados.0.smithi137.stdout:456: finishing write tid 1 to smithi13777483-12 2024-03-04T06:43:26.465 INFO:tasks.rados.rados.0.smithi137.stdout:458: finishing write tid 3 to smithi13777483-26 2024-03-04T06:43:26.465 INFO:tasks.rados.rados.0.smithi137.stdout:458: oid 26 updating version 0 to 115 2024-03-04T06:43:26.465 INFO:tasks.rados.rados.0.smithi137.stdout:458: oid 26 updating version 115 to 116 2024-03-04T06:43:26.465 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 116 (ObjNum 156 snap 44 seq_num 156) dirty exists 2024-03-04T06:43:26.465 INFO:tasks.rados.rados.0.smithi137.stdout:458: left oid 26 (ObjNum 156 snap 44 seq_num 156) 2024-03-04T06:43:26.465 INFO:tasks.rados.rados.0.smithi137.stdout:456: finishing write tid 2 to smithi13777483-12 2024-03-04T06:43:26.465 INFO:tasks.rados.rados.0.smithi137.stdout:456: finishing write tid 3 to smithi13777483-12 2024-03-04T06:43:26.465 INFO:tasks.rados.rados.0.smithi137.stdout:456: oid 12 updating version 0 to 88 2024-03-04T06:43:26.466 INFO:tasks.rados.rados.0.smithi137.stdout:456: oid 12 updating version 88 to 89 2024-03-04T06:43:26.466 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 89 (ObjNum 155 snap 44 seq_num 155) dirty exists 2024-03-04T06:43:26.466 INFO:tasks.rados.rados.0.smithi137.stdout:456: left oid 12 (ObjNum 155 snap 44 seq_num 155) 2024-03-04T06:43:26.704 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:26 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.137:0/3032065030' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-04T06:43:26.704 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:26 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.137:0/3032065030' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:43:26.704 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:26 smithi203 ceph-mon[30756]: mgrmap e27: x(active, since 8s), standbys: y 2024-03-04T06:43:26.704 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:26 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:43:26.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:26 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.137:0/3032065030' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-04T06:43:26.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:26 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.137:0/3032065030' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:43:26.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:26 smithi137 ceph-mon[26846]: mgrmap e27: x(active, since 8s), standbys: y 2024-03-04T06:43:26.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:26 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:43:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:26 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.137:0/3032065030' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-04T06:43:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:26 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.137:0/3032065030' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:43:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:26 smithi137 ceph-mon[37364]: mgrmap e27: x(active, since 8s), standbys: y 2024-03-04T06:43:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:26 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:43:27.456 INFO:tasks.rados.rados.0.smithi137.stdout:456: done (3 left) 2024-03-04T06:43:27.457 INFO:tasks.rados.rados.0.smithi137.stdout:457: done (2 left) 2024-03-04T06:43:27.457 INFO:tasks.rados.rados.0.smithi137.stdout:458: done (1 left) 2024-03-04T06:43:27.457 INFO:tasks.rados.rados.0.smithi137.stdout:459: done (0 left) 2024-03-04T06:43:27.457 INFO:tasks.rados.rados.0.smithi137.stdout:460: copy_from oid 15 from oid 40 current snap is 45 2024-03-04T06:43:27.457 INFO:tasks.rados.rados.0.smithi137.stdout:461: read oid 7 snap 37 2024-03-04T06:43:27.457 INFO:tasks.rados.rados.0.smithi137.stdout:461: expect (ObjNum 6 snap 0 seq_num 6) 2024-03-04T06:43:27.457 INFO:tasks.rados.rados.0.smithi137.stdout:462: rollback oid 31 current snap is 45 2024-03-04T06:43:27.457 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 31 to 42 2024-03-04T06:43:27.457 INFO:tasks.rados.rados.0.smithi137.stdout:463: delete oid 35 current snap is 45 2024-03-04T06:43:27.459 INFO:tasks.rados.rados.0.smithi137.stdout:461: expect (ObjNum 6 snap 0 seq_num 6) 2024-03-04T06:43:27.464 INFO:tasks.rados.rados.0.smithi137.stdout:461: done (3 left) 2024-03-04T06:43:27.464 INFO:tasks.rados.rados.0.smithi137.stdout:463: done (2 left) 2024-03-04T06:43:27.464 INFO:tasks.rados.rados.0.smithi137.stdout:464: read oid 8 snap -1 2024-03-04T06:43:27.464 INFO:tasks.rados.rados.0.smithi137.stdout:464: expect (ObjNum 135 snap 39 seq_num 135) 2024-03-04T06:43:27.464 INFO:tasks.rados.rados.0.smithi137.stdout:465: rollback oid 5 current snap is 45 2024-03-04T06:43:27.465 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 5 to 40 2024-03-04T06:43:27.465 INFO:tasks.rados.rados.0.smithi137.stdout:460: finishing copy_from racing read to smithi13777483-15 2024-03-04T06:43:27.465 INFO:tasks.rados.rados.0.smithi137.stdout:462: finishing rollback tid 0 to smithi13777483-31 2024-03-04T06:43:27.465 INFO:tasks.rados.rados.0.smithi137.stdout:462: finishing rollback tid 1 to smithi13777483-31 2024-03-04T06:43:27.465 INFO:tasks.rados.rados.0.smithi137.stdout:462: finishing rollback tid 2 to smithi13777483-31 2024-03-04T06:43:27.465 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 154 (ObjNum 141 snap 40 seq_num 141) dirty exists 2024-03-04T06:43:27.465 INFO:tasks.rados.rados.0.smithi137.stdout:460: finishing copy_from to smithi13777483-15 2024-03-04T06:43:27.465 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 73 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-03-04T06:43:27.465 INFO:tasks.rados.rados.0.smithi137.stdout:460: done (3 left) 2024-03-04T06:43:27.465 INFO:tasks.rados.rados.0.smithi137.stdout:462: done (2 left) 2024-03-04T06:43:27.465 INFO:tasks.rados.rados.0.smithi137.stdout:466: delete oid 35 current snap is 45 2024-03-04T06:43:27.466 INFO:tasks.rados.rados.0.smithi137.stdout:466: done (2 left) 2024-03-04T06:43:27.466 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 45 2024-03-04T06:43:27.466 INFO:tasks.rados.rados.0.smithi137.stdout:467: seq_num 159 ranges {3153920=270336} 2024-03-04T06:43:27.483 INFO:tasks.rados.rados.0.smithi137.stdout:467: writing smithi13777483-30 from 3153920 to 3424256 tid 1 2024-03-04T06:43:27.483 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 45 2024-03-04T06:43:27.484 INFO:tasks.rados.rados.0.smithi137.stdout:468: seq_num 160 ranges {4980736=286720} 2024-03-04T06:43:27.513 INFO:tasks.rados.rados.0.smithi137.stdout:468: writing smithi13777483-39 from 4980736 to 5267456 tid 1 2024-03-04T06:43:27.513 INFO:tasks.rados.rados.0.smithi137.stdout:469: read oid 11 snap -1 2024-03-04T06:43:27.513 INFO:tasks.rados.rados.0.smithi137.stdout:469: expect deleted 2024-03-04T06:43:27.513 INFO:tasks.rados.rados.0.smithi137.stdout:470: read oid 34 snap -1 2024-03-04T06:43:27.513 INFO:tasks.rados.rados.0.smithi137.stdout:470: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:43:27.513 INFO:tasks.rados.rados.0.smithi137.stdout:471: copy_from oid 50 from oid 19 current snap is 45 2024-03-04T06:43:27.513 INFO:tasks.rados.rados.0.smithi137.stdout:465: finishing rollback tid 1 to smithi13777483-5 2024-03-04T06:43:27.513 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 191 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-04T06:43:27.514 INFO:tasks.rados.rados.0.smithi137.stdout:465: done (6 left) 2024-03-04T06:43:27.514 INFO:tasks.rados.rados.0.smithi137.stdout:472: rollback oid 18 current snap is 45 2024-03-04T06:43:27.514 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 18 to 39 2024-03-04T06:43:27.514 INFO:tasks.rados.rados.0.smithi137.stdout:464: expect (ObjNum 135 snap 39 seq_num 135) 2024-03-04T06:43:27.581 INFO:tasks.rados.rados.0.smithi137.stdout:467: finishing write tid 1 to smithi13777483-30 2024-03-04T06:43:27.581 INFO:tasks.rados.rados.0.smithi137.stdout:467: finishing write tid 2 to smithi13777483-30 2024-03-04T06:43:27.581 INFO:tasks.rados.rados.0.smithi137.stdout:467: finishing write tid 3 to smithi13777483-30 2024-03-04T06:43:27.581 INFO:tasks.rados.rados.0.smithi137.stdout:467: oid 30 updating version 0 to 91 2024-03-04T06:43:27.581 INFO:tasks.rados.rados.0.smithi137.stdout:467: oid 30 updating version 91 to 92 2024-03-04T06:43:27.581 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 92 (ObjNum 159 snap 45 seq_num 159) dirty exists 2024-03-04T06:43:27.581 INFO:tasks.rados.rados.0.smithi137.stdout:467: left oid 30 (ObjNum 159 snap 45 seq_num 159) 2024-03-04T06:43:27.581 INFO:tasks.rados.rados.0.smithi137.stdout:464: done (6 left) 2024-03-04T06:43:27.581 INFO:tasks.rados.rados.0.smithi137.stdout:467: done (5 left) 2024-03-04T06:43:27.582 INFO:tasks.rados.rados.0.smithi137.stdout:473: delete oid 4 current snap is 45 2024-03-04T06:43:27.582 INFO:tasks.rados.rados.0.smithi137.stdout:468: finishing write tid 1 to smithi13777483-39 2024-03-04T06:43:27.582 INFO:tasks.rados.rados.0.smithi137.stdout:468: finishing write tid 2 to smithi13777483-39 2024-03-04T06:43:27.582 INFO:tasks.rados.rados.0.smithi137.stdout:472: finishing rollback tid 0 to smithi13777483-18 2024-03-04T06:43:27.582 INFO:tasks.rados.rados.0.smithi137.stdout:472: finishing rollback tid 1 to smithi13777483-18 2024-03-04T06:43:27.582 INFO:tasks.rados.rados.0.smithi137.stdout:468: finishing write tid 3 to smithi13777483-39 2024-03-04T06:43:27.582 INFO:tasks.rados.rados.0.smithi137.stdout:468: oid 39 updating version 0 to 71 2024-03-04T06:43:27.582 INFO:tasks.rados.rados.0.smithi137.stdout:468: oid 39 version 71 is already newer than 70 2024-03-04T06:43:27.582 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 71 (ObjNum 160 snap 45 seq_num 160) dirty exists 2024-03-04T06:43:27.582 INFO:tasks.rados.rados.0.smithi137.stdout:468: left oid 39 (ObjNum 160 snap 45 seq_num 160) 2024-03-04T06:43:27.582 INFO:tasks.rados.rados.0.smithi137.stdout:472: finishing rollback tid 2 to smithi13777483-18 2024-03-04T06:43:27.582 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 120 (ObjNum 102 snap 21 seq_num 102) dirty exists 2024-03-04T06:43:27.582 INFO:tasks.rados.rados.0.smithi137.stdout:470: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:43:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:471: finishing copy_from racing read to smithi13777483-50 2024-03-04T06:43:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:471: finishing copy_from to smithi13777483-50 2024-03-04T06:43:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 135 (ObjNum 124 snap 34 seq_num 124) dirty exists 2024-03-04T06:43:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:468: done (5 left) 2024-03-04T06:43:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:469: done (4 left) 2024-03-04T06:43:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:470: done (3 left) 2024-03-04T06:43:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:471: done (2 left) 2024-03-04T06:43:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:472: done (1 left) 2024-03-04T06:43:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:473: done (0 left) 2024-03-04T06:43:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 28 current snap is 45 2024-03-04T06:43:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:474: seq_num 162 ranges {2408448=319488} 2024-03-04T06:43:27.618 INFO:tasks.rados.rados.0.smithi137.stdout:474: writing smithi13777483-28 from 2408448 to 2727936 tid 1 2024-03-04T06:43:27.618 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 45 2024-03-04T06:43:27.618 INFO:tasks.rados.rados.0.smithi137.stdout:475: seq_num 163 ranges {139264=335872} 2024-03-04T06:43:27.621 INFO:tasks.rados.rados.0.smithi137.stdout:475: writing smithi13777483-17 from 139264 to 475136 tid 1 2024-03-04T06:43:27.621 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 45 2024-03-04T06:43:27.621 INFO:tasks.rados.rados.0.smithi137.stdout:474: finishing write tid 1 to smithi13777483-28 2024-03-04T06:43:27.621 INFO:tasks.rados.rados.0.smithi137.stdout:474: finishing write tid 2 to smithi13777483-28 2024-03-04T06:43:27.621 INFO:tasks.rados.rados.0.smithi137.stdout:476: seq_num 164 ranges {2547712=352256} 2024-03-04T06:43:27.637 INFO:tasks.rados.rados.0.smithi137.stdout:476: writing smithi13777483-12 from 2547712 to 2899968 tid 1 2024-03-04T06:43:27.637 INFO:tasks.rados.rados.0.smithi137.stdout:477: read oid 34 snap -1 2024-03-04T06:43:27.637 INFO:tasks.rados.rados.0.smithi137.stdout:477: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:43:27.637 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 45 2024-03-04T06:43:27.637 INFO:tasks.rados.rados.0.smithi137.stdout:474: finishing write tid 3 to smithi13777483-28 2024-03-04T06:43:27.637 INFO:tasks.rados.rados.0.smithi137.stdout:474: oid 28 updating version 0 to 228 2024-03-04T06:43:27.637 INFO:tasks.rados.rados.0.smithi137.stdout:474: oid 28 version 228 is already newer than 227 2024-03-04T06:43:27.637 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 228 (ObjNum 162 snap 45 seq_num 162) dirty exists 2024-03-04T06:43:27.637 INFO:tasks.rados.rados.0.smithi137.stdout:474: left oid 28 (ObjNum 162 snap 45 seq_num 162) 2024-03-04T06:43:27.638 INFO:tasks.rados.rados.0.smithi137.stdout:475: finishing write tid 1 to smithi13777483-17 2024-03-04T06:43:27.638 INFO:tasks.rados.rados.0.smithi137.stdout:475: finishing write tid 2 to smithi13777483-17 2024-03-04T06:43:27.638 INFO:tasks.rados.rados.0.smithi137.stdout:478: seq_num 165 ranges {3891200=368640} 2024-03-04T06:43:27.660 INFO:tasks.rados.rados.0.smithi137.stdout:478: writing smithi13777483-38 from 3891200 to 4259840 tid 1 2024-03-04T06:43:27.660 INFO:tasks.rados.rados.0.smithi137.stdout:474: done (4 left) 2024-03-04T06:43:27.660 INFO:tasks.rados.rados.0.smithi137.stdout:479: read oid 15 snap 35 2024-03-04T06:43:27.660 INFO:tasks.rados.rados.0.smithi137.stdout:479: expect (ObjNum 41 snap 0 seq_num 41) 2024-03-04T06:43:27.660 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 45 2024-03-04T06:43:27.660 INFO:tasks.rados.rados.0.smithi137.stdout:480: seq_num 166 ranges {1245184=385024} 2024-03-04T06:43:27.669 INFO:tasks.rados.rados.0.smithi137.stdout:480: writing smithi13777483-47 from 1245184 to 1630208 tid 1 2024-03-04T06:43:27.669 INFO:tasks.rados.rados.0.smithi137.stdout:481: delete oid 45 current snap is 45 2024-03-04T06:43:27.670 INFO:tasks.rados.rados.0.smithi137.stdout:475: finishing write tid 3 to smithi13777483-17 2024-03-04T06:43:27.670 INFO:tasks.rados.rados.0.smithi137.stdout:475: oid 17 updating version 0 to 102 2024-03-04T06:43:27.670 INFO:tasks.rados.rados.0.smithi137.stdout:475: oid 17 updating version 102 to 103 2024-03-04T06:43:27.670 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 103 (ObjNum 163 snap 45 seq_num 163) dirty exists 2024-03-04T06:43:27.670 INFO:tasks.rados.rados.0.smithi137.stdout:475: left oid 17 (ObjNum 163 snap 45 seq_num 163) 2024-03-04T06:43:27.670 INFO:tasks.rados.rados.0.smithi137.stdout:477: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:43:27.693 INFO:tasks.rados.rados.0.smithi137.stdout:476: finishing write tid 1 to smithi13777483-12 2024-03-04T06:43:27.693 INFO:tasks.rados.rados.0.smithi137.stdout:476: finishing write tid 2 to smithi13777483-12 2024-03-04T06:43:27.693 INFO:tasks.rados.rados.0.smithi137.stdout:476: finishing write tid 3 to smithi13777483-12 2024-03-04T06:43:27.693 INFO:tasks.rados.rados.0.smithi137.stdout:476: oid 12 updating version 0 to 94 2024-03-04T06:43:27.693 INFO:tasks.rados.rados.0.smithi137.stdout:476: oid 12 updating version 94 to 95 2024-03-04T06:43:27.693 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 95 (ObjNum 164 snap 45 seq_num 164) dirty exists 2024-03-04T06:43:27.693 INFO:tasks.rados.rados.0.smithi137.stdout:476: left oid 12 (ObjNum 164 snap 45 seq_num 164) 2024-03-04T06:43:27.693 INFO:tasks.rados.rados.0.smithi137.stdout:478: finishing write tid 1 to smithi13777483-38 2024-03-04T06:43:27.694 INFO:tasks.rados.rados.0.smithi137.stdout:475: done (6 left) 2024-03-04T06:43:27.694 INFO:tasks.rados.rados.0.smithi137.stdout:476: done (5 left) 2024-03-04T06:43:27.694 INFO:tasks.rados.rados.0.smithi137.stdout:477: done (4 left) 2024-03-04T06:43:27.694 INFO:tasks.rados.rados.0.smithi137.stdout:481: done (3 left) 2024-03-04T06:43:27.694 INFO:tasks.rados.rados.0.smithi137.stdout:482: copy_from oid 19 from oid 48 current snap is 45 2024-03-04T06:43:27.694 INFO:tasks.rados.rados.0.smithi137.stdout:478: finishing write tid 2 to smithi13777483-38 2024-03-04T06:43:27.694 INFO:tasks.rados.rados.0.smithi137.stdout:479: expect (ObjNum 41 snap 0 seq_num 41) 2024-03-04T06:43:27.711 INFO:tasks.rados.rados.0.smithi137.stdout:478: finishing write tid 3 to smithi13777483-38 2024-03-04T06:43:27.711 INFO:tasks.rados.rados.0.smithi137.stdout:478: oid 38 updating version 0 to 230 2024-03-04T06:43:27.711 INFO:tasks.rados.rados.0.smithi137.stdout:478: oid 38 updating version 230 to 231 2024-03-04T06:43:27.711 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 231 (ObjNum 165 snap 45 seq_num 165) dirty exists 2024-03-04T06:43:27.711 INFO:tasks.rados.rados.0.smithi137.stdout:478: left oid 38 (ObjNum 165 snap 45 seq_num 165) 2024-03-04T06:43:27.712 INFO:tasks.rados.rados.0.smithi137.stdout:480: finishing write tid 1 to smithi13777483-47 2024-03-04T06:43:27.712 INFO:tasks.rados.rados.0.smithi137.stdout:480: finishing write tid 2 to smithi13777483-47 2024-03-04T06:43:27.712 INFO:tasks.rados.rados.0.smithi137.stdout:480: finishing write tid 3 to smithi13777483-47 2024-03-04T06:43:27.712 INFO:tasks.rados.rados.0.smithi137.stdout:480: oid 47 updating version 0 to 233 2024-03-04T06:43:27.712 INFO:tasks.rados.rados.0.smithi137.stdout:480: oid 47 updating version 233 to 234 2024-03-04T06:43:27.712 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 234 (ObjNum 166 snap 45 seq_num 166) dirty exists 2024-03-04T06:43:27.712 INFO:tasks.rados.rados.0.smithi137.stdout:480: left oid 47 (ObjNum 166 snap 45 seq_num 166) 2024-03-04T06:43:27.712 INFO:tasks.rados.rados.0.smithi137.stdout:482: finishing copy_from to smithi13777483-19 2024-03-04T06:43:27.712 INFO:tasks.rados.rados.0.smithi137.stdout:482: got expected ENOENT (src dne) 2024-03-04T06:43:27.712 INFO:tasks.rados.rados.0.smithi137.stdout:482: finishing copy_from racing read to smithi13777483-19 2024-03-04T06:43:27.712 INFO:tasks.rados.rados.0.smithi137.stdout:478: done (3 left) 2024-03-04T06:43:27.712 INFO:tasks.rados.rados.0.smithi137.stdout:479: done (2 left) 2024-03-04T06:43:27.712 INFO:tasks.rados.rados.0.smithi137.stdout:480: done (1 left) 2024-03-04T06:43:27.713 INFO:tasks.rados.rados.0.smithi137.stdout:482: done (0 left) 2024-03-04T06:43:27.713 INFO:tasks.rados.rados.0.smithi137.stdout:483: read oid 4 snap 40 2024-03-04T06:43:27.713 INFO:tasks.rados.rados.0.smithi137.stdout:483: expect deleted 2024-03-04T06:43:27.713 INFO:tasks.rados.rados.0.smithi137.stdout:484: snap_create 2024-03-04T06:43:27.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:27 smithi137 ceph-mon[26846]: pgmap v15: 121 pgs: 121 active+clean; 156 MiB data, 512 MiB used, 715 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.3 MiB/s wr, 61 op/s 2024-03-04T06:43:27.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:27 smithi137 ceph-mon[26846]: osdmap e151: 8 total, 8 up, 8 in 2024-03-04T06:43:27.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:27 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:27.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:27 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:27.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:27 smithi137 ceph-mon[37364]: pgmap v15: 121 pgs: 121 active+clean; 156 MiB data, 512 MiB used, 715 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.3 MiB/s wr, 61 op/s 2024-03-04T06:43:27.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:27 smithi137 ceph-mon[37364]: osdmap e151: 8 total, 8 up, 8 in 2024-03-04T06:43:27.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:27 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:27.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:27 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:27.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:27 smithi203 ceph-mon[30756]: pgmap v15: 121 pgs: 121 active+clean; 156 MiB data, 512 MiB used, 715 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.3 MiB/s wr, 61 op/s 2024-03-04T06:43:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:27 smithi203 ceph-mon[30756]: osdmap e151: 8 total, 8 up, 8 in 2024-03-04T06:43:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:27 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:27 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.596 INFO:tasks.rados.rados.0.smithi137.stdout:483: done (1 left) 2024-03-04T06:43:28.596 INFO:tasks.rados.rados.0.smithi137.stdout:484: done (0 left) 2024-03-04T06:43:28.596 INFO:tasks.rados.rados.0.smithi137.stdout:485: setattr oid 25 current snap is 46 2024-03-04T06:43:28.596 INFO:tasks.rados.rados.0.smithi137.stdout:486: snap_create 2024-03-04T06:43:28.601 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 235 (ObjNum 129 snap 0 seq_num 3130981184) dirty exists 2024-03-04T06:43:28.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: osdmap e152: 8 total, 8 up, 8 in 2024-03-04T06:43:28.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: Adjusting osd_memory_target on smithi137 to 2480M 2024-03-04T06:43:28.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:28 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: osdmap e152: 8 total, 8 up, 8 in 2024-03-04T06:43:28.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: Adjusting osd_memory_target on smithi137 to 2480M 2024-03-04T06:43:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: osdmap e152: 8 total, 8 up, 8 in 2024-03-04T06:43:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: Adjusting osd_memory_target on smithi137 to 2480M 2024-03-04T06:43:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:28 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:29.593 INFO:tasks.rados.rados.0.smithi137.stdout:485: done (1 left) 2024-03-04T06:43:29.593 INFO:tasks.rados.rados.0.smithi137.stdout:486: done (0 left) 2024-03-04T06:43:29.593 INFO:tasks.rados.rados.0.smithi137.stdout:487: rmattr oid 4 current snap is 47 2024-03-04T06:43:29.594 INFO:tasks.rados.rados.0.smithi137.stdout:487: done (0 left) 2024-03-04T06:43:29.594 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 47 2024-03-04T06:43:29.594 INFO:tasks.rados.rados.0.smithi137.stdout:488: seq_num 168 ranges {5267456=417792} 2024-03-04T06:43:29.624 INFO:tasks.rados.rados.0.smithi137.stdout:488: writing smithi13777483-39 from 5267456 to 5685248 tid 1 2024-03-04T06:43:29.624 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 37 current snap is 47 2024-03-04T06:43:29.624 INFO:tasks.rados.rados.0.smithi137.stdout:489: seq_num 169 ranges {4136960=434176} 2024-03-04T06:43:29.649 INFO:tasks.rados.rados.0.smithi137.stdout:489: writing smithi13777483-37 from 4136960 to 4571136 tid 1 2024-03-04T06:43:29.649 INFO:tasks.rados.rados.0.smithi137.stdout:490: read oid 33 snap 26 2024-03-04T06:43:29.649 INFO:tasks.rados.rados.0.smithi137.stdout:490: expect (ObjNum 103 snap 22 seq_num 103) 2024-03-04T06:43:29.649 INFO:tasks.rados.rados.0.smithi137.stdout:491: delete oid 23 current snap is 47 2024-03-04T06:43:29.649 INFO:tasks.rados.rados.0.smithi137.stdout:488: finishing write tid 1 to smithi13777483-39 2024-03-04T06:43:29.649 INFO:tasks.rados.rados.0.smithi137.stdout:488: finishing write tid 2 to smithi13777483-39 2024-03-04T06:43:29.649 INFO:tasks.rados.rados.0.smithi137.stdout:488: finishing write tid 3 to smithi13777483-39 2024-03-04T06:43:29.649 INFO:tasks.rados.rados.0.smithi137.stdout:488: oid 39 updating version 0 to 74 2024-03-04T06:43:29.649 INFO:tasks.rados.rados.0.smithi137.stdout:488: oid 39 version 74 is already newer than 73 2024-03-04T06:43:29.649 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 74 (ObjNum 168 snap 47 seq_num 168) dirty exists 2024-03-04T06:43:29.649 INFO:tasks.rados.rados.0.smithi137.stdout:488: left oid 39 (ObjNum 168 snap 47 seq_num 168) 2024-03-04T06:43:29.652 INFO:tasks.rados.rados.0.smithi137.stdout:488: done (3 left) 2024-03-04T06:43:29.652 INFO:tasks.rados.rados.0.smithi137.stdout:491: done (2 left) 2024-03-04T06:43:29.652 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 47 2024-03-04T06:43:29.652 INFO:tasks.rados.rados.0.smithi137.stdout:492: seq_num 171 ranges {319488=466944} 2024-03-04T06:43:29.656 INFO:tasks.rados.rados.0.smithi137.stdout:492: writing smithi13777483-6 from 319488 to 786432 tid 1 2024-03-04T06:43:29.656 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 47 2024-03-04T06:43:29.656 INFO:tasks.rados.rados.0.smithi137.stdout:493: seq_num 172 ranges {1892352=483328} 2024-03-04T06:43:29.670 INFO:tasks.rados.rados.0.smithi137.stdout:493: writing smithi13777483-14 from 1892352 to 2375680 tid 1 2024-03-04T06:43:29.670 INFO:tasks.rados.rados.0.smithi137.stdout:494: rollback oid 17 current snap is 47 2024-03-04T06:43:29.670 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 17 to 45 2024-03-04T06:43:29.670 INFO:tasks.rados.rados.0.smithi137.stdout:489: finishing write tid 1 to smithi13777483-37 2024-03-04T06:43:29.670 INFO:tasks.rados.rados.0.smithi137.stdout:489: finishing write tid 2 to smithi13777483-37 2024-03-04T06:43:29.670 INFO:tasks.rados.rados.0.smithi137.stdout:489: finishing write tid 3 to smithi13777483-37 2024-03-04T06:43:29.670 INFO:tasks.rados.rados.0.smithi137.stdout:489: oid 37 updating version 0 to 199 2024-03-04T06:43:29.670 INFO:tasks.rados.rados.0.smithi137.stdout:489: oid 37 updating version 199 to 200 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 200 (ObjNum 169 snap 47 seq_num 169) dirty exists 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:489: left oid 37 (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:489: done (4 left) 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:495: read oid 36 snap -1 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:495: expect (ObjNum 97 snap 19 seq_num 97) 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:496: rollback oid 18 current snap is 47 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 18 to 27 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:492: finishing write tid 1 to smithi13777483-6 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:492: finishing write tid 2 to smithi13777483-6 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:492: finishing write tid 3 to smithi13777483-6 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:492: oid 6 updating version 0 to 203 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:492: oid 6 version 203 is already newer than 202 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 203 (ObjNum 171 snap 47 seq_num 171) dirty exists 2024-03-04T06:43:29.671 INFO:tasks.rados.rados.0.smithi137.stdout:492: left oid 6 (ObjNum 171 snap 47 seq_num 171) 2024-03-04T06:43:29.672 INFO:tasks.rados.rados.0.smithi137.stdout:492: done (5 left) 2024-03-04T06:43:29.672 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 47 2024-03-04T06:43:29.672 INFO:tasks.rados.rados.0.smithi137.stdout:490: expect (ObjNum 103 snap 22 seq_num 103) 2024-03-04T06:43:29.739 INFO:tasks.rados.rados.0.smithi137.stdout:494: finishing rollback tid 0 to smithi13777483-17 2024-03-04T06:43:29.739 INFO:tasks.rados.rados.0.smithi137.stdout:497: seq_num 173 ranges {0=499712} 2024-03-04T06:43:29.742 INFO:tasks.rados.rados.0.smithi137.stdout:497: writing smithi13777483-13 from 0 to 499712 tid 1 2024-03-04T06:43:29.742 INFO:tasks.rados.rados.0.smithi137.stdout:490: done (5 left) 2024-03-04T06:43:29.742 INFO:tasks.rados.rados.0.smithi137.stdout:498: rollback oid 12 current snap is 47 2024-03-04T06:43:29.742 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 12 to 27 2024-03-04T06:43:29.742 INFO:tasks.rados.rados.0.smithi137.stdout:494: finishing rollback tid 1 to smithi13777483-17 2024-03-04T06:43:29.742 INFO:tasks.rados.rados.0.smithi137.stdout:494: finishing rollback tid 2 to smithi13777483-17 2024-03-04T06:43:29.743 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 106 (ObjNum 163 snap 45 seq_num 163) dirty exists 2024-03-04T06:43:29.743 INFO:tasks.rados.rados.0.smithi137.stdout:493: finishing write tid 1 to smithi13777483-14 2024-03-04T06:43:29.743 INFO:tasks.rados.rados.0.smithi137.stdout:493: finishing write tid 2 to smithi13777483-14 2024-03-04T06:43:29.743 INFO:tasks.rados.rados.0.smithi137.stdout:493: finishing write tid 3 to smithi13777483-14 2024-03-04T06:43:29.743 INFO:tasks.rados.rados.0.smithi137.stdout:493: oid 14 updating version 0 to 130 2024-03-04T06:43:29.743 INFO:tasks.rados.rados.0.smithi137.stdout:493: oid 14 updating version 130 to 131 2024-03-04T06:43:29.743 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 131 (ObjNum 172 snap 47 seq_num 172) dirty exists 2024-03-04T06:43:29.743 INFO:tasks.rados.rados.0.smithi137.stdout:493: left oid 14 (ObjNum 172 snap 47 seq_num 172) 2024-03-04T06:43:29.743 INFO:tasks.rados.rados.0.smithi137.stdout:496: finishing rollback tid 0 to smithi13777483-18 2024-03-04T06:43:29.743 INFO:tasks.rados.rados.0.smithi137.stdout:496: finishing rollback tid 1 to smithi13777483-18 2024-03-04T06:43:29.743 INFO:tasks.rados.rados.0.smithi137.stdout:496: finishing rollback tid 2 to smithi13777483-18 2024-03-04T06:43:29.743 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 124 (ObjNum 106 snap 27 seq_num 106) dirty exists 2024-03-04T06:43:29.743 INFO:tasks.rados.rados.0.smithi137.stdout:495: expect (ObjNum 97 snap 19 seq_num 97) 2024-03-04T06:43:29.832 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:29 smithi203 ceph-mon[30756]: pgmap v18: 121 pgs: 121 active+clean; 156 MiB data, 512 MiB used, 715 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.3 MiB/s wr, 61 op/s 2024-03-04T06:43:29.832 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:29 smithi203 ceph-mon[30756]: osdmap e153: 8 total, 8 up, 8 in 2024-03-04T06:43:29.832 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:29 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:29.832 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:29 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:29.845 INFO:tasks.rados.rados.0.smithi137.stdout:498: finishing rollback tid 0 to smithi13777483-12 2024-03-04T06:43:29.846 INFO:tasks.rados.rados.0.smithi137.stdout:497: finishing write tid 1 to smithi13777483-13 2024-03-04T06:43:29.846 INFO:tasks.rados.rados.0.smithi137.stdout:498: finishing rollback tid 1 to smithi13777483-12 2024-03-04T06:43:29.846 INFO:tasks.rados.rados.0.smithi137.stdout:497: finishing write tid 2 to smithi13777483-13 2024-03-04T06:43:29.846 INFO:tasks.rados.rados.0.smithi137.stdout:498: finishing rollback tid 2 to smithi13777483-12 2024-03-04T06:43:29.846 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 99 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-03-04T06:43:29.846 INFO:tasks.rados.rados.0.smithi137.stdout:497: finishing write tid 3 to smithi13777483-13 2024-03-04T06:43:29.846 INFO:tasks.rados.rados.0.smithi137.stdout:497: oid 13 updating version 0 to 284 2024-03-04T06:43:29.846 INFO:tasks.rados.rados.0.smithi137.stdout:497: oid 13 version 284 is already newer than 283 2024-03-04T06:43:29.846 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 284 (ObjNum 173 snap 47 seq_num 173) dirty exists 2024-03-04T06:43:29.846 INFO:tasks.rados.rados.0.smithi137.stdout:497: left oid 13 (ObjNum 173 snap 47 seq_num 173) 2024-03-04T06:43:29.846 INFO:tasks.rados.rados.0.smithi137.stdout:493: done (5 left) 2024-03-04T06:43:29.846 INFO:tasks.rados.rados.0.smithi137.stdout:494: done (4 left) 2024-03-04T06:43:29.846 INFO:tasks.rados.rados.0.smithi137.stdout:495: done (3 left) 2024-03-04T06:43:29.847 INFO:tasks.rados.rados.0.smithi137.stdout:496: done (2 left) 2024-03-04T06:43:29.847 INFO:tasks.rados.rados.0.smithi137.stdout:497: done (1 left) 2024-03-04T06:43:29.847 INFO:tasks.rados.rados.0.smithi137.stdout:498: done (0 left) 2024-03-04T06:43:29.847 INFO:tasks.rados.rados.0.smithi137.stdout:499: snap_remove snap 41 2024-03-04T06:43:30.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:29 smithi137 ceph-mon[37364]: pgmap v18: 121 pgs: 121 active+clean; 156 MiB data, 512 MiB used, 715 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.3 MiB/s wr, 61 op/s 2024-03-04T06:43:30.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:29 smithi137 ceph-mon[37364]: osdmap e153: 8 total, 8 up, 8 in 2024-03-04T06:43:30.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:29 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:30.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:29 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:30.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:29 smithi137 ceph-mon[26846]: pgmap v18: 121 pgs: 121 active+clean; 156 MiB data, 512 MiB used, 715 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.3 MiB/s wr, 61 op/s 2024-03-04T06:43:30.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:29 smithi137 ceph-mon[26846]: osdmap e153: 8 total, 8 up, 8 in 2024-03-04T06:43:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:29 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:29 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:499: done (0 left) 2024-03-04T06:43:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 47 2024-03-04T06:43:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:500: seq_num 174 ranges {2375680=516096} 2024-03-04T06:43:30.384 INFO:tasks.rados.rados.0.smithi137.stdout:500: writing smithi13777483-14 from 2375680 to 2891776 tid 1 2024-03-04T06:43:30.385 INFO:tasks.rados.rados.0.smithi137.stdout:501: delete oid 1 current snap is 47 2024-03-04T06:43:30.386 INFO:tasks.rados.rados.0.smithi137.stdout:501: done (1 left) 2024-03-04T06:43:30.386 INFO:tasks.rados.rados.0.smithi137.stdout:502: snap_create 2024-03-04T06:43:30.387 INFO:tasks.rados.rados.0.smithi137.stdout:500: finishing write tid 1 to smithi13777483-14 2024-03-04T06:43:30.388 INFO:tasks.rados.rados.0.smithi137.stdout:500: finishing write tid 2 to smithi13777483-14 2024-03-04T06:43:30.388 INFO:tasks.rados.rados.0.smithi137.stdout:500: finishing write tid 3 to smithi13777483-14 2024-03-04T06:43:30.389 INFO:tasks.rados.rados.0.smithi137.stdout:500: oid 14 updating version 0 to 137 2024-03-04T06:43:30.389 INFO:tasks.rados.rados.0.smithi137.stdout:500: oid 14 version 137 is already newer than 136 2024-03-04T06:43:30.389 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 137 (ObjNum 174 snap 47 seq_num 174) dirty exists 2024-03-04T06:43:30.389 INFO:tasks.rados.rados.0.smithi137.stdout:500: left oid 14 (ObjNum 174 snap 47 seq_num 174) 2024-03-04T06:43:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:30 smithi203 ceph-mon[30756]: osdmap e154: 8 total, 8 up, 8 in 2024-03-04T06:43:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:30 smithi203 ceph-mon[30756]: osdmap e155: 8 total, 8 up, 8 in 2024-03-04T06:43:31.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:30 smithi137 ceph-mon[26846]: osdmap e154: 8 total, 8 up, 8 in 2024-03-04T06:43:31.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:30 smithi137 ceph-mon[26846]: osdmap e155: 8 total, 8 up, 8 in 2024-03-04T06:43:31.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:30 smithi137 ceph-mon[37364]: osdmap e154: 8 total, 8 up, 8 in 2024-03-04T06:43:31.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:30 smithi137 ceph-mon[37364]: osdmap e155: 8 total, 8 up, 8 in 2024-03-04T06:43:31.375 INFO:tasks.rados.rados.0.smithi137.stdout:500: done (1 left) 2024-03-04T06:43:31.375 INFO:tasks.rados.rados.0.smithi137.stdout:502: done (0 left) 2024-03-04T06:43:31.375 INFO:tasks.rados.rados.0.smithi137.stdout:503: snap_create 2024-03-04T06:43:32.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:31 smithi137 ceph-mon[37364]: pgmap v21: 121 pgs: 121 active+clean; 152 MiB data, 577 MiB used, 715 GiB / 715 GiB avail; 17 MiB/s rd, 2.1 MiB/s wr, 46 op/s 2024-03-04T06:43:32.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:31 smithi137 ceph-mon[37364]: osdmap e156: 8 total, 8 up, 8 in 2024-03-04T06:43:32.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:31 smithi137 ceph-mon[26846]: pgmap v21: 121 pgs: 121 active+clean; 152 MiB data, 577 MiB used, 715 GiB / 715 GiB avail; 17 MiB/s rd, 2.1 MiB/s wr, 46 op/s 2024-03-04T06:43:32.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:31 smithi137 ceph-mon[26846]: osdmap e156: 8 total, 8 up, 8 in 2024-03-04T06:43:32.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:31 smithi203 ceph-mon[30756]: pgmap v21: 121 pgs: 121 active+clean; 152 MiB data, 577 MiB used, 715 GiB / 715 GiB avail; 17 MiB/s rd, 2.1 MiB/s wr, 46 op/s 2024-03-04T06:43:32.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:31 smithi203 ceph-mon[30756]: osdmap e156: 8 total, 8 up, 8 in 2024-03-04T06:43:32.376 INFO:tasks.rados.rados.0.smithi137.stdout:503: done (0 left) 2024-03-04T06:43:32.376 INFO:tasks.rados.rados.0.smithi137.stdout:504: snap_remove snap 40 2024-03-04T06:43:33.379 INFO:tasks.rados.rados.0.smithi137.stdout:504: done (0 left) 2024-03-04T06:43:33.379 INFO:tasks.rados.rados.0.smithi137.stdout:505: read oid 21 snap -1 2024-03-04T06:43:33.379 INFO:tasks.rados.rados.0.smithi137.stdout:505: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:43:33.379 INFO:tasks.rados.rados.0.smithi137.stdout:506: snap_remove snap 38 2024-03-04T06:43:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: pgmap v24: 121 pgs: 121 active+clean; 152 MiB data, 577 MiB used, 715 GiB / 715 GiB avail; 17 MiB/s rd, 2.1 MiB/s wr, 46 op/s 2024-03-04T06:43:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: osdmap e157: 8 total, 8 up, 8 in 2024-03-04T06:43:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:33.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:43:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: pgmap v24: 121 pgs: 121 active+clean; 152 MiB data, 577 MiB used, 715 GiB / 715 GiB avail; 17 MiB/s rd, 2.1 MiB/s wr, 46 op/s 2024-03-04T06:43:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: osdmap e157: 8 total, 8 up, 8 in 2024-03-04T06:43:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:33.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:33.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:33 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:43:33.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: pgmap v24: 121 pgs: 121 active+clean; 152 MiB data, 577 MiB used, 715 GiB / 715 GiB avail; 17 MiB/s rd, 2.1 MiB/s wr, 46 op/s 2024-03-04T06:43:33.909 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: osdmap e157: 8 total, 8 up, 8 in 2024-03-04T06:43:33.909 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:33.909 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:33.909 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.910 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.910 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.910 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.910 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.910 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.910 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.910 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T06:43:33.910 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:33.910 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:33.910 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:33 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:43:34.386 INFO:tasks.rados.rados.0.smithi137.stdout:506: done (1 left) 2024-03-04T06:43:34.386 INFO:tasks.rados.rados.0.smithi137.stdout:507: snap_remove snap 27 2024-03-04T06:43:34.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: Adjusting osd_memory_target on smithi203 to 2480M 2024-03-04T06:43:34.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:43:34.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:43:34.788 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:43:34.788 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:43:34.788 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:43:34.788 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:43:34.788 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:43:34.788 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:43:34.788 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: osdmap e158: 8 total, 8 up, 8 in 2024-03-04T06:43:34.788 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:34.788 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.788 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.788 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.788 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.788 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:34 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: Adjusting osd_memory_target on smithi203 to 2480M 2024-03-04T06:43:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:43:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:43:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:43:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:43:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:43:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:43:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:43:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:43:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: osdmap e158: 8 total, 8 up, 8 in 2024-03-04T06:43:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: Adjusting osd_memory_target on smithi203 to 2480M 2024-03-04T06:43:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:43:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:43:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:43:34.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:43:34.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:43:34.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:43:34.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:43:34.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:43:34.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: osdmap e158: 8 total, 8 up, 8 in 2024-03-04T06:43:34.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:34.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:34.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:34 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:35.371 INFO:tasks.rados.rados.0.smithi137.stdout:507: done (1 left) 2024-03-04T06:43:35.371 INFO:tasks.rados.rados.0.smithi137.stdout:508: copy_from oid 40 from oid 22 current snap is 49 2024-03-04T06:43:35.371 INFO:tasks.rados.rados.0.smithi137.stdout:509: rollback oid 41 current snap is 49 2024-03-04T06:43:35.371 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 41 to 42 2024-03-04T06:43:35.371 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 49 2024-03-04T06:43:35.371 INFO:tasks.rados.rados.0.smithi137.stdout:510: seq_num 176 ranges {663552=557056} 2024-03-04T06:43:35.378 INFO:tasks.rados.rados.0.smithi137.stdout:510: writing smithi13777483-15 from 663552 to 1220608 tid 1 2024-03-04T06:43:35.378 INFO:tasks.rados.rados.0.smithi137.stdout:511: snap_create 2024-03-04T06:43:35.378 INFO:tasks.rados.rados.0.smithi137.stdout:505: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:43:35.386 INFO:tasks.rados.rados.0.smithi137.stdout:509: finishing rollback tid 0 to smithi13777483-41 2024-03-04T06:43:35.386 INFO:tasks.rados.rados.0.smithi137.stdout:509: finishing rollback tid 1 to smithi13777483-41 2024-03-04T06:43:35.386 INFO:tasks.rados.rados.0.smithi137.stdout:509: finishing rollback tid 2 to smithi13777483-41 2024-03-04T06:43:35.386 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 98 (ObjNum 145 snap 40 seq_num 145) dirty exists 2024-03-04T06:43:35.389 INFO:tasks.rados.rados.0.smithi137.stdout:510: finishing write tid 1 to smithi13777483-15 2024-03-04T06:43:35.394 INFO:tasks.rados.rados.0.smithi137.stdout:508: finishing copy_from racing read to smithi13777483-40 2024-03-04T06:43:35.394 INFO:tasks.rados.rados.0.smithi137.stdout:510: finishing write tid 2 to smithi13777483-15 2024-03-04T06:43:35.396 INFO:tasks.rados.rados.0.smithi137.stdout:510: finishing write tid 3 to smithi13777483-15 2024-03-04T06:43:35.396 INFO:tasks.rados.rados.0.smithi137.stdout:510: oid 15 updating version 0 to 229 2024-03-04T06:43:35.396 INFO:tasks.rados.rados.0.smithi137.stdout:510: oid 15 updating version 229 to 230 2024-03-04T06:43:35.396 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 230 (ObjNum 176 snap 49 seq_num 176) dirty exists 2024-03-04T06:43:35.396 INFO:tasks.rados.rados.0.smithi137.stdout:510: left oid 15 (ObjNum 176 snap 49 seq_num 176) 2024-03-04T06:43:35.398 INFO:tasks.rados.rados.0.smithi137.stdout:508: finishing copy_from to smithi13777483-40 2024-03-04T06:43:35.398 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 120 (ObjNum 78 snap 11 seq_num 78) dirty exists 2024-03-04T06:43:35.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[27078]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:43:35] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-03-04T06:43:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:35 smithi137 ceph-mon[26846]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-04T06:43:35.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:35 smithi137 ceph-mon[26846]: Reconfiguring daemon prometheus.a on smithi203 2024-03-04T06:43:35.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:35 smithi137 ceph-mon[26846]: pgmap v27: 121 pgs: 121 active+clean; 152 MiB data, 577 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:35.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:35 smithi137 ceph-mon[26846]: osdmap e159: 8 total, 8 up, 8 in 2024-03-04T06:43:35.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:35 smithi137 ceph-mon[26846]: osdmap e160: 8 total, 8 up, 8 in 2024-03-04T06:43:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:35 smithi137 ceph-mon[37364]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-04T06:43:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:35 smithi137 ceph-mon[37364]: Reconfiguring daemon prometheus.a on smithi203 2024-03-04T06:43:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:35 smithi137 ceph-mon[37364]: pgmap v27: 121 pgs: 121 active+clean; 152 MiB data, 577 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:35 smithi137 ceph-mon[37364]: osdmap e159: 8 total, 8 up, 8 in 2024-03-04T06:43:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:35 smithi137 ceph-mon[37364]: osdmap e160: 8 total, 8 up, 8 in 2024-03-04T06:43:35.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:35 smithi203 ceph-mon[30756]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-04T06:43:35.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:35 smithi203 ceph-mon[30756]: Reconfiguring daemon prometheus.a on smithi203 2024-03-04T06:43:35.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:35 smithi203 ceph-mon[30756]: pgmap v27: 121 pgs: 121 active+clean; 152 MiB data, 577 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:35.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:35 smithi203 ceph-mon[30756]: osdmap e159: 8 total, 8 up, 8 in 2024-03-04T06:43:35.795 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:35 smithi203 ceph-mon[30756]: osdmap e160: 8 total, 8 up, 8 in 2024-03-04T06:43:36.381 INFO:tasks.rados.rados.0.smithi137.stdout:505: done (4 left) 2024-03-04T06:43:36.381 INFO:tasks.rados.rados.0.smithi137.stdout:508: done (3 left) 2024-03-04T06:43:36.381 INFO:tasks.rados.rados.0.smithi137.stdout:509: done (2 left) 2024-03-04T06:43:36.381 INFO:tasks.rados.rados.0.smithi137.stdout:510: done (1 left) 2024-03-04T06:43:36.381 INFO:tasks.rados.rados.0.smithi137.stdout:511: done (0 left) 2024-03-04T06:43:36.381 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 50 2024-03-04T06:43:36.381 INFO:tasks.rados.rados.0.smithi137.stdout:512: seq_num 177 ranges {475136=573440} 2024-03-04T06:43:36.387 INFO:tasks.rados.rados.0.smithi137.stdout:512: writing smithi13777483-17 from 475136 to 1048576 tid 1 2024-03-04T06:43:36.387 INFO:tasks.rados.rados.0.smithi137.stdout:513: copy_from oid 28 from oid 42 current snap is 50 2024-03-04T06:43:36.387 INFO:tasks.rados.rados.0.smithi137.stdout:514: rollback oid 15 current snap is 50 2024-03-04T06:43:36.387 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 15 to 45 2024-03-04T06:43:36.387 INFO:tasks.rados.rados.0.smithi137.stdout:515: rollback oid 33 current snap is 50 2024-03-04T06:43:36.387 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 33 to 43 2024-03-04T06:43:36.387 INFO:tasks.rados.rados.0.smithi137.stdout:516: delete oid 46 current snap is 50 2024-03-04T06:43:36.391 INFO:tasks.rados.rados.0.smithi137.stdout:513: finishing copy_from to smithi13777483-28 2024-03-04T06:43:36.391 INFO:tasks.rados.rados.0.smithi137.stdout:513: got expected ENOENT (src dne) 2024-03-04T06:43:36.391 INFO:tasks.rados.rados.0.smithi137.stdout:513: finishing copy_from racing read to smithi13777483-28 2024-03-04T06:43:36.395 INFO:tasks.rados.rados.0.smithi137.stdout:515: finishing rollback tid 0 to smithi13777483-33 2024-03-04T06:43:36.395 INFO:tasks.rados.rados.0.smithi137.stdout:515: finishing rollback tid 1 to smithi13777483-33 2024-03-04T06:43:36.395 INFO:tasks.rados.rados.0.smithi137.stdout:515: finishing rollback tid 2 to smithi13777483-33 2024-03-04T06:43:36.395 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 179 (ObjNum 103 snap 22 seq_num 103) dirty exists 2024-03-04T06:43:36.396 INFO:tasks.rados.rados.0.smithi137.stdout:512: finishing write tid 1 to smithi13777483-17 2024-03-04T06:43:36.396 INFO:tasks.rados.rados.0.smithi137.stdout:513: done (4 left) 2024-03-04T06:43:36.396 INFO:tasks.rados.rados.0.smithi137.stdout:515: done (3 left) 2024-03-04T06:43:36.396 INFO:tasks.rados.rados.0.smithi137.stdout:516: done (2 left) 2024-03-04T06:43:36.396 INFO:tasks.rados.rados.0.smithi137.stdout:517: read oid 46 snap 47 2024-03-04T06:43:36.396 INFO:tasks.rados.rados.0.smithi137.stdout:517: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:43:36.397 INFO:tasks.rados.rados.0.smithi137.stdout:518: read oid 44 snap -1 2024-03-04T06:43:36.397 INFO:tasks.rados.rados.0.smithi137.stdout:518: expect deleted 2024-03-04T06:43:36.397 INFO:tasks.rados.rados.0.smithi137.stdout:512: finishing write tid 2 to smithi13777483-17 2024-03-04T06:43:36.397 INFO:tasks.rados.rados.0.smithi137.stdout:519: copy_from oid 12 from oid 40 current snap is 50 2024-03-04T06:43:36.397 INFO:tasks.rados.rados.0.smithi137.stdout:520: delete oid 36 current snap is 50 2024-03-04T06:43:36.397 INFO:tasks.rados.rados.0.smithi137.stdout:514: finishing rollback tid 0 to smithi13777483-15 2024-03-04T06:43:36.397 INFO:tasks.rados.rados.0.smithi137.stdout:514: finishing rollback tid 1 to smithi13777483-15 2024-03-04T06:43:36.398 INFO:tasks.rados.rados.0.smithi137.stdout:512: finishing write tid 3 to smithi13777483-17 2024-03-04T06:43:36.398 INFO:tasks.rados.rados.0.smithi137.stdout:512: oid 17 updating version 0 to 108 2024-03-04T06:43:36.398 INFO:tasks.rados.rados.0.smithi137.stdout:512: oid 17 version 108 is already newer than 107 2024-03-04T06:43:36.398 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 108 (ObjNum 177 snap 50 seq_num 177) dirty exists 2024-03-04T06:43:36.398 INFO:tasks.rados.rados.0.smithi137.stdout:512: left oid 17 (ObjNum 177 snap 50 seq_num 177) 2024-03-04T06:43:36.398 INFO:tasks.rados.rados.0.smithi137.stdout:514: finishing rollback tid 2 to smithi13777483-15 2024-03-04T06:43:36.398 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 238 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-03-04T06:43:36.400 INFO:tasks.rados.rados.0.smithi137.stdout:512: done (5 left) 2024-03-04T06:43:36.400 INFO:tasks.rados.rados.0.smithi137.stdout:514: done (4 left) 2024-03-04T06:43:36.400 INFO:tasks.rados.rados.0.smithi137.stdout:518: done (3 left) 2024-03-04T06:43:36.400 INFO:tasks.rados.rados.0.smithi137.stdout:520: done (2 left) 2024-03-04T06:43:36.400 INFO:tasks.rados.rados.0.smithi137.stdout:521: read oid 11 snap -1 2024-03-04T06:43:36.400 INFO:tasks.rados.rados.0.smithi137.stdout:521: expect deleted 2024-03-04T06:43:36.400 INFO:tasks.rados.rados.0.smithi137.stdout:522: delete oid 9 current snap is 50 2024-03-04T06:43:36.401 INFO:tasks.rados.rados.0.smithi137.stdout:517: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:43:36.422 INFO:tasks.rados.rados.0.smithi137.stdout:519: finishing copy_from racing read to smithi13777483-12 2024-03-04T06:43:36.422 INFO:tasks.rados.rados.0.smithi137.stdout:519: finishing copy_from to smithi13777483-12 2024-03-04T06:43:36.422 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 120 (ObjNum 78 snap 11 seq_num 78) dirty exists 2024-03-04T06:43:36.422 INFO:tasks.rados.rados.0.smithi137.stdout:517: done (3 left) 2024-03-04T06:43:36.422 INFO:tasks.rados.rados.0.smithi137.stdout:519: done (2 left) 2024-03-04T06:43:36.422 INFO:tasks.rados.rados.0.smithi137.stdout:521: done (1 left) 2024-03-04T06:43:36.422 INFO:tasks.rados.rados.0.smithi137.stdout:522: done (0 left) 2024-03-04T06:43:36.422 INFO:tasks.rados.rados.0.smithi137.stdout:523: copy_from oid 8 from oid 29 current snap is 50 2024-03-04T06:43:36.422 INFO:tasks.rados.rados.0.smithi137.stdout:524: delete oid 10 current snap is 50 2024-03-04T06:43:36.424 INFO:tasks.rados.rados.0.smithi137.stdout:524: done (1 left) 2024-03-04T06:43:36.424 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 50 2024-03-04T06:43:36.424 INFO:tasks.rados.rados.0.smithi137.stdout:525: seq_num 182 ranges {1630208=655360} 2024-03-04T06:43:36.437 INFO:tasks.rados.rados.0.smithi137.stdout:525: writing smithi13777483-47 from 1630208 to 2285568 tid 1 2024-03-04T06:43:36.437 INFO:tasks.rados.rados.0.smithi137.stdout:526: rollback oid 21 current snap is 50 2024-03-04T06:43:36.437 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 21 to 48 2024-03-04T06:43:36.438 INFO:tasks.rados.rados.0.smithi137.stdout:523: finishing copy_from racing read to smithi13777483-8 2024-03-04T06:43:36.438 INFO:tasks.rados.rados.0.smithi137.stdout:523: finishing copy_from to smithi13777483-8 2024-03-04T06:43:36.438 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 96 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-04T06:43:36.438 INFO:tasks.rados.rados.0.smithi137.stdout:523: done (2 left) 2024-03-04T06:43:36.438 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 43 current snap is 50 2024-03-04T06:43:36.438 INFO:tasks.rados.rados.0.smithi137.stdout:527: seq_num 183 ranges {1245184=671744} 2024-03-04T06:43:36.448 INFO:tasks.rados.rados.0.smithi137.stdout:527: writing smithi13777483-43 from 1245184 to 1916928 tid 1 2024-03-04T06:43:36.448 INFO:tasks.rados.rados.0.smithi137.stdout:528: delete oid 5 current snap is 50 2024-03-04T06:43:36.448 INFO:tasks.rados.rados.0.smithi137.stdout:525: finishing write tid 1 to smithi13777483-47 2024-03-04T06:43:36.449 INFO:tasks.rados.rados.0.smithi137.stdout:525: finishing write tid 2 to smithi13777483-47 2024-03-04T06:43:36.449 INFO:tasks.rados.rados.0.smithi137.stdout:526: finishing rollback tid 0 to smithi13777483-21 2024-03-04T06:43:36.449 INFO:tasks.rados.rados.0.smithi137.stdout:525: finishing write tid 3 to smithi13777483-47 2024-03-04T06:43:36.449 INFO:tasks.rados.rados.0.smithi137.stdout:525: oid 47 updating version 0 to 267 2024-03-04T06:43:36.449 INFO:tasks.rados.rados.0.smithi137.stdout:525: oid 47 updating version 267 to 268 2024-03-04T06:43:36.449 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 268 (ObjNum 182 snap 50 seq_num 182) dirty exists 2024-03-04T06:43:36.449 INFO:tasks.rados.rados.0.smithi137.stdout:525: left oid 47 (ObjNum 182 snap 50 seq_num 182) 2024-03-04T06:43:36.449 INFO:tasks.rados.rados.0.smithi137.stdout:526: finishing rollback tid 1 to smithi13777483-21 2024-03-04T06:43:36.449 INFO:tasks.rados.rados.0.smithi137.stdout:526: finishing rollback tid 2 to smithi13777483-21 2024-03-04T06:43:36.449 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 272 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:43:36.450 INFO:tasks.rados.rados.0.smithi137.stdout:525: done (3 left) 2024-03-04T06:43:36.450 INFO:tasks.rados.rados.0.smithi137.stdout:526: done (2 left) 2024-03-04T06:43:36.450 INFO:tasks.rados.rados.0.smithi137.stdout:528: done (1 left) 2024-03-04T06:43:36.450 INFO:tasks.rados.rados.0.smithi137.stdout:529: delete oid 10 current snap is 50 2024-03-04T06:43:36.451 INFO:tasks.rados.rados.0.smithi137.stdout:529: done (1 left) 2024-03-04T06:43:36.451 INFO:tasks.rados.rados.0.smithi137.stdout:530: rmattr oid 29 current snap is 50 2024-03-04T06:43:36.451 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 50 2024-03-04T06:43:36.451 INFO:tasks.rados.rados.0.smithi137.stdout:531: seq_num 186 ranges {2891776=720896} 2024-03-04T06:43:36.471 INFO:tasks.rados.rados.0.smithi137.stdout:531: writing smithi13777483-14 from 2891776 to 3612672 tid 1 2024-03-04T06:43:36.471 INFO:tasks.rados.rados.0.smithi137.stdout:532: read oid 26 snap -1 2024-03-04T06:43:36.471 INFO:tasks.rados.rados.0.smithi137.stdout:532: expect (ObjNum 156 snap 44 seq_num 156) 2024-03-04T06:43:36.471 INFO:tasks.rados.rados.0.smithi137.stdout:533: read oid 12 snap -1 2024-03-04T06:43:36.471 INFO:tasks.rados.rados.0.smithi137.stdout:533: expect (ObjNum 78 snap 11 seq_num 78) 2024-03-04T06:43:36.471 INFO:tasks.rados.rados.0.smithi137.stdout:534: rollback oid 13 current snap is 50 2024-03-04T06:43:36.471 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 13 to 35 2024-03-04T06:43:36.471 INFO:tasks.rados.rados.0.smithi137.stdout:527: finishing write tid 1 to smithi13777483-43 2024-03-04T06:43:36.471 INFO:tasks.rados.rados.0.smithi137.stdout:527: finishing write tid 2 to smithi13777483-43 2024-03-04T06:43:36.471 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 142 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-04T06:43:36.472 INFO:tasks.rados.rados.0.smithi137.stdout:527: finishing write tid 3 to smithi13777483-43 2024-03-04T06:43:36.472 INFO:tasks.rados.rados.0.smithi137.stdout:527: oid 43 updating version 0 to 110 2024-03-04T06:43:36.472 INFO:tasks.rados.rados.0.smithi137.stdout:527: oid 43 version 110 is already newer than 109 2024-03-04T06:43:36.472 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 110 (ObjNum 183 snap 50 seq_num 183) dirty exists 2024-03-04T06:43:36.472 INFO:tasks.rados.rados.0.smithi137.stdout:527: left oid 43 (ObjNum 183 snap 50 seq_num 183) 2024-03-04T06:43:36.472 INFO:tasks.rados.rados.0.smithi137.stdout:527: done (5 left) 2024-03-04T06:43:36.472 INFO:tasks.rados.rados.0.smithi137.stdout:530: done (4 left) 2024-03-04T06:43:36.472 INFO:tasks.rados.rados.0.smithi137.stdout:535: setattr oid 20 current snap is 50 2024-03-04T06:43:36.473 INFO:tasks.rados.rados.0.smithi137.stdout:536: rollback oid 19 current snap is 50 2024-03-04T06:43:36.473 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 19 to 42 2024-03-04T06:43:36.473 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 50 2024-03-04T06:43:36.473 INFO:tasks.rados.rados.0.smithi137.stdout:537: seq_num 187 ranges {180224=737280} 2024-03-04T06:43:36.478 INFO:tasks.rados.rados.0.smithi137.stdout:537: writing smithi13777483-49 from 180224 to 917504 tid 1 2024-03-04T06:43:36.478 INFO:tasks.rados.rados.0.smithi137.stdout:538: snap_remove snap 47 2024-03-04T06:43:37.403 INFO:tasks.rados.rados.0.smithi137.stdout:538: done (7 left) 2024-03-04T06:43:37.403 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 50 2024-03-04T06:43:37.403 INFO:tasks.rados.rados.0.smithi137.stdout:539: seq_num 188 ranges {0=753664} 2024-03-04T06:43:37.408 INFO:tasks.rados.rados.0.smithi137.stdout:539: writing smithi13777483-21 from 0 to 753664 tid 1 2024-03-04T06:43:37.409 INFO:tasks.rados.rados.0.smithi137.stdout:540: rollback oid 43 current snap is 50 2024-03-04T06:43:37.409 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 43 to 39 2024-03-04T06:43:37.409 INFO:tasks.rados.rados.0.smithi137.stdout:541: rmattr oid 9 current snap is 50 2024-03-04T06:43:37.409 INFO:tasks.rados.rados.0.smithi137.stdout:541: done (9 left) 2024-03-04T06:43:37.409 INFO:tasks.rados.rados.0.smithi137.stdout:542: read oid 28 snap -1 2024-03-04T06:43:37.409 INFO:tasks.rados.rados.0.smithi137.stdout:542: expect (ObjNum 162 snap 45 seq_num 162) 2024-03-04T06:43:37.409 INFO:tasks.rados.rados.0.smithi137.stdout:543: snap_create 2024-03-04T06:43:37.409 INFO:tasks.rados.rados.0.smithi137.stdout:534: finishing rollback tid 0 to smithi13777483-13 2024-03-04T06:43:37.409 INFO:tasks.rados.rados.0.smithi137.stdout:531: finishing write tid 1 to smithi13777483-14 2024-03-04T06:43:37.409 INFO:tasks.rados.rados.0.smithi137.stdout:532: expect (ObjNum 156 snap 44 seq_num 156) 2024-03-04T06:43:37.421 INFO:tasks.rados.rados.0.smithi137.stdout:534: finishing rollback tid 1 to smithi13777483-13 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:534: finishing rollback tid 2 to smithi13777483-13 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 318 (ObjNum 125 snap 34 seq_num 125) dirty exists 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:536: finishing rollback tid 0 to smithi13777483-19 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:536: finishing rollback tid 1 to smithi13777483-19 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:536: finishing rollback tid 2 to smithi13777483-19 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 258 (ObjNum 124 snap 34 seq_num 124) dirty exists 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:531: finishing write tid 2 to smithi13777483-14 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:531: finishing write tid 3 to smithi13777483-14 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:531: oid 14 updating version 0 to 153 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:531: oid 14 updating version 153 to 154 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 154 (ObjNum 186 snap 50 seq_num 186) dirty exists 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:531: left oid 14 (ObjNum 186 snap 50 seq_num 186) 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:537: finishing write tid 1 to smithi13777483-49 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:537: finishing write tid 2 to smithi13777483-49 2024-03-04T06:43:37.422 INFO:tasks.rados.rados.0.smithi137.stdout:537: finishing write tid 3 to smithi13777483-49 2024-03-04T06:43:37.423 INFO:tasks.rados.rados.0.smithi137.stdout:537: oid 49 updating version 0 to 182 2024-03-04T06:43:37.423 INFO:tasks.rados.rados.0.smithi137.stdout:537: oid 49 version 182 is already newer than 181 2024-03-04T06:43:37.423 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 182 (ObjNum 187 snap 50 seq_num 187) dirty exists 2024-03-04T06:43:37.423 INFO:tasks.rados.rados.0.smithi137.stdout:537: left oid 49 (ObjNum 187 snap 50 seq_num 187) 2024-03-04T06:43:37.423 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 156 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-03-04T06:43:37.423 INFO:tasks.rados.rados.0.smithi137.stdout:533: expect (ObjNum 78 snap 11 seq_num 78) 2024-03-04T06:43:37.491 INFO:tasks.rados.rados.0.smithi137.stdout:540: finishing rollback tid 0 to smithi13777483-43 2024-03-04T06:43:37.491 INFO:tasks.rados.rados.0.smithi137.stdout:540: finishing rollback tid 1 to smithi13777483-43 2024-03-04T06:43:37.491 INFO:tasks.rados.rados.0.smithi137.stdout:540: finishing rollback tid 2 to smithi13777483-43 2024-03-04T06:43:37.491 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 113 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:43:37.491 INFO:tasks.rados.rados.0.smithi137.stdout:539: finishing write tid 1 to smithi13777483-21 2024-03-04T06:43:37.491 INFO:tasks.rados.rados.0.smithi137.stdout:539: finishing write tid 2 to smithi13777483-21 2024-03-04T06:43:37.491 INFO:tasks.rados.rados.0.smithi137.stdout:542: expect (ObjNum 162 snap 45 seq_num 162) 2024-03-04T06:43:37.596 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 systemd[1]: Stopping Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:43:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-mon[30756]: pgmap v30: 121 pgs: 121 active+clean; 160 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 688 KiB/s wr, 9 op/s 2024-03-04T06:43:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-mon[30756]: osdmap e161: 8 total, 8 up, 8 in 2024-03-04T06:43:37.597 INFO:tasks.rados.rados.0.smithi137.stdout:539: finishing write tid 3 to smithi13777483-21 2024-03-04T06:43:37.597 INFO:tasks.rados.rados.0.smithi137.stdout:539: oid 21 updating version 0 to 278 2024-03-04T06:43:37.597 INFO:tasks.rados.rados.0.smithi137.stdout:539: oid 21 version 278 is already newer than 277 2024-03-04T06:43:37.597 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 278 (ObjNum 188 snap 50 seq_num 188) dirty exists 2024-03-04T06:43:37.598 INFO:tasks.rados.rados.0.smithi137.stdout:539: left oid 21 (ObjNum 188 snap 50 seq_num 188) 2024-03-04T06:43:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:37 smithi137 ceph-mon[26846]: pgmap v30: 121 pgs: 121 active+clean; 160 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 688 KiB/s wr, 9 op/s 2024-03-04T06:43:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:37 smithi137 ceph-mon[26846]: osdmap e161: 8 total, 8 up, 8 in 2024-03-04T06:43:37.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:37 smithi137 ceph-mon[37364]: pgmap v30: 121 pgs: 121 active+clean; 160 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 688 KiB/s wr, 9 op/s 2024-03-04T06:43:37.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:37 smithi137 ceph-mon[37364]: osdmap e161: 8 total, 8 up, 8 in 2024-03-04T06:43:37.957 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:43:37.633Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:43:37.633Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:43:37.633Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:43:37.633Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:43:37.633Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:43:37.633Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:43:37.633Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:43:37.633Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:43:37.634Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:43:37.634Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:43:37.634Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[62821]: ts=2024-03-04T06:43:37.634Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 podman[73728]: 2024-03-04 06:43:37.643781219 +0000 UTC m=+0.096325766 container died 80efb24031c2e622c9f7f61e69fb402173797b12935b2f01fc9fcf460aef8c21 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 podman[73728]: 2024-03-04 06:43:37.95783248 +0000 UTC m=+0.410377027 container cleanup 80efb24031c2e622c9f7f61e69fb402173797b12935b2f01fc9fcf460aef8c21 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:43:37.958 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:37 smithi203 bash[73728]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a 2024-03-04T06:43:38.345 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 podman[73740]: 2024-03-04 06:43:38.175841273 +0000 UTC m=+0.530805166 container remove 80efb24031c2e622c9f7f61e69fb402173797b12935b2f01fc9fcf460aef8c21 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:43:38.407 INFO:tasks.rados.rados.0.smithi137.stdout:531: done (10 left) 2024-03-04T06:43:38.408 INFO:tasks.rados.rados.0.smithi137.stdout:532: done (9 left) 2024-03-04T06:43:38.408 INFO:tasks.rados.rados.0.smithi137.stdout:533: done (8 left) 2024-03-04T06:43:38.408 INFO:tasks.rados.rados.0.smithi137.stdout:534: done (7 left) 2024-03-04T06:43:38.408 INFO:tasks.rados.rados.0.smithi137.stdout:535: done (6 left) 2024-03-04T06:43:38.408 INFO:tasks.rados.rados.0.smithi137.stdout:536: done (5 left) 2024-03-04T06:43:38.408 INFO:tasks.rados.rados.0.smithi137.stdout:537: done (4 left) 2024-03-04T06:43:38.408 INFO:tasks.rados.rados.0.smithi137.stdout:539: done (3 left) 2024-03-04T06:43:38.408 INFO:tasks.rados.rados.0.smithi137.stdout:540: done (2 left) 2024-03-04T06:43:38.408 INFO:tasks.rados.rados.0.smithi137.stdout:542: done (1 left) 2024-03-04T06:43:38.408 INFO:tasks.rados.rados.0.smithi137.stdout:543: done (0 left) 2024-03-04T06:43:38.409 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 51 2024-03-04T06:43:38.409 INFO:tasks.rados.rados.0.smithi137.stdout:544: seq_num 189 ranges {0=770048} 2024-03-04T06:43:38.412 INFO:tasks.rados.rados.0.smithi137.stdout:544: writing smithi13777483-3 from 0 to 770048 tid 1 2024-03-04T06:43:38.412 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 51 2024-03-04T06:43:38.412 INFO:tasks.rados.rados.0.smithi137.stdout:545: seq_num 190 ranges {917504=786432} 2024-03-04T06:43:38.422 INFO:tasks.rados.rados.0.smithi137.stdout:545: writing smithi13777483-49 from 917504 to 1703936 tid 1 2024-03-04T06:43:38.422 INFO:tasks.rados.rados.0.smithi137.stdout:546: read oid 32 snap 25 2024-03-04T06:43:38.422 INFO:tasks.rados.rados.0.smithi137.stdout:546: expect (ObjNum 96 snap 19 seq_num 96) 2024-03-04T06:43:38.422 INFO:tasks.rados.rados.0.smithi137.stdout:547: rollback oid 50 current snap is 51 2024-03-04T06:43:38.422 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 50 to 44 2024-03-04T06:43:38.422 INFO:tasks.rados.rados.0.smithi137.stdout:544: finishing write tid 1 to smithi13777483-3 2024-03-04T06:43:38.422 INFO:tasks.rados.rados.0.smithi137.stdout:544: finishing write tid 2 to smithi13777483-3 2024-03-04T06:43:38.422 INFO:tasks.rados.rados.0.smithi137.stdout:544: finishing write tid 3 to smithi13777483-3 2024-03-04T06:43:38.422 INFO:tasks.rados.rados.0.smithi137.stdout:544: oid 3 updating version 0 to 264 2024-03-04T06:43:38.422 INFO:tasks.rados.rados.0.smithi137.stdout:544: oid 3 version 264 is already newer than 263 2024-03-04T06:43:38.423 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 264 (ObjNum 189 snap 51 seq_num 189) dirty exists 2024-03-04T06:43:38.423 INFO:tasks.rados.rados.0.smithi137.stdout:544: left oid 3 (ObjNum 189 snap 51 seq_num 189) 2024-03-04T06:43:38.423 INFO:tasks.rados.rados.0.smithi137.stdout:544: done (3 left) 2024-03-04T06:43:38.423 INFO:tasks.rados.rados.0.smithi137.stdout:548: snap_create 2024-03-04T06:43:38.428 INFO:tasks.rados.rados.0.smithi137.stdout:545: finishing write tid 1 to smithi13777483-49 2024-03-04T06:43:38.428 INFO:tasks.rados.rados.0.smithi137.stdout:545: finishing write tid 2 to smithi13777483-49 2024-03-04T06:43:38.430 INFO:tasks.rados.rados.0.smithi137.stdout:545: finishing write tid 3 to smithi13777483-49 2024-03-04T06:43:38.430 INFO:tasks.rados.rados.0.smithi137.stdout:545: oid 49 updating version 0 to 189 2024-03-04T06:43:38.430 INFO:tasks.rados.rados.0.smithi137.stdout:545: oid 49 version 189 is already newer than 188 2024-03-04T06:43:38.430 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 189 (ObjNum 190 snap 51 seq_num 190) dirty exists 2024-03-04T06:43:38.430 INFO:tasks.rados.rados.0.smithi137.stdout:545: left oid 49 (ObjNum 190 snap 51 seq_num 190) 2024-03-04T06:43:38.430 INFO:tasks.rados.rados.0.smithi137.stdout:546: expect (ObjNum 96 snap 19 seq_num 96) 2024-03-04T06:43:38.495 INFO:tasks.rados.rados.0.smithi137.stdout:547: finishing rollback tid 0 to smithi13777483-50 2024-03-04T06:43:38.495 INFO:tasks.rados.rados.0.smithi137.stdout:547: finishing rollback tid 1 to smithi13777483-50 2024-03-04T06:43:38.495 INFO:tasks.rados.rados.0.smithi137.stdout:547: finishing rollback tid 2 to smithi13777483-50 2024-03-04T06:43:38.495 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 326 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-03-04T06:43:38.651 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-mon[30756]: osdmap e162: 8 total, 8 up, 8 in 2024-03-04T06:43:38.651 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@prometheus.a.service: Deactivated successfully. 2024-03-04T06:43:38.651 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 systemd[1]: Stopped Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:43:38.651 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@prometheus.a.service: Consumed 1.535s CPU time. 2024-03-04T06:43:38.652 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 systemd[1]: Starting Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:43:38.652 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 podman[73839]: 2024-03-04 06:43:38.546325806 +0000 UTC m=+0.018750536 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-03-04T06:43:38.652 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 podman[73839]: 2024-03-04 06:43:38.651759002 +0000 UTC m=+0.124183732 container create 93bdbbe990e9c2ed9ae707b82e8725a3915065d8bac20c04f9f17ebb8ed14465 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:43:38.777 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:38 smithi137 ceph-mon[26846]: osdmap e162: 8 total, 8 up, 8 in 2024-03-04T06:43:38.777 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:38 smithi137 ceph-mon[37364]: osdmap e162: 8 total, 8 up, 8 in 2024-03-04T06:43:38.902 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 podman[73839]: 2024-03-04 06:43:38.862353616 +0000 UTC m=+0.334778346 container init 93bdbbe990e9c2ed9ae707b82e8725a3915065d8bac20c04f9f17ebb8ed14465 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:43:38.902 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 podman[73839]: 2024-03-04 06:43:38.864949271 +0000 UTC m=+0.337374011 container start 93bdbbe990e9c2ed9ae707b82e8725a3915065d8bac20c04f9f17ebb8ed14465 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:43:38.902 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.889Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-04T06:43:38.902 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.889Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-04T06:43:38.902 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.889Z caller=main.go:570 level=info host_details="(Linux 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 x86_64 smithi203 (none))" 2024-03-04T06:43:38.902 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.889Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-04T06:43:38.902 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.889Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-04T06:43:38.902 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.890Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-04T06:43:38.903 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.891Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-04T06:43:38.903 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.891Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-04T06:43:38.903 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.891Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-04T06:43:38.903 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.893Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-04T06:43:38.903 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.893Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.773µs 2024-03-04T06:43:38.903 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.893Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-04T06:43:38.903 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.896Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-03-04T06:43:38.903 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.902Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-03-04T06:43:39.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.903Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-03-04T06:43:39.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.903Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=18.439µs wal_replay_duration=9.901446ms wbl_replay_duration=140ns total_replay_duration=9.937001ms 2024-03-04T06:43:39.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.905Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-04T06:43:39.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.905Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-04T06:43:39.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.905Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-04T06:43:39.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.926Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=20.881904ms db_storage=766ns remote_storage=1.09µs web_handler=410ns query_engine=609ns scrape=253.637µs scrape_sd=81.889µs notify=30.09µs notify_sd=13.23µs rules=20.208128ms tracing=5.985µs 2024-03-04T06:43:39.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.926Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-04T06:43:39.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:43:38.926Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-04T06:43:39.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 bash[73839]: 93bdbbe990e9c2ed9ae707b82e8725a3915065d8bac20c04f9f17ebb8ed14465 2024-03-04T06:43:39.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:43:38 smithi203 systemd[1]: Started Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:43:39.417 INFO:tasks.rados.rados.0.smithi137.stdout:545: done (3 left) 2024-03-04T06:43:39.417 INFO:tasks.rados.rados.0.smithi137.stdout:546: done (2 left) 2024-03-04T06:43:39.417 INFO:tasks.rados.rados.0.smithi137.stdout:547: done (1 left) 2024-03-04T06:43:39.417 INFO:tasks.rados.rados.0.smithi137.stdout:548: done (0 left) 2024-03-04T06:43:39.417 INFO:tasks.rados.rados.0.smithi137.stdout:549: read oid 22 snap -1 2024-03-04T06:43:39.418 INFO:tasks.rados.rados.0.smithi137.stdout:549: expect (ObjNum 78 snap 11 seq_num 78) 2024-03-04T06:43:39.418 INFO:tasks.rados.rados.0.smithi137.stdout:550: read oid 9 snap -1 2024-03-04T06:43:39.418 INFO:tasks.rados.rados.0.smithi137.stdout:550: expect deleted 2024-03-04T06:43:39.418 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 52 2024-03-04T06:43:39.418 INFO:tasks.rados.rados.0.smithi137.stdout:551: seq_num 191 ranges {778240=802816} 2024-03-04T06:43:39.426 INFO:tasks.rados.rados.0.smithi137.stdout:551: writing smithi13777483-8 from 778240 to 1581056 tid 1 2024-03-04T06:43:39.426 INFO:tasks.rados.rados.0.smithi137.stdout:552: snap_create 2024-03-04T06:43:39.426 INFO:tasks.rados.rados.0.smithi137.stdout:549: expect (ObjNum 78 snap 11 seq_num 78) 2024-03-04T06:43:39.503 INFO:tasks.rados.rados.0.smithi137.stdout:551: finishing write tid 1 to smithi13777483-8 2024-03-04T06:43:39.504 INFO:tasks.rados.rados.0.smithi137.stdout:551: finishing write tid 2 to smithi13777483-8 2024-03-04T06:43:39.504 INFO:tasks.rados.rados.0.smithi137.stdout:551: finishing write tid 3 to smithi13777483-8 2024-03-04T06:43:39.504 INFO:tasks.rados.rados.0.smithi137.stdout:551: oid 8 updating version 0 to 98 2024-03-04T06:43:39.504 INFO:tasks.rados.rados.0.smithi137.stdout:551: oid 8 version 98 is already newer than 97 2024-03-04T06:43:39.504 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 98 (ObjNum 191 snap 52 seq_num 191) dirty exists 2024-03-04T06:43:39.504 INFO:tasks.rados.rados.0.smithi137.stdout:551: left oid 8 (ObjNum 191 snap 52 seq_num 191) 2024-03-04T06:43:39.667 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:39 smithi203 ceph-mon[30756]: pgmap v33: 121 pgs: 121 active+clean; 160 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 688 KiB/s wr, 9 op/s 2024-03-04T06:43:39.667 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:39 smithi203 ceph-mon[30756]: osdmap e163: 8 total, 8 up, 8 in 2024-03-04T06:43:39.667 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:39 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:39.667 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:39 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:39.667 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:39 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:43:39.668 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:39 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:39.750 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:39 smithi137 ceph-mon[26846]: pgmap v33: 121 pgs: 121 active+clean; 160 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 688 KiB/s wr, 9 op/s 2024-03-04T06:43:39.751 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:39 smithi137 ceph-mon[26846]: osdmap e163: 8 total, 8 up, 8 in 2024-03-04T06:43:39.751 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:39 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:39.751 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:39 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:39.751 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:39 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:43:39.751 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:39 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:39.751 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:39 smithi137 ceph-mon[37364]: pgmap v33: 121 pgs: 121 active+clean; 160 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 688 KiB/s wr, 9 op/s 2024-03-04T06:43:39.751 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:39 smithi137 ceph-mon[37364]: osdmap e163: 8 total, 8 up, 8 in 2024-03-04T06:43:39.751 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:39 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:39.751 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:39 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:39.751 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:39 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:43:39.751 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:39 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:40.421 INFO:tasks.rados.rados.0.smithi137.stdout:549: done (3 left) 2024-03-04T06:43:40.422 INFO:tasks.rados.rados.0.smithi137.stdout:550: done (2 left) 2024-03-04T06:43:40.422 INFO:tasks.rados.rados.0.smithi137.stdout:551: done (1 left) 2024-03-04T06:43:40.422 INFO:tasks.rados.rados.0.smithi137.stdout:552: done (0 left) 2024-03-04T06:43:40.422 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 53 2024-03-04T06:43:40.422 INFO:tasks.rados.rados.0.smithi137.stdout:553: seq_num 192 ranges {0=417792,417792=401408} 2024-03-04T06:43:40.423 INFO:tasks.rados.rados.0.smithi137.stdout:553: writing smithi13777483-23 from 0 to 417792 tid 1 2024-03-04T06:43:40.425 INFO:tasks.rados.rados.0.smithi137.stdout:553: writing smithi13777483-23 from 417792 to 819200 tid 2 2024-03-04T06:43:40.426 INFO:tasks.rados.rados.0.smithi137.stdout:554: copy_from oid 26 from oid 22 current snap is 53 2024-03-04T06:43:40.426 INFO:tasks.rados.rados.0.smithi137.stdout:555: snap_create 2024-03-04T06:43:40.430 INFO:tasks.rados.rados.0.smithi137.stdout:553: finishing write tid 1 to smithi13777483-23 2024-03-04T06:43:40.431 INFO:tasks.rados.rados.0.smithi137.stdout:553: finishing write tid 2 to smithi13777483-23 2024-03-04T06:43:40.431 INFO:tasks.rados.rados.0.smithi137.stdout:553: finishing write tid 3 to smithi13777483-23 2024-03-04T06:43:40.432 INFO:tasks.rados.rados.0.smithi137.stdout:553: finishing write tid 4 to smithi13777483-23 2024-03-04T06:43:40.432 INFO:tasks.rados.rados.0.smithi137.stdout:553: oid 23 updating version 0 to 163 2024-03-04T06:43:40.432 INFO:tasks.rados.rados.0.smithi137.stdout:553: oid 23 version 163 is already newer than 162 2024-03-04T06:43:40.432 INFO:tasks.rados.rados.0.smithi137.stdout:553: oid 23 version 163 is already newer than 161 2024-03-04T06:43:40.432 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 163 (ObjNum 192 snap 53 seq_num 192) dirty exists 2024-03-04T06:43:40.432 INFO:tasks.rados.rados.0.smithi137.stdout:553: left oid 23 (ObjNum 192 snap 53 seq_num 192) 2024-03-04T06:43:40.435 INFO:tasks.rados.rados.0.smithi137.stdout:554: finishing copy_from racing read to smithi13777483-26 2024-03-04T06:43:40.440 INFO:tasks.rados.rados.0.smithi137.stdout:554: finishing copy_from to smithi13777483-26 2024-03-04T06:43:40.440 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 120 (ObjNum 78 snap 11 seq_num 78) dirty exists 2024-03-04T06:43:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:40 smithi137 ceph-mon[26846]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:43:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:40 smithi137 ceph-mon[26846]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-04T06:43:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:40 smithi137 ceph-mon[26846]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-04T06:43:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:40 smithi137 ceph-mon[26846]: osdmap e164: 8 total, 8 up, 8 in 2024-03-04T06:43:40.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:40 smithi137 ceph-mon[37364]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:43:40.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:40 smithi137 ceph-mon[37364]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-04T06:43:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:40 smithi137 ceph-mon[37364]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-04T06:43:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:40 smithi137 ceph-mon[37364]: osdmap e164: 8 total, 8 up, 8 in 2024-03-04T06:43:40.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:40 smithi203 ceph-mon[30756]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:43:40.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:40 smithi203 ceph-mon[30756]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-04T06:43:40.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:40 smithi203 ceph-mon[30756]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-04T06:43:40.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:40 smithi203 ceph-mon[30756]: osdmap e164: 8 total, 8 up, 8 in 2024-03-04T06:43:41.433 INFO:tasks.rados.rados.0.smithi137.stdout:553: done (2 left) 2024-03-04T06:43:41.433 INFO:tasks.rados.rados.0.smithi137.stdout:554: done (1 left) 2024-03-04T06:43:41.433 INFO:tasks.rados.rados.0.smithi137.stdout:555: done (0 left) 2024-03-04T06:43:41.434 INFO:tasks.rados.rados.0.smithi137.stdout:556: snap_create 2024-03-04T06:43:41.442 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:43:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[26846]: pgmap v36: 121 pgs: 121 active+clean; 174 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 24 op/s 2024-03-04T06:43:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[26846]: osdmap e165: 8 total, 8 up, 8 in 2024-03-04T06:43:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:43:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:43:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:43:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[37364]: pgmap v36: 121 pgs: 121 active+clean; 174 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 24 op/s 2024-03-04T06:43:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[37364]: osdmap e165: 8 total, 8 up, 8 in 2024-03-04T06:43:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:43:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:43:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:43:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:41 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:41.761 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:43:41.761 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (3m) 15s ago 4m 27.7M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:43:41.761 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (4m) 13s ago 4m 87.4M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:43:41.761 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (5m) 15s ago 5m 17.2M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (5m) 13s ago 5m 17.1M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (38s) 13s ago 9m 492M - 19.0.0-1791-gefb04e5e 0c401cd3e778 8fd5e9ed1e80 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:9283,8765 running (10m) 15s ago 10m 372M - 18.2.1-696-g5cc7a767 540557f94930 d360a32fa2a3 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (10m) 15s ago 10m 55.0M 2048M 18.2.1-696-g5cc7a767 540557f94930 0279ece55dcc 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (9m) 13s ago 9m 46.7M 2048M 18.2.1-696-g5cc7a767 540557f94930 c1087568a246 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (9m) 15s ago 9m 41.6M 2048M 18.2.1-696-g5cc7a767 540557f94930 63f51a40232d 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (3m) 15s ago 3m 16.4M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (3m) 13s ago 3m 15.7M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (8m) 15s ago 8m 95.5M 2480M 18.2.1-696-g5cc7a767 540557f94930 732ea50ff558 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (8m) 15s ago 8m 88.6M 2480M 18.2.1-696-g5cc7a767 540557f94930 708139c858a7 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (7m) 15s ago 7m 112M 2480M 18.2.1-696-g5cc7a767 540557f94930 b247adf81a73 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (7m) 15s ago 7m 60.7M 2480M 18.2.1-696-g5cc7a767 540557f94930 afdbc25c9fba 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (7m) 13s ago 7m 94.7M 2480M 18.2.1-696-g5cc7a767 540557f94930 d4841ffd0747 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (6m) 13s ago 6m 102M 2480M 18.2.1-696-g5cc7a767 540557f94930 81d21771e157 2024-03-04T06:43:41.762 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (6m) 13s ago 6m 66.4M 2480M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:43:41.763 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (5m) 13s ago 5m 82.8M 2480M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:43:41.763 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 starting - - - - 2024-03-04T06:43:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:41 smithi203 ceph-mon[30756]: pgmap v36: 121 pgs: 121 active+clean; 174 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 24 op/s 2024-03-04T06:43:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:41 smithi203 ceph-mon[30756]: osdmap e165: 8 total, 8 up, 8 in 2024-03-04T06:43:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:41 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:41 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:43:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:41 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:43:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:41 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:43:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:41 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:42.154 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:43:42.154 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:43:42.154 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 3 2024-03-04T06:43:42.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:43:42.154 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:43:42.154 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 1, 2024-03-04T06:43:42.154 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 1 2024-03-04T06:43:42.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:43:42.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:43:42.155 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 8 2024-03-04T06:43:42.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:43:42.155 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:43:42.155 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:43:42.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:43:42.155 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:43:42.155 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 14, 2024-03-04T06:43:42.155 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 1 2024-03-04T06:43:42.155 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:43:42.155 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:43:42.437 INFO:tasks.rados.rados.0.smithi137.stdout:556: done (0 left) 2024-03-04T06:43:42.437 INFO:tasks.rados.rados.0.smithi137.stdout:557: delete oid 4 current snap is 55 2024-03-04T06:43:42.440 INFO:tasks.rados.rados.0.smithi137.stdout:557: done (0 left) 2024-03-04T06:43:42.440 INFO:tasks.rados.rados.0.smithi137.stdout:558: delete oid 15 current snap is 55 2024-03-04T06:43:42.443 INFO:tasks.rados.rados.0.smithi137.stdout:558: done (0 left) 2024-03-04T06:43:42.443 INFO:tasks.rados.rados.0.smithi137.stdout:559: snap_create 2024-03-04T06:43:42.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:42 smithi137 ceph-mon[26846]: Upgrade: Updating mgr.y 2024-03-04T06:43:42.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:42 smithi137 ceph-mon[26846]: Deploying daemon mgr.y on smithi137 2024-03-04T06:43:42.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:42 smithi137 ceph-mon[26846]: from='client.25088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:43:42.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:42 smithi137 ceph-mon[26846]: osdmap e166: 8 total, 8 up, 8 in 2024-03-04T06:43:42.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:42 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/758679931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:43:42.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:42 smithi137 ceph-mon[37364]: Upgrade: Updating mgr.y 2024-03-04T06:43:42.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:42 smithi137 ceph-mon[37364]: Deploying daemon mgr.y on smithi137 2024-03-04T06:43:42.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:42 smithi137 ceph-mon[37364]: from='client.25088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:43:42.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:42 smithi137 ceph-mon[37364]: osdmap e166: 8 total, 8 up, 8 in 2024-03-04T06:43:42.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:42 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/758679931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:43:42.832 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:42 smithi137 systemd[1]: Stopping Ceph mgr.y for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:43:42.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:42 smithi203 ceph-mon[30756]: Upgrade: Updating mgr.y 2024-03-04T06:43:42.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:42 smithi203 ceph-mon[30756]: Deploying daemon mgr.y on smithi137 2024-03-04T06:43:42.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:42 smithi203 ceph-mon[30756]: from='client.25088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:43:42.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:42 smithi203 ceph-mon[30756]: osdmap e166: 8 total, 8 up, 8 in 2024-03-04T06:43:42.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:42 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/758679931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:43:43.085 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:42 smithi137 podman[80075]: 2024-03-04 06:43:42.832031296 +0000 UTC m=+0.135261788 container died d360a32fa2a312892e0fca411600a39a893961a0a8480a6e7d9e23c10832ffc8 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=reef-5cc7a76, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:43:43.360 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:43 smithi137 podman[80075]: 2024-03-04 06:43:43.142678097 +0000 UTC m=+0.445908588 container cleanup d360a32fa2a312892e0fca411600a39a893961a0a8480a6e7d9e23c10832ffc8 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=reef-5cc7a76, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True) 2024-03-04T06:43:43.360 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:43 smithi137 bash[80075]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y 2024-03-04T06:43:43.445 INFO:tasks.rados.rados.0.smithi137.stdout:559: done (0 left) 2024-03-04T06:43:43.445 INFO:tasks.rados.rados.0.smithi137.stdout:560: setattr oid 19 current snap is 56 2024-03-04T06:43:43.447 INFO:tasks.rados.rados.0.smithi137.stdout:561: rmattr oid 42 current snap is 56 2024-03-04T06:43:43.447 INFO:tasks.rados.rados.0.smithi137.stdout:561: done (1 left) 2024-03-04T06:43:43.447 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 56 2024-03-04T06:43:43.447 INFO:tasks.rados.rados.0.smithi137.stdout:562: seq_num 195 ranges {5685248=475136,6160384=401408} 2024-03-04T06:43:43.481 INFO:tasks.rados.rados.0.smithi137.stdout:562: writing smithi13777483-39 from 5685248 to 6160384 tid 1 2024-03-04T06:43:43.484 INFO:tasks.rados.rados.0.smithi137.stdout:562: writing smithi13777483-39 from 6160384 to 6561792 tid 2 2024-03-04T06:43:43.484 INFO:tasks.rados.rados.0.smithi137.stdout:563: read oid 47 snap -1 2024-03-04T06:43:43.484 INFO:tasks.rados.rados.0.smithi137.stdout:563: expect (ObjNum 182 snap 50 seq_num 182) 2024-03-04T06:43:43.484 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 41 current snap is 56 2024-03-04T06:43:43.484 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 266 (ObjNum 124 snap 34 seq_num 124) dirty exists 2024-03-04T06:43:43.484 INFO:tasks.rados.rados.0.smithi137.stdout:564: seq_num 196 ranges {32768=491520,524288=401408} 2024-03-04T06:43:43.486 INFO:tasks.rados.rados.0.smithi137.stdout:564: writing smithi13777483-41 from 32768 to 524288 tid 1 2024-03-04T06:43:43.489 INFO:tasks.rados.rados.0.smithi137.stdout:564: writing smithi13777483-41 from 524288 to 925696 tid 2 2024-03-04T06:43:43.489 INFO:tasks.rados.rados.0.smithi137.stdout:560: done (3 left) 2024-03-04T06:43:43.489 INFO:tasks.rados.rados.0.smithi137.stdout:565: read oid 26 snap 48 2024-03-04T06:43:43.490 INFO:tasks.rados.rados.0.smithi137.stdout:565: expect (ObjNum 156 snap 44 seq_num 156) 2024-03-04T06:43:43.490 INFO:tasks.rados.rados.0.smithi137.stdout:566: snap_remove snap 35 2024-03-04T06:43:43.770 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:43 smithi137 ceph-mon[26846]: from='client.25094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:43:43.770 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:43 smithi137 ceph-mon[26846]: pgmap v39: 121 pgs: 121 active+clean; 174 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 24 op/s 2024-03-04T06:43:43.771 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:43 smithi137 ceph-mon[26846]: osdmap e167: 8 total, 8 up, 8 in 2024-03-04T06:43:43.771 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:43 smithi137 ceph-mon[37364]: from='client.25094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:43:43.771 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:43 smithi137 ceph-mon[37364]: pgmap v39: 121 pgs: 121 active+clean; 174 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 24 op/s 2024-03-04T06:43:43.771 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:43 smithi137 ceph-mon[37364]: osdmap e167: 8 total, 8 up, 8 in 2024-03-04T06:43:43.771 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:43 smithi137 podman[80089]: 2024-03-04 06:43:43.360771522 +0000 UTC m=+0.528929788 container remove d360a32fa2a312892e0fca411600a39a893961a0a8480a6e7d9e23c10832ffc8 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=reef-5cc7a76, ceph=True, org.label-schema.license=GPLv2) 2024-03-04T06:43:43.771 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:43 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-03-04T06:43:43.771 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:43 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.y.service: Failed with result 'exit-code'. 2024-03-04T06:43:43.771 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:43 smithi137 systemd[1]: Stopped Ceph mgr.y for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:43:43.771 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:43 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.y.service: Consumed 1min 5.422s CPU time. 2024-03-04T06:43:43.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:43 smithi203 ceph-mon[30756]: from='client.25094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:43:43.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:43 smithi203 ceph-mon[30756]: pgmap v39: 121 pgs: 121 active+clean; 174 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 24 op/s 2024-03-04T06:43:43.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:43 smithi203 ceph-mon[30756]: osdmap e167: 8 total, 8 up, 8 in 2024-03-04T06:43:44.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:43 smithi137 systemd[1]: Starting Ceph mgr.y for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:43:44.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:43 smithi137 podman[80219]: 2024-03-04 06:43:43.885274669 +0000 UTC m=+0.018493804 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:43:44.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:43 smithi137 podman[80219]: 2024-03-04 06:43:43.986608395 +0000 UTC m=+0.119827531 container create 766428acf3e507ac9991b76d718f040c4228c1c2c56644db7a2b6212dbb0b2c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222) 2024-03-04T06:43:44.451 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:44 smithi137 podman[80219]: 2024-03-04 06:43:44.255831616 +0000 UTC m=+0.389050764 container init 766428acf3e507ac9991b76d718f040c4228c1c2c56644db7a2b6212dbb0b2c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=) 2024-03-04T06:43:44.452 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:44 smithi137 podman[80219]: 2024-03-04 06:43:44.258413298 +0000 UTC m=+0.391632440 container start 766428acf3e507ac9991b76d718f040c4228c1c2c56644db7a2b6212dbb0b2c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, io.buildah.version=1.33.5) 2024-03-04T06:43:44.452 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:44 smithi137 ceph-mgr[80238]: -- 172.21.15.137:0/2194034128 <== mon.0 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561055f2c5a0 con 0x561055f00800 2024-03-04T06:43:44.452 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:44 smithi137 bash[80219]: 766428acf3e507ac9991b76d718f040c4228c1c2c56644db7a2b6212dbb0b2c3 2024-03-04T06:43:44.452 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:44 smithi137 systemd[1]: Started Ceph mgr.y for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:43:44.462 INFO:tasks.rados.rados.0.smithi137.stdout:566: done (4 left) 2024-03-04T06:43:44.462 INFO:tasks.rados.rados.0.smithi137.stdout:567: read oid 32 snap -1 2024-03-04T06:43:44.462 INFO:tasks.rados.rados.0.smithi137.stdout:567: expect (ObjNum 140 snap 40 seq_num 140) 2024-03-04T06:43:44.462 INFO:tasks.rados.rados.0.smithi137.stdout:568: rollback oid 29 current snap is 56 2024-03-04T06:43:44.462 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 29 to 53 2024-03-04T06:43:44.462 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 40 current snap is 56 2024-03-04T06:43:44.462 INFO:tasks.rados.rados.0.smithi137.stdout:569: seq_num 197 ranges {2113536=507904,2621440=401408} 2024-03-04T06:43:44.478 INFO:tasks.rados.rados.0.smithi137.stdout:569: writing smithi13777483-40 from 2113536 to 2621440 tid 1 2024-03-04T06:43:44.481 INFO:tasks.rados.rados.0.smithi137.stdout:569: writing smithi13777483-40 from 2621440 to 3022848 tid 2 2024-03-04T06:43:44.481 INFO:tasks.rados.rados.0.smithi137.stdout:562: finishing write tid 1 to smithi13777483-39 2024-03-04T06:43:44.481 INFO:tasks.rados.rados.0.smithi137.stdout:562: finishing write tid 2 to smithi13777483-39 2024-03-04T06:43:44.481 INFO:tasks.rados.rados.0.smithi137.stdout:562: finishing write tid 3 to smithi13777483-39 2024-03-04T06:43:44.481 INFO:tasks.rados.rados.0.smithi137.stdout:565: expect (ObjNum 156 snap 44 seq_num 156) 2024-03-04T06:43:44.494 INFO:tasks.rados.rados.0.smithi137.stdout:562: finishing write tid 4 to smithi13777483-39 2024-03-04T06:43:44.494 INFO:tasks.rados.rados.0.smithi137.stdout:562: oid 39 updating version 0 to 84 2024-03-04T06:43:44.494 INFO:tasks.rados.rados.0.smithi137.stdout:562: oid 39 updating version 84 to 86 2024-03-04T06:43:44.494 INFO:tasks.rados.rados.0.smithi137.stdout:562: oid 39 version 86 is already newer than 85 2024-03-04T06:43:44.494 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 86 (ObjNum 195 snap 56 seq_num 195) dirty exists 2024-03-04T06:43:44.494 INFO:tasks.rados.rados.0.smithi137.stdout:562: left oid 39 (ObjNum 195 snap 56 seq_num 195) 2024-03-04T06:43:44.494 INFO:tasks.rados.rados.0.smithi137.stdout:564: finishing write tid 1 to smithi13777483-41 2024-03-04T06:43:44.494 INFO:tasks.rados.rados.0.smithi137.stdout:564: finishing write tid 2 to smithi13777483-41 2024-03-04T06:43:44.494 INFO:tasks.rados.rados.0.smithi137.stdout:564: finishing write tid 3 to smithi13777483-41 2024-03-04T06:43:44.494 INFO:tasks.rados.rados.0.smithi137.stdout:564: finishing write tid 4 to smithi13777483-41 2024-03-04T06:43:44.494 INFO:tasks.rados.rados.0.smithi137.stdout:564: oid 41 updating version 0 to 102 2024-03-04T06:43:44.494 INFO:tasks.rados.rados.0.smithi137.stdout:564: oid 41 updating version 102 to 103 2024-03-04T06:43:44.495 INFO:tasks.rados.rados.0.smithi137.stdout:564: oid 41 updating version 103 to 104 2024-03-04T06:43:44.495 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 104 (ObjNum 196 snap 56 seq_num 196) dirty exists 2024-03-04T06:43:44.495 INFO:tasks.rados.rados.0.smithi137.stdout:564: left oid 41 (ObjNum 196 snap 56 seq_num 196) 2024-03-04T06:43:44.495 INFO:tasks.rados.rados.0.smithi137.stdout:562: done (6 left) 2024-03-04T06:43:44.495 INFO:tasks.rados.rados.0.smithi137.stdout:564: done (5 left) 2024-03-04T06:43:44.495 INFO:tasks.rados.rados.0.smithi137.stdout:565: done (4 left) 2024-03-04T06:43:44.495 INFO:tasks.rados.rados.0.smithi137.stdout:570: copy_from oid 35 from oid 43 current snap is 56 2024-03-04T06:43:44.495 INFO:tasks.rados.rados.0.smithi137.stdout:563: expect (ObjNum 182 snap 50 seq_num 182) 2024-03-04T06:43:44.605 INFO:tasks.rados.rados.0.smithi137.stdout:568: finishing rollback tid 0 to smithi13777483-29 2024-03-04T06:43:44.605 INFO:tasks.rados.rados.0.smithi137.stdout:568: finishing rollback tid 1 to smithi13777483-29 2024-03-04T06:43:44.605 INFO:tasks.rados.rados.0.smithi137.stdout:568: finishing rollback tid 2 to smithi13777483-29 2024-03-04T06:43:44.605 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 150 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-04T06:43:44.605 INFO:tasks.rados.rados.0.smithi137.stdout:563: done (4 left) 2024-03-04T06:43:44.605 INFO:tasks.rados.rados.0.smithi137.stdout:568: done (3 left) 2024-03-04T06:43:44.605 INFO:tasks.rados.rados.0.smithi137.stdout:571: rollback oid 4 current snap is 56 2024-03-04T06:43:44.605 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 4 to 50 2024-03-04T06:43:44.605 INFO:tasks.rados.rados.0.smithi137.stdout:567: expect (ObjNum 140 snap 40 seq_num 140) 2024-03-04T06:43:44.668 INFO:tasks.rados.rados.0.smithi137.stdout:569: finishing write tid 1 to smithi13777483-40 2024-03-04T06:43:44.668 INFO:tasks.rados.rados.0.smithi137.stdout:569: finishing write tid 2 to smithi13777483-40 2024-03-04T06:43:44.668 INFO:tasks.rados.rados.0.smithi137.stdout:567: done (3 left) 2024-03-04T06:43:44.668 INFO:tasks.rados.rados.0.smithi137.stdout:572: copy_from oid 17 from oid 22 current snap is 56 2024-03-04T06:43:44.668 INFO:tasks.rados.rados.0.smithi137.stdout:569: finishing write tid 3 to smithi13777483-40 2024-03-04T06:43:44.668 INFO:tasks.rados.rados.0.smithi137.stdout:569: finishing write tid 4 to smithi13777483-40 2024-03-04T06:43:44.668 INFO:tasks.rados.rados.0.smithi137.stdout:569: oid 40 updating version 0 to 258 2024-03-04T06:43:44.668 INFO:tasks.rados.rados.0.smithi137.stdout:569: oid 40 version 258 is already newer than 257 2024-03-04T06:43:44.668 INFO:tasks.rados.rados.0.smithi137.stdout:569: oid 40 version 258 is already newer than 256 2024-03-04T06:43:44.668 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 258 (ObjNum 197 snap 56 seq_num 197) dirty exists 2024-03-04T06:43:44.669 INFO:tasks.rados.rados.0.smithi137.stdout:569: left oid 40 (ObjNum 197 snap 56 seq_num 197) 2024-03-04T06:43:44.669 INFO:tasks.rados.rados.0.smithi137.stdout:570: finishing copy_from racing read to smithi13777483-35 2024-03-04T06:43:44.669 INFO:tasks.rados.rados.0.smithi137.stdout:570: finishing copy_from to smithi13777483-35 2024-03-04T06:43:44.669 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 113 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:43:44.669 INFO:tasks.rados.rados.0.smithi137.stdout:571: finishing rollback tid 1 to smithi13777483-4 2024-03-04T06:43:44.669 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 0 (ObjNum 129 snap 0 seq_num 3131223280) dirty dne 2024-03-04T06:43:44.669 INFO:tasks.rados.rados.0.smithi137.stdout:569: done (3 left) 2024-03-04T06:43:44.669 INFO:tasks.rados.rados.0.smithi137.stdout:570: done (2 left) 2024-03-04T06:43:44.669 INFO:tasks.rados.rados.0.smithi137.stdout:571: done (1 left) 2024-03-04T06:43:44.669 INFO:tasks.rados.rados.0.smithi137.stdout:573: rollback oid 47 current snap is 56 2024-03-04T06:43:44.669 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 47 to 21 2024-03-04T06:43:44.669 INFO:tasks.rados.rados.0.smithi137.stdout:574: delete oid 50 current snap is 56 2024-03-04T06:43:44.670 INFO:tasks.rados.rados.0.smithi137.stdout:574: done (2 left) 2024-03-04T06:43:44.670 INFO:tasks.rados.rados.0.smithi137.stdout:575: delete oid 14 current snap is 56 2024-03-04T06:43:44.671 INFO:tasks.rados.rados.0.smithi137.stdout:573: finishing rollback tid 0 to smithi13777483-47 2024-03-04T06:43:44.671 INFO:tasks.rados.rados.0.smithi137.stdout:573: finishing rollback tid 1 to smithi13777483-47 2024-03-04T06:43:44.672 INFO:tasks.rados.rados.0.smithi137.stdout:575: done (2 left) 2024-03-04T06:43:44.672 INFO:tasks.rados.rados.0.smithi137.stdout:576: read oid 9 snap -1 2024-03-04T06:43:44.672 INFO:tasks.rados.rados.0.smithi137.stdout:576: expect deleted 2024-03-04T06:43:44.672 INFO:tasks.rados.rados.0.smithi137.stdout:577: rollback oid 49 current snap is 56 2024-03-04T06:43:44.672 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 49 to 20 2024-03-04T06:43:44.672 INFO:tasks.rados.rados.0.smithi137.stdout:578: delete oid 45 current snap is 56 2024-03-04T06:43:44.672 INFO:tasks.rados.rados.0.smithi137.stdout:573: finishing rollback tid 2 to smithi13777483-47 2024-03-04T06:43:44.673 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 290 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:43:44.674 INFO:tasks.rados.rados.0.smithi137.stdout:573: done (4 left) 2024-03-04T06:43:44.674 INFO:tasks.rados.rados.0.smithi137.stdout:576: done (3 left) 2024-03-04T06:43:44.674 INFO:tasks.rados.rados.0.smithi137.stdout:578: done (2 left) 2024-03-04T06:43:44.674 INFO:tasks.rados.rados.0.smithi137.stdout:579: read oid 30 snap -1 2024-03-04T06:43:44.674 INFO:tasks.rados.rados.0.smithi137.stdout:579: expect (ObjNum 159 snap 45 seq_num 159) 2024-03-04T06:43:44.674 INFO:tasks.rados.rados.0.smithi137.stdout:580: snap_create 2024-03-04T06:43:44.675 INFO:tasks.rados.rados.0.smithi137.stdout:577: finishing rollback tid 0 to smithi13777483-49 2024-03-04T06:43:44.675 INFO:tasks.rados.rados.0.smithi137.stdout:577: finishing rollback tid 1 to smithi13777483-49 2024-03-04T06:43:44.676 INFO:tasks.rados.rados.0.smithi137.stdout:572: finishing copy_from racing read to smithi13777483-17 2024-03-04T06:43:44.676 INFO:tasks.rados.rados.0.smithi137.stdout:577: finishing rollback tid 2 to smithi13777483-49 2024-03-04T06:43:44.676 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 200 (ObjNum 63 snap 4 seq_num 63) dirty exists 2024-03-04T06:43:44.679 INFO:tasks.rados.rados.0.smithi137.stdout:572: finishing copy_from to smithi13777483-17 2024-03-04T06:43:44.679 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 120 (ObjNum 78 snap 11 seq_num 78) dirty exists 2024-03-04T06:43:44.691 INFO:tasks.rados.rados.0.smithi137.stdout:579: expect (ObjNum 159 snap 45 seq_num 159) 2024-03-04T06:43:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:44 smithi137 ceph-mon[26846]: osdmap e168: 8 total, 8 up, 8 in 2024-03-04T06:43:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:44 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:44 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:44.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:44 smithi137 ceph-mon[37364]: osdmap e168: 8 total, 8 up, 8 in 2024-03-04T06:43:44.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:44 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:44.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:44 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:44.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:44 smithi203 ceph-mon[30756]: osdmap e168: 8 total, 8 up, 8 in 2024-03-04T06:43:44.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:44 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:44.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:44 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:45.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:44.850+0000 7f0f9c522200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T06:43:45.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:44.956+0000 7f0f9c522200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T06:43:45.370 INFO:tasks.rados.rados.0.smithi137.stdout:572: done (3 left) 2024-03-04T06:43:45.370 INFO:tasks.rados.rados.0.smithi137.stdout:577: done (2 left) 2024-03-04T06:43:45.370 INFO:tasks.rados.rados.0.smithi137.stdout:579: done (1 left) 2024-03-04T06:43:45.370 INFO:tasks.rados.rados.0.smithi137.stdout:580: done (0 left) 2024-03-04T06:43:45.370 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 57 2024-03-04T06:43:45.370 INFO:tasks.rados.rados.0.smithi137.stdout:581: seq_num 201 ranges {6561792=573440,7135232=401408} 2024-03-04T06:43:45.409 INFO:tasks.rados.rados.0.smithi137.stdout:581: writing smithi13777483-39 from 6561792 to 7135232 tid 1 2024-03-04T06:43:45.411 INFO:tasks.rados.rados.0.smithi137.stdout:581: writing smithi13777483-39 from 7135232 to 7536640 tid 2 2024-03-04T06:43:45.412 INFO:tasks.rados.rados.0.smithi137.stdout:582: read oid 48 snap -1 2024-03-04T06:43:45.412 INFO:tasks.rados.rados.0.smithi137.stdout:582: expect deleted 2024-03-04T06:43:45.412 INFO:tasks.rados.rados.0.smithi137.stdout:583: rollback oid 18 current snap is 57 2024-03-04T06:43:45.412 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 18 to 55 2024-03-04T06:43:45.412 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 57 2024-03-04T06:43:45.412 INFO:tasks.rados.rados.0.smithi137.stdout:584: seq_num 202 ranges {0=589824,589824=401408} 2024-03-04T06:43:45.415 INFO:tasks.rados.rados.0.smithi137.stdout:584: writing smithi13777483-44 from 0 to 589824 tid 1 2024-03-04T06:43:45.417 INFO:tasks.rados.rados.0.smithi137.stdout:584: writing smithi13777483-44 from 589824 to 991232 tid 2 2024-03-04T06:43:45.418 INFO:tasks.rados.rados.0.smithi137.stdout:585: snap_create 2024-03-04T06:43:45.418 INFO:tasks.rados.rados.0.smithi137.stdout:583: finishing rollback tid 0 to smithi13777483-18 2024-03-04T06:43:45.418 INFO:tasks.rados.rados.0.smithi137.stdout:581: finishing write tid 1 to smithi13777483-39 2024-03-04T06:43:45.418 INFO:tasks.rados.rados.0.smithi137.stdout:581: finishing write tid 2 to smithi13777483-39 2024-03-04T06:43:45.418 INFO:tasks.rados.rados.0.smithi137.stdout:581: finishing write tid 3 to smithi13777483-39 2024-03-04T06:43:45.418 INFO:tasks.rados.rados.0.smithi137.stdout:583: finishing rollback tid 1 to smithi13777483-18 2024-03-04T06:43:45.418 INFO:tasks.rados.rados.0.smithi137.stdout:583: finishing rollback tid 2 to smithi13777483-18 2024-03-04T06:43:45.418 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 160 (ObjNum 106 snap 27 seq_num 106) dirty exists 2024-03-04T06:43:45.418 INFO:tasks.rados.rados.0.smithi137.stdout:581: finishing write tid 4 to smithi13777483-39 2024-03-04T06:43:45.418 INFO:tasks.rados.rados.0.smithi137.stdout:581: oid 39 updating version 0 to 91 2024-03-04T06:43:45.418 INFO:tasks.rados.rados.0.smithi137.stdout:581: oid 39 updating version 91 to 92 2024-03-04T06:43:45.418 INFO:tasks.rados.rados.0.smithi137.stdout:581: oid 39 version 92 is already newer than 90 2024-03-04T06:43:45.418 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 92 (ObjNum 201 snap 57 seq_num 201) dirty exists 2024-03-04T06:43:45.419 INFO:tasks.rados.rados.0.smithi137.stdout:581: left oid 39 (ObjNum 201 snap 57 seq_num 201) 2024-03-04T06:43:45.421 INFO:tasks.rados.rados.0.smithi137.stdout:584: finishing write tid 1 to smithi13777483-44 2024-03-04T06:43:45.421 INFO:tasks.rados.rados.0.smithi137.stdout:584: finishing write tid 2 to smithi13777483-44 2024-03-04T06:43:45.421 INFO:tasks.rados.rados.0.smithi137.stdout:584: finishing write tid 3 to smithi13777483-44 2024-03-04T06:43:45.422 INFO:tasks.rados.rados.0.smithi137.stdout:584: finishing write tid 4 to smithi13777483-44 2024-03-04T06:43:45.422 INFO:tasks.rados.rados.0.smithi137.stdout:584: oid 44 updating version 0 to 167 2024-03-04T06:43:45.423 INFO:tasks.rados.rados.0.smithi137.stdout:584: oid 44 updating version 167 to 168 2024-03-04T06:43:45.423 INFO:tasks.rados.rados.0.smithi137.stdout:584: oid 44 version 168 is already newer than 166 2024-03-04T06:43:45.423 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 168 (ObjNum 202 snap 57 seq_num 202) dirty exists 2024-03-04T06:43:45.423 INFO:tasks.rados.rados.0.smithi137.stdout:584: left oid 44 (ObjNum 202 snap 57 seq_num 202) 2024-03-04T06:43:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:45 smithi203 ceph-mon[30756]: pgmap v42: 121 pgs: 121 active+clean; 174 MiB data, 654 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:45 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:45 smithi203 ceph-mon[30756]: osdmap e169: 8 total, 8 up, 8 in 2024-03-04T06:43:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:45 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:45 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:45 smithi203 ceph-mon[30756]: osdmap e170: 8 total, 8 up, 8 in 2024-03-04T06:43:45.758 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:45.665+0000 7f0f9c522200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T06:43:45.758 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:45.757+0000 7f0f9c522200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T06:43:45.758 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-mon[37364]: pgmap v42: 121 pgs: 121 active+clean; 174 MiB data, 654 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:45.758 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:45.758 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-mon[37364]: osdmap e169: 8 total, 8 up, 8 in 2024-03-04T06:43:45.759 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:45.759 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:45.759 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-mon[37364]: osdmap e170: 8 total, 8 up, 8 in 2024-03-04T06:43:45.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-mon[26846]: pgmap v42: 121 pgs: 121 active+clean; 174 MiB data, 654 MiB used, 715 GiB / 715 GiB avail 2024-03-04T06:43:45.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:45.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-mon[26846]: osdmap e169: 8 total, 8 up, 8 in 2024-03-04T06:43:45.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:45.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:45.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-mon[26846]: osdmap e170: 8 total, 8 up, 8 in 2024-03-04T06:43:46.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:45.903+0000 7f0f9c522200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T06:43:46.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:46.005+0000 7f0f9c522200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T06:43:46.364 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:46.090+0000 7f0f9c522200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T06:43:46.364 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:46.364+0000 7f0f9c522200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T06:43:46.376 INFO:tasks.rados.rados.0.smithi137.stdout:581: done (4 left) 2024-03-04T06:43:46.376 INFO:tasks.rados.rados.0.smithi137.stdout:582: done (3 left) 2024-03-04T06:43:46.376 INFO:tasks.rados.rados.0.smithi137.stdout:583: done (2 left) 2024-03-04T06:43:46.376 INFO:tasks.rados.rados.0.smithi137.stdout:584: done (1 left) 2024-03-04T06:43:46.376 INFO:tasks.rados.rados.0.smithi137.stdout:585: done (0 left) 2024-03-04T06:43:46.376 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 58 2024-03-04T06:43:46.376 INFO:tasks.rados.rados.0.smithi137.stdout:586: seq_num 203 ranges {4653056=606208,5259264=401408} 2024-03-04T06:43:46.404 INFO:tasks.rados.rados.0.smithi137.stdout:586: writing smithi13777483-18 from 4653056 to 5259264 tid 1 2024-03-04T06:43:46.406 INFO:tasks.rados.rados.0.smithi137.stdout:586: writing smithi13777483-18 from 5259264 to 5660672 tid 2 2024-03-04T06:43:46.406 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 58 2024-03-04T06:43:46.407 INFO:tasks.rados.rados.0.smithi137.stdout:587: seq_num 204 ranges {7536640=622592,8159232=401408} 2024-03-04T06:43:46.451 INFO:tasks.rados.rados.0.smithi137.stdout:587: writing smithi13777483-39 from 7536640 to 8159232 tid 1 2024-03-04T06:43:46.453 INFO:tasks.rados.rados.0.smithi137.stdout:587: writing smithi13777483-39 from 8159232 to 8560640 tid 2 2024-03-04T06:43:46.453 INFO:tasks.rados.rados.0.smithi137.stdout:588: setattr oid 49 current snap is 58 2024-03-04T06:43:46.454 INFO:tasks.rados.rados.0.smithi137.stdout:586: finishing write tid 1 to smithi13777483-18 2024-03-04T06:43:46.454 INFO:tasks.rados.rados.0.smithi137.stdout:586: finishing write tid 2 to smithi13777483-18 2024-03-04T06:43:46.454 INFO:tasks.rados.rados.0.smithi137.stdout:586: finishing write tid 3 to smithi13777483-18 2024-03-04T06:43:46.454 INFO:tasks.rados.rados.0.smithi137.stdout:586: finishing write tid 4 to smithi13777483-18 2024-03-04T06:43:46.454 INFO:tasks.rados.rados.0.smithi137.stdout:586: oid 18 updating version 0 to 162 2024-03-04T06:43:46.454 INFO:tasks.rados.rados.0.smithi137.stdout:586: oid 18 updating version 162 to 164 2024-03-04T06:43:46.454 INFO:tasks.rados.rados.0.smithi137.stdout:586: oid 18 version 164 is already newer than 163 2024-03-04T06:43:46.454 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 164 (ObjNum 203 snap 58 seq_num 203) dirty exists 2024-03-04T06:43:46.454 INFO:tasks.rados.rados.0.smithi137.stdout:586: left oid 18 (ObjNum 203 snap 58 seq_num 203) 2024-03-04T06:43:46.455 INFO:tasks.rados.rados.0.smithi137.stdout:586: done (2 left) 2024-03-04T06:43:46.455 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 58 2024-03-04T06:43:46.455 INFO:tasks.rados.rados.0.smithi137.stdout:589: seq_num 205 ranges {1581056=638976,2220032=401408} 2024-03-04T06:43:46.467 INFO:tasks.rados.rados.0.smithi137.stdout:589: writing smithi13777483-8 from 1581056 to 2220032 tid 1 2024-03-04T06:43:46.470 INFO:tasks.rados.rados.0.smithi137.stdout:589: writing smithi13777483-8 from 2220032 to 2621440 tid 2 2024-03-04T06:43:46.470 INFO:tasks.rados.rados.0.smithi137.stdout:590: rollback oid 23 current snap is 58 2024-03-04T06:43:46.470 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 23 to 56 2024-03-04T06:43:46.470 INFO:tasks.rados.rados.0.smithi137.stdout:587: finishing write tid 1 to smithi13777483-39 2024-03-04T06:43:46.471 INFO:tasks.rados.rados.0.smithi137.stdout:587: finishing write tid 2 to smithi13777483-39 2024-03-04T06:43:46.471 INFO:tasks.rados.rados.0.smithi137.stdout:587: finishing write tid 3 to smithi13777483-39 2024-03-04T06:43:46.471 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 202 (ObjNum 63 snap 4 seq_num 63) dirty exists 2024-03-04T06:43:46.471 INFO:tasks.rados.rados.0.smithi137.stdout:587: finishing write tid 4 to smithi13777483-39 2024-03-04T06:43:46.471 INFO:tasks.rados.rados.0.smithi137.stdout:587: oid 39 updating version 0 to 94 2024-03-04T06:43:46.471 INFO:tasks.rados.rados.0.smithi137.stdout:587: oid 39 updating version 94 to 96 2024-03-04T06:43:46.471 INFO:tasks.rados.rados.0.smithi137.stdout:587: oid 39 version 96 is already newer than 95 2024-03-04T06:43:46.471 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 96 (ObjNum 204 snap 58 seq_num 204) dirty exists 2024-03-04T06:43:46.471 INFO:tasks.rados.rados.0.smithi137.stdout:587: left oid 39 (ObjNum 204 snap 58 seq_num 204) 2024-03-04T06:43:46.471 INFO:tasks.rados.rados.0.smithi137.stdout:587: done (3 left) 2024-03-04T06:43:46.471 INFO:tasks.rados.rados.0.smithi137.stdout:588: done (2 left) 2024-03-04T06:43:46.471 INFO:tasks.rados.rados.0.smithi137.stdout:591: copy_from oid 46 from oid 12 current snap is 58 2024-03-04T06:43:46.471 INFO:tasks.rados.rados.0.smithi137.stdout:592: snap_remove snap 51 2024-03-04T06:43:46.667 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:46.488+0000 7f0f9c522200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T06:43:46.667 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:46.580+0000 7f0f9c522200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T06:43:47.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:46.684+0000 7f0f9c522200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T06:43:47.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:46.863+0000 7f0f9c522200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T06:43:47.460 INFO:tasks.rados.rados.0.smithi137.stdout:592: done (3 left) 2024-03-04T06:43:47.460 INFO:tasks.rados.rados.0.smithi137.stdout:593: copy_from oid 30 from oid 35 current snap is 58 2024-03-04T06:43:47.460 INFO:tasks.rados.rados.0.smithi137.stdout:594: read oid 3 snap 48 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:594: expect deleted 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:595: copy_from oid 44 from oid 25 current snap is 58 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:596: delete oid 39 current snap is 58 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:590: finishing rollback tid 0 to smithi13777483-23 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:590: finishing rollback tid 1 to smithi13777483-23 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:589: finishing write tid 1 to smithi13777483-8 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:590: finishing rollback tid 2 to smithi13777483-23 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 173 (ObjNum 192 snap 53 seq_num 192) dirty exists 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:589: finishing write tid 2 to smithi13777483-8 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:589: finishing write tid 3 to smithi13777483-8 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:589: finishing write tid 4 to smithi13777483-8 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:589: oid 8 updating version 0 to 99 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:589: oid 8 updating version 99 to 100 2024-03-04T06:43:47.461 INFO:tasks.rados.rados.0.smithi137.stdout:589: oid 8 updating version 100 to 101 2024-03-04T06:43:47.462 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 101 (ObjNum 205 snap 58 seq_num 205) dirty exists 2024-03-04T06:43:47.462 INFO:tasks.rados.rados.0.smithi137.stdout:589: left oid 8 (ObjNum 205 snap 58 seq_num 205) 2024-03-04T06:43:47.462 INFO:tasks.rados.rados.0.smithi137.stdout:591: finishing copy_from racing read to smithi13777483-46 2024-03-04T06:43:47.462 INFO:tasks.rados.rados.0.smithi137.stdout:591: finishing copy_from to smithi13777483-46 2024-03-04T06:43:47.462 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 120 (ObjNum 78 snap 11 seq_num 78) dirty exists 2024-03-04T06:43:47.469 INFO:tasks.rados.rados.0.smithi137.stdout:589: done (6 left) 2024-03-04T06:43:47.470 INFO:tasks.rados.rados.0.smithi137.stdout:590: done (5 left) 2024-03-04T06:43:47.470 INFO:tasks.rados.rados.0.smithi137.stdout:591: done (4 left) 2024-03-04T06:43:47.470 INFO:tasks.rados.rados.0.smithi137.stdout:594: done (3 left) 2024-03-04T06:43:47.470 INFO:tasks.rados.rados.0.smithi137.stdout:596: done (2 left) 2024-03-04T06:43:47.470 INFO:tasks.rados.rados.0.smithi137.stdout:597: snap_create 2024-03-04T06:43:47.472 INFO:tasks.rados.rados.0.smithi137.stdout:595: finishing copy_from racing read to smithi13777483-44 2024-03-04T06:43:47.473 INFO:tasks.rados.rados.0.smithi137.stdout:595: finishing copy_from to smithi13777483-44 2024-03-04T06:43:47.473 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 235 (ObjNum 177 snap 0 seq_num 3162484096) dirty exists 2024-03-04T06:43:47.477 INFO:tasks.rados.rados.0.smithi137.stdout:593: finishing copy_from racing read to smithi13777483-30 2024-03-04T06:43:47.479 INFO:tasks.rados.rados.0.smithi137.stdout:593: finishing copy_from to smithi13777483-30 2024-03-04T06:43:47.479 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 113 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:43:47.714 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:47 smithi137 ceph-mon[26846]: pgmap v45: 121 pgs: 121 active+clean; 179 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-03-04T06:43:47.714 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:47 smithi137 ceph-mon[26846]: osdmap e171: 8 total, 8 up, 8 in 2024-03-04T06:43:47.715 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:47 smithi137 ceph-mon[37364]: pgmap v45: 121 pgs: 121 active+clean; 179 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-03-04T06:43:47.715 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:47 smithi137 ceph-mon[37364]: osdmap e171: 8 total, 8 up, 8 in 2024-03-04T06:43:47.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:47 smithi203 ceph-mon[30756]: pgmap v45: 121 pgs: 121 active+clean; 179 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-03-04T06:43:47.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:47 smithi203 ceph-mon[30756]: osdmap e171: 8 total, 8 up, 8 in 2024-03-04T06:43:48.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:47.910+0000 7f0f9c522200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T06:43:48.395 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:48.044+0000 7f0f9c522200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T06:43:48.395 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:48.394+0000 7f0f9c522200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T06:43:48.469 INFO:tasks.rados.rados.0.smithi137.stdout:593: done (2 left) 2024-03-04T06:43:48.469 INFO:tasks.rados.rados.0.smithi137.stdout:595: done (1 left) 2024-03-04T06:43:48.469 INFO:tasks.rados.rados.0.smithi137.stdout:597: done (0 left) 2024-03-04T06:43:48.469 INFO:tasks.rados.rados.0.smithi137.stdout:598: read oid 45 snap -1 2024-03-04T06:43:48.469 INFO:tasks.rados.rados.0.smithi137.stdout:598: expect deleted 2024-03-04T06:43:48.469 INFO:tasks.rados.rados.0.smithi137.stdout:599: copy_from oid 49 from oid 4 current snap is 59 2024-03-04T06:43:48.469 INFO:tasks.rados.rados.0.smithi137.stdout:600: snap_remove snap 20 2024-03-04T06:43:48.685 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:48 smithi137 ceph-mon[26846]: osdmap e172: 8 total, 8 up, 8 in 2024-03-04T06:43:48.685 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:48 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:48.686 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:48.494+0000 7f0f9c522200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T06:43:48.686 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:48 smithi137 ceph-mon[37364]: osdmap e172: 8 total, 8 up, 8 in 2024-03-04T06:43:48.686 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:48 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:48.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:48 smithi203 ceph-mon[30756]: osdmap e172: 8 total, 8 up, 8 in 2024-03-04T06:43:48.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:48 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:49.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:48.700+0000 7f0f9c522200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:43:49.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:48.888+0000 7f0f9c522200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T06:43:49.463 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:49.207+0000 7f0f9c522200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:43:49.463 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-mon[37364]: pgmap v48: 121 pgs: 121 active+clean; 179 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-03-04T06:43:49.464 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-mon[37364]: osdmap e173: 8 total, 8 up, 8 in 2024-03-04T06:43:49.464 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:49.464 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:49.464 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:49.464 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:49.471 INFO:tasks.rados.rados.0.smithi137.stdout:600: done (2 left) 2024-03-04T06:43:49.471 INFO:tasks.rados.rados.0.smithi137.stdout:601: rollback oid 14 current snap is 59 2024-03-04T06:43:49.472 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 14 to 53 2024-03-04T06:43:49.472 INFO:tasks.rados.rados.0.smithi137.stdout:602: snap_create 2024-03-04T06:43:49.472 INFO:tasks.rados.rados.0.smithi137.stdout:599: finishing copy_from to smithi13777483-49 2024-03-04T06:43:49.472 INFO:tasks.rados.rados.0.smithi137.stdout:599: got expected ENOENT (src dne) 2024-03-04T06:43:49.472 INFO:tasks.rados.rados.0.smithi137.stdout:599: finishing copy_from racing read to smithi13777483-49 2024-03-04T06:43:49.484 INFO:tasks.rados.rados.0.smithi137.stdout:601: finishing rollback tid 1 to smithi13777483-14 2024-03-04T06:43:49.486 INFO:tasks.rados.rados.0.smithi137.stdout:601: finishing rollback tid 2 to smithi13777483-14 2024-03-04T06:43:49.486 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 177 (ObjNum 186 snap 50 seq_num 186) dirty exists 2024-03-04T06:43:49.764 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:49.501+0000 7f0f9c522200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T06:43:49.764 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-mon[26846]: pgmap v48: 121 pgs: 121 active+clean; 179 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-03-04T06:43:49.764 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-mon[26846]: osdmap e173: 8 total, 8 up, 8 in 2024-03-04T06:43:49.764 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:49.764 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:49.764 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:49.764 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:49 smithi203 ceph-mon[30756]: pgmap v48: 121 pgs: 121 active+clean; 179 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-03-04T06:43:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:49 smithi203 ceph-mon[30756]: osdmap e173: 8 total, 8 up, 8 in 2024-03-04T06:43:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:49 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:49 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:49 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:49 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:50.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:49.763+0000 7f0f9c522200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T06:43:50.474 INFO:tasks.rados.rados.0.smithi137.stdout:598: done (3 left) 2024-03-04T06:43:50.474 INFO:tasks.rados.rados.0.smithi137.stdout:599: done (2 left) 2024-03-04T06:43:50.474 INFO:tasks.rados.rados.0.smithi137.stdout:601: done (1 left) 2024-03-04T06:43:50.474 INFO:tasks.rados.rados.0.smithi137.stdout:602: done (0 left) 2024-03-04T06:43:50.474 INFO:tasks.rados.rados.0.smithi137.stdout:603: copy_from oid 16 from oid 10 current snap is 60 2024-03-04T06:43:50.474 INFO:tasks.rados.rados.0.smithi137.stdout:604: snap_remove snap 56 2024-03-04T06:43:50.745 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:50.634+0000 7f0f9c522200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T06:43:50.746 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:50 smithi137 ceph-mon[37364]: osdmap e174: 8 total, 8 up, 8 in 2024-03-04T06:43:50.746 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:50 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:50.746 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:50 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:50.746 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:50 smithi137 ceph-mon[26846]: osdmap e174: 8 total, 8 up, 8 in 2024-03-04T06:43:50.746 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:50 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:50.746 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:50 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:50 smithi203 ceph-mon[30756]: osdmap e174: 8 total, 8 up, 8 in 2024-03-04T06:43:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:50 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:50 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:51.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:51.232+0000 7f0f9c522200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T06:43:51.477 INFO:tasks.rados.rados.0.smithi137.stdout:604: done (1 left) 2024-03-04T06:43:51.478 INFO:tasks.rados.rados.0.smithi137.stdout:605: read oid 35 snap -1 2024-03-04T06:43:51.478 INFO:tasks.rados.rados.0.smithi137.stdout:605: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:43:51.478 INFO:tasks.rados.rados.0.smithi137.stdout:606: copy_from oid 27 from oid 13 current snap is 60 2024-03-04T06:43:51.478 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 60 2024-03-04T06:43:51.478 INFO:tasks.rados.rados.0.smithi137.stdout:607: seq_num 207 ranges {1245184=671744,1916928=401408} 2024-03-04T06:43:51.487 INFO:tasks.rados.rados.0.smithi137.stdout:607: writing smithi13777483-47 from 1245184 to 1916928 tid 1 2024-03-04T06:43:51.491 INFO:tasks.rados.rados.0.smithi137.stdout:607: writing smithi13777483-47 from 1916928 to 2318336 tid 2 2024-03-04T06:43:51.491 INFO:tasks.rados.rados.0.smithi137.stdout:608: rollback oid 34 current snap is 60 2024-03-04T06:43:51.491 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 34 to 53 2024-03-04T06:43:51.491 INFO:tasks.rados.rados.0.smithi137.stdout:603: finishing copy_from to smithi13777483-16 2024-03-04T06:43:51.491 INFO:tasks.rados.rados.0.smithi137.stdout:603: got expected ENOENT (src dne) 2024-03-04T06:43:51.491 INFO:tasks.rados.rados.0.smithi137.stdout:603: finishing copy_from racing read to smithi13777483-16 2024-03-04T06:43:51.491 INFO:tasks.rados.rados.0.smithi137.stdout:603: done (4 left) 2024-03-04T06:43:51.491 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 60 2024-03-04T06:43:51.491 INFO:tasks.rados.rados.0.smithi137.stdout:609: seq_num 208 ranges {0=688128,688128=401408} 2024-03-04T06:43:51.495 INFO:tasks.rados.rados.0.smithi137.stdout:609: writing smithi13777483-10 from 0 to 688128 tid 1 2024-03-04T06:43:51.498 INFO:tasks.rados.rados.0.smithi137.stdout:609: writing smithi13777483-10 from 688128 to 1089536 tid 2 2024-03-04T06:43:51.498 INFO:tasks.rados.rados.0.smithi137.stdout:610: rollback oid 2 current snap is 60 2024-03-04T06:43:51.499 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 2 to 42 2024-03-04T06:43:51.499 INFO:tasks.rados.rados.0.smithi137.stdout:605: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:43:51.542 INFO:tasks.rados.rados.0.smithi137.stdout:607: finishing write tid 1 to smithi13777483-47 2024-03-04T06:43:51.542 INFO:tasks.rados.rados.0.smithi137.stdout:607: finishing write tid 2 to smithi13777483-47 2024-03-04T06:43:51.542 INFO:tasks.rados.rados.0.smithi137.stdout:607: finishing write tid 3 to smithi13777483-47 2024-03-04T06:43:51.543 INFO:tasks.rados.rados.0.smithi137.stdout:605: done (5 left) 2024-03-04T06:43:51.543 INFO:tasks.rados.rados.0.smithi137.stdout:611: rollback oid 18 current snap is 60 2024-03-04T06:43:51.543 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 18 to 49 2024-03-04T06:43:51.543 INFO:tasks.rados.rados.0.smithi137.stdout:608: finishing rollback tid 0 to smithi13777483-34 2024-03-04T06:43:51.543 INFO:tasks.rados.rados.0.smithi137.stdout:607: finishing write tid 4 to smithi13777483-47 2024-03-04T06:43:51.543 INFO:tasks.rados.rados.0.smithi137.stdout:607: oid 47 updating version 0 to 306 2024-03-04T06:43:51.543 INFO:tasks.rados.rados.0.smithi137.stdout:607: oid 47 version 306 is already newer than 304 2024-03-04T06:43:51.543 INFO:tasks.rados.rados.0.smithi137.stdout:607: oid 47 version 306 is already newer than 305 2024-03-04T06:43:51.543 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 306 (ObjNum 207 snap 60 seq_num 207) dirty exists 2024-03-04T06:43:51.543 INFO:tasks.rados.rados.0.smithi137.stdout:607: left oid 47 (ObjNum 207 snap 60 seq_num 207) 2024-03-04T06:43:51.544 INFO:tasks.rados.rados.0.smithi137.stdout:608: finishing rollback tid 1 to smithi13777483-34 2024-03-04T06:43:51.544 INFO:tasks.rados.rados.0.smithi137.stdout:608: finishing rollback tid 2 to smithi13777483-34 2024-03-04T06:43:51.544 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 238 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-04T06:43:51.544 INFO:tasks.rados.rados.0.smithi137.stdout:609: finishing write tid 1 to smithi13777483-10 2024-03-04T06:43:51.544 INFO:tasks.rados.rados.0.smithi137.stdout:609: finishing write tid 2 to smithi13777483-10 2024-03-04T06:43:51.544 INFO:tasks.rados.rados.0.smithi137.stdout:610: finishing rollback tid 0 to smithi13777483-2 2024-03-04T06:43:51.544 INFO:tasks.rados.rados.0.smithi137.stdout:609: finishing write tid 3 to smithi13777483-10 2024-03-04T06:43:51.544 INFO:tasks.rados.rados.0.smithi137.stdout:610: finishing rollback tid 1 to smithi13777483-2 2024-03-04T06:43:51.544 INFO:tasks.rados.rados.0.smithi137.stdout:610: finishing rollback tid 2 to smithi13777483-2 2024-03-04T06:43:51.544 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 100 (ObjNum 93 snap 14 seq_num 93) dirty exists 2024-03-04T06:43:51.544 INFO:tasks.rados.rados.0.smithi137.stdout:609: finishing write tid 4 to smithi13777483-10 2024-03-04T06:43:51.544 INFO:tasks.rados.rados.0.smithi137.stdout:609: oid 10 updating version 0 to 289 2024-03-04T06:43:51.545 INFO:tasks.rados.rados.0.smithi137.stdout:609: oid 10 version 289 is already newer than 287 2024-03-04T06:43:51.545 INFO:tasks.rados.rados.0.smithi137.stdout:609: oid 10 version 289 is already newer than 288 2024-03-04T06:43:51.545 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 289 (ObjNum 208 snap 60 seq_num 208) dirty exists 2024-03-04T06:43:51.545 INFO:tasks.rados.rados.0.smithi137.stdout:609: left oid 10 (ObjNum 208 snap 60 seq_num 208) 2024-03-04T06:43:51.545 INFO:tasks.rados.rados.0.smithi137.stdout:607: done (5 left) 2024-03-04T06:43:51.545 INFO:tasks.rados.rados.0.smithi137.stdout:608: done (4 left) 2024-03-04T06:43:51.545 INFO:tasks.rados.rados.0.smithi137.stdout:609: done (3 left) 2024-03-04T06:43:51.545 INFO:tasks.rados.rados.0.smithi137.stdout:610: done (2 left) 2024-03-04T06:43:51.545 INFO:tasks.rados.rados.0.smithi137.stdout:612: read oid 2 snap 59 2024-03-04T06:43:51.545 INFO:tasks.rados.rados.0.smithi137.stdout:612: expect (ObjNum 93 snap 14 seq_num 93) 2024-03-04T06:43:51.545 INFO:tasks.rados.rados.0.smithi137.stdout:613: copy_from oid 17 from oid 44 current snap is 60 2024-03-04T06:43:51.545 INFO:tasks.rados.rados.0.smithi137.stdout:606: finishing copy_from racing read to smithi13777483-27 2024-03-04T06:43:51.545 INFO:tasks.rados.rados.0.smithi137.stdout:606: finishing copy_from to smithi13777483-27 2024-03-04T06:43:51.546 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 318 (ObjNum 125 snap 34 seq_num 125) dirty exists 2024-03-04T06:43:51.546 INFO:tasks.rados.rados.0.smithi137.stdout:606: done (3 left) 2024-03-04T06:43:51.546 INFO:tasks.rados.rados.0.smithi137.stdout:614: snap_remove snap 48 2024-03-04T06:43:51.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:51 smithi137 ceph-mon[26846]: pgmap v51: 121 pgs: 121 active+clean; 187 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 3.0 MiB/s wr, 19 op/s 2024-03-04T06:43:51.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:51 smithi137 ceph-mon[26846]: osdmap e175: 8 total, 8 up, 8 in 2024-03-04T06:43:51.594 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:51.334+0000 7f0f9c522200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T06:43:51.594 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:51.578+0000 7f0f9c522200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T06:43:51.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:51 smithi137 ceph-mon[37364]: pgmap v51: 121 pgs: 121 active+clean; 187 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 3.0 MiB/s wr, 19 op/s 2024-03-04T06:43:51.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:51 smithi137 ceph-mon[37364]: osdmap e175: 8 total, 8 up, 8 in 2024-03-04T06:43:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:51 smithi203 ceph-mon[30756]: pgmap v51: 121 pgs: 121 active+clean; 187 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 3.0 MiB/s wr, 19 op/s 2024-03-04T06:43:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:51 smithi203 ceph-mon[30756]: osdmap e175: 8 total, 8 up, 8 in 2024-03-04T06:43:51.983 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:06:43:51] ENGINE Bus STARTING 2024-03-04T06:43:51.983 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: CherryPy Checker: 2024-03-04T06:43:51.983 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: The Application mounted at '' has an empty config. 2024-03-04T06:43:51.983 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:51.983 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:06:43:51] ENGINE Serving on http://:::9283 2024-03-04T06:43:51.983 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:06:43:51] ENGINE Bus STARTED 2024-03-04T06:43:52.497 INFO:tasks.rados.rados.0.smithi137.stdout:614: done (3 left) 2024-03-04T06:43:52.497 INFO:tasks.rados.rados.0.smithi137.stdout:615: snap_remove snap 21 2024-03-04T06:43:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[26846]: osdmap e176: 8 total, 8 up, 8 in 2024-03-04T06:43:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[26846]: Standby manager daemon y restarted 2024-03-04T06:43:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[26846]: Standby manager daemon y started 2024-03-04T06:43:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-04T06:43:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:43:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-04T06:43:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:43:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[37364]: osdmap e176: 8 total, 8 up, 8 in 2024-03-04T06:43:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[37364]: Standby manager daemon y restarted 2024-03-04T06:43:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[37364]: Standby manager daemon y started 2024-03-04T06:43:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-04T06:43:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:43:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-04T06:43:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:52 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:43:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:52 smithi203 ceph-mon[30756]: osdmap e176: 8 total, 8 up, 8 in 2024-03-04T06:43:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:52 smithi203 ceph-mon[30756]: Standby manager daemon y restarted 2024-03-04T06:43:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:52 smithi203 ceph-mon[30756]: Standby manager daemon y started 2024-03-04T06:43:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:52 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-04T06:43:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:52 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:43:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:52 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-04T06:43:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:52 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:43:53.491 INFO:tasks.rados.rados.0.smithi137.stdout:615: done (3 left) 2024-03-04T06:43:53.491 INFO:tasks.rados.rados.0.smithi137.stdout:616: rollback oid 32 current snap is 60 2024-03-04T06:43:53.492 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 32 to 50 2024-03-04T06:43:53.492 INFO:tasks.rados.rados.0.smithi137.stdout:617: delete oid 24 current snap is 60 2024-03-04T06:43:53.492 INFO:tasks.rados.rados.0.smithi137.stdout:611: finishing rollback tid 0 to smithi13777483-18 2024-03-04T06:43:53.492 INFO:tasks.rados.rados.0.smithi137.stdout:613: finishing copy_from racing read to smithi13777483-17 2024-03-04T06:43:53.492 INFO:tasks.rados.rados.0.smithi137.stdout:611: finishing rollback tid 1 to smithi13777483-18 2024-03-04T06:43:53.492 INFO:tasks.rados.rados.0.smithi137.stdout:613: finishing copy_from to smithi13777483-17 2024-03-04T06:43:53.492 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 235 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:43:53.492 INFO:tasks.rados.rados.0.smithi137.stdout:611: finishing rollback tid 2 to smithi13777483-18 2024-03-04T06:43:53.492 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 180 (ObjNum 106 snap 27 seq_num 106) dirty exists 2024-03-04T06:43:53.492 INFO:tasks.rados.rados.0.smithi137.stdout:612: expect (ObjNum 93 snap 14 seq_num 93) 2024-03-04T06:43:53.492 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:43:53] "GET /metrics HTTP/1.1" 200 35998 "" "Prometheus/2.43.0" 2024-03-04T06:43:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:53 smithi137 ceph-mon[26846]: pgmap v54: 121 pgs: 121 active+clean; 187 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 3.0 MiB/s wr, 19 op/s 2024-03-04T06:43:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:53 smithi137 ceph-mon[26846]: osdmap e177: 8 total, 8 up, 8 in 2024-03-04T06:43:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:53 smithi137 ceph-mon[26846]: mgrmap e28: x(active, since 34s), standbys: y 2024-03-04T06:43:53.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:53 smithi137 ceph-mon[37364]: pgmap v54: 121 pgs: 121 active+clean; 187 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 3.0 MiB/s wr, 19 op/s 2024-03-04T06:43:53.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:53 smithi137 ceph-mon[37364]: osdmap e177: 8 total, 8 up, 8 in 2024-03-04T06:43:53.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:53 smithi137 ceph-mon[37364]: mgrmap e28: x(active, since 34s), standbys: y 2024-03-04T06:43:53.733 INFO:tasks.rados.rados.0.smithi137.stdout:616: finishing rollback tid 0 to smithi13777483-32 2024-03-04T06:43:53.733 INFO:tasks.rados.rados.0.smithi137.stdout:616: finishing rollback tid 1 to smithi13777483-32 2024-03-04T06:43:53.733 INFO:tasks.rados.rados.0.smithi137.stdout:616: finishing rollback tid 2 to smithi13777483-32 2024-03-04T06:43:53.733 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 368 (ObjNum 140 snap 40 seq_num 140) dirty exists 2024-03-04T06:43:53.733 INFO:tasks.rados.rados.0.smithi137.stdout:611: done (4 left) 2024-03-04T06:43:53.733 INFO:tasks.rados.rados.0.smithi137.stdout:612: done (3 left) 2024-03-04T06:43:53.733 INFO:tasks.rados.rados.0.smithi137.stdout:613: done (2 left) 2024-03-04T06:43:53.733 INFO:tasks.rados.rados.0.smithi137.stdout:616: done (1 left) 2024-03-04T06:43:53.733 INFO:tasks.rados.rados.0.smithi137.stdout:617: done (0 left) 2024-03-04T06:43:53.733 INFO:tasks.rados.rados.0.smithi137.stdout:618: read oid 42 snap -1 2024-03-04T06:43:53.734 INFO:tasks.rados.rados.0.smithi137.stdout:618: expect deleted 2024-03-04T06:43:53.734 INFO:tasks.rados.rados.0.smithi137.stdout:619: setattr oid 5 current snap is 60 2024-03-04T06:43:53.735 INFO:tasks.rados.rados.0.smithi137.stdout:618: done (1 left) 2024-03-04T06:43:53.735 INFO:tasks.rados.rados.0.smithi137.stdout:620: rmattr oid 24 current snap is 60 2024-03-04T06:43:53.735 INFO:tasks.rados.rados.0.smithi137.stdout:620: done (1 left) 2024-03-04T06:43:53.735 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 60 2024-03-04T06:43:53.735 INFO:tasks.rados.rados.0.smithi137.stdout:621: seq_num 210 ranges {770048=720896,1490944=401408} 2024-03-04T06:43:53.743 INFO:tasks.rados.rados.0.smithi137.stdout:621: writing smithi13777483-3 from 770048 to 1490944 tid 1 2024-03-04T06:43:53.745 INFO:tasks.rados.rados.0.smithi137.stdout:621: writing smithi13777483-3 from 1490944 to 1892352 tid 2 2024-03-04T06:43:53.745 INFO:tasks.rados.rados.0.smithi137.stdout:622: snap_create 2024-03-04T06:43:53.745 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 302 (ObjNum 673 snap 0 seq_num 3130994688) dirty exists 2024-03-04T06:43:53.747 INFO:tasks.rados.rados.0.smithi137.stdout:621: finishing write tid 1 to smithi13777483-3 2024-03-04T06:43:53.747 INFO:tasks.rados.rados.0.smithi137.stdout:621: finishing write tid 2 to smithi13777483-3 2024-03-04T06:43:53.747 INFO:tasks.rados.rados.0.smithi137.stdout:621: finishing write tid 3 to smithi13777483-3 2024-03-04T06:43:53.748 INFO:tasks.rados.rados.0.smithi137.stdout:621: finishing write tid 4 to smithi13777483-3 2024-03-04T06:43:53.748 INFO:tasks.rados.rados.0.smithi137.stdout:621: oid 3 updating version 0 to 305 2024-03-04T06:43:53.748 INFO:tasks.rados.rados.0.smithi137.stdout:621: oid 3 version 305 is already newer than 304 2024-03-04T06:43:53.748 INFO:tasks.rados.rados.0.smithi137.stdout:621: oid 3 updating version 305 to 306 2024-03-04T06:43:53.748 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 306 (ObjNum 210 snap 60 seq_num 210) dirty exists 2024-03-04T06:43:53.748 INFO:tasks.rados.rados.0.smithi137.stdout:621: left oid 3 (ObjNum 210 snap 60 seq_num 210) 2024-03-04T06:43:53.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:53 smithi203 ceph-mon[30756]: pgmap v54: 121 pgs: 121 active+clean; 187 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 3.0 MiB/s wr, 19 op/s 2024-03-04T06:43:53.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:53 smithi203 ceph-mon[30756]: osdmap e177: 8 total, 8 up, 8 in 2024-03-04T06:43:53.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:53 smithi203 ceph-mon[30756]: mgrmap e28: x(active, since 34s), standbys: y 2024-03-04T06:43:53.924 INFO:tasks.rados.rados.0.smithi137.stdout:619: done (2 left) 2024-03-04T06:43:53.924 INFO:tasks.rados.rados.0.smithi137.stdout:621: done (1 left) 2024-03-04T06:43:53.924 INFO:tasks.rados.rados.0.smithi137.stdout:622: done (0 left) 2024-03-04T06:43:53.924 INFO:tasks.rados.rados.0.smithi137.stdout:623: snap_remove snap 55 2024-03-04T06:43:53.943 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:06:43:53] ENGINE Bus STOPPING 2024-03-04T06:43:54.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:06:43:53] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T06:43:54.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:06:43:53] ENGINE Bus STOPPED 2024-03-04T06:43:54.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:06:43:54] ENGINE Bus STARTING 2024-03-04T06:43:54.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:54.070+0000 7f0ef81fd700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:54.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:54.070+0000 7f0ef81fd700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:54.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:54.070+0000 7f0ef81fd700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:54.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:54.070+0000 7f0ef81fd700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:54.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:54.070+0000 7f0ef81fd700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:54.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:54.075+0000 7f0efaa02700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:54.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:54.075+0000 7f0efaa02700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:54.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:54.075+0000 7f0efaa02700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:54.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:54.076+0000 7f0efaa02700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:54.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:43:54.076+0000 7f0efaa02700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:43:54.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:06:43:54] ENGINE Serving on http://:::9283 2024-03-04T06:43:54.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:06:43:54] ENGINE Bus STARTED 2024-03-04T06:43:54.345 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:53.924+0000 7f95ece5c700 -1 mgr handle_mgr_map I was active but no longer am 2024-03-04T06:43:54.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: ignoring --setuser ceph since I am not root 2024-03-04T06:43:54.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: ignoring --setgroup ceph since I am not root 2024-03-04T06:43:54.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:53 smithi203 ceph-mgr[64867]: -- 172.21.15.203:0/3667198704 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ccef0be5a0 con 0x55ccef092800 2024-03-04T06:43:54.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: osdmap e178: 8 total, 8 up, 8 in 2024-03-04T06:43:54.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:54.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:54.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:54.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:43:54.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:54.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:54.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-04T06:43:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-04T06:43:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: osdmap e179: 8 total, 8 up, 8 in 2024-03-04T06:43:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.24823 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-03-04T06:43:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: mgrmap e29: y(active, starting, since 0.00646613s) 2024-03-04T06:43:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:43:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:43:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:43:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:43:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:43:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:43:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:43:54.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:43:54.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:43:54.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:43:54.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:43:54.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:43:54.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:43:54.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:43:54.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:43:54.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:43:54.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:43:54.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: Manager daemon y is now available 2024-03-04T06:43:54.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: osdmap e178: 8 total, 8 up, 8 in 2024-03-04T06:43:54.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:54.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:54.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:54.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:43:54.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:54.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:54.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-04T06:43:54.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-04T06:43:54.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: osdmap e179: 8 total, 8 up, 8 in 2024-03-04T06:43:54.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.24823 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-03-04T06:43:54.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: mgrmap e29: y(active, starting, since 0.00646613s) 2024-03-04T06:43:54.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:43:54.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:43:54.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:43:54.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:43:54.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:43:54.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:43:54.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:43:54.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:43:54.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:43:54.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:43:54.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:43:54.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:43:54.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:43:54.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:43:54.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:43:54.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:43:54.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:43:54.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: Manager daemon y is now available 2024-03-04T06:43:54.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:54.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:54.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:54.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:43:54.800 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:43:54.800 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:43:54.800 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:43:54.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:54.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:54.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:54.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:43:54.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:43:54.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:43:54.801 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:54 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:43:54.845 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:54.511+0000 7f03f98ad200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T06:43:54.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:54.610+0000 7f03f98ad200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T06:43:54.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: osdmap e178: 8 total, 8 up, 8 in 2024-03-04T06:43:54.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:54.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:54.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:43:54.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:43:54.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' 2024-03-04T06:43:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.24823 172.21.15.203:0/4023871414' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-04T06:43:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-04T06:43:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: osdmap e179: 8 total, 8 up, 8 in 2024-03-04T06:43:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.24823 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-03-04T06:43:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: mgrmap e29: y(active, starting, since 0.00646613s) 2024-03-04T06:43:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:43:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:43:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:43:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:43:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:43:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:43:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:43:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:43:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:43:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:43:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:43:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:43:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:43:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:43:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:43:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:43:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:43:54.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: Manager daemon y is now available 2024-03-04T06:43:54.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:54.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:43:54.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:43:54.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:43:54.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:43:54.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:43:54.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:54 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:43:54.925 INFO:tasks.rados.rados.0.smithi137.stdout:623: done (0 left) 2024-03-04T06:43:54.926 INFO:tasks.rados.rados.0.smithi137.stdout:624: snap_remove snap 60 2024-03-04T06:43:55.372 INFO:tasks.rados.rados.0.smithi137.stdout:624: done (0 left) 2024-03-04T06:43:55.373 INFO:tasks.rados.rados.0.smithi137.stdout:625: rollback oid 12 current snap is 61 2024-03-04T06:43:55.373 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 12 to 26 2024-03-04T06:43:55.373 INFO:tasks.rados.rados.0.smithi137.stdout:626: read oid 21 snap -1 2024-03-04T06:43:55.373 INFO:tasks.rados.rados.0.smithi137.stdout:626: expect (ObjNum 188 snap 50 seq_num 188) 2024-03-04T06:43:55.373 INFO:tasks.rados.rados.0.smithi137.stdout:627: rmattr oid 8 current snap is 61 2024-03-04T06:43:55.373 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 48 current snap is 61 2024-03-04T06:43:55.373 INFO:tasks.rados.rados.0.smithi137.stdout:628: seq_num 211 ranges {0=737280,737280=401408} 2024-03-04T06:43:55.377 INFO:tasks.rados.rados.0.smithi137.stdout:628: writing smithi13777483-48 from 0 to 737280 tid 1 2024-03-04T06:43:55.380 INFO:tasks.rados.rados.0.smithi137.stdout:628: writing smithi13777483-48 from 737280 to 1138688 tid 2 2024-03-04T06:43:55.380 INFO:tasks.rados.rados.0.smithi137.stdout:629: rollback oid 25 current snap is 61 2024-03-04T06:43:55.380 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 25 to 58 2024-03-04T06:43:55.380 INFO:tasks.rados.rados.0.smithi137.stdout:630: read oid 50 snap -1 2024-03-04T06:43:55.380 INFO:tasks.rados.rados.0.smithi137.stdout:630: expect deleted 2024-03-04T06:43:55.380 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 61 2024-03-04T06:43:55.380 INFO:tasks.rados.rados.0.smithi137.stdout:631: seq_num 212 ranges {1892352=753664,2646016=401408} 2024-03-04T06:43:55.394 INFO:tasks.rados.rados.0.smithi137.stdout:631: writing smithi13777483-3 from 1892352 to 2646016 tid 1 2024-03-04T06:43:55.397 INFO:tasks.rados.rados.0.smithi137.stdout:631: writing smithi13777483-3 from 2646016 to 3047424 tid 2 2024-03-04T06:43:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:632: snap_create 2024-03-04T06:43:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 102 (ObjNum 205 snap 58 seq_num 205) dirty exists 2024-03-04T06:43:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:625: finishing rollback tid 0 to smithi13777483-12 2024-03-04T06:43:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:625: finishing rollback tid 1 to smithi13777483-12 2024-03-04T06:43:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:625: finishing rollback tid 2 to smithi13777483-12 2024-03-04T06:43:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 143 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-03-04T06:43:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:628: finishing write tid 1 to smithi13777483-48 2024-03-04T06:43:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:628: finishing write tid 2 to smithi13777483-48 2024-03-04T06:43:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:628: finishing write tid 3 to smithi13777483-48 2024-03-04T06:43:55.398 INFO:tasks.rados.rados.0.smithi137.stdout:626: expect (ObjNum 188 snap 50 seq_num 188) 2024-03-04T06:43:55.402 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:55.302+0000 7f03f98ad200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T06:43:55.422 INFO:tasks.rados.rados.0.smithi137.stdout:629: finishing rollback tid 0 to smithi13777483-25 2024-03-04T06:43:55.422 INFO:tasks.rados.rados.0.smithi137.stdout:628: finishing write tid 4 to smithi13777483-48 2024-03-04T06:43:55.422 INFO:tasks.rados.rados.0.smithi137.stdout:628: oid 48 updating version 0 to 111 2024-03-04T06:43:55.422 INFO:tasks.rados.rados.0.smithi137.stdout:628: oid 48 version 111 is already newer than 109 2024-03-04T06:43:55.422 INFO:tasks.rados.rados.0.smithi137.stdout:628: oid 48 version 111 is already newer than 110 2024-03-04T06:43:55.422 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 111 (ObjNum 211 snap 61 seq_num 211) dirty exists 2024-03-04T06:43:55.422 INFO:tasks.rados.rados.0.smithi137.stdout:628: left oid 48 (ObjNum 211 snap 61 seq_num 211) 2024-03-04T06:43:55.422 INFO:tasks.rados.rados.0.smithi137.stdout:629: finishing rollback tid 1 to smithi13777483-25 2024-03-04T06:43:55.422 INFO:tasks.rados.rados.0.smithi137.stdout:629: finishing rollback tid 2 to smithi13777483-25 2024-03-04T06:43:55.422 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 326 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-03-04T06:43:55.422 INFO:tasks.rados.rados.0.smithi137.stdout:631: finishing write tid 1 to smithi13777483-3 2024-03-04T06:43:55.422 INFO:tasks.rados.rados.0.smithi137.stdout:631: finishing write tid 2 to smithi13777483-3 2024-03-04T06:43:55.422 INFO:tasks.rados.rados.0.smithi137.stdout:631: finishing write tid 3 to smithi13777483-3 2024-03-04T06:43:55.423 INFO:tasks.rados.rados.0.smithi137.stdout:631: finishing write tid 4 to smithi13777483-3 2024-03-04T06:43:55.423 INFO:tasks.rados.rados.0.smithi137.stdout:631: oid 3 updating version 0 to 311 2024-03-04T06:43:55.423 INFO:tasks.rados.rados.0.smithi137.stdout:631: oid 3 updating version 311 to 313 2024-03-04T06:43:55.423 INFO:tasks.rados.rados.0.smithi137.stdout:631: oid 3 version 313 is already newer than 312 2024-03-04T06:43:55.423 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 313 (ObjNum 212 snap 61 seq_num 212) dirty exists 2024-03-04T06:43:55.423 INFO:tasks.rados.rados.0.smithi137.stdout:631: left oid 3 (ObjNum 212 snap 61 seq_num 212) 2024-03-04T06:43:55.747 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:55.403+0000 7f03f98ad200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T06:43:55.747 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:55.547+0000 7f03f98ad200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T06:43:55.747 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:55.650+0000 7f03f98ad200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T06:43:55.747 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:55.743+0000 7f03f98ad200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T06:43:56.020 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:55 smithi203 ceph-mon[30756]: [04/Mar/2024:06:43:54] ENGINE Bus STARTING 2024-03-04T06:43:56.020 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:55 smithi203 ceph-mon[30756]: [04/Mar/2024:06:43:54] ENGINE Serving on https://172.21.15.137:7150 2024-03-04T06:43:56.020 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:55 smithi203 ceph-mon[30756]: [04/Mar/2024:06:43:54] ENGINE Serving on http://172.21.15.137:8765 2024-03-04T06:43:56.020 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:55 smithi203 ceph-mon[30756]: [04/Mar/2024:06:43:54] ENGINE Bus STARTED 2024-03-04T06:43:56.020 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:55 smithi203 ceph-mon[30756]: osdmap e180: 8 total, 8 up, 8 in 2024-03-04T06:43:56.020 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:55 smithi203 ceph-mon[30756]: mgrmap e30: y(active, since 1.01711s) 2024-03-04T06:43:56.020 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:55 smithi203 ceph-mon[30756]: pgmap v4: 121 pgs: 121 active+clean; 192 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:43:56.020 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:55 smithi203 ceph-mon[30756]: osdmap e181: 8 total, 8 up, 8 in 2024-03-04T06:43:56.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[26846]: [04/Mar/2024:06:43:54] ENGINE Bus STARTING 2024-03-04T06:43:56.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[26846]: [04/Mar/2024:06:43:54] ENGINE Serving on https://172.21.15.137:7150 2024-03-04T06:43:56.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[26846]: [04/Mar/2024:06:43:54] ENGINE Serving on http://172.21.15.137:8765 2024-03-04T06:43:56.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[26846]: [04/Mar/2024:06:43:54] ENGINE Bus STARTED 2024-03-04T06:43:56.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[26846]: osdmap e180: 8 total, 8 up, 8 in 2024-03-04T06:43:56.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[26846]: mgrmap e30: y(active, since 1.01711s) 2024-03-04T06:43:56.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[26846]: pgmap v4: 121 pgs: 121 active+clean; 192 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:43:56.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[26846]: osdmap e181: 8 total, 8 up, 8 in 2024-03-04T06:43:56.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[37364]: [04/Mar/2024:06:43:54] ENGINE Bus STARTING 2024-03-04T06:43:56.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[37364]: [04/Mar/2024:06:43:54] ENGINE Serving on https://172.21.15.137:7150 2024-03-04T06:43:56.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[37364]: [04/Mar/2024:06:43:54] ENGINE Serving on http://172.21.15.137:8765 2024-03-04T06:43:56.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[37364]: [04/Mar/2024:06:43:54] ENGINE Bus STARTED 2024-03-04T06:43:56.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[37364]: osdmap e180: 8 total, 8 up, 8 in 2024-03-04T06:43:56.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[37364]: mgrmap e30: y(active, since 1.01711s) 2024-03-04T06:43:56.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[37364]: pgmap v4: 121 pgs: 121 active+clean; 192 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:43:56.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:55 smithi137 ceph-mon[37364]: osdmap e181: 8 total, 8 up, 8 in 2024-03-04T06:43:56.330 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:56.019+0000 7f03f98ad200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T06:43:56.330 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:56.133+0000 7f03f98ad200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T06:43:56.331 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:56.222+0000 7f03f98ad200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T06:43:56.331 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:56.329+0000 7f03f98ad200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T06:43:56.395 INFO:tasks.rados.rados.0.smithi137.stdout:625: done (7 left) 2024-03-04T06:43:56.395 INFO:tasks.rados.rados.0.smithi137.stdout:626: done (6 left) 2024-03-04T06:43:56.395 INFO:tasks.rados.rados.0.smithi137.stdout:627: done (5 left) 2024-03-04T06:43:56.395 INFO:tasks.rados.rados.0.smithi137.stdout:628: done (4 left) 2024-03-04T06:43:56.395 INFO:tasks.rados.rados.0.smithi137.stdout:629: done (3 left) 2024-03-04T06:43:56.395 INFO:tasks.rados.rados.0.smithi137.stdout:630: done (2 left) 2024-03-04T06:43:56.395 INFO:tasks.rados.rados.0.smithi137.stdout:631: done (1 left) 2024-03-04T06:43:56.395 INFO:tasks.rados.rados.0.smithi137.stdout:632: done (0 left) 2024-03-04T06:43:56.395 INFO:tasks.rados.rados.0.smithi137.stdout:633: delete oid 2 current snap is 62 2024-03-04T06:43:56.397 INFO:tasks.rados.rados.0.smithi137.stdout:633: done (0 left) 2024-03-04T06:43:56.397 INFO:tasks.rados.rados.0.smithi137.stdout:634: delete oid 5 current snap is 62 2024-03-04T06:43:56.400 INFO:tasks.rados.rados.0.smithi137.stdout:634: done (0 left) 2024-03-04T06:43:56.400 INFO:tasks.rados.rados.0.smithi137.stdout:635: read oid 43 snap -1 2024-03-04T06:43:56.400 INFO:tasks.rados.rados.0.smithi137.stdout:635: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:43:56.400 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 62 2024-03-04T06:43:56.400 INFO:tasks.rados.rados.0.smithi137.stdout:636: seq_num 215 ranges {0=409600,409600=532480,942080=270336} 2024-03-04T06:43:56.402 INFO:tasks.rados.rados.0.smithi137.stdout:636: writing smithi13777483-1 from 0 to 409600 tid 1 2024-03-04T06:43:56.405 INFO:tasks.rados.rados.0.smithi137.stdout:636: writing smithi13777483-1 from 409600 to 942080 tid 2 2024-03-04T06:43:56.407 INFO:tasks.rados.rados.0.smithi137.stdout:636: writing smithi13777483-1 from 942080 to 1212416 tid 3 2024-03-04T06:43:56.407 INFO:tasks.rados.rados.0.smithi137.stdout:637: rollback oid 50 current snap is 62 2024-03-04T06:43:56.407 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 50 to 26 2024-03-04T06:43:56.408 INFO:tasks.rados.rados.0.smithi137.stdout:636: finishing write tid 1 to smithi13777483-1 2024-03-04T06:43:56.408 INFO:tasks.rados.rados.0.smithi137.stdout:635: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:43:56.451 INFO:tasks.rados.rados.0.smithi137.stdout:637: finishing rollback tid 1 to smithi13777483-50 2024-03-04T06:43:56.451 INFO:tasks.rados.rados.0.smithi137.stdout:636: finishing write tid 2 to smithi13777483-1 2024-03-04T06:43:56.451 INFO:tasks.rados.rados.0.smithi137.stdout:636: finishing write tid 3 to smithi13777483-1 2024-03-04T06:43:56.451 INFO:tasks.rados.rados.0.smithi137.stdout:637: finishing rollback tid 2 to smithi13777483-50 2024-03-04T06:43:56.452 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 382 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-03-04T06:43:56.452 INFO:tasks.rados.rados.0.smithi137.stdout:636: finishing write tid 4 to smithi13777483-1 2024-03-04T06:43:56.452 INFO:tasks.rados.rados.0.smithi137.stdout:636: finishing write tid 5 to smithi13777483-1 2024-03-04T06:43:56.452 INFO:tasks.rados.rados.0.smithi137.stdout:636: oid 1 updating version 0 to 115 2024-03-04T06:43:56.452 INFO:tasks.rados.rados.0.smithi137.stdout:636: oid 1 version 115 is already newer than 114 2024-03-04T06:43:56.452 INFO:tasks.rados.rados.0.smithi137.stdout:636: oid 1 updating version 115 to 117 2024-03-04T06:43:56.452 INFO:tasks.rados.rados.0.smithi137.stdout:636: oid 1 version 117 is already newer than 116 2024-03-04T06:43:56.452 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 117 (ObjNum 215 snap 62 seq_num 215) dirty exists 2024-03-04T06:43:56.452 INFO:tasks.rados.rados.0.smithi137.stdout:636: left oid 1 (ObjNum 215 snap 62 seq_num 215) 2024-03-04T06:43:56.452 INFO:tasks.rados.rados.0.smithi137.stdout:635: done (2 left) 2024-03-04T06:43:56.452 INFO:tasks.rados.rados.0.smithi137.stdout:636: done (1 left) 2024-03-04T06:43:56.453 INFO:tasks.rados.rados.0.smithi137.stdout:637: done (0 left) 2024-03-04T06:43:56.453 INFO:tasks.rados.rados.0.smithi137.stdout:638: read oid 43 snap -1 2024-03-04T06:43:56.453 INFO:tasks.rados.rados.0.smithi137.stdout:638: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:43:56.453 INFO:tasks.rados.rados.0.smithi137.stdout:639: snap_create 2024-03-04T06:43:56.457 INFO:tasks.rados.rados.0.smithi137.stdout:638: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:43:56.595 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:56.536+0000 7f03f98ad200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T06:43:57.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:56 smithi203 ceph-mon[30756]: pgmap v6: 121 pgs: 121 active+clean; 192 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:43:57.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:56 smithi203 ceph-mon[30756]: mgrmap e31: y(active, since 2s) 2024-03-04T06:43:57.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:56 smithi203 ceph-mon[30756]: osdmap e182: 8 total, 8 up, 8 in 2024-03-04T06:43:57.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:56 smithi137 ceph-mon[26846]: pgmap v6: 121 pgs: 121 active+clean; 192 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:43:57.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:56 smithi137 ceph-mon[26846]: mgrmap e31: y(active, since 2s) 2024-03-04T06:43:57.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:56 smithi137 ceph-mon[26846]: osdmap e182: 8 total, 8 up, 8 in 2024-03-04T06:43:57.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:56 smithi137 ceph-mon[37364]: pgmap v6: 121 pgs: 121 active+clean; 192 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:43:57.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:56 smithi137 ceph-mon[37364]: mgrmap e31: y(active, since 2s) 2024-03-04T06:43:57.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:56 smithi137 ceph-mon[37364]: osdmap e182: 8 total, 8 up, 8 in 2024-03-04T06:43:57.392 INFO:tasks.rados.rados.0.smithi137.stdout:638: done (1 left) 2024-03-04T06:43:57.393 INFO:tasks.rados.rados.0.smithi137.stdout:639: done (0 left) 2024-03-04T06:43:57.393 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 63 2024-03-04T06:43:57.393 INFO:tasks.rados.rados.0.smithi137.stdout:640: seq_num 216 ranges {0=425984,425984=409600,835584=393216} 2024-03-04T06:43:57.394 INFO:tasks.rados.rados.0.smithi137.stdout:640: writing smithi13777483-44 from 0 to 425984 tid 1 2024-03-04T06:43:57.397 INFO:tasks.rados.rados.0.smithi137.stdout:640: writing smithi13777483-44 from 425984 to 835584 tid 2 2024-03-04T06:43:57.400 INFO:tasks.rados.rados.0.smithi137.stdout:640: writing smithi13777483-44 from 835584 to 1228800 tid 3 2024-03-04T06:43:57.400 INFO:tasks.rados.rados.0.smithi137.stdout:641: rmattr oid 6 current snap is 63 2024-03-04T06:43:57.400 INFO:tasks.rados.rados.0.smithi137.stdout:640: finishing write tid 1 to smithi13777483-44 2024-03-04T06:43:57.401 INFO:tasks.rados.rados.0.smithi137.stdout:640: finishing write tid 2 to smithi13777483-44 2024-03-04T06:43:57.401 INFO:tasks.rados.rados.0.smithi137.stdout:642: rmattr oid 49 current snap is 63 2024-03-04T06:43:57.401 INFO:tasks.rados.rados.0.smithi137.stdout:643: rmattr oid 26 current snap is 63 2024-03-04T06:43:57.401 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 63 2024-03-04T06:43:57.401 INFO:tasks.rados.rados.0.smithi137.stdout:644: seq_num 217 ranges {2359296=442368,2801664=696320,3497984=106496} 2024-03-04T06:43:57.415 INFO:tasks.rados.rados.0.smithi137.stdout:644: writing smithi13777483-32 from 2359296 to 2801664 tid 1 2024-03-04T06:43:57.419 INFO:tasks.rados.rados.0.smithi137.stdout:644: writing smithi13777483-32 from 2801664 to 3497984 tid 2 2024-03-04T06:43:57.420 INFO:tasks.rados.rados.0.smithi137.stdout:644: writing smithi13777483-32 from 3497984 to 3604480 tid 3 2024-03-04T06:43:57.420 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 63 2024-03-04T06:43:57.420 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 196 (ObjNum 78 snap 11 seq_num 78) dirty exists 2024-03-04T06:43:57.420 INFO:tasks.rados.rados.0.smithi137.stdout:645: seq_num 218 ranges {1302528=458752,1761280=581632,2342912=221184} 2024-03-04T06:43:57.429 INFO:tasks.rados.rados.0.smithi137.stdout:645: writing smithi13777483-12 from 1302528 to 1761280 tid 1 2024-03-04T06:43:57.433 INFO:tasks.rados.rados.0.smithi137.stdout:645: writing smithi13777483-12 from 1761280 to 2342912 tid 2 2024-03-04T06:43:57.435 INFO:tasks.rados.rados.0.smithi137.stdout:645: writing smithi13777483-12 from 2342912 to 2564096 tid 3 2024-03-04T06:43:57.435 INFO:tasks.rados.rados.0.smithi137.stdout:643: done (5 left) 2024-03-04T06:43:57.435 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 63 2024-03-04T06:43:57.435 INFO:tasks.rados.rados.0.smithi137.stdout:640: finishing write tid 3 to smithi13777483-44 2024-03-04T06:43:57.435 INFO:tasks.rados.rados.0.smithi137.stdout:640: finishing write tid 4 to smithi13777483-44 2024-03-04T06:43:57.436 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 290 (ObjNum 171 snap 47 seq_num 171) dirty exists 2024-03-04T06:43:57.436 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 222 (ObjNum 63 snap 4 seq_num 63) dirty exists 2024-03-04T06:43:57.436 INFO:tasks.rados.rados.0.smithi137.stdout:640: finishing write tid 5 to smithi13777483-44 2024-03-04T06:43:57.436 INFO:tasks.rados.rados.0.smithi137.stdout:640: oid 44 updating version 0 to 242 2024-03-04T06:43:57.436 INFO:tasks.rados.rados.0.smithi137.stdout:640: oid 44 version 242 is already newer than 241 2024-03-04T06:43:57.436 INFO:tasks.rados.rados.0.smithi137.stdout:640: oid 44 version 242 is already newer than 240 2024-03-04T06:43:57.436 INFO:tasks.rados.rados.0.smithi137.stdout:640: oid 44 version 242 is already newer than 239 2024-03-04T06:43:57.436 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 242 (ObjNum 216 snap 63 seq_num 216) dirty exists 2024-03-04T06:43:57.436 INFO:tasks.rados.rados.0.smithi137.stdout:640: left oid 44 (ObjNum 216 snap 63 seq_num 216) 2024-03-04T06:43:57.436 INFO:tasks.rados.rados.0.smithi137.stdout:644: finishing write tid 1 to smithi13777483-32 2024-03-04T06:43:57.436 INFO:tasks.rados.rados.0.smithi137.stdout:646: seq_num 219 ranges {0=475136,475136=466944,942080=335872} 2024-03-04T06:43:57.437 INFO:tasks.rados.rados.0.smithi137.stdout:646: writing smithi13777483-39 from 0 to 475136 tid 1 2024-03-04T06:43:57.440 INFO:tasks.rados.rados.0.smithi137.stdout:646: writing smithi13777483-39 from 475136 to 942080 tid 2 2024-03-04T06:43:57.443 INFO:tasks.rados.rados.0.smithi137.stdout:646: writing smithi13777483-39 from 942080 to 1277952 tid 3 2024-03-04T06:43:57.443 INFO:tasks.rados.rados.0.smithi137.stdout:640: done (5 left) 2024-03-04T06:43:57.443 INFO:tasks.rados.rados.0.smithi137.stdout:641: done (4 left) 2024-03-04T06:43:57.443 INFO:tasks.rados.rados.0.smithi137.stdout:642: done (3 left) 2024-03-04T06:43:57.443 INFO:tasks.rados.rados.0.smithi137.stdout:647: read oid 5 snap -1 2024-03-04T06:43:57.443 INFO:tasks.rados.rados.0.smithi137.stdout:647: expect deleted 2024-03-04T06:43:57.443 INFO:tasks.rados.rados.0.smithi137.stdout:648: read oid 25 snap -1 2024-03-04T06:43:57.444 INFO:tasks.rados.rados.0.smithi137.stdout:648: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:43:57.444 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 63 2024-03-04T06:43:57.444 INFO:tasks.rados.rados.0.smithi137.stdout:644: finishing write tid 2 to smithi13777483-32 2024-03-04T06:43:57.444 INFO:tasks.rados.rados.0.smithi137.stdout:644: finishing write tid 3 to smithi13777483-32 2024-03-04T06:43:57.444 INFO:tasks.rados.rados.0.smithi137.stdout:644: finishing write tid 4 to smithi13777483-32 2024-03-04T06:43:57.444 INFO:tasks.rados.rados.0.smithi137.stdout:644: finishing write tid 5 to smithi13777483-32 2024-03-04T06:43:57.444 INFO:tasks.rados.rados.0.smithi137.stdout:644: oid 32 updating version 0 to 386 2024-03-04T06:43:57.444 INFO:tasks.rados.rados.0.smithi137.stdout:644: oid 32 version 386 is already newer than 384 2024-03-04T06:43:57.444 INFO:tasks.rados.rados.0.smithi137.stdout:644: oid 32 version 386 is already newer than 385 2024-03-04T06:43:57.444 INFO:tasks.rados.rados.0.smithi137.stdout:644: oid 32 updating version 386 to 387 2024-03-04T06:43:57.444 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 387 (ObjNum 217 snap 63 seq_num 217) dirty exists 2024-03-04T06:43:57.444 INFO:tasks.rados.rados.0.smithi137.stdout:644: left oid 32 (ObjNum 217 snap 63 seq_num 217) 2024-03-04T06:43:57.444 INFO:tasks.rados.rados.0.smithi137.stdout:645: finishing write tid 1 to smithi13777483-12 2024-03-04T06:43:57.445 INFO:tasks.rados.rados.0.smithi137.stdout:649: seq_num 220 ranges {0=491520,491520=753664,1245184=49152} 2024-03-04T06:43:57.445 INFO:tasks.rados.rados.0.smithi137.stdout:649: writing smithi13777483-45 from 0 to 491520 tid 1 2024-03-04T06:43:57.449 INFO:tasks.rados.rados.0.smithi137.stdout:649: writing smithi13777483-45 from 491520 to 1245184 tid 2 2024-03-04T06:43:57.450 INFO:tasks.rados.rados.0.smithi137.stdout:649: writing smithi13777483-45 from 1245184 to 1294336 tid 3 2024-03-04T06:43:57.450 INFO:tasks.rados.rados.0.smithi137.stdout:644: done (5 left) 2024-03-04T06:43:57.450 INFO:tasks.rados.rados.0.smithi137.stdout:650: delete oid 24 current snap is 63 2024-03-04T06:43:57.450 INFO:tasks.rados.rados.0.smithi137.stdout:645: finishing write tid 2 to smithi13777483-12 2024-03-04T06:43:57.451 INFO:tasks.rados.rados.0.smithi137.stdout:645: finishing write tid 3 to smithi13777483-12 2024-03-04T06:43:57.451 INFO:tasks.rados.rados.0.smithi137.stdout:645: finishing write tid 4 to smithi13777483-12 2024-03-04T06:43:57.451 INFO:tasks.rados.rados.0.smithi137.stdout:645: finishing write tid 5 to smithi13777483-12 2024-03-04T06:43:57.451 INFO:tasks.rados.rados.0.smithi137.stdout:645: oid 12 updating version 0 to 148 2024-03-04T06:43:57.451 INFO:tasks.rados.rados.0.smithi137.stdout:645: oid 12 version 148 is already newer than 147 2024-03-04T06:43:57.451 INFO:tasks.rados.rados.0.smithi137.stdout:645: oid 12 version 148 is already newer than 146 2024-03-04T06:43:57.451 INFO:tasks.rados.rados.0.smithi137.stdout:645: oid 12 version 148 is already newer than 145 2024-03-04T06:43:57.451 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 148 (ObjNum 218 snap 63 seq_num 218) dirty exists 2024-03-04T06:43:57.451 INFO:tasks.rados.rados.0.smithi137.stdout:645: left oid 12 (ObjNum 218 snap 63 seq_num 218) 2024-03-04T06:43:57.451 INFO:tasks.rados.rados.0.smithi137.stdout:646: finishing write tid 1 to smithi13777483-39 2024-03-04T06:43:57.451 INFO:tasks.rados.rados.0.smithi137.stdout:646: finishing write tid 2 to smithi13777483-39 2024-03-04T06:43:57.452 INFO:tasks.rados.rados.0.smithi137.stdout:648: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:43:57.452 INFO:tasks.rados.rados.0.smithi137.stdout:646: finishing write tid 3 to smithi13777483-39 2024-03-04T06:43:57.453 INFO:tasks.rados.rados.0.smithi137.stdout:646: finishing write tid 4 to smithi13777483-39 2024-03-04T06:43:57.453 INFO:tasks.rados.rados.0.smithi137.stdout:646: finishing write tid 5 to smithi13777483-39 2024-03-04T06:43:57.453 INFO:tasks.rados.rados.0.smithi137.stdout:646: oid 39 updating version 0 to 115 2024-03-04T06:43:57.453 INFO:tasks.rados.rados.0.smithi137.stdout:646: oid 39 version 115 is already newer than 114 2024-03-04T06:43:57.453 INFO:tasks.rados.rados.0.smithi137.stdout:646: oid 39 updating version 115 to 116 2024-03-04T06:43:57.453 INFO:tasks.rados.rados.0.smithi137.stdout:646: oid 39 updating version 116 to 117 2024-03-04T06:43:57.453 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 117 (ObjNum 219 snap 63 seq_num 219) dirty exists 2024-03-04T06:43:57.453 INFO:tasks.rados.rados.0.smithi137.stdout:646: left oid 39 (ObjNum 219 snap 63 seq_num 219) 2024-03-04T06:43:57.453 INFO:tasks.rados.rados.0.smithi137.stdout:649: finishing write tid 1 to smithi13777483-45 2024-03-04T06:43:57.453 INFO:tasks.rados.rados.0.smithi137.stdout:645: done (5 left) 2024-03-04T06:43:57.453 INFO:tasks.rados.rados.0.smithi137.stdout:646: done (4 left) 2024-03-04T06:43:57.453 INFO:tasks.rados.rados.0.smithi137.stdout:647: done (3 left) 2024-03-04T06:43:57.454 INFO:tasks.rados.rados.0.smithi137.stdout:648: done (2 left) 2024-03-04T06:43:57.454 INFO:tasks.rados.rados.0.smithi137.stdout:650: done (1 left) 2024-03-04T06:43:57.454 INFO:tasks.rados.rados.0.smithi137.stdout:651: copy_from oid 34 from oid 26 current snap is 63 2024-03-04T06:43:57.454 INFO:tasks.rados.rados.0.smithi137.stdout:652: snap_create 2024-03-04T06:43:57.454 INFO:tasks.rados.rados.0.smithi137.stdout:649: finishing write tid 2 to smithi13777483-45 2024-03-04T06:43:57.455 INFO:tasks.rados.rados.0.smithi137.stdout:649: finishing write tid 3 to smithi13777483-45 2024-03-04T06:43:57.455 INFO:tasks.rados.rados.0.smithi137.stdout:649: finishing write tid 4 to smithi13777483-45 2024-03-04T06:43:57.455 INFO:tasks.rados.rados.0.smithi137.stdout:649: finishing write tid 5 to smithi13777483-45 2024-03-04T06:43:57.455 INFO:tasks.rados.rados.0.smithi137.stdout:649: oid 45 updating version 0 to 119 2024-03-04T06:43:57.455 INFO:tasks.rados.rados.0.smithi137.stdout:649: oid 45 updating version 119 to 121 2024-03-04T06:43:57.455 INFO:tasks.rados.rados.0.smithi137.stdout:649: oid 45 version 121 is already newer than 118 2024-03-04T06:43:57.455 INFO:tasks.rados.rados.0.smithi137.stdout:649: oid 45 version 121 is already newer than 120 2024-03-04T06:43:57.456 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 121 (ObjNum 220 snap 63 seq_num 220) dirty exists 2024-03-04T06:43:57.456 INFO:tasks.rados.rados.0.smithi137.stdout:649: left oid 45 (ObjNum 220 snap 63 seq_num 220) 2024-03-04T06:43:57.460 INFO:tasks.rados.rados.0.smithi137.stdout:651: finishing copy_from racing read to smithi13777483-34 2024-03-04T06:43:57.461 INFO:tasks.rados.rados.0.smithi137.stdout:651: finishing copy_from to smithi13777483-34 2024-03-04T06:43:57.461 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 196 (ObjNum 78 snap 11 seq_num 78) dirty exists 2024-03-04T06:43:57.730 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:57.586+0000 7f03f98ad200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T06:43:57.730 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:57.728+0000 7f03f98ad200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T06:43:58.345 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:58.090+0000 7f03f98ad200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T06:43:58.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:58.188+0000 7f03f98ad200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T06:43:58.403 INFO:tasks.rados.rados.0.smithi137.stdout:649: done (2 left) 2024-03-04T06:43:58.403 INFO:tasks.rados.rados.0.smithi137.stdout:651: done (1 left) 2024-03-04T06:43:58.403 INFO:tasks.rados.rados.0.smithi137.stdout:652: done (0 left) 2024-03-04T06:43:58.404 INFO:tasks.rados.rados.0.smithi137.stdout:653: read oid 39 snap -1 2024-03-04T06:43:58.404 INFO:tasks.rados.rados.0.smithi137.stdout:653: expect (ObjNum 219 snap 63 seq_num 219) 2024-03-04T06:43:58.404 INFO:tasks.rados.rados.0.smithi137.stdout:654: read oid 8 snap 44 2024-03-04T06:43:58.404 INFO:tasks.rados.rados.0.smithi137.stdout:654: expect (ObjNum 135 snap 39 seq_num 135) 2024-03-04T06:43:58.404 INFO:tasks.rados.rados.0.smithi137.stdout:655: snap_remove snap 52 2024-03-04T06:43:58.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:58 smithi137 ceph-mon[37364]: osdmap e183: 8 total, 8 up, 8 in 2024-03-04T06:43:58.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:58 smithi137 ceph-mon[37364]: pgmap v9: 121 pgs: 121 active+clean; 192 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:43:58.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:58 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:58.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:58 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:58.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:58 smithi137 ceph-mon[26846]: osdmap e183: 8 total, 8 up, 8 in 2024-03-04T06:43:58.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:58 smithi137 ceph-mon[26846]: pgmap v9: 121 pgs: 121 active+clean; 192 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:43:58.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:58 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:58 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:58.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:58.402+0000 7f03f98ad200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:43:58.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:58.606+0000 7f03f98ad200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T06:43:58.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:58 smithi203 ceph-mon[30756]: osdmap e183: 8 total, 8 up, 8 in 2024-03-04T06:43:58.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:58 smithi203 ceph-mon[30756]: pgmap v9: 121 pgs: 121 active+clean; 192 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:43:58.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:58 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:58.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:58 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:59.209 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:58.924+0000 7f03f98ad200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:43:59.402 INFO:tasks.rados.rados.0.smithi137.stdout:655: done (2 left) 2024-03-04T06:43:59.402 INFO:tasks.rados.rados.0.smithi137.stdout:656: delete oid 33 current snap is 64 2024-03-04T06:43:59.402 INFO:tasks.rados.rados.0.smithi137.stdout:654: expect (ObjNum 135 snap 39 seq_num 135) 2024-03-04T06:43:59.472 INFO:tasks.rados.rados.0.smithi137.stdout:653: expect (ObjNum 219 snap 63 seq_num 219) 2024-03-04T06:43:59.502 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:59.207+0000 7f03f98ad200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T06:43:59.502 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:59 smithi203 ceph-mon[30756]: mgrmap e32: y(active, since 4s) 2024-03-04T06:43:59.502 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:59 smithi203 ceph-mon[30756]: osdmap e184: 8 total, 8 up, 8 in 2024-03-04T06:43:59.502 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:59 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:59.502 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:59 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:59.502 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:59 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:59.503 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:43:59 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:59.505 INFO:tasks.rados.rados.0.smithi137.stdout:653: done (2 left) 2024-03-04T06:43:59.505 INFO:tasks.rados.rados.0.smithi137.stdout:654: done (1 left) 2024-03-04T06:43:59.505 INFO:tasks.rados.rados.0.smithi137.stdout:656: done (0 left) 2024-03-04T06:43:59.506 INFO:tasks.rados.rados.0.smithi137.stdout:657: snap_create 2024-03-04T06:43:59.713 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:59 smithi137 ceph-mon[37364]: mgrmap e32: y(active, since 4s) 2024-03-04T06:43:59.713 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:59 smithi137 ceph-mon[37364]: osdmap e184: 8 total, 8 up, 8 in 2024-03-04T06:43:59.713 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:59 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:59.713 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:59 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:59.713 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:59 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:59.713 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:43:59 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:59.714 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:59 smithi137 ceph-mon[26846]: mgrmap e32: y(active, since 4s) 2024-03-04T06:43:59.714 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:59 smithi137 ceph-mon[26846]: osdmap e184: 8 total, 8 up, 8 in 2024-03-04T06:43:59.714 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:59 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:59.714 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:59 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:59.714 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:59 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:59.714 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:43:59 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:43:59.845 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:43:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:43:59.501+0000 7f03f98ad200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T06:44:00.375 INFO:tasks.rados.rados.0.smithi137.stdout:657: done (0 left) 2024-03-04T06:44:00.375 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 65 2024-03-04T06:44:00.376 INFO:tasks.rados.rados.0.smithi137.stdout:658: seq_num 223 ranges {2113536=540672,2654208=450560,3104768=352256} 2024-03-04T06:44:00.389 INFO:tasks.rados.rados.0.smithi137.stdout:658: writing smithi13777483-26 from 2113536 to 2654208 tid 1 2024-03-04T06:44:00.392 INFO:tasks.rados.rados.0.smithi137.stdout:658: writing smithi13777483-26 from 2654208 to 3104768 tid 2 2024-03-04T06:44:00.394 INFO:tasks.rados.rados.0.smithi137.stdout:658: writing smithi13777483-26 from 3104768 to 3457024 tid 3 2024-03-04T06:44:00.394 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 65 2024-03-04T06:44:00.394 INFO:tasks.rados.rados.0.smithi137.stdout:659: seq_num 224 ranges {786432=557056,1343488=737280,2080768=65536} 2024-03-04T06:44:00.402 INFO:tasks.rados.rados.0.smithi137.stdout:659: writing smithi13777483-6 from 786432 to 1343488 tid 1 2024-03-04T06:44:00.406 INFO:tasks.rados.rados.0.smithi137.stdout:659: writing smithi13777483-6 from 1343488 to 2080768 tid 2 2024-03-04T06:44:00.407 INFO:tasks.rados.rados.0.smithi137.stdout:659: writing smithi13777483-6 from 2080768 to 2146304 tid 3 2024-03-04T06:44:00.408 INFO:tasks.rados.rados.0.smithi137.stdout:660: copy_from oid 41 from oid 39 current snap is 65 2024-03-04T06:44:00.408 INFO:tasks.rados.rados.0.smithi137.stdout:658: finishing write tid 1 to smithi13777483-26 2024-03-04T06:44:00.408 INFO:tasks.rados.rados.0.smithi137.stdout:658: finishing write tid 2 to smithi13777483-26 2024-03-04T06:44:00.408 INFO:tasks.rados.rados.0.smithi137.stdout:658: finishing write tid 3 to smithi13777483-26 2024-03-04T06:44:00.408 INFO:tasks.rados.rados.0.smithi137.stdout:658: finishing write tid 4 to smithi13777483-26 2024-03-04T06:44:00.408 INFO:tasks.rados.rados.0.smithi137.stdout:658: finishing write tid 5 to smithi13777483-26 2024-03-04T06:44:00.408 INFO:tasks.rados.rados.0.smithi137.stdout:658: oid 26 updating version 0 to 204 2024-03-04T06:44:00.408 INFO:tasks.rados.rados.0.smithi137.stdout:658: oid 26 updating version 204 to 207 2024-03-04T06:44:00.408 INFO:tasks.rados.rados.0.smithi137.stdout:658: oid 26 version 207 is already newer than 206 2024-03-04T06:44:00.408 INFO:tasks.rados.rados.0.smithi137.stdout:658: oid 26 version 207 is already newer than 205 2024-03-04T06:44:00.408 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 207 (ObjNum 223 snap 65 seq_num 223) dirty exists 2024-03-04T06:44:00.408 INFO:tasks.rados.rados.0.smithi137.stdout:658: left oid 26 (ObjNum 223 snap 65 seq_num 223) 2024-03-04T06:44:00.409 INFO:tasks.rados.rados.0.smithi137.stdout:659: finishing write tid 1 to smithi13777483-6 2024-03-04T06:44:00.409 INFO:tasks.rados.rados.0.smithi137.stdout:658: done (2 left) 2024-03-04T06:44:00.409 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 65 2024-03-04T06:44:00.409 INFO:tasks.rados.rados.0.smithi137.stdout:661: seq_num 225 ranges {2531328=573440,3104768=622592,3727360=180224} 2024-03-04T06:44:00.424 INFO:tasks.rados.rados.0.smithi137.stdout:661: writing smithi13777483-19 from 2531328 to 3104768 tid 1 2024-03-04T06:44:00.427 INFO:tasks.rados.rados.0.smithi137.stdout:661: writing smithi13777483-19 from 3104768 to 3727360 tid 2 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:661: writing smithi13777483-19 from 3727360 to 3907584 tid 3 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:662: delete oid 46 current snap is 65 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:659: finishing write tid 2 to smithi13777483-6 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:659: finishing write tid 3 to smithi13777483-6 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:659: finishing write tid 4 to smithi13777483-6 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:659: finishing write tid 5 to smithi13777483-6 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:659: oid 6 updating version 0 to 299 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:659: oid 6 updating version 299 to 300 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:659: oid 6 updating version 300 to 301 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:659: oid 6 version 301 is already newer than 298 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 301 (ObjNum 224 snap 65 seq_num 224) dirty exists 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:659: left oid 6 (ObjNum 224 snap 65 seq_num 224) 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:660: finishing copy_from racing read to smithi13777483-41 2024-03-04T06:44:00.429 INFO:tasks.rados.rados.0.smithi137.stdout:660: finishing copy_from to smithi13777483-41 2024-03-04T06:44:00.430 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 117 (ObjNum 219 snap 63 seq_num 219) dirty exists 2024-03-04T06:44:00.430 INFO:tasks.rados.rados.0.smithi137.stdout:661: finishing write tid 1 to smithi13777483-19 2024-03-04T06:44:00.432 INFO:tasks.rados.rados.0.smithi137.stdout:659: done (3 left) 2024-03-04T06:44:00.432 INFO:tasks.rados.rados.0.smithi137.stdout:660: done (2 left) 2024-03-04T06:44:00.432 INFO:tasks.rados.rados.0.smithi137.stdout:662: done (1 left) 2024-03-04T06:44:00.432 INFO:tasks.rados.rados.0.smithi137.stdout:663: snap_remove snap 39 2024-03-04T06:44:00.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:44:00.330+0000 7f03f98ad200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T06:44:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:00 smithi203 ceph-mon[30756]: osdmap e185: 8 total, 8 up, 8 in 2024-03-04T06:44:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:00 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:00 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:00 smithi203 ceph-mon[30756]: pgmap v12: 121 pgs: 121 active+clean; 192 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:00 smithi203 ceph-mon[30756]: osdmap e186: 8 total, 8 up, 8 in 2024-03-04T06:44:00.723 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:00 smithi137 ceph-mon[26846]: osdmap e185: 8 total, 8 up, 8 in 2024-03-04T06:44:00.723 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:00 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:00.723 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:00 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:00.723 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:00 smithi137 ceph-mon[26846]: pgmap v12: 121 pgs: 121 active+clean; 192 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:00.723 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:00 smithi137 ceph-mon[26846]: osdmap e186: 8 total, 8 up, 8 in 2024-03-04T06:44:00.724 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:00 smithi137 ceph-mon[37364]: osdmap e185: 8 total, 8 up, 8 in 2024-03-04T06:44:00.724 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:00 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:00.724 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:00 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:00.724 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:00 smithi137 ceph-mon[37364]: pgmap v12: 121 pgs: 121 active+clean; 192 MiB data, 743 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:00.724 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:00 smithi137 ceph-mon[37364]: osdmap e186: 8 total, 8 up, 8 in 2024-03-04T06:44:01.236 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:44:00.914+0000 7f03f98ad200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T06:44:01.237 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:44:01.014+0000 7f03f98ad200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T06:44:01.411 INFO:tasks.rados.rados.0.smithi137.stdout:663: done (1 left) 2024-03-04T06:44:01.412 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 36 current snap is 65 2024-03-04T06:44:01.412 INFO:tasks.rados.rados.0.smithi137.stdout:664: seq_num 227 ranges {0=606208,606208=794624,1400832=8192} 2024-03-04T06:44:01.415 INFO:tasks.rados.rados.0.smithi137.stdout:664: writing smithi13777483-36 from 0 to 606208 tid 1 2024-03-04T06:44:01.421 INFO:tasks.rados.rados.0.smithi137.stdout:664: writing smithi13777483-36 from 606208 to 1400832 tid 2 2024-03-04T06:44:01.422 INFO:tasks.rados.rados.0.smithi137.stdout:664: writing smithi13777483-36 from 1400832 to 1409024 tid 3 2024-03-04T06:44:01.422 INFO:tasks.rados.rados.0.smithi137.stdout:665: read oid 17 snap -1 2024-03-04T06:44:01.422 INFO:tasks.rados.rados.0.smithi137.stdout:665: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:44:01.422 INFO:tasks.rados.rados.0.smithi137.stdout:666: read oid 30 snap -1 2024-03-04T06:44:01.422 INFO:tasks.rados.rados.0.smithi137.stdout:666: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:44:01.423 INFO:tasks.rados.rados.0.smithi137.stdout:667: read oid 44 snap 63 2024-03-04T06:44:01.423 INFO:tasks.rados.rados.0.smithi137.stdout:667: expect (ObjNum 216 snap 63 seq_num 216) 2024-03-04T06:44:01.423 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 65 2024-03-04T06:44:01.423 INFO:tasks.rados.rados.0.smithi137.stdout:668: seq_num 228 ranges {1294336=622592,1916928=671744,2588672=131072} 2024-03-04T06:44:01.434 INFO:tasks.rados.rados.0.smithi137.stdout:668: writing smithi13777483-45 from 1294336 to 1916928 tid 1 2024-03-04T06:44:01.439 INFO:tasks.rados.rados.0.smithi137.stdout:668: writing smithi13777483-45 from 1916928 to 2588672 tid 2 2024-03-04T06:44:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:668: writing smithi13777483-45 from 2588672 to 2719744 tid 3 2024-03-04T06:44:01.441 INFO:tasks.rados.rados.0.smithi137.stdout:669: read oid 26 snap -1 2024-03-04T06:44:01.441 INFO:tasks.rados.rados.0.smithi137.stdout:669: expect (ObjNum 223 snap 65 seq_num 223) 2024-03-04T06:44:01.441 INFO:tasks.rados.rados.0.smithi137.stdout:670: read oid 28 snap -1 2024-03-04T06:44:01.441 INFO:tasks.rados.rados.0.smithi137.stdout:670: expect (ObjNum 162 snap 45 seq_num 162) 2024-03-04T06:44:01.441 INFO:tasks.rados.rados.0.smithi137.stdout:671: snap_remove snap 49 2024-03-04T06:44:01.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:44:01.236+0000 7f03f98ad200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T06:44:01.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: [04/Mar/2024:06:44:01] ENGINE Bus STARTING 2024-03-04T06:44:01.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: CherryPy Checker: 2024-03-04T06:44:01.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: The Application mounted at '' has an empty config. 2024-03-04T06:44:01.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: 2024-03-04T06:44:01.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: [04/Mar/2024:06:44:01] ENGINE Serving on http://:::9283 2024-03-04T06:44:01.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: [04/Mar/2024:06:44:01] ENGINE Bus STARTED 2024-03-04T06:44:02.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:01 smithi137 ceph-mon[26846]: Standby manager daemon x started 2024-03-04T06:44:02.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:01 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/476450215' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:44:02.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:01 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/476450215' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:44:02.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:01 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/476450215' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:44:02.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:01 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/476450215' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:44:02.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:01 smithi137 ceph-mon[26846]: osdmap e187: 8 total, 8 up, 8 in 2024-03-04T06:44:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:01 smithi137 ceph-mon[37364]: Standby manager daemon x started 2024-03-04T06:44:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:01 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/476450215' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:44:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:01 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/476450215' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:44:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:01 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/476450215' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:44:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:01 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/476450215' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:44:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:01 smithi137 ceph-mon[37364]: osdmap e187: 8 total, 8 up, 8 in 2024-03-04T06:44:02.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-mon[30756]: Standby manager daemon x started 2024-03-04T06:44:02.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/476450215' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:44:02.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/476450215' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:44:02.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/476450215' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:44:02.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/476450215' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:44:02.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:01 smithi203 ceph-mon[30756]: osdmap e187: 8 total, 8 up, 8 in 2024-03-04T06:44:02.412 INFO:tasks.rados.rados.0.smithi137.stdout:661: finishing write tid 2 to smithi13777483-19 2024-03-04T06:44:02.412 INFO:tasks.rados.rados.0.smithi137.stdout:661: finishing write tid 3 to smithi13777483-19 2024-03-04T06:44:02.412 INFO:tasks.rados.rados.0.smithi137.stdout:661: finishing write tid 4 to smithi13777483-19 2024-03-04T06:44:02.413 INFO:tasks.rados.rados.0.smithi137.stdout:661: finishing write tid 5 to smithi13777483-19 2024-03-04T06:44:02.413 INFO:tasks.rados.rados.0.smithi137.stdout:661: oid 19 updating version 0 to 322 2024-03-04T06:44:02.413 INFO:tasks.rados.rados.0.smithi137.stdout:661: oid 19 updating version 322 to 323 2024-03-04T06:44:02.413 INFO:tasks.rados.rados.0.smithi137.stdout:661: oid 19 version 323 is already newer than 321 2024-03-04T06:44:02.413 INFO:tasks.rados.rados.0.smithi137.stdout:661: oid 19 updating version 323 to 324 2024-03-04T06:44:02.413 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 324 (ObjNum 225 snap 65 seq_num 225) dirty exists 2024-03-04T06:44:02.413 INFO:tasks.rados.rados.0.smithi137.stdout:661: left oid 19 (ObjNum 225 snap 65 seq_num 225) 2024-03-04T06:44:02.413 INFO:tasks.rados.rados.0.smithi137.stdout:665: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:44:02.418 INFO:tasks.rados.rados.0.smithi137.stdout:664: finishing write tid 1 to smithi13777483-36 2024-03-04T06:44:02.418 INFO:tasks.rados.rados.0.smithi137.stdout:664: finishing write tid 2 to smithi13777483-36 2024-03-04T06:44:02.418 INFO:tasks.rados.rados.0.smithi137.stdout:666: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:44:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:664: finishing write tid 3 to smithi13777483-36 2024-03-04T06:44:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:664: finishing write tid 4 to smithi13777483-36 2024-03-04T06:44:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:664: finishing write tid 5 to smithi13777483-36 2024-03-04T06:44:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:664: oid 36 updating version 0 to 53 2024-03-04T06:44:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:664: oid 36 version 53 is already newer than 51 2024-03-04T06:44:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:664: oid 36 version 53 is already newer than 52 2024-03-04T06:44:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:664: oid 36 updating version 53 to 54 2024-03-04T06:44:02.458 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 54 (ObjNum 227 snap 65 seq_num 227) dirty exists 2024-03-04T06:44:02.459 INFO:tasks.rados.rados.0.smithi137.stdout:664: left oid 36 (ObjNum 227 snap 65 seq_num 227) 2024-03-04T06:44:02.459 INFO:tasks.rados.rados.0.smithi137.stdout:667: expect (ObjNum 216 snap 63 seq_num 216) 2024-03-04T06:44:02.491 INFO:tasks.rados.rados.0.smithi137.stdout:668: finishing write tid 1 to smithi13777483-45 2024-03-04T06:44:02.491 INFO:tasks.rados.rados.0.smithi137.stdout:668: finishing write tid 2 to smithi13777483-45 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:661: done (8 left) 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:664: done (7 left) 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:665: done (6 left) 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:666: done (5 left) 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:667: done (4 left) 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:671: done (3 left) 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:672: snap_create 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:668: finishing write tid 3 to smithi13777483-45 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:668: finishing write tid 4 to smithi13777483-45 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:668: finishing write tid 5 to smithi13777483-45 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:668: oid 45 updating version 0 to 129 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:668: oid 45 updating version 129 to 132 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:668: oid 45 version 132 is already newer than 131 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:668: oid 45 version 132 is already newer than 130 2024-03-04T06:44:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 132 (ObjNum 228 snap 65 seq_num 228) dirty exists 2024-03-04T06:44:02.493 INFO:tasks.rados.rados.0.smithi137.stdout:668: left oid 45 (ObjNum 228 snap 65 seq_num 228) 2024-03-04T06:44:02.493 INFO:tasks.rados.rados.0.smithi137.stdout:670: expect (ObjNum 162 snap 45 seq_num 162) 2024-03-04T06:44:02.599 INFO:tasks.rados.rados.0.smithi137.stdout:669: expect (ObjNum 223 snap 65 seq_num 223) 2024-03-04T06:44:03.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:44:03.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[37364]: mgrmap e33: y(active, since 7s), standbys: x 2024-03-04T06:44:03.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[37364]: pgmap v15: 121 pgs: 121 active+clean; 205 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.8 MiB/s wr, 52 op/s 2024-03-04T06:44:03.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[37364]: osdmap e188: 8 total, 8 up, 8 in 2024-03-04T06:44:03.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:03.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:03.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:03.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:44:03.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:44:03.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[26846]: mgrmap e33: y(active, since 7s), standbys: x 2024-03-04T06:44:03.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[26846]: pgmap v15: 121 pgs: 121 active+clean; 205 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.8 MiB/s wr, 52 op/s 2024-03-04T06:44:03.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[26846]: osdmap e188: 8 total, 8 up, 8 in 2024-03-04T06:44:03.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:03.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:03.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:03.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:02 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:44:03.147 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:02 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:44:03.147 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:02 smithi203 ceph-mon[30756]: mgrmap e33: y(active, since 7s), standbys: x 2024-03-04T06:44:03.147 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:02 smithi203 ceph-mon[30756]: pgmap v15: 121 pgs: 121 active+clean; 205 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.8 MiB/s wr, 52 op/s 2024-03-04T06:44:03.147 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:02 smithi203 ceph-mon[30756]: osdmap e188: 8 total, 8 up, 8 in 2024-03-04T06:44:03.147 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:02 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:03.148 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:02 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:03.148 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:02 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:03.148 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:02 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:44:03.416 INFO:tasks.rados.rados.0.smithi137.stdout:668: done (3 left) 2024-03-04T06:44:03.416 INFO:tasks.rados.rados.0.smithi137.stdout:669: done (2 left) 2024-03-04T06:44:03.416 INFO:tasks.rados.rados.0.smithi137.stdout:670: done (1 left) 2024-03-04T06:44:03.416 INFO:tasks.rados.rados.0.smithi137.stdout:672: done (0 left) 2024-03-04T06:44:03.417 INFO:tasks.rados.rados.0.smithi137.stdout:673: read oid 1 snap -1 2024-03-04T06:44:03.417 INFO:tasks.rados.rados.0.smithi137.stdout:673: expect (ObjNum 215 snap 62 seq_num 215) 2024-03-04T06:44:03.417 INFO:tasks.rados.rados.0.smithi137.stdout:674: rollback oid 50 current snap is 66 2024-03-04T06:44:03.417 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 50 to 50 2024-03-04T06:44:03.417 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 66 2024-03-04T06:44:03.417 INFO:tasks.rados.rados.0.smithi137.stdout:675: seq_num 229 ranges {2113536=638976,2752512=606208,3358720=196608} 2024-03-04T06:44:03.431 INFO:tasks.rados.rados.0.smithi137.stdout:675: writing smithi13777483-22 from 2113536 to 2752512 tid 1 2024-03-04T06:44:03.435 INFO:tasks.rados.rados.0.smithi137.stdout:675: writing smithi13777483-22 from 2752512 to 3358720 tid 2 2024-03-04T06:44:03.437 INFO:tasks.rados.rados.0.smithi137.stdout:675: writing smithi13777483-22 from 3358720 to 3555328 tid 3 2024-03-04T06:44:03.437 INFO:tasks.rados.rados.0.smithi137.stdout:676: read oid 9 snap -1 2024-03-04T06:44:03.437 INFO:tasks.rados.rados.0.smithi137.stdout:676: expect deleted 2024-03-04T06:44:03.437 INFO:tasks.rados.rados.0.smithi137.stdout:677: delete oid 5 current snap is 66 2024-03-04T06:44:03.437 INFO:tasks.rados.rados.0.smithi137.stdout:674: finishing rollback tid 0 to smithi13777483-50 2024-03-04T06:44:03.438 INFO:tasks.rados.rados.0.smithi137.stdout:674: finishing rollback tid 1 to smithi13777483-50 2024-03-04T06:44:03.438 INFO:tasks.rados.rados.0.smithi137.stdout:674: finishing rollback tid 2 to smithi13777483-50 2024-03-04T06:44:03.438 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 413 (ObjNum 124 snap 34 seq_num 124) dirty exists 2024-03-04T06:44:03.438 INFO:tasks.rados.rados.0.smithi137.stdout:673: expect (ObjNum 215 snap 62 seq_num 215) 2024-03-04T06:44:03.470 INFO:tasks.rados.rados.0.smithi137.stdout:673: done (4 left) 2024-03-04T06:44:03.470 INFO:tasks.rados.rados.0.smithi137.stdout:674: done (3 left) 2024-03-04T06:44:03.470 INFO:tasks.rados.rados.0.smithi137.stdout:676: done (2 left) 2024-03-04T06:44:03.470 INFO:tasks.rados.rados.0.smithi137.stdout:677: done (1 left) 2024-03-04T06:44:03.471 INFO:tasks.rados.rados.0.smithi137.stdout:678: read oid 19 snap -1 2024-03-04T06:44:03.471 INFO:tasks.rados.rados.0.smithi137.stdout:678: expect (ObjNum 225 snap 65 seq_num 225) 2024-03-04T06:44:03.471 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 33 current snap is 66 2024-03-04T06:44:03.471 INFO:tasks.rados.rados.0.smithi137.stdout:675: finishing write tid 1 to smithi13777483-22 2024-03-04T06:44:03.471 INFO:tasks.rados.rados.0.smithi137.stdout:675: finishing write tid 2 to smithi13777483-22 2024-03-04T06:44:03.471 INFO:tasks.rados.rados.0.smithi137.stdout:675: finishing write tid 3 to smithi13777483-22 2024-03-04T06:44:03.471 INFO:tasks.rados.rados.0.smithi137.stdout:675: finishing write tid 4 to smithi13777483-22 2024-03-04T06:44:03.471 INFO:tasks.rados.rados.0.smithi137.stdout:675: finishing write tid 5 to smithi13777483-22 2024-03-04T06:44:03.471 INFO:tasks.rados.rados.0.smithi137.stdout:675: oid 22 updating version 0 to 320 2024-03-04T06:44:03.471 INFO:tasks.rados.rados.0.smithi137.stdout:675: oid 22 version 320 is already newer than 319 2024-03-04T06:44:03.471 INFO:tasks.rados.rados.0.smithi137.stdout:675: oid 22 version 320 is already newer than 317 2024-03-04T06:44:03.471 INFO:tasks.rados.rados.0.smithi137.stdout:675: oid 22 version 320 is already newer than 318 2024-03-04T06:44:03.472 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 320 (ObjNum 229 snap 66 seq_num 229) dirty exists 2024-03-04T06:44:03.472 INFO:tasks.rados.rados.0.smithi137.stdout:675: left oid 22 (ObjNum 229 snap 66 seq_num 229) 2024-03-04T06:44:03.472 INFO:tasks.rados.rados.0.smithi137.stdout:679: seq_num 231 ranges {0=671744,671744=778240,1449984=24576} 2024-03-04T06:44:03.474 INFO:tasks.rados.rados.0.smithi137.stdout:679: writing smithi13777483-33 from 0 to 671744 tid 1 2024-03-04T06:44:03.479 INFO:tasks.rados.rados.0.smithi137.stdout:679: writing smithi13777483-33 from 671744 to 1449984 tid 2 2024-03-04T06:44:03.479 INFO:tasks.rados.rados.0.smithi137.stdout:679: writing smithi13777483-33 from 1449984 to 1474560 tid 3 2024-03-04T06:44:03.479 INFO:tasks.rados.rados.0.smithi137.stdout:675: done (2 left) 2024-03-04T06:44:03.480 INFO:tasks.rados.rados.0.smithi137.stdout:680: delete oid 3 current snap is 66 2024-03-04T06:44:03.480 INFO:tasks.rados.rados.0.smithi137.stdout:679: finishing write tid 1 to smithi13777483-33 2024-03-04T06:44:03.483 INFO:tasks.rados.rados.0.smithi137.stdout:679: finishing write tid 2 to smithi13777483-33 2024-03-04T06:44:03.483 INFO:tasks.rados.rados.0.smithi137.stdout:679: finishing write tid 3 to smithi13777483-33 2024-03-04T06:44:03.483 INFO:tasks.rados.rados.0.smithi137.stdout:679: finishing write tid 4 to smithi13777483-33 2024-03-04T06:44:03.484 INFO:tasks.rados.rados.0.smithi137.stdout:678: expect (ObjNum 225 snap 65 seq_num 225) 2024-03-04T06:44:03.595 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[64863]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:44:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-03-04T06:44:03.642 INFO:tasks.rados.rados.0.smithi137.stdout:679: finishing write tid 5 to smithi13777483-33 2024-03-04T06:44:03.642 INFO:tasks.rados.rados.0.smithi137.stdout:679: oid 33 updating version 0 to 237 2024-03-04T06:44:03.643 INFO:tasks.rados.rados.0.smithi137.stdout:679: oid 33 updating version 237 to 239 2024-03-04T06:44:03.643 INFO:tasks.rados.rados.0.smithi137.stdout:679: oid 33 updating version 239 to 240 2024-03-04T06:44:03.643 INFO:tasks.rados.rados.0.smithi137.stdout:679: oid 33 version 240 is already newer than 238 2024-03-04T06:44:03.643 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 240 (ObjNum 231 snap 66 seq_num 231) dirty exists 2024-03-04T06:44:03.643 INFO:tasks.rados.rados.0.smithi137.stdout:679: left oid 33 (ObjNum 231 snap 66 seq_num 231) 2024-03-04T06:44:03.643 INFO:tasks.rados.rados.0.smithi137.stdout:678: done (2 left) 2024-03-04T06:44:03.643 INFO:tasks.rados.rados.0.smithi137.stdout:679: done (1 left) 2024-03-04T06:44:03.643 INFO:tasks.rados.rados.0.smithi137.stdout:680: done (0 left) 2024-03-04T06:44:03.643 INFO:tasks.rados.rados.0.smithi137.stdout:681: snap_create 2024-03-04T06:44:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[37364]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:44:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[37364]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:44:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[37364]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:44:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[37364]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:44:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[37364]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:44:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[37364]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:44:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[37364]: osdmap e189: 8 total, 8 up, 8 in 2024-03-04T06:44:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[26846]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:44:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[26846]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:44:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[26846]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:44:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[26846]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:44:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[26846]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:44:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[26846]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:44:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[26846]: osdmap e189: 8 total, 8 up, 8 in 2024-03-04T06:44:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:03 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:03 smithi203 ceph-mon[30756]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:44:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:03 smithi203 ceph-mon[30756]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:44:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:03 smithi203 ceph-mon[30756]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:44:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:03 smithi203 ceph-mon[30756]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:44:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:03 smithi203 ceph-mon[30756]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:44:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:03 smithi203 ceph-mon[30756]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:44:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:03 smithi203 ceph-mon[30756]: osdmap e189: 8 total, 8 up, 8 in 2024-03-04T06:44:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:03 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:03 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:03 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:03 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:03 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:681: done (0 left) 2024-03-04T06:44:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:682: rmattr oid 13 current snap is 67 2024-03-04T06:44:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:683: snap_create 2024-03-04T06:44:04.616 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 415 (ObjNum 125 snap 34 seq_num 125) dirty exists 2024-03-04T06:44:05.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:04 smithi137 ceph-mon[26846]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:44:05.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:04 smithi137 ceph-mon[26846]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:44:05.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:04 smithi137 ceph-mon[26846]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-04T06:44:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:04 smithi137 ceph-mon[26846]: pgmap v18: 121 pgs: 121 active+clean; 205 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.8 MiB/s wr, 52 op/s 2024-03-04T06:44:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:04 smithi137 ceph-mon[26846]: Reconfiguring daemon prometheus.a on smithi203 2024-03-04T06:44:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:04 smithi137 ceph-mon[26846]: osdmap e190: 8 total, 8 up, 8 in 2024-03-04T06:44:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:04 smithi137 ceph-mon[37364]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:44:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:04 smithi137 ceph-mon[37364]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:44:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:04 smithi137 ceph-mon[37364]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-04T06:44:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:04 smithi137 ceph-mon[37364]: pgmap v18: 121 pgs: 121 active+clean; 205 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.8 MiB/s wr, 52 op/s 2024-03-04T06:44:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:04 smithi137 ceph-mon[37364]: Reconfiguring daemon prometheus.a on smithi203 2024-03-04T06:44:05.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:04 smithi137 ceph-mon[37364]: osdmap e190: 8 total, 8 up, 8 in 2024-03-04T06:44:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:04 smithi203 ceph-mon[30756]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:44:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:04 smithi203 ceph-mon[30756]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:44:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:04 smithi203 ceph-mon[30756]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-04T06:44:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:04 smithi203 ceph-mon[30756]: pgmap v18: 121 pgs: 121 active+clean; 205 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.8 MiB/s wr, 52 op/s 2024-03-04T06:44:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:04 smithi203 ceph-mon[30756]: Reconfiguring daemon prometheus.a on smithi203 2024-03-04T06:44:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:04 smithi203 ceph-mon[30756]: osdmap e190: 8 total, 8 up, 8 in 2024-03-04T06:44:05.616 INFO:tasks.rados.rados.0.smithi137.stdout:682: done (1 left) 2024-03-04T06:44:05.617 INFO:tasks.rados.rados.0.smithi137.stdout:683: done (0 left) 2024-03-04T06:44:05.617 INFO:tasks.rados.rados.0.smithi137.stdout:684: copy_from oid 43 from oid 39 current snap is 68 2024-03-04T06:44:05.617 INFO:tasks.rados.rados.0.smithi137.stdout:685: delete oid 49 current snap is 68 2024-03-04T06:44:05.623 INFO:tasks.rados.rados.0.smithi137.stdout:685: done (1 left) 2024-03-04T06:44:05.623 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 68 2024-03-04T06:44:05.623 INFO:tasks.rados.rados.0.smithi137.stdout:686: seq_num 234 ranges {819200=729088,1548288=434176,1982464=368640} 2024-03-04T06:44:05.631 INFO:tasks.rados.rados.0.smithi137.stdout:686: writing smithi13777483-23 from 819200 to 1548288 tid 1 2024-03-04T06:44:05.634 INFO:tasks.rados.rados.0.smithi137.stdout:686: writing smithi13777483-23 from 1548288 to 1982464 tid 2 2024-03-04T06:44:05.636 INFO:tasks.rados.rados.0.smithi137.stdout:686: writing smithi13777483-23 from 1982464 to 2351104 tid 3 2024-03-04T06:44:05.636 INFO:tasks.rados.rados.0.smithi137.stdout:687: rollback oid 3 current snap is 68 2024-03-04T06:44:05.636 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 3 to 43 2024-03-04T06:44:05.636 INFO:tasks.rados.rados.0.smithi137.stdout:684: finishing copy_from racing read to smithi13777483-43 2024-03-04T06:44:05.637 INFO:tasks.rados.rados.0.smithi137.stdout:684: finishing copy_from to smithi13777483-43 2024-03-04T06:44:05.637 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 117 (ObjNum 219 snap 63 seq_num 219) dirty exists 2024-03-04T06:44:05.637 INFO:tasks.rados.rados.0.smithi137.stdout:686: finishing write tid 1 to smithi13777483-23 2024-03-04T06:44:05.637 INFO:tasks.rados.rados.0.smithi137.stdout:684: done (2 left) 2024-03-04T06:44:05.637 INFO:tasks.rados.rados.0.smithi137.stdout:688: snap_create 2024-03-04T06:44:05.637 INFO:tasks.rados.rados.0.smithi137.stdout:686: finishing write tid 2 to smithi13777483-23 2024-03-04T06:44:05.637 INFO:tasks.rados.rados.0.smithi137.stdout:687: finishing rollback tid 1 to smithi13777483-3 2024-03-04T06:44:05.637 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 339 (ObjNum 177 snap 0 seq_num 3162484096) dirty dne 2024-03-04T06:44:05.638 INFO:tasks.rados.rados.0.smithi137.stdout:686: finishing write tid 3 to smithi13777483-23 2024-03-04T06:44:05.638 INFO:tasks.rados.rados.0.smithi137.stdout:686: finishing write tid 4 to smithi13777483-23 2024-03-04T06:44:05.639 INFO:tasks.rados.rados.0.smithi137.stdout:686: finishing write tid 5 to smithi13777483-23 2024-03-04T06:44:05.640 INFO:tasks.rados.rados.0.smithi137.stdout:686: oid 23 updating version 0 to 213 2024-03-04T06:44:05.640 INFO:tasks.rados.rados.0.smithi137.stdout:686: oid 23 version 213 is already newer than 212 2024-03-04T06:44:05.640 INFO:tasks.rados.rados.0.smithi137.stdout:686: oid 23 updating version 213 to 214 2024-03-04T06:44:05.640 INFO:tasks.rados.rados.0.smithi137.stdout:686: oid 23 version 214 is already newer than 211 2024-03-04T06:44:05.640 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 214 (ObjNum 234 snap 68 seq_num 234) dirty exists 2024-03-04T06:44:05.640 INFO:tasks.rados.rados.0.smithi137.stdout:686: left oid 23 (ObjNum 234 snap 68 seq_num 234) 2024-03-04T06:44:06.626 INFO:tasks.rados.rados.0.smithi137.stdout:686: done (2 left) 2024-03-04T06:44:06.626 INFO:tasks.rados.rados.0.smithi137.stdout:687: done (1 left) 2024-03-04T06:44:06.626 INFO:tasks.rados.rados.0.smithi137.stdout:688: done (0 left) 2024-03-04T06:44:06.626 INFO:tasks.rados.rados.0.smithi137.stdout:689: read oid 42 snap -1 2024-03-04T06:44:06.626 INFO:tasks.rados.rados.0.smithi137.stdout:689: expect deleted 2024-03-04T06:44:06.626 INFO:tasks.rados.rados.0.smithi137.stdout:690: read oid 24 snap -1 2024-03-04T06:44:06.626 INFO:tasks.rados.rados.0.smithi137.stdout:690: expect deleted 2024-03-04T06:44:06.626 INFO:tasks.rados.rados.0.smithi137.stdout:691: snap_create 2024-03-04T06:44:06.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:06 smithi203 ceph-mon[30756]: osdmap e191: 8 total, 8 up, 8 in 2024-03-04T06:44:06.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:06 smithi203 ceph-mon[30756]: pgmap v21: 121 pgs: 121 active+clean; 209 MiB data, 791 MiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 2.6 MiB/s wr, 20 op/s 2024-03-04T06:44:07.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:06 smithi137 ceph-mon[26846]: osdmap e191: 8 total, 8 up, 8 in 2024-03-04T06:44:07.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:06 smithi137 ceph-mon[26846]: pgmap v21: 121 pgs: 121 active+clean; 209 MiB data, 791 MiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 2.6 MiB/s wr, 20 op/s 2024-03-04T06:44:07.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:06 smithi137 ceph-mon[37364]: osdmap e191: 8 total, 8 up, 8 in 2024-03-04T06:44:07.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:06 smithi137 ceph-mon[37364]: pgmap v21: 121 pgs: 121 active+clean; 209 MiB data, 791 MiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 2.6 MiB/s wr, 20 op/s 2024-03-04T06:44:07.596 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 systemd[1]: Stopping Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:44:07.625 INFO:tasks.rados.rados.0.smithi137.stdout:689: done (2 left) 2024-03-04T06:44:07.625 INFO:tasks.rados.rados.0.smithi137.stdout:690: done (1 left) 2024-03-04T06:44:07.626 INFO:tasks.rados.rados.0.smithi137.stdout:691: done (0 left) 2024-03-04T06:44:07.626 INFO:tasks.rados.rados.0.smithi137.stdout:692: delete oid 10 current snap is 70 2024-03-04T06:44:07.629 INFO:tasks.rados.rados.0.smithi137.stdout:692: done (0 left) 2024-03-04T06:44:07.629 INFO:tasks.rados.rados.0.smithi137.stdout:693: snap_create 2024-03-04T06:44:08.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:07 smithi137 ceph-mon[26846]: osdmap e192: 8 total, 8 up, 8 in 2024-03-04T06:44:08.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:07 smithi137 ceph-mon[37364]: osdmap e192: 8 total, 8 up, 8 in 2024-03-04T06:44:08.062 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:07 smithi203 ceph-mon[30756]: osdmap e192: 8 total, 8 up, 8 in 2024-03-04T06:44:08.062 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:44:07.736Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-04T06:44:08.063 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:44:07.736Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-04T06:44:08.063 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:44:07.736Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-04T06:44:08.063 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:44:07.736Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-04T06:44:08.063 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:44:07.736Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-04T06:44:08.063 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:44:07.736Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-04T06:44:08.063 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:44:07.736Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-04T06:44:08.063 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:44:07.736Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-04T06:44:08.063 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:44:07.737Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-04T06:44:08.063 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:44:07.737Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-04T06:44:08.063 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:44:07.737Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-04T06:44:08.063 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[73853]: ts=2024-03-04T06:44:07.737Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-04T06:44:08.063 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:07 smithi203 podman[76372]: 2024-03-04 06:44:07.746875331 +0000 UTC m=+0.105643109 container died 93bdbbe990e9c2ed9ae707b82e8725a3915065d8bac20c04f9f17ebb8ed14465 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:44:08.345 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:08 smithi203 podman[76372]: 2024-03-04 06:44:08.162051512 +0000 UTC m=+0.520819336 container cleanup 93bdbbe990e9c2ed9ae707b82e8725a3915065d8bac20c04f9f17ebb8ed14465 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:44:08.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:08 smithi203 bash[76372]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a 2024-03-04T06:44:08.638 INFO:tasks.rados.rados.0.smithi137.stdout:693: done (0 left) 2024-03-04T06:44:08.638 INFO:tasks.rados.rados.0.smithi137.stdout:694: read oid 17 snap -1 2024-03-04T06:44:08.638 INFO:tasks.rados.rados.0.smithi137.stdout:694: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:44:08.638 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 71 2024-03-04T06:44:08.638 INFO:tasks.rados.rados.0.smithi137.stdout:695: seq_num 236 ranges {2351104=761856,3112960=647168,3760128=155648} 2024-03-04T06:44:08.654 INFO:tasks.rados.rados.0.smithi137.stdout:695: writing smithi13777483-23 from 2351104 to 3112960 tid 1 2024-03-04T06:44:08.657 INFO:tasks.rados.rados.0.smithi137.stdout:695: writing smithi13777483-23 from 3112960 to 3760128 tid 2 2024-03-04T06:44:08.659 INFO:tasks.rados.rados.0.smithi137.stdout:695: writing smithi13777483-23 from 3760128 to 3915776 tid 3 2024-03-04T06:44:08.659 INFO:tasks.rados.rados.0.smithi137.stdout:696: rmattr oid 9 current snap is 71 2024-03-04T06:44:08.659 INFO:tasks.rados.rados.0.smithi137.stdout:696: done (2 left) 2024-03-04T06:44:08.659 INFO:tasks.rados.rados.0.smithi137.stdout:697: read oid 22 snap -1 2024-03-04T06:44:08.659 INFO:tasks.rados.rados.0.smithi137.stdout:697: expect (ObjNum 229 snap 66 seq_num 229) 2024-03-04T06:44:08.659 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 71 2024-03-04T06:44:08.659 INFO:tasks.rados.rados.0.smithi137.stdout:698: seq_num 237 ranges {0=778240,778240=532480,1310720=270336} 2024-03-04T06:44:08.663 INFO:tasks.rados.rados.0.smithi137.stdout:698: writing smithi13777483-7 from 0 to 778240 tid 1 2024-03-04T06:44:08.666 INFO:tasks.rados.rados.0.smithi137.stdout:698: writing smithi13777483-7 from 778240 to 1310720 tid 2 2024-03-04T06:44:08.668 INFO:tasks.rados.rados.0.smithi137.stdout:698: writing smithi13777483-7 from 1310720 to 1581056 tid 3 2024-03-04T06:44:08.668 INFO:tasks.rados.rados.0.smithi137.stdout:699: rollback oid 47 current snap is 71 2024-03-04T06:44:08.668 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 47 to 62 2024-03-04T06:44:08.668 INFO:tasks.rados.rados.0.smithi137.stdout:694: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:44:08.670 INFO:tasks.rados.rados.0.smithi137.stdout:695: finishing write tid 1 to smithi13777483-23 2024-03-04T06:44:08.670 INFO:tasks.rados.rados.0.smithi137.stdout:695: finishing write tid 2 to smithi13777483-23 2024-03-04T06:44:08.670 INFO:tasks.rados.rados.0.smithi137.stdout:695: finishing write tid 3 to smithi13777483-23 2024-03-04T06:44:08.670 INFO:tasks.rados.rados.0.smithi137.stdout:695: finishing write tid 4 to smithi13777483-23 2024-03-04T06:44:08.670 INFO:tasks.rados.rados.0.smithi137.stdout:695: finishing write tid 5 to smithi13777483-23 2024-03-04T06:44:08.670 INFO:tasks.rados.rados.0.smithi137.stdout:695: oid 23 updating version 0 to 219 2024-03-04T06:44:08.671 INFO:tasks.rados.rados.0.smithi137.stdout:695: oid 23 version 219 is already newer than 216 2024-03-04T06:44:08.671 INFO:tasks.rados.rados.0.smithi137.stdout:695: oid 23 version 219 is already newer than 218 2024-03-04T06:44:08.671 INFO:tasks.rados.rados.0.smithi137.stdout:695: oid 23 version 219 is already newer than 217 2024-03-04T06:44:08.671 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 219 (ObjNum 236 snap 71 seq_num 236) dirty exists 2024-03-04T06:44:08.671 INFO:tasks.rados.rados.0.smithi137.stdout:695: left oid 23 (ObjNum 236 snap 71 seq_num 236) 2024-03-04T06:44:08.671 INFO:tasks.rados.rados.0.smithi137.stdout:698: finishing write tid 1 to smithi13777483-7 2024-03-04T06:44:08.671 INFO:tasks.rados.rados.0.smithi137.stdout:694: done (4 left) 2024-03-04T06:44:08.671 INFO:tasks.rados.rados.0.smithi137.stdout:695: done (3 left) 2024-03-04T06:44:08.671 INFO:tasks.rados.rados.0.smithi137.stdout:700: snap_create 2024-03-04T06:44:08.671 INFO:tasks.rados.rados.0.smithi137.stdout:698: finishing write tid 2 to smithi13777483-7 2024-03-04T06:44:08.672 INFO:tasks.rados.rados.0.smithi137.stdout:698: finishing write tid 3 to smithi13777483-7 2024-03-04T06:44:08.672 INFO:tasks.rados.rados.0.smithi137.stdout:698: finishing write tid 4 to smithi13777483-7 2024-03-04T06:44:08.673 INFO:tasks.rados.rados.0.smithi137.stdout:699: finishing rollback tid 0 to smithi13777483-47 2024-03-04T06:44:08.673 INFO:tasks.rados.rados.0.smithi137.stdout:699: finishing rollback tid 1 to smithi13777483-47 2024-03-04T06:44:08.674 INFO:tasks.rados.rados.0.smithi137.stdout:699: finishing rollback tid 2 to smithi13777483-47 2024-03-04T06:44:08.674 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 348 (ObjNum 207 snap 60 seq_num 207) dirty exists 2024-03-04T06:44:08.674 INFO:tasks.rados.rados.0.smithi137.stdout:698: finishing write tid 5 to smithi13777483-7 2024-03-04T06:44:08.674 INFO:tasks.rados.rados.0.smithi137.stdout:698: oid 7 updating version 0 to 108 2024-03-04T06:44:08.674 INFO:tasks.rados.rados.0.smithi137.stdout:698: oid 7 updating version 108 to 109 2024-03-04T06:44:08.674 INFO:tasks.rados.rados.0.smithi137.stdout:698: oid 7 version 109 is already newer than 107 2024-03-04T06:44:08.675 INFO:tasks.rados.rados.0.smithi137.stdout:698: oid 7 version 109 is already newer than 106 2024-03-04T06:44:08.675 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 109 (ObjNum 237 snap 71 seq_num 237) dirty exists 2024-03-04T06:44:08.675 INFO:tasks.rados.rados.0.smithi137.stdout:698: left oid 7 (ObjNum 237 snap 71 seq_num 237) 2024-03-04T06:44:08.679 INFO:tasks.rados.rados.0.smithi137.stdout:697: expect (ObjNum 229 snap 66 seq_num 229) 2024-03-04T06:44:08.772 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:08 smithi203 ceph-mon[30756]: osdmap e193: 8 total, 8 up, 8 in 2024-03-04T06:44:08.772 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:08 smithi203 ceph-mon[30756]: pgmap v24: 121 pgs: 121 active+clean; 209 MiB data, 791 MiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 2.6 MiB/s wr, 20 op/s 2024-03-04T06:44:08.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:08 smithi203 podman[76386]: 2024-03-04 06:44:08.405101687 +0000 UTC m=+0.656941096 container remove 93bdbbe990e9c2ed9ae707b82e8725a3915065d8bac20c04f9f17ebb8ed14465 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:44:08.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:08 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@prometheus.a.service: Deactivated successfully. 2024-03-04T06:44:08.773 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:08 smithi203 systemd[1]: Stopped Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:44:08.773 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:08 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@prometheus.a.service: Consumed 1.045s CPU time. 2024-03-04T06:44:08.773 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:08 smithi203 systemd[1]: Starting Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:44:09.034 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:08 smithi203 podman[76484]: 2024-03-04 06:44:08.772881038 +0000 UTC m=+0.109620800 container create 6a88bdd1023c75676b0612fafce87598bdf5e91c38c14e90272d00f617631b29 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:44:09.034 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:08 smithi203 podman[76484]: 2024-03-04 06:44:08.684949144 +0000 UTC m=+0.021688873 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-03-04T06:44:09.034 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 podman[76484]: 2024-03-04 06:44:09.008407619 +0000 UTC m=+0.345147335 container init 6a88bdd1023c75676b0612fafce87598bdf5e91c38c14e90272d00f617631b29 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:44:09.034 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 podman[76484]: 2024-03-04 06:44:09.011058767 +0000 UTC m=+0.347798484 container start 6a88bdd1023c75676b0612fafce87598bdf5e91c38c14e90272d00f617631b29 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:44:09.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:08 smithi137 ceph-mon[26846]: osdmap e193: 8 total, 8 up, 8 in 2024-03-04T06:44:09.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:08 smithi137 ceph-mon[26846]: pgmap v24: 121 pgs: 121 active+clean; 209 MiB data, 791 MiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 2.6 MiB/s wr, 20 op/s 2024-03-04T06:44:09.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:08 smithi137 ceph-mon[37364]: osdmap e193: 8 total, 8 up, 8 in 2024-03-04T06:44:09.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:08 smithi137 ceph-mon[37364]: pgmap v24: 121 pgs: 121 active+clean; 209 MiB data, 791 MiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 2.6 MiB/s wr, 20 op/s 2024-03-04T06:44:09.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.034Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-04T06:44:09.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.034Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-04T06:44:09.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.034Z caller=main.go:570 level=info host_details="(Linux 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 x86_64 smithi203 (none))" 2024-03-04T06:44:09.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.034Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-04T06:44:09.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.034Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-04T06:44:09.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.036Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-04T06:44:09.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.037Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-04T06:44:09.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.038Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-04T06:44:09.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.038Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-04T06:44:09.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.040Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-04T06:44:09.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.040Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.613µs 2024-03-04T06:44:09.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.040Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-04T06:44:09.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.042Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3 2024-03-04T06:44:09.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.050Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3 2024-03-04T06:44:09.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.052Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3 2024-03-04T06:44:09.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.052Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3 2024-03-04T06:44:09.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.052Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=24.101µs wal_replay_duration=11.69034ms wbl_replay_duration=96ns total_replay_duration=11.732674ms 2024-03-04T06:44:09.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.053Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-04T06:44:09.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.053Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-04T06:44:09.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.053Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-04T06:44:09.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.073Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=19.717933ms db_storage=879ns remote_storage=1.172µs web_handler=466ns query_engine=540ns scrape=437.179µs scrape_sd=87.885µs notify=9.553µs notify_sd=14.029µs rules=18.876736ms tracing=6.055µs 2024-03-04T06:44:09.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.073Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-04T06:44:09.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:44:09.073Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-04T06:44:09.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 bash[76484]: 6a88bdd1023c75676b0612fafce87598bdf5e91c38c14e90272d00f617631b29 2024-03-04T06:44:09.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:44:09 smithi203 systemd[1]: Started Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:44:09.644 INFO:tasks.rados.rados.0.smithi137.stdout:697: done (3 left) 2024-03-04T06:44:09.644 INFO:tasks.rados.rados.0.smithi137.stdout:698: done (2 left) 2024-03-04T06:44:09.644 INFO:tasks.rados.rados.0.smithi137.stdout:699: done (1 left) 2024-03-04T06:44:09.644 INFO:tasks.rados.rados.0.smithi137.stdout:700: done (0 left) 2024-03-04T06:44:09.644 INFO:tasks.rados.rados.0.smithi137.stdout:701: copy_from oid 48 from oid 7 current snap is 72 2024-03-04T06:44:09.644 INFO:tasks.rados.rados.0.smithi137.stdout:702: read oid 2 snap -1 2024-03-04T06:44:09.644 INFO:tasks.rados.rados.0.smithi137.stdout:702: expect deleted 2024-03-04T06:44:09.644 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 72 2024-03-04T06:44:09.644 INFO:tasks.rados.rados.0.smithi137.stdout:703: seq_num 238 ranges {4972544=794624,5767168=417792,6184960=385024} 2024-03-04T06:44:09.674 INFO:tasks.rados.rados.0.smithi137.stdout:703: writing smithi13777483-13 from 4972544 to 5767168 tid 1 2024-03-04T06:44:09.677 INFO:tasks.rados.rados.0.smithi137.stdout:703: writing smithi13777483-13 from 5767168 to 6184960 tid 2 2024-03-04T06:44:09.679 INFO:tasks.rados.rados.0.smithi137.stdout:703: writing smithi13777483-13 from 6184960 to 6569984 tid 3 2024-03-04T06:44:09.680 INFO:tasks.rados.rados.0.smithi137.stdout:704: read oid 47 snap -1 2024-03-04T06:44:09.680 INFO:tasks.rados.rados.0.smithi137.stdout:704: expect (ObjNum 207 snap 60 seq_num 207) 2024-03-04T06:44:09.680 INFO:tasks.rados.rados.0.smithi137.stdout:705: setattr oid 20 current snap is 72 2024-03-04T06:44:09.680 INFO:tasks.rados.rados.0.smithi137.stdout:701: finishing copy_from racing read to smithi13777483-48 2024-03-04T06:44:09.680 INFO:tasks.rados.rados.0.smithi137.stdout:701: finishing copy_from to smithi13777483-48 2024-03-04T06:44:09.680 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 109 (ObjNum 237 snap 71 seq_num 237) dirty exists 2024-03-04T06:44:09.680 INFO:tasks.rados.rados.0.smithi137.stdout:703: finishing write tid 1 to smithi13777483-13 2024-03-04T06:44:09.681 INFO:tasks.rados.rados.0.smithi137.stdout:701: done (4 left) 2024-03-04T06:44:09.681 INFO:tasks.rados.rados.0.smithi137.stdout:702: done (3 left) 2024-03-04T06:44:09.681 INFO:tasks.rados.rados.0.smithi137.stdout:706: read oid 19 snap 62 2024-03-04T06:44:09.681 INFO:tasks.rados.rados.0.smithi137.stdout:706: expect (ObjNum 124 snap 34 seq_num 124) 2024-03-04T06:44:09.681 INFO:tasks.rados.rados.0.smithi137.stdout:707: read oid 5 snap 59 2024-03-04T06:44:09.682 INFO:tasks.rados.rados.0.smithi137.stdout:707: expect deleted 2024-03-04T06:44:09.682 INFO:tasks.rados.rados.0.smithi137.stdout:708: rmattr oid 22 current snap is 72 2024-03-04T06:44:09.682 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 72 2024-03-04T06:44:09.682 INFO:tasks.rados.rados.0.smithi137.stdout:709: seq_num 239 ranges {1245184=409600,1654784=704512,2359296=499712} 2024-03-04T06:44:09.690 INFO:tasks.rados.rados.0.smithi137.stdout:709: writing smithi13777483-30 from 1245184 to 1654784 tid 1 2024-03-04T06:44:09.695 INFO:tasks.rados.rados.0.smithi137.stdout:709: writing smithi13777483-30 from 1654784 to 2359296 tid 2 2024-03-04T06:44:09.698 INFO:tasks.rados.rados.0.smithi137.stdout:709: writing smithi13777483-30 from 2359296 to 2859008 tid 3 2024-03-04T06:44:09.698 INFO:tasks.rados.rados.0.smithi137.stdout:710: read oid 12 snap -1 2024-03-04T06:44:09.698 INFO:tasks.rados.rados.0.smithi137.stdout:710: expect (ObjNum 218 snap 63 seq_num 218) 2024-03-04T06:44:09.698 INFO:tasks.rados.rados.0.smithi137.stdout:711: read oid 6 snap -1 2024-03-04T06:44:09.698 INFO:tasks.rados.rados.0.smithi137.stdout:711: expect (ObjNum 224 snap 65 seq_num 224) 2024-03-04T06:44:09.699 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 24 current snap is 72 2024-03-04T06:44:09.699 INFO:tasks.rados.rados.0.smithi137.stdout:703: finishing write tid 2 to smithi13777483-13 2024-03-04T06:44:09.699 INFO:tasks.rados.rados.0.smithi137.stdout:703: finishing write tid 3 to smithi13777483-13 2024-03-04T06:44:09.699 INFO:tasks.rados.rados.0.smithi137.stdout:703: finishing write tid 4 to smithi13777483-13 2024-03-04T06:44:09.699 INFO:tasks.rados.rados.0.smithi137.stdout:712: seq_num 240 ranges {0=425984,425984=589824,1015808=483328,1499136=131072} 2024-03-04T06:44:09.700 INFO:tasks.rados.rados.0.smithi137.stdout:712: writing smithi13777483-24 from 0 to 425984 tid 1 2024-03-04T06:44:09.704 INFO:tasks.rados.rados.0.smithi137.stdout:712: writing smithi13777483-24 from 425984 to 1015808 tid 2 2024-03-04T06:44:09.707 INFO:tasks.rados.rados.0.smithi137.stdout:712: writing smithi13777483-24 from 1015808 to 1499136 tid 3 2024-03-04T06:44:09.708 INFO:tasks.rados.rados.0.smithi137.stdout:712: writing smithi13777483-24 from 1499136 to 1630208 tid 4 2024-03-04T06:44:09.708 INFO:tasks.rados.rados.0.smithi137.stdout:713: snap_remove snap 44 2024-03-04T06:44:09.906 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-mon[30756]: osdmap e194: 8 total, 8 up, 8 in 2024-03-04T06:44:09.906 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:44:09.906 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:09.906 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:09.907 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:44:09.907 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-mon[30756]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:44:09.907 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:09 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:10.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[26846]: osdmap e194: 8 total, 8 up, 8 in 2024-03-04T06:44:10.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:44:10.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:10.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:10.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:44:10.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[26846]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:44:10.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:10.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[37364]: osdmap e194: 8 total, 8 up, 8 in 2024-03-04T06:44:10.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:44:10.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:10.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:10.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:44:10.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[37364]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:44:10.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:09 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:10.383 INFO:tasks.rados.rados.0.smithi137.stdout:713: done (10 left) 2024-03-04T06:44:10.383 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 72 2024-03-04T06:44:10.383 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 322 (ObjNum 229 snap 66 seq_num 229) dirty exists 2024-03-04T06:44:10.384 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 221 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:44:10.384 INFO:tasks.rados.rados.0.smithi137.stdout:703: finishing write tid 5 to smithi13777483-13 2024-03-04T06:44:10.384 INFO:tasks.rados.rados.0.smithi137.stdout:703: oid 13 updating version 0 to 420 2024-03-04T06:44:10.384 INFO:tasks.rados.rados.0.smithi137.stdout:703: oid 13 version 420 is already newer than 417 2024-03-04T06:44:10.384 INFO:tasks.rados.rados.0.smithi137.stdout:703: oid 13 version 420 is already newer than 419 2024-03-04T06:44:10.384 INFO:tasks.rados.rados.0.smithi137.stdout:703: oid 13 version 420 is already newer than 418 2024-03-04T06:44:10.384 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 420 (ObjNum 238 snap 72 seq_num 238) dirty exists 2024-03-04T06:44:10.384 INFO:tasks.rados.rados.0.smithi137.stdout:703: left oid 13 (ObjNum 238 snap 72 seq_num 238) 2024-03-04T06:44:10.384 INFO:tasks.rados.rados.0.smithi137.stdout:706: expect (ObjNum 124 snap 34 seq_num 124) 2024-03-04T06:44:10.464 INFO:tasks.rados.rados.0.smithi137.stdout:704: expect (ObjNum 207 snap 60 seq_num 207) 2024-03-04T06:44:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:709: finishing write tid 1 to smithi13777483-30 2024-03-04T06:44:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:709: finishing write tid 2 to smithi13777483-30 2024-03-04T06:44:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:714: seq_num 241 ranges {0=442368,442368=466944,909312=688128,1597440=49152} 2024-03-04T06:44:10.550 INFO:tasks.rados.rados.0.smithi137.stdout:714: writing smithi13777483-2 from 0 to 442368 tid 1 2024-03-04T06:44:10.553 INFO:tasks.rados.rados.0.smithi137.stdout:714: writing smithi13777483-2 from 442368 to 909312 tid 2 2024-03-04T06:44:10.557 INFO:tasks.rados.rados.0.smithi137.stdout:714: writing smithi13777483-2 from 909312 to 1597440 tid 3 2024-03-04T06:44:10.558 INFO:tasks.rados.rados.0.smithi137.stdout:714: writing smithi13777483-2 from 1597440 to 1646592 tid 4 2024-03-04T06:44:10.558 INFO:tasks.rados.rados.0.smithi137.stdout:703: done (10 left) 2024-03-04T06:44:10.558 INFO:tasks.rados.rados.0.smithi137.stdout:704: done (9 left) 2024-03-04T06:44:10.558 INFO:tasks.rados.rados.0.smithi137.stdout:705: done (8 left) 2024-03-04T06:44:10.558 INFO:tasks.rados.rados.0.smithi137.stdout:706: done (7 left) 2024-03-04T06:44:10.558 INFO:tasks.rados.rados.0.smithi137.stdout:707: done (6 left) 2024-03-04T06:44:10.558 INFO:tasks.rados.rados.0.smithi137.stdout:708: done (5 left) 2024-03-04T06:44:10.558 INFO:tasks.rados.rados.0.smithi137.stdout:715: copy_from oid 40 from oid 47 current snap is 72 2024-03-04T06:44:10.559 INFO:tasks.rados.rados.0.smithi137.stdout:712: finishing write tid 1 to smithi13777483-24 2024-03-04T06:44:10.559 INFO:tasks.rados.rados.0.smithi137.stdout:709: finishing write tid 3 to smithi13777483-30 2024-03-04T06:44:10.559 INFO:tasks.rados.rados.0.smithi137.stdout:709: finishing write tid 4 to smithi13777483-30 2024-03-04T06:44:10.559 INFO:tasks.rados.rados.0.smithi137.stdout:712: finishing write tid 2 to smithi13777483-24 2024-03-04T06:44:10.559 INFO:tasks.rados.rados.0.smithi137.stdout:711: expect (ObjNum 224 snap 65 seq_num 224) 2024-03-04T06:44:10.635 INFO:tasks.rados.rados.0.smithi137.stdout:712: finishing write tid 3 to smithi13777483-24 2024-03-04T06:44:10.635 INFO:tasks.rados.rados.0.smithi137.stdout:712: finishing write tid 4 to smithi13777483-24 2024-03-04T06:44:10.636 INFO:tasks.rados.rados.0.smithi137.stdout:712: finishing write tid 5 to smithi13777483-24 2024-03-04T06:44:10.636 INFO:tasks.rados.rados.0.smithi137.stdout:712: finishing write tid 6 to smithi13777483-24 2024-03-04T06:44:10.636 INFO:tasks.rados.rados.0.smithi137.stdout:712: oid 24 updating version 0 to 134 2024-03-04T06:44:10.636 INFO:tasks.rados.rados.0.smithi137.stdout:712: oid 24 version 134 is already newer than 132 2024-03-04T06:44:10.636 INFO:tasks.rados.rados.0.smithi137.stdout:712: oid 24 version 134 is already newer than 133 2024-03-04T06:44:10.636 INFO:tasks.rados.rados.0.smithi137.stdout:712: oid 24 version 134 is already newer than 131 2024-03-04T06:44:10.636 INFO:tasks.rados.rados.0.smithi137.stdout:712: oid 24 updating version 134 to 135 2024-03-04T06:44:10.636 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 135 (ObjNum 240 snap 72 seq_num 240) dirty exists 2024-03-04T06:44:10.636 INFO:tasks.rados.rados.0.smithi137.stdout:712: left oid 24 (ObjNum 240 snap 72 seq_num 240) 2024-03-04T06:44:10.636 INFO:tasks.rados.rados.0.smithi137.stdout:710: expect (ObjNum 218 snap 63 seq_num 218) 2024-03-04T06:44:10.729 INFO:tasks.rados.rados.0.smithi137.stdout:709: finishing write tid 5 to smithi13777483-30 2024-03-04T06:44:10.729 INFO:tasks.rados.rados.0.smithi137.stdout:709: oid 30 updating version 0 to 161 2024-03-04T06:44:10.729 INFO:tasks.rados.rados.0.smithi137.stdout:709: oid 30 updating version 161 to 162 2024-03-04T06:44:10.729 INFO:tasks.rados.rados.0.smithi137.stdout:709: oid 30 updating version 162 to 163 2024-03-04T06:44:10.730 INFO:tasks.rados.rados.0.smithi137.stdout:709: oid 30 version 163 is already newer than 160 2024-03-04T06:44:10.730 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 163 (ObjNum 239 snap 72 seq_num 239) dirty exists 2024-03-04T06:44:10.730 INFO:tasks.rados.rados.0.smithi137.stdout:709: left oid 30 (ObjNum 239 snap 72 seq_num 239) 2024-03-04T06:44:10.730 INFO:tasks.rados.rados.0.smithi137.stdout:709: done (5 left) 2024-03-04T06:44:10.730 INFO:tasks.rados.rados.0.smithi137.stdout:710: done (4 left) 2024-03-04T06:44:10.730 INFO:tasks.rados.rados.0.smithi137.stdout:711: done (3 left) 2024-03-04T06:44:10.730 INFO:tasks.rados.rados.0.smithi137.stdout:712: done (2 left) 2024-03-04T06:44:10.730 INFO:tasks.rados.rados.0.smithi137.stdout:716: snap_remove snap 42 2024-03-04T06:44:10.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:10 smithi203 ceph-mon[30756]: osdmap e195: 8 total, 8 up, 8 in 2024-03-04T06:44:10.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:10 smithi203 ceph-mon[30756]: pgmap v27: 121 pgs: 121 active+clean; 209 MiB data, 791 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:10.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:10 smithi203 ceph-mon[30756]: osdmap e196: 8 total, 8 up, 8 in 2024-03-04T06:44:11.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:10 smithi137 ceph-mon[26846]: osdmap e195: 8 total, 8 up, 8 in 2024-03-04T06:44:11.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:10 smithi137 ceph-mon[26846]: pgmap v27: 121 pgs: 121 active+clean; 209 MiB data, 791 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:11.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:10 smithi137 ceph-mon[26846]: osdmap e196: 8 total, 8 up, 8 in 2024-03-04T06:44:11.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:10 smithi137 ceph-mon[37364]: osdmap e195: 8 total, 8 up, 8 in 2024-03-04T06:44:11.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:10 smithi137 ceph-mon[37364]: pgmap v27: 121 pgs: 121 active+clean; 209 MiB data, 791 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:11.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:10 smithi137 ceph-mon[37364]: osdmap e196: 8 total, 8 up, 8 in 2024-03-04T06:44:11.661 INFO:tasks.rados.rados.0.smithi137.stdout:716: done (2 left) 2024-03-04T06:44:11.661 INFO:tasks.rados.rados.0.smithi137.stdout:717: copy_from oid 23 from oid 21 current snap is 72 2024-03-04T06:44:11.661 INFO:tasks.rados.rados.0.smithi137.stdout:718: copy_from oid 14 from oid 11 current snap is 72 2024-03-04T06:44:11.661 INFO:tasks.rados.rados.0.smithi137.stdout:719: setattr oid 7 current snap is 72 2024-03-04T06:44:11.664 INFO:tasks.rados.rados.0.smithi137.stdout:714: finishing write tid 1 to smithi13777483-2 2024-03-04T06:44:11.664 INFO:tasks.rados.rados.0.smithi137.stdout:714: finishing write tid 2 to smithi13777483-2 2024-03-04T06:44:11.664 INFO:tasks.rados.rados.0.smithi137.stdout:714: finishing write tid 3 to smithi13777483-2 2024-03-04T06:44:11.664 INFO:tasks.rados.rados.0.smithi137.stdout:714: finishing write tid 4 to smithi13777483-2 2024-03-04T06:44:11.664 INFO:tasks.rados.rados.0.smithi137.stdout:714: finishing write tid 5 to smithi13777483-2 2024-03-04T06:44:11.664 INFO:tasks.rados.rados.0.smithi137.stdout:714: finishing write tid 6 to smithi13777483-2 2024-03-04T06:44:11.664 INFO:tasks.rados.rados.0.smithi137.stdout:714: oid 2 updating version 0 to 130 2024-03-04T06:44:11.664 INFO:tasks.rados.rados.0.smithi137.stdout:714: oid 2 updating version 130 to 131 2024-03-04T06:44:11.664 INFO:tasks.rados.rados.0.smithi137.stdout:714: oid 2 updating version 131 to 134 2024-03-04T06:44:11.664 INFO:tasks.rados.rados.0.smithi137.stdout:714: oid 2 version 134 is already newer than 133 2024-03-04T06:44:11.664 INFO:tasks.rados.rados.0.smithi137.stdout:714: oid 2 version 134 is already newer than 132 2024-03-04T06:44:11.665 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 134 (ObjNum 241 snap 72 seq_num 241) dirty exists 2024-03-04T06:44:11.665 INFO:tasks.rados.rados.0.smithi137.stdout:714: left oid 2 (ObjNum 241 snap 72 seq_num 241) 2024-03-04T06:44:11.665 INFO:tasks.rados.rados.0.smithi137.stdout:715: finishing copy_from racing read to smithi13777483-40 2024-03-04T06:44:11.665 INFO:tasks.rados.rados.0.smithi137.stdout:715: finishing copy_from to smithi13777483-40 2024-03-04T06:44:11.665 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 348 (ObjNum 207 snap 60 seq_num 207) dirty exists 2024-03-04T06:44:11.665 INFO:tasks.rados.rados.0.smithi137.stdout:714: done (4 left) 2024-03-04T06:44:11.665 INFO:tasks.rados.rados.0.smithi137.stdout:715: done (3 left) 2024-03-04T06:44:11.665 INFO:tasks.rados.rados.0.smithi137.stdout:720: setattr oid 33 current snap is 72 2024-03-04T06:44:11.666 INFO:tasks.rados.rados.0.smithi137.stdout:721: snap_create 2024-03-04T06:44:11.668 INFO:tasks.rados.rados.0.smithi137.stdout:718: finishing copy_from to smithi13777483-14 2024-03-04T06:44:11.668 INFO:tasks.rados.rados.0.smithi137.stdout:718: got expected ENOENT (src dne) 2024-03-04T06:44:11.668 INFO:tasks.rados.rados.0.smithi137.stdout:718: finishing copy_from racing read to smithi13777483-14 2024-03-04T06:44:11.670 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 115 (ObjNum 237 snap 71 seq_num 237) dirty exists 2024-03-04T06:44:11.671 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 260 (ObjNum 231 snap 66 seq_num 231) dirty exists 2024-03-04T06:44:11.678 INFO:tasks.rados.rados.0.smithi137.stdout:717: finishing copy_from racing read to smithi13777483-23 2024-03-04T06:44:11.679 INFO:tasks.rados.rados.0.smithi137.stdout:717: finishing copy_from to smithi13777483-23 2024-03-04T06:44:11.679 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 278 (ObjNum 188 snap 50 seq_num 188) dirty exists 2024-03-04T06:44:12.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:11 smithi137 ceph-mon[26846]: Upgrade: Updating mgr.x 2024-03-04T06:44:12.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:11 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:44:12.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:11 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:44:12.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:11 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:44:12.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:11 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:12.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:11 smithi137 ceph-mon[26846]: Deploying daemon mgr.x on smithi203 2024-03-04T06:44:12.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:11 smithi137 ceph-mon[37364]: Upgrade: Updating mgr.x 2024-03-04T06:44:12.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:11 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:44:12.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:11 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:44:12.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:11 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:44:12.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:11 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:12.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:11 smithi137 ceph-mon[37364]: Deploying daemon mgr.x on smithi203 2024-03-04T06:44:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:11 smithi203 ceph-mon[30756]: Upgrade: Updating mgr.x 2024-03-04T06:44:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:11 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:44:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:11 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:44:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:11 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:44:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:11 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:12.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:11 smithi203 ceph-mon[30756]: Deploying daemon mgr.x on smithi203 2024-03-04T06:44:12.505 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:44:12.667 INFO:tasks.rados.rados.0.smithi137.stdout:717: done (4 left) 2024-03-04T06:44:12.668 INFO:tasks.rados.rados.0.smithi137.stdout:718: done (3 left) 2024-03-04T06:44:12.668 INFO:tasks.rados.rados.0.smithi137.stdout:719: done (2 left) 2024-03-04T06:44:12.668 INFO:tasks.rados.rados.0.smithi137.stdout:720: done (1 left) 2024-03-04T06:44:12.668 INFO:tasks.rados.rados.0.smithi137.stdout:721: done (0 left) 2024-03-04T06:44:12.668 INFO:tasks.rados.rados.0.smithi137.stdout:722: rollback oid 27 current snap is 73 2024-03-04T06:44:12.668 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 27 to 26 2024-03-04T06:44:12.668 INFO:tasks.rados.rados.0.smithi137.stdout:723: snap_remove snap 53 2024-03-04T06:44:12.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:12 smithi137 ceph-mon[26846]: osdmap e197: 8 total, 8 up, 8 in 2024-03-04T06:44:12.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:12 smithi137 ceph-mon[26846]: pgmap v30: 121 pgs: 121 active+clean; 221 MiB data, 820 MiB used, 714 GiB / 715 GiB avail; 9.5 MiB/s rd, 3.0 MiB/s wr, 22 op/s 2024-03-04T06:44:12.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:12 smithi137 ceph-mon[37364]: osdmap e197: 8 total, 8 up, 8 in 2024-03-04T06:44:12.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:12 smithi137 ceph-mon[37364]: pgmap v30: 121 pgs: 121 active+clean; 221 MiB data, 820 MiB used, 714 GiB / 715 GiB avail; 9.5 MiB/s rd, 3.0 MiB/s wr, 22 op/s 2024-03-04T06:44:12.823 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (4m) 14s ago 4m 27.7M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (4m) 14s ago 4m 87.9M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (6m) 14s ago 6m 17.4M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (6m) 14s ago 6m 17.4M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (69s) 14s ago 9m 72.7M - 19.0.0-1791-gefb04e5e 0c401cd3e778 8fd5e9ed1e80 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (28s) 14s ago 11m 473M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (11m) 14s ago 11m 57.6M 2048M 18.2.1-696-g5cc7a767 540557f94930 0279ece55dcc 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (9m) 14s ago 9m 51.4M 2048M 18.2.1-696-g5cc7a767 540557f94930 c1087568a246 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (9m) 14s ago 9m 46.0M 2048M 18.2.1-696-g5cc7a767 540557f94930 63f51a40232d 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (4m) 14s ago 4m 16.4M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (4m) 14s ago 4m 15.5M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (9m) 14s ago 9m 119M 2480M 18.2.1-696-g5cc7a767 540557f94930 732ea50ff558 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (8m) 14s ago 8m 119M 2480M 18.2.1-696-g5cc7a767 540557f94930 708139c858a7 2024-03-04T06:44:12.824 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (8m) 14s ago 8m 134M 2480M 18.2.1-696-g5cc7a767 540557f94930 b247adf81a73 2024-03-04T06:44:12.825 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (7m) 14s ago 7m 76.3M 2480M 18.2.1-696-g5cc7a767 540557f94930 afdbc25c9fba 2024-03-04T06:44:12.825 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (7m) 14s ago 7m 127M 2480M 18.2.1-696-g5cc7a767 540557f94930 d4841ffd0747 2024-03-04T06:44:12.825 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (7m) 14s ago 7m 143M 2480M 18.2.1-696-g5cc7a767 540557f94930 81d21771e157 2024-03-04T06:44:12.825 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (6m) 14s ago 6m 75.3M 2480M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:44:12.825 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (6m) 14s ago 6m 97.6M 2480M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:44:12.825 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 starting - - - - 2024-03-04T06:44:12.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:12 smithi203 ceph-mon[30756]: osdmap e197: 8 total, 8 up, 8 in 2024-03-04T06:44:12.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:12 smithi203 ceph-mon[30756]: pgmap v30: 121 pgs: 121 active+clean; 221 MiB data, 820 MiB used, 714 GiB / 715 GiB avail; 9.5 MiB/s rd, 3.0 MiB/s wr, 22 op/s 2024-03-04T06:44:12.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:12 smithi203 systemd[1]: Stopping Ceph mgr.x for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:44:13.202 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:12 smithi203 podman[76827]: 2024-03-04 06:44:12.881856226 +0000 UTC m=+0.149410530 container died 8fd5e9ed1e809d346c935ac9af204f01e6734dd562603bb7c3417c2510aae936 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-04T06:44:13.214 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:44:13.214 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:44:13.214 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 3 2024-03-04T06:44:13.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:44:13.214 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:44:13.214 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:44:13.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:44:13.214 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:44:13.214 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 8 2024-03-04T06:44:13.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:44:13.215 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:44:13.215 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:44:13.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:44:13.215 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:44:13.215 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 13, 2024-03-04T06:44:13.215 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:44:13.215 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:44:13.215 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:44:13.494 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:13 smithi203 podman[76827]: 2024-03-04 06:44:13.276724537 +0000 UTC m=+0.544278849 container cleanup 8fd5e9ed1e809d346c935ac9af204f01e6734dd562603bb7c3417c2510aae936 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-04T06:44:13.494 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:13 smithi203 bash[76827]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x 2024-03-04T06:44:13.675 INFO:tasks.rados.rados.0.smithi137.stdout:723: done (1 left) 2024-03-04T06:44:13.675 INFO:tasks.rados.rados.0.smithi137.stdout:724: copy_from oid 11 from oid 41 current snap is 73 2024-03-04T06:44:13.675 INFO:tasks.rados.rados.0.smithi137.stdout:722: finishing rollback tid 0 to smithi13777483-27 2024-03-04T06:44:13.675 INFO:tasks.rados.rados.0.smithi137.stdout:722: finishing rollback tid 1 to smithi13777483-27 2024-03-04T06:44:13.675 INFO:tasks.rados.rados.0.smithi137.stdout:722: finishing rollback tid 2 to smithi13777483-27 2024-03-04T06:44:13.676 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 440 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-03-04T06:44:13.676 INFO:tasks.rados.rados.0.smithi137.stdout:722: done (1 left) 2024-03-04T06:44:13.676 INFO:tasks.rados.rados.0.smithi137.stdout:725: copy_from oid 46 from oid 17 current snap is 73 2024-03-04T06:44:13.676 INFO:tasks.rados.rados.0.smithi137.stdout:726: delete oid 29 current snap is 73 2024-03-04T06:44:13.680 INFO:tasks.rados.rados.0.smithi137.stdout:725: finishing copy_from racing read to smithi13777483-46 2024-03-04T06:44:13.682 INFO:tasks.rados.rados.0.smithi137.stdout:725: finishing copy_from to smithi13777483-46 2024-03-04T06:44:13.682 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 235 (ObjNum 177 snap 0 seq_num 1) dirty exists 2024-03-04T06:44:13.683 INFO:tasks.rados.rados.0.smithi137.stdout:725: done (2 left) 2024-03-04T06:44:13.683 INFO:tasks.rados.rados.0.smithi137.stdout:726: done (1 left) 2024-03-04T06:44:13.683 INFO:tasks.rados.rados.0.smithi137.stdout:727: snap_remove snap 65 2024-03-04T06:44:13.820 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:13 smithi203 ceph-mon[30756]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:44:13.820 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:13 smithi203 ceph-mon[30756]: osdmap e198: 8 total, 8 up, 8 in 2024-03-04T06:44:13.820 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:13 smithi203 ceph-mon[30756]: from='client.25157 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:44:13.820 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:13 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/3382031181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:44:13.820 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:13 smithi203 podman[76841]: 2024-03-04 06:44:13.494723824 +0000 UTC m=+0.615966353 container remove 8fd5e9ed1e809d346c935ac9af204f01e6734dd562603bb7c3417c2510aae936 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-04T06:44:13.820 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:13 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-03-04T06:44:13.820 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:13 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-03-04T06:44:13.821 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:13 smithi203 systemd[1]: Stopped Ceph mgr.x for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:44:13.821 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:13 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.x.service: Consumed 24.769s CPU time. 2024-03-04T06:44:14.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:13 smithi137 ceph-mon[26846]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:44:14.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:13 smithi137 ceph-mon[26846]: osdmap e198: 8 total, 8 up, 8 in 2024-03-04T06:44:14.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:13 smithi137 ceph-mon[26846]: from='client.25157 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:44:14.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:13 smithi137 ceph-mon[26846]: from='client.? 172.21.15.137:0/3382031181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:44:14.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:13 smithi137 ceph-mon[37364]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:44:14.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:13 smithi137 ceph-mon[37364]: osdmap e198: 8 total, 8 up, 8 in 2024-03-04T06:44:14.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:13 smithi137 ceph-mon[37364]: from='client.25157 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:44:14.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:13 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/3382031181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:44:14.071 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:13 smithi203 systemd[1]: Starting Ceph mgr.x for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:44:14.071 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:14 smithi203 podman[76971]: 2024-03-04 06:44:13.940978103 +0000 UTC m=+0.018079234 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:44:14.071 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:14 smithi203 podman[76971]: 2024-03-04 06:44:14.071695083 +0000 UTC m=+0.148796199 container create 48c66fe4203a361f45daa52874f1d7c1f89d7c9a1319b8f77643c8df2393aea0 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-04T06:44:14.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:14 smithi203 podman[76971]: 2024-03-04 06:44:14.291289039 +0000 UTC m=+0.368390159 container init 48c66fe4203a361f45daa52874f1d7c1f89d7c9a1319b8f77643c8df2393aea0 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=) 2024-03-04T06:44:14.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:14 smithi203 podman[76971]: 2024-03-04 06:44:14.293948867 +0000 UTC m=+0.371049987 container start 48c66fe4203a361f45daa52874f1d7c1f89d7c9a1319b8f77643c8df2393aea0 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-04T06:44:14.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:14 smithi203 ceph-mgr[76990]: -- 172.21.15.203:0/3920489030 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55be8d1d25a0 con 0x55be8d1a6800 2024-03-04T06:44:14.674 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:14 smithi203 bash[76971]: 48c66fe4203a361f45daa52874f1d7c1f89d7c9a1319b8f77643c8df2393aea0 2024-03-04T06:44:14.674 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:14 smithi203 systemd[1]: Started Ceph mgr.x for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:44:14.679 INFO:tasks.rados.rados.0.smithi137.stdout:724: finishing copy_from racing read to smithi13777483-11 2024-03-04T06:44:14.679 INFO:tasks.rados.rados.0.smithi137.stdout:724: finishing copy_from to smithi13777483-11 2024-03-04T06:44:14.679 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 117 (ObjNum 219 snap 63 seq_num 219) dirty exists 2024-03-04T06:44:14.680 INFO:tasks.rados.rados.0.smithi137.stdout:724: done (1 left) 2024-03-04T06:44:14.680 INFO:tasks.rados.rados.0.smithi137.stdout:727: done (0 left) 2024-03-04T06:44:14.680 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 73 2024-03-04T06:44:14.680 INFO:tasks.rados.rados.0.smithi137.stdout:728: seq_num 243 ranges {2482176=475136,2957312=638976,3596288=565248} 2024-03-04T06:44:14.696 INFO:tasks.rados.rados.0.smithi137.stdout:728: writing smithi13777483-31 from 2482176 to 2957312 tid 1 2024-03-04T06:44:14.700 INFO:tasks.rados.rados.0.smithi137.stdout:728: writing smithi13777483-31 from 2957312 to 3596288 tid 2 2024-03-04T06:44:14.703 INFO:tasks.rados.rados.0.smithi137.stdout:728: writing smithi13777483-31 from 3596288 to 4161536 tid 3 2024-03-04T06:44:14.703 INFO:tasks.rados.rados.0.smithi137.stdout:729: delete oid 29 current snap is 73 2024-03-04T06:44:14.703 INFO:tasks.rados.rados.0.smithi137.stdout:728: finishing write tid 1 to smithi13777483-31 2024-03-04T06:44:14.703 INFO:tasks.rados.rados.0.smithi137.stdout:728: finishing write tid 2 to smithi13777483-31 2024-03-04T06:44:14.704 INFO:tasks.rados.rados.0.smithi137.stdout:729: done (1 left) 2024-03-04T06:44:14.704 INFO:tasks.rados.rados.0.smithi137.stdout:730: snap_remove snap 37 2024-03-04T06:44:14.984 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:14.879+0000 7f805f421200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T06:44:14.984 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:14 smithi203 ceph-mon[30756]: osdmap e199: 8 total, 8 up, 8 in 2024-03-04T06:44:14.984 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:14 smithi203 ceph-mon[30756]: pgmap v33: 121 pgs: 121 active+clean; 221 MiB data, 820 MiB used, 714 GiB / 715 GiB avail; 9.5 MiB/s rd, 3.0 MiB/s wr, 22 op/s 2024-03-04T06:44:14.984 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:14 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:14.984 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:14 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:14.985 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:14 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:15.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:14 smithi137 ceph-mon[26846]: osdmap e199: 8 total, 8 up, 8 in 2024-03-04T06:44:15.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:14 smithi137 ceph-mon[26846]: pgmap v33: 121 pgs: 121 active+clean; 221 MiB data, 820 MiB used, 714 GiB / 715 GiB avail; 9.5 MiB/s rd, 3.0 MiB/s wr, 22 op/s 2024-03-04T06:44:15.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:14 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:15.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:14 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:15.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:14 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:15.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:14 smithi137 ceph-mon[37364]: osdmap e199: 8 total, 8 up, 8 in 2024-03-04T06:44:15.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:14 smithi137 ceph-mon[37364]: pgmap v33: 121 pgs: 121 active+clean; 221 MiB data, 820 MiB used, 714 GiB / 715 GiB avail; 9.5 MiB/s rd, 3.0 MiB/s wr, 22 op/s 2024-03-04T06:44:15.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:14 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:15.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:14 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:15.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:14 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:15.345 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:14.983+0000 7f805f421200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T06:44:15.674 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:44:15] "GET /metrics HTTP/1.1" 200 36001 "" "Prometheus/2.43.0" 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:728: finishing write tid 3 to smithi13777483-31 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:728: finishing write tid 4 to smithi13777483-31 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:728: finishing write tid 5 to smithi13777483-31 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:728: oid 31 updating version 0 to 269 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:728: oid 31 updating version 269 to 270 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:728: oid 31 updating version 270 to 271 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:728: oid 31 version 271 is already newer than 268 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 271 (ObjNum 243 snap 73 seq_num 243) dirty exists 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:728: left oid 31 (ObjNum 243 snap 73 seq_num 243) 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:728: done (1 left) 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:730: done (0 left) 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:731: read oid 14 snap -1 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:731: expect (ObjNum 186 snap 50 seq_num 186) 2024-03-04T06:44:15.685 INFO:tasks.rados.rados.0.smithi137.stdout:732: snap_remove snap 45 2024-03-04T06:44:15.952 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:15 smithi203 ceph-mon[30756]: osdmap e200: 8 total, 8 up, 8 in 2024-03-04T06:44:15.952 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:15 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:15.952 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:15 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:15.952 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:15.699+0000 7f805f421200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T06:44:15.952 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:15.800+0000 7f805f421200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T06:44:16.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:15 smithi137 ceph-mon[37364]: osdmap e200: 8 total, 8 up, 8 in 2024-03-04T06:44:16.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:15 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:16.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:15 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:16.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:15 smithi137 ceph-mon[26846]: osdmap e200: 8 total, 8 up, 8 in 2024-03-04T06:44:16.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:15 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:16.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:15 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:16.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:15.952+0000 7f805f421200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T06:44:16.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:16.049+0000 7f805f421200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T06:44:16.346 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:16.135+0000 7f805f421200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T06:44:16.685 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:16.412+0000 7f805f421200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T06:44:16.685 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:16.523+0000 7f805f421200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T06:44:16.685 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:16.615+0000 7f805f421200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T06:44:16.689 INFO:tasks.rados.rados.0.smithi137.stdout:732: done (1 left) 2024-03-04T06:44:16.689 INFO:tasks.rados.rados.0.smithi137.stdout:733: read oid 32 snap -1 2024-03-04T06:44:16.689 INFO:tasks.rados.rados.0.smithi137.stdout:733: expect (ObjNum 217 snap 63 seq_num 217) 2024-03-04T06:44:16.690 INFO:tasks.rados.rados.0.smithi137.stdout:734: rollback oid 45 current snap is 73 2024-03-04T06:44:16.690 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 45 to 62 2024-03-04T06:44:16.690 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 73 2024-03-04T06:44:16.690 INFO:tasks.rados.rados.0.smithi137.stdout:735: seq_num 245 ranges {0=507904,507904=458752,966656=671744,1638400=73728} 2024-03-04T06:44:16.693 INFO:tasks.rados.rados.0.smithi137.stdout:735: writing smithi13777483-3 from 0 to 507904 tid 1 2024-03-04T06:44:16.697 INFO:tasks.rados.rados.0.smithi137.stdout:735: writing smithi13777483-3 from 507904 to 966656 tid 2 2024-03-04T06:44:16.701 INFO:tasks.rados.rados.0.smithi137.stdout:735: writing smithi13777483-3 from 966656 to 1638400 tid 3 2024-03-04T06:44:16.702 INFO:tasks.rados.rados.0.smithi137.stdout:735: writing smithi13777483-3 from 1638400 to 1712128 tid 4 2024-03-04T06:44:16.702 INFO:tasks.rados.rados.0.smithi137.stdout:731: expect (ObjNum 186 snap 50 seq_num 186) 2024-03-04T06:44:16.917 INFO:tasks.rados.rados.0.smithi137.stdout:734: finishing rollback tid 0 to smithi13777483-45 2024-03-04T06:44:16.917 INFO:tasks.rados.rados.0.smithi137.stdout:734: finishing rollback tid 1 to smithi13777483-45 2024-03-04T06:44:16.917 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 151 (ObjNum 1345 snap 0 seq_num 3130750032) dirty dne 2024-03-04T06:44:16.917 INFO:tasks.rados.rados.0.smithi137.stdout:731: done (3 left) 2024-03-04T06:44:16.917 INFO:tasks.rados.rados.0.smithi137.stdout:734: done (2 left) 2024-03-04T06:44:16.917 INFO:tasks.rados.rados.0.smithi137.stdout:736: read oid 21 snap -1 2024-03-04T06:44:16.917 INFO:tasks.rados.rados.0.smithi137.stdout:736: expect (ObjNum 188 snap 50 seq_num 188) 2024-03-04T06:44:16.917 INFO:tasks.rados.rados.0.smithi137.stdout:737: delete oid 10 current snap is 73 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:735: finishing write tid 1 to smithi13777483-3 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:735: finishing write tid 2 to smithi13777483-3 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:735: finishing write tid 3 to smithi13777483-3 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:735: finishing write tid 4 to smithi13777483-3 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:735: finishing write tid 5 to smithi13777483-3 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:735: finishing write tid 6 to smithi13777483-3 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:735: oid 3 updating version 0 to 376 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:735: oid 3 version 376 is already newer than 370 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:735: oid 3 version 376 is already newer than 369 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:735: oid 3 updating version 376 to 377 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:735: oid 3 version 377 is already newer than 375 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 377 (ObjNum 245 snap 73 seq_num 245) dirty exists 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:735: left oid 3 (ObjNum 245 snap 73 seq_num 245) 2024-03-04T06:44:16.918 INFO:tasks.rados.rados.0.smithi137.stdout:733: expect (ObjNum 217 snap 63 seq_num 217) 2024-03-04T06:44:17.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:16 smithi137 ceph-mon[26846]: osdmap e201: 8 total, 8 up, 8 in 2024-03-04T06:44:17.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:16 smithi137 ceph-mon[26846]: pgmap v36: 121 pgs: 121 active+clean; 228 MiB data, 875 MiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 1.8 MiB/s wr, 15 op/s 2024-03-04T06:44:17.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:16 smithi137 ceph-mon[37364]: osdmap e201: 8 total, 8 up, 8 in 2024-03-04T06:44:17.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:16 smithi137 ceph-mon[37364]: pgmap v36: 121 pgs: 121 active+clean; 228 MiB data, 875 MiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 1.8 MiB/s wr, 15 op/s 2024-03-04T06:44:17.046 INFO:tasks.rados.rados.0.smithi137.stdout:736: expect (ObjNum 188 snap 50 seq_num 188) 2024-03-04T06:44:17.070 INFO:tasks.rados.rados.0.smithi137.stdout:733: done (3 left) 2024-03-04T06:44:17.071 INFO:tasks.rados.rados.0.smithi137.stdout:735: done (2 left) 2024-03-04T06:44:17.071 INFO:tasks.rados.rados.0.smithi137.stdout:736: done (1 left) 2024-03-04T06:44:17.071 INFO:tasks.rados.rados.0.smithi137.stdout:737: done (0 left) 2024-03-04T06:44:17.071 INFO:tasks.rados.rados.0.smithi137.stdout:738: setattr oid 25 current snap is 73 2024-03-04T06:44:17.072 INFO:tasks.rados.rados.0.smithi137.stdout:739: rmattr oid 30 current snap is 73 2024-03-04T06:44:17.072 INFO:tasks.rados.rados.0.smithi137.stdout:740: setattr oid 20 current snap is 73 2024-03-04T06:44:17.073 INFO:tasks.rados.rados.0.smithi137.stdout:741: delete oid 10 current snap is 73 2024-03-04T06:44:17.075 INFO:tasks.rados.rados.0.smithi137.stdout:741: done (3 left) 2024-03-04T06:44:17.075 INFO:tasks.rados.rados.0.smithi137.stdout:742: copy_from oid 6 from oid 44 current snap is 73 2024-03-04T06:44:17.075 INFO:tasks.rados.rados.0.smithi137.stdout:743: read oid 39 snap -1 2024-03-04T06:44:17.075 INFO:tasks.rados.rados.0.smithi137.stdout:743: expect (ObjNum 219 snap 63 seq_num 219) 2024-03-04T06:44:17.075 INFO:tasks.rados.rados.0.smithi137.stdout:744: setattr oid 45 current snap is 73 2024-03-04T06:44:17.076 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 185 (ObjNum 239 snap 72 seq_num 239) dirty exists 2024-03-04T06:44:17.076 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 384 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:44:17.077 INFO:tasks.rados.rados.0.smithi137.stdout:738: done (5 left) 2024-03-04T06:44:17.077 INFO:tasks.rados.rados.0.smithi137.stdout:739: done (4 left) 2024-03-04T06:44:17.077 INFO:tasks.rados.rados.0.smithi137.stdout:745: rollback oid 29 current snap is 73 2024-03-04T06:44:17.077 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 29 to 69 2024-03-04T06:44:17.077 INFO:tasks.rados.rados.0.smithi137.stdout:746: copy_from oid 9 from oid 37 current snap is 73 2024-03-04T06:44:17.077 INFO:tasks.rados.rados.0.smithi137.stdout:747: read oid 36 snap -1 2024-03-04T06:44:17.077 INFO:tasks.rados.rados.0.smithi137.stdout:747: expect (ObjNum 227 snap 65 seq_num 227) 2024-03-04T06:44:17.078 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 73 2024-03-04T06:44:17.078 INFO:tasks.rados.rados.0.smithi137.stdout:748: seq_num 248 ranges {2564096=557056,3121152=507904,3629056=442368,4071424=253952} 2024-03-04T06:44:17.094 INFO:tasks.rados.rados.0.smithi137.stdout:748: writing smithi13777483-12 from 2564096 to 3121152 tid 1 2024-03-04T06:44:17.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:16 smithi203 ceph-mon[30756]: osdmap e201: 8 total, 8 up, 8 in 2024-03-04T06:44:17.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:16 smithi203 ceph-mon[30756]: pgmap v36: 121 pgs: 121 active+clean; 228 MiB data, 875 MiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 1.8 MiB/s wr, 15 op/s 2024-03-04T06:44:17.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:16.729+0000 7f805f421200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T06:44:17.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:16.908+0000 7f805f421200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T06:44:17.097 INFO:tasks.rados.rados.0.smithi137.stdout:748: writing smithi13777483-12 from 3121152 to 3629056 tid 2 2024-03-04T06:44:17.100 INFO:tasks.rados.rados.0.smithi137.stdout:748: writing smithi13777483-12 from 3629056 to 4071424 tid 3 2024-03-04T06:44:17.102 INFO:tasks.rados.rados.0.smithi137.stdout:748: writing smithi13777483-12 from 4071424 to 4325376 tid 4 2024-03-04T06:44:17.102 INFO:tasks.rados.rados.0.smithi137.stdout:749: read oid 32 snap -1 2024-03-04T06:44:17.102 INFO:tasks.rados.rados.0.smithi137.stdout:749: expect (ObjNum 217 snap 63 seq_num 217) 2024-03-04T06:44:17.102 INFO:tasks.rados.rados.0.smithi137.stdout:750: snap_remove snap 61 2024-03-04T06:44:17.697 INFO:tasks.rados.rados.0.smithi137.stdout:750: done (9 left) 2024-03-04T06:44:17.697 INFO:tasks.rados.rados.0.smithi137.stdout:751: snap_create 2024-03-04T06:44:17.697 INFO:tasks.rados.rados.0.smithi137.stdout:745: finishing rollback tid 1 to smithi13777483-29 2024-03-04T06:44:17.697 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 279 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-03-04T06:44:17.697 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 152 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:44:17.697 INFO:tasks.rados.rados.0.smithi137.stdout:745: finishing rollback tid 2 to smithi13777483-29 2024-03-04T06:44:17.697 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 256 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-04T06:44:17.697 INFO:tasks.rados.rados.0.smithi137.stdout:747: expect (ObjNum 227 snap 65 seq_num 227) 2024-03-04T06:44:17.754 INFO:tasks.rados.rados.0.smithi137.stdout:743: expect (ObjNum 219 snap 63 seq_num 219) 2024-03-04T06:44:17.790 INFO:tasks.rados.rados.0.smithi137.stdout:742: finishing copy_from racing read to smithi13777483-6 2024-03-04T06:44:17.790 INFO:tasks.rados.rados.0.smithi137.stdout:742: finishing copy_from to smithi13777483-6 2024-03-04T06:44:17.791 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 242 (ObjNum 216 snap 63 seq_num 216) dirty exists 2024-03-04T06:44:17.791 INFO:tasks.rados.rados.0.smithi137.stdout:748: finishing write tid 1 to smithi13777483-12 2024-03-04T06:44:17.791 INFO:tasks.rados.rados.0.smithi137.stdout:748: finishing write tid 2 to smithi13777483-12 2024-03-04T06:44:17.791 INFO:tasks.rados.rados.0.smithi137.stdout:746: finishing copy_from racing read to smithi13777483-9 2024-03-04T06:44:17.791 INFO:tasks.rados.rados.0.smithi137.stdout:746: finishing copy_from to smithi13777483-9 2024-03-04T06:44:17.791 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 200 (ObjNum 169 snap 47 seq_num 169) dirty exists 2024-03-04T06:44:17.791 INFO:tasks.rados.rados.0.smithi137.stdout:748: finishing write tid 3 to smithi13777483-12 2024-03-04T06:44:17.791 INFO:tasks.rados.rados.0.smithi137.stdout:748: finishing write tid 4 to smithi13777483-12 2024-03-04T06:44:17.791 INFO:tasks.rados.rados.0.smithi137.stdout:748: finishing write tid 5 to smithi13777483-12 2024-03-04T06:44:17.791 INFO:tasks.rados.rados.0.smithi137.stdout:748: finishing write tid 6 to smithi13777483-12 2024-03-04T06:44:17.791 INFO:tasks.rados.rados.0.smithi137.stdout:748: oid 12 updating version 0 to 190 2024-03-04T06:44:17.791 INFO:tasks.rados.rados.0.smithi137.stdout:748: oid 12 version 190 is already newer than 189 2024-03-04T06:44:17.791 INFO:tasks.rados.rados.0.smithi137.stdout:748: oid 12 version 190 is already newer than 188 2024-03-04T06:44:17.792 INFO:tasks.rados.rados.0.smithi137.stdout:748: oid 12 updating version 190 to 191 2024-03-04T06:44:17.792 INFO:tasks.rados.rados.0.smithi137.stdout:748: oid 12 version 191 is already newer than 187 2024-03-04T06:44:17.792 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 191 (ObjNum 248 snap 73 seq_num 248) dirty exists 2024-03-04T06:44:17.792 INFO:tasks.rados.rados.0.smithi137.stdout:748: left oid 12 (ObjNum 248 snap 73 seq_num 248) 2024-03-04T06:44:17.792 INFO:tasks.rados.rados.0.smithi137.stdout:749: expect (ObjNum 217 snap 63 seq_num 217) 2024-03-04T06:44:17.970 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:17 smithi203 ceph-mon[30756]: osdmap e202: 8 total, 8 up, 8 in 2024-03-04T06:44:18.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:17 smithi137 ceph-mon[26846]: osdmap e202: 8 total, 8 up, 8 in 2024-03-04T06:44:18.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:17 smithi137 ceph-mon[37364]: osdmap e202: 8 total, 8 up, 8 in 2024-03-04T06:44:18.329 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:17.970+0000 7f805f421200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T06:44:18.329 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:18.103+0000 7f805f421200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T06:44:18.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:18.459+0000 7f805f421200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T06:44:18.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:18.553+0000 7f805f421200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T06:44:18.699 INFO:tasks.rados.rados.0.smithi137.stdout:740: done (9 left) 2024-03-04T06:44:18.700 INFO:tasks.rados.rados.0.smithi137.stdout:742: done (8 left) 2024-03-04T06:44:18.700 INFO:tasks.rados.rados.0.smithi137.stdout:743: done (7 left) 2024-03-04T06:44:18.700 INFO:tasks.rados.rados.0.smithi137.stdout:744: done (6 left) 2024-03-04T06:44:18.700 INFO:tasks.rados.rados.0.smithi137.stdout:745: done (5 left) 2024-03-04T06:44:18.700 INFO:tasks.rados.rados.0.smithi137.stdout:746: done (4 left) 2024-03-04T06:44:18.700 INFO:tasks.rados.rados.0.smithi137.stdout:747: done (3 left) 2024-03-04T06:44:18.700 INFO:tasks.rados.rados.0.smithi137.stdout:748: done (2 left) 2024-03-04T06:44:18.700 INFO:tasks.rados.rados.0.smithi137.stdout:749: done (1 left) 2024-03-04T06:44:18.700 INFO:tasks.rados.rados.0.smithi137.stdout:751: done (0 left) 2024-03-04T06:44:18.700 INFO:tasks.rados.rados.0.smithi137.stdout:752: rollback oid 21 current snap is 74 2024-03-04T06:44:18.700 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 21 to 68 2024-03-04T06:44:18.700 INFO:tasks.rados.rados.0.smithi137.stdout:753: copy_from oid 28 from oid 37 current snap is 74 2024-03-04T06:44:18.700 INFO:tasks.rados.rados.0.smithi137.stdout:754: delete oid 1 current snap is 74 2024-03-04T06:44:18.701 INFO:tasks.rados.rados.0.smithi137.stdout:754: done (2 left) 2024-03-04T06:44:18.701 INFO:tasks.rados.rados.0.smithi137.stdout:755: delete oid 20 current snap is 74 2024-03-04T06:44:18.705 INFO:tasks.rados.rados.0.smithi137.stdout:752: finishing rollback tid 0 to smithi13777483-21 2024-03-04T06:44:18.706 INFO:tasks.rados.rados.0.smithi137.stdout:755: done (2 left) 2024-03-04T06:44:18.707 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 50 current snap is 74 2024-03-04T06:44:18.707 INFO:tasks.rados.rados.0.smithi137.stdout:756: seq_num 251 ranges {2531328=606208,3137536=614400,3751936=589824} 2024-03-04T06:44:18.724 INFO:tasks.rados.rados.0.smithi137.stdout:756: writing smithi13777483-50 from 2531328 to 3137536 tid 1 2024-03-04T06:44:18.728 INFO:tasks.rados.rados.0.smithi137.stdout:756: writing smithi13777483-50 from 3137536 to 3751936 tid 2 2024-03-04T06:44:18.731 INFO:tasks.rados.rados.0.smithi137.stdout:756: writing smithi13777483-50 from 3751936 to 4341760 tid 3 2024-03-04T06:44:18.732 INFO:tasks.rados.rados.0.smithi137.stdout:757: rmattr oid 44 current snap is 74 2024-03-04T06:44:18.732 INFO:tasks.rados.rados.0.smithi137.stdout:752: finishing rollback tid 1 to smithi13777483-21 2024-03-04T06:44:18.732 INFO:tasks.rados.rados.0.smithi137.stdout:752: finishing rollback tid 2 to smithi13777483-21 2024-03-04T06:44:18.732 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 392 (ObjNum 188 snap 50 seq_num 188) dirty exists 2024-03-04T06:44:18.732 INFO:tasks.rados.rados.0.smithi137.stdout:753: finishing copy_from racing read to smithi13777483-28 2024-03-04T06:44:18.732 INFO:tasks.rados.rados.0.smithi137.stdout:753: finishing copy_from to smithi13777483-28 2024-03-04T06:44:18.732 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 200 (ObjNum 169 snap 47 seq_num 169) dirty exists 2024-03-04T06:44:18.732 INFO:tasks.rados.rados.0.smithi137.stdout:756: finishing write tid 1 to smithi13777483-50 2024-03-04T06:44:18.732 INFO:tasks.rados.rados.0.smithi137.stdout:756: finishing write tid 2 to smithi13777483-50 2024-03-04T06:44:18.732 INFO:tasks.rados.rados.0.smithi137.stdout:752: done (3 left) 2024-03-04T06:44:18.732 INFO:tasks.rados.rados.0.smithi137.stdout:753: done (2 left) 2024-03-04T06:44:18.732 INFO:tasks.rados.rados.0.smithi137.stdout:758: snap_create 2024-03-04T06:44:18.733 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 243 (ObjNum 216 snap 63 seq_num 216) dirty exists 2024-03-04T06:44:18.734 INFO:tasks.rados.rados.0.smithi137.stdout:756: finishing write tid 3 to smithi13777483-50 2024-03-04T06:44:18.734 INFO:tasks.rados.rados.0.smithi137.stdout:756: finishing write tid 4 to smithi13777483-50 2024-03-04T06:44:18.736 INFO:tasks.rados.rados.0.smithi137.stdout:756: finishing write tid 5 to smithi13777483-50 2024-03-04T06:44:18.736 INFO:tasks.rados.rados.0.smithi137.stdout:756: oid 50 updating version 0 to 481 2024-03-04T06:44:18.736 INFO:tasks.rados.rados.0.smithi137.stdout:756: oid 50 updating version 481 to 482 2024-03-04T06:44:18.736 INFO:tasks.rados.rados.0.smithi137.stdout:756: oid 50 updating version 482 to 484 2024-03-04T06:44:18.736 INFO:tasks.rados.rados.0.smithi137.stdout:756: oid 50 version 484 is already newer than 483 2024-03-04T06:44:18.736 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 484 (ObjNum 251 snap 74 seq_num 251) dirty exists 2024-03-04T06:44:18.736 INFO:tasks.rados.rados.0.smithi137.stdout:756: left oid 50 (ObjNum 251 snap 74 seq_num 251) 2024-03-04T06:44:18.959 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:18 smithi203 ceph-mon[30756]: osdmap e203: 8 total, 8 up, 8 in 2024-03-04T06:44:18.959 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:18 smithi203 ceph-mon[30756]: pgmap v39: 121 pgs: 121 active+clean; 228 MiB data, 875 MiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 1.8 MiB/s wr, 15 op/s 2024-03-04T06:44:18.959 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:18.777+0000 7f805f421200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:44:19.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:18 smithi137 ceph-mon[26846]: osdmap e203: 8 total, 8 up, 8 in 2024-03-04T06:44:19.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:18 smithi137 ceph-mon[26846]: pgmap v39: 121 pgs: 121 active+clean; 228 MiB data, 875 MiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 1.8 MiB/s wr, 15 op/s 2024-03-04T06:44:19.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:18 smithi137 ceph-mon[37364]: osdmap e203: 8 total, 8 up, 8 in 2024-03-04T06:44:19.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:18 smithi137 ceph-mon[37364]: pgmap v39: 121 pgs: 121 active+clean; 228 MiB data, 875 MiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 1.8 MiB/s wr, 15 op/s 2024-03-04T06:44:19.263 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:18.968+0000 7f805f421200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T06:44:19.541 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:19.263+0000 7f805f421200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:44:19.541 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:19.541+0000 7f805f421200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T06:44:19.707 INFO:tasks.rados.rados.0.smithi137.stdout:756: done (2 left) 2024-03-04T06:44:19.707 INFO:tasks.rados.rados.0.smithi137.stdout:757: done (1 left) 2024-03-04T06:44:19.707 INFO:tasks.rados.rados.0.smithi137.stdout:758: done (0 left) 2024-03-04T06:44:19.708 INFO:tasks.rados.rados.0.smithi137.stdout:759: rmattr oid 35 current snap is 75 2024-03-04T06:44:19.708 INFO:tasks.rados.rados.0.smithi137.stdout:760: read oid 16 snap -1 2024-03-04T06:44:19.708 INFO:tasks.rados.rados.0.smithi137.stdout:760: expect (ObjNum 101 snap 21 seq_num 101) 2024-03-04T06:44:19.708 INFO:tasks.rados.rados.0.smithi137.stdout:761: setattr oid 12 current snap is 75 2024-03-04T06:44:19.710 INFO:tasks.rados.rados.0.smithi137.stdout:762: rollback oid 43 current snap is 75 2024-03-04T06:44:19.710 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 43 to 46 2024-03-04T06:44:19.710 INFO:tasks.rados.rados.0.smithi137.stdout:763: snap_remove snap 25 2024-03-04T06:44:19.801 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:19 smithi203 ceph-mon[30756]: osdmap e204: 8 total, 8 up, 8 in 2024-03-04T06:44:19.801 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:19 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:19.802 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:19 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:19 smithi137 ceph-mon[26846]: osdmap e204: 8 total, 8 up, 8 in 2024-03-04T06:44:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:19 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:19 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:20.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:19 smithi137 ceph-mon[37364]: osdmap e204: 8 total, 8 up, 8 in 2024-03-04T06:44:20.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:19 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:20.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:19 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:20.095 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:19.800+0000 7f805f421200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T06:44:20.382 INFO:tasks.rados.rados.0.smithi137.stdout:762: finishing rollback tid 0 to smithi13777483-43 2024-03-04T06:44:20.382 INFO:tasks.rados.rados.0.smithi137.stdout:762: finishing rollback tid 1 to smithi13777483-43 2024-03-04T06:44:20.382 INFO:tasks.rados.rados.0.smithi137.stdout:762: finishing rollback tid 2 to smithi13777483-43 2024-03-04T06:44:20.382 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 238 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:44:20.382 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 291 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:44:20.383 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 197 (ObjNum 248 snap 73 seq_num 248) dirty exists 2024-03-04T06:44:20.383 INFO:tasks.rados.rados.0.smithi137.stdout:760: expect (ObjNum 101 snap 21 seq_num 101) 2024-03-04T06:44:20.560 INFO:tasks.rados.rados.0.smithi137.stdout:759: done (4 left) 2024-03-04T06:44:20.560 INFO:tasks.rados.rados.0.smithi137.stdout:760: done (3 left) 2024-03-04T06:44:20.560 INFO:tasks.rados.rados.0.smithi137.stdout:761: done (2 left) 2024-03-04T06:44:20.560 INFO:tasks.rados.rados.0.smithi137.stdout:762: done (1 left) 2024-03-04T06:44:20.560 INFO:tasks.rados.rados.0.smithi137.stdout:763: done (0 left) 2024-03-04T06:44:20.560 INFO:tasks.rados.rados.0.smithi137.stdout:764: snap_create 2024-03-04T06:44:21.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:20 smithi137 ceph-mon[37364]: osdmap e205: 8 total, 8 up, 8 in 2024-03-04T06:44:21.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:20 smithi137 ceph-mon[37364]: pgmap v42: 121 pgs: 121 active+clean; 228 MiB data, 875 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:21.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:20 smithi137 ceph-mon[37364]: osdmap e206: 8 total, 8 up, 8 in 2024-03-04T06:44:21.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:20 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:21.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:20 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:21.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:20 smithi137 ceph-mon[26846]: osdmap e205: 8 total, 8 up, 8 in 2024-03-04T06:44:21.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:20 smithi137 ceph-mon[26846]: pgmap v42: 121 pgs: 121 active+clean; 228 MiB data, 875 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:21.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:20 smithi137 ceph-mon[26846]: osdmap e206: 8 total, 8 up, 8 in 2024-03-04T06:44:21.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:20 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:21.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:20 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:21.095 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:20.691+0000 7f805f421200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T06:44:21.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:20 smithi203 ceph-mon[30756]: osdmap e205: 8 total, 8 up, 8 in 2024-03-04T06:44:21.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:20 smithi203 ceph-mon[30756]: pgmap v42: 121 pgs: 121 active+clean; 228 MiB data, 875 MiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:21.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:20 smithi203 ceph-mon[30756]: osdmap e206: 8 total, 8 up, 8 in 2024-03-04T06:44:21.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:20 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:21.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:20 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:21.393 INFO:tasks.rados.rados.0.smithi137.stdout:764: done (0 left) 2024-03-04T06:44:21.393 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 76 2024-03-04T06:44:21.393 INFO:tasks.rados.rados.0.smithi137.stdout:765: seq_num 252 ranges {0=630784,630784=499712,1130496=425984,1556480=278528} 2024-03-04T06:44:21.396 INFO:tasks.rados.rados.0.smithi137.stdout:765: writing smithi13777483-1 from 0 to 630784 tid 1 2024-03-04T06:44:21.399 INFO:tasks.rados.rados.0.smithi137.stdout:765: writing smithi13777483-1 from 630784 to 1130496 tid 2 2024-03-04T06:44:21.402 INFO:tasks.rados.rados.0.smithi137.stdout:765: writing smithi13777483-1 from 1130496 to 1556480 tid 3 2024-03-04T06:44:21.405 INFO:tasks.rados.rados.0.smithi137.stdout:765: writing smithi13777483-1 from 1556480 to 1835008 tid 4 2024-03-04T06:44:21.405 INFO:tasks.rados.rados.0.smithi137.stdout:766: copy_from oid 48 from oid 18 current snap is 76 2024-03-04T06:44:21.405 INFO:tasks.rados.rados.0.smithi137.stdout:765: finishing write tid 1 to smithi13777483-1 2024-03-04T06:44:21.405 INFO:tasks.rados.rados.0.smithi137.stdout:767: read oid 33 snap -1 2024-03-04T06:44:21.406 INFO:tasks.rados.rados.0.smithi137.stdout:767: expect (ObjNum 231 snap 66 seq_num 231) 2024-03-04T06:44:21.406 INFO:tasks.rados.rados.0.smithi137.stdout:768: copy_from oid 32 from oid 37 current snap is 76 2024-03-04T06:44:21.406 INFO:tasks.rados.rados.0.smithi137.stdout:765: finishing write tid 2 to smithi13777483-1 2024-03-04T06:44:21.406 INFO:tasks.rados.rados.0.smithi137.stdout:769: delete oid 20 current snap is 76 2024-03-04T06:44:21.406 INFO:tasks.rados.rados.0.smithi137.stdout:765: finishing write tid 3 to smithi13777483-1 2024-03-04T06:44:21.408 INFO:tasks.rados.rados.0.smithi137.stdout:765: finishing write tid 4 to smithi13777483-1 2024-03-04T06:44:21.409 INFO:tasks.rados.rados.0.smithi137.stdout:765: finishing write tid 5 to smithi13777483-1 2024-03-04T06:44:21.410 INFO:tasks.rados.rados.0.smithi137.stdout:765: finishing write tid 6 to smithi13777483-1 2024-03-04T06:44:21.411 INFO:tasks.rados.rados.0.smithi137.stdout:765: oid 1 updating version 0 to 163 2024-03-04T06:44:21.411 INFO:tasks.rados.rados.0.smithi137.stdout:765: oid 1 version 163 is already newer than 160 2024-03-04T06:44:21.411 INFO:tasks.rados.rados.0.smithi137.stdout:765: oid 1 version 163 is already newer than 161 2024-03-04T06:44:21.411 INFO:tasks.rados.rados.0.smithi137.stdout:765: oid 1 version 163 is already newer than 159 2024-03-04T06:44:21.411 INFO:tasks.rados.rados.0.smithi137.stdout:765: oid 1 version 163 is already newer than 162 2024-03-04T06:44:21.411 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 163 (ObjNum 252 snap 76 seq_num 252) dirty exists 2024-03-04T06:44:21.411 INFO:tasks.rados.rados.0.smithi137.stdout:765: left oid 1 (ObjNum 252 snap 76 seq_num 252) 2024-03-04T06:44:21.412 INFO:tasks.rados.rados.0.smithi137.stdout:765: done (4 left) 2024-03-04T06:44:21.412 INFO:tasks.rados.rados.0.smithi137.stdout:769: done (3 left) 2024-03-04T06:44:21.412 INFO:tasks.rados.rados.0.smithi137.stdout:770: snap_create 2024-03-04T06:44:21.423 INFO:tasks.rados.rados.0.smithi137.stdout:767: expect (ObjNum 231 snap 66 seq_num 231) 2024-03-04T06:44:21.465 INFO:tasks.rados.rados.0.smithi137.stdout:768: finishing copy_from racing read to smithi13777483-32 2024-03-04T06:44:21.465 INFO:tasks.rados.rados.0.smithi137.stdout:768: finishing copy_from to smithi13777483-32 2024-03-04T06:44:21.465 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 200 (ObjNum 169 snap 47 seq_num 169) dirty exists 2024-03-04T06:44:21.465 INFO:tasks.rados.rados.0.smithi137.stdout:766: finishing copy_from racing read to smithi13777483-48 2024-03-04T06:44:21.465 INFO:tasks.rados.rados.0.smithi137.stdout:766: finishing copy_from to smithi13777483-48 2024-03-04T06:44:21.465 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 180 (ObjNum 106 snap 27 seq_num 106) dirty exists 2024-03-04T06:44:21.540 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:21.316+0000 7f805f421200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T06:44:21.540 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:21.427+0000 7f805f421200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T06:44:21.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:21.658+0000 7f805f421200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T06:44:21.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: [04/Mar/2024:06:44:21] ENGINE Bus STARTING 2024-03-04T06:44:21.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: CherryPy Checker: 2024-03-04T06:44:21.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: The Application mounted at '' has an empty config. 2024-03-04T06:44:21.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:21.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: [04/Mar/2024:06:44:21] ENGINE Serving on http://:::9283 2024-03-04T06:44:21.846 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: [04/Mar/2024:06:44:21] ENGINE Bus STARTED 2024-03-04T06:44:22.406 INFO:tasks.rados.rados.0.smithi137.stdout:766: done (3 left) 2024-03-04T06:44:22.406 INFO:tasks.rados.rados.0.smithi137.stdout:767: done (2 left) 2024-03-04T06:44:22.406 INFO:tasks.rados.rados.0.smithi137.stdout:768: done (1 left) 2024-03-04T06:44:22.406 INFO:tasks.rados.rados.0.smithi137.stdout:770: done (0 left) 2024-03-04T06:44:22.406 INFO:tasks.rados.rados.0.smithi137.stdout:771: read oid 28 snap -1 2024-03-04T06:44:22.406 INFO:tasks.rados.rados.0.smithi137.stdout:771: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:44:22.406 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 77 2024-03-04T06:44:22.406 INFO:tasks.rados.rados.0.smithi137.stdout:772: seq_num 254 ranges {1646592=663552,2310144=663552,2973696=540672} 2024-03-04T06:44:22.419 INFO:tasks.rados.rados.0.smithi137.stdout:772: writing smithi13777483-2 from 1646592 to 2310144 tid 1 2024-03-04T06:44:22.423 INFO:tasks.rados.rados.0.smithi137.stdout:772: writing smithi13777483-2 from 2310144 to 2973696 tid 2 2024-03-04T06:44:22.427 INFO:tasks.rados.rados.0.smithi137.stdout:772: writing smithi13777483-2 from 2973696 to 3514368 tid 3 2024-03-04T06:44:22.427 INFO:tasks.rados.rados.0.smithi137.stdout:773: delete oid 38 current snap is 77 2024-03-04T06:44:22.427 INFO:tasks.rados.rados.0.smithi137.stdout:772: finishing write tid 1 to smithi13777483-2 2024-03-04T06:44:22.427 INFO:tasks.rados.rados.0.smithi137.stdout:772: finishing write tid 2 to smithi13777483-2 2024-03-04T06:44:22.427 INFO:tasks.rados.rados.0.smithi137.stdout:771: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:44:22.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:22 smithi203 ceph-mon[30756]: osdmap e207: 8 total, 8 up, 8 in 2024-03-04T06:44:22.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:22 smithi203 ceph-mon[30756]: Standby manager daemon x restarted 2024-03-04T06:44:22.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:22 smithi203 ceph-mon[30756]: Standby manager daemon x started 2024-03-04T06:44:22.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:22 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/3453109514' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:44:22.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:22 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/3453109514' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:44:22.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:22 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/3453109514' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:44:22.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:22 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/3453109514' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:44:22.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:22 smithi203 ceph-mon[30756]: pgmap v45: 121 pgs: 121 active+clean; 223 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.7 MiB/s wr, 43 op/s 2024-03-04T06:44:22.641 INFO:tasks.rados.rados.0.smithi137.stdout:772: finishing write tid 3 to smithi13777483-2 2024-03-04T06:44:22.641 INFO:tasks.rados.rados.0.smithi137.stdout:772: finishing write tid 4 to smithi13777483-2 2024-03-04T06:44:22.641 INFO:tasks.rados.rados.0.smithi137.stdout:772: finishing write tid 5 to smithi13777483-2 2024-03-04T06:44:22.641 INFO:tasks.rados.rados.0.smithi137.stdout:772: oid 2 updating version 0 to 182 2024-03-04T06:44:22.641 INFO:tasks.rados.rados.0.smithi137.stdout:772: oid 2 updating version 182 to 183 2024-03-04T06:44:22.641 INFO:tasks.rados.rados.0.smithi137.stdout:772: oid 2 updating version 183 to 184 2024-03-04T06:44:22.641 INFO:tasks.rados.rados.0.smithi137.stdout:772: oid 2 version 184 is already newer than 181 2024-03-04T06:44:22.641 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 184 (ObjNum 254 snap 77 seq_num 254) dirty exists 2024-03-04T06:44:22.641 INFO:tasks.rados.rados.0.smithi137.stdout:772: left oid 2 (ObjNum 254 snap 77 seq_num 254) 2024-03-04T06:44:22.641 INFO:tasks.rados.rados.0.smithi137.stdout:771: done (2 left) 2024-03-04T06:44:22.641 INFO:tasks.rados.rados.0.smithi137.stdout:772: done (1 left) 2024-03-04T06:44:22.642 INFO:tasks.rados.rados.0.smithi137.stdout:773: done (0 left) 2024-03-04T06:44:22.642 INFO:tasks.rados.rados.0.smithi137.stdout:774: snap_create 2024-03-04T06:44:22.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[26846]: osdmap e207: 8 total, 8 up, 8 in 2024-03-04T06:44:22.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[26846]: Standby manager daemon x restarted 2024-03-04T06:44:22.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[26846]: Standby manager daemon x started 2024-03-04T06:44:22.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/3453109514' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:44:22.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/3453109514' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:44:22.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/3453109514' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:44:22.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[26846]: from='mgr.? 172.21.15.203:0/3453109514' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:44:22.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[26846]: pgmap v45: 121 pgs: 121 active+clean; 223 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.7 MiB/s wr, 43 op/s 2024-03-04T06:44:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[37364]: osdmap e207: 8 total, 8 up, 8 in 2024-03-04T06:44:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[37364]: Standby manager daemon x restarted 2024-03-04T06:44:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[37364]: Standby manager daemon x started 2024-03-04T06:44:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/3453109514' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:44:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/3453109514' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:44:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/3453109514' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:44:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/3453109514' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:44:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:22 smithi137 ceph-mon[37364]: pgmap v45: 121 pgs: 121 active+clean; 223 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.7 MiB/s wr, 43 op/s 2024-03-04T06:44:23.407 INFO:tasks.rados.rados.0.smithi137.stdout:774: done (0 left) 2024-03-04T06:44:23.407 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 78 2024-03-04T06:44:23.407 INFO:tasks.rados.rados.0.smithi137.stdout:775: seq_num 256 ranges {442368=696320,1138688=434176,1572864=770048} 2024-03-04T06:44:23.413 INFO:tasks.rados.rados.0.smithi137.stdout:775: writing smithi13777483-27 from 442368 to 1138688 tid 1 2024-03-04T06:44:23.415 INFO:tasks.rados.rados.0.smithi137.stdout:775: writing smithi13777483-27 from 1138688 to 1572864 tid 2 2024-03-04T06:44:23.421 INFO:tasks.rados.rados.0.smithi137.stdout:775: writing smithi13777483-27 from 1572864 to 2342912 tid 3 2024-03-04T06:44:23.421 INFO:tasks.rados.rados.0.smithi137.stdout:776: read oid 26 snap -1 2024-03-04T06:44:23.421 INFO:tasks.rados.rados.0.smithi137.stdout:776: expect (ObjNum 223 snap 65 seq_num 223) 2024-03-04T06:44:23.421 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 78 2024-03-04T06:44:23.421 INFO:tasks.rados.rados.0.smithi137.stdout:775: finishing write tid 1 to smithi13777483-27 2024-03-04T06:44:23.421 INFO:tasks.rados.rados.0.smithi137.stdout:775: finishing write tid 2 to smithi13777483-27 2024-03-04T06:44:23.421 INFO:tasks.rados.rados.0.smithi137.stdout:777: seq_num 257 ranges {0=712704,712704=720896,1433600=483328} 2024-03-04T06:44:23.425 INFO:tasks.rados.rados.0.smithi137.stdout:777: writing smithi13777483-38 from 0 to 712704 tid 1 2024-03-04T06:44:23.430 INFO:tasks.rados.rados.0.smithi137.stdout:777: writing smithi13777483-38 from 712704 to 1433600 tid 2 2024-03-04T06:44:23.433 INFO:tasks.rados.rados.0.smithi137.stdout:777: writing smithi13777483-38 from 1433600 to 1916928 tid 3 2024-03-04T06:44:23.433 INFO:tasks.rados.rados.0.smithi137.stdout:778: read oid 44 snap -1 2024-03-04T06:44:23.433 INFO:tasks.rados.rados.0.smithi137.stdout:778: expect (ObjNum 216 snap 63 seq_num 216) 2024-03-04T06:44:23.434 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 50 current snap is 78 2024-03-04T06:44:23.434 INFO:tasks.rados.rados.0.smithi137.stdout:777: finishing write tid 1 to smithi13777483-38 2024-03-04T06:44:23.434 INFO:tasks.rados.rados.0.smithi137.stdout:779: seq_num 258 ranges {4341760=729088,5070848=606208,5677056=598016} 2024-03-04T06:44:23.460 INFO:tasks.rados.rados.0.smithi137.stdout:779: writing smithi13777483-50 from 4341760 to 5070848 tid 1 2024-03-04T06:44:23.464 INFO:tasks.rados.rados.0.smithi137.stdout:779: writing smithi13777483-50 from 5070848 to 5677056 tid 2 2024-03-04T06:44:23.468 INFO:tasks.rados.rados.0.smithi137.stdout:779: writing smithi13777483-50 from 5677056 to 6275072 tid 3 2024-03-04T06:44:23.468 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 78 2024-03-04T06:44:23.468 INFO:tasks.rados.rados.0.smithi137.stdout:780: seq_num 259 ranges {3907584=745472,4653056=540672,5193728=581632,5775360=81920} 2024-03-04T06:44:23.493 INFO:tasks.rados.rados.0.smithi137.stdout:780: writing smithi13777483-19 from 3907584 to 4653056 tid 1 2024-03-04T06:44:23.496 INFO:tasks.rados.rados.0.smithi137.stdout:780: writing smithi13777483-19 from 4653056 to 5193728 tid 2 2024-03-04T06:44:23.499 INFO:tasks.rados.rados.0.smithi137.stdout:780: writing smithi13777483-19 from 5193728 to 5775360 tid 3 2024-03-04T06:44:23.500 INFO:tasks.rados.rados.0.smithi137.stdout:780: writing smithi13777483-19 from 5775360 to 5857280 tid 4 2024-03-04T06:44:23.500 INFO:tasks.rados.rados.0.smithi137.stdout:781: rollback oid 39 current snap is 78 2024-03-04T06:44:23.500 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 39 to 74 2024-03-04T06:44:23.500 INFO:tasks.rados.rados.0.smithi137.stdout:775: finishing write tid 3 to smithi13777483-27 2024-03-04T06:44:23.500 INFO:tasks.rados.rados.0.smithi137.stdout:775: finishing write tid 4 to smithi13777483-27 2024-03-04T06:44:23.500 INFO:tasks.rados.rados.0.smithi137.stdout:775: finishing write tid 5 to smithi13777483-27 2024-03-04T06:44:23.501 INFO:tasks.rados.rados.0.smithi137.stdout:775: oid 27 updating version 0 to 500 2024-03-04T06:44:23.501 INFO:tasks.rados.rados.0.smithi137.stdout:775: oid 27 updating version 500 to 501 2024-03-04T06:44:23.501 INFO:tasks.rados.rados.0.smithi137.stdout:775: oid 27 updating version 501 to 503 2024-03-04T06:44:23.501 INFO:tasks.rados.rados.0.smithi137.stdout:775: oid 27 version 503 is already newer than 502 2024-03-04T06:44:23.501 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 503 (ObjNum 256 snap 78 seq_num 256) dirty exists 2024-03-04T06:44:23.501 INFO:tasks.rados.rados.0.smithi137.stdout:775: left oid 27 (ObjNum 256 snap 78 seq_num 256) 2024-03-04T06:44:23.501 INFO:tasks.rados.rados.0.smithi137.stdout:777: finishing write tid 2 to smithi13777483-38 2024-03-04T06:44:23.501 INFO:tasks.rados.rados.0.smithi137.stdout:776: expect (ObjNum 223 snap 65 seq_num 223) 2024-03-04T06:44:23.637 INFO:tasks.rados.rados.0.smithi137.stdout:777: finishing write tid 3 to smithi13777483-38 2024-03-04T06:44:23.637 INFO:tasks.rados.rados.0.smithi137.stdout:777: finishing write tid 4 to smithi13777483-38 2024-03-04T06:44:23.637 INFO:tasks.rados.rados.0.smithi137.stdout:775: done (6 left) 2024-03-04T06:44:23.637 INFO:tasks.rados.rados.0.smithi137.stdout:776: done (5 left) 2024-03-04T06:44:23.637 INFO:tasks.rados.rados.0.smithi137.stdout:782: snap_create 2024-03-04T06:44:23.637 INFO:tasks.rados.rados.0.smithi137.stdout:777: finishing write tid 5 to smithi13777483-38 2024-03-04T06:44:23.637 INFO:tasks.rados.rados.0.smithi137.stdout:777: oid 38 updating version 0 to 410 2024-03-04T06:44:23.637 INFO:tasks.rados.rados.0.smithi137.stdout:777: oid 38 version 410 is already newer than 407 2024-03-04T06:44:23.637 INFO:tasks.rados.rados.0.smithi137.stdout:777: oid 38 version 410 is already newer than 408 2024-03-04T06:44:23.637 INFO:tasks.rados.rados.0.smithi137.stdout:777: oid 38 version 410 is already newer than 409 2024-03-04T06:44:23.638 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 410 (ObjNum 257 snap 78 seq_num 257) dirty exists 2024-03-04T06:44:23.638 INFO:tasks.rados.rados.0.smithi137.stdout:777: left oid 38 (ObjNum 257 snap 78 seq_num 257) 2024-03-04T06:44:23.638 INFO:tasks.rados.rados.0.smithi137.stdout:778: expect (ObjNum 216 snap 63 seq_num 216) 2024-03-04T06:44:23.669 INFO:tasks.rados.rados.0.smithi137.stdout:779: finishing write tid 1 to smithi13777483-50 2024-03-04T06:44:23.669 INFO:tasks.rados.rados.0.smithi137.stdout:779: finishing write tid 2 to smithi13777483-50 2024-03-04T06:44:23.669 INFO:tasks.rados.rados.0.smithi137.stdout:779: finishing write tid 3 to smithi13777483-50 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:779: finishing write tid 4 to smithi13777483-50 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:779: finishing write tid 5 to smithi13777483-50 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:779: oid 50 updating version 0 to 505 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:779: oid 50 updating version 505 to 508 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:779: oid 50 version 508 is already newer than 507 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:779: oid 50 version 508 is already newer than 506 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 508 (ObjNum 258 snap 78 seq_num 258) dirty exists 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:779: left oid 50 (ObjNum 258 snap 78 seq_num 258) 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:780: finishing write tid 1 to smithi13777483-19 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:780: finishing write tid 2 to smithi13777483-19 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:780: finishing write tid 3 to smithi13777483-19 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:780: finishing write tid 4 to smithi13777483-19 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:780: finishing write tid 5 to smithi13777483-19 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:780: finishing write tid 6 to smithi13777483-19 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:780: oid 19 updating version 0 to 401 2024-03-04T06:44:23.670 INFO:tasks.rados.rados.0.smithi137.stdout:780: oid 19 version 401 is already newer than 398 2024-03-04T06:44:23.671 INFO:tasks.rados.rados.0.smithi137.stdout:780: oid 19 version 401 is already newer than 399 2024-03-04T06:44:23.671 INFO:tasks.rados.rados.0.smithi137.stdout:780: oid 19 updating version 401 to 402 2024-03-04T06:44:23.671 INFO:tasks.rados.rados.0.smithi137.stdout:780: oid 19 version 402 is already newer than 400 2024-03-04T06:44:23.671 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 402 (ObjNum 259 snap 78 seq_num 259) dirty exists 2024-03-04T06:44:23.671 INFO:tasks.rados.rados.0.smithi137.stdout:780: left oid 19 (ObjNum 259 snap 78 seq_num 259) 2024-03-04T06:44:23.671 INFO:tasks.rados.rados.0.smithi137.stdout:781: finishing rollback tid 0 to smithi13777483-39 2024-03-04T06:44:23.671 INFO:tasks.rados.rados.0.smithi137.stdout:781: finishing rollback tid 1 to smithi13777483-39 2024-03-04T06:44:23.671 INFO:tasks.rados.rados.0.smithi137.stdout:781: finishing rollback tid 2 to smithi13777483-39 2024-03-04T06:44:23.671 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 163 (ObjNum 219 snap 63 seq_num 219) dirty exists 2024-03-04T06:44:23.777 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:23 smithi203 ceph-mon[30756]: mgrmap e34: y(active, since 28s), standbys: x 2024-03-04T06:44:23.777 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:23 smithi203 ceph-mon[30756]: osdmap e208: 8 total, 8 up, 8 in 2024-03-04T06:44:23.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:23 smithi137 ceph-mon[26846]: mgrmap e34: y(active, since 28s), standbys: x 2024-03-04T06:44:23.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:23 smithi137 ceph-mon[26846]: osdmap e208: 8 total, 8 up, 8 in 2024-03-04T06:44:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:23 smithi137 ceph-mon[37364]: mgrmap e34: y(active, since 28s), standbys: x 2024-03-04T06:44:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:23 smithi137 ceph-mon[37364]: osdmap e208: 8 total, 8 up, 8 in 2024-03-04T06:44:24.419 INFO:tasks.rados.rados.0.smithi137.stdout:777: done (5 left) 2024-03-04T06:44:24.419 INFO:tasks.rados.rados.0.smithi137.stdout:778: done (4 left) 2024-03-04T06:44:24.419 INFO:tasks.rados.rados.0.smithi137.stdout:779: done (3 left) 2024-03-04T06:44:24.419 INFO:tasks.rados.rados.0.smithi137.stdout:780: done (2 left) 2024-03-04T06:44:24.419 INFO:tasks.rados.rados.0.smithi137.stdout:781: done (1 left) 2024-03-04T06:44:24.419 INFO:tasks.rados.rados.0.smithi137.stdout:782: done (0 left) 2024-03-04T06:44:24.419 INFO:tasks.rados.rados.0.smithi137.stdout:783: copy_from oid 31 from oid 39 current snap is 79 2024-03-04T06:44:24.419 INFO:tasks.rados.rados.0.smithi137.stdout:784: copy_from oid 28 from oid 43 current snap is 79 2024-03-04T06:44:24.420 INFO:tasks.rados.rados.0.smithi137.stdout:785: delete oid 3 current snap is 79 2024-03-04T06:44:24.423 INFO:tasks.rados.rados.0.smithi137.stdout:785: done (2 left) 2024-03-04T06:44:24.423 INFO:tasks.rados.rados.0.smithi137.stdout:786: read oid 20 snap -1 2024-03-04T06:44:24.424 INFO:tasks.rados.rados.0.smithi137.stdout:786: expect deleted 2024-03-04T06:44:24.424 INFO:tasks.rados.rados.0.smithi137.stdout:787: read oid 1 snap 78 2024-03-04T06:44:24.424 INFO:tasks.rados.rados.0.smithi137.stdout:787: expect (ObjNum 252 snap 76 seq_num 252) 2024-03-04T06:44:24.424 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 79 2024-03-04T06:44:24.424 INFO:tasks.rados.rados.0.smithi137.stdout:788: seq_num 261 ranges {4571136=778240,5349376=704512,6053888=499712} 2024-03-04T06:44:24.455 INFO:tasks.rados.rados.0.smithi137.stdout:788: writing smithi13777483-9 from 4571136 to 5349376 tid 1 2024-03-04T06:44:24.460 INFO:tasks.rados.rados.0.smithi137.stdout:788: writing smithi13777483-9 from 5349376 to 6053888 tid 2 2024-03-04T06:44:24.464 INFO:tasks.rados.rados.0.smithi137.stdout:788: writing smithi13777483-9 from 6053888 to 6553600 tid 3 2024-03-04T06:44:24.464 INFO:tasks.rados.rados.0.smithi137.stdout:789: read oid 47 snap 66 2024-03-04T06:44:24.464 INFO:tasks.rados.rados.0.smithi137.stdout:789: expect (ObjNum 207 snap 60 seq_num 207) 2024-03-04T06:44:24.464 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 79 2024-03-04T06:44:24.464 INFO:tasks.rados.rados.0.smithi137.stdout:790: seq_num 262 ranges {3555328=794624,4349952=589824,4939776=614400} 2024-03-04T06:44:24.490 INFO:tasks.rados.rados.0.smithi137.stdout:790: writing smithi13777483-22 from 3555328 to 4349952 tid 1 2024-03-04T06:44:24.494 INFO:tasks.rados.rados.0.smithi137.stdout:790: writing smithi13777483-22 from 4349952 to 4939776 tid 2 2024-03-04T06:44:24.499 INFO:tasks.rados.rados.0.smithi137.stdout:790: writing smithi13777483-22 from 4939776 to 5554176 tid 3 2024-03-04T06:44:24.499 INFO:tasks.rados.rados.0.smithi137.stdout:791: delete oid 41 current snap is 79 2024-03-04T06:44:24.499 INFO:tasks.rados.rados.0.smithi137.stdout:783: finishing copy_from racing read to smithi13777483-31 2024-03-04T06:44:24.499 INFO:tasks.rados.rados.0.smithi137.stdout:784: finishing copy_from racing read to smithi13777483-28 2024-03-04T06:44:24.499 INFO:tasks.rados.rados.0.smithi137.stdout:783: finishing copy_from to smithi13777483-31 2024-03-04T06:44:24.499 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 163 (ObjNum 219 snap 63 seq_num 219) dirty exists 2024-03-04T06:44:24.499 INFO:tasks.rados.rados.0.smithi137.stdout:787: expect (ObjNum 252 snap 76 seq_num 252) 2024-03-04T06:44:24.546 INFO:tasks.rados.rados.0.smithi137.stdout:784: finishing copy_from to smithi13777483-28 2024-03-04T06:44:24.547 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 238 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:44:24.547 INFO:tasks.rados.rados.0.smithi137.stdout:788: finishing write tid 1 to smithi13777483-9 2024-03-04T06:44:24.547 INFO:tasks.rados.rados.0.smithi137.stdout:788: finishing write tid 2 to smithi13777483-9 2024-03-04T06:44:24.547 INFO:tasks.rados.rados.0.smithi137.stdout:788: finishing write tid 3 to smithi13777483-9 2024-03-04T06:44:24.547 INFO:tasks.rados.rados.0.smithi137.stdout:788: finishing write tid 4 to smithi13777483-9 2024-03-04T06:44:24.547 INFO:tasks.rados.rados.0.smithi137.stdout:788: finishing write tid 5 to smithi13777483-9 2024-03-04T06:44:24.547 INFO:tasks.rados.rados.0.smithi137.stdout:788: oid 9 updating version 0 to 407 2024-03-04T06:44:24.547 INFO:tasks.rados.rados.0.smithi137.stdout:788: oid 9 updating version 407 to 409 2024-03-04T06:44:24.547 INFO:tasks.rados.rados.0.smithi137.stdout:788: oid 9 version 409 is already newer than 408 2024-03-04T06:44:24.547 INFO:tasks.rados.rados.0.smithi137.stdout:788: oid 9 version 409 is already newer than 406 2024-03-04T06:44:24.547 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 409 (ObjNum 261 snap 79 seq_num 261) dirty exists 2024-03-04T06:44:24.547 INFO:tasks.rados.rados.0.smithi137.stdout:788: left oid 9 (ObjNum 261 snap 79 seq_num 261) 2024-03-04T06:44:24.547 INFO:tasks.rados.rados.0.smithi137.stdout:789: expect (ObjNum 207 snap 60 seq_num 207) 2024-03-04T06:44:24.631 INFO:tasks.rados.rados.0.smithi137.stdout:790: finishing write tid 1 to smithi13777483-22 2024-03-04T06:44:24.632 INFO:tasks.rados.rados.0.smithi137.stdout:790: finishing write tid 2 to smithi13777483-22 2024-03-04T06:44:24.632 INFO:tasks.rados.rados.0.smithi137.stdout:790: finishing write tid 3 to smithi13777483-22 2024-03-04T06:44:24.632 INFO:tasks.rados.rados.0.smithi137.stdout:783: done (7 left) 2024-03-04T06:44:24.632 INFO:tasks.rados.rados.0.smithi137.stdout:784: done (6 left) 2024-03-04T06:44:24.632 INFO:tasks.rados.rados.0.smithi137.stdout:786: done (5 left) 2024-03-04T06:44:24.632 INFO:tasks.rados.rados.0.smithi137.stdout:787: done (4 left) 2024-03-04T06:44:24.632 INFO:tasks.rados.rados.0.smithi137.stdout:788: done (3 left) 2024-03-04T06:44:24.632 INFO:tasks.rados.rados.0.smithi137.stdout:789: done (2 left) 2024-03-04T06:44:24.632 INFO:tasks.rados.rados.0.smithi137.stdout:791: done (1 left) 2024-03-04T06:44:24.632 INFO:tasks.rados.rados.0.smithi137.stdout:792: rollback oid 20 current snap is 79 2024-03-04T06:44:24.632 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 20 to 26 2024-03-04T06:44:24.633 INFO:tasks.rados.rados.0.smithi137.stdout:790: finishing write tid 4 to smithi13777483-22 2024-03-04T06:44:24.633 INFO:tasks.rados.rados.0.smithi137.stdout:790: finishing write tid 5 to smithi13777483-22 2024-03-04T06:44:24.633 INFO:tasks.rados.rados.0.smithi137.stdout:790: oid 22 updating version 0 to 399 2024-03-04T06:44:24.633 INFO:tasks.rados.rados.0.smithi137.stdout:790: oid 22 version 399 is already newer than 398 2024-03-04T06:44:24.633 INFO:tasks.rados.rados.0.smithi137.stdout:790: oid 22 version 399 is already newer than 397 2024-03-04T06:44:24.633 INFO:tasks.rados.rados.0.smithi137.stdout:790: oid 22 version 399 is already newer than 396 2024-03-04T06:44:24.633 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 399 (ObjNum 262 snap 79 seq_num 262) dirty exists 2024-03-04T06:44:24.633 INFO:tasks.rados.rados.0.smithi137.stdout:790: left oid 22 (ObjNum 262 snap 79 seq_num 262) 2024-03-04T06:44:24.633 INFO:tasks.rados.rados.0.smithi137.stdout:790: done (1 left) 2024-03-04T06:44:24.633 INFO:tasks.rados.rados.0.smithi137.stdout:793: snap_remove snap 43 2024-03-04T06:44:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: osdmap e209: 8 total, 8 up, 8 in 2024-03-04T06:44:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: pgmap v48: 121 pgs: 121 active+clean; 223 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.7 MiB/s wr, 43 op/s 2024-03-04T06:44:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:44:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:44:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:44:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-04T06:44:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-04T06:44:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-04T06:44:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-04T06:44:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-04T06:44:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-03-04T06:44:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-04T06:44:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-04T06:44:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: osdmap e209: 8 total, 8 up, 8 in 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: pgmap v48: 121 pgs: 121 active+clean; 223 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.7 MiB/s wr, 43 op/s 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-04T06:44:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-04T06:44:24.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-03-04T06:44:24.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-04T06:44:24.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:24 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-04T06:44:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: osdmap e209: 8 total, 8 up, 8 in 2024-03-04T06:44:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: pgmap v48: 121 pgs: 121 active+clean; 223 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.7 MiB/s wr, 43 op/s 2024-03-04T06:44:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:44:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:44:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:44:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-04T06:44:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-04T06:44:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-04T06:44:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-04T06:44:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-04T06:44:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-03-04T06:44:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-04T06:44:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:24 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-04T06:44:25.386 INFO:tasks.rados.rados.0.smithi137.stdout:793: done (1 left) 2024-03-04T06:44:25.387 INFO:tasks.rados.rados.0.smithi137.stdout:794: snap_create 2024-03-04T06:44:25.387 INFO:tasks.rados.rados.0.smithi137.stdout:792: finishing rollback tid 1 to smithi13777483-20 2024-03-04T06:44:25.387 INFO:tasks.rados.rados.0.smithi137.stdout:792: finishing rollback tid 2 to smithi13777483-20 2024-03-04T06:44:25.387 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 282 (ObjNum 105 snap 26 seq_num 105) dirty exists 2024-03-04T06:44:25.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:44:25] "GET /metrics HTTP/1.1" 200 36003 "" "Prometheus/2.43.0" 2024-03-04T06:44:25.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:25 smithi137 ceph-mon[37364]: Upgrade: Setting container_image for all mgr 2024-03-04T06:44:25.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:25 smithi137 ceph-mon[37364]: Upgrade: It appears safe to stop mon.a 2024-03-04T06:44:25.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:25 smithi137 ceph-mon[37364]: osdmap e210: 8 total, 8 up, 8 in 2024-03-04T06:44:25.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:25 smithi137 ceph-mon[37364]: osdmap e211: 8 total, 8 up, 8 in 2024-03-04T06:44:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:25 smithi137 ceph-mon[26846]: Upgrade: Setting container_image for all mgr 2024-03-04T06:44:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:25 smithi137 ceph-mon[26846]: Upgrade: It appears safe to stop mon.a 2024-03-04T06:44:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:25 smithi137 ceph-mon[26846]: osdmap e210: 8 total, 8 up, 8 in 2024-03-04T06:44:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:25 smithi137 ceph-mon[26846]: osdmap e211: 8 total, 8 up, 8 in 2024-03-04T06:44:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:25 smithi203 ceph-mon[30756]: Upgrade: Setting container_image for all mgr 2024-03-04T06:44:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:25 smithi203 ceph-mon[30756]: Upgrade: It appears safe to stop mon.a 2024-03-04T06:44:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:25 smithi203 ceph-mon[30756]: osdmap e210: 8 total, 8 up, 8 in 2024-03-04T06:44:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:25 smithi203 ceph-mon[30756]: osdmap e211: 8 total, 8 up, 8 in 2024-03-04T06:44:26.388 INFO:tasks.rados.rados.0.smithi137.stdout:792: done (1 left) 2024-03-04T06:44:26.388 INFO:tasks.rados.rados.0.smithi137.stdout:794: done (0 left) 2024-03-04T06:44:26.388 INFO:tasks.rados.rados.0.smithi137.stdout:795: read oid 46 snap -1 2024-03-04T06:44:26.388 INFO:tasks.rados.rados.0.smithi137.stdout:795: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:44:26.388 INFO:tasks.rados.rados.0.smithi137.stdout:796: delete oid 8 current snap is 80 2024-03-04T06:44:26.389 INFO:tasks.rados.rados.0.smithi137.stdout:795: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:44:26.392 INFO:tasks.rados.rados.0.smithi137.stdout:795: done (1 left) 2024-03-04T06:44:26.393 INFO:tasks.rados.rados.0.smithi137.stdout:796: done (0 left) 2024-03-04T06:44:26.393 INFO:tasks.rados.rados.0.smithi137.stdout:797: snap_create 2024-03-04T06:44:27.279 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[37364]: pgmap v51: 121 pgs: 121 active+clean; 252 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 6.5 MiB/s wr, 19 op/s 2024-03-04T06:44:27.279 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[37364]: Upgrade: Updating mon.a 2024-03-04T06:44:27.279 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:27.279 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:44:27.279 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:44:27.279 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[37364]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:27.279 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[37364]: Deploying daemon mon.a on smithi137 2024-03-04T06:44:27.279 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[37364]: osdmap e212: 8 total, 8 up, 8 in 2024-03-04T06:44:27.279 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[26846]: pgmap v51: 121 pgs: 121 active+clean; 252 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 6.5 MiB/s wr, 19 op/s 2024-03-04T06:44:27.279 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[26846]: Upgrade: Updating mon.a 2024-03-04T06:44:27.279 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[26846]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:27.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:44:27.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:44:27.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[26846]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:27.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[26846]: Deploying daemon mon.a on smithi137 2024-03-04T06:44:27.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:27 smithi137 ceph-mon[26846]: osdmap e212: 8 total, 8 up, 8 in 2024-03-04T06:44:27.388 INFO:tasks.rados.rados.0.smithi137.stdout:797: done (0 left) 2024-03-04T06:44:27.388 INFO:tasks.rados.rados.0.smithi137.stdout:798: setattr oid 42 current snap is 81 2024-03-04T06:44:27.389 INFO:tasks.rados.rados.0.smithi137.stdout:799: delete oid 12 current snap is 81 2024-03-04T06:44:27.392 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 517 (ObjNum 289 snap 0 seq_num 3818905721) dirty exists 2024-03-04T06:44:27.395 INFO:tasks.rados.rados.0.smithi137.stdout:798: done (1 left) 2024-03-04T06:44:27.395 INFO:tasks.rados.rados.0.smithi137.stdout:799: done (0 left) 2024-03-04T06:44:27.395 INFO:tasks.rados.rados.0.smithi137.stdout:800: read oid 29 snap 26 2024-03-04T06:44:27.395 INFO:tasks.rados.rados.0.smithi137.stdout:800: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-04T06:44:27.395 INFO:tasks.rados.rados.0.smithi137.stdout:801: rmattr oid 44 current snap is 81 2024-03-04T06:44:27.395 INFO:tasks.rados.rados.0.smithi137.stdout:802: snap_remove snap 46 2024-03-04T06:44:27.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:27 smithi203 ceph-mon[30756]: pgmap v51: 121 pgs: 121 active+clean; 252 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 6.5 MiB/s wr, 19 op/s 2024-03-04T06:44:27.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:27 smithi203 ceph-mon[30756]: Upgrade: Updating mon.a 2024-03-04T06:44:27.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:27 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='mgr.y' 2024-03-04T06:44:27.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:27 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:44:27.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:27 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:44:27.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:27 smithi203 ceph-mon[30756]: from='mgr.15198 172.21.15.137:0/4043025015' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:27.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:27 smithi203 ceph-mon[30756]: Deploying daemon mon.a on smithi137 2024-03-04T06:44:27.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:27 smithi203 ceph-mon[30756]: osdmap e212: 8 total, 8 up, 8 in 2024-03-04T06:44:28.209 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:27 smithi137 systemd[1]: Stopping Ceph mon.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:44:28.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[26842]: 2024-03-04T06:44:28.208+0000 7f6361f14700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:44:28.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[26842]: 2024-03-04T06:44:28.208+0000 7f6361f14700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-04T06:44:28.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:28 smithi137 podman[88710]: 2024-03-04 06:44:28.23939502 +0000 UTC m=+0.142099179 container died 0279ece55dcce5ba82312214c2ff2e825003a66225c0d180d1b0e454e9e4fdbf (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=reef-5cc7a76, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-04T06:44:28.987 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:28 smithi137 podman[88710]: 2024-03-04 06:44:28.692083586 +0000 UTC m=+0.594787754 container cleanup 0279ece55dcce5ba82312214c2ff2e825003a66225c0d180d1b0e454e9e4fdbf (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=reef-5cc7a76, org.label-schema.license=GPLv2) 2024-03-04T06:44:28.987 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:28 smithi137 bash[88710]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a 2024-03-04T06:44:29.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:28 smithi137 podman[88722]: 2024-03-04 06:44:28.987137756 +0000 UTC m=+0.748088886 container remove 0279ece55dcce5ba82312214c2ff2e825003a66225c0d180d1b0e454e9e4fdbf (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=reef-5cc7a76, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-03-04T06:44:29.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.a.service: Deactivated successfully. 2024-03-04T06:44:29.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 systemd[1]: Stopped Ceph mon.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:44:29.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.a.service: Consumed 13.977s CPU time. 2024-03-04T06:44:29.664 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 systemd[1]: Starting Ceph mon.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:44:29.664 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 podman[88850]: 2024-03-04 06:44:29.521471151 +0000 UTC m=+0.110628736 container create 317873ab051e367e41bbdeef657827c29f57f2879ab3c7180967c8a0a53e5d5e (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-04T06:44:29.664 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 podman[88850]: 2024-03-04 06:44:29.428691554 +0000 UTC m=+0.017849163 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:44:30.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 podman[88850]: 2024-03-04 06:44:29.774118767 +0000 UTC m=+0.363276361 container init 317873ab051e367e41bbdeef657827c29f57f2879ab3c7180967c8a0a53e5d5e (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-04T06:44:30.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 podman[88850]: 2024-03-04 06:44:29.777538925 +0000 UTC m=+0.366696521 container start 317873ab051e367e41bbdeef657827c29f57f2879ab3c7180967c8a0a53e5d5e (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-04T06:44:30.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: set uid:gid to 167:167 (ceph:ceph) 2024-03-04T06:44:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev), process ceph-mon, pid 2 2024-03-04T06:44:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: pidfile_write: ignore empty --pid-file 2024-03-04T06:44:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: load: jerasure load: lrc 2024-03-04T06:44:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: RocksDB version: 7.9.2 2024-03-04T06:44:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Git sha 0 2024-03-04T06:44:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Compile date 2024-03-01 16:22:25 2024-03-04T06:44:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: DB SUMMARY 2024-03-04T06:44:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: DB Session ID: 86RC16WS0YB90BYD9ZV2 2024-03-04T06:44:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: CURRENT file: CURRENT 2024-03-04T06:44:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: IDENTITY file: IDENTITY 2024-03-04T06:44:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1510 Bytes 2024-03-04T06:44:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000032.sst 2024-03-04T06:44:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000030.log size: 5697320 ; 2024-03-04T06:44:30.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.error_if_exists: 0 2024-03-04T06:44:30.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.create_if_missing: 0 2024-03-04T06:44:30.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.paranoid_checks: 1 2024-03-04T06:44:30.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-04T06:44:30.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-04T06:44:30.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-04T06:44:30.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.env: 0x55e2244e2b20 2024-03-04T06:44:30.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.fs: PosixFileSystem 2024-03-04T06:44:30.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.info_log: 0x55e225d9f9e0 2024-03-04T06:44:30.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_file_opening_threads: 16 2024-03-04T06:44:30.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.statistics: (nil) 2024-03-04T06:44:30.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.use_fsync: 0 2024-03-04T06:44:30.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_log_file_size: 0 2024-03-04T06:44:30.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-04T06:44:30.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-04T06:44:30.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.keep_log_file_num: 1000 2024-03-04T06:44:30.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.recycle_log_file_num: 0 2024-03-04T06:44:30.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.allow_fallocate: 1 2024-03-04T06:44:30.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.allow_mmap_reads: 0 2024-03-04T06:44:30.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.allow_mmap_writes: 0 2024-03-04T06:44:30.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.use_direct_reads: 0 2024-03-04T06:44:30.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-04T06:44:30.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.create_missing_column_families: 0 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.db_log_dir: 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.wal_dir: 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.advise_random_on_open: 1 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.db_write_buffer_size: 0 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.write_buffer_manager: 0x55e225d72dc0 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-04T06:44:30.048 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.rate_limiter: (nil) 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.wal_recovery_mode: 2 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.enable_thread_tracking: 0 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.enable_pipelined_write: 0 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.unordered_write: 0 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.row_cache: None 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.wal_filter: None 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.allow_ingest_behind: 0 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.two_write_queues: 0 2024-03-04T06:44:30.049 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.manual_wal_flush: 0 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.wal_compression: 0 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.atomic_flush: 0 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.log_readahead_size: 0 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.best_efforts_recovery: 0 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.allow_data_in_errors: 0 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.db_host_id: __hostname__ 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_background_jobs: 2 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_background_compactions: -1 2024-03-04T06:44:30.050 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_subcompactions: 1 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_total_wal_size: 0 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_open_files: -1 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.bytes_per_sync: 0 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compaction_readahead_size: 0 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_background_flushes: -1 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Compression algorithms supported: 2024-03-04T06:44:30.051 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: kZSTD supported: 0 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: kXpressCompression supported: 0 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: kLZ4HCCompression supported: 1 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: kZlibCompression supported: 1 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: kSnappyCompression supported: 1 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: kLZ4Compression supported: 1 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: kBZip2Compression supported: 0 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.merge_operator: 2024-03-04T06:44:30.052 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compaction_filter: None 2024-03-04T06:44:30.053 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compaction_filter_factory: None 2024-03-04T06:44:30.053 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.sst_partitioner_factory: None 2024-03-04T06:44:30.053 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-04T06:44:30.053 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-04T06:44:30.053 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e225d9fae0) 2024-03-04T06:44:30.053 INFO:journalctl@ceph.mon.a.smithi137.stdout: cache_index_and_filter_blocks: 1 2024-03-04T06:44:30.053 INFO:journalctl@ceph.mon.a.smithi137.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-04T06:44:30.053 INFO:journalctl@ceph.mon.a.smithi137.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-04T06:44:30.053 INFO:journalctl@ceph.mon.a.smithi137.stdout: pin_top_level_index_and_filter: 1 2024-03-04T06:44:30.053 INFO:journalctl@ceph.mon.a.smithi137.stdout: index_type: 0 2024-03-04T06:44:30.054 INFO:journalctl@ceph.mon.a.smithi137.stdout: data_block_index_type: 0 2024-03-04T06:44:30.054 INFO:journalctl@ceph.mon.a.smithi137.stdout: index_shortening: 1 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: checksum: 4 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: no_block_cache: 0 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_cache: 0x55e225da51f0 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_cache_name: BinnedLRUCache 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_cache_options: 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: capacity : 536870912 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: num_shard_bits : 4 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: strict_capacity_limit : 0 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: high_pri_pool_ratio: 0.000 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_cache_compressed: (nil) 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: persistent_cache: (nil) 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_size: 4096 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_size_deviation: 10 2024-03-04T06:44:30.055 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_restart_interval: 16 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: index_block_restart_interval: 1 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: metadata_block_size: 4096 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: partition_filters: 0 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: use_delta_encoding: 1 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: filter_policy: bloomfilter 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: whole_key_filtering: 1 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: verify_compression: 0 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: read_amp_bytes_per_bit: 0 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: format_version: 5 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: enable_index_compression: 1 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_align: 0 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: max_auto_readahead_size: 262144 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: prepopulate_block_cache: 0 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: initial_auto_readahead_size: 8192 2024-03-04T06:44:30.056 INFO:journalctl@ceph.mon.a.smithi137.stdout: num_file_reads_for_auto_readahead: 2 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.write_buffer_size: 33554432 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_write_buffer_number: 2 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compression: NoCompression 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.bottommost_compression: Disabled 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.prefix_extractor: nullptr 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.num_levels: 7 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-04T06:44:30.057 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compression_opts.level: 32767 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compression_opts.strategy: 0 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compression_opts.enabled: false 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-04T06:44:30.058 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.target_file_size_base: 67108864 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-04T06:44:30.059 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.arena_block_size: 1048576 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.disable_auto_compactions: 0 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-04T06:44:30.060 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.table_properties_collectors: 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.inplace_update_support: 0 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.bloom_locality: 0 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.max_successive_merges: 0 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.paranoid_file_checks: 0 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.force_consistency_checks: 1 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.report_bg_io_stats: 0 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.ttl: 2592000 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-04T06:44:30.061 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.enable_blob_files: false 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.min_blob_size: 0 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.blob_file_size: 268435456 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.blob_file_starting_level: 0 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12658, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1bf909fe-1f6c-485a-8c25-696c6a455d26 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534669806718, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-03-04T06:44:30.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534669823375, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 5238984, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12659, "largest_seqno": 15559, "table_properties": {"data_size": 5225247, "index_size": 9260, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3461, "raw_key_size": 31553, "raw_average_key_size": 22, "raw_value_size": 5196591, "raw_average_value_size": 3782, "num_data_blocks": 404, "num_entries": 1374, "num_filter_entries": 1374, "num_deletions": 296, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709534669, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1bf909fe-1f6c-485a-8c25-696c6a455d26", "db_session_id": "86RC16WS0YB90BYD9ZV2", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534669823470, "job": 1, "event": "recovery_finished"} 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e225e98000 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: DB pointer 0x55e225e82000 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout: ** DB Stats ** 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T06:44:30.063 INFO:journalctl@ceph.mon.a.smithi137.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: ** Compaction Stats [default] ** 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: L0 1/0 5.00 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 573.2 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: L6 1/0 5.63 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: Sum 2/0 10.63 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 573.2 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 573.2 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: ** Compaction Stats [default] ** 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T06:44:30.064 INFO:journalctl@ceph.mon.a.smithi137.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 573.2 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: Flush(GB): cumulative 0.005, interval 0.005 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: Cumulative compaction: 0.00 GB write, 234.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: Interval compaction: 0.00 GB write, 234.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: Block cache BinnedLRUCache@0x55e225da51f0#2 capacity: 512.00 MB usage: 14.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-03-04T06:44:30.065 INFO:journalctl@ceph.mon.a.smithi137.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,10.08 KB,0.00192225%) Misc(1,0.00 KB,0%) 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: starting mon.a rank 0 at public addrs [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] at bind addrs [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: mon.a@-1(???) e3 preinit fsid d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: mon.a@-1(???).mds e6 new map 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: mon.a@-1(???).mds e6 print_map 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout: e6 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout: legacy client fscid: 1 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout: Filesystem 'cephfs' (1) 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout: fs_name cephfs 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout: epoch 6 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-04T06:44:30.066 INFO:journalctl@ceph.mon.a.smithi137.stdout: created 2024-03-04T06:38:12.879589+0000 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: modified 2024-03-04T06:38:14.885821+0000 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: tableserver 0 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: root 0 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: session_timeout 60 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: session_autoclose 300 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: max_file_size 1099511627776 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: max_xattr_size 65536 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: required_client_features {} 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: last_failure 0 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: last_failure_osd_epoch 0 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: max_mds 1 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: in 0 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: up {0=24352} 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: failed 2024-03-04T06:44:30.067 INFO:journalctl@ceph.mon.a.smithi137.stdout: damaged 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout: stopped 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout: data_pools [3] 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout: metadata_pool 2 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout: inline_data disabled 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout: balancer 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout: bal_rank_mask -1 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout: standby_count_wanted 0 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout: [mds.b{0:24352} state up:active seq 3 addr [v2:172.21.15.203:6832/3636376444,v1:172.21.15.203:6833/3636376444] compat {c=[1],r=[1],i=[7ff]}] 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout: Standby daemons: 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout: [mds.a{-1:14451} state up:standby seq 1 addr [v2:172.21.15.137:6834/3869447426,v1:172.21.15.137:6835/3869447426] compat {c=[1],r=[1],i=[7ff]}] 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: mon.a@-1(???).osd e213 crush map has features 3314933069573799936, adjusting msgr requires 2024-03-04T06:44:30.068 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: mon.a@-1(???).osd e213 crush map has features 432629308056666112, adjusting msgr requires 2024-03-04T06:44:30.069 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: mon.a@-1(???).osd e213 crush map has features 432629308056666112, adjusting msgr requires 2024-03-04T06:44:30.069 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: mon.a@-1(???).osd e213 crush map has features 432629308056666112, adjusting msgr requires 2024-03-04T06:44:30.069 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 ceph-mon[88869]: mon.a@-1(???).paxosservice(auth 1..18) refresh upgraded, format 0 -> 3 2024-03-04T06:44:30.069 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 bash[88850]: 317873ab051e367e41bbdeef657827c29f57f2879ab3c7180967c8a0a53e5d5e 2024-03-04T06:44:30.069 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:29 smithi137 systemd[1]: Started Ceph mon.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:44:31.323 INFO:tasks.rados.rados.0.smithi137.stdout:802: done (2 left) 2024-03-04T06:44:31.323 INFO:tasks.rados.rados.0.smithi137.stdout:803: setattr oid 17 current snap is 81 2024-03-04T06:44:31.323 INFO:tasks.rados.rados.0.smithi137.stdout:804: rmattr oid 11 current snap is 81 2024-03-04T06:44:31.323 INFO:tasks.rados.rados.0.smithi137.stdout:804: done (3 left) 2024-03-04T06:44:31.323 INFO:tasks.rados.rados.0.smithi137.stdout:805: rollback oid 7 current snap is 81 2024-03-04T06:44:31.324 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 7 to 71 2024-03-04T06:44:31.324 INFO:tasks.rados.rados.0.smithi137.stdout:806: rollback oid 27 current snap is 81 2024-03-04T06:44:31.324 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 27 to 54 2024-03-04T06:44:31.324 INFO:tasks.rados.rados.0.smithi137.stdout:807: snap_create 2024-03-04T06:44:31.324 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 244 (ObjNum 216 snap 63 seq_num 216) dirty exists 2024-03-04T06:44:31.324 INFO:tasks.rados.rados.0.smithi137.stdout:800: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-04T06:44:31.359 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 239 (ObjNum 2945 snap 0 seq_num 3162485424) dirty exists 2024-03-04T06:44:31.359 INFO:tasks.rados.rados.0.smithi137.stdout:805: finishing rollback tid 0 to smithi13777483-7 2024-03-04T06:44:31.359 INFO:tasks.rados.rados.0.smithi137.stdout:805: finishing rollback tid 1 to smithi13777483-7 2024-03-04T06:44:31.359 INFO:tasks.rados.rados.0.smithi137.stdout:805: finishing rollback tid 2 to smithi13777483-7 2024-03-04T06:44:31.359 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 136 (ObjNum 237 snap 71 seq_num 237) dirty exists 2024-03-04T06:44:31.359 INFO:tasks.rados.rados.0.smithi137.stdout:806: finishing rollback tid 0 to smithi13777483-27 2024-03-04T06:44:31.359 INFO:tasks.rados.rados.0.smithi137.stdout:806: finishing rollback tid 1 to smithi13777483-27 2024-03-04T06:44:31.359 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 520 (ObjNum 449 snap 0 seq_num 3819584962) dirty dne 2024-03-04T06:44:31.592 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ignoring --setuser ceph since I am not root 2024-03-04T06:44:31.592 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ignoring --setgroup ceph since I am not root 2024-03-04T06:44:31.592 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mgr[80238]: -- 172.21.15.137:0/2706614526 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ceb885c1a0 con 0x55ceb8832c00 2024-03-04T06:44:31.592 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mgr[80238]: -- 172.21.15.137:0/2706614526 <== mon.0 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ceb885e5a0 con 0x55ceb8832c00 2024-03-04T06:44:31.593 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[37364]: pgmap v54: 121 pgs: 121 active+clean; 252 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 6.5 MiB/s wr, 19 op/s 2024-03-04T06:44:31.593 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[37364]: pgmap v55: 121 pgs: 121 active+clean; 252 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-03-04T06:44:31.593 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[37364]: mon.a calling monitor election 2024-03-04T06:44:31.593 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[37364]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-04T06:44:31.593 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[37364]: monmap e3: 3 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0],c=[v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:44:31.593 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[37364]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:44:31.593 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[37364]: osdmap e213: 8 total, 8 up, 8 in 2024-03-04T06:44:31.593 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[37364]: mgrmap e34: y(active, since 37s), standbys: x 2024-03-04T06:44:31.593 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[37364]: overall HEALTH_OK 2024-03-04T06:44:31.593 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[37364]: from='mgr.15198 ' entity='' 2024-03-04T06:44:31.593 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[37364]: mgrmap e35: y(active, since 37s), standbys: x 2024-03-04T06:44:31.594 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[88869]: pgmap v54: 121 pgs: 121 active+clean; 252 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 6.5 MiB/s wr, 19 op/s 2024-03-04T06:44:31.594 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[88869]: pgmap v55: 121 pgs: 121 active+clean; 252 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-03-04T06:44:31.594 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[88869]: mon.a calling monitor election 2024-03-04T06:44:31.594 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[88869]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-04T06:44:31.594 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[88869]: monmap e3: 3 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0],c=[v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:44:31.594 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[88869]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:44:31.594 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[88869]: osdmap e213: 8 total, 8 up, 8 in 2024-03-04T06:44:31.594 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[88869]: mgrmap e34: y(active, since 37s), standbys: x 2024-03-04T06:44:31.594 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[88869]: overall HEALTH_OK 2024-03-04T06:44:31.594 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[88869]: from='mgr.15198 ' entity='' 2024-03-04T06:44:31.594 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-mon[88869]: mgrmap e35: y(active, since 37s), standbys: x 2024-03-04T06:44:31.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: ignoring --setuser ceph since I am not root 2024-03-04T06:44:31.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: ignoring --setgroup ceph since I am not root 2024-03-04T06:44:31.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-mgr[76990]: -- 172.21.15.203:0/2466149165 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556e6d8aa5a0 con 0x556e6d87f000 2024-03-04T06:44:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-mon[30756]: pgmap v54: 121 pgs: 121 active+clean; 252 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 6.5 MiB/s wr, 19 op/s 2024-03-04T06:44:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-mon[30756]: pgmap v55: 121 pgs: 121 active+clean; 252 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-03-04T06:44:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-mon[30756]: mon.a calling monitor election 2024-03-04T06:44:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-mon[30756]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-04T06:44:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-mon[30756]: monmap e3: 3 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0],c=[v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:44:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-mon[30756]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:44:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-mon[30756]: osdmap e213: 8 total, 8 up, 8 in 2024-03-04T06:44:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-mon[30756]: mgrmap e34: y(active, since 37s), standbys: x 2024-03-04T06:44:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-mon[30756]: overall HEALTH_OK 2024-03-04T06:44:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-mon[30756]: from='mgr.15198 ' entity='' 2024-03-04T06:44:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-mon[30756]: mgrmap e35: y(active, since 37s), standbys: x 2024-03-04T06:44:32.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:31.886+0000 7fcad2e37200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T06:44:32.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:31.983+0000 7fcad2e37200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T06:44:32.317 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:31.865+0000 7ff48d16b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T06:44:32.317 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:31.964+0000 7ff48d16b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T06:44:32.331 INFO:tasks.rados.rados.0.smithi137.stdout:800: done (5 left) 2024-03-04T06:44:32.331 INFO:tasks.rados.rados.0.smithi137.stdout:801: done (4 left) 2024-03-04T06:44:32.331 INFO:tasks.rados.rados.0.smithi137.stdout:803: done (3 left) 2024-03-04T06:44:32.331 INFO:tasks.rados.rados.0.smithi137.stdout:805: done (2 left) 2024-03-04T06:44:32.331 INFO:tasks.rados.rados.0.smithi137.stdout:806: done (1 left) 2024-03-04T06:44:32.331 INFO:tasks.rados.rados.0.smithi137.stdout:807: done (0 left) 2024-03-04T06:44:32.331 INFO:tasks.rados.rados.0.smithi137.stdout:808: rollback oid 43 current snap is 82 2024-03-04T06:44:32.331 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 43 to 79 2024-03-04T06:44:32.331 INFO:tasks.rados.rados.0.smithi137.stdout:809: snap_create 2024-03-04T06:44:32.334 INFO:tasks.rados.rados.0.smithi137.stdout:808: finishing rollback tid 0 to smithi13777483-43 2024-03-04T06:44:32.335 INFO:tasks.rados.rados.0.smithi137.stdout:808: finishing rollback tid 1 to smithi13777483-43 2024-03-04T06:44:32.335 INFO:tasks.rados.rados.0.smithi137.stdout:808: finishing rollback tid 2 to smithi13777483-43 2024-03-04T06:44:32.335 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 242 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:44:32.573 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:32 smithi137 ceph-mon[88869]: osdmap e214: 8 total, 8 up, 8 in 2024-03-04T06:44:32.573 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:32 smithi137 ceph-mon[37364]: osdmap e214: 8 total, 8 up, 8 in 2024-03-04T06:44:32.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:32 smithi203 ceph-mon[30756]: osdmap e214: 8 total, 8 up, 8 in 2024-03-04T06:44:32.880 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:32.644+0000 7fcad2e37200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T06:44:32.880 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:32.738+0000 7fcad2e37200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T06:44:32.956 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:32.620+0000 7ff48d16b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T06:44:32.957 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:32.715+0000 7ff48d16b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T06:44:32.957 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:32.860+0000 7ff48d16b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T06:44:32.957 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:32.955+0000 7ff48d16b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T06:44:33.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:32.880+0000 7fcad2e37200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T06:44:33.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:32.975+0000 7fcad2e37200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T06:44:33.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:33.057+0000 7fcad2e37200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T06:44:33.311 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:33.039+0000 7ff48d16b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T06:44:33.311 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:33.309+0000 7ff48d16b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T06:44:33.331 INFO:tasks.rados.rados.0.smithi137.stdout:808: done (1 left) 2024-03-04T06:44:33.331 INFO:tasks.rados.rados.0.smithi137.stdout:809: done (0 left) 2024-03-04T06:44:33.332 INFO:tasks.rados.rados.0.smithi137.stdout:810: rmattr oid 29 current snap is 83 2024-03-04T06:44:33.332 INFO:tasks.rados.rados.0.smithi137.stdout:811: snap_create 2024-03-04T06:44:33.338 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 278 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-04T06:44:33.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:33 smithi203 ceph-mon[30756]: osdmap e215: 8 total, 8 up, 8 in 2024-03-04T06:44:33.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:33.423+0000 7ff48d16b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T06:44:33.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:33.513+0000 7ff48d16b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T06:44:33.624 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:33 smithi137 ceph-mon[88869]: osdmap e215: 8 total, 8 up, 8 in 2024-03-04T06:44:33.624 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:33 smithi137 ceph-mon[37364]: osdmap e215: 8 total, 8 up, 8 in 2024-03-04T06:44:33.624 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:33.328+0000 7fcad2e37200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T06:44:33.625 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:33.441+0000 7fcad2e37200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T06:44:33.625 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:33.528+0000 7fcad2e37200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T06:44:33.625 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:33.624+0000 7fcad2e37200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T06:44:34.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:33.800+0000 7fcad2e37200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T06:44:34.095 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:33.607+0000 7ff48d16b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T06:44:34.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:33.786+0000 7ff48d16b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T06:44:34.344 INFO:tasks.rados.rados.0.smithi137.stdout:810: done (1 left) 2024-03-04T06:44:34.345 INFO:tasks.rados.rados.0.smithi137.stdout:811: done (0 left) 2024-03-04T06:44:34.345 INFO:tasks.rados.rados.0.smithi137.stdout:812: delete oid 33 current snap is 84 2024-03-04T06:44:34.350 INFO:tasks.rados.rados.0.smithi137.stdout:812: done (0 left) 2024-03-04T06:44:34.350 INFO:tasks.rados.rados.0.smithi137.stdout:813: setattr oid 48 current snap is 84 2024-03-04T06:44:34.351 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 84 2024-03-04T06:44:34.352 INFO:tasks.rados.rados.0.smithi137.stdout:814: seq_num 267 ranges {3514368=475136,3989504=458752,4448256=540672,4988928=606208} 2024-03-04T06:44:34.373 INFO:tasks.rados.rados.0.smithi137.stdout:814: writing smithi13777483-2 from 3514368 to 3989504 tid 1 2024-03-04T06:44:34.376 INFO:tasks.rados.rados.0.smithi137.stdout:814: writing smithi13777483-2 from 3989504 to 4448256 tid 2 2024-03-04T06:44:34.379 INFO:tasks.rados.rados.0.smithi137.stdout:814: writing smithi13777483-2 from 4448256 to 4988928 tid 3 2024-03-04T06:44:34.384 INFO:tasks.rados.rados.0.smithi137.stdout:814: writing smithi13777483-2 from 4988928 to 5595136 tid 4 2024-03-04T06:44:34.384 INFO:tasks.rados.rados.0.smithi137.stdout:815: read oid 37 snap -1 2024-03-04T06:44:34.384 INFO:tasks.rados.rados.0.smithi137.stdout:815: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:44:34.384 INFO:tasks.rados.rados.0.smithi137.stdout:816: copy_from oid 40 from oid 33 current snap is 84 2024-03-04T06:44:34.384 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 185 (ObjNum 106 snap 27 seq_num 106) dirty exists 2024-03-04T06:44:34.384 INFO:tasks.rados.rados.0.smithi137.stdout:814: finishing write tid 1 to smithi13777483-2 2024-03-04T06:44:34.384 INFO:tasks.rados.rados.0.smithi137.stdout:814: finishing write tid 2 to smithi13777483-2 2024-03-04T06:44:34.384 INFO:tasks.rados.rados.0.smithi137.stdout:814: finishing write tid 3 to smithi13777483-2 2024-03-04T06:44:34.384 INFO:tasks.rados.rados.0.smithi137.stdout:813: done (3 left) 2024-03-04T06:44:34.384 INFO:tasks.rados.rados.0.smithi137.stdout:817: snap_remove snap 66 2024-03-04T06:44:34.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:34 smithi203 ceph-mon[30756]: osdmap e216: 8 total, 8 up, 8 in 2024-03-04T06:44:34.767 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:34 smithi137 ceph-mon[88869]: osdmap e216: 8 total, 8 up, 8 in 2024-03-04T06:44:34.768 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:34 smithi137 ceph-mon[37364]: osdmap e216: 8 total, 8 up, 8 in 2024-03-04T06:44:34.844 INFO:tasks.rados.rados.0.smithi137.stdout:817: done (3 left) 2024-03-04T06:44:34.844 INFO:tasks.rados.rados.0.smithi137.stdout:818: setattr oid 27 current snap is 84 2024-03-04T06:44:34.846 INFO:tasks.rados.rados.0.smithi137.stdout:814: finishing write tid 4 to smithi13777483-2 2024-03-04T06:44:34.846 INFO:tasks.rados.rados.0.smithi137.stdout:814: finishing write tid 5 to smithi13777483-2 2024-03-04T06:44:34.846 INFO:tasks.rados.rados.0.smithi137.stdout:814: finishing write tid 6 to smithi13777483-2 2024-03-04T06:44:34.846 INFO:tasks.rados.rados.0.smithi137.stdout:814: oid 2 updating version 0 to 190 2024-03-04T06:44:34.847 INFO:tasks.rados.rados.0.smithi137.stdout:814: oid 2 version 190 is already newer than 188 2024-03-04T06:44:34.847 INFO:tasks.rados.rados.0.smithi137.stdout:814: oid 2 version 190 is already newer than 187 2024-03-04T06:44:34.847 INFO:tasks.rados.rados.0.smithi137.stdout:814: oid 2 version 190 is already newer than 186 2024-03-04T06:44:34.847 INFO:tasks.rados.rados.0.smithi137.stdout:814: oid 2 version 190 is already newer than 189 2024-03-04T06:44:34.847 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 190 (ObjNum 267 snap 84 seq_num 267) dirty exists 2024-03-04T06:44:34.847 INFO:tasks.rados.rados.0.smithi137.stdout:814: left oid 2 (ObjNum 267 snap 84 seq_num 267) 2024-03-04T06:44:34.847 INFO:tasks.rados.rados.0.smithi137.stdout:816: finishing copy_from to smithi13777483-40 2024-03-04T06:44:34.847 INFO:tasks.rados.rados.0.smithi137.stdout:816: got expected ENOENT (src dne) 2024-03-04T06:44:34.847 INFO:tasks.rados.rados.0.smithi137.stdout:816: finishing copy_from racing read to smithi13777483-40 2024-03-04T06:44:34.847 INFO:tasks.rados.rados.0.smithi137.stdout:815: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:44:35.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:34.767+0000 7fcad2e37200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T06:44:35.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:34.912+0000 7fcad2e37200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T06:44:35.073 INFO:tasks.rados.rados.0.smithi137.stdout:814: done (3 left) 2024-03-04T06:44:35.073 INFO:tasks.rados.rados.0.smithi137.stdout:815: done (2 left) 2024-03-04T06:44:35.073 INFO:tasks.rados.rados.0.smithi137.stdout:816: done (1 left) 2024-03-04T06:44:35.073 INFO:tasks.rados.rados.0.smithi137.stdout:819: snap_create 2024-03-04T06:44:35.075 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 537 (ObjNum 33 snap 0 seq_num 3132065936) dirty exists 2024-03-04T06:44:35.095 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:34.759+0000 7ff48d16b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T06:44:35.096 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:34.902+0000 7ff48d16b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T06:44:35.528 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:35 smithi203 ceph-mon[30756]: osdmap e217: 8 total, 8 up, 8 in 2024-03-04T06:44:35.528 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:35 smithi203 ceph-mon[30756]: osdmap e218: 8 total, 8 up, 8 in 2024-03-04T06:44:35.529 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:35.237+0000 7ff48d16b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T06:44:35.529 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:35.329+0000 7ff48d16b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T06:44:35.538 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:35 smithi137 ceph-mon[88869]: osdmap e217: 8 total, 8 up, 8 in 2024-03-04T06:44:35.538 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:35 smithi137 ceph-mon[88869]: osdmap e218: 8 total, 8 up, 8 in 2024-03-04T06:44:35.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:35 smithi137 ceph-mon[37364]: osdmap e217: 8 total, 8 up, 8 in 2024-03-04T06:44:35.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:35 smithi137 ceph-mon[37364]: osdmap e218: 8 total, 8 up, 8 in 2024-03-04T06:44:35.539 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:35.251+0000 7fcad2e37200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T06:44:35.539 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:35.342+0000 7fcad2e37200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T06:44:35.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:35.538+0000 7fcad2e37200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:44:35.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:35.725+0000 7fcad2e37200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T06:44:35.843 INFO:tasks.rados.rados.0.smithi137.stdout:818: done (1 left) 2024-03-04T06:44:35.843 INFO:tasks.rados.rados.0.smithi137.stdout:819: done (0 left) 2024-03-04T06:44:35.843 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 37 current snap is 85 2024-03-04T06:44:35.843 INFO:tasks.rados.rados.0.smithi137.stdout:820: seq_num 268 ranges {4571136=491520,5062656=745472,5808128=745472,6553600=114688} 2024-03-04T06:44:35.845 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:35.527+0000 7ff48d16b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:44:35.845 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:35.713+0000 7ff48d16b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T06:44:35.871 INFO:tasks.rados.rados.0.smithi137.stdout:820: writing smithi13777483-37 from 4571136 to 5062656 tid 1 2024-03-04T06:44:35.876 INFO:tasks.rados.rados.0.smithi137.stdout:820: writing smithi13777483-37 from 5062656 to 5808128 tid 2 2024-03-04T06:44:35.882 INFO:tasks.rados.rados.0.smithi137.stdout:820: writing smithi13777483-37 from 5808128 to 6553600 tid 3 2024-03-04T06:44:35.883 INFO:tasks.rados.rados.0.smithi137.stdout:820: writing smithi13777483-37 from 6553600 to 6668288 tid 4 2024-03-04T06:44:35.883 INFO:tasks.rados.rados.0.smithi137.stdout:821: snap_create 2024-03-04T06:44:35.883 INFO:tasks.rados.rados.0.smithi137.stdout:820: finishing write tid 1 to smithi13777483-37 2024-03-04T06:44:35.883 INFO:tasks.rados.rados.0.smithi137.stdout:820: finishing write tid 2 to smithi13777483-37 2024-03-04T06:44:35.886 INFO:tasks.rados.rados.0.smithi137.stdout:820: finishing write tid 3 to smithi13777483-37 2024-03-04T06:44:35.886 INFO:tasks.rados.rados.0.smithi137.stdout:820: finishing write tid 4 to smithi13777483-37 2024-03-04T06:44:35.886 INFO:tasks.rados.rados.0.smithi137.stdout:820: finishing write tid 5 to smithi13777483-37 2024-03-04T06:44:35.887 INFO:tasks.rados.rados.0.smithi137.stdout:820: finishing write tid 6 to smithi13777483-37 2024-03-04T06:44:35.887 INFO:tasks.rados.rados.0.smithi137.stdout:820: oid 37 updating version 0 to 430 2024-03-04T06:44:35.887 INFO:tasks.rados.rados.0.smithi137.stdout:820: oid 37 version 430 is already newer than 429 2024-03-04T06:44:35.887 INFO:tasks.rados.rados.0.smithi137.stdout:820: oid 37 version 430 is already newer than 427 2024-03-04T06:44:35.887 INFO:tasks.rados.rados.0.smithi137.stdout:820: oid 37 version 430 is already newer than 428 2024-03-04T06:44:35.887 INFO:tasks.rados.rados.0.smithi137.stdout:820: oid 37 updating version 430 to 431 2024-03-04T06:44:35.887 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 431 (ObjNum 268 snap 85 seq_num 268) dirty exists 2024-03-04T06:44:35.888 INFO:tasks.rados.rados.0.smithi137.stdout:820: left oid 37 (ObjNum 268 snap 85 seq_num 268) 2024-03-04T06:44:36.270 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:36.006+0000 7ff48d16b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:44:36.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:36.032+0000 7fcad2e37200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T06:44:36.595 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:36.268+0000 7ff48d16b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T06:44:36.596 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:36.508+0000 7ff48d16b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T06:44:36.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:36.293+0000 7fcad2e37200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T06:44:36.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:36.529+0000 7fcad2e37200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T06:44:36.851 INFO:tasks.rados.rados.0.smithi137.stdout:820: done (1 left) 2024-03-04T06:44:36.851 INFO:tasks.rados.rados.0.smithi137.stdout:821: done (0 left) 2024-03-04T06:44:36.851 INFO:tasks.rados.rados.0.smithi137.stdout:822: read oid 11 snap 83 2024-03-04T06:44:36.851 INFO:tasks.rados.rados.0.smithi137.stdout:822: expect (ObjNum 219 snap 63 seq_num 219) 2024-03-04T06:44:36.851 INFO:tasks.rados.rados.0.smithi137.stdout:823: snap_create 2024-03-04T06:44:36.857 INFO:tasks.rados.rados.0.smithi137.stdout:822: expect (ObjNum 219 snap 63 seq_num 219) 2024-03-04T06:44:37.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:36 smithi203 ceph-mon[30756]: osdmap e219: 8 total, 8 up, 8 in 2024-03-04T06:44:37.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:36 smithi137 ceph-mon[88869]: osdmap e219: 8 total, 8 up, 8 in 2024-03-04T06:44:37.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:36 smithi137 ceph-mon[37364]: osdmap e219: 8 total, 8 up, 8 in 2024-03-04T06:44:37.595 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:37.319+0000 7ff48d16b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T06:44:37.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:37.355+0000 7fcad2e37200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T06:44:37.851 INFO:tasks.rados.rados.0.smithi137.stdout:822: done (1 left) 2024-03-04T06:44:37.851 INFO:tasks.rados.rados.0.smithi137.stdout:823: done (0 left) 2024-03-04T06:44:37.851 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 87 2024-03-04T06:44:37.851 INFO:tasks.rados.rados.0.smithi137.stdout:824: seq_num 269 ranges {0=507904,507904=630784,1138688=557056,1695744=417792} 2024-03-04T06:44:37.854 INFO:tasks.rados.rados.0.smithi137.stdout:824: writing smithi13777483-10 from 0 to 507904 tid 1 2024-03-04T06:44:37.858 INFO:tasks.rados.rados.0.smithi137.stdout:824: writing smithi13777483-10 from 507904 to 1138688 tid 2 2024-03-04T06:44:37.861 INFO:tasks.rados.rados.0.smithi137.stdout:824: writing smithi13777483-10 from 1138688 to 1695744 tid 3 2024-03-04T06:44:37.865 INFO:tasks.rados.rados.0.smithi137.stdout:824: writing smithi13777483-10 from 1695744 to 2113536 tid 4 2024-03-04T06:44:37.865 INFO:tasks.rados.rados.0.smithi137.stdout:825: copy_from oid 5 from oid 16 current snap is 87 2024-03-04T06:44:37.865 INFO:tasks.rados.rados.0.smithi137.stdout:824: finishing write tid 1 to smithi13777483-10 2024-03-04T06:44:37.865 INFO:tasks.rados.rados.0.smithi137.stdout:824: finishing write tid 2 to smithi13777483-10 2024-03-04T06:44:37.865 INFO:tasks.rados.rados.0.smithi137.stdout:824: finishing write tid 3 to smithi13777483-10 2024-03-04T06:44:37.865 INFO:tasks.rados.rados.0.smithi137.stdout:826: copy_from oid 36 from oid 3 current snap is 87 2024-03-04T06:44:37.865 INFO:tasks.rados.rados.0.smithi137.stdout:827: read oid 6 snap -1 2024-03-04T06:44:37.865 INFO:tasks.rados.rados.0.smithi137.stdout:827: expect (ObjNum 216 snap 63 seq_num 216) 2024-03-04T06:44:37.865 INFO:tasks.rados.rados.0.smithi137.stdout:828: rmattr oid 7 current snap is 87 2024-03-04T06:44:37.866 INFO:tasks.rados.rados.0.smithi137.stdout:828: done (4 left) 2024-03-04T06:44:37.866 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 87 2024-03-04T06:44:37.866 INFO:tasks.rados.rados.0.smithi137.stdout:829: seq_num 270 ranges {0=524288,524288=516096,1040384=761856,1802240=327680} 2024-03-04T06:44:37.868 INFO:tasks.rados.rados.0.smithi137.stdout:829: writing smithi13777483-49 from 0 to 524288 tid 1 2024-03-04T06:44:37.871 INFO:tasks.rados.rados.0.smithi137.stdout:829: writing smithi13777483-49 from 524288 to 1040384 tid 2 2024-03-04T06:44:37.876 INFO:tasks.rados.rados.0.smithi137.stdout:829: writing smithi13777483-49 from 1040384 to 1802240 tid 3 2024-03-04T06:44:37.879 INFO:tasks.rados.rados.0.smithi137.stdout:829: writing smithi13777483-49 from 1802240 to 2129920 tid 4 2024-03-04T06:44:37.879 INFO:tasks.rados.rados.0.smithi137.stdout:830: read oid 17 snap -1 2024-03-04T06:44:37.879 INFO:tasks.rados.rados.0.smithi137.stdout:830: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:44:37.879 INFO:tasks.rados.rados.0.smithi137.stdout:831: rollback oid 4 current snap is 87 2024-03-04T06:44:37.879 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 4 to 84 2024-03-04T06:44:37.879 INFO:tasks.rados.rados.0.smithi137.stdout:824: finishing write tid 4 to smithi13777483-10 2024-03-04T06:44:37.879 INFO:tasks.rados.rados.0.smithi137.stdout:824: finishing write tid 5 to smithi13777483-10 2024-03-04T06:44:37.879 INFO:tasks.rados.rados.0.smithi137.stdout:826: finishing copy_from to smithi13777483-36 2024-03-04T06:44:37.879 INFO:tasks.rados.rados.0.smithi137.stdout:826: got expected ENOENT (src dne) 2024-03-04T06:44:37.880 INFO:tasks.rados.rados.0.smithi137.stdout:826: finishing copy_from racing read to smithi13777483-36 2024-03-04T06:44:37.880 INFO:tasks.rados.rados.0.smithi137.stdout:824: finishing write tid 6 to smithi13777483-10 2024-03-04T06:44:37.880 INFO:tasks.rados.rados.0.smithi137.stdout:824: oid 10 updating version 0 to 426 2024-03-04T06:44:37.880 INFO:tasks.rados.rados.0.smithi137.stdout:824: oid 10 version 426 is already newer than 425 2024-03-04T06:44:37.880 INFO:tasks.rados.rados.0.smithi137.stdout:824: oid 10 version 426 is already newer than 424 2024-03-04T06:44:37.880 INFO:tasks.rados.rados.0.smithi137.stdout:824: oid 10 version 426 is already newer than 423 2024-03-04T06:44:37.880 INFO:tasks.rados.rados.0.smithi137.stdout:824: oid 10 version 426 is already newer than 422 2024-03-04T06:44:37.880 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 426 (ObjNum 269 snap 87 seq_num 269) dirty exists 2024-03-04T06:44:37.880 INFO:tasks.rados.rados.0.smithi137.stdout:824: left oid 10 (ObjNum 269 snap 87 seq_num 269) 2024-03-04T06:44:37.880 INFO:tasks.rados.rados.0.smithi137.stdout:827: expect (ObjNum 216 snap 63 seq_num 216) 2024-03-04T06:44:37.914 INFO:tasks.rados.rados.0.smithi137.stdout:829: finishing write tid 1 to smithi13777483-49 2024-03-04T06:44:37.914 INFO:tasks.rados.rados.0.smithi137.stdout:829: finishing write tid 2 to smithi13777483-49 2024-03-04T06:44:37.914 INFO:tasks.rados.rados.0.smithi137.stdout:824: done (6 left) 2024-03-04T06:44:37.914 INFO:tasks.rados.rados.0.smithi137.stdout:826: done (5 left) 2024-03-04T06:44:37.914 INFO:tasks.rados.rados.0.smithi137.stdout:827: done (4 left) 2024-03-04T06:44:37.914 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 87 2024-03-04T06:44:37.914 INFO:tasks.rados.rados.0.smithi137.stdout:832: seq_num 271 ranges {0=540672,540672=802816,1343488=516096,1859584=286720} 2024-03-04T06:44:37.917 INFO:tasks.rados.rados.0.smithi137.stdout:832: writing smithi13777483-25 from 0 to 540672 tid 1 2024-03-04T06:44:37.921 INFO:tasks.rados.rados.0.smithi137.stdout:832: writing smithi13777483-25 from 540672 to 1343488 tid 2 2024-03-04T06:44:37.925 INFO:tasks.rados.rados.0.smithi137.stdout:832: writing smithi13777483-25 from 1343488 to 1859584 tid 3 2024-03-04T06:44:37.926 INFO:tasks.rados.rados.0.smithi137.stdout:832: writing smithi13777483-25 from 1859584 to 2146304 tid 4 2024-03-04T06:44:37.926 INFO:tasks.rados.rados.0.smithi137.stdout:833: copy_from oid 23 from oid 7 current snap is 87 2024-03-04T06:44:37.927 INFO:tasks.rados.rados.0.smithi137.stdout:830: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:44:37.932 INFO:tasks.rados.rados.0.smithi137.stdout:829: finishing write tid 3 to smithi13777483-49 2024-03-04T06:44:37.932 INFO:tasks.rados.rados.0.smithi137.stdout:831: finishing rollback tid 1 to smithi13777483-4 2024-03-04T06:44:37.932 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 0 (ObjNum 177 snap 0 seq_num 0) dirty dne 2024-03-04T06:44:37.932 INFO:tasks.rados.rados.0.smithi137.stdout:829: finishing write tid 4 to smithi13777483-49 2024-03-04T06:44:37.932 INFO:tasks.rados.rados.0.smithi137.stdout:830: done (5 left) 2024-03-04T06:44:37.932 INFO:tasks.rados.rados.0.smithi137.stdout:831: done (4 left) 2024-03-04T06:44:37.932 INFO:tasks.rados.rados.0.smithi137.stdout:834: snap_create 2024-03-04T06:44:37.932 INFO:tasks.rados.rados.0.smithi137.stdout:825: finishing copy_from racing read to smithi13777483-5 2024-03-04T06:44:37.932 INFO:tasks.rados.rados.0.smithi137.stdout:829: finishing write tid 5 to smithi13777483-49 2024-03-04T06:44:37.932 INFO:tasks.rados.rados.0.smithi137.stdout:825: finishing copy_from to smithi13777483-5 2024-03-04T06:44:37.932 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 131 (ObjNum 101 snap 21 seq_num 101) dirty exists 2024-03-04T06:44:37.932 INFO:tasks.rados.rados.0.smithi137.stdout:829: finishing write tid 6 to smithi13777483-49 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:829: oid 49 updating version 0 to 324 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:829: oid 49 updating version 324 to 325 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:829: oid 49 version 325 is already newer than 322 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:829: oid 49 version 325 is already newer than 323 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:829: oid 49 updating version 325 to 326 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 326 (ObjNum 270 snap 87 seq_num 270) dirty exists 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:829: left oid 49 (ObjNum 270 snap 87 seq_num 270) 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:832: finishing write tid 1 to smithi13777483-25 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:832: finishing write tid 2 to smithi13777483-25 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:832: finishing write tid 3 to smithi13777483-25 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:832: finishing write tid 4 to smithi13777483-25 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:832: finishing write tid 5 to smithi13777483-25 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:832: finishing write tid 6 to smithi13777483-25 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:832: oid 25 updating version 0 to 445 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:832: oid 25 updating version 445 to 446 2024-03-04T06:44:37.933 INFO:tasks.rados.rados.0.smithi137.stdout:832: oid 25 version 446 is already newer than 443 2024-03-04T06:44:37.934 INFO:tasks.rados.rados.0.smithi137.stdout:832: oid 25 version 446 is already newer than 444 2024-03-04T06:44:37.934 INFO:tasks.rados.rados.0.smithi137.stdout:832: oid 25 version 446 is already newer than 442 2024-03-04T06:44:37.934 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 446 (ObjNum 271 snap 87 seq_num 271) dirty exists 2024-03-04T06:44:37.934 INFO:tasks.rados.rados.0.smithi137.stdout:832: left oid 25 (ObjNum 271 snap 87 seq_num 271) 2024-03-04T06:44:37.934 INFO:tasks.rados.rados.0.smithi137.stdout:833: finishing copy_from racing read to smithi13777483-23 2024-03-04T06:44:37.935 INFO:tasks.rados.rados.0.smithi137.stdout:833: finishing copy_from to smithi13777483-23 2024-03-04T06:44:37.935 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 136 (ObjNum 237 snap 71 seq_num 237) dirty exists 2024-03-04T06:44:38.226 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:37 smithi203 ceph-mon[30756]: osdmap e220: 8 total, 8 up, 8 in 2024-03-04T06:44:38.226 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:37.904+0000 7ff48d16b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T06:44:38.226 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:38.008+0000 7ff48d16b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T06:44:38.273 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:37 smithi137 ceph-mon[88869]: osdmap e220: 8 total, 8 up, 8 in 2024-03-04T06:44:38.273 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:37 smithi137 ceph-mon[37364]: osdmap e220: 8 total, 8 up, 8 in 2024-03-04T06:44:38.273 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:37.953+0000 7fcad2e37200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T06:44:38.273 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:38.052+0000 7fcad2e37200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T06:44:38.274 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:38.272+0000 7fcad2e37200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T06:44:38.298 INFO:tasks.rados.rados.0.smithi137.stdout:825: done (4 left) 2024-03-04T06:44:38.298 INFO:tasks.rados.rados.0.smithi137.stdout:829: done (3 left) 2024-03-04T06:44:38.298 INFO:tasks.rados.rados.0.smithi137.stdout:832: done (2 left) 2024-03-04T06:44:38.298 INFO:tasks.rados.rados.0.smithi137.stdout:833: done (1 left) 2024-03-04T06:44:38.298 INFO:tasks.rados.rados.0.smithi137.stdout:834: done (0 left) 2024-03-04T06:44:38.298 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 88 2024-03-04T06:44:38.298 INFO:tasks.rados.rados.0.smithi137.stdout:835: seq_num 272 ranges {0=565248,565248=688128,1253376=729088,1982464=188416} 2024-03-04T06:44:38.301 INFO:tasks.rados.rados.0.smithi137.stdout:835: writing smithi13777483-15 from 0 to 565248 tid 1 2024-03-04T06:44:38.305 INFO:tasks.rados.rados.0.smithi137.stdout:835: writing smithi13777483-15 from 565248 to 1253376 tid 2 2024-03-04T06:44:38.310 INFO:tasks.rados.rados.0.smithi137.stdout:835: writing smithi13777483-15 from 1253376 to 1982464 tid 3 2024-03-04T06:44:38.311 INFO:tasks.rados.rados.0.smithi137.stdout:835: writing smithi13777483-15 from 1982464 to 2170880 tid 4 2024-03-04T06:44:38.311 INFO:tasks.rados.rados.0.smithi137.stdout:836: delete oid 31 current snap is 88 2024-03-04T06:44:38.311 INFO:tasks.rados.rados.0.smithi137.stdout:835: finishing write tid 1 to smithi13777483-15 2024-03-04T06:44:38.311 INFO:tasks.rados.rados.0.smithi137.stdout:835: finishing write tid 2 to smithi13777483-15 2024-03-04T06:44:38.314 INFO:tasks.rados.rados.0.smithi137.stdout:835: finishing write tid 3 to smithi13777483-15 2024-03-04T06:44:38.314 INFO:tasks.rados.rados.0.smithi137.stdout:835: finishing write tid 4 to smithi13777483-15 2024-03-04T06:44:38.314 INFO:tasks.rados.rados.0.smithi137.stdout:835: finishing write tid 5 to smithi13777483-15 2024-03-04T06:44:38.315 INFO:tasks.rados.rados.0.smithi137.stdout:836: done (1 left) 2024-03-04T06:44:38.315 INFO:tasks.rados.rados.0.smithi137.stdout:837: snap_create 2024-03-04T06:44:38.316 INFO:tasks.rados.rados.0.smithi137.stdout:835: finishing write tid 6 to smithi13777483-15 2024-03-04T06:44:38.316 INFO:tasks.rados.rados.0.smithi137.stdout:835: oid 15 updating version 0 to 436 2024-03-04T06:44:38.316 INFO:tasks.rados.rados.0.smithi137.stdout:835: oid 15 version 436 is already newer than 435 2024-03-04T06:44:38.316 INFO:tasks.rados.rados.0.smithi137.stdout:835: oid 15 version 436 is already newer than 432 2024-03-04T06:44:38.316 INFO:tasks.rados.rados.0.smithi137.stdout:835: oid 15 version 436 is already newer than 433 2024-03-04T06:44:38.316 INFO:tasks.rados.rados.0.smithi137.stdout:835: oid 15 version 436 is already newer than 434 2024-03-04T06:44:38.316 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 436 (ObjNum 272 snap 88 seq_num 272) dirty exists 2024-03-04T06:44:38.316 INFO:tasks.rados.rados.0.smithi137.stdout:835: left oid 15 (ObjNum 272 snap 88 seq_num 272) 2024-03-04T06:44:38.489 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:38.224+0000 7ff48d16b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T06:44:38.489 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: [04/Mar/2024:06:44:38] ENGINE Bus STARTING 2024-03-04T06:44:38.489 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: CherryPy Checker: 2024-03-04T06:44:38.489 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: The Application mounted at '' has an empty config. 2024-03-04T06:44:38.489 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: 2024-03-04T06:44:38.489 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: [04/Mar/2024:06:44:38] ENGINE Serving on http://:::9283 2024-03-04T06:44:38.489 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x[76986]: [04/Mar/2024:06:44:38] ENGINE Bus STARTED 2024-03-04T06:44:38.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:06:44:38] ENGINE Bus STARTING 2024-03-04T06:44:38.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:38.434+0000 7fca2f250700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:44:38.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:38.434+0000 7fca2f250700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:44:38.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:38.434+0000 7fca2f250700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:44:38.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:38.434+0000 7fca2f250700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:44:38.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:38.434+0000 7fca2f250700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:44:38.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:38.436+0000 7fca31a55700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:44:38.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:38.436+0000 7fca31a55700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:44:38.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:38.436+0000 7fca31a55700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:44:38.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:38.436+0000 7fca31a55700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:44:38.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:38.436+0000 7fca31a55700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T06:44:38.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: CherryPy Checker: 2024-03-04T06:44:38.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: The Application mounted at '' has an empty config. 2024-03-04T06:44:38.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:38.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:06:44:38] ENGINE Serving on http://:::9283 2024-03-04T06:44:38.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:06:44:38] ENGINE Bus STARTED 2024-03-04T06:44:39.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: osdmap e221: 8 total, 8 up, 8 in 2024-03-04T06:44:39.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: Standby manager daemon x restarted 2024-03-04T06:44:39.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: Standby manager daemon x started 2024-03-04T06:44:39.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/3474292275' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:44:39.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/3474292275' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:44:39.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/3474292275' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:44:39.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.? 172.21.15.203:0/3474292275' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:44:39.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: Active manager daemon y restarted 2024-03-04T06:44:39.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: Activating manager daemon y 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: osdmap e222: 8 total, 8 up, 8 in 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: mgrmap e36: y(active, starting, since 0.00576425s), standbys: x 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:44:39.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:44:39.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:44:39.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:44:39.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:44:39.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:44:39.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:44:39.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: Manager daemon y is now available 2024-03-04T06:44:39.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:39.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:39.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:44:39.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:44:39.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: osdmap e221: 8 total, 8 up, 8 in 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: Standby manager daemon x restarted 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: Standby manager daemon x started 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.? 172.21.15.203:0/3474292275' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.? 172.21.15.203:0/3474292275' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.? 172.21.15.203:0/3474292275' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.? 172.21.15.203:0/3474292275' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: Active manager daemon y restarted 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: Activating manager daemon y 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: osdmap e222: 8 total, 8 up, 8 in 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: mgrmap e36: y(active, starting, since 0.00576425s), standbys: x 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:44:39.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:44:39.298 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:44:39.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: Manager daemon y is now available 2024-03-04T06:44:39.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:39.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:39.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:44:39.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:44:39.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:44:39.305 INFO:tasks.rados.rados.0.smithi137.stdout:835: done (1 left) 2024-03-04T06:44:39.306 INFO:tasks.rados.rados.0.smithi137.stdout:837: done (0 left) 2024-03-04T06:44:39.306 INFO:tasks.rados.rados.0.smithi137.stdout:838: copy_from oid 33 from oid 44 current snap is 89 2024-03-04T06:44:39.306 INFO:tasks.rados.rados.0.smithi137.stdout:839: delete oid 3 current snap is 89 2024-03-04T06:44:39.308 INFO:tasks.rados.rados.0.smithi137.stdout:839: done (1 left) 2024-03-04T06:44:39.308 INFO:tasks.rados.rados.0.smithi137.stdout:840: snap_remove snap 81 2024-03-04T06:44:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: osdmap e221: 8 total, 8 up, 8 in 2024-03-04T06:44:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: Standby manager daemon x restarted 2024-03-04T06:44:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: Standby manager daemon x started 2024-03-04T06:44:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/3474292275' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-04T06:44:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/3474292275' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T06:44:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/3474292275' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-04T06:44:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.? 172.21.15.203:0/3474292275' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T06:44:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: Active manager daemon y restarted 2024-03-04T06:44:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: Activating manager daemon y 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: osdmap e222: 8 total, 8 up, 8 in 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: mgrmap e36: y(active, starting, since 0.00576425s), standbys: x 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:44:39.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:44:39.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:44:39.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T06:44:39.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T06:44:39.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T06:44:39.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: Manager daemon y is now available 2024-03-04T06:44:39.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:39.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:39.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:44:39.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-04T06:44:39.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:38 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-04T06:44:39.695 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:39.301+0000 7fca9a02c700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-03-04T06:44:40.312 INFO:tasks.rados.rados.0.smithi137.stdout:840: done (1 left) 2024-03-04T06:44:40.312 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 89 2024-03-04T06:44:40.312 INFO:tasks.rados.rados.0.smithi137.stdout:838: finishing copy_from racing read to smithi13777483-33 2024-03-04T06:44:40.312 INFO:tasks.rados.rados.0.smithi137.stdout:838: finishing copy_from to smithi13777483-33 2024-03-04T06:44:40.312 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 244 (ObjNum 216 snap 63 seq_num 216) dirty exists 2024-03-04T06:44:40.312 INFO:tasks.rados.rados.0.smithi137.stdout:841: seq_num 275 ranges {753664=614400,1368064=786432,2154496=499712,2654208=319488} 2024-03-04T06:44:40.319 INFO:tasks.rados.rados.0.smithi137.stdout:841: writing smithi13777483-21 from 753664 to 1368064 tid 1 2024-03-04T06:44:40.325 INFO:tasks.rados.rados.0.smithi137.stdout:841: writing smithi13777483-21 from 1368064 to 2154496 tid 2 2024-03-04T06:44:40.328 INFO:tasks.rados.rados.0.smithi137.stdout:841: writing smithi13777483-21 from 2154496 to 2654208 tid 3 2024-03-04T06:44:40.330 INFO:tasks.rados.rados.0.smithi137.stdout:841: writing smithi13777483-21 from 2654208 to 2973696 tid 4 2024-03-04T06:44:40.331 INFO:tasks.rados.rados.0.smithi137.stdout:838: done (1 left) 2024-03-04T06:44:40.331 INFO:tasks.rados.rados.0.smithi137.stdout:842: read oid 26 snap -1 2024-03-04T06:44:40.331 INFO:tasks.rados.rados.0.smithi137.stdout:842: expect (ObjNum 223 snap 65 seq_num 223) 2024-03-04T06:44:40.331 INFO:tasks.rados.rados.0.smithi137.stdout:841: finishing write tid 1 to smithi13777483-21 2024-03-04T06:44:40.331 INFO:tasks.rados.rados.0.smithi137.stdout:841: finishing write tid 2 to smithi13777483-21 2024-03-04T06:44:40.331 INFO:tasks.rados.rados.0.smithi137.stdout:843: rollback oid 4 current snap is 89 2024-03-04T06:44:40.331 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 4 to 63 2024-03-04T06:44:40.331 INFO:tasks.rados.rados.0.smithi137.stdout:844: snap_remove snap 83 2024-03-04T06:44:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:40 smithi203 ceph-mon[30756]: [04/Mar/2024:06:44:39] ENGINE Bus STARTING 2024-03-04T06:44:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:40 smithi203 ceph-mon[30756]: [04/Mar/2024:06:44:39] ENGINE Serving on http://172.21.15.137:8765 2024-03-04T06:44:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:40 smithi203 ceph-mon[30756]: mgrmap e37: y(active, since 1.01193s), standbys: x 2024-03-04T06:44:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:40 smithi203 ceph-mon[30756]: [04/Mar/2024:06:44:39] ENGINE Serving on https://172.21.15.137:7150 2024-03-04T06:44:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:40 smithi203 ceph-mon[30756]: [04/Mar/2024:06:44:39] ENGINE Bus STARTED 2024-03-04T06:44:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:40 smithi203 ceph-mon[30756]: osdmap e223: 8 total, 8 up, 8 in 2024-03-04T06:44:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:40 smithi203 ceph-mon[30756]: pgmap v4: 121 pgs: 121 active+clean; 255 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[88869]: [04/Mar/2024:06:44:39] ENGINE Bus STARTING 2024-03-04T06:44:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[88869]: [04/Mar/2024:06:44:39] ENGINE Serving on http://172.21.15.137:8765 2024-03-04T06:44:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[88869]: mgrmap e37: y(active, since 1.01193s), standbys: x 2024-03-04T06:44:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[88869]: [04/Mar/2024:06:44:39] ENGINE Serving on https://172.21.15.137:7150 2024-03-04T06:44:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[88869]: [04/Mar/2024:06:44:39] ENGINE Bus STARTED 2024-03-04T06:44:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[88869]: osdmap e223: 8 total, 8 up, 8 in 2024-03-04T06:44:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[88869]: pgmap v4: 121 pgs: 121 active+clean; 255 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[37364]: [04/Mar/2024:06:44:39] ENGINE Bus STARTING 2024-03-04T06:44:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[37364]: [04/Mar/2024:06:44:39] ENGINE Serving on http://172.21.15.137:8765 2024-03-04T06:44:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[37364]: mgrmap e37: y(active, since 1.01193s), standbys: x 2024-03-04T06:44:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[37364]: [04/Mar/2024:06:44:39] ENGINE Serving on https://172.21.15.137:7150 2024-03-04T06:44:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[37364]: [04/Mar/2024:06:44:39] ENGINE Bus STARTED 2024-03-04T06:44:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[37364]: osdmap e223: 8 total, 8 up, 8 in 2024-03-04T06:44:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:40 smithi137 ceph-mon[37364]: pgmap v4: 121 pgs: 121 active+clean; 255 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:41.321 INFO:tasks.rados.rados.0.smithi137.stdout:844: done (3 left) 2024-03-04T06:44:41.321 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 89 2024-03-04T06:44:41.321 INFO:tasks.rados.rados.0.smithi137.stdout:843: finishing rollback tid 1 to smithi13777483-4 2024-03-04T06:44:41.321 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 0 (ObjNum 2945 snap 0 seq_num 3162485424) dirty dne 2024-03-04T06:44:41.321 INFO:tasks.rados.rados.0.smithi137.stdout:841: finishing write tid 3 to smithi13777483-21 2024-03-04T06:44:41.321 INFO:tasks.rados.rados.0.smithi137.stdout:841: finishing write tid 4 to smithi13777483-21 2024-03-04T06:44:41.321 INFO:tasks.rados.rados.0.smithi137.stdout:841: finishing write tid 5 to smithi13777483-21 2024-03-04T06:44:41.322 INFO:tasks.rados.rados.0.smithi137.stdout:841: finishing write tid 6 to smithi13777483-21 2024-03-04T06:44:41.322 INFO:tasks.rados.rados.0.smithi137.stdout:841: oid 21 updating version 0 to 454 2024-03-04T06:44:41.322 INFO:tasks.rados.rados.0.smithi137.stdout:841: oid 21 version 454 is already newer than 452 2024-03-04T06:44:41.322 INFO:tasks.rados.rados.0.smithi137.stdout:841: oid 21 version 454 is already newer than 453 2024-03-04T06:44:41.322 INFO:tasks.rados.rados.0.smithi137.stdout:841: oid 21 version 454 is already newer than 448 2024-03-04T06:44:41.322 INFO:tasks.rados.rados.0.smithi137.stdout:841: oid 21 version 454 is already newer than 449 2024-03-04T06:44:41.322 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 454 (ObjNum 275 snap 89 seq_num 275) dirty exists 2024-03-04T06:44:41.322 INFO:tasks.rados.rados.0.smithi137.stdout:841: left oid 21 (ObjNum 275 snap 89 seq_num 275) 2024-03-04T06:44:41.322 INFO:tasks.rados.rados.0.smithi137.stdout:842: expect (ObjNum 223 snap 65 seq_num 223) 2024-03-04T06:44:41.458 INFO:tasks.rados.rados.0.smithi137.stdout:845: seq_num 276 ranges {0=630784,630784=671744,1302528=704512,2007040=229376} 2024-03-04T06:44:41.462 INFO:tasks.rados.rados.0.smithi137.stdout:845: writing smithi13777483-42 from 0 to 630784 tid 1 2024-03-04T06:44:41.466 INFO:tasks.rados.rados.0.smithi137.stdout:845: writing smithi13777483-42 from 630784 to 1302528 tid 2 2024-03-04T06:44:41.471 INFO:tasks.rados.rados.0.smithi137.stdout:845: writing smithi13777483-42 from 1302528 to 2007040 tid 3 2024-03-04T06:44:41.473 INFO:tasks.rados.rados.0.smithi137.stdout:845: writing smithi13777483-42 from 2007040 to 2236416 tid 4 2024-03-04T06:44:41.473 INFO:tasks.rados.rados.0.smithi137.stdout:841: done (3 left) 2024-03-04T06:44:41.473 INFO:tasks.rados.rados.0.smithi137.stdout:842: done (2 left) 2024-03-04T06:44:41.473 INFO:tasks.rados.rados.0.smithi137.stdout:843: done (1 left) 2024-03-04T06:44:41.473 INFO:tasks.rados.rados.0.smithi137.stdout:846: read oid 39 snap -1 2024-03-04T06:44:41.473 INFO:tasks.rados.rados.0.smithi137.stdout:846: expect (ObjNum 219 snap 63 seq_num 219) 2024-03-04T06:44:41.473 INFO:tasks.rados.rados.0.smithi137.stdout:847: setattr oid 31 current snap is 89 2024-03-04T06:44:41.473 INFO:tasks.rados.rados.0.smithi137.stdout:845: finishing write tid 1 to smithi13777483-42 2024-03-04T06:44:41.473 INFO:tasks.rados.rados.0.smithi137.stdout:845: finishing write tid 2 to smithi13777483-42 2024-03-04T06:44:41.474 INFO:tasks.rados.rados.0.smithi137.stdout:848: delete oid 12 current snap is 89 2024-03-04T06:44:41.474 INFO:tasks.rados.rados.0.smithi137.stdout:845: finishing write tid 3 to smithi13777483-42 2024-03-04T06:44:41.475 INFO:tasks.rados.rados.0.smithi137.stdout:845: finishing write tid 4 to smithi13777483-42 2024-03-04T06:44:41.475 INFO:tasks.rados.rados.0.smithi137.stdout:845: finishing write tid 5 to smithi13777483-42 2024-03-04T06:44:41.477 INFO:tasks.rados.rados.0.smithi137.stdout:848: done (3 left) 2024-03-04T06:44:41.477 INFO:tasks.rados.rados.0.smithi137.stdout:849: rollback oid 48 current snap is 89 2024-03-04T06:44:41.477 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 48 to 82 2024-03-04T06:44:41.477 INFO:tasks.rados.rados.0.smithi137.stdout:850: rollback oid 3 current snap is 89 2024-03-04T06:44:41.477 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 3 to 85 2024-03-04T06:44:41.477 INFO:tasks.rados.rados.0.smithi137.stdout:851: rmattr oid 28 current snap is 89 2024-03-04T06:44:41.477 INFO:tasks.rados.rados.0.smithi137.stdout:852: read oid 43 snap -1 2024-03-04T06:44:41.477 INFO:tasks.rados.rados.0.smithi137.stdout:852: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:44:41.477 INFO:tasks.rados.rados.0.smithi137.stdout:853: rollback oid 44 current snap is 89 2024-03-04T06:44:41.477 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 44 to 26 2024-03-04T06:44:41.477 INFO:tasks.rados.rados.0.smithi137.stdout:854: read oid 4 snap -1 2024-03-04T06:44:41.478 INFO:tasks.rados.rados.0.smithi137.stdout:854: expect deleted 2024-03-04T06:44:41.478 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 89 2024-03-04T06:44:41.478 INFO:tasks.rados.rados.0.smithi137.stdout:855: seq_num 278 ranges {0=663552,663552=442368,1105920=720896,1826816=442368} 2024-03-04T06:44:41.481 INFO:tasks.rados.rados.0.smithi137.stdout:855: writing smithi13777483-46 from 0 to 663552 tid 1 2024-03-04T06:44:41.484 INFO:tasks.rados.rados.0.smithi137.stdout:855: writing smithi13777483-46 from 663552 to 1105920 tid 2 2024-03-04T06:44:41.488 INFO:tasks.rados.rados.0.smithi137.stdout:855: writing smithi13777483-46 from 1105920 to 1826816 tid 3 2024-03-04T06:44:41.491 INFO:tasks.rados.rados.0.smithi137.stdout:855: writing smithi13777483-46 from 1826816 to 2269184 tid 4 2024-03-04T06:44:41.491 INFO:tasks.rados.rados.0.smithi137.stdout:856: delete oid 10 current snap is 89 2024-03-04T06:44:41.491 INFO:tasks.rados.rados.0.smithi137.stdout:846: expect (ObjNum 219 snap 63 seq_num 219) 2024-03-04T06:44:41.526 INFO:tasks.rados.rados.0.smithi137.stdout:845: finishing write tid 6 to smithi13777483-42 2024-03-04T06:44:41.526 INFO:tasks.rados.rados.0.smithi137.stdout:845: oid 42 updating version 0 to 542 2024-03-04T06:44:41.526 INFO:tasks.rados.rados.0.smithi137.stdout:845: oid 42 version 542 is already newer than 540 2024-03-04T06:44:41.526 INFO:tasks.rados.rados.0.smithi137.stdout:845: oid 42 version 542 is already newer than 539 2024-03-04T06:44:41.526 INFO:tasks.rados.rados.0.smithi137.stdout:845: oid 42 updating version 542 to 543 2024-03-04T06:44:41.526 INFO:tasks.rados.rados.0.smithi137.stdout:845: oid 42 version 543 is already newer than 541 2024-03-04T06:44:41.526 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 543 (ObjNum 276 snap 89 seq_num 276) dirty exists 2024-03-04T06:44:41.526 INFO:tasks.rados.rados.0.smithi137.stdout:845: left oid 42 (ObjNum 276 snap 89 seq_num 276) 2024-03-04T06:44:41.526 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 460 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:44:41.526 INFO:tasks.rados.rados.0.smithi137.stdout:850: finishing rollback tid 1 to smithi13777483-3 2024-03-04T06:44:41.526 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 404 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-03-04T06:44:41.526 INFO:tasks.rados.rados.0.smithi137.stdout:849: finishing rollback tid 0 to smithi13777483-48 2024-03-04T06:44:41.526 INFO:tasks.rados.rados.0.smithi137.stdout:849: finishing rollback tid 1 to smithi13777483-48 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:853: finishing rollback tid 0 to smithi13777483-44 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:845: done (10 left) 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:846: done (9 left) 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:850: done (8 left) 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:851: done (7 left) 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:854: done (6 left) 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:856: done (5 left) 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:857: rmattr oid 20 current snap is 89 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:857: done (5 left) 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:858: setattr oid 41 current snap is 89 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:853: finishing rollback tid 1 to smithi13777483-44 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:853: finishing rollback tid 2 to smithi13777483-44 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 249 (ObjNum 77 snap 10 seq_num 77) dirty exists 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 334 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-03-04T06:44:41.527 INFO:tasks.rados.rados.0.smithi137.stdout:849: finishing rollback tid 2 to smithi13777483-48 2024-03-04T06:44:41.528 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 198 (ObjNum 106 snap 27 seq_num 106) dirty exists 2024-03-04T06:44:41.528 INFO:tasks.rados.rados.0.smithi137.stdout:852: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:44:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:41 smithi137 ceph-mon[88869]: pgmap v5: 121 pgs: 121 active+clean; 255 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:41 smithi137 ceph-mon[88869]: osdmap e224: 8 total, 8 up, 8 in 2024-03-04T06:44:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:41 smithi137 ceph-mon[88869]: mgrmap e38: y(active, since 3s), standbys: x 2024-03-04T06:44:41.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:41 smithi137 ceph-mon[37364]: pgmap v5: 121 pgs: 121 active+clean; 255 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:41.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:41 smithi137 ceph-mon[37364]: osdmap e224: 8 total, 8 up, 8 in 2024-03-04T06:44:41.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:41 smithi137 ceph-mon[37364]: mgrmap e38: y(active, since 3s), standbys: x 2024-03-04T06:44:41.564 INFO:tasks.rados.rados.0.smithi137.stdout:855: finishing write tid 1 to smithi13777483-46 2024-03-04T06:44:41.564 INFO:tasks.rados.rados.0.smithi137.stdout:855: finishing write tid 2 to smithi13777483-46 2024-03-04T06:44:41.564 INFO:tasks.rados.rados.0.smithi137.stdout:855: finishing write tid 3 to smithi13777483-46 2024-03-04T06:44:41.564 INFO:tasks.rados.rados.0.smithi137.stdout:855: finishing write tid 4 to smithi13777483-46 2024-03-04T06:44:41.564 INFO:tasks.rados.rados.0.smithi137.stdout:855: finishing write tid 5 to smithi13777483-46 2024-03-04T06:44:41.564 INFO:tasks.rados.rados.0.smithi137.stdout:855: finishing write tid 6 to smithi13777483-46 2024-03-04T06:44:41.564 INFO:tasks.rados.rados.0.smithi137.stdout:855: oid 46 updating version 0 to 546 2024-03-04T06:44:41.564 INFO:tasks.rados.rados.0.smithi137.stdout:855: oid 46 updating version 546 to 548 2024-03-04T06:44:41.564 INFO:tasks.rados.rados.0.smithi137.stdout:855: oid 46 updating version 548 to 549 2024-03-04T06:44:41.564 INFO:tasks.rados.rados.0.smithi137.stdout:855: oid 46 version 549 is already newer than 545 2024-03-04T06:44:41.565 INFO:tasks.rados.rados.0.smithi137.stdout:855: oid 46 version 549 is already newer than 547 2024-03-04T06:44:41.565 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 549 (ObjNum 278 snap 89 seq_num 278) dirty exists 2024-03-04T06:44:41.565 INFO:tasks.rados.rados.0.smithi137.stdout:855: left oid 46 (ObjNum 278 snap 89 seq_num 278) 2024-03-04T06:44:41.565 INFO:tasks.rados.rados.0.smithi137.stdout:847: done (5 left) 2024-03-04T06:44:41.565 INFO:tasks.rados.rados.0.smithi137.stdout:849: done (4 left) 2024-03-04T06:44:41.565 INFO:tasks.rados.rados.0.smithi137.stdout:852: done (3 left) 2024-03-04T06:44:41.565 INFO:tasks.rados.rados.0.smithi137.stdout:853: done (2 left) 2024-03-04T06:44:41.565 INFO:tasks.rados.rados.0.smithi137.stdout:855: done (1 left) 2024-03-04T06:44:41.565 INFO:tasks.rados.rados.0.smithi137.stdout:859: snap_remove snap 86 2024-03-04T06:44:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:41 smithi203 ceph-mon[30756]: pgmap v5: 121 pgs: 121 active+clean; 255 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:41 smithi203 ceph-mon[30756]: osdmap e224: 8 total, 8 up, 8 in 2024-03-04T06:44:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:41 smithi203 ceph-mon[30756]: mgrmap e38: y(active, since 3s), standbys: x 2024-03-04T06:44:42.326 INFO:tasks.rados.rados.0.smithi137.stdout:859: done (1 left) 2024-03-04T06:44:42.326 INFO:tasks.rados.rados.0.smithi137.stdout:860: rollback oid 16 current snap is 89 2024-03-04T06:44:42.326 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 16 to 62 2024-03-04T06:44:42.326 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 169 (ObjNum 0 snap 0 seq_num 304) dirty exists 2024-03-04T06:44:42.326 INFO:tasks.rados.rados.0.smithi137.stdout:858: done (1 left) 2024-03-04T06:44:42.326 INFO:tasks.rados.rados.0.smithi137.stdout:861: snap_remove snap 88 2024-03-04T06:44:42.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:42 smithi203 ceph-mon[30756]: osdmap e225: 8 total, 8 up, 8 in 2024-03-04T06:44:42.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:42 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:42.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:42 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:42.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:42 smithi137 ceph-mon[88869]: osdmap e225: 8 total, 8 up, 8 in 2024-03-04T06:44:42.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:42 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:42.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:42 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:42.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:42 smithi137 ceph-mon[37364]: osdmap e225: 8 total, 8 up, 8 in 2024-03-04T06:44:42.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:42 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:42 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:43.332 INFO:tasks.rados.rados.0.smithi137.stdout:861: done (1 left) 2024-03-04T06:44:43.332 INFO:tasks.rados.rados.0.smithi137.stdout:862: read oid 46 snap -1 2024-03-04T06:44:43.332 INFO:tasks.rados.rados.0.smithi137.stdout:862: expect (ObjNum 278 snap 89 seq_num 278) 2024-03-04T06:44:43.332 INFO:tasks.rados.rados.0.smithi137.stdout:863: copy_from oid 15 from oid 22 current snap is 89 2024-03-04T06:44:43.333 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 89 2024-03-04T06:44:43.333 INFO:tasks.rados.rados.0.smithi137.stdout:864: seq_num 280 ranges {0=696320,696320=606208,1302528=688128,1990656=311296} 2024-03-04T06:44:43.336 INFO:tasks.rados.rados.0.smithi137.stdout:864: writing smithi13777483-10 from 0 to 696320 tid 1 2024-03-04T06:44:43.341 INFO:tasks.rados.rados.0.smithi137.stdout:864: writing smithi13777483-10 from 696320 to 1302528 tid 2 2024-03-04T06:44:43.346 INFO:tasks.rados.rados.0.smithi137.stdout:864: writing smithi13777483-10 from 1302528 to 1990656 tid 3 2024-03-04T06:44:43.348 INFO:tasks.rados.rados.0.smithi137.stdout:864: writing smithi13777483-10 from 1990656 to 2301952 tid 4 2024-03-04T06:44:43.348 INFO:tasks.rados.rados.0.smithi137.stdout:865: read oid 43 snap 54 2024-03-04T06:44:43.348 INFO:tasks.rados.rados.0.smithi137.stdout:865: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:44:43.349 INFO:tasks.rados.rados.0.smithi137.stdout:866: copy_from oid 34 from oid 19 current snap is 89 2024-03-04T06:44:43.349 INFO:tasks.rados.rados.0.smithi137.stdout:860: finishing rollback tid 0 to smithi13777483-16 2024-03-04T06:44:43.349 INFO:tasks.rados.rados.0.smithi137.stdout:860: finishing rollback tid 1 to smithi13777483-16 2024-03-04T06:44:43.349 INFO:tasks.rados.rados.0.smithi137.stdout:860: finishing rollback tid 2 to smithi13777483-16 2024-03-04T06:44:43.349 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 253 (ObjNum 101 snap 21 seq_num 101) dirty exists 2024-03-04T06:44:43.349 INFO:tasks.rados.rados.0.smithi137.stdout:860: done (5 left) 2024-03-04T06:44:43.349 INFO:tasks.rados.rados.0.smithi137.stdout:867: snap_remove snap 75 2024-03-04T06:44:43.592 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:44:43.592 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:43 smithi137 ceph-mon[88869]: pgmap v8: 121 pgs: 121 active+clean; 255 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:43.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:43 smithi137 ceph-mon[88869]: osdmap e226: 8 total, 8 up, 8 in 2024-03-04T06:44:43.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:43 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:43.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:43 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:43.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:43 smithi137 ceph-mon[88869]: mgrmap e39: y(active, since 4s), standbys: x 2024-03-04T06:44:43.593 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:43 smithi137 ceph-mon[37364]: pgmap v8: 121 pgs: 121 active+clean; 255 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:43.593 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:43 smithi137 ceph-mon[37364]: osdmap e226: 8 total, 8 up, 8 in 2024-03-04T06:44:43.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:43 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:43.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:43 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:43.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:43 smithi137 ceph-mon[37364]: mgrmap e39: y(active, since 4s), standbys: x 2024-03-04T06:44:43.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:43 smithi203 ceph-mon[30756]: pgmap v8: 121 pgs: 121 active+clean; 255 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:43.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:43 smithi203 ceph-mon[30756]: osdmap e226: 8 total, 8 up, 8 in 2024-03-04T06:44:43.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:43 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:43.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:43 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:43.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:43 smithi203 ceph-mon[30756]: mgrmap e39: y(active, since 4s), standbys: x 2024-03-04T06:44:43.912 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:44:43.912 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (4m) 1s ago 5m 27.7M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:44:43.912 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (5m) 0s ago 5m 87.9M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:44:43.912 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (6m) 1s ago 6m 17.8M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:44:43.912 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (6m) 0s ago 6m 18.0M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:44:43.912 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (29s) 0s ago 10m 446M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:44:43.913 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (60s) 1s ago 11m 473M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:44:43.913 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (14s) 1s ago 11m 33.1M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:44:43.913 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (10m) 0s ago 10m 60.5M 2048M 18.2.1-696-g5cc7a767 540557f94930 c1087568a246 2024-03-04T06:44:43.913 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (10m) 1s ago 10m 53.9M 2048M 18.2.1-696-g5cc7a767 540557f94930 63f51a40232d 2024-03-04T06:44:43.913 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (4m) 1s ago 4m 16.5M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:44:43.913 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (4m) 0s ago 4m 16.1M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:44:43.913 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (9m) 1s ago 9m 157M 2480M 18.2.1-696-g5cc7a767 540557f94930 732ea50ff558 2024-03-04T06:44:43.913 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (9m) 1s ago 9m 161M 2480M 18.2.1-696-g5cc7a767 540557f94930 708139c858a7 2024-03-04T06:44:43.913 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (8m) 1s ago 8m 164M 2480M 18.2.1-696-g5cc7a767 540557f94930 b247adf81a73 2024-03-04T06:44:43.913 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (8m) 1s ago 8m 93.2M 2480M 18.2.1-696-g5cc7a767 540557f94930 afdbc25c9fba 2024-03-04T06:44:43.913 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (8m) 0s ago 8m 173M 2480M 18.2.1-696-g5cc7a767 540557f94930 d4841ffd0747 2024-03-04T06:44:43.913 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (7m) 0s ago 7m 187M 2480M 18.2.1-696-g5cc7a767 540557f94930 81d21771e157 2024-03-04T06:44:43.913 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (7m) 0s ago 7m 93.5M 2480M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:44:43.914 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (6m) 0s ago 6m 115M 2480M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:44:43.914 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (35s) 0s ago 6m 38.5M - 2.43.0 a07b618ecd1d 6a88bdd1023c 2024-03-04T06:44:44.303 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:44:44.303 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:44:44.303 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2, 2024-03-04T06:44:44.304 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 1 2024-03-04T06:44:44.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:44:44.304 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:44:44.304 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:44:44.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:44:44.304 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:44:44.304 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 8 2024-03-04T06:44:44.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:44:44.304 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:44:44.304 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:44:44.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:44:44.305 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:44:44.305 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 12, 2024-03-04T06:44:44.305 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:44:44.305 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:44:44.305 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:44:44.360 INFO:tasks.rados.rados.0.smithi137.stdout:867: done (5 left) 2024-03-04T06:44:44.360 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 89 2024-03-04T06:44:44.360 INFO:tasks.rados.rados.0.smithi137.stdout:868: seq_num 281 ranges {3612672=712704,4325376=491520,4816896=491520,5308416=622592} 2024-03-04T06:44:44.384 INFO:tasks.rados.rados.0.smithi137.stdout:868: writing smithi13777483-14 from 3612672 to 4325376 tid 1 2024-03-04T06:44:44.387 INFO:tasks.rados.rados.0.smithi137.stdout:868: writing smithi13777483-14 from 4325376 to 4816896 tid 2 2024-03-04T06:44:44.390 INFO:tasks.rados.rados.0.smithi137.stdout:868: writing smithi13777483-14 from 4816896 to 5308416 tid 3 2024-03-04T06:44:44.393 INFO:tasks.rados.rados.0.smithi137.stdout:868: writing smithi13777483-14 from 5308416 to 5931008 tid 4 2024-03-04T06:44:44.393 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 89 2024-03-04T06:44:44.393 INFO:tasks.rados.rados.0.smithi137.stdout:869: seq_num 282 ranges {0=729088,729088=425984,1155072=704512,1859584=475136} 2024-03-04T06:44:44.397 INFO:tasks.rados.rados.0.smithi137.stdout:869: writing smithi13777483-31 from 0 to 729088 tid 1 2024-03-04T06:44:44.399 INFO:tasks.rados.rados.0.smithi137.stdout:869: writing smithi13777483-31 from 729088 to 1155072 tid 2 2024-03-04T06:44:44.403 INFO:tasks.rados.rados.0.smithi137.stdout:869: writing smithi13777483-31 from 1155072 to 1859584 tid 3 2024-03-04T06:44:44.406 INFO:tasks.rados.rados.0.smithi137.stdout:869: writing smithi13777483-31 from 1859584 to 2334720 tid 4 2024-03-04T06:44:44.406 INFO:tasks.rados.rados.0.smithi137.stdout:870: rmattr oid 12 current snap is 89 2024-03-04T06:44:44.406 INFO:tasks.rados.rados.0.smithi137.stdout:870: done (7 left) 2024-03-04T06:44:44.406 INFO:tasks.rados.rados.0.smithi137.stdout:871: setattr oid 35 current snap is 89 2024-03-04T06:44:44.407 INFO:tasks.rados.rados.0.smithi137.stdout:864: finishing write tid 1 to smithi13777483-10 2024-03-04T06:44:44.407 INFO:tasks.rados.rados.0.smithi137.stdout:864: finishing write tid 2 to smithi13777483-10 2024-03-04T06:44:44.407 INFO:tasks.rados.rados.0.smithi137.stdout:864: finishing write tid 3 to smithi13777483-10 2024-03-04T06:44:44.407 INFO:tasks.rados.rados.0.smithi137.stdout:864: finishing write tid 4 to smithi13777483-10 2024-03-04T06:44:44.407 INFO:tasks.rados.rados.0.smithi137.stdout:862: expect (ObjNum 278 snap 89 seq_num 278) 2024-03-04T06:44:44.465 INFO:tasks.rados.rados.0.smithi137.stdout:864: finishing write tid 5 to smithi13777483-10 2024-03-04T06:44:44.465 INFO:tasks.rados.rados.0.smithi137.stdout:865: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:44:44.502 INFO:tasks.rados.rados.0.smithi137.stdout:864: finishing write tid 6 to smithi13777483-10 2024-03-04T06:44:44.502 INFO:tasks.rados.rados.0.smithi137.stdout:864: oid 10 updating version 0 to 432 2024-03-04T06:44:44.502 INFO:tasks.rados.rados.0.smithi137.stdout:864: oid 10 updating version 432 to 437 2024-03-04T06:44:44.503 INFO:tasks.rados.rados.0.smithi137.stdout:864: oid 10 version 437 is already newer than 435 2024-03-04T06:44:44.503 INFO:tasks.rados.rados.0.smithi137.stdout:864: oid 10 version 437 is already newer than 436 2024-03-04T06:44:44.503 INFO:tasks.rados.rados.0.smithi137.stdout:864: oid 10 updating version 437 to 438 2024-03-04T06:44:44.503 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 438 (ObjNum 280 snap 89 seq_num 280) dirty exists 2024-03-04T06:44:44.503 INFO:tasks.rados.rados.0.smithi137.stdout:864: left oid 10 (ObjNum 280 snap 89 seq_num 280) 2024-03-04T06:44:44.503 INFO:tasks.rados.rados.0.smithi137.stdout:863: finishing copy_from racing read to smithi13777483-15 2024-03-04T06:44:44.503 INFO:tasks.rados.rados.0.smithi137.stdout:863: finishing copy_from to smithi13777483-15 2024-03-04T06:44:44.503 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 399 (ObjNum 262 snap 79 seq_num 262) dirty exists 2024-03-04T06:44:44.503 INFO:tasks.rados.rados.0.smithi137.stdout:866: finishing copy_from racing read to smithi13777483-34 2024-03-04T06:44:44.503 INFO:tasks.rados.rados.0.smithi137.stdout:866: finishing copy_from to smithi13777483-34 2024-03-04T06:44:44.503 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 402 (ObjNum 259 snap 78 seq_num 259) dirty exists 2024-03-04T06:44:44.504 INFO:tasks.rados.rados.0.smithi137.stdout:868: finishing write tid 1 to smithi13777483-14 2024-03-04T06:44:44.504 INFO:tasks.rados.rados.0.smithi137.stdout:868: finishing write tid 2 to smithi13777483-14 2024-03-04T06:44:44.504 INFO:tasks.rados.rados.0.smithi137.stdout:868: finishing write tid 3 to smithi13777483-14 2024-03-04T06:44:44.504 INFO:tasks.rados.rados.0.smithi137.stdout:868: finishing write tid 4 to smithi13777483-14 2024-03-04T06:44:44.504 INFO:tasks.rados.rados.0.smithi137.stdout:868: finishing write tid 5 to smithi13777483-14 2024-03-04T06:44:44.504 INFO:tasks.rados.rados.0.smithi137.stdout:868: finishing write tid 6 to smithi13777483-14 2024-03-04T06:44:44.504 INFO:tasks.rados.rados.0.smithi137.stdout:868: oid 14 updating version 0 to 302 2024-03-04T06:44:44.504 INFO:tasks.rados.rados.0.smithi137.stdout:868: oid 14 version 302 is already newer than 300 2024-03-04T06:44:44.504 INFO:tasks.rados.rados.0.smithi137.stdout:868: oid 14 updating version 302 to 304 2024-03-04T06:44:44.504 INFO:tasks.rados.rados.0.smithi137.stdout:868: oid 14 version 304 is already newer than 303 2024-03-04T06:44:44.504 INFO:tasks.rados.rados.0.smithi137.stdout:868: oid 14 version 304 is already newer than 301 2024-03-04T06:44:44.504 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 304 (ObjNum 281 snap 89 seq_num 281) dirty exists 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:868: left oid 14 (ObjNum 281 snap 89 seq_num 281) 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:869: finishing write tid 1 to smithi13777483-31 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:869: finishing write tid 2 to smithi13777483-31 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:869: finishing write tid 3 to smithi13777483-31 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:869: finishing write tid 4 to smithi13777483-31 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:869: finishing write tid 5 to smithi13777483-31 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:869: finishing write tid 6 to smithi13777483-31 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:869: oid 31 updating version 0 to 346 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:869: oid 31 version 346 is already newer than 345 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:869: oid 31 updating version 346 to 348 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:869: oid 31 updating version 348 to 349 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:869: oid 31 version 349 is already newer than 347 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 349 (ObjNum 282 snap 89 seq_num 282) dirty exists 2024-03-04T06:44:44.505 INFO:tasks.rados.rados.0.smithi137.stdout:869: left oid 31 (ObjNum 282 snap 89 seq_num 282) 2024-03-04T06:44:44.506 INFO:tasks.rados.rados.0.smithi137.stdout:862: done (7 left) 2024-03-04T06:44:44.506 INFO:tasks.rados.rados.0.smithi137.stdout:863: done (6 left) 2024-03-04T06:44:44.506 INFO:tasks.rados.rados.0.smithi137.stdout:864: done (5 left) 2024-03-04T06:44:44.506 INFO:tasks.rados.rados.0.smithi137.stdout:865: done (4 left) 2024-03-04T06:44:44.506 INFO:tasks.rados.rados.0.smithi137.stdout:866: done (3 left) 2024-03-04T06:44:44.506 INFO:tasks.rados.rados.0.smithi137.stdout:868: done (2 left) 2024-03-04T06:44:44.506 INFO:tasks.rados.rados.0.smithi137.stdout:869: done (1 left) 2024-03-04T06:44:44.506 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 89 2024-03-04T06:44:44.506 INFO:tasks.rados.rados.0.smithi137.stdout:872: seq_num 283 ranges {5554176=745472,6299648=712704,7012352=458752,7471104=434176} 2024-03-04T06:44:44.534 INFO:tasks.rados.rados.0.smithi137.stdout:872: writing smithi13777483-15 from 5554176 to 6299648 tid 1 2024-03-04T06:44:44.538 INFO:tasks.rados.rados.0.smithi137.stdout:872: writing smithi13777483-15 from 6299648 to 7012352 tid 2 2024-03-04T06:44:44.541 INFO:tasks.rados.rados.0.smithi137.stdout:872: writing smithi13777483-15 from 7012352 to 7471104 tid 3 2024-03-04T06:44:44.544 INFO:tasks.rados.rados.0.smithi137.stdout:872: writing smithi13777483-15 from 7471104 to 7905280 tid 4 2024-03-04T06:44:44.544 INFO:tasks.rados.rados.0.smithi137.stdout:873: delete oid 4 current snap is 89 2024-03-04T06:44:44.544 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 351 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:44:44.544 INFO:tasks.rados.rados.0.smithi137.stdout:872: finishing write tid 1 to smithi13777483-15 2024-03-04T06:44:44.544 INFO:tasks.rados.rados.0.smithi137.stdout:872: finishing write tid 2 to smithi13777483-15 2024-03-04T06:44:44.545 INFO:tasks.rados.rados.0.smithi137.stdout:872: finishing write tid 3 to smithi13777483-15 2024-03-04T06:44:44.545 INFO:tasks.rados.rados.0.smithi137.stdout:871: done (2 left) 2024-03-04T06:44:44.545 INFO:tasks.rados.rados.0.smithi137.stdout:873: done (1 left) 2024-03-04T06:44:44.545 INFO:tasks.rados.rados.0.smithi137.stdout:874: read oid 5 snap -1 2024-03-04T06:44:44.545 INFO:tasks.rados.rados.0.smithi137.stdout:874: expect (ObjNum 101 snap 21 seq_num 101) 2024-03-04T06:44:44.545 INFO:tasks.rados.rados.0.smithi137.stdout:875: rmattr oid 32 current snap is 89 2024-03-04T06:44:44.546 INFO:tasks.rados.rados.0.smithi137.stdout:875: done (2 left) 2024-03-04T06:44:44.546 INFO:tasks.rados.rados.0.smithi137.stdout:876: rmattr oid 47 current snap is 89 2024-03-04T06:44:44.546 INFO:tasks.rados.rados.0.smithi137.stdout:877: setattr oid 21 current snap is 89 2024-03-04T06:44:44.547 INFO:tasks.rados.rados.0.smithi137.stdout:878: read oid 25 snap 84 2024-03-04T06:44:44.547 INFO:tasks.rados.rados.0.smithi137.stdout:878: expect (ObjNum -1164282720 snap 21906 seq_num 3131953984) 2024-03-04T06:44:44.547 INFO:tasks.rados.rados.0.smithi137.stdout:879: rollback oid 35 current snap is 89 2024-03-04T06:44:44.547 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 35 to 84 2024-03-04T06:44:44.547 INFO:tasks.rados.rados.0.smithi137.stdout:880: delete oid 34 current snap is 89 2024-03-04T06:44:44.548 INFO:tasks.rados.rados.0.smithi137.stdout:872: finishing write tid 4 to smithi13777483-15 2024-03-04T06:44:44.549 INFO:tasks.rados.rados.0.smithi137.stdout:878: expect (ObjNum -1164282720 snap 21906 seq_num 3131953984) 2024-03-04T06:44:44.555 INFO:tasks.rados.rados.0.smithi137.stdout:872: finishing write tid 5 to smithi13777483-15 2024-03-04T06:44:44.555 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 480 (ObjNum 207 snap 60 seq_num 207) dirty exists 2024-03-04T06:44:44.555 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 481 (ObjNum 275 snap 89 seq_num 275) dirty exists 2024-03-04T06:44:44.555 INFO:tasks.rados.rados.0.smithi137.stdout:879: finishing rollback tid 0 to smithi13777483-35 2024-03-04T06:44:44.555 INFO:tasks.rados.rados.0.smithi137.stdout:879: finishing rollback tid 1 to smithi13777483-35 2024-03-04T06:44:44.555 INFO:tasks.rados.rados.0.smithi137.stdout:876: done (6 left) 2024-03-04T06:44:44.555 INFO:tasks.rados.rados.0.smithi137.stdout:877: done (5 left) 2024-03-04T06:44:44.555 INFO:tasks.rados.rados.0.smithi137.stdout:878: done (4 left) 2024-03-04T06:44:44.555 INFO:tasks.rados.rados.0.smithi137.stdout:880: done (3 left) 2024-03-04T06:44:44.556 INFO:tasks.rados.rados.0.smithi137.stdout:881: delete oid 37 current snap is 89 2024-03-04T06:44:44.556 INFO:tasks.rados.rados.0.smithi137.stdout:872: finishing write tid 6 to smithi13777483-15 2024-03-04T06:44:44.556 INFO:tasks.rados.rados.0.smithi137.stdout:872: oid 15 updating version 0 to 448 2024-03-04T06:44:44.556 INFO:tasks.rados.rados.0.smithi137.stdout:872: oid 15 updating version 448 to 450 2024-03-04T06:44:44.556 INFO:tasks.rados.rados.0.smithi137.stdout:872: oid 15 version 450 is already newer than 446 2024-03-04T06:44:44.556 INFO:tasks.rados.rados.0.smithi137.stdout:872: oid 15 version 450 is already newer than 447 2024-03-04T06:44:44.556 INFO:tasks.rados.rados.0.smithi137.stdout:872: oid 15 version 450 is already newer than 449 2024-03-04T06:44:44.556 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 450 (ObjNum 283 snap 89 seq_num 283) dirty exists 2024-03-04T06:44:44.556 INFO:tasks.rados.rados.0.smithi137.stdout:872: left oid 15 (ObjNum 283 snap 89 seq_num 283) 2024-03-04T06:44:44.556 INFO:tasks.rados.rados.0.smithi137.stdout:879: finishing rollback tid 2 to smithi13777483-35 2024-03-04T06:44:44.556 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 354 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:44:44.557 INFO:tasks.rados.rados.0.smithi137.stdout:872: done (3 left) 2024-03-04T06:44:44.557 INFO:tasks.rados.rados.0.smithi137.stdout:879: done (2 left) 2024-03-04T06:44:44.557 INFO:tasks.rados.rados.0.smithi137.stdout:881: done (1 left) 2024-03-04T06:44:44.557 INFO:tasks.rados.rados.0.smithi137.stdout:882: snap_remove snap 54 2024-03-04T06:44:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:44 smithi203 ceph-mon[30756]: osdmap e227: 8 total, 8 up, 8 in 2024-03-04T06:44:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:44 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:44 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:44 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:44 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:44 smithi203 ceph-mon[30756]: from='client.? 172.21.15.137:0/161367557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:44:44.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:44 smithi137 ceph-mon[37364]: osdmap e227: 8 total, 8 up, 8 in 2024-03-04T06:44:44.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:44 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:44.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:44 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:44.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:44 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:44.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:44 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:44 smithi137 ceph-mon[37364]: from='client.? 172.21.15.137:0/161367557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:44:44.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:44 smithi137 ceph-mon[88869]: osdmap e227: 8 total, 8 up, 8 in 2024-03-04T06:44:44.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:44.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:44.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:44.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:44.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:44 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/161367557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:44:44.840 INFO:tasks.rados.rados.0.smithi137.stdout:882: done (1 left) 2024-03-04T06:44:44.840 INFO:tasks.rados.rados.0.smithi137.stdout:883: snap_remove snap 73 2024-03-04T06:44:45.761 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:45 smithi203 ceph-mon[30756]: from='client.25000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:44:45.761 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:45 smithi203 ceph-mon[30756]: from='client.25202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:44:45.761 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:45 smithi203 ceph-mon[30756]: pgmap v11: 121 pgs: 121 active+clean; 255 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:45.761 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:45 smithi203 ceph-mon[30756]: osdmap e228: 8 total, 8 up, 8 in 2024-03-04T06:44:45.761 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:45 smithi203 ceph-mon[30756]: osdmap e229: 8 total, 8 up, 8 in 2024-03-04T06:44:45.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:44:45] "GET /metrics HTTP/1.1" 200 33281 "" "Prometheus/2.43.0" 2024-03-04T06:44:45.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:45 smithi137 ceph-mon[37364]: from='client.25000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:44:45.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:45 smithi137 ceph-mon[37364]: from='client.25202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:44:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:45 smithi137 ceph-mon[37364]: pgmap v11: 121 pgs: 121 active+clean; 255 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:45 smithi137 ceph-mon[37364]: osdmap e228: 8 total, 8 up, 8 in 2024-03-04T06:44:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:45 smithi137 ceph-mon[37364]: osdmap e229: 8 total, 8 up, 8 in 2024-03-04T06:44:45.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:45 smithi137 ceph-mon[88869]: from='client.25000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:44:45.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:45 smithi137 ceph-mon[88869]: from='client.25202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:44:45.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:45 smithi137 ceph-mon[88869]: pgmap v11: 121 pgs: 121 active+clean; 255 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:45.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:45 smithi137 ceph-mon[88869]: osdmap e228: 8 total, 8 up, 8 in 2024-03-04T06:44:45.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:45 smithi137 ceph-mon[88869]: osdmap e229: 8 total, 8 up, 8 in 2024-03-04T06:44:45.844 INFO:tasks.rados.rados.0.smithi137.stdout:883: done (1 left) 2024-03-04T06:44:45.844 INFO:tasks.rados.rados.0.smithi137.stdout:884: snap_create 2024-03-04T06:44:45.844 INFO:tasks.rados.rados.0.smithi137.stdout:874: expect (ObjNum 101 snap 21 seq_num 101) 2024-03-04T06:44:46.853 INFO:tasks.rados.rados.0.smithi137.stdout:874: done (1 left) 2024-03-04T06:44:46.854 INFO:tasks.rados.rados.0.smithi137.stdout:884: done (0 left) 2024-03-04T06:44:46.854 INFO:tasks.rados.rados.0.smithi137.stdout:885: rollback oid 48 current snap is 90 2024-03-04T06:44:46.854 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 48 to 64 2024-03-04T06:44:46.854 INFO:tasks.rados.rados.0.smithi137.stdout:886: copy_from oid 4 from oid 24 current snap is 90 2024-03-04T06:44:46.854 INFO:tasks.rados.rados.0.smithi137.stdout:887: snap_create 2024-03-04T06:44:46.860 INFO:tasks.rados.rados.0.smithi137.stdout:885: finishing rollback tid 0 to smithi13777483-48 2024-03-04T06:44:46.860 INFO:tasks.rados.rados.0.smithi137.stdout:885: finishing rollback tid 1 to smithi13777483-48 2024-03-04T06:44:46.860 INFO:tasks.rados.rados.0.smithi137.stdout:885: finishing rollback tid 2 to smithi13777483-48 2024-03-04T06:44:46.860 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 218 (ObjNum 211 snap 61 seq_num 211) dirty exists 2024-03-04T06:44:46.869 INFO:tasks.rados.rados.0.smithi137.stdout:886: finishing copy_from racing read to smithi13777483-4 2024-03-04T06:44:46.870 INFO:tasks.rados.rados.0.smithi137.stdout:886: finishing copy_from to smithi13777483-4 2024-03-04T06:44:46.870 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 135 (ObjNum 240 snap 72 seq_num 240) dirty exists 2024-03-04T06:44:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:46 smithi137 ceph-mon[88869]: osdmap e230: 8 total, 8 up, 8 in 2024-03-04T06:44:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:46 smithi137 ceph-mon[88869]: pgmap v15: 121 pgs: 121 active+clean; 275 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.0 MiB/s rd, 5.2 MiB/s wr, 58 op/s 2024-03-04T06:44:47.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:46 smithi137 ceph-mon[37364]: osdmap e230: 8 total, 8 up, 8 in 2024-03-04T06:44:47.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:46 smithi137 ceph-mon[37364]: pgmap v15: 121 pgs: 121 active+clean; 275 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.0 MiB/s rd, 5.2 MiB/s wr, 58 op/s 2024-03-04T06:44:47.307 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:46 smithi203 ceph-mon[30756]: osdmap e230: 8 total, 8 up, 8 in 2024-03-04T06:44:47.307 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:46 smithi203 ceph-mon[30756]: pgmap v15: 121 pgs: 121 active+clean; 275 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.0 MiB/s rd, 5.2 MiB/s wr, 58 op/s 2024-03-04T06:44:47.854 INFO:tasks.rados.rados.0.smithi137.stdout:885: done (2 left) 2024-03-04T06:44:47.854 INFO:tasks.rados.rados.0.smithi137.stdout:886: done (1 left) 2024-03-04T06:44:47.855 INFO:tasks.rados.rados.0.smithi137.stdout:887: done (0 left) 2024-03-04T06:44:47.855 INFO:tasks.rados.rados.0.smithi137.stdout:888: read oid 34 snap 59 2024-03-04T06:44:47.855 INFO:tasks.rados.rados.0.smithi137.stdout:888: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:44:47.855 INFO:tasks.rados.rados.0.smithi137.stdout:889: read oid 46 snap -1 2024-03-04T06:44:47.855 INFO:tasks.rados.rados.0.smithi137.stdout:889: expect (ObjNum 278 snap 89 seq_num 278) 2024-03-04T06:44:47.855 INFO:tasks.rados.rados.0.smithi137.stdout:890: read oid 17 snap -1 2024-03-04T06:44:47.855 INFO:tasks.rados.rados.0.smithi137.stdout:890: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:44:47.855 INFO:tasks.rados.rados.0.smithi137.stdout:891: setattr oid 13 current snap is 91 2024-03-04T06:44:47.855 INFO:tasks.rados.rados.0.smithi137.stdout:890: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:44:47.860 INFO:tasks.rados.rados.0.smithi137.stdout:890: done (3 left) 2024-03-04T06:44:47.860 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 91 2024-03-04T06:44:47.860 INFO:tasks.rados.rados.0.smithi137.stdout:892: seq_num 287 ranges {7905280=8192} 2024-03-04T06:44:47.903 INFO:tasks.rados.rados.0.smithi137.stdout:892: writing smithi13777483-15 from 7905280 to 7913472 tid 1 2024-03-04T06:44:47.903 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 91 2024-03-04T06:44:47.903 INFO:tasks.rados.rados.0.smithi137.stdout:893: seq_num 288 ranges {1294336=24576} 2024-03-04T06:44:47.911 INFO:tasks.rados.rados.0.smithi137.stdout:893: writing smithi13777483-44 from 1294336 to 1318912 tid 1 2024-03-04T06:44:47.911 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 33 current snap is 91 2024-03-04T06:44:47.911 INFO:tasks.rados.rados.0.smithi137.stdout:894: seq_num 289 ranges {1228800=40960} 2024-03-04T06:44:47.918 INFO:tasks.rados.rados.0.smithi137.stdout:894: writing smithi13777483-33 from 1228800 to 1269760 tid 1 2024-03-04T06:44:47.918 INFO:tasks.rados.rados.0.smithi137.stdout:895: setattr oid 29 current snap is 91 2024-03-04T06:44:47.918 INFO:tasks.rados.rados.0.smithi137.stdout:888: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-04T06:44:47.941 INFO:tasks.rados.rados.0.smithi137.stdout:889: expect (ObjNum 278 snap 89 seq_num 278) 2024-03-04T06:44:48.004 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 581 (ObjNum 238 snap 72 seq_num 238) dirty exists 2024-03-04T06:44:48.004 INFO:tasks.rados.rados.0.smithi137.stdout:892: finishing write tid 1 to smithi13777483-15 2024-03-04T06:44:48.004 INFO:tasks.rados.rados.0.smithi137.stdout:892: finishing write tid 2 to smithi13777483-15 2024-03-04T06:44:48.004 INFO:tasks.rados.rados.0.smithi137.stdout:892: finishing write tid 3 to smithi13777483-15 2024-03-04T06:44:48.004 INFO:tasks.rados.rados.0.smithi137.stdout:892: oid 15 updating version 0 to 469 2024-03-04T06:44:48.004 INFO:tasks.rados.rados.0.smithi137.stdout:892: oid 15 version 469 is already newer than 468 2024-03-04T06:44:48.004 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 469 (ObjNum 287 snap 91 seq_num 287) dirty exists 2024-03-04T06:44:48.004 INFO:tasks.rados.rados.0.smithi137.stdout:892: left oid 15 (ObjNum 287 snap 91 seq_num 287) 2024-03-04T06:44:48.004 INFO:tasks.rados.rados.0.smithi137.stdout:893: finishing write tid 1 to smithi13777483-44 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:893: finishing write tid 2 to smithi13777483-44 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:893: finishing write tid 3 to smithi13777483-44 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:893: oid 44 updating version 0 to 404 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:893: oid 44 updating version 404 to 405 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 405 (ObjNum 288 snap 91 seq_num 288) dirty exists 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:893: left oid 44 (ObjNum 288 snap 91 seq_num 288) 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:894: finishing write tid 1 to smithi13777483-33 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:894: finishing write tid 2 to smithi13777483-33 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:894: finishing write tid 3 to smithi13777483-33 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:894: oid 33 updating version 0 to 368 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:894: oid 33 updating version 368 to 369 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 369 (ObjNum 289 snap 91 seq_num 289) dirty exists 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:894: left oid 33 (ObjNum 289 snap 91 seq_num 289) 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:888: done (6 left) 2024-03-04T06:44:48.005 INFO:tasks.rados.rados.0.smithi137.stdout:889: done (5 left) 2024-03-04T06:44:48.006 INFO:tasks.rados.rados.0.smithi137.stdout:891: done (4 left) 2024-03-04T06:44:48.006 INFO:tasks.rados.rados.0.smithi137.stdout:892: done (3 left) 2024-03-04T06:44:48.006 INFO:tasks.rados.rados.0.smithi137.stdout:893: done (2 left) 2024-03-04T06:44:48.006 INFO:tasks.rados.rados.0.smithi137.stdout:894: done (1 left) 2024-03-04T06:44:48.006 INFO:tasks.rados.rados.0.smithi137.stdout:896: snap_remove snap 67 2024-03-04T06:44:48.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:47 smithi137 ceph-mon[88869]: osdmap e231: 8 total, 8 up, 8 in 2024-03-04T06:44:48.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:47 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:48.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:47 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:48.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:47 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:48.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:47 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:44:48.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:47 smithi137 ceph-mon[37364]: osdmap e231: 8 total, 8 up, 8 in 2024-03-04T06:44:48.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:47 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:48.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:47 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:48.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:47 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:48.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:47 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:44:48.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:47 smithi203 ceph-mon[30756]: osdmap e231: 8 total, 8 up, 8 in 2024-03-04T06:44:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:47 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:47 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:47 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:47 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:44:48.868 INFO:tasks.rados.rados.0.smithi137.stdout:896: done (1 left) 2024-03-04T06:44:48.868 INFO:tasks.rados.rados.0.smithi137.stdout:897: copy_from oid 1 from oid 49 current snap is 91 2024-03-04T06:44:48.868 INFO:tasks.rados.rados.0.smithi137.stdout:898: delete oid 38 current snap is 91 2024-03-04T06:44:48.868 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 294 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-04T06:44:48.876 INFO:tasks.rados.rados.0.smithi137.stdout:895: done (2 left) 2024-03-04T06:44:48.876 INFO:tasks.rados.rados.0.smithi137.stdout:898: done (1 left) 2024-03-04T06:44:48.876 INFO:tasks.rados.rados.0.smithi137.stdout:899: snap_remove snap 76 2024-03-04T06:44:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:44:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:44:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: osdmap e232: 8 total, 8 up, 8 in 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: pgmap v18: 121 pgs: 121 active+clean; 275 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-04T06:44:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-03-04T06:44:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:44:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:44:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: osdmap e232: 8 total, 8 up, 8 in 2024-03-04T06:44:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:44:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:44:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:44:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:44:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: pgmap v18: 121 pgs: 121 active+clean; 275 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:49.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:44:49.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-04T06:44:49.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:48 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-03-04T06:44:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: Updating smithi137:/etc/ceph/ceph.conf 2024-03-04T06:44:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: Updating smithi203:/etc/ceph/ceph.conf 2024-03-04T06:44:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: osdmap e232: 8 total, 8 up, 8 in 2024-03-04T06:44:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:44:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T06:44:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:44:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-03-04T06:44:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: pgmap v18: 121 pgs: 121 active+clean; 275 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:44:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:44:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-04T06:44:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:48 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-03-04T06:44:49.876 INFO:tasks.rados.rados.0.smithi137.stdout:899: done (1 left) 2024-03-04T06:44:49.877 INFO:tasks.rados.rados.0.smithi137.stdout:900: snap_create 2024-03-04T06:44:49.877 INFO:tasks.rados.rados.0.smithi137.stdout:897: finishing copy_from racing read to smithi13777483-1 2024-03-04T06:44:49.877 INFO:tasks.rados.rados.0.smithi137.stdout:897: finishing copy_from to smithi13777483-1 2024-03-04T06:44:49.877 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 326 (ObjNum 270 snap 87 seq_num 270) dirty exists 2024-03-04T06:44:50.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:49 smithi137 ceph-mon[88869]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:44:50.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:49 smithi137 ceph-mon[88869]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:44:50.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:49 smithi137 ceph-mon[88869]: Upgrade: It appears safe to stop mon.c 2024-03-04T06:44:50.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:49 smithi137 ceph-mon[88869]: osdmap e233: 8 total, 8 up, 8 in 2024-03-04T06:44:50.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:49 smithi137 ceph-mon[37364]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:44:50.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:49 smithi137 ceph-mon[37364]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:44:50.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:49 smithi137 ceph-mon[37364]: Upgrade: It appears safe to stop mon.c 2024-03-04T06:44:50.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:49 smithi137 ceph-mon[37364]: osdmap e233: 8 total, 8 up, 8 in 2024-03-04T06:44:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:49 smithi203 ceph-mon[30756]: Updating smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:44:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:49 smithi203 ceph-mon[30756]: Updating smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T06:44:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:49 smithi203 ceph-mon[30756]: Upgrade: It appears safe to stop mon.c 2024-03-04T06:44:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:49 smithi203 ceph-mon[30756]: osdmap e233: 8 total, 8 up, 8 in 2024-03-04T06:44:50.885 INFO:tasks.rados.rados.0.smithi137.stdout:897: done (1 left) 2024-03-04T06:44:50.885 INFO:tasks.rados.rados.0.smithi137.stdout:900: done (0 left) 2024-03-04T06:44:50.885 INFO:tasks.rados.rados.0.smithi137.stdout:901: copy_from oid 20 from oid 32 current snap is 92 2024-03-04T06:44:50.885 INFO:tasks.rados.rados.0.smithi137.stdout:902: delete oid 3 current snap is 92 2024-03-04T06:44:50.887 INFO:tasks.rados.rados.0.smithi137.stdout:902: done (1 left) 2024-03-04T06:44:50.887 INFO:tasks.rados.rados.0.smithi137.stdout:903: copy_from oid 45 from oid 37 current snap is 92 2024-03-04T06:44:50.887 INFO:tasks.rados.rados.0.smithi137.stdout:904: snap_remove snap 57 2024-03-04T06:44:51.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:50 smithi137 ceph-mon[88869]: osdmap e234: 8 total, 8 up, 8 in 2024-03-04T06:44:51.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:50 smithi137 ceph-mon[88869]: pgmap v21: 121 pgs: 121 active+clean; 280 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 5.2 MiB/s rd, 2.6 MiB/s wr, 38 op/s 2024-03-04T06:44:51.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:51.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:44:51.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:44:51.207 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:51.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:50 smithi137 ceph-mon[37364]: osdmap e234: 8 total, 8 up, 8 in 2024-03-04T06:44:51.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:50 smithi137 ceph-mon[37364]: pgmap v21: 121 pgs: 121 active+clean; 280 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 5.2 MiB/s rd, 2.6 MiB/s wr, 38 op/s 2024-03-04T06:44:51.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:50 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:51.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:50 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:44:51.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:50 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:44:51.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:50 smithi137 ceph-mon[37364]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:50 smithi203 ceph-mon[30756]: osdmap e234: 8 total, 8 up, 8 in 2024-03-04T06:44:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:50 smithi203 ceph-mon[30756]: pgmap v21: 121 pgs: 121 active+clean; 280 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 5.2 MiB/s rd, 2.6 MiB/s wr, 38 op/s 2024-03-04T06:44:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:50 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:50 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:44:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:50 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:44:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:50 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:44:51.891 INFO:tasks.rados.rados.0.smithi137.stdout:904: done (2 left) 2024-03-04T06:44:51.891 INFO:tasks.rados.rados.0.smithi137.stdout:905: snap_create 2024-03-04T06:44:51.891 INFO:tasks.rados.rados.0.smithi137.stdout:903: finishing copy_from to smithi13777483-45 2024-03-04T06:44:51.891 INFO:tasks.rados.rados.0.smithi137.stdout:903: got expected ENOENT (src dne) 2024-03-04T06:44:51.891 INFO:tasks.rados.rados.0.smithi137.stdout:903: finishing copy_from racing read to smithi13777483-45 2024-03-04T06:44:51.891 INFO:tasks.rados.rados.0.smithi137.stdout:901: finishing copy_from racing read to smithi13777483-20 2024-03-04T06:44:51.892 INFO:tasks.rados.rados.0.smithi137.stdout:901: finishing copy_from to smithi13777483-20 2024-03-04T06:44:51.892 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 200 (ObjNum 169 snap 47 seq_num 169) dirty exists 2024-03-04T06:44:52.125 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:51 smithi137 ceph-mon[88869]: Upgrade: Updating mon.c 2024-03-04T06:44:52.126 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:51 smithi137 ceph-mon[88869]: Deploying daemon mon.c on smithi137 2024-03-04T06:44:52.126 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:51 smithi137 ceph-mon[88869]: osdmap e235: 8 total, 8 up, 8 in 2024-03-04T06:44:52.126 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:51 smithi137 ceph-mon[37364]: Upgrade: Updating mon.c 2024-03-04T06:44:52.126 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:51 smithi137 ceph-mon[37364]: Deploying daemon mon.c on smithi137 2024-03-04T06:44:52.126 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:51 smithi137 ceph-mon[37364]: osdmap e235: 8 total, 8 up, 8 in 2024-03-04T06:44:52.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:51 smithi203 ceph-mon[30756]: Upgrade: Updating mon.c 2024-03-04T06:44:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:51 smithi203 ceph-mon[30756]: Deploying daemon mon.c on smithi137 2024-03-04T06:44:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:51 smithi203 ceph-mon[30756]: osdmap e235: 8 total, 8 up, 8 in 2024-03-04T06:44:52.473 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:52 smithi137 systemd[1]: Stopping Ceph mon.c for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:44:52.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c[37360]: 2024-03-04T06:44:52.472+0000 7f4ecc8c8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:44:52.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c[37360]: 2024-03-04T06:44:52.472+0000 7f4ecc8c8700 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-03-04T06:44:52.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:52 smithi137 podman[91144]: 2024-03-04 06:44:52.503496865 +0000 UTC m=+0.238167116 container died 63f51a40232d4b89850f48423548f614a5df5626e3a82eeed49dbbb1361e056b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=reef-5cc7a76, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-03-04T06:44:53.215 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:52 smithi137 podman[91144]: 2024-03-04 06:44:52.981089549 +0000 UTC m=+0.715759775 container cleanup 63f51a40232d4b89850f48423548f614a5df5626e3a82eeed49dbbb1361e056b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c, RELEASE=reef-5cc7a76, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:44:53.215 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:52 smithi137 bash[91144]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c 2024-03-04T06:44:53.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:53 smithi137 podman[91158]: 2024-03-04 06:44:53.215797158 +0000 UTC m=+0.709022831 container remove 63f51a40232d4b89850f48423548f614a5df5626e3a82eeed49dbbb1361e056b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, RELEASE=reef-5cc7a76, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-03-04T06:44:53.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:53 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.c.service: Deactivated successfully. 2024-03-04T06:44:53.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:53 smithi137 systemd[1]: Stopped Ceph mon.c for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:44:53.539 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:53 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.c.service: Consumed 7.673s CPU time. 2024-03-04T06:44:53.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:53 smithi137 systemd[1]: Starting Ceph mon.c for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:44:53.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:53 smithi137 podman[91295]: 2024-03-04 06:44:53.655551643 +0000 UTC m=+0.017787725 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:44:53.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:53 smithi137 podman[91295]: 2024-03-04 06:44:53.774879314 +0000 UTC m=+0.137115396 container create b69d9079fc81da0c9437d9bd6d786a4b64fa88436c947e414d9167691ee5f465 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, ceph=True) 2024-03-04T06:44:54.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 podman[91295]: 2024-03-04 06:44:54.094352983 +0000 UTC m=+0.456589065 container init b69d9079fc81da0c9437d9bd6d786a4b64fa88436c947e414d9167691ee5f465 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:44:54.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 podman[91295]: 2024-03-04 06:44:54.098296761 +0000 UTC m=+0.460532846 container start b69d9079fc81da0c9437d9bd6d786a4b64fa88436c947e414d9167691ee5f465 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2) 2024-03-04T06:44:54.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: set uid:gid to 167:167 (ceph:ceph) 2024-03-04T06:44:54.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev), process ceph-mon, pid 2 2024-03-04T06:44:54.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: pidfile_write: ignore empty --pid-file 2024-03-04T06:44:54.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: load: jerasure load: lrc 2024-03-04T06:44:54.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: RocksDB version: 7.9.2 2024-03-04T06:44:54.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Git sha 0 2024-03-04T06:44:54.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Compile date 2024-03-01 16:22:25 2024-03-04T06:44:54.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: DB SUMMARY 2024-03-04T06:44:54.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: DB Session ID: N3G2XLLUHVMYV8H42RJK 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: CURRENT file: CURRENT 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: IDENTITY file: IDENTITY 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1404 Bytes 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000027.sst 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000025.log size: 11736010 ; 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.error_if_exists: 0 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.create_if_missing: 0 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.paranoid_checks: 1 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.env: 0x55fe93257b20 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.fs: PosixFileSystem 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.info_log: 0x55fe9541f9e0 2024-03-04T06:44:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_file_opening_threads: 16 2024-03-04T06:44:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.statistics: (nil) 2024-03-04T06:44:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.use_fsync: 0 2024-03-04T06:44:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_log_file_size: 0 2024-03-04T06:44:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-04T06:44:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-04T06:44:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.keep_log_file_num: 1000 2024-03-04T06:44:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.recycle_log_file_num: 0 2024-03-04T06:44:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.allow_fallocate: 1 2024-03-04T06:44:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.allow_mmap_reads: 0 2024-03-04T06:44:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.allow_mmap_writes: 0 2024-03-04T06:44:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.use_direct_reads: 0 2024-03-04T06:44:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-04T06:44:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.create_missing_column_families: 0 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.db_log_dir: 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.wal_dir: 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.advise_random_on_open: 1 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.db_write_buffer_size: 0 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.write_buffer_manager: 0x55fe953f2dc0 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.rate_limiter: (nil) 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-04T06:44:54.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.wal_recovery_mode: 2 2024-03-04T06:44:54.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.enable_thread_tracking: 0 2024-03-04T06:44:54.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.enable_pipelined_write: 0 2024-03-04T06:44:54.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.unordered_write: 0 2024-03-04T06:44:54.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-04T06:44:54.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-04T06:44:54.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-04T06:44:54.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-04T06:44:54.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.row_cache: None 2024-03-04T06:44:54.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.wal_filter: None 2024-03-04T06:44:54.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-04T06:44:54.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.allow_ingest_behind: 0 2024-03-04T06:44:54.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.two_write_queues: 0 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.manual_wal_flush: 0 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.wal_compression: 0 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.atomic_flush: 0 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.log_readahead_size: 0 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.best_efforts_recovery: 0 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.allow_data_in_errors: 0 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.db_host_id: __hostname__ 2024-03-04T06:44:54.300 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_background_jobs: 2 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_background_compactions: -1 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_subcompactions: 1 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_total_wal_size: 0 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_open_files: -1 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.bytes_per_sync: 0 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-04T06:44:54.301 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compaction_readahead_size: 0 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_background_flushes: -1 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Compression algorithms supported: 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: kZSTD supported: 0 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: kXpressCompression supported: 0 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: kLZ4HCCompression supported: 1 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: kZlibCompression supported: 1 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: kSnappyCompression supported: 1 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: kLZ4Compression supported: 1 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: kBZip2Compression supported: 0 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000010 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-04T06:44:54.302 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.merge_operator: 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compaction_filter: None 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compaction_filter_factory: None 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.sst_partitioner_factory: None 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fe9541fae0) 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: cache_index_and_filter_blocks: 1 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: pin_top_level_index_and_filter: 1 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: index_type: 0 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: data_block_index_type: 0 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: index_shortening: 1 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: checksum: 4 2024-03-04T06:44:54.303 INFO:journalctl@ceph.mon.c.smithi137.stdout: no_block_cache: 0 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_cache: 0x55fe954251f0 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_cache_name: BinnedLRUCache 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_cache_options: 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: capacity : 536870912 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: num_shard_bits : 4 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: strict_capacity_limit : 0 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: high_pri_pool_ratio: 0.000 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_cache_compressed: (nil) 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: persistent_cache: (nil) 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_size: 4096 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_size_deviation: 10 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_restart_interval: 16 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: index_block_restart_interval: 1 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: metadata_block_size: 4096 2024-03-04T06:44:54.304 INFO:journalctl@ceph.mon.c.smithi137.stdout: partition_filters: 0 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: use_delta_encoding: 1 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: filter_policy: bloomfilter 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: whole_key_filtering: 1 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: verify_compression: 0 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: read_amp_bytes_per_bit: 0 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: format_version: 5 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: enable_index_compression: 1 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: block_align: 0 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: max_auto_readahead_size: 262144 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: prepopulate_block_cache: 0 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: initial_auto_readahead_size: 8192 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout: num_file_reads_for_auto_readahead: 2 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.write_buffer_size: 33554432 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_write_buffer_number: 2 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compression: NoCompression 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.bottommost_compression: Disabled 2024-03-04T06:44:54.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.prefix_extractor: nullptr 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.num_levels: 7 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-04T06:44:54.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compression_opts.level: 32767 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compression_opts.strategy: 0 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compression_opts.enabled: false 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.target_file_size_base: 67108864 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-04T06:44:54.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.arena_block_size: 1048576 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.disable_auto_compactions: 0 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-04T06:44:54.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.table_properties_collectors: 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.inplace_update_support: 0 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.bloom_locality: 0 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.max_successive_merges: 0 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-04T06:44:54.309 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.paranoid_file_checks: 0 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.force_consistency_checks: 1 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.report_bg_io_stats: 0 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.ttl: 2592000 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.enable_blob_files: false 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.min_blob_size: 0 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.blob_file_size: 268435456 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.blob_file_starting_level: 0 2024-03-04T06:44:54.310 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 13203, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 06277ad3-8ea4-4637-a751-ef7266e44b2a 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534694127676, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 bash[91295]: b69d9079fc81da0c9437d9bd6d786a4b64fa88436c947e414d9167691ee5f465 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 systemd[1]: Started Ceph mon.c for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534694155216, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 7166967, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 13208, "largest_seqno": 17122, "table_properties": {"data_size": 7149912, "index_size": 11810, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 4229, "raw_key_size": 38471, "raw_average_key_size": 22, "raw_value_size": 7114648, "raw_average_value_size": 4247, "num_data_blocks": 513, "num_entries": 1675, "num_filter_entries": 1675, "num_deletions": 301, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709534694, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "06277ad3-8ea4-4637-a751-ef7266e44b2a", "db_session_id": "N3G2XLLUHVMYV8H42RJK", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534694155374, "job": 1, "event": "recovery_finished"} 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fe95518000 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: DB pointer 0x55fe95502000 2024-03-04T06:44:54.311 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: ** DB Stats ** 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: ** Compaction Stats [default] ** 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: L0 1/0 6.83 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 548.0 0.01 0.00 1 0.012 0 0 0.0 0.0 2024-03-04T06:44:54.312 INFO:journalctl@ceph.mon.c.smithi137.stdout: L6 1/0 5.63 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: Sum 2/0 12.47 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 548.0 0.01 0.00 1 0.012 0 0 0.0 0.0 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 548.0 0.01 0.00 1 0.012 0 0 0.0 0.0 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: ** Compaction Stats [default] ** 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 548.0 0.01 0.00 1 0.012 0 0 0.0 0.0 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: Flush(GB): cumulative 0.007, interval 0.007 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-04T06:44:54.313 INFO:journalctl@ceph.mon.c.smithi137.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: Cumulative compaction: 0.01 GB write, 220.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: Interval compaction: 0.01 GB write, 220.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: Block cache BinnedLRUCache@0x55fe954251f0#2 capacity: 512.00 MB usage: 16.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.53 KB,0.000864267%) IndexBlock(1,12.08 KB,0.00230372%) Misc(1,0.00 KB,0%) 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: starting mon.c rank 2 at public addrs [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] at bind addrs [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: mon.c@-1(???) e3 preinit fsid d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: mon.c@-1(???).mds e6 new map 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: mon.c@-1(???).mds e6 print_map 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: e6 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-04T06:44:54.314 INFO:journalctl@ceph.mon.c.smithi137.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: legacy client fscid: 1 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: Filesystem 'cephfs' (1) 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: fs_name cephfs 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: epoch 6 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: created 2024-03-04T06:38:12.879589+0000 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: modified 2024-03-04T06:38:14.885821+0000 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: tableserver 0 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: root 0 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: session_timeout 60 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: session_autoclose 300 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: max_file_size 1099511627776 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: max_xattr_size 65536 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: required_client_features {} 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: last_failure 0 2024-03-04T06:44:54.315 INFO:journalctl@ceph.mon.c.smithi137.stdout: last_failure_osd_epoch 0 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: max_mds 1 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: in 0 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: up {0=24352} 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: failed 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: damaged 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: stopped 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: data_pools [3] 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: metadata_pool 2 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: inline_data disabled 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: balancer 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: bal_rank_mask -1 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: standby_count_wanted 0 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: [mds.b{0:24352} state up:active seq 3 addr [v2:172.21.15.203:6832/3636376444,v1:172.21.15.203:6833/3636376444] compat {c=[1],r=[1],i=[7ff]}] 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:44:54.316 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:44:54.317 INFO:journalctl@ceph.mon.c.smithi137.stdout: Standby daemons: 2024-03-04T06:44:54.317 INFO:journalctl@ceph.mon.c.smithi137.stdout: 2024-03-04T06:44:54.317 INFO:journalctl@ceph.mon.c.smithi137.stdout: [mds.a{-1:14451} state up:standby seq 1 addr [v2:172.21.15.137:6834/3869447426,v1:172.21.15.137:6835/3869447426] compat {c=[1],r=[1],i=[7ff]}] 2024-03-04T06:44:54.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: mon.c@-1(???).osd e236 crush map has features 3314933069573799936, adjusting msgr requires 2024-03-04T06:44:54.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: mon.c@-1(???).osd e236 crush map has features 432629308056666112, adjusting msgr requires 2024-03-04T06:44:54.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: mon.c@-1(???).osd e236 crush map has features 432629308056666112, adjusting msgr requires 2024-03-04T06:44:54.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: mon.c@-1(???).osd e236 crush map has features 432629308056666112, adjusting msgr requires 2024-03-04T06:44:54.317 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:54 smithi137 ceph-mon[91314]: mon.c@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-03-04T06:44:54.845 INFO:tasks.rados.rados.0.smithi137.stdout:901: done (2 left) 2024-03-04T06:44:54.845 INFO:tasks.rados.rados.0.smithi137.stdout:903: done (1 left) 2024-03-04T06:44:54.845 INFO:tasks.rados.rados.0.smithi137.stdout:905: done (0 left) 2024-03-04T06:44:54.845 INFO:tasks.rados.rados.0.smithi137.stdout:906: snap_remove snap 71 2024-03-04T06:44:55.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:44:55] "GET /metrics HTTP/1.1" 200 36000 "" "Prometheus/2.43.0" 2024-03-04T06:44:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:44:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: mon.c calling monitor election 2024-03-04T06:44:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: mon.a calling monitor election 2024-03-04T06:44:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: pgmap v25: 121 pgs: 121 active+clean; 280 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2024-03-04T06:44:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-04T06:44:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: monmap e3: 3 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0],c=[v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: osdmap e236: 8 total, 8 up, 8 in 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: mgrmap e39: y(active, since 16s), standbys: x 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: overall HEALTH_OK 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[91314]: osdmap e237: 8 total, 8 up, 8 in 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: mon.c calling monitor election 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: mon.a calling monitor election 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: pgmap v25: 121 pgs: 121 active+clean; 280 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-04T06:44:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: monmap e3: 3 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0],c=[v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:44:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:44:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: osdmap e236: 8 total, 8 up, 8 in 2024-03-04T06:44:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: mgrmap e39: y(active, since 16s), standbys: x 2024-03-04T06:44:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: overall HEALTH_OK 2024-03-04T06:44:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:55 smithi137 ceph-mon[88869]: osdmap e237: 8 total, 8 up, 8 in 2024-03-04T06:44:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:44:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: mon.c calling monitor election 2024-03-04T06:44:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: mon.a calling monitor election 2024-03-04T06:44:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: pgmap v25: 121 pgs: 121 active+clean; 280 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2024-03-04T06:44:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-04T06:44:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: monmap e3: 3 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0],c=[v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:44:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:44:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: osdmap e236: 8 total, 8 up, 8 in 2024-03-04T06:44:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: mgrmap e39: y(active, since 16s), standbys: x 2024-03-04T06:44:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: overall HEALTH_OK 2024-03-04T06:44:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:44:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:55 smithi203 ceph-mon[30756]: osdmap e237: 8 total, 8 up, 8 in 2024-03-04T06:44:55.849 INFO:tasks.rados.rados.0.smithi137.stdout:906: done (0 left) 2024-03-04T06:44:55.850 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 93 2024-03-04T06:44:55.850 INFO:tasks.rados.rados.0.smithi137.stdout:907: seq_num 292 ranges {2146304=98304} 2024-03-04T06:44:55.863 INFO:tasks.rados.rados.0.smithi137.stdout:907: writing smithi13777483-25 from 2146304 to 2244608 tid 1 2024-03-04T06:44:55.863 INFO:tasks.rados.rados.0.smithi137.stdout:908: copy_from oid 1 from oid 10 current snap is 93 2024-03-04T06:44:55.863 INFO:tasks.rados.rados.0.smithi137.stdout:909: read oid 46 snap -1 2024-03-04T06:44:55.863 INFO:tasks.rados.rados.0.smithi137.stdout:909: expect (ObjNum 278 snap 89 seq_num 278) 2024-03-04T06:44:55.863 INFO:tasks.rados.rados.0.smithi137.stdout:910: setattr oid 4 current snap is 93 2024-03-04T06:44:55.866 INFO:tasks.rados.rados.0.smithi137.stdout:911: delete oid 21 current snap is 93 2024-03-04T06:44:55.871 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 136 (ObjNum 240 snap 72 seq_num 240) dirty exists 2024-03-04T06:44:55.874 INFO:tasks.rados.rados.0.smithi137.stdout:907: finishing write tid 1 to smithi13777483-25 2024-03-04T06:44:55.874 INFO:tasks.rados.rados.0.smithi137.stdout:907: finishing write tid 2 to smithi13777483-25 2024-03-04T06:44:55.875 INFO:tasks.rados.rados.0.smithi137.stdout:910: done (4 left) 2024-03-04T06:44:55.876 INFO:tasks.rados.rados.0.smithi137.stdout:911: done (3 left) 2024-03-04T06:44:55.876 INFO:tasks.rados.rados.0.smithi137.stdout:912: snap_remove snap 62 2024-03-04T06:44:56.855 INFO:tasks.rados.rados.0.smithi137.stdout:912: done (3 left) 2024-03-04T06:44:56.855 INFO:tasks.rados.rados.0.smithi137.stdout:913: rollback oid 41 current snap is 93 2024-03-04T06:44:56.855 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 41 to 26 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:914: read oid 29 snap -1 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:914: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:915: read oid 32 snap -1 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:915: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:916: snap_create 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:907: finishing write tid 3 to smithi13777483-25 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:907: oid 25 updating version 0 to 540 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:907: oid 25 version 540 is already newer than 539 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 540 (ObjNum 292 snap 93 seq_num 292) dirty exists 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:907: left oid 25 (ObjNum 292 snap 93 seq_num 292) 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:908: finishing copy_from racing read to smithi13777483-1 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:908: finishing copy_from to smithi13777483-1 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 438 (ObjNum 280 snap 89 seq_num 280) dirty exists 2024-03-04T06:44:56.856 INFO:tasks.rados.rados.0.smithi137.stdout:909: expect (ObjNum 278 snap 89 seq_num 278) 2024-03-04T06:44:56.930 INFO:tasks.rados.rados.0.smithi137.stdout:913: finishing rollback tid 0 to smithi13777483-41 2024-03-04T06:44:56.930 INFO:tasks.rados.rados.0.smithi137.stdout:913: finishing rollback tid 1 to smithi13777483-41 2024-03-04T06:44:56.930 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 192 (ObjNum 593 snap 0 seq_num 0) dirty dne 2024-03-04T06:44:56.930 INFO:tasks.rados.rados.0.smithi137.stdout:914: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-04T06:44:56.958 INFO:tasks.rados.rados.0.smithi137.stdout:915: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:44:57.112 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:56 smithi137 ceph-mon[88869]: osdmap e238: 8 total, 8 up, 8 in 2024-03-04T06:44:57.112 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:56 smithi137 ceph-mon[88869]: pgmap v28: 121 pgs: 121 active+clean; 281 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 824 KiB/s wr, 0 op/s 2024-03-04T06:44:57.113 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:56 smithi137 ceph-mon[91314]: osdmap e238: 8 total, 8 up, 8 in 2024-03-04T06:44:57.113 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:56 smithi137 ceph-mon[91314]: pgmap v28: 121 pgs: 121 active+clean; 281 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 824 KiB/s wr, 0 op/s 2024-03-04T06:44:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:56 smithi203 ceph-mon[30756]: osdmap e238: 8 total, 8 up, 8 in 2024-03-04T06:44:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:56 smithi203 ceph-mon[30756]: pgmap v28: 121 pgs: 121 active+clean; 281 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 824 KiB/s wr, 0 op/s 2024-03-04T06:44:57.855 INFO:tasks.rados.rados.0.smithi137.stdout:907: done (6 left) 2024-03-04T06:44:57.855 INFO:tasks.rados.rados.0.smithi137.stdout:908: done (5 left) 2024-03-04T06:44:57.855 INFO:tasks.rados.rados.0.smithi137.stdout:909: done (4 left) 2024-03-04T06:44:57.855 INFO:tasks.rados.rados.0.smithi137.stdout:913: done (3 left) 2024-03-04T06:44:57.855 INFO:tasks.rados.rados.0.smithi137.stdout:914: done (2 left) 2024-03-04T06:44:57.855 INFO:tasks.rados.rados.0.smithi137.stdout:915: done (1 left) 2024-03-04T06:44:57.855 INFO:tasks.rados.rados.0.smithi137.stdout:916: done (0 left) 2024-03-04T06:44:57.855 INFO:tasks.rados.rados.0.smithi137.stdout:917: copy_from oid 31 from oid 33 current snap is 94 2024-03-04T06:44:57.855 INFO:tasks.rados.rados.0.smithi137.stdout:918: read oid 10 snap -1 2024-03-04T06:44:57.856 INFO:tasks.rados.rados.0.smithi137.stdout:918: expect (ObjNum 280 snap 89 seq_num 280) 2024-03-04T06:44:57.856 INFO:tasks.rados.rados.0.smithi137.stdout:919: snap_remove snap 50 2024-03-04T06:44:58.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:57 smithi137 ceph-mon[88869]: osdmap e239: 8 total, 8 up, 8 in 2024-03-04T06:44:58.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:57 smithi137 ceph-mon[91314]: osdmap e239: 8 total, 8 up, 8 in 2024-03-04T06:44:58.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:57 smithi203 ceph-mon[30756]: osdmap e239: 8 total, 8 up, 8 in 2024-03-04T06:44:58.871 INFO:tasks.rados.rados.0.smithi137.stdout:919: done (2 left) 2024-03-04T06:44:58.871 INFO:tasks.rados.rados.0.smithi137.stdout:920: snap_create 2024-03-04T06:44:58.871 INFO:tasks.rados.rados.0.smithi137.stdout:918: expect (ObjNum 280 snap 89 seq_num 280) 2024-03-04T06:44:58.934 INFO:tasks.rados.rados.0.smithi137.stdout:917: finishing copy_from racing read to smithi13777483-31 2024-03-04T06:44:58.935 INFO:tasks.rados.rados.0.smithi137.stdout:917: finishing copy_from to smithi13777483-31 2024-03-04T06:44:58.935 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 369 (ObjNum 289 snap 91 seq_num 289) dirty exists 2024-03-04T06:44:59.166 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:58 smithi137 ceph-mon[91314]: osdmap e240: 8 total, 8 up, 8 in 2024-03-04T06:44:59.166 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:58 smithi137 ceph-mon[91314]: pgmap v31: 121 pgs: 121 active+clean; 281 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 0 op/s 2024-03-04T06:44:59.166 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:58 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:59.166 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:58 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:59.166 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:58 smithi137 ceph-mon[88869]: osdmap e240: 8 total, 8 up, 8 in 2024-03-04T06:44:59.166 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:58 smithi137 ceph-mon[88869]: pgmap v31: 121 pgs: 121 active+clean; 281 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 0 op/s 2024-03-04T06:44:59.166 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:58 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:59.166 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:58 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:59.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:58 smithi203 ceph-mon[30756]: osdmap e240: 8 total, 8 up, 8 in 2024-03-04T06:44:59.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:58 smithi203 ceph-mon[30756]: pgmap v31: 121 pgs: 121 active+clean; 281 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 0 op/s 2024-03-04T06:44:59.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:58 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:59.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:58 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:44:59.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:44:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:44:59.165+0000 7fca9a02c700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-04T06:44:59.867 INFO:tasks.rados.rados.0.smithi137.stdout:917: done (2 left) 2024-03-04T06:44:59.867 INFO:tasks.rados.rados.0.smithi137.stdout:918: done (1 left) 2024-03-04T06:44:59.867 INFO:tasks.rados.rados.0.smithi137.stdout:920: done (0 left) 2024-03-04T06:44:59.867 INFO:tasks.rados.rados.0.smithi137.stdout:921: read oid 29 snap -1 2024-03-04T06:44:59.867 INFO:tasks.rados.rados.0.smithi137.stdout:921: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-04T06:44:59.867 INFO:tasks.rados.rados.0.smithi137.stdout:922: delete oid 5 current snap is 95 2024-03-04T06:44:59.871 INFO:tasks.rados.rados.0.smithi137.stdout:922: done (1 left) 2024-03-04T06:44:59.871 INFO:tasks.rados.rados.0.smithi137.stdout:923: setattr oid 25 current snap is 95 2024-03-04T06:44:59.874 INFO:tasks.rados.rados.0.smithi137.stdout:921: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-04T06:44:59.906 INFO:tasks.rados.rados.0.smithi137.stdout:921: done (1 left) 2024-03-04T06:44:59.907 INFO:tasks.rados.rados.0.smithi137.stdout:924: rollback oid 27 current snap is 95 2024-03-04T06:44:59.907 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 27 to 87 2024-03-04T06:44:59.907 INFO:tasks.rados.rados.0.smithi137.stdout:925: delete oid 42 current snap is 95 2024-03-04T06:44:59.910 INFO:tasks.rados.rados.0.smithi137.stdout:924: finishing rollback tid 0 to smithi13777483-27 2024-03-04T06:44:59.910 INFO:tasks.rados.rados.0.smithi137.stdout:924: finishing rollback tid 1 to smithi13777483-27 2024-03-04T06:44:59.912 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 570 (ObjNum 292 snap 93 seq_num 292) dirty exists 2024-03-04T06:44:59.912 INFO:tasks.rados.rados.0.smithi137.stdout:924: finishing rollback tid 2 to smithi13777483-27 2024-03-04T06:44:59.912 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 629 (ObjNum 289 snap 0 seq_num 3817368743) dirty exists 2024-03-04T06:44:59.912 INFO:tasks.rados.rados.0.smithi137.stdout:923: done (2 left) 2024-03-04T06:44:59.913 INFO:tasks.rados.rados.0.smithi137.stdout:924: done (1 left) 2024-03-04T06:44:59.913 INFO:tasks.rados.rados.0.smithi137.stdout:925: done (0 left) 2024-03-04T06:44:59.913 INFO:tasks.rados.rados.0.smithi137.stdout:926: copy_from oid 34 from oid 6 current snap is 95 2024-03-04T06:44:59.913 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 95 2024-03-04T06:44:59.913 INFO:tasks.rados.rados.0.smithi137.stdout:927: seq_num 296 ranges {2301952=163840} 2024-03-04T06:44:59.926 INFO:tasks.rados.rados.0.smithi137.stdout:927: writing smithi13777483-1 from 2301952 to 2465792 tid 1 2024-03-04T06:44:59.926 INFO:tasks.rados.rados.0.smithi137.stdout:928: delete oid 36 current snap is 95 2024-03-04T06:44:59.926 INFO:tasks.rados.rados.0.smithi137.stdout:926: finishing copy_from racing read to smithi13777483-34 2024-03-04T06:44:59.926 INFO:tasks.rados.rados.0.smithi137.stdout:926: finishing copy_from to smithi13777483-34 2024-03-04T06:44:59.926 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 242 (ObjNum 216 snap 63 seq_num 216) dirty exists 2024-03-04T06:44:59.928 INFO:tasks.rados.rados.0.smithi137.stdout:926: done (2 left) 2024-03-04T06:44:59.928 INFO:tasks.rados.rados.0.smithi137.stdout:928: done (1 left) 2024-03-04T06:44:59.928 INFO:tasks.rados.rados.0.smithi137.stdout:929: snap_create 2024-03-04T06:44:59.928 INFO:tasks.rados.rados.0.smithi137.stdout:927: finishing write tid 1 to smithi13777483-1 2024-03-04T06:44:59.928 INFO:tasks.rados.rados.0.smithi137.stdout:927: finishing write tid 2 to smithi13777483-1 2024-03-04T06:44:59.929 INFO:tasks.rados.rados.0.smithi137.stdout:927: finishing write tid 3 to smithi13777483-1 2024-03-04T06:44:59.929 INFO:tasks.rados.rados.0.smithi137.stdout:927: oid 1 updating version 0 to 439 2024-03-04T06:44:59.930 INFO:tasks.rados.rados.0.smithi137.stdout:927: oid 1 updating version 439 to 440 2024-03-04T06:44:59.930 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 440 (ObjNum 296 snap 95 seq_num 296) dirty exists 2024-03-04T06:44:59.930 INFO:tasks.rados.rados.0.smithi137.stdout:927: left oid 1 (ObjNum 296 snap 95 seq_num 296) 2024-03-04T06:45:00.110 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:59 smithi137 ceph-mon[88869]: osdmap e241: 8 total, 8 up, 8 in 2024-03-04T06:45:00.110 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:59 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:00.110 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:44:59 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:00.110 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:59 smithi137 ceph-mon[91314]: osdmap e241: 8 total, 8 up, 8 in 2024-03-04T06:45:00.110 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:59 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:00.110 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:44:59 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:59 smithi203 ceph-mon[30756]: osdmap e241: 8 total, 8 up, 8 in 2024-03-04T06:45:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:59 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:44:59 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:00.872 INFO:tasks.rados.rados.0.smithi137.stdout:927: done (1 left) 2024-03-04T06:45:00.873 INFO:tasks.rados.rados.0.smithi137.stdout:929: done (0 left) 2024-03-04T06:45:00.873 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 96 2024-03-04T06:45:00.873 INFO:tasks.rados.rados.0.smithi137.stdout:930: seq_num 298 ranges {2318336=196608} 2024-03-04T06:45:00.886 INFO:tasks.rados.rados.0.smithi137.stdout:930: writing smithi13777483-47 from 2318336 to 2514944 tid 1 2024-03-04T06:45:00.886 INFO:tasks.rados.rados.0.smithi137.stdout:931: snap_remove snap 77 2024-03-04T06:45:01.247 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:00 smithi203 ceph-mon[30756]: osdmap e242: 8 total, 8 up, 8 in 2024-03-04T06:45:01.247 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:00 smithi203 ceph-mon[30756]: pgmap v34: 121 pgs: 121 active+clean; 270 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 896 KiB/s wr, 11 op/s 2024-03-04T06:45:01.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:00 smithi137 ceph-mon[88869]: osdmap e242: 8 total, 8 up, 8 in 2024-03-04T06:45:01.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:00 smithi137 ceph-mon[88869]: pgmap v34: 121 pgs: 121 active+clean; 270 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 896 KiB/s wr, 11 op/s 2024-03-04T06:45:01.281 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:00 smithi137 ceph-mon[91314]: osdmap e242: 8 total, 8 up, 8 in 2024-03-04T06:45:01.281 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:00 smithi137 ceph-mon[91314]: pgmap v34: 121 pgs: 121 active+clean; 270 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 896 KiB/s wr, 11 op/s 2024-03-04T06:45:01.876 INFO:tasks.rados.rados.0.smithi137.stdout:931: done (1 left) 2024-03-04T06:45:01.876 INFO:tasks.rados.rados.0.smithi137.stdout:932: delete oid 9 current snap is 96 2024-03-04T06:45:01.876 INFO:tasks.rados.rados.0.smithi137.stdout:930: finishing write tid 1 to smithi13777483-47 2024-03-04T06:45:01.877 INFO:tasks.rados.rados.0.smithi137.stdout:930: finishing write tid 2 to smithi13777483-47 2024-03-04T06:45:01.877 INFO:tasks.rados.rados.0.smithi137.stdout:930: finishing write tid 3 to smithi13777483-47 2024-03-04T06:45:01.877 INFO:tasks.rados.rados.0.smithi137.stdout:930: oid 47 updating version 0 to 573 2024-03-04T06:45:01.877 INFO:tasks.rados.rados.0.smithi137.stdout:930: oid 47 version 573 is already newer than 572 2024-03-04T06:45:01.877 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 573 (ObjNum 298 snap 96 seq_num 298) dirty exists 2024-03-04T06:45:01.877 INFO:tasks.rados.rados.0.smithi137.stdout:930: left oid 47 (ObjNum 298 snap 96 seq_num 298) 2024-03-04T06:45:01.889 INFO:tasks.rados.rados.0.smithi137.stdout:930: done (1 left) 2024-03-04T06:45:01.889 INFO:tasks.rados.rados.0.smithi137.stdout:932: done (0 left) 2024-03-04T06:45:01.889 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 96 2024-03-04T06:45:01.889 INFO:tasks.rados.rados.0.smithi137.stdout:933: seq_num 300 ranges {2269184=229376} 2024-03-04T06:45:01.903 INFO:tasks.rados.rados.0.smithi137.stdout:933: writing smithi13777483-46 from 2269184 to 2498560 tid 1 2024-03-04T06:45:01.903 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 96 2024-03-04T06:45:01.903 INFO:tasks.rados.rados.0.smithi137.stdout:934: seq_num 301 ranges {7913472=245760} 2024-03-04T06:45:01.948 INFO:tasks.rados.rados.0.smithi137.stdout:934: writing smithi13777483-15 from 7913472 to 8159232 tid 1 2024-03-04T06:45:01.949 INFO:tasks.rados.rados.0.smithi137.stdout:935: read oid 31 snap -1 2024-03-04T06:45:01.949 INFO:tasks.rados.rados.0.smithi137.stdout:935: expect (ObjNum 289 snap 91 seq_num 289) 2024-03-04T06:45:01.949 INFO:tasks.rados.rados.0.smithi137.stdout:936: rmattr oid 29 current snap is 96 2024-03-04T06:45:01.949 INFO:tasks.rados.rados.0.smithi137.stdout:933: finishing write tid 1 to smithi13777483-46 2024-03-04T06:45:01.949 INFO:tasks.rados.rados.0.smithi137.stdout:933: finishing write tid 2 to smithi13777483-46 2024-03-04T06:45:01.949 INFO:tasks.rados.rados.0.smithi137.stdout:933: finishing write tid 3 to smithi13777483-46 2024-03-04T06:45:01.949 INFO:tasks.rados.rados.0.smithi137.stdout:933: oid 46 updating version 0 to 642 2024-03-04T06:45:01.949 INFO:tasks.rados.rados.0.smithi137.stdout:933: oid 46 version 642 is already newer than 641 2024-03-04T06:45:01.949 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 642 (ObjNum 300 snap 96 seq_num 300) dirty exists 2024-03-04T06:45:01.949 INFO:tasks.rados.rados.0.smithi137.stdout:933: left oid 46 (ObjNum 300 snap 96 seq_num 300) 2024-03-04T06:45:01.949 INFO:tasks.rados.rados.0.smithi137.stdout:933: done (3 left) 2024-03-04T06:45:01.949 INFO:tasks.rados.rados.0.smithi137.stdout:937: rmattr oid 4 current snap is 96 2024-03-04T06:45:01.949 INFO:tasks.rados.rados.0.smithi137.stdout:938: setattr oid 6 current snap is 96 2024-03-04T06:45:01.950 INFO:tasks.rados.rados.0.smithi137.stdout:939: copy_from oid 36 from oid 49 current snap is 96 2024-03-04T06:45:01.950 INFO:tasks.rados.rados.0.smithi137.stdout:940: rollback oid 9 current snap is 96 2024-03-04T06:45:01.950 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 9 to 26 2024-03-04T06:45:01.950 INFO:tasks.rados.rados.0.smithi137.stdout:941: snap_create 2024-03-04T06:45:01.952 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 137 (ObjNum 240 snap 72 seq_num 240) dirty exists 2024-03-04T06:45:01.952 INFO:tasks.rados.rados.0.smithi137.stdout:940: finishing rollback tid 1 to smithi13777483-9 2024-03-04T06:45:01.952 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 320 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-04T06:45:01.953 INFO:tasks.rados.rados.0.smithi137.stdout:940: finishing rollback tid 2 to smithi13777483-9 2024-03-04T06:45:01.954 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 491 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-03-04T06:45:01.955 INFO:tasks.rados.rados.0.smithi137.stdout:934: finishing write tid 1 to smithi13777483-15 2024-03-04T06:45:01.955 INFO:tasks.rados.rados.0.smithi137.stdout:934: finishing write tid 2 to smithi13777483-15 2024-03-04T06:45:01.956 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 524 (ObjNum 216 snap 63 seq_num 216) dirty exists 2024-03-04T06:45:01.956 INFO:tasks.rados.rados.0.smithi137.stdout:935: expect (ObjNum 289 snap 91 seq_num 289) 2024-03-04T06:45:02.012 INFO:tasks.rados.rados.0.smithi137.stdout:934: finishing write tid 3 to smithi13777483-15 2024-03-04T06:45:02.012 INFO:tasks.rados.rados.0.smithi137.stdout:934: oid 15 updating version 0 to 522 2024-03-04T06:45:02.012 INFO:tasks.rados.rados.0.smithi137.stdout:934: oid 15 version 522 is already newer than 521 2024-03-04T06:45:02.012 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 522 (ObjNum 301 snap 96 seq_num 301) dirty exists 2024-03-04T06:45:02.012 INFO:tasks.rados.rados.0.smithi137.stdout:934: left oid 15 (ObjNum 301 snap 96 seq_num 301) 2024-03-04T06:45:02.012 INFO:tasks.rados.rados.0.smithi137.stdout:939: finishing copy_from racing read to smithi13777483-36 2024-03-04T06:45:02.012 INFO:tasks.rados.rados.0.smithi137.stdout:939: finishing copy_from to smithi13777483-36 2024-03-04T06:45:02.013 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 326 (ObjNum 270 snap 87 seq_num 270) dirty exists 2024-03-04T06:45:02.291 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:01 smithi137 ceph-mon[88869]: osdmap e243: 8 total, 8 up, 8 in 2024-03-04T06:45:02.292 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:01 smithi137 ceph-mon[91314]: osdmap e243: 8 total, 8 up, 8 in 2024-03-04T06:45:02.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:01 smithi203 ceph-mon[30756]: osdmap e243: 8 total, 8 up, 8 in 2024-03-04T06:45:02.892 INFO:tasks.rados.rados.0.smithi137.stdout:934: done (7 left) 2024-03-04T06:45:02.892 INFO:tasks.rados.rados.0.smithi137.stdout:935: done (6 left) 2024-03-04T06:45:02.893 INFO:tasks.rados.rados.0.smithi137.stdout:936: done (5 left) 2024-03-04T06:45:02.893 INFO:tasks.rados.rados.0.smithi137.stdout:937: done (4 left) 2024-03-04T06:45:02.893 INFO:tasks.rados.rados.0.smithi137.stdout:938: done (3 left) 2024-03-04T06:45:02.893 INFO:tasks.rados.rados.0.smithi137.stdout:939: done (2 left) 2024-03-04T06:45:02.893 INFO:tasks.rados.rados.0.smithi137.stdout:940: done (1 left) 2024-03-04T06:45:02.893 INFO:tasks.rados.rados.0.smithi137.stdout:941: done (0 left) 2024-03-04T06:45:02.893 INFO:tasks.rados.rados.0.smithi137.stdout:942: read oid 7 snap 59 2024-03-04T06:45:02.893 INFO:tasks.rados.rados.0.smithi137.stdout:942: expect deleted 2024-03-04T06:45:02.893 INFO:tasks.rados.rados.0.smithi137.stdout:943: copy_from oid 13 from oid 41 current snap is 97 2024-03-04T06:45:02.893 INFO:tasks.rados.rados.0.smithi137.stdout:944: snap_remove snap 84 2024-03-04T06:45:03.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:02 smithi137 ceph-mon[91314]: osdmap e244: 8 total, 8 up, 8 in 2024-03-04T06:45:03.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:02 smithi137 ceph-mon[91314]: pgmap v37: 121 pgs: 121 active+clean; 270 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 896 KiB/s wr, 11 op/s 2024-03-04T06:45:03.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:02 smithi137 ceph-mon[88869]: osdmap e244: 8 total, 8 up, 8 in 2024-03-04T06:45:03.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:02 smithi137 ceph-mon[88869]: pgmap v37: 121 pgs: 121 active+clean; 270 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 896 KiB/s wr, 11 op/s 2024-03-04T06:45:03.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:02 smithi203 ceph-mon[30756]: osdmap e244: 8 total, 8 up, 8 in 2024-03-04T06:45:03.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:02 smithi203 ceph-mon[30756]: pgmap v37: 121 pgs: 121 active+clean; 270 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 896 KiB/s wr, 11 op/s 2024-03-04T06:45:03.896 INFO:tasks.rados.rados.0.smithi137.stdout:944: done (2 left) 2024-03-04T06:45:03.896 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 97 2024-03-04T06:45:03.896 INFO:tasks.rados.rados.0.smithi137.stdout:945: seq_num 302 ranges {1318912=262144} 2024-03-04T06:45:03.901 INFO:tasks.rados.rados.0.smithi137.stdout:945: writing smithi13777483-44 from 1318912 to 1581056 tid 1 2024-03-04T06:45:03.901 INFO:tasks.rados.rados.0.smithi137.stdout:946: snap_create 2024-03-04T06:45:03.901 INFO:tasks.rados.rados.0.smithi137.stdout:943: finishing copy_from to smithi13777483-13 2024-03-04T06:45:03.901 INFO:tasks.rados.rados.0.smithi137.stdout:943: got expected ENOENT (src dne) 2024-03-04T06:45:03.901 INFO:tasks.rados.rados.0.smithi137.stdout:943: finishing copy_from racing read to smithi13777483-13 2024-03-04T06:45:03.907 INFO:tasks.rados.rados.0.smithi137.stdout:945: finishing write tid 1 to smithi13777483-44 2024-03-04T06:45:03.907 INFO:tasks.rados.rados.0.smithi137.stdout:945: finishing write tid 2 to smithi13777483-44 2024-03-04T06:45:03.909 INFO:tasks.rados.rados.0.smithi137.stdout:945: finishing write tid 3 to smithi13777483-44 2024-03-04T06:45:03.909 INFO:tasks.rados.rados.0.smithi137.stdout:945: oid 44 updating version 0 to 407 2024-03-04T06:45:03.909 INFO:tasks.rados.rados.0.smithi137.stdout:945: oid 44 version 407 is already newer than 406 2024-03-04T06:45:03.909 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 407 (ObjNum 302 snap 97 seq_num 302) dirty exists 2024-03-04T06:45:03.909 INFO:tasks.rados.rados.0.smithi137.stdout:945: left oid 44 (ObjNum 302 snap 97 seq_num 302) 2024-03-04T06:45:04.163 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:03 smithi203 ceph-mon[30756]: osdmap e245: 8 total, 8 up, 8 in 2024-03-04T06:45:04.163 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:03 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:04.163 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:03 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:04.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:03 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:04.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:03 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:45:04.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:03 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:04.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:03 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:45:04.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:03 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:04.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:03 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-04T06:45:04.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:03 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-04T06:45:04.164 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:03 smithi203 ceph-mon[30756]: Upgrade: It appears safe to stop mon.b 2024-03-04T06:45:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[91314]: osdmap e245: 8 total, 8 up, 8 in 2024-03-04T06:45:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:45:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:45:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-04T06:45:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-04T06:45:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[91314]: Upgrade: It appears safe to stop mon.b 2024-03-04T06:45:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[88869]: osdmap e245: 8 total, 8 up, 8 in 2024-03-04T06:45:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:45:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:45:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-04T06:45:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-04T06:45:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:03 smithi137 ceph-mon[88869]: Upgrade: It appears safe to stop mon.b 2024-03-04T06:45:04.846 INFO:tasks.rados.rados.0.smithi137.stdout:942: done (3 left) 2024-03-04T06:45:04.846 INFO:tasks.rados.rados.0.smithi137.stdout:943: done (2 left) 2024-03-04T06:45:04.846 INFO:tasks.rados.rados.0.smithi137.stdout:945: done (1 left) 2024-03-04T06:45:04.846 INFO:tasks.rados.rados.0.smithi137.stdout:946: done (0 left) 2024-03-04T06:45:04.847 INFO:tasks.rados.rados.0.smithi137.stdout:947: snap_create 2024-03-04T06:45:05.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:04 smithi203 ceph-mon[30756]: osdmap e246: 8 total, 8 up, 8 in 2024-03-04T06:45:05.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:04 smithi203 ceph-mon[30756]: pgmap v40: 121 pgs: 121 active+clean; 270 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:45:05.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:04 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:05.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:04 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:45:05.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:04 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:45:05.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:04 smithi203 ceph-mon[30756]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:05.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:04 smithi203 ceph-mon[30756]: osdmap e247: 8 total, 8 up, 8 in 2024-03-04T06:45:05.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[91314]: osdmap e246: 8 total, 8 up, 8 in 2024-03-04T06:45:05.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[91314]: pgmap v40: 121 pgs: 121 active+clean; 270 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:45:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:45:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:45:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[91314]: osdmap e247: 8 total, 8 up, 8 in 2024-03-04T06:45:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[88869]: osdmap e246: 8 total, 8 up, 8 in 2024-03-04T06:45:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[88869]: pgmap v40: 121 pgs: 121 active+clean; 270 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:45:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:45:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:45:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:04 smithi137 ceph-mon[88869]: osdmap e247: 8 total, 8 up, 8 in 2024-03-04T06:45:05.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:45:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:45:05] "GET /metrics HTTP/1.1" 200 36000 "" "Prometheus/2.43.0" 2024-03-04T06:45:05.849 INFO:tasks.rados.rados.0.smithi137.stdout:947: done (0 left) 2024-03-04T06:45:05.849 INFO:tasks.rados.rados.0.smithi137.stdout:948: snap_remove snap 59 2024-03-04T06:45:06.058 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:05 smithi203 ceph-mon[30756]: Upgrade: Updating mon.b 2024-03-04T06:45:06.058 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:05 smithi203 ceph-mon[30756]: Deploying daemon mon.b on smithi203 2024-03-04T06:45:06.058 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:05 smithi203 ceph-mon[30756]: osdmap e248: 8 total, 8 up, 8 in 2024-03-04T06:45:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:05 smithi137 ceph-mon[91314]: Upgrade: Updating mon.b 2024-03-04T06:45:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:05 smithi137 ceph-mon[91314]: Deploying daemon mon.b on smithi203 2024-03-04T06:45:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:05 smithi137 ceph-mon[91314]: osdmap e248: 8 total, 8 up, 8 in 2024-03-04T06:45:06.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:05 smithi137 ceph-mon[88869]: Upgrade: Updating mon.b 2024-03-04T06:45:06.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:05 smithi137 ceph-mon[88869]: Deploying daemon mon.b on smithi203 2024-03-04T06:45:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:05 smithi137 ceph-mon[88869]: osdmap e248: 8 total, 8 up, 8 in 2024-03-04T06:45:06.853 INFO:tasks.rados.rados.0.smithi137.stdout:948: done (0 left) 2024-03-04T06:45:06.853 INFO:tasks.rados.rados.0.smithi137.stdout:949: snap_remove snap 93 2024-03-04T06:45:06.872 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:06 smithi203 systemd[1]: Stopping Ceph mon.b for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:45:07.263 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b[30752]: 2024-03-04T06:45:06.871+0000 7fdb3dc0e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:45:07.263 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b[30752]: 2024-03-04T06:45:06.871+0000 7fdb3dc0e700 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-03-04T06:45:07.263 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:07 smithi203 podman[85409]: 2024-03-04 06:45:07.015559446 +0000 UTC m=+0.259646983 container died c1087568a24648aac52339e8dd525c6f333a866bb58884a14166ec7d8a725c91 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=reef-5cc7a76) 2024-03-04T06:45:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:07 smithi203 podman[85409]: 2024-03-04 06:45:07.429741219 +0000 UTC m=+0.673828756 container cleanup c1087568a24648aac52339e8dd525c6f333a866bb58884a14166ec7d8a725c91 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, ceph=True, RELEASE=reef-5cc7a76, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-04T06:45:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:07 smithi203 bash[85409]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b 2024-03-04T06:45:08.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:07 smithi203 podman[85423]: 2024-03-04 06:45:07.677305051 +0000 UTC m=+0.663479139 container remove c1087568a24648aac52339e8dd525c6f333a866bb58884a14166ec7d8a725c91 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=reef-5cc7a76, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-03-04T06:45:08.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:07 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.b.service: Deactivated successfully. 2024-03-04T06:45:08.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:07 smithi203 systemd[1]: Stopped Ceph mon.b for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:45:08.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:07 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.b.service: Consumed 10.067s CPU time. 2024-03-04T06:45:08.436 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 systemd[1]: Starting Ceph mon.b for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:45:08.436 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 podman[85554]: 2024-03-04 06:45:08.218294557 +0000 UTC m=+0.018372249 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:45:08.436 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 podman[85554]: 2024-03-04 06:45:08.33301193 +0000 UTC m=+0.133089650 container create b544783be085c8ba9572c5755f52615c82e6f4ec56ba3245cda0d4f18b1dee69 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-04T06:45:08.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 podman[85554]: 2024-03-04 06:45:08.57843286 +0000 UTC m=+0.378510549 container init b544783be085c8ba9572c5755f52615c82e6f4ec56ba3245cda0d4f18b1dee69 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-04T06:45:08.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 podman[85554]: 2024-03-04 06:45:08.581727341 +0000 UTC m=+0.381805015 container start b544783be085c8ba9572c5755f52615c82e6f4ec56ba3245cda0d4f18b1dee69 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-04T06:45:08.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: set uid:gid to 167:167 (ceph:ceph) 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev), process ceph-mon, pid 2 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: pidfile_write: ignore empty --pid-file 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: load: jerasure load: lrc 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: RocksDB version: 7.9.2 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Git sha 0 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Compile date 2024-03-01 16:22:25 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: DB SUMMARY 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: DB Session ID: 1OPEDDHF3078KMR2ATR5 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: CURRENT file: CURRENT 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: IDENTITY file: IDENTITY 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1404 Bytes 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000027.sst 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000025.log size: 12645647 ; 2024-03-04T06:45:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.error_if_exists: 0 2024-03-04T06:45:08.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.create_if_missing: 0 2024-03-04T06:45:08.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.paranoid_checks: 1 2024-03-04T06:45:08.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-04T06:45:08.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-04T06:45:08.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-04T06:45:08.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.env: 0x55992bf5fb20 2024-03-04T06:45:08.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.fs: PosixFileSystem 2024-03-04T06:45:08.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.info_log: 0x55992d8739e0 2024-03-04T06:45:08.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_file_opening_threads: 16 2024-03-04T06:45:08.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.statistics: (nil) 2024-03-04T06:45:08.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.use_fsync: 0 2024-03-04T06:45:08.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_log_file_size: 0 2024-03-04T06:45:08.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-04T06:45:08.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-04T06:45:08.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.keep_log_file_num: 1000 2024-03-04T06:45:08.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.recycle_log_file_num: 0 2024-03-04T06:45:08.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.allow_fallocate: 1 2024-03-04T06:45:08.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.allow_mmap_reads: 0 2024-03-04T06:45:08.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.allow_mmap_writes: 0 2024-03-04T06:45:08.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.use_direct_reads: 0 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.create_missing_column_families: 0 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.db_log_dir: 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.wal_dir: 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.advise_random_on_open: 1 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.db_write_buffer_size: 0 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.write_buffer_manager: 0x55992d846dc0 2024-03-04T06:45:08.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.rate_limiter: (nil) 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.wal_recovery_mode: 2 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.enable_thread_tracking: 0 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.enable_pipelined_write: 0 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.unordered_write: 0 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.row_cache: None 2024-03-04T06:45:08.852 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.wal_filter: None 2024-03-04T06:45:08.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-04T06:45:08.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.allow_ingest_behind: 0 2024-03-04T06:45:08.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.two_write_queues: 0 2024-03-04T06:45:08.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.manual_wal_flush: 0 2024-03-04T06:45:08.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.wal_compression: 0 2024-03-04T06:45:08.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.atomic_flush: 0 2024-03-04T06:45:08.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-04T06:45:08.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-04T06:45:08.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-04T06:45:08.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.log_readahead_size: 0 2024-03-04T06:45:08.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-04T06:45:08.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.best_efforts_recovery: 0 2024-03-04T06:45:08.853 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.allow_data_in_errors: 0 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.db_host_id: __hostname__ 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_background_jobs: 2 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_background_compactions: -1 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_subcompactions: 1 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_total_wal_size: 0 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-04T06:45:08.854 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_open_files: -1 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.bytes_per_sync: 0 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compaction_readahead_size: 0 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_background_flushes: -1 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Compression algorithms supported: 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: kZSTD supported: 0 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: kXpressCompression supported: 0 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: kLZ4HCCompression supported: 1 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: kZlibCompression supported: 1 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: kSnappyCompression supported: 1 2024-03-04T06:45:08.855 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: kLZ4Compression supported: 1 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: kBZip2Compression supported: 0 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000010 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.merge_operator: 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compaction_filter: None 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compaction_filter_factory: None 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.sst_partitioner_factory: None 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55992d873ae0) 2024-03-04T06:45:08.856 INFO:journalctl@ceph.mon.b.smithi203.stdout: cache_index_and_filter_blocks: 1 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: pin_top_level_index_and_filter: 1 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: index_type: 0 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: data_block_index_type: 0 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: index_shortening: 1 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: checksum: 4 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: no_block_cache: 0 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_cache: 0x55992d8791f0 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_cache_name: BinnedLRUCache 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_cache_options: 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: capacity : 536870912 2024-03-04T06:45:08.857 INFO:journalctl@ceph.mon.b.smithi203.stdout: num_shard_bits : 4 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: strict_capacity_limit : 0 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: high_pri_pool_ratio: 0.000 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_cache_compressed: (nil) 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: persistent_cache: (nil) 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_size: 4096 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_size_deviation: 10 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_restart_interval: 16 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: index_block_restart_interval: 1 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: metadata_block_size: 4096 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: partition_filters: 0 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: use_delta_encoding: 1 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: filter_policy: bloomfilter 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: whole_key_filtering: 1 2024-03-04T06:45:08.858 INFO:journalctl@ceph.mon.b.smithi203.stdout: verify_compression: 0 2024-03-04T06:45:08.859 INFO:journalctl@ceph.mon.b.smithi203.stdout: read_amp_bytes_per_bit: 0 2024-03-04T06:45:08.859 INFO:journalctl@ceph.mon.b.smithi203.stdout: format_version: 5 2024-03-04T06:45:08.859 INFO:journalctl@ceph.mon.b.smithi203.stdout: enable_index_compression: 1 2024-03-04T06:45:08.859 INFO:journalctl@ceph.mon.b.smithi203.stdout: block_align: 0 2024-03-04T06:45:08.859 INFO:journalctl@ceph.mon.b.smithi203.stdout: max_auto_readahead_size: 262144 2024-03-04T06:45:08.859 INFO:journalctl@ceph.mon.b.smithi203.stdout: prepopulate_block_cache: 0 2024-03-04T06:45:08.859 INFO:journalctl@ceph.mon.b.smithi203.stdout: initial_auto_readahead_size: 8192 2024-03-04T06:45:08.859 INFO:journalctl@ceph.mon.b.smithi203.stdout: num_file_reads_for_auto_readahead: 2 2024-03-04T06:45:08.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.write_buffer_size: 33554432 2024-03-04T06:45:08.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_write_buffer_number: 2 2024-03-04T06:45:08.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compression: NoCompression 2024-03-04T06:45:08.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.bottommost_compression: Disabled 2024-03-04T06:45:08.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.prefix_extractor: nullptr 2024-03-04T06:45:08.860 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-04T06:45:08.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.num_levels: 7 2024-03-04T06:45:08.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-04T06:45:08.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-04T06:45:08.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-04T06:45:08.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-04T06:45:08.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-04T06:45:08.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-04T06:45:08.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-04T06:45:08.861 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compression_opts.level: 32767 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compression_opts.strategy: 0 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compression_opts.enabled: false 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-04T06:45:08.862 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-04T06:45:08.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-04T06:45:08.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-04T06:45:08.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.target_file_size_base: 67108864 2024-03-04T06:45:08.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-04T06:45:08.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-04T06:45:08.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-04T06:45:08.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-04T06:45:08.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-04T06:45:08.863 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-04T06:45:08.864 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-04T06:45:08.864 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-04T06:45:08.864 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-04T06:45:08.864 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-04T06:45:08.864 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-04T06:45:08.864 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-04T06:45:08.864 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-04T06:45:08.864 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.arena_block_size: 1048576 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.disable_auto_compactions: 0 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-04T06:45:08.865 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.table_properties_collectors: 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.inplace_update_support: 0 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.bloom_locality: 0 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.max_successive_merges: 0 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.paranoid_file_checks: 0 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.force_consistency_checks: 1 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.report_bg_io_stats: 0 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.ttl: 2592000 2024-03-04T06:45:08.866 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.enable_blob_files: false 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.min_blob_size: 0 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.blob_file_size: 268435456 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.blob_file_starting_level: 0 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-04T06:45:08.867 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 13277, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-03-04T06:45:08.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-03-04T06:45:08.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c6147200-c21d-4ff7-94c5-2fe598fef76e 2024-03-04T06:45:08.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534708611204, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-03-04T06:45:08.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-03-04T06:45:08.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534708641038, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 7708915, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 13282, "largest_seqno": 17633, "table_properties": {"data_size": 7690083, "index_size": 13203, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 4613, "raw_key_size": 42261, "raw_average_key_size": 23, "raw_value_size": 7651181, "raw_average_value_size": 4174, "num_data_blocks": 573, "num_entries": 1833, "num_filter_entries": 1833, "num_deletions": 309, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709534708, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c6147200-c21d-4ff7-94c5-2fe598fef76e", "db_session_id": "1OPEDDHF3078KMR2ATR5", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-03-04T06:45:08.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709534708641138, "job": 1, "event": "recovery_finished"} 2024-03-04T06:45:08.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-03-04T06:45:08.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-04T06:45:08.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-04T06:45:08.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55992d96c000 2024-03-04T06:45:08.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: DB pointer 0x55992d956000 2024-03-04T06:45:08.868 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-04T06:45:08.869 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-04T06:45:08.869 INFO:journalctl@ceph.mon.b.smithi203.stdout: ** DB Stats ** 2024-03-04T06:45:08.869 INFO:journalctl@ceph.mon.b.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T06:45:08.869 INFO:journalctl@ceph.mon.b.smithi203.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-04T06:45:08.869 INFO:journalctl@ceph.mon.b.smithi203.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T06:45:08.869 INFO:journalctl@ceph.mon.b.smithi203.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T06:45:08.869 INFO:journalctl@ceph.mon.b.smithi203.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-04T06:45:08.869 INFO:journalctl@ceph.mon.b.smithi203.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T06:45:08.869 INFO:journalctl@ceph.mon.b.smithi203.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T06:45:08.869 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: ** Compaction Stats [default] ** 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: L0 1/0 7.35 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 562.6 0.01 0.00 1 0.013 0 0 0.0 0.0 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: L6 1/0 5.63 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: Sum 2/0 12.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 562.6 0.01 0.00 1 0.013 0 0 0.0 0.0 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 562.6 0.01 0.00 1 0.013 0 0 0.0 0.0 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: ** Compaction Stats [default] ** 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 562.6 0.01 0.00 1 0.013 0 0 0.0 0.0 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:45:08.870 INFO:journalctl@ceph.mon.b.smithi203.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: Flush(GB): cumulative 0.007, interval 0.007 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: Cumulative compaction: 0.01 GB write, 220.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: Interval compaction: 0.01 GB write, 220.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: Block cache BinnedLRUCache@0x55992d8791f0#2 capacity: 512.00 MB usage: 18.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,5.03 KB,0.000959635%) IndexBlock(1,13.08 KB,0.00249445%) Misc(1,0.00 KB,0%) 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-04T06:45:08.871 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: starting mon.b rank 1 at public addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] at bind addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:45:08.872 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: mon.b@-1(???) e3 preinit fsid d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T06:45:08.872 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: mon.b@-1(???).mds e6 new map 2024-03-04T06:45:08.872 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: mon.b@-1(???).mds e6 print_map 2024-03-04T06:45:08.872 INFO:journalctl@ceph.mon.b.smithi203.stdout: e6 2024-03-04T06:45:08.872 INFO:journalctl@ceph.mon.b.smithi203.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-04T06:45:08.872 INFO:journalctl@ceph.mon.b.smithi203.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-04T06:45:08.872 INFO:journalctl@ceph.mon.b.smithi203.stdout: legacy client fscid: 1 2024-03-04T06:45:08.872 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:45:08.872 INFO:journalctl@ceph.mon.b.smithi203.stdout: Filesystem 'cephfs' (1) 2024-03-04T06:45:08.872 INFO:journalctl@ceph.mon.b.smithi203.stdout: fs_name cephfs 2024-03-04T06:45:08.872 INFO:journalctl@ceph.mon.b.smithi203.stdout: epoch 6 2024-03-04T06:45:08.872 INFO:journalctl@ceph.mon.b.smithi203.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-04T06:45:08.872 INFO:journalctl@ceph.mon.b.smithi203.stdout: created 2024-03-04T06:38:12.879589+0000 2024-03-04T06:45:08.873 INFO:journalctl@ceph.mon.b.smithi203.stdout: modified 2024-03-04T06:38:14.885821+0000 2024-03-04T06:45:08.873 INFO:journalctl@ceph.mon.b.smithi203.stdout: tableserver 0 2024-03-04T06:45:08.873 INFO:journalctl@ceph.mon.b.smithi203.stdout: root 0 2024-03-04T06:45:08.873 INFO:journalctl@ceph.mon.b.smithi203.stdout: session_timeout 60 2024-03-04T06:45:08.873 INFO:journalctl@ceph.mon.b.smithi203.stdout: session_autoclose 300 2024-03-04T06:45:08.873 INFO:journalctl@ceph.mon.b.smithi203.stdout: max_file_size 1099511627776 2024-03-04T06:45:08.873 INFO:journalctl@ceph.mon.b.smithi203.stdout: max_xattr_size 65536 2024-03-04T06:45:08.873 INFO:journalctl@ceph.mon.b.smithi203.stdout: required_client_features {} 2024-03-04T06:45:08.873 INFO:journalctl@ceph.mon.b.smithi203.stdout: last_failure 0 2024-03-04T06:45:08.873 INFO:journalctl@ceph.mon.b.smithi203.stdout: last_failure_osd_epoch 0 2024-03-04T06:45:08.874 INFO:journalctl@ceph.mon.b.smithi203.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-04T06:45:08.874 INFO:journalctl@ceph.mon.b.smithi203.stdout: max_mds 1 2024-03-04T06:45:08.874 INFO:journalctl@ceph.mon.b.smithi203.stdout: in 0 2024-03-04T06:45:08.874 INFO:journalctl@ceph.mon.b.smithi203.stdout: up {0=24352} 2024-03-04T06:45:08.874 INFO:journalctl@ceph.mon.b.smithi203.stdout: failed 2024-03-04T06:45:08.874 INFO:journalctl@ceph.mon.b.smithi203.stdout: damaged 2024-03-04T06:45:08.874 INFO:journalctl@ceph.mon.b.smithi203.stdout: stopped 2024-03-04T06:45:08.874 INFO:journalctl@ceph.mon.b.smithi203.stdout: data_pools [3] 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout: metadata_pool 2 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout: inline_data disabled 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout: balancer 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout: bal_rank_mask -1 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout: standby_count_wanted 0 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout: [mds.b{0:24352} state up:active seq 3 addr [v2:172.21.15.203:6832/3636376444,v1:172.21.15.203:6833/3636376444] compat {c=[1],r=[1],i=[7ff]}] 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout: Standby daemons: 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout: 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout: [mds.a{-1:14451} state up:standby seq 1 addr [v2:172.21.15.137:6834/3869447426,v1:172.21.15.137:6835/3869447426] compat {c=[1],r=[1],i=[7ff]}] 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: mon.b@-1(???).osd e249 crush map has features 3314933069573799936, adjusting msgr requires 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: mon.b@-1(???).osd e249 crush map has features 432629308056666112, adjusting msgr requires 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: mon.b@-1(???).osd e249 crush map has features 432629308056666112, adjusting msgr requires 2024-03-04T06:45:08.875 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: mon.b@-1(???).osd e249 crush map has features 432629308056666112, adjusting msgr requires 2024-03-04T06:45:08.876 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 ceph-mon[85573]: mon.b@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-03-04T06:45:08.876 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 bash[85554]: b544783be085c8ba9572c5755f52615c82e6f4ec56ba3245cda0d4f18b1dee69 2024-03-04T06:45:08.876 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:08 smithi203 systemd[1]: Started Ceph mon.b for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:45:10.957 INFO:tasks.rados.rados.0.smithi137.stdout:949: done (0 left) 2024-03-04T06:45:10.957 INFO:tasks.rados.rados.0.smithi137.stdout:950: delete oid 6 current snap is 99 2024-03-04T06:45:10.967 INFO:tasks.rados.rados.0.smithi137.stdout:950: done (0 left) 2024-03-04T06:45:10.967 INFO:tasks.rados.rados.0.smithi137.stdout:951: read oid 23 snap 72 2024-03-04T06:45:10.967 INFO:tasks.rados.rados.0.smithi137.stdout:951: expect (ObjNum 188 snap 50 seq_num 188) 2024-03-04T06:45:10.967 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 99 2024-03-04T06:45:10.967 INFO:tasks.rados.rados.0.smithi137.stdout:952: seq_num 304 ranges {5931008=294912} 2024-03-04T06:45:11.001 INFO:tasks.rados.rados.0.smithi137.stdout:952: writing smithi13777483-14 from 5931008 to 6225920 tid 1 2024-03-04T06:45:11.001 INFO:tasks.rados.rados.0.smithi137.stdout:953: delete oid 37 current snap is 99 2024-03-04T06:45:11.001 INFO:tasks.rados.rados.0.smithi137.stdout:951: expect (ObjNum 188 snap 50 seq_num 188) 2024-03-04T06:45:11.025 INFO:tasks.rados.rados.0.smithi137.stdout:952: finishing write tid 1 to smithi13777483-14 2024-03-04T06:45:11.026 INFO:tasks.rados.rados.0.smithi137.stdout:952: finishing write tid 2 to smithi13777483-14 2024-03-04T06:45:11.026 INFO:tasks.rados.rados.0.smithi137.stdout:952: finishing write tid 3 to smithi13777483-14 2024-03-04T06:45:11.026 INFO:tasks.rados.rados.0.smithi137.stdout:952: oid 14 updating version 0 to 367 2024-03-04T06:45:11.026 INFO:tasks.rados.rados.0.smithi137.stdout:952: oid 14 version 367 is already newer than 366 2024-03-04T06:45:11.026 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 367 (ObjNum 304 snap 99 seq_num 304) dirty exists 2024-03-04T06:45:11.026 INFO:tasks.rados.rados.0.smithi137.stdout:952: left oid 14 (ObjNum 304 snap 99 seq_num 304) 2024-03-04T06:45:11.026 INFO:tasks.rados.rados.0.smithi137.stdout:951: done (2 left) 2024-03-04T06:45:11.026 INFO:tasks.rados.rados.0.smithi137.stdout:952: done (1 left) 2024-03-04T06:45:11.026 INFO:tasks.rados.rados.0.smithi137.stdout:953: done (0 left) 2024-03-04T06:45:11.026 INFO:tasks.rados.rados.0.smithi137.stdout:954: read oid 27 snap -1 2024-03-04T06:45:11.026 INFO:tasks.rados.rados.0.smithi137.stdout:954: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:45:11.026 INFO:tasks.rados.rados.0.smithi137.stdout:955: read oid 12 snap -1 2024-03-04T06:45:11.026 INFO:tasks.rados.rados.0.smithi137.stdout:955: expect deleted 2024-03-04T06:45:11.027 INFO:tasks.rados.rados.0.smithi137.stdout:956: delete oid 38 current snap is 99 2024-03-04T06:45:11.027 INFO:tasks.rados.rados.0.smithi137.stdout:955: done (2 left) 2024-03-04T06:45:11.027 INFO:tasks.rados.rados.0.smithi137.stdout:956: done (1 left) 2024-03-04T06:45:11.027 INFO:tasks.rados.rados.0.smithi137.stdout:957: snap_remove snap 82 2024-03-04T06:45:11.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: mon.c calling monitor election 2024-03-04T06:45:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: mon.b calling monitor election 2024-03-04T06:45:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:45:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: mon.a calling monitor election 2024-03-04T06:45:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:45:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:45:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-04T06:45:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: monmap e4: 3 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0],c=[v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:45:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:45:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: osdmap e249: 8 total, 8 up, 8 in 2024-03-04T06:45:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: mgrmap e39: y(active, since 31s), standbys: x 2024-03-04T06:45:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: overall HEALTH_OK 2024-03-04T06:45:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:11.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:45:11.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[91314]: pgmap v46: 121 pgs: 121 active+clean; 275 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.0 MiB/s rd, 725 KiB/s wr, 14 op/s 2024-03-04T06:45:11.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: mon.c calling monitor election 2024-03-04T06:45:11.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: mon.b calling monitor election 2024-03-04T06:45:11.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:45:11.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: mon.a calling monitor election 2024-03-04T06:45:11.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:45:11.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:45:11.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-04T06:45:11.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: monmap e4: 3 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0],c=[v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:45:11.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:45:11.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: osdmap e249: 8 total, 8 up, 8 in 2024-03-04T06:45:11.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: mgrmap e39: y(active, since 31s), standbys: x 2024-03-04T06:45:11.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: overall HEALTH_OK 2024-03-04T06:45:11.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:11.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:11.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:45:11.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:10 smithi137 ceph-mon[88869]: pgmap v46: 121 pgs: 121 active+clean; 275 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.0 MiB/s rd, 725 KiB/s wr, 14 op/s 2024-03-04T06:45:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: mon.c calling monitor election 2024-03-04T06:45:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: mon.b calling monitor election 2024-03-04T06:45:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T06:45:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: mon.a calling monitor election 2024-03-04T06:45:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T06:45:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T06:45:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-04T06:45:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: monmap e4: 3 mons at {a=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],b=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0],c=[v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T06:45:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:45:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: osdmap e249: 8 total, 8 up, 8 in 2024-03-04T06:45:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: mgrmap e39: y(active, since 31s), standbys: x 2024-03-04T06:45:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: overall HEALTH_OK 2024-03-04T06:45:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:45:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:10 smithi203 ceph-mon[85573]: pgmap v46: 121 pgs: 121 active+clean; 275 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.0 MiB/s rd, 725 KiB/s wr, 14 op/s 2024-03-04T06:45:11.992 INFO:tasks.rados.rados.0.smithi137.stdout:957: done (1 left) 2024-03-04T06:45:11.992 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 99 2024-03-04T06:45:11.992 INFO:tasks.rados.rados.0.smithi137.stdout:958: seq_num 307 ranges {1228800=344064} 2024-03-04T06:45:12.000 INFO:tasks.rados.rados.0.smithi137.stdout:958: writing smithi13777483-34 from 1228800 to 1572864 tid 1 2024-03-04T06:45:12.000 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 99 2024-03-04T06:45:12.001 INFO:tasks.rados.rados.0.smithi137.stdout:954: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:45:12.004 INFO:tasks.rados.rados.0.smithi137.stdout:958: finishing write tid 1 to smithi13777483-34 2024-03-04T06:45:12.004 INFO:tasks.rados.rados.0.smithi137.stdout:958: finishing write tid 2 to smithi13777483-34 2024-03-04T06:45:12.004 INFO:tasks.rados.rados.0.smithi137.stdout:959: seq_num 308 ranges {1630208=360448} 2024-03-04T06:45:12.015 INFO:tasks.rados.rados.0.smithi137.stdout:959: writing smithi13777483-4 from 1630208 to 1990656 tid 1 2024-03-04T06:45:12.015 INFO:tasks.rados.rados.0.smithi137.stdout:954: done (2 left) 2024-03-04T06:45:12.015 INFO:tasks.rados.rados.0.smithi137.stdout:960: copy_from oid 21 from oid 1 current snap is 99 2024-03-04T06:45:12.015 INFO:tasks.rados.rados.0.smithi137.stdout:958: finishing write tid 3 to smithi13777483-34 2024-03-04T06:45:12.015 INFO:tasks.rados.rados.0.smithi137.stdout:958: oid 34 updating version 0 to 408 2024-03-04T06:45:12.015 INFO:tasks.rados.rados.0.smithi137.stdout:958: oid 34 updating version 408 to 409 2024-03-04T06:45:12.016 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 409 (ObjNum 307 snap 99 seq_num 307) dirty exists 2024-03-04T06:45:12.016 INFO:tasks.rados.rados.0.smithi137.stdout:958: left oid 34 (ObjNum 307 snap 99 seq_num 307) 2024-03-04T06:45:12.016 INFO:tasks.rados.rados.0.smithi137.stdout:958: done (2 left) 2024-03-04T06:45:12.016 INFO:tasks.rados.rados.0.smithi137.stdout:961: snap_remove snap 58 2024-03-04T06:45:12.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:11 smithi137 ceph-mon[88869]: osdmap e250: 8 total, 8 up, 8 in 2024-03-04T06:45:12.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:11 smithi137 ceph-mon[91314]: osdmap e250: 8 total, 8 up, 8 in 2024-03-04T06:45:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:11 smithi203 ceph-mon[85573]: osdmap e250: 8 total, 8 up, 8 in 2024-03-04T06:45:12.996 INFO:tasks.rados.rados.0.smithi137.stdout:961: done (2 left) 2024-03-04T06:45:12.997 INFO:tasks.rados.rados.0.smithi137.stdout:962: read oid 28 snap 96 2024-03-04T06:45:12.997 INFO:tasks.rados.rados.0.smithi137.stdout:962: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:45:12.997 INFO:tasks.rados.rados.0.smithi137.stdout:963: rmattr oid 38 current snap is 99 2024-03-04T06:45:12.997 INFO:tasks.rados.rados.0.smithi137.stdout:963: done (3 left) 2024-03-04T06:45:12.997 INFO:tasks.rados.rados.0.smithi137.stdout:964: read oid 49 snap -1 2024-03-04T06:45:12.997 INFO:tasks.rados.rados.0.smithi137.stdout:964: expect (ObjNum 270 snap 87 seq_num 270) 2024-03-04T06:45:12.997 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 37 current snap is 99 2024-03-04T06:45:12.997 INFO:tasks.rados.rados.0.smithi137.stdout:965: seq_num 309 ranges {0=376832} 2024-03-04T06:45:12.999 INFO:tasks.rados.rados.0.smithi137.stdout:965: writing smithi13777483-37 from 0 to 376832 tid 1 2024-03-04T06:45:12.999 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 99 2024-03-04T06:45:12.999 INFO:tasks.rados.rados.0.smithi137.stdout:966: seq_num 310 ranges {0=401408} 2024-03-04T06:45:13.003 INFO:tasks.rados.rados.0.smithi137.stdout:966: writing smithi13777483-3 from 0 to 401408 tid 1 2024-03-04T06:45:13.003 INFO:tasks.rados.rados.0.smithi137.stdout:959: finishing write tid 1 to smithi13777483-4 2024-03-04T06:45:13.004 INFO:tasks.rados.rados.0.smithi137.stdout:959: finishing write tid 2 to smithi13777483-4 2024-03-04T06:45:13.004 INFO:tasks.rados.rados.0.smithi137.stdout:959: finishing write tid 3 to smithi13777483-4 2024-03-04T06:45:13.004 INFO:tasks.rados.rados.0.smithi137.stdout:959: oid 4 updating version 0 to 138 2024-03-04T06:45:13.004 INFO:tasks.rados.rados.0.smithi137.stdout:959: oid 4 updating version 138 to 139 2024-03-04T06:45:13.004 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 139 (ObjNum 308 snap 99 seq_num 308) dirty exists 2024-03-04T06:45:13.004 INFO:tasks.rados.rados.0.smithi137.stdout:959: left oid 4 (ObjNum 308 snap 99 seq_num 308) 2024-03-04T06:45:13.004 INFO:tasks.rados.rados.0.smithi137.stdout:960: finishing copy_from racing read to smithi13777483-21 2024-03-04T06:45:13.004 INFO:tasks.rados.rados.0.smithi137.stdout:960: finishing copy_from to smithi13777483-21 2024-03-04T06:45:13.004 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 440 (ObjNum 296 snap 95 seq_num 296) dirty exists 2024-03-04T06:45:13.004 INFO:tasks.rados.rados.0.smithi137.stdout:959: done (5 left) 2024-03-04T06:45:13.004 INFO:tasks.rados.rados.0.smithi137.stdout:960: done (4 left) 2024-03-04T06:45:13.004 INFO:tasks.rados.rados.0.smithi137.stdout:967: snap_create 2024-03-04T06:45:13.012 INFO:tasks.rados.rados.0.smithi137.stdout:962: expect (ObjNum 74 snap 9 seq_num 74) 2024-03-04T06:45:13.054 INFO:tasks.rados.rados.0.smithi137.stdout:964: expect (ObjNum 270 snap 87 seq_num 270) 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:966: finishing write tid 1 to smithi13777483-3 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:966: finishing write tid 2 to smithi13777483-3 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:965: finishing write tid 1 to smithi13777483-37 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:965: finishing write tid 2 to smithi13777483-37 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:965: finishing write tid 3 to smithi13777483-37 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:965: oid 37 updating version 0 to 553 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:965: oid 37 version 553 is already newer than 552 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 553 (ObjNum 309 snap 99 seq_num 309) dirty exists 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:965: left oid 37 (ObjNum 309 snap 99 seq_num 309) 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:966: finishing write tid 3 to smithi13777483-3 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:966: oid 3 updating version 0 to 505 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:966: oid 3 version 505 is already newer than 504 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 505 (ObjNum 310 snap 99 seq_num 310) dirty exists 2024-03-04T06:45:13.110 INFO:tasks.rados.rados.0.smithi137.stdout:966: left oid 3 (ObjNum 310 snap 99 seq_num 310) 2024-03-04T06:45:13.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:12 smithi137 ceph-mon[88869]: osdmap e251: 8 total, 8 up, 8 in 2024-03-04T06:45:13.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:12 smithi137 ceph-mon[88869]: pgmap v49: 121 pgs: 121 active+clean; 275 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:45:13.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:12 smithi137 ceph-mon[91314]: osdmap e251: 8 total, 8 up, 8 in 2024-03-04T06:45:13.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:12 smithi137 ceph-mon[91314]: pgmap v49: 121 pgs: 121 active+clean; 275 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:45:13.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:12 smithi203 ceph-mon[85573]: osdmap e251: 8 total, 8 up, 8 in 2024-03-04T06:45:13.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:12 smithi203 ceph-mon[85573]: pgmap v49: 121 pgs: 121 active+clean; 275 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:45:13.992 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:45:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:45:13.649+0000 7fca9a02c700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-04T06:45:14.008 INFO:tasks.rados.rados.0.smithi137.stdout:962: done (4 left) 2024-03-04T06:45:14.008 INFO:tasks.rados.rados.0.smithi137.stdout:964: done (3 left) 2024-03-04T06:45:14.008 INFO:tasks.rados.rados.0.smithi137.stdout:965: done (2 left) 2024-03-04T06:45:14.008 INFO:tasks.rados.rados.0.smithi137.stdout:966: done (1 left) 2024-03-04T06:45:14.008 INFO:tasks.rados.rados.0.smithi137.stdout:967: done (0 left) 2024-03-04T06:45:14.008 INFO:tasks.rados.rados.0.smithi137.stdout:968: snap_create 2024-03-04T06:45:14.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:13 smithi203 ceph-mon[85573]: osdmap e252: 8 total, 8 up, 8 in 2024-03-04T06:45:14.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:13 smithi137 ceph-mon[88869]: osdmap e252: 8 total, 8 up, 8 in 2024-03-04T06:45:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:13 smithi137 ceph-mon[91314]: osdmap e252: 8 total, 8 up, 8 in 2024-03-04T06:45:14.652 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:45:14.850 INFO:tasks.rados.rados.0.smithi137.stdout:968: done (0 left) 2024-03-04T06:45:14.851 INFO:tasks.rados.rados.0.smithi137.stdout:969: read oid 16 snap -1 2024-03-04T06:45:14.851 INFO:tasks.rados.rados.0.smithi137.stdout:969: expect (ObjNum 101 snap 21 seq_num 101) 2024-03-04T06:45:14.851 INFO:tasks.rados.rados.0.smithi137.stdout:970: read oid 47 snap -1 2024-03-04T06:45:14.851 INFO:tasks.rados.rados.0.smithi137.stdout:970: expect (ObjNum 298 snap 96 seq_num 298) 2024-03-04T06:45:14.851 INFO:tasks.rados.rados.0.smithi137.stdout:971: read oid 20 snap -1 2024-03-04T06:45:14.851 INFO:tasks.rados.rados.0.smithi137.stdout:971: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:45:14.851 INFO:tasks.rados.rados.0.smithi137.stdout:972: copy_from oid 3 from oid 35 current snap is 101 2024-03-04T06:45:14.851 INFO:tasks.rados.rados.0.smithi137.stdout:973: snap_create 2024-03-04T06:45:14.862 INFO:tasks.rados.rados.0.smithi137.stdout:970: expect (ObjNum 298 snap 96 seq_num 298) 2024-03-04T06:45:14.984 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:45:14.984 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (5m) 16s ago 5m 27.7M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:45:14.984 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (5m) 0s ago 5m 87.9M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:45:14.984 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (7m) 16s ago 7m 17.9M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:45:14.984 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (7m) 0s ago 7m 18.6M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:45:14.984 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (61s) 0s ago 10m 448M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:45:14.984 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (91s) 16s ago 12m 492M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:45:14.984 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (45s) 16s ago 12m 39.1M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:45:14.984 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (6s) 0s ago 10m 29.9M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:45:14.985 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (21s) 16s ago 10m 22.7M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:45:14.985 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (5m) 16s ago 5m 16.5M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:45:14.985 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (5m) 0s ago 5m 15.6M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:45:14.985 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (10m) 16s ago 10m 178M 2480M 18.2.1-696-g5cc7a767 540557f94930 732ea50ff558 2024-03-04T06:45:14.985 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (9m) 16s ago 9m 180M 2480M 18.2.1-696-g5cc7a767 540557f94930 708139c858a7 2024-03-04T06:45:14.985 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (9m) 16s ago 9m 183M 2480M 18.2.1-696-g5cc7a767 540557f94930 b247adf81a73 2024-03-04T06:45:14.985 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (9m) 16s ago 9m 101M 2480M 18.2.1-696-g5cc7a767 540557f94930 afdbc25c9fba 2024-03-04T06:45:14.985 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (8m) 0s ago 8m 212M 2480M 18.2.1-696-g5cc7a767 540557f94930 d4841ffd0747 2024-03-04T06:45:14.985 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (8m) 0s ago 8m 225M 2480M 18.2.1-696-g5cc7a767 540557f94930 81d21771e157 2024-03-04T06:45:14.985 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (7m) 0s ago 7m 109M 2480M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:45:14.985 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (7m) 0s ago 7m 136M 2480M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:45:14.985 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (66s) 0s ago 6m 49.8M - 2.43.0 a07b618ecd1d 6a88bdd1023c 2024-03-04T06:45:14.993 INFO:tasks.rados.rados.0.smithi137.stdout:972: finishing copy_from racing read to smithi13777483-3 2024-03-04T06:45:14.993 INFO:tasks.rados.rados.0.smithi137.stdout:972: finishing copy_from to smithi13777483-3 2024-03-04T06:45:14.993 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 354 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:45:14.993 INFO:tasks.rados.rados.0.smithi137.stdout:969: expect (ObjNum 101 snap 21 seq_num 101) 2024-03-04T06:45:15.183 INFO:tasks.rados.rados.0.smithi137.stdout:971: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:45:15.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:15 smithi137 ceph-mon[88869]: osdmap e253: 8 total, 8 up, 8 in 2024-03-04T06:45:15.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:15 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:15.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:15 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:15.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:15 smithi137 ceph-mon[88869]: pgmap v52: 121 pgs: 121 active+clean; 276 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 928 KiB/s rd, 694 KiB/s wr, 2 op/s 2024-03-04T06:45:15.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:15 smithi137 ceph-mon[88869]: osdmap e254: 8 total, 8 up, 8 in 2024-03-04T06:45:15.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:15 smithi137 ceph-mon[91314]: osdmap e253: 8 total, 8 up, 8 in 2024-03-04T06:45:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:15 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:15 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:15 smithi137 ceph-mon[91314]: pgmap v52: 121 pgs: 121 active+clean; 276 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 928 KiB/s rd, 694 KiB/s wr, 2 op/s 2024-03-04T06:45:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:15 smithi137 ceph-mon[91314]: osdmap e254: 8 total, 8 up, 8 in 2024-03-04T06:45:15.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:15 smithi203 ceph-mon[85573]: osdmap e253: 8 total, 8 up, 8 in 2024-03-04T06:45:15.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:15 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:15.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:15 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:15.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:15 smithi203 ceph-mon[85573]: pgmap v52: 121 pgs: 121 active+clean; 276 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 928 KiB/s rd, 694 KiB/s wr, 2 op/s 2024-03-04T06:45:15.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:15 smithi203 ceph-mon[85573]: osdmap e254: 8 total, 8 up, 8 in 2024-03-04T06:45:15.409 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:45:15.409 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:45:15.409 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 8 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 10, 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 5 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:45:15.410 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:45:15.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:45:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:45:15] "GET /metrics HTTP/1.1" 200 36002 "" "Prometheus/2.43.0" 2024-03-04T06:45:15.849 INFO:tasks.rados.rados.0.smithi137.stdout:969: done (4 left) 2024-03-04T06:45:15.849 INFO:tasks.rados.rados.0.smithi137.stdout:970: done (3 left) 2024-03-04T06:45:15.849 INFO:tasks.rados.rados.0.smithi137.stdout:971: done (2 left) 2024-03-04T06:45:15.849 INFO:tasks.rados.rados.0.smithi137.stdout:972: done (1 left) 2024-03-04T06:45:15.849 INFO:tasks.rados.rados.0.smithi137.stdout:973: done (0 left) 2024-03-04T06:45:15.849 INFO:tasks.rados.rados.0.smithi137.stdout:974: rmattr oid 26 current snap is 102 2024-03-04T06:45:15.849 INFO:tasks.rados.rados.0.smithi137.stdout:975: rmattr oid 42 current snap is 102 2024-03-04T06:45:15.849 INFO:tasks.rados.rados.0.smithi137.stdout:975: done (1 left) 2024-03-04T06:45:15.849 INFO:tasks.rados.rados.0.smithi137.stdout:976: rmattr oid 11 current snap is 102 2024-03-04T06:45:15.849 INFO:tasks.rados.rados.0.smithi137.stdout:976: done (1 left) 2024-03-04T06:45:15.849 INFO:tasks.rados.rados.0.smithi137.stdout:977: snap_remove snap 97 2024-03-04T06:45:16.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:16 smithi137 ceph-mon[91314]: from='client.34161 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:45:16.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:16 smithi137 ceph-mon[91314]: from='client.34167 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:45:16.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:16 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:16.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:16 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:16.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:16 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/4245223327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:16.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:16 smithi137 ceph-mon[91314]: osdmap e255: 8 total, 8 up, 8 in 2024-03-04T06:45:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:16 smithi137 ceph-mon[88869]: from='client.34161 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:45:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:16 smithi137 ceph-mon[88869]: from='client.34167 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:45:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:16 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:16 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:16 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/4245223327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:16 smithi137 ceph-mon[88869]: osdmap e255: 8 total, 8 up, 8 in 2024-03-04T06:45:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:16 smithi203 ceph-mon[85573]: from='client.34161 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:45:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:16 smithi203 ceph-mon[85573]: from='client.34167 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:45:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:16 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:16 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:16 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/4245223327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:16 smithi203 ceph-mon[85573]: osdmap e255: 8 total, 8 up, 8 in 2024-03-04T06:45:16.852 INFO:tasks.rados.rados.0.smithi137.stdout:977: done (1 left) 2024-03-04T06:45:16.852 INFO:tasks.rados.rados.0.smithi137.stdout:978: delete oid 37 current snap is 102 2024-03-04T06:45:16.852 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 340 (ObjNum 223 snap 65 seq_num 223) dirty exists 2024-03-04T06:45:16.855 INFO:tasks.rados.rados.0.smithi137.stdout:974: done (1 left) 2024-03-04T06:45:16.855 INFO:tasks.rados.rados.0.smithi137.stdout:978: done (0 left) 2024-03-04T06:45:16.855 INFO:tasks.rados.rados.0.smithi137.stdout:979: rollback oid 3 current snap is 102 2024-03-04T06:45:16.856 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 3 to 99 2024-03-04T06:45:16.856 INFO:tasks.rados.rados.0.smithi137.stdout:980: setattr oid 37 current snap is 102 2024-03-04T06:45:16.857 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 102 2024-03-04T06:45:16.857 INFO:tasks.rados.rados.0.smithi137.stdout:981: seq_num 312 ranges {4653056=434176} 2024-03-04T06:45:16.884 INFO:tasks.rados.rados.0.smithi137.stdout:981: writing smithi13777483-18 from 4653056 to 5087232 tid 1 2024-03-04T06:45:16.884 INFO:tasks.rados.rados.0.smithi137.stdout:982: snap_create 2024-03-04T06:45:16.884 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 562 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:45:16.884 INFO:tasks.rados.rados.0.smithi137.stdout:979: finishing rollback tid 0 to smithi13777483-3 2024-03-04T06:45:16.884 INFO:tasks.rados.rados.0.smithi137.stdout:979: finishing rollback tid 1 to smithi13777483-3 2024-03-04T06:45:16.885 INFO:tasks.rados.rados.0.smithi137.stdout:979: finishing rollback tid 2 to smithi13777483-3 2024-03-04T06:45:16.885 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 515 (ObjNum 310 snap 99 seq_num 310) dirty exists 2024-03-04T06:45:16.887 INFO:tasks.rados.rados.0.smithi137.stdout:981: finishing write tid 1 to smithi13777483-18 2024-03-04T06:45:16.887 INFO:tasks.rados.rados.0.smithi137.stdout:981: finishing write tid 2 to smithi13777483-18 2024-03-04T06:45:16.889 INFO:tasks.rados.rados.0.smithi137.stdout:981: finishing write tid 3 to smithi13777483-18 2024-03-04T06:45:16.889 INFO:tasks.rados.rados.0.smithi137.stdout:981: oid 18 updating version 0 to 344 2024-03-04T06:45:16.889 INFO:tasks.rados.rados.0.smithi137.stdout:981: oid 18 updating version 344 to 345 2024-03-04T06:45:16.889 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 345 (ObjNum 312 snap 102 seq_num 312) dirty exists 2024-03-04T06:45:16.889 INFO:tasks.rados.rados.0.smithi137.stdout:981: left oid 18 (ObjNum 312 snap 102 seq_num 312) 2024-03-04T06:45:17.493 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:17 smithi203 ceph-mon[85573]: pgmap v55: 121 pgs: 121 active+clean; 273 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-03-04T06:45:17.493 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:17 smithi203 ceph-mon[85573]: osdmap e256: 8 total, 8 up, 8 in 2024-03-04T06:45:17.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:17 smithi137 ceph-mon[91314]: pgmap v55: 121 pgs: 121 active+clean; 273 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-03-04T06:45:17.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:17 smithi137 ceph-mon[91314]: osdmap e256: 8 total, 8 up, 8 in 2024-03-04T06:45:17.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:17 smithi137 ceph-mon[88869]: pgmap v55: 121 pgs: 121 active+clean; 273 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-03-04T06:45:17.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:17 smithi137 ceph-mon[88869]: osdmap e256: 8 total, 8 up, 8 in 2024-03-04T06:45:17.855 INFO:tasks.rados.rados.0.smithi137.stdout:979: done (3 left) 2024-03-04T06:45:17.855 INFO:tasks.rados.rados.0.smithi137.stdout:980: done (2 left) 2024-03-04T06:45:17.855 INFO:tasks.rados.rados.0.smithi137.stdout:981: done (1 left) 2024-03-04T06:45:17.855 INFO:tasks.rados.rados.0.smithi137.stdout:982: done (0 left) 2024-03-04T06:45:17.855 INFO:tasks.rados.rados.0.smithi137.stdout:983: read oid 7 snap 70 2024-03-04T06:45:17.855 INFO:tasks.rados.rados.0.smithi137.stdout:983: expect deleted 2024-03-04T06:45:17.855 INFO:tasks.rados.rados.0.smithi137.stdout:984: rmattr oid 2 current snap is 103 2024-03-04T06:45:17.855 INFO:tasks.rados.rados.0.smithi137.stdout:984: done (1 left) 2024-03-04T06:45:17.855 INFO:tasks.rados.rados.0.smithi137.stdout:985: copy_from oid 47 from oid 9 current snap is 103 2024-03-04T06:45:17.855 INFO:tasks.rados.rados.0.smithi137.stdout:986: copy_from oid 42 from oid 35 current snap is 103 2024-03-04T06:45:17.855 INFO:tasks.rados.rados.0.smithi137.stdout:987: copy_from oid 15 from oid 1 current snap is 103 2024-03-04T06:45:17.855 INFO:tasks.rados.rados.0.smithi137.stdout:988: delete oid 28 current snap is 103 2024-03-04T06:45:17.863 INFO:tasks.rados.rados.0.smithi137.stdout:985: finishing copy_from racing read to smithi13777483-47 2024-03-04T06:45:17.863 INFO:tasks.rados.rados.0.smithi137.stdout:983: done (4 left) 2024-03-04T06:45:17.863 INFO:tasks.rados.rados.0.smithi137.stdout:988: done (3 left) 2024-03-04T06:45:17.863 INFO:tasks.rados.rados.0.smithi137.stdout:989: rollback oid 40 current snap is 103 2024-03-04T06:45:17.863 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 40 to 64 2024-03-04T06:45:17.863 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 48 current snap is 103 2024-03-04T06:45:17.863 INFO:tasks.rados.rados.0.smithi137.stdout:990: seq_num 314 ranges {1138688=466944} 2024-03-04T06:45:17.872 INFO:tasks.rados.rados.0.smithi137.stdout:990: writing smithi13777483-48 from 1138688 to 1605632 tid 1 2024-03-04T06:45:17.872 INFO:tasks.rados.rados.0.smithi137.stdout:991: snap_remove snap 90 2024-03-04T06:45:18.862 INFO:tasks.rados.rados.0.smithi137.stdout:991: done (5 left) 2024-03-04T06:45:18.862 INFO:tasks.rados.rados.0.smithi137.stdout:992: snap_remove snap 89 2024-03-04T06:45:19.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[88869]: osdmap e257: 8 total, 8 up, 8 in 2024-03-04T06:45:19.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[88869]: pgmap v58: 121 pgs: 121 active+clean; 273 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 342 KiB/s wr, 5 op/s 2024-03-04T06:45:19.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:19.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:45:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[91314]: osdmap e257: 8 total, 8 up, 8 in 2024-03-04T06:45:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[91314]: pgmap v58: 121 pgs: 121 active+clean; 273 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 342 KiB/s wr, 5 op/s 2024-03-04T06:45:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:45:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:19.338 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:18 smithi203 ceph-mon[85573]: osdmap e257: 8 total, 8 up, 8 in 2024-03-04T06:45:19.338 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:18 smithi203 ceph-mon[85573]: pgmap v58: 121 pgs: 121 active+clean; 273 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 342 KiB/s wr, 5 op/s 2024-03-04T06:45:19.338 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:19.338 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:19.338 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:19.338 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:45:19.338 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:19.847 INFO:tasks.rados.rados.0.smithi137.stdout:992: done (5 left) 2024-03-04T06:45:19.848 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 103 2024-03-04T06:45:19.848 INFO:tasks.rados.rados.0.smithi137.stdout:985: finishing copy_from to smithi13777483-47 2024-03-04T06:45:19.848 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 491 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-03-04T06:45:19.848 INFO:tasks.rados.rados.0.smithi137.stdout:993: seq_num 315 ranges {5857280=483328} 2024-03-04T06:45:19.883 INFO:tasks.rados.rados.0.smithi137.stdout:993: writing smithi13777483-19 from 5857280 to 6340608 tid 1 2024-03-04T06:45:19.884 INFO:tasks.rados.rados.0.smithi137.stdout:985: done (5 left) 2024-03-04T06:45:19.884 INFO:tasks.rados.rados.0.smithi137.stdout:994: read oid 13 snap -1 2024-03-04T06:45:19.884 INFO:tasks.rados.rados.0.smithi137.stdout:994: expect (ObjNum 238 snap 72 seq_num 238) 2024-03-04T06:45:19.884 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 24 current snap is 103 2024-03-04T06:45:19.884 INFO:tasks.rados.rados.0.smithi137.stdout:986: finishing copy_from racing read to smithi13777483-42 2024-03-04T06:45:19.884 INFO:tasks.rados.rados.0.smithi137.stdout:986: finishing copy_from to smithi13777483-42 2024-03-04T06:45:19.884 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 354 (ObjNum 74 snap 9 seq_num 74) dirty exists 2024-03-04T06:45:19.884 INFO:tasks.rados.rados.0.smithi137.stdout:987: finishing copy_from racing read to smithi13777483-15 2024-03-04T06:45:19.884 INFO:tasks.rados.rados.0.smithi137.stdout:989: finishing rollback tid 0 to smithi13777483-40 2024-03-04T06:45:19.884 INFO:tasks.rados.rados.0.smithi137.stdout:995: seq_num 316 ranges {1630208=499712} 2024-03-04T06:45:19.896 INFO:tasks.rados.rados.0.smithi137.stdout:995: writing smithi13777483-24 from 1630208 to 2129920 tid 1 2024-03-04T06:45:19.896 INFO:tasks.rados.rados.0.smithi137.stdout:986: done (6 left) 2024-03-04T06:45:19.896 INFO:tasks.rados.rados.0.smithi137.stdout:996: read oid 3 snap -1 2024-03-04T06:45:19.896 INFO:tasks.rados.rados.0.smithi137.stdout:996: expect (ObjNum 310 snap 99 seq_num 310) 2024-03-04T06:45:19.896 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 103 2024-03-04T06:45:19.897 INFO:tasks.rados.rados.0.smithi137.stdout:989: finishing rollback tid 1 to smithi13777483-40 2024-03-04T06:45:19.897 INFO:tasks.rados.rados.0.smithi137.stdout:987: finishing copy_from to smithi13777483-15 2024-03-04T06:45:19.897 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 440 (ObjNum 296 snap 95 seq_num 296) dirty exists 2024-03-04T06:45:19.897 INFO:tasks.rados.rados.0.smithi137.stdout:989: finishing rollback tid 2 to smithi13777483-40 2024-03-04T06:45:19.897 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 568 (ObjNum 197 snap 56 seq_num 197) dirty exists 2024-03-04T06:45:19.897 INFO:tasks.rados.rados.0.smithi137.stdout:990: finishing write tid 1 to smithi13777483-48 2024-03-04T06:45:19.897 INFO:tasks.rados.rados.0.smithi137.stdout:990: finishing write tid 2 to smithi13777483-48 2024-03-04T06:45:19.897 INFO:tasks.rados.rados.0.smithi137.stdout:990: finishing write tid 3 to smithi13777483-48 2024-03-04T06:45:19.897 INFO:tasks.rados.rados.0.smithi137.stdout:990: oid 48 updating version 0 to 442 2024-03-04T06:45:19.897 INFO:tasks.rados.rados.0.smithi137.stdout:990: oid 48 version 442 is already newer than 441 2024-03-04T06:45:19.897 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 442 (ObjNum 314 snap 103 seq_num 314) dirty exists 2024-03-04T06:45:19.897 INFO:tasks.rados.rados.0.smithi137.stdout:990: left oid 48 (ObjNum 314 snap 103 seq_num 314) 2024-03-04T06:45:19.897 INFO:tasks.rados.rados.0.smithi137.stdout:997: seq_num 317 ranges {0=516096} 2024-03-04T06:45:19.899 INFO:tasks.rados.rados.0.smithi137.stdout:997: writing smithi13777483-27 from 0 to 516096 tid 1 2024-03-04T06:45:19.899 INFO:tasks.rados.rados.0.smithi137.stdout:987: done (7 left) 2024-03-04T06:45:19.899 INFO:tasks.rados.rados.0.smithi137.stdout:989: done (6 left) 2024-03-04T06:45:19.900 INFO:tasks.rados.rados.0.smithi137.stdout:990: done (5 left) 2024-03-04T06:45:19.900 INFO:tasks.rados.rados.0.smithi137.stdout:998: delete oid 46 current snap is 103 2024-03-04T06:45:19.900 INFO:tasks.rados.rados.0.smithi137.stdout:993: finishing write tid 1 to smithi13777483-19 2024-03-04T06:45:19.900 INFO:tasks.rados.rados.0.smithi137.stdout:993: finishing write tid 2 to smithi13777483-19 2024-03-04T06:45:19.900 INFO:tasks.rados.rados.0.smithi137.stdout:993: finishing write tid 3 to smithi13777483-19 2024-03-04T06:45:19.900 INFO:tasks.rados.rados.0.smithi137.stdout:993: oid 19 updating version 0 to 526 2024-03-04T06:45:19.900 INFO:tasks.rados.rados.0.smithi137.stdout:993: oid 19 version 526 is already newer than 525 2024-03-04T06:45:19.900 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 526 (ObjNum 315 snap 103 seq_num 315) dirty exists 2024-03-04T06:45:19.900 INFO:tasks.rados.rados.0.smithi137.stdout:993: left oid 19 (ObjNum 315 snap 103 seq_num 315) 2024-03-04T06:45:19.900 INFO:tasks.rados.rados.0.smithi137.stdout:995: finishing write tid 1 to smithi13777483-24 2024-03-04T06:45:19.900 INFO:tasks.rados.rados.0.smithi137.stdout:995: finishing write tid 2 to smithi13777483-24 2024-03-04T06:45:19.902 INFO:tasks.rados.rados.0.smithi137.stdout:995: finishing write tid 3 to smithi13777483-24 2024-03-04T06:45:19.902 INFO:tasks.rados.rados.0.smithi137.stdout:995: oid 24 updating version 0 to 203 2024-03-04T06:45:19.902 INFO:tasks.rados.rados.0.smithi137.stdout:995: oid 24 updating version 203 to 204 2024-03-04T06:45:19.902 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 204 (ObjNum 316 snap 103 seq_num 316) dirty exists 2024-03-04T06:45:19.902 INFO:tasks.rados.rados.0.smithi137.stdout:995: left oid 24 (ObjNum 316 snap 103 seq_num 316) 2024-03-04T06:45:19.902 INFO:tasks.rados.rados.0.smithi137.stdout:996: expect (ObjNum 310 snap 99 seq_num 310) 2024-03-04T06:45:19.914 INFO:tasks.rados.rados.0.smithi137.stdout:994: expect (ObjNum 238 snap 72 seq_num 238) 2024-03-04T06:45:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[88869]: osdmap e258: 8 total, 8 up, 8 in 2024-03-04T06:45:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[88869]: Reconfiguring mon.a (monmap changed)... 2024-03-04T06:45:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:45:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:45:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[88869]: Reconfiguring daemon mon.a on smithi137 2024-03-04T06:45:20.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[88869]: osdmap e259: 8 total, 8 up, 8 in 2024-03-04T06:45:20.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[91314]: osdmap e258: 8 total, 8 up, 8 in 2024-03-04T06:45:20.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[91314]: Reconfiguring mon.a (monmap changed)... 2024-03-04T06:45:20.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:45:20.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:45:20.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:20.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[91314]: Reconfiguring daemon mon.a on smithi137 2024-03-04T06:45:20.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:19 smithi137 ceph-mon[91314]: osdmap e259: 8 total, 8 up, 8 in 2024-03-04T06:45:20.244 INFO:tasks.rados.rados.0.smithi137.stdout:997: finishing write tid 1 to smithi13777483-27 2024-03-04T06:45:20.244 INFO:tasks.rados.rados.0.smithi137.stdout:997: finishing write tid 2 to smithi13777483-27 2024-03-04T06:45:20.244 INFO:tasks.rados.rados.0.smithi137.stdout:997: finishing write tid 3 to smithi13777483-27 2024-03-04T06:45:20.244 INFO:tasks.rados.rados.0.smithi137.stdout:997: oid 27 updating version 0 to 693 2024-03-04T06:45:20.244 INFO:tasks.rados.rados.0.smithi137.stdout:997: oid 27 updating version 693 to 694 2024-03-04T06:45:20.245 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 694 (ObjNum 317 snap 103 seq_num 317) dirty exists 2024-03-04T06:45:20.245 INFO:tasks.rados.rados.0.smithi137.stdout:997: left oid 27 (ObjNum 317 snap 103 seq_num 317) 2024-03-04T06:45:20.245 INFO:tasks.rados.rados.0.smithi137.stdout:993: done (5 left) 2024-03-04T06:45:20.245 INFO:tasks.rados.rados.0.smithi137.stdout:994: done (4 left) 2024-03-04T06:45:20.245 INFO:tasks.rados.rados.0.smithi137.stdout:995: done (3 left) 2024-03-04T06:45:20.245 INFO:tasks.rados.rados.0.smithi137.stdout:996: done (2 left) 2024-03-04T06:45:20.245 INFO:tasks.rados.rados.0.smithi137.stdout:997: done (1 left) 2024-03-04T06:45:20.245 INFO:tasks.rados.rados.0.smithi137.stdout:998: done (0 left) 2024-03-04T06:45:20.245 INFO:tasks.rados.rados.0.smithi137.stdout:999: snap_remove snap 78 2024-03-04T06:45:20.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:19 smithi203 ceph-mon[85573]: osdmap e258: 8 total, 8 up, 8 in 2024-03-04T06:45:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:19 smithi203 ceph-mon[85573]: Reconfiguring mon.a (monmap changed)... 2024-03-04T06:45:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:45:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:45:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:19 smithi203 ceph-mon[85573]: Reconfiguring daemon mon.a on smithi137 2024-03-04T06:45:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:19 smithi203 ceph-mon[85573]: osdmap e259: 8 total, 8 up, 8 in 2024-03-04T06:45:20.869 INFO:tasks.rados.rados.0.smithi137.stdout:999: done (0 left) 2024-03-04T06:45:20.869 INFO:tasks.rados.rados.0.smithi137.stdout:1000: copy_from oid 18 from oid 9 current snap is 103 2024-03-04T06:45:20.869 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 48 current snap is 103 2024-03-04T06:45:20.869 INFO:tasks.rados.rados.0.smithi137.stdout:1001: seq_num 319 ranges {1605632=548864} 2024-03-04T06:45:20.882 INFO:tasks.rados.rados.0.smithi137.stdout:1001: writing smithi13777483-48 from 1605632 to 2154496 tid 1 2024-03-04T06:45:20.882 INFO:tasks.rados.rados.0.smithi137.stdout:1002: delete oid 27 current snap is 103 2024-03-04T06:45:20.890 INFO:tasks.rados.rados.0.smithi137.stdout:1001: finishing write tid 1 to smithi13777483-48 2024-03-04T06:45:20.890 INFO:tasks.rados.rados.0.smithi137.stdout:1001: finishing write tid 2 to smithi13777483-48 2024-03-04T06:45:20.890 INFO:tasks.rados.rados.0.smithi137.stdout:1000: finishing copy_from racing read to smithi13777483-18 2024-03-04T06:45:20.890 INFO:tasks.rados.rados.0.smithi137.stdout:1002: done (2 left) 2024-03-04T06:45:20.890 INFO:tasks.rados.rados.0.smithi137.stdout:1003: read oid 33 snap 80 2024-03-04T06:45:20.890 INFO:tasks.rados.rados.0.smithi137.stdout:1003: expect (ObjNum 231 snap 66 seq_num 231) 2024-03-04T06:45:20.890 INFO:tasks.rados.rados.0.smithi137.stdout:1004: read oid 36 snap -1 2024-03-04T06:45:20.890 INFO:tasks.rados.rados.0.smithi137.stdout:1004: expect (ObjNum 270 snap 87 seq_num 270) 2024-03-04T06:45:20.890 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 103 2024-03-04T06:45:20.890 INFO:tasks.rados.rados.0.smithi137.stdout:1005: seq_num 321 ranges {1277952=581632} 2024-03-04T06:45:20.901 INFO:tasks.rados.rados.0.smithi137.stdout:1005: writing smithi13777483-39 from 1277952 to 1859584 tid 1 2024-03-04T06:45:20.902 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 103 2024-03-04T06:45:20.902 INFO:tasks.rados.rados.0.smithi137.stdout:1006: seq_num 322 ranges {0=598016} 2024-03-04T06:45:20.906 INFO:tasks.rados.rados.0.smithi137.stdout:1006: writing smithi13777483-12 from 0 to 598016 tid 1 2024-03-04T06:45:20.906 INFO:tasks.rados.rados.0.smithi137.stdout:1007: read oid 41 snap -1 2024-03-04T06:45:20.906 INFO:tasks.rados.rados.0.smithi137.stdout:1007: expect deleted 2024-03-04T06:45:20.906 INFO:tasks.rados.rados.0.smithi137.stdout:1001: finishing write tid 3 to smithi13777483-48 2024-03-04T06:45:20.906 INFO:tasks.rados.rados.0.smithi137.stdout:1001: oid 48 updating version 0 to 444 2024-03-04T06:45:20.907 INFO:tasks.rados.rados.0.smithi137.stdout:1001: oid 48 version 444 is already newer than 443 2024-03-04T06:45:20.907 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 444 (ObjNum 319 snap 103 seq_num 319) dirty exists 2024-03-04T06:45:20.907 INFO:tasks.rados.rados.0.smithi137.stdout:1001: left oid 48 (ObjNum 319 snap 103 seq_num 319) 2024-03-04T06:45:20.907 INFO:tasks.rados.rados.0.smithi137.stdout:1003: expect (ObjNum 231 snap 66 seq_num 231) 2024-03-04T06:45:20.948 INFO:tasks.rados.rados.0.smithi137.stdout:1004: expect (ObjNum 270 snap 87 seq_num 270) 2024-03-04T06:45:21.008 INFO:tasks.rados.rados.0.smithi137.stdout:1000: finishing copy_from to smithi13777483-18 2024-03-04T06:45:21.008 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 491 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-03-04T06:45:21.008 INFO:tasks.rados.rados.0.smithi137.stdout:1000: done (6 left) 2024-03-04T06:45:21.008 INFO:tasks.rados.rados.0.smithi137.stdout:1001: done (5 left) 2024-03-04T06:45:21.008 INFO:tasks.rados.rados.0.smithi137.stdout:1003: done (4 left) 2024-03-04T06:45:21.009 INFO:tasks.rados.rados.0.smithi137.stdout:1004: done (3 left) 2024-03-04T06:45:21.009 INFO:tasks.rados.rados.0.smithi137.stdout:1008: copy_from oid 19 from oid 4 current snap is 103 2024-03-04T06:45:21.009 INFO:tasks.rados.rados.0.smithi137.stdout:1005: finishing write tid 1 to smithi13777483-39 2024-03-04T06:45:21.009 INFO:tasks.rados.rados.0.smithi137.stdout:1005: finishing write tid 2 to smithi13777483-39 2024-03-04T06:45:21.009 INFO:tasks.rados.rados.0.smithi137.stdout:1005: finishing write tid 3 to smithi13777483-39 2024-03-04T06:45:21.009 INFO:tasks.rados.rados.0.smithi137.stdout:1005: oid 39 updating version 0 to 209 2024-03-04T06:45:21.010 INFO:tasks.rados.rados.0.smithi137.stdout:1005: oid 39 version 209 is already newer than 208 2024-03-04T06:45:21.010 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 209 (ObjNum 321 snap 103 seq_num 321) dirty exists 2024-03-04T06:45:21.010 INFO:tasks.rados.rados.0.smithi137.stdout:1005: left oid 39 (ObjNum 321 snap 103 seq_num 321) 2024-03-04T06:45:21.010 INFO:tasks.rados.rados.0.smithi137.stdout:1006: finishing write tid 1 to smithi13777483-12 2024-03-04T06:45:21.010 INFO:tasks.rados.rados.0.smithi137.stdout:1006: finishing write tid 2 to smithi13777483-12 2024-03-04T06:45:21.010 INFO:tasks.rados.rados.0.smithi137.stdout:1006: finishing write tid 3 to smithi13777483-12 2024-03-04T06:45:21.010 INFO:tasks.rados.rados.0.smithi137.stdout:1006: oid 12 updating version 0 to 259 2024-03-04T06:45:21.011 INFO:tasks.rados.rados.0.smithi137.stdout:1006: oid 12 updating version 259 to 260 2024-03-04T06:45:21.011 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 260 (ObjNum 322 snap 103 seq_num 322) dirty exists 2024-03-04T06:45:21.011 INFO:tasks.rados.rados.0.smithi137.stdout:1006: left oid 12 (ObjNum 322 snap 103 seq_num 322) 2024-03-04T06:45:21.011 INFO:tasks.rados.rados.0.smithi137.stdout:1005: done (3 left) 2024-03-04T06:45:21.011 INFO:tasks.rados.rados.0.smithi137.stdout:1006: done (2 left) 2024-03-04T06:45:21.011 INFO:tasks.rados.rados.0.smithi137.stdout:1007: done (1 left) 2024-03-04T06:45:21.012 INFO:tasks.rados.rados.0.smithi137.stdout:1009: read oid 34 snap -1 2024-03-04T06:45:21.012 INFO:tasks.rados.rados.0.smithi137.stdout:1009: expect (ObjNum 307 snap 99 seq_num 307) 2024-03-04T06:45:21.012 INFO:tasks.rados.rados.0.smithi137.stdout:1010: rollback oid 49 current snap is 103 2024-03-04T06:45:21.012 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 49 to 95 2024-03-04T06:45:21.012 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 103 2024-03-04T06:45:21.012 INFO:tasks.rados.rados.0.smithi137.stdout:1011: seq_num 323 ranges {1581056=614400} 2024-03-04T06:45:21.019 INFO:tasks.rados.rados.0.smithi137.stdout:1011: writing smithi13777483-23 from 1581056 to 2195456 tid 1 2024-03-04T06:45:21.019 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 103 2024-03-04T06:45:21.019 INFO:tasks.rados.rados.0.smithi137.stdout:1010: finishing rollback tid 0 to smithi13777483-49 2024-03-04T06:45:21.019 INFO:tasks.rados.rados.0.smithi137.stdout:1012: seq_num 324 ranges {1269760=630784} 2024-03-04T06:45:21.030 INFO:tasks.rados.rados.0.smithi137.stdout:1012: writing smithi13777483-31 from 1269760 to 1900544 tid 1 2024-03-04T06:45:21.030 INFO:tasks.rados.rados.0.smithi137.stdout:1013: delete oid 33 current snap is 103 2024-03-04T06:45:21.030 INFO:tasks.rados.rados.0.smithi137.stdout:1010: finishing rollback tid 1 to smithi13777483-49 2024-03-04T06:45:21.030 INFO:tasks.rados.rados.0.smithi137.stdout:1010: finishing rollback tid 2 to smithi13777483-49 2024-03-04T06:45:21.031 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 465 (ObjNum 270 snap 87 seq_num 270) dirty exists 2024-03-04T06:45:21.031 INFO:tasks.rados.rados.0.smithi137.stdout:1009: expect (ObjNum 307 snap 99 seq_num 307) 2024-03-04T06:45:21.092 INFO:tasks.rados.rados.0.smithi137.stdout:1008: finishing copy_from racing read to smithi13777483-19 2024-03-04T06:45:21.092 INFO:tasks.rados.rados.0.smithi137.stdout:1008: finishing copy_from to smithi13777483-19 2024-03-04T06:45:21.092 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 139 (ObjNum 308 snap 99 seq_num 308) dirty exists 2024-03-04T06:45:21.092 INFO:tasks.rados.rados.0.smithi137.stdout:1011: finishing write tid 1 to smithi13777483-23 2024-03-04T06:45:21.092 INFO:tasks.rados.rados.0.smithi137.stdout:1011: finishing write tid 2 to smithi13777483-23 2024-03-04T06:45:21.092 INFO:tasks.rados.rados.0.smithi137.stdout:1008: done (5 left) 2024-03-04T06:45:21.092 INFO:tasks.rados.rados.0.smithi137.stdout:1009: done (4 left) 2024-03-04T06:45:21.092 INFO:tasks.rados.rados.0.smithi137.stdout:1010: done (3 left) 2024-03-04T06:45:21.092 INFO:tasks.rados.rados.0.smithi137.stdout:1013: done (2 left) 2024-03-04T06:45:21.092 INFO:tasks.rados.rados.0.smithi137.stdout:1014: read oid 19 snap -1 2024-03-04T06:45:21.092 INFO:tasks.rados.rados.0.smithi137.stdout:1014: expect (ObjNum 308 snap 99 seq_num 308) 2024-03-04T06:45:21.092 INFO:tasks.rados.rados.0.smithi137.stdout:1015: snap_remove snap 94 2024-03-04T06:45:21.154 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:20 smithi137 ceph-mon[88869]: pgmap v61: 121 pgs: 121 active+clean; 282 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 8.1 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2024-03-04T06:45:21.154 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:20 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:21.154 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:20 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:21.154 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:20 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:45:21.154 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:20 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:45:21.155 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:20 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:21.155 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:20 smithi137 ceph-mon[91314]: pgmap v61: 121 pgs: 121 active+clean; 282 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 8.1 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2024-03-04T06:45:21.155 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:20 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:21.155 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:20 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:21.155 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:20 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:45:21.155 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:20 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:45:21.155 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:20 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:21.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:20 smithi203 ceph-mon[85573]: pgmap v61: 121 pgs: 121 active+clean; 282 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 8.1 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2024-03-04T06:45:21.413 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:20 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:21.413 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:20 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:21.414 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:20 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:45:21.414 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:20 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:45:21.414 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:20 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:21.874 INFO:tasks.rados.rados.0.smithi137.stdout:1015: done (3 left) 2024-03-04T06:45:21.874 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 103 2024-03-04T06:45:21.874 INFO:tasks.rados.rados.0.smithi137.stdout:1011: finishing write tid 3 to smithi13777483-23 2024-03-04T06:45:21.874 INFO:tasks.rados.rados.0.smithi137.stdout:1011: oid 23 updating version 0 to 394 2024-03-04T06:45:21.874 INFO:tasks.rados.rados.0.smithi137.stdout:1011: oid 23 version 394 is already newer than 393 2024-03-04T06:45:21.875 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 394 (ObjNum 323 snap 103 seq_num 323) dirty exists 2024-03-04T06:45:21.875 INFO:tasks.rados.rados.0.smithi137.stdout:1011: left oid 23 (ObjNum 323 snap 103 seq_num 323) 2024-03-04T06:45:21.875 INFO:tasks.rados.rados.0.smithi137.stdout:1012: finishing write tid 1 to smithi13777483-31 2024-03-04T06:45:21.875 INFO:tasks.rados.rados.0.smithi137.stdout:1012: finishing write tid 2 to smithi13777483-31 2024-03-04T06:45:21.875 INFO:tasks.rados.rados.0.smithi137.stdout:1016: seq_num 326 ranges {2465792=663552} 2024-03-04T06:45:21.892 INFO:tasks.rados.rados.0.smithi137.stdout:1016: writing smithi13777483-15 from 2465792 to 3129344 tid 1 2024-03-04T06:45:21.892 INFO:tasks.rados.rados.0.smithi137.stdout:1011: done (3 left) 2024-03-04T06:45:21.892 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 103 2024-03-04T06:45:21.892 INFO:tasks.rados.rados.0.smithi137.stdout:1012: finishing write tid 3 to smithi13777483-31 2024-03-04T06:45:21.892 INFO:tasks.rados.rados.0.smithi137.stdout:1012: oid 31 updating version 0 to 468 2024-03-04T06:45:21.892 INFO:tasks.rados.rados.0.smithi137.stdout:1012: oid 31 version 468 is already newer than 467 2024-03-04T06:45:21.892 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 468 (ObjNum 324 snap 103 seq_num 324) dirty exists 2024-03-04T06:45:21.893 INFO:tasks.rados.rados.0.smithi137.stdout:1012: left oid 31 (ObjNum 324 snap 103 seq_num 324) 2024-03-04T06:45:21.893 INFO:tasks.rados.rados.0.smithi137.stdout:1014: expect (ObjNum 308 snap 99 seq_num 308) 2024-03-04T06:45:21.971 INFO:tasks.rados.rados.0.smithi137.stdout:1016: finishing write tid 1 to smithi13777483-15 2024-03-04T06:45:21.971 INFO:tasks.rados.rados.0.smithi137.stdout:1016: finishing write tid 2 to smithi13777483-15 2024-03-04T06:45:21.971 INFO:tasks.rados.rados.0.smithi137.stdout:1016: finishing write tid 3 to smithi13777483-15 2024-03-04T06:45:21.971 INFO:tasks.rados.rados.0.smithi137.stdout:1016: oid 15 updating version 0 to 596 2024-03-04T06:45:21.971 INFO:tasks.rados.rados.0.smithi137.stdout:1016: oid 15 version 596 is already newer than 595 2024-03-04T06:45:21.971 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 596 (ObjNum 326 snap 103 seq_num 326) dirty exists 2024-03-04T06:45:21.971 INFO:tasks.rados.rados.0.smithi137.stdout:1016: left oid 15 (ObjNum 326 snap 103 seq_num 326) 2024-03-04T06:45:21.971 INFO:tasks.rados.rados.0.smithi137.stdout:1017: seq_num 327 ranges {3457024=679936} 2024-03-04T06:45:21.992 INFO:tasks.rados.rados.0.smithi137.stdout:1017: writing smithi13777483-26 from 3457024 to 4136960 tid 1 2024-03-04T06:45:21.992 INFO:tasks.rados.rados.0.smithi137.stdout:1012: done (3 left) 2024-03-04T06:45:21.992 INFO:tasks.rados.rados.0.smithi137.stdout:1014: done (2 left) 2024-03-04T06:45:21.993 INFO:tasks.rados.rados.0.smithi137.stdout:1016: done (1 left) 2024-03-04T06:45:21.993 INFO:tasks.rados.rados.0.smithi137.stdout:1018: snap_remove snap 91 2024-03-04T06:45:22.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:21 smithi137 ceph-mon[88869]: Reconfiguring mgr.y (monmap changed)... 2024-03-04T06:45:22.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:21 smithi137 ceph-mon[88869]: Reconfiguring daemon mgr.y on smithi137 2024-03-04T06:45:22.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:21 smithi137 ceph-mon[88869]: osdmap e260: 8 total, 8 up, 8 in 2024-03-04T06:45:22.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:21 smithi137 ceph-mon[91314]: Reconfiguring mgr.y (monmap changed)... 2024-03-04T06:45:22.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:21 smithi137 ceph-mon[91314]: Reconfiguring daemon mgr.y on smithi137 2024-03-04T06:45:22.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:21 smithi137 ceph-mon[91314]: osdmap e260: 8 total, 8 up, 8 in 2024-03-04T06:45:22.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:21 smithi203 ceph-mon[85573]: Reconfiguring mgr.y (monmap changed)... 2024-03-04T06:45:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:21 smithi203 ceph-mon[85573]: Reconfiguring daemon mgr.y on smithi137 2024-03-04T06:45:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:21 smithi203 ceph-mon[85573]: osdmap e260: 8 total, 8 up, 8 in 2024-03-04T06:45:22.891 INFO:tasks.rados.rados.0.smithi137.stdout:1018: done (1 left) 2024-03-04T06:45:22.891 INFO:tasks.rados.rados.0.smithi137.stdout:1019: rollback oid 23 current snap is 103 2024-03-04T06:45:22.891 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 23 to 68 2024-03-04T06:45:22.891 INFO:tasks.rados.rados.0.smithi137.stdout:1017: finishing write tid 1 to smithi13777483-26 2024-03-04T06:45:22.891 INFO:tasks.rados.rados.0.smithi137.stdout:1020: read oid 4 snap -1 2024-03-04T06:45:22.891 INFO:tasks.rados.rados.0.smithi137.stdout:1020: expect (ObjNum 308 snap 99 seq_num 308) 2024-03-04T06:45:22.891 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 103 2024-03-04T06:45:22.891 INFO:tasks.rados.rados.0.smithi137.stdout:1021: seq_num 328 ranges {0=696320} 2024-03-04T06:45:22.895 INFO:tasks.rados.rados.0.smithi137.stdout:1021: writing smithi13777483-45 from 0 to 696320 tid 1 2024-03-04T06:45:22.895 INFO:tasks.rados.rados.0.smithi137.stdout:1022: copy_from oid 29 from oid 9 current snap is 103 2024-03-04T06:45:22.896 INFO:tasks.rados.rados.0.smithi137.stdout:1023: snap_create 2024-03-04T06:45:22.896 INFO:tasks.rados.rados.0.smithi137.stdout:1017: finishing write tid 2 to smithi13777483-26 2024-03-04T06:45:22.896 INFO:tasks.rados.rados.0.smithi137.stdout:1017: finishing write tid 3 to smithi13777483-26 2024-03-04T06:45:22.896 INFO:tasks.rados.rados.0.smithi137.stdout:1017: oid 26 updating version 0 to 493 2024-03-04T06:45:22.896 INFO:tasks.rados.rados.0.smithi137.stdout:1017: oid 26 version 493 is already newer than 492 2024-03-04T06:45:22.896 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 493 (ObjNum 327 snap 103 seq_num 327) dirty exists 2024-03-04T06:45:22.896 INFO:tasks.rados.rados.0.smithi137.stdout:1017: left oid 26 (ObjNum 327 snap 103 seq_num 327) 2024-03-04T06:45:22.901 INFO:tasks.rados.rados.0.smithi137.stdout:1022: finishing copy_from racing read to smithi13777483-29 2024-03-04T06:45:22.903 INFO:tasks.rados.rados.0.smithi137.stdout:1021: finishing write tid 1 to smithi13777483-45 2024-03-04T06:45:22.905 INFO:tasks.rados.rados.0.smithi137.stdout:1022: finishing copy_from to smithi13777483-29 2024-03-04T06:45:22.905 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 491 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-03-04T06:45:22.905 INFO:tasks.rados.rados.0.smithi137.stdout:1021: finishing write tid 2 to smithi13777483-45 2024-03-04T06:45:22.905 INFO:tasks.rados.rados.0.smithi137.stdout:1019: finishing rollback tid 0 to smithi13777483-23 2024-03-04T06:45:22.906 INFO:tasks.rados.rados.0.smithi137.stdout:1019: finishing rollback tid 1 to smithi13777483-23 2024-03-04T06:45:22.906 INFO:tasks.rados.rados.0.smithi137.stdout:1019: finishing rollback tid 2 to smithi13777483-23 2024-03-04T06:45:22.906 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 401 (ObjNum 234 snap 68 seq_num 234) dirty exists 2024-03-04T06:45:22.907 INFO:tasks.rados.rados.0.smithi137.stdout:1021: finishing write tid 3 to smithi13777483-45 2024-03-04T06:45:22.907 INFO:tasks.rados.rados.0.smithi137.stdout:1021: oid 45 updating version 0 to 211 2024-03-04T06:45:22.907 INFO:tasks.rados.rados.0.smithi137.stdout:1021: oid 45 version 211 is already newer than 210 2024-03-04T06:45:22.907 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 211 (ObjNum 328 snap 103 seq_num 328) dirty exists 2024-03-04T06:45:22.907 INFO:tasks.rados.rados.0.smithi137.stdout:1021: left oid 45 (ObjNum 328 snap 103 seq_num 328) 2024-03-04T06:45:22.908 INFO:tasks.rados.rados.0.smithi137.stdout:1020: expect (ObjNum 308 snap 99 seq_num 308) 2024-03-04T06:45:22.962 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[88869]: osdmap e261: 8 total, 8 up, 8 in 2024-03-04T06:45:22.963 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:22.963 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:22.963 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[88869]: Reconfiguring mon.c (monmap changed)... 2024-03-04T06:45:22.963 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:45:22.963 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:45:22.963 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:22.963 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[88869]: Reconfiguring daemon mon.c on smithi137 2024-03-04T06:45:22.963 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[88869]: pgmap v64: 121 pgs: 121 active+clean; 282 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 8.1 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2024-03-04T06:45:22.963 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[91314]: osdmap e261: 8 total, 8 up, 8 in 2024-03-04T06:45:22.963 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:22.963 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:22.964 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[91314]: Reconfiguring mon.c (monmap changed)... 2024-03-04T06:45:22.964 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:45:22.964 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:45:22.964 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:22.964 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[91314]: Reconfiguring daemon mon.c on smithi137 2024-03-04T06:45:22.964 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:22 smithi137 ceph-mon[91314]: pgmap v64: 121 pgs: 121 active+clean; 282 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 8.1 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2024-03-04T06:45:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:22 smithi203 ceph-mon[85573]: osdmap e261: 8 total, 8 up, 8 in 2024-03-04T06:45:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:22 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:22 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:22 smithi203 ceph-mon[85573]: Reconfiguring mon.c (monmap changed)... 2024-03-04T06:45:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:22 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:45:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:22 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:45:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:22 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:22 smithi203 ceph-mon[85573]: Reconfiguring daemon mon.c on smithi137 2024-03-04T06:45:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:22 smithi203 ceph-mon[85573]: pgmap v64: 121 pgs: 121 active+clean; 282 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 8.1 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2024-03-04T06:45:23.891 INFO:tasks.rados.rados.0.smithi137.stdout:1017: done (5 left) 2024-03-04T06:45:23.891 INFO:tasks.rados.rados.0.smithi137.stdout:1019: done (4 left) 2024-03-04T06:45:23.891 INFO:tasks.rados.rados.0.smithi137.stdout:1020: done (3 left) 2024-03-04T06:45:23.891 INFO:tasks.rados.rados.0.smithi137.stdout:1021: done (2 left) 2024-03-04T06:45:23.891 INFO:tasks.rados.rados.0.smithi137.stdout:1022: done (1 left) 2024-03-04T06:45:23.891 INFO:tasks.rados.rados.0.smithi137.stdout:1023: done (0 left) 2024-03-04T06:45:23.891 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 104 2024-03-04T06:45:23.892 INFO:tasks.rados.rados.0.smithi137.stdout:1024: seq_num 329 ranges {1572864=712704} 2024-03-04T06:45:23.904 INFO:tasks.rados.rados.0.smithi137.stdout:1024: writing smithi13777483-34 from 1572864 to 2285568 tid 1 2024-03-04T06:45:23.904 INFO:tasks.rados.rados.0.smithi137.stdout:1025: read oid 37 snap -1 2024-03-04T06:45:23.904 INFO:tasks.rados.rados.0.smithi137.stdout:1025: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:45:23.904 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 104 2024-03-04T06:45:23.904 INFO:tasks.rados.rados.0.smithi137.stdout:1026: seq_num 330 ranges {6569984=737280} 2024-03-04T06:45:23.944 INFO:tasks.rados.rados.0.smithi137.stdout:1026: writing smithi13777483-13 from 6569984 to 7307264 tid 1 2024-03-04T06:45:23.944 INFO:tasks.rados.rados.0.smithi137.stdout:1027: copy_from oid 44 from oid 28 current snap is 104 2024-03-04T06:45:23.944 INFO:tasks.rados.rados.0.smithi137.stdout:1025: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:45:23.947 INFO:tasks.rados.rados.0.smithi137.stdout:1024: finishing write tid 1 to smithi13777483-34 2024-03-04T06:45:23.947 INFO:tasks.rados.rados.0.smithi137.stdout:1024: finishing write tid 2 to smithi13777483-34 2024-03-04T06:45:23.947 INFO:tasks.rados.rados.0.smithi137.stdout:1024: finishing write tid 3 to smithi13777483-34 2024-03-04T06:45:23.947 INFO:tasks.rados.rados.0.smithi137.stdout:1024: oid 34 updating version 0 to 411 2024-03-04T06:45:23.947 INFO:tasks.rados.rados.0.smithi137.stdout:1024: oid 34 version 411 is already newer than 410 2024-03-04T06:45:23.947 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 411 (ObjNum 329 snap 104 seq_num 329) dirty exists 2024-03-04T06:45:23.947 INFO:tasks.rados.rados.0.smithi137.stdout:1024: left oid 34 (ObjNum 329 snap 104 seq_num 329) 2024-03-04T06:45:23.947 INFO:tasks.rados.rados.0.smithi137.stdout:1024: done (3 left) 2024-03-04T06:45:23.947 INFO:tasks.rados.rados.0.smithi137.stdout:1025: done (2 left) 2024-03-04T06:45:23.948 INFO:tasks.rados.rados.0.smithi137.stdout:1028: snap_create 2024-03-04T06:45:23.948 INFO:tasks.rados.rados.0.smithi137.stdout:1027: finishing copy_from to smithi13777483-44 2024-03-04T06:45:23.948 INFO:tasks.rados.rados.0.smithi137.stdout:1027: got expected ENOENT (src dne) 2024-03-04T06:45:23.948 INFO:tasks.rados.rados.0.smithi137.stdout:1027: finishing copy_from racing read to smithi13777483-44 2024-03-04T06:45:23.953 INFO:tasks.rados.rados.0.smithi137.stdout:1026: finishing write tid 1 to smithi13777483-13 2024-03-04T06:45:23.953 INFO:tasks.rados.rados.0.smithi137.stdout:1026: finishing write tid 2 to smithi13777483-13 2024-03-04T06:45:23.954 INFO:tasks.rados.rados.0.smithi137.stdout:1026: finishing write tid 3 to smithi13777483-13 2024-03-04T06:45:23.954 INFO:tasks.rados.rados.0.smithi137.stdout:1026: oid 13 updating version 0 to 717 2024-03-04T06:45:23.954 INFO:tasks.rados.rados.0.smithi137.stdout:1026: oid 13 updating version 717 to 718 2024-03-04T06:45:23.954 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 718 (ObjNum 330 snap 104 seq_num 330) dirty exists 2024-03-04T06:45:23.954 INFO:tasks.rados.rados.0.smithi137.stdout:1026: left oid 13 (ObjNum 330 snap 104 seq_num 330) 2024-03-04T06:45:24.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:23 smithi137 ceph-mon[91314]: osdmap e262: 8 total, 8 up, 8 in 2024-03-04T06:45:24.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:45:24.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:23 smithi137 ceph-mon[88869]: osdmap e262: 8 total, 8 up, 8 in 2024-03-04T06:45:24.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:45:24.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:23 smithi203 ceph-mon[85573]: osdmap e262: 8 total, 8 up, 8 in 2024-03-04T06:45:24.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:45:24.918 INFO:tasks.rados.rados.0.smithi137.stdout:1026: done (2 left) 2024-03-04T06:45:24.918 INFO:tasks.rados.rados.0.smithi137.stdout:1027: done (1 left) 2024-03-04T06:45:24.918 INFO:tasks.rados.rados.0.smithi137.stdout:1028: done (0 left) 2024-03-04T06:45:24.918 INFO:tasks.rados.rados.0.smithi137.stdout:1029: delete oid 25 current snap is 105 2024-03-04T06:45:24.923 INFO:tasks.rados.rados.0.smithi137.stdout:1029: done (0 left) 2024-03-04T06:45:24.923 INFO:tasks.rados.rados.0.smithi137.stdout:1030: delete oid 12 current snap is 105 2024-03-04T06:45:24.928 INFO:tasks.rados.rados.0.smithi137.stdout:1030: done (0 left) 2024-03-04T06:45:24.928 INFO:tasks.rados.rados.0.smithi137.stdout:1031: rollback oid 34 current snap is 105 2024-03-04T06:45:24.928 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 34 to 101 2024-03-04T06:45:24.928 INFO:tasks.rados.rados.0.smithi137.stdout:1032: snap_remove snap 79 2024-03-04T06:45:25.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[88869]: osdmap e263: 8 total, 8 up, 8 in 2024-03-04T06:45:25.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:25.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:25.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[88869]: Reconfiguring osd.0 (monmap changed)... 2024-03-04T06:45:25.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-04T06:45:25.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:25.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[88869]: Reconfiguring daemon osd.0 on smithi137 2024-03-04T06:45:25.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[88869]: pgmap v67: 121 pgs: 121 active+clean; 288 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-03-04T06:45:25.156 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[91314]: osdmap e263: 8 total, 8 up, 8 in 2024-03-04T06:45:25.156 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:25.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:25.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[91314]: Reconfiguring osd.0 (monmap changed)... 2024-03-04T06:45:25.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-04T06:45:25.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:25.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[91314]: Reconfiguring daemon osd.0 on smithi137 2024-03-04T06:45:25.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:24 smithi137 ceph-mon[91314]: pgmap v67: 121 pgs: 121 active+clean; 288 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-03-04T06:45:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:24 smithi203 ceph-mon[85573]: osdmap e263: 8 total, 8 up, 8 in 2024-03-04T06:45:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:24 smithi203 ceph-mon[85573]: Reconfiguring osd.0 (monmap changed)... 2024-03-04T06:45:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-04T06:45:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:24 smithi203 ceph-mon[85573]: Reconfiguring daemon osd.0 on smithi137 2024-03-04T06:45:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:24 smithi203 ceph-mon[85573]: pgmap v67: 121 pgs: 121 active+clean; 288 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-03-04T06:45:25.456 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:45:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:45:25] "GET /metrics HTTP/1.1" 200 36000 "" "Prometheus/2.43.0" 2024-03-04T06:45:25.933 INFO:tasks.rados.rados.0.smithi137.stdout:1032: done (1 left) 2024-03-04T06:45:25.933 INFO:tasks.rados.rados.0.smithi137.stdout:1033: copy_from oid 15 from oid 41 current snap is 105 2024-03-04T06:45:25.933 INFO:tasks.rados.rados.0.smithi137.stdout:1031: finishing rollback tid 0 to smithi13777483-34 2024-03-04T06:45:25.933 INFO:tasks.rados.rados.0.smithi137.stdout:1031: finishing rollback tid 1 to smithi13777483-34 2024-03-04T06:45:25.933 INFO:tasks.rados.rados.0.smithi137.stdout:1031: finishing rollback tid 2 to smithi13777483-34 2024-03-04T06:45:25.933 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 414 (ObjNum 307 snap 99 seq_num 307) dirty exists 2024-03-04T06:45:25.934 INFO:tasks.rados.rados.0.smithi137.stdout:1031: done (1 left) 2024-03-04T06:45:25.934 INFO:tasks.rados.rados.0.smithi137.stdout:1034: rollback oid 24 current snap is 105 2024-03-04T06:45:25.934 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 24 to 92 2024-03-04T06:45:25.934 INFO:tasks.rados.rados.0.smithi137.stdout:1035: rollback oid 49 current snap is 105 2024-03-04T06:45:25.934 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 49 to 64 2024-03-04T06:45:25.934 INFO:tasks.rados.rados.0.smithi137.stdout:1036: snap_remove snap 99 2024-03-04T06:45:26.174 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:25 smithi137 ceph-mon[88869]: osdmap e264: 8 total, 8 up, 8 in 2024-03-04T06:45:26.174 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:25 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:26.174 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:25 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:26.174 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:25 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-04T06:45:26.174 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:25 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:26.174 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:25 smithi137 ceph-mon[91314]: osdmap e264: 8 total, 8 up, 8 in 2024-03-04T06:45:26.174 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:25 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:26.174 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:25 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:26.174 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:25 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-04T06:45:26.175 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:25 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:26.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:25 smithi203 ceph-mon[85573]: osdmap e264: 8 total, 8 up, 8 in 2024-03-04T06:45:26.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:25 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:26.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:25 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:26.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:25 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-04T06:45:26.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:25 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:26.936 INFO:tasks.rados.rados.0.smithi137.stdout:1036: done (3 left) 2024-03-04T06:45:26.936 INFO:tasks.rados.rados.0.smithi137.stdout:1037: copy_from oid 2 from oid 11 current snap is 105 2024-03-04T06:45:26.937 INFO:tasks.rados.rados.0.smithi137.stdout:1038: snap_create 2024-03-04T06:45:26.937 INFO:tasks.rados.rados.0.smithi137.stdout:1033: finishing copy_from to smithi13777483-15 2024-03-04T06:45:26.937 INFO:tasks.rados.rados.0.smithi137.stdout:1033: got expected ENOENT (src dne) 2024-03-04T06:45:26.937 INFO:tasks.rados.rados.0.smithi137.stdout:1033: finishing copy_from racing read to smithi13777483-15 2024-03-04T06:45:26.937 INFO:tasks.rados.rados.0.smithi137.stdout:1035: finishing rollback tid 0 to smithi13777483-49 2024-03-04T06:45:26.937 INFO:tasks.rados.rados.0.smithi137.stdout:1035: finishing rollback tid 1 to smithi13777483-49 2024-03-04T06:45:26.937 INFO:tasks.rados.rados.0.smithi137.stdout:1034: finishing rollback tid 0 to smithi13777483-24 2024-03-04T06:45:26.937 INFO:tasks.rados.rados.0.smithi137.stdout:1034: finishing rollback tid 1 to smithi13777483-24 2024-03-04T06:45:26.937 INFO:tasks.rados.rados.0.smithi137.stdout:1035: finishing rollback tid 2 to smithi13777483-49 2024-03-04T06:45:26.937 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 486 (ObjNum 63 snap 4 seq_num 63) dirty exists 2024-03-04T06:45:26.937 INFO:tasks.rados.rados.0.smithi137.stdout:1034: finishing rollback tid 2 to smithi13777483-24 2024-03-04T06:45:26.937 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 221 (ObjNum 240 snap 72 seq_num 240) dirty exists 2024-03-04T06:45:26.953 INFO:tasks.rados.rados.0.smithi137.stdout:1037: finishing copy_from racing read to smithi13777483-2 2024-03-04T06:45:26.954 INFO:tasks.rados.rados.0.smithi137.stdout:1037: finishing copy_from to smithi13777483-2 2024-03-04T06:45:26.954 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 117 (ObjNum 219 snap 63 seq_num 219) dirty exists 2024-03-04T06:45:27.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:26 smithi137 ceph-mon[88869]: Reconfiguring osd.1 (monmap changed)... 2024-03-04T06:45:27.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:26 smithi137 ceph-mon[88869]: Reconfiguring daemon osd.1 on smithi137 2024-03-04T06:45:27.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:26 smithi137 ceph-mon[88869]: osdmap e265: 8 total, 8 up, 8 in 2024-03-04T06:45:27.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:26 smithi137 ceph-mon[88869]: pgmap v70: 121 pgs: 121 active+clean; 293 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 21 op/s 2024-03-04T06:45:27.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:26 smithi137 ceph-mon[91314]: Reconfiguring osd.1 (monmap changed)... 2024-03-04T06:45:27.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:26 smithi137 ceph-mon[91314]: Reconfiguring daemon osd.1 on smithi137 2024-03-04T06:45:27.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:26 smithi137 ceph-mon[91314]: osdmap e265: 8 total, 8 up, 8 in 2024-03-04T06:45:27.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:26 smithi137 ceph-mon[91314]: pgmap v70: 121 pgs: 121 active+clean; 293 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 21 op/s 2024-03-04T06:45:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:26 smithi203 ceph-mon[85573]: Reconfiguring osd.1 (monmap changed)... 2024-03-04T06:45:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:26 smithi203 ceph-mon[85573]: Reconfiguring daemon osd.1 on smithi137 2024-03-04T06:45:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:26 smithi203 ceph-mon[85573]: osdmap e265: 8 total, 8 up, 8 in 2024-03-04T06:45:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:26 smithi203 ceph-mon[85573]: pgmap v70: 121 pgs: 121 active+clean; 293 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 21 op/s 2024-03-04T06:45:27.935 INFO:tasks.rados.rados.0.smithi137.stdout:1033: done (4 left) 2024-03-04T06:45:27.935 INFO:tasks.rados.rados.0.smithi137.stdout:1034: done (3 left) 2024-03-04T06:45:27.936 INFO:tasks.rados.rados.0.smithi137.stdout:1035: done (2 left) 2024-03-04T06:45:27.936 INFO:tasks.rados.rados.0.smithi137.stdout:1037: done (1 left) 2024-03-04T06:45:27.936 INFO:tasks.rados.rados.0.smithi137.stdout:1038: done (0 left) 2024-03-04T06:45:27.936 INFO:tasks.rados.rados.0.smithi137.stdout:1039: copy_from oid 35 from oid 22 current snap is 106 2024-03-04T06:45:27.936 INFO:tasks.rados.rados.0.smithi137.stdout:1040: rollback oid 20 current snap is 106 2024-03-04T06:45:27.936 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 20 to 95 2024-03-04T06:45:27.936 INFO:tasks.rados.rados.0.smithi137.stdout:1041: delete oid 27 current snap is 106 2024-03-04T06:45:27.937 INFO:tasks.rados.rados.0.smithi137.stdout:1041: done (2 left) 2024-03-04T06:45:27.937 INFO:tasks.rados.rados.0.smithi137.stdout:1042: rollback oid 36 current snap is 106 2024-03-04T06:45:27.938 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 36 to 100 2024-03-04T06:45:27.938 INFO:tasks.rados.rados.0.smithi137.stdout:1043: delete oid 7 current snap is 106 2024-03-04T06:45:27.941 INFO:tasks.rados.rados.0.smithi137.stdout:1042: finishing rollback tid 0 to smithi13777483-36 2024-03-04T06:45:27.943 INFO:tasks.rados.rados.0.smithi137.stdout:1040: finishing rollback tid 0 to smithi13777483-20 2024-03-04T06:45:27.943 INFO:tasks.rados.rados.0.smithi137.stdout:1040: finishing rollback tid 1 to smithi13777483-20 2024-03-04T06:45:27.944 INFO:tasks.rados.rados.0.smithi137.stdout:1040: finishing rollback tid 2 to smithi13777483-20 2024-03-04T06:45:27.944 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 419 (ObjNum 169 snap 47 seq_num 169) dirty exists 2024-03-04T06:45:27.944 INFO:tasks.rados.rados.0.smithi137.stdout:1042: finishing rollback tid 1 to smithi13777483-36 2024-03-04T06:45:27.944 INFO:tasks.rados.rados.0.smithi137.stdout:1042: finishing rollback tid 2 to smithi13777483-36 2024-03-04T06:45:27.945 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 329 (ObjNum 270 snap 87 seq_num 270) dirty exists 2024-03-04T06:45:27.946 INFO:tasks.rados.rados.0.smithi137.stdout:1040: done (3 left) 2024-03-04T06:45:27.946 INFO:tasks.rados.rados.0.smithi137.stdout:1042: done (2 left) 2024-03-04T06:45:27.946 INFO:tasks.rados.rados.0.smithi137.stdout:1043: done (1 left) 2024-03-04T06:45:27.946 INFO:tasks.rados.rados.0.smithi137.stdout:1044: copy_from oid 42 from oid 45 current snap is 106 2024-03-04T06:45:27.946 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 106 2024-03-04T06:45:27.946 INFO:tasks.rados.rados.0.smithi137.stdout:1045: seq_num 335 ranges {139264=417792,557056=401408} 2024-03-04T06:45:27.949 INFO:tasks.rados.rados.0.smithi137.stdout:1045: writing smithi13777483-9 from 139264 to 557056 tid 1 2024-03-04T06:45:27.951 INFO:tasks.rados.rados.0.smithi137.stdout:1045: writing smithi13777483-9 from 557056 to 958464 tid 2 2024-03-04T06:45:27.952 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 106 2024-03-04T06:45:27.952 INFO:tasks.rados.rados.0.smithi137.stdout:1046: seq_num 336 ranges {1277952=434176,1712128=401408} 2024-03-04T06:45:27.961 INFO:tasks.rados.rados.0.smithi137.stdout:1046: writing smithi13777483-2 from 1277952 to 1712128 tid 1 2024-03-04T06:45:27.964 INFO:tasks.rados.rados.0.smithi137.stdout:1046: writing smithi13777483-2 from 1712128 to 2113536 tid 2 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:1047: rollback oid 17 current snap is 106 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 17 to 74 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:1044: finishing copy_from racing read to smithi13777483-42 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:1044: finishing copy_from to smithi13777483-42 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 211 (ObjNum 328 snap 103 seq_num 328) dirty exists 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:1045: finishing write tid 1 to smithi13777483-9 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:1045: finishing write tid 2 to smithi13777483-9 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:1045: finishing write tid 3 to smithi13777483-9 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:1045: finishing write tid 4 to smithi13777483-9 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:1045: oid 9 updating version 0 to 555 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:1045: oid 9 updating version 555 to 556 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:1045: oid 9 updating version 556 to 557 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 557 (ObjNum 335 snap 106 seq_num 335) dirty exists 2024-03-04T06:45:27.965 INFO:tasks.rados.rados.0.smithi137.stdout:1045: left oid 9 (ObjNum 335 snap 106 seq_num 335) 2024-03-04T06:45:27.966 INFO:tasks.rados.rados.0.smithi137.stdout:1044: done (4 left) 2024-03-04T06:45:27.966 INFO:tasks.rados.rados.0.smithi137.stdout:1045: done (3 left) 2024-03-04T06:45:27.966 INFO:tasks.rados.rados.0.smithi137.stdout:1048: read oid 14 snap -1 2024-03-04T06:45:27.966 INFO:tasks.rados.rados.0.smithi137.stdout:1048: expect (ObjNum 304 snap 99 seq_num 304) 2024-03-04T06:45:27.966 INFO:tasks.rados.rados.0.smithi137.stdout:1049: snap_remove snap 68 2024-03-04T06:45:28.066 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[91314]: osdmap e266: 8 total, 8 up, 8 in 2024-03-04T06:45:28.066 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:28.066 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:28.066 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[91314]: Reconfiguring osd.2 (monmap changed)... 2024-03-04T06:45:28.066 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-04T06:45:28.066 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:28.066 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[91314]: Reconfiguring daemon osd.2 on smithi137 2024-03-04T06:45:28.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[88869]: osdmap e266: 8 total, 8 up, 8 in 2024-03-04T06:45:28.066 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:28.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:28.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[88869]: Reconfiguring osd.2 (monmap changed)... 2024-03-04T06:45:28.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-04T06:45:28.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:28.067 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:27 smithi137 ceph-mon[88869]: Reconfiguring daemon osd.2 on smithi137 2024-03-04T06:45:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:27 smithi203 ceph-mon[85573]: osdmap e266: 8 total, 8 up, 8 in 2024-03-04T06:45:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:27 smithi203 ceph-mon[85573]: Reconfiguring osd.2 (monmap changed)... 2024-03-04T06:45:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-04T06:45:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:27 smithi203 ceph-mon[85573]: Reconfiguring daemon osd.2 on smithi137 2024-03-04T06:45:28.946 INFO:tasks.rados.rados.0.smithi137.stdout:1046: finishing write tid 1 to smithi13777483-2 2024-03-04T06:45:28.946 INFO:tasks.rados.rados.0.smithi137.stdout:1046: finishing write tid 2 to smithi13777483-2 2024-03-04T06:45:28.946 INFO:tasks.rados.rados.0.smithi137.stdout:1046: finishing write tid 3 to smithi13777483-2 2024-03-04T06:45:28.946 INFO:tasks.rados.rados.0.smithi137.stdout:1047: finishing rollback tid 0 to smithi13777483-17 2024-03-04T06:45:28.946 INFO:tasks.rados.rados.0.smithi137.stdout:1039: finishing copy_from racing read to smithi13777483-35 2024-03-04T06:45:28.946 INFO:tasks.rados.rados.0.smithi137.stdout:1046: finishing write tid 4 to smithi13777483-2 2024-03-04T06:45:28.946 INFO:tasks.rados.rados.0.smithi137.stdout:1046: oid 2 updating version 0 to 446 2024-03-04T06:45:28.946 INFO:tasks.rados.rados.0.smithi137.stdout:1046: oid 2 updating version 446 to 447 2024-03-04T06:45:28.947 INFO:tasks.rados.rados.0.smithi137.stdout:1046: oid 2 version 447 is already newer than 445 2024-03-04T06:45:28.947 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 447 (ObjNum 336 snap 106 seq_num 336) dirty exists 2024-03-04T06:45:28.947 INFO:tasks.rados.rados.0.smithi137.stdout:1046: left oid 2 (ObjNum 336 snap 106 seq_num 336) 2024-03-04T06:45:28.947 INFO:tasks.rados.rados.0.smithi137.stdout:1039: finishing copy_from to smithi13777483-35 2024-03-04T06:45:28.947 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 399 (ObjNum 262 snap 79 seq_num 262) dirty exists 2024-03-04T06:45:28.947 INFO:tasks.rados.rados.0.smithi137.stdout:1047: finishing rollback tid 1 to smithi13777483-17 2024-03-04T06:45:28.947 INFO:tasks.rados.rados.0.smithi137.stdout:1047: finishing rollback tid 2 to smithi13777483-17 2024-03-04T06:45:28.947 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 245 (ObjNum 33 snap 0 seq_num 1867665519) dirty exists 2024-03-04T06:45:28.947 INFO:tasks.rados.rados.0.smithi137.stdout:1048: expect (ObjNum 304 snap 99 seq_num 304) 2024-03-04T06:45:29.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:28 smithi137 ceph-mon[88869]: osdmap e267: 8 total, 8 up, 8 in 2024-03-04T06:45:29.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:28 smithi137 ceph-mon[88869]: pgmap v73: 121 pgs: 121 active+clean; 293 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2024-03-04T06:45:29.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:28 smithi137 ceph-mon[91314]: osdmap e267: 8 total, 8 up, 8 in 2024-03-04T06:45:29.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:28 smithi137 ceph-mon[91314]: pgmap v73: 121 pgs: 121 active+clean; 293 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2024-03-04T06:45:29.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:28 smithi203 ceph-mon[85573]: osdmap e267: 8 total, 8 up, 8 in 2024-03-04T06:45:29.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:28 smithi203 ceph-mon[85573]: pgmap v73: 121 pgs: 121 active+clean; 293 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2024-03-04T06:45:29.397 INFO:tasks.rados.rados.0.smithi137.stdout:1039: done (4 left) 2024-03-04T06:45:29.397 INFO:tasks.rados.rados.0.smithi137.stdout:1046: done (3 left) 2024-03-04T06:45:29.397 INFO:tasks.rados.rados.0.smithi137.stdout:1047: done (2 left) 2024-03-04T06:45:29.397 INFO:tasks.rados.rados.0.smithi137.stdout:1048: done (1 left) 2024-03-04T06:45:29.398 INFO:tasks.rados.rados.0.smithi137.stdout:1049: done (0 left) 2024-03-04T06:45:29.398 INFO:tasks.rados.rados.0.smithi137.stdout:1050: delete oid 37 current snap is 106 2024-03-04T06:45:29.400 INFO:tasks.rados.rados.0.smithi137.stdout:1050: done (0 left) 2024-03-04T06:45:29.400 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 106 2024-03-04T06:45:29.400 INFO:tasks.rados.rados.0.smithi137.stdout:1051: seq_num 338 ranges {1990656=466944,2457600=401408} 2024-03-04T06:45:29.413 INFO:tasks.rados.rados.0.smithi137.stdout:1051: writing smithi13777483-19 from 1990656 to 2457600 tid 1 2024-03-04T06:45:29.415 INFO:tasks.rados.rados.0.smithi137.stdout:1051: writing smithi13777483-19 from 2457600 to 2859008 tid 2 2024-03-04T06:45:29.415 INFO:tasks.rados.rados.0.smithi137.stdout:1052: snap_create 2024-03-04T06:45:29.418 INFO:tasks.rados.rados.0.smithi137.stdout:1051: finishing write tid 1 to smithi13777483-19 2024-03-04T06:45:29.418 INFO:tasks.rados.rados.0.smithi137.stdout:1051: finishing write tid 2 to smithi13777483-19 2024-03-04T06:45:29.418 INFO:tasks.rados.rados.0.smithi137.stdout:1051: finishing write tid 3 to smithi13777483-19 2024-03-04T06:45:29.419 INFO:tasks.rados.rados.0.smithi137.stdout:1051: finishing write tid 4 to smithi13777483-19 2024-03-04T06:45:29.420 INFO:tasks.rados.rados.0.smithi137.stdout:1051: oid 19 updating version 0 to 563 2024-03-04T06:45:29.420 INFO:tasks.rados.rados.0.smithi137.stdout:1051: oid 19 updating version 563 to 564 2024-03-04T06:45:29.420 INFO:tasks.rados.rados.0.smithi137.stdout:1051: oid 19 updating version 564 to 565 2024-03-04T06:45:29.420 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 565 (ObjNum 338 snap 106 seq_num 338) dirty exists 2024-03-04T06:45:29.420 INFO:tasks.rados.rados.0.smithi137.stdout:1051: left oid 19 (ObjNum 338 snap 106 seq_num 338) 2024-03-04T06:45:29.849 INFO:tasks.rados.rados.0.smithi137.stdout:1051: done (1 left) 2024-03-04T06:45:29.850 INFO:tasks.rados.rados.0.smithi137.stdout:1052: done (0 left) 2024-03-04T06:45:29.850 INFO:tasks.rados.rados.0.smithi137.stdout:1053: snap_create 2024-03-04T06:45:29.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[88869]: osdmap e268: 8 total, 8 up, 8 in 2024-03-04T06:45:29.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:29.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:29.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[88869]: Reconfiguring osd.3 (monmap changed)... 2024-03-04T06:45:29.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-04T06:45:29.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:29.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[88869]: Reconfiguring daemon osd.3 on smithi137 2024-03-04T06:45:29.998 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[88869]: osdmap e269: 8 total, 8 up, 8 in 2024-03-04T06:45:29.998 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[91314]: osdmap e268: 8 total, 8 up, 8 in 2024-03-04T06:45:29.998 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:29.999 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:29.999 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[91314]: Reconfiguring osd.3 (monmap changed)... 2024-03-04T06:45:29.999 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-04T06:45:29.999 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:29.999 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[91314]: Reconfiguring daemon osd.3 on smithi137 2024-03-04T06:45:29.999 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:29 smithi137 ceph-mon[91314]: osdmap e269: 8 total, 8 up, 8 in 2024-03-04T06:45:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:29 smithi203 ceph-mon[85573]: osdmap e268: 8 total, 8 up, 8 in 2024-03-04T06:45:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:29 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:29 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:29 smithi203 ceph-mon[85573]: Reconfiguring osd.3 (monmap changed)... 2024-03-04T06:45:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:29 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-04T06:45:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:29 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:29 smithi203 ceph-mon[85573]: Reconfiguring daemon osd.3 on smithi137 2024-03-04T06:45:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:29 smithi203 ceph-mon[85573]: osdmap e269: 8 total, 8 up, 8 in 2024-03-04T06:45:30.852 INFO:tasks.rados.rados.0.smithi137.stdout:1053: done (0 left) 2024-03-04T06:45:30.853 INFO:tasks.rados.rados.0.smithi137.stdout:1054: rollback oid 44 current snap is 108 2024-03-04T06:45:30.853 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 44 to 87 2024-03-04T06:45:30.853 INFO:tasks.rados.rados.0.smithi137.stdout:1055: read oid 36 snap -1 2024-03-04T06:45:30.853 INFO:tasks.rados.rados.0.smithi137.stdout:1055: expect (ObjNum 270 snap 87 seq_num 270) 2024-03-04T06:45:30.853 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 108 2024-03-04T06:45:30.853 INFO:tasks.rados.rados.0.smithi137.stdout:1056: seq_num 339 ranges {2465792=483328,2949120=401408} 2024-03-04T06:45:30.868 INFO:tasks.rados.rados.0.smithi137.stdout:1056: writing smithi13777483-1 from 2465792 to 2949120 tid 1 2024-03-04T06:45:30.871 INFO:tasks.rados.rados.0.smithi137.stdout:1056: writing smithi13777483-1 from 2949120 to 3350528 tid 2 2024-03-04T06:45:30.871 INFO:tasks.rados.rados.0.smithi137.stdout:1057: delete oid 50 current snap is 108 2024-03-04T06:45:30.871 INFO:tasks.rados.rados.0.smithi137.stdout:1054: finishing rollback tid 0 to smithi13777483-44 2024-03-04T06:45:30.871 INFO:tasks.rados.rados.0.smithi137.stdout:1055: expect (ObjNum 270 snap 87 seq_num 270) 2024-03-04T06:45:30.931 INFO:tasks.rados.rados.0.smithi137.stdout:1054: finishing rollback tid 1 to smithi13777483-44 2024-03-04T06:45:30.931 INFO:tasks.rados.rados.0.smithi137.stdout:1054: finishing rollback tid 2 to smithi13777483-44 2024-03-04T06:45:30.932 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 417 (ObjNum 216 snap 63 seq_num 216) dirty exists 2024-03-04T06:45:30.932 INFO:tasks.rados.rados.0.smithi137.stdout:1054: done (3 left) 2024-03-04T06:45:30.932 INFO:tasks.rados.rados.0.smithi137.stdout:1055: done (2 left) 2024-03-04T06:45:30.932 INFO:tasks.rados.rados.0.smithi137.stdout:1057: done (1 left) 2024-03-04T06:45:30.932 INFO:tasks.rados.rados.0.smithi137.stdout:1058: read oid 48 snap -1 2024-03-04T06:45:30.932 INFO:tasks.rados.rados.0.smithi137.stdout:1058: expect (ObjNum 319 snap 103 seq_num 319) 2024-03-04T06:45:30.932 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 108 2024-03-04T06:45:30.932 INFO:tasks.rados.rados.0.smithi137.stdout:1056: finishing write tid 1 to smithi13777483-1 2024-03-04T06:45:30.932 INFO:tasks.rados.rados.0.smithi137.stdout:1056: finishing write tid 2 to smithi13777483-1 2024-03-04T06:45:30.932 INFO:tasks.rados.rados.0.smithi137.stdout:1056: finishing write tid 3 to smithi13777483-1 2024-03-04T06:45:30.932 INFO:tasks.rados.rados.0.smithi137.stdout:1056: finishing write tid 4 to smithi13777483-1 2024-03-04T06:45:30.932 INFO:tasks.rados.rados.0.smithi137.stdout:1056: oid 1 updating version 0 to 450 2024-03-04T06:45:30.933 INFO:tasks.rados.rados.0.smithi137.stdout:1056: oid 1 version 450 is already newer than 448 2024-03-04T06:45:30.933 INFO:tasks.rados.rados.0.smithi137.stdout:1056: oid 1 version 450 is already newer than 449 2024-03-04T06:45:30.933 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 450 (ObjNum 339 snap 108 seq_num 339) dirty exists 2024-03-04T06:45:30.933 INFO:tasks.rados.rados.0.smithi137.stdout:1056: left oid 1 (ObjNum 339 snap 108 seq_num 339) 2024-03-04T06:45:30.933 INFO:tasks.rados.rados.0.smithi137.stdout:1059: seq_num 341 ranges {0=516096,516096=401408} 2024-03-04T06:45:30.933 INFO:tasks.rados.rados.0.smithi137.stdout:1059: writing smithi13777483-6 from 0 to 516096 tid 1 2024-03-04T06:45:30.936 INFO:tasks.rados.rados.0.smithi137.stdout:1059: writing smithi13777483-6 from 516096 to 917504 tid 2 2024-03-04T06:45:30.936 INFO:tasks.rados.rados.0.smithi137.stdout:1056: done (2 left) 2024-03-04T06:45:30.936 INFO:tasks.rados.rados.0.smithi137.stdout:1060: snap_create 2024-03-04T06:45:30.939 INFO:tasks.rados.rados.0.smithi137.stdout:1059: finishing write tid 1 to smithi13777483-6 2024-03-04T06:45:30.939 INFO:tasks.rados.rados.0.smithi137.stdout:1059: finishing write tid 2 to smithi13777483-6 2024-03-04T06:45:30.939 INFO:tasks.rados.rados.0.smithi137.stdout:1058: expect (ObjNum 319 snap 103 seq_num 319) 2024-03-04T06:45:31.042 INFO:tasks.rados.rados.0.smithi137.stdout:1059: finishing write tid 3 to smithi13777483-6 2024-03-04T06:45:31.042 INFO:tasks.rados.rados.0.smithi137.stdout:1059: finishing write tid 4 to smithi13777483-6 2024-03-04T06:45:31.042 INFO:tasks.rados.rados.0.smithi137.stdout:1059: oid 6 updating version 0 to 625 2024-03-04T06:45:31.042 INFO:tasks.rados.rados.0.smithi137.stdout:1059: oid 6 updating version 625 to 627 2024-03-04T06:45:31.042 INFO:tasks.rados.rados.0.smithi137.stdout:1059: oid 6 version 627 is already newer than 626 2024-03-04T06:45:31.042 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 627 (ObjNum 341 snap 108 seq_num 341) dirty exists 2024-03-04T06:45:31.042 INFO:tasks.rados.rados.0.smithi137.stdout:1059: left oid 6 (ObjNum 341 snap 108 seq_num 341) 2024-03-04T06:45:31.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:30 smithi137 ceph-mon[91314]: pgmap v76: 121 pgs: 121 active+clean; 303 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 8 op/s 2024-03-04T06:45:31.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:30 smithi137 ceph-mon[91314]: osdmap e270: 8 total, 8 up, 8 in 2024-03-04T06:45:31.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:31.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:31.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:45:31.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:31.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:30 smithi137 ceph-mon[88869]: pgmap v76: 121 pgs: 121 active+clean; 303 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 8 op/s 2024-03-04T06:45:31.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:30 smithi137 ceph-mon[88869]: osdmap e270: 8 total, 8 up, 8 in 2024-03-04T06:45:31.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:31.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:31.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:45:31.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:31.248 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:30 smithi203 ceph-mon[85573]: pgmap v76: 121 pgs: 121 active+clean; 303 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 8 op/s 2024-03-04T06:45:31.248 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:30 smithi203 ceph-mon[85573]: osdmap e270: 8 total, 8 up, 8 in 2024-03-04T06:45:31.248 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:31.248 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:31.248 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:45:31.248 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:31.885 INFO:tasks.rados.rados.0.smithi137.stdout:1058: done (2 left) 2024-03-04T06:45:31.886 INFO:tasks.rados.rados.0.smithi137.stdout:1059: done (1 left) 2024-03-04T06:45:31.886 INFO:tasks.rados.rados.0.smithi137.stdout:1060: done (0 left) 2024-03-04T06:45:31.886 INFO:tasks.rados.rados.0.smithi137.stdout:1061: read oid 49 snap -1 2024-03-04T06:45:31.886 INFO:tasks.rados.rados.0.smithi137.stdout:1061: expect (ObjNum 63 snap 4 seq_num 63) 2024-03-04T06:45:31.886 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 40 current snap is 109 2024-03-04T06:45:31.886 INFO:tasks.rados.rados.0.smithi137.stdout:1062: seq_num 342 ranges {3022848=532480,3555328=401408} 2024-03-04T06:45:31.904 INFO:tasks.rados.rados.0.smithi137.stdout:1062: writing smithi13777483-40 from 3022848 to 3555328 tid 1 2024-03-04T06:45:31.907 INFO:tasks.rados.rados.0.smithi137.stdout:1062: writing smithi13777483-40 from 3555328 to 3956736 tid 2 2024-03-04T06:45:31.907 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 109 2024-03-04T06:45:31.907 INFO:tasks.rados.rados.0.smithi137.stdout:1063: seq_num 343 ranges {4136960=548864,4685824=401408} 2024-03-04T06:45:31.932 INFO:tasks.rados.rados.0.smithi137.stdout:1063: writing smithi13777483-26 from 4136960 to 4685824 tid 1 2024-03-04T06:45:31.935 INFO:tasks.rados.rados.0.smithi137.stdout:1063: writing smithi13777483-26 from 4685824 to 5087232 tid 2 2024-03-04T06:45:31.935 INFO:tasks.rados.rados.0.smithi137.stdout:1064: rmattr oid 11 current snap is 109 2024-03-04T06:45:31.935 INFO:tasks.rados.rados.0.smithi137.stdout:1064: done (3 left) 2024-03-04T06:45:31.935 INFO:tasks.rados.rados.0.smithi137.stdout:1065: delete oid 19 current snap is 109 2024-03-04T06:45:31.935 INFO:tasks.rados.rados.0.smithi137.stdout:1061: expect (ObjNum 63 snap 4 seq_num 63) 2024-03-04T06:45:32.000 INFO:tasks.rados.rados.0.smithi137.stdout:1062: finishing write tid 1 to smithi13777483-40 2024-03-04T06:45:32.000 INFO:tasks.rados.rados.0.smithi137.stdout:1062: finishing write tid 2 to smithi13777483-40 2024-03-04T06:45:32.000 INFO:tasks.rados.rados.0.smithi137.stdout:1062: finishing write tid 3 to smithi13777483-40 2024-03-04T06:45:32.001 INFO:tasks.rados.rados.0.smithi137.stdout:1062: finishing write tid 4 to smithi13777483-40 2024-03-04T06:45:32.001 INFO:tasks.rados.rados.0.smithi137.stdout:1062: oid 40 updating version 0 to 630 2024-03-04T06:45:32.001 INFO:tasks.rados.rados.0.smithi137.stdout:1062: oid 40 updating version 630 to 631 2024-03-04T06:45:32.001 INFO:tasks.rados.rados.0.smithi137.stdout:1062: oid 40 version 631 is already newer than 629 2024-03-04T06:45:32.001 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 631 (ObjNum 342 snap 109 seq_num 342) dirty exists 2024-03-04T06:45:32.001 INFO:tasks.rados.rados.0.smithi137.stdout:1062: left oid 40 (ObjNum 342 snap 109 seq_num 342) 2024-03-04T06:45:32.001 INFO:tasks.rados.rados.0.smithi137.stdout:1063: finishing write tid 1 to smithi13777483-26 2024-03-04T06:45:32.001 INFO:tasks.rados.rados.0.smithi137.stdout:1063: finishing write tid 2 to smithi13777483-26 2024-03-04T06:45:32.001 INFO:tasks.rados.rados.0.smithi137.stdout:1063: finishing write tid 3 to smithi13777483-26 2024-03-04T06:45:32.001 INFO:tasks.rados.rados.0.smithi137.stdout:1061: done (3 left) 2024-03-04T06:45:32.001 INFO:tasks.rados.rados.0.smithi137.stdout:1062: done (2 left) 2024-03-04T06:45:32.001 INFO:tasks.rados.rados.0.smithi137.stdout:1065: done (1 left) 2024-03-04T06:45:32.001 INFO:tasks.rados.rados.0.smithi137.stdout:1066: snap_create 2024-03-04T06:45:32.002 INFO:tasks.rados.rados.0.smithi137.stdout:1063: finishing write tid 4 to smithi13777483-26 2024-03-04T06:45:32.002 INFO:tasks.rados.rados.0.smithi137.stdout:1063: oid 26 updating version 0 to 495 2024-03-04T06:45:32.002 INFO:tasks.rados.rados.0.smithi137.stdout:1063: oid 26 updating version 495 to 496 2024-03-04T06:45:32.002 INFO:tasks.rados.rados.0.smithi137.stdout:1063: oid 26 version 496 is already newer than 494 2024-03-04T06:45:32.002 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 496 (ObjNum 343 snap 109 seq_num 343) dirty exists 2024-03-04T06:45:32.002 INFO:tasks.rados.rados.0.smithi137.stdout:1063: left oid 26 (ObjNum 343 snap 109 seq_num 343) 2024-03-04T06:45:32.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:31 smithi137 ceph-mon[88869]: Reconfiguring mds.a (monmap changed)... 2024-03-04T06:45:32.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:31 smithi137 ceph-mon[88869]: Reconfiguring daemon mds.a on smithi137 2024-03-04T06:45:32.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:31 smithi137 ceph-mon[88869]: osdmap e271: 8 total, 8 up, 8 in 2024-03-04T06:45:32.032 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:31 smithi137 ceph-mon[91314]: Reconfiguring mds.a (monmap changed)... 2024-03-04T06:45:32.032 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:31 smithi137 ceph-mon[91314]: Reconfiguring daemon mds.a on smithi137 2024-03-04T06:45:32.033 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:31 smithi137 ceph-mon[91314]: osdmap e271: 8 total, 8 up, 8 in 2024-03-04T06:45:32.267 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:31 smithi203 ceph-mon[85573]: Reconfiguring mds.a (monmap changed)... 2024-03-04T06:45:32.267 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:31 smithi203 ceph-mon[85573]: Reconfiguring daemon mds.a on smithi137 2024-03-04T06:45:32.267 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:31 smithi203 ceph-mon[85573]: osdmap e271: 8 total, 8 up, 8 in 2024-03-04T06:45:32.960 INFO:tasks.rados.rados.0.smithi137.stdout:1063: done (1 left) 2024-03-04T06:45:32.960 INFO:tasks.rados.rados.0.smithi137.stdout:1066: done (0 left) 2024-03-04T06:45:32.960 INFO:tasks.rados.rados.0.smithi137.stdout:1067: read oid 10 snap -1 2024-03-04T06:45:32.960 INFO:tasks.rados.rados.0.smithi137.stdout:1067: expect (ObjNum 280 snap 89 seq_num 280) 2024-03-04T06:45:32.960 INFO:tasks.rados.rados.0.smithi137.stdout:1068: delete oid 19 current snap is 110 2024-03-04T06:45:32.968 INFO:tasks.rados.rados.0.smithi137.stdout:1067: expect (ObjNum 280 snap 89 seq_num 280) 2024-03-04T06:45:33.028 INFO:tasks.rados.rados.0.smithi137.stdout:1067: done (1 left) 2024-03-04T06:45:33.028 INFO:tasks.rados.rados.0.smithi137.stdout:1068: done (0 left) 2024-03-04T06:45:33.028 INFO:tasks.rados.rados.0.smithi137.stdout:1069: delete oid 11 current snap is 110 2024-03-04T06:45:33.030 INFO:tasks.rados.rados.0.smithi137.stdout:1069: done (0 left) 2024-03-04T06:45:33.030 INFO:tasks.rados.rados.0.smithi137.stdout:1070: read oid 3 snap -1 2024-03-04T06:45:33.030 INFO:tasks.rados.rados.0.smithi137.stdout:1070: expect (ObjNum 310 snap 99 seq_num 310) 2024-03-04T06:45:33.030 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 110 2024-03-04T06:45:33.030 INFO:tasks.rados.rados.0.smithi137.stdout:1071: seq_num 347 ranges {2351104=614400,2965504=401408} 2024-03-04T06:45:33.045 INFO:tasks.rados.rados.0.smithi137.stdout:1071: writing smithi13777483-23 from 2351104 to 2965504 tid 1 2024-03-04T06:45:33.048 INFO:tasks.rados.rados.0.smithi137.stdout:1071: writing smithi13777483-23 from 2965504 to 3366912 tid 2 2024-03-04T06:45:33.048 INFO:tasks.rados.rados.0.smithi137.stdout:1072: rmattr oid 20 current snap is 110 2024-03-04T06:45:33.048 INFO:tasks.rados.rados.0.smithi137.stdout:1072: done (2 left) 2024-03-04T06:45:33.048 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 41 current snap is 110 2024-03-04T06:45:33.048 INFO:tasks.rados.rados.0.smithi137.stdout:1073: seq_num 348 ranges {0=630784,630784=401408} 2024-03-04T06:45:33.051 INFO:tasks.rados.rados.0.smithi137.stdout:1073: writing smithi13777483-41 from 0 to 630784 tid 1 2024-03-04T06:45:33.054 INFO:tasks.rados.rados.0.smithi137.stdout:1073: writing smithi13777483-41 from 630784 to 1032192 tid 2 2024-03-04T06:45:33.054 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 110 2024-03-04T06:45:33.054 INFO:tasks.rados.rados.0.smithi137.stdout:1074: seq_num 349 ranges {0=655360,655360=401408} 2024-03-04T06:45:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:1074: writing smithi13777483-11 from 0 to 655360 tid 1 2024-03-04T06:45:33.060 INFO:tasks.rados.rados.0.smithi137.stdout:1074: writing smithi13777483-11 from 655360 to 1056768 tid 2 2024-03-04T06:45:33.060 INFO:tasks.rados.rados.0.smithi137.stdout:1075: snap_remove snap 98 2024-03-04T06:45:33.276 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:32 smithi203 ceph-mon[85573]: pgmap v79: 121 pgs: 121 active+clean; 303 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 8 op/s 2024-03-04T06:45:33.276 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:32 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:33.276 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:32 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:33.276 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:32 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:45:33.276 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:32 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:45:33.276 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:32 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:33.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:32 smithi137 ceph-mon[91314]: pgmap v79: 121 pgs: 121 active+clean; 303 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 8 op/s 2024-03-04T06:45:33.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:32 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:33.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:32 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:33.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:32 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:45:33.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:32 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:45:33.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:32 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:33.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:32 smithi137 ceph-mon[88869]: pgmap v79: 121 pgs: 121 active+clean; 303 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 8 op/s 2024-03-04T06:45:33.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:32 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:33.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:32 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:33.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:32 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T06:45:33.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:32 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T06:45:33.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:32 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:33.976 INFO:tasks.rados.rados.0.smithi137.stdout:1070: expect (ObjNum 310 snap 99 seq_num 310) 2024-03-04T06:45:33.989 INFO:tasks.rados.rados.0.smithi137.stdout:1071: finishing write tid 1 to smithi13777483-23 2024-03-04T06:45:33.989 INFO:tasks.rados.rados.0.smithi137.stdout:1071: finishing write tid 2 to smithi13777483-23 2024-03-04T06:45:33.989 INFO:tasks.rados.rados.0.smithi137.stdout:1071: finishing write tid 3 to smithi13777483-23 2024-03-04T06:45:33.989 INFO:tasks.rados.rados.0.smithi137.stdout:1071: finishing write tid 4 to smithi13777483-23 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:1071: oid 23 updating version 0 to 429 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:1071: oid 23 version 429 is already newer than 428 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:1071: oid 23 version 429 is already newer than 427 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 429 (ObjNum 347 snap 110 seq_num 347) dirty exists 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:1071: left oid 23 (ObjNum 347 snap 110 seq_num 347) 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:1073: finishing write tid 1 to smithi13777483-41 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:1073: finishing write tid 2 to smithi13777483-41 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:1073: finishing write tid 3 to smithi13777483-41 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:1073: finishing write tid 4 to smithi13777483-41 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:1073: oid 41 updating version 0 to 222 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:1073: oid 41 version 222 is already newer than 221 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:1073: oid 41 version 222 is already newer than 220 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 222 (ObjNum 348 snap 110 seq_num 348) dirty exists 2024-03-04T06:45:33.990 INFO:tasks.rados.rados.0.smithi137.stdout:1073: left oid 41 (ObjNum 348 snap 110 seq_num 348) 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1074: finishing write tid 1 to smithi13777483-11 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1074: finishing write tid 2 to smithi13777483-11 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1074: finishing write tid 3 to smithi13777483-11 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1074: finishing write tid 4 to smithi13777483-11 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1074: oid 11 updating version 0 to 187 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1074: oid 11 updating version 187 to 188 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1074: oid 11 updating version 188 to 189 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 189 (ObjNum 349 snap 110 seq_num 349) dirty exists 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1074: left oid 11 (ObjNum 349 snap 110 seq_num 349) 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1070: done (4 left) 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1071: done (3 left) 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1073: done (2 left) 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1074: done (1 left) 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1075: done (0 left) 2024-03-04T06:45:33.991 INFO:tasks.rados.rados.0.smithi137.stdout:1076: snap_remove snap 74 2024-03-04T06:45:34.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:33 smithi137 ceph-mon[88869]: Reconfiguring mon.b (monmap changed)... 2024-03-04T06:45:34.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:33 smithi137 ceph-mon[88869]: Reconfiguring daemon mon.b on smithi203 2024-03-04T06:45:34.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:33 smithi137 ceph-mon[88869]: osdmap e272: 8 total, 8 up, 8 in 2024-03-04T06:45:34.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:33 smithi137 ceph-mon[91314]: Reconfiguring mon.b (monmap changed)... 2024-03-04T06:45:34.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:33 smithi137 ceph-mon[91314]: Reconfiguring daemon mon.b on smithi203 2024-03-04T06:45:34.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:33 smithi137 ceph-mon[91314]: osdmap e272: 8 total, 8 up, 8 in 2024-03-04T06:45:34.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:33 smithi203 ceph-mon[85573]: Reconfiguring mon.b (monmap changed)... 2024-03-04T06:45:34.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:33 smithi203 ceph-mon[85573]: Reconfiguring daemon mon.b on smithi203 2024-03-04T06:45:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:33 smithi203 ceph-mon[85573]: osdmap e272: 8 total, 8 up, 8 in 2024-03-04T06:45:34.857 INFO:tasks.rados.rados.0.smithi137.stdout:1076: done (0 left) 2024-03-04T06:45:34.857 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 110 2024-03-04T06:45:34.857 INFO:tasks.rados.rados.0.smithi137.stdout:1077: seq_num 350 ranges {0=671744,671744=401408} 2024-03-04T06:45:34.861 INFO:tasks.rados.rados.0.smithi137.stdout:1077: writing smithi13777483-12 from 0 to 671744 tid 1 2024-03-04T06:45:34.864 INFO:tasks.rados.rados.0.smithi137.stdout:1077: writing smithi13777483-12 from 671744 to 1073152 tid 2 2024-03-04T06:45:34.864 INFO:tasks.rados.rados.0.smithi137.stdout:1078: read oid 41 snap 104 2024-03-04T06:45:34.864 INFO:tasks.rados.rados.0.smithi137.stdout:1078: expect deleted 2024-03-04T06:45:34.864 INFO:tasks.rados.rados.0.smithi137.stdout:1079: rmattr oid 31 current snap is 110 2024-03-04T06:45:34.864 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 110 2024-03-04T06:45:34.864 INFO:tasks.rados.rados.0.smithi137.stdout:1080: seq_num 351 ranges {0=688128,688128=401408} 2024-03-04T06:45:34.868 INFO:tasks.rados.rados.0.smithi137.stdout:1080: writing smithi13777483-25 from 0 to 688128 tid 1 2024-03-04T06:45:34.871 INFO:tasks.rados.rados.0.smithi137.stdout:1080: writing smithi13777483-25 from 688128 to 1089536 tid 2 2024-03-04T06:45:34.872 INFO:tasks.rados.rados.0.smithi137.stdout:1081: read oid 23 snap -1 2024-03-04T06:45:34.872 INFO:tasks.rados.rados.0.smithi137.stdout:1081: expect (ObjNum 347 snap 110 seq_num 347) 2024-03-04T06:45:34.872 INFO:tasks.rados.rados.0.smithi137.stdout:1082: delete oid 28 current snap is 110 2024-03-04T06:45:34.872 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 520 (ObjNum 324 snap 103 seq_num 324) dirty exists 2024-03-04T06:45:34.872 INFO:tasks.rados.rados.0.smithi137.stdout:1077: finishing write tid 1 to smithi13777483-12 2024-03-04T06:45:34.872 INFO:tasks.rados.rados.0.smithi137.stdout:1077: finishing write tid 2 to smithi13777483-12 2024-03-04T06:45:34.872 INFO:tasks.rados.rados.0.smithi137.stdout:1077: finishing write tid 3 to smithi13777483-12 2024-03-04T06:45:34.877 INFO:tasks.rados.rados.0.smithi137.stdout:1077: finishing write tid 4 to smithi13777483-12 2024-03-04T06:45:34.877 INFO:tasks.rados.rados.0.smithi137.stdout:1077: oid 12 updating version 0 to 272 2024-03-04T06:45:34.877 INFO:tasks.rados.rados.0.smithi137.stdout:1077: oid 12 version 272 is already newer than 271 2024-03-04T06:45:34.878 INFO:tasks.rados.rados.0.smithi137.stdout:1077: oid 12 updating version 272 to 273 2024-03-04T06:45:34.878 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 273 (ObjNum 350 snap 110 seq_num 350) dirty exists 2024-03-04T06:45:34.878 INFO:tasks.rados.rados.0.smithi137.stdout:1077: left oid 12 (ObjNum 350 snap 110 seq_num 350) 2024-03-04T06:45:34.882 INFO:tasks.rados.rados.0.smithi137.stdout:1080: finishing write tid 1 to smithi13777483-25 2024-03-04T06:45:34.882 INFO:tasks.rados.rados.0.smithi137.stdout:1080: finishing write tid 2 to smithi13777483-25 2024-03-04T06:45:34.882 INFO:tasks.rados.rados.0.smithi137.stdout:1080: finishing write tid 3 to smithi13777483-25 2024-03-04T06:45:34.884 INFO:tasks.rados.rados.0.smithi137.stdout:1077: done (5 left) 2024-03-04T06:45:34.884 INFO:tasks.rados.rados.0.smithi137.stdout:1078: done (4 left) 2024-03-04T06:45:34.885 INFO:tasks.rados.rados.0.smithi137.stdout:1079: done (3 left) 2024-03-04T06:45:34.885 INFO:tasks.rados.rados.0.smithi137.stdout:1082: done (2 left) 2024-03-04T06:45:34.885 INFO:tasks.rados.rados.0.smithi137.stdout:1083: rollback oid 47 current snap is 110 2024-03-04T06:45:34.885 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 47 to 96 2024-03-04T06:45:34.885 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 110 2024-03-04T06:45:34.885 INFO:tasks.rados.rados.0.smithi137.stdout:1084: seq_num 353 ranges {401408=720896,1122304=401408} 2024-03-04T06:45:34.891 INFO:tasks.rados.rados.0.smithi137.stdout:1084: writing smithi13777483-3 from 401408 to 1122304 tid 1 2024-03-04T06:45:34.894 INFO:tasks.rados.rados.0.smithi137.stdout:1084: writing smithi13777483-3 from 1122304 to 1523712 tid 2 2024-03-04T06:45:34.894 INFO:tasks.rados.rados.0.smithi137.stdout:1085: read oid 32 snap -1 2024-03-04T06:45:34.894 INFO:tasks.rados.rados.0.smithi137.stdout:1085: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:45:34.894 INFO:tasks.rados.rados.0.smithi137.stdout:1086: read oid 15 snap 101 2024-03-04T06:45:34.894 INFO:tasks.rados.rados.0.smithi137.stdout:1086: expect (ObjNum 301 snap 96 seq_num 301) 2024-03-04T06:45:34.894 INFO:tasks.rados.rados.0.smithi137.stdout:1087: rollback oid 27 current snap is 110 2024-03-04T06:45:34.894 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 27 to 109 2024-03-04T06:45:34.895 INFO:tasks.rados.rados.0.smithi137.stdout:1080: finishing write tid 4 to smithi13777483-25 2024-03-04T06:45:34.895 INFO:tasks.rados.rados.0.smithi137.stdout:1080: oid 25 updating version 0 to 716 2024-03-04T06:45:34.895 INFO:tasks.rados.rados.0.smithi137.stdout:1080: oid 25 version 716 is already newer than 715 2024-03-04T06:45:34.895 INFO:tasks.rados.rados.0.smithi137.stdout:1080: oid 25 version 716 is already newer than 714 2024-03-04T06:45:34.895 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 716 (ObjNum 351 snap 110 seq_num 351) dirty exists 2024-03-04T06:45:34.895 INFO:tasks.rados.rados.0.smithi137.stdout:1080: left oid 25 (ObjNum 351 snap 110 seq_num 351) 2024-03-04T06:45:34.895 INFO:tasks.rados.rados.0.smithi137.stdout:1080: done (6 left) 2024-03-04T06:45:34.895 INFO:tasks.rados.rados.0.smithi137.stdout:1088: rmattr oid 4 current snap is 110 2024-03-04T06:45:34.895 INFO:tasks.rados.rados.0.smithi137.stdout:1081: expect (ObjNum 347 snap 110 seq_num 347) 2024-03-04T06:45:35.037 INFO:tasks.rados.rados.0.smithi137.stdout:1083: finishing rollback tid 0 to smithi13777483-47 2024-03-04T06:45:35.037 INFO:tasks.rados.rados.0.smithi137.stdout:1083: finishing rollback tid 1 to smithi13777483-47 2024-03-04T06:45:35.037 INFO:tasks.rados.rados.0.smithi137.stdout:1081: done (6 left) 2024-03-04T06:45:35.037 INFO:tasks.rados.rados.0.smithi137.stdout:1089: setattr oid 8 current snap is 110 2024-03-04T06:45:35.037 INFO:tasks.rados.rados.0.smithi137.stdout:1083: finishing rollback tid 2 to smithi13777483-47 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 725 (ObjNum 298 snap 96 seq_num 298) dirty exists 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:1084: finishing write tid 1 to smithi13777483-3 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:1084: finishing write tid 2 to smithi13777483-3 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 140 (ObjNum 308 snap 99 seq_num 308) dirty exists 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:1084: finishing write tid 3 to smithi13777483-3 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:1084: finishing write tid 4 to smithi13777483-3 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:1084: oid 3 updating version 0 to 582 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:1084: oid 3 version 582 is already newer than 580 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:1084: oid 3 version 582 is already newer than 581 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 582 (ObjNum 353 snap 110 seq_num 353) dirty exists 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:1084: left oid 3 (ObjNum 353 snap 110 seq_num 353) 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:1087: finishing rollback tid 1 to smithi13777483-27 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 697 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-03-04T06:45:35.038 INFO:tasks.rados.rados.0.smithi137.stdout:1085: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:45:35.247 INFO:tasks.rados.rados.0.smithi137.stdout:1086: expect (ObjNum 301 snap 96 seq_num 301) 2024-03-04T06:45:35.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[91314]: osdmap e273: 8 total, 8 up, 8 in 2024-03-04T06:45:35.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:35.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:35.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[91314]: Reconfiguring mgr.x (monmap changed)... 2024-03-04T06:45:35.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:45:35.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:45:35.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:35.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[91314]: Reconfiguring daemon mgr.x on smithi203 2024-03-04T06:45:35.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[91314]: pgmap v82: 121 pgs: 121 active+clean; 311 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-03-04T06:45:35.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[91314]: osdmap e274: 8 total, 8 up, 8 in 2024-03-04T06:45:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[88869]: osdmap e273: 8 total, 8 up, 8 in 2024-03-04T06:45:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[88869]: Reconfiguring mgr.x (monmap changed)... 2024-03-04T06:45:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:45:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:45:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[88869]: Reconfiguring daemon mgr.x on smithi203 2024-03-04T06:45:35.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[88869]: pgmap v82: 121 pgs: 121 active+clean; 311 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-03-04T06:45:35.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:34 smithi137 ceph-mon[88869]: osdmap e274: 8 total, 8 up, 8 in 2024-03-04T06:45:35.313 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:34 smithi203 ceph-mon[85573]: osdmap e273: 8 total, 8 up, 8 in 2024-03-04T06:45:35.313 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:35.313 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:35.313 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:34 smithi203 ceph-mon[85573]: Reconfiguring mgr.x (monmap changed)... 2024-03-04T06:45:35.314 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T06:45:35.314 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T06:45:35.314 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:35.314 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:34 smithi203 ceph-mon[85573]: Reconfiguring daemon mgr.x on smithi203 2024-03-04T06:45:35.314 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:34 smithi203 ceph-mon[85573]: pgmap v82: 121 pgs: 121 active+clean; 311 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-03-04T06:45:35.314 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:34 smithi203 ceph-mon[85573]: osdmap e274: 8 total, 8 up, 8 in 2024-03-04T06:45:35.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:45:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:45:35] "GET /metrics HTTP/1.1" 200 36000 "" "Prometheus/2.43.0" 2024-03-04T06:45:35.892 INFO:tasks.rados.rados.0.smithi137.stdout:1083: done (6 left) 2024-03-04T06:45:35.892 INFO:tasks.rados.rados.0.smithi137.stdout:1084: done (5 left) 2024-03-04T06:45:35.892 INFO:tasks.rados.rados.0.smithi137.stdout:1085: done (4 left) 2024-03-04T06:45:35.893 INFO:tasks.rados.rados.0.smithi137.stdout:1086: done (3 left) 2024-03-04T06:45:35.893 INFO:tasks.rados.rados.0.smithi137.stdout:1087: done (2 left) 2024-03-04T06:45:35.893 INFO:tasks.rados.rados.0.smithi137.stdout:1088: done (1 left) 2024-03-04T06:45:35.893 INFO:tasks.rados.rados.0.smithi137.stdout:1090: snap_remove snap 70 2024-03-04T06:45:36.777 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 200 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-03-04T06:45:36.777 INFO:tasks.rados.rados.0.smithi137.stdout:1089: done (1 left) 2024-03-04T06:45:36.777 INFO:tasks.rados.rados.0.smithi137.stdout:1090: done (0 left) 2024-03-04T06:45:36.777 INFO:tasks.rados.rados.0.smithi137.stdout:1091: rmattr oid 30 current snap is 110 2024-03-04T06:45:36.777 INFO:tasks.rados.rados.0.smithi137.stdout:1092: snap_remove snap 26 2024-03-04T06:45:37.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[88869]: Reconfiguring osd.4 (monmap changed)... 2024-03-04T06:45:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-04T06:45:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[88869]: Reconfiguring daemon osd.4 on smithi203 2024-03-04T06:45:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[88869]: pgmap v84: 121 pgs: 121 active+clean; 312 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.7 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-03-04T06:45:37.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:37.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:37.047 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[91314]: Reconfiguring osd.4 (monmap changed)... 2024-03-04T06:45:37.047 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-04T06:45:37.047 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:37.047 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[91314]: Reconfiguring daemon osd.4 on smithi203 2024-03-04T06:45:37.047 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:36 smithi137 ceph-mon[91314]: pgmap v84: 121 pgs: 121 active+clean; 312 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.7 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-03-04T06:45:37.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:36 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:37.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:36 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:37.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:36 smithi203 ceph-mon[85573]: Reconfiguring osd.4 (monmap changed)... 2024-03-04T06:45:37.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:36 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-04T06:45:37.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:36 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:36 smithi203 ceph-mon[85573]: Reconfiguring daemon osd.4 on smithi203 2024-03-04T06:45:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:36 smithi203 ceph-mon[85573]: pgmap v84: 121 pgs: 121 active+clean; 312 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.7 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-03-04T06:45:37.788 INFO:tasks.rados.rados.0.smithi137.stdout:1092: done (1 left) 2024-03-04T06:45:37.788 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 110 2024-03-04T06:45:37.788 INFO:tasks.rados.rados.0.smithi137.stdout:1093: seq_num 354 ranges {1900544=737280,2637824=401408} 2024-03-04T06:45:37.804 INFO:tasks.rados.rados.0.smithi137.stdout:1093: writing smithi13777483-31 from 1900544 to 2637824 tid 1 2024-03-04T06:45:37.807 INFO:tasks.rados.rados.0.smithi137.stdout:1093: writing smithi13777483-31 from 2637824 to 3039232 tid 2 2024-03-04T06:45:37.807 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 110 2024-03-04T06:45:37.807 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 279 (ObjNum 239 snap 72 seq_num 239) dirty exists 2024-03-04T06:45:37.807 INFO:tasks.rados.rados.0.smithi137.stdout:1094: seq_num 355 ranges {917504=753664,1671168=401408} 2024-03-04T06:45:37.817 INFO:tasks.rados.rados.0.smithi137.stdout:1094: writing smithi13777483-6 from 917504 to 1671168 tid 1 2024-03-04T06:45:37.820 INFO:tasks.rados.rados.0.smithi137.stdout:1094: writing smithi13777483-6 from 1671168 to 2072576 tid 2 2024-03-04T06:45:37.820 INFO:tasks.rados.rados.0.smithi137.stdout:1091: done (2 left) 2024-03-04T06:45:37.820 INFO:tasks.rados.rados.0.smithi137.stdout:1095: rollback oid 12 current snap is 110 2024-03-04T06:45:37.820 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 12 to 107 2024-03-04T06:45:37.820 INFO:tasks.rados.rados.0.smithi137.stdout:1093: finishing write tid 1 to smithi13777483-31 2024-03-04T06:45:37.820 INFO:tasks.rados.rados.0.smithi137.stdout:1093: finishing write tid 2 to smithi13777483-31 2024-03-04T06:45:37.820 INFO:tasks.rados.rados.0.smithi137.stdout:1093: finishing write tid 3 to smithi13777483-31 2024-03-04T06:45:37.820 INFO:tasks.rados.rados.0.smithi137.stdout:1093: finishing write tid 4 to smithi13777483-31 2024-03-04T06:45:37.821 INFO:tasks.rados.rados.0.smithi137.stdout:1093: oid 31 updating version 0 to 534 2024-03-04T06:45:37.821 INFO:tasks.rados.rados.0.smithi137.stdout:1093: oid 31 version 534 is already newer than 533 2024-03-04T06:45:37.821 INFO:tasks.rados.rados.0.smithi137.stdout:1093: oid 31 updating version 534 to 535 2024-03-04T06:45:37.821 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 535 (ObjNum 354 snap 110 seq_num 354) dirty exists 2024-03-04T06:45:37.821 INFO:tasks.rados.rados.0.smithi137.stdout:1093: left oid 31 (ObjNum 354 snap 110 seq_num 354) 2024-03-04T06:45:37.821 INFO:tasks.rados.rados.0.smithi137.stdout:1093: done (2 left) 2024-03-04T06:45:37.821 INFO:tasks.rados.rados.0.smithi137.stdout:1096: rollback oid 25 current snap is 110 2024-03-04T06:45:37.821 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 25 to 106 2024-03-04T06:45:37.821 INFO:tasks.rados.rados.0.smithi137.stdout:1097: rmattr oid 45 current snap is 110 2024-03-04T06:45:37.821 INFO:tasks.rados.rados.0.smithi137.stdout:1098: rmattr oid 18 current snap is 110 2024-03-04T06:45:37.821 INFO:tasks.rados.rados.0.smithi137.stdout:1098: done (4 left) 2024-03-04T06:45:37.821 INFO:tasks.rados.rados.0.smithi137.stdout:1099: delete oid 13 current snap is 110 2024-03-04T06:45:37.822 INFO:tasks.rados.rados.0.smithi137.stdout:1096: finishing rollback tid 0 to smithi13777483-25 2024-03-04T06:45:37.822 INFO:tasks.rados.rados.0.smithi137.stdout:1095: finishing rollback tid 0 to smithi13777483-12 2024-03-04T06:45:37.823 INFO:tasks.rados.rados.0.smithi137.stdout:1094: finishing write tid 1 to smithi13777483-6 2024-03-04T06:45:37.823 INFO:tasks.rados.rados.0.smithi137.stdout:1096: finishing rollback tid 1 to smithi13777483-25 2024-03-04T06:45:37.823 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 749 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-04T06:45:37.824 INFO:tasks.rados.rados.0.smithi137.stdout:1095: finishing rollback tid 1 to smithi13777483-12 2024-03-04T06:45:37.824 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 285 (ObjNum 145 snap 0 seq_num 3131103616) dirty dne 2024-03-04T06:45:37.824 INFO:tasks.rados.rados.0.smithi137.stdout:1094: finishing write tid 2 to smithi13777483-6 2024-03-04T06:45:37.824 INFO:tasks.rados.rados.0.smithi137.stdout:1094: finishing write tid 3 to smithi13777483-6 2024-03-04T06:45:37.824 INFO:tasks.rados.rados.0.smithi137.stdout:1095: done (4 left) 2024-03-04T06:45:37.824 INFO:tasks.rados.rados.0.smithi137.stdout:1096: done (3 left) 2024-03-04T06:45:37.825 INFO:tasks.rados.rados.0.smithi137.stdout:1099: done (2 left) 2024-03-04T06:45:37.825 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 110 2024-03-04T06:45:37.825 INFO:tasks.rados.rados.0.smithi137.stdout:1100: seq_num 357 ranges {0=786432,786432=401408} 2024-03-04T06:45:37.829 INFO:tasks.rados.rados.0.smithi137.stdout:1100: writing smithi13777483-46 from 0 to 786432 tid 1 2024-03-04T06:45:37.831 INFO:tasks.rados.rados.0.smithi137.stdout:1100: writing smithi13777483-46 from 786432 to 1187840 tid 2 2024-03-04T06:45:37.831 INFO:tasks.rados.rados.0.smithi137.stdout:1101: snap_remove snap 69 2024-03-04T06:45:38.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:37 smithi137 ceph-mon[91314]: osdmap e275: 8 total, 8 up, 8 in 2024-03-04T06:45:38.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:37 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:38.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:37 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:38.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:37 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-04T06:45:38.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:37 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:37 smithi137 ceph-mon[88869]: osdmap e275: 8 total, 8 up, 8 in 2024-03-04T06:45:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:37 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:37 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:37 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-04T06:45:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:37 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:38.044 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:37 smithi203 ceph-mon[85573]: osdmap e275: 8 total, 8 up, 8 in 2024-03-04T06:45:38.045 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:37 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:38.045 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:37 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:38.045 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:37 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-04T06:45:38.045 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:37 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:38.793 INFO:tasks.rados.rados.0.smithi137.stdout:1101: done (3 left) 2024-03-04T06:45:38.793 INFO:tasks.rados.rados.0.smithi137.stdout:1102: read oid 29 snap -1 2024-03-04T06:45:38.793 INFO:tasks.rados.rados.0.smithi137.stdout:1102: expect (ObjNum 8 snap 0 seq_num 8) 2024-03-04T06:45:38.793 INFO:tasks.rados.rados.0.smithi137.stdout:1103: copy_from oid 24 from oid 41 current snap is 110 2024-03-04T06:45:38.793 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 236 (ObjNum 328 snap 103 seq_num 328) dirty exists 2024-03-04T06:45:38.793 INFO:tasks.rados.rados.0.smithi137.stdout:1094: finishing write tid 4 to smithi13777483-6 2024-03-04T06:45:38.793 INFO:tasks.rados.rados.0.smithi137.stdout:1094: oid 6 updating version 0 to 666 2024-03-04T06:45:38.793 INFO:tasks.rados.rados.0.smithi137.stdout:1094: oid 6 version 666 is already newer than 665 2024-03-04T06:45:38.793 INFO:tasks.rados.rados.0.smithi137.stdout:1094: oid 6 updating version 666 to 667 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 667 (ObjNum 355 snap 110 seq_num 355) dirty exists 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:1094: left oid 6 (ObjNum 355 snap 110 seq_num 355) 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:1100: finishing write tid 1 to smithi13777483-46 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:1094: done (4 left) 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:1097: done (3 left) 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:1104: delete oid 32 current snap is 110 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:1100: finishing write tid 2 to smithi13777483-46 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:1100: finishing write tid 3 to smithi13777483-46 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:1100: finishing write tid 4 to smithi13777483-46 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:1100: oid 46 updating version 0 to 787 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:1100: oid 46 version 787 is already newer than 786 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:1100: oid 46 version 787 is already newer than 785 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 787 (ObjNum 357 snap 110 seq_num 357) dirty exists 2024-03-04T06:45:38.794 INFO:tasks.rados.rados.0.smithi137.stdout:1100: left oid 46 (ObjNum 357 snap 110 seq_num 357) 2024-03-04T06:45:38.802 INFO:tasks.rados.rados.0.smithi137.stdout:1102: expect (ObjNum 8 snap 0 seq_num 8) 2024-03-04T06:45:38.810 INFO:tasks.rados.rados.0.smithi137.stdout:1100: done (3 left) 2024-03-04T06:45:38.810 INFO:tasks.rados.rados.0.smithi137.stdout:1102: done (2 left) 2024-03-04T06:45:38.810 INFO:tasks.rados.rados.0.smithi137.stdout:1104: done (1 left) 2024-03-04T06:45:38.810 INFO:tasks.rados.rados.0.smithi137.stdout:1105: copy_from oid 25 from oid 3 current snap is 110 2024-03-04T06:45:38.810 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 110 2024-03-04T06:45:38.810 INFO:tasks.rados.rados.0.smithi137.stdout:1106: seq_num 359 ranges {3350528=417792,3768320=417792,4186112=385024} 2024-03-04T06:45:38.831 INFO:tasks.rados.rados.0.smithi137.stdout:1106: writing smithi13777483-1 from 3350528 to 3768320 tid 1 2024-03-04T06:45:38.833 INFO:tasks.rados.rados.0.smithi137.stdout:1106: writing smithi13777483-1 from 3768320 to 4186112 tid 2 2024-03-04T06:45:38.836 INFO:tasks.rados.rados.0.smithi137.stdout:1106: writing smithi13777483-1 from 4186112 to 4571136 tid 3 2024-03-04T06:45:38.836 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 110 2024-03-04T06:45:38.836 INFO:tasks.rados.rados.0.smithi137.stdout:1103: finishing copy_from racing read to smithi13777483-24 2024-03-04T06:45:38.836 INFO:tasks.rados.rados.0.smithi137.stdout:1103: finishing copy_from to smithi13777483-24 2024-03-04T06:45:38.836 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 222 (ObjNum 348 snap 110 seq_num 348) dirty exists 2024-03-04T06:45:38.837 INFO:tasks.rados.rados.0.smithi137.stdout:1105: finishing copy_from racing read to smithi13777483-25 2024-03-04T06:45:38.837 INFO:tasks.rados.rados.0.smithi137.stdout:1105: finishing copy_from to smithi13777483-25 2024-03-04T06:45:38.837 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 582 (ObjNum 353 snap 110 seq_num 353) dirty exists 2024-03-04T06:45:38.837 INFO:tasks.rados.rados.0.smithi137.stdout:1106: finishing write tid 1 to smithi13777483-1 2024-03-04T06:45:38.837 INFO:tasks.rados.rados.0.smithi137.stdout:1106: finishing write tid 2 to smithi13777483-1 2024-03-04T06:45:38.837 INFO:tasks.rados.rados.0.smithi137.stdout:1107: seq_num 360 ranges {0=434176,434176=704512,1138688=98304} 2024-03-04T06:45:38.839 INFO:tasks.rados.rados.0.smithi137.stdout:1107: writing smithi13777483-27 from 0 to 434176 tid 1 2024-03-04T06:45:38.843 INFO:tasks.rados.rados.0.smithi137.stdout:1107: writing smithi13777483-27 from 434176 to 1138688 tid 2 2024-03-04T06:45:38.844 INFO:tasks.rados.rados.0.smithi137.stdout:1107: writing smithi13777483-27 from 1138688 to 1236992 tid 3 2024-03-04T06:45:38.844 INFO:tasks.rados.rados.0.smithi137.stdout:1103: done (3 left) 2024-03-04T06:45:38.844 INFO:tasks.rados.rados.0.smithi137.stdout:1105: done (2 left) 2024-03-04T06:45:38.844 INFO:tasks.rados.rados.0.smithi137.stdout:1108: read oid 20 snap -1 2024-03-04T06:45:38.844 INFO:tasks.rados.rados.0.smithi137.stdout:1108: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:45:38.844 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 110 2024-03-04T06:45:38.844 INFO:tasks.rados.rados.0.smithi137.stdout:1106: finishing write tid 3 to smithi13777483-1 2024-03-04T06:45:38.844 INFO:tasks.rados.rados.0.smithi137.stdout:1109: seq_num 361 ranges {1523712=450560,1974272=581632,2555904=221184} 2024-03-04T06:45:38.855 INFO:tasks.rados.rados.0.smithi137.stdout:1109: writing smithi13777483-25 from 1523712 to 1974272 tid 1 2024-03-04T06:45:38.858 INFO:tasks.rados.rados.0.smithi137.stdout:1109: writing smithi13777483-25 from 1974272 to 2555904 tid 2 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:1109: writing smithi13777483-25 from 2555904 to 2777088 tid 3 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:1110: rollback oid 23 current snap is 110 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 23 to 101 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:1111: copy_from oid 10 from oid 3 current snap is 110 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:1106: finishing write tid 4 to smithi13777483-1 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:1106: finishing write tid 5 to smithi13777483-1 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:1106: oid 1 updating version 0 to 454 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:1106: oid 1 version 454 is already newer than 451 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:1106: oid 1 version 454 is already newer than 453 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:1106: oid 1 version 454 is already newer than 452 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 454 (ObjNum 359 snap 110 seq_num 359) dirty exists 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:1106: left oid 1 (ObjNum 359 snap 110 seq_num 359) 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:1107: finishing write tid 1 to smithi13777483-27 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:1106: done (5 left) 2024-03-04T06:45:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:1112: snap_remove snap 64 2024-03-04T06:45:38.930 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:38 smithi203 ceph-mon[85573]: Reconfiguring osd.5 (monmap changed)... 2024-03-04T06:45:38.931 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:38 smithi203 ceph-mon[85573]: Reconfiguring daemon osd.5 on smithi203 2024-03-04T06:45:38.931 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:38 smithi203 ceph-mon[85573]: osdmap e276: 8 total, 8 up, 8 in 2024-03-04T06:45:38.931 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:38 smithi203 ceph-mon[85573]: pgmap v87: 121 pgs: 121 active+clean; 312 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.9 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2024-03-04T06:45:38.931 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:45:39.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:38 smithi137 ceph-mon[88869]: Reconfiguring osd.5 (monmap changed)... 2024-03-04T06:45:39.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:38 smithi137 ceph-mon[88869]: Reconfiguring daemon osd.5 on smithi203 2024-03-04T06:45:39.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:38 smithi137 ceph-mon[88869]: osdmap e276: 8 total, 8 up, 8 in 2024-03-04T06:45:39.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:38 smithi137 ceph-mon[88869]: pgmap v87: 121 pgs: 121 active+clean; 312 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.9 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2024-03-04T06:45:39.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:45:39.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:38 smithi137 ceph-mon[91314]: Reconfiguring osd.5 (monmap changed)... 2024-03-04T06:45:39.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:38 smithi137 ceph-mon[91314]: Reconfiguring daemon osd.5 on smithi203 2024-03-04T06:45:39.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:38 smithi137 ceph-mon[91314]: osdmap e276: 8 total, 8 up, 8 in 2024-03-04T06:45:39.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:38 smithi137 ceph-mon[91314]: pgmap v87: 121 pgs: 121 active+clean; 312 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.9 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2024-03-04T06:45:39.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:45:39.802 INFO:tasks.rados.rados.0.smithi137.stdout:1112: done (5 left) 2024-03-04T06:45:39.802 INFO:tasks.rados.rados.0.smithi137.stdout:1113: copy_from oid 12 from oid 31 current snap is 110 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:1107: finishing write tid 2 to smithi13777483-27 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:1107: finishing write tid 3 to smithi13777483-27 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:1107: finishing write tid 4 to smithi13777483-27 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:1107: finishing write tid 5 to smithi13777483-27 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:1107: oid 27 updating version 0 to 798 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:1107: oid 27 updating version 798 to 799 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:1107: oid 27 updating version 799 to 801 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:1107: oid 27 version 801 is already newer than 800 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 801 (ObjNum 360 snap 110 seq_num 360) dirty exists 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:1107: left oid 27 (ObjNum 360 snap 110 seq_num 360) 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:1109: finishing write tid 1 to smithi13777483-25 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:1109: finishing write tid 2 to smithi13777483-25 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:1109: finishing write tid 3 to smithi13777483-25 2024-03-04T06:45:39.803 INFO:tasks.rados.rados.0.smithi137.stdout:1109: finishing write tid 4 to smithi13777483-25 2024-03-04T06:45:39.804 INFO:tasks.rados.rados.0.smithi137.stdout:1109: finishing write tid 5 to smithi13777483-25 2024-03-04T06:45:39.804 INFO:tasks.rados.rados.0.smithi137.stdout:1109: oid 25 updating version 0 to 761 2024-03-04T06:45:39.804 INFO:tasks.rados.rados.0.smithi137.stdout:1109: oid 25 updating version 761 to 764 2024-03-04T06:45:39.804 INFO:tasks.rados.rados.0.smithi137.stdout:1109: oid 25 version 764 is already newer than 763 2024-03-04T06:45:39.804 INFO:tasks.rados.rados.0.smithi137.stdout:1109: oid 25 version 764 is already newer than 762 2024-03-04T06:45:39.804 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 764 (ObjNum 361 snap 110 seq_num 361) dirty exists 2024-03-04T06:45:39.804 INFO:tasks.rados.rados.0.smithi137.stdout:1109: left oid 25 (ObjNum 361 snap 110 seq_num 361) 2024-03-04T06:45:39.804 INFO:tasks.rados.rados.0.smithi137.stdout:1108: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:45:39.883 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:39 smithi203 ceph-mon[85573]: osdmap e277: 8 total, 8 up, 8 in 2024-03-04T06:45:39.883 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:39.883 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:39.883 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:39 smithi203 ceph-mon[85573]: Reconfiguring osd.6 (monmap changed)... 2024-03-04T06:45:39.883 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-04T06:45:39.883 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:39.883 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:39 smithi203 ceph-mon[85573]: Reconfiguring daemon osd.6 on smithi203 2024-03-04T06:45:40.025 INFO:tasks.rados.rados.0.smithi137.stdout:1110: finishing rollback tid 0 to smithi13777483-23 2024-03-04T06:45:40.025 INFO:tasks.rados.rados.0.smithi137.stdout:1110: finishing rollback tid 1 to smithi13777483-23 2024-03-04T06:45:40.025 INFO:tasks.rados.rados.0.smithi137.stdout:1110: finishing rollback tid 2 to smithi13777483-23 2024-03-04T06:45:40.026 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 460 (ObjNum 237 snap 71 seq_num 237) dirty exists 2024-03-04T06:45:40.026 INFO:tasks.rados.rados.0.smithi137.stdout:1111: finishing copy_from racing read to smithi13777483-10 2024-03-04T06:45:40.026 INFO:tasks.rados.rados.0.smithi137.stdout:1107: done (5 left) 2024-03-04T06:45:40.026 INFO:tasks.rados.rados.0.smithi137.stdout:1108: done (4 left) 2024-03-04T06:45:40.026 INFO:tasks.rados.rados.0.smithi137.stdout:1109: done (3 left) 2024-03-04T06:45:40.026 INFO:tasks.rados.rados.0.smithi137.stdout:1110: done (2 left) 2024-03-04T06:45:40.026 INFO:tasks.rados.rados.0.smithi137.stdout:1114: snap_create 2024-03-04T06:45:40.026 INFO:tasks.rados.rados.0.smithi137.stdout:1111: finishing copy_from to smithi13777483-10 2024-03-04T06:45:40.026 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 582 (ObjNum 353 snap 110 seq_num 353) dirty exists 2024-03-04T06:45:40.026 INFO:tasks.rados.rados.0.smithi137.stdout:1113: finishing copy_from racing read to smithi13777483-12 2024-03-04T06:45:40.026 INFO:tasks.rados.rados.0.smithi137.stdout:1113: finishing copy_from to smithi13777483-12 2024-03-04T06:45:40.026 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 535 (ObjNum 354 snap 110 seq_num 354) dirty exists 2024-03-04T06:45:40.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[88869]: osdmap e277: 8 total, 8 up, 8 in 2024-03-04T06:45:40.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:40.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:40.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[88869]: Reconfiguring osd.6 (monmap changed)... 2024-03-04T06:45:40.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-04T06:45:40.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:40.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[88869]: Reconfiguring daemon osd.6 on smithi203 2024-03-04T06:45:40.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[91314]: osdmap e277: 8 total, 8 up, 8 in 2024-03-04T06:45:40.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:40.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:40.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[91314]: Reconfiguring osd.6 (monmap changed)... 2024-03-04T06:45:40.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-04T06:45:40.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:40.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:39 smithi137 ceph-mon[91314]: Reconfiguring daemon osd.6 on smithi203 2024-03-04T06:45:40.817 INFO:tasks.rados.rados.0.smithi137.stdout:1111: done (2 left) 2024-03-04T06:45:40.817 INFO:tasks.rados.rados.0.smithi137.stdout:1113: done (1 left) 2024-03-04T06:45:40.818 INFO:tasks.rados.rados.0.smithi137.stdout:1114: done (0 left) 2024-03-04T06:45:40.818 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 111 2024-03-04T06:45:40.818 INFO:tasks.rados.rados.0.smithi137.stdout:1115: seq_num 362 ranges {1056768=466944,1523712=466944,1990656=335872} 2024-03-04T06:45:40.825 INFO:tasks.rados.rados.0.smithi137.stdout:1115: writing smithi13777483-11 from 1056768 to 1523712 tid 1 2024-03-04T06:45:40.828 INFO:tasks.rados.rados.0.smithi137.stdout:1115: writing smithi13777483-11 from 1523712 to 1990656 tid 2 2024-03-04T06:45:40.831 INFO:tasks.rados.rados.0.smithi137.stdout:1115: writing smithi13777483-11 from 1990656 to 2326528 tid 3 2024-03-04T06:45:40.831 INFO:tasks.rados.rados.0.smithi137.stdout:1116: rmattr oid 30 current snap is 111 2024-03-04T06:45:40.832 INFO:tasks.rados.rados.0.smithi137.stdout:1117: delete oid 23 current snap is 111 2024-03-04T06:45:40.834 INFO:tasks.rados.rados.0.smithi137.stdout:1117: done (2 left) 2024-03-04T06:45:40.834 INFO:tasks.rados.rados.0.smithi137.stdout:1118: rollback oid 13 current snap is 111 2024-03-04T06:45:40.834 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 13 to 92 2024-03-04T06:45:40.834 INFO:tasks.rados.rados.0.smithi137.stdout:1119: copy_from oid 37 from oid 2 current snap is 111 2024-03-04T06:45:40.834 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 111 2024-03-04T06:45:40.834 INFO:tasks.rados.rados.0.smithi137.stdout:1120: seq_num 364 ranges {696320=499712,1196032=638976,1835008=163840} 2024-03-04T06:45:40.841 INFO:tasks.rados.rados.0.smithi137.stdout:1120: writing smithi13777483-42 from 696320 to 1196032 tid 1 2024-03-04T06:45:40.845 INFO:tasks.rados.rados.0.smithi137.stdout:1120: writing smithi13777483-42 from 1196032 to 1835008 tid 2 2024-03-04T06:45:40.847 INFO:tasks.rados.rados.0.smithi137.stdout:1120: writing smithi13777483-42 from 1835008 to 1998848 tid 3 2024-03-04T06:45:40.847 INFO:tasks.rados.rados.0.smithi137.stdout:1121: read oid 47 snap 100 2024-03-04T06:45:40.847 INFO:tasks.rados.rados.0.smithi137.stdout:1121: expect (ObjNum 298 snap 96 seq_num 298) 2024-03-04T06:45:40.847 INFO:tasks.rados.rados.0.smithi137.stdout:1122: delete oid 38 current snap is 111 2024-03-04T06:45:40.847 INFO:tasks.rados.rados.0.smithi137.stdout:1115: finishing write tid 1 to smithi13777483-11 2024-03-04T06:45:40.847 INFO:tasks.rados.rados.0.smithi137.stdout:1115: finishing write tid 2 to smithi13777483-11 2024-03-04T06:45:40.847 INFO:tasks.rados.rados.0.smithi137.stdout:1115: finishing write tid 3 to smithi13777483-11 2024-03-04T06:45:40.847 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 536 (ObjNum 239 snap 72 seq_num 239) dirty exists 2024-03-04T06:45:40.847 INFO:tasks.rados.rados.0.smithi137.stdout:1115: finishing write tid 4 to smithi13777483-11 2024-03-04T06:45:40.847 INFO:tasks.rados.rados.0.smithi137.stdout:1115: finishing write tid 5 to smithi13777483-11 2024-03-04T06:45:40.847 INFO:tasks.rados.rados.0.smithi137.stdout:1115: oid 11 updating version 0 to 215 2024-03-04T06:45:40.848 INFO:tasks.rados.rados.0.smithi137.stdout:1115: oid 11 version 215 is already newer than 212 2024-03-04T06:45:40.848 INFO:tasks.rados.rados.0.smithi137.stdout:1115: oid 11 version 215 is already newer than 213 2024-03-04T06:45:40.848 INFO:tasks.rados.rados.0.smithi137.stdout:1115: oid 11 version 215 is already newer than 214 2024-03-04T06:45:40.848 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 215 (ObjNum 362 snap 111 seq_num 362) dirty exists 2024-03-04T06:45:40.848 INFO:tasks.rados.rados.0.smithi137.stdout:1115: left oid 11 (ObjNum 362 snap 111 seq_num 362) 2024-03-04T06:45:40.848 INFO:tasks.rados.rados.0.smithi137.stdout:1118: finishing rollback tid 1 to smithi13777483-13 2024-03-04T06:45:40.848 INFO:tasks.rados.rados.0.smithi137.stdout:1118: finishing rollback tid 2 to smithi13777483-13 2024-03-04T06:45:40.848 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 813 (ObjNum 238 snap 72 seq_num 238) dirty exists 2024-03-04T06:45:40.848 INFO:tasks.rados.rados.0.smithi137.stdout:1120: finishing write tid 1 to smithi13777483-42 2024-03-04T06:45:40.848 INFO:tasks.rados.rados.0.smithi137.stdout:1119: finishing copy_from racing read to smithi13777483-37 2024-03-04T06:45:40.849 INFO:tasks.rados.rados.0.smithi137.stdout:1119: finishing copy_from to smithi13777483-37 2024-03-04T06:45:40.849 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 447 (ObjNum 336 snap 106 seq_num 336) dirty exists 2024-03-04T06:45:40.851 INFO:tasks.rados.rados.0.smithi137.stdout:1120: finishing write tid 2 to smithi13777483-42 2024-03-04T06:45:40.851 INFO:tasks.rados.rados.0.smithi137.stdout:1120: finishing write tid 3 to smithi13777483-42 2024-03-04T06:45:40.851 INFO:tasks.rados.rados.0.smithi137.stdout:1120: finishing write tid 4 to smithi13777483-42 2024-03-04T06:45:40.853 INFO:tasks.rados.rados.0.smithi137.stdout:1120: finishing write tid 5 to smithi13777483-42 2024-03-04T06:45:40.853 INFO:tasks.rados.rados.0.smithi137.stdout:1120: oid 42 updating version 0 to 817 2024-03-04T06:45:40.853 INFO:tasks.rados.rados.0.smithi137.stdout:1120: oid 42 version 817 is already newer than 815 2024-03-04T06:45:40.853 INFO:tasks.rados.rados.0.smithi137.stdout:1120: oid 42 updating version 817 to 818 2024-03-04T06:45:40.854 INFO:tasks.rados.rados.0.smithi137.stdout:1120: oid 42 version 818 is already newer than 816 2024-03-04T06:45:40.854 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 818 (ObjNum 364 snap 111 seq_num 364) dirty exists 2024-03-04T06:45:40.854 INFO:tasks.rados.rados.0.smithi137.stdout:1120: left oid 42 (ObjNum 364 snap 111 seq_num 364) 2024-03-04T06:45:40.856 INFO:tasks.rados.rados.0.smithi137.stdout:1121: expect (ObjNum 298 snap 96 seq_num 298) 2024-03-04T06:45:40.983 INFO:tasks.rados.rados.0.smithi137.stdout:1115: done (6 left) 2024-03-04T06:45:40.983 INFO:tasks.rados.rados.0.smithi137.stdout:1116: done (5 left) 2024-03-04T06:45:40.983 INFO:tasks.rados.rados.0.smithi137.stdout:1118: done (4 left) 2024-03-04T06:45:40.983 INFO:tasks.rados.rados.0.smithi137.stdout:1119: done (3 left) 2024-03-04T06:45:40.983 INFO:tasks.rados.rados.0.smithi137.stdout:1120: done (2 left) 2024-03-04T06:45:40.983 INFO:tasks.rados.rados.0.smithi137.stdout:1121: done (1 left) 2024-03-04T06:45:40.983 INFO:tasks.rados.rados.0.smithi137.stdout:1122: done (0 left) 2024-03-04T06:45:40.983 INFO:tasks.rados.rados.0.smithi137.stdout:1123: read oid 12 snap 103 2024-03-04T06:45:40.983 INFO:tasks.rados.rados.0.smithi137.stdout:1123: expect (ObjNum 322 snap 103 seq_num 322) 2024-03-04T06:45:40.983 INFO:tasks.rados.rados.0.smithi137.stdout:1124: read oid 26 snap -1 2024-03-04T06:45:40.983 INFO:tasks.rados.rados.0.smithi137.stdout:1124: expect (ObjNum 343 snap 109 seq_num 343) 2024-03-04T06:45:40.984 INFO:tasks.rados.rados.0.smithi137.stdout:1125: read oid 11 snap -1 2024-03-04T06:45:40.984 INFO:tasks.rados.rados.0.smithi137.stdout:1125: expect (ObjNum 362 snap 111 seq_num 362) 2024-03-04T06:45:40.984 INFO:tasks.rados.rados.0.smithi137.stdout:1126: read oid 45 snap -1 2024-03-04T06:45:40.984 INFO:tasks.rados.rados.0.smithi137.stdout:1126: expect (ObjNum 328 snap 103 seq_num 328) 2024-03-04T06:45:40.984 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 41 current snap is 111 2024-03-04T06:45:40.984 INFO:tasks.rados.rados.0.smithi137.stdout:1127: seq_num 366 ranges {1032192=532480,1564672=458752,2023424=344064} 2024-03-04T06:45:40.992 INFO:tasks.rados.rados.0.smithi137.stdout:1127: writing smithi13777483-41 from 1032192 to 1564672 tid 1 2024-03-04T06:45:40.995 INFO:tasks.rados.rados.0.smithi137.stdout:1127: writing smithi13777483-41 from 1564672 to 2023424 tid 2 2024-03-04T06:45:40.997 INFO:tasks.rados.rados.0.smithi137.stdout:1127: writing smithi13777483-41 from 2023424 to 2367488 tid 3 2024-03-04T06:45:40.997 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 111 2024-03-04T06:45:40.997 INFO:tasks.rados.rados.0.smithi137.stdout:1128: seq_num 367 ranges {0=548864,548864=737280,1286144=65536} 2024-03-04T06:45:41.000 INFO:tasks.rados.rados.0.smithi137.stdout:1128: writing smithi13777483-7 from 0 to 548864 tid 1 2024-03-04T06:45:41.004 INFO:tasks.rados.rados.0.smithi137.stdout:1128: writing smithi13777483-7 from 548864 to 1286144 tid 2 2024-03-04T06:45:41.005 INFO:tasks.rados.rados.0.smithi137.stdout:1128: writing smithi13777483-7 from 1286144 to 1351680 tid 3 2024-03-04T06:45:41.005 INFO:tasks.rados.rados.0.smithi137.stdout:1129: snap_create 2024-03-04T06:45:41.005 INFO:tasks.rados.rados.0.smithi137.stdout:1123: expect (ObjNum 322 snap 103 seq_num 322) 2024-03-04T06:45:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:1126: expect (ObjNum 328 snap 103 seq_num 328) 2024-03-04T06:45:41.039 INFO:tasks.rados.rados.0.smithi137.stdout:1125: expect (ObjNum 362 snap 111 seq_num 362) 2024-03-04T06:45:41.092 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:40 smithi203 ceph-mon[85573]: osdmap e278: 8 total, 8 up, 8 in 2024-03-04T06:45:41.092 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:40 smithi203 ceph-mon[85573]: pgmap v90: 121 pgs: 121 active+clean; 262 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.5 MiB/s wr, 32 op/s 2024-03-04T06:45:41.092 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:40 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:41.092 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:40 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:41.092 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:40 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-04T06:45:41.092 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:40 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:41.114 INFO:tasks.rados.rados.0.smithi137.stdout:1127: finishing write tid 1 to smithi13777483-41 2024-03-04T06:45:41.114 INFO:tasks.rados.rados.0.smithi137.stdout:1127: finishing write tid 2 to smithi13777483-41 2024-03-04T06:45:41.114 INFO:tasks.rados.rados.0.smithi137.stdout:1127: finishing write tid 3 to smithi13777483-41 2024-03-04T06:45:41.114 INFO:tasks.rados.rados.0.smithi137.stdout:1127: finishing write tid 4 to smithi13777483-41 2024-03-04T06:45:41.114 INFO:tasks.rados.rados.0.smithi137.stdout:1127: finishing write tid 5 to smithi13777483-41 2024-03-04T06:45:41.114 INFO:tasks.rados.rados.0.smithi137.stdout:1127: oid 41 updating version 0 to 247 2024-03-04T06:45:41.114 INFO:tasks.rados.rados.0.smithi137.stdout:1127: oid 41 version 247 is already newer than 246 2024-03-04T06:45:41.114 INFO:tasks.rados.rados.0.smithi137.stdout:1127: oid 41 updating version 247 to 248 2024-03-04T06:45:41.115 INFO:tasks.rados.rados.0.smithi137.stdout:1127: oid 41 updating version 248 to 249 2024-03-04T06:45:41.115 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 249 (ObjNum 366 snap 111 seq_num 366) dirty exists 2024-03-04T06:45:41.115 INFO:tasks.rados.rados.0.smithi137.stdout:1127: left oid 41 (ObjNum 366 snap 111 seq_num 366) 2024-03-04T06:45:41.115 INFO:tasks.rados.rados.0.smithi137.stdout:1128: finishing write tid 1 to smithi13777483-7 2024-03-04T06:45:41.115 INFO:tasks.rados.rados.0.smithi137.stdout:1124: expect (ObjNum 343 snap 109 seq_num 343) 2024-03-04T06:45:41.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:40 smithi137 ceph-mon[88869]: osdmap e278: 8 total, 8 up, 8 in 2024-03-04T06:45:41.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:40 smithi137 ceph-mon[88869]: pgmap v90: 121 pgs: 121 active+clean; 262 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.5 MiB/s wr, 32 op/s 2024-03-04T06:45:41.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:40 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:41.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:40 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:41.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:40 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-04T06:45:41.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:40 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:41.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:40 smithi137 ceph-mon[91314]: osdmap e278: 8 total, 8 up, 8 in 2024-03-04T06:45:41.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:40 smithi137 ceph-mon[91314]: pgmap v90: 121 pgs: 121 active+clean; 262 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.5 MiB/s wr, 32 op/s 2024-03-04T06:45:41.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:40 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:41.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:40 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:41.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:40 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-04T06:45:41.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:40 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:41.409 INFO:tasks.rados.rados.0.smithi137.stdout:1128: finishing write tid 2 to smithi13777483-7 2024-03-04T06:45:41.410 INFO:tasks.rados.rados.0.smithi137.stdout:1128: finishing write tid 3 to smithi13777483-7 2024-03-04T06:45:41.410 INFO:tasks.rados.rados.0.smithi137.stdout:1128: finishing write tid 4 to smithi13777483-7 2024-03-04T06:45:41.410 INFO:tasks.rados.rados.0.smithi137.stdout:1128: finishing write tid 5 to smithi13777483-7 2024-03-04T06:45:41.410 INFO:tasks.rados.rados.0.smithi137.stdout:1128: oid 7 updating version 0 to 219 2024-03-04T06:45:41.410 INFO:tasks.rados.rados.0.smithi137.stdout:1128: oid 7 version 219 is already newer than 216 2024-03-04T06:45:41.410 INFO:tasks.rados.rados.0.smithi137.stdout:1128: oid 7 version 219 is already newer than 218 2024-03-04T06:45:41.410 INFO:tasks.rados.rados.0.smithi137.stdout:1128: oid 7 version 219 is already newer than 217 2024-03-04T06:45:41.410 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 219 (ObjNum 367 snap 111 seq_num 367) dirty exists 2024-03-04T06:45:41.410 INFO:tasks.rados.rados.0.smithi137.stdout:1128: left oid 7 (ObjNum 367 snap 111 seq_num 367) 2024-03-04T06:45:41.818 INFO:tasks.rados.rados.0.smithi137.stdout:1123: done (6 left) 2024-03-04T06:45:41.818 INFO:tasks.rados.rados.0.smithi137.stdout:1124: done (5 left) 2024-03-04T06:45:41.818 INFO:tasks.rados.rados.0.smithi137.stdout:1125: done (4 left) 2024-03-04T06:45:41.819 INFO:tasks.rados.rados.0.smithi137.stdout:1126: done (3 left) 2024-03-04T06:45:41.819 INFO:tasks.rados.rados.0.smithi137.stdout:1127: done (2 left) 2024-03-04T06:45:41.819 INFO:tasks.rados.rados.0.smithi137.stdout:1128: done (1 left) 2024-03-04T06:45:41.819 INFO:tasks.rados.rados.0.smithi137.stdout:1129: done (0 left) 2024-03-04T06:45:41.819 INFO:tasks.rados.rados.0.smithi137.stdout:1130: read oid 39 snap -1 2024-03-04T06:45:41.819 INFO:tasks.rados.rados.0.smithi137.stdout:1130: expect (ObjNum 321 snap 103 seq_num 321) 2024-03-04T06:45:41.819 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 112 2024-03-04T06:45:41.819 INFO:tasks.rados.rados.0.smithi137.stdout:1131: seq_num 368 ranges {3039232=573440,3612672=622592,4235264=180224} 2024-03-04T06:45:41.838 INFO:tasks.rados.rados.0.smithi137.stdout:1131: writing smithi13777483-31 from 3039232 to 3612672 tid 1 2024-03-04T06:45:41.842 INFO:tasks.rados.rados.0.smithi137.stdout:1131: writing smithi13777483-31 from 3612672 to 4235264 tid 2 2024-03-04T06:45:41.844 INFO:tasks.rados.rados.0.smithi137.stdout:1131: writing smithi13777483-31 from 4235264 to 4415488 tid 3 2024-03-04T06:45:41.844 INFO:tasks.rados.rados.0.smithi137.stdout:1132: read oid 20 snap -1 2024-03-04T06:45:41.844 INFO:tasks.rados.rados.0.smithi137.stdout:1132: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:45:41.844 INFO:tasks.rados.rados.0.smithi137.stdout:1133: setattr oid 1 current snap is 112 2024-03-04T06:45:41.844 INFO:tasks.rados.rados.0.smithi137.stdout:1130: expect (ObjNum 321 snap 103 seq_num 321) 2024-03-04T06:45:41.914 INFO:tasks.rados.rados.0.smithi137.stdout:1131: finishing write tid 1 to smithi13777483-31 2024-03-04T06:45:41.914 INFO:tasks.rados.rados.0.smithi137.stdout:1131: finishing write tid 2 to smithi13777483-31 2024-03-04T06:45:41.914 INFO:tasks.rados.rados.0.smithi137.stdout:1131: finishing write tid 3 to smithi13777483-31 2024-03-04T06:45:41.914 INFO:tasks.rados.rados.0.smithi137.stdout:1131: finishing write tid 4 to smithi13777483-31 2024-03-04T06:45:41.914 INFO:tasks.rados.rados.0.smithi137.stdout:1131: finishing write tid 5 to smithi13777483-31 2024-03-04T06:45:41.914 INFO:tasks.rados.rados.0.smithi137.stdout:1131: oid 31 updating version 0 to 549 2024-03-04T06:45:41.914 INFO:tasks.rados.rados.0.smithi137.stdout:1131: oid 31 updating version 549 to 552 2024-03-04T06:45:41.914 INFO:tasks.rados.rados.0.smithi137.stdout:1131: oid 31 version 552 is already newer than 550 2024-03-04T06:45:41.915 INFO:tasks.rados.rados.0.smithi137.stdout:1131: oid 31 version 552 is already newer than 551 2024-03-04T06:45:41.915 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 552 (ObjNum 368 snap 112 seq_num 368) dirty exists 2024-03-04T06:45:41.915 INFO:tasks.rados.rados.0.smithi137.stdout:1131: left oid 31 (ObjNum 368 snap 112 seq_num 368) 2024-03-04T06:45:41.915 INFO:tasks.rados.rados.0.smithi137.stdout:1132: expect (ObjNum 169 snap 47 seq_num 169) 2024-03-04T06:45:41.944 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:41 smithi203 ceph-mon[85573]: Reconfiguring osd.7 (monmap changed)... 2024-03-04T06:45:41.944 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:41 smithi203 ceph-mon[85573]: Reconfiguring daemon osd.7 on smithi203 2024-03-04T06:45:41.944 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:41 smithi203 ceph-mon[85573]: osdmap e279: 8 total, 8 up, 8 in 2024-03-04T06:45:42.130 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 455 (ObjNum 359 snap 110 seq_num 359) dirty exists 2024-03-04T06:45:42.130 INFO:tasks.rados.rados.0.smithi137.stdout:1130: done (3 left) 2024-03-04T06:45:42.130 INFO:tasks.rados.rados.0.smithi137.stdout:1131: done (2 left) 2024-03-04T06:45:42.130 INFO:tasks.rados.rados.0.smithi137.stdout:1132: done (1 left) 2024-03-04T06:45:42.130 INFO:tasks.rados.rados.0.smithi137.stdout:1133: done (0 left) 2024-03-04T06:45:42.130 INFO:tasks.rados.rados.0.smithi137.stdout:1134: setattr oid 36 current snap is 112 2024-03-04T06:45:42.131 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 43 current snap is 112 2024-03-04T06:45:42.131 INFO:tasks.rados.rados.0.smithi137.stdout:1135: seq_num 369 ranges {1245184=589824,1835008=507904,2342912=294912} 2024-03-04T06:45:42.141 INFO:tasks.rados.rados.0.smithi137.stdout:1135: writing smithi13777483-43 from 1245184 to 1835008 tid 1 2024-03-04T06:45:42.144 INFO:tasks.rados.rados.0.smithi137.stdout:1135: writing smithi13777483-43 from 1835008 to 2342912 tid 2 2024-03-04T06:45:42.146 INFO:tasks.rados.rados.0.smithi137.stdout:1135: writing smithi13777483-43 from 2342912 to 2637824 tid 3 2024-03-04T06:45:42.146 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 112 2024-03-04T06:45:42.146 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 330 (ObjNum 270 snap 87 seq_num 270) dirty exists 2024-03-04T06:45:42.146 INFO:tasks.rados.rados.0.smithi137.stdout:1136: seq_num 370 ranges {4571136=606208,5177344=794624,5971968=8192} 2024-03-04T06:45:42.173 INFO:tasks.rados.rados.0.smithi137.stdout:1136: writing smithi13777483-20 from 4571136 to 5177344 tid 1 2024-03-04T06:45:42.178 INFO:tasks.rados.rados.0.smithi137.stdout:1136: writing smithi13777483-20 from 5177344 to 5971968 tid 2 2024-03-04T06:45:42.178 INFO:tasks.rados.rados.0.smithi137.stdout:1136: writing smithi13777483-20 from 5971968 to 5980160 tid 3 2024-03-04T06:45:42.178 INFO:tasks.rados.rados.0.smithi137.stdout:1134: done (2 left) 2024-03-04T06:45:42.178 INFO:tasks.rados.rados.0.smithi137.stdout:1137: rollback oid 30 current snap is 112 2024-03-04T06:45:42.178 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 30 to 96 2024-03-04T06:45:42.179 INFO:tasks.rados.rados.0.smithi137.stdout:1135: finishing write tid 1 to smithi13777483-43 2024-03-04T06:45:42.179 INFO:tasks.rados.rados.0.smithi137.stdout:1135: finishing write tid 2 to smithi13777483-43 2024-03-04T06:45:42.179 INFO:tasks.rados.rados.0.smithi137.stdout:1135: finishing write tid 3 to smithi13777483-43 2024-03-04T06:45:42.179 INFO:tasks.rados.rados.0.smithi137.stdout:1135: finishing write tid 4 to smithi13777483-43 2024-03-04T06:45:42.179 INFO:tasks.rados.rados.0.smithi137.stdout:1138: snap_remove snap 103 2024-03-04T06:45:42.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:41 smithi137 ceph-mon[88869]: Reconfiguring osd.7 (monmap changed)... 2024-03-04T06:45:42.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:41 smithi137 ceph-mon[88869]: Reconfiguring daemon osd.7 on smithi203 2024-03-04T06:45:42.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:41 smithi137 ceph-mon[88869]: osdmap e279: 8 total, 8 up, 8 in 2024-03-04T06:45:42.194 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:41 smithi137 ceph-mon[91314]: Reconfiguring osd.7 (monmap changed)... 2024-03-04T06:45:42.194 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:41 smithi137 ceph-mon[91314]: Reconfiguring daemon osd.7 on smithi203 2024-03-04T06:45:42.195 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:41 smithi137 ceph-mon[91314]: osdmap e279: 8 total, 8 up, 8 in 2024-03-04T06:45:42.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:42 smithi203 ceph-mon[85573]: osdmap e280: 8 total, 8 up, 8 in 2024-03-04T06:45:42.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:42 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:42.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:42 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:42.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:42 smithi203 ceph-mon[85573]: Reconfiguring mds.b (monmap changed)... 2024-03-04T06:45:42.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:42 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:45:42.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:42 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:42.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:42 smithi203 ceph-mon[85573]: Reconfiguring daemon mds.b on smithi203 2024-03-04T06:45:42.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:42 smithi203 ceph-mon[85573]: pgmap v93: 121 pgs: 121 active+clean; 262 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.5 MiB/s wr, 32 op/s 2024-03-04T06:45:43.048 INFO:tasks.rados.rados.0.smithi137.stdout:1138: done (3 left) 2024-03-04T06:45:43.048 INFO:tasks.rados.rados.0.smithi137.stdout:1139: delete oid 47 current snap is 112 2024-03-04T06:45:43.048 INFO:tasks.rados.rados.0.smithi137.stdout:1135: finishing write tid 5 to smithi13777483-43 2024-03-04T06:45:43.048 INFO:tasks.rados.rados.0.smithi137.stdout:1135: oid 43 updating version 0 to 271 2024-03-04T06:45:43.048 INFO:tasks.rados.rados.0.smithi137.stdout:1135: oid 43 updating version 271 to 272 2024-03-04T06:45:43.048 INFO:tasks.rados.rados.0.smithi137.stdout:1135: oid 43 updating version 272 to 274 2024-03-04T06:45:43.048 INFO:tasks.rados.rados.0.smithi137.stdout:1135: oid 43 version 274 is already newer than 273 2024-03-04T06:45:43.048 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 274 (ObjNum 369 snap 112 seq_num 369) dirty exists 2024-03-04T06:45:43.048 INFO:tasks.rados.rados.0.smithi137.stdout:1135: left oid 43 (ObjNum 369 snap 112 seq_num 369) 2024-03-04T06:45:43.048 INFO:tasks.rados.rados.0.smithi137.stdout:1136: finishing write tid 1 to smithi13777483-20 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:1136: finishing write tid 2 to smithi13777483-20 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:1136: finishing write tid 3 to smithi13777483-20 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:1136: finishing write tid 4 to smithi13777483-20 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:1136: finishing write tid 5 to smithi13777483-20 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:1136: oid 20 updating version 0 to 470 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:1136: oid 20 updating version 470 to 471 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:1136: oid 20 updating version 471 to 472 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:1136: oid 20 updating version 472 to 473 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 473 (ObjNum 370 snap 112 seq_num 370) dirty exists 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:1136: left oid 20 (ObjNum 370 snap 112 seq_num 370) 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:1137: finishing rollback tid 0 to smithi13777483-30 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:1137: finishing rollback tid 1 to smithi13777483-30 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:1137: finishing rollback tid 2 to smithi13777483-30 2024-03-04T06:45:43.049 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 539 (ObjNum 239 snap 72 seq_num 239) dirty exists 2024-03-04T06:45:43.055 INFO:tasks.rados.rados.0.smithi137.stdout:1135: done (3 left) 2024-03-04T06:45:43.055 INFO:tasks.rados.rados.0.smithi137.stdout:1136: done (2 left) 2024-03-04T06:45:43.055 INFO:tasks.rados.rados.0.smithi137.stdout:1137: done (1 left) 2024-03-04T06:45:43.055 INFO:tasks.rados.rados.0.smithi137.stdout:1139: done (0 left) 2024-03-04T06:45:43.055 INFO:tasks.rados.rados.0.smithi137.stdout:1140: snap_create 2024-03-04T06:45:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[88869]: osdmap e280: 8 total, 8 up, 8 in 2024-03-04T06:45:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[88869]: Reconfiguring mds.b (monmap changed)... 2024-03-04T06:45:43.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:45:43.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:43.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[88869]: Reconfiguring daemon mds.b on smithi203 2024-03-04T06:45:43.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[88869]: pgmap v93: 121 pgs: 121 active+clean; 262 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.5 MiB/s wr, 32 op/s 2024-03-04T06:45:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[91314]: osdmap e280: 8 total, 8 up, 8 in 2024-03-04T06:45:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[91314]: Reconfiguring mds.b (monmap changed)... 2024-03-04T06:45:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:45:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[91314]: Reconfiguring daemon mds.b on smithi203 2024-03-04T06:45:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:42 smithi137 ceph-mon[91314]: pgmap v93: 121 pgs: 121 active+clean; 262 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.5 MiB/s wr, 32 op/s 2024-03-04T06:45:44.054 INFO:tasks.rados.rados.0.smithi137.stdout:1140: done (0 left) 2024-03-04T06:45:44.054 INFO:tasks.rados.rados.0.smithi137.stdout:1141: snap_create 2024-03-04T06:45:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: osdmap e281: 8 total, 8 up, 8 in 2024-03-04T06:45:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:45:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-04T06:45:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-03-04T06:45:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-04T06:45:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-03-04T06:45:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-04T06:45:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-03-04T06:45:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-04T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: osdmap e281: 8 total, 8 up, 8 in 2024-03-04T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-04T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-03-04T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-04T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-03-04T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-04T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-03-04T06:45:44.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:44.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:44.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-04T06:45:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: osdmap e281: 8 total, 8 up, 8 in 2024-03-04T06:45:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:45:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-04T06:45:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-03-04T06:45:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-04T06:45:44.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-03-04T06:45:44.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-04T06:45:44.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-03-04T06:45:44.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:44.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:44.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-04T06:45:44.856 INFO:tasks.rados.rados.0.smithi137.stdout:1141: done (0 left) 2024-03-04T06:45:44.856 INFO:tasks.rados.rados.0.smithi137.stdout:1142: rollback oid 2 current snap is 114 2024-03-04T06:45:44.857 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 2 to 105 2024-03-04T06:45:44.857 INFO:tasks.rados.rados.0.smithi137.stdout:1143: read oid 21 snap -1 2024-03-04T06:45:44.857 INFO:tasks.rados.rados.0.smithi137.stdout:1143: expect (ObjNum 296 snap 95 seq_num 296) 2024-03-04T06:45:44.857 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 114 2024-03-04T06:45:44.857 INFO:tasks.rados.rados.0.smithi137.stdout:1144: seq_num 372 ranges {1228800=638976,1867776=565248,2433024=237568} 2024-03-04T06:45:44.867 INFO:tasks.rados.rados.0.smithi137.stdout:1144: writing smithi13777483-44 from 1228800 to 1867776 tid 1 2024-03-04T06:45:44.870 INFO:tasks.rados.rados.0.smithi137.stdout:1144: writing smithi13777483-44 from 1867776 to 2433024 tid 2 2024-03-04T06:45:44.872 INFO:tasks.rados.rados.0.smithi137.stdout:1144: writing smithi13777483-44 from 2433024 to 2670592 tid 3 2024-03-04T06:45:44.872 INFO:tasks.rados.rados.0.smithi137.stdout:1145: delete oid 1 current snap is 114 2024-03-04T06:45:44.872 INFO:tasks.rados.rados.0.smithi137.stdout:1142: finishing rollback tid 0 to smithi13777483-2 2024-03-04T06:45:44.872 INFO:tasks.rados.rados.0.smithi137.stdout:1142: finishing rollback tid 1 to smithi13777483-2 2024-03-04T06:45:44.872 INFO:tasks.rados.rados.0.smithi137.stdout:1142: finishing rollback tid 2 to smithi13777483-2 2024-03-04T06:45:44.872 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 458 (ObjNum 219 snap 63 seq_num 219) dirty exists 2024-03-04T06:45:44.872 INFO:tasks.rados.rados.0.smithi137.stdout:1143: expect (ObjNum 296 snap 95 seq_num 296) 2024-03-04T06:45:44.975 INFO:tasks.rados.rados.0.smithi137.stdout:1144: finishing write tid 1 to smithi13777483-44 2024-03-04T06:45:44.975 INFO:tasks.rados.rados.0.smithi137.stdout:1144: finishing write tid 2 to smithi13777483-44 2024-03-04T06:45:44.975 INFO:tasks.rados.rados.0.smithi137.stdout:1144: finishing write tid 3 to smithi13777483-44 2024-03-04T06:45:44.975 INFO:tasks.rados.rados.0.smithi137.stdout:1144: finishing write tid 4 to smithi13777483-44 2024-03-04T06:45:44.975 INFO:tasks.rados.rados.0.smithi137.stdout:1144: finishing write tid 5 to smithi13777483-44 2024-03-04T06:45:44.975 INFO:tasks.rados.rados.0.smithi137.stdout:1144: oid 44 updating version 0 to 438 2024-03-04T06:45:44.975 INFO:tasks.rados.rados.0.smithi137.stdout:1144: oid 44 version 438 is already newer than 435 2024-03-04T06:45:44.975 INFO:tasks.rados.rados.0.smithi137.stdout:1144: oid 44 version 438 is already newer than 437 2024-03-04T06:45:44.975 INFO:tasks.rados.rados.0.smithi137.stdout:1144: oid 44 version 438 is already newer than 436 2024-03-04T06:45:44.975 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 438 (ObjNum 372 snap 114 seq_num 372) dirty exists 2024-03-04T06:45:44.975 INFO:tasks.rados.rados.0.smithi137.stdout:1144: left oid 44 (ObjNum 372 snap 114 seq_num 372) 2024-03-04T06:45:44.975 INFO:tasks.rados.rados.0.smithi137.stdout:1142: done (3 left) 2024-03-04T06:45:44.976 INFO:tasks.rados.rados.0.smithi137.stdout:1143: done (2 left) 2024-03-04T06:45:44.976 INFO:tasks.rados.rados.0.smithi137.stdout:1144: done (1 left) 2024-03-04T06:45:44.976 INFO:tasks.rados.rados.0.smithi137.stdout:1145: done (0 left) 2024-03-04T06:45:44.976 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 114 2024-03-04T06:45:44.976 INFO:tasks.rados.rados.0.smithi137.stdout:1146: seq_num 374 ranges {1875968=671744,2547712=778240,3325952=24576} 2024-03-04T06:45:44.988 INFO:tasks.rados.rados.0.smithi137.stdout:1146: writing smithi13777483-49 from 1875968 to 2547712 tid 1 2024-03-04T06:45:44.992 INFO:tasks.rados.rados.0.smithi137.stdout:1146: writing smithi13777483-49 from 2547712 to 3325952 tid 2 2024-03-04T06:45:44.992 INFO:tasks.rados.rados.0.smithi137.stdout:1146: writing smithi13777483-49 from 3325952 to 3350528 tid 3 2024-03-04T06:45:44.993 INFO:tasks.rados.rados.0.smithi137.stdout:1147: snap_remove snap 72 2024-03-04T06:45:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[88869]: Upgrade: Setting container_image for all mon 2024-03-04T06:45:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[88869]: Upgrade: Setting container_image for all crash 2024-03-04T06:45:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-04T06:45:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[88869]: Upgrade: osd.0 is safe to restart 2024-03-04T06:45:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[88869]: osdmap e282: 8 total, 8 up, 8 in 2024-03-04T06:45:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[88869]: pgmap v96: 121 pgs: 121 active+clean; 283 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 28 op/s 2024-03-04T06:45:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[88869]: osdmap e283: 8 total, 8 up, 8 in 2024-03-04T06:45:45.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[91314]: Upgrade: Setting container_image for all mon 2024-03-04T06:45:45.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[91314]: Upgrade: Setting container_image for all crash 2024-03-04T06:45:45.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-04T06:45:45.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[91314]: Upgrade: osd.0 is safe to restart 2024-03-04T06:45:45.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[91314]: osdmap e282: 8 total, 8 up, 8 in 2024-03-04T06:45:45.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[91314]: pgmap v96: 121 pgs: 121 active+clean; 283 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 28 op/s 2024-03-04T06:45:45.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-mon[91314]: osdmap e283: 8 total, 8 up, 8 in 2024-03-04T06:45:45.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:45 smithi203 ceph-mon[85573]: Upgrade: Setting container_image for all mon 2024-03-04T06:45:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:45 smithi203 ceph-mon[85573]: Upgrade: Setting container_image for all crash 2024-03-04T06:45:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:45 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-04T06:45:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:45 smithi203 ceph-mon[85573]: Upgrade: osd.0 is safe to restart 2024-03-04T06:45:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:45 smithi203 ceph-mon[85573]: osdmap e282: 8 total, 8 up, 8 in 2024-03-04T06:45:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:45 smithi203 ceph-mon[85573]: pgmap v96: 121 pgs: 121 active+clean; 283 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 28 op/s 2024-03-04T06:45:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:45 smithi203 ceph-mon[85573]: osdmap e283: 8 total, 8 up, 8 in 2024-03-04T06:45:45.768 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:45:45.768 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:45:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:45:45] "GET /metrics HTTP/1.1" 200 35929 "" "Prometheus/2.43.0" 2024-03-04T06:45:45.855 INFO:tasks.rados.rados.0.smithi137.stdout:1147: done (1 left) 2024-03-04T06:45:45.856 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 114 2024-03-04T06:45:45.856 INFO:tasks.rados.rados.0.smithi137.stdout:1146: finishing write tid 1 to smithi13777483-49 2024-03-04T06:45:45.856 INFO:tasks.rados.rados.0.smithi137.stdout:1148: seq_num 375 ranges {1859584=688128,2547712=663552,3211264=139264} 2024-03-04T06:45:45.871 INFO:tasks.rados.rados.0.smithi137.stdout:1148: writing smithi13777483-39 from 1859584 to 2547712 tid 1 2024-03-04T06:45:45.876 INFO:tasks.rados.rados.0.smithi137.stdout:1148: writing smithi13777483-39 from 2547712 to 3211264 tid 2 2024-03-04T06:45:45.877 INFO:tasks.rados.rados.0.smithi137.stdout:1148: writing smithi13777483-39 from 3211264 to 3350528 tid 3 2024-03-04T06:45:45.877 INFO:tasks.rados.rados.0.smithi137.stdout:1149: setattr oid 30 current snap is 114 2024-03-04T06:45:45.877 INFO:tasks.rados.rados.0.smithi137.stdout:1146: finishing write tid 2 to smithi13777483-49 2024-03-04T06:45:45.877 INFO:tasks.rados.rados.0.smithi137.stdout:1146: finishing write tid 3 to smithi13777483-49 2024-03-04T06:45:45.878 INFO:tasks.rados.rados.0.smithi137.stdout:1146: finishing write tid 4 to smithi13777483-49 2024-03-04T06:45:45.878 INFO:tasks.rados.rados.0.smithi137.stdout:1146: finishing write tid 5 to smithi13777483-49 2024-03-04T06:45:45.878 INFO:tasks.rados.rados.0.smithi137.stdout:1146: oid 49 updating version 0 to 561 2024-03-04T06:45:45.878 INFO:tasks.rados.rados.0.smithi137.stdout:1146: oid 49 updating version 561 to 563 2024-03-04T06:45:45.878 INFO:tasks.rados.rados.0.smithi137.stdout:1146: oid 49 version 563 is already newer than 562 2024-03-04T06:45:45.878 INFO:tasks.rados.rados.0.smithi137.stdout:1146: oid 49 version 563 is already newer than 560 2024-03-04T06:45:45.878 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 563 (ObjNum 374 snap 114 seq_num 374) dirty exists 2024-03-04T06:45:45.878 INFO:tasks.rados.rados.0.smithi137.stdout:1146: left oid 49 (ObjNum 374 snap 114 seq_num 374) 2024-03-04T06:45:45.881 INFO:tasks.rados.rados.0.smithi137.stdout:1148: finishing write tid 1 to smithi13777483-39 2024-03-04T06:45:45.882 INFO:tasks.rados.rados.0.smithi137.stdout:1146: done (2 left) 2024-03-04T06:45:45.882 INFO:tasks.rados.rados.0.smithi137.stdout:1150: copy_from oid 47 from oid 9 current snap is 114 2024-03-04T06:45:45.882 INFO:tasks.rados.rados.0.smithi137.stdout:1151: snap_create 2024-03-04T06:45:45.883 INFO:tasks.rados.rados.0.smithi137.stdout:1148: finishing write tid 2 to smithi13777483-39 2024-03-04T06:45:45.883 INFO:tasks.rados.rados.0.smithi137.stdout:1148: finishing write tid 3 to smithi13777483-39 2024-03-04T06:45:45.883 INFO:tasks.rados.rados.0.smithi137.stdout:1148: finishing write tid 4 to smithi13777483-39 2024-03-04T06:45:45.884 INFO:tasks.rados.rados.0.smithi137.stdout:1148: finishing write tid 5 to smithi13777483-39 2024-03-04T06:45:45.884 INFO:tasks.rados.rados.0.smithi137.stdout:1148: oid 39 updating version 0 to 262 2024-03-04T06:45:45.885 INFO:tasks.rados.rados.0.smithi137.stdout:1148: oid 39 version 262 is already newer than 260 2024-03-04T06:45:45.885 INFO:tasks.rados.rados.0.smithi137.stdout:1148: oid 39 version 262 is already newer than 261 2024-03-04T06:45:45.885 INFO:tasks.rados.rados.0.smithi137.stdout:1148: oid 39 version 262 is already newer than 259 2024-03-04T06:45:45.885 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 262 (ObjNum 375 snap 114 seq_num 375) dirty exists 2024-03-04T06:45:45.885 INFO:tasks.rados.rados.0.smithi137.stdout:1148: left oid 39 (ObjNum 375 snap 114 seq_num 375) 2024-03-04T06:45:45.886 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 540 (ObjNum 239 snap 72 seq_num 239) dirty exists 2024-03-04T06:45:45.890 INFO:tasks.rados.rados.0.smithi137.stdout:1150: finishing copy_from racing read to smithi13777483-47 2024-03-04T06:45:45.891 INFO:tasks.rados.rados.0.smithi137.stdout:1150: finishing copy_from to smithi13777483-47 2024-03-04T06:45:45.891 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 557 (ObjNum 335 snap 106 seq_num 335) dirty exists 2024-03-04T06:45:46.113 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:45:46.113 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (5m) 47s ago 6m 27.7M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:45:46.113 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (6m) 31s ago 6m 87.9M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:45:46.113 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (7m) 47s ago 7m 17.9M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:45:46.113 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (7m) 31s ago 7m 18.6M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:45:46.113 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (92s) 31s ago 11m 448M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:45:46.113 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (2m) 47s ago 12m 492M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:45:46.113 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (76s) 47s ago 13m 39.1M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:45:46.113 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (37s) 31s ago 11m 29.9M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:45:46.113 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (52s) 47s ago 11m 22.7M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:45:46.113 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (6m) 47s ago 5m 16.5M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:45:46.113 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (5m) 31s ago 5m 15.6M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:45:46.113 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (10m) 47s ago 10m 178M 2480M 18.2.1-696-g5cc7a767 540557f94930 732ea50ff558 2024-03-04T06:45:46.114 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (10m) 47s ago 10m 180M 2480M 18.2.1-696-g5cc7a767 540557f94930 708139c858a7 2024-03-04T06:45:46.114 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (9m) 47s ago 9m 183M 2480M 18.2.1-696-g5cc7a767 540557f94930 b247adf81a73 2024-03-04T06:45:46.114 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (9m) 47s ago 9m 101M 2480M 18.2.1-696-g5cc7a767 540557f94930 afdbc25c9fba 2024-03-04T06:45:46.114 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (9m) 31s ago 9m 212M 2480M 18.2.1-696-g5cc7a767 540557f94930 d4841ffd0747 2024-03-04T06:45:46.114 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (8m) 31s ago 8m 225M 2480M 18.2.1-696-g5cc7a767 540557f94930 81d21771e157 2024-03-04T06:45:46.114 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (8m) 31s ago 8m 109M 2480M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:45:46.114 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (7m) 31s ago 7m 136M 2480M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:45:46.114 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (97s) 31s ago 7m 49.8M - 2.43.0 a07b618ecd1d 6a88bdd1023c 2024-03-04T06:45:46.512 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:45:46.512 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:45:46.512 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:45:46.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:45:46.512 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:45:46.512 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:45:46.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:45:46.512 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:45:46.512 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 8 2024-03-04T06:45:46.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:45:46.512 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:45:46.512 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:45:46.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:45:46.513 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:45:46.513 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 10, 2024-03-04T06:45:46.513 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 5 2024-03-04T06:45:46.513 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:45:46.513 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:45:46.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:46 smithi137 ceph-mon[88869]: Upgrade: Updating osd.0 2024-03-04T06:45:46.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:46 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:46.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:46 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-04T06:45:46.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:46 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:46.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:46 smithi137 ceph-mon[88869]: Deploying daemon osd.0 on smithi137 2024-03-04T06:45:46.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:46 smithi137 ceph-mon[88869]: osdmap e284: 8 total, 8 up, 8 in 2024-03-04T06:45:46.514 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:46 smithi137 ceph-mon[91314]: Upgrade: Updating osd.0 2024-03-04T06:45:46.514 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:46 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:46.514 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:46 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-04T06:45:46.514 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:46 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:46.514 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:46 smithi137 ceph-mon[91314]: Deploying daemon osd.0 on smithi137 2024-03-04T06:45:46.514 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:46 smithi137 ceph-mon[91314]: osdmap e284: 8 total, 8 up, 8 in 2024-03-04T06:45:46.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:46 smithi203 ceph-mon[85573]: Upgrade: Updating osd.0 2024-03-04T06:45:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:46 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:46 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-04T06:45:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:46 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:45:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:46 smithi203 ceph-mon[85573]: Deploying daemon osd.0 on smithi137 2024-03-04T06:45:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:46 smithi203 ceph-mon[85573]: osdmap e284: 8 total, 8 up, 8 in 2024-03-04T06:45:46.858 INFO:tasks.rados.rados.0.smithi137.stdout:1148: done (3 left) 2024-03-04T06:45:46.858 INFO:tasks.rados.rados.0.smithi137.stdout:1149: done (2 left) 2024-03-04T06:45:46.858 INFO:tasks.rados.rados.0.smithi137.stdout:1150: done (1 left) 2024-03-04T06:45:46.858 INFO:tasks.rados.rados.0.smithi137.stdout:1151: done (0 left) 2024-03-04T06:45:46.858 INFO:tasks.rados.rados.0.smithi137.stdout:1152: snap_remove snap 105 2024-03-04T06:45:47.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:47 smithi137 ceph-mon[88869]: from='client.34179 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:45:47.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:47 smithi137 ceph-mon[88869]: from='client.54124 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:45:47.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:47 smithi137 ceph-mon[88869]: pgmap v99: 121 pgs: 121 active+clean; 283 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 28 op/s 2024-03-04T06:45:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:47 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/2381254631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:47 smithi137 ceph-mon[88869]: osdmap e285: 8 total, 8 up, 8 in 2024-03-04T06:45:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:47 smithi137 ceph-mon[91314]: from='client.34179 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:45:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:47 smithi137 ceph-mon[91314]: from='client.54124 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:45:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:47 smithi137 ceph-mon[91314]: pgmap v99: 121 pgs: 121 active+clean; 283 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 28 op/s 2024-03-04T06:45:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:47 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/2381254631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:47 smithi137 ceph-mon[91314]: osdmap e285: 8 total, 8 up, 8 in 2024-03-04T06:45:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:47 smithi203 ceph-mon[85573]: from='client.34179 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:45:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:47 smithi203 ceph-mon[85573]: from='client.54124 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:45:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:47 smithi203 ceph-mon[85573]: pgmap v99: 121 pgs: 121 active+clean; 283 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 28 op/s 2024-03-04T06:45:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:47 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/2381254631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:45:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:47 smithi203 ceph-mon[85573]: osdmap e285: 8 total, 8 up, 8 in 2024-03-04T06:45:47.860 INFO:tasks.rados.rados.0.smithi137.stdout:1152: done (0 left) 2024-03-04T06:45:47.860 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 115 2024-03-04T06:45:47.860 INFO:tasks.rados.rados.0.smithi137.stdout:1153: seq_num 376 ranges {0=704512,704512=548864,1253376=253952} 2024-03-04T06:45:47.864 INFO:tasks.rados.rados.0.smithi137.stdout:1153: writing smithi13777483-8 from 0 to 704512 tid 1 2024-03-04T06:45:47.868 INFO:tasks.rados.rados.0.smithi137.stdout:1153: writing smithi13777483-8 from 704512 to 1253376 tid 2 2024-03-04T06:45:47.870 INFO:tasks.rados.rados.0.smithi137.stdout:1153: writing smithi13777483-8 from 1253376 to 1507328 tid 3 2024-03-04T06:45:47.870 INFO:tasks.rados.rados.0.smithi137.stdout:1154: rollback oid 31 current snap is 115 2024-03-04T06:45:47.870 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 31 to 100 2024-03-04T06:45:47.870 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 115 2024-03-04T06:45:47.870 INFO:tasks.rados.rados.0.smithi137.stdout:1155: seq_num 377 ranges {5980160=720896,6701056=434176,7135232=368640} 2024-03-04T06:45:47.906 INFO:tasks.rados.rados.0.smithi137.stdout:1155: writing smithi13777483-20 from 5980160 to 6701056 tid 1 2024-03-04T06:45:47.909 INFO:tasks.rados.rados.0.smithi137.stdout:1155: writing smithi13777483-20 from 6701056 to 7135232 tid 2 2024-03-04T06:45:47.911 INFO:tasks.rados.rados.0.smithi137.stdout:1155: writing smithi13777483-20 from 7135232 to 7503872 tid 3 2024-03-04T06:45:47.911 INFO:tasks.rados.rados.0.smithi137.stdout:1156: read oid 41 snap -1 2024-03-04T06:45:47.912 INFO:tasks.rados.rados.0.smithi137.stdout:1156: expect (ObjNum 366 snap 111 seq_num 366) 2024-03-04T06:45:47.912 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 50 current snap is 115 2024-03-04T06:45:47.912 INFO:tasks.rados.rados.0.smithi137.stdout:1153: finishing write tid 1 to smithi13777483-8 2024-03-04T06:45:47.912 INFO:tasks.rados.rados.0.smithi137.stdout:1157: seq_num 378 ranges {0=737280,737280=720896,1458176=81920} 2024-03-04T06:45:47.915 INFO:tasks.rados.rados.0.smithi137.stdout:1157: writing smithi13777483-50 from 0 to 737280 tid 1 2024-03-04T06:45:47.919 INFO:tasks.rados.rados.0.smithi137.stdout:1157: writing smithi13777483-50 from 737280 to 1458176 tid 2 2024-03-04T06:45:47.921 INFO:tasks.rados.rados.0.smithi137.stdout:1157: writing smithi13777483-50 from 1458176 to 1540096 tid 3 2024-03-04T06:45:47.921 INFO:tasks.rados.rados.0.smithi137.stdout:1158: rollback oid 9 current snap is 115 2024-03-04T06:45:47.921 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 9 to 113 2024-03-04T06:45:47.921 INFO:tasks.rados.rados.0.smithi137.stdout:1153: finishing write tid 2 to smithi13777483-8 2024-03-04T06:45:47.921 INFO:tasks.rados.rados.0.smithi137.stdout:1153: finishing write tid 3 to smithi13777483-8 2024-03-04T06:45:47.921 INFO:tasks.rados.rados.0.smithi137.stdout:1153: finishing write tid 4 to smithi13777483-8 2024-03-04T06:45:47.921 INFO:tasks.rados.rados.0.smithi137.stdout:1154: finishing rollback tid 0 to smithi13777483-31 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:1153: finishing write tid 5 to smithi13777483-8 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:1153: oid 8 updating version 0 to 236 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:1153: oid 8 version 236 is already newer than 235 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:1153: oid 8 version 236 is already newer than 234 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:1153: oid 8 version 236 is already newer than 229 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 236 (ObjNum 376 snap 115 seq_num 376) dirty exists 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:1153: left oid 8 (ObjNum 376 snap 115 seq_num 376) 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:1154: finishing rollback tid 1 to smithi13777483-31 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:1154: finishing rollback tid 2 to smithi13777483-31 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 577 (ObjNum 289 snap 91 seq_num 289) dirty exists 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:1155: finishing write tid 1 to smithi13777483-20 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:1155: finishing write tid 2 to smithi13777483-20 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:1153: done (5 left) 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:1154: done (4 left) 2024-03-04T06:45:47.922 INFO:tasks.rados.rados.0.smithi137.stdout:1159: read oid 43 snap -1 2024-03-04T06:45:47.923 INFO:tasks.rados.rados.0.smithi137.stdout:1159: expect (ObjNum 369 snap 112 seq_num 369) 2024-03-04T06:45:47.923 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 115 2024-03-04T06:45:47.923 INFO:tasks.rados.rados.0.smithi137.stdout:1160: seq_num 379 ranges {5087232=753664,5840896=606208,6447104=196608} 2024-03-04T06:45:47.952 INFO:tasks.rados.rados.0.smithi137.stdout:1160: writing smithi13777483-26 from 5087232 to 5840896 tid 1 2024-03-04T06:45:47.955 INFO:tasks.rados.rados.0.smithi137.stdout:1160: writing smithi13777483-26 from 5840896 to 6447104 tid 2 2024-03-04T06:45:47.957 INFO:tasks.rados.rados.0.smithi137.stdout:1160: writing smithi13777483-26 from 6447104 to 6643712 tid 3 2024-03-04T06:45:47.958 INFO:tasks.rados.rados.0.smithi137.stdout:1161: snap_create 2024-03-04T06:45:47.958 INFO:tasks.rados.rados.0.smithi137.stdout:1155: finishing write tid 3 to smithi13777483-20 2024-03-04T06:45:47.958 INFO:tasks.rados.rados.0.smithi137.stdout:1155: finishing write tid 4 to smithi13777483-20 2024-03-04T06:45:47.958 INFO:tasks.rados.rados.0.smithi137.stdout:1155: finishing write tid 5 to smithi13777483-20 2024-03-04T06:45:47.958 INFO:tasks.rados.rados.0.smithi137.stdout:1155: oid 20 updating version 0 to 489 2024-03-04T06:45:47.958 INFO:tasks.rados.rados.0.smithi137.stdout:1155: oid 20 updating version 489 to 490 2024-03-04T06:45:47.958 INFO:tasks.rados.rados.0.smithi137.stdout:1155: oid 20 updating version 490 to 491 2024-03-04T06:45:47.958 INFO:tasks.rados.rados.0.smithi137.stdout:1155: oid 20 updating version 491 to 492 2024-03-04T06:45:47.958 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 492 (ObjNum 377 snap 115 seq_num 377) dirty exists 2024-03-04T06:45:47.958 INFO:tasks.rados.rados.0.smithi137.stdout:1155: left oid 20 (ObjNum 377 snap 115 seq_num 377) 2024-03-04T06:45:47.958 INFO:tasks.rados.rados.0.smithi137.stdout:1157: finishing write tid 1 to smithi13777483-50 2024-03-04T06:45:47.958 INFO:tasks.rados.rados.0.smithi137.stdout:1156: expect (ObjNum 366 snap 111 seq_num 366) 2024-03-04T06:45:48.034 INFO:tasks.rados.rados.0.smithi137.stdout:1158: finishing rollback tid 0 to smithi13777483-9 2024-03-04T06:45:48.034 INFO:tasks.rados.rados.0.smithi137.stdout:1157: finishing write tid 2 to smithi13777483-50 2024-03-04T06:45:48.034 INFO:tasks.rados.rados.0.smithi137.stdout:1158: finishing rollback tid 1 to smithi13777483-9 2024-03-04T06:45:48.035 INFO:tasks.rados.rados.0.smithi137.stdout:1157: finishing write tid 3 to smithi13777483-50 2024-03-04T06:45:48.035 INFO:tasks.rados.rados.0.smithi137.stdout:1158: finishing rollback tid 2 to smithi13777483-9 2024-03-04T06:45:48.035 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 626 (ObjNum 335 snap 106 seq_num 335) dirty exists 2024-03-04T06:45:48.035 INFO:tasks.rados.rados.0.smithi137.stdout:1157: finishing write tid 4 to smithi13777483-50 2024-03-04T06:45:48.035 INFO:tasks.rados.rados.0.smithi137.stdout:1157: finishing write tid 5 to smithi13777483-50 2024-03-04T06:45:48.035 INFO:tasks.rados.rados.0.smithi137.stdout:1157: oid 50 updating version 0 to 846 2024-03-04T06:45:48.035 INFO:tasks.rados.rados.0.smithi137.stdout:1157: oid 50 version 846 is already newer than 845 2024-03-04T06:45:48.035 INFO:tasks.rados.rados.0.smithi137.stdout:1157: oid 50 version 846 is already newer than 843 2024-03-04T06:45:48.035 INFO:tasks.rados.rados.0.smithi137.stdout:1157: oid 50 version 846 is already newer than 844 2024-03-04T06:45:48.035 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 846 (ObjNum 378 snap 115 seq_num 378) dirty exists 2024-03-04T06:45:48.035 INFO:tasks.rados.rados.0.smithi137.stdout:1157: left oid 50 (ObjNum 378 snap 115 seq_num 378) 2024-03-04T06:45:48.035 INFO:tasks.rados.rados.0.smithi137.stdout:1159: expect (ObjNum 369 snap 112 seq_num 369) 2024-03-04T06:45:48.126 INFO:tasks.rados.rados.0.smithi137.stdout:1160: finishing write tid 1 to smithi13777483-26 2024-03-04T06:45:48.126 INFO:tasks.rados.rados.0.smithi137.stdout:1160: finishing write tid 2 to smithi13777483-26 2024-03-04T06:45:48.126 INFO:tasks.rados.rados.0.smithi137.stdout:1160: finishing write tid 3 to smithi13777483-26 2024-03-04T06:45:48.126 INFO:tasks.rados.rados.0.smithi137.stdout:1160: finishing write tid 4 to smithi13777483-26 2024-03-04T06:45:48.126 INFO:tasks.rados.rados.0.smithi137.stdout:1160: finishing write tid 5 to smithi13777483-26 2024-03-04T06:45:48.126 INFO:tasks.rados.rados.0.smithi137.stdout:1160: oid 26 updating version 0 to 498 2024-03-04T06:45:48.126 INFO:tasks.rados.rados.0.smithi137.stdout:1160: oid 26 version 498 is already newer than 497 2024-03-04T06:45:48.126 INFO:tasks.rados.rados.0.smithi137.stdout:1160: oid 26 updating version 498 to 499 2024-03-04T06:45:48.127 INFO:tasks.rados.rados.0.smithi137.stdout:1160: oid 26 updating version 499 to 500 2024-03-04T06:45:48.127 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 500 (ObjNum 379 snap 115 seq_num 379) dirty exists 2024-03-04T06:45:48.127 INFO:tasks.rados.rados.0.smithi137.stdout:1160: left oid 26 (ObjNum 379 snap 115 seq_num 379) 2024-03-04T06:45:48.799 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:48 smithi137 systemd[1]: Stopping Ceph osd.0 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:45:48.866 INFO:tasks.rados.rados.0.smithi137.stdout:1155: done (6 left) 2024-03-04T06:45:48.866 INFO:tasks.rados.rados.0.smithi137.stdout:1156: done (5 left) 2024-03-04T06:45:48.867 INFO:tasks.rados.rados.0.smithi137.stdout:1157: done (4 left) 2024-03-04T06:45:48.867 INFO:tasks.rados.rados.0.smithi137.stdout:1158: done (3 left) 2024-03-04T06:45:48.867 INFO:tasks.rados.rados.0.smithi137.stdout:1159: done (2 left) 2024-03-04T06:45:48.867 INFO:tasks.rados.rados.0.smithi137.stdout:1160: done (1 left) 2024-03-04T06:45:48.867 INFO:tasks.rados.rados.0.smithi137.stdout:1161: done (0 left) 2024-03-04T06:45:48.867 INFO:tasks.rados.rados.0.smithi137.stdout:1162: rollback oid 1 current snap is 116 2024-03-04T06:45:48.867 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 1 to 95 2024-03-04T06:45:48.867 INFO:tasks.rados.rados.0.smithi137.stdout:1163: rollback oid 36 current snap is 116 2024-03-04T06:45:48.867 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 36 to 112 2024-03-04T06:45:48.867 INFO:tasks.rados.rados.0.smithi137.stdout:1164: snap_remove snap 96 2024-03-04T06:45:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:48 smithi137 ceph-mon[88869]: osdmap e286: 8 total, 8 up, 8 in 2024-03-04T06:45:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:48 smithi137 ceph-mon[88869]: pgmap v102: 121 pgs: 121 active+clean; 283 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:45:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:48 smithi137 ceph-mon[88869]: osd.0 marked itself down and dead 2024-03-04T06:45:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:48 smithi137 ceph-mon[91314]: osdmap e286: 8 total, 8 up, 8 in 2024-03-04T06:45:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:48 smithi137 ceph-mon[91314]: pgmap v102: 121 pgs: 121 active+clean; 283 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:45:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:48 smithi137 ceph-mon[91314]: osd.0 marked itself down and dead 2024-03-04T06:45:49.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[41303]: 2024-03-04T06:45:48.798+0000 7f008211e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:45:49.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[41303]: 2024-03-04T06:45:48.798+0000 7f008211e700 -1 osd.0 286 *** Got signal Terminated *** 2024-03-04T06:45:49.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[41303]: 2024-03-04T06:45:48.798+0000 7f008211e700 -1 osd.0 286 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T06:45:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:48 smithi203 ceph-mon[85573]: osdmap e286: 8 total, 8 up, 8 in 2024-03-04T06:45:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:48 smithi203 ceph-mon[85573]: pgmap v102: 121 pgs: 121 active+clean; 283 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail 2024-03-04T06:45:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:48 smithi203 ceph-mon[85573]: osd.0 marked itself down and dead 2024-03-04T06:45:49.674 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:49 smithi137 podman[96544]: 2024-03-04 06:45:49.411211951 +0000 UTC m=+0.698268344 container died 732ea50ff558183559b7f940b4bb93a346ab185dff4fdd053173f2a376c6c279 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=reef-5cc7a76) 2024-03-04T06:45:49.868 INFO:tasks.rados.rados.0.smithi137.stdout:1164: done (2 left) 2024-03-04T06:45:49.868 INFO:tasks.rados.rados.0.smithi137.stdout:1165: snap_remove snap 109 2024-03-04T06:45:49.966 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:49 smithi137 ceph-mon[88869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:45:49.966 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:49 smithi137 ceph-mon[88869]: osdmap e287: 8 total, 7 up, 8 in 2024-03-04T06:45:49.966 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:49 smithi137 ceph-mon[91314]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:45:49.966 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:49 smithi137 ceph-mon[91314]: osdmap e287: 8 total, 7 up, 8 in 2024-03-04T06:45:49.967 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:49 smithi137 podman[96544]: 2024-03-04 06:45:49.748394107 +0000 UTC m=+1.035450499 container cleanup 732ea50ff558183559b7f940b4bb93a346ab185dff4fdd053173f2a376c6c279 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=reef-5cc7a76, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:45:49.967 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:49 smithi137 bash[96544]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0 2024-03-04T06:45:50.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:49 smithi137 podman[96561]: 2024-03-04 06:45:49.96672563 +0000 UTC m=+0.556249888 container remove 732ea50ff558183559b7f940b4bb93a346ab185dff4fdd053173f2a376c6c279 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0, RELEASE=reef-5cc7a76, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:45:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:49 smithi203 ceph-mon[85573]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:45:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:49 smithi203 ceph-mon[85573]: osdmap e287: 8 total, 7 up, 8 in 2024-03-04T06:45:50.644 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:50 smithi137 podman[96654]: 2024-03-04 06:45:50.392519748 +0000 UTC m=+0.103804551 container create 23d0857d255efc7aeca12bf75bdcf977f1daa8c3e1e4a06da41f65d03808a19a (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-04T06:45:50.644 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:50 smithi137 podman[96654]: 2024-03-04 06:45:50.306675028 +0000 UTC m=+0.017959801 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:45:50.645 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:50 smithi137 podman[96654]: 2024-03-04 06:45:50.644731906 +0000 UTC m=+0.356016668 container init 23d0857d255efc7aeca12bf75bdcf977f1daa8c3e1e4a06da41f65d03808a19a (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux ) 2024-03-04T06:45:50.869 INFO:tasks.rados.rados.0.smithi137.stdout:1165: done (2 left) 2024-03-04T06:45:50.870 INFO:tasks.rados.rados.0.smithi137.stdout:1166: snap_remove snap 113 2024-03-04T06:45:50.945 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:50 smithi137 ceph-mon[88869]: osdmap e288: 8 total, 7 up, 8 in 2024-03-04T06:45:50.945 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:50 smithi137 ceph-mon[88869]: pgmap v105: 121 pgs: 53 peering, 68 active+clean; 289 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.7 MiB/s wr, 19 op/s 2024-03-04T06:45:50.945 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:50 smithi137 ceph-mon[91314]: osdmap e288: 8 total, 7 up, 8 in 2024-03-04T06:45:50.945 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:50 smithi137 ceph-mon[91314]: pgmap v105: 121 pgs: 53 peering, 68 active+clean; 289 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.7 MiB/s wr, 19 op/s 2024-03-04T06:45:50.945 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:50 smithi137 podman[96654]: 2024-03-04 06:45:50.647878029 +0000 UTC m=+0.359162798 container start 23d0857d255efc7aeca12bf75bdcf977f1daa8c3e1e4a06da41f65d03808a19a (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222) 2024-03-04T06:45:50.946 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:50 smithi137 podman[96654]: 2024-03-04 06:45:50.753462353 +0000 UTC m=+0.464747124 container attach 23d0857d255efc7aeca12bf75bdcf977f1daa8c3e1e4a06da41f65d03808a19a (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240222, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-04T06:45:51.289 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:50 smithi137 podman[96654]: 2024-03-04 06:45:50.945318578 +0000 UTC m=+0.656603339 container died 23d0857d255efc7aeca12bf75bdcf977f1daa8c3e1e4a06da41f65d03808a19a (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-03-04T06:45:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:50 smithi203 ceph-mon[85573]: osdmap e288: 8 total, 7 up, 8 in 2024-03-04T06:45:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:50 smithi203 ceph-mon[85573]: pgmap v105: 121 pgs: 53 peering, 68 active+clean; 289 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.7 MiB/s wr, 19 op/s 2024-03-04T06:45:51.872 INFO:tasks.rados.rados.0.smithi137.stdout:1166: done (2 left) 2024-03-04T06:45:51.872 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 29 current snap is 116 2024-03-04T06:45:51.872 INFO:tasks.rados.rados.0.smithi137.stdout:1162: finishing rollback tid 1 to smithi13777483-1 2024-03-04T06:45:51.872 INFO:tasks.rados.rados.0.smithi137.stdout:1167: seq_num 380 ranges {139264=770048,909312=483328,1392640=319488} 2024-03-04T06:45:51.875 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:51 smithi137 podman[96679]: 2024-03-04 06:45:51.59027468 +0000 UTC m=+0.639599682 container remove 23d0857d255efc7aeca12bf75bdcf977f1daa8c3e1e4a06da41f65d03808a19a (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD) 2024-03-04T06:45:51.875 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:51 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.0.service: Deactivated successfully. 2024-03-04T06:45:51.875 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:51 smithi137 systemd[1]: Stopped Ceph osd.0 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:45:51.876 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:51 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.0.service: Consumed 10.740s CPU time. 2024-03-04T06:45:51.876 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:51 smithi137 systemd[1]: Starting Ceph osd.0 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:45:51.876 INFO:tasks.rados.rados.0.smithi137.stdout:1167: writing smithi13777483-29 from 139264 to 909312 tid 1 2024-03-04T06:45:51.879 INFO:tasks.rados.rados.0.smithi137.stdout:1167: writing smithi13777483-29 from 909312 to 1392640 tid 2 2024-03-04T06:45:51.882 INFO:tasks.rados.rados.0.smithi137.stdout:1167: writing smithi13777483-29 from 1392640 to 1712128 tid 3 2024-03-04T06:45:51.882 INFO:tasks.rados.rados.0.smithi137.stdout:1168: snap_remove snap 63 2024-03-04T06:45:52.200 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:51 smithi137 ceph-mon[88869]: osdmap e289: 8 total, 7 up, 8 in 2024-03-04T06:45:52.200 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:51 smithi137 ceph-mon[88869]: Health check failed: Reduced data availability: 10 pgs inactive, 12 pgs peering (PG_AVAILABILITY) 2024-03-04T06:45:52.200 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:51 smithi137 ceph-mon[88869]: osdmap e290: 8 total, 7 up, 8 in 2024-03-04T06:45:52.201 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:51 smithi137 ceph-mon[91314]: osdmap e289: 8 total, 7 up, 8 in 2024-03-04T06:45:52.201 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:51 smithi137 ceph-mon[91314]: Health check failed: Reduced data availability: 10 pgs inactive, 12 pgs peering (PG_AVAILABILITY) 2024-03-04T06:45:52.201 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:51 smithi137 ceph-mon[91314]: osdmap e290: 8 total, 7 up, 8 in 2024-03-04T06:45:52.201 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 podman[96781]: 2024-03-04 06:45:51.945858398 +0000 UTC m=+0.018464682 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:45:52.201 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 podman[96781]: 2024-03-04 06:45:52.074859919 +0000 UTC m=+0.147466191 container create 0daebd6ac9f12c17e5ef16cd7fe328e34ee14212f02246a43b84ed1630dfa1f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:45:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:51 smithi203 ceph-mon[85573]: osdmap e289: 8 total, 7 up, 8 in 2024-03-04T06:45:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:51 smithi203 ceph-mon[85573]: Health check failed: Reduced data availability: 10 pgs inactive, 12 pgs peering (PG_AVAILABILITY) 2024-03-04T06:45:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:51 smithi203 ceph-mon[85573]: osdmap e290: 8 total, 7 up, 8 in 2024-03-04T06:45:52.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 podman[96781]: 2024-03-04 06:45:52.327129771 +0000 UTC m=+0.399736044 container init 0daebd6ac9f12c17e5ef16cd7fe328e34ee14212f02246a43b84ed1630dfa1f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux ) 2024-03-04T06:45:52.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 podman[96781]: 2024-03-04 06:45:52.330561235 +0000 UTC m=+0.403167518 container start 0daebd6ac9f12c17e5ef16cd7fe328e34ee14212f02246a43b84ed1630dfa1f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0) 2024-03-04T06:45:52.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 podman[96781]: 2024-03-04 06:45:52.427206171 +0000 UTC m=+0.499812450 container attach 0daebd6ac9f12c17e5ef16cd7fe328e34ee14212f02246a43b84ed1630dfa1f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-activate, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0) 2024-03-04T06:45:52.883 INFO:tasks.rados.rados.0.smithi137.stdout:1168: done (3 left) 2024-03-04T06:45:52.883 INFO:tasks.rados.rados.0.smithi137.stdout:1169: delete oid 13 current snap is 116 2024-03-04T06:45:52.883 INFO:tasks.rados.rados.0.smithi137.stdout:1162: finishing rollback tid 2 to smithi13777483-1 2024-03-04T06:45:52.884 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 461 (ObjNum 296 snap 95 seq_num 296) dirty exists 2024-03-04T06:45:52.884 INFO:tasks.rados.rados.0.smithi137.stdout:1163: finishing rollback tid 0 to smithi13777483-36 2024-03-04T06:45:52.884 INFO:tasks.rados.rados.0.smithi137.stdout:1163: finishing rollback tid 1 to smithi13777483-36 2024-03-04T06:45:52.884 INFO:tasks.rados.rados.0.smithi137.stdout:1163: finishing rollback tid 2 to smithi13777483-36 2024-03-04T06:45:52.884 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 333 (ObjNum 270 snap 87 seq_num 270) dirty exists 2024-03-04T06:45:52.884 INFO:tasks.rados.rados.0.smithi137.stdout:1167: finishing write tid 1 to smithi13777483-29 2024-03-04T06:45:52.884 INFO:tasks.rados.rados.0.smithi137.stdout:1167: finishing write tid 2 to smithi13777483-29 2024-03-04T06:45:52.884 INFO:tasks.rados.rados.0.smithi137.stdout:1167: finishing write tid 3 to smithi13777483-29 2024-03-04T06:45:52.884 INFO:tasks.rados.rados.0.smithi137.stdout:1167: finishing write tid 4 to smithi13777483-29 2024-03-04T06:45:52.884 INFO:tasks.rados.rados.0.smithi137.stdout:1167: finishing write tid 5 to smithi13777483-29 2024-03-04T06:45:52.884 INFO:tasks.rados.rados.0.smithi137.stdout:1167: oid 29 updating version 0 to 503 2024-03-04T06:45:52.884 INFO:tasks.rados.rados.0.smithi137.stdout:1167: oid 29 updating version 503 to 504 2024-03-04T06:45:52.885 INFO:tasks.rados.rados.0.smithi137.stdout:1167: oid 29 version 504 is already newer than 502 2024-03-04T06:45:52.885 INFO:tasks.rados.rados.0.smithi137.stdout:1167: oid 29 version 504 is already newer than 501 2024-03-04T06:45:52.885 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 504 (ObjNum 380 snap 116 seq_num 380) dirty exists 2024-03-04T06:45:52.885 INFO:tasks.rados.rados.0.smithi137.stdout:1167: left oid 29 (ObjNum 380 snap 116 seq_num 380) 2024-03-04T06:45:52.896 INFO:tasks.rados.rados.0.smithi137.stdout:1162: done (3 left) 2024-03-04T06:45:52.897 INFO:tasks.rados.rados.0.smithi137.stdout:1163: done (2 left) 2024-03-04T06:45:52.897 INFO:tasks.rados.rados.0.smithi137.stdout:1167: done (1 left) 2024-03-04T06:45:52.897 INFO:tasks.rados.rados.0.smithi137.stdout:1169: done (0 left) 2024-03-04T06:45:52.897 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 116 2024-03-04T06:45:52.897 INFO:tasks.rados.rados.0.smithi137.stdout:1170: seq_num 382 ranges {3129344=802816,3932160=704512,4636672=98304} 2024-03-04T06:45:52.918 INFO:tasks.rados.rados.0.smithi137.stdout:1170: writing smithi13777483-15 from 3129344 to 3932160 tid 1 2024-03-04T06:45:52.922 INFO:tasks.rados.rados.0.smithi137.stdout:1170: writing smithi13777483-15 from 3932160 to 4636672 tid 2 2024-03-04T06:45:52.922 INFO:tasks.rados.rados.0.smithi137.stdout:1170: writing smithi13777483-15 from 4636672 to 4734976 tid 3 2024-03-04T06:45:52.923 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 116 2024-03-04T06:45:52.923 INFO:tasks.rados.rados.0.smithi137.stdout:1171: seq_num 383 ranges {5554176=417792,5971968=589824,6561792=417792,6979584=196608} 2024-03-04T06:45:52.954 INFO:tasks.rados.rados.0.smithi137.stdout:1171: writing smithi13777483-22 from 5554176 to 5971968 tid 1 2024-03-04T06:45:52.957 INFO:tasks.rados.rados.0.smithi137.stdout:1171: writing smithi13777483-22 from 5971968 to 6561792 tid 2 2024-03-04T06:45:52.959 INFO:tasks.rados.rados.0.smithi137.stdout:1171: writing smithi13777483-22 from 6561792 to 6979584 tid 3 2024-03-04T06:45:52.961 INFO:tasks.rados.rados.0.smithi137.stdout:1171: writing smithi13777483-22 from 6979584 to 7176192 tid 4 2024-03-04T06:45:52.961 INFO:tasks.rados.rados.0.smithi137.stdout:1172: read oid 30 snap -1 2024-03-04T06:45:52.961 INFO:tasks.rados.rados.0.smithi137.stdout:1172: expect (ObjNum 239 snap 72 seq_num 239) 2024-03-04T06:45:52.961 INFO:tasks.rados.rados.0.smithi137.stdout:1173: copy_from oid 7 from oid 3 current snap is 116 2024-03-04T06:45:52.962 INFO:tasks.rados.rados.0.smithi137.stdout:1170: finishing write tid 1 to smithi13777483-15 2024-03-04T06:45:52.962 INFO:tasks.rados.rados.0.smithi137.stdout:1170: finishing write tid 2 to smithi13777483-15 2024-03-04T06:45:52.962 INFO:tasks.rados.rados.0.smithi137.stdout:1170: finishing write tid 3 to smithi13777483-15 2024-03-04T06:45:52.962 INFO:tasks.rados.rados.0.smithi137.stdout:1170: finishing write tid 4 to smithi13777483-15 2024-03-04T06:45:52.962 INFO:tasks.rados.rados.0.smithi137.stdout:1170: finishing write tid 5 to smithi13777483-15 2024-03-04T06:45:52.962 INFO:tasks.rados.rados.0.smithi137.stdout:1170: oid 15 updating version 0 to 702 2024-03-04T06:45:52.962 INFO:tasks.rados.rados.0.smithi137.stdout:1170: oid 15 updating version 702 to 704 2024-03-04T06:45:52.962 INFO:tasks.rados.rados.0.smithi137.stdout:1170: oid 15 version 704 is already newer than 703 2024-03-04T06:45:52.962 INFO:tasks.rados.rados.0.smithi137.stdout:1170: oid 15 updating version 704 to 705 2024-03-04T06:45:52.962 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 705 (ObjNum 382 snap 116 seq_num 382) dirty exists 2024-03-04T06:45:52.962 INFO:tasks.rados.rados.0.smithi137.stdout:1170: left oid 15 (ObjNum 382 snap 116 seq_num 382) 2024-03-04T06:45:52.962 INFO:tasks.rados.rados.0.smithi137.stdout:1171: finishing write tid 1 to smithi13777483-22 2024-03-04T06:45:52.962 INFO:tasks.rados.rados.0.smithi137.stdout:1171: finishing write tid 2 to smithi13777483-22 2024-03-04T06:45:52.963 INFO:tasks.rados.rados.0.smithi137.stdout:1170: done (3 left) 2024-03-04T06:45:52.963 INFO:tasks.rados.rados.0.smithi137.stdout:1174: copy_from oid 46 from oid 11 current snap is 116 2024-03-04T06:45:52.963 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 116 2024-03-04T06:45:52.963 INFO:tasks.rados.rados.0.smithi137.stdout:1175: seq_num 384 ranges {1523712=434176,1957888=475136,2433024=630784,3063808=98304} 2024-03-04T06:45:52.972 INFO:tasks.rados.rados.0.smithi137.stdout:1175: writing smithi13777483-10 from 1523712 to 1957888 tid 1 2024-03-04T06:45:52.975 INFO:tasks.rados.rados.0.smithi137.stdout:1175: writing smithi13777483-10 from 1957888 to 2433024 tid 2 2024-03-04T06:45:52.979 INFO:tasks.rados.rados.0.smithi137.stdout:1175: writing smithi13777483-10 from 2433024 to 3063808 tid 3 2024-03-04T06:45:52.980 INFO:tasks.rados.rados.0.smithi137.stdout:1175: writing smithi13777483-10 from 3063808 to 3162112 tid 4 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 48 current snap is 116 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:1171: finishing write tid 3 to smithi13777483-22 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:1171: finishing write tid 4 to smithi13777483-22 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:1171: finishing write tid 5 to smithi13777483-22 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:1171: finishing write tid 6 to smithi13777483-22 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:1171: oid 22 updating version 0 to 709 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:1171: oid 22 version 709 is already newer than 708 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:1171: oid 22 updating version 709 to 710 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:1171: oid 22 version 710 is already newer than 707 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:1171: oid 22 updating version 710 to 711 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 711 (ObjNum 383 snap 116 seq_num 383) dirty exists 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:1171: left oid 22 (ObjNum 383 snap 116 seq_num 383) 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:1173: finishing copy_from racing read to smithi13777483-7 2024-03-04T06:45:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:1176: seq_num 385 ranges {2154496=450560,2605056=761856,3366912=442368} 2024-03-04T06:45:52.994 INFO:tasks.rados.rados.0.smithi137.stdout:1176: writing smithi13777483-48 from 2154496 to 2605056 tid 1 2024-03-04T06:45:52.999 INFO:tasks.rados.rados.0.smithi137.stdout:1176: writing smithi13777483-48 from 2605056 to 3366912 tid 2 2024-03-04T06:45:53.002 INFO:tasks.rados.rados.0.smithi137.stdout:1176: writing smithi13777483-48 from 3366912 to 3809280 tid 3 2024-03-04T06:45:53.002 INFO:tasks.rados.rados.0.smithi137.stdout:1171: done (5 left) 2024-03-04T06:45:53.002 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 116 2024-03-04T06:45:53.002 INFO:tasks.rados.rados.0.smithi137.stdout:1174: finishing copy_from racing read to smithi13777483-46 2024-03-04T06:45:53.002 INFO:tasks.rados.rados.0.smithi137.stdout:1174: finishing copy_from to smithi13777483-46 2024-03-04T06:45:53.003 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 215 (ObjNum 362 snap 111 seq_num 362) dirty exists 2024-03-04T06:45:53.003 INFO:tasks.rados.rados.0.smithi137.stdout:1173: finishing copy_from to smithi13777483-7 2024-03-04T06:45:53.003 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 582 (ObjNum 353 snap 110 seq_num 353) dirty exists 2024-03-04T06:45:53.003 INFO:tasks.rados.rados.0.smithi137.stdout:1175: finishing write tid 1 to smithi13777483-10 2024-03-04T06:45:53.003 INFO:tasks.rados.rados.0.smithi137.stdout:1172: expect (ObjNum 239 snap 72 seq_num 239) 2024-03-04T06:45:53.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:52 smithi137 ceph-mon[88869]: pgmap v108: 121 pgs: 53 peering, 68 active+clean; 289 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.7 MiB/s wr, 19 op/s 2024-03-04T06:45:53.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:52 smithi137 ceph-mon[91314]: pgmap v108: 121 pgs: 53 peering, 68 active+clean; 289 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.7 MiB/s wr, 19 op/s 2024-03-04T06:45:53.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-activate[96795]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-04T06:45:53.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-activate[96795]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-04T06:45:53.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 bash[96781]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-04T06:45:53.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 bash[96781]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-04T06:45:53.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 bash[96781]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-04T06:45:53.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 bash[96781]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-04T06:45:53.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 bash[96781]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-03-04T06:45:53.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 bash[96781]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-04T06:45:53.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 bash[96781]: --> ceph-volume raw activate successful for osd ID: 0 2024-03-04T06:45:53.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-activate[96795]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-04T06:45:53.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-activate[96795]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-04T06:45:53.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-activate[96795]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-03-04T06:45:53.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-activate[96795]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-04T06:45:53.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-activate[96795]: --> ceph-volume raw activate successful for osd ID: 0 2024-03-04T06:45:53.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:52 smithi137 podman[96781]: 2024-03-04 06:45:52.791581591 +0000 UTC m=+0.864187872 container died 0daebd6ac9f12c17e5ef16cd7fe328e34ee14212f02246a43b84ed1630dfa1f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2) 2024-03-04T06:45:53.108 INFO:tasks.rados.rados.0.smithi137.stdout:1175: finishing write tid 2 to smithi13777483-10 2024-03-04T06:45:53.108 INFO:tasks.rados.rados.0.smithi137.stdout:1175: finishing write tid 3 to smithi13777483-10 2024-03-04T06:45:53.108 INFO:tasks.rados.rados.0.smithi137.stdout:1175: finishing write tid 4 to smithi13777483-10 2024-03-04T06:45:53.108 INFO:tasks.rados.rados.0.smithi137.stdout:1175: finishing write tid 5 to smithi13777483-10 2024-03-04T06:45:53.108 INFO:tasks.rados.rados.0.smithi137.stdout:1175: finishing write tid 6 to smithi13777483-10 2024-03-04T06:45:53.108 INFO:tasks.rados.rados.0.smithi137.stdout:1175: oid 10 updating version 0 to 628 2024-03-04T06:45:53.108 INFO:tasks.rados.rados.0.smithi137.stdout:1175: oid 10 updating version 628 to 629 2024-03-04T06:45:53.109 INFO:tasks.rados.rados.0.smithi137.stdout:1175: oid 10 updating version 629 to 632 2024-03-04T06:45:53.109 INFO:tasks.rados.rados.0.smithi137.stdout:1175: oid 10 version 632 is already newer than 631 2024-03-04T06:45:53.109 INFO:tasks.rados.rados.0.smithi137.stdout:1175: oid 10 version 632 is already newer than 630 2024-03-04T06:45:53.109 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 632 (ObjNum 384 snap 116 seq_num 384) dirty exists 2024-03-04T06:45:53.109 INFO:tasks.rados.rados.0.smithi137.stdout:1175: left oid 10 (ObjNum 384 snap 116 seq_num 384) 2024-03-04T06:45:53.109 INFO:tasks.rados.rados.0.smithi137.stdout:1176: finishing write tid 1 to smithi13777483-48 2024-03-04T06:45:53.109 INFO:tasks.rados.rados.0.smithi137.stdout:1177: seq_num 386 ranges {2670592=466944,3137536=638976,3776512=565248} 2024-03-04T06:45:53.124 INFO:tasks.rados.rados.0.smithi137.stdout:1177: writing smithi13777483-44 from 2670592 to 3137536 tid 1 2024-03-04T06:45:53.128 INFO:tasks.rados.rados.0.smithi137.stdout:1177: writing smithi13777483-44 from 3137536 to 3776512 tid 2 2024-03-04T06:45:53.132 INFO:tasks.rados.rados.0.smithi137.stdout:1177: writing smithi13777483-44 from 3776512 to 4341760 tid 3 2024-03-04T06:45:53.133 INFO:tasks.rados.rados.0.smithi137.stdout:1172: done (5 left) 2024-03-04T06:45:53.133 INFO:tasks.rados.rados.0.smithi137.stdout:1173: done (4 left) 2024-03-04T06:45:53.133 INFO:tasks.rados.rados.0.smithi137.stdout:1174: done (3 left) 2024-03-04T06:45:53.133 INFO:tasks.rados.rados.0.smithi137.stdout:1175: done (2 left) 2024-03-04T06:45:53.133 INFO:tasks.rados.rados.0.smithi137.stdout:1178: rmattr oid 15 current snap is 116 2024-03-04T06:45:53.133 INFO:tasks.rados.rados.0.smithi137.stdout:1178: done (2 left) 2024-03-04T06:45:53.133 INFO:tasks.rados.rados.0.smithi137.stdout:1179: delete oid 20 current snap is 116 2024-03-04T06:45:53.133 INFO:tasks.rados.rados.0.smithi137.stdout:1176: finishing write tid 2 to smithi13777483-48 2024-03-04T06:45:53.133 INFO:tasks.rados.rados.0.smithi137.stdout:1176: finishing write tid 3 to smithi13777483-48 2024-03-04T06:45:53.133 INFO:tasks.rados.rados.0.smithi137.stdout:1176: finishing write tid 4 to smithi13777483-48 2024-03-04T06:45:53.133 INFO:tasks.rados.rados.0.smithi137.stdout:1176: finishing write tid 5 to smithi13777483-48 2024-03-04T06:45:53.133 INFO:tasks.rados.rados.0.smithi137.stdout:1176: oid 48 updating version 0 to 463 2024-03-04T06:45:53.134 INFO:tasks.rados.rados.0.smithi137.stdout:1176: oid 48 updating version 463 to 465 2024-03-04T06:45:53.134 INFO:tasks.rados.rados.0.smithi137.stdout:1176: oid 48 version 465 is already newer than 462 2024-03-04T06:45:53.134 INFO:tasks.rados.rados.0.smithi137.stdout:1176: oid 48 version 465 is already newer than 464 2024-03-04T06:45:53.134 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 465 (ObjNum 385 snap 116 seq_num 385) dirty exists 2024-03-04T06:45:53.134 INFO:tasks.rados.rados.0.smithi137.stdout:1176: left oid 48 (ObjNum 385 snap 116 seq_num 385) 2024-03-04T06:45:53.134 INFO:tasks.rados.rados.0.smithi137.stdout:1177: finishing write tid 1 to smithi13777483-44 2024-03-04T06:45:53.134 INFO:tasks.rados.rados.0.smithi137.stdout:1177: finishing write tid 2 to smithi13777483-44 2024-03-04T06:45:53.134 INFO:tasks.rados.rados.0.smithi137.stdout:1176: done (2 left) 2024-03-04T06:45:53.135 INFO:tasks.rados.rados.0.smithi137.stdout:1179: done (1 left) 2024-03-04T06:45:53.135 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 5 current snap is 116 2024-03-04T06:45:53.135 INFO:tasks.rados.rados.0.smithi137.stdout:1180: seq_num 388 ranges {0=507904,507904=458752,966656=606208,1572864=139264} 2024-03-04T06:45:53.136 INFO:tasks.rados.rados.0.smithi137.stdout:1180: writing smithi13777483-5 from 0 to 507904 tid 1 2024-03-04T06:45:53.139 INFO:tasks.rados.rados.0.smithi137.stdout:1180: writing smithi13777483-5 from 507904 to 966656 tid 2 2024-03-04T06:45:53.142 INFO:tasks.rados.rados.0.smithi137.stdout:1180: writing smithi13777483-5 from 966656 to 1572864 tid 3 2024-03-04T06:45:53.143 INFO:tasks.rados.rados.0.smithi137.stdout:1180: writing smithi13777483-5 from 1572864 to 1712128 tid 4 2024-03-04T06:45:53.144 INFO:tasks.rados.rados.0.smithi137.stdout:1181: delete oid 37 current snap is 116 2024-03-04T06:45:53.144 INFO:tasks.rados.rados.0.smithi137.stdout:1177: finishing write tid 3 to smithi13777483-44 2024-03-04T06:45:53.144 INFO:tasks.rados.rados.0.smithi137.stdout:1177: finishing write tid 4 to smithi13777483-44 2024-03-04T06:45:53.144 INFO:tasks.rados.rados.0.smithi137.stdout:1177: finishing write tid 5 to smithi13777483-44 2024-03-04T06:45:53.144 INFO:tasks.rados.rados.0.smithi137.stdout:1177: oid 44 updating version 0 to 450 2024-03-04T06:45:53.144 INFO:tasks.rados.rados.0.smithi137.stdout:1177: oid 44 updating version 450 to 451 2024-03-04T06:45:53.144 INFO:tasks.rados.rados.0.smithi137.stdout:1177: oid 44 version 451 is already newer than 448 2024-03-04T06:45:53.144 INFO:tasks.rados.rados.0.smithi137.stdout:1177: oid 44 version 451 is already newer than 449 2024-03-04T06:45:53.144 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 451 (ObjNum 386 snap 116 seq_num 386) dirty exists 2024-03-04T06:45:53.144 INFO:tasks.rados.rados.0.smithi137.stdout:1177: left oid 44 (ObjNum 386 snap 116 seq_num 386) 2024-03-04T06:45:53.144 INFO:tasks.rados.rados.0.smithi137.stdout:1180: finishing write tid 1 to smithi13777483-5 2024-03-04T06:45:53.144 INFO:tasks.rados.rados.0.smithi137.stdout:1180: finishing write tid 2 to smithi13777483-5 2024-03-04T06:45:53.145 INFO:tasks.rados.rados.0.smithi137.stdout:1180: finishing write tid 3 to smithi13777483-5 2024-03-04T06:45:53.145 INFO:tasks.rados.rados.0.smithi137.stdout:1180: finishing write tid 4 to smithi13777483-5 2024-03-04T06:45:53.145 INFO:tasks.rados.rados.0.smithi137.stdout:1177: done (2 left) 2024-03-04T06:45:53.145 INFO:tasks.rados.rados.0.smithi137.stdout:1181: done (1 left) 2024-03-04T06:45:53.145 INFO:tasks.rados.rados.0.smithi137.stdout:1182: setattr oid 17 current snap is 116 2024-03-04T06:45:53.146 INFO:tasks.rados.rados.0.smithi137.stdout:1180: finishing write tid 5 to smithi13777483-5 2024-03-04T06:45:53.147 INFO:tasks.rados.rados.0.smithi137.stdout:1180: finishing write tid 6 to smithi13777483-5 2024-03-04T06:45:53.147 INFO:tasks.rados.rados.0.smithi137.stdout:1180: oid 5 updating version 0 to 634 2024-03-04T06:45:53.147 INFO:tasks.rados.rados.0.smithi137.stdout:1180: oid 5 version 634 is already newer than 633 2024-03-04T06:45:53.147 INFO:tasks.rados.rados.0.smithi137.stdout:1180: oid 5 updating version 634 to 637 2024-03-04T06:45:53.147 INFO:tasks.rados.rados.0.smithi137.stdout:1180: oid 5 version 637 is already newer than 635 2024-03-04T06:45:53.147 INFO:tasks.rados.rados.0.smithi137.stdout:1180: oid 5 version 637 is already newer than 636 2024-03-04T06:45:53.147 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 637 (ObjNum 388 snap 116 seq_num 388) dirty exists 2024-03-04T06:45:53.147 INFO:tasks.rados.rados.0.smithi137.stdout:1180: left oid 5 (ObjNum 388 snap 116 seq_num 388) 2024-03-04T06:45:53.147 INFO:tasks.rados.rados.0.smithi137.stdout:1180: done (1 left) 2024-03-04T06:45:53.147 INFO:tasks.rados.rados.0.smithi137.stdout:1183: read oid 1 snap -1 2024-03-04T06:45:53.147 INFO:tasks.rados.rados.0.smithi137.stdout:1183: expect (ObjNum 296 snap 95 seq_num 296) 2024-03-04T06:45:53.147 INFO:tasks.rados.rados.0.smithi137.stdout:1184: snap_remove snap 107 2024-03-04T06:45:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:52 smithi203 ceph-mon[85573]: pgmap v108: 121 pgs: 53 peering, 68 active+clean; 289 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.7 MiB/s wr, 19 op/s 2024-03-04T06:45:53.723 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:53 smithi137 podman[96912]: 2024-03-04 06:45:53.364322778 +0000 UTC m=+0.562818954 container remove 0daebd6ac9f12c17e5ef16cd7fe328e34ee14212f02246a43b84ed1630dfa1f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-activate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-04T06:45:53.723 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:53 smithi137 podman[96976]: 2024-03-04 06:45:53.48127488 +0000 UTC m=+0.019512529 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:45:53.723 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:53 smithi137 podman[96976]: 2024-03-04 06:45:53.60784701 +0000 UTC m=+0.146084649 container create bd2207652b338904451990e9e5c1da5e3c45a70e407e4661600012ba1dbb2057 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-04T06:45:53.894 INFO:tasks.rados.rados.0.smithi137.stdout:1184: done (2 left) 2024-03-04T06:45:53.894 INFO:tasks.rados.rados.0.smithi137.stdout:1185: snap_remove snap 87 2024-03-04T06:45:54.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:53 smithi137 ceph-mon[88869]: osdmap e291: 8 total, 7 up, 8 in 2024-03-04T06:45:54.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:53 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:54.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:53 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:45:54.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:53 smithi137 ceph-mon[91314]: osdmap e291: 8 total, 7 up, 8 in 2024-03-04T06:45:54.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:53 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:54.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:53 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:45:54.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:53 smithi137 podman[96976]: 2024-03-04 06:45:53.842444946 +0000 UTC m=+0.380682585 container init bd2207652b338904451990e9e5c1da5e3c45a70e407e4661600012ba1dbb2057 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:45:54.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:53 smithi137 podman[96976]: 2024-03-04 06:45:53.845483744 +0000 UTC m=+0.383721384 container start bd2207652b338904451990e9e5c1da5e3c45a70e407e4661600012ba1dbb2057 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0, GIT_CLEAN=True, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:45:54.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:53 smithi137 ceph-osd[96995]: -- 172.21.15.137:0/2278325023 <== mon.0 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563f5bd07680 con 0x563f5bcd0c00 2024-03-04T06:45:54.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:53 smithi137 bash[96976]: bd2207652b338904451990e9e5c1da5e3c45a70e407e4661600012ba1dbb2057 2024-03-04T06:45:54.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:53 smithi137 systemd[1]: Started Ceph osd.0 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:45:54.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:53 smithi203 ceph-mon[85573]: osdmap e291: 8 total, 7 up, 8 in 2024-03-04T06:45:54.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:53 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:54.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:53 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:45:54.789 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:45:54.391+0000 7f5c7b4727c0 -1 Falling back to public interface 2024-03-04T06:45:54.856 INFO:tasks.rados.rados.0.smithi137.stdout:1185: done (2 left) 2024-03-04T06:45:54.857 INFO:tasks.rados.rados.0.smithi137.stdout:1186: snap_create 2024-03-04T06:45:54.857 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 298 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:45:54.857 INFO:tasks.rados.rados.0.smithi137.stdout:1183: expect (ObjNum 296 snap 95 seq_num 296) 2024-03-04T06:45:55.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:54 smithi137 ceph-mon[88869]: osdmap e292: 8 total, 7 up, 8 in 2024-03-04T06:45:55.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:55.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:55.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:45:55.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:54 smithi137 ceph-mon[88869]: pgmap v111: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 277 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 18 op/s; 123/717 objects degraded (17.155%) 2024-03-04T06:45:55.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:54 smithi137 ceph-mon[88869]: osdmap e293: 8 total, 7 up, 8 in 2024-03-04T06:45:55.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:54 smithi137 ceph-mon[91314]: osdmap e292: 8 total, 7 up, 8 in 2024-03-04T06:45:55.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:55.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:55.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:45:55.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:54 smithi137 ceph-mon[91314]: pgmap v111: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 277 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 18 op/s; 123/717 objects degraded (17.155%) 2024-03-04T06:45:55.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:54 smithi137 ceph-mon[91314]: osdmap e293: 8 total, 7 up, 8 in 2024-03-04T06:45:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:54 smithi203 ceph-mon[85573]: osdmap e292: 8 total, 7 up, 8 in 2024-03-04T06:45:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:45:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:54 smithi203 ceph-mon[85573]: pgmap v111: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 277 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 18 op/s; 123/717 objects degraded (17.155%) 2024-03-04T06:45:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:54 smithi203 ceph-mon[85573]: osdmap e293: 8 total, 7 up, 8 in 2024-03-04T06:45:55.615 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:45:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:45:55] "GET /metrics HTTP/1.1" 200 36133 "" "Prometheus/2.43.0" 2024-03-04T06:45:55.860 INFO:tasks.rados.rados.0.smithi137.stdout:1182: done (2 left) 2024-03-04T06:45:55.860 INFO:tasks.rados.rados.0.smithi137.stdout:1183: done (1 left) 2024-03-04T06:45:55.860 INFO:tasks.rados.rados.0.smithi137.stdout:1186: done (0 left) 2024-03-04T06:45:55.860 INFO:tasks.rados.rados.0.smithi137.stdout:1187: rollback oid 14 current snap is 117 2024-03-04T06:45:55.860 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 14 to 112 2024-03-04T06:45:55.860 INFO:tasks.rados.rados.0.smithi137.stdout:1188: snap_remove snap 111 2024-03-04T06:45:56.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:55 smithi137 ceph-mon[91314]: Health check failed: Degraded data redundancy: 123/717 objects degraded (17.155%), 15 pgs degraded (PG_DEGRADED) 2024-03-04T06:45:56.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:55 smithi137 ceph-mon[91314]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs inactive, 12 pgs peering) 2024-03-04T06:45:56.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:55 smithi137 ceph-mon[91314]: osdmap e294: 8 total, 7 up, 8 in 2024-03-04T06:45:56.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:55 smithi137 ceph-mon[88869]: Health check failed: Degraded data redundancy: 123/717 objects degraded (17.155%), 15 pgs degraded (PG_DEGRADED) 2024-03-04T06:45:56.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:55 smithi137 ceph-mon[88869]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs inactive, 12 pgs peering) 2024-03-04T06:45:56.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:55 smithi137 ceph-mon[88869]: osdmap e294: 8 total, 7 up, 8 in 2024-03-04T06:45:56.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:55 smithi203 ceph-mon[85573]: Health check failed: Degraded data redundancy: 123/717 objects degraded (17.155%), 15 pgs degraded (PG_DEGRADED) 2024-03-04T06:45:56.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:55 smithi203 ceph-mon[85573]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs inactive, 12 pgs peering) 2024-03-04T06:45:56.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:55 smithi203 ceph-mon[85573]: osdmap e294: 8 total, 7 up, 8 in 2024-03-04T06:45:56.860 INFO:tasks.rados.rados.0.smithi137.stdout:1188: done (1 left) 2024-03-04T06:45:56.860 INFO:tasks.rados.rados.0.smithi137.stdout:1189: snap_remove snap 102 2024-03-04T06:45:57.145 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:56 smithi137 ceph-mon[88869]: pgmap v114: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 277 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 18 op/s; 123/717 objects degraded (17.155%) 2024-03-04T06:45:57.145 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:56 smithi137 ceph-mon[88869]: osdmap e295: 8 total, 7 up, 8 in 2024-03-04T06:45:57.146 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:56 smithi137 ceph-mon[91314]: pgmap v114: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 277 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 18 op/s; 123/717 objects degraded (17.155%) 2024-03-04T06:45:57.146 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:56 smithi137 ceph-mon[91314]: osdmap e295: 8 total, 7 up, 8 in 2024-03-04T06:45:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:56 smithi203 ceph-mon[85573]: pgmap v114: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 277 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 18 op/s; 123/717 objects degraded (17.155%) 2024-03-04T06:45:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:56 smithi203 ceph-mon[85573]: osdmap e295: 8 total, 7 up, 8 in 2024-03-04T06:45:57.862 INFO:tasks.rados.rados.0.smithi137.stdout:1189: done (1 left) 2024-03-04T06:45:57.862 INFO:tasks.rados.rados.0.smithi137.stdout:1190: rollback oid 38 current snap is 117 2024-03-04T06:45:57.862 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 38 to 106 2024-03-04T06:45:57.862 INFO:tasks.rados.rados.0.smithi137.stdout:1187: finishing rollback tid 0 to smithi13777483-14 2024-03-04T06:45:57.862 INFO:tasks.rados.rados.0.smithi137.stdout:1187: finishing rollback tid 1 to smithi13777483-14 2024-03-04T06:45:57.863 INFO:tasks.rados.rados.0.smithi137.stdout:1187: finishing rollback tid 2 to smithi13777483-14 2024-03-04T06:45:57.863 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 526 (ObjNum 304 snap 99 seq_num 304) dirty exists 2024-03-04T06:45:57.863 INFO:tasks.rados.rados.0.smithi137.stdout:1187: done (1 left) 2024-03-04T06:45:57.863 INFO:tasks.rados.rados.0.smithi137.stdout:1191: read oid 30 snap -1 2024-03-04T06:45:57.863 INFO:tasks.rados.rados.0.smithi137.stdout:1191: expect (ObjNum 239 snap 72 seq_num 239) 2024-03-04T06:45:57.863 INFO:tasks.rados.rados.0.smithi137.stdout:1192: rollback oid 25 current snap is 117 2024-03-04T06:45:57.863 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 25 to 80 2024-03-04T06:45:57.863 INFO:tasks.rados.rados.0.smithi137.stdout:1193: read oid 15 snap -1 2024-03-04T06:45:57.863 INFO:tasks.rados.rados.0.smithi137.stdout:1193: expect (ObjNum 382 snap 116 seq_num 382) 2024-03-04T06:45:57.863 INFO:tasks.rados.rados.0.smithi137.stdout:1194: copy_from oid 1 from oid 5 current snap is 117 2024-03-04T06:45:57.863 INFO:tasks.rados.rados.0.smithi137.stdout:1195: snap_create 2024-03-04T06:45:57.877 INFO:tasks.rados.rados.0.smithi137.stdout:1190: finishing rollback tid 1 to smithi13777483-38 2024-03-04T06:45:57.877 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 503 (ObjNum 289 snap 0 seq_num 1) dirty dne 2024-03-04T06:45:57.883 INFO:tasks.rados.rados.0.smithi137.stdout:1194: finishing copy_from racing read to smithi13777483-1 2024-03-04T06:45:57.885 INFO:tasks.rados.rados.0.smithi137.stdout:1192: finishing rollback tid 0 to smithi13777483-25 2024-03-04T06:45:57.885 INFO:tasks.rados.rados.0.smithi137.stdout:1192: finishing rollback tid 1 to smithi13777483-25 2024-03-04T06:45:57.885 INFO:tasks.rados.rados.0.smithi137.stdout:1192: finishing rollback tid 2 to smithi13777483-25 2024-03-04T06:45:57.885 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 799 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:45:57.886 INFO:tasks.rados.rados.0.smithi137.stdout:1191: expect (ObjNum 239 snap 72 seq_num 239) 2024-03-04T06:45:57.958 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:45:57.573+0000 7f5c7b4727c0 -1 osd.0 286 log_to_monitors true 2024-03-04T06:45:57.997 INFO:tasks.rados.rados.0.smithi137.stdout:1194: finishing copy_from to smithi13777483-1 2024-03-04T06:45:57.997 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 637 (ObjNum 388 snap 116 seq_num 388) dirty exists 2024-03-04T06:45:57.998 INFO:tasks.rados.rados.0.smithi137.stdout:1193: expect (ObjNum 382 snap 116 seq_num 382) 2024-03-04T06:45:58.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[91314]: from='osd.0 [v2:172.21.15.137:6802/3821842792,v1:172.21.15.137:6803/3821842792]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-04T06:45:58.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[91314]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-04T06:45:58.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:58.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:58.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[91314]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-04T06:45:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[91314]: osdmap e296: 8 total, 7 up, 8 in 2024-03-04T06:45:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[91314]: from='osd.0 [v2:172.21.15.137:6802/3821842792,v1:172.21.15.137:6803/3821842792]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:45:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[91314]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:45:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[88869]: from='osd.0 [v2:172.21.15.137:6802/3821842792,v1:172.21.15.137:6803/3821842792]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-04T06:45:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[88869]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-04T06:45:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[88869]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-04T06:45:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[88869]: osdmap e296: 8 total, 7 up, 8 in 2024-03-04T06:45:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[88869]: from='osd.0 [v2:172.21.15.137:6802/3821842792,v1:172.21.15.137:6803/3821842792]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:45:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:57 smithi137 ceph-mon[88869]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:45:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:57 smithi203 ceph-mon[85573]: from='osd.0 [v2:172.21.15.137:6802/3821842792,v1:172.21.15.137:6803/3821842792]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-04T06:45:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:57 smithi203 ceph-mon[85573]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-04T06:45:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:57 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:57 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:57 smithi203 ceph-mon[85573]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-04T06:45:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:57 smithi203 ceph-mon[85573]: osdmap e296: 8 total, 7 up, 8 in 2024-03-04T06:45:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:57 smithi203 ceph-mon[85573]: from='osd.0 [v2:172.21.15.137:6802/3821842792,v1:172.21.15.137:6803/3821842792]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:45:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:57 smithi203 ceph-mon[85573]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:45:58.624 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:45:58.346+0000 7f5c688c2700 -1 osd.0 286 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:45:58.868 INFO:tasks.rados.rados.0.smithi137.stdout:1190: done (5 left) 2024-03-04T06:45:58.868 INFO:tasks.rados.rados.0.smithi137.stdout:1191: done (4 left) 2024-03-04T06:45:58.868 INFO:tasks.rados.rados.0.smithi137.stdout:1192: done (3 left) 2024-03-04T06:45:58.868 INFO:tasks.rados.rados.0.smithi137.stdout:1193: done (2 left) 2024-03-04T06:45:58.868 INFO:tasks.rados.rados.0.smithi137.stdout:1194: done (1 left) 2024-03-04T06:45:58.868 INFO:tasks.rados.rados.0.smithi137.stdout:1195: done (0 left) 2024-03-04T06:45:58.869 INFO:tasks.rados.rados.0.smithi137.stdout:1196: setattr oid 12 current snap is 118 2024-03-04T06:45:58.869 INFO:tasks.rados.rados.0.smithi137.stdout:1197: delete oid 11 current snap is 118 2024-03-04T06:45:58.879 INFO:tasks.rados.rados.0.smithi137.stdout:1197: done (1 left) 2024-03-04T06:45:58.879 INFO:tasks.rados.rados.0.smithi137.stdout:1198: snap_remove snap 85 2024-03-04T06:45:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:59 smithi203 ceph-mon[85573]: pgmap v117: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 277 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 123/717 objects degraded (17.155%) 2024-03-04T06:45:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:59 smithi203 ceph-mon[85573]: from='osd.0 ' entity='osd.0' 2024-03-04T06:45:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:59 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:59 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:59 smithi203 ceph-mon[85573]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:45:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:59 smithi203 ceph-mon[85573]: osd.0 [v2:172.21.15.137:6802/3821842792,v1:172.21.15.137:6803/3821842792] boot 2024-03-04T06:45:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:59 smithi203 ceph-mon[85573]: osdmap e297: 8 total, 8 up, 8 in 2024-03-04T06:45:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:45:59 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:45:59.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[88869]: pgmap v117: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 277 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 123/717 objects degraded (17.155%) 2024-03-04T06:45:59.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[88869]: from='osd.0 ' entity='osd.0' 2024-03-04T06:45:59.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:59.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:59.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[88869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:45:59.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[88869]: osd.0 [v2:172.21.15.137:6802/3821842792,v1:172.21.15.137:6803/3821842792] boot 2024-03-04T06:45:59.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[88869]: osdmap e297: 8 total, 8 up, 8 in 2024-03-04T06:45:59.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:45:59.679 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[91314]: pgmap v117: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 277 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 123/717 objects degraded (17.155%) 2024-03-04T06:45:59.679 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[91314]: from='osd.0 ' entity='osd.0' 2024-03-04T06:45:59.679 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:59.679 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:45:59.679 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[91314]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:45:59.679 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[91314]: osd.0 [v2:172.21.15.137:6802/3821842792,v1:172.21.15.137:6803/3821842792] boot 2024-03-04T06:45:59.680 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[91314]: osdmap e297: 8 total, 8 up, 8 in 2024-03-04T06:45:59.680 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:1198: done (1 left) 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:1199: rmattr oid 47 current snap is 118 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:1199: done (1 left) 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:1200: read oid 15 snap 106 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:1200: expect (ObjNum 326 snap 103 seq_num 326) 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:1201: read oid 23 snap -1 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:1201: expect deleted 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:1202: read oid 19 snap -1 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:1202: expect deleted 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:1203: rmattr oid 3 current snap is 118 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:1203: done (4 left) 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:1204: copy_from oid 25 from oid 21 current snap is 118 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 118 2024-03-04T06:45:59.869 INFO:tasks.rados.rados.0.smithi137.stdout:1205: seq_num 391 ranges {0=557056,557056=516096,1073152=688128} 2024-03-04T06:45:59.872 INFO:tasks.rados.rados.0.smithi137.stdout:1205: writing smithi13777483-13 from 0 to 557056 tid 1 2024-03-04T06:45:59.876 INFO:tasks.rados.rados.0.smithi137.stdout:1205: writing smithi13777483-13 from 557056 to 1073152 tid 2 2024-03-04T06:45:59.881 INFO:tasks.rados.rados.0.smithi137.stdout:1205: writing smithi13777483-13 from 1073152 to 1761280 tid 3 2024-03-04T06:45:59.881 INFO:tasks.rados.rados.0.smithi137.stdout:1201: done (5 left) 2024-03-04T06:45:59.881 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 118 2024-03-04T06:45:59.881 INFO:tasks.rados.rados.0.smithi137.stdout:1206: seq_num 392 ranges {1712128=573440,2285568=802816,3088384=401408} 2024-03-04T06:45:59.895 INFO:tasks.rados.rados.0.smithi137.stdout:1206: writing smithi13777483-1 from 1712128 to 2285568 tid 1 2024-03-04T06:45:59.901 INFO:tasks.rados.rados.0.smithi137.stdout:1206: writing smithi13777483-1 from 2285568 to 3088384 tid 2 2024-03-04T06:45:59.904 INFO:tasks.rados.rados.0.smithi137.stdout:1206: writing smithi13777483-1 from 3088384 to 3489792 tid 3 2024-03-04T06:45:59.904 INFO:tasks.rados.rados.0.smithi137.stdout:1207: setattr oid 5 current snap is 118 2024-03-04T06:45:59.904 INFO:tasks.rados.rados.0.smithi137.stdout:1205: finishing write tid 1 to smithi13777483-13 2024-03-04T06:45:59.904 INFO:tasks.rados.rados.0.smithi137.stdout:1205: finishing write tid 2 to smithi13777483-13 2024-03-04T06:45:59.904 INFO:tasks.rados.rados.0.smithi137.stdout:1205: finishing write tid 3 to smithi13777483-13 2024-03-04T06:45:59.904 INFO:tasks.rados.rados.0.smithi137.stdout:1205: finishing write tid 4 to smithi13777483-13 2024-03-04T06:45:59.904 INFO:tasks.rados.rados.0.smithi137.stdout:1205: finishing write tid 5 to smithi13777483-13 2024-03-04T06:45:59.904 INFO:tasks.rados.rados.0.smithi137.stdout:1205: oid 13 updating version 0 to 912 2024-03-04T06:45:59.904 INFO:tasks.rados.rados.0.smithi137.stdout:1205: oid 13 updating version 912 to 914 2024-03-04T06:45:59.905 INFO:tasks.rados.rados.0.smithi137.stdout:1205: oid 13 version 914 is already newer than 913 2024-03-04T06:45:59.905 INFO:tasks.rados.rados.0.smithi137.stdout:1205: oid 13 version 914 is already newer than 911 2024-03-04T06:45:59.905 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 914 (ObjNum 391 snap 118 seq_num 391) dirty exists 2024-03-04T06:45:59.905 INFO:tasks.rados.rados.0.smithi137.stdout:1205: left oid 13 (ObjNum 391 snap 118 seq_num 391) 2024-03-04T06:45:59.907 INFO:tasks.rados.rados.0.smithi137.stdout:1205: done (6 left) 2024-03-04T06:45:59.907 INFO:tasks.rados.rados.0.smithi137.stdout:1208: rollback oid 30 current snap is 118 2024-03-04T06:45:59.907 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 30 to 112 2024-03-04T06:45:59.908 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 118 2024-03-04T06:45:59.908 INFO:tasks.rados.rados.0.smithi137.stdout:1209: seq_num 393 ranges {1507328=589824,2097152=679936,2777088=524288} 2024-03-04T06:45:59.920 INFO:tasks.rados.rados.0.smithi137.stdout:1209: writing smithi13777483-8 from 1507328 to 2097152 tid 1 2024-03-04T06:45:59.925 INFO:tasks.rados.rados.0.smithi137.stdout:1209: writing smithi13777483-8 from 2097152 to 2777088 tid 2 2024-03-04T06:45:59.929 INFO:tasks.rados.rados.0.smithi137.stdout:1209: writing smithi13777483-8 from 2777088 to 3301376 tid 3 2024-03-04T06:45:59.930 INFO:tasks.rados.rados.0.smithi137.stdout:1210: rmattr oid 34 current snap is 118 2024-03-04T06:45:59.934 INFO:tasks.rados.rados.0.smithi137.stdout:1206: finishing write tid 1 to smithi13777483-1 2024-03-04T06:45:59.935 INFO:tasks.rados.rados.0.smithi137.stdout:1200: expect (ObjNum 326 snap 103 seq_num 326) 2024-03-04T06:46:00.002 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:45:59.899+0000 7f5c50091700 -1 osd.0 pg_epoch: 298 pg[5.5s0( v 286'36 (0'0,286'36] local-lis/les=297/298 n=4 ec=72/72 lis/c=297/297 les/c/f=298/298/0 sis=297) [0,1,4]p0(0) r=0 lpr=297 crt=286'36 lcod 0'0 mlcod 0'0 active+clean+snaptrim trimq=[9a~1,a0~1,a5~1,a7~1,a9~1,ab~1] ps=[6d~1,8f~1,91~1]] update_snap_map remove_oid 5:a94e4514:::smithi13777483-4:9c failed with -2 2024-03-04T06:46:00.002 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:45:59.902+0000 7f5c53097700 -1 osd.0 pg_epoch: 298 pg[5.7s2( v 298'314 (0'0,298'314] local-lis/les=297/298 n=10 ec=72/72 lis/c=297/297 les/c/f=298/298/0 sis=297) [5,1,0]p5(0) r=2 lpr=297 luod=0'0 crt=286'312 lcod 0'0 mlcod 0'0 active mbc={}] update_snap_map remove_oid 5:e41724be:::smithi13777483-12:7b failed with -2 2024-03-04T06:46:00.002 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:45:59.912+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:00.002 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:45:59.912+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:00.002 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:45:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:45:59.923+0000 7f5c4f08f700 -1 osd.0 pg_epoch: 298 pg[5.7s2( v 298'324 (0'0,298'324] local-lis/les=297/298 n=9 ec=72/72 lis/c=297/297 les/c/f=298/298/0 sis=297) [5,1,0]p5(0) r=2 lpr=297 luod=0'0 crt=298'324 mlcod 298'324 active mbc={} ps=[6d~1,8f~1,91~1,9a~1,a0~1,a5~1,a7~1]] update_snap_map remove_oid 5:e323bb3c:::smithi13777483-30:a9 failed with -2 2024-03-04T06:46:00.132 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 541 (ObjNum 354 snap 110 seq_num 354) dirty exists 2024-03-04T06:46:00.132 INFO:tasks.rados.rados.0.smithi137.stdout:1208: finishing rollback tid 0 to smithi13777483-30 2024-03-04T06:46:00.132 INFO:tasks.rados.rados.0.smithi137.stdout:1206: finishing write tid 2 to smithi13777483-1 2024-03-04T06:46:00.132 INFO:tasks.rados.rados.0.smithi137.stdout:1196: done (8 left) 2024-03-04T06:46:00.132 INFO:tasks.rados.rados.0.smithi137.stdout:1200: done (7 left) 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1202: done (6 left) 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1211: read oid 17 snap -1 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1211: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1212: snap_create 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1206: finishing write tid 3 to smithi13777483-1 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1206: finishing write tid 4 to smithi13777483-1 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1208: finishing rollback tid 1 to smithi13777483-30 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1208: finishing rollback tid 2 to smithi13777483-30 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 544 (ObjNum 239 snap 72 seq_num 239) dirty exists 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1206: finishing write tid 5 to smithi13777483-1 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1206: oid 1 updating version 0 to 638 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1206: oid 1 updating version 638 to 640 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1206: oid 1 updating version 640 to 641 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1206: oid 1 version 641 is already newer than 639 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 641 (ObjNum 392 snap 118 seq_num 392) dirty exists 2024-03-04T06:46:00.133 INFO:tasks.rados.rados.0.smithi137.stdout:1206: left oid 1 (ObjNum 392 snap 118 seq_num 392) 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:1209: finishing write tid 1 to smithi13777483-8 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:1209: finishing write tid 2 to smithi13777483-8 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:1204: finishing copy_from racing read to smithi13777483-25 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:1209: finishing write tid 3 to smithi13777483-8 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 639 (ObjNum 388 snap 116 seq_num 388) dirty exists 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:1209: finishing write tid 4 to smithi13777483-8 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:1209: finishing write tid 5 to smithi13777483-8 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:1209: oid 8 updating version 0 to 584 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:1209: oid 8 updating version 584 to 587 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:1209: oid 8 version 587 is already newer than 585 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:1209: oid 8 version 587 is already newer than 586 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 587 (ObjNum 393 snap 118 seq_num 393) dirty exists 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:1209: left oid 8 (ObjNum 393 snap 118 seq_num 393) 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:1204: finishing copy_from to smithi13777483-25 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 440 (ObjNum 296 snap 95 seq_num 296) dirty exists 2024-03-04T06:46:00.134 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 453 (ObjNum 307 snap 99 seq_num 307) dirty exists 2024-03-04T06:46:00.135 INFO:tasks.rados.rados.0.smithi137.stdout:1211: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:46:00.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:00.000+0000 7f5c4f890700 -1 osd.0 pg_epoch: 298 pg[5.es2( v 298'717 (0'0,298'717] local-lis/les=297/298 n=20 ec=72/72 lis/c=297/297 les/c/f=298/298/0 sis=297) [4,5,0]p4(0) r=2 lpr=297 luod=0'0 crt=298'717 mlcod 298'717 active mbc={}] update_snap_map remove_oid 5:73fc32c4:::smithi13777483-6:6f failed with -2 2024-03-04T06:46:00.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:00.012+0000 7f5c4f890700 -1 osd.0 pg_epoch: 298 pg[5.es2( v 298'731 (0'0,298'731] local-lis/les=297/298 n=17 ec=72/72 lis/c=297/297 les/c/f=298/298/0 sis=297) [4,5,0]p4(0) r=2 lpr=297 luod=0'0 crt=298'729 mlcod 298'729 active mbc={} ps=[6d~1,8f~1,91~1]] update_snap_map remove_oid 5:73fc32c4:::smithi13777483-6:9c failed with -2 2024-03-04T06:46:00.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:00.016+0000 7f5c5489a700 -1 osd.0 pg_epoch: 298 pg[5.cs2( v 298'801 (0'0,298'801] local-lis/les=297/298 n=24 ec=72/72 lis/c=297/297 les/c/f=298/298/0 sis=297) [1,4,0]p1(0) r=2 lpr=297 luod=0'0 crt=298'801 mlcod 298'801 active mbc={}] update_snap_map remove_oid 5:36653b08:::smithi13777483-25:7b failed with -2 2024-03-04T06:46:00.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:00.079+0000 7f5c5509b700 -1 osd.0 pg_epoch: 298 pg[5.bs1( v 298'641 (0'0,298'641] local-lis/les=297/298 n=20 ec=72/72 lis/c=297/297 les/c/f=298/298/0 sis=297) [2,0,5]p2(0) r=1 lpr=297 luod=0'0 crt=298'639 mlcod 298'639 active mbc={}] update_snap_map remove_oid 5:db43246c:::smithi13777483-19:6f failed with -2 2024-03-04T06:46:00.874 INFO:tasks.rados.rados.0.smithi137.stdout:1204: done (7 left) 2024-03-04T06:46:00.874 INFO:tasks.rados.rados.0.smithi137.stdout:1206: done (6 left) 2024-03-04T06:46:00.874 INFO:tasks.rados.rados.0.smithi137.stdout:1207: done (5 left) 2024-03-04T06:46:00.875 INFO:tasks.rados.rados.0.smithi137.stdout:1208: done (4 left) 2024-03-04T06:46:00.875 INFO:tasks.rados.rados.0.smithi137.stdout:1209: done (3 left) 2024-03-04T06:46:00.875 INFO:tasks.rados.rados.0.smithi137.stdout:1210: done (2 left) 2024-03-04T06:46:00.875 INFO:tasks.rados.rados.0.smithi137.stdout:1211: done (1 left) 2024-03-04T06:46:00.875 INFO:tasks.rados.rados.0.smithi137.stdout:1212: done (0 left) 2024-03-04T06:46:00.875 INFO:tasks.rados.rados.0.smithi137.stdout:1213: rmattr oid 41 current snap is 119 2024-03-04T06:46:00.875 INFO:tasks.rados.rados.0.smithi137.stdout:1213: done (0 left) 2024-03-04T06:46:00.875 INFO:tasks.rados.rados.0.smithi137.stdout:1214: snap_remove snap 114 2024-03-04T06:46:01.116 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:00 smithi137 ceph-mon[88869]: osdmap e298: 8 total, 8 up, 8 in 2024-03-04T06:46:01.116 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:01.116 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:00 smithi137 ceph-mon[88869]: pgmap v120: 121 pgs: 39 peering, 4 active+undersized+degraded, 10 active+undersized, 68 active+clean; 279 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 418 KiB/s wr, 3 op/s; 24/723 objects degraded (3.320%) 2024-03-04T06:46:01.117 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:00 smithi137 ceph-mon[91314]: osdmap e298: 8 total, 8 up, 8 in 2024-03-04T06:46:01.117 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:01.117 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:00 smithi137 ceph-mon[91314]: pgmap v120: 121 pgs: 39 peering, 4 active+undersized+degraded, 10 active+undersized, 68 active+clean; 279 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 418 KiB/s wr, 3 op/s; 24/723 objects degraded (3.320%) 2024-03-04T06:46:01.117 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:00.935+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:01.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:00 smithi203 ceph-mon[85573]: osdmap e298: 8 total, 8 up, 8 in 2024-03-04T06:46:01.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:01.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:00 smithi203 ceph-mon[85573]: pgmap v120: 121 pgs: 39 peering, 4 active+undersized+degraded, 10 active+undersized, 68 active+clean; 279 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 418 KiB/s wr, 3 op/s; 24/723 objects degraded (3.320%) 2024-03-04T06:46:01.880 INFO:tasks.rados.rados.0.smithi137.stdout:1214: done (0 left) 2024-03-04T06:46:01.881 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 119 2024-03-04T06:46:01.881 INFO:tasks.rados.rados.0.smithi137.stdout:1215: seq_num 394 ranges {696320=606208,1302528=565248,1867776=557056,2424832=81920} 2024-03-04T06:46:01.888 INFO:tasks.rados.rados.0.smithi137.stdout:1215: writing smithi13777483-45 from 696320 to 1302528 tid 1 2024-03-04T06:46:01.892 INFO:tasks.rados.rados.0.smithi137.stdout:1215: writing smithi13777483-45 from 1302528 to 1867776 tid 2 2024-03-04T06:46:01.896 INFO:tasks.rados.rados.0.smithi137.stdout:1215: writing smithi13777483-45 from 1867776 to 2424832 tid 3 2024-03-04T06:46:01.897 INFO:tasks.rados.rados.0.smithi137.stdout:1215: writing smithi13777483-45 from 2424832 to 2506752 tid 4 2024-03-04T06:46:01.897 INFO:tasks.rados.rados.0.smithi137.stdout:1216: delete oid 26 current snap is 119 2024-03-04T06:46:01.897 INFO:tasks.rados.rados.0.smithi137.stdout:1215: finishing write tid 1 to smithi13777483-45 2024-03-04T06:46:01.897 INFO:tasks.rados.rados.0.smithi137.stdout:1215: finishing write tid 2 to smithi13777483-45 2024-03-04T06:46:01.901 INFO:tasks.rados.rados.0.smithi137.stdout:1216: done (1 left) 2024-03-04T06:46:01.901 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 119 2024-03-04T06:46:01.901 INFO:tasks.rados.rados.0.smithi137.stdout:1215: finishing write tid 3 to smithi13777483-45 2024-03-04T06:46:01.901 INFO:tasks.rados.rados.0.smithi137.stdout:1217: seq_num 396 ranges {139264=638976,778240=786432,1564672=417792} 2024-03-04T06:46:01.905 INFO:tasks.rados.rados.0.smithi137.stdout:1217: writing smithi13777483-18 from 139264 to 778240 tid 1 2024-03-04T06:46:01.911 INFO:tasks.rados.rados.0.smithi137.stdout:1217: writing smithi13777483-18 from 778240 to 1564672 tid 2 2024-03-04T06:46:01.914 INFO:tasks.rados.rados.0.smithi137.stdout:1217: writing smithi13777483-18 from 1564672 to 1982464 tid 3 2024-03-04T06:46:01.914 INFO:tasks.rados.rados.0.smithi137.stdout:1218: delete oid 1 current snap is 119 2024-03-04T06:46:01.914 INFO:tasks.rados.rados.0.smithi137.stdout:1215: finishing write tid 4 to smithi13777483-45 2024-03-04T06:46:01.914 INFO:tasks.rados.rados.0.smithi137.stdout:1215: finishing write tid 5 to smithi13777483-45 2024-03-04T06:46:01.914 INFO:tasks.rados.rados.0.smithi137.stdout:1215: finishing write tid 6 to smithi13777483-45 2024-03-04T06:46:01.914 INFO:tasks.rados.rados.0.smithi137.stdout:1215: oid 45 updating version 0 to 275 2024-03-04T06:46:01.914 INFO:tasks.rados.rados.0.smithi137.stdout:1215: oid 45 updating version 275 to 276 2024-03-04T06:46:01.914 INFO:tasks.rados.rados.0.smithi137.stdout:1215: oid 45 updating version 276 to 278 2024-03-04T06:46:01.914 INFO:tasks.rados.rados.0.smithi137.stdout:1215: oid 45 updating version 278 to 279 2024-03-04T06:46:01.915 INFO:tasks.rados.rados.0.smithi137.stdout:1215: oid 45 version 279 is already newer than 277 2024-03-04T06:46:01.915 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 279 (ObjNum 394 snap 119 seq_num 394) dirty exists 2024-03-04T06:46:01.915 INFO:tasks.rados.rados.0.smithi137.stdout:1215: left oid 45 (ObjNum 394 snap 119 seq_num 394) 2024-03-04T06:46:01.915 INFO:tasks.rados.rados.0.smithi137.stdout:1217: finishing write tid 1 to smithi13777483-18 2024-03-04T06:46:01.916 INFO:tasks.rados.rados.0.smithi137.stdout:1217: finishing write tid 2 to smithi13777483-18 2024-03-04T06:46:01.917 INFO:tasks.rados.rados.0.smithi137.stdout:1217: finishing write tid 3 to smithi13777483-18 2024-03-04T06:46:01.917 INFO:tasks.rados.rados.0.smithi137.stdout:1215: done (2 left) 2024-03-04T06:46:01.917 INFO:tasks.rados.rados.0.smithi137.stdout:1218: done (1 left) 2024-03-04T06:46:01.918 INFO:tasks.rados.rados.0.smithi137.stdout:1219: copy_from oid 4 from oid 1 current snap is 119 2024-03-04T06:46:01.918 INFO:tasks.rados.rados.0.smithi137.stdout:1217: finishing write tid 4 to smithi13777483-18 2024-03-04T06:46:01.918 INFO:tasks.rados.rados.0.smithi137.stdout:1220: snap_create 2024-03-04T06:46:01.919 INFO:tasks.rados.rados.0.smithi137.stdout:1217: finishing write tid 5 to smithi13777483-18 2024-03-04T06:46:01.919 INFO:tasks.rados.rados.0.smithi137.stdout:1217: oid 18 updating version 0 to 509 2024-03-04T06:46:01.919 INFO:tasks.rados.rados.0.smithi137.stdout:1217: oid 18 version 509 is already newer than 508 2024-03-04T06:46:01.919 INFO:tasks.rados.rados.0.smithi137.stdout:1217: oid 18 updating version 509 to 511 2024-03-04T06:46:01.919 INFO:tasks.rados.rados.0.smithi137.stdout:1217: oid 18 version 511 is already newer than 510 2024-03-04T06:46:01.919 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 511 (ObjNum 396 snap 119 seq_num 396) dirty exists 2024-03-04T06:46:01.920 INFO:tasks.rados.rados.0.smithi137.stdout:1217: left oid 18 (ObjNum 396 snap 119 seq_num 396) 2024-03-04T06:46:01.920 INFO:tasks.rados.rados.0.smithi137.stdout:1219: finishing copy_from to smithi13777483-4 2024-03-04T06:46:01.920 INFO:tasks.rados.rados.0.smithi137.stdout:1219: got expected ENOENT (src dne) 2024-03-04T06:46:01.920 INFO:tasks.rados.rados.0.smithi137.stdout:1219: finishing copy_from racing read to smithi13777483-4 2024-03-04T06:46:02.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:01 smithi203 ceph-mon[85573]: Health check update: Degraded data redundancy: 24/723 objects degraded (3.320%), 4 pgs degraded (PG_DEGRADED) 2024-03-04T06:46:02.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:01 smithi203 ceph-mon[85573]: osdmap e299: 8 total, 8 up, 8 in 2024-03-04T06:46:02.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:02.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:01 smithi137 ceph-mon[91314]: Health check update: Degraded data redundancy: 24/723 objects degraded (3.320%), 4 pgs degraded (PG_DEGRADED) 2024-03-04T06:46:02.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:01 smithi137 ceph-mon[91314]: osdmap e299: 8 total, 8 up, 8 in 2024-03-04T06:46:02.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:02.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:01 smithi137 ceph-mon[88869]: Health check update: Degraded data redundancy: 24/723 objects degraded (3.320%), 4 pgs degraded (PG_DEGRADED) 2024-03-04T06:46:02.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:01 smithi137 ceph-mon[88869]: osdmap e299: 8 total, 8 up, 8 in 2024-03-04T06:46:02.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:02.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:01.890+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:02.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:01.890+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:02.890 INFO:tasks.rados.rados.0.smithi137.stdout:1217: done (2 left) 2024-03-04T06:46:02.890 INFO:tasks.rados.rados.0.smithi137.stdout:1219: done (1 left) 2024-03-04T06:46:02.890 INFO:tasks.rados.rados.0.smithi137.stdout:1220: done (0 left) 2024-03-04T06:46:02.890 INFO:tasks.rados.rados.0.smithi137.stdout:1221: setattr oid 25 current snap is 120 2024-03-04T06:46:02.892 INFO:tasks.rados.rados.0.smithi137.stdout:1222: setattr oid 47 current snap is 120 2024-03-04T06:46:02.894 INFO:tasks.rados.rados.0.smithi137.stdout:1223: snap_create 2024-03-04T06:46:02.899 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 837 (ObjNum 296 snap 95 seq_num 296) dirty exists 2024-03-04T06:46:02.900 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 839 (ObjNum 335 snap 106 seq_num 335) dirty exists 2024-03-04T06:46:03.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:02 smithi203 ceph-mon[85573]: osdmap e300: 8 total, 8 up, 8 in 2024-03-04T06:46:03.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:03.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:02 smithi203 ceph-mon[85573]: pgmap v123: 121 pgs: 39 peering, 4 active+undersized+degraded, 10 active+undersized, 68 active+clean; 279 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 418 KiB/s wr, 3 op/s; 24/723 objects degraded (3.320%) 2024-03-04T06:46:03.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:02 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:03.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:02 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:03.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:02 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:46:03.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:02 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:46:03.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:46:03.021+0000 7fca9a02c700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-03-04T06:46:03.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:02.898+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[88869]: osdmap e300: 8 total, 8 up, 8 in 2024-03-04T06:46:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[88869]: pgmap v123: 121 pgs: 39 peering, 4 active+undersized+degraded, 10 active+undersized, 68 active+clean; 279 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 418 KiB/s wr, 3 op/s; 24/723 objects degraded (3.320%) 2024-03-04T06:46:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:46:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:46:03.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[91314]: osdmap e300: 8 total, 8 up, 8 in 2024-03-04T06:46:03.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:03.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[91314]: pgmap v123: 121 pgs: 39 peering, 4 active+undersized+degraded, 10 active+undersized, 68 active+clean; 279 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 418 KiB/s wr, 3 op/s; 24/723 objects degraded (3.320%) 2024-03-04T06:46:03.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:03.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:46:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:02 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:46:03.900 INFO:tasks.rados.rados.0.smithi137.stdout:1221: done (2 left) 2024-03-04T06:46:03.900 INFO:tasks.rados.rados.0.smithi137.stdout:1222: done (1 left) 2024-03-04T06:46:03.900 INFO:tasks.rados.rados.0.smithi137.stdout:1223: done (0 left) 2024-03-04T06:46:03.900 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 121 2024-03-04T06:46:03.900 INFO:tasks.rados.rados.0.smithi137.stdout:1224: seq_num 398 ranges {1523712=671744,2195456=557056,2752512=532480,3284992=114688} 2024-03-04T06:46:03.913 INFO:tasks.rados.rados.0.smithi137.stdout:1224: writing smithi13777483-7 from 1523712 to 2195456 tid 1 2024-03-04T06:46:03.916 INFO:tasks.rados.rados.0.smithi137.stdout:1224: writing smithi13777483-7 from 2195456 to 2752512 tid 2 2024-03-04T06:46:03.920 INFO:tasks.rados.rados.0.smithi137.stdout:1224: writing smithi13777483-7 from 2752512 to 3284992 tid 3 2024-03-04T06:46:03.921 INFO:tasks.rados.rados.0.smithi137.stdout:1224: writing smithi13777483-7 from 3284992 to 3399680 tid 4 2024-03-04T06:46:03.921 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 121 2024-03-04T06:46:03.921 INFO:tasks.rados.rados.0.smithi137.stdout:1224: finishing write tid 1 to smithi13777483-7 2024-03-04T06:46:03.921 INFO:tasks.rados.rados.0.smithi137.stdout:1224: finishing write tid 2 to smithi13777483-7 2024-03-04T06:46:03.921 INFO:tasks.rados.rados.0.smithi137.stdout:1225: seq_num 399 ranges {0=688128,688128=434176,1122304=745472,1867776=24576} 2024-03-04T06:46:03.925 INFO:tasks.rados.rados.0.smithi137.stdout:1225: writing smithi13777483-32 from 0 to 688128 tid 1 2024-03-04T06:46:03.928 INFO:tasks.rados.rados.0.smithi137.stdout:1225: writing smithi13777483-32 from 688128 to 1122304 tid 2 2024-03-04T06:46:03.933 INFO:tasks.rados.rados.0.smithi137.stdout:1225: writing smithi13777483-32 from 1122304 to 1867776 tid 3 2024-03-04T06:46:03.933 INFO:tasks.rados.rados.0.smithi137.stdout:1225: writing smithi13777483-32 from 1867776 to 1892352 tid 4 2024-03-04T06:46:03.933 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 121 2024-03-04T06:46:03.933 INFO:tasks.rados.rados.0.smithi137.stdout:1224: finishing write tid 3 to smithi13777483-7 2024-03-04T06:46:03.933 INFO:tasks.rados.rados.0.smithi137.stdout:1226: seq_num 400 ranges {1572864=704512,2277376=720896,2998272=483328} 2024-03-04T06:46:03.945 INFO:tasks.rados.rados.0.smithi137.stdout:1226: writing smithi13777483-34 from 1572864 to 2277376 tid 1 2024-03-04T06:46:03.950 INFO:tasks.rados.rados.0.smithi137.stdout:1226: writing smithi13777483-34 from 2277376 to 2998272 tid 2 2024-03-04T06:46:03.953 INFO:tasks.rados.rados.0.smithi137.stdout:1226: writing smithi13777483-34 from 2998272 to 3481600 tid 3 2024-03-04T06:46:03.953 INFO:tasks.rados.rados.0.smithi137.stdout:1227: snap_create 2024-03-04T06:46:03.953 INFO:tasks.rados.rados.0.smithi137.stdout:1224: finishing write tid 4 to smithi13777483-7 2024-03-04T06:46:03.953 INFO:tasks.rados.rados.0.smithi137.stdout:1224: finishing write tid 5 to smithi13777483-7 2024-03-04T06:46:03.953 INFO:tasks.rados.rados.0.smithi137.stdout:1224: finishing write tid 6 to smithi13777483-7 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1224: oid 7 updating version 0 to 592 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1224: oid 7 version 592 is already newer than 590 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1224: oid 7 version 592 is already newer than 591 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1224: oid 7 version 592 is already newer than 589 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1224: oid 7 version 592 is already newer than 588 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 592 (ObjNum 398 snap 121 seq_num 398) dirty exists 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1224: left oid 7 (ObjNum 398 snap 121 seq_num 398) 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1225: finishing write tid 1 to smithi13777483-32 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1225: finishing write tid 2 to smithi13777483-32 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1225: finishing write tid 3 to smithi13777483-32 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1225: finishing write tid 4 to smithi13777483-32 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1225: finishing write tid 5 to smithi13777483-32 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1225: finishing write tid 6 to smithi13777483-32 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1225: oid 32 updating version 0 to 935 2024-03-04T06:46:03.954 INFO:tasks.rados.rados.0.smithi137.stdout:1225: oid 32 version 935 is already newer than 932 2024-03-04T06:46:03.955 INFO:tasks.rados.rados.0.smithi137.stdout:1225: oid 32 version 935 is already newer than 933 2024-03-04T06:46:03.955 INFO:tasks.rados.rados.0.smithi137.stdout:1225: oid 32 version 935 is already newer than 931 2024-03-04T06:46:03.955 INFO:tasks.rados.rados.0.smithi137.stdout:1225: oid 32 version 935 is already newer than 934 2024-03-04T06:46:03.955 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 935 (ObjNum 399 snap 121 seq_num 399) dirty exists 2024-03-04T06:46:03.955 INFO:tasks.rados.rados.0.smithi137.stdout:1225: left oid 32 (ObjNum 399 snap 121 seq_num 399) 2024-03-04T06:46:03.958 INFO:tasks.rados.rados.0.smithi137.stdout:1226: finishing write tid 1 to smithi13777483-34 2024-03-04T06:46:03.958 INFO:tasks.rados.rados.0.smithi137.stdout:1226: finishing write tid 2 to smithi13777483-34 2024-03-04T06:46:03.964 INFO:tasks.rados.rados.0.smithi137.stdout:1226: finishing write tid 3 to smithi13777483-34 2024-03-04T06:46:03.964 INFO:tasks.rados.rados.0.smithi137.stdout:1226: finishing write tid 4 to smithi13777483-34 2024-03-04T06:46:03.966 INFO:tasks.rados.rados.0.smithi137.stdout:1226: finishing write tid 5 to smithi13777483-34 2024-03-04T06:46:03.967 INFO:tasks.rados.rados.0.smithi137.stdout:1226: oid 34 updating version 0 to 4969 2024-03-04T06:46:03.967 INFO:tasks.rados.rados.0.smithi137.stdout:1226: oid 34 updating version 4969 to 4970 2024-03-04T06:46:03.967 INFO:tasks.rados.rados.0.smithi137.stdout:1226: oid 34 version 4970 is already newer than 4963 2024-03-04T06:46:03.967 INFO:tasks.rados.rados.0.smithi137.stdout:1226: oid 34 version 4970 is already newer than 4968 2024-03-04T06:46:03.967 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 4970 (ObjNum 400 snap 121 seq_num 400) dirty exists 2024-03-04T06:46:03.967 INFO:tasks.rados.rados.0.smithi137.stdout:1226: left oid 34 (ObjNum 400 snap 121 seq_num 400) 2024-03-04T06:46:04.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:03.898+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:04.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:03.898+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:04.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[91314]: osdmap e301: 8 total, 8 up, 8 in 2024-03-04T06:46:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:46:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-04T06:46:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-04T06:46:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[91314]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-03-04T06:46:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[88869]: osdmap e301: 8 total, 8 up, 8 in 2024-03-04T06:46:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:46:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-04T06:46:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-04T06:46:04.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:03 smithi137 ceph-mon[88869]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-03-04T06:46:04.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:03 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:03 smithi203 ceph-mon[85573]: osdmap e301: 8 total, 8 up, 8 in 2024-03-04T06:46:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:03 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:46:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:03 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:03 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:03 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:03 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-04T06:46:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:03 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-04T06:46:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:03 smithi203 ceph-mon[85573]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-03-04T06:46:04.907 INFO:tasks.rados.rados.0.smithi137.stdout:1224: done (3 left) 2024-03-04T06:46:04.907 INFO:tasks.rados.rados.0.smithi137.stdout:1225: done (2 left) 2024-03-04T06:46:04.907 INFO:tasks.rados.rados.0.smithi137.stdout:1226: done (1 left) 2024-03-04T06:46:04.907 INFO:tasks.rados.rados.0.smithi137.stdout:1227: done (0 left) 2024-03-04T06:46:04.907 INFO:tasks.rados.rados.0.smithi137.stdout:1228: delete oid 40 current snap is 122 2024-03-04T06:46:04.914 INFO:tasks.rados.rados.0.smithi137.stdout:1228: done (0 left) 2024-03-04T06:46:04.914 INFO:tasks.rados.rados.0.smithi137.stdout:1229: snap_remove snap 104 2024-03-04T06:46:05.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:04.914+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:04 smithi137 ceph-mon[91314]: osdmap e302: 8 total, 8 up, 8 in 2024-03-04T06:46:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:04 smithi137 ceph-mon[91314]: pgmap v126: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 275 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 34 op/s; 10 MiB/s, 3 objects/s recovering 2024-03-04T06:46:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:46:04.893+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg snaptrim_error (PG_DAMAGED) 2024-03-04T06:46:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:04 smithi137 ceph-mon[88869]: osdmap e302: 8 total, 8 up, 8 in 2024-03-04T06:46:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:04 smithi137 ceph-mon[88869]: pgmap v126: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 275 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 34 op/s; 10 MiB/s, 3 objects/s recovering 2024-03-04T06:46:05.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:05.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:04 smithi203 ceph-mon[85573]: osdmap e302: 8 total, 8 up, 8 in 2024-03-04T06:46:05.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:04 smithi203 ceph-mon[85573]: pgmap v126: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 275 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 34 op/s; 10 MiB/s, 3 objects/s recovering 2024-03-04T06:46:05.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:46:05] "GET /metrics HTTP/1.1" 200 36133 "" "Prometheus/2.43.0" 2024-03-04T06:46:05.911 INFO:tasks.rados.rados.0.smithi137.stdout:1229: done (0 left) 2024-03-04T06:46:05.911 INFO:tasks.rados.rados.0.smithi137.stdout:1230: snap_remove snap 106 2024-03-04T06:46:06.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-mon[88869]: Health check failed: Possible data damage: 1 pg snaptrim_error (PG_DAMAGED) 2024-03-04T06:46:06.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-mon[88869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/723 objects degraded (3.320%), 4 pgs degraded) 2024-03-04T06:46:06.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-mon[88869]: osdmap e303: 8 total, 8 up, 8 in 2024-03-04T06:46:06.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-mon[91314]: Health check failed: Possible data damage: 1 pg snaptrim_error (PG_DAMAGED) 2024-03-04T06:46:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-mon[91314]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/723 objects degraded (3.320%), 4 pgs degraded) 2024-03-04T06:46:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-mon[91314]: osdmap e303: 8 total, 8 up, 8 in 2024-03-04T06:46:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:06.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:05.915+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:06.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:05.915+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:06.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:05.916+0000 7f5c53097700 -1 osd.0 pg_epoch: 304 pg[5.7s2( v 300'332 (0'0,300'332] local-lis/les=297/298 n=8 ec=72/72 lis/c=297/297 les/c/f=298/298/0 sis=297) [5,1,0]p5(0) r=2 lpr=297 luod=0'0 crt=300'332 mlcod 300'332 active mbc={} ps=[6d~1,8f~1,91~1,9a~1,a0~1,a5~1,a7~1,a9~1,ab~2]] update_snap_map remove_oid 5:e41724be:::smithi13777483-12:a2 failed with -2 2024-03-04T06:46:06.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:05.923+0000 7f5c51894700 -1 osd.0 pg_epoch: 304 pg[5.2s1( v 304'278 (0'0,304'278] local-lis/les=297/298 n=6 ec=72/72 lis/c=297/297 les/c/f=298/298/0 sis=297) [6,0,5]p6(0) r=1 lpr=297 luod=0'0 crt=298'276 lcod 298'276 mlcod 298'276 active mbc={} ps=[6d~1,8f~1,91~1,9a~1,a0~1,a5~1,a7~1,a9~1,ab~2]] update_snap_map remove_oid 5:449e7577:::smithi13777483-24:a2 failed with -2 2024-03-04T06:46:06.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:05.932+0000 7f5c5509b700 -1 osd.0 pg_epoch: 304 pg[5.bs1( v 304'673 (0'0,304'673] local-lis/les=297/298 n=17 ec=72/72 lis/c=297/297 les/c/f=298/298/0 sis=297) [2,0,5]p2(0) r=1 lpr=297 luod=0'0 crt=304'673 mlcod 304'673 active mbc={} ps=[6d~1,8f~1,91~1,9a~1,a0~1,a5~1,a7~1,a9~1,ab~2]] update_snap_map remove_oid 5:db43246c:::smithi13777483-19:a3 failed with -2 2024-03-04T06:46:06.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:05 smithi203 ceph-mon[85573]: Health check failed: Possible data damage: 1 pg snaptrim_error (PG_DAMAGED) 2024-03-04T06:46:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:05 smithi203 ceph-mon[85573]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/723 objects degraded (3.320%), 4 pgs degraded) 2024-03-04T06:46:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:05 smithi203 ceph-mon[85573]: osdmap e303: 8 total, 8 up, 8 in 2024-03-04T06:46:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:06.917 INFO:tasks.rados.rados.0.smithi137.stdout:1230: done (0 left) 2024-03-04T06:46:06.918 INFO:tasks.rados.rados.0.smithi137.stdout:1231: snap_remove snap 116 2024-03-04T06:46:07.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:06 smithi137 ceph-mon[88869]: osdmap e304: 8 total, 8 up, 8 in 2024-03-04T06:46:07.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:06 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:07.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:06 smithi137 ceph-mon[88869]: pgmap v129: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 275 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 34 op/s; 10 MiB/s, 3 objects/s recovering 2024-03-04T06:46:07.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:06 smithi137 ceph-mon[91314]: osdmap e304: 8 total, 8 up, 8 in 2024-03-04T06:46:07.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:06 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:07.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:06 smithi137 ceph-mon[91314]: pgmap v129: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 275 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 34 op/s; 10 MiB/s, 3 objects/s recovering 2024-03-04T06:46:07.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:06.923+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:07.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:06 smithi203 ceph-mon[85573]: osdmap e304: 8 total, 8 up, 8 in 2024-03-04T06:46:07.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:06 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:07.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:06 smithi203 ceph-mon[85573]: pgmap v129: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 275 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 34 op/s; 10 MiB/s, 3 objects/s recovering 2024-03-04T06:46:07.918 INFO:tasks.rados.rados.0.smithi137.stdout:1231: done (0 left) 2024-03-04T06:46:07.919 INFO:tasks.rados.rados.0.smithi137.stdout:1232: delete oid 34 current snap is 122 2024-03-04T06:46:07.931 INFO:tasks.rados.rados.0.smithi137.stdout:1232: done (0 left) 2024-03-04T06:46:07.931 INFO:tasks.rados.rados.0.smithi137.stdout:1233: read oid 33 snap -1 2024-03-04T06:46:07.931 INFO:tasks.rados.rados.0.smithi137.stdout:1233: expect deleted 2024-03-04T06:46:07.932 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 48 current snap is 122 2024-03-04T06:46:07.932 INFO:tasks.rados.rados.0.smithi137.stdout:1234: seq_num 403 ranges {3809280=753664,4562944=425984,4988928=720896,5709824=57344} 2024-03-04T06:46:07.957 INFO:tasks.rados.rados.0.smithi137.stdout:1234: writing smithi13777483-48 from 3809280 to 4562944 tid 1 2024-03-04T06:46:07.960 INFO:tasks.rados.rados.0.smithi137.stdout:1234: writing smithi13777483-48 from 4562944 to 4988928 tid 2 2024-03-04T06:46:07.965 INFO:tasks.rados.rados.0.smithi137.stdout:1234: writing smithi13777483-48 from 4988928 to 5709824 tid 3 2024-03-04T06:46:07.965 INFO:tasks.rados.rados.0.smithi137.stdout:1234: writing smithi13777483-48 from 5709824 to 5767168 tid 4 2024-03-04T06:46:07.965 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 5 current snap is 122 2024-03-04T06:46:07.965 INFO:tasks.rados.rados.0.smithi137.stdout:1235: seq_num 404 ranges {1712128=770048,2482176=712704,3194880=491520} 2024-03-04T06:46:07.980 INFO:tasks.rados.rados.0.smithi137.stdout:1235: writing smithi13777483-5 from 1712128 to 2482176 tid 1 2024-03-04T06:46:07.984 INFO:tasks.rados.rados.0.smithi137.stdout:1235: writing smithi13777483-5 from 2482176 to 3194880 tid 2 2024-03-04T06:46:07.988 INFO:tasks.rados.rados.0.smithi137.stdout:1235: writing smithi13777483-5 from 3194880 to 3686400 tid 3 2024-03-04T06:46:07.988 INFO:tasks.rados.rados.0.smithi137.stdout:1236: read oid 42 snap -1 2024-03-04T06:46:07.988 INFO:tasks.rados.rados.0.smithi137.stdout:1236: expect (ObjNum 364 snap 111 seq_num 364) 2024-03-04T06:46:07.988 INFO:tasks.rados.rados.0.smithi137.stdout:1237: read oid 25 snap 119 2024-03-04T06:46:07.988 INFO:tasks.rados.rados.0.smithi137.stdout:1237: expect (ObjNum 296 snap 95 seq_num 296) 2024-03-04T06:46:07.988 INFO:tasks.rados.rados.0.smithi137.stdout:1238: delete oid 29 current snap is 122 2024-03-04T06:46:07.989 INFO:tasks.rados.rados.0.smithi137.stdout:1234: finishing write tid 1 to smithi13777483-48 2024-03-04T06:46:07.989 INFO:tasks.rados.rados.0.smithi137.stdout:1234: finishing write tid 2 to smithi13777483-48 2024-03-04T06:46:07.989 INFO:tasks.rados.rados.0.smithi137.stdout:1234: finishing write tid 3 to smithi13777483-48 2024-03-04T06:46:07.989 INFO:tasks.rados.rados.0.smithi137.stdout:1234: finishing write tid 4 to smithi13777483-48 2024-03-04T06:46:07.989 INFO:tasks.rados.rados.0.smithi137.stdout:1234: finishing write tid 5 to smithi13777483-48 2024-03-04T06:46:07.989 INFO:tasks.rados.rados.0.smithi137.stdout:1234: finishing write tid 6 to smithi13777483-48 2024-03-04T06:46:07.989 INFO:tasks.rados.rados.0.smithi137.stdout:1234: oid 48 updating version 0 to 645 2024-03-04T06:46:07.989 INFO:tasks.rados.rados.0.smithi137.stdout:1234: oid 48 version 645 is already newer than 643 2024-03-04T06:46:07.989 INFO:tasks.rados.rados.0.smithi137.stdout:1234: oid 48 updating version 645 to 646 2024-03-04T06:46:07.989 INFO:tasks.rados.rados.0.smithi137.stdout:1234: oid 48 updating version 646 to 647 2024-03-04T06:46:07.989 INFO:tasks.rados.rados.0.smithi137.stdout:1234: oid 48 version 647 is already newer than 644 2024-03-04T06:46:07.989 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 647 (ObjNum 403 snap 122 seq_num 403) dirty exists 2024-03-04T06:46:07.989 INFO:tasks.rados.rados.0.smithi137.stdout:1234: left oid 48 (ObjNum 403 snap 122 seq_num 403) 2024-03-04T06:46:07.990 INFO:tasks.rados.rados.0.smithi137.stdout:1233: done (5 left) 2024-03-04T06:46:07.990 INFO:tasks.rados.rados.0.smithi137.stdout:1234: done (4 left) 2024-03-04T06:46:07.990 INFO:tasks.rados.rados.0.smithi137.stdout:1238: done (3 left) 2024-03-04T06:46:07.990 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 122 2024-03-04T06:46:07.990 INFO:tasks.rados.rados.0.smithi137.stdout:1239: seq_num 406 ranges {2465792=802816,3268608=475136,3743744=499712,4243456=229376} 2024-03-04T06:46:08.009 INFO:tasks.rados.rados.0.smithi137.stdout:1239: writing smithi13777483-21 from 2465792 to 3268608 tid 1 2024-03-04T06:46:08.012 INFO:tasks.rados.rados.0.smithi137.stdout:1239: writing smithi13777483-21 from 3268608 to 3743744 tid 2 2024-03-04T06:46:08.015 INFO:tasks.rados.rados.0.smithi137.stdout:1239: writing smithi13777483-21 from 3743744 to 4243456 tid 3 2024-03-04T06:46:08.017 INFO:tasks.rados.rados.0.smithi137.stdout:1239: writing smithi13777483-21 from 4243456 to 4472832 tid 4 2024-03-04T06:46:08.017 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 28 current snap is 122 2024-03-04T06:46:08.017 INFO:tasks.rados.rados.0.smithi137.stdout:1240: seq_num 407 ranges {0=425984,425984=761856,1187840=704512,1892352=139264} 2024-03-04T06:46:08.020 INFO:tasks.rados.rados.0.smithi137.stdout:1240: writing smithi13777483-28 from 0 to 425984 tid 1 2024-03-04T06:46:08.025 INFO:tasks.rados.rados.0.smithi137.stdout:1240: writing smithi13777483-28 from 425984 to 1187840 tid 2 2024-03-04T06:46:08.030 INFO:tasks.rados.rados.0.smithi137.stdout:1240: writing smithi13777483-28 from 1187840 to 1892352 tid 3 2024-03-04T06:46:08.031 INFO:tasks.rados.rados.0.smithi137.stdout:1240: writing smithi13777483-28 from 1892352 to 2031616 tid 4 2024-03-04T06:46:08.031 INFO:tasks.rados.rados.0.smithi137.stdout:1241: rollback oid 24 current snap is 122 2024-03-04T06:46:08.031 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 24 to 121 2024-03-04T06:46:08.031 INFO:tasks.rados.rados.0.smithi137.stdout:1235: finishing write tid 1 to smithi13777483-5 2024-03-04T06:46:08.031 INFO:tasks.rados.rados.0.smithi137.stdout:1236: expect (ObjNum 364 snap 111 seq_num 364) 2024-03-04T06:46:08.113 INFO:tasks.rados.rados.0.smithi137.stdout:1237: expect (ObjNum 296 snap 95 seq_num 296) 2024-03-04T06:46:08.239 INFO:tasks.rados.rados.0.smithi137.stdout:1235: finishing write tid 2 to smithi13777483-5 2024-03-04T06:46:08.240 INFO:tasks.rados.rados.0.smithi137.stdout:1235: finishing write tid 3 to smithi13777483-5 2024-03-04T06:46:08.240 INFO:tasks.rados.rados.0.smithi137.stdout:1235: finishing write tid 4 to smithi13777483-5 2024-03-04T06:46:08.240 INFO:tasks.rados.rados.0.smithi137.stdout:1235: finishing write tid 5 to smithi13777483-5 2024-03-04T06:46:08.240 INFO:tasks.rados.rados.0.smithi137.stdout:1235: oid 5 updating version 0 to 689 2024-03-04T06:46:08.240 INFO:tasks.rados.rados.0.smithi137.stdout:1235: oid 5 updating version 689 to 691 2024-03-04T06:46:08.240 INFO:tasks.rados.rados.0.smithi137.stdout:1235: oid 5 updating version 691 to 692 2024-03-04T06:46:08.240 INFO:tasks.rados.rados.0.smithi137.stdout:1235: oid 5 version 692 is already newer than 690 2024-03-04T06:46:08.240 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 692 (ObjNum 404 snap 122 seq_num 404) dirty exists 2024-03-04T06:46:08.240 INFO:tasks.rados.rados.0.smithi137.stdout:1235: left oid 5 (ObjNum 404 snap 122 seq_num 404) 2024-03-04T06:46:08.240 INFO:tasks.rados.rados.0.smithi137.stdout:1239: finishing write tid 1 to smithi13777483-21 2024-03-04T06:46:08.240 INFO:tasks.rados.rados.0.smithi137.stdout:1239: finishing write tid 2 to smithi13777483-21 2024-03-04T06:46:08.240 INFO:tasks.rados.rados.0.smithi137.stdout:1239: finishing write tid 3 to smithi13777483-21 2024-03-04T06:46:08.240 INFO:tasks.rados.rados.0.smithi137.stdout:1235: done (5 left) 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1236: done (4 left) 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1237: done (3 left) 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1242: setattr oid 47 current snap is 122 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1239: finishing write tid 4 to smithi13777483-21 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1239: finishing write tid 5 to smithi13777483-21 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1240: finishing write tid 1 to smithi13777483-28 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1239: finishing write tid 6 to smithi13777483-21 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1239: oid 21 updating version 0 to 852 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1239: oid 21 updating version 852 to 854 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1239: oid 21 version 854 is already newer than 853 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1239: oid 21 version 854 is already newer than 851 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1239: oid 21 updating version 854 to 855 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 855 (ObjNum 406 snap 122 seq_num 406) dirty exists 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1239: left oid 21 (ObjNum 406 snap 122 seq_num 406) 2024-03-04T06:46:08.241 INFO:tasks.rados.rados.0.smithi137.stdout:1240: finishing write tid 2 to smithi13777483-28 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:1241: finishing rollback tid 0 to smithi13777483-24 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:1241: finishing rollback tid 1 to smithi13777483-24 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:1241: finishing rollback tid 2 to smithi13777483-24 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 288 (ObjNum 348 snap 110 seq_num 348) dirty exists 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:1240: finishing write tid 3 to smithi13777483-28 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:1240: finishing write tid 4 to smithi13777483-28 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:1240: finishing write tid 5 to smithi13777483-28 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:1240: finishing write tid 6 to smithi13777483-28 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:1240: oid 28 updating version 0 to 856 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:1240: oid 28 updating version 856 to 858 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:1240: oid 28 version 858 is already newer than 857 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:1240: oid 28 updating version 858 to 859 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:1240: oid 28 updating version 859 to 860 2024-03-04T06:46:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 860 (ObjNum 407 snap 122 seq_num 407) dirty exists 2024-03-04T06:46:08.243 INFO:tasks.rados.rados.0.smithi137.stdout:1240: left oid 28 (ObjNum 407 snap 122 seq_num 407) 2024-03-04T06:46:08.243 INFO:tasks.rados.rados.0.smithi137.stdout:1239: done (3 left) 2024-03-04T06:46:08.243 INFO:tasks.rados.rados.0.smithi137.stdout:1240: done (2 left) 2024-03-04T06:46:08.243 INFO:tasks.rados.rados.0.smithi137.stdout:1241: done (1 left) 2024-03-04T06:46:08.243 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 122 2024-03-04T06:46:08.243 INFO:tasks.rados.rados.0.smithi137.stdout:1243: seq_num 408 ranges {0=442368,442368=647168,1089536=507904,1597440=450560} 2024-03-04T06:46:08.244 INFO:tasks.rados.rados.0.smithi137.stdout:1243: writing smithi13777483-34 from 0 to 442368 tid 1 2024-03-04T06:46:08.247 INFO:tasks.rados.rados.0.smithi137.stdout:1243: writing smithi13777483-34 from 442368 to 1089536 tid 2 2024-03-04T06:46:08.249 INFO:tasks.rados.rados.0.smithi137.stdout:1243: writing smithi13777483-34 from 1089536 to 1597440 tid 3 2024-03-04T06:46:08.252 INFO:tasks.rados.rados.0.smithi137.stdout:1243: writing smithi13777483-34 from 1597440 to 2048000 tid 4 2024-03-04T06:46:08.253 INFO:tasks.rados.rados.0.smithi137.stdout:1244: copy_from oid 23 from oid 20 current snap is 122 2024-03-04T06:46:08.253 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 862 (ObjNum 335 snap 106 seq_num 335) dirty exists 2024-03-04T06:46:08.253 INFO:tasks.rados.rados.0.smithi137.stdout:1242: done (2 left) 2024-03-04T06:46:08.253 INFO:tasks.rados.rados.0.smithi137.stdout:1245: read oid 12 snap -1 2024-03-04T06:46:08.253 INFO:tasks.rados.rados.0.smithi137.stdout:1245: expect (ObjNum 354 snap 110 seq_num 354) 2024-03-04T06:46:08.253 INFO:tasks.rados.rados.0.smithi137.stdout:1246: snap_create 2024-03-04T06:46:08.257 INFO:tasks.rados.rados.0.smithi137.stdout:1243: finishing write tid 1 to smithi13777483-34 2024-03-04T06:46:08.257 INFO:tasks.rados.rados.0.smithi137.stdout:1243: finishing write tid 2 to smithi13777483-34 2024-03-04T06:46:08.257 INFO:tasks.rados.rados.0.smithi137.stdout:1244: finishing copy_from to smithi13777483-23 2024-03-04T06:46:08.258 INFO:tasks.rados.rados.0.smithi137.stdout:1244: got expected ENOENT (src dne) 2024-03-04T06:46:08.258 INFO:tasks.rados.rados.0.smithi137.stdout:1244: finishing copy_from racing read to smithi13777483-23 2024-03-04T06:46:08.264 INFO:tasks.rados.rados.0.smithi137.stdout:1243: finishing write tid 3 to smithi13777483-34 2024-03-04T06:46:08.267 INFO:tasks.rados.rados.0.smithi137.stdout:1245: expect (ObjNum 354 snap 110 seq_num 354) 2024-03-04T06:46:08.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:07 smithi137 ceph-mon[88869]: osdmap e305: 8 total, 8 up, 8 in 2024-03-04T06:46:08.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:08.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:07 smithi137 ceph-mon[91314]: osdmap e305: 8 total, 8 up, 8 in 2024-03-04T06:46:08.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:08.296 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:07.918+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:08.296 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:07.918+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:08.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:07 smithi203 ceph-mon[85573]: osdmap e305: 8 total, 8 up, 8 in 2024-03-04T06:46:08.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:08.450 INFO:tasks.rados.rados.0.smithi137.stdout:1243: finishing write tid 4 to smithi13777483-34 2024-03-04T06:46:08.450 INFO:tasks.rados.rados.0.smithi137.stdout:1243: finishing write tid 5 to smithi13777483-34 2024-03-04T06:46:08.450 INFO:tasks.rados.rados.0.smithi137.stdout:1243: finishing write tid 6 to smithi13777483-34 2024-03-04T06:46:08.450 INFO:tasks.rados.rados.0.smithi137.stdout:1243: oid 34 updating version 0 to 8082 2024-03-04T06:46:08.450 INFO:tasks.rados.rados.0.smithi137.stdout:1243: oid 34 version 8082 is already newer than 8081 2024-03-04T06:46:08.451 INFO:tasks.rados.rados.0.smithi137.stdout:1243: oid 34 updating version 8082 to 8087 2024-03-04T06:46:08.451 INFO:tasks.rados.rados.0.smithi137.stdout:1243: oid 34 updating version 8087 to 8089 2024-03-04T06:46:08.451 INFO:tasks.rados.rados.0.smithi137.stdout:1243: oid 34 version 8089 is already newer than 8088 2024-03-04T06:46:08.451 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 8089 (ObjNum 408 snap 122 seq_num 408) dirty exists 2024-03-04T06:46:08.451 INFO:tasks.rados.rados.0.smithi137.stdout:1243: left oid 34 (ObjNum 408 snap 122 seq_num 408) 2024-03-04T06:46:08.931 INFO:tasks.rados.rados.0.smithi137.stdout:1243: done (3 left) 2024-03-04T06:46:08.931 INFO:tasks.rados.rados.0.smithi137.stdout:1244: done (2 left) 2024-03-04T06:46:08.931 INFO:tasks.rados.rados.0.smithi137.stdout:1245: done (1 left) 2024-03-04T06:46:08.931 INFO:tasks.rados.rados.0.smithi137.stdout:1246: done (0 left) 2024-03-04T06:46:08.931 INFO:tasks.rados.rados.0.smithi137.stdout:1247: delete oid 20 current snap is 123 2024-03-04T06:46:08.934 INFO:tasks.rados.rados.0.smithi137.stdout:1247: done (0 left) 2024-03-04T06:46:08.934 INFO:tasks.rados.rados.0.smithi137.stdout:1248: delete oid 13 current snap is 123 2024-03-04T06:46:08.939 INFO:tasks.rados.rados.0.smithi137.stdout:1248: done (0 left) 2024-03-04T06:46:08.939 INFO:tasks.rados.rados.0.smithi137.stdout:1249: snap_remove snap 120 2024-03-04T06:46:09.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:08.937+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:09.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:08 smithi137 ceph-mon[88869]: osdmap e306: 8 total, 8 up, 8 in 2024-03-04T06:46:09.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:09.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:08 smithi137 ceph-mon[88869]: pgmap v132: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 277 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 466 KiB/s wr, 1 op/s 2024-03-04T06:46:09.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:09.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:46:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:08 smithi137 ceph-mon[91314]: osdmap e306: 8 total, 8 up, 8 in 2024-03-04T06:46:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:08 smithi137 ceph-mon[91314]: pgmap v132: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 277 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 466 KiB/s wr, 1 op/s 2024-03-04T06:46:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:46:09.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:08 smithi203 ceph-mon[85573]: osdmap e306: 8 total, 8 up, 8 in 2024-03-04T06:46:09.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:09.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:08 smithi203 ceph-mon[85573]: pgmap v132: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 277 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 466 KiB/s wr, 1 op/s 2024-03-04T06:46:09.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:09.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:46:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:1249: done (0 left) 2024-03-04T06:46:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:1250: snap_remove snap 92 2024-03-04T06:46:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:09 smithi137 ceph-mon[88869]: osdmap e307: 8 total, 8 up, 8 in 2024-03-04T06:46:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:09 smithi137 ceph-mon[88869]: mgrmap e40: y(active, since 91s), standbys: x 2024-03-04T06:46:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:09 smithi137 ceph-mon[88869]: osdmap e308: 8 total, 8 up, 8 in 2024-03-04T06:46:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:09 smithi137 ceph-mon[91314]: osdmap e307: 8 total, 8 up, 8 in 2024-03-04T06:46:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:09 smithi137 ceph-mon[91314]: mgrmap e40: y(active, since 91s), standbys: x 2024-03-04T06:46:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:09 smithi137 ceph-mon[91314]: osdmap e308: 8 total, 8 up, 8 in 2024-03-04T06:46:10.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:09.863+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:10.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:09.863+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:10.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:09 smithi203 ceph-mon[85573]: osdmap e307: 8 total, 8 up, 8 in 2024-03-04T06:46:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:09 smithi203 ceph-mon[85573]: mgrmap e40: y(active, since 91s), standbys: x 2024-03-04T06:46:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:09 smithi203 ceph-mon[85573]: osdmap e308: 8 total, 8 up, 8 in 2024-03-04T06:46:10.863 INFO:tasks.rados.rados.0.smithi137.stdout:1250: done (0 left) 2024-03-04T06:46:10.863 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 123 2024-03-04T06:46:10.863 INFO:tasks.rados.rados.0.smithi137.stdout:1251: seq_num 411 ranges {0=491520,491520=753664,1245184=688128,1933312=163840} 2024-03-04T06:46:10.866 INFO:tasks.rados.rados.0.smithi137.stdout:1251: writing smithi13777483-23 from 0 to 491520 tid 1 2024-03-04T06:46:10.872 INFO:tasks.rados.rados.0.smithi137.stdout:1251: writing smithi13777483-23 from 491520 to 1245184 tid 2 2024-03-04T06:46:10.877 INFO:tasks.rados.rados.0.smithi137.stdout:1251: writing smithi13777483-23 from 1245184 to 1933312 tid 3 2024-03-04T06:46:10.878 INFO:tasks.rados.rados.0.smithi137.stdout:1251: writing smithi13777483-23 from 1933312 to 2097152 tid 4 2024-03-04T06:46:10.878 INFO:tasks.rados.rados.0.smithi137.stdout:1252: rmattr oid 15 current snap is 123 2024-03-04T06:46:10.878 INFO:tasks.rados.rados.0.smithi137.stdout:1252: done (1 left) 2024-03-04T06:46:10.878 INFO:tasks.rados.rados.0.smithi137.stdout:1253: read oid 6 snap 112 2024-03-04T06:46:10.879 INFO:tasks.rados.rados.0.smithi137.stdout:1253: expect (ObjNum 355 snap 110 seq_num 355) 2024-03-04T06:46:10.879 INFO:tasks.rados.rados.0.smithi137.stdout:1254: snap_remove snap 122 2024-03-04T06:46:11.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:11.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:10 smithi137 ceph-mon[88869]: pgmap v135: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 280 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2024-03-04T06:46:11.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:10 smithi137 ceph-mon[88869]: osdmap e309: 8 total, 8 up, 8 in 2024-03-04T06:46:11.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:10.881+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:10 smithi137 ceph-mon[91314]: pgmap v135: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 280 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2024-03-04T06:46:11.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:10 smithi137 ceph-mon[91314]: osdmap e309: 8 total, 8 up, 8 in 2024-03-04T06:46:11.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{96=[96],99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:10 smithi203 ceph-mon[85573]: pgmap v135: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 280 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2024-03-04T06:46:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:10 smithi203 ceph-mon[85573]: osdmap e309: 8 total, 8 up, 8 in 2024-03-04T06:46:11.863 INFO:tasks.rados.rados.0.smithi137.stdout:1254: done (2 left) 2024-03-04T06:46:11.864 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 24 current snap is 123 2024-03-04T06:46:11.864 INFO:tasks.rados.rados.0.smithi137.stdout:1255: seq_num 412 ranges {1032192=507904,1540096=630784,2170880=491520,2662400=483328} 2024-03-04T06:46:11.872 INFO:tasks.rados.rados.0.smithi137.stdout:1255: writing smithi13777483-24 from 1032192 to 1540096 tid 1 2024-03-04T06:46:11.877 INFO:tasks.rados.rados.0.smithi137.stdout:1255: writing smithi13777483-24 from 1540096 to 2170880 tid 2 2024-03-04T06:46:11.880 INFO:tasks.rados.rados.0.smithi137.stdout:1255: writing smithi13777483-24 from 2170880 to 2662400 tid 3 2024-03-04T06:46:11.883 INFO:tasks.rados.rados.0.smithi137.stdout:1255: writing smithi13777483-24 from 2662400 to 3145728 tid 4 2024-03-04T06:46:11.883 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 123 2024-03-04T06:46:11.883 INFO:tasks.rados.rados.0.smithi137.stdout:1251: finishing write tid 1 to smithi13777483-23 2024-03-04T06:46:11.883 INFO:tasks.rados.rados.0.smithi137.stdout:1256: seq_num 413 ranges {3350528=524288,3874816=516096,4390912=696320,5087232=393216} 2024-03-04T06:46:11.905 INFO:tasks.rados.rados.0.smithi137.stdout:1256: writing smithi13777483-39 from 3350528 to 3874816 tid 1 2024-03-04T06:46:11.908 INFO:tasks.rados.rados.0.smithi137.stdout:1256: writing smithi13777483-39 from 3874816 to 4390912 tid 2 2024-03-04T06:46:11.912 INFO:tasks.rados.rados.0.smithi137.stdout:1256: writing smithi13777483-39 from 4390912 to 5087232 tid 3 2024-03-04T06:46:11.916 INFO:tasks.rados.rados.0.smithi137.stdout:1256: writing smithi13777483-39 from 5087232 to 5480448 tid 4 2024-03-04T06:46:11.916 INFO:tasks.rados.rados.0.smithi137.stdout:1257: read oid 17 snap 80 2024-03-04T06:46:11.916 INFO:tasks.rados.rados.0.smithi137.stdout:1257: expect (ObjNum -1163921824 snap 21906 seq_num 3132322128) 2024-03-04T06:46:11.916 INFO:tasks.rados.rados.0.smithi137.stdout:1258: rollback oid 45 current snap is 123 2024-03-04T06:46:11.916 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 45 to 115 2024-03-04T06:46:11.916 INFO:tasks.rados.rados.0.smithi137.stdout:1251: finishing write tid 2 to smithi13777483-23 2024-03-04T06:46:11.916 INFO:tasks.rados.rados.0.smithi137.stdout:1251: finishing write tid 3 to smithi13777483-23 2024-03-04T06:46:11.916 INFO:tasks.rados.rados.0.smithi137.stdout:1251: finishing write tid 4 to smithi13777483-23 2024-03-04T06:46:11.916 INFO:tasks.rados.rados.0.smithi137.stdout:1251: finishing write tid 5 to smithi13777483-23 2024-03-04T06:46:11.916 INFO:tasks.rados.rados.0.smithi137.stdout:1251: finishing write tid 6 to smithi13777483-23 2024-03-04T06:46:11.916 INFO:tasks.rados.rados.0.smithi137.stdout:1251: oid 23 updating version 0 to 570 2024-03-04T06:46:11.917 INFO:tasks.rados.rados.0.smithi137.stdout:1251: oid 23 updating version 570 to 571 2024-03-04T06:46:11.917 INFO:tasks.rados.rados.0.smithi137.stdout:1251: oid 23 version 571 is already newer than 567 2024-03-04T06:46:11.917 INFO:tasks.rados.rados.0.smithi137.stdout:1251: oid 23 version 571 is already newer than 566 2024-03-04T06:46:11.917 INFO:tasks.rados.rados.0.smithi137.stdout:1251: oid 23 updating version 571 to 572 2024-03-04T06:46:11.917 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 572 (ObjNum 411 snap 123 seq_num 411) dirty exists 2024-03-04T06:46:11.917 INFO:tasks.rados.rados.0.smithi137.stdout:1251: left oid 23 (ObjNum 411 snap 123 seq_num 411) 2024-03-04T06:46:11.917 INFO:tasks.rados.rados.0.smithi137.stdout:1253: expect (ObjNum 355 snap 110 seq_num 355) 2024-03-04T06:46:11.997 INFO:tasks.rados.rados.0.smithi137.stdout:1255: finishing write tid 1 to smithi13777483-24 2024-03-04T06:46:11.997 INFO:tasks.rados.rados.0.smithi137.stdout:1255: finishing write tid 2 to smithi13777483-24 2024-03-04T06:46:11.997 INFO:tasks.rados.rados.0.smithi137.stdout:1251: done (5 left) 2024-03-04T06:46:11.997 INFO:tasks.rados.rados.0.smithi137.stdout:1253: done (4 left) 2024-03-04T06:46:11.997 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 123 2024-03-04T06:46:11.997 INFO:tasks.rados.rados.0.smithi137.stdout:1255: finishing write tid 3 to smithi13777483-24 2024-03-04T06:46:11.997 INFO:tasks.rados.rados.0.smithi137.stdout:1259: seq_num 414 ranges {4341760=540672,4882432=802816,5685248=458752,6144000=344064} 2024-03-04T06:46:12.024 INFO:tasks.rados.rados.0.smithi137.stdout:1259: writing smithi13777483-44 from 4341760 to 4882432 tid 1 2024-03-04T06:46:12.029 INFO:tasks.rados.rados.0.smithi137.stdout:1259: writing smithi13777483-44 from 4882432 to 5685248 tid 2 2024-03-04T06:46:12.031 INFO:tasks.rados.rados.0.smithi137.stdout:1259: writing smithi13777483-44 from 5685248 to 6144000 tid 3 2024-03-04T06:46:12.034 INFO:tasks.rados.rados.0.smithi137.stdout:1259: writing smithi13777483-44 from 6144000 to 6488064 tid 4 2024-03-04T06:46:12.034 INFO:tasks.rados.rados.0.smithi137.stdout:1260: snap_remove snap 121 2024-03-04T06:46:12.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:12.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:11 smithi137 ceph-mon[88869]: osdmap e310: 8 total, 8 up, 8 in 2024-03-04T06:46:12.195 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:12.195 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:11 smithi137 ceph-mon[91314]: osdmap e310: 8 total, 8 up, 8 in 2024-03-04T06:46:12.195 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:11.877+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:12.195 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:11.877+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:11 smithi203 ceph-mon[85573]: osdmap e310: 8 total, 8 up, 8 in 2024-03-04T06:46:12.944 INFO:tasks.rados.rados.0.smithi137.stdout:1260: done (5 left) 2024-03-04T06:46:12.944 INFO:tasks.rados.rados.0.smithi137.stdout:1261: read oid 34 snap 100 2024-03-04T06:46:12.944 INFO:tasks.rados.rados.0.smithi137.stdout:1261: expect (ObjNum 307 snap 99 seq_num 307) 2024-03-04T06:46:12.944 INFO:tasks.rados.rados.0.smithi137.stdout:1262: rollback oid 37 current snap is 123 2024-03-04T06:46:12.944 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 37 to 110 2024-03-04T06:46:12.944 INFO:tasks.rados.rados.0.smithi137.stdout:1255: finishing write tid 4 to smithi13777483-24 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:1255: finishing write tid 5 to smithi13777483-24 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:1255: finishing write tid 6 to smithi13777483-24 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:1255: oid 24 updating version 0 to 296 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:1255: oid 24 updating version 296 to 297 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:1255: oid 24 version 297 is already newer than 295 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:1255: oid 24 updating version 297 to 298 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:1255: oid 24 updating version 298 to 299 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 299 (ObjNum 412 snap 123 seq_num 412) dirty exists 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:1255: left oid 24 (ObjNum 412 snap 123 seq_num 412) 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:1256: finishing write tid 1 to smithi13777483-39 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:1255: done (6 left) 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:1263: snap_create 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:1256: finishing write tid 2 to smithi13777483-39 2024-03-04T06:46:12.945 INFO:tasks.rados.rados.0.smithi137.stdout:1256: finishing write tid 3 to smithi13777483-39 2024-03-04T06:46:12.946 INFO:tasks.rados.rados.0.smithi137.stdout:1257: expect (ObjNum -1163921824 snap 21906 seq_num 3132322128) 2024-03-04T06:46:12.946 INFO:tasks.rados.rados.0.smithi137.stdout:1256: finishing write tid 4 to smithi13777483-39 2024-03-04T06:46:12.946 INFO:tasks.rados.rados.0.smithi137.stdout:1256: finishing write tid 5 to smithi13777483-39 2024-03-04T06:46:12.946 INFO:tasks.rados.rados.0.smithi137.stdout:1258: finishing rollback tid 0 to smithi13777483-45 2024-03-04T06:46:12.946 INFO:tasks.rados.rados.0.smithi137.stdout:1258: finishing rollback tid 1 to smithi13777483-45 2024-03-04T06:46:12.946 INFO:tasks.rados.rados.0.smithi137.stdout:1258: finishing rollback tid 2 to smithi13777483-45 2024-03-04T06:46:12.946 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 293 (ObjNum 328 snap 103 seq_num 328) dirty exists 2024-03-04T06:46:12.947 INFO:tasks.rados.rados.0.smithi137.stdout:1256: finishing write tid 6 to smithi13777483-39 2024-03-04T06:46:12.947 INFO:tasks.rados.rados.0.smithi137.stdout:1256: oid 39 updating version 0 to 302 2024-03-04T06:46:12.947 INFO:tasks.rados.rados.0.smithi137.stdout:1256: oid 39 version 302 is already newer than 301 2024-03-04T06:46:12.947 INFO:tasks.rados.rados.0.smithi137.stdout:1256: oid 39 updating version 302 to 303 2024-03-04T06:46:12.947 INFO:tasks.rados.rados.0.smithi137.stdout:1256: oid 39 updating version 303 to 305 2024-03-04T06:46:12.947 INFO:tasks.rados.rados.0.smithi137.stdout:1256: oid 39 version 305 is already newer than 304 2024-03-04T06:46:12.947 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 305 (ObjNum 413 snap 123 seq_num 413) dirty exists 2024-03-04T06:46:12.947 INFO:tasks.rados.rados.0.smithi137.stdout:1256: left oid 39 (ObjNum 413 snap 123 seq_num 413) 2024-03-04T06:46:12.947 INFO:tasks.rados.rados.0.smithi137.stdout:1259: finishing write tid 1 to smithi13777483-44 2024-03-04T06:46:12.947 INFO:tasks.rados.rados.0.smithi137.stdout:1259: finishing write tid 2 to smithi13777483-44 2024-03-04T06:46:12.947 INFO:tasks.rados.rados.0.smithi137.stdout:1259: finishing write tid 3 to smithi13777483-44 2024-03-04T06:46:12.947 INFO:tasks.rados.rados.0.smithi137.stdout:1259: finishing write tid 4 to smithi13777483-44 2024-03-04T06:46:12.948 INFO:tasks.rados.rados.0.smithi137.stdout:1259: finishing write tid 5 to smithi13777483-44 2024-03-04T06:46:12.948 INFO:tasks.rados.rados.0.smithi137.stdout:1259: finishing write tid 6 to smithi13777483-44 2024-03-04T06:46:12.948 INFO:tasks.rados.rados.0.smithi137.stdout:1259: oid 44 updating version 0 to 10857 2024-03-04T06:46:12.948 INFO:tasks.rados.rados.0.smithi137.stdout:1259: oid 44 updating version 10857 to 10860 2024-03-04T06:46:12.948 INFO:tasks.rados.rados.0.smithi137.stdout:1259: oid 44 updating version 10860 to 10861 2024-03-04T06:46:12.948 INFO:tasks.rados.rados.0.smithi137.stdout:1259: oid 44 version 10861 is already newer than 10859 2024-03-04T06:46:12.948 INFO:tasks.rados.rados.0.smithi137.stdout:1259: oid 44 version 10861 is already newer than 10858 2024-03-04T06:46:12.948 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 10861 (ObjNum 414 snap 123 seq_num 414) dirty exists 2024-03-04T06:46:12.948 INFO:tasks.rados.rados.0.smithi137.stdout:1259: left oid 44 (ObjNum 414 snap 123 seq_num 414) 2024-03-04T06:46:12.951 INFO:tasks.rados.rados.0.smithi137.stdout:1262: finishing rollback tid 1 to smithi13777483-37 2024-03-04T06:46:12.951 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 713 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-04T06:46:12.959 INFO:tasks.rados.rados.0.smithi137.stdout:1261: expect (ObjNum 307 snap 99 seq_num 307) 2024-03-04T06:46:13.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:13.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:12 smithi203 ceph-mon[85573]: pgmap v138: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 280 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2024-03-04T06:46:13.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:13.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:12 smithi137 ceph-mon[88869]: pgmap v138: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 280 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2024-03-04T06:46:13.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:13.207 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:12 smithi137 ceph-mon[91314]: pgmap v138: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 280 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2024-03-04T06:46:13.207 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:12.947+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:13.945 INFO:tasks.rados.rados.0.smithi137.stdout:1256: done (6 left) 2024-03-04T06:46:13.945 INFO:tasks.rados.rados.0.smithi137.stdout:1257: done (5 left) 2024-03-04T06:46:13.945 INFO:tasks.rados.rados.0.smithi137.stdout:1258: done (4 left) 2024-03-04T06:46:13.945 INFO:tasks.rados.rados.0.smithi137.stdout:1259: done (3 left) 2024-03-04T06:46:13.945 INFO:tasks.rados.rados.0.smithi137.stdout:1261: done (2 left) 2024-03-04T06:46:13.946 INFO:tasks.rados.rados.0.smithi137.stdout:1262: done (1 left) 2024-03-04T06:46:13.946 INFO:tasks.rados.rados.0.smithi137.stdout:1263: done (0 left) 2024-03-04T06:46:13.946 INFO:tasks.rados.rados.0.smithi137.stdout:1264: delete oid 14 current snap is 124 2024-03-04T06:46:13.953 INFO:tasks.rados.rados.0.smithi137.stdout:1264: done (0 left) 2024-03-04T06:46:13.953 INFO:tasks.rados.rados.0.smithi137.stdout:1265: read oid 24 snap -1 2024-03-04T06:46:13.953 INFO:tasks.rados.rados.0.smithi137.stdout:1265: expect (ObjNum 412 snap 123 seq_num 412) 2024-03-04T06:46:13.953 INFO:tasks.rados.rados.0.smithi137.stdout:1266: read oid 4 snap 115 2024-03-04T06:46:13.953 INFO:tasks.rados.rados.0.smithi137.stdout:1266: expect (ObjNum 308 snap 99 seq_num 308) 2024-03-04T06:46:13.953 INFO:tasks.rados.rados.0.smithi137.stdout:1267: read oid 19 snap -1 2024-03-04T06:46:13.953 INFO:tasks.rados.rados.0.smithi137.stdout:1267: expect deleted 2024-03-04T06:46:13.953 INFO:tasks.rados.rados.0.smithi137.stdout:1268: snap_remove snap 108 2024-03-04T06:46:14.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:13 smithi137 ceph-mon[88869]: osdmap e311: 8 total, 8 up, 8 in 2024-03-04T06:46:14.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:14.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:14.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:13 smithi137 ceph-mon[91314]: osdmap e311: 8 total, 8 up, 8 in 2024-03-04T06:46:14.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:14.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:14.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:13.964+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:14.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:13.964+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:14.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:13 smithi203 ceph-mon[85573]: osdmap e311: 8 total, 8 up, 8 in 2024-03-04T06:46:14.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:14.958 INFO:tasks.rados.rados.0.smithi137.stdout:1268: done (3 left) 2024-03-04T06:46:14.959 INFO:tasks.rados.rados.0.smithi137.stdout:1269: snap_remove snap 117 2024-03-04T06:46:15.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:14 smithi137 ceph-mon[88869]: osdmap e312: 8 total, 8 up, 8 in 2024-03-04T06:46:15.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:15.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:14 smithi137 ceph-mon[88869]: pgmap v141: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 277 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-03-04T06:46:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:14 smithi137 ceph-mon[91314]: osdmap e312: 8 total, 8 up, 8 in 2024-03-04T06:46:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:14 smithi137 ceph-mon[91314]: pgmap v141: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 277 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-03-04T06:46:15.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:14.960+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:15.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:14 smithi203 ceph-mon[85573]: osdmap e312: 8 total, 8 up, 8 in 2024-03-04T06:46:15.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:15.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:14 smithi203 ceph-mon[85573]: pgmap v141: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 277 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-03-04T06:46:15.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:46:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:46:15] "GET /metrics HTTP/1.1" 200 36124 "" "Prometheus/2.43.0" 2024-03-04T06:46:15.964 INFO:tasks.rados.rados.0.smithi137.stdout:1269: done (3 left) 2024-03-04T06:46:15.964 INFO:tasks.rados.rados.0.smithi137.stdout:1270: delete oid 1 current snap is 124 2024-03-04T06:46:15.964 INFO:tasks.rados.rados.0.smithi137.stdout:1266: expect (ObjNum 308 snap 99 seq_num 308) 2024-03-04T06:46:16.064 INFO:tasks.rados.rados.0.smithi137.stdout:1265: expect (ObjNum 412 snap 123 seq_num 412) 2024-03-04T06:46:16.180 INFO:tasks.rados.rados.0.smithi137.stdout:1265: done (3 left) 2024-03-04T06:46:16.180 INFO:tasks.rados.rados.0.smithi137.stdout:1266: done (2 left) 2024-03-04T06:46:16.180 INFO:tasks.rados.rados.0.smithi137.stdout:1267: done (1 left) 2024-03-04T06:46:16.180 INFO:tasks.rados.rados.0.smithi137.stdout:1270: done (0 left) 2024-03-04T06:46:16.180 INFO:tasks.rados.rados.0.smithi137.stdout:1271: snap_remove snap 101 2024-03-04T06:46:16.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:15 smithi137 ceph-mon[88869]: osdmap e313: 8 total, 8 up, 8 in 2024-03-04T06:46:16.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:16.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:15 smithi137 ceph-mon[91314]: osdmap e313: 8 total, 8 up, 8 in 2024-03-04T06:46:16.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:16.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:15.968+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:16.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:15.968+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:16.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:15 smithi203 ceph-mon[85573]: osdmap e313: 8 total, 8 up, 8 in 2024-03-04T06:46:16.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:16.956 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:46:16.972 INFO:tasks.rados.rados.0.smithi137.stdout:1271: done (0 left) 2024-03-04T06:46:16.972 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 124 2024-03-04T06:46:16.972 INFO:tasks.rados.rados.0.smithi137.stdout:1272: seq_num 417 ranges {4202496=589824,4792320=458752,5251072=679936,5931008=466944} 2024-03-04T06:46:17.000 INFO:tasks.rados.rados.0.smithi137.stdout:1272: writing smithi13777483-16 from 4202496 to 4792320 tid 1 2024-03-04T06:46:17.003 INFO:tasks.rados.rados.0.smithi137.stdout:1272: writing smithi13777483-16 from 4792320 to 5251072 tid 2 2024-03-04T06:46:17.007 INFO:tasks.rados.rados.0.smithi137.stdout:1272: writing smithi13777483-16 from 5251072 to 5931008 tid 3 2024-03-04T06:46:17.010 INFO:tasks.rados.rados.0.smithi137.stdout:1272: writing smithi13777483-16 from 5931008 to 6397952 tid 4 2024-03-04T06:46:17.010 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 124 2024-03-04T06:46:17.010 INFO:tasks.rados.rados.0.smithi137.stdout:1273: seq_num 418 ranges {4734976=606208,5341184=737280,6078464=434176,6512640=434176} 2024-03-04T06:46:17.039 INFO:tasks.rados.rados.0.smithi137.stdout:1273: writing smithi13777483-15 from 4734976 to 5341184 tid 1 2024-03-04T06:46:17.044 INFO:tasks.rados.rados.0.smithi137.stdout:1273: writing smithi13777483-15 from 5341184 to 6078464 tid 2 2024-03-04T06:46:17.046 INFO:tasks.rados.rados.0.smithi137.stdout:1273: writing smithi13777483-15 from 6078464 to 6512640 tid 3 2024-03-04T06:46:17.049 INFO:tasks.rados.rados.0.smithi137.stdout:1273: writing smithi13777483-15 from 6512640 to 6946816 tid 4 2024-03-04T06:46:17.049 INFO:tasks.rados.rados.0.smithi137.stdout:1274: snap_remove snap 112 2024-03-04T06:46:17.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:16 smithi137 ceph-mon[88869]: osdmap e314: 8 total, 8 up, 8 in 2024-03-04T06:46:17.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:17.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:16 smithi137 ceph-mon[88869]: pgmap v144: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 277 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-03-04T06:46:17.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:16 smithi137 ceph-mon[91314]: osdmap e314: 8 total, 8 up, 8 in 2024-03-04T06:46:17.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:17.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:16 smithi137 ceph-mon[91314]: pgmap v144: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 277 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-03-04T06:46:17.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:16.977+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:17.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:17.008+0000 7f5c5509b700 -1 osd.0 pg_epoch: 315 pg[5.bs1( v 314'714 (0'0,314'714] local-lis/les=297/298 n=13 ec=72/72 lis/c=297/297 les/c/f=298/298/0 sis=297) [2,0,5]p2(0) r=1 lpr=297 luod=0'0 crt=314'714 mlcod 314'714 active mbc={} ps=[96~1,9a~1,a0~1,a2~1,a4~4,a9~1,ab~2,ae~2,b2~3]] update_snap_map remove_oid 5:dc845682:::smithi13777483-3:9f failed with -2 2024-03-04T06:46:17.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:16 smithi203 ceph-mon[85573]: osdmap e314: 8 total, 8 up, 8 in 2024-03-04T06:46:17.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:17.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:16 smithi203 ceph-mon[85573]: pgmap v144: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 277 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-03-04T06:46:17.381 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:46:17.382 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (6m) 19s ago 6m 26.4M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:46:17.382 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (6m) 63s ago 6m 87.9M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:46:17.382 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (8m) 19s ago 8m 18.2M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:46:17.382 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (8m) 63s ago 8m 18.6M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:46:17.382 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (2m) 63s ago 11m 448M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:46:17.382 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (2m) 19s ago 13m 501M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:46:17.382 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (107s) 19s ago 13m 48.6M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:46:17.382 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (69s) 63s ago 12m 29.9M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:46:17.382 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (83s) 19s ago 11m 39.7M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:46:17.382 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (6m) 19s ago 6m 16.4M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:46:17.382 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (6m) 63s ago 6m 15.6M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:46:17.382 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (23s) 19s ago 11m 11.7M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 bd2207652b33 2024-03-04T06:46:17.382 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (10m) 19s ago 10m 243M 2480M 18.2.1-696-g5cc7a767 540557f94930 708139c858a7 2024-03-04T06:46:17.383 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (10m) 19s ago 10m 230M 2480M 18.2.1-696-g5cc7a767 540557f94930 b247adf81a73 2024-03-04T06:46:17.383 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (10m) 19s ago 10m 127M 2480M 18.2.1-696-g5cc7a767 540557f94930 afdbc25c9fba 2024-03-04T06:46:17.383 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (9m) 63s ago 9m 212M 2480M 18.2.1-696-g5cc7a767 540557f94930 d4841ffd0747 2024-03-04T06:46:17.383 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (9m) 63s ago 9m 225M 2480M 18.2.1-696-g5cc7a767 540557f94930 81d21771e157 2024-03-04T06:46:17.383 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (8m) 63s ago 8m 109M 2480M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:46:17.383 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (8m) 63s ago 8m 136M 2480M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:46:17.383 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (2m) 63s ago 7m 49.8M - 2.43.0 a07b618ecd1d 6a88bdd1023c 2024-03-04T06:46:17.891 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:46:17.891 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:46:17.891 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:46:17.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:46:17.891 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:46:17.891 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:46:17.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:46:17.891 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:46:17.891 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 7, 2024-03-04T06:46:17.891 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 1 2024-03-04T06:46:17.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:46:17.892 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:46:17.892 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:46:17.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:46:17.892 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:46:17.892 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 9, 2024-03-04T06:46:17.892 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 6 2024-03-04T06:46:17.892 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:46:17.892 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:46:17.976 INFO:tasks.rados.rados.0.smithi137.stdout:1274: done (2 left) 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1275: read oid 20 snap -1 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1275: expect deleted 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1276: read oid 33 snap 123 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1276: expect deleted 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1277: snap_create 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1272: finishing write tid 1 to smithi13777483-16 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1272: finishing write tid 2 to smithi13777483-16 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1272: finishing write tid 3 to smithi13777483-16 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1272: finishing write tid 4 to smithi13777483-16 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1272: finishing write tid 5 to smithi13777483-16 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1273: finishing write tid 1 to smithi13777483-15 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1272: finishing write tid 6 to smithi13777483-16 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1272: oid 16 updating version 0 to 14207 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1272: oid 16 updating version 14207 to 14208 2024-03-04T06:46:17.977 INFO:tasks.rados.rados.0.smithi137.stdout:1272: oid 16 updating version 14208 to 14210 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:1272: oid 16 updating version 14210 to 14211 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:1272: oid 16 version 14211 is already newer than 14209 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 14211 (ObjNum 417 snap 124 seq_num 417) dirty exists 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:1272: left oid 16 (ObjNum 417 snap 124 seq_num 417) 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:1273: finishing write tid 2 to smithi13777483-15 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:1273: finishing write tid 3 to smithi13777483-15 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:1273: finishing write tid 4 to smithi13777483-15 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:1273: finishing write tid 5 to smithi13777483-15 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:1273: finishing write tid 6 to smithi13777483-15 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:1273: oid 15 updating version 0 to 803 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:1273: oid 15 updating version 803 to 804 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:1273: oid 15 version 804 is already newer than 802 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:1273: oid 15 version 804 is already newer than 801 2024-03-04T06:46:17.978 INFO:tasks.rados.rados.0.smithi137.stdout:1273: oid 15 version 804 is already newer than 800 2024-03-04T06:46:17.979 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 804 (ObjNum 418 snap 124 seq_num 418) dirty exists 2024-03-04T06:46:17.979 INFO:tasks.rados.rados.0.smithi137.stdout:1273: left oid 15 (ObjNum 418 snap 124 seq_num 418) 2024-03-04T06:46:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:17 smithi137 ceph-mon[88869]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:46:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:17 smithi137 ceph-mon[88869]: osdmap e315: 8 total, 8 up, 8 in 2024-03-04T06:46:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:18.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:17 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/708217363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:18.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:17 smithi137 ceph-mon[91314]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:46:18.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:17 smithi137 ceph-mon[91314]: osdmap e315: 8 total, 8 up, 8 in 2024-03-04T06:46:18.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:18.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:17 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/708217363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:18.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:17.987+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:18.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:17.987+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:17 smithi203 ceph-mon[85573]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:46:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:17 smithi203 ceph-mon[85573]: osdmap e315: 8 total, 8 up, 8 in 2024-03-04T06:46:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:17 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/708217363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:18.988 INFO:tasks.rados.rados.0.smithi137.stdout:1272: done (4 left) 2024-03-04T06:46:18.988 INFO:tasks.rados.rados.0.smithi137.stdout:1273: done (3 left) 2024-03-04T06:46:18.988 INFO:tasks.rados.rados.0.smithi137.stdout:1275: done (2 left) 2024-03-04T06:46:18.988 INFO:tasks.rados.rados.0.smithi137.stdout:1276: done (1 left) 2024-03-04T06:46:18.989 INFO:tasks.rados.rados.0.smithi137.stdout:1277: done (0 left) 2024-03-04T06:46:18.989 INFO:tasks.rados.rados.0.smithi137.stdout:1278: rollback oid 49 current snap is 125 2024-03-04T06:46:18.989 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 49 to 123 2024-03-04T06:46:18.989 INFO:tasks.rados.rados.0.smithi137.stdout:1279: rmattr oid 46 current snap is 125 2024-03-04T06:46:18.989 INFO:tasks.rados.rados.0.smithi137.stdout:1279: done (1 left) 2024-03-04T06:46:18.989 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 125 2024-03-04T06:46:18.989 INFO:tasks.rados.rados.0.smithi137.stdout:1280: seq_num 419 ranges {6397952=622592,7020544=671744,7692288=647168,8339456=286720} 2024-03-04T06:46:19.027 INFO:tasks.rados.rados.0.smithi137.stdout:1280: writing smithi13777483-16 from 6397952 to 7020544 tid 1 2024-03-04T06:46:19.032 INFO:tasks.rados.rados.0.smithi137.stdout:1280: writing smithi13777483-16 from 7020544 to 7692288 tid 2 2024-03-04T06:46:19.036 INFO:tasks.rados.rados.0.smithi137.stdout:1280: writing smithi13777483-16 from 7692288 to 8339456 tid 3 2024-03-04T06:46:19.038 INFO:tasks.rados.rados.0.smithi137.stdout:1280: writing smithi13777483-16 from 8339456 to 8626176 tid 4 2024-03-04T06:46:19.038 INFO:tasks.rados.rados.0.smithi137.stdout:1281: snap_create 2024-03-04T06:46:19.038 INFO:tasks.rados.rados.0.smithi137.stdout:1278: finishing rollback tid 0 to smithi13777483-49 2024-03-04T06:46:19.038 INFO:tasks.rados.rados.0.smithi137.stdout:1278: finishing rollback tid 1 to smithi13777483-49 2024-03-04T06:46:19.038 INFO:tasks.rados.rados.0.smithi137.stdout:1278: finishing rollback tid 2 to smithi13777483-49 2024-03-04T06:46:19.038 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 669 (ObjNum 374 snap 114 seq_num 374) dirty exists 2024-03-04T06:46:19.041 INFO:tasks.rados.rados.0.smithi137.stdout:1280: finishing write tid 1 to smithi13777483-16 2024-03-04T06:46:19.041 INFO:tasks.rados.rados.0.smithi137.stdout:1280: finishing write tid 2 to smithi13777483-16 2024-03-04T06:46:19.053 INFO:tasks.rados.rados.0.smithi137.stdout:1280: finishing write tid 3 to smithi13777483-16 2024-03-04T06:46:19.053 INFO:tasks.rados.rados.0.smithi137.stdout:1280: finishing write tid 4 to smithi13777483-16 2024-03-04T06:46:19.054 INFO:tasks.rados.rados.0.smithi137.stdout:1280: finishing write tid 5 to smithi13777483-16 2024-03-04T06:46:19.060 INFO:tasks.rados.rados.0.smithi137.stdout:1280: finishing write tid 6 to smithi13777483-16 2024-03-04T06:46:19.061 INFO:tasks.rados.rados.0.smithi137.stdout:1280: oid 16 updating version 0 to 15434 2024-03-04T06:46:19.061 INFO:tasks.rados.rados.0.smithi137.stdout:1280: oid 16 updating version 15434 to 15437 2024-03-04T06:46:19.061 INFO:tasks.rados.rados.0.smithi137.stdout:1280: oid 16 version 15437 is already newer than 15433 2024-03-04T06:46:19.061 INFO:tasks.rados.rados.0.smithi137.stdout:1280: oid 16 version 15437 is already newer than 15436 2024-03-04T06:46:19.061 INFO:tasks.rados.rados.0.smithi137.stdout:1280: oid 16 version 15437 is already newer than 15435 2024-03-04T06:46:19.061 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 15437 (ObjNum 419 snap 125 seq_num 419) dirty exists 2024-03-04T06:46:19.061 INFO:tasks.rados.rados.0.smithi137.stdout:1280: left oid 16 (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:46:19.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:18.993+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:19.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[88869]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:46:19.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[88869]: osdmap e316: 8 total, 8 up, 8 in 2024-03-04T06:46:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-04T06:46:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-04T06:46:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[88869]: Upgrade: osd.1 is safe to restart 2024-03-04T06:46:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[88869]: pgmap v147: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 279 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 2.6 MiB/s rd, 536 KiB/s wr, 3 op/s 2024-03-04T06:46:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[91314]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:46:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[91314]: osdmap e316: 8 total, 8 up, 8 in 2024-03-04T06:46:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-04T06:46:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-04T06:46:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[91314]: Upgrade: osd.1 is safe to restart 2024-03-04T06:46:19.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:18 smithi137 ceph-mon[91314]: pgmap v147: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 279 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 2.6 MiB/s rd, 536 KiB/s wr, 3 op/s 2024-03-04T06:46:19.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:18 smithi203 ceph-mon[85573]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:46:19.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:18 smithi203 ceph-mon[85573]: osdmap e316: 8 total, 8 up, 8 in 2024-03-04T06:46:19.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:19.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-04T06:46:19.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:18 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-04T06:46:19.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:18 smithi203 ceph-mon[85573]: Upgrade: osd.1 is safe to restart 2024-03-04T06:46:19.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:18 smithi203 ceph-mon[85573]: pgmap v147: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 279 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 2.6 MiB/s rd, 536 KiB/s wr, 3 op/s 2024-03-04T06:46:19.991 INFO:tasks.rados.rados.0.smithi137.stdout:1278: done (2 left) 2024-03-04T06:46:19.991 INFO:tasks.rados.rados.0.smithi137.stdout:1280: done (1 left) 2024-03-04T06:46:19.991 INFO:tasks.rados.rados.0.smithi137.stdout:1281: done (0 left) 2024-03-04T06:46:19.991 INFO:tasks.rados.rados.0.smithi137.stdout:1282: delete oid 24 current snap is 126 2024-03-04T06:46:19.995 INFO:tasks.rados.rados.0.smithi137.stdout:1282: done (0 left) 2024-03-04T06:46:19.995 INFO:tasks.rados.rados.0.smithi137.stdout:1283: snap_remove snap 95 2024-03-04T06:46:19.996 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:19 smithi137 ceph-mon[88869]: osdmap e317: 8 total, 8 up, 8 in 2024-03-04T06:46:19.997 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:19.997 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:19.997 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-04T06:46:19.997 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:46:19.997 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:19 smithi137 ceph-mon[91314]: osdmap e317: 8 total, 8 up, 8 in 2024-03-04T06:46:19.997 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:19.997 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:19.997 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-04T06:46:19.997 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:46:20.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:19.995+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:20.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:19.995+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:19 smithi203 ceph-mon[85573]: osdmap e317: 8 total, 8 up, 8 in 2024-03-04T06:46:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-04T06:46:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:46:20.997 INFO:tasks.rados.rados.0.smithi137.stdout:1283: done (0 left) 2024-03-04T06:46:20.997 INFO:tasks.rados.rados.0.smithi137.stdout:1284: delete oid 24 current snap is 126 2024-03-04T06:46:21.008 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:20 smithi137 ceph-mon[88869]: Upgrade: Updating osd.1 2024-03-04T06:46:21.008 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:20 smithi137 ceph-mon[88869]: Deploying daemon osd.1 on smithi137 2024-03-04T06:46:21.008 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:20 smithi137 ceph-mon[88869]: osdmap e318: 8 total, 8 up, 8 in 2024-03-04T06:46:21.008 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:21.009 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:20 smithi137 ceph-mon[88869]: pgmap v150: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 273 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.1 MiB/s wr, 5 op/s 2024-03-04T06:46:21.009 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:20 smithi137 ceph-mon[91314]: Upgrade: Updating osd.1 2024-03-04T06:46:21.009 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:20 smithi137 ceph-mon[91314]: Deploying daemon osd.1 on smithi137 2024-03-04T06:46:21.009 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:20 smithi137 ceph-mon[91314]: osdmap e318: 8 total, 8 up, 8 in 2024-03-04T06:46:21.009 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:21.009 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:20 smithi137 ceph-mon[91314]: pgmap v150: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 273 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.1 MiB/s wr, 5 op/s 2024-03-04T06:46:21.009 INFO:tasks.rados.rados.0.smithi137.stdout:1284: done (0 left) 2024-03-04T06:46:21.009 INFO:tasks.rados.rados.0.smithi137.stdout:1285: read oid 30 snap -1 2024-03-04T06:46:21.010 INFO:tasks.rados.rados.0.smithi137.stdout:1285: expect (ObjNum 239 snap 72 seq_num 239) 2024-03-04T06:46:21.010 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 126 2024-03-04T06:46:21.010 INFO:tasks.rados.rados.0.smithi137.stdout:1286: seq_num 422 ranges {958464=671744,1630208=729088,2359296=417792,2777088=458752} 2024-03-04T06:46:21.011 INFO:tasks.rados.rados.0.smithi137.stdout:1286: writing smithi13777483-47 from 958464 to 1630208 tid 1 2024-03-04T06:46:21.016 INFO:tasks.rados.rados.0.smithi137.stdout:1286: writing smithi13777483-47 from 1630208 to 2359296 tid 2 2024-03-04T06:46:21.019 INFO:tasks.rados.rados.0.smithi137.stdout:1286: writing smithi13777483-47 from 2359296 to 2777088 tid 3 2024-03-04T06:46:21.022 INFO:tasks.rados.rados.0.smithi137.stdout:1286: writing smithi13777483-47 from 2777088 to 3235840 tid 4 2024-03-04T06:46:21.023 INFO:tasks.rados.rados.0.smithi137.stdout:1287: read oid 14 snap -1 2024-03-04T06:46:21.023 INFO:tasks.rados.rados.0.smithi137.stdout:1287: expect deleted 2024-03-04T06:46:21.023 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 126 2024-03-04T06:46:21.023 INFO:tasks.rados.rados.0.smithi137.stdout:1288: seq_num 423 ranges {1269760=688128,1957888=614400,2572288=622592,3194880=368640} 2024-03-04T06:46:21.034 INFO:tasks.rados.rados.0.smithi137.stdout:1288: writing smithi13777483-31 from 1269760 to 1957888 tid 1 2024-03-04T06:46:21.038 INFO:tasks.rados.rados.0.smithi137.stdout:1288: writing smithi13777483-31 from 1957888 to 2572288 tid 2 2024-03-04T06:46:21.041 INFO:tasks.rados.rados.0.smithi137.stdout:1288: writing smithi13777483-31 from 2572288 to 3194880 tid 3 2024-03-04T06:46:21.043 INFO:tasks.rados.rados.0.smithi137.stdout:1288: writing smithi13777483-31 from 3194880 to 3563520 tid 4 2024-03-04T06:46:21.043 INFO:tasks.rados.rados.0.smithi137.stdout:1289: delete oid 11 current snap is 126 2024-03-04T06:46:21.043 INFO:tasks.rados.rados.0.smithi137.stdout:1285: expect (ObjNum 239 snap 72 seq_num 239) 2024-03-04T06:46:21.144 INFO:tasks.rados.rados.0.smithi137.stdout:1286: finishing write tid 1 to smithi13777483-47 2024-03-04T06:46:21.144 INFO:tasks.rados.rados.0.smithi137.stdout:1286: finishing write tid 2 to smithi13777483-47 2024-03-04T06:46:21.144 INFO:tasks.rados.rados.0.smithi137.stdout:1286: finishing write tid 3 to smithi13777483-47 2024-03-04T06:46:21.144 INFO:tasks.rados.rados.0.smithi137.stdout:1286: finishing write tid 4 to smithi13777483-47 2024-03-04T06:46:21.144 INFO:tasks.rados.rados.0.smithi137.stdout:1286: finishing write tid 5 to smithi13777483-47 2024-03-04T06:46:21.144 INFO:tasks.rados.rados.0.smithi137.stdout:1286: finishing write tid 6 to smithi13777483-47 2024-03-04T06:46:21.144 INFO:tasks.rados.rados.0.smithi137.stdout:1286: oid 47 updating version 0 to 912 2024-03-04T06:46:21.144 INFO:tasks.rados.rados.0.smithi137.stdout:1286: oid 47 version 912 is already newer than 909 2024-03-04T06:46:21.144 INFO:tasks.rados.rados.0.smithi137.stdout:1286: oid 47 version 912 is already newer than 906 2024-03-04T06:46:21.144 INFO:tasks.rados.rados.0.smithi137.stdout:1286: oid 47 version 912 is already newer than 911 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1286: oid 47 version 912 is already newer than 910 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 912 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1286: left oid 47 (ObjNum 422 snap 126 seq_num 422) 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1288: finishing write tid 1 to smithi13777483-31 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1288: finishing write tid 2 to smithi13777483-31 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1288: finishing write tid 3 to smithi13777483-31 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1288: finishing write tid 4 to smithi13777483-31 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1285: done (4 left) 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1286: done (3 left) 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1287: done (2 left) 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1289: done (1 left) 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1290: snap_create 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1288: finishing write tid 5 to smithi13777483-31 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1288: finishing write tid 6 to smithi13777483-31 2024-03-04T06:46:21.145 INFO:tasks.rados.rados.0.smithi137.stdout:1288: oid 31 updating version 0 to 680 2024-03-04T06:46:21.146 INFO:tasks.rados.rados.0.smithi137.stdout:1288: oid 31 updating version 680 to 683 2024-03-04T06:46:21.146 INFO:tasks.rados.rados.0.smithi137.stdout:1288: oid 31 version 683 is already newer than 681 2024-03-04T06:46:21.146 INFO:tasks.rados.rados.0.smithi137.stdout:1288: oid 31 version 683 is already newer than 679 2024-03-04T06:46:21.146 INFO:tasks.rados.rados.0.smithi137.stdout:1288: oid 31 version 683 is already newer than 682 2024-03-04T06:46:21.146 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 683 (ObjNum 423 snap 126 seq_num 423) dirty exists 2024-03-04T06:46:21.146 INFO:tasks.rados.rados.0.smithi137.stdout:1288: left oid 31 (ObjNum 423 snap 126 seq_num 423) 2024-03-04T06:46:21.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:21.004+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:21.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:21.024+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:21.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:20 smithi203 ceph-mon[85573]: Upgrade: Updating osd.1 2024-03-04T06:46:21.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:20 smithi203 ceph-mon[85573]: Deploying daemon osd.1 on smithi137 2024-03-04T06:46:21.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:20 smithi203 ceph-mon[85573]: osdmap e318: 8 total, 8 up, 8 in 2024-03-04T06:46:21.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{99=[99],a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:21.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:20 smithi203 ceph-mon[85573]: pgmap v150: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 273 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.1 MiB/s wr, 5 op/s 2024-03-04T06:46:22.004 INFO:tasks.rados.rados.0.smithi137.stdout:1288: done (1 left) 2024-03-04T06:46:22.004 INFO:tasks.rados.rados.0.smithi137.stdout:1290: done (0 left) 2024-03-04T06:46:22.004 INFO:tasks.rados.rados.0.smithi137.stdout:1291: rollback oid 30 current snap is 127 2024-03-04T06:46:22.004 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 30 to 124 2024-03-04T06:46:22.004 INFO:tasks.rados.rados.0.smithi137.stdout:1292: snap_remove snap 125 2024-03-04T06:46:22.212 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:21 smithi137 ceph-mon[88869]: osdmap e319: 8 total, 8 up, 8 in 2024-03-04T06:46:22.212 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:22.212 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:22.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:21 smithi137 ceph-mon[91314]: osdmap e319: 8 total, 8 up, 8 in 2024-03-04T06:46:22.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:22.212 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:22.213 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:22.007+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:22.213 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:22.007+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:22.213 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:22.008+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:22.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:21 smithi203 ceph-mon[85573]: osdmap e319: 8 total, 8 up, 8 in 2024-03-04T06:46:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:22.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:23.012 INFO:tasks.rados.rados.0.smithi137.stdout:1292: done (1 left) 2024-03-04T06:46:23.012 INFO:tasks.rados.rados.0.smithi137.stdout:1293: delete oid 36 current snap is 127 2024-03-04T06:46:23.012 INFO:tasks.rados.rados.0.smithi137.stdout:1291: finishing rollback tid 0 to smithi13777483-30 2024-03-04T06:46:23.012 INFO:tasks.rados.rados.0.smithi137.stdout:1291: finishing rollback tid 1 to smithi13777483-30 2024-03-04T06:46:23.012 INFO:tasks.rados.rados.0.smithi137.stdout:1291: finishing rollback tid 2 to smithi13777483-30 2024-03-04T06:46:23.012 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 547 (ObjNum 239 snap 72 seq_num 239) dirty exists 2024-03-04T06:46:23.019 INFO:tasks.rados.rados.0.smithi137.stdout:1291: done (1 left) 2024-03-04T06:46:23.019 INFO:tasks.rados.rados.0.smithi137.stdout:1293: done (0 left) 2024-03-04T06:46:23.019 INFO:tasks.rados.rados.0.smithi137.stdout:1294: snap_remove snap 115 2024-03-04T06:46:23.205 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-mon[88869]: osdmap e320: 8 total, 8 up, 8 in 2024-03-04T06:46:23.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:23.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:23.206 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-mon[88869]: pgmap v153: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 273 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 540 KiB/s wr, 1 op/s 2024-03-04T06:46:23.206 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-mon[91314]: osdmap e320: 8 total, 8 up, 8 in 2024-03-04T06:46:23.206 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:23.206 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:23.206 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-mon[91314]: pgmap v153: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 273 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 540 KiB/s wr, 1 op/s 2024-03-04T06:46:23.207 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:23.017+0000 7f5c5509b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 96 after trimming was started 2024-03-04T06:46:23.207 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:23.017+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a7=[]:{a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:23.207 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:23.017+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:23.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:23 smithi203 ceph-mon[85573]: osdmap e320: 8 total, 8 up, 8 in 2024-03-04T06:46:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:23 smithi203 ceph-mon[85573]: pgmap v153: 121 pgs: 1 active+clean+snaptrim_error, 1 active+clean+snaptrim, 119 active+clean; 273 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 540 KiB/s wr, 1 op/s 2024-03-04T06:46:23.472 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:23 smithi137 systemd[1]: Stopping Ceph osd.1 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:46:23.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[47423]: 2024-03-04T06:46:23.472+0000 7f45348ae700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:46:23.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[47423]: 2024-03-04T06:46:23.472+0000 7f45348ae700 -1 osd.1 321 *** Got signal Terminated *** 2024-03-04T06:46:23.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[47423]: 2024-03-04T06:46:23.472+0000 7f45348ae700 -1 osd.1 321 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T06:46:24.013 INFO:tasks.rados.rados.0.smithi137.stdout:1294: done (0 left) 2024-03-04T06:46:24.013 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 127 2024-03-04T06:46:24.013 INFO:tasks.rados.rados.0.smithi137.stdout:1295: seq_num 426 ranges {1892352=737280,2629632=712704,3342336=802816,4145152=90112} 2024-03-04T06:46:24.029 INFO:tasks.rados.rados.0.smithi137.stdout:1295: writing smithi13777483-32 from 1892352 to 2629632 tid 1 2024-03-04T06:46:24.033 INFO:tasks.rados.rados.0.smithi137.stdout:1295: writing smithi13777483-32 from 2629632 to 3342336 tid 2 2024-03-04T06:46:24.038 INFO:tasks.rados.rados.0.smithi137.stdout:1295: writing smithi13777483-32 from 3342336 to 4145152 tid 3 2024-03-04T06:46:24.039 INFO:tasks.rados.rados.0.smithi137.stdout:1295: writing smithi13777483-32 from 4145152 to 4235264 tid 4 2024-03-04T06:46:24.039 INFO:tasks.rados.rados.0.smithi137.stdout:1296: read oid 23 snap -1 2024-03-04T06:46:24.039 INFO:tasks.rados.rados.0.smithi137.stdout:1296: expect (ObjNum 411 snap 123 seq_num 411) 2024-03-04T06:46:24.039 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 41 current snap is 127 2024-03-04T06:46:24.039 INFO:tasks.rados.rados.0.smithi137.stdout:1297: seq_num 427 ranges {2367488=761856,3129344=598016,3727360=606208,4333568=401408} 2024-03-04T06:46:24.055 INFO:tasks.rados.rados.0.smithi137.stdout:1297: writing smithi13777483-41 from 2367488 to 3129344 tid 1 2024-03-04T06:46:24.059 INFO:tasks.rados.rados.0.smithi137.stdout:1297: writing smithi13777483-41 from 3129344 to 3727360 tid 2 2024-03-04T06:46:24.062 INFO:tasks.rados.rados.0.smithi137.stdout:1297: writing smithi13777483-41 from 3727360 to 4333568 tid 3 2024-03-04T06:46:24.065 INFO:tasks.rados.rados.0.smithi137.stdout:1297: writing smithi13777483-41 from 4333568 to 4734976 tid 4 2024-03-04T06:46:24.065 INFO:tasks.rados.rados.0.smithi137.stdout:1298: read oid 36 snap -1 2024-03-04T06:46:24.065 INFO:tasks.rados.rados.0.smithi137.stdout:1298: expect deleted 2024-03-04T06:46:24.065 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 127 2024-03-04T06:46:24.065 INFO:tasks.rados.rados.0.smithi137.stdout:1299: seq_num 428 ranges {4472832=778240,5251072=483328,5734400=409600,6144000=417792,6561792=294912} 2024-03-04T06:46:24.093 INFO:tasks.rados.rados.0.smithi137.stdout:1299: writing smithi13777483-21 from 4472832 to 5251072 tid 1 2024-03-04T06:46:24.096 INFO:tasks.rados.rados.0.smithi137.stdout:1299: writing smithi13777483-21 from 5251072 to 5734400 tid 2 2024-03-04T06:46:24.098 INFO:tasks.rados.rados.0.smithi137.stdout:1299: writing smithi13777483-21 from 5734400 to 6144000 tid 3 2024-03-04T06:46:24.100 INFO:tasks.rados.rados.0.smithi137.stdout:1299: writing smithi13777483-21 from 6144000 to 6561792 tid 4 2024-03-04T06:46:24.102 INFO:tasks.rados.rados.0.smithi137.stdout:1299: writing smithi13777483-21 from 6561792 to 6856704 tid 5 2024-03-04T06:46:24.102 INFO:tasks.rados.rados.0.smithi137.stdout:1300: setattr oid 20 current snap is 127 2024-03-04T06:46:24.102 INFO:tasks.rados.rados.0.smithi137.stdout:1296: expect (ObjNum 411 snap 123 seq_num 411) 2024-03-04T06:46:24.156 INFO:tasks.rados.rados.0.smithi137.stdout:1297: finishing write tid 1 to smithi13777483-41 2024-03-04T06:46:24.156 INFO:tasks.rados.rados.0.smithi137.stdout:1297: finishing write tid 2 to smithi13777483-41 2024-03-04T06:46:24.156 INFO:tasks.rados.rados.0.smithi137.stdout:1297: finishing write tid 3 to smithi13777483-41 2024-03-04T06:46:24.156 INFO:tasks.rados.rados.0.smithi137.stdout:1297: finishing write tid 4 to smithi13777483-41 2024-03-04T06:46:24.156 INFO:tasks.rados.rados.0.smithi137.stdout:1297: finishing write tid 5 to smithi13777483-41 2024-03-04T06:46:24.157 INFO:tasks.rados.rados.0.smithi137.stdout:1297: finishing write tid 6 to smithi13777483-41 2024-03-04T06:46:24.157 INFO:tasks.rados.rados.0.smithi137.stdout:1297: oid 41 updating version 0 to 309 2024-03-04T06:46:24.157 INFO:tasks.rados.rados.0.smithi137.stdout:1297: oid 41 updating version 309 to 313 2024-03-04T06:46:24.157 INFO:tasks.rados.rados.0.smithi137.stdout:1297: oid 41 version 313 is already newer than 311 2024-03-04T06:46:24.157 INFO:tasks.rados.rados.0.smithi137.stdout:1297: oid 41 version 313 is already newer than 312 2024-03-04T06:46:24.157 INFO:tasks.rados.rados.0.smithi137.stdout:1297: oid 41 version 313 is already newer than 310 2024-03-04T06:46:24.157 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 313 (ObjNum 427 snap 127 seq_num 427) dirty exists 2024-03-04T06:46:24.157 INFO:tasks.rados.rados.0.smithi137.stdout:1297: left oid 41 (ObjNum 427 snap 127 seq_num 427) 2024-03-04T06:46:24.157 INFO:tasks.rados.rados.0.smithi137.stdout:1296: done (5 left) 2024-03-04T06:46:24.157 INFO:tasks.rados.rados.0.smithi137.stdout:1297: done (4 left) 2024-03-04T06:46:24.157 INFO:tasks.rados.rados.0.smithi137.stdout:1301: delete oid 29 current snap is 127 2024-03-04T06:46:24.159 INFO:tasks.rados.rados.0.smithi137.stdout:1301: done (4 left) 2024-03-04T06:46:24.159 INFO:tasks.rados.rados.0.smithi137.stdout:1302: rollback oid 45 current snap is 127 2024-03-04T06:46:24.159 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 45 to 80 2024-03-04T06:46:24.159 INFO:tasks.rados.rados.0.smithi137.stdout:1303: delete oid 29 current snap is 127 2024-03-04T06:46:24.159 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 603 (ObjNum 65 snap 0 seq_num 1448107090) dirty exists 2024-03-04T06:46:24.160 INFO:tasks.rados.rados.0.smithi137.stdout:1300: done (5 left) 2024-03-04T06:46:24.160 INFO:tasks.rados.rados.0.smithi137.stdout:1303: done (4 left) 2024-03-04T06:46:24.160 INFO:tasks.rados.rados.0.smithi137.stdout:1304: delete oid 19 current snap is 127 2024-03-04T06:46:24.162 INFO:tasks.rados.rados.0.smithi137.stdout:1302: finishing rollback tid 0 to smithi13777483-45 2024-03-04T06:46:24.162 INFO:tasks.rados.rados.0.smithi137.stdout:1302: finishing rollback tid 1 to smithi13777483-45 2024-03-04T06:46:24.162 INFO:tasks.rados.rados.0.smithi137.stdout:1304: done (4 left) 2024-03-04T06:46:24.162 INFO:tasks.rados.rados.0.smithi137.stdout:1305: read oid 28 snap -1 2024-03-04T06:46:24.162 INFO:tasks.rados.rados.0.smithi137.stdout:1305: expect (ObjNum 407 snap 122 seq_num 407) 2024-03-04T06:46:24.162 INFO:tasks.rados.rados.0.smithi137.stdout:1306: setattr oid 47 current snap is 127 2024-03-04T06:46:24.163 INFO:tasks.rados.rados.0.smithi137.stdout:1302: finishing rollback tid 2 to smithi13777483-45 2024-03-04T06:46:24.163 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 317 (ObjNum 129 snap 0 seq_num 3130629328) dirty exists 2024-03-04T06:46:24.164 INFO:tasks.rados.rados.0.smithi137.stdout:1302: done (5 left) 2024-03-04T06:46:24.164 INFO:tasks.rados.rados.0.smithi137.stdout:1307: snap_remove snap 123 2024-03-04T06:46:24.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:24.018+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:24.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:24 smithi137 ceph-mon[91314]: osdmap e321: 8 total, 8 up, 8 in 2024-03-04T06:46:24.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset a7=[]:{a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:24.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:24.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:46:24.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:24 smithi137 ceph-mon[91314]: osd.1 marked itself down and dead 2024-03-04T06:46:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:24 smithi137 ceph-mon[88869]: osdmap e321: 8 total, 8 up, 8 in 2024-03-04T06:46:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset a7=[]:{a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:46:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:24 smithi137 ceph-mon[88869]: osd.1 marked itself down and dead 2024-03-04T06:46:24.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:24 smithi203 ceph-mon[85573]: osdmap e321: 8 total, 8 up, 8 in 2024-03-04T06:46:24.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset a7=[]:{a7=[a7,a6,a5,a4,a2,a0,9f,9e]} for object 5:a94e4514:::smithi13777483-4:9c 2024-03-04T06:46:24.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:24.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:46:24.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:24 smithi203 ceph-mon[85573]: osd.1 marked itself down and dead 2024-03-04T06:46:24.864 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:24 smithi137 podman[101513]: 2024-03-04 06:46:24.574035655 +0000 UTC m=+1.221763684 container died 708139c858a7da3295afa6a77daa7f8c21e004a059d6ca9e0d77eefa3c47899a (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=reef-5cc7a76, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-03-04T06:46:25.028 INFO:tasks.rados.rados.0.smithi137.stdout:1307: done (5 left) 2024-03-04T06:46:25.029 INFO:tasks.rados.rados.0.smithi137.stdout:1308: read oid 25 snap -1 2024-03-04T06:46:25.029 INFO:tasks.rados.rados.0.smithi137.stdout:1308: expect (ObjNum 296 snap 95 seq_num 296) 2024-03-04T06:46:25.029 INFO:tasks.rados.rados.0.smithi137.stdout:1309: snap_create 2024-03-04T06:46:25.045 INFO:tasks.rados.rados.0.smithi137.stdout:1295: finishing write tid 1 to smithi13777483-32 2024-03-04T06:46:25.046 INFO:tasks.rados.rados.0.smithi137.stdout:1295: finishing write tid 2 to smithi13777483-32 2024-03-04T06:46:25.046 INFO:tasks.rados.rados.0.smithi137.stdout:1295: finishing write tid 3 to smithi13777483-32 2024-03-04T06:46:25.046 INFO:tasks.rados.rados.0.smithi137.stdout:1295: finishing write tid 4 to smithi13777483-32 2024-03-04T06:46:25.047 INFO:tasks.rados.rados.0.smithi137.stdout:1295: finishing write tid 5 to smithi13777483-32 2024-03-04T06:46:25.047 INFO:tasks.rados.rados.0.smithi137.stdout:1299: finishing write tid 1 to smithi13777483-21 2024-03-04T06:46:25.048 INFO:tasks.rados.rados.0.smithi137.stdout:1295: finishing write tid 6 to smithi13777483-32 2024-03-04T06:46:25.048 INFO:tasks.rados.rados.0.smithi137.stdout:1295: oid 32 updating version 0 to 1004 2024-03-04T06:46:25.048 INFO:tasks.rados.rados.0.smithi137.stdout:1295: oid 32 updating version 1004 to 1007 2024-03-04T06:46:25.048 INFO:tasks.rados.rados.0.smithi137.stdout:1295: oid 32 version 1007 is already newer than 1006 2024-03-04T06:46:25.048 INFO:tasks.rados.rados.0.smithi137.stdout:1295: oid 32 version 1007 is already newer than 1005 2024-03-04T06:46:25.049 INFO:tasks.rados.rados.0.smithi137.stdout:1295: oid 32 version 1007 is already newer than 1003 2024-03-04T06:46:25.049 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 1007 (ObjNum 426 snap 127 seq_num 426) dirty exists 2024-03-04T06:46:25.049 INFO:tasks.rados.rados.0.smithi137.stdout:1295: left oid 32 (ObjNum 426 snap 127 seq_num 426) 2024-03-04T06:46:25.049 INFO:tasks.rados.rados.0.smithi137.stdout:1299: finishing write tid 2 to smithi13777483-21 2024-03-04T06:46:25.049 INFO:tasks.rados.rados.0.smithi137.stdout:1299: finishing write tid 3 to smithi13777483-21 2024-03-04T06:46:25.050 INFO:tasks.rados.rados.0.smithi137.stdout:1299: finishing write tid 4 to smithi13777483-21 2024-03-04T06:46:25.051 INFO:tasks.rados.rados.0.smithi137.stdout:1299: finishing write tid 5 to smithi13777483-21 2024-03-04T06:46:25.052 INFO:tasks.rados.rados.0.smithi137.stdout:1299: finishing write tid 6 to smithi13777483-21 2024-03-04T06:46:25.062 INFO:tasks.rados.rados.0.smithi137.stdout:1299: finishing write tid 7 to smithi13777483-21 2024-03-04T06:46:25.062 INFO:tasks.rados.rados.0.smithi137.stdout:1299: oid 21 updating version 0 to 920 2024-03-04T06:46:25.062 INFO:tasks.rados.rados.0.smithi137.stdout:1299: oid 21 version 920 is already newer than 918 2024-03-04T06:46:25.063 INFO:tasks.rados.rados.0.smithi137.stdout:1299: oid 21 version 920 is already newer than 916 2024-03-04T06:46:25.063 INFO:tasks.rados.rados.0.smithi137.stdout:1299: oid 21 version 920 is already newer than 917 2024-03-04T06:46:25.063 INFO:tasks.rados.rados.0.smithi137.stdout:1299: oid 21 version 920 is already newer than 919 2024-03-04T06:46:25.063 INFO:tasks.rados.rados.0.smithi137.stdout:1299: oid 21 updating version 920 to 921 2024-03-04T06:46:25.063 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 921 (ObjNum 428 snap 127 seq_num 428) dirty exists 2024-03-04T06:46:25.063 INFO:tasks.rados.rados.0.smithi137.stdout:1299: left oid 21 (ObjNum 428 snap 127 seq_num 428) 2024-03-04T06:46:25.066 INFO:tasks.rados.rados.0.smithi137.stdout:1305: expect (ObjNum 407 snap 122 seq_num 407) 2024-03-04T06:46:25.118 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 923 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:46:25.118 INFO:tasks.rados.rados.0.smithi137.stdout:1308: expect (ObjNum 296 snap 95 seq_num 296) 2024-03-04T06:46:25.256 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:25 smithi137 ceph-mon[91314]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:46:25.257 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:25 smithi137 ceph-mon[91314]: osdmap e322: 8 total, 7 up, 8 in 2024-03-04T06:46:25.257 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:25.257 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:25 smithi137 ceph-mon[91314]: pgmap v156: 121 pgs: 36 peering, 2 stale+active+clean, 2 active+clean+snaptrim_error, 81 active+clean; 277 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2024-03-04T06:46:25.257 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:25 smithi137 ceph-mon[88869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:46:25.257 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:25 smithi137 ceph-mon[88869]: osdmap e322: 8 total, 7 up, 8 in 2024-03-04T06:46:25.257 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:25.257 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:25 smithi137 ceph-mon[88869]: pgmap v156: 121 pgs: 36 peering, 2 stale+active+clean, 2 active+clean+snaptrim_error, 81 active+clean; 277 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2024-03-04T06:46:25.257 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:46:25.013+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 2 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:46:25.258 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:25.033+0000 7f5c51093700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 96 after trimming was started 2024-03-04T06:46:25.258 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:25.034+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:25.258 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:24 smithi137 podman[101513]: 2024-03-04 06:46:24.980406163 +0000 UTC m=+1.628134189 container cleanup 708139c858a7da3295afa6a77daa7f8c21e004a059d6ca9e0d77eefa3c47899a (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=reef-5cc7a76, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-03-04T06:46:25.258 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:24 smithi137 bash[101513]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1 2024-03-04T06:46:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:25 smithi203 ceph-mon[85573]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:46:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:25 smithi203 ceph-mon[85573]: osdmap e322: 8 total, 7 up, 8 in 2024-03-04T06:46:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:25 smithi203 ceph-mon[85573]: pgmap v156: 121 pgs: 36 peering, 2 stale+active+clean, 2 active+clean+snaptrim_error, 81 active+clean; 277 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2024-03-04T06:46:25.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:46:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:46:25] "GET /metrics HTTP/1.1" 200 36193 "" "Prometheus/2.43.0" 2024-03-04T06:46:25.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:25 smithi137 podman[101529]: 2024-03-04 06:46:25.256864748 +0000 UTC m=+0.683042707 container remove 708139c858a7da3295afa6a77daa7f8c21e004a059d6ca9e0d77eefa3c47899a (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-5cc7a76, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True) 2024-03-04T06:46:25.927 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:25 smithi137 podman[101620]: 2024-03-04 06:46:25.556708094 +0000 UTC m=+0.018581064 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:46:25.928 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:25 smithi137 podman[101620]: 2024-03-04 06:46:25.691160286 +0000 UTC m=+0.153033248 container create 150da34d8526d4e6db3ff767596d70b901139300c7c8c92b82e71d323c650495 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:46:25.928 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:25 smithi137 podman[101620]: 2024-03-04 06:46:25.927474533 +0000 UTC m=+0.389347499 container init 150da34d8526d4e6db3ff767596d70b901139300c7c8c92b82e71d323c650495 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:46:26.029 INFO:tasks.rados.rados.0.smithi137.stdout:1295: done (6 left) 2024-03-04T06:46:26.030 INFO:tasks.rados.rados.0.smithi137.stdout:1298: done (5 left) 2024-03-04T06:46:26.030 INFO:tasks.rados.rados.0.smithi137.stdout:1299: done (4 left) 2024-03-04T06:46:26.030 INFO:tasks.rados.rados.0.smithi137.stdout:1305: done (3 left) 2024-03-04T06:46:26.030 INFO:tasks.rados.rados.0.smithi137.stdout:1306: done (2 left) 2024-03-04T06:46:26.030 INFO:tasks.rados.rados.0.smithi137.stdout:1308: done (1 left) 2024-03-04T06:46:26.030 INFO:tasks.rados.rados.0.smithi137.stdout:1309: done (0 left) 2024-03-04T06:46:26.030 INFO:tasks.rados.rados.0.smithi137.stdout:1310: read oid 11 snap -1 2024-03-04T06:46:26.030 INFO:tasks.rados.rados.0.smithi137.stdout:1310: expect deleted 2024-03-04T06:46:26.030 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 24 current snap is 128 2024-03-04T06:46:26.030 INFO:tasks.rados.rados.0.smithi137.stdout:1311: seq_num 432 ranges {0=40960} 2024-03-04T06:46:26.030 INFO:tasks.rados.rados.0.smithi137.stdout:1311: writing smithi13777483-24 from 0 to 40960 tid 1 2024-03-04T06:46:26.030 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 128 2024-03-04T06:46:26.031 INFO:tasks.rados.rados.0.smithi137.stdout:1312: seq_num 433 ranges {4235264=57344} 2024-03-04T06:46:26.052 INFO:tasks.rados.rados.0.smithi137.stdout:1312: writing smithi13777483-32 from 4235264 to 4292608 tid 1 2024-03-04T06:46:26.052 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 36 current snap is 128 2024-03-04T06:46:26.053 INFO:tasks.rados.rados.0.smithi137.stdout:1313: seq_num 434 ranges {0=73728} 2024-03-04T06:46:26.053 INFO:tasks.rados.rados.0.smithi137.stdout:1313: writing smithi13777483-36 from 0 to 73728 tid 1 2024-03-04T06:46:26.053 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 128 2024-03-04T06:46:26.053 INFO:tasks.rados.rados.0.smithi137.stdout:1314: seq_num 435 ranges {7176192=90112} 2024-03-04T06:46:26.092 INFO:tasks.rados.rados.0.smithi137.stdout:1314: writing smithi13777483-22 from 7176192 to 7266304 tid 1 2024-03-04T06:46:26.093 INFO:tasks.rados.rados.0.smithi137.stdout:1315: snap_remove snap 100 2024-03-04T06:46:26.238 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:26 smithi137 ceph-mon[88869]: Health check failed: Reduced data availability: 9 pgs inactive, 12 pgs peering (PG_AVAILABILITY) 2024-03-04T06:46:26.238 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:26 smithi137 ceph-mon[88869]: Health check update: Possible data damage: 2 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:46:26.238 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:26 smithi137 ceph-mon[88869]: osdmap e323: 8 total, 7 up, 8 in 2024-03-04T06:46:26.238 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:26.239 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:26 smithi137 ceph-mon[91314]: Health check failed: Reduced data availability: 9 pgs inactive, 12 pgs peering (PG_AVAILABILITY) 2024-03-04T06:46:26.239 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:26 smithi137 ceph-mon[91314]: Health check update: Possible data damage: 2 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:46:26.239 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:26 smithi137 ceph-mon[91314]: osdmap e323: 8 total, 7 up, 8 in 2024-03-04T06:46:26.239 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:26.239 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:25 smithi137 podman[101620]: 2024-03-04 06:46:25.931267368 +0000 UTC m=+0.393140326 container start 150da34d8526d4e6db3ff767596d70b901139300c7c8c92b82e71d323c650495 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-04T06:46:26.239 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:26 smithi137 podman[101620]: 2024-03-04 06:46:26.002165864 +0000 UTC m=+0.464038849 container attach 150da34d8526d4e6db3ff767596d70b901139300c7c8c92b82e71d323c650495 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5) 2024-03-04T06:46:26.239 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:26.034+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:26.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:26 smithi203 ceph-mon[85573]: Health check failed: Reduced data availability: 9 pgs inactive, 12 pgs peering (PG_AVAILABILITY) 2024-03-04T06:46:26.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:26 smithi203 ceph-mon[85573]: Health check update: Possible data damage: 2 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:46:26.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:26 smithi203 ceph-mon[85573]: osdmap e323: 8 total, 7 up, 8 in 2024-03-04T06:46:26.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:26.521 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:26 smithi137 podman[101620]: 2024-03-04 06:46:26.238806683 +0000 UTC m=+0.700679656 container died 150da34d8526d4e6db3ff767596d70b901139300c7c8c92b82e71d323c650495 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-03-04T06:46:27.042 INFO:tasks.rados.rados.0.smithi137.stdout:1315: done (5 left) 2024-03-04T06:46:27.042 INFO:tasks.rados.rados.0.smithi137.stdout:1316: rollback oid 34 current snap is 128 2024-03-04T06:46:27.042 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 34 to 127 2024-03-04T06:46:27.042 INFO:tasks.rados.rados.0.smithi137.stdout:1311: finishing write tid 1 to smithi13777483-24 2024-03-04T06:46:27.042 INFO:tasks.rados.rados.0.smithi137.stdout:1311: finishing write tid 2 to smithi13777483-24 2024-03-04T06:46:27.042 INFO:tasks.rados.rados.0.smithi137.stdout:1311: finishing write tid 3 to smithi13777483-24 2024-03-04T06:46:27.042 INFO:tasks.rados.rados.0.smithi137.stdout:1311: oid 24 updating version 0 to 342 2024-03-04T06:46:27.042 INFO:tasks.rados.rados.0.smithi137.stdout:1311: oid 24 version 342 is already newer than 341 2024-03-04T06:46:27.042 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 342 (ObjNum 432 snap 128 seq_num 432) dirty exists 2024-03-04T06:46:27.042 INFO:tasks.rados.rados.0.smithi137.stdout:1311: left oid 24 (ObjNum 432 snap 128 seq_num 432) 2024-03-04T06:46:27.042 INFO:tasks.rados.rados.0.smithi137.stdout:1313: finishing write tid 1 to smithi13777483-36 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:1313: finishing write tid 2 to smithi13777483-36 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:1312: finishing write tid 1 to smithi13777483-32 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:1312: finishing write tid 2 to smithi13777483-32 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:1313: finishing write tid 3 to smithi13777483-36 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:1313: oid 36 updating version 0 to 336 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:1313: oid 36 version 336 is already newer than 335 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 336 (ObjNum 434 snap 128 seq_num 434) dirty exists 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:1313: left oid 36 (ObjNum 434 snap 128 seq_num 434) 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:1312: finishing write tid 3 to smithi13777483-32 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:1312: oid 32 updating version 0 to 1009 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:1312: oid 32 updating version 1009 to 1010 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 1010 (ObjNum 433 snap 128 seq_num 433) dirty exists 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:1312: left oid 32 (ObjNum 433 snap 128 seq_num 433) 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:1314: finishing write tid 1 to smithi13777483-22 2024-03-04T06:46:27.043 INFO:tasks.rados.rados.0.smithi137.stdout:1314: finishing write tid 2 to smithi13777483-22 2024-03-04T06:46:27.044 INFO:tasks.rados.rados.0.smithi137.stdout:1314: finishing write tid 3 to smithi13777483-22 2024-03-04T06:46:27.044 INFO:tasks.rados.rados.0.smithi137.stdout:1314: oid 22 updating version 0 to 832 2024-03-04T06:46:27.044 INFO:tasks.rados.rados.0.smithi137.stdout:1314: oid 22 updating version 832 to 833 2024-03-04T06:46:27.044 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 833 (ObjNum 435 snap 128 seq_num 435) dirty exists 2024-03-04T06:46:27.044 INFO:tasks.rados.rados.0.smithi137.stdout:1314: left oid 22 (ObjNum 435 snap 128 seq_num 435) 2024-03-04T06:46:27.044 INFO:tasks.rados.rados.0.smithi137.stdout:1310: done (5 left) 2024-03-04T06:46:27.044 INFO:tasks.rados.rados.0.smithi137.stdout:1311: done (4 left) 2024-03-04T06:46:27.044 INFO:tasks.rados.rados.0.smithi137.stdout:1312: done (3 left) 2024-03-04T06:46:27.044 INFO:tasks.rados.rados.0.smithi137.stdout:1313: done (2 left) 2024-03-04T06:46:27.044 INFO:tasks.rados.rados.0.smithi137.stdout:1314: done (1 left) 2024-03-04T06:46:27.044 INFO:tasks.rados.rados.0.smithi137.stdout:1317: snap_remove snap 119 2024-03-04T06:46:27.055 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-mon[88869]: osdmap e324: 8 total, 7 up, 8 in 2024-03-04T06:46:27.056 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:27.056 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-mon[88869]: pgmap v159: 121 pgs: 36 peering, 2 stale+active+clean, 2 active+clean+snaptrim_error, 81 active+clean; 277 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2024-03-04T06:46:27.056 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-mon[91314]: osdmap e324: 8 total, 7 up, 8 in 2024-03-04T06:46:27.056 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:27.056 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-mon[91314]: pgmap v159: 121 pgs: 36 peering, 2 stale+active+clean, 2 active+clean+snaptrim_error, 81 active+clean; 277 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2024-03-04T06:46:27.056 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:27.036+0000 7f5c51093700 -1 osd.0 pg_epoch: 324 pg[5.bs1( v 322'735 (0'0,322'735] local-lis/les=297/298 n=12 ec=72/72 lis/c=297/297 les/c/f=298/298/0 sis=297) [2,0,5]p2(0) r=1 lpr=297 luod=0'0 crt=322'734 mlcod 322'734 active mbc={} ps=[96~1,99~2,9f~2,a2~1,a4~4,a9~7,b2~4,b7~1]] update_snap_map remove_oid 5:dc845682:::smithi13777483-3:9e failed with -2 2024-03-04T06:46:27.057 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:26 smithi137 podman[101646]: 2024-03-04 06:46:26.797107671 +0000 UTC m=+0.553797245 container remove 150da34d8526d4e6db3ff767596d70b901139300c7c8c92b82e71d323c650495 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:46:27.057 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:26 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.1.service: Deactivated successfully. 2024-03-04T06:46:27.057 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:26 smithi137 systemd[1]: Stopped Ceph osd.1 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:46:27.057 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:26 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.1.service: Consumed 11.899s CPU time. 2024-03-04T06:46:27.057 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 systemd[1]: Starting Ceph osd.1 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:46:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:27 smithi203 ceph-mon[85573]: osdmap e324: 8 total, 7 up, 8 in 2024-03-04T06:46:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:27 smithi203 ceph-mon[85573]: pgmap v159: 121 pgs: 36 peering, 2 stale+active+clean, 2 active+clean+snaptrim_error, 81 active+clean; 277 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2024-03-04T06:46:27.409 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:27.055+0000 7f5c5509b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 96 after trimming was started 2024-03-04T06:46:27.409 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:27.055+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:27.409 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 podman[101751]: 2024-03-04 06:46:27.16189453 +0000 UTC m=+0.018226821 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:46:27.409 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 podman[101751]: 2024-03-04 06:46:27.290372321 +0000 UTC m=+0.146704634 container create 4dff91e374f92386f504174563cc5bb73deca4e4497734b017195197e69a20cb (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0) 2024-03-04T06:46:27.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 podman[101751]: 2024-03-04 06:46:27.530547379 +0000 UTC m=+0.386879664 container init 4dff91e374f92386f504174563cc5bb73deca4e4497734b017195197e69a20cb (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-activate, GIT_CLEAN=True, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T06:46:27.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 podman[101751]: 2024-03-04 06:46:27.534323907 +0000 UTC m=+0.390656179 container start 4dff91e374f92386f504174563cc5bb73deca4e4497734b017195197e69a20cb (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-activate, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:46:27.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 podman[101751]: 2024-03-04 06:46:27.605396692 +0000 UTC m=+0.461728974 container attach 4dff91e374f92386f504174563cc5bb73deca4e4497734b017195197e69a20cb (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD) 2024-03-04T06:46:28.042 INFO:tasks.rados.rados.0.smithi137.stdout:1317: done (1 left) 2024-03-04T06:46:28.042 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 128 2024-03-04T06:46:28.042 INFO:tasks.rados.rados.0.smithi137.stdout:1316: finishing rollback tid 0 to smithi13777483-34 2024-03-04T06:46:28.042 INFO:tasks.rados.rados.0.smithi137.stdout:1318: seq_num 436 ranges {2097152=106496} 2024-03-04T06:46:28.055 INFO:tasks.rados.rados.0.smithi137.stdout:1318: writing smithi13777483-23 from 2097152 to 2203648 tid 1 2024-03-04T06:46:28.055 INFO:tasks.rados.rados.0.smithi137.stdout:1316: finishing rollback tid 1 to smithi13777483-34 2024-03-04T06:46:28.055 INFO:tasks.rados.rados.0.smithi137.stdout:1319: read oid 13 snap 126 2024-03-04T06:46:28.055 INFO:tasks.rados.rados.0.smithi137.stdout:1319: expect deleted 2024-03-04T06:46:28.055 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 29 current snap is 128 2024-03-04T06:46:28.055 INFO:tasks.rados.rados.0.smithi137.stdout:1316: finishing rollback tid 2 to smithi13777483-34 2024-03-04T06:46:28.055 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16725 (ObjNum 408 snap 122 seq_num 408) dirty exists 2024-03-04T06:46:28.056 INFO:tasks.rados.rados.0.smithi137.stdout:1320: seq_num 437 ranges {0=122880} 2024-03-04T06:46:28.056 INFO:tasks.rados.rados.0.smithi137.stdout:1320: writing smithi13777483-29 from 0 to 122880 tid 1 2024-03-04T06:46:28.056 INFO:tasks.rados.rados.0.smithi137.stdout:1316: done (3 left) 2024-03-04T06:46:28.056 INFO:tasks.rados.rados.0.smithi137.stdout:1321: copy_from oid 40 from oid 41 current snap is 128 2024-03-04T06:46:28.056 INFO:tasks.rados.rados.0.smithi137.stdout:1319: done (3 left) 2024-03-04T06:46:28.056 INFO:tasks.rados.rados.0.smithi137.stdout:1322: snap_remove snap 127 2024-03-04T06:46:28.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:28 smithi137 ceph-mon[88869]: osdmap e325: 8 total, 7 up, 8 in 2024-03-04T06:46:28.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:28.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:28 smithi137 ceph-mon[91314]: osdmap e325: 8 total, 7 up, 8 in 2024-03-04T06:46:28.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:28.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:28.046+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:28.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-activate[101765]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-04T06:46:28.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-activate[101765]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-04T06:46:28.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-activate[101765]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-04T06:46:28.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-activate[101765]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-04T06:46:28.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-activate[101765]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-03-04T06:46:28.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 bash[101751]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-04T06:46:28.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 bash[101751]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-04T06:46:28.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 bash[101751]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-04T06:46:28.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 bash[101751]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-04T06:46:28.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 bash[101751]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-03-04T06:46:28.295 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 bash[101751]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-04T06:46:28.295 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 bash[101751]: --> ceph-volume raw activate successful for osd ID: 1 2024-03-04T06:46:28.295 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-activate[101765]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-04T06:46:28.295 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-activate[101765]: --> ceph-volume raw activate successful for osd ID: 1 2024-03-04T06:46:28.295 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:27 smithi137 podman[101751]: 2024-03-04 06:46:27.991778539 +0000 UTC m=+0.848110812 container died 4dff91e374f92386f504174563cc5bb73deca4e4497734b017195197e69a20cb (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-activate, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:46:28.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:28 smithi203 ceph-mon[85573]: osdmap e325: 8 total, 7 up, 8 in 2024-03-04T06:46:28.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:28.976 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:28 smithi137 podman[101882]: 2024-03-04 06:46:28.725898146 +0000 UTC m=+0.729122197 container remove 4dff91e374f92386f504174563cc5bb73deca4e4497734b017195197e69a20cb (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True) 2024-03-04T06:46:28.976 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:28 smithi137 podman[101947]: 2024-03-04 06:46:28.840015864 +0000 UTC m=+0.017853960 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:46:28.977 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:28 smithi137 podman[101947]: 2024-03-04 06:46:28.976856735 +0000 UTC m=+0.154694832 container create 47b5cdaad147457289732c305968f39d1b51d829dbcd669f1f3aa68dfcf08228 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T06:46:29.048 INFO:tasks.rados.rados.0.smithi137.stdout:1322: done (3 left) 2024-03-04T06:46:29.048 INFO:tasks.rados.rados.0.smithi137.stdout:1323: snap_create 2024-03-04T06:46:29.048 INFO:tasks.rados.rados.0.smithi137.stdout:1320: finishing write tid 1 to smithi13777483-29 2024-03-04T06:46:29.048 INFO:tasks.rados.rados.0.smithi137.stdout:1318: finishing write tid 1 to smithi13777483-23 2024-03-04T06:46:29.048 INFO:tasks.rados.rados.0.smithi137.stdout:1320: finishing write tid 2 to smithi13777483-29 2024-03-04T06:46:29.048 INFO:tasks.rados.rados.0.smithi137.stdout:1318: finishing write tid 2 to smithi13777483-23 2024-03-04T06:46:29.048 INFO:tasks.rados.rados.0.smithi137.stdout:1318: finishing write tid 3 to smithi13777483-23 2024-03-04T06:46:29.048 INFO:tasks.rados.rados.0.smithi137.stdout:1318: oid 23 updating version 0 to 616 2024-03-04T06:46:29.048 INFO:tasks.rados.rados.0.smithi137.stdout:1318: oid 23 version 616 is already newer than 615 2024-03-04T06:46:29.048 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 616 (ObjNum 436 snap 128 seq_num 436) dirty exists 2024-03-04T06:46:29.048 INFO:tasks.rados.rados.0.smithi137.stdout:1318: left oid 23 (ObjNum 436 snap 128 seq_num 436) 2024-03-04T06:46:29.048 INFO:tasks.rados.rados.0.smithi137.stdout:1320: finishing write tid 3 to smithi13777483-29 2024-03-04T06:46:29.048 INFO:tasks.rados.rados.0.smithi137.stdout:1320: oid 29 updating version 0 to 587 2024-03-04T06:46:29.049 INFO:tasks.rados.rados.0.smithi137.stdout:1320: oid 29 version 587 is already newer than 586 2024-03-04T06:46:29.049 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 587 (ObjNum 437 snap 128 seq_num 437) dirty exists 2024-03-04T06:46:29.049 INFO:tasks.rados.rados.0.smithi137.stdout:1320: left oid 29 (ObjNum 437 snap 128 seq_num 437) 2024-03-04T06:46:29.049 INFO:tasks.rados.rados.0.smithi137.stdout:1321: finishing copy_from racing read to smithi13777483-40 2024-03-04T06:46:29.049 INFO:tasks.rados.rados.0.smithi137.stdout:1321: finishing copy_from to smithi13777483-40 2024-03-04T06:46:29.049 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 313 (ObjNum 427 snap 127 seq_num 427) dirty exists 2024-03-04T06:46:29.238 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:29 smithi137 ceph-mon[88869]: osdmap e326: 8 total, 7 up, 8 in 2024-03-04T06:46:29.238 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:29.238 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:29 smithi137 ceph-mon[88869]: pgmap v162: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 36 peering, 1 active+clean+snaptrim_error, 7 active+undersized, 76 active+clean; 277 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 0 B/s wr, 0 op/s; 2/630 objects degraded (0.317%) 2024-03-04T06:46:29.238 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:29 smithi137 ceph-mon[91314]: osdmap e326: 8 total, 7 up, 8 in 2024-03-04T06:46:29.238 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:29.238 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:29 smithi137 ceph-mon[91314]: pgmap v162: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 36 peering, 1 active+clean+snaptrim_error, 7 active+undersized, 76 active+clean; 277 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 0 B/s wr, 0 op/s; 2/630 objects degraded (0.317%) 2024-03-04T06:46:29.239 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:29.046+0000 7f5c5509b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 96 after trimming was started 2024-03-04T06:46:29.239 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:29.046+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:29.239 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:29 smithi137 podman[101947]: 2024-03-04 06:46:29.154748812 +0000 UTC m=+0.332586923 container init 47b5cdaad147457289732c305968f39d1b51d829dbcd669f1f3aa68dfcf08228 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:46:29.239 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:29 smithi137 podman[101947]: 2024-03-04 06:46:29.157805773 +0000 UTC m=+0.335643870 container start 47b5cdaad147457289732c305968f39d1b51d829dbcd669f1f3aa68dfcf08228 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-04T06:46:29.239 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:29 smithi137 ceph-osd[101967]: -- 172.21.15.137:0/2216763501 <== mon.0 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558baeb8d680 con 0x558baeb57400 2024-03-04T06:46:29.239 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:29 smithi137 bash[101947]: 47b5cdaad147457289732c305968f39d1b51d829dbcd669f1f3aa68dfcf08228 2024-03-04T06:46:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:29 smithi203 ceph-mon[85573]: osdmap e326: 8 total, 7 up, 8 in 2024-03-04T06:46:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:29 smithi203 ceph-mon[85573]: pgmap v162: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 36 peering, 1 active+clean+snaptrim_error, 7 active+undersized, 76 active+clean; 277 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 0 B/s wr, 0 op/s; 2/630 objects degraded (0.317%) 2024-03-04T06:46:29.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:29 smithi137 systemd[1]: Started Ceph osd.1 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:46:30.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:29.696+0000 7fb3e7d4c7c0 -1 Falling back to public interface 2024-03-04T06:46:30.049 INFO:tasks.rados.rados.0.smithi137.stdout:1318: done (3 left) 2024-03-04T06:46:30.049 INFO:tasks.rados.rados.0.smithi137.stdout:1320: done (2 left) 2024-03-04T06:46:30.049 INFO:tasks.rados.rados.0.smithi137.stdout:1321: done (1 left) 2024-03-04T06:46:30.049 INFO:tasks.rados.rados.0.smithi137.stdout:1323: done (0 left) 2024-03-04T06:46:30.049 INFO:tasks.rados.rados.0.smithi137.stdout:1324: read oid 28 snap -1 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:1324: expect (ObjNum 407 snap 122 seq_num 407) 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:1325: read oid 11 snap -1 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:1325: expect deleted 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:1326: read oid 14 snap -1 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:1326: expect deleted 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:1327: copy_from oid 50 from oid 12 current snap is 129 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 129 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:1328: seq_num 438 ranges {0=139264} 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:1328: writing smithi13777483-45 from 0 to 139264 tid 1 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:1329: read oid 2 snap 128 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:1329: expect (ObjNum 219 snap 63 seq_num 219) 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:1330: rollback oid 37 current snap is 129 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 37 to 124 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 40 current snap is 129 2024-03-04T06:46:30.050 INFO:tasks.rados.rados.0.smithi137.stdout:1331: seq_num 439 ranges {4734976=155648} 2024-03-04T06:46:30.078 INFO:tasks.rados.rados.0.smithi137.stdout:1331: writing smithi13777483-40 from 4734976 to 4890624 tid 1 2024-03-04T06:46:30.078 INFO:tasks.rados.rados.0.smithi137.stdout:1332: snap_remove snap 110 2024-03-04T06:46:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:30 smithi203 ceph-mon[85573]: Health check failed: Degraded data redundancy: 2/630 objects degraded (0.317%), 1 pg degraded (PG_DEGRADED) 2024-03-04T06:46:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:30 smithi203 ceph-mon[85573]: osdmap e327: 8 total, 7 up, 8 in 2024-03-04T06:46:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:46:30.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:30.058+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:30 smithi137 ceph-mon[88869]: Health check failed: Degraded data redundancy: 2/630 objects degraded (0.317%), 1 pg degraded (PG_DEGRADED) 2024-03-04T06:46:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:30 smithi137 ceph-mon[88869]: osdmap e327: 8 total, 7 up, 8 in 2024-03-04T06:46:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:46:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:30 smithi137 ceph-mon[91314]: Health check failed: Degraded data redundancy: 2/630 objects degraded (0.317%), 1 pg degraded (PG_DEGRADED) 2024-03-04T06:46:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:30 smithi137 ceph-mon[91314]: osdmap e327: 8 total, 7 up, 8 in 2024-03-04T06:46:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:46:31.063 INFO:tasks.rados.rados.0.smithi137.stdout:1332: done (8 left) 2024-03-04T06:46:31.063 INFO:tasks.rados.rados.0.smithi137.stdout:1333: snap_remove snap 80 2024-03-04T06:46:31.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:31.062+0000 7f5c51093700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 96 after trimming was started 2024-03-04T06:46:31.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:31.062+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:31.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:31 smithi137 ceph-mon[88869]: osdmap e328: 8 total, 7 up, 8 in 2024-03-04T06:46:31.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:31.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:31 smithi137 ceph-mon[88869]: pgmap v165: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 1 active+clean+snaptrim_error, 33 active+undersized, 76 active+clean; 271 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 15 op/s; 92/609 objects degraded (15.107%) 2024-03-04T06:46:31.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:31 smithi137 ceph-mon[91314]: osdmap e328: 8 total, 7 up, 8 in 2024-03-04T06:46:31.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:31.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:31 smithi137 ceph-mon[91314]: pgmap v165: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 1 active+clean+snaptrim_error, 33 active+undersized, 76 active+clean; 271 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 15 op/s; 92/609 objects degraded (15.107%) 2024-03-04T06:46:31.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:31 smithi203 ceph-mon[85573]: osdmap e328: 8 total, 7 up, 8 in 2024-03-04T06:46:31.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:31.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:31 smithi203 ceph-mon[85573]: pgmap v165: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 1 active+clean+snaptrim_error, 33 active+undersized, 76 active+clean; 271 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 15 op/s; 92/609 objects degraded (15.107%) 2024-03-04T06:46:32.071 INFO:tasks.rados.rados.0.smithi137.stdout:1333: done (8 left) 2024-03-04T06:46:32.071 INFO:tasks.rados.rados.0.smithi137.stdout:1334: setattr oid 19 current snap is 129 2024-03-04T06:46:32.071 INFO:tasks.rados.rados.0.smithi137.stdout:1328: finishing write tid 1 to smithi13777483-45 2024-03-04T06:46:32.071 INFO:tasks.rados.rados.0.smithi137.stdout:1328: finishing write tid 2 to smithi13777483-45 2024-03-04T06:46:32.071 INFO:tasks.rados.rados.0.smithi137.stdout:1328: finishing write tid 3 to smithi13777483-45 2024-03-04T06:46:32.071 INFO:tasks.rados.rados.0.smithi137.stdout:1328: oid 45 updating version 0 to 330 2024-03-04T06:46:32.071 INFO:tasks.rados.rados.0.smithi137.stdout:1328: oid 45 version 330 is already newer than 329 2024-03-04T06:46:32.071 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 330 (ObjNum 438 snap 129 seq_num 438) dirty exists 2024-03-04T06:46:32.071 INFO:tasks.rados.rados.0.smithi137.stdout:1328: left oid 45 (ObjNum 438 snap 129 seq_num 438) 2024-03-04T06:46:32.071 INFO:tasks.rados.rados.0.smithi137.stdout:1329: expect (ObjNum 219 snap 63 seq_num 219) 2024-03-04T06:46:32.108 INFO:tasks.rados.rados.0.smithi137.stdout:1330: finishing rollback tid 1 to smithi13777483-37 2024-03-04T06:46:32.108 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 713 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-04T06:46:32.108 INFO:tasks.rados.rados.0.smithi137.stdout:1324: expect (ObjNum 407 snap 122 seq_num 407) 2024-03-04T06:46:32.163 INFO:tasks.rados.rados.0.smithi137.stdout:1327: finishing copy_from racing read to smithi13777483-50 2024-03-04T06:46:32.163 INFO:tasks.rados.rados.0.smithi137.stdout:1327: finishing copy_from to smithi13777483-50 2024-03-04T06:46:32.164 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 541 (ObjNum 354 snap 110 seq_num 354) dirty exists 2024-03-04T06:46:32.164 INFO:tasks.rados.rados.0.smithi137.stdout:1331: finishing write tid 1 to smithi13777483-40 2024-03-04T06:46:32.164 INFO:tasks.rados.rados.0.smithi137.stdout:1331: finishing write tid 2 to smithi13777483-40 2024-03-04T06:46:32.164 INFO:tasks.rados.rados.0.smithi137.stdout:1331: finishing write tid 3 to smithi13777483-40 2024-03-04T06:46:32.164 INFO:tasks.rados.rados.0.smithi137.stdout:1331: oid 40 updating version 0 to 853 2024-03-04T06:46:32.164 INFO:tasks.rados.rados.0.smithi137.stdout:1331: oid 40 updating version 853 to 854 2024-03-04T06:46:32.164 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 854 (ObjNum 439 snap 129 seq_num 439) dirty exists 2024-03-04T06:46:32.164 INFO:tasks.rados.rados.0.smithi137.stdout:1331: left oid 40 (ObjNum 439 snap 129 seq_num 439) 2024-03-04T06:46:32.164 INFO:tasks.rados.rados.0.smithi137.stdout:1324: done (8 left) 2024-03-04T06:46:32.164 INFO:tasks.rados.rados.0.smithi137.stdout:1325: done (7 left) 2024-03-04T06:46:32.164 INFO:tasks.rados.rados.0.smithi137.stdout:1326: done (6 left) 2024-03-04T06:46:32.164 INFO:tasks.rados.rados.0.smithi137.stdout:1327: done (5 left) 2024-03-04T06:46:32.164 INFO:tasks.rados.rados.0.smithi137.stdout:1328: done (4 left) 2024-03-04T06:46:32.165 INFO:tasks.rados.rados.0.smithi137.stdout:1329: done (3 left) 2024-03-04T06:46:32.165 INFO:tasks.rados.rados.0.smithi137.stdout:1330: done (2 left) 2024-03-04T06:46:32.165 INFO:tasks.rados.rados.0.smithi137.stdout:1331: done (1 left) 2024-03-04T06:46:32.165 INFO:tasks.rados.rados.0.smithi137.stdout:1335: delete oid 22 current snap is 129 2024-03-04T06:46:32.165 INFO:tasks.rados.rados.0.smithi137.stdout:1335: done (1 left) 2024-03-04T06:46:32.166 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 129 2024-03-04T06:46:32.166 INFO:tasks.rados.rados.0.smithi137.stdout:1336: seq_num 441 ranges {2072576=188416} 2024-03-04T06:46:32.178 INFO:tasks.rados.rados.0.smithi137.stdout:1336: writing smithi13777483-6 from 2072576 to 2260992 tid 1 2024-03-04T06:46:32.178 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 129 2024-03-04T06:46:32.178 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 754 (ObjNum 65 snap 0 seq_num 1516592471) dirty exists 2024-03-04T06:46:32.178 INFO:tasks.rados.rados.0.smithi137.stdout:1337: seq_num 442 ranges {0=204800} 2024-03-04T06:46:32.179 INFO:tasks.rados.rados.0.smithi137.stdout:1337: writing smithi13777483-20 from 0 to 204800 tid 1 2024-03-04T06:46:32.179 INFO:tasks.rados.rados.0.smithi137.stdout:1334: done (2 left) 2024-03-04T06:46:32.179 INFO:tasks.rados.rados.0.smithi137.stdout:1338: snap_remove snap 128 2024-03-04T06:46:32.270 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:32 smithi137 ceph-mon[91314]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs inactive, 12 pgs peering) 2024-03-04T06:46:32.270 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:32.270 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:32 smithi137 ceph-mon[91314]: osdmap e329: 8 total, 7 up, 8 in 2024-03-04T06:46:32.271 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:32.069+0000 7f5c5509b700 -1 osd.0 pg_epoch: 330 pg[5.3s0( v 325'16725 (310'11003,325'16725] local-lis/les=297/298 n=17 ec=72/72 lis/c=297/297 les/c/f=298/298/0 sis=297) [0,3,6]p0(0) r=0 lpr=297 crt=325'16725 lcod 325'16724 mlcod 325'16724 active+clean+snaptrim trimq=[8a~1,96~1,99~2,9e~3,a2~1,a4~c,b1~5,b7~1,b9~1]] update_snap_map remove_oid 5:c64b2138:::smithi13777483-44:8a failed with -2 2024-03-04T06:46:32.271 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:32.083+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:32.271 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:32 smithi137 ceph-mon[88869]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs inactive, 12 pgs peering) 2024-03-04T06:46:32.271 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:32.271 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:32 smithi137 ceph-mon[88869]: osdmap e329: 8 total, 7 up, 8 in 2024-03-04T06:46:32.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:32 smithi203 ceph-mon[85573]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs inactive, 12 pgs peering) 2024-03-04T06:46:32.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{8a=[8a],a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:9a 2024-03-04T06:46:32.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:32 smithi203 ceph-mon[85573]: osdmap e329: 8 total, 7 up, 8 in 2024-03-04T06:46:33.076 INFO:tasks.rados.rados.0.smithi137.stdout:1338: done (2 left) 2024-03-04T06:46:33.076 INFO:tasks.rados.rados.0.smithi137.stdout:1339: snap_remove snap 118 2024-03-04T06:46:33.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:33.077+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:33.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[88869]: osdmap e330: 8 total, 7 up, 8 in 2024-03-04T06:46:33.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:33.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[88869]: pgmap v168: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 1 active+clean+snaptrim_error, 33 active+undersized, 76 active+clean; 271 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 15 op/s; 92/609 objects degraded (15.107%) 2024-03-04T06:46:33.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[88869]: from='osd.1 [v2:172.21.15.137:6810/3966921225,v1:172.21.15.137:6811/3966921225]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T06:46:33.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[88869]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T06:46:33.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:33.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:33.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:32.923+0000 7fb3e7d4c7c0 -1 osd.1 321 log_to_monitors true 2024-03-04T06:46:33.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:33.093+0000 7fb3d91a4700 -1 osd.1 321 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:46:33.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[91314]: osdmap e330: 8 total, 7 up, 8 in 2024-03-04T06:46:33.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:33.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[91314]: pgmap v168: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 1 active+clean+snaptrim_error, 33 active+undersized, 76 active+clean; 271 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 15 op/s; 92/609 objects degraded (15.107%) 2024-03-04T06:46:33.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[91314]: from='osd.1 [v2:172.21.15.137:6810/3966921225,v1:172.21.15.137:6811/3966921225]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T06:46:33.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[91314]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T06:46:33.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:33.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:33 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:33 smithi203 ceph-mon[85573]: osdmap e330: 8 total, 7 up, 8 in 2024-03-04T06:46:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:33 smithi203 ceph-mon[85573]: pgmap v168: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 1 active+clean+snaptrim_error, 33 active+undersized, 76 active+clean; 271 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 15 op/s; 92/609 objects degraded (15.107%) 2024-03-04T06:46:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:33 smithi203 ceph-mon[85573]: from='osd.1 [v2:172.21.15.137:6810/3966921225,v1:172.21.15.137:6811/3966921225]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T06:46:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:33 smithi203 ceph-mon[85573]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T06:46:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:33 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:33 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:34.083 INFO:tasks.rados.rados.0.smithi137.stdout:1339: done (2 left) 2024-03-04T06:46:34.083 INFO:tasks.rados.rados.0.smithi137.stdout:1340: snap_create 2024-03-04T06:46:34.083 INFO:tasks.rados.rados.0.smithi137.stdout:1336: finishing write tid 1 to smithi13777483-6 2024-03-04T06:46:34.083 INFO:tasks.rados.rados.0.smithi137.stdout:1336: finishing write tid 2 to smithi13777483-6 2024-03-04T06:46:34.083 INFO:tasks.rados.rados.0.smithi137.stdout:1337: finishing write tid 1 to smithi13777483-20 2024-03-04T06:46:34.084 INFO:tasks.rados.rados.0.smithi137.stdout:1336: finishing write tid 3 to smithi13777483-6 2024-03-04T06:46:34.084 INFO:tasks.rados.rados.0.smithi137.stdout:1336: oid 6 updating version 0 to 872 2024-03-04T06:46:34.084 INFO:tasks.rados.rados.0.smithi137.stdout:1336: oid 6 updating version 872 to 873 2024-03-04T06:46:34.084 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 873 (ObjNum 441 snap 129 seq_num 441) dirty exists 2024-03-04T06:46:34.084 INFO:tasks.rados.rados.0.smithi137.stdout:1336: left oid 6 (ObjNum 441 snap 129 seq_num 441) 2024-03-04T06:46:34.084 INFO:tasks.rados.rados.0.smithi137.stdout:1337: finishing write tid 2 to smithi13777483-20 2024-03-04T06:46:34.084 INFO:tasks.rados.rados.0.smithi137.stdout:1337: finishing write tid 3 to smithi13777483-20 2024-03-04T06:46:34.084 INFO:tasks.rados.rados.0.smithi137.stdout:1337: oid 20 updating version 0 to 632 2024-03-04T06:46:34.084 INFO:tasks.rados.rados.0.smithi137.stdout:1337: oid 20 updating version 632 to 633 2024-03-04T06:46:34.084 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 633 (ObjNum 442 snap 129 seq_num 442) dirty exists 2024-03-04T06:46:34.084 INFO:tasks.rados.rados.0.smithi137.stdout:1337: left oid 20 (ObjNum 442 snap 129 seq_num 442) 2024-03-04T06:46:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:34 smithi203 ceph-mon[85573]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-04T06:46:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:34 smithi203 ceph-mon[85573]: osdmap e331: 8 total, 7 up, 8 in 2024-03-04T06:46:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:34 smithi203 ceph-mon[85573]: from='osd.1 [v2:172.21.15.137:6810/3966921225,v1:172.21.15.137:6811/3966921225]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:46:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:34 smithi203 ceph-mon[85573]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:46:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:34.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:34.102+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:34.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[91314]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-04T06:46:34.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[91314]: osdmap e331: 8 total, 7 up, 8 in 2024-03-04T06:46:34.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[91314]: from='osd.1 [v2:172.21.15.137:6810/3966921225,v1:172.21.15.137:6811/3966921225]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:46:34.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[91314]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:46:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[88869]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-04T06:46:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[88869]: osdmap e331: 8 total, 7 up, 8 in 2024-03-04T06:46:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[88869]: from='osd.1 [v2:172.21.15.137:6810/3966921225,v1:172.21.15.137:6811/3966921225]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:46:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[88869]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:46:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:35.085 INFO:tasks.rados.rados.0.smithi137.stdout:1336: done (2 left) 2024-03-04T06:46:35.085 INFO:tasks.rados.rados.0.smithi137.stdout:1337: done (1 left) 2024-03-04T06:46:35.085 INFO:tasks.rados.rados.0.smithi137.stdout:1340: done (0 left) 2024-03-04T06:46:35.085 INFO:tasks.rados.rados.0.smithi137.stdout:1341: read oid 50 snap -1 2024-03-04T06:46:35.085 INFO:tasks.rados.rados.0.smithi137.stdout:1341: expect (ObjNum 354 snap 110 seq_num 354) 2024-03-04T06:46:35.085 INFO:tasks.rados.rados.0.smithi137.stdout:1342: delete oid 2 current snap is 130 2024-03-04T06:46:35.093 INFO:tasks.rados.rados.0.smithi137.stdout:1342: done (1 left) 2024-03-04T06:46:35.093 INFO:tasks.rados.rados.0.smithi137.stdout:1343: read oid 3 snap -1 2024-03-04T06:46:35.093 INFO:tasks.rados.rados.0.smithi137.stdout:1343: expect (ObjNum 353 snap 110 seq_num 353) 2024-03-04T06:46:35.093 INFO:tasks.rados.rados.0.smithi137.stdout:1344: snap_create 2024-03-04T06:46:35.101 INFO:tasks.rados.rados.0.smithi137.stdout:1343: expect (ObjNum 353 snap 110 seq_num 353) 2024-03-04T06:46:35.168 INFO:tasks.rados.rados.0.smithi137.stdout:1341: expect (ObjNum 354 snap 110 seq_num 354) 2024-03-04T06:46:35.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[88869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:46:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[88869]: osd.1 [v2:172.21.15.137:6810/3966921225,v1:172.21.15.137:6811/3966921225] boot 2024-03-04T06:46:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[88869]: osdmap e332: 8 total, 8 up, 8 in 2024-03-04T06:46:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:46:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[88869]: pgmap v171: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 22 peering, 4 active+undersized+degraded, 17 active+undersized, 76 active+clean; 200 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 937 KiB/s rd, 910 KiB/s wr, 9 op/s; 27/456 objects degraded (5.921%) 2024-03-04T06:46:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[88869]: Health check update: Degraded data redundancy: 92/609 objects degraded (15.107%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:46:35.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[88869]: osdmap e333: 8 total, 8 up, 8 in 2024-03-04T06:46:35.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[91314]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:46:35.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[91314]: osd.1 [v2:172.21.15.137:6810/3966921225,v1:172.21.15.137:6811/3966921225] boot 2024-03-04T06:46:35.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[91314]: osdmap e332: 8 total, 8 up, 8 in 2024-03-04T06:46:35.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:46:35.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:35.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[91314]: pgmap v171: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 22 peering, 4 active+undersized+degraded, 17 active+undersized, 76 active+clean; 200 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 937 KiB/s rd, 910 KiB/s wr, 9 op/s; 27/456 objects degraded (5.921%) 2024-03-04T06:46:35.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[91314]: Health check update: Degraded data redundancy: 92/609 objects degraded (15.107%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:46:35.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-mon[91314]: osdmap e333: 8 total, 8 up, 8 in 2024-03-04T06:46:35.296 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:35.086+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:35.296 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:35.103+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:35.296 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:35.104+0000 7f5c4f08f700 -1 osd.0 pg_epoch: 333 pg[5.7s2( v 321'364 (0'0,321'364] local-lis/les=332/333 n=7 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [5,1,0]p5(0) r=2 lpr=332 luod=0'0 crt=321'364 mlcod 0'0 active mbc={} ps=[96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:e41724be:::smithi13777483-12:8a failed with -2 2024-03-04T06:46:35.296 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:35.121+0000 7f5c4f08f700 -1 osd.0 pg_epoch: 333 pg[5.7s2( v 333'370 (0'0,333'370] local-lis/les=332/333 n=4 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [5,1,0]p5(0) r=2 lpr=332 luod=0'0 crt=333'368 lcod 333'368 mlcod 333'368 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:e323bb3c:::smithi13777483-30:a8 failed with -2 2024-03-04T06:46:35.297 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.100+0000 7fb3c7180700 -1 osd.1 pg_epoch: 333 pg[5.0s1( v 319'326 (0'0,319'326] local-lis/les=332/333 n=11 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [3,1,4]p3(0) r=1 lpr=332 luod=0'0 crt=319'326 lcod 0'0 mlcod 0'0 active mbc={} ps=[96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:0ae7f3d2:::smithi13777483-7:8a failed with -2 2024-03-04T06:46:35.297 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.106+0000 7fb3c697f700 -1 osd.1 pg_epoch: 333 pg[5.9s2( v 333'687 (0'0,333'687] local-lis/les=332/333 n=13 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [7,6,1]p7(0) r=2 lpr=332 luod=0'0 crt=321'685 mlcod 0'0 active mbc={} ps=[96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:9be3359d:::smithi13777483-33:8d failed with -2 2024-03-04T06:46:35.297 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.106+0000 7fb3c3178700 -1 osd.1 pg_epoch: 333 pg[5.0s1( v 333'328 (0'0,333'328] local-lis/les=332/333 n=10 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [3,1,4]p3(0) r=1 lpr=332 luod=0'0 crt=319'326 lcod 0'0 mlcod 0'0 active mbc={} ps=[96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:0ed1097c:::smithi13777483-11:a7 failed with -2 2024-03-04T06:46:35.297 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.113+0000 7fb3bf971700 -1 osd.1 pg_epoch: 333 pg[5.7s1( v 321'364 (0'0,321'364] local-lis/les=332/333 n=7 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [5,1,0]p5(0) r=1 lpr=332 luod=0'0 crt=321'364 lcod 0'0 mlcod 0'0 active mbc={} ps=[96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:e41724be:::smithi13777483-12:8a failed with -2 2024-03-04T06:46:35.297 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.113+0000 7fb3c7180700 -1 osd.1 pg_epoch: 333 pg[5.0s1( v 333'330 (0'0,333'330] local-lis/les=332/333 n=9 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [3,1,4]p3(0) r=1 lpr=332 luod=0'0 crt=333'330 mlcod 333'330 active mbc={} ps=[8a~1,96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:0ae7f3d2:::smithi13777483-7:a3 failed with -2 2024-03-04T06:46:35.297 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.114+0000 7fb3c3979700 -1 osd.1 pg_epoch: 333 pg[5.7s1( v 333'366 (0'0,333'366] local-lis/les=332/333 n=6 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [5,1,0]p5(0) r=1 lpr=332 luod=0'0 crt=321'364 lcod 0'0 mlcod 0'0 active mbc={} ps=[96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:e323bb3c:::smithi13777483-30:a7 failed with -2 2024-03-04T06:46:35.297 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.118+0000 7fb3c697f700 -1 osd.1 pg_epoch: 333 pg[5.9s2( v 333'691 (0'0,333'691] local-lis/les=332/333 n=11 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [7,6,1]p7(0) r=2 lpr=332 luod=0'0 crt=333'691 mlcod 333'691 active mbc={} ps=[8a~1,96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:9c196b24:::smithi13777483-31:a0 failed with -2 2024-03-04T06:46:35.297 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.120+0000 7fb3bf971700 -1 osd.1 pg_epoch: 333 pg[5.7s1( v 333'368 (0'0,333'368] local-lis/les=332/333 n=5 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [5,1,0]p5(0) r=1 lpr=332 luod=0'0 crt=333'368 mlcod 333'368 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:e41724be:::smithi13777483-12:af failed with -2 2024-03-04T06:46:35.297 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.120+0000 7fb3c3178700 -1 osd.1 pg_epoch: 333 pg[5.0s1( v 333'332 (0'0,333'332] local-lis/les=332/333 n=8 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [3,1,4]p3(0) r=1 lpr=332 luod=0'0 crt=333'332 mlcod 333'332 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:0ed1097c:::smithi13777483-11:a8 failed with -2 2024-03-04T06:46:35.298 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.120+0000 7fb3c2977700 -1 osd.1 pg_epoch: 333 pg[5.9s2( v 333'693 (0'0,333'693] local-lis/les=332/333 n=10 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [7,6,1]p7(0) r=2 lpr=332 luod=0'0 crt=333'691 mlcod 333'691 active mbc={} ps=[8a~1,96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:968444e8:::smithi13777483-49:a0 failed with -2 2024-03-04T06:46:35.298 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.120+0000 7fb3c3178700 -1 osd.1 pg_epoch: 333 pg[5.0s1( v 333'334 (0'0,333'334] local-lis/les=332/333 n=7 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [3,1,4]p3(0) r=1 lpr=332 luod=0'0 crt=333'332 lcod 333'332 mlcod 333'332 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:05b24749:::smithi13777483-8:ac failed with -2 2024-03-04T06:46:35.298 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.121+0000 7fb3c3979700 -1 osd.1 pg_epoch: 333 pg[5.7s1( v 333'370 (0'0,333'370] local-lis/les=332/333 n=4 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [5,1,0]p5(0) r=1 lpr=332 luod=0'0 crt=333'368 lcod 333'368 mlcod 333'368 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:e323bb3c:::smithi13777483-30:a8 failed with -2 2024-03-04T06:46:35.298 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.125+0000 7fb3c7180700 -1 osd.1 pg_epoch: 333 pg[5.8s2( v 333'149 (0'0,333'149] local-lis/les=332/333 n=4 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [2,0,1]p2(0) r=2 lpr=332 luod=0'0 crt=333'149 mlcod 333'149 active mbc={} ps=[8a~1,96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:13df9545:::smithi13777483-36:a3 failed with -2 2024-03-04T06:46:35.298 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.127+0000 7fb3bf971700 -1 osd.1 pg_epoch: 333 pg[5.7s1( v 333'372 (0'0,333'372] local-lis/les=332/333 n=3 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [5,1,0]p5(0) r=1 lpr=332 luod=0'0 crt=333'372 mlcod 333'372 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~9,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:e323bb3c:::smithi13777483-30:af failed with -2 2024-03-04T06:46:35.298 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.129+0000 7fb3c697f700 -1 osd.1 pg_epoch: 333 pg[5.9s2( v 333'695 (0'0,333'695] local-lis/les=332/333 n=8 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [7,6,1]p7(0) r=2 lpr=332 luod=0'0 crt=333'695 mlcod 333'695 active mbc={} ps=[8a~1,96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:9be3359d:::smithi13777483-33:a0 failed with -2 2024-03-04T06:46:35.298 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.129+0000 7fb3c2977700 -1 osd.1 pg_epoch: 333 pg[5.9s2( v 333'697 (0'0,333'697] local-lis/les=332/333 n=7 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [7,6,1]p7(0) r=2 lpr=332 luod=0'0 crt=333'695 lcod 333'695 mlcod 333'695 active mbc={} ps=[8a~1,96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:9bf0d325:::smithi13777483-35:a3 failed with -2 2024-03-04T06:46:35.298 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.129+0000 7fb3c7180700 -1 osd.1 pg_epoch: 333 pg[5.0s1( v 333'336 (0'0,333'336] local-lis/les=332/333 n=6 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [3,1,4]p3(0) r=1 lpr=332 luod=0'0 crt=333'336 mlcod 333'336 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~9,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:0ae7f3d2:::smithi13777483-7:ad failed with -2 2024-03-04T06:46:35.298 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.130+0000 7fb3c3178700 -1 osd.1 pg_epoch: 333 pg[5.0s1( v 333'338 (0'0,333'338] local-lis/les=332/333 n=4 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [3,1,4]p3(0) r=1 lpr=332 luod=0'0 crt=333'336 lcod 333'336 mlcod 333'336 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~9,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:0ed1097c:::smithi13777483-11:af failed with -2 2024-03-04T06:46:35.298 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.130+0000 7fb3c7180700 -1 osd.1 pg_epoch: 333 pg[5.8s2( v 333'151 (0'0,333'151] local-lis/les=332/333 n=3 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [2,0,1]p2(0) r=2 lpr=332 luod=0'0 crt=333'151 mlcod 333'151 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:13df9545:::smithi13777483-36:a9 failed with -2 2024-03-04T06:46:35.298 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.134+0000 7fb3c2977700 -1 osd.1 pg_epoch: 333 pg[5.9s2( v 333'699 (0'0,333'699] local-lis/les=332/333 n=6 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [7,6,1]p7(0) r=2 lpr=332 luod=0'0 crt=333'699 mlcod 333'699 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:9c196b24:::smithi13777483-31:a9 failed with -2 2024-03-04T06:46:35.298 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.135+0000 7fb3c2977700 -1 osd.1 pg_epoch: 333 pg[5.9s2( v 333'701 (0'0,333'701] local-lis/les=332/333 n=5 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [7,6,1]p7(0) r=2 lpr=332 luod=0'0 crt=333'699 lcod 333'699 mlcod 333'699 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:968444e8:::smithi13777483-49:ab failed with -2 2024-03-04T06:46:35.298 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.135+0000 7fb3c7180700 -1 osd.1 pg_epoch: 333 pg[5.0s1( v 333'340 (0'0,333'340] local-lis/les=332/333 n=3 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [3,1,4]p3(0) r=1 lpr=332 luod=0'0 crt=333'340 mlcod 333'340 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~9,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:05b24749:::smithi13777483-8:af failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.136+0000 7fb3c7180700 -1 osd.1 pg_epoch: 333 pg[5.8s2( v 333'153 (0'0,333'153] local-lis/les=332/333 n=2 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [2,0,1]p2(0) r=2 lpr=332 luod=0'0 crt=333'153 mlcod 333'153 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~9,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:13df9545:::smithi13777483-36:ad failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.140+0000 7fb3c7180700 -1 osd.1 pg_epoch: 333 pg[5.0s1( v 333'342 (0'0,333'342] local-lis/les=332/333 n=2 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [3,1,4]p3(0) r=1 lpr=332 luod=0'0 crt=333'342 mlcod 333'342 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~c,b2~3,b7~1]] update_snap_map remove_oid 5:0ae7f3d2:::smithi13777483-7:b2 failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.200+0000 7fb3c0172700 -1 osd.1 pg_epoch: 333 pg[5.6s2( v 333'1014 (0'0,333'1014] local-lis/les=332/333 n=19 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [2,5,1]p2(0) r=2 lpr=332 luod=0'0 crt=328'1012 mlcod 0'0 active mbc={} ps=[96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:6193d38e:::smithi13777483-27:8a failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.203+0000 7fb3c417a700 -1 osd.1 pg_epoch: 333 pg[5.6s2( v 333'1016 (0'0,333'1016] local-lis/les=332/333 n=18 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [2,5,1]p2(0) r=2 lpr=332 luod=0'0 crt=333'1016 mlcod 333'1016 active mbc={} ps=[96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:6d7516e4:::smithi13777483-32:a7 failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.204+0000 7fb3c417a700 -1 osd.1 pg_epoch: 333 pg[5.6s2( v 333'1018 (0'0,333'1018] local-lis/les=332/333 n=17 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [2,5,1]p2(0) r=2 lpr=332 luod=0'0 crt=333'1016 mlcod 333'1016 active mbc={} ps=[96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:6bf2bd1d:::smithi13777483-50:a5 failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.210+0000 7fb3c417a700 -1 osd.1 pg_epoch: 333 pg[5.6s2( v 333'1022 (0'0,333'1022] local-lis/les=332/333 n=15 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [2,5,1]p2(0) r=2 lpr=332 luod=0'0 crt=333'1022 mlcod 333'1022 active mbc={} ps=[8a~1,96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:6c4e266a:::smithi13777483-46:a0 failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.211+0000 7fb3c0172700 -1 osd.1 pg_epoch: 333 pg[5.6s2( v 333'1024 (0'0,333'1024] local-lis/les=332/333 n=14 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [2,5,1]p2(0) r=2 lpr=332 luod=0'0 crt=333'1022 mlcod 333'1022 active mbc={} ps=[8a~1,96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:6193d38e:::smithi13777483-27:a0 failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.213+0000 7fb3c0172700 -1 osd.1 pg_epoch: 333 pg[5.6s2( v 333'1026 (0'0,333'1026] local-lis/les=332/333 n=13 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [2,5,1]p2(0) r=2 lpr=332 luod=0'0 crt=333'1026 mlcod 333'1026 active mbc={} ps=[8a~1,96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:67b6b834:::smithi13777483-13:a1 failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.217+0000 7fb3c0172700 -1 osd.1 pg_epoch: 333 pg[5.6s2( v 333'1028 (0'0,333'1028] local-lis/les=332/333 n=12 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [2,5,1]p2(0) r=2 lpr=332 luod=0'0 crt=333'1028 mlcod 333'1028 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:6c4e266a:::smithi13777483-46:ad failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.218+0000 7fb3c417a700 -1 osd.1 pg_epoch: 333 pg[5.6s2( v 333'1030 (0'0,333'1030] local-lis/les=332/333 n=11 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [2,5,1]p2(0) r=2 lpr=332 luod=0'0 crt=333'1028 mlcod 333'1028 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:6a11bac8:::smithi13777483-42:a8 failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.221+0000 7fb3c0172700 -1 osd.1 pg_epoch: 333 pg[5.6s2( v 333'1032 (0'0,333'1032] local-lis/les=332/333 n=10 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [2,5,1]p2(0) r=2 lpr=332 luod=0'0 crt=333'1032 mlcod 333'1032 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~9,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:67b6b834:::smithi13777483-13:ad failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.226+0000 7fb3c0172700 -1 osd.1 pg_epoch: 333 pg[5.6s2( v 333'1036 (0'0,333'1036] local-lis/les=332/333 n=8 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [2,5,1]p2(0) r=2 lpr=332 luod=0'0 crt=333'1034 lcod 333'1034 mlcod 333'1034 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~c,b2~3,b7~1]] update_snap_map remove_oid 5:67b6b834:::smithi13777483-13:b4 failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.231+0000 7fb3c1174700 -1 osd.1 pg_epoch: 333 pg[5.cs0( v 333'933 (0'0,333'933] local-lis/les=332/333 n=14 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [1,4,0]p1(0) r=0 lpr=332 crt=333'933 lcod 333'931 mlcod 333'931 active+clean+snaptrim trimq=[9e~1,a8~1,ad~1,b0~2,b5~1,b9~2] ps=[8a~1,96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:36653b08:::smithi13777483-25:a2 failed with -2 2024-03-04T06:46:35.299 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.233+0000 7fb3c1174700 -1 osd.1 pg_epoch: 333 pg[5.cs0( v 333'935 (0'0,333'935] local-lis/les=332/333 n=13 ec=72/72 lis/c=332/332 les/c/f=333/333/0 sis=332) [1,4,0]p1(0) r=0 lpr=332 luod=333'933 crt=333'933 lcod 333'931 mlcod 333'931 active+clean+snaptrim trimq=[9e~1,a8~1,ad~1,b0~2,b5~1,b9~2] ps=[8a~1,96~1,99~2,9f~2,a2~1,a4~4,a9~4,ae~2,b2~3,b7~1]] update_snap_map remove_oid 5:394b7223:::smithi13777483-28:a0 failed with -2 2024-03-04T06:46:35.300 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:35.234+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:35.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:35 smithi203 ceph-mon[85573]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:46:35.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:35 smithi203 ceph-mon[85573]: osd.1 [v2:172.21.15.137:6810/3966921225,v1:172.21.15.137:6811/3966921225] boot 2024-03-04T06:46:35.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:35 smithi203 ceph-mon[85573]: osdmap e332: 8 total, 8 up, 8 in 2024-03-04T06:46:35.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:35 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T06:46:35.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:35.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:35 smithi203 ceph-mon[85573]: pgmap v171: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 22 peering, 4 active+undersized+degraded, 17 active+undersized, 76 active+clean; 200 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 937 KiB/s rd, 910 KiB/s wr, 9 op/s; 27/456 objects degraded (5.921%) 2024-03-04T06:46:35.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:35 smithi203 ceph-mon[85573]: Health check update: Degraded data redundancy: 92/609 objects degraded (15.107%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:46:35.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:35 smithi203 ceph-mon[85573]: osdmap e333: 8 total, 8 up, 8 in 2024-03-04T06:46:35.684 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:46:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:46:35] "GET /metrics HTTP/1.1" 200 36193 "" "Prometheus/2.43.0" 2024-03-04T06:46:36.094 INFO:tasks.rados.rados.0.smithi137.stdout:1341: done (2 left) 2024-03-04T06:46:36.094 INFO:tasks.rados.rados.0.smithi137.stdout:1343: done (1 left) 2024-03-04T06:46:36.094 INFO:tasks.rados.rados.0.smithi137.stdout:1344: done (0 left) 2024-03-04T06:46:36.094 INFO:tasks.rados.rados.0.smithi137.stdout:1345: read oid 36 snap -1 2024-03-04T06:46:36.094 INFO:tasks.rados.rados.0.smithi137.stdout:1345: expect (ObjNum 434 snap 128 seq_num 434) 2024-03-04T06:46:36.094 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 131 2024-03-04T06:46:36.094 INFO:tasks.rados.rados.0.smithi137.stdout:1346: seq_num 444 ranges {0=237568} 2024-03-04T06:46:36.095 INFO:tasks.rados.rados.0.smithi137.stdout:1346: writing smithi13777483-1 from 0 to 237568 tid 1 2024-03-04T06:46:36.096 INFO:tasks.rados.rados.0.smithi137.stdout:1347: rollback oid 8 current snap is 131 2024-03-04T06:46:36.096 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 8 to 124 2024-03-04T06:46:36.096 INFO:tasks.rados.rados.0.smithi137.stdout:1348: rollback oid 10 current snap is 131 2024-03-04T06:46:36.096 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 10 to 124 2024-03-04T06:46:36.096 INFO:tasks.rados.rados.0.smithi137.stdout:1349: rmattr oid 16 current snap is 131 2024-03-04T06:46:36.096 INFO:tasks.rados.rados.0.smithi137.stdout:1349: done (4 left) 2024-03-04T06:46:36.096 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 131 2024-03-04T06:46:36.096 INFO:tasks.rados.rados.0.smithi137.stdout:1350: seq_num 445 ranges {2326528=253952} 2024-03-04T06:46:36.111 INFO:tasks.rados.rados.0.smithi137.stdout:1350: writing smithi13777483-46 from 2326528 to 2580480 tid 1 2024-03-04T06:46:36.111 INFO:tasks.rados.rados.0.smithi137.stdout:1351: read oid 43 snap -1 2024-03-04T06:46:36.111 INFO:tasks.rados.rados.0.smithi137.stdout:1351: expect (ObjNum 369 snap 112 seq_num 369) 2024-03-04T06:46:36.111 INFO:tasks.rados.rados.0.smithi137.stdout:1352: snap_remove snap 126 2024-03-04T06:46:36.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:36.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:36.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:36.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:36 smithi137 ceph-mon[88869]: osdmap e334: 8 total, 8 up, 8 in 2024-03-04T06:46:36.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:36.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:36.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:36.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:36 smithi137 ceph-mon[91314]: osdmap e334: 8 total, 8 up, 8 in 2024-03-04T06:46:36.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:36.106+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:36.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:36.096+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:36.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:36.096+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:36.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:36.097+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:36 smithi203 ceph-mon[85573]: osdmap e334: 8 total, 8 up, 8 in 2024-03-04T06:46:37.113 INFO:tasks.rados.rados.0.smithi137.stdout:1345: expect (ObjNum 434 snap 128 seq_num 434) 2024-03-04T06:46:37.116 INFO:tasks.rados.rados.0.smithi137.stdout:1346: finishing write tid 1 to smithi13777483-1 2024-03-04T06:46:37.116 INFO:tasks.rados.rados.0.smithi137.stdout:1346: finishing write tid 2 to smithi13777483-1 2024-03-04T06:46:37.117 INFO:tasks.rados.rados.0.smithi137.stdout:1346: finishing write tid 3 to smithi13777483-1 2024-03-04T06:46:37.117 INFO:tasks.rados.rados.0.smithi137.stdout:1346: oid 1 updating version 0 to 650 2024-03-04T06:46:37.117 INFO:tasks.rados.rados.0.smithi137.stdout:1346: oid 1 version 650 is already newer than 649 2024-03-04T06:46:37.117 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 650 (ObjNum 444 snap 131 seq_num 444) dirty exists 2024-03-04T06:46:37.117 INFO:tasks.rados.rados.0.smithi137.stdout:1346: left oid 1 (ObjNum 444 snap 131 seq_num 444) 2024-03-04T06:46:37.117 INFO:tasks.rados.rados.0.smithi137.stdout:1347: finishing rollback tid 0 to smithi13777483-8 2024-03-04T06:46:37.117 INFO:tasks.rados.rados.0.smithi137.stdout:1347: finishing rollback tid 1 to smithi13777483-8 2024-03-04T06:46:37.117 INFO:tasks.rados.rados.0.smithi137.stdout:1345: done (6 left) 2024-03-04T06:46:37.117 INFO:tasks.rados.rados.0.smithi137.stdout:1346: done (5 left) 2024-03-04T06:46:37.117 INFO:tasks.rados.rados.0.smithi137.stdout:1352: done (4 left) 2024-03-04T06:46:37.117 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 35 current snap is 131 2024-03-04T06:46:37.117 INFO:tasks.rados.rados.0.smithi137.stdout:1353: seq_num 446 ranges {5554176=278528} 2024-03-04T06:46:37.149 INFO:tasks.rados.rados.0.smithi137.stdout:1353: writing smithi13777483-35 from 5554176 to 5832704 tid 1 2024-03-04T06:46:37.149 INFO:tasks.rados.rados.0.smithi137.stdout:1354: rollback oid 32 current snap is 131 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 32 to 129 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:1347: finishing rollback tid 2 to smithi13777483-8 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 595 (ObjNum 393 snap 118 seq_num 393) dirty exists 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:1347: done (5 left) 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:1355: setattr oid 50 current snap is 131 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:1348: finishing rollback tid 0 to smithi13777483-10 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:1348: finishing rollback tid 1 to smithi13777483-10 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:1348: finishing rollback tid 2 to smithi13777483-10 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 760 (ObjNum 384 snap 116 seq_num 384) dirty exists 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:1350: finishing write tid 1 to smithi13777483-46 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:1350: finishing write tid 2 to smithi13777483-46 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:1350: finishing write tid 3 to smithi13777483-46 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:1350: oid 46 updating version 0 to 1043 2024-03-04T06:46:37.150 INFO:tasks.rados.rados.0.smithi137.stdout:1350: oid 46 version 1043 is already newer than 1042 2024-03-04T06:46:37.151 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 1043 (ObjNum 445 snap 131 seq_num 445) dirty exists 2024-03-04T06:46:37.151 INFO:tasks.rados.rados.0.smithi137.stdout:1350: left oid 46 (ObjNum 445 snap 131 seq_num 445) 2024-03-04T06:46:37.151 INFO:tasks.rados.rados.0.smithi137.stdout:1351: expect (ObjNum 369 snap 112 seq_num 369) 2024-03-04T06:46:37.244 INFO:tasks.rados.rados.0.smithi137.stdout:1354: finishing rollback tid 0 to smithi13777483-32 2024-03-04T06:46:37.244 INFO:tasks.rados.rados.0.smithi137.stdout:1354: finishing rollback tid 1 to smithi13777483-32 2024-03-04T06:46:37.244 INFO:tasks.rados.rados.0.smithi137.stdout:1353: finishing write tid 1 to smithi13777483-35 2024-03-04T06:46:37.244 INFO:tasks.rados.rados.0.smithi137.stdout:1354: finishing rollback tid 2 to smithi13777483-32 2024-03-04T06:46:37.244 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 1053 (ObjNum 433 snap 128 seq_num 433) dirty exists 2024-03-04T06:46:37.244 INFO:tasks.rados.rados.0.smithi137.stdout:1353: finishing write tid 2 to smithi13777483-35 2024-03-04T06:46:37.244 INFO:tasks.rados.rados.0.smithi137.stdout:1353: finishing write tid 3 to smithi13777483-35 2024-03-04T06:46:37.244 INFO:tasks.rados.rados.0.smithi137.stdout:1353: oid 35 updating version 0 to 709 2024-03-04T06:46:37.244 INFO:tasks.rados.rados.0.smithi137.stdout:1353: oid 35 updating version 709 to 710 2024-03-04T06:46:37.244 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 710 (ObjNum 446 snap 131 seq_num 446) dirty exists 2024-03-04T06:46:37.244 INFO:tasks.rados.rados.0.smithi137.stdout:1353: left oid 35 (ObjNum 446 snap 131 seq_num 446) 2024-03-04T06:46:37.244 INFO:tasks.rados.rados.0.smithi137.stdout:1348: done (5 left) 2024-03-04T06:46:37.245 INFO:tasks.rados.rados.0.smithi137.stdout:1350: done (4 left) 2024-03-04T06:46:37.245 INFO:tasks.rados.rados.0.smithi137.stdout:1351: done (3 left) 2024-03-04T06:46:37.245 INFO:tasks.rados.rados.0.smithi137.stdout:1353: done (2 left) 2024-03-04T06:46:37.245 INFO:tasks.rados.rados.0.smithi137.stdout:1354: done (1 left) 2024-03-04T06:46:37.245 INFO:tasks.rados.rados.0.smithi137.stdout:1356: rollback oid 8 current snap is 131 2024-03-04T06:46:37.245 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 8 to 124 2024-03-04T06:46:37.245 INFO:tasks.rados.rados.0.smithi137.stdout:1357: snap_remove snap 130 2024-03-04T06:46:37.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:37.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:37.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:37.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:37 smithi137 ceph-mon[88869]: pgmap v174: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 22 peering, 4 active+undersized+degraded, 17 active+undersized, 76 active+clean; 200 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 937 KiB/s rd, 910 KiB/s wr, 9 op/s; 27/456 objects degraded (5.921%) 2024-03-04T06:46:37.492 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:37.493 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:37.493 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:37.493 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:37 smithi137 ceph-mon[91314]: pgmap v174: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 22 peering, 4 active+undersized+degraded, 17 active+undersized, 76 active+clean; 200 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 937 KiB/s rd, 910 KiB/s wr, 9 op/s; 27/456 objects degraded (5.921%) 2024-03-04T06:46:37.493 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:37.116+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:37.493 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:37.118+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:37.493 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:37.120+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:37 smithi203 ceph-mon[85573]: pgmap v174: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 22 peering, 4 active+undersized+degraded, 17 active+undersized, 76 active+clean; 200 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 937 KiB/s rd, 910 KiB/s wr, 9 op/s; 27/456 objects degraded (5.921%) 2024-03-04T06:46:37.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:46:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:46:37.700+0000 7fca9a02c700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-03-04T06:46:38.115 INFO:tasks.rados.rados.0.smithi137.stdout:1357: done (2 left) 2024-03-04T06:46:38.115 INFO:tasks.rados.rados.0.smithi137.stdout:1358: rollback oid 34 current snap is 131 2024-03-04T06:46:38.116 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 34 to 129 2024-03-04T06:46:38.116 INFO:tasks.rados.rados.0.smithi137.stdout:1356: finishing rollback tid 0 to smithi13777483-8 2024-03-04T06:46:38.116 INFO:tasks.rados.rados.0.smithi137.stdout:1356: finishing rollback tid 1 to smithi13777483-8 2024-03-04T06:46:38.116 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 1055 (ObjNum 354 snap 110 seq_num 354) dirty exists 2024-03-04T06:46:38.116 INFO:tasks.rados.rados.0.smithi137.stdout:1356: finishing rollback tid 2 to smithi13777483-8 2024-03-04T06:46:38.116 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 598 (ObjNum 393 snap 118 seq_num 393) dirty exists 2024-03-04T06:46:38.116 INFO:tasks.rados.rados.0.smithi137.stdout:1355: done (2 left) 2024-03-04T06:46:38.116 INFO:tasks.rados.rados.0.smithi137.stdout:1356: done (1 left) 2024-03-04T06:46:38.116 INFO:tasks.rados.rados.0.smithi137.stdout:1359: delete oid 30 current snap is 131 2024-03-04T06:46:38.123 INFO:tasks.rados.rados.0.smithi137.stdout:1359: done (1 left) 2024-03-04T06:46:38.124 INFO:tasks.rados.rados.0.smithi137.stdout:1360: snap_remove snap 124 2024-03-04T06:46:38.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:38.119+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:38.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:38.114+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:38.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:38.114+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:38.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:38.115+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: osdmap e335: 8 total, 8 up, 8 in 2024-03-04T06:46:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:46:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:46:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:46:38.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:38.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:38.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:38.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-04T06:46:38.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: osdmap e335: 8 total, 8 up, 8 in 2024-03-04T06:46:38.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:38.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:38.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:38.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:38.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:38.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:46:38.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:46:38.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:38.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:46:38.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:38.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:38.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:38.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-04T06:46:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: osdmap e335: 8 total, 8 up, 8 in 2024-03-04T06:46:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:46:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:46:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:46:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:38.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-04T06:46:39.122 INFO:tasks.rados.rados.0.smithi137.stdout:1360: done (1 left) 2024-03-04T06:46:39.122 INFO:tasks.rados.rados.0.smithi137.stdout:1361: read oid 22 snap 129 2024-03-04T06:46:39.122 INFO:tasks.rados.rados.0.smithi137.stdout:1361: expect deleted 2024-03-04T06:46:39.122 INFO:tasks.rados.rados.0.smithi137.stdout:1362: delete oid 19 current snap is 131 2024-03-04T06:46:39.123 INFO:tasks.rados.rados.0.smithi137.stdout:1358: finishing rollback tid 0 to smithi13777483-34 2024-03-04T06:46:39.123 INFO:tasks.rados.rados.0.smithi137.stdout:1358: finishing rollback tid 1 to smithi13777483-34 2024-03-04T06:46:39.123 INFO:tasks.rados.rados.0.smithi137.stdout:1358: finishing rollback tid 2 to smithi13777483-34 2024-03-04T06:46:39.123 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16733 (ObjNum 408 snap 122 seq_num 408) dirty exists 2024-03-04T06:46:39.132 INFO:tasks.rados.rados.0.smithi137.stdout:1358: done (2 left) 2024-03-04T06:46:39.132 INFO:tasks.rados.rados.0.smithi137.stdout:1361: done (1 left) 2024-03-04T06:46:39.132 INFO:tasks.rados.rados.0.smithi137.stdout:1362: done (0 left) 2024-03-04T06:46:39.133 INFO:tasks.rados.rados.0.smithi137.stdout:1363: read oid 32 snap -1 2024-03-04T06:46:39.133 INFO:tasks.rados.rados.0.smithi137.stdout:1363: expect (ObjNum 433 snap 128 seq_num 433) 2024-03-04T06:46:39.133 INFO:tasks.rados.rados.0.smithi137.stdout:1364: read oid 7 snap -1 2024-03-04T06:46:39.133 INFO:tasks.rados.rados.0.smithi137.stdout:1364: expect (ObjNum 398 snap 121 seq_num 398) 2024-03-04T06:46:39.133 INFO:tasks.rados.rados.0.smithi137.stdout:1365: read oid 45 snap -1 2024-03-04T06:46:39.133 INFO:tasks.rados.rados.0.smithi137.stdout:1365: expect (ObjNum 438 snap 129 seq_num 438) 2024-03-04T06:46:39.133 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 131 2024-03-04T06:46:39.133 INFO:tasks.rados.rados.0.smithi137.stdout:1366: seq_num 449 ranges {5480448=327680} 2024-03-04T06:46:39.164 INFO:tasks.rados.rados.0.smithi137.stdout:1366: writing smithi13777483-39 from 5480448 to 5808128 tid 1 2024-03-04T06:46:39.165 INFO:tasks.rados.rados.0.smithi137.stdout:1367: setattr oid 18 current snap is 131 2024-03-04T06:46:39.165 INFO:tasks.rados.rados.0.smithi137.stdout:1365: expect (ObjNum 438 snap 129 seq_num 438) 2024-03-04T06:46:39.170 INFO:tasks.rados.rados.0.smithi137.stdout:1364: expect (ObjNum 398 snap 121 seq_num 398) 2024-03-04T06:46:39.287 INFO:tasks.rados.rados.0.smithi137.stdout:1363: expect (ObjNum 433 snap 128 seq_num 433) 2024-03-04T06:46:39.493 INFO:tasks.rados.rados.0.smithi137.stdout:1366: finishing write tid 1 to smithi13777483-39 2024-03-04T06:46:39.494 INFO:tasks.rados.rados.0.smithi137.stdout:1366: finishing write tid 2 to smithi13777483-39 2024-03-04T06:46:39.494 INFO:tasks.rados.rados.0.smithi137.stdout:1366: finishing write tid 3 to smithi13777483-39 2024-03-04T06:46:39.494 INFO:tasks.rados.rados.0.smithi137.stdout:1366: oid 39 updating version 0 to 367 2024-03-04T06:46:39.494 INFO:tasks.rados.rados.0.smithi137.stdout:1366: oid 39 version 367 is already newer than 366 2024-03-04T06:46:39.494 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 367 (ObjNum 449 snap 131 seq_num 449) dirty exists 2024-03-04T06:46:39.494 INFO:tasks.rados.rados.0.smithi137.stdout:1366: left oid 39 (ObjNum 449 snap 131 seq_num 449) 2024-03-04T06:46:39.494 INFO:tasks.rados.rados.0.smithi137.stdout:1363: done (4 left) 2024-03-04T06:46:39.494 INFO:tasks.rados.rados.0.smithi137.stdout:1364: done (3 left) 2024-03-04T06:46:39.494 INFO:tasks.rados.rados.0.smithi137.stdout:1365: done (2 left) 2024-03-04T06:46:39.494 INFO:tasks.rados.rados.0.smithi137.stdout:1366: done (1 left) 2024-03-04T06:46:39.494 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 131 2024-03-04T06:46:39.494 INFO:tasks.rados.rados.0.smithi137.stdout:1368: seq_num 450 ranges {2048000=344064} 2024-03-04T06:46:39.506 INFO:tasks.rados.rados.0.smithi137.stdout:1368: writing smithi13777483-34 from 2048000 to 2392064 tid 1 2024-03-04T06:46:39.506 INFO:tasks.rados.rados.0.smithi137.stdout:1369: snap_remove snap 129 2024-03-04T06:46:39.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:39.124+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:39.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:39.123+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:39.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:39.124+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-04T06:46:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[91314]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-03-04T06:46:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[91314]: osdmap e336: 8 total, 8 up, 8 in 2024-03-04T06:46:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[91314]: pgmap v177: 121 pgs: 3 active+clean+snaptrim_error, 22 peering, 96 active+clean; 195 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.2 MiB/s, 0 objects/s recovering 2024-03-04T06:46:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:46:39.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:46:39.111+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 3 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:46:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-04T06:46:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[88869]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-03-04T06:46:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[88869]: osdmap e336: 8 total, 8 up, 8 in 2024-03-04T06:46:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[88869]: pgmap v177: 121 pgs: 3 active+clean+snaptrim_error, 22 peering, 96 active+clean; 195 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.2 MiB/s, 0 objects/s recovering 2024-03-04T06:46:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:46:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:39 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-04T06:46:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:39 smithi203 ceph-mon[85573]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-03-04T06:46:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:39 smithi203 ceph-mon[85573]: osdmap e336: 8 total, 8 up, 8 in 2024-03-04T06:46:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:39 smithi203 ceph-mon[85573]: pgmap v177: 121 pgs: 3 active+clean+snaptrim_error, 22 peering, 96 active+clean; 195 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.2 MiB/s, 0 objects/s recovering 2024-03-04T06:46:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:46:40.131 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 607 (ObjNum 396 snap 119 seq_num 396) dirty exists 2024-03-04T06:46:40.132 INFO:tasks.rados.rados.0.smithi137.stdout:1368: finishing write tid 1 to smithi13777483-34 2024-03-04T06:46:40.132 INFO:tasks.rados.rados.0.smithi137.stdout:1368: finishing write tid 2 to smithi13777483-34 2024-03-04T06:46:40.132 INFO:tasks.rados.rados.0.smithi137.stdout:1368: finishing write tid 3 to smithi13777483-34 2024-03-04T06:46:40.132 INFO:tasks.rados.rados.0.smithi137.stdout:1368: oid 34 updating version 0 to 16735 2024-03-04T06:46:40.132 INFO:tasks.rados.rados.0.smithi137.stdout:1368: oid 34 version 16735 is already newer than 16734 2024-03-04T06:46:40.132 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16735 (ObjNum 450 snap 131 seq_num 450) dirty exists 2024-03-04T06:46:40.132 INFO:tasks.rados.rados.0.smithi137.stdout:1368: left oid 34 (ObjNum 450 snap 131 seq_num 450) 2024-03-04T06:46:40.132 INFO:tasks.rados.rados.0.smithi137.stdout:1367: done (2 left) 2024-03-04T06:46:40.132 INFO:tasks.rados.rados.0.smithi137.stdout:1368: done (1 left) 2024-03-04T06:46:40.132 INFO:tasks.rados.rados.0.smithi137.stdout:1369: done (0 left) 2024-03-04T06:46:40.132 INFO:tasks.rados.rados.0.smithi137.stdout:1370: rollback oid 35 current snap is 131 2024-03-04T06:46:40.132 INFO:tasks.rados.rados.0.smithi137.stdout:1370: done (0 left) 2024-03-04T06:46:40.133 INFO:tasks.rados.rados.0.smithi137.stdout:1371: read oid 43 snap -1 2024-03-04T06:46:40.133 INFO:tasks.rados.rados.0.smithi137.stdout:1371: expect (ObjNum 369 snap 112 seq_num 369) 2024-03-04T06:46:40.133 INFO:tasks.rados.rados.0.smithi137.stdout:1372: delete oid 40 current snap is 131 2024-03-04T06:46:40.143 INFO:tasks.rados.rados.0.smithi137.stdout:1372: done (1 left) 2024-03-04T06:46:40.144 INFO:tasks.rados.rados.0.smithi137.stdout:1373: rollback oid 1 current snap is 131 2024-03-04T06:46:40.144 INFO:tasks.rados.rados.0.smithi137.stdout:1373: done (1 left) 2024-03-04T06:46:40.144 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 131 2024-03-04T06:46:40.144 INFO:tasks.rados.rados.0.smithi137.stdout:1374: seq_num 452 ranges {0=376832} 2024-03-04T06:46:40.146 INFO:tasks.rados.rados.0.smithi137.stdout:1374: writing smithi13777483-2 from 0 to 376832 tid 1 2024-03-04T06:46:40.146 INFO:tasks.rados.rados.0.smithi137.stdout:1375: snap_create 2024-03-04T06:46:40.148 INFO:tasks.rados.rados.0.smithi137.stdout:1371: expect (ObjNum 369 snap 112 seq_num 369) 2024-03-04T06:46:40.239 INFO:tasks.rados.rados.0.smithi137.stdout:1374: finishing write tid 1 to smithi13777483-2 2024-03-04T06:46:40.239 INFO:tasks.rados.rados.0.smithi137.stdout:1374: finishing write tid 2 to smithi13777483-2 2024-03-04T06:46:40.239 INFO:tasks.rados.rados.0.smithi137.stdout:1374: finishing write tid 3 to smithi13777483-2 2024-03-04T06:46:40.240 INFO:tasks.rados.rados.0.smithi137.stdout:1374: oid 2 updating version 0 to 651 2024-03-04T06:46:40.240 INFO:tasks.rados.rados.0.smithi137.stdout:1374: oid 2 updating version 651 to 652 2024-03-04T06:46:40.240 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 652 (ObjNum 452 snap 131 seq_num 452) dirty exists 2024-03-04T06:46:40.240 INFO:tasks.rados.rados.0.smithi137.stdout:1374: left oid 2 (ObjNum 452 snap 131 seq_num 452) 2024-03-04T06:46:40.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-mon[91314]: Health check update: Possible data damage: 3 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:46:40.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-mon[91314]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/456 objects degraded (5.921%), 5 pgs degraded) 2024-03-04T06:46:40.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-mon[91314]: osdmap e337: 8 total, 8 up, 8 in 2024-03-04T06:46:40.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:40.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:40.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-mon[88869]: Health check update: Possible data damage: 3 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:46:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-mon[88869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/456 objects degraded (5.921%), 5 pgs degraded) 2024-03-04T06:46:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-mon[88869]: osdmap e337: 8 total, 8 up, 8 in 2024-03-04T06:46:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:40.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:40.135+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:40.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:40.135+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:40.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:40.135+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:40.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:40.130+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:40 smithi203 ceph-mon[85573]: Health check update: Possible data damage: 3 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:46:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:40 smithi203 ceph-mon[85573]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/456 objects degraded (5.921%), 5 pgs degraded) 2024-03-04T06:46:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:40 smithi203 ceph-mon[85573]: osdmap e337: 8 total, 8 up, 8 in 2024-03-04T06:46:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:41.132 INFO:tasks.rados.rados.0.smithi137.stdout:1371: done (2 left) 2024-03-04T06:46:41.132 INFO:tasks.rados.rados.0.smithi137.stdout:1374: done (1 left) 2024-03-04T06:46:41.132 INFO:tasks.rados.rados.0.smithi137.stdout:1375: done (0 left) 2024-03-04T06:46:41.132 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 132 2024-03-04T06:46:41.133 INFO:tasks.rados.rados.0.smithi137.stdout:1376: seq_num 453 ranges {0=393216} 2024-03-04T06:46:41.134 INFO:tasks.rados.rados.0.smithi137.stdout:1376: writing smithi13777483-19 from 0 to 393216 tid 1 2024-03-04T06:46:41.134 INFO:tasks.rados.rados.0.smithi137.stdout:1377: copy_from oid 10 from oid 3 current snap is 132 2024-03-04T06:46:41.134 INFO:tasks.rados.rados.0.smithi137.stdout:1378: snap_remove snap 131 2024-03-04T06:46:41.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:41.131+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:41.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:41 smithi137 ceph-mon[91314]: osdmap e338: 8 total, 8 up, 8 in 2024-03-04T06:46:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:41 smithi137 ceph-mon[91314]: pgmap v180: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 131 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.6 MiB/s rd, 268 KiB/s wr, 16 op/s; 7.8 MiB/s, 2 objects/s recovering 2024-03-04T06:46:41.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:41.138+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:41.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:41.138+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:41 smithi137 ceph-mon[88869]: osdmap e338: 8 total, 8 up, 8 in 2024-03-04T06:46:41.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:41.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:41.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:41.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:41 smithi137 ceph-mon[88869]: pgmap v180: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 131 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.6 MiB/s rd, 268 KiB/s wr, 16 op/s; 7.8 MiB/s, 2 objects/s recovering 2024-03-04T06:46:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:41 smithi203 ceph-mon[85573]: osdmap e338: 8 total, 8 up, 8 in 2024-03-04T06:46:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:41 smithi203 ceph-mon[85573]: pgmap v180: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 131 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.6 MiB/s rd, 268 KiB/s wr, 16 op/s; 7.8 MiB/s, 2 objects/s recovering 2024-03-04T06:46:42.133 INFO:tasks.rados.rados.0.smithi137.stdout:1378: done (2 left) 2024-03-04T06:46:42.133 INFO:tasks.rados.rados.0.smithi137.stdout:1379: delete oid 29 current snap is 132 2024-03-04T06:46:42.133 INFO:tasks.rados.rados.0.smithi137.stdout:1376: finishing write tid 1 to smithi13777483-19 2024-03-04T06:46:42.133 INFO:tasks.rados.rados.0.smithi137.stdout:1376: finishing write tid 2 to smithi13777483-19 2024-03-04T06:46:42.133 INFO:tasks.rados.rados.0.smithi137.stdout:1376: finishing write tid 3 to smithi13777483-19 2024-03-04T06:46:42.133 INFO:tasks.rados.rados.0.smithi137.stdout:1376: oid 19 updating version 0 to 773 2024-03-04T06:46:42.134 INFO:tasks.rados.rados.0.smithi137.stdout:1376: oid 19 updating version 773 to 774 2024-03-04T06:46:42.134 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 774 (ObjNum 453 snap 132 seq_num 453) dirty exists 2024-03-04T06:46:42.134 INFO:tasks.rados.rados.0.smithi137.stdout:1376: left oid 19 (ObjNum 453 snap 132 seq_num 453) 2024-03-04T06:46:42.134 INFO:tasks.rados.rados.0.smithi137.stdout:1377: finishing copy_from racing read to smithi13777483-10 2024-03-04T06:46:42.134 INFO:tasks.rados.rados.0.smithi137.stdout:1377: finishing copy_from to smithi13777483-10 2024-03-04T06:46:42.134 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 582 (ObjNum 353 snap 110 seq_num 353) dirty exists 2024-03-04T06:46:42.138 INFO:tasks.rados.rados.0.smithi137.stdout:1376: done (2 left) 2024-03-04T06:46:42.138 INFO:tasks.rados.rados.0.smithi137.stdout:1377: done (1 left) 2024-03-04T06:46:42.138 INFO:tasks.rados.rados.0.smithi137.stdout:1379: done (0 left) 2024-03-04T06:46:42.138 INFO:tasks.rados.rados.0.smithi137.stdout:1380: read oid 24 snap -1 2024-03-04T06:46:42.139 INFO:tasks.rados.rados.0.smithi137.stdout:1380: expect (ObjNum 432 snap 128 seq_num 432) 2024-03-04T06:46:42.139 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 132 2024-03-04T06:46:42.139 INFO:tasks.rados.rados.0.smithi137.stdout:1381: seq_num 455 ranges {0=425984} 2024-03-04T06:46:42.141 INFO:tasks.rados.rados.0.smithi137.stdout:1381: writing smithi13777483-17 from 0 to 425984 tid 1 2024-03-04T06:46:42.141 INFO:tasks.rados.rados.0.smithi137.stdout:1382: read oid 36 snap -1 2024-03-04T06:46:42.141 INFO:tasks.rados.rados.0.smithi137.stdout:1382: expect (ObjNum 434 snap 128 seq_num 434) 2024-03-04T06:46:42.141 INFO:tasks.rados.rados.0.smithi137.stdout:1383: snap_create 2024-03-04T06:46:42.143 INFO:tasks.rados.rados.0.smithi137.stdout:1382: expect (ObjNum 434 snap 128 seq_num 434) 2024-03-04T06:46:42.145 INFO:tasks.rados.rados.0.smithi137.stdout:1380: expect (ObjNum 432 snap 128 seq_num 432) 2024-03-04T06:46:42.148 INFO:tasks.rados.rados.0.smithi137.stdout:1381: finishing write tid 1 to smithi13777483-17 2024-03-04T06:46:42.149 INFO:tasks.rados.rados.0.smithi137.stdout:1381: finishing write tid 2 to smithi13777483-17 2024-03-04T06:46:42.150 INFO:tasks.rados.rados.0.smithi137.stdout:1381: finishing write tid 3 to smithi13777483-17 2024-03-04T06:46:42.150 INFO:tasks.rados.rados.0.smithi137.stdout:1381: oid 17 updating version 0 to 362 2024-03-04T06:46:42.150 INFO:tasks.rados.rados.0.smithi137.stdout:1381: oid 17 version 362 is already newer than 361 2024-03-04T06:46:42.150 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 362 (ObjNum 455 snap 132 seq_num 455) dirty exists 2024-03-04T06:46:42.150 INFO:tasks.rados.rados.0.smithi137.stdout:1381: left oid 17 (ObjNum 455 snap 132 seq_num 455) 2024-03-04T06:46:42.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:42 smithi137 ceph-mon[88869]: osdmap e339: 8 total, 8 up, 8 in 2024-03-04T06:46:42.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:42.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:42.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:42.445 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:42 smithi137 ceph-mon[91314]: osdmap e339: 8 total, 8 up, 8 in 2024-03-04T06:46:42.445 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:42.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:42.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:42.446 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:42.136+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:42.446 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:42.136+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:42.446 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:42.136+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:42.446 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:42.241+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:42.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:42 smithi203 ceph-mon[85573]: osdmap e339: 8 total, 8 up, 8 in 2024-03-04T06:46:42.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:42.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:42.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:43.148 INFO:tasks.rados.rados.0.smithi137.stdout:1380: done (3 left) 2024-03-04T06:46:43.148 INFO:tasks.rados.rados.0.smithi137.stdout:1381: done (2 left) 2024-03-04T06:46:43.149 INFO:tasks.rados.rados.0.smithi137.stdout:1382: done (1 left) 2024-03-04T06:46:43.149 INFO:tasks.rados.rados.0.smithi137.stdout:1383: done (0 left) 2024-03-04T06:46:43.149 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 133 2024-03-04T06:46:43.149 INFO:tasks.rados.rados.0.smithi137.stdout:1384: seq_num 456 ranges {6488064=442368} 2024-03-04T06:46:43.184 INFO:tasks.rados.rados.0.smithi137.stdout:1384: writing smithi13777483-44 from 6488064 to 6930432 tid 1 2024-03-04T06:46:43.185 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 48 current snap is 133 2024-03-04T06:46:43.185 INFO:tasks.rados.rados.0.smithi137.stdout:1385: seq_num 457 ranges {5767168=458752} 2024-03-04T06:46:43.218 INFO:tasks.rados.rados.0.smithi137.stdout:1385: writing smithi13777483-48 from 5767168 to 6225920 tid 1 2024-03-04T06:46:43.219 INFO:tasks.rados.rados.0.smithi137.stdout:1386: delete oid 25 current snap is 133 2024-03-04T06:46:43.219 INFO:tasks.rados.rados.0.smithi137.stdout:1384: finishing write tid 1 to smithi13777483-44 2024-03-04T06:46:43.219 INFO:tasks.rados.rados.0.smithi137.stdout:1384: finishing write tid 2 to smithi13777483-44 2024-03-04T06:46:43.219 INFO:tasks.rados.rados.0.smithi137.stdout:1384: finishing write tid 3 to smithi13777483-44 2024-03-04T06:46:43.219 INFO:tasks.rados.rados.0.smithi137.stdout:1384: oid 44 updating version 0 to 16737 2024-03-04T06:46:43.219 INFO:tasks.rados.rados.0.smithi137.stdout:1384: oid 44 updating version 16737 to 16738 2024-03-04T06:46:43.219 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16738 (ObjNum 456 snap 133 seq_num 456) dirty exists 2024-03-04T06:46:43.219 INFO:tasks.rados.rados.0.smithi137.stdout:1384: left oid 44 (ObjNum 456 snap 133 seq_num 456) 2024-03-04T06:46:43.224 INFO:tasks.rados.rados.0.smithi137.stdout:1385: finishing write tid 1 to smithi13777483-48 2024-03-04T06:46:43.224 INFO:tasks.rados.rados.0.smithi137.stdout:1385: finishing write tid 2 to smithi13777483-48 2024-03-04T06:46:43.224 INFO:tasks.rados.rados.0.smithi137.stdout:1384: done (2 left) 2024-03-04T06:46:43.225 INFO:tasks.rados.rados.0.smithi137.stdout:1386: done (1 left) 2024-03-04T06:46:43.225 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 133 2024-03-04T06:46:43.225 INFO:tasks.rados.rados.0.smithi137.stdout:1387: seq_num 459 ranges {0=491520} 2024-03-04T06:46:43.227 INFO:tasks.rados.rados.0.smithi137.stdout:1387: writing smithi13777483-22 from 0 to 491520 tid 1 2024-03-04T06:46:43.227 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 133 2024-03-04T06:46:43.228 INFO:tasks.rados.rados.0.smithi137.stdout:1388: seq_num 460 ranges {3350528=507904} 2024-03-04T06:46:43.249 INFO:tasks.rados.rados.0.smithi137.stdout:1388: writing smithi13777483-49 from 3350528 to 3858432 tid 1 2024-03-04T06:46:43.250 INFO:tasks.rados.rados.0.smithi137.stdout:1389: read oid 44 snap 132 2024-03-04T06:46:43.250 INFO:tasks.rados.rados.0.smithi137.stdout:1389: expect (ObjNum 414 snap 123 seq_num 414) 2024-03-04T06:46:43.250 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 5 current snap is 133 2024-03-04T06:46:43.250 INFO:tasks.rados.rados.0.smithi137.stdout:1385: finishing write tid 3 to smithi13777483-48 2024-03-04T06:46:43.250 INFO:tasks.rados.rados.0.smithi137.stdout:1385: oid 48 updating version 0 to 654 2024-03-04T06:46:43.250 INFO:tasks.rados.rados.0.smithi137.stdout:1385: oid 48 version 654 is already newer than 653 2024-03-04T06:46:43.250 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 654 (ObjNum 457 snap 133 seq_num 457) dirty exists 2024-03-04T06:46:43.250 INFO:tasks.rados.rados.0.smithi137.stdout:1385: left oid 48 (ObjNum 457 snap 133 seq_num 457) 2024-03-04T06:46:43.250 INFO:tasks.rados.rados.0.smithi137.stdout:1387: finishing write tid 1 to smithi13777483-22 2024-03-04T06:46:43.250 INFO:tasks.rados.rados.0.smithi137.stdout:1387: finishing write tid 2 to smithi13777483-22 2024-03-04T06:46:43.250 INFO:tasks.rados.rados.0.smithi137.stdout:1387: finishing write tid 3 to smithi13777483-22 2024-03-04T06:46:43.250 INFO:tasks.rados.rados.0.smithi137.stdout:1387: oid 22 updating version 0 to 898 2024-03-04T06:46:43.251 INFO:tasks.rados.rados.0.smithi137.stdout:1387: oid 22 version 898 is already newer than 897 2024-03-04T06:46:43.251 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 898 (ObjNum 459 snap 133 seq_num 459) dirty exists 2024-03-04T06:46:43.251 INFO:tasks.rados.rados.0.smithi137.stdout:1387: left oid 22 (ObjNum 459 snap 133 seq_num 459) 2024-03-04T06:46:43.251 INFO:tasks.rados.rados.0.smithi137.stdout:1390: seq_num 461 ranges {3686400=524288} 2024-03-04T06:46:43.273 INFO:tasks.rados.rados.0.smithi137.stdout:1390: writing smithi13777483-5 from 3686400 to 4210688 tid 1 2024-03-04T06:46:43.305 INFO:tasks.rados.rados.0.smithi137.stdout:1385: done (4 left) 2024-03-04T06:46:43.306 INFO:tasks.rados.rados.0.smithi137.stdout:1387: done (3 left) 2024-03-04T06:46:43.306 INFO:tasks.rados.rados.0.smithi137.stdout:1391: delete oid 37 current snap is 133 2024-03-04T06:46:43.306 INFO:tasks.rados.rados.0.smithi137.stdout:1388: finishing write tid 1 to smithi13777483-49 2024-03-04T06:46:43.306 INFO:tasks.rados.rados.0.smithi137.stdout:1388: finishing write tid 2 to smithi13777483-49 2024-03-04T06:46:43.306 INFO:tasks.rados.rados.0.smithi137.stdout:1388: finishing write tid 3 to smithi13777483-49 2024-03-04T06:46:43.306 INFO:tasks.rados.rados.0.smithi137.stdout:1388: oid 49 updating version 0 to 723 2024-03-04T06:46:43.306 INFO:tasks.rados.rados.0.smithi137.stdout:1388: oid 49 version 723 is already newer than 722 2024-03-04T06:46:43.306 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 723 (ObjNum 460 snap 133 seq_num 460) dirty exists 2024-03-04T06:46:43.306 INFO:tasks.rados.rados.0.smithi137.stdout:1388: left oid 49 (ObjNum 460 snap 133 seq_num 460) 2024-03-04T06:46:43.306 INFO:tasks.rados.rados.0.smithi137.stdout:1389: expect (ObjNum 414 snap 123 seq_num 414) 2024-03-04T06:46:43.467 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:43 smithi137 ceph-mon[88869]: osdmap e340: 8 total, 8 up, 8 in 2024-03-04T06:46:43.468 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:43.468 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:43.468 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:43.468 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:43 smithi137 ceph-mon[88869]: pgmap v183: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 131 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 268 KiB/s wr, 18 op/s; 3.6 MiB/s, 1 objects/s recovering 2024-03-04T06:46:43.468 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:43 smithi137 ceph-mon[91314]: osdmap e340: 8 total, 8 up, 8 in 2024-03-04T06:46:43.468 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:43.469 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:43.469 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:43.469 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:43 smithi137 ceph-mon[91314]: pgmap v183: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 131 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 268 KiB/s wr, 18 op/s; 3.6 MiB/s, 1 objects/s recovering 2024-03-04T06:46:43.469 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:43.187+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:43.469 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:43.194+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset be=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:43.469 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:43.224+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset be=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:43.576 INFO:tasks.rados.rados.0.smithi137.stdout:1390: finishing write tid 1 to smithi13777483-5 2024-03-04T06:46:43.576 INFO:tasks.rados.rados.0.smithi137.stdout:1390: finishing write tid 2 to smithi13777483-5 2024-03-04T06:46:43.576 INFO:tasks.rados.rados.0.smithi137.stdout:1390: finishing write tid 3 to smithi13777483-5 2024-03-04T06:46:43.576 INFO:tasks.rados.rados.0.smithi137.stdout:1390: oid 5 updating version 0 to 780 2024-03-04T06:46:43.576 INFO:tasks.rados.rados.0.smithi137.stdout:1390: oid 5 updating version 780 to 781 2024-03-04T06:46:43.576 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 781 (ObjNum 461 snap 133 seq_num 461) dirty exists 2024-03-04T06:46:43.576 INFO:tasks.rados.rados.0.smithi137.stdout:1390: left oid 5 (ObjNum 461 snap 133 seq_num 461) 2024-03-04T06:46:43.576 INFO:tasks.rados.rados.0.smithi137.stdout:1388: done (3 left) 2024-03-04T06:46:43.576 INFO:tasks.rados.rados.0.smithi137.stdout:1389: done (2 left) 2024-03-04T06:46:43.577 INFO:tasks.rados.rados.0.smithi137.stdout:1390: done (1 left) 2024-03-04T06:46:43.577 INFO:tasks.rados.rados.0.smithi137.stdout:1391: done (0 left) 2024-03-04T06:46:43.577 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 133 2024-03-04T06:46:43.577 INFO:tasks.rados.rados.0.smithi137.stdout:1392: seq_num 463 ranges {3399680=557056} 2024-03-04T06:46:43.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:43 smithi203 ceph-mon[85573]: osdmap e340: 8 total, 8 up, 8 in 2024-03-04T06:46:43.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:43.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset b4=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:43.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset b1=[]:{ae=[ad,a8],b1=[b1,b0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:43.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:43 smithi203 ceph-mon[85573]: pgmap v183: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 131 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 268 KiB/s wr, 18 op/s; 3.6 MiB/s, 1 objects/s recovering 2024-03-04T06:46:43.597 INFO:tasks.rados.rados.0.smithi137.stdout:1392: writing smithi13777483-7 from 3399680 to 3956736 tid 1 2024-03-04T06:46:43.597 INFO:tasks.rados.rados.0.smithi137.stdout:1393: copy_from oid 15 from oid 13 current snap is 133 2024-03-04T06:46:43.597 INFO:tasks.rados.rados.0.smithi137.stdout:1394: copy_from oid 48 from oid 47 current snap is 133 2024-03-04T06:46:43.598 INFO:tasks.rados.rados.0.smithi137.stdout:1395: snap_remove snap 132 2024-03-04T06:46:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:1395: done (3 left) 2024-03-04T06:46:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:1396: copy_from oid 1 from oid 29 current snap is 133 2024-03-04T06:46:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:1393: finishing copy_from to smithi13777483-15 2024-03-04T06:46:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:1393: got expected ENOENT (src dne) 2024-03-04T06:46:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:1393: finishing copy_from racing read to smithi13777483-15 2024-03-04T06:46:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:1392: finishing write tid 1 to smithi13777483-7 2024-03-04T06:46:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:1392: finishing write tid 2 to smithi13777483-7 2024-03-04T06:46:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:1392: finishing write tid 3 to smithi13777483-7 2024-03-04T06:46:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:1392: oid 7 updating version 0 to 599 2024-03-04T06:46:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:1392: oid 7 updating version 599 to 600 2024-03-04T06:46:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 600 (ObjNum 463 snap 133 seq_num 463) dirty exists 2024-03-04T06:46:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:1392: left oid 7 (ObjNum 463 snap 133 seq_num 463) 2024-03-04T06:46:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:1394: finishing copy_from racing read to smithi13777483-48 2024-03-04T06:46:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:1394: finishing copy_from to smithi13777483-48 2024-03-04T06:46:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 923 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:46:44.153 INFO:tasks.rados.rados.0.smithi137.stdout:1392: done (3 left) 2024-03-04T06:46:44.153 INFO:tasks.rados.rados.0.smithi137.stdout:1393: done (2 left) 2024-03-04T06:46:44.153 INFO:tasks.rados.rados.0.smithi137.stdout:1394: done (1 left) 2024-03-04T06:46:44.153 INFO:tasks.rados.rados.0.smithi137.stdout:1397: rmattr oid 10 current snap is 133 2024-03-04T06:46:44.153 INFO:tasks.rados.rados.0.smithi137.stdout:1397: done (1 left) 2024-03-04T06:46:44.153 INFO:tasks.rados.rados.0.smithi137.stdout:1398: snap_create 2024-03-04T06:46:44.155 INFO:tasks.rados.rados.0.smithi137.stdout:1396: finishing copy_from to smithi13777483-1 2024-03-04T06:46:44.155 INFO:tasks.rados.rados.0.smithi137.stdout:1396: got expected ENOENT (src dne) 2024-03-04T06:46:44.155 INFO:tasks.rados.rados.0.smithi137.stdout:1396: finishing copy_from racing read to smithi13777483-1 2024-03-04T06:46:44.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:44 smithi137 ceph-mon[91314]: osdmap e341: 8 total, 8 up, 8 in 2024-03-04T06:46:44.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:44.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset be=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:44.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset be=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:44.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:44.161+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:44.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:44.161+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:44.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:44.162+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset be=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:44 smithi137 ceph-mon[88869]: osdmap e341: 8 total, 8 up, 8 in 2024-03-04T06:46:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset be=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset be=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:44.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:44.159+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset be=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:44 smithi203 ceph-mon[85573]: osdmap e341: 8 total, 8 up, 8 in 2024-03-04T06:46:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset be=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset be=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:45.160 INFO:tasks.rados.rados.0.smithi137.stdout:1396: done (1 left) 2024-03-04T06:46:45.160 INFO:tasks.rados.rados.0.smithi137.stdout:1398: done (0 left) 2024-03-04T06:46:45.160 INFO:tasks.rados.rados.0.smithi137.stdout:1399: rollback oid 43 current snap is 134 2024-03-04T06:46:45.160 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 43 to 133 2024-03-04T06:46:45.160 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 134 2024-03-04T06:46:45.160 INFO:tasks.rados.rados.0.smithi137.stdout:1400: seq_num 464 ranges {1990656=573440} 2024-03-04T06:46:45.174 INFO:tasks.rados.rados.0.smithi137.stdout:1400: writing smithi13777483-4 from 1990656 to 2564096 tid 1 2024-03-04T06:46:45.174 INFO:tasks.rados.rados.0.smithi137.stdout:1401: read oid 18 snap -1 2024-03-04T06:46:45.174 INFO:tasks.rados.rados.0.smithi137.stdout:1401: expect (ObjNum 396 snap 119 seq_num 396) 2024-03-04T06:46:45.174 INFO:tasks.rados.rados.0.smithi137.stdout:1402: read oid 50 snap -1 2024-03-04T06:46:45.174 INFO:tasks.rados.rados.0.smithi137.stdout:1402: expect (ObjNum 354 snap 110 seq_num 354) 2024-03-04T06:46:45.174 INFO:tasks.rados.rados.0.smithi137.stdout:1403: delete oid 2 current snap is 134 2024-03-04T06:46:45.174 INFO:tasks.rados.rados.0.smithi137.stdout:1399: finishing rollback tid 0 to smithi13777483-43 2024-03-04T06:46:45.174 INFO:tasks.rados.rados.0.smithi137.stdout:1399: finishing rollback tid 1 to smithi13777483-43 2024-03-04T06:46:45.175 INFO:tasks.rados.rados.0.smithi137.stdout:1399: finishing rollback tid 2 to smithi13777483-43 2024-03-04T06:46:45.175 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 366 (ObjNum 369 snap 112 seq_num 369) dirty exists 2024-03-04T06:46:45.178 INFO:tasks.rados.rados.0.smithi137.stdout:1399: done (4 left) 2024-03-04T06:46:45.178 INFO:tasks.rados.rados.0.smithi137.stdout:1403: done (3 left) 2024-03-04T06:46:45.178 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 134 2024-03-04T06:46:45.178 INFO:tasks.rados.rados.0.smithi137.stdout:1404: seq_num 466 ranges {204800=614400} 2024-03-04T06:46:45.183 INFO:tasks.rados.rados.0.smithi137.stdout:1404: writing smithi13777483-20 from 204800 to 819200 tid 1 2024-03-04T06:46:45.184 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 134 2024-03-04T06:46:45.184 INFO:tasks.rados.rados.0.smithi137.stdout:1400: finishing write tid 1 to smithi13777483-4 2024-03-04T06:46:45.184 INFO:tasks.rados.rados.0.smithi137.stdout:1400: finishing write tid 2 to smithi13777483-4 2024-03-04T06:46:45.184 INFO:tasks.rados.rados.0.smithi137.stdout:1400: finishing write tid 3 to smithi13777483-4 2024-03-04T06:46:45.184 INFO:tasks.rados.rados.0.smithi137.stdout:1400: oid 4 updating version 0 to 142 2024-03-04T06:46:45.184 INFO:tasks.rados.rados.0.smithi137.stdout:1400: oid 4 version 142 is already newer than 141 2024-03-04T06:46:45.184 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 142 (ObjNum 464 snap 134 seq_num 464) dirty exists 2024-03-04T06:46:45.184 INFO:tasks.rados.rados.0.smithi137.stdout:1400: left oid 4 (ObjNum 464 snap 134 seq_num 464) 2024-03-04T06:46:45.184 INFO:tasks.rados.rados.0.smithi137.stdout:1405: seq_num 467 ranges {1523712=630784} 2024-03-04T06:46:45.195 INFO:tasks.rados.rados.0.smithi137.stdout:1405: writing smithi13777483-10 from 1523712 to 2154496 tid 1 2024-03-04T06:46:45.195 INFO:tasks.rados.rados.0.smithi137.stdout:1400: done (4 left) 2024-03-04T06:46:45.195 INFO:tasks.rados.rados.0.smithi137.stdout:1406: rollback oid 6 current snap is 134 2024-03-04T06:46:45.195 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 6 to 133 2024-03-04T06:46:45.195 INFO:tasks.rados.rados.0.smithi137.stdout:1401: expect (ObjNum 396 snap 119 seq_num 396) 2024-03-04T06:46:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:1404: finishing write tid 1 to smithi13777483-20 2024-03-04T06:46:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:1404: finishing write tid 2 to smithi13777483-20 2024-03-04T06:46:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:1401: done (4 left) 2024-03-04T06:46:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:1407: delete oid 27 current snap is 134 2024-03-04T06:46:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:1404: finishing write tid 3 to smithi13777483-20 2024-03-04T06:46:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:1404: oid 20 updating version 0 to 643 2024-03-04T06:46:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:1404: oid 20 updating version 643 to 644 2024-03-04T06:46:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 644 (ObjNum 466 snap 134 seq_num 466) dirty exists 2024-03-04T06:46:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:1404: left oid 20 (ObjNum 466 snap 134 seq_num 466) 2024-03-04T06:46:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:1402: expect (ObjNum 354 snap 110 seq_num 354) 2024-03-04T06:46:45.404 INFO:tasks.rados.rados.0.smithi137.stdout:1405: finishing write tid 1 to smithi13777483-10 2024-03-04T06:46:45.404 INFO:tasks.rados.rados.0.smithi137.stdout:1406: finishing rollback tid 0 to smithi13777483-6 2024-03-04T06:46:45.404 INFO:tasks.rados.rados.0.smithi137.stdout:1406: finishing rollback tid 1 to smithi13777483-6 2024-03-04T06:46:45.404 INFO:tasks.rados.rados.0.smithi137.stdout:1405: finishing write tid 2 to smithi13777483-10 2024-03-04T06:46:45.404 INFO:tasks.rados.rados.0.smithi137.stdout:1406: finishing rollback tid 2 to smithi13777483-6 2024-03-04T06:46:45.404 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 903 (ObjNum 441 snap 129 seq_num 441) dirty exists 2024-03-04T06:46:45.404 INFO:tasks.rados.rados.0.smithi137.stdout:1405: finishing write tid 3 to smithi13777483-10 2024-03-04T06:46:45.404 INFO:tasks.rados.rados.0.smithi137.stdout:1405: oid 10 updating version 0 to 785 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:1405: oid 10 updating version 785 to 786 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 786 (ObjNum 467 snap 134 seq_num 467) dirty exists 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:1405: left oid 10 (ObjNum 467 snap 134 seq_num 467) 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:1402: done (4 left) 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:1404: done (3 left) 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:1405: done (2 left) 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:1406: done (1 left) 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:1407: done (0 left) 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:1408: rmattr oid 29 current snap is 134 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:1408: done (0 left) 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:1409: rollback oid 33 current snap is 134 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 33 to 133 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:1410: read oid 27 snap 133 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:1410: expect (ObjNum 360 snap 110 seq_num 360) 2024-03-04T06:46:45.405 INFO:tasks.rados.rados.0.smithi137.stdout:1411: read oid 36 snap -1 2024-03-04T06:46:45.406 INFO:tasks.rados.rados.0.smithi137.stdout:1411: expect (ObjNum 434 snap 128 seq_num 434) 2024-03-04T06:46:45.406 INFO:tasks.rados.rados.0.smithi137.stdout:1412: copy_from oid 25 from oid 3 current snap is 134 2024-03-04T06:46:45.406 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 134 2024-03-04T06:46:45.406 INFO:tasks.rados.rados.0.smithi137.stdout:1413: seq_num 469 ranges {0=663552} 2024-03-04T06:46:45.408 INFO:tasks.rados.rados.0.smithi137.stdout:1413: writing smithi13777483-11 from 0 to 663552 tid 1 2024-03-04T06:46:45.408 INFO:tasks.rados.rados.0.smithi137.stdout:1414: copy_from oid 12 from oid 46 current snap is 134 2024-03-04T06:46:45.408 INFO:tasks.rados.rados.0.smithi137.stdout:1409: finishing rollback tid 1 to smithi13777483-33 2024-03-04T06:46:45.408 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 0 (ObjNum 33 snap 0 seq_num 3131952512) dirty dne 2024-03-04T06:46:45.408 INFO:tasks.rados.rados.0.smithi137.stdout:1411: expect (ObjNum 434 snap 128 seq_num 434) 2024-03-04T06:46:45.410 INFO:tasks.rados.rados.0.smithi137.stdout:1410: expect (ObjNum 360 snap 110 seq_num 360) 2024-03-04T06:46:45.446 INFO:tasks.rados.rados.0.smithi137.stdout:1413: finishing write tid 1 to smithi13777483-11 2024-03-04T06:46:45.446 INFO:tasks.rados.rados.0.smithi137.stdout:1413: finishing write tid 2 to smithi13777483-11 2024-03-04T06:46:45.446 INFO:tasks.rados.rados.0.smithi137.stdout:1412: finishing copy_from racing read to smithi13777483-25 2024-03-04T06:46:45.446 INFO:tasks.rados.rados.0.smithi137.stdout:1412: finishing copy_from to smithi13777483-25 2024-03-04T06:46:45.446 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 582 (ObjNum 353 snap 110 seq_num 353) dirty exists 2024-03-04T06:46:45.446 INFO:tasks.rados.rados.0.smithi137.stdout:1413: finishing write tid 3 to smithi13777483-11 2024-03-04T06:46:45.446 INFO:tasks.rados.rados.0.smithi137.stdout:1413: oid 11 updating version 0 to 602 2024-03-04T06:46:45.446 INFO:tasks.rados.rados.0.smithi137.stdout:1413: oid 11 version 602 is already newer than 601 2024-03-04T06:46:45.446 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 602 (ObjNum 469 snap 134 seq_num 469) dirty exists 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1413: left oid 11 (ObjNum 469 snap 134 seq_num 469) 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1414: finishing copy_from racing read to smithi13777483-12 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1409: done (5 left) 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1410: done (4 left) 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1411: done (3 left) 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1412: done (2 left) 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1413: done (1 left) 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1415: read oid 35 snap -1 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1415: expect (ObjNum 446 snap 131 seq_num 446) 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1416: read oid 49 snap -1 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1416: expect (ObjNum 460 snap 133 seq_num 460) 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1417: rollback oid 30 current snap is 134 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 30 to 133 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1414: finishing copy_from to smithi13777483-12 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 1043 (ObjNum 445 snap 131 seq_num 445) dirty exists 2024-03-04T06:46:45.447 INFO:tasks.rados.rados.0.smithi137.stdout:1414: done (3 left) 2024-03-04T06:46:45.448 INFO:tasks.rados.rados.0.smithi137.stdout:1418: read oid 17 snap -1 2024-03-04T06:46:45.448 INFO:tasks.rados.rados.0.smithi137.stdout:1418: expect (ObjNum 455 snap 132 seq_num 455) 2024-03-04T06:46:45.448 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 134 2024-03-04T06:46:45.448 INFO:tasks.rados.rados.0.smithi137.stdout:1419: seq_num 470 ranges {6930432=679936} 2024-03-04T06:46:45.489 INFO:tasks.rados.rados.0.smithi137.stdout:1419: writing smithi13777483-44 from 6930432 to 7610368 tid 1 2024-03-04T06:46:45.489 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 134 2024-03-04T06:46:45.489 INFO:tasks.rados.rados.0.smithi137.stdout:1417: finishing rollback tid 1 to smithi13777483-30 2024-03-04T06:46:45.489 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 0 (ObjNum 33 snap 0 seq_num 3132154048) dirty dne 2024-03-04T06:46:45.489 INFO:tasks.rados.rados.0.smithi137.stdout:1418: expect (ObjNum 455 snap 132 seq_num 455) 2024-03-04T06:46:45.505 INFO:tasks.rados.rados.0.smithi137.stdout:1415: expect (ObjNum 446 snap 131 seq_num 446) 2024-03-04T06:46:45.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:46:45] "GET /metrics HTTP/1.1" 200 36273 "" "Prometheus/2.43.0" 2024-03-04T06:46:45.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:45.159+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset be=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:45.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:45.159+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:45.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-mon[88869]: osdmap e342: 8 total, 8 up, 8 in 2024-03-04T06:46:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset be=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset be=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-mon[88869]: pgmap v186: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 122 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-03-04T06:46:45.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-mon[91314]: osdmap e342: 8 total, 8 up, 8 in 2024-03-04T06:46:45.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset be=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:45.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:45.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset be=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:45.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-mon[91314]: pgmap v186: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 122 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-03-04T06:46:45.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:45.179+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset be=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:45 smithi203 ceph-mon[85573]: osdmap e342: 8 total, 8 up, 8 in 2024-03-04T06:46:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset be=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset be=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:45 smithi203 ceph-mon[85573]: pgmap v186: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 122 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-03-04T06:46:45.842 INFO:tasks.rados.rados.0.smithi137.stdout:1416: expect (ObjNum 460 snap 133 seq_num 460) 2024-03-04T06:46:46.035 INFO:tasks.rados.rados.0.smithi137.stdout:1419: finishing write tid 1 to smithi13777483-44 2024-03-04T06:46:46.035 INFO:tasks.rados.rados.0.smithi137.stdout:1419: finishing write tid 2 to smithi13777483-44 2024-03-04T06:46:46.035 INFO:tasks.rados.rados.0.smithi137.stdout:1419: finishing write tid 3 to smithi13777483-44 2024-03-04T06:46:46.036 INFO:tasks.rados.rados.0.smithi137.stdout:1419: oid 44 updating version 0 to 16740 2024-03-04T06:46:46.036 INFO:tasks.rados.rados.0.smithi137.stdout:1419: oid 44 updating version 16740 to 16741 2024-03-04T06:46:46.036 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16741 (ObjNum 470 snap 134 seq_num 470) dirty exists 2024-03-04T06:46:46.036 INFO:tasks.rados.rados.0.smithi137.stdout:1419: left oid 44 (ObjNum 470 snap 134 seq_num 470) 2024-03-04T06:46:46.036 INFO:tasks.rados.rados.0.smithi137.stdout:1420: seq_num 471 ranges {4292608=696320} 2024-03-04T06:46:46.062 INFO:tasks.rados.rados.0.smithi137.stdout:1420: writing smithi13777483-32 from 4292608 to 4988928 tid 1 2024-03-04T06:46:46.062 INFO:tasks.rados.rados.0.smithi137.stdout:1415: done (5 left) 2024-03-04T06:46:46.062 INFO:tasks.rados.rados.0.smithi137.stdout:1416: done (4 left) 2024-03-04T06:46:46.062 INFO:tasks.rados.rados.0.smithi137.stdout:1417: done (3 left) 2024-03-04T06:46:46.062 INFO:tasks.rados.rados.0.smithi137.stdout:1418: done (2 left) 2024-03-04T06:46:46.062 INFO:tasks.rados.rados.0.smithi137.stdout:1419: done (1 left) 2024-03-04T06:46:46.062 INFO:tasks.rados.rados.0.smithi137.stdout:1421: read oid 2 snap -1 2024-03-04T06:46:46.062 INFO:tasks.rados.rados.0.smithi137.stdout:1421: expect deleted 2024-03-04T06:46:46.062 INFO:tasks.rados.rados.0.smithi137.stdout:1422: snap_create 2024-03-04T06:46:46.065 INFO:tasks.rados.rados.0.smithi137.stdout:1420: finishing write tid 1 to smithi13777483-32 2024-03-04T06:46:46.065 INFO:tasks.rados.rados.0.smithi137.stdout:1420: finishing write tid 2 to smithi13777483-32 2024-03-04T06:46:46.066 INFO:tasks.rados.rados.0.smithi137.stdout:1420: finishing write tid 3 to smithi13777483-32 2024-03-04T06:46:46.066 INFO:tasks.rados.rados.0.smithi137.stdout:1420: oid 32 updating version 0 to 1077 2024-03-04T06:46:46.066 INFO:tasks.rados.rados.0.smithi137.stdout:1420: oid 32 updating version 1077 to 1078 2024-03-04T06:46:46.066 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 1078 (ObjNum 471 snap 134 seq_num 471) dirty exists 2024-03-04T06:46:46.067 INFO:tasks.rados.rados.0.smithi137.stdout:1420: left oid 32 (ObjNum 471 snap 134 seq_num 471) 2024-03-04T06:46:46.164 INFO:tasks.rados.rados.0.smithi137.stdout:1420: done (2 left) 2024-03-04T06:46:46.164 INFO:tasks.rados.rados.0.smithi137.stdout:1421: done (1 left) 2024-03-04T06:46:46.164 INFO:tasks.rados.rados.0.smithi137.stdout:1422: done (0 left) 2024-03-04T06:46:46.164 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 135 2024-03-04T06:46:46.164 INFO:tasks.rados.rados.0.smithi137.stdout:1423: seq_num 472 ranges {0=712704} 2024-03-04T06:46:46.168 INFO:tasks.rados.rados.0.smithi137.stdout:1423: writing smithi13777483-27 from 0 to 712704 tid 1 2024-03-04T06:46:46.168 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 135 2024-03-04T06:46:46.168 INFO:tasks.rados.rados.0.smithi137.stdout:1424: seq_num 473 ranges {6946816=729088} 2024-03-04T06:46:46.210 INFO:tasks.rados.rados.0.smithi137.stdout:1424: writing smithi13777483-15 from 6946816 to 7675904 tid 1 2024-03-04T06:46:46.210 INFO:tasks.rados.rados.0.smithi137.stdout:1425: read oid 29 snap -1 2024-03-04T06:46:46.210 INFO:tasks.rados.rados.0.smithi137.stdout:1425: expect deleted 2024-03-04T06:46:46.210 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 135 2024-03-04T06:46:46.210 INFO:tasks.rados.rados.0.smithi137.stdout:1423: finishing write tid 1 to smithi13777483-27 2024-03-04T06:46:46.210 INFO:tasks.rados.rados.0.smithi137.stdout:1423: finishing write tid 2 to smithi13777483-27 2024-03-04T06:46:46.210 INFO:tasks.rados.rados.0.smithi137.stdout:1423: finishing write tid 3 to smithi13777483-27 2024-03-04T06:46:46.210 INFO:tasks.rados.rados.0.smithi137.stdout:1423: oid 27 updating version 0 to 1080 2024-03-04T06:46:46.210 INFO:tasks.rados.rados.0.smithi137.stdout:1423: oid 27 version 1080 is already newer than 1079 2024-03-04T06:46:46.210 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 1080 (ObjNum 472 snap 135 seq_num 472) dirty exists 2024-03-04T06:46:46.210 INFO:tasks.rados.rados.0.smithi137.stdout:1423: left oid 27 (ObjNum 472 snap 135 seq_num 472) 2024-03-04T06:46:46.210 INFO:tasks.rados.rados.0.smithi137.stdout:1426: seq_num 474 ranges {3563520=745472} 2024-03-04T06:46:46.232 INFO:tasks.rados.rados.0.smithi137.stdout:1426: writing smithi13777483-31 from 3563520 to 4308992 tid 1 2024-03-04T06:46:46.232 INFO:tasks.rados.rados.0.smithi137.stdout:1423: done (3 left) 2024-03-04T06:46:46.233 INFO:tasks.rados.rados.0.smithi137.stdout:1427: read oid 38 snap -1 2024-03-04T06:46:46.233 INFO:tasks.rados.rados.0.smithi137.stdout:1427: expect deleted 2024-03-04T06:46:46.233 INFO:tasks.rados.rados.0.smithi137.stdout:1428: delete oid 4 current snap is 135 2024-03-04T06:46:46.233 INFO:tasks.rados.rados.0.smithi137.stdout:1424: finishing write tid 1 to smithi13777483-15 2024-03-04T06:46:46.233 INFO:tasks.rados.rados.0.smithi137.stdout:1424: finishing write tid 2 to smithi13777483-15 2024-03-04T06:46:46.233 INFO:tasks.rados.rados.0.smithi137.stdout:1424: finishing write tid 3 to smithi13777483-15 2024-03-04T06:46:46.233 INFO:tasks.rados.rados.0.smithi137.stdout:1424: oid 15 updating version 0 to 905 2024-03-04T06:46:46.233 INFO:tasks.rados.rados.0.smithi137.stdout:1424: oid 15 updating version 905 to 906 2024-03-04T06:46:46.233 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 906 (ObjNum 473 snap 135 seq_num 473) dirty exists 2024-03-04T06:46:46.233 INFO:tasks.rados.rados.0.smithi137.stdout:1424: left oid 15 (ObjNum 473 snap 135 seq_num 473) 2024-03-04T06:46:46.234 INFO:tasks.rados.rados.0.smithi137.stdout:1424: done (4 left) 2024-03-04T06:46:46.234 INFO:tasks.rados.rados.0.smithi137.stdout:1425: done (3 left) 2024-03-04T06:46:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:1427: done (2 left) 2024-03-04T06:46:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:1428: done (1 left) 2024-03-04T06:46:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 135 2024-03-04T06:46:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:1429: seq_num 476 ranges {2580480=778240} 2024-03-04T06:46:46.253 INFO:tasks.rados.rados.0.smithi137.stdout:1429: writing smithi13777483-12 from 2580480 to 3358720 tid 1 2024-03-04T06:46:46.253 INFO:tasks.rados.rados.0.smithi137.stdout:1430: snap_remove snap 134 2024-03-04T06:46:46.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:46 smithi137 ceph-mon[88869]: osdmap e343: 8 total, 8 up, 8 in 2024-03-04T06:46:46.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset be=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:46.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:46.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset be=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:46.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:46.173+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:46.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:46 smithi137 ceph-mon[91314]: osdmap e343: 8 total, 8 up, 8 in 2024-03-04T06:46:46.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset be=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:46.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:46.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset be=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:46.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:46.163+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:46.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:46.164+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:46.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:46.164+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:46 smithi203 ceph-mon[85573]: osdmap e343: 8 total, 8 up, 8 in 2024-03-04T06:46:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset be=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset be=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:47.168 INFO:tasks.rados.rados.0.smithi137.stdout:1430: done (2 left) 2024-03-04T06:46:47.169 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 135 2024-03-04T06:46:47.169 INFO:tasks.rados.rados.0.smithi137.stdout:1426: finishing write tid 1 to smithi13777483-31 2024-03-04T06:46:47.169 INFO:tasks.rados.rados.0.smithi137.stdout:1431: seq_num 477 ranges {0=794624} 2024-03-04T06:46:47.173 INFO:tasks.rados.rados.0.smithi137.stdout:1431: writing smithi13777483-26 from 0 to 794624 tid 1 2024-03-04T06:46:47.173 INFO:tasks.rados.rados.0.smithi137.stdout:1432: snap_create 2024-03-04T06:46:47.173 INFO:tasks.rados.rados.0.smithi137.stdout:1426: finishing write tid 2 to smithi13777483-31 2024-03-04T06:46:47.173 INFO:tasks.rados.rados.0.smithi137.stdout:1426: finishing write tid 3 to smithi13777483-31 2024-03-04T06:46:47.173 INFO:tasks.rados.rados.0.smithi137.stdout:1426: oid 31 updating version 0 to 727 2024-03-04T06:46:47.173 INFO:tasks.rados.rados.0.smithi137.stdout:1426: oid 31 updating version 727 to 728 2024-03-04T06:46:47.174 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 728 (ObjNum 474 snap 135 seq_num 474) dirty exists 2024-03-04T06:46:47.174 INFO:tasks.rados.rados.0.smithi137.stdout:1426: left oid 31 (ObjNum 474 snap 135 seq_num 474) 2024-03-04T06:46:47.174 INFO:tasks.rados.rados.0.smithi137.stdout:1429: finishing write tid 1 to smithi13777483-12 2024-03-04T06:46:47.174 INFO:tasks.rados.rados.0.smithi137.stdout:1429: finishing write tid 2 to smithi13777483-12 2024-03-04T06:46:47.174 INFO:tasks.rados.rados.0.smithi137.stdout:1429: finishing write tid 3 to smithi13777483-12 2024-03-04T06:46:47.174 INFO:tasks.rados.rados.0.smithi137.stdout:1429: oid 12 updating version 0 to 1044 2024-03-04T06:46:47.174 INFO:tasks.rados.rados.0.smithi137.stdout:1429: oid 12 updating version 1044 to 1045 2024-03-04T06:46:47.174 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 1045 (ObjNum 476 snap 135 seq_num 476) dirty exists 2024-03-04T06:46:47.174 INFO:tasks.rados.rados.0.smithi137.stdout:1429: left oid 12 (ObjNum 476 snap 135 seq_num 476) 2024-03-04T06:46:47.179 INFO:tasks.rados.rados.0.smithi137.stdout:1431: finishing write tid 1 to smithi13777483-26 2024-03-04T06:46:47.180 INFO:tasks.rados.rados.0.smithi137.stdout:1431: finishing write tid 2 to smithi13777483-26 2024-03-04T06:46:47.182 INFO:tasks.rados.rados.0.smithi137.stdout:1431: finishing write tid 3 to smithi13777483-26 2024-03-04T06:46:47.182 INFO:tasks.rados.rados.0.smithi137.stdout:1431: oid 26 updating version 0 to 612 2024-03-04T06:46:47.182 INFO:tasks.rados.rados.0.smithi137.stdout:1431: oid 26 version 612 is already newer than 611 2024-03-04T06:46:47.182 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 612 (ObjNum 477 snap 135 seq_num 477) dirty exists 2024-03-04T06:46:47.182 INFO:tasks.rados.rados.0.smithi137.stdout:1431: left oid 26 (ObjNum 477 snap 135 seq_num 477) 2024-03-04T06:46:47.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:47.168+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:47.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:47.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:47 smithi137 ceph-mon[88869]: osdmap e344: 8 total, 8 up, 8 in 2024-03-04T06:46:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:47 smithi137 ceph-mon[88869]: pgmap v189: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 122 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-03-04T06:46:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:47 smithi137 ceph-mon[91314]: osdmap e344: 8 total, 8 up, 8 in 2024-03-04T06:46:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:47 smithi137 ceph-mon[91314]: pgmap v189: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 122 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-03-04T06:46:47.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:47.183+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:47.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:47.183+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:47 smithi203 ceph-mon[85573]: osdmap e344: 8 total, 8 up, 8 in 2024-03-04T06:46:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:47.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:47 smithi203 ceph-mon[85573]: pgmap v189: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 122 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-03-04T06:46:48.174 INFO:tasks.rados.rados.0.smithi137.stdout:1426: done (3 left) 2024-03-04T06:46:48.175 INFO:tasks.rados.rados.0.smithi137.stdout:1429: done (2 left) 2024-03-04T06:46:48.175 INFO:tasks.rados.rados.0.smithi137.stdout:1431: done (1 left) 2024-03-04T06:46:48.175 INFO:tasks.rados.rados.0.smithi137.stdout:1432: done (0 left) 2024-03-04T06:46:48.175 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 136 2024-03-04T06:46:48.175 INFO:tasks.rados.rados.0.smithi137.stdout:1433: seq_num 478 ranges {1523712=409600,1933312=401408} 2024-03-04T06:46:48.185 INFO:tasks.rados.rados.0.smithi137.stdout:1433: writing smithi13777483-3 from 1523712 to 1933312 tid 1 2024-03-04T06:46:48.188 INFO:tasks.rados.rados.0.smithi137.stdout:1433: writing smithi13777483-3 from 1933312 to 2334720 tid 2 2024-03-04T06:46:48.188 INFO:tasks.rados.rados.0.smithi137.stdout:1434: read oid 23 snap -1 2024-03-04T06:46:48.188 INFO:tasks.rados.rados.0.smithi137.stdout:1434: expect (ObjNum 436 snap 128 seq_num 436) 2024-03-04T06:46:48.188 INFO:tasks.rados.rados.0.smithi137.stdout:1435: read oid 30 snap 135 2024-03-04T06:46:48.188 INFO:tasks.rados.rados.0.smithi137.stdout:1435: expect deleted 2024-03-04T06:46:48.188 INFO:tasks.rados.rados.0.smithi137.stdout:1436: rmattr oid 13 current snap is 136 2024-03-04T06:46:48.188 INFO:tasks.rados.rados.0.smithi137.stdout:1436: done (3 left) 2024-03-04T06:46:48.188 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 136 2024-03-04T06:46:48.188 INFO:tasks.rados.rados.0.smithi137.stdout:1437: seq_num 479 ranges {6856704=425984,7282688=401408} 2024-03-04T06:46:48.227 INFO:tasks.rados.rados.0.smithi137.stdout:1437: writing smithi13777483-21 from 6856704 to 7282688 tid 1 2024-03-04T06:46:48.230 INFO:tasks.rados.rados.0.smithi137.stdout:1437: writing smithi13777483-21 from 7282688 to 7684096 tid 2 2024-03-04T06:46:48.230 INFO:tasks.rados.rados.0.smithi137.stdout:1438: read oid 37 snap -1 2024-03-04T06:46:48.230 INFO:tasks.rados.rados.0.smithi137.stdout:1438: expect deleted 2024-03-04T06:46:48.230 INFO:tasks.rados.rados.0.smithi137.stdout:1439: rollback oid 45 current snap is 136 2024-03-04T06:46:48.230 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 45 to 135 2024-03-04T06:46:48.230 INFO:tasks.rados.rados.0.smithi137.stdout:1433: finishing write tid 1 to smithi13777483-3 2024-03-04T06:46:48.230 INFO:tasks.rados.rados.0.smithi137.stdout:1433: finishing write tid 2 to smithi13777483-3 2024-03-04T06:46:48.230 INFO:tasks.rados.rados.0.smithi137.stdout:1433: finishing write tid 3 to smithi13777483-3 2024-03-04T06:46:48.230 INFO:tasks.rados.rados.0.smithi137.stdout:1433: finishing write tid 4 to smithi13777483-3 2024-03-04T06:46:48.230 INFO:tasks.rados.rados.0.smithi137.stdout:1433: oid 3 updating version 0 to 790 2024-03-04T06:46:48.230 INFO:tasks.rados.rados.0.smithi137.stdout:1433: oid 3 version 790 is already newer than 788 2024-03-04T06:46:48.231 INFO:tasks.rados.rados.0.smithi137.stdout:1433: oid 3 version 790 is already newer than 789 2024-03-04T06:46:48.231 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 790 (ObjNum 478 snap 136 seq_num 478) dirty exists 2024-03-04T06:46:48.231 INFO:tasks.rados.rados.0.smithi137.stdout:1433: left oid 3 (ObjNum 478 snap 136 seq_num 478) 2024-03-04T06:46:48.231 INFO:tasks.rados.rados.0.smithi137.stdout:1434: expect (ObjNum 436 snap 128 seq_num 436) 2024-03-04T06:46:48.262 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:46:48.325 INFO:tasks.rados.rados.0.smithi137.stdout:1439: finishing rollback tid 0 to smithi13777483-45 2024-03-04T06:46:48.325 INFO:tasks.rados.rados.0.smithi137.stdout:1439: finishing rollback tid 1 to smithi13777483-45 2024-03-04T06:46:48.325 INFO:tasks.rados.rados.0.smithi137.stdout:1439: finishing rollback tid 2 to smithi13777483-45 2024-03-04T06:46:48.325 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 354 (ObjNum 438 snap 129 seq_num 438) dirty exists 2024-03-04T06:46:48.325 INFO:tasks.rados.rados.0.smithi137.stdout:1437: finishing write tid 1 to smithi13777483-21 2024-03-04T06:46:48.325 INFO:tasks.rados.rados.0.smithi137.stdout:1437: finishing write tid 2 to smithi13777483-21 2024-03-04T06:46:48.325 INFO:tasks.rados.rados.0.smithi137.stdout:1437: finishing write tid 3 to smithi13777483-21 2024-03-04T06:46:48.325 INFO:tasks.rados.rados.0.smithi137.stdout:1437: finishing write tid 4 to smithi13777483-21 2024-03-04T06:46:48.325 INFO:tasks.rados.rados.0.smithi137.stdout:1437: oid 21 updating version 0 to 943 2024-03-04T06:46:48.326 INFO:tasks.rados.rados.0.smithi137.stdout:1437: oid 21 updating version 943 to 944 2024-03-04T06:46:48.326 INFO:tasks.rados.rados.0.smithi137.stdout:1437: oid 21 version 944 is already newer than 942 2024-03-04T06:46:48.326 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 944 (ObjNum 479 snap 136 seq_num 479) dirty exists 2024-03-04T06:46:48.326 INFO:tasks.rados.rados.0.smithi137.stdout:1437: left oid 21 (ObjNum 479 snap 136 seq_num 479) 2024-03-04T06:46:48.326 INFO:tasks.rados.rados.0.smithi137.stdout:1433: done (5 left) 2024-03-04T06:46:48.326 INFO:tasks.rados.rados.0.smithi137.stdout:1434: done (4 left) 2024-03-04T06:46:48.326 INFO:tasks.rados.rados.0.smithi137.stdout:1435: done (3 left) 2024-03-04T06:46:48.326 INFO:tasks.rados.rados.0.smithi137.stdout:1437: done (2 left) 2024-03-04T06:46:48.326 INFO:tasks.rados.rados.0.smithi137.stdout:1438: done (1 left) 2024-03-04T06:46:48.326 INFO:tasks.rados.rados.0.smithi137.stdout:1439: done (0 left) 2024-03-04T06:46:48.326 INFO:tasks.rados.rados.0.smithi137.stdout:1440: delete oid 37 current snap is 136 2024-03-04T06:46:48.327 INFO:tasks.rados.rados.0.smithi137.stdout:1440: done (0 left) 2024-03-04T06:46:48.327 INFO:tasks.rados.rados.0.smithi137.stdout:1441: read oid 14 snap 133 2024-03-04T06:46:48.327 INFO:tasks.rados.rados.0.smithi137.stdout:1441: expect deleted 2024-03-04T06:46:48.328 INFO:tasks.rados.rados.0.smithi137.stdout:1442: read oid 45 snap -1 2024-03-04T06:46:48.328 INFO:tasks.rados.rados.0.smithi137.stdout:1442: expect (ObjNum 438 snap 129 seq_num 438) 2024-03-04T06:46:48.328 INFO:tasks.rados.rados.0.smithi137.stdout:1443: snap_remove snap 135 2024-03-04T06:46:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:48 smithi137 ceph-mon[88869]: osdmap e345: 8 total, 8 up, 8 in 2024-03-04T06:46:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:48 smithi137 ceph-mon[91314]: osdmap e345: 8 total, 8 up, 8 in 2024-03-04T06:46:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:48.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:48.191+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:48.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:48.191+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:48.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:48.192+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:48.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:48.233+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:48.583 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:46:48.583 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (6m) 15s ago 7m 26.4M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:46:48.583 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (7m) 94s ago 7m 87.9M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:46:48.583 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (8m) 15s ago 8m 18.3M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:46:48.583 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (8m) 94s ago 8m 18.6M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:46:48.583 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (2m) 94s ago 12m 448M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:46:48.583 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (3m) 15s ago 13m 503M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:46:48.583 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (2m) 15s ago 14m 47.9M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:46:48.584 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (100s) 94s ago 12m 29.9M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:46:48.584 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (114s) 15s ago 12m 42.9M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:46:48.584 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (7m) 15s ago 7m 16.6M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:46:48.584 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (6m) 94s ago 6m 15.6M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:46:48.584 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (55s) 15s ago 11m 163M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 bd2207652b33 2024-03-04T06:46:48.584 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (19s) 15s ago 11m 12.7M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 47b5cdaad147 2024-03-04T06:46:48.584 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (11m) 15s ago 10m 246M 2480M 18.2.1-696-g5cc7a767 540557f94930 b247adf81a73 2024-03-04T06:46:48.584 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (10m) 15s ago 10m 270M 2480M 18.2.1-696-g5cc7a767 540557f94930 afdbc25c9fba 2024-03-04T06:46:48.584 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (10m) 94s ago 10m 212M 2480M 18.2.1-696-g5cc7a767 540557f94930 d4841ffd0747 2024-03-04T06:46:48.584 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (9m) 94s ago 9m 225M 2480M 18.2.1-696-g5cc7a767 540557f94930 81d21771e157 2024-03-04T06:46:48.584 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (9m) 94s ago 9m 109M 2480M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:46:48.584 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (9m) 94s ago 8m 136M 2480M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:46:48.584 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (2m) 94s ago 8m 49.8M - 2.43.0 a07b618ecd1d 6a88bdd1023c 2024-03-04T06:46:48.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:48 smithi203 ceph-mon[85573]: osdmap e345: 8 total, 8 up, 8 in 2024-03-04T06:46:48.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:48.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:48.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:48.974 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 6, 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:46:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 8, 2024-03-04T06:46:48.976 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 7 2024-03-04T06:46:48.976 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:46:48.976 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:46:49.182 INFO:tasks.rados.rados.0.smithi137.stdout:1443: done (2 left) 2024-03-04T06:46:49.182 INFO:tasks.rados.rados.0.smithi137.stdout:1444: read oid 39 snap -1 2024-03-04T06:46:49.182 INFO:tasks.rados.rados.0.smithi137.stdout:1444: expect (ObjNum 449 snap 131 seq_num 449) 2024-03-04T06:46:49.182 INFO:tasks.rados.rados.0.smithi137.stdout:1445: setattr oid 36 current snap is 136 2024-03-04T06:46:49.182 INFO:tasks.rados.rados.0.smithi137.stdout:1442: expect (ObjNum 438 snap 129 seq_num 438) 2024-03-04T06:46:49.189 INFO:tasks.rados.rados.0.smithi137.stdout:1441: done (3 left) 2024-03-04T06:46:49.190 INFO:tasks.rados.rados.0.smithi137.stdout:1442: done (2 left) 2024-03-04T06:46:49.190 INFO:tasks.rados.rados.0.smithi137.stdout:1446: snap_create 2024-03-04T06:46:49.193 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 337 (ObjNum 434 snap 128 seq_num 434) dirty exists 2024-03-04T06:46:49.212 INFO:tasks.rados.rados.0.smithi137.stdout:1444: expect (ObjNum 449 snap 131 seq_num 449) 2024-03-04T06:46:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[88869]: osdmap e346: 8 total, 8 up, 8 in 2024-03-04T06:46:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[88869]: from='client.44165 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:46:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[88869]: pgmap v192: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 125 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.6 MiB/s rd, 786 KiB/s wr, 4 op/s 2024-03-04T06:46:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/1463710722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:49.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:49.184+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:49.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:49.184+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[91314]: osdmap e346: 8 total, 8 up, 8 in 2024-03-04T06:46:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[91314]: from='client.44165 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:46:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[91314]: pgmap v192: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 125 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.6 MiB/s rd, 786 KiB/s wr, 4 op/s 2024-03-04T06:46:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/1463710722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:49.295 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:49.193+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:49 smithi203 ceph-mon[85573]: osdmap e346: 8 total, 8 up, 8 in 2024-03-04T06:46:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:49 smithi203 ceph-mon[85573]: from='client.44165 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:46:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:49 smithi203 ceph-mon[85573]: pgmap v192: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 125 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.6 MiB/s rd, 786 KiB/s wr, 4 op/s 2024-03-04T06:46:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:49 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:49 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/1463710722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:46:50.191 INFO:tasks.rados.rados.0.smithi137.stdout:1444: done (2 left) 2024-03-04T06:46:50.191 INFO:tasks.rados.rados.0.smithi137.stdout:1445: done (1 left) 2024-03-04T06:46:50.191 INFO:tasks.rados.rados.0.smithi137.stdout:1446: done (0 left) 2024-03-04T06:46:50.192 INFO:tasks.rados.rados.0.smithi137.stdout:1447: delete oid 6 current snap is 137 2024-03-04T06:46:50.195 INFO:tasks.rados.rados.0.smithi137.stdout:1447: done (0 left) 2024-03-04T06:46:50.195 INFO:tasks.rados.rados.0.smithi137.stdout:1448: snap_create 2024-03-04T06:46:50.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-mon[88869]: from='client.44171 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:46:50.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-mon[88869]: osdmap e347: 8 total, 8 up, 8 in 2024-03-04T06:46:50.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:50.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:50.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-mon[91314]: from='client.44171 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:46:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-mon[91314]: osdmap e347: 8 total, 8 up, 8 in 2024-03-04T06:46:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:50.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:50.195+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:50.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:50.195+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:50.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:50.195+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:50.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:50.329+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:50.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:50 smithi203 ceph-mon[85573]: from='client.44171 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:46:50.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:50 smithi203 ceph-mon[85573]: osdmap e347: 8 total, 8 up, 8 in 2024-03-04T06:46:50.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:50.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:50.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:51.198 INFO:tasks.rados.rados.0.smithi137.stdout:1448: done (0 left) 2024-03-04T06:46:51.198 INFO:tasks.rados.rados.0.smithi137.stdout:1449: snap_remove snap 137 2024-03-04T06:46:51.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:51.196+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:51.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:51.196+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:51.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:51 smithi137 ceph-mon[88869]: osdmap e348: 8 total, 8 up, 8 in 2024-03-04T06:46:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:51 smithi137 ceph-mon[88869]: pgmap v195: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 134 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 3.1 MiB/s wr, 30 op/s 2024-03-04T06:46:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:51.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:51 smithi137 ceph-mon[91314]: osdmap e348: 8 total, 8 up, 8 in 2024-03-04T06:46:51.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:51.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:51.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:51 smithi137 ceph-mon[91314]: pgmap v195: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 134 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 3.1 MiB/s wr, 30 op/s 2024-03-04T06:46:51.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:51 smithi203 ceph-mon[85573]: osdmap e348: 8 total, 8 up, 8 in 2024-03-04T06:46:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:51 smithi203 ceph-mon[85573]: pgmap v195: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 134 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 3.1 MiB/s wr, 30 op/s 2024-03-04T06:46:51.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:52.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:51.735+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:52.200 INFO:tasks.rados.rados.0.smithi137.stdout:1449: done (0 left) 2024-03-04T06:46:52.200 INFO:tasks.rados.rados.0.smithi137.stdout:1450: delete oid 32 current snap is 138 2024-03-04T06:46:52.204 INFO:tasks.rados.rados.0.smithi137.stdout:1450: done (0 left) 2024-03-04T06:46:52.204 INFO:tasks.rados.rados.0.smithi137.stdout:1451: delete oid 21 current snap is 138 2024-03-04T06:46:52.208 INFO:tasks.rados.rados.0.smithi137.stdout:1451: done (0 left) 2024-03-04T06:46:52.208 INFO:tasks.rados.rados.0.smithi137.stdout:1452: snap_remove snap 133 2024-03-04T06:46:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:52 smithi137 ceph-mon[88869]: osdmap e349: 8 total, 8 up, 8 in 2024-03-04T06:46:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:52 smithi137 ceph-mon[91314]: osdmap e349: 8 total, 8 up, 8 in 2024-03-04T06:46:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:52.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:52.208+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:52.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:52.208+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:52.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:52.208+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:52.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:52.204+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:52.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:52.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:52.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:52 smithi203 ceph-mon[85573]: osdmap e349: 8 total, 8 up, 8 in 2024-03-04T06:46:52.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:53.213 INFO:tasks.rados.rados.0.smithi137.stdout:1452: done (0 left) 2024-03-04T06:46:53.213 INFO:tasks.rados.rados.0.smithi137.stdout:1453: snap_remove snap 136 2024-03-04T06:46:53.460 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-mon[88869]: osdmap e350: 8 total, 8 up, 8 in 2024-03-04T06:46:53.461 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:53.461 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:53.461 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:53.461 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-mon[88869]: pgmap v198: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 134 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 2.3 MiB/s wr, 25 op/s 2024-03-04T06:46:53.461 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-04T06:46:53.461 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-mon[91314]: osdmap e350: 8 total, 8 up, 8 in 2024-03-04T06:46:53.461 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:53.461 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:53.461 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:53.462 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-mon[91314]: pgmap v198: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 134 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 2.3 MiB/s wr, 25 op/s 2024-03-04T06:46:53.462 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-04T06:46:53.462 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:53.211+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:53.462 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:53.211+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:53.462 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:53.215+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:53 smithi203 ceph-mon[85573]: osdmap e350: 8 total, 8 up, 8 in 2024-03-04T06:46:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:53 smithi203 ceph-mon[85573]: pgmap v198: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 134 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 2.3 MiB/s wr, 25 op/s 2024-03-04T06:46:53.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:53 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-04T06:46:54.214 INFO:tasks.rados.rados.0.smithi137.stdout:1453: done (0 left) 2024-03-04T06:46:54.214 INFO:tasks.rados.rados.0.smithi137.stdout:1454: copy_from oid 11 from oid 16 current snap is 138 2024-03-04T06:46:54.215 INFO:tasks.rados.rados.0.smithi137.stdout:1455: rollback oid 40 current snap is 138 2024-03-04T06:46:54.215 INFO:tasks.rados.rados.0.smithi137.stdout:1455: done (1 left) 2024-03-04T06:46:54.215 INFO:tasks.rados.rados.0.smithi137.stdout:1456: read oid 21 snap -1 2024-03-04T06:46:54.215 INFO:tasks.rados.rados.0.smithi137.stdout:1456: expect deleted 2024-03-04T06:46:54.215 INFO:tasks.rados.rados.0.smithi137.stdout:1457: rollback oid 39 current snap is 138 2024-03-04T06:46:54.215 INFO:tasks.rados.rados.0.smithi137.stdout:1457: done (2 left) 2024-03-04T06:46:54.215 INFO:tasks.rados.rados.0.smithi137.stdout:1458: copy_from oid 18 from oid 14 current snap is 138 2024-03-04T06:46:54.215 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 50 current snap is 138 2024-03-04T06:46:54.215 INFO:tasks.rados.rados.0.smithi137.stdout:1459: seq_num 484 ranges {3039232=507904,3547136=401408} 2024-03-04T06:46:54.235 INFO:tasks.rados.rados.0.smithi137.stdout:1459: writing smithi13777483-50 from 3039232 to 3547136 tid 1 2024-03-04T06:46:54.238 INFO:tasks.rados.rados.0.smithi137.stdout:1459: writing smithi13777483-50 from 3547136 to 3948544 tid 2 2024-03-04T06:46:54.238 INFO:tasks.rados.rados.0.smithi137.stdout:1460: copy_from oid 15 from oid 4 current snap is 138 2024-03-04T06:46:54.238 INFO:tasks.rados.rados.0.smithi137.stdout:1458: finishing copy_from to smithi13777483-18 2024-03-04T06:46:54.238 INFO:tasks.rados.rados.0.smithi137.stdout:1458: got expected ENOENT (src dne) 2024-03-04T06:46:54.238 INFO:tasks.rados.rados.0.smithi137.stdout:1458: finishing copy_from racing read to smithi13777483-18 2024-03-04T06:46:54.238 INFO:tasks.rados.rados.0.smithi137.stdout:1456: done (4 left) 2024-03-04T06:46:54.238 INFO:tasks.rados.rados.0.smithi137.stdout:1458: done (3 left) 2024-03-04T06:46:54.239 INFO:tasks.rados.rados.0.smithi137.stdout:1461: delete oid 1 current snap is 138 2024-03-04T06:46:54.240 INFO:tasks.rados.rados.0.smithi137.stdout:1460: finishing copy_from to smithi13777483-15 2024-03-04T06:46:54.240 INFO:tasks.rados.rados.0.smithi137.stdout:1460: got expected ENOENT (src dne) 2024-03-04T06:46:54.240 INFO:tasks.rados.rados.0.smithi137.stdout:1461: done (3 left) 2024-03-04T06:46:54.240 INFO:tasks.rados.rados.0.smithi137.stdout:1462: snap_create 2024-03-04T06:46:54.240 INFO:tasks.rados.rados.0.smithi137.stdout:1460: finishing copy_from racing read to smithi13777483-15 2024-03-04T06:46:54.241 INFO:tasks.rados.rados.0.smithi137.stdout:1459: finishing write tid 1 to smithi13777483-50 2024-03-04T06:46:54.241 INFO:tasks.rados.rados.0.smithi137.stdout:1459: finishing write tid 2 to smithi13777483-50 2024-03-04T06:46:54.242 INFO:tasks.rados.rados.0.smithi137.stdout:1459: finishing write tid 3 to smithi13777483-50 2024-03-04T06:46:54.243 INFO:tasks.rados.rados.0.smithi137.stdout:1459: finishing write tid 4 to smithi13777483-50 2024-03-04T06:46:54.243 INFO:tasks.rados.rados.0.smithi137.stdout:1459: oid 50 updating version 0 to 1089 2024-03-04T06:46:54.243 INFO:tasks.rados.rados.0.smithi137.stdout:1459: oid 50 updating version 1089 to 1091 2024-03-04T06:46:54.243 INFO:tasks.rados.rados.0.smithi137.stdout:1459: oid 50 version 1091 is already newer than 1090 2024-03-04T06:46:54.243 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 1091 (ObjNum 484 snap 138 seq_num 484) dirty exists 2024-03-04T06:46:54.243 INFO:tasks.rados.rados.0.smithi137.stdout:1459: left oid 50 (ObjNum 484 snap 138 seq_num 484) 2024-03-04T06:46:54.255 INFO:tasks.rados.rados.0.smithi137.stdout:1454: finishing copy_from racing read to smithi13777483-11 2024-03-04T06:46:54.258 INFO:tasks.rados.rados.0.smithi137.stdout:1454: finishing copy_from to smithi13777483-11 2024-03-04T06:46:54.258 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 15437 (ObjNum 419 snap 125 seq_num 419) dirty exists 2024-03-04T06:46:54.431 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:54.219+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:54.431 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-04T06:46:54.432 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[88869]: Upgrade: osd.2 is safe to restart 2024-03-04T06:46:54.432 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:54.432 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:54.432 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[88869]: osdmap e351: 8 total, 8 up, 8 in 2024-03-04T06:46:54.432 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:54.432 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:54.432 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:46:54.432 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-04T06:46:54.432 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[91314]: Upgrade: osd.2 is safe to restart 2024-03-04T06:46:54.433 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:54.433 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:54.433 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[91314]: osdmap e351: 8 total, 8 up, 8 in 2024-03-04T06:46:54.433 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:54.433 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:54.433 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:46:54.433 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:54.218+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:54.433 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:54.218+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:54.433 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:54.218+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:54.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:54 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-04T06:46:54.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:54 smithi203 ceph-mon[85573]: Upgrade: osd.2 is safe to restart 2024-03-04T06:46:54.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:54.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:54.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:54 smithi203 ceph-mon[85573]: osdmap e351: 8 total, 8 up, 8 in 2024-03-04T06:46:54.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:54.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:54.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:46:55.230 INFO:tasks.rados.rados.0.smithi137.stdout:1454: done (3 left) 2024-03-04T06:46:55.230 INFO:tasks.rados.rados.0.smithi137.stdout:1459: done (2 left) 2024-03-04T06:46:55.230 INFO:tasks.rados.rados.0.smithi137.stdout:1460: done (1 left) 2024-03-04T06:46:55.230 INFO:tasks.rados.rados.0.smithi137.stdout:1462: done (0 left) 2024-03-04T06:46:55.230 INFO:tasks.rados.rados.0.smithi137.stdout:1463: read oid 3 snap 138 2024-03-04T06:46:55.230 INFO:tasks.rados.rados.0.smithi137.stdout:1463: expect (ObjNum 478 snap 136 seq_num 478) 2024-03-04T06:46:55.230 INFO:tasks.rados.rados.0.smithi137.stdout:1464: rmattr oid 18 current snap is 139 2024-03-04T06:46:55.230 INFO:tasks.rados.rados.0.smithi137.stdout:1465: read oid 12 snap -1 2024-03-04T06:46:55.231 INFO:tasks.rados.rados.0.smithi137.stdout:1465: expect (ObjNum 476 snap 135 seq_num 476) 2024-03-04T06:46:55.231 INFO:tasks.rados.rados.0.smithi137.stdout:1466: copy_from oid 7 from oid 35 current snap is 139 2024-03-04T06:46:55.231 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 139 2024-03-04T06:46:55.231 INFO:tasks.rados.rados.0.smithi137.stdout:1467: seq_num 486 ranges {139264=548864,688128=401408} 2024-03-04T06:46:55.234 INFO:tasks.rados.rados.0.smithi137.stdout:1467: writing smithi13777483-45 from 139264 to 688128 tid 1 2024-03-04T06:46:55.237 INFO:tasks.rados.rados.0.smithi137.stdout:1467: writing smithi13777483-45 from 688128 to 1089536 tid 2 2024-03-04T06:46:55.237 INFO:tasks.rados.rados.0.smithi137.stdout:1468: setattr oid 28 current snap is 139 2024-03-04T06:46:55.237 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 614 (ObjNum 396 snap 119 seq_num 396) dirty exists 2024-03-04T06:46:55.240 INFO:tasks.rados.rados.0.smithi137.stdout:1464: done (5 left) 2024-03-04T06:46:55.240 INFO:tasks.rados.rados.0.smithi137.stdout:1469: read oid 50 snap -1 2024-03-04T06:46:55.240 INFO:tasks.rados.rados.0.smithi137.stdout:1469: expect (ObjNum 484 snap 138 seq_num 484) 2024-03-04T06:46:55.240 INFO:tasks.rados.rados.0.smithi137.stdout:1470: rmattr oid 4 current snap is 139 2024-03-04T06:46:55.240 INFO:tasks.rados.rados.0.smithi137.stdout:1463: expect (ObjNum 478 snap 136 seq_num 478) 2024-03-04T06:46:55.305 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:55.235+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:55.306 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:55.227+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:55.306 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:55.228+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:55.306 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[88869]: osdmap e352: 8 total, 8 up, 8 in 2024-03-04T06:46:55.306 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:55.306 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:55.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:55.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[88869]: pgmap v201: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 132 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 2.5 MiB/s wr, 4 op/s 2024-03-04T06:46:55.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:55.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-04T06:46:55.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:46:55.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[91314]: osdmap e352: 8 total, 8 up, 8 in 2024-03-04T06:46:55.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:55.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:55.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:55.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[91314]: pgmap v201: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 132 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 2.5 MiB/s wr, 4 op/s 2024-03-04T06:46:55.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:55.307 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-04T06:46:55.308 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:46:55.336 INFO:tasks.rados.rados.0.smithi137.stdout:1467: finishing write tid 1 to smithi13777483-45 2024-03-04T06:46:55.336 INFO:tasks.rados.rados.0.smithi137.stdout:1467: finishing write tid 2 to smithi13777483-45 2024-03-04T06:46:55.336 INFO:tasks.rados.rados.0.smithi137.stdout:1463: done (6 left) 2024-03-04T06:46:55.336 INFO:tasks.rados.rados.0.smithi137.stdout:1470: done (5 left) 2024-03-04T06:46:55.336 INFO:tasks.rados.rados.0.smithi137.stdout:1471: read oid 41 snap -1 2024-03-04T06:46:55.336 INFO:tasks.rados.rados.0.smithi137.stdout:1471: expect (ObjNum 427 snap 127 seq_num 427) 2024-03-04T06:46:55.336 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 139 2024-03-04T06:46:55.336 INFO:tasks.rados.rados.0.smithi137.stdout:1467: finishing write tid 3 to smithi13777483-45 2024-03-04T06:46:55.336 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 948 (ObjNum 407 snap 122 seq_num 407) dirty exists 2024-03-04T06:46:55.336 INFO:tasks.rados.rados.0.smithi137.stdout:1467: finishing write tid 4 to smithi13777483-45 2024-03-04T06:46:55.336 INFO:tasks.rados.rados.0.smithi137.stdout:1467: oid 45 updating version 0 to 361 2024-03-04T06:46:55.336 INFO:tasks.rados.rados.0.smithi137.stdout:1467: oid 45 version 361 is already newer than 360 2024-03-04T06:46:55.337 INFO:tasks.rados.rados.0.smithi137.stdout:1467: oid 45 updating version 361 to 362 2024-03-04T06:46:55.337 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 362 (ObjNum 486 snap 139 seq_num 486) dirty exists 2024-03-04T06:46:55.337 INFO:tasks.rados.rados.0.smithi137.stdout:1467: left oid 45 (ObjNum 486 snap 139 seq_num 486) 2024-03-04T06:46:55.337 INFO:tasks.rados.rados.0.smithi137.stdout:1472: seq_num 487 ranges {819200=565248,1384448=401408} 2024-03-04T06:46:55.343 INFO:tasks.rados.rados.0.smithi137.stdout:1472: writing smithi13777483-20 from 819200 to 1384448 tid 1 2024-03-04T06:46:55.345 INFO:tasks.rados.rados.0.smithi137.stdout:1472: writing smithi13777483-20 from 1384448 to 1785856 tid 2 2024-03-04T06:46:55.345 INFO:tasks.rados.rados.0.smithi137.stdout:1467: done (6 left) 2024-03-04T06:46:55.345 INFO:tasks.rados.rados.0.smithi137.stdout:1468: done (5 left) 2024-03-04T06:46:55.345 INFO:tasks.rados.rados.0.smithi137.stdout:1473: snap_remove snap 138 2024-03-04T06:46:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:55 smithi203 ceph-mon[85573]: osdmap e352: 8 total, 8 up, 8 in 2024-03-04T06:46:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:55 smithi203 ceph-mon[85573]: pgmap v201: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 132 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 2.5 MiB/s wr, 4 op/s 2024-03-04T06:46:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:55 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:46:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:55 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-04T06:46:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:55 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:46:55.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:46:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:46:55] "GET /metrics HTTP/1.1" 200 36265 "" "Prometheus/2.43.0" 2024-03-04T06:46:56.231 INFO:tasks.rados.rados.0.smithi137.stdout:1473: done (5 left) 2024-03-04T06:46:56.232 INFO:tasks.rados.rados.0.smithi137.stdout:1474: snap_create 2024-03-04T06:46:56.232 INFO:tasks.rados.rados.0.smithi137.stdout:1465: expect (ObjNum 476 snap 135 seq_num 476) 2024-03-04T06:46:56.322 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-mon[88869]: Upgrade: Updating osd.2 2024-03-04T06:46:56.322 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-mon[88869]: Deploying daemon osd.2 on smithi137 2024-03-04T06:46:56.322 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-mon[88869]: osdmap e353: 8 total, 8 up, 8 in 2024-03-04T06:46:56.322 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:56.323 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:56.323 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:56.323 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-mon[91314]: Upgrade: Updating osd.2 2024-03-04T06:46:56.323 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-mon[91314]: Deploying daemon osd.2 on smithi137 2024-03-04T06:46:56.323 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-mon[91314]: osdmap e353: 8 total, 8 up, 8 in 2024-03-04T06:46:56.323 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:56.323 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:56.323 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:56.323 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:56.230+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:56.414 INFO:tasks.rados.rados.0.smithi137.stdout:1469: expect (ObjNum 484 snap 138 seq_num 484) 2024-03-04T06:46:56.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:56 smithi203 ceph-mon[85573]: Upgrade: Updating osd.2 2024-03-04T06:46:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:56 smithi203 ceph-mon[85573]: Deploying daemon osd.2 on smithi137 2024-03-04T06:46:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:56 smithi203 ceph-mon[85573]: osdmap e353: 8 total, 8 up, 8 in 2024-03-04T06:46:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:56 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:56.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:56 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:56.645 INFO:tasks.rados.rados.0.smithi137.stdout:1466: finishing copy_from racing read to smithi13777483-7 2024-03-04T06:46:56.645 INFO:tasks.rados.rados.0.smithi137.stdout:1466: finishing copy_from to smithi13777483-7 2024-03-04T06:46:56.645 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 710 (ObjNum 446 snap 131 seq_num 446) dirty exists 2024-03-04T06:46:56.646 INFO:tasks.rados.rados.0.smithi137.stdout:1472: finishing write tid 1 to smithi13777483-20 2024-03-04T06:46:56.646 INFO:tasks.rados.rados.0.smithi137.stdout:1472: finishing write tid 2 to smithi13777483-20 2024-03-04T06:46:56.646 INFO:tasks.rados.rados.0.smithi137.stdout:1472: finishing write tid 3 to smithi13777483-20 2024-03-04T06:46:56.646 INFO:tasks.rados.rados.0.smithi137.stdout:1472: finishing write tid 4 to smithi13777483-20 2024-03-04T06:46:56.646 INFO:tasks.rados.rados.0.smithi137.stdout:1472: oid 20 updating version 0 to 650 2024-03-04T06:46:56.646 INFO:tasks.rados.rados.0.smithi137.stdout:1472: oid 20 version 650 is already newer than 648 2024-03-04T06:46:56.646 INFO:tasks.rados.rados.0.smithi137.stdout:1472: oid 20 version 650 is already newer than 649 2024-03-04T06:46:56.646 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 650 (ObjNum 487 snap 139 seq_num 487) dirty exists 2024-03-04T06:46:56.646 INFO:tasks.rados.rados.0.smithi137.stdout:1472: left oid 20 (ObjNum 487 snap 139 seq_num 487) 2024-03-04T06:46:56.646 INFO:tasks.rados.rados.0.smithi137.stdout:1471: expect (ObjNum 427 snap 127 seq_num 427) 2024-03-04T06:46:57.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:56.591+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:57.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:56.591+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:57.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:56.591+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:57.237 INFO:tasks.rados.rados.0.smithi137.stdout:1465: done (5 left) 2024-03-04T06:46:57.237 INFO:tasks.rados.rados.0.smithi137.stdout:1466: done (4 left) 2024-03-04T06:46:57.237 INFO:tasks.rados.rados.0.smithi137.stdout:1469: done (3 left) 2024-03-04T06:46:57.237 INFO:tasks.rados.rados.0.smithi137.stdout:1471: done (2 left) 2024-03-04T06:46:57.237 INFO:tasks.rados.rados.0.smithi137.stdout:1472: done (1 left) 2024-03-04T06:46:57.238 INFO:tasks.rados.rados.0.smithi137.stdout:1474: done (0 left) 2024-03-04T06:46:57.238 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 140 2024-03-04T06:46:57.238 INFO:tasks.rados.rados.0.smithi137.stdout:1475: seq_num 488 ranges {1998848=581632,2580480=401408} 2024-03-04T06:46:57.251 INFO:tasks.rados.rados.0.smithi137.stdout:1475: writing smithi13777483-42 from 1998848 to 2580480 tid 1 2024-03-04T06:46:57.253 INFO:tasks.rados.rados.0.smithi137.stdout:1475: writing smithi13777483-42 from 2580480 to 2981888 tid 2 2024-03-04T06:46:57.253 INFO:tasks.rados.rados.0.smithi137.stdout:1476: copy_from oid 22 from oid 18 current snap is 140 2024-03-04T06:46:57.253 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 140 2024-03-04T06:46:57.254 INFO:tasks.rados.rados.0.smithi137.stdout:1477: seq_num 489 ranges {0=598016,598016=401408} 2024-03-04T06:46:57.257 INFO:tasks.rados.rados.0.smithi137.stdout:1477: writing smithi13777483-21 from 0 to 598016 tid 1 2024-03-04T06:46:57.260 INFO:tasks.rados.rados.0.smithi137.stdout:1477: writing smithi13777483-21 from 598016 to 999424 tid 2 2024-03-04T06:46:57.260 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 140 2024-03-04T06:46:57.260 INFO:tasks.rados.rados.0.smithi137.stdout:1478: seq_num 490 ranges {7675904=614400,8290304=401408} 2024-03-04T06:46:57.304 INFO:tasks.rados.rados.0.smithi137.stdout:1478: writing smithi13777483-15 from 7675904 to 8290304 tid 1 2024-03-04T06:46:57.307 INFO:tasks.rados.rados.0.smithi137.stdout:1478: writing smithi13777483-15 from 8290304 to 8691712 tid 2 2024-03-04T06:46:57.307 INFO:tasks.rados.rados.0.smithi137.stdout:1479: read oid 38 snap -1 2024-03-04T06:46:57.307 INFO:tasks.rados.rados.0.smithi137.stdout:1479: expect deleted 2024-03-04T06:46:57.307 INFO:tasks.rados.rados.0.smithi137.stdout:1480: snap_remove snap 139 2024-03-04T06:46:57.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:57 smithi137 ceph-mon[88869]: osdmap e354: 8 total, 8 up, 8 in 2024-03-04T06:46:57.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:57.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:57 smithi137 ceph-mon[88869]: pgmap v204: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 132 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 2.5 MiB/s wr, 4 op/s 2024-03-04T06:46:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:57 smithi137 ceph-mon[91314]: osdmap e354: 8 total, 8 up, 8 in 2024-03-04T06:46:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:57 smithi137 ceph-mon[91314]: pgmap v204: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 132 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 2.5 MiB/s wr, 4 op/s 2024-03-04T06:46:57.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:57.236+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:57.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:57.236+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:57.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:57.238+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:57.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:57 smithi203 ceph-mon[85573]: osdmap e354: 8 total, 8 up, 8 in 2024-03-04T06:46:57.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:57.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:57 smithi203 ceph-mon[85573]: pgmap v204: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 132 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 2.5 MiB/s wr, 4 op/s 2024-03-04T06:46:58.249 INFO:tasks.rados.rados.0.smithi137.stdout:1480: done (5 left) 2024-03-04T06:46:58.249 INFO:tasks.rados.rados.0.smithi137.stdout:1481: rmattr oid 48 current snap is 140 2024-03-04T06:46:58.249 INFO:tasks.rados.rados.0.smithi137.stdout:1475: finishing write tid 1 to smithi13777483-42 2024-03-04T06:46:58.249 INFO:tasks.rados.rados.0.smithi137.stdout:1475: finishing write tid 2 to smithi13777483-42 2024-03-04T06:46:58.249 INFO:tasks.rados.rados.0.smithi137.stdout:1475: finishing write tid 3 to smithi13777483-42 2024-03-04T06:46:58.249 INFO:tasks.rados.rados.0.smithi137.stdout:1477: finishing write tid 1 to smithi13777483-21 2024-03-04T06:46:58.249 INFO:tasks.rados.rados.0.smithi137.stdout:1477: finishing write tid 2 to smithi13777483-21 2024-03-04T06:46:58.249 INFO:tasks.rados.rados.0.smithi137.stdout:1477: finishing write tid 3 to smithi13777483-21 2024-03-04T06:46:58.249 INFO:tasks.rados.rados.0.smithi137.stdout:1475: finishing write tid 4 to smithi13777483-42 2024-03-04T06:46:58.249 INFO:tasks.rados.rados.0.smithi137.stdout:1475: oid 42 updating version 0 to 1093 2024-03-04T06:46:58.249 INFO:tasks.rados.rados.0.smithi137.stdout:1475: oid 42 updating version 1093 to 1094 2024-03-04T06:46:58.249 INFO:tasks.rados.rados.0.smithi137.stdout:1475: oid 42 updating version 1094 to 1095 2024-03-04T06:46:58.249 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 1095 (ObjNum 488 snap 140 seq_num 488) dirty exists 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1475: left oid 42 (ObjNum 488 snap 140 seq_num 488) 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1477: finishing write tid 4 to smithi13777483-21 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1477: oid 21 updating version 0 to 949 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1477: oid 21 updating version 949 to 951 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1477: oid 21 version 951 is already newer than 950 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 951 (ObjNum 489 snap 140 seq_num 489) dirty exists 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1477: left oid 21 (ObjNum 489 snap 140 seq_num 489) 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1476: finishing copy_from racing read to smithi13777483-22 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1475: done (5 left) 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1477: done (4 left) 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1482: rollback oid 3 current snap is 140 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1476: finishing copy_from to smithi13777483-22 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 614 (ObjNum 396 snap 119 seq_num 396) dirty exists 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1478: finishing write tid 1 to smithi13777483-15 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1478: finishing write tid 2 to smithi13777483-15 2024-03-04T06:46:58.250 INFO:tasks.rados.rados.0.smithi137.stdout:1478: finishing write tid 3 to smithi13777483-15 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1478: finishing write tid 4 to smithi13777483-15 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1478: oid 15 updating version 0 to 922 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1478: oid 15 version 922 is already newer than 921 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1478: oid 15 updating version 922 to 923 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 923 (ObjNum 490 snap 140 seq_num 490) dirty exists 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1478: left oid 15 (ObjNum 490 snap 140 seq_num 490) 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1476: done (4 left) 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1478: done (3 left) 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1479: done (2 left) 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1482: done (1 left) 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1483: rollback oid 47 current snap is 140 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1483: done (1 left) 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1484: copy_from oid 21 from oid 20 current snap is 140 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1485: read oid 6 snap -1 2024-03-04T06:46:58.251 INFO:tasks.rados.rados.0.smithi137.stdout:1485: expect deleted 2024-03-04T06:46:58.252 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 24 current snap is 140 2024-03-04T06:46:58.252 INFO:tasks.rados.rados.0.smithi137.stdout:1486: seq_num 491 ranges {40960=630784,671744=401408} 2024-03-04T06:46:58.252 INFO:tasks.rados.rados.0.smithi137.stdout:1486: writing smithi13777483-24 from 40960 to 671744 tid 1 2024-03-04T06:46:58.254 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:46:58 smithi137 systemd[1]: Stopping Ceph osd.2 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:46:58.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:58.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:58.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-mon[88869]: osdmap e355: 8 total, 8 up, 8 in 2024-03-04T06:46:58.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:58.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:58.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:58.255 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:58.255 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:58.255 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-mon[91314]: osdmap e355: 8 total, 8 up, 8 in 2024-03-04T06:46:58.255 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:58.255 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:58.255 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:58.256 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:58.246+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:58.256 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:58.247+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:46:58.256 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:58.247+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:58.256 INFO:tasks.rados.rados.0.smithi137.stdout:1486: writing smithi13777483-24 from 671744 to 1073152 tid 2 2024-03-04T06:46:58.256 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 140 2024-03-04T06:46:58.256 INFO:tasks.rados.rados.0.smithi137.stdout:1487: seq_num 492 ranges {0=647168,647168=401408} 2024-03-04T06:46:58.259 INFO:tasks.rados.rados.0.smithi137.stdout:1487: writing smithi13777483-14 from 0 to 647168 tid 1 2024-03-04T06:46:58.263 INFO:tasks.rados.rados.0.smithi137.stdout:1487: writing smithi13777483-14 from 647168 to 1048576 tid 2 2024-03-04T06:46:58.263 INFO:tasks.rados.rados.0.smithi137.stdout:1488: read oid 16 snap -1 2024-03-04T06:46:58.263 INFO:tasks.rados.rados.0.smithi137.stdout:1488: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:46:58.263 INFO:tasks.rados.rados.0.smithi137.stdout:1489: setattr oid 1 current snap is 140 2024-03-04T06:46:58.263 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 926 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:46:58.263 INFO:tasks.rados.rados.0.smithi137.stdout:1486: finishing write tid 1 to smithi13777483-24 2024-03-04T06:46:58.263 INFO:tasks.rados.rados.0.smithi137.stdout:1486: finishing write tid 2 to smithi13777483-24 2024-03-04T06:46:58.263 INFO:tasks.rados.rados.0.smithi137.stdout:1486: finishing write tid 3 to smithi13777483-24 2024-03-04T06:46:58.264 INFO:tasks.rados.rados.0.smithi137.stdout:1481: done (6 left) 2024-03-04T06:46:58.264 INFO:tasks.rados.rados.0.smithi137.stdout:1485: done (5 left) 2024-03-04T06:46:58.264 INFO:tasks.rados.rados.0.smithi137.stdout:1490: setattr oid 31 current snap is 140 2024-03-04T06:46:58.266 INFO:tasks.rados.rados.0.smithi137.stdout:1491: copy_from oid 2 from oid 27 current snap is 140 2024-03-04T06:46:58.267 INFO:tasks.rados.rados.0.smithi137.stdout:1487: finishing write tid 1 to smithi13777483-14 2024-03-04T06:46:58.267 INFO:tasks.rados.rados.0.smithi137.stdout:1487: finishing write tid 2 to smithi13777483-14 2024-03-04T06:46:58.267 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 140 2024-03-04T06:46:58.267 INFO:tasks.rados.rados.0.smithi137.stdout:1492: seq_num 493 ranges {1982464=663552,2646016=401408} 2024-03-04T06:46:58.282 INFO:tasks.rados.rados.0.smithi137.stdout:1492: writing smithi13777483-18 from 1982464 to 2646016 tid 1 2024-03-04T06:46:58.285 INFO:tasks.rados.rados.0.smithi137.stdout:1492: writing smithi13777483-18 from 2646016 to 3047424 tid 2 2024-03-04T06:46:58.285 INFO:tasks.rados.rados.0.smithi137.stdout:1493: read oid 41 snap -1 2024-03-04T06:46:58.285 INFO:tasks.rados.rados.0.smithi137.stdout:1493: expect (ObjNum 427 snap 127 seq_num 427) 2024-03-04T06:46:58.285 INFO:tasks.rados.rados.0.smithi137.stdout:1494: rmattr oid 12 current snap is 140 2024-03-04T06:46:58.285 INFO:tasks.rados.rados.0.smithi137.stdout:1494: done (9 left) 2024-03-04T06:46:58.285 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 140 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:1486: finishing write tid 4 to smithi13777483-24 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:1486: oid 24 updating version 0 to 372 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:1486: oid 24 version 372 is already newer than 371 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:1486: oid 24 version 372 is already newer than 370 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 372 (ObjNum 491 snap 140 seq_num 491) dirty exists 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:1486: left oid 24 (ObjNum 491 snap 140 seq_num 491) 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:1487: finishing write tid 3 to smithi13777483-14 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:1484: finishing copy_from racing read to smithi13777483-21 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:1484: finishing copy_from to smithi13777483-21 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 650 (ObjNum 487 snap 139 seq_num 487) dirty exists 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 927 (ObjNum 49 snap 0 seq_num 3128687152) dirty exists 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:1487: finishing write tid 4 to smithi13777483-14 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:1487: oid 14 updating version 0 to 654 2024-03-04T06:46:58.286 INFO:tasks.rados.rados.0.smithi137.stdout:1487: oid 14 updating version 654 to 655 2024-03-04T06:46:58.287 INFO:tasks.rados.rados.0.smithi137.stdout:1487: oid 14 version 655 is already newer than 653 2024-03-04T06:46:58.287 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 655 (ObjNum 492 snap 140 seq_num 492) dirty exists 2024-03-04T06:46:58.287 INFO:tasks.rados.rados.0.smithi137.stdout:1487: left oid 14 (ObjNum 492 snap 140 seq_num 492) 2024-03-04T06:46:58.287 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 733 (ObjNum 474 snap 135 seq_num 474) dirty exists 2024-03-04T06:46:58.287 INFO:tasks.rados.rados.0.smithi137.stdout:1491: finishing copy_from racing read to smithi13777483-2 2024-03-04T06:46:58.287 INFO:tasks.rados.rados.0.smithi137.stdout:1495: seq_num 494 ranges {0=679936,679936=401408} 2024-03-04T06:46:58.289 INFO:tasks.rados.rados.0.smithi137.stdout:1495: writing smithi13777483-4 from 0 to 679936 tid 1 2024-03-04T06:46:58.292 INFO:tasks.rados.rados.0.smithi137.stdout:1495: writing smithi13777483-4 from 679936 to 1081344 tid 2 2024-03-04T06:46:58.292 INFO:tasks.rados.rados.0.smithi137.stdout:1484: done (9 left) 2024-03-04T06:46:58.292 INFO:tasks.rados.rados.0.smithi137.stdout:1486: done (8 left) 2024-03-04T06:46:58.292 INFO:tasks.rados.rados.0.smithi137.stdout:1487: done (7 left) 2024-03-04T06:46:58.292 INFO:tasks.rados.rados.0.smithi137.stdout:1489: done (6 left) 2024-03-04T06:46:58.292 INFO:tasks.rados.rados.0.smithi137.stdout:1490: done (5 left) 2024-03-04T06:46:58.292 INFO:tasks.rados.rados.0.smithi137.stdout:1496: rollback oid 17 current snap is 140 2024-03-04T06:46:58.292 INFO:tasks.rados.rados.0.smithi137.stdout:1496: done (5 left) 2024-03-04T06:46:58.293 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 140 2024-03-04T06:46:58.293 INFO:tasks.rados.rados.0.smithi137.stdout:1491: finishing copy_from to smithi13777483-2 2024-03-04T06:46:58.293 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 1080 (ObjNum 472 snap 135 seq_num 472) dirty exists 2024-03-04T06:46:58.293 INFO:tasks.rados.rados.0.smithi137.stdout:1497: seq_num 495 ranges {0=696320,696320=401408} 2024-03-04T06:46:58.296 INFO:tasks.rados.rados.0.smithi137.stdout:1497: writing smithi13777483-1 from 0 to 696320 tid 1 2024-03-04T06:46:58.299 INFO:tasks.rados.rados.0.smithi137.stdout:1497: writing smithi13777483-1 from 696320 to 1097728 tid 2 2024-03-04T06:46:58.299 INFO:tasks.rados.rados.0.smithi137.stdout:1491: done (5 left) 2024-03-04T06:46:58.299 INFO:tasks.rados.rados.0.smithi137.stdout:1498: copy_from oid 21 from oid 15 current snap is 140 2024-03-04T06:46:58.299 INFO:tasks.rados.rados.0.smithi137.stdout:1492: finishing write tid 1 to smithi13777483-18 2024-03-04T06:46:58.299 INFO:tasks.rados.rados.0.smithi137.stdout:1492: finishing write tid 2 to smithi13777483-18 2024-03-04T06:46:58.300 INFO:tasks.rados.rados.0.smithi137.stdout:1488: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:46:58.521 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:58.253+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:58.521 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[53055]: 2024-03-04T06:46:58.309+0000 7fc3a6568700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:46:58.521 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[53055]: 2024-03-04T06:46:58.309+0000 7fc3a6568700 -1 osd.2 356 *** Got signal Terminated *** 2024-03-04T06:46:58.522 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:46:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[53055]: 2024-03-04T06:46:58.309+0000 7fc3a6568700 -1 osd.2 356 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T06:46:58.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:58.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:58.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:58 smithi203 ceph-mon[85573]: osdmap e355: 8 total, 8 up, 8 in 2024-03-04T06:46:58.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:58.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:58.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:58.784 INFO:tasks.rados.rados.0.smithi137.stdout:1495: finishing write tid 1 to smithi13777483-4 2024-03-04T06:46:58.784 INFO:tasks.rados.rados.0.smithi137.stdout:1495: finishing write tid 2 to smithi13777483-4 2024-03-04T06:46:58.784 INFO:tasks.rados.rados.0.smithi137.stdout:1495: finishing write tid 3 to smithi13777483-4 2024-03-04T06:46:58.784 INFO:tasks.rados.rados.0.smithi137.stdout:1492: finishing write tid 3 to smithi13777483-18 2024-03-04T06:46:58.784 INFO:tasks.rados.rados.0.smithi137.stdout:1488: done (5 left) 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 140 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:1495: finishing write tid 4 to smithi13777483-4 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:1495: oid 4 updating version 0 to 145 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:1495: oid 4 updating version 145 to 146 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:1495: oid 4 version 146 is already newer than 144 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 146 (ObjNum 494 snap 140 seq_num 494) dirty exists 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:1495: left oid 4 (ObjNum 494 snap 140 seq_num 494) 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:1492: finishing write tid 4 to smithi13777483-18 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:1492: oid 18 updating version 0 to 617 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:1492: oid 18 updating version 617 to 618 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:1492: oid 18 updating version 618 to 619 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 619 (ObjNum 493 snap 140 seq_num 493) dirty exists 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:1492: left oid 18 (ObjNum 493 snap 140 seq_num 493) 2024-03-04T06:46:58.785 INFO:tasks.rados.rados.0.smithi137.stdout:1499: seq_num 496 ranges {0=712704,712704=401408} 2024-03-04T06:46:58.787 INFO:tasks.rados.rados.0.smithi137.stdout:1499: writing smithi13777483-30 from 0 to 712704 tid 1 2024-03-04T06:46:58.790 INFO:tasks.rados.rados.0.smithi137.stdout:1499: writing smithi13777483-30 from 712704 to 1114112 tid 2 2024-03-04T06:46:58.790 INFO:tasks.rados.rados.0.smithi137.stdout:1492: done (5 left) 2024-03-04T06:46:58.790 INFO:tasks.rados.rados.0.smithi137.stdout:1495: done (4 left) 2024-03-04T06:46:58.790 INFO:tasks.rados.rados.0.smithi137.stdout:1500: snap_create 2024-03-04T06:46:58.790 INFO:tasks.rados.rados.0.smithi137.stdout:1497: finishing write tid 1 to smithi13777483-1 2024-03-04T06:46:58.790 INFO:tasks.rados.rados.0.smithi137.stdout:1497: finishing write tid 2 to smithi13777483-1 2024-03-04T06:46:58.790 INFO:tasks.rados.rados.0.smithi137.stdout:1497: finishing write tid 3 to smithi13777483-1 2024-03-04T06:46:58.791 INFO:tasks.rados.rados.0.smithi137.stdout:1497: finishing write tid 4 to smithi13777483-1 2024-03-04T06:46:58.791 INFO:tasks.rados.rados.0.smithi137.stdout:1497: oid 1 updating version 0 to 1081 2024-03-04T06:46:58.791 INFO:tasks.rados.rados.0.smithi137.stdout:1497: oid 1 updating version 1081 to 1082 2024-03-04T06:46:58.791 INFO:tasks.rados.rados.0.smithi137.stdout:1497: oid 1 updating version 1082 to 1083 2024-03-04T06:46:58.791 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 1083 (ObjNum 495 snap 140 seq_num 495) dirty exists 2024-03-04T06:46:58.791 INFO:tasks.rados.rados.0.smithi137.stdout:1497: left oid 1 (ObjNum 495 snap 140 seq_num 495) 2024-03-04T06:46:58.791 INFO:tasks.rados.rados.0.smithi137.stdout:1493: expect (ObjNum 427 snap 127 seq_num 427) 2024-03-04T06:46:58.971 INFO:tasks.rados.rados.0.smithi137.stdout:1498: finishing copy_from racing read to smithi13777483-21 2024-03-04T06:46:58.971 INFO:tasks.rados.rados.0.smithi137.stdout:1498: finishing copy_from to smithi13777483-21 2024-03-04T06:46:58.971 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 923 (ObjNum 490 snap 140 seq_num 490) dirty exists 2024-03-04T06:46:58.971 INFO:tasks.rados.rados.0.smithi137.stdout:1499: finishing write tid 1 to smithi13777483-30 2024-03-04T06:46:58.971 INFO:tasks.rados.rados.0.smithi137.stdout:1499: finishing write tid 2 to smithi13777483-30 2024-03-04T06:46:58.971 INFO:tasks.rados.rados.0.smithi137.stdout:1499: finishing write tid 3 to smithi13777483-30 2024-03-04T06:46:58.971 INFO:tasks.rados.rados.0.smithi137.stdout:1499: finishing write tid 4 to smithi13777483-30 2024-03-04T06:46:58.971 INFO:tasks.rados.rados.0.smithi137.stdout:1499: oid 30 updating version 0 to 1048 2024-03-04T06:46:58.972 INFO:tasks.rados.rados.0.smithi137.stdout:1499: oid 30 version 1048 is already newer than 1047 2024-03-04T06:46:58.972 INFO:tasks.rados.rados.0.smithi137.stdout:1499: oid 30 version 1048 is already newer than 1046 2024-03-04T06:46:58.972 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 1048 (ObjNum 496 snap 140 seq_num 496) dirty exists 2024-03-04T06:46:58.972 INFO:tasks.rados.rados.0.smithi137.stdout:1499: left oid 30 (ObjNum 496 snap 140 seq_num 496) 2024-03-04T06:46:59.252 INFO:tasks.rados.rados.0.smithi137.stdout:1493: done (4 left) 2024-03-04T06:46:59.252 INFO:tasks.rados.rados.0.smithi137.stdout:1497: done (3 left) 2024-03-04T06:46:59.253 INFO:tasks.rados.rados.0.smithi137.stdout:1498: done (2 left) 2024-03-04T06:46:59.253 INFO:tasks.rados.rados.0.smithi137.stdout:1499: done (1 left) 2024-03-04T06:46:59.253 INFO:tasks.rados.rados.0.smithi137.stdout:1500: done (0 left) 2024-03-04T06:46:59.253 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 141 2024-03-04T06:46:59.253 INFO:tasks.rados.rados.0.smithi137.stdout:1501: seq_num 497 ranges {3235840=729088,3964928=401408} 2024-03-04T06:46:59.275 INFO:tasks.rados.rados.0.smithi137.stdout:1501: writing smithi13777483-47 from 3235840 to 3964928 tid 1 2024-03-04T06:46:59.279 INFO:tasks.rados.rados.0.smithi137.stdout:1501: writing smithi13777483-47 from 3964928 to 4366336 tid 2 2024-03-04T06:46:59.279 INFO:tasks.rados.rados.0.smithi137.stdout:1502: read oid 37 snap -1 2024-03-04T06:46:59.279 INFO:tasks.rados.rados.0.smithi137.stdout:1502: expect deleted 2024-03-04T06:46:59.279 INFO:tasks.rados.rados.0.smithi137.stdout:1503: snap_create 2024-03-04T06:46:59.282 INFO:tasks.rados.rados.0.smithi137.stdout:1501: finishing write tid 1 to smithi13777483-47 2024-03-04T06:46:59.282 INFO:tasks.rados.rados.0.smithi137.stdout:1501: finishing write tid 2 to smithi13777483-47 2024-03-04T06:46:59.282 INFO:tasks.rados.rados.0.smithi137.stdout:1501: finishing write tid 3 to smithi13777483-47 2024-03-04T06:46:59.284 INFO:tasks.rados.rados.0.smithi137.stdout:1501: finishing write tid 4 to smithi13777483-47 2024-03-04T06:46:59.284 INFO:tasks.rados.rados.0.smithi137.stdout:1501: oid 47 updating version 0 to 956 2024-03-04T06:46:59.284 INFO:tasks.rados.rados.0.smithi137.stdout:1501: oid 47 version 956 is already newer than 955 2024-03-04T06:46:59.284 INFO:tasks.rados.rados.0.smithi137.stdout:1501: oid 47 updating version 956 to 957 2024-03-04T06:46:59.284 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 957 (ObjNum 497 snap 141 seq_num 497) dirty exists 2024-03-04T06:46:59.284 INFO:tasks.rados.rados.0.smithi137.stdout:1501: left oid 47 (ObjNum 497 snap 141 seq_num 497) 2024-03-04T06:46:59.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-mon[91314]: osdmap e356: 8 total, 8 up, 8 in 2024-03-04T06:46:59.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:59.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:59.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:59.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-mon[91314]: osd.2 marked itself down and dead 2024-03-04T06:46:59.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-mon[91314]: pgmap v207: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 133 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 244 KiB/s wr, 5 op/s 2024-03-04T06:46:59.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:59.262+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:59.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:46:59.262+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:59.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-mon[88869]: osdmap e356: 8 total, 8 up, 8 in 2024-03-04T06:46:59.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:59.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:59.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:59.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-mon[88869]: osd.2 marked itself down and dead 2024-03-04T06:46:59.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-mon[88869]: pgmap v207: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 133 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 244 KiB/s wr, 5 op/s 2024-03-04T06:46:59.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:46:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:46:59.259+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:59 smithi203 ceph-mon[85573]: osdmap e356: 8 total, 8 up, 8 in 2024-03-04T06:46:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:46:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:46:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:46:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:59 smithi203 ceph-mon[85573]: osd.2 marked itself down and dead 2024-03-04T06:46:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:46:59 smithi203 ceph-mon[85573]: pgmap v207: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 133 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 244 KiB/s wr, 5 op/s 2024-03-04T06:47:00.043 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:46:59 smithi137 podman[106384]: 2024-03-04 06:46:59.733930718 +0000 UTC m=+1.557637759 container died b247adf81a73e85fd908bc270ae15eabab7fa0ebed3a049137ec63d15a08af40 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=reef-5cc7a76) 2024-03-04T06:47:00.261 INFO:tasks.rados.rados.0.smithi137.stdout:1501: done (2 left) 2024-03-04T06:47:00.261 INFO:tasks.rados.rados.0.smithi137.stdout:1502: done (1 left) 2024-03-04T06:47:00.261 INFO:tasks.rados.rados.0.smithi137.stdout:1503: done (0 left) 2024-03-04T06:47:00.261 INFO:tasks.rados.rados.0.smithi137.stdout:1504: snap_create 2024-03-04T06:47:00.543 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:00 smithi137 podman[106384]: 2024-03-04 06:47:00.352824122 +0000 UTC m=+2.176531159 container cleanup b247adf81a73e85fd908bc270ae15eabab7fa0ebed3a049137ec63d15a08af40 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-5cc7a76, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:47:00.543 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:00 smithi137 bash[106384]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2 2024-03-04T06:47:00.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-mon[88869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:47:00.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-mon[88869]: osdmap e357: 8 total, 7 up, 8 in 2024-03-04T06:47:00.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:00.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:00.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:00.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-mon[91314]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:47:00.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-mon[91314]: osdmap e357: 8 total, 7 up, 8 in 2024-03-04T06:47:00.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:00.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:00.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:00.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:00.263+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:00.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:00.263+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:00.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:00.263+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:00.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:00.264+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:00 smithi203 ceph-mon[85573]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:47:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:00 smithi203 ceph-mon[85573]: osdmap e357: 8 total, 7 up, 8 in 2024-03-04T06:47:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:00.903 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:00 smithi137 podman[106413]: 2024-03-04 06:47:00.568981601 +0000 UTC m=+0.830080730 container remove b247adf81a73e85fd908bc270ae15eabab7fa0ebed3a049137ec63d15a08af40 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=reef-5cc7a76, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:47:01.197 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:00 smithi137 podman[106504]: 2024-03-04 06:47:00.807125876 +0000 UTC m=+0.017813278 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:47:01.197 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:00 smithi137 podman[106504]: 2024-03-04 06:47:00.936709893 +0000 UTC m=+0.147397290 container create 336c774f909d0118fa23c651f535575505e92a8c8fb5e9dc76508641e435e08a (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-03-04T06:47:01.197 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:01 smithi137 podman[106504]: 2024-03-04 06:47:01.139308383 +0000 UTC m=+0.349995780 container init 336c774f909d0118fa23c651f535575505e92a8c8fb5e9dc76508641e435e08a (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-03-04T06:47:01.198 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:01 smithi137 podman[106504]: 2024-03-04 06:47:01.142605836 +0000 UTC m=+0.353293234 container start 336c774f909d0118fa23c651f535575505e92a8c8fb5e9dc76508641e435e08a (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-04T06:47:01.198 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:01 smithi137 podman[106504]: 2024-03-04 06:47:01.197521639 +0000 UTC m=+0.408209038 container attach 336c774f909d0118fa23c651f535575505e92a8c8fb5e9dc76508641e435e08a (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:47:01.266 INFO:tasks.rados.rados.0.smithi137.stdout:1504: done (0 left) 2024-03-04T06:47:01.266 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 143 2024-03-04T06:47:01.266 INFO:tasks.rados.rados.0.smithi137.stdout:1505: seq_num 498 ranges {712704=745472,1458176=401408} 2024-03-04T06:47:01.274 INFO:tasks.rados.rados.0.smithi137.stdout:1505: writing smithi13777483-27 from 712704 to 1458176 tid 1 2024-03-04T06:47:01.276 INFO:tasks.rados.rados.0.smithi137.stdout:1505: writing smithi13777483-27 from 1458176 to 1859584 tid 2 2024-03-04T06:47:01.277 INFO:tasks.rados.rados.0.smithi137.stdout:1506: setattr oid 26 current snap is 143 2024-03-04T06:47:01.278 INFO:tasks.rados.rados.0.smithi137.stdout:1507: read oid 1 snap -1 2024-03-04T06:47:01.278 INFO:tasks.rados.rados.0.smithi137.stdout:1507: expect (ObjNum 495 snap 140 seq_num 495) 2024-03-04T06:47:01.278 INFO:tasks.rados.rados.0.smithi137.stdout:1508: snap_remove snap 141 2024-03-04T06:47:01.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:01.281+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:01.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:01.265+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:01.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:01.265+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:01.544 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:01 smithi137 podman[106504]: 2024-03-04 06:47:01.438455818 +0000 UTC m=+0.649143216 container died 336c774f909d0118fa23c651f535575505e92a8c8fb5e9dc76508641e435e08a (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T06:47:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:01 smithi137 ceph-mon[88869]: osdmap e358: 8 total, 7 up, 8 in 2024-03-04T06:47:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:01.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:01 smithi137 ceph-mon[88869]: pgmap v210: 121 pgs: 27 peering, 3 stale+active+clean, 3 active+clean+snaptrim_error, 88 active+clean; 145 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 4.5 MiB/s wr, 33 op/s 2024-03-04T06:47:01.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:01 smithi137 ceph-mon[91314]: osdmap e358: 8 total, 7 up, 8 in 2024-03-04T06:47:01.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:01.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:01.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:01.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:01 smithi137 ceph-mon[91314]: pgmap v210: 121 pgs: 27 peering, 3 stale+active+clean, 3 active+clean+snaptrim_error, 88 active+clean; 145 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 4.5 MiB/s wr, 33 op/s 2024-03-04T06:47:01.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:01 smithi203 ceph-mon[85573]: osdmap e358: 8 total, 7 up, 8 in 2024-03-04T06:47:01.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:01.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:01.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:01.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:01 smithi203 ceph-mon[85573]: pgmap v210: 121 pgs: 27 peering, 3 stale+active+clean, 3 active+clean+snaptrim_error, 88 active+clean; 145 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 4.5 MiB/s wr, 33 op/s 2024-03-04T06:47:02.275 INFO:tasks.rados.rados.0.smithi137.stdout:1508: done (3 left) 2024-03-04T06:47:02.275 INFO:tasks.rados.rados.0.smithi137.stdout:1509: delete oid 20 current snap is 143 2024-03-04T06:47:02.275 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 621 (ObjNum 477 snap 135 seq_num 477) dirty exists 2024-03-04T06:47:02.275 INFO:tasks.rados.rados.0.smithi137.stdout:1505: finishing write tid 1 to smithi13777483-27 2024-03-04T06:47:02.276 INFO:tasks.rados.rados.0.smithi137.stdout:1505: finishing write tid 2 to smithi13777483-27 2024-03-04T06:47:02.276 INFO:tasks.rados.rados.0.smithi137.stdout:1505: finishing write tid 3 to smithi13777483-27 2024-03-04T06:47:02.276 INFO:tasks.rados.rados.0.smithi137.stdout:1505: finishing write tid 4 to smithi13777483-27 2024-03-04T06:47:02.276 INFO:tasks.rados.rados.0.smithi137.stdout:1505: oid 27 updating version 0 to 1100 2024-03-04T06:47:02.276 INFO:tasks.rados.rados.0.smithi137.stdout:1505: oid 27 updating version 1100 to 1101 2024-03-04T06:47:02.276 INFO:tasks.rados.rados.0.smithi137.stdout:1505: oid 27 version 1101 is already newer than 1099 2024-03-04T06:47:02.276 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 1101 (ObjNum 498 snap 143 seq_num 498) dirty exists 2024-03-04T06:47:02.276 INFO:tasks.rados.rados.0.smithi137.stdout:1505: left oid 27 (ObjNum 498 snap 143 seq_num 498) 2024-03-04T06:47:02.276 INFO:tasks.rados.rados.0.smithi137.stdout:1507: expect (ObjNum 495 snap 140 seq_num 495) 2024-03-04T06:47:02.306 INFO:tasks.rados.rados.0.smithi137.stdout:1505: done (3 left) 2024-03-04T06:47:02.306 INFO:tasks.rados.rados.0.smithi137.stdout:1506: done (2 left) 2024-03-04T06:47:02.306 INFO:tasks.rados.rados.0.smithi137.stdout:1507: done (1 left) 2024-03-04T06:47:02.306 INFO:tasks.rados.rados.0.smithi137.stdout:1509: done (0 left) 2024-03-04T06:47:02.307 INFO:tasks.rados.rados.0.smithi137.stdout:1510: delete oid 40 current snap is 143 2024-03-04T06:47:02.309 INFO:tasks.rados.rados.0.smithi137.stdout:1510: done (0 left) 2024-03-04T06:47:02.309 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 143 2024-03-04T06:47:02.309 INFO:tasks.rados.rados.0.smithi137.stdout:1511: seq_num 501 ranges {8691712=794624,9486336=401408} 2024-03-04T06:47:02.360 INFO:tasks.rados.rados.0.smithi137.stdout:1511: writing smithi13777483-15 from 8691712 to 9486336 tid 1 2024-03-04T06:47:02.363 INFO:tasks.rados.rados.0.smithi137.stdout:1511: writing smithi13777483-15 from 9486336 to 9887744 tid 2 2024-03-04T06:47:02.363 INFO:tasks.rados.rados.0.smithi137.stdout:1512: delete oid 41 current snap is 143 2024-03-04T06:47:02.366 INFO:tasks.rados.rados.0.smithi137.stdout:1512: done (1 left) 2024-03-04T06:47:02.366 INFO:tasks.rados.rados.0.smithi137.stdout:1513: read oid 43 snap -1 2024-03-04T06:47:02.366 INFO:tasks.rados.rados.0.smithi137.stdout:1513: expect (ObjNum 369 snap 112 seq_num 369) 2024-03-04T06:47:02.366 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 143 2024-03-04T06:47:02.366 INFO:tasks.rados.rados.0.smithi137.stdout:1514: seq_num 503 ranges {794624=425984,1220608=704512,1925120=98304} 2024-03-04T06:47:02.373 INFO:tasks.rados.rados.0.smithi137.stdout:1514: writing smithi13777483-26 from 794624 to 1220608 tid 1 2024-03-04T06:47:02.377 INFO:tasks.rados.rados.0.smithi137.stdout:1514: writing smithi13777483-26 from 1220608 to 1925120 tid 2 2024-03-04T06:47:02.378 INFO:tasks.rados.rados.0.smithi137.stdout:1514: writing smithi13777483-26 from 1925120 to 2023424 tid 3 2024-03-04T06:47:02.378 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 29 current snap is 143 2024-03-04T06:47:02.378 INFO:tasks.rados.rados.0.smithi137.stdout:1511: finishing write tid 1 to smithi13777483-15 2024-03-04T06:47:02.378 INFO:tasks.rados.rados.0.smithi137.stdout:1515: seq_num 504 ranges {0=450560,450560=589824,1040384=212992} 2024-03-04T06:47:02.380 INFO:tasks.rados.rados.0.smithi137.stdout:1515: writing smithi13777483-29 from 0 to 450560 tid 1 2024-03-04T06:47:02.384 INFO:tasks.rados.rados.0.smithi137.stdout:1515: writing smithi13777483-29 from 450560 to 1040384 tid 2 2024-03-04T06:47:02.385 INFO:tasks.rados.rados.0.smithi137.stdout:1515: writing smithi13777483-29 from 1040384 to 1253376 tid 3 2024-03-04T06:47:02.385 INFO:tasks.rados.rados.0.smithi137.stdout:1516: read oid 47 snap -1 2024-03-04T06:47:02.385 INFO:tasks.rados.rados.0.smithi137.stdout:1516: expect (ObjNum 497 snap 141 seq_num 497) 2024-03-04T06:47:02.386 INFO:tasks.rados.rados.0.smithi137.stdout:1511: finishing write tid 2 to smithi13777483-15 2024-03-04T06:47:02.386 INFO:tasks.rados.rados.0.smithi137.stdout:1511: finishing write tid 3 to smithi13777483-15 2024-03-04T06:47:02.386 INFO:tasks.rados.rados.0.smithi137.stdout:1511: finishing write tid 4 to smithi13777483-15 2024-03-04T06:47:02.386 INFO:tasks.rados.rados.0.smithi137.stdout:1511: oid 15 updating version 0 to 930 2024-03-04T06:47:02.386 INFO:tasks.rados.rados.0.smithi137.stdout:1511: oid 15 updating version 930 to 932 2024-03-04T06:47:02.386 INFO:tasks.rados.rados.0.smithi137.stdout:1511: oid 15 version 932 is already newer than 931 2024-03-04T06:47:02.386 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 932 (ObjNum 501 snap 143 seq_num 501) dirty exists 2024-03-04T06:47:02.386 INFO:tasks.rados.rados.0.smithi137.stdout:1511: left oid 15 (ObjNum 501 snap 143 seq_num 501) 2024-03-04T06:47:02.386 INFO:tasks.rados.rados.0.smithi137.stdout:1514: finishing write tid 1 to smithi13777483-26 2024-03-04T06:47:02.386 INFO:tasks.rados.rados.0.smithi137.stdout:1513: expect (ObjNum 369 snap 112 seq_num 369) 2024-03-04T06:47:02.483 INFO:tasks.rados.rados.0.smithi137.stdout:1514: finishing write tid 2 to smithi13777483-26 2024-03-04T06:47:02.483 INFO:tasks.rados.rados.0.smithi137.stdout:1514: finishing write tid 3 to smithi13777483-26 2024-03-04T06:47:02.483 INFO:tasks.rados.rados.0.smithi137.stdout:1517: read oid 48 snap -1 2024-03-04T06:47:02.483 INFO:tasks.rados.rados.0.smithi137.stdout:1517: expect (ObjNum 422 snap 126 seq_num 422) 2024-03-04T06:47:02.484 INFO:tasks.rados.rados.0.smithi137.stdout:1511: done (5 left) 2024-03-04T06:47:02.484 INFO:tasks.rados.rados.0.smithi137.stdout:1513: done (4 left) 2024-03-04T06:47:02.484 INFO:tasks.rados.rados.0.smithi137.stdout:1518: snap_create 2024-03-04T06:47:02.484 INFO:tasks.rados.rados.0.smithi137.stdout:1514: finishing write tid 4 to smithi13777483-26 2024-03-04T06:47:02.484 INFO:tasks.rados.rados.0.smithi137.stdout:1515: finishing write tid 1 to smithi13777483-29 2024-03-04T06:47:02.484 INFO:tasks.rados.rados.0.smithi137.stdout:1514: finishing write tid 5 to smithi13777483-26 2024-03-04T06:47:02.484 INFO:tasks.rados.rados.0.smithi137.stdout:1514: oid 26 updating version 0 to 625 2024-03-04T06:47:02.484 INFO:tasks.rados.rados.0.smithi137.stdout:1514: oid 26 version 625 is already newer than 624 2024-03-04T06:47:02.484 INFO:tasks.rados.rados.0.smithi137.stdout:1514: oid 26 version 625 is already newer than 622 2024-03-04T06:47:02.484 INFO:tasks.rados.rados.0.smithi137.stdout:1514: oid 26 version 625 is already newer than 623 2024-03-04T06:47:02.484 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 625 (ObjNum 503 snap 143 seq_num 503) dirty exists 2024-03-04T06:47:02.484 INFO:tasks.rados.rados.0.smithi137.stdout:1514: left oid 26 (ObjNum 503 snap 143 seq_num 503) 2024-03-04T06:47:02.484 INFO:tasks.rados.rados.0.smithi137.stdout:1515: finishing write tid 2 to smithi13777483-29 2024-03-04T06:47:02.485 INFO:tasks.rados.rados.0.smithi137.stdout:1515: finishing write tid 3 to smithi13777483-29 2024-03-04T06:47:02.485 INFO:tasks.rados.rados.0.smithi137.stdout:1515: finishing write tid 4 to smithi13777483-29 2024-03-04T06:47:02.485 INFO:tasks.rados.rados.0.smithi137.stdout:1515: finishing write tid 5 to smithi13777483-29 2024-03-04T06:47:02.485 INFO:tasks.rados.rados.0.smithi137.stdout:1515: oid 29 updating version 0 to 627 2024-03-04T06:47:02.485 INFO:tasks.rados.rados.0.smithi137.stdout:1515: oid 29 updating version 627 to 628 2024-03-04T06:47:02.485 INFO:tasks.rados.rados.0.smithi137.stdout:1515: oid 29 version 628 is already newer than 626 2024-03-04T06:47:02.485 INFO:tasks.rados.rados.0.smithi137.stdout:1515: oid 29 updating version 628 to 629 2024-03-04T06:47:02.485 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 629 (ObjNum 504 snap 143 seq_num 504) dirty exists 2024-03-04T06:47:02.485 INFO:tasks.rados.rados.0.smithi137.stdout:1515: left oid 29 (ObjNum 504 snap 143 seq_num 504) 2024-03-04T06:47:02.485 INFO:tasks.rados.rados.0.smithi137.stdout:1516: expect (ObjNum 497 snap 141 seq_num 497) 2024-03-04T06:47:02.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-mon[88869]: Health check failed: Reduced data availability: 6 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2024-03-04T06:47:02.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-mon[88869]: osdmap e359: 8 total, 7 up, 8 in 2024-03-04T06:47:02.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:02.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:02.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:02.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-mon[91314]: Health check failed: Reduced data availability: 6 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2024-03-04T06:47:02.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-mon[91314]: osdmap e359: 8 total, 7 up, 8 in 2024-03-04T06:47:02.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:02.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:02.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:02.544 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:02 smithi137 podman[106529]: 2024-03-04 06:47:02.143532233 +0000 UTC m=+0.700010725 container remove 336c774f909d0118fa23c651f535575505e92a8c8fb5e9dc76508641e435e08a (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T06:47:02.544 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:02 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.2.service: Deactivated successfully. 2024-03-04T06:47:02.544 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:02 smithi137 systemd[1]: Stopped Ceph osd.2 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:47:02.544 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:02 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.2.service: Consumed 15.122s CPU time. 2024-03-04T06:47:02.544 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:02 smithi137 systemd[1]: Starting Ceph osd.2 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:47:02.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:02.309+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:02.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:02.309+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:02.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:02.309+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:02.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:02.338+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:02.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:02 smithi203 ceph-mon[85573]: Health check failed: Reduced data availability: 6 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2024-03-04T06:47:02.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:02 smithi203 ceph-mon[85573]: osdmap e359: 8 total, 7 up, 8 in 2024-03-04T06:47:02.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:02.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:02.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:02.677 INFO:tasks.rados.rados.0.smithi137.stdout:1517: expect (ObjNum 422 snap 126 seq_num 422) 2024-03-04T06:47:02.863 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:02 smithi137 podman[106631]: 2024-03-04 06:47:02.49577963 +0000 UTC m=+0.019064702 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:47:02.864 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:02 smithi137 podman[106631]: 2024-03-04 06:47:02.602953544 +0000 UTC m=+0.126238611 container create d89a181efe41f46eb61a6aa70f371bf41a310e9bf4c13d5e25e11b3fccde27e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-03-04T06:47:03.277 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:02 smithi137 podman[106631]: 2024-03-04 06:47:02.864092288 +0000 UTC m=+0.387377366 container init d89a181efe41f46eb61a6aa70f371bf41a310e9bf4c13d5e25e11b3fccde27e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-activate, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-04T06:47:03.277 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:02 smithi137 podman[106631]: 2024-03-04 06:47:02.86730187 +0000 UTC m=+0.390586941 container start d89a181efe41f46eb61a6aa70f371bf41a310e9bf4c13d5e25e11b3fccde27e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-activate, org.label-schema.build-date=20240222, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux ) 2024-03-04T06:47:03.277 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:02 smithi137 podman[106631]: 2024-03-04 06:47:02.955916403 +0000 UTC m=+0.479201479 container attach d89a181efe41f46eb61a6aa70f371bf41a310e9bf4c13d5e25e11b3fccde27e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-activate, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-04T06:47:03.278 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-mon[91314]: osdmap e360: 8 total, 7 up, 8 in 2024-03-04T06:47:03.278 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:03.278 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:03.278 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-mon[91314]: pgmap v213: 121 pgs: 27 peering, 3 stale+active+clean, 3 active+clean+snaptrim_error, 88 active+clean; 145 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 4.2 MiB/s wr, 27 op/s 2024-03-04T06:47:03.278 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:03.280 INFO:tasks.rados.rados.0.smithi137.stdout:1514: done (4 left) 2024-03-04T06:47:03.281 INFO:tasks.rados.rados.0.smithi137.stdout:1515: done (3 left) 2024-03-04T06:47:03.281 INFO:tasks.rados.rados.0.smithi137.stdout:1516: done (2 left) 2024-03-04T06:47:03.281 INFO:tasks.rados.rados.0.smithi137.stdout:1517: done (1 left) 2024-03-04T06:47:03.281 INFO:tasks.rados.rados.0.smithi137.stdout:1518: done (0 left) 2024-03-04T06:47:03.281 INFO:tasks.rados.rados.0.smithi137.stdout:1519: delete oid 4 current snap is 144 2024-03-04T06:47:03.286 INFO:tasks.rados.rados.0.smithi137.stdout:1519: done (0 left) 2024-03-04T06:47:03.286 INFO:tasks.rados.rados.0.smithi137.stdout:1520: snap_remove snap 140 2024-03-04T06:47:03.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-mon[88869]: osdmap e360: 8 total, 7 up, 8 in 2024-03-04T06:47:03.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:03.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:03.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-mon[88869]: pgmap v213: 121 pgs: 27 peering, 3 stale+active+clean, 3 active+clean+snaptrim_error, 88 active+clean; 145 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 4.2 MiB/s wr, 27 op/s 2024-03-04T06:47:03.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:03.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:03.283+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:03.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:03.284+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:03.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:03.280+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:03.544 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-activate[106647]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-04T06:47:03.544 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-activate[106647]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-04T06:47:03.544 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 bash[106631]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-04T06:47:03.544 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 bash[106631]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-04T06:47:03.545 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 bash[106631]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-04T06:47:03.545 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 bash[106631]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-04T06:47:03.545 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 bash[106631]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-03-04T06:47:03.545 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 bash[106631]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-04T06:47:03.545 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 bash[106631]: --> ceph-volume raw activate successful for osd ID: 2 2024-03-04T06:47:03.545 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-activate[106647]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-04T06:47:03.545 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-activate[106647]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-04T06:47:03.545 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-activate[106647]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-03-04T06:47:03.545 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-activate[106647]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-04T06:47:03.545 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-activate[106647]: --> ceph-volume raw activate successful for osd ID: 2 2024-03-04T06:47:03.545 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:03 smithi137 podman[106631]: 2024-03-04 06:47:03.337652561 +0000 UTC m=+0.860937626 container died d89a181efe41f46eb61a6aa70f371bf41a310e9bf4c13d5e25e11b3fccde27e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-04T06:47:03.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:03 smithi203 ceph-mon[85573]: osdmap e360: 8 total, 7 up, 8 in 2024-03-04T06:47:03.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:03.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:03.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:03 smithi203 ceph-mon[85573]: pgmap v213: 121 pgs: 27 peering, 3 stale+active+clean, 3 active+clean+snaptrim_error, 88 active+clean; 145 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 4.2 MiB/s wr, 27 op/s 2024-03-04T06:47:03.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:04.283 INFO:tasks.rados.rados.0.smithi137.stdout:1520: done (0 left) 2024-03-04T06:47:04.283 INFO:tasks.rados.rados.0.smithi137.stdout:1521: rollback oid 35 current snap is 144 2024-03-04T06:47:04.283 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 35 to 143 2024-03-04T06:47:04.284 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 29 current snap is 144 2024-03-04T06:47:04.284 INFO:tasks.rados.rados.0.smithi137.stdout:1522: seq_num 506 ranges {1253376=483328,1736704=761856,2498560=40960} 2024-03-04T06:47:04.287 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:04 smithi137 ceph-mon[88869]: osdmap e361: 8 total, 7 up, 8 in 2024-03-04T06:47:04.287 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:04.287 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:04.287 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:04.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:04 smithi137 ceph-mon[91314]: osdmap e361: 8 total, 7 up, 8 in 2024-03-04T06:47:04.287 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:04.288 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:04.288 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:04.288 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:04 smithi137 podman[106764]: 2024-03-04 06:47:04.026730457 +0000 UTC m=+0.684362762 container remove d89a181efe41f46eb61a6aa70f371bf41a310e9bf4c13d5e25e11b3fccde27e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-activate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-04T06:47:04.288 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:04 smithi137 podman[106827]: 2024-03-04 06:47:04.15010504 +0000 UTC m=+0.018062962 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:47:04.289 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:04 smithi137 podman[106827]: 2024-03-04 06:47:04.260972891 +0000 UTC m=+0.128930803 container create 436ae07776d974e50caf25e0ac9280d19c1a0d9c62e2370cf16018f6368b1644 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T06:47:04.292 INFO:tasks.rados.rados.0.smithi137.stdout:1522: writing smithi13777483-29 from 1253376 to 1736704 tid 1 2024-03-04T06:47:04.297 INFO:tasks.rados.rados.0.smithi137.stdout:1522: writing smithi13777483-29 from 1736704 to 2498560 tid 2 2024-03-04T06:47:04.297 INFO:tasks.rados.rados.0.smithi137.stdout:1522: writing smithi13777483-29 from 2498560 to 2539520 tid 3 2024-03-04T06:47:04.297 INFO:tasks.rados.rados.0.smithi137.stdout:1523: delete oid 30 current snap is 144 2024-03-04T06:47:04.298 INFO:tasks.rados.rados.0.smithi137.stdout:1521: finishing rollback tid 0 to smithi13777483-35 2024-03-04T06:47:04.298 INFO:tasks.rados.rados.0.smithi137.stdout:1521: finishing rollback tid 1 to smithi13777483-35 2024-03-04T06:47:04.298 INFO:tasks.rados.rados.0.smithi137.stdout:1521: finishing rollback tid 2 to smithi13777483-35 2024-03-04T06:47:04.298 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 737 (ObjNum 446 snap 131 seq_num 446) dirty exists 2024-03-04T06:47:04.298 INFO:tasks.rados.rados.0.smithi137.stdout:1522: finishing write tid 1 to smithi13777483-29 2024-03-04T06:47:04.299 INFO:tasks.rados.rados.0.smithi137.stdout:1521: done (2 left) 2024-03-04T06:47:04.299 INFO:tasks.rados.rados.0.smithi137.stdout:1523: done (1 left) 2024-03-04T06:47:04.299 INFO:tasks.rados.rados.0.smithi137.stdout:1524: delete oid 19 current snap is 144 2024-03-04T06:47:04.302 INFO:tasks.rados.rados.0.smithi137.stdout:1522: finishing write tid 2 to smithi13777483-29 2024-03-04T06:47:04.302 INFO:tasks.rados.rados.0.smithi137.stdout:1524: done (1 left) 2024-03-04T06:47:04.302 INFO:tasks.rados.rados.0.smithi137.stdout:1525: read oid 28 snap -1 2024-03-04T06:47:04.302 INFO:tasks.rados.rados.0.smithi137.stdout:1525: expect (ObjNum 407 snap 122 seq_num 407) 2024-03-04T06:47:04.302 INFO:tasks.rados.rados.0.smithi137.stdout:1526: read oid 31 snap -1 2024-03-04T06:47:04.302 INFO:tasks.rados.rados.0.smithi137.stdout:1526: expect (ObjNum 474 snap 135 seq_num 474) 2024-03-04T06:47:04.302 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 144 2024-03-04T06:47:04.302 INFO:tasks.rados.rados.0.smithi137.stdout:1522: finishing write tid 3 to smithi13777483-29 2024-03-04T06:47:04.302 INFO:tasks.rados.rados.0.smithi137.stdout:1527: seq_num 509 ranges {4366336=532480,4898816=409600,5308416=393216} 2024-03-04T06:47:04.329 INFO:tasks.rados.rados.0.smithi137.stdout:1527: writing smithi13777483-47 from 4366336 to 4898816 tid 1 2024-03-04T06:47:04.331 INFO:tasks.rados.rados.0.smithi137.stdout:1527: writing smithi13777483-47 from 4898816 to 5308416 tid 2 2024-03-04T06:47:04.334 INFO:tasks.rados.rados.0.smithi137.stdout:1527: writing smithi13777483-47 from 5308416 to 5701632 tid 3 2024-03-04T06:47:04.334 INFO:tasks.rados.rados.0.smithi137.stdout:1528: copy_from oid 50 from oid 9 current snap is 144 2024-03-04T06:47:04.334 INFO:tasks.rados.rados.0.smithi137.stdout:1522: finishing write tid 4 to smithi13777483-29 2024-03-04T06:47:04.334 INFO:tasks.rados.rados.0.smithi137.stdout:1522: finishing write tid 5 to smithi13777483-29 2024-03-04T06:47:04.334 INFO:tasks.rados.rados.0.smithi137.stdout:1522: oid 29 updating version 0 to 634 2024-03-04T06:47:04.334 INFO:tasks.rados.rados.0.smithi137.stdout:1522: oid 29 version 634 is already newer than 633 2024-03-04T06:47:04.334 INFO:tasks.rados.rados.0.smithi137.stdout:1522: oid 29 version 634 is already newer than 632 2024-03-04T06:47:04.334 INFO:tasks.rados.rados.0.smithi137.stdout:1522: oid 29 version 634 is already newer than 631 2024-03-04T06:47:04.334 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 634 (ObjNum 506 snap 144 seq_num 506) dirty exists 2024-03-04T06:47:04.335 INFO:tasks.rados.rados.0.smithi137.stdout:1522: left oid 29 (ObjNum 506 snap 144 seq_num 506) 2024-03-04T06:47:04.335 INFO:tasks.rados.rados.0.smithi137.stdout:1522: done (4 left) 2024-03-04T06:47:04.335 INFO:tasks.rados.rados.0.smithi137.stdout:1529: setattr oid 45 current snap is 144 2024-03-04T06:47:04.335 INFO:tasks.rados.rados.0.smithi137.stdout:1525: expect (ObjNum 407 snap 122 seq_num 407) 2024-03-04T06:47:04.396 INFO:tasks.rados.rados.0.smithi137.stdout:1526: expect (ObjNum 474 snap 135 seq_num 474) 2024-03-04T06:47:04.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:04.289+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:04.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:04.285+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:04.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:04.285+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:04.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:04.285+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:04.544 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:04 smithi137 podman[106827]: 2024-03-04 06:47:04.495024182 +0000 UTC m=+0.362982108 container init 436ae07776d974e50caf25e0ac9280d19c1a0d9c62e2370cf16018f6368b1644 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-04T06:47:04.544 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:04 smithi137 podman[106827]: 2024-03-04 06:47:04.498116386 +0000 UTC m=+0.366074308 container start 436ae07776d974e50caf25e0ac9280d19c1a0d9c62e2370cf16018f6368b1644 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T06:47:04.544 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:04 smithi137 ceph-osd[106845]: -- 172.21.15.137:0/4154435860 <== mon.2 v2:172.21.15.137:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55facaf35680 con 0x55facaeff400 2024-03-04T06:47:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:04 smithi203 ceph-mon[85573]: osdmap e361: 8 total, 7 up, 8 in 2024-03-04T06:47:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:04.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:1527: finishing write tid 1 to smithi13777483-47 2024-03-04T06:47:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:1527: finishing write tid 2 to smithi13777483-47 2024-03-04T06:47:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:1527: finishing write tid 3 to smithi13777483-47 2024-03-04T06:47:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:1527: finishing write tid 4 to smithi13777483-47 2024-03-04T06:47:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:1527: finishing write tid 5 to smithi13777483-47 2024-03-04T06:47:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:1527: oid 47 updating version 0 to 960 2024-03-04T06:47:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:1527: oid 47 updating version 960 to 962 2024-03-04T06:47:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:1527: oid 47 version 962 is already newer than 959 2024-03-04T06:47:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:1527: oid 47 version 962 is already newer than 961 2024-03-04T06:47:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 962 (ObjNum 509 snap 144 seq_num 509) dirty exists 2024-03-04T06:47:04.613 INFO:tasks.rados.rados.0.smithi137.stdout:1527: left oid 47 (ObjNum 509 snap 144 seq_num 509) 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:1528: finishing copy_from racing read to smithi13777483-50 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:1528: finishing copy_from to smithi13777483-50 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 626 (ObjNum 335 snap 106 seq_num 335) dirty exists 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:1525: done (4 left) 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:1526: done (3 left) 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:1527: done (2 left) 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:1528: done (1 left) 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:1530: copy_from oid 42 from oid 25 current snap is 144 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:1531: read oid 27 snap -1 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:1531: expect (ObjNum 498 snap 143 seq_num 498) 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:1532: rollback oid 31 current snap is 144 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 31 to 142 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:1533: copy_from oid 9 from oid 36 current snap is 144 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:1534: rollback oid 16 current snap is 144 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 16 to 142 2024-03-04T06:47:04.614 INFO:tasks.rados.rados.0.smithi137.stdout:1535: snap_create 2024-03-04T06:47:04.617 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 368 (ObjNum 486 snap 139 seq_num 486) dirty exists 2024-03-04T06:47:04.619 INFO:tasks.rados.rados.0.smithi137.stdout:1532: finishing rollback tid 0 to smithi13777483-31 2024-03-04T06:47:04.619 INFO:tasks.rados.rados.0.smithi137.stdout:1532: finishing rollback tid 1 to smithi13777483-31 2024-03-04T06:47:04.620 INFO:tasks.rados.rados.0.smithi137.stdout:1532: finishing rollback tid 2 to smithi13777483-31 2024-03-04T06:47:04.620 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 741 (ObjNum 474 snap 135 seq_num 474) dirty exists 2024-03-04T06:47:04.624 INFO:tasks.rados.rados.0.smithi137.stdout:1533: finishing copy_from to smithi13777483-9 2024-03-04T06:47:04.624 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 337 (ObjNum 434 snap 128 seq_num 434) dirty exists 2024-03-04T06:47:04.624 INFO:tasks.rados.rados.0.smithi137.stdout:1534: finishing rollback tid 0 to smithi13777483-16 2024-03-04T06:47:04.624 INFO:tasks.rados.rados.0.smithi137.stdout:1534: finishing rollback tid 1 to smithi13777483-16 2024-03-04T06:47:04.624 INFO:tasks.rados.rados.0.smithi137.stdout:1533: finishing copy_from racing read to smithi13777483-9 2024-03-04T06:47:04.625 INFO:tasks.rados.rados.0.smithi137.stdout:1534: finishing rollback tid 2 to smithi13777483-16 2024-03-04T06:47:04.625 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16745 (ObjNum 419 snap 125 seq_num 419) dirty exists 2024-03-04T06:47:04.625 INFO:tasks.rados.rados.0.smithi137.stdout:1531: expect (ObjNum 498 snap 143 seq_num 498) 2024-03-04T06:47:04.687 INFO:tasks.rados.rados.0.smithi137.stdout:1530: finishing copy_from racing read to smithi13777483-42 2024-03-04T06:47:04.688 INFO:tasks.rados.rados.0.smithi137.stdout:1530: finishing copy_from to smithi13777483-42 2024-03-04T06:47:04.688 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 582 (ObjNum 353 snap 110 seq_num 353) dirty exists 2024-03-04T06:47:05.039 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:04 smithi137 bash[106827]: 436ae07776d974e50caf25e0ac9280d19c1a0d9c62e2370cf16018f6368b1644 2024-03-04T06:47:05.039 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:04 smithi137 systemd[1]: Started Ceph osd.2 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:47:05.289 INFO:tasks.rados.rados.0.smithi137.stdout:1529: done (6 left) 2024-03-04T06:47:05.289 INFO:tasks.rados.rados.0.smithi137.stdout:1530: done (5 left) 2024-03-04T06:47:05.289 INFO:tasks.rados.rados.0.smithi137.stdout:1531: done (4 left) 2024-03-04T06:47:05.289 INFO:tasks.rados.rados.0.smithi137.stdout:1532: done (3 left) 2024-03-04T06:47:05.289 INFO:tasks.rados.rados.0.smithi137.stdout:1533: done (2 left) 2024-03-04T06:47:05.289 INFO:tasks.rados.rados.0.smithi137.stdout:1534: done (1 left) 2024-03-04T06:47:05.289 INFO:tasks.rados.rados.0.smithi137.stdout:1535: done (0 left) 2024-03-04T06:47:05.289 INFO:tasks.rados.rados.0.smithi137.stdout:1536: snap_create 2024-03-04T06:47:05.293 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[106841]: 2024-03-04T06:47:05.037+0000 7f58abe7b7c0 -1 Falling back to public interface 2024-03-04T06:47:05.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[88869]: osdmap e362: 8 total, 7 up, 8 in 2024-03-04T06:47:05.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:05.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:05.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:05.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[88869]: pgmap v216: 121 pgs: 11 active+undersized+degraded, 3 active+clean+snaptrim_error, 26 active+undersized, 81 active+clean; 161 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 4.5 MiB/s wr, 21 op/s; 30/324 objects degraded (9.259%) 2024-03-04T06:47:05.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:47:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[91314]: osdmap e362: 8 total, 7 up, 8 in 2024-03-04T06:47:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[91314]: pgmap v216: 121 pgs: 11 active+undersized+degraded, 3 active+clean+snaptrim_error, 26 active+undersized, 81 active+clean; 161 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 4.5 MiB/s wr, 21 op/s; 30/324 objects degraded (9.259%) 2024-03-04T06:47:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:47:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:05 smithi203 ceph-mon[85573]: osdmap e362: 8 total, 7 up, 8 in 2024-03-04T06:47:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:05 smithi203 ceph-mon[85573]: pgmap v216: 121 pgs: 11 active+undersized+degraded, 3 active+clean+snaptrim_error, 26 active+undersized, 81 active+clean; 161 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 4.5 MiB/s wr, 21 op/s; 30/324 objects degraded (9.259%) 2024-03-04T06:47:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:47:05.601 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:47:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:47:05] "GET /metrics HTTP/1.1" 200 36265 "" "Prometheus/2.43.0" 2024-03-04T06:47:06.291 INFO:tasks.rados.rados.0.smithi137.stdout:1536: done (0 left) 2024-03-04T06:47:06.292 INFO:tasks.rados.rados.0.smithi137.stdout:1537: read oid 37 snap -1 2024-03-04T06:47:06.292 INFO:tasks.rados.rados.0.smithi137.stdout:1537: expect deleted 2024-03-04T06:47:06.292 INFO:tasks.rados.rados.0.smithi137.stdout:1538: read oid 17 snap -1 2024-03-04T06:47:06.292 INFO:tasks.rados.rados.0.smithi137.stdout:1538: expect (ObjNum 455 snap 132 seq_num 455) 2024-03-04T06:47:06.292 INFO:tasks.rados.rados.0.smithi137.stdout:1539: setattr oid 9 current snap is 146 2024-03-04T06:47:06.295 INFO:tasks.rados.rados.0.smithi137.stdout:1540: read oid 30 snap 144 2024-03-04T06:47:06.295 INFO:tasks.rados.rados.0.smithi137.stdout:1540: expect deleted 2024-03-04T06:47:06.295 INFO:tasks.rados.rados.0.smithi137.stdout:1541: delete oid 45 current snap is 146 2024-03-04T06:47:06.298 INFO:tasks.rados.rados.0.smithi137.stdout:1538: expect (ObjNum 455 snap 132 seq_num 455) 2024-03-04T06:47:06.314 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 802 (ObjNum 434 snap 128 seq_num 434) dirty exists 2024-03-04T06:47:06.314 INFO:tasks.rados.rados.0.smithi137.stdout:1537: done (4 left) 2024-03-04T06:47:06.314 INFO:tasks.rados.rados.0.smithi137.stdout:1538: done (3 left) 2024-03-04T06:47:06.314 INFO:tasks.rados.rados.0.smithi137.stdout:1539: done (2 left) 2024-03-04T06:47:06.315 INFO:tasks.rados.rados.0.smithi137.stdout:1540: done (1 left) 2024-03-04T06:47:06.315 INFO:tasks.rados.rados.0.smithi137.stdout:1541: done (0 left) 2024-03-04T06:47:06.315 INFO:tasks.rados.rados.0.smithi137.stdout:1542: read oid 4 snap -1 2024-03-04T06:47:06.315 INFO:tasks.rados.rados.0.smithi137.stdout:1542: expect deleted 2024-03-04T06:47:06.315 INFO:tasks.rados.rados.0.smithi137.stdout:1543: read oid 11 snap -1 2024-03-04T06:47:06.315 INFO:tasks.rados.rados.0.smithi137.stdout:1543: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:47:06.315 INFO:tasks.rados.rados.0.smithi137.stdout:1544: copy_from oid 33 from oid 6 current snap is 146 2024-03-04T06:47:06.315 INFO:tasks.rados.rados.0.smithi137.stdout:1545: snap_remove snap 144 2024-03-04T06:47:06.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:06 smithi203 ceph-mon[85573]: Health check failed: Degraded data redundancy: 30/324 objects degraded (9.259%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:06.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:06 smithi203 ceph-mon[85573]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs inactive, 8 pgs peering) 2024-03-04T06:47:06.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:06 smithi203 ceph-mon[85573]: osdmap e363: 8 total, 7 up, 8 in 2024-03-04T06:47:06.600 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:06 smithi137 ceph-mon[88869]: Health check failed: Degraded data redundancy: 30/324 objects degraded (9.259%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:06.601 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:06 smithi137 ceph-mon[88869]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs inactive, 8 pgs peering) 2024-03-04T06:47:06.601 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:06 smithi137 ceph-mon[88869]: osdmap e363: 8 total, 7 up, 8 in 2024-03-04T06:47:06.601 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:06.299+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:06.601 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:06.299+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:06.601 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:06.317+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:06.601 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:06 smithi137 ceph-mon[91314]: Health check failed: Degraded data redundancy: 30/324 objects degraded (9.259%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:06.601 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:06 smithi137 ceph-mon[91314]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs inactive, 8 pgs peering) 2024-03-04T06:47:06.602 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:06 smithi137 ceph-mon[91314]: osdmap e363: 8 total, 7 up, 8 in 2024-03-04T06:47:07.306 INFO:tasks.rados.rados.0.smithi137.stdout:1545: done (3 left) 2024-03-04T06:47:07.306 INFO:tasks.rados.rados.0.smithi137.stdout:1546: read oid 49 snap -1 2024-03-04T06:47:07.306 INFO:tasks.rados.rados.0.smithi137.stdout:1546: expect (ObjNum 460 snap 133 seq_num 460) 2024-03-04T06:47:07.306 INFO:tasks.rados.rados.0.smithi137.stdout:1547: delete oid 7 current snap is 146 2024-03-04T06:47:07.306 INFO:tasks.rados.rados.0.smithi137.stdout:1544: finishing copy_from to smithi13777483-33 2024-03-04T06:47:07.306 INFO:tasks.rados.rados.0.smithi137.stdout:1544: got expected ENOENT (src dne) 2024-03-04T06:47:07.306 INFO:tasks.rados.rados.0.smithi137.stdout:1544: finishing copy_from racing read to smithi13777483-33 2024-03-04T06:47:07.306 INFO:tasks.rados.rados.0.smithi137.stdout:1543: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:47:07.562 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-mon[88869]: osdmap e364: 8 total, 7 up, 8 in 2024-03-04T06:47:07.562 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:07.563 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:07.563 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:07.563 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-mon[88869]: pgmap v219: 121 pgs: 11 active+undersized+degraded, 3 active+clean+snaptrim_error, 26 active+undersized, 81 active+clean; 161 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 4.5 MiB/s wr, 21 op/s; 30/324 objects degraded (9.259%) 2024-03-04T06:47:07.563 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-mon[91314]: osdmap e364: 8 total, 7 up, 8 in 2024-03-04T06:47:07.563 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:07.563 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:07.563 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:07.563 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-mon[91314]: pgmap v219: 121 pgs: 11 active+undersized+degraded, 3 active+clean+snaptrim_error, 26 active+undersized, 81 active+clean; 161 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 4.5 MiB/s wr, 21 op/s; 30/324 objects degraded (9.259%) 2024-03-04T06:47:07.564 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:07.309+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:07.564 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:07.376+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:07.564 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:07.376+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:07.564 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:07.376+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:07.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:07 smithi203 ceph-mon[85573]: osdmap e364: 8 total, 7 up, 8 in 2024-03-04T06:47:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:07 smithi203 ceph-mon[85573]: pgmap v219: 121 pgs: 11 active+undersized+degraded, 3 active+clean+snaptrim_error, 26 active+undersized, 81 active+clean; 161 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 4.5 MiB/s wr, 21 op/s; 30/324 objects degraded (9.259%) 2024-03-04T06:47:07.769 INFO:tasks.rados.rados.0.smithi137.stdout:1546: expect (ObjNum 460 snap 133 seq_num 460) 2024-03-04T06:47:07.972 INFO:tasks.rados.rados.0.smithi137.stdout:1542: done (4 left) 2024-03-04T06:47:07.972 INFO:tasks.rados.rados.0.smithi137.stdout:1543: done (3 left) 2024-03-04T06:47:07.972 INFO:tasks.rados.rados.0.smithi137.stdout:1544: done (2 left) 2024-03-04T06:47:07.972 INFO:tasks.rados.rados.0.smithi137.stdout:1546: done (1 left) 2024-03-04T06:47:07.972 INFO:tasks.rados.rados.0.smithi137.stdout:1547: done (0 left) 2024-03-04T06:47:07.972 INFO:tasks.rados.rados.0.smithi137.stdout:1548: rollback oid 11 current snap is 146 2024-03-04T06:47:07.972 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 11 to 143 2024-03-04T06:47:07.972 INFO:tasks.rados.rados.0.smithi137.stdout:1549: read oid 21 snap -1 2024-03-04T06:47:07.972 INFO:tasks.rados.rados.0.smithi137.stdout:1549: expect (ObjNum 490 snap 140 seq_num 490) 2024-03-04T06:47:07.972 INFO:tasks.rados.rados.0.smithi137.stdout:1550: read oid 30 snap -1 2024-03-04T06:47:07.972 INFO:tasks.rados.rados.0.smithi137.stdout:1550: expect deleted 2024-03-04T06:47:07.972 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 146 2024-03-04T06:47:07.972 INFO:tasks.rados.rados.0.smithi137.stdout:1551: seq_num 512 ranges {9887744=581632,10469376=516096,10985472=286720} 2024-03-04T06:47:08.028 INFO:tasks.rados.rados.0.smithi137.stdout:1551: writing smithi13777483-15 from 9887744 to 10469376 tid 1 2024-03-04T06:47:08.031 INFO:tasks.rados.rados.0.smithi137.stdout:1551: writing smithi13777483-15 from 10469376 to 10985472 tid 2 2024-03-04T06:47:08.033 INFO:tasks.rados.rados.0.smithi137.stdout:1551: writing smithi13777483-15 from 10985472 to 11272192 tid 3 2024-03-04T06:47:08.033 INFO:tasks.rados.rados.0.smithi137.stdout:1552: copy_from oid 17 from oid 29 current snap is 146 2024-03-04T06:47:08.034 INFO:tasks.rados.rados.0.smithi137.stdout:1548: finishing rollback tid 0 to smithi13777483-11 2024-03-04T06:47:08.034 INFO:tasks.rados.rados.0.smithi137.stdout:1548: finishing rollback tid 1 to smithi13777483-11 2024-03-04T06:47:08.034 INFO:tasks.rados.rados.0.smithi137.stdout:1548: finishing rollback tid 2 to smithi13777483-11 2024-03-04T06:47:08.034 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 15441 (ObjNum 419 snap 125 seq_num 419) dirty exists 2024-03-04T06:47:08.034 INFO:tasks.rados.rados.0.smithi137.stdout:1549: expect (ObjNum 490 snap 140 seq_num 490) 2024-03-04T06:47:08.293 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[106841]: 2024-03-04T06:47:08.249+0000 7f58abe7b7c0 -1 osd.2 356 log_to_monitors true 2024-03-04T06:47:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:08 smithi203 ceph-mon[85573]: osdmap e365: 8 total, 7 up, 8 in 2024-03-04T06:47:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:08 smithi203 ceph-mon[85573]: from='osd.2 [v2:172.21.15.137:6818/2721042151,v1:172.21.15.137:6819/2721042151]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T06:47:08.723 INFO:tasks.rados.rados.0.smithi137.stdout:1551: finishing write tid 1 to smithi13777483-15 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:1551: finishing write tid 2 to smithi13777483-15 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:1551: finishing write tid 3 to smithi13777483-15 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:1551: finishing write tid 4 to smithi13777483-15 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:1551: finishing write tid 5 to smithi13777483-15 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:1551: oid 15 updating version 0 to 939 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:1551: oid 15 version 939 is already newer than 938 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:1551: oid 15 version 939 is already newer than 937 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:1551: oid 15 version 939 is already newer than 936 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 939 (ObjNum 512 snap 146 seq_num 512) dirty exists 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:1551: left oid 15 (ObjNum 512 snap 146 seq_num 512) 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:1552: finishing copy_from racing read to smithi13777483-17 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:1552: finishing copy_from to smithi13777483-17 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 634 (ObjNum 506 snap 144 seq_num 506) dirty exists 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:1548: done (4 left) 2024-03-04T06:47:08.724 INFO:tasks.rados.rados.0.smithi137.stdout:1549: done (3 left) 2024-03-04T06:47:08.725 INFO:tasks.rados.rados.0.smithi137.stdout:1550: done (2 left) 2024-03-04T06:47:08.725 INFO:tasks.rados.rados.0.smithi137.stdout:1551: done (1 left) 2024-03-04T06:47:08.725 INFO:tasks.rados.rados.0.smithi137.stdout:1552: done (0 left) 2024-03-04T06:47:08.725 INFO:tasks.rados.rados.0.smithi137.stdout:1553: rollback oid 25 current snap is 146 2024-03-04T06:47:08.725 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 25 to 142 2024-03-04T06:47:08.725 INFO:tasks.rados.rados.0.smithi137.stdout:1554: rollback oid 18 current snap is 146 2024-03-04T06:47:08.725 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 18 to 143 2024-03-04T06:47:08.725 INFO:tasks.rados.rados.0.smithi137.stdout:1555: read oid 40 snap -1 2024-03-04T06:47:08.725 INFO:tasks.rados.rados.0.smithi137.stdout:1555: expect deleted 2024-03-04T06:47:08.725 INFO:tasks.rados.rados.0.smithi137.stdout:1556: delete oid 43 current snap is 146 2024-03-04T06:47:08.728 INFO:tasks.rados.rados.0.smithi137.stdout:1553: finishing rollback tid 0 to smithi13777483-25 2024-03-04T06:47:08.728 INFO:tasks.rados.rados.0.smithi137.stdout:1554: finishing rollback tid 0 to smithi13777483-18 2024-03-04T06:47:08.728 INFO:tasks.rados.rados.0.smithi137.stdout:1553: finishing rollback tid 1 to smithi13777483-25 2024-03-04T06:47:08.728 INFO:tasks.rados.rados.0.smithi137.stdout:1554: finishing rollback tid 1 to smithi13777483-18 2024-03-04T06:47:08.729 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-mon[88869]: osdmap e365: 8 total, 7 up, 8 in 2024-03-04T06:47:08.729 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:08.729 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:08.729 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:08.729 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-mon[88869]: from='osd.2 [v2:172.21.15.137:6818/2721042151,v1:172.21.15.137:6819/2721042151]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T06:47:08.729 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:08.304+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:08.729 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:08.304+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:08.729 INFO:tasks.rados.rados.0.smithi137.stdout:1555: done (3 left) 2024-03-04T06:47:08.729 INFO:tasks.rados.rados.0.smithi137.stdout:1556: done (2 left) 2024-03-04T06:47:08.730 INFO:tasks.rados.rados.0.smithi137.stdout:1557: snap_remove snap 145 2024-03-04T06:47:08.730 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-mon[91314]: osdmap e365: 8 total, 7 up, 8 in 2024-03-04T06:47:08.730 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{ae=[ad,a8],b1=[b1,b0],be=[be]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:08.730 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:08.730 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:08.730 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-mon[91314]: from='osd.2 [v2:172.21.15.137:6818/2721042151,v1:172.21.15.137:6819/2721042151]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T06:47:08.730 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[106841]: 2024-03-04T06:47:08.329+0000 7f589d2d3700 -1 osd.2 356 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:47:09.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:08.727+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:09.314 INFO:tasks.rados.rados.0.smithi137.stdout:1557: done (2 left) 2024-03-04T06:47:09.314 INFO:tasks.rados.rados.0.smithi137.stdout:1558: read oid 4 snap 142 2024-03-04T06:47:09.315 INFO:tasks.rados.rados.0.smithi137.stdout:1558: expect (ObjNum 494 snap 140 seq_num 494) 2024-03-04T06:47:09.315 INFO:tasks.rados.rados.0.smithi137.stdout:1559: rmattr oid 16 current snap is 146 2024-03-04T06:47:09.315 INFO:tasks.rados.rados.0.smithi137.stdout:1559: done (3 left) 2024-03-04T06:47:09.315 INFO:tasks.rados.rados.0.smithi137.stdout:1560: rollback oid 47 current snap is 146 2024-03-04T06:47:09.315 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 47 to 143 2024-03-04T06:47:09.315 INFO:tasks.rados.rados.0.smithi137.stdout:1554: finishing rollback tid 2 to smithi13777483-18 2024-03-04T06:47:09.315 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 638 (ObjNum 493 snap 140 seq_num 493) dirty exists 2024-03-04T06:47:09.315 INFO:tasks.rados.rados.0.smithi137.stdout:1553: finishing rollback tid 2 to smithi13777483-25 2024-03-04T06:47:09.315 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 966 (ObjNum 353 snap 110 seq_num 353) dirty exists 2024-03-04T06:47:09.315 INFO:tasks.rados.rados.0.smithi137.stdout:1553: done (3 left) 2024-03-04T06:47:09.315 INFO:tasks.rados.rados.0.smithi137.stdout:1554: done (2 left) 2024-03-04T06:47:09.315 INFO:tasks.rados.rados.0.smithi137.stdout:1561: setattr oid 39 current snap is 146 2024-03-04T06:47:09.325 INFO:tasks.rados.rados.0.smithi137.stdout:1562: read oid 19 snap -1 2024-03-04T06:47:09.325 INFO:tasks.rados.rados.0.smithi137.stdout:1562: expect deleted 2024-03-04T06:47:09.325 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 146 2024-03-04T06:47:09.325 INFO:tasks.rados.rados.0.smithi137.stdout:1563: seq_num 514 ranges {2334720=614400,2949120=679936,3629056=122880} 2024-03-04T06:47:09.338 INFO:tasks.rados.rados.0.smithi137.stdout:1563: writing smithi13777483-3 from 2334720 to 2949120 tid 1 2024-03-04T06:47:09.343 INFO:tasks.rados.rados.0.smithi137.stdout:1563: writing smithi13777483-3 from 2949120 to 3629056 tid 2 2024-03-04T06:47:09.344 INFO:tasks.rados.rados.0.smithi137.stdout:1563: writing smithi13777483-3 from 3629056 to 3751936 tid 3 2024-03-04T06:47:09.346 INFO:tasks.rados.rados.0.smithi137.stdout:1564: copy_from oid 30 from oid 25 current snap is 146 2024-03-04T06:47:09.346 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 374 (ObjNum 449 snap 131 seq_num 449) dirty exists 2024-03-04T06:47:09.346 INFO:tasks.rados.rados.0.smithi137.stdout:1560: finishing rollback tid 0 to smithi13777483-47 2024-03-04T06:47:09.346 INFO:tasks.rados.rados.0.smithi137.stdout:1560: finishing rollback tid 1 to smithi13777483-47 2024-03-04T06:47:09.346 INFO:tasks.rados.rados.0.smithi137.stdout:1561: done (5 left) 2024-03-04T06:47:09.346 INFO:tasks.rados.rados.0.smithi137.stdout:1565: rollback oid 16 current snap is 146 2024-03-04T06:47:09.346 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 16 to 142 2024-03-04T06:47:09.346 INFO:tasks.rados.rados.0.smithi137.stdout:1566: copy_from oid 9 from oid 40 current snap is 146 2024-03-04T06:47:09.346 INFO:tasks.rados.rados.0.smithi137.stdout:1567: read oid 2 snap 142 2024-03-04T06:47:09.347 INFO:tasks.rados.rados.0.smithi137.stdout:1567: expect (ObjNum 472 snap 135 seq_num 472) 2024-03-04T06:47:09.347 INFO:tasks.rados.rados.0.smithi137.stdout:1568: read oid 49 snap -1 2024-03-04T06:47:09.347 INFO:tasks.rados.rados.0.smithi137.stdout:1568: expect (ObjNum 460 snap 133 seq_num 460) 2024-03-04T06:47:09.347 INFO:tasks.rados.rados.0.smithi137.stdout:1569: copy_from oid 7 from oid 20 current snap is 146 2024-03-04T06:47:09.347 INFO:tasks.rados.rados.0.smithi137.stdout:1570: read oid 36 snap 142 2024-03-04T06:47:09.347 INFO:tasks.rados.rados.0.smithi137.stdout:1570: expect (ObjNum 434 snap 128 seq_num 434) 2024-03-04T06:47:09.347 INFO:tasks.rados.rados.0.smithi137.stdout:1571: read oid 29 snap -1 2024-03-04T06:47:09.347 INFO:tasks.rados.rados.0.smithi137.stdout:1571: expect (ObjNum 506 snap 144 seq_num 506) 2024-03-04T06:47:09.347 INFO:tasks.rados.rados.0.smithi137.stdout:1572: read oid 41 snap -1 2024-03-04T06:47:09.347 INFO:tasks.rados.rados.0.smithi137.stdout:1572: expect deleted 2024-03-04T06:47:09.348 INFO:tasks.rados.rados.0.smithi137.stdout:1573: read oid 22 snap -1 2024-03-04T06:47:09.348 INFO:tasks.rados.rados.0.smithi137.stdout:1573: expect (ObjNum 396 snap 119 seq_num 396) 2024-03-04T06:47:09.348 INFO:tasks.rados.rados.0.smithi137.stdout:1574: delete oid 34 current snap is 146 2024-03-04T06:47:09.348 INFO:tasks.rados.rados.0.smithi137.stdout:1560: finishing rollback tid 2 to smithi13777483-47 2024-03-04T06:47:09.348 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 969 (ObjNum 497 snap 141 seq_num 497) dirty exists 2024-03-04T06:47:09.351 INFO:tasks.rados.rados.0.smithi137.stdout:1558: expect (ObjNum 494 snap 140 seq_num 494) 2024-03-04T06:47:09.400 INFO:tasks.rados.rados.0.smithi137.stdout:1564: finishing copy_from racing read to smithi13777483-30 2024-03-04T06:47:09.400 INFO:tasks.rados.rados.0.smithi137.stdout:1564: finishing copy_from to smithi13777483-30 2024-03-04T06:47:09.400 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 966 (ObjNum 353 snap 110 seq_num 353) dirty exists 2024-03-04T06:47:09.400 INFO:tasks.rados.rados.0.smithi137.stdout:1569: finishing copy_from to smithi13777483-7 2024-03-04T06:47:09.401 INFO:tasks.rados.rados.0.smithi137.stdout:1569: got expected ENOENT (src dne) 2024-03-04T06:47:09.401 INFO:tasks.rados.rados.0.smithi137.stdout:1569: finishing copy_from racing read to smithi13777483-7 2024-03-04T06:47:09.401 INFO:tasks.rados.rados.0.smithi137.stdout:1565: finishing rollback tid 0 to smithi13777483-16 2024-03-04T06:47:09.401 INFO:tasks.rados.rados.0.smithi137.stdout:1565: finishing rollback tid 1 to smithi13777483-16 2024-03-04T06:47:09.401 INFO:tasks.rados.rados.0.smithi137.stdout:1565: finishing rollback tid 2 to smithi13777483-16 2024-03-04T06:47:09.401 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16748 (ObjNum 419 snap 125 seq_num 419) dirty exists 2024-03-04T06:47:09.401 INFO:tasks.rados.rados.0.smithi137.stdout:1573: expect (ObjNum 396 snap 119 seq_num 396) 2024-03-04T06:47:09.456 INFO:tasks.rados.rados.0.smithi137.stdout:1568: expect (ObjNum 460 snap 133 seq_num 460) 2024-03-04T06:47:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:09 smithi203 ceph-mon[85573]: from='osd.2 [v2:172.21.15.137:6818/2721042151,v1:172.21.15.137:6819/2721042151]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-04T06:47:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:09 smithi203 ceph-mon[85573]: osdmap e366: 8 total, 7 up, 8 in 2024-03-04T06:47:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:09 smithi203 ceph-mon[85573]: from='osd.2 [v2:172.21.15.137:6818/2721042151,v1:172.21.15.137:6819/2721042151]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:47:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:09 smithi203 ceph-mon[85573]: pgmap v222: 121 pgs: 11 active+undersized+degraded, 3 active+clean+snaptrim_error, 26 active+undersized, 81 active+clean; 162 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 344 KiB/s wr, 9 op/s; 33/342 objects degraded (9.649%) 2024-03-04T06:47:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:47:09.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:09.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:09.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:09.667 INFO:tasks.rados.rados.0.smithi137.stdout:1558: done (14 left) 2024-03-04T06:47:09.667 INFO:tasks.rados.rados.0.smithi137.stdout:1560: done (13 left) 2024-03-04T06:47:09.667 INFO:tasks.rados.rados.0.smithi137.stdout:1564: done (12 left) 2024-03-04T06:47:09.667 INFO:tasks.rados.rados.0.smithi137.stdout:1565: done (11 left) 2024-03-04T06:47:09.667 INFO:tasks.rados.rados.0.smithi137.stdout:1568: done (10 left) 2024-03-04T06:47:09.667 INFO:tasks.rados.rados.0.smithi137.stdout:1569: done (9 left) 2024-03-04T06:47:09.667 INFO:tasks.rados.rados.0.smithi137.stdout:1573: done (8 left) 2024-03-04T06:47:09.667 INFO:tasks.rados.rados.0.smithi137.stdout:1574: done (7 left) 2024-03-04T06:47:09.667 INFO:tasks.rados.rados.0.smithi137.stdout:1575: snap_create 2024-03-04T06:47:09.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:09.343+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:09.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:09.330+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:09.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:09.343+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:09.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:09.343+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[91314]: from='osd.2 [v2:172.21.15.137:6818/2721042151,v1:172.21.15.137:6819/2721042151]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-04T06:47:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[91314]: osdmap e366: 8 total, 7 up, 8 in 2024-03-04T06:47:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[91314]: from='osd.2 [v2:172.21.15.137:6818/2721042151,v1:172.21.15.137:6819/2721042151]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:47:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[91314]: pgmap v222: 121 pgs: 11 active+undersized+degraded, 3 active+clean+snaptrim_error, 26 active+undersized, 81 active+clean; 162 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 344 KiB/s wr, 9 op/s; 33/342 objects degraded (9.649%) 2024-03-04T06:47:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[88869]: from='osd.2 [v2:172.21.15.137:6818/2721042151,v1:172.21.15.137:6819/2721042151]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[88869]: osdmap e366: 8 total, 7 up, 8 in 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[88869]: from='osd.2 [v2:172.21.15.137:6818/2721042151,v1:172.21.15.137:6819/2721042151]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[88869]: pgmap v222: 121 pgs: 11 active+undersized+degraded, 3 active+clean+snaptrim_error, 26 active+undersized, 81 active+clean; 162 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 344 KiB/s wr, 9 op/s; 33/342 objects degraded (9.649%) 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:10.319 INFO:tasks.rados.rados.0.smithi137.stdout:1575: done (7 left) 2024-03-04T06:47:10.319 INFO:tasks.rados.rados.0.smithi137.stdout:1576: copy_from oid 14 from oid 23 current snap is 147 2024-03-04T06:47:10.319 INFO:tasks.rados.rados.0.smithi137.stdout:1577: read oid 38 snap 146 2024-03-04T06:47:10.319 INFO:tasks.rados.rados.0.smithi137.stdout:1577: expect deleted 2024-03-04T06:47:10.319 INFO:tasks.rados.rados.0.smithi137.stdout:1578: rmattr oid 16 current snap is 147 2024-03-04T06:47:10.319 INFO:tasks.rados.rados.0.smithi137.stdout:1578: done (9 left) 2024-03-04T06:47:10.319 INFO:tasks.rados.rados.0.smithi137.stdout:1579: read oid 8 snap 143 2024-03-04T06:47:10.319 INFO:tasks.rados.rados.0.smithi137.stdout:1579: expect (ObjNum 393 snap 118 seq_num 393) 2024-03-04T06:47:10.319 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 147 2024-03-04T06:47:10.319 INFO:tasks.rados.rados.0.smithi137.stdout:1580: seq_num 516 ranges {1097728=647168,1744896=450560,2195456=352256} 2024-03-04T06:47:10.328 INFO:tasks.rados.rados.0.smithi137.stdout:1580: writing smithi13777483-1 from 1097728 to 1744896 tid 1 2024-03-04T06:47:10.332 INFO:tasks.rados.rados.0.smithi137.stdout:1580: writing smithi13777483-1 from 1744896 to 2195456 tid 2 2024-03-04T06:47:10.335 INFO:tasks.rados.rados.0.smithi137.stdout:1580: writing smithi13777483-1 from 2195456 to 2547712 tid 3 2024-03-04T06:47:10.335 INFO:tasks.rados.rados.0.smithi137.stdout:1581: rollback oid 16 current snap is 147 2024-03-04T06:47:10.335 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 16 to 143 2024-03-04T06:47:10.335 INFO:tasks.rados.rados.0.smithi137.stdout:1577: done (11 left) 2024-03-04T06:47:10.335 INFO:tasks.rados.rados.0.smithi137.stdout:1582: snap_create 2024-03-04T06:47:10.335 INFO:tasks.rados.rados.0.smithi137.stdout:1576: finishing copy_from racing read to smithi13777483-14 2024-03-04T06:47:10.337 INFO:tasks.rados.rados.0.smithi137.stdout:1576: finishing copy_from to smithi13777483-14 2024-03-04T06:47:10.337 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 616 (ObjNum 436 snap 128 seq_num 436) dirty exists 2024-03-04T06:47:10.344 INFO:tasks.rados.rados.0.smithi137.stdout:1579: expect (ObjNum 393 snap 118 seq_num 393) 2024-03-04T06:47:10.479 INFO:tasks.rados.rados.0.smithi137.stdout:1567: expect (ObjNum 472 snap 135 seq_num 472) 2024-03-04T06:47:10.479 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:10.326+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:10.479 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:10.326+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:10.480 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:10.329+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:10.480 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[91314]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:47:10.480 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[91314]: osd.2 [v2:172.21.15.137:6818/2721042151,v1:172.21.15.137:6819/2721042151] boot 2024-03-04T06:47:10.480 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[91314]: osdmap e367: 8 total, 8 up, 8 in 2024-03-04T06:47:10.480 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:47:10.480 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:10.480 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:10.480 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:10.480 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:10.480 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:10.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[88869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:47:10.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[88869]: osd.2 [v2:172.21.15.137:6818/2721042151,v1:172.21.15.137:6819/2721042151] boot 2024-03-04T06:47:10.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[88869]: osdmap e367: 8 total, 8 up, 8 in 2024-03-04T06:47:10.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:47:10.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:10.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:10.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:10.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:10.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:10.501 INFO:tasks.rados.rados.0.smithi137.stdout:1581: finishing rollback tid 0 to smithi13777483-16 2024-03-04T06:47:10.501 INFO:tasks.rados.rados.0.smithi137.stdout:1581: finishing rollback tid 1 to smithi13777483-16 2024-03-04T06:47:10.501 INFO:tasks.rados.rados.0.smithi137.stdout:1581: finishing rollback tid 2 to smithi13777483-16 2024-03-04T06:47:10.501 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16754 (ObjNum 419 snap 125 seq_num 419) dirty exists 2024-03-04T06:47:10.501 INFO:tasks.rados.rados.0.smithi137.stdout:1570: expect (ObjNum 434 snap 128 seq_num 434) 2024-03-04T06:47:10.505 INFO:tasks.rados.rados.0.smithi137.stdout:1580: finishing write tid 1 to smithi13777483-1 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1580: finishing write tid 2 to smithi13777483-1 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1580: finishing write tid 3 to smithi13777483-1 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1580: finishing write tid 4 to smithi13777483-1 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1580: finishing write tid 5 to smithi13777483-1 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1580: oid 1 updating version 0 to 1085 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1580: oid 1 updating version 1085 to 1086 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1580: oid 1 updating version 1086 to 1087 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1580: oid 1 version 1087 is already newer than 1084 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 1087 (ObjNum 516 snap 147 seq_num 516) dirty exists 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1580: left oid 1 (ObjNum 516 snap 147 seq_num 516) 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1563: finishing write tid 1 to smithi13777483-3 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1563: finishing write tid 2 to smithi13777483-3 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1563: finishing write tid 3 to smithi13777483-3 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1563: finishing write tid 4 to smithi13777483-3 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1563: finishing write tid 5 to smithi13777483-3 2024-03-04T06:47:10.506 INFO:tasks.rados.rados.0.smithi137.stdout:1563: oid 3 updating version 0 to 807 2024-03-04T06:47:10.507 INFO:tasks.rados.rados.0.smithi137.stdout:1563: oid 3 version 807 is already newer than 804 2024-03-04T06:47:10.507 INFO:tasks.rados.rados.0.smithi137.stdout:1563: oid 3 version 807 is already newer than 806 2024-03-04T06:47:10.507 INFO:tasks.rados.rados.0.smithi137.stdout:1563: oid 3 version 807 is already newer than 805 2024-03-04T06:47:10.507 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 807 (ObjNum 514 snap 146 seq_num 514) dirty exists 2024-03-04T06:47:10.507 INFO:tasks.rados.rados.0.smithi137.stdout:1563: left oid 3 (ObjNum 514 snap 146 seq_num 514) 2024-03-04T06:47:10.507 INFO:tasks.rados.rados.0.smithi137.stdout:1566: finishing copy_from to smithi13777483-9 2024-03-04T06:47:10.507 INFO:tasks.rados.rados.0.smithi137.stdout:1566: got expected ENOENT (src dne) 2024-03-04T06:47:10.507 INFO:tasks.rados.rados.0.smithi137.stdout:1566: finishing copy_from racing read to smithi13777483-9 2024-03-04T06:47:10.507 INFO:tasks.rados.rados.0.smithi137.stdout:1571: expect (ObjNum 506 snap 144 seq_num 506) 2024-03-04T06:47:10.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:10 smithi203 ceph-mon[85573]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:47:10.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:10 smithi203 ceph-mon[85573]: osd.2 [v2:172.21.15.137:6818/2721042151,v1:172.21.15.137:6819/2721042151] boot 2024-03-04T06:47:10.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:10 smithi203 ceph-mon[85573]: osdmap e367: 8 total, 8 up, 8 in 2024-03-04T06:47:10.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T06:47:10.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:10.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:10.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:10.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:10.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:11.328 INFO:tasks.rados.rados.0.smithi137.stdout:1562: done (11 left) 2024-03-04T06:47:11.329 INFO:tasks.rados.rados.0.smithi137.stdout:1563: done (10 left) 2024-03-04T06:47:11.329 INFO:tasks.rados.rados.0.smithi137.stdout:1566: done (9 left) 2024-03-04T06:47:11.329 INFO:tasks.rados.rados.0.smithi137.stdout:1567: done (8 left) 2024-03-04T06:47:11.329 INFO:tasks.rados.rados.0.smithi137.stdout:1570: done (7 left) 2024-03-04T06:47:11.329 INFO:tasks.rados.rados.0.smithi137.stdout:1571: done (6 left) 2024-03-04T06:47:11.329 INFO:tasks.rados.rados.0.smithi137.stdout:1572: done (5 left) 2024-03-04T06:47:11.329 INFO:tasks.rados.rados.0.smithi137.stdout:1576: done (4 left) 2024-03-04T06:47:11.329 INFO:tasks.rados.rados.0.smithi137.stdout:1579: done (3 left) 2024-03-04T06:47:11.329 INFO:tasks.rados.rados.0.smithi137.stdout:1580: done (2 left) 2024-03-04T06:47:11.329 INFO:tasks.rados.rados.0.smithi137.stdout:1581: done (1 left) 2024-03-04T06:47:11.329 INFO:tasks.rados.rados.0.smithi137.stdout:1582: done (0 left) 2024-03-04T06:47:11.329 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 148 2024-03-04T06:47:11.329 INFO:tasks.rados.rados.0.smithi137.stdout:1583: seq_num 517 ranges {3301376=663552,3964928=786432,4751360=16384} 2024-03-04T06:47:11.350 INFO:tasks.rados.rados.0.smithi137.stdout:1583: writing smithi13777483-8 from 3301376 to 3964928 tid 1 2024-03-04T06:47:11.354 INFO:tasks.rados.rados.0.smithi137.stdout:1583: writing smithi13777483-8 from 3964928 to 4751360 tid 2 2024-03-04T06:47:11.354 INFO:tasks.rados.rados.0.smithi137.stdout:1583: writing smithi13777483-8 from 4751360 to 4767744 tid 3 2024-03-04T06:47:11.355 INFO:tasks.rados.rados.0.smithi137.stdout:1584: delete oid 12 current snap is 148 2024-03-04T06:47:11.356 INFO:tasks.rados.rados.0.smithi137.stdout:1583: finishing write tid 1 to smithi13777483-8 2024-03-04T06:47:11.358 INFO:tasks.rados.rados.0.smithi137.stdout:1583: finishing write tid 2 to smithi13777483-8 2024-03-04T06:47:11.358 INFO:tasks.rados.rados.0.smithi137.stdout:1583: finishing write tid 3 to smithi13777483-8 2024-03-04T06:47:11.360 INFO:tasks.rados.rados.0.smithi137.stdout:1583: finishing write tid 4 to smithi13777483-8 2024-03-04T06:47:11.360 INFO:tasks.rados.rados.0.smithi137.stdout:1584: done (1 left) 2024-03-04T06:47:11.360 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 35 current snap is 148 2024-03-04T06:47:11.361 INFO:tasks.rados.rados.0.smithi137.stdout:1585: seq_num 519 ranges {5832704=696320,6529024=548864,7077888=253952} 2024-03-04T06:47:11.397 INFO:tasks.rados.rados.0.smithi137.stdout:1585: writing smithi13777483-35 from 5832704 to 6529024 tid 1 2024-03-04T06:47:11.400 INFO:tasks.rados.rados.0.smithi137.stdout:1585: writing smithi13777483-35 from 6529024 to 7077888 tid 2 2024-03-04T06:47:11.402 INFO:tasks.rados.rados.0.smithi137.stdout:1585: writing smithi13777483-35 from 7077888 to 7331840 tid 3 2024-03-04T06:47:11.402 INFO:tasks.rados.rados.0.smithi137.stdout:1586: delete oid 4 current snap is 148 2024-03-04T06:47:11.402 INFO:tasks.rados.rados.0.smithi137.stdout:1583: finishing write tid 5 to smithi13777483-8 2024-03-04T06:47:11.402 INFO:tasks.rados.rados.0.smithi137.stdout:1583: oid 8 updating version 0 to 15442 2024-03-04T06:47:11.402 INFO:tasks.rados.rados.0.smithi137.stdout:1583: oid 8 updating version 15442 to 15445 2024-03-04T06:47:11.402 INFO:tasks.rados.rados.0.smithi137.stdout:1583: oid 8 version 15445 is already newer than 15443 2024-03-04T06:47:11.402 INFO:tasks.rados.rados.0.smithi137.stdout:1583: oid 8 version 15445 is already newer than 15444 2024-03-04T06:47:11.402 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 15445 (ObjNum 517 snap 148 seq_num 517) dirty exists 2024-03-04T06:47:11.403 INFO:tasks.rados.rados.0.smithi137.stdout:1583: left oid 8 (ObjNum 517 snap 148 seq_num 517) 2024-03-04T06:47:11.403 INFO:tasks.rados.rados.0.smithi137.stdout:1583: done (2 left) 2024-03-04T06:47:11.403 INFO:tasks.rados.rados.0.smithi137.stdout:1586: done (1 left) 2024-03-04T06:47:11.404 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 148 2024-03-04T06:47:11.404 INFO:tasks.rados.rados.0.smithi137.stdout:1587: seq_num 521 ranges {4366336=729088,5095424=720896,5816320=81920} 2024-03-04T06:47:11.431 INFO:tasks.rados.rados.0.smithi137.stdout:1587: writing smithi13777483-47 from 4366336 to 5095424 tid 1 2024-03-04T06:47:11.437 INFO:tasks.rados.rados.0.smithi137.stdout:1587: writing smithi13777483-47 from 5095424 to 5816320 tid 2 2024-03-04T06:47:11.437 INFO:tasks.rados.rados.0.smithi137.stdout:1587: writing smithi13777483-47 from 5816320 to 5898240 tid 3 2024-03-04T06:47:11.437 INFO:tasks.rados.rados.0.smithi137.stdout:1588: rmattr oid 23 current snap is 148 2024-03-04T06:47:11.437 INFO:tasks.rados.rados.0.smithi137.stdout:1588: done (2 left) 2024-03-04T06:47:11.437 INFO:tasks.rados.rados.0.smithi137.stdout:1589: copy_from oid 30 from oid 2 current snap is 148 2024-03-04T06:47:11.437 INFO:tasks.rados.rados.0.smithi137.stdout:1585: finishing write tid 1 to smithi13777483-35 2024-03-04T06:47:11.437 INFO:tasks.rados.rados.0.smithi137.stdout:1585: finishing write tid 2 to smithi13777483-35 2024-03-04T06:47:11.437 INFO:tasks.rados.rados.0.smithi137.stdout:1585: finishing write tid 3 to smithi13777483-35 2024-03-04T06:47:11.437 INFO:tasks.rados.rados.0.smithi137.stdout:1585: finishing write tid 4 to smithi13777483-35 2024-03-04T06:47:11.437 INFO:tasks.rados.rados.0.smithi137.stdout:1585: finishing write tid 5 to smithi13777483-35 2024-03-04T06:47:11.437 INFO:tasks.rados.rados.0.smithi137.stdout:1585: oid 35 updating version 0 to 743 2024-03-04T06:47:11.437 INFO:tasks.rados.rados.0.smithi137.stdout:1585: oid 35 updating version 743 to 744 2024-03-04T06:47:11.437 INFO:tasks.rados.rados.0.smithi137.stdout:1585: oid 35 updating version 744 to 745 2024-03-04T06:47:11.438 INFO:tasks.rados.rados.0.smithi137.stdout:1585: oid 35 updating version 745 to 746 2024-03-04T06:47:11.438 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 746 (ObjNum 519 snap 148 seq_num 519) dirty exists 2024-03-04T06:47:11.438 INFO:tasks.rados.rados.0.smithi137.stdout:1585: left oid 35 (ObjNum 519 snap 148 seq_num 519) 2024-03-04T06:47:11.438 INFO:tasks.rados.rados.0.smithi137.stdout:1585: done (2 left) 2024-03-04T06:47:11.438 INFO:tasks.rados.rados.0.smithi137.stdout:1590: copy_from oid 18 from oid 44 current snap is 148 2024-03-04T06:47:11.438 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 148 2024-03-04T06:47:11.438 INFO:tasks.rados.rados.0.smithi137.stdout:1591: seq_num 522 ranges {0=745472,745472=606208,1351680=196608} 2024-03-04T06:47:11.441 INFO:tasks.rados.rados.0.smithi137.stdout:1591: writing smithi13777483-7 from 0 to 745472 tid 1 2024-03-04T06:47:11.445 INFO:tasks.rados.rados.0.smithi137.stdout:1591: writing smithi13777483-7 from 745472 to 1351680 tid 2 2024-03-04T06:47:11.446 INFO:tasks.rados.rados.0.smithi137.stdout:1591: writing smithi13777483-7 from 1351680 to 1548288 tid 3 2024-03-04T06:47:11.446 INFO:tasks.rados.rados.0.smithi137.stdout:1592: delete oid 46 current snap is 148 2024-03-04T06:47:11.447 INFO:tasks.rados.rados.0.smithi137.stdout:1587: finishing write tid 1 to smithi13777483-47 2024-03-04T06:47:11.447 INFO:tasks.rados.rados.0.smithi137.stdout:1587: finishing write tid 2 to smithi13777483-47 2024-03-04T06:47:11.447 INFO:tasks.rados.rados.0.smithi137.stdout:1589: finishing copy_from racing read to smithi13777483-30 2024-03-04T06:47:11.447 INFO:tasks.rados.rados.0.smithi137.stdout:1587: finishing write tid 3 to smithi13777483-47 2024-03-04T06:47:11.447 INFO:tasks.rados.rados.0.smithi137.stdout:1587: finishing write tid 4 to smithi13777483-47 2024-03-04T06:47:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:1587: finishing write tid 5 to smithi13777483-47 2024-03-04T06:47:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:1587: oid 47 updating version 0 to 972 2024-03-04T06:47:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:1587: oid 47 version 972 is already newer than 971 2024-03-04T06:47:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:1587: oid 47 updating version 972 to 973 2024-03-04T06:47:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:1587: oid 47 updating version 973 to 974 2024-03-04T06:47:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 974 (ObjNum 521 snap 148 seq_num 521) dirty exists 2024-03-04T06:47:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:1587: left oid 47 (ObjNum 521 snap 148 seq_num 521) 2024-03-04T06:47:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:1589: finishing copy_from to smithi13777483-30 2024-03-04T06:47:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 1080 (ObjNum 472 snap 135 seq_num 472) dirty exists 2024-03-04T06:47:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:1591: finishing write tid 1 to smithi13777483-7 2024-03-04T06:47:11.450 INFO:tasks.rados.rados.0.smithi137.stdout:1591: finishing write tid 2 to smithi13777483-7 2024-03-04T06:47:11.450 INFO:tasks.rados.rados.0.smithi137.stdout:1591: finishing write tid 3 to smithi13777483-7 2024-03-04T06:47:11.450 INFO:tasks.rados.rados.0.smithi137.stdout:1591: finishing write tid 4 to smithi13777483-7 2024-03-04T06:47:11.451 INFO:tasks.rados.rados.0.smithi137.stdout:1587: done (4 left) 2024-03-04T06:47:11.451 INFO:tasks.rados.rados.0.smithi137.stdout:1589: done (3 left) 2024-03-04T06:47:11.451 INFO:tasks.rados.rados.0.smithi137.stdout:1592: done (2 left) 2024-03-04T06:47:11.451 INFO:tasks.rados.rados.0.smithi137.stdout:1593: read oid 16 snap -1 2024-03-04T06:47:11.451 INFO:tasks.rados.rados.0.smithi137.stdout:1593: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:47:11.451 INFO:tasks.rados.rados.0.smithi137.stdout:1594: delete oid 30 current snap is 148 2024-03-04T06:47:11.452 INFO:tasks.rados.rados.0.smithi137.stdout:1591: finishing write tid 5 to smithi13777483-7 2024-03-04T06:47:11.453 INFO:tasks.rados.rados.0.smithi137.stdout:1591: oid 7 updating version 0 to 15448 2024-03-04T06:47:11.453 INFO:tasks.rados.rados.0.smithi137.stdout:1591: oid 7 updating version 15448 to 15449 2024-03-04T06:47:11.453 INFO:tasks.rados.rados.0.smithi137.stdout:1591: oid 7 version 15449 is already newer than 15446 2024-03-04T06:47:11.453 INFO:tasks.rados.rados.0.smithi137.stdout:1591: oid 7 version 15449 is already newer than 15447 2024-03-04T06:47:11.453 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 15449 (ObjNum 522 snap 148 seq_num 522) dirty exists 2024-03-04T06:47:11.453 INFO:tasks.rados.rados.0.smithi137.stdout:1591: left oid 7 (ObjNum 522 snap 148 seq_num 522) 2024-03-04T06:47:11.455 INFO:tasks.rados.rados.0.smithi137.stdout:1591: done (3 left) 2024-03-04T06:47:11.455 INFO:tasks.rados.rados.0.smithi137.stdout:1594: done (2 left) 2024-03-04T06:47:11.455 INFO:tasks.rados.rados.0.smithi137.stdout:1595: snap_create 2024-03-04T06:47:11.480 INFO:tasks.rados.rados.0.smithi137.stdout:1590: finishing copy_from racing read to smithi13777483-18 2024-03-04T06:47:11.485 INFO:tasks.rados.rados.0.smithi137.stdout:1593: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:47:11.490 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-mon[88869]: osdmap e368: 8 total, 8 up, 8 in 2024-03-04T06:47:11.490 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:11.490 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:11.490 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:11.490 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-mon[88869]: pgmap v225: 121 pgs: 15 peering, 8 active+undersized+degraded, 3 active+clean+snaptrim, 3 active+clean+snaptrim_error, 14 active+undersized, 78 active+clean; 166 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 1.3 MiB/s wr, 21 op/s; 28/366 objects degraded (7.650%) 2024-03-04T06:47:11.490 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-mon[91314]: osdmap e368: 8 total, 8 up, 8 in 2024-03-04T06:47:11.490 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:11.490 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:11.490 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:11.491 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-mon[91314]: pgmap v225: 121 pgs: 15 peering, 8 active+undersized+degraded, 3 active+clean+snaptrim, 3 active+clean+snaptrim_error, 14 active+undersized, 78 active+clean; 166 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 1.3 MiB/s wr, 21 op/s; 28/366 objects degraded (7.650%) 2024-03-04T06:47:11.491 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:11.360+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:11.491 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:11.360+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:11.491 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:11.360+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:11.491 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:11.332+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:11.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:11 smithi203 ceph-mon[85573]: osdmap e368: 8 total, 8 up, 8 in 2024-03-04T06:47:11.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:11.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:11.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:11.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:11 smithi203 ceph-mon[85573]: pgmap v225: 121 pgs: 15 peering, 8 active+undersized+degraded, 3 active+clean+snaptrim, 3 active+clean+snaptrim_error, 14 active+undersized, 78 active+clean; 166 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 1.3 MiB/s wr, 21 op/s; 28/366 objects degraded (7.650%) 2024-03-04T06:47:11.948 INFO:tasks.rados.rados.0.smithi137.stdout:1590: finishing copy_from to smithi13777483-18 2024-03-04T06:47:11.948 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16741 (ObjNum 470 snap 134 seq_num 470) dirty exists 2024-03-04T06:47:12.347 INFO:tasks.rados.rados.0.smithi137.stdout:1590: done (2 left) 2024-03-04T06:47:12.348 INFO:tasks.rados.rados.0.smithi137.stdout:1593: done (1 left) 2024-03-04T06:47:12.348 INFO:tasks.rados.rados.0.smithi137.stdout:1595: done (0 left) 2024-03-04T06:47:12.348 INFO:tasks.rados.rados.0.smithi137.stdout:1596: delete oid 9 current snap is 149 2024-03-04T06:47:12.351 INFO:tasks.rados.rados.0.smithi137.stdout:1596: done (0 left) 2024-03-04T06:47:12.351 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 149 2024-03-04T06:47:12.351 INFO:tasks.rados.rados.0.smithi137.stdout:1597: seq_num 526 ranges {5808128=417792,6225920=589824,6815744=614400} 2024-03-04T06:47:12.385 INFO:tasks.rados.rados.0.smithi137.stdout:1597: writing smithi13777483-39 from 5808128 to 6225920 tid 1 2024-03-04T06:47:12.389 INFO:tasks.rados.rados.0.smithi137.stdout:1597: writing smithi13777483-39 from 6225920 to 6815744 tid 2 2024-03-04T06:47:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:1597: writing smithi13777483-39 from 6815744 to 7430144 tid 3 2024-03-04T06:47:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 149 2024-03-04T06:47:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:1597: finishing write tid 1 to smithi13777483-39 2024-03-04T06:47:12.393 INFO:tasks.rados.rados.0.smithi137.stdout:1598: seq_num 527 ranges {5898240=434176,6332416=475136,6807552=565248,7372800=163840} 2024-03-04T06:47:12.427 INFO:tasks.rados.rados.0.smithi137.stdout:1598: writing smithi13777483-47 from 5898240 to 6332416 tid 1 2024-03-04T06:47:12.430 INFO:tasks.rados.rados.0.smithi137.stdout:1598: writing smithi13777483-47 from 6332416 to 6807552 tid 2 2024-03-04T06:47:12.434 INFO:tasks.rados.rados.0.smithi137.stdout:1598: writing smithi13777483-47 from 6807552 to 7372800 tid 3 2024-03-04T06:47:12.435 INFO:tasks.rados.rados.0.smithi137.stdout:1598: writing smithi13777483-47 from 7372800 to 7536640 tid 4 2024-03-04T06:47:12.435 INFO:tasks.rados.rados.0.smithi137.stdout:1599: read oid 32 snap -1 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:1599: expect deleted 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:1600: snap_create 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:1597: finishing write tid 2 to smithi13777483-39 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:1597: finishing write tid 3 to smithi13777483-39 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:1597: finishing write tid 4 to smithi13777483-39 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:1597: finishing write tid 5 to smithi13777483-39 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:1597: oid 39 updating version 0 to 377 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:1597: oid 39 version 377 is already newer than 376 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:1597: oid 39 updating version 377 to 379 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:1597: oid 39 version 379 is already newer than 378 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 379 (ObjNum 526 snap 149 seq_num 526) dirty exists 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:1597: left oid 39 (ObjNum 526 snap 149 seq_num 526) 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:1598: finishing write tid 1 to smithi13777483-47 2024-03-04T06:47:12.436 INFO:tasks.rados.rados.0.smithi137.stdout:1598: finishing write tid 2 to smithi13777483-47 2024-03-04T06:47:12.439 INFO:tasks.rados.rados.0.smithi137.stdout:1598: finishing write tid 3 to smithi13777483-47 2024-03-04T06:47:12.440 INFO:tasks.rados.rados.0.smithi137.stdout:1598: finishing write tid 4 to smithi13777483-47 2024-03-04T06:47:12.440 INFO:tasks.rados.rados.0.smithi137.stdout:1598: finishing write tid 5 to smithi13777483-47 2024-03-04T06:47:12.441 INFO:tasks.rados.rados.0.smithi137.stdout:1598: finishing write tid 6 to smithi13777483-47 2024-03-04T06:47:12.441 INFO:tasks.rados.rados.0.smithi137.stdout:1598: oid 47 updating version 0 to 979 2024-03-04T06:47:12.441 INFO:tasks.rados.rados.0.smithi137.stdout:1598: oid 47 version 979 is already newer than 976 2024-03-04T06:47:12.441 INFO:tasks.rados.rados.0.smithi137.stdout:1598: oid 47 version 979 is already newer than 977 2024-03-04T06:47:12.441 INFO:tasks.rados.rados.0.smithi137.stdout:1598: oid 47 version 979 is already newer than 978 2024-03-04T06:47:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:1598: oid 47 updating version 979 to 980 2024-03-04T06:47:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 980 (ObjNum 527 snap 149 seq_num 527) dirty exists 2024-03-04T06:47:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:1598: left oid 47 (ObjNum 527 snap 149 seq_num 527) 2024-03-04T06:47:12.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:12 smithi203 ceph-mon[85573]: Health check update: Degraded data redundancy: 28/366 objects degraded (7.650%), 8 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:12.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:12 smithi203 ceph-mon[85573]: osdmap e369: 8 total, 8 up, 8 in 2024-03-04T06:47:12.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:12.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:12.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:12.732 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:12.394+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:12.733 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:12 smithi137 ceph-mon[88869]: Health check update: Degraded data redundancy: 28/366 objects degraded (7.650%), 8 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:12.733 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:12 smithi137 ceph-mon[88869]: osdmap e369: 8 total, 8 up, 8 in 2024-03-04T06:47:12.733 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:12.733 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:12.733 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:12.733 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:12 smithi137 ceph-mon[91314]: Health check update: Degraded data redundancy: 28/366 objects degraded (7.650%), 8 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:12.733 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:12 smithi137 ceph-mon[91314]: osdmap e369: 8 total, 8 up, 8 in 2024-03-04T06:47:12.734 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:12.734 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:12.734 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:12.734 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:12.350+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:12.734 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:12.350+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:13.340 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:47:13.281+0000 7fca9a02c700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-04T06:47:13.353 INFO:tasks.rados.rados.0.smithi137.stdout:1597: done (3 left) 2024-03-04T06:47:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:1598: done (2 left) 2024-03-04T06:47:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:1599: done (1 left) 2024-03-04T06:47:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:1600: done (0 left) 2024-03-04T06:47:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:1601: copy_from oid 23 from oid 48 current snap is 150 2024-03-04T06:47:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:1602: delete oid 40 current snap is 150 2024-03-04T06:47:13.356 INFO:tasks.rados.rados.0.smithi137.stdout:1602: done (1 left) 2024-03-04T06:47:13.356 INFO:tasks.rados.rados.0.smithi137.stdout:1603: snap_remove snap 148 2024-03-04T06:47:13.592 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:13.355+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:13.592 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:13.355+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:13.592 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:13.355+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:13.592 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: pgmap v227: 121 pgs: 15 peering, 8 active+undersized+degraded, 3 active+clean+snaptrim, 3 active+clean+snaptrim_error, 14 active+undersized, 78 active+clean; 166 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 951 KiB/s wr, 11 op/s; 28/366 objects degraded (7.650%) 2024-03-04T06:47:13.592 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: osdmap e370: 8 total, 8 up, 8 in 2024-03-04T06:47:13.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:13.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:13.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:13.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:13.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:13.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:47:13.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:47:13.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:13.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:47:13.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:13.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:13.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:13.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-04T06:47:13.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: pgmap v227: 121 pgs: 15 peering, 8 active+undersized+degraded, 3 active+clean+snaptrim, 3 active+clean+snaptrim_error, 14 active+undersized, 78 active+clean; 166 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 951 KiB/s wr, 11 op/s; 28/366 objects degraded (7.650%) 2024-03-04T06:47:13.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: osdmap e370: 8 total, 8 up, 8 in 2024-03-04T06:47:13.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:13.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:13.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:13.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:13.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:13.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:47:13.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:47:13.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:13.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:47:13.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:13.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:13.595 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:13.595 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-04T06:47:13.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: pgmap v227: 121 pgs: 15 peering, 8 active+undersized+degraded, 3 active+clean+snaptrim, 3 active+clean+snaptrim_error, 14 active+undersized, 78 active+clean; 166 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 951 KiB/s wr, 11 op/s; 28/366 objects degraded (7.650%) 2024-03-04T06:47:13.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: osdmap e370: 8 total, 8 up, 8 in 2024-03-04T06:47:13.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:13.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:13.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:13.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:13.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:13.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:47:13.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:47:13.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:13.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:47:13.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:13.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:13.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:13.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-04T06:47:14.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:13.589+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:14.362 INFO:tasks.rados.rados.0.smithi137.stdout:1603: done (1 left) 2024-03-04T06:47:14.362 INFO:tasks.rados.rados.0.smithi137.stdout:1604: setattr oid 37 current snap is 150 2024-03-04T06:47:14.363 INFO:tasks.rados.rados.0.smithi137.stdout:1601: finishing copy_from racing read to smithi13777483-23 2024-03-04T06:47:14.363 INFO:tasks.rados.rados.0.smithi137.stdout:1601: finishing copy_from to smithi13777483-23 2024-03-04T06:47:14.363 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 926 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:47:14.363 INFO:tasks.rados.rados.0.smithi137.stdout:1601: done (1 left) 2024-03-04T06:47:14.363 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 150 2024-03-04T06:47:14.363 INFO:tasks.rados.rados.0.smithi137.stdout:1605: seq_num 529 ranges {0=466944,466944=647168,1114112=532480,1646592=24576} 2024-03-04T06:47:14.366 INFO:tasks.rados.rados.0.smithi137.stdout:1605: writing smithi13777483-46 from 0 to 466944 tid 1 2024-03-04T06:47:14.370 INFO:tasks.rados.rados.0.smithi137.stdout:1605: writing smithi13777483-46 from 466944 to 1114112 tid 2 2024-03-04T06:47:14.374 INFO:tasks.rados.rados.0.smithi137.stdout:1605: writing smithi13777483-46 from 1114112 to 1646592 tid 3 2024-03-04T06:47:14.374 INFO:tasks.rados.rados.0.smithi137.stdout:1605: writing smithi13777483-46 from 1646592 to 1671168 tid 4 2024-03-04T06:47:14.374 INFO:tasks.rados.rados.0.smithi137.stdout:1606: delete oid 23 current snap is 150 2024-03-04T06:47:14.374 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 943 (ObjNum 33 snap 0 seq_num 3131046144) dirty exists 2024-03-04T06:47:14.375 INFO:tasks.rados.rados.0.smithi137.stdout:1605: finishing write tid 1 to smithi13777483-46 2024-03-04T06:47:14.377 INFO:tasks.rados.rados.0.smithi137.stdout:1604: done (2 left) 2024-03-04T06:47:14.377 INFO:tasks.rados.rados.0.smithi137.stdout:1606: done (1 left) 2024-03-04T06:47:14.377 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 150 2024-03-04T06:47:14.377 INFO:tasks.rados.rados.0.smithi137.stdout:1607: seq_num 531 ranges {2023424=499712,2523136=417792,2940928=548864,3489792=237568} 2024-03-04T06:47:14.390 INFO:tasks.rados.rados.0.smithi137.stdout:1607: writing smithi13777483-26 from 2023424 to 2523136 tid 1 2024-03-04T06:47:14.393 INFO:tasks.rados.rados.0.smithi137.stdout:1607: writing smithi13777483-26 from 2523136 to 2940928 tid 2 2024-03-04T06:47:14.396 INFO:tasks.rados.rados.0.smithi137.stdout:1607: writing smithi13777483-26 from 2940928 to 3489792 tid 3 2024-03-04T06:47:14.398 INFO:tasks.rados.rados.0.smithi137.stdout:1607: writing smithi13777483-26 from 3489792 to 3727360 tid 4 2024-03-04T06:47:14.398 INFO:tasks.rados.rados.0.smithi137.stdout:1608: snap_remove snap 149 2024-03-04T06:47:14.469 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-04T06:47:14.469 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-mon[88869]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-04T06:47:14.469 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-mon[88869]: osdmap e371: 8 total, 8 up, 8 in 2024-03-04T06:47:14.469 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:14.469 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:14.469 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:14.469 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-04T06:47:14.469 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-mon[91314]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-04T06:47:14.469 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-mon[91314]: osdmap e371: 8 total, 8 up, 8 in 2024-03-04T06:47:14.470 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:14.470 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:14.470 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:14.470 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:14.365+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:14.470 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:14.365+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:14.470 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:14.373+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:14 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-04T06:47:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:14 smithi203 ceph-mon[85573]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-04T06:47:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:14 smithi203 ceph-mon[85573]: osdmap e371: 8 total, 8 up, 8 in 2024-03-04T06:47:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:15.369 INFO:tasks.rados.rados.0.smithi137.stdout:1605: finishing write tid 2 to smithi13777483-46 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1605: finishing write tid 3 to smithi13777483-46 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1605: finishing write tid 4 to smithi13777483-46 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1605: finishing write tid 5 to smithi13777483-46 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1605: finishing write tid 6 to smithi13777483-46 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1605: oid 46 updating version 0 to 1114 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1605: oid 46 version 1114 is already newer than 1112 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1605: oid 46 version 1114 is already newer than 1113 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1605: oid 46 version 1114 is already newer than 1111 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1605: oid 46 version 1114 is already newer than 1110 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 1114 (ObjNum 529 snap 150 seq_num 529) dirty exists 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1605: left oid 46 (ObjNum 529 snap 150 seq_num 529) 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1607: finishing write tid 1 to smithi13777483-26 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1607: finishing write tid 2 to smithi13777483-26 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1607: finishing write tid 3 to smithi13777483-26 2024-03-04T06:47:15.370 INFO:tasks.rados.rados.0.smithi137.stdout:1607: finishing write tid 4 to smithi13777483-26 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:1607: finishing write tid 5 to smithi13777483-26 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:1607: finishing write tid 6 to smithi13777483-26 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:1607: oid 26 updating version 0 to 16746 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:1607: oid 26 version 16746 is already newer than 16742 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:1607: oid 26 version 16746 is already newer than 16744 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:1607: oid 26 version 16746 is already newer than 16743 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:1607: oid 26 version 16746 is already newer than 16745 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16746 (ObjNum 531 snap 150 seq_num 531) dirty exists 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:1607: left oid 26 (ObjNum 531 snap 150 seq_num 531) 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:1605: done (2 left) 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:1607: done (1 left) 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:1608: done (0 left) 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 150 2024-03-04T06:47:15.371 INFO:tasks.rados.rados.0.smithi137.stdout:1609: seq_num 532 ranges {1859584=516096,2375680=696320,3072000=507904} 2024-03-04T06:47:15.382 INFO:tasks.rados.rados.0.smithi137.stdout:1609: writing smithi13777483-27 from 1859584 to 2375680 tid 1 2024-03-04T06:47:15.386 INFO:tasks.rados.rados.0.smithi137.stdout:1609: writing smithi13777483-27 from 2375680 to 3072000 tid 2 2024-03-04T06:47:15.389 INFO:tasks.rados.rados.0.smithi137.stdout:1609: writing smithi13777483-27 from 3072000 to 3579904 tid 3 2024-03-04T06:47:15.390 INFO:tasks.rados.rados.0.smithi137.stdout:1610: snap_create 2024-03-04T06:47:15.390 INFO:tasks.rados.rados.0.smithi137.stdout:1609: finishing write tid 1 to smithi13777483-27 2024-03-04T06:47:15.390 INFO:tasks.rados.rados.0.smithi137.stdout:1609: finishing write tid 2 to smithi13777483-27 2024-03-04T06:47:15.392 INFO:tasks.rados.rados.0.smithi137.stdout:1609: finishing write tid 3 to smithi13777483-27 2024-03-04T06:47:15.392 INFO:tasks.rados.rados.0.smithi137.stdout:1609: finishing write tid 4 to smithi13777483-27 2024-03-04T06:47:15.393 INFO:tasks.rados.rados.0.smithi137.stdout:1609: finishing write tid 5 to smithi13777483-27 2024-03-04T06:47:15.393 INFO:tasks.rados.rados.0.smithi137.stdout:1609: oid 27 updating version 0 to 1118 2024-03-04T06:47:15.394 INFO:tasks.rados.rados.0.smithi137.stdout:1609: oid 27 version 1118 is already newer than 1116 2024-03-04T06:47:15.394 INFO:tasks.rados.rados.0.smithi137.stdout:1609: oid 27 updating version 1118 to 1119 2024-03-04T06:47:15.394 INFO:tasks.rados.rados.0.smithi137.stdout:1609: oid 27 version 1119 is already newer than 1117 2024-03-04T06:47:15.394 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 1119 (ObjNum 532 snap 150 seq_num 532) dirty exists 2024-03-04T06:47:15.394 INFO:tasks.rados.rados.0.smithi137.stdout:1609: left oid 27 (ObjNum 532 snap 150 seq_num 532) 2024-03-04T06:47:15.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:47:15] "GET /metrics HTTP/1.1" 200 36125 "" "Prometheus/2.43.0" 2024-03-04T06:47:15.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-mon[88869]: pgmap v230: 121 pgs: 2 peering, 1 active+clean+snaptrim, 3 active+clean+snaptrim_error, 115 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 6.4 MiB/s wr, 25 op/s; 7.9 MiB/s, 5 objects/s recovering 2024-03-04T06:47:15.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-mon[88869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/366 objects degraded (7.650%), 8 pgs degraded) 2024-03-04T06:47:15.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-mon[88869]: osdmap e372: 8 total, 8 up, 8 in 2024-03-04T06:47:15.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:15.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:15.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:15.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:15.384+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-mon[91314]: pgmap v230: 121 pgs: 2 peering, 1 active+clean+snaptrim, 3 active+clean+snaptrim_error, 115 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 6.4 MiB/s wr, 25 op/s; 7.9 MiB/s, 5 objects/s recovering 2024-03-04T06:47:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-mon[91314]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/366 objects degraded (7.650%), 8 pgs degraded) 2024-03-04T06:47:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-mon[91314]: osdmap e372: 8 total, 8 up, 8 in 2024-03-04T06:47:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:15 smithi203 ceph-mon[85573]: pgmap v230: 121 pgs: 2 peering, 1 active+clean+snaptrim, 3 active+clean+snaptrim_error, 115 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 6.4 MiB/s wr, 25 op/s; 7.9 MiB/s, 5 objects/s recovering 2024-03-04T06:47:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:15 smithi203 ceph-mon[85573]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/366 objects degraded (7.650%), 8 pgs degraded) 2024-03-04T06:47:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:15 smithi203 ceph-mon[85573]: osdmap e372: 8 total, 8 up, 8 in 2024-03-04T06:47:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:16.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:15.853+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:16.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:15.853+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:16.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:15.853+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:16.382 INFO:tasks.rados.rados.0.smithi137.stdout:1609: done (1 left) 2024-03-04T06:47:16.382 INFO:tasks.rados.rados.0.smithi137.stdout:1610: done (0 left) 2024-03-04T06:47:16.382 INFO:tasks.rados.rados.0.smithi137.stdout:1611: rollback oid 36 current snap is 151 2024-03-04T06:47:16.382 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 36 to 147 2024-03-04T06:47:16.382 INFO:tasks.rados.rados.0.smithi137.stdout:1612: snap_create 2024-03-04T06:47:16.389 INFO:tasks.rados.rados.0.smithi137.stdout:1611: finishing rollback tid 0 to smithi13777483-36 2024-03-04T06:47:16.390 INFO:tasks.rados.rados.0.smithi137.stdout:1611: finishing rollback tid 1 to smithi13777483-36 2024-03-04T06:47:16.390 INFO:tasks.rados.rados.0.smithi137.stdout:1611: finishing rollback tid 2 to smithi13777483-36 2024-03-04T06:47:16.390 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 340 (ObjNum 434 snap 128 seq_num 434) dirty exists 2024-03-04T06:47:16.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:16 smithi137 ceph-mon[88869]: osdmap e373: 8 total, 8 up, 8 in 2024-03-04T06:47:16.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:16.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:16 smithi137 ceph-mon[91314]: osdmap e373: 8 total, 8 up, 8 in 2024-03-04T06:47:16.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:16.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:16.389+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:16.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:16.389+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:16.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:16.388+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:16 smithi203 ceph-mon[85573]: osdmap e373: 8 total, 8 up, 8 in 2024-03-04T06:47:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:17.380 INFO:tasks.rados.rados.0.smithi137.stdout:1611: done (1 left) 2024-03-04T06:47:17.380 INFO:tasks.rados.rados.0.smithi137.stdout:1612: done (0 left) 2024-03-04T06:47:17.380 INFO:tasks.rados.rados.0.smithi137.stdout:1613: read oid 4 snap 146 2024-03-04T06:47:17.380 INFO:tasks.rados.rados.0.smithi137.stdout:1613: expect deleted 2024-03-04T06:47:17.380 INFO:tasks.rados.rados.0.smithi137.stdout:1614: snap_remove snap 147 2024-03-04T06:47:17.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:17.588+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[88869]: pgmap v233: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 14 MiB/s rd, 7.1 MiB/s wr, 29 op/s; 7.9 MiB/s, 5 objects/s recovering 2024-03-04T06:47:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[88869]: osdmap e374: 8 total, 8 up, 8 in 2024-03-04T06:47:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:17.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:17.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:17.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[91314]: pgmap v233: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 14 MiB/s rd, 7.1 MiB/s wr, 29 op/s; 7.9 MiB/s, 5 objects/s recovering 2024-03-04T06:47:17.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[91314]: osdmap e374: 8 total, 8 up, 8 in 2024-03-04T06:47:17.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:17.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:17.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:17.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:17.383+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:17.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:17.384+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:17.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:17.384+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:17.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:17.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:17.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:17 smithi203 ceph-mon[85573]: pgmap v233: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 14 MiB/s rd, 7.1 MiB/s wr, 29 op/s; 7.9 MiB/s, 5 objects/s recovering 2024-03-04T06:47:17.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:17 smithi203 ceph-mon[85573]: osdmap e374: 8 total, 8 up, 8 in 2024-03-04T06:47:17.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:17.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:17.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:18.380 INFO:tasks.rados.rados.0.smithi137.stdout:1613: done (1 left) 2024-03-04T06:47:18.380 INFO:tasks.rados.rados.0.smithi137.stdout:1614: done (0 left) 2024-03-04T06:47:18.381 INFO:tasks.rados.rados.0.smithi137.stdout:1615: setattr oid 3 current snap is 152 2024-03-04T06:47:18.383 INFO:tasks.rados.rados.0.smithi137.stdout:1616: snap_remove snap 142 2024-03-04T06:47:18.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:18.385+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:18.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:18.385+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-mon[88869]: osdmap e375: 8 total, 8 up, 8 in 2024-03-04T06:47:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-mon[88869]: pgmap v236: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 197 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.9 MiB/s wr, 8 op/s 2024-03-04T06:47:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-mon[88869]: osdmap e376: 8 total, 8 up, 8 in 2024-03-04T06:47:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-mon[91314]: osdmap e375: 8 total, 8 up, 8 in 2024-03-04T06:47:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:18.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-mon[91314]: pgmap v236: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 197 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.9 MiB/s wr, 8 op/s 2024-03-04T06:47:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-mon[91314]: osdmap e376: 8 total, 8 up, 8 in 2024-03-04T06:47:18.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:18.384+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:18 smithi203 ceph-mon[85573]: osdmap e375: 8 total, 8 up, 8 in 2024-03-04T06:47:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:18 smithi203 ceph-mon[85573]: pgmap v236: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 197 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.9 MiB/s wr, 8 op/s 2024-03-04T06:47:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:18 smithi203 ceph-mon[85573]: osdmap e376: 8 total, 8 up, 8 in 2024-03-04T06:47:19.329 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:47:19.381 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 815 (ObjNum 514 snap 146 seq_num 514) dirty exists 2024-03-04T06:47:19.381 INFO:tasks.rados.rados.0.smithi137.stdout:1615: done (1 left) 2024-03-04T06:47:19.381 INFO:tasks.rados.rados.0.smithi137.stdout:1616: done (0 left) 2024-03-04T06:47:19.382 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 152 2024-03-04T06:47:19.382 INFO:tasks.rados.rados.0.smithi137.stdout:1617: seq_num 533 ranges {1671168=532480,2203648=630784,2834432=516096,3350528=57344} 2024-03-04T06:47:19.394 INFO:tasks.rados.rados.0.smithi137.stdout:1617: writing smithi13777483-46 from 1671168 to 2203648 tid 1 2024-03-04T06:47:19.399 INFO:tasks.rados.rados.0.smithi137.stdout:1617: writing smithi13777483-46 from 2203648 to 2834432 tid 2 2024-03-04T06:47:19.403 INFO:tasks.rados.rados.0.smithi137.stdout:1617: writing smithi13777483-46 from 2834432 to 3350528 tid 3 2024-03-04T06:47:19.403 INFO:tasks.rados.rados.0.smithi137.stdout:1617: writing smithi13777483-46 from 3350528 to 3407872 tid 4 2024-03-04T06:47:19.403 INFO:tasks.rados.rados.0.smithi137.stdout:1618: copy_from oid 29 from oid 48 current snap is 152 2024-03-04T06:47:19.403 INFO:tasks.rados.rados.0.smithi137.stdout:1619: snap_remove snap 146 2024-03-04T06:47:19.656 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:47:19.656 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (7m) 11s ago 7m 26.4M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (7m) 2m ago 7m 87.9M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (9m) 11s ago 9m 18.5M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (9m) 2m ago 9m 18.6M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (3m) 2m ago 12m 448M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (3m) 11s ago 14m 505M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (2m) 11s ago 14m 50.2M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (2m) 2m ago 13m 29.9M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (2m) 11s ago 12m 47.1M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (7m) 11s ago 7m 16.5M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (7m) 2m ago 7m 15.6M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (86s) 11s ago 12m 186M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 bd2207652b33 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (50s) 11s ago 11m 120M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 47b5cdaad147 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (15s) 11s ago 11m 11.6M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 436ae07776d9 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (11m) 11s ago 11m 283M 2480M 18.2.1-696-g5cc7a767 540557f94930 afdbc25c9fba 2024-03-04T06:47:19.657 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (10m) 2m ago 10m 212M 2480M 18.2.1-696-g5cc7a767 540557f94930 d4841ffd0747 2024-03-04T06:47:19.658 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (10m) 2m ago 10m 225M 2480M 18.2.1-696-g5cc7a767 540557f94930 81d21771e157 2024-03-04T06:47:19.658 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (9m) 2m ago 9m 109M 2480M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:47:19.658 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (9m) 2m ago 9m 136M 2480M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:47:19.658 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (3m) 2m ago 8m 49.8M - 2.43.0 a07b618ecd1d 6a88bdd1023c 2024-03-04T06:47:19.658 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:19.658 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:19.658 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:19.658 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-mon[88869]: from='client.44189 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:47:19.658 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-mon[88869]: osdmap e377: 8 total, 8 up, 8 in 2024-03-04T06:47:19.659 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:19.659 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:19.659 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:19.659 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-mon[91314]: from='client.44189 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:47:19.659 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-mon[91314]: osdmap e377: 8 total, 8 up, 8 in 2024-03-04T06:47:19.659 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:19.391+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:19.659 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:19.386+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:19.659 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:19.386+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:19.659 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:19.386+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:19 smithi203 ceph-mon[85573]: from='client.44189 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:47:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:19 smithi203 ceph-mon[85573]: osdmap e377: 8 total, 8 up, 8 in 2024-03-04T06:47:20.048 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 5, 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:47:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:47:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 7, 2024-03-04T06:47:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 8 2024-03-04T06:47:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:47:20.050 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:47:20.404 INFO:tasks.rados.rados.0.smithi137.stdout:1619: done (2 left) 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 152 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:1617: finishing write tid 1 to smithi13777483-46 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:1617: finishing write tid 2 to smithi13777483-46 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:1617: finishing write tid 3 to smithi13777483-46 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:1617: finishing write tid 4 to smithi13777483-46 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:1617: finishing write tid 5 to smithi13777483-46 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:1617: finishing write tid 6 to smithi13777483-46 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:1617: oid 46 updating version 0 to 1134 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:1617: oid 46 version 1134 is already newer than 1129 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:1617: oid 46 updating version 1134 to 1137 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:1617: oid 46 version 1137 is already newer than 1135 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:1617: oid 46 version 1137 is already newer than 1136 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 1137 (ObjNum 533 snap 152 seq_num 533) dirty exists 2024-03-04T06:47:20.405 INFO:tasks.rados.rados.0.smithi137.stdout:1617: left oid 46 (ObjNum 533 snap 152 seq_num 533) 2024-03-04T06:47:20.406 INFO:tasks.rados.rados.0.smithi137.stdout:1618: finishing copy_from racing read to smithi13777483-29 2024-03-04T06:47:20.406 INFO:tasks.rados.rados.0.smithi137.stdout:1618: finishing copy_from to smithi13777483-29 2024-03-04T06:47:20.406 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 926 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:47:20.406 INFO:tasks.rados.rados.0.smithi137.stdout:1620: seq_num 534 ranges {3858432=548864,4407296=516096,4923392=688128} 2024-03-04T06:47:20.428 INFO:tasks.rados.rados.0.smithi137.stdout:1620: writing smithi13777483-49 from 3858432 to 4407296 tid 1 2024-03-04T06:47:20.431 INFO:tasks.rados.rados.0.smithi137.stdout:1620: writing smithi13777483-49 from 4407296 to 4923392 tid 2 2024-03-04T06:47:20.435 INFO:tasks.rados.rados.0.smithi137.stdout:1620: writing smithi13777483-49 from 4923392 to 5611520 tid 3 2024-03-04T06:47:20.435 INFO:tasks.rados.rados.0.smithi137.stdout:1617: done (2 left) 2024-03-04T06:47:20.435 INFO:tasks.rados.rados.0.smithi137.stdout:1618: done (1 left) 2024-03-04T06:47:20.435 INFO:tasks.rados.rados.0.smithi137.stdout:1621: read oid 11 snap -1 2024-03-04T06:47:20.435 INFO:tasks.rados.rados.0.smithi137.stdout:1621: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:47:20.435 INFO:tasks.rados.rados.0.smithi137.stdout:1622: snap_create 2024-03-04T06:47:20.435 INFO:tasks.rados.rados.0.smithi137.stdout:1620: finishing write tid 1 to smithi13777483-49 2024-03-04T06:47:20.436 INFO:tasks.rados.rados.0.smithi137.stdout:1620: finishing write tid 2 to smithi13777483-49 2024-03-04T06:47:20.438 INFO:tasks.rados.rados.0.smithi137.stdout:1620: finishing write tid 3 to smithi13777483-49 2024-03-04T06:47:20.438 INFO:tasks.rados.rados.0.smithi137.stdout:1620: finishing write tid 4 to smithi13777483-49 2024-03-04T06:47:20.441 INFO:tasks.rados.rados.0.smithi137.stdout:1620: finishing write tid 5 to smithi13777483-49 2024-03-04T06:47:20.441 INFO:tasks.rados.rados.0.smithi137.stdout:1620: oid 49 updating version 0 to 757 2024-03-04T06:47:20.441 INFO:tasks.rados.rados.0.smithi137.stdout:1620: oid 49 version 757 is already newer than 756 2024-03-04T06:47:20.441 INFO:tasks.rados.rados.0.smithi137.stdout:1620: oid 49 updating version 757 to 759 2024-03-04T06:47:20.441 INFO:tasks.rados.rados.0.smithi137.stdout:1620: oid 49 version 759 is already newer than 758 2024-03-04T06:47:20.441 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 759 (ObjNum 534 snap 152 seq_num 534) dirty exists 2024-03-04T06:47:20.441 INFO:tasks.rados.rados.0.smithi137.stdout:1620: left oid 49 (ObjNum 534 snap 152 seq_num 534) 2024-03-04T06:47:20.471 INFO:tasks.rados.rados.0.smithi137.stdout:1621: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:47:20.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:20.402+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:20.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:20.407+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:20.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:20.408+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-mon[88869]: from='client.44195 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:47:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/688857722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-mon[88869]: pgmap v239: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 194 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 767 B/s rd, 1.2 MiB/s wr, 10 op/s 2024-03-04T06:47:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-mon[91314]: from='client.44195 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:47:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/688857722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:20 smithi137 ceph-mon[91314]: pgmap v239: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 194 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 767 B/s rd, 1.2 MiB/s wr, 10 op/s 2024-03-04T06:47:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:20 smithi203 ceph-mon[85573]: from='client.44195 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:47:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:20 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/688857722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:20 smithi203 ceph-mon[85573]: pgmap v239: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 194 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 767 B/s rd, 1.2 MiB/s wr, 10 op/s 2024-03-04T06:47:21.408 INFO:tasks.rados.rados.0.smithi137.stdout:1620: done (2 left) 2024-03-04T06:47:21.408 INFO:tasks.rados.rados.0.smithi137.stdout:1621: done (1 left) 2024-03-04T06:47:21.408 INFO:tasks.rados.rados.0.smithi137.stdout:1622: done (0 left) 2024-03-04T06:47:21.408 INFO:tasks.rados.rados.0.smithi137.stdout:1623: setattr oid 37 current snap is 153 2024-03-04T06:47:21.409 INFO:tasks.rados.rados.0.smithi137.stdout:1624: copy_from oid 34 from oid 33 current snap is 153 2024-03-04T06:47:21.409 INFO:tasks.rados.rados.0.smithi137.stdout:1625: copy_from oid 16 from oid 43 current snap is 153 2024-03-04T06:47:21.409 INFO:tasks.rados.rados.0.smithi137.stdout:1626: rollback oid 13 current snap is 153 2024-03-04T06:47:21.409 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 13 to 151 2024-03-04T06:47:21.409 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 24 current snap is 153 2024-03-04T06:47:21.410 INFO:tasks.rados.rados.0.smithi137.stdout:1627: seq_num 535 ranges {1073152=565248,1638400=802816,2441216=401408} 2024-03-04T06:47:21.418 INFO:tasks.rados.rados.0.smithi137.stdout:1627: writing smithi13777483-24 from 1073152 to 1638400 tid 1 2024-03-04T06:47:21.423 INFO:tasks.rados.rados.0.smithi137.stdout:1627: writing smithi13777483-24 from 1638400 to 2441216 tid 2 2024-03-04T06:47:21.426 INFO:tasks.rados.rados.0.smithi137.stdout:1627: writing smithi13777483-24 from 2441216 to 2842624 tid 3 2024-03-04T06:47:21.426 INFO:tasks.rados.rados.0.smithi137.stdout:1628: copy_from oid 38 from oid 11 current snap is 153 2024-03-04T06:47:21.426 INFO:tasks.rados.rados.0.smithi137.stdout:1624: finishing copy_from to smithi13777483-34 2024-03-04T06:47:21.426 INFO:tasks.rados.rados.0.smithi137.stdout:1624: got expected ENOENT (src dne) 2024-03-04T06:47:21.426 INFO:tasks.rados.rados.0.smithi137.stdout:1625: finishing copy_from to smithi13777483-16 2024-03-04T06:47:21.426 INFO:tasks.rados.rados.0.smithi137.stdout:1625: got expected ENOENT (src dne) 2024-03-04T06:47:21.426 INFO:tasks.rados.rados.0.smithi137.stdout:1625: finishing copy_from racing read to smithi13777483-16 2024-03-04T06:47:21.427 INFO:tasks.rados.rados.0.smithi137.stdout:1624: finishing copy_from racing read to smithi13777483-34 2024-03-04T06:47:21.427 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 947 (ObjNum 33 snap 0 seq_num 3110926128) dirty exists 2024-03-04T06:47:21.427 INFO:tasks.rados.rados.0.smithi137.stdout:1626: finishing rollback tid 1 to smithi13777483-13 2024-03-04T06:47:21.427 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 0 (ObjNum 161 snap 0 seq_num 3132262400) dirty dne 2024-03-04T06:47:21.427 INFO:tasks.rados.rados.0.smithi137.stdout:1627: finishing write tid 1 to smithi13777483-24 2024-03-04T06:47:21.427 INFO:tasks.rados.rados.0.smithi137.stdout:1623: done (5 left) 2024-03-04T06:47:21.427 INFO:tasks.rados.rados.0.smithi137.stdout:1624: done (4 left) 2024-03-04T06:47:21.427 INFO:tasks.rados.rados.0.smithi137.stdout:1625: done (3 left) 2024-03-04T06:47:21.427 INFO:tasks.rados.rados.0.smithi137.stdout:1626: done (2 left) 2024-03-04T06:47:21.427 INFO:tasks.rados.rados.0.smithi137.stdout:1629: rollback oid 26 current snap is 153 2024-03-04T06:47:21.427 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 26 to 152 2024-03-04T06:47:21.427 INFO:tasks.rados.rados.0.smithi137.stdout:1630: snap_create 2024-03-04T06:47:21.428 INFO:tasks.rados.rados.0.smithi137.stdout:1627: finishing write tid 2 to smithi13777483-24 2024-03-04T06:47:21.428 INFO:tasks.rados.rados.0.smithi137.stdout:1627: finishing write tid 3 to smithi13777483-24 2024-03-04T06:47:21.429 INFO:tasks.rados.rados.0.smithi137.stdout:1627: finishing write tid 4 to smithi13777483-24 2024-03-04T06:47:21.430 INFO:tasks.rados.rados.0.smithi137.stdout:1629: finishing rollback tid 0 to smithi13777483-26 2024-03-04T06:47:21.430 INFO:tasks.rados.rados.0.smithi137.stdout:1629: finishing rollback tid 1 to smithi13777483-26 2024-03-04T06:47:21.431 INFO:tasks.rados.rados.0.smithi137.stdout:1629: finishing rollback tid 2 to smithi13777483-26 2024-03-04T06:47:21.431 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16749 (ObjNum 531 snap 150 seq_num 531) dirty exists 2024-03-04T06:47:21.432 INFO:tasks.rados.rados.0.smithi137.stdout:1627: finishing write tid 5 to smithi13777483-24 2024-03-04T06:47:21.433 INFO:tasks.rados.rados.0.smithi137.stdout:1627: oid 24 updating version 0 to 391 2024-03-04T06:47:21.433 INFO:tasks.rados.rados.0.smithi137.stdout:1627: oid 24 version 391 is already newer than 389 2024-03-04T06:47:21.433 INFO:tasks.rados.rados.0.smithi137.stdout:1627: oid 24 updating version 391 to 392 2024-03-04T06:47:21.433 INFO:tasks.rados.rados.0.smithi137.stdout:1627: oid 24 version 392 is already newer than 390 2024-03-04T06:47:21.433 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 392 (ObjNum 535 snap 153 seq_num 535) dirty exists 2024-03-04T06:47:21.433 INFO:tasks.rados.rados.0.smithi137.stdout:1627: left oid 24 (ObjNum 535 snap 153 seq_num 535) 2024-03-04T06:47:21.457 INFO:tasks.rados.rados.0.smithi137.stdout:1628: finishing copy_from racing read to smithi13777483-38 2024-03-04T06:47:21.458 INFO:tasks.rados.rados.0.smithi137.stdout:1628: finishing copy_from to smithi13777483-38 2024-03-04T06:47:21.458 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 15441 (ObjNum 419 snap 125 seq_num 419) dirty exists 2024-03-04T06:47:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:21 smithi137 ceph-mon[91314]: osdmap e378: 8 total, 8 up, 8 in 2024-03-04T06:47:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:21 smithi137 ceph-mon[88869]: osdmap e378: 8 total, 8 up, 8 in 2024-03-04T06:47:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:21.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:21.412+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:21.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:21.412+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:21.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:21.413+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:21.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:21.415+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:21 smithi203 ceph-mon[85573]: osdmap e378: 8 total, 8 up, 8 in 2024-03-04T06:47:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:22.415 INFO:tasks.rados.rados.0.smithi137.stdout:1627: done (3 left) 2024-03-04T06:47:22.415 INFO:tasks.rados.rados.0.smithi137.stdout:1628: done (2 left) 2024-03-04T06:47:22.415 INFO:tasks.rados.rados.0.smithi137.stdout:1629: done (1 left) 2024-03-04T06:47:22.415 INFO:tasks.rados.rados.0.smithi137.stdout:1630: done (0 left) 2024-03-04T06:47:22.415 INFO:tasks.rados.rados.0.smithi137.stdout:1631: rmattr oid 9 current snap is 154 2024-03-04T06:47:22.415 INFO:tasks.rados.rados.0.smithi137.stdout:1631: done (0 left) 2024-03-04T06:47:22.415 INFO:tasks.rados.rados.0.smithi137.stdout:1632: copy_from oid 8 from oid 42 current snap is 154 2024-03-04T06:47:22.415 INFO:tasks.rados.rados.0.smithi137.stdout:1633: delete oid 3 current snap is 154 2024-03-04T06:47:22.422 INFO:tasks.rados.rados.0.smithi137.stdout:1633: done (1 left) 2024-03-04T06:47:22.422 INFO:tasks.rados.rados.0.smithi137.stdout:1634: rollback oid 25 current snap is 154 2024-03-04T06:47:22.422 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 25 to 151 2024-03-04T06:47:22.422 INFO:tasks.rados.rados.0.smithi137.stdout:1635: snap_create 2024-03-04T06:47:22.428 INFO:tasks.rados.rados.0.smithi137.stdout:1632: finishing copy_from racing read to smithi13777483-8 2024-03-04T06:47:22.429 INFO:tasks.rados.rados.0.smithi137.stdout:1632: finishing copy_from to smithi13777483-8 2024-03-04T06:47:22.429 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 582 (ObjNum 353 snap 110 seq_num 353) dirty exists 2024-03-04T06:47:22.429 INFO:tasks.rados.rados.0.smithi137.stdout:1634: finishing rollback tid 0 to smithi13777483-25 2024-03-04T06:47:22.430 INFO:tasks.rados.rados.0.smithi137.stdout:1634: finishing rollback tid 1 to smithi13777483-25 2024-03-04T06:47:22.430 INFO:tasks.rados.rados.0.smithi137.stdout:1634: finishing rollback tid 2 to smithi13777483-25 2024-03-04T06:47:22.430 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 15444 (ObjNum 353 snap 110 seq_num 353) dirty exists 2024-03-04T06:47:22.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:22 smithi137 ceph-mon[91314]: osdmap e379: 8 total, 8 up, 8 in 2024-03-04T06:47:22.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:22.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:22.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:22.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:22 smithi137 ceph-mon[91314]: pgmap v242: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 194 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 5 op/s 2024-03-04T06:47:22.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:22.421+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:22.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:22.422+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:22.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:22 smithi137 ceph-mon[88869]: osdmap e379: 8 total, 8 up, 8 in 2024-03-04T06:47:22.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:22.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:22.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:22.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:22 smithi137 ceph-mon[88869]: pgmap v242: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 194 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 5 op/s 2024-03-04T06:47:22.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:22.431+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:22.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:22 smithi203 ceph-mon[85573]: osdmap e379: 8 total, 8 up, 8 in 2024-03-04T06:47:22.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:22.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:22.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset cb=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:22.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:22 smithi203 ceph-mon[85573]: pgmap v242: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 194 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 5 op/s 2024-03-04T06:47:23.419 INFO:tasks.rados.rados.0.smithi137.stdout:1632: done (2 left) 2024-03-04T06:47:23.419 INFO:tasks.rados.rados.0.smithi137.stdout:1634: done (1 left) 2024-03-04T06:47:23.420 INFO:tasks.rados.rados.0.smithi137.stdout:1635: done (0 left) 2024-03-04T06:47:23.420 INFO:tasks.rados.rados.0.smithi137.stdout:1636: read oid 30 snap 152 2024-03-04T06:47:23.420 INFO:tasks.rados.rados.0.smithi137.stdout:1636: expect deleted 2024-03-04T06:47:23.420 INFO:tasks.rados.rados.0.smithi137.stdout:1637: rollback oid 17 current snap is 155 2024-03-04T06:47:23.420 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 17 to 143 2024-03-04T06:47:23.420 INFO:tasks.rados.rados.0.smithi137.stdout:1638: read oid 14 snap 151 2024-03-04T06:47:23.420 INFO:tasks.rados.rados.0.smithi137.stdout:1638: expect (ObjNum 436 snap 128 seq_num 436) 2024-03-04T06:47:23.420 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 155 2024-03-04T06:47:23.420 INFO:tasks.rados.rados.0.smithi137.stdout:1639: seq_num 537 ranges {0=598016,598016=573440,1171456=491520,1662976=139264} 2024-03-04T06:47:23.423 INFO:tasks.rados.rados.0.smithi137.stdout:1639: writing smithi13777483-13 from 0 to 598016 tid 1 2024-03-04T06:47:23.426 INFO:tasks.rados.rados.0.smithi137.stdout:1639: writing smithi13777483-13 from 598016 to 1171456 tid 2 2024-03-04T06:47:23.430 INFO:tasks.rados.rados.0.smithi137.stdout:1639: writing smithi13777483-13 from 1171456 to 1662976 tid 3 2024-03-04T06:47:23.431 INFO:tasks.rados.rados.0.smithi137.stdout:1639: writing smithi13777483-13 from 1662976 to 1802240 tid 4 2024-03-04T06:47:23.431 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 155 2024-03-04T06:47:23.431 INFO:tasks.rados.rados.0.smithi137.stdout:1640: seq_num 538 ranges {0=614400,614400=450560,1064960=704512,1769472=49152} 2024-03-04T06:47:23.435 INFO:tasks.rados.rados.0.smithi137.stdout:1640: writing smithi13777483-23 from 0 to 614400 tid 1 2024-03-04T06:47:23.438 INFO:tasks.rados.rados.0.smithi137.stdout:1640: writing smithi13777483-23 from 614400 to 1064960 tid 2 2024-03-04T06:47:23.442 INFO:tasks.rados.rados.0.smithi137.stdout:1640: writing smithi13777483-23 from 1064960 to 1769472 tid 3 2024-03-04T06:47:23.443 INFO:tasks.rados.rados.0.smithi137.stdout:1640: writing smithi13777483-23 from 1769472 to 1818624 tid 4 2024-03-04T06:47:23.443 INFO:tasks.rados.rados.0.smithi137.stdout:1641: rollback oid 32 current snap is 155 2024-03-04T06:47:23.443 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 32 to 151 2024-03-04T06:47:23.443 INFO:tasks.rados.rados.0.smithi137.stdout:1637: finishing rollback tid 0 to smithi13777483-17 2024-03-04T06:47:23.443 INFO:tasks.rados.rados.0.smithi137.stdout:1637: finishing rollback tid 1 to smithi13777483-17 2024-03-04T06:47:23.443 INFO:tasks.rados.rados.0.smithi137.stdout:1637: finishing rollback tid 2 to smithi13777483-17 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 638 (ObjNum 455 snap 132 seq_num 455) dirty exists 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:1639: finishing write tid 1 to smithi13777483-13 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:1639: finishing write tid 2 to smithi13777483-13 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:1639: finishing write tid 3 to smithi13777483-13 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:1639: finishing write tid 4 to smithi13777483-13 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:1639: finishing write tid 5 to smithi13777483-13 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:1639: finishing write tid 6 to smithi13777483-13 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:1639: oid 13 updating version 0 to 1145 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:1639: oid 13 updating version 1145 to 1147 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:1639: oid 13 version 1147 is already newer than 1143 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:1639: oid 13 version 1147 is already newer than 1144 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:1639: oid 13 version 1147 is already newer than 1146 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 1147 (ObjNum 537 snap 155 seq_num 537) dirty exists 2024-03-04T06:47:23.444 INFO:tasks.rados.rados.0.smithi137.stdout:1639: left oid 13 (ObjNum 537 snap 155 seq_num 537) 2024-03-04T06:47:23.445 INFO:tasks.rados.rados.0.smithi137.stdout:1638: expect (ObjNum 436 snap 128 seq_num 436) 2024-03-04T06:47:23.532 INFO:tasks.rados.rados.0.smithi137.stdout:1640: finishing write tid 1 to smithi13777483-23 2024-03-04T06:47:23.532 INFO:tasks.rados.rados.0.smithi137.stdout:1640: finishing write tid 2 to smithi13777483-23 2024-03-04T06:47:23.532 INFO:tasks.rados.rados.0.smithi137.stdout:1636: done (5 left) 2024-03-04T06:47:23.532 INFO:tasks.rados.rados.0.smithi137.stdout:1637: done (4 left) 2024-03-04T06:47:23.532 INFO:tasks.rados.rados.0.smithi137.stdout:1638: done (3 left) 2024-03-04T06:47:23.532 INFO:tasks.rados.rados.0.smithi137.stdout:1639: done (2 left) 2024-03-04T06:47:23.533 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 35 current snap is 155 2024-03-04T06:47:23.533 INFO:tasks.rados.rados.0.smithi137.stdout:1641: finishing rollback tid 1 to smithi13777483-32 2024-03-04T06:47:23.533 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 0 (ObjNum 97 snap 0 seq_num 3162484016) dirty dne 2024-03-04T06:47:23.533 INFO:tasks.rados.rados.0.smithi137.stdout:1640: finishing write tid 3 to smithi13777483-23 2024-03-04T06:47:23.533 INFO:tasks.rados.rados.0.smithi137.stdout:1640: finishing write tid 4 to smithi13777483-23 2024-03-04T06:47:23.533 INFO:tasks.rados.rados.0.smithi137.stdout:1640: finishing write tid 5 to smithi13777483-23 2024-03-04T06:47:23.533 INFO:tasks.rados.rados.0.smithi137.stdout:1642: seq_num 539 ranges {7331840=630784,7962624=737280,8699904=466944} 2024-03-04T06:47:23.573 INFO:tasks.rados.rados.0.smithi137.stdout:1642: writing smithi13777483-35 from 7331840 to 7962624 tid 1 2024-03-04T06:47:23.577 INFO:tasks.rados.rados.0.smithi137.stdout:1642: writing smithi13777483-35 from 7962624 to 8699904 tid 2 2024-03-04T06:47:23.580 INFO:tasks.rados.rados.0.smithi137.stdout:1642: writing smithi13777483-35 from 8699904 to 9166848 tid 3 2024-03-04T06:47:23.580 INFO:tasks.rados.rados.0.smithi137.stdout:1641: done (2 left) 2024-03-04T06:47:23.580 INFO:tasks.rados.rados.0.smithi137.stdout:1643: read oid 15 snap -1 2024-03-04T06:47:23.580 INFO:tasks.rados.rados.0.smithi137.stdout:1643: expect (ObjNum 512 snap 146 seq_num 512) 2024-03-04T06:47:23.580 INFO:tasks.rados.rados.0.smithi137.stdout:1644: snap_remove snap 153 2024-03-04T06:47:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:23 smithi137 ceph-mon[91314]: osdmap e380: 8 total, 8 up, 8 in 2024-03-04T06:47:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:47:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:23 smithi137 ceph-mon[88869]: osdmap e380: 8 total, 8 up, 8 in 2024-03-04T06:47:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:23.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:47:23.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:23.429+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:23.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:23 smithi203 ceph-mon[85573]: osdmap e380: 8 total, 8 up, 8 in 2024-03-04T06:47:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:47:24.429 INFO:tasks.rados.rados.0.smithi137.stdout:1644: done (3 left) 2024-03-04T06:47:24.429 INFO:tasks.rados.rados.0.smithi137.stdout:1645: rollback oid 11 current snap is 155 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 11 to 154 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:1646: read oid 37 snap 150 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:1646: expect (ObjNum -1163753504 snap 21906 seq_num 3130988736) 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:1647: read oid 39 snap 151 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:1647: expect (ObjNum 526 snap 149 seq_num 526) 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:1648: copy_from oid 40 from oid 7 current snap is 155 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:1640: finishing write tid 6 to smithi13777483-23 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:1640: oid 23 updating version 0 to 932 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:1640: oid 23 version 932 is already newer than 928 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:1640: oid 23 version 932 is already newer than 931 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:1640: oid 23 version 932 is already newer than 930 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:1640: oid 23 version 932 is already newer than 929 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 932 (ObjNum 538 snap 155 seq_num 538) dirty exists 2024-03-04T06:47:24.430 INFO:tasks.rados.rados.0.smithi137.stdout:1640: left oid 23 (ObjNum 538 snap 155 seq_num 538) 2024-03-04T06:47:24.431 INFO:tasks.rados.rados.0.smithi137.stdout:1642: finishing write tid 1 to smithi13777483-35 2024-03-04T06:47:24.431 INFO:tasks.rados.rados.0.smithi137.stdout:1642: finishing write tid 2 to smithi13777483-35 2024-03-04T06:47:24.431 INFO:tasks.rados.rados.0.smithi137.stdout:1642: finishing write tid 3 to smithi13777483-35 2024-03-04T06:47:24.431 INFO:tasks.rados.rados.0.smithi137.stdout:1642: finishing write tid 4 to smithi13777483-35 2024-03-04T06:47:24.431 INFO:tasks.rados.rados.0.smithi137.stdout:1642: finishing write tid 5 to smithi13777483-35 2024-03-04T06:47:24.431 INFO:tasks.rados.rados.0.smithi137.stdout:1642: oid 35 updating version 0 to 763 2024-03-04T06:47:24.431 INFO:tasks.rados.rados.0.smithi137.stdout:1642: oid 35 version 763 is already newer than 762 2024-03-04T06:47:24.431 INFO:tasks.rados.rados.0.smithi137.stdout:1642: oid 35 version 763 is already newer than 761 2024-03-04T06:47:24.431 INFO:tasks.rados.rados.0.smithi137.stdout:1642: oid 35 updating version 763 to 764 2024-03-04T06:47:24.431 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 764 (ObjNum 539 snap 155 seq_num 539) dirty exists 2024-03-04T06:47:24.431 INFO:tasks.rados.rados.0.smithi137.stdout:1642: left oid 35 (ObjNum 539 snap 155 seq_num 539) 2024-03-04T06:47:24.431 INFO:tasks.rados.rados.0.smithi137.stdout:1643: expect (ObjNum 512 snap 146 seq_num 512) 2024-03-04T06:47:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:24 smithi137 ceph-mon[91314]: osdmap e381: 8 total, 8 up, 8 in 2024-03-04T06:47:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:24 smithi137 ceph-mon[91314]: pgmap v245: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 207 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.6 MiB/s rd, 5.0 MiB/s wr, 21 op/s 2024-03-04T06:47:24.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:24.438+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:24.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:24.438+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:24.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:24.438+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:24 smithi137 ceph-mon[88869]: osdmap e381: 8 total, 8 up, 8 in 2024-03-04T06:47:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:24 smithi137 ceph-mon[88869]: pgmap v245: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 207 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.6 MiB/s rd, 5.0 MiB/s wr, 21 op/s 2024-03-04T06:47:24.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:24.428+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:24 smithi203 ceph-mon[85573]: osdmap e381: 8 total, 8 up, 8 in 2024-03-04T06:47:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:24 smithi203 ceph-mon[85573]: pgmap v245: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 207 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.6 MiB/s rd, 5.0 MiB/s wr, 21 op/s 2024-03-04T06:47:25.441 INFO:tasks.rados.rados.0.smithi137.stdout:1646: expect (ObjNum -1163753504 snap 21906 seq_num 3130988736) 2024-03-04T06:47:25.443 INFO:tasks.rados.rados.0.smithi137.stdout:1645: finishing rollback tid 0 to smithi13777483-11 2024-03-04T06:47:25.443 INFO:tasks.rados.rados.0.smithi137.stdout:1645: finishing rollback tid 1 to smithi13777483-11 2024-03-04T06:47:25.443 INFO:tasks.rados.rados.0.smithi137.stdout:1645: finishing rollback tid 2 to smithi13777483-11 2024-03-04T06:47:25.443 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 15452 (ObjNum 419 snap 125 seq_num 419) dirty exists 2024-03-04T06:47:25.443 INFO:tasks.rados.rados.0.smithi137.stdout:1648: finishing copy_from racing read to smithi13777483-40 2024-03-04T06:47:25.443 INFO:tasks.rados.rados.0.smithi137.stdout:1648: finishing copy_from to smithi13777483-40 2024-03-04T06:47:25.443 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 15449 (ObjNum 522 snap 148 seq_num 522) dirty exists 2024-03-04T06:47:25.443 INFO:tasks.rados.rados.0.smithi137.stdout:1647: expect (ObjNum 526 snap 149 seq_num 526) 2024-03-04T06:47:25.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:47:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:47:25] "GET /metrics HTTP/1.1" 200 36262 "" "Prometheus/2.43.0" 2024-03-04T06:47:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:25 smithi137 ceph-mon[88869]: osdmap e382: 8 total, 8 up, 8 in 2024-03-04T06:47:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:25.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:25.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:25 smithi137 ceph-mon[91314]: osdmap e382: 8 total, 8 up, 8 in 2024-03-04T06:47:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:25 smithi203 ceph-mon[85573]: osdmap e382: 8 total, 8 up, 8 in 2024-03-04T06:47:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:25.912 INFO:tasks.rados.rados.0.smithi137.stdout:1640: done (6 left) 2024-03-04T06:47:25.912 INFO:tasks.rados.rados.0.smithi137.stdout:1642: done (5 left) 2024-03-04T06:47:25.912 INFO:tasks.rados.rados.0.smithi137.stdout:1643: done (4 left) 2024-03-04T06:47:25.912 INFO:tasks.rados.rados.0.smithi137.stdout:1645: done (3 left) 2024-03-04T06:47:25.912 INFO:tasks.rados.rados.0.smithi137.stdout:1646: done (2 left) 2024-03-04T06:47:25.913 INFO:tasks.rados.rados.0.smithi137.stdout:1647: done (1 left) 2024-03-04T06:47:25.913 INFO:tasks.rados.rados.0.smithi137.stdout:1648: done (0 left) 2024-03-04T06:47:25.913 INFO:tasks.rados.rados.0.smithi137.stdout:1649: snap_remove snap 143 2024-03-04T06:47:26.433 INFO:tasks.rados.rados.0.smithi137.stdout:1649: done (0 left) 2024-03-04T06:47:26.433 INFO:tasks.rados.rados.0.smithi137.stdout:1650: setattr oid 29 current snap is 155 2024-03-04T06:47:26.438 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 155 2024-03-04T06:47:26.438 INFO:tasks.rados.rados.0.smithi137.stdout:1651: seq_num 540 ranges {4308992=647168,4956160=671744,5627904=532480} 2024-03-04T06:47:26.466 INFO:tasks.rados.rados.0.smithi137.stdout:1651: writing smithi13777483-31 from 4308992 to 4956160 tid 1 2024-03-04T06:47:26.470 INFO:tasks.rados.rados.0.smithi137.stdout:1651: writing smithi13777483-31 from 4956160 to 5627904 tid 2 2024-03-04T06:47:26.473 INFO:tasks.rados.rados.0.smithi137.stdout:1651: writing smithi13777483-31 from 5627904 to 6160384 tid 3 2024-03-04T06:47:26.473 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 155 2024-03-04T06:47:26.473 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16750 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:47:26.473 INFO:tasks.rados.rados.0.smithi137.stdout:1651: finishing write tid 1 to smithi13777483-31 2024-03-04T06:47:26.473 INFO:tasks.rados.rados.0.smithi137.stdout:1652: seq_num 541 ranges {3407872=663552,4071424=557056,4628480=475136,5103616=172032} 2024-03-04T06:47:26.495 INFO:tasks.rados.rados.0.smithi137.stdout:1652: writing smithi13777483-46 from 3407872 to 4071424 tid 1 2024-03-04T06:47:26.498 INFO:tasks.rados.rados.0.smithi137.stdout:1652: writing smithi13777483-46 from 4071424 to 4628480 tid 2 2024-03-04T06:47:26.501 INFO:tasks.rados.rados.0.smithi137.stdout:1652: writing smithi13777483-46 from 4628480 to 5103616 tid 3 2024-03-04T06:47:26.502 INFO:tasks.rados.rados.0.smithi137.stdout:1652: writing smithi13777483-46 from 5103616 to 5275648 tid 4 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:1650: done (2 left) 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 155 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:1651: finishing write tid 2 to smithi13777483-31 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:1651: finishing write tid 3 to smithi13777483-31 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:1651: finishing write tid 4 to smithi13777483-31 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:1651: finishing write tid 5 to smithi13777483-31 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:1651: oid 31 updating version 0 to 776 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:1651: oid 31 updating version 776 to 777 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:1651: oid 31 version 777 is already newer than 775 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:1651: oid 31 version 777 is already newer than 774 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 777 (ObjNum 540 snap 155 seq_num 540) dirty exists 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:1651: left oid 31 (ObjNum 540 snap 155 seq_num 540) 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:1652: finishing write tid 1 to smithi13777483-46 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:1652: finishing write tid 2 to smithi13777483-46 2024-03-04T06:47:26.503 INFO:tasks.rados.rados.0.smithi137.stdout:1653: seq_num 542 ranges {1523712=679936,2203648=442368,2646016=679936,3325952=81920} 2024-03-04T06:47:26.514 INFO:tasks.rados.rados.0.smithi137.stdout:1653: writing smithi13777483-25 from 1523712 to 2203648 tid 1 2024-03-04T06:47:26.516 INFO:tasks.rados.rados.0.smithi137.stdout:1653: writing smithi13777483-25 from 2203648 to 2646016 tid 2 2024-03-04T06:47:26.520 INFO:tasks.rados.rados.0.smithi137.stdout:1653: writing smithi13777483-25 from 2646016 to 3325952 tid 3 2024-03-04T06:47:26.521 INFO:tasks.rados.rados.0.smithi137.stdout:1653: writing smithi13777483-25 from 3325952 to 3407872 tid 4 2024-03-04T06:47:26.521 INFO:tasks.rados.rados.0.smithi137.stdout:1651: done (2 left) 2024-03-04T06:47:26.521 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 155 2024-03-04T06:47:26.522 INFO:tasks.rados.rados.0.smithi137.stdout:1652: finishing write tid 3 to smithi13777483-46 2024-03-04T06:47:26.522 INFO:tasks.rados.rados.0.smithi137.stdout:1652: finishing write tid 4 to smithi13777483-46 2024-03-04T06:47:26.522 INFO:tasks.rados.rados.0.smithi137.stdout:1652: finishing write tid 5 to smithi13777483-46 2024-03-04T06:47:26.522 INFO:tasks.rados.rados.0.smithi137.stdout:1652: finishing write tid 6 to smithi13777483-46 2024-03-04T06:47:26.522 INFO:tasks.rados.rados.0.smithi137.stdout:1652: oid 46 updating version 0 to 1161 2024-03-04T06:47:26.522 INFO:tasks.rados.rados.0.smithi137.stdout:1652: oid 46 version 1161 is already newer than 1158 2024-03-04T06:47:26.522 INFO:tasks.rados.rados.0.smithi137.stdout:1652: oid 46 version 1161 is already newer than 1159 2024-03-04T06:47:26.522 INFO:tasks.rados.rados.0.smithi137.stdout:1652: oid 46 version 1161 is already newer than 1160 2024-03-04T06:47:26.522 INFO:tasks.rados.rados.0.smithi137.stdout:1652: oid 46 updating version 1161 to 1162 2024-03-04T06:47:26.522 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 1162 (ObjNum 541 snap 155 seq_num 541) dirty exists 2024-03-04T06:47:26.522 INFO:tasks.rados.rados.0.smithi137.stdout:1652: left oid 46 (ObjNum 541 snap 155 seq_num 541) 2024-03-04T06:47:26.522 INFO:tasks.rados.rados.0.smithi137.stdout:1653: finishing write tid 1 to smithi13777483-25 2024-03-04T06:47:26.522 INFO:tasks.rados.rados.0.smithi137.stdout:1654: seq_num 543 ranges {1523712=704512,2228224=729088,2957312=475136} 2024-03-04T06:47:26.533 INFO:tasks.rados.rados.0.smithi137.stdout:1654: writing smithi13777483-42 from 1523712 to 2228224 tid 1 2024-03-04T06:47:26.537 INFO:tasks.rados.rados.0.smithi137.stdout:1654: writing smithi13777483-42 from 2228224 to 2957312 tid 2 2024-03-04T06:47:26.541 INFO:tasks.rados.rados.0.smithi137.stdout:1654: writing smithi13777483-42 from 2957312 to 3432448 tid 3 2024-03-04T06:47:26.541 INFO:tasks.rados.rados.0.smithi137.stdout:1652: done (2 left) 2024-03-04T06:47:26.541 INFO:tasks.rados.rados.0.smithi137.stdout:1655: rmattr oid 43 current snap is 155 2024-03-04T06:47:26.541 INFO:tasks.rados.rados.0.smithi137.stdout:1655: done (2 left) 2024-03-04T06:47:26.541 INFO:tasks.rados.rados.0.smithi137.stdout:1656: setattr oid 39 current snap is 155 2024-03-04T06:47:26.541 INFO:tasks.rados.rados.0.smithi137.stdout:1653: finishing write tid 2 to smithi13777483-25 2024-03-04T06:47:26.541 INFO:tasks.rados.rados.0.smithi137.stdout:1653: finishing write tid 3 to smithi13777483-25 2024-03-04T06:47:26.541 INFO:tasks.rados.rados.0.smithi137.stdout:1653: finishing write tid 4 to smithi13777483-25 2024-03-04T06:47:26.541 INFO:tasks.rados.rados.0.smithi137.stdout:1653: finishing write tid 5 to smithi13777483-25 2024-03-04T06:47:26.541 INFO:tasks.rados.rados.0.smithi137.stdout:1653: finishing write tid 6 to smithi13777483-25 2024-03-04T06:47:26.541 INFO:tasks.rados.rados.0.smithi137.stdout:1653: oid 25 updating version 0 to 15445 2024-03-04T06:47:26.541 INFO:tasks.rados.rados.0.smithi137.stdout:1653: oid 25 updating version 15445 to 15446 2024-03-04T06:47:26.541 INFO:tasks.rados.rados.0.smithi137.stdout:1653: oid 25 updating version 15446 to 15449 2024-03-04T06:47:26.542 INFO:tasks.rados.rados.0.smithi137.stdout:1653: oid 25 version 15449 is already newer than 15448 2024-03-04T06:47:26.542 INFO:tasks.rados.rados.0.smithi137.stdout:1653: oid 25 version 15449 is already newer than 15447 2024-03-04T06:47:26.542 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 15449 (ObjNum 542 snap 155 seq_num 542) dirty exists 2024-03-04T06:47:26.542 INFO:tasks.rados.rados.0.smithi137.stdout:1653: left oid 25 (ObjNum 542 snap 155 seq_num 542) 2024-03-04T06:47:26.542 INFO:tasks.rados.rados.0.smithi137.stdout:1654: finishing write tid 1 to smithi13777483-42 2024-03-04T06:47:26.542 INFO:tasks.rados.rados.0.smithi137.stdout:1654: finishing write tid 2 to smithi13777483-42 2024-03-04T06:47:26.542 INFO:tasks.rados.rados.0.smithi137.stdout:1654: finishing write tid 3 to smithi13777483-42 2024-03-04T06:47:26.543 INFO:tasks.rados.rados.0.smithi137.stdout:1653: done (2 left) 2024-03-04T06:47:26.543 INFO:tasks.rados.rados.0.smithi137.stdout:1657: rollback oid 23 current snap is 155 2024-03-04T06:47:26.543 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 23 to 154 2024-03-04T06:47:26.543 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 40 current snap is 155 2024-03-04T06:47:26.543 INFO:tasks.rados.rados.0.smithi137.stdout:1658: seq_num 544 ranges {1548288=720896,2269184=614400,2883584=589824} 2024-03-04T06:47:26.555 INFO:tasks.rados.rados.0.smithi137.stdout:1658: writing smithi13777483-40 from 1548288 to 2269184 tid 1 2024-03-04T06:47:26.558 INFO:tasks.rados.rados.0.smithi137.stdout:1658: writing smithi13777483-40 from 2269184 to 2883584 tid 2 2024-03-04T06:47:26.562 INFO:tasks.rados.rados.0.smithi137.stdout:1658: writing smithi13777483-40 from 2883584 to 3473408 tid 3 2024-03-04T06:47:26.562 INFO:tasks.rados.rados.0.smithi137.stdout:1659: rollback oid 43 current snap is 155 2024-03-04T06:47:26.562 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 43 to 152 2024-03-04T06:47:26.562 INFO:tasks.rados.rados.0.smithi137.stdout:1654: finishing write tid 4 to smithi13777483-42 2024-03-04T06:47:26.562 INFO:tasks.rados.rados.0.smithi137.stdout:1654: finishing write tid 5 to smithi13777483-42 2024-03-04T06:47:26.562 INFO:tasks.rados.rados.0.smithi137.stdout:1654: oid 42 updating version 0 to 1167 2024-03-04T06:47:26.562 INFO:tasks.rados.rados.0.smithi137.stdout:1654: oid 42 version 1167 is already newer than 1165 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:1654: oid 42 version 1167 is already newer than 1166 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:1654: oid 42 version 1167 is already newer than 1164 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 1167 (ObjNum 543 snap 155 seq_num 543) dirty exists 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:1654: left oid 42 (ObjNum 543 snap 155 seq_num 543) 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:1657: finishing rollback tid 0 to smithi13777483-23 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:1654: done (4 left) 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:1660: copy_from oid 37 from oid 20 current snap is 155 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:1657: finishing rollback tid 1 to smithi13777483-23 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 934 (ObjNum 65 snap 0 seq_num 1349213012) dirty dne 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 398 (ObjNum 526 snap 149 seq_num 526) dirty exists 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:1658: finishing write tid 1 to smithi13777483-40 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:1656: done (4 left) 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:1657: done (3 left) 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:1661: delete oid 22 current snap is 155 2024-03-04T06:47:26.563 INFO:tasks.rados.rados.0.smithi137.stdout:1658: finishing write tid 2 to smithi13777483-40 2024-03-04T06:47:26.564 INFO:tasks.rados.rados.0.smithi137.stdout:1659: finishing rollback tid 1 to smithi13777483-43 2024-03-04T06:47:26.564 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 0 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-04T06:47:26.564 INFO:tasks.rados.rados.0.smithi137.stdout:1658: finishing write tid 3 to smithi13777483-40 2024-03-04T06:47:26.564 INFO:tasks.rados.rados.0.smithi137.stdout:1658: finishing write tid 4 to smithi13777483-40 2024-03-04T06:47:26.566 INFO:tasks.rados.rados.0.smithi137.stdout:1660: finishing copy_from to smithi13777483-37 2024-03-04T06:47:26.566 INFO:tasks.rados.rados.0.smithi137.stdout:1660: got expected ENOENT (src dne) 2024-03-04T06:47:26.566 INFO:tasks.rados.rados.0.smithi137.stdout:1660: finishing copy_from racing read to smithi13777483-37 2024-03-04T06:47:26.568 INFO:tasks.rados.rados.0.smithi137.stdout:1658: finishing write tid 5 to smithi13777483-40 2024-03-04T06:47:26.568 INFO:tasks.rados.rados.0.smithi137.stdout:1658: oid 40 updating version 0 to 15453 2024-03-04T06:47:26.568 INFO:tasks.rados.rados.0.smithi137.stdout:1658: oid 40 version 15453 is already newer than 15452 2024-03-04T06:47:26.568 INFO:tasks.rados.rados.0.smithi137.stdout:1658: oid 40 version 15453 is already newer than 15451 2024-03-04T06:47:26.568 INFO:tasks.rados.rados.0.smithi137.stdout:1658: oid 40 version 15453 is already newer than 15450 2024-03-04T06:47:26.568 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 15453 (ObjNum 544 snap 155 seq_num 544) dirty exists 2024-03-04T06:47:26.568 INFO:tasks.rados.rados.0.smithi137.stdout:1658: left oid 40 (ObjNum 544 snap 155 seq_num 544) 2024-03-04T06:47:26.568 INFO:tasks.rados.rados.0.smithi137.stdout:1658: done (3 left) 2024-03-04T06:47:26.568 INFO:tasks.rados.rados.0.smithi137.stdout:1659: done (2 left) 2024-03-04T06:47:26.568 INFO:tasks.rados.rados.0.smithi137.stdout:1660: done (1 left) 2024-03-04T06:47:26.569 INFO:tasks.rados.rados.0.smithi137.stdout:1661: done (0 left) 2024-03-04T06:47:26.569 INFO:tasks.rados.rados.0.smithi137.stdout:1662: rmattr oid 31 current snap is 155 2024-03-04T06:47:26.569 INFO:tasks.rados.rados.0.smithi137.stdout:1663: copy_from oid 12 from oid 26 current snap is 155 2024-03-04T06:47:26.569 INFO:tasks.rados.rados.0.smithi137.stdout:1664: setattr oid 13 current snap is 155 2024-03-04T06:47:26.569 INFO:tasks.rados.rados.0.smithi137.stdout:1665: snap_create 2024-03-04T06:47:26.570 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 778 (ObjNum 540 snap 155 seq_num 540) dirty exists 2024-03-04T06:47:26.571 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 1168 (ObjNum 537 snap 155 seq_num 537) dirty exists 2024-03-04T06:47:26.586 INFO:tasks.rados.rados.0.smithi137.stdout:1663: finishing copy_from racing read to smithi13777483-12 2024-03-04T06:47:26.591 INFO:tasks.rados.rados.0.smithi137.stdout:1663: finishing copy_from to smithi13777483-12 2024-03-04T06:47:26.591 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16749 (ObjNum 531 snap 150 seq_num 531) dirty exists 2024-03-04T06:47:26.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:26 smithi137 ceph-mon[88869]: pgmap v247: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 208 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 4.3 MiB/s wr, 18 op/s 2024-03-04T06:47:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:26 smithi137 ceph-mon[91314]: pgmap v247: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 208 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 4.3 MiB/s wr, 18 op/s 2024-03-04T06:47:26.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:26.435+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:26.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:26.438+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:26.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:26.438+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:26 smithi203 ceph-mon[85573]: pgmap v247: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 208 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 4.3 MiB/s wr, 18 op/s 2024-03-04T06:47:27.434 INFO:tasks.rados.rados.0.smithi137.stdout:1662: done (3 left) 2024-03-04T06:47:27.434 INFO:tasks.rados.rados.0.smithi137.stdout:1663: done (2 left) 2024-03-04T06:47:27.435 INFO:tasks.rados.rados.0.smithi137.stdout:1664: done (1 left) 2024-03-04T06:47:27.435 INFO:tasks.rados.rados.0.smithi137.stdout:1665: done (0 left) 2024-03-04T06:47:27.435 INFO:tasks.rados.rados.0.smithi137.stdout:1666: delete oid 24 current snap is 156 2024-03-04T06:47:27.444 INFO:tasks.rados.rados.0.smithi137.stdout:1666: done (0 left) 2024-03-04T06:47:27.444 INFO:tasks.rados.rados.0.smithi137.stdout:1667: rmattr oid 14 current snap is 156 2024-03-04T06:47:27.444 INFO:tasks.rados.rados.0.smithi137.stdout:1667: done (0 left) 2024-03-04T06:47:27.445 INFO:tasks.rados.rados.0.smithi137.stdout:1668: delete oid 15 current snap is 156 2024-03-04T06:47:27.449 INFO:tasks.rados.rados.0.smithi137.stdout:1668: done (0 left) 2024-03-04T06:47:27.449 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 156 2024-03-04T06:47:27.449 INFO:tasks.rados.rados.0.smithi137.stdout:1669: seq_num 548 ranges {0=786432,786432=598016,1384448=606208} 2024-03-04T06:47:27.453 INFO:tasks.rados.rados.0.smithi137.stdout:1669: writing smithi13777483-4 from 0 to 786432 tid 1 2024-03-04T06:47:27.457 INFO:tasks.rados.rados.0.smithi137.stdout:1669: writing smithi13777483-4 from 786432 to 1384448 tid 2 2024-03-04T06:47:27.461 INFO:tasks.rados.rados.0.smithi137.stdout:1669: writing smithi13777483-4 from 1384448 to 1990656 tid 3 2024-03-04T06:47:27.461 INFO:tasks.rados.rados.0.smithi137.stdout:1670: snap_create 2024-03-04T06:47:27.461 INFO:tasks.rados.rados.0.smithi137.stdout:1669: finishing write tid 1 to smithi13777483-4 2024-03-04T06:47:27.461 INFO:tasks.rados.rados.0.smithi137.stdout:1669: finishing write tid 2 to smithi13777483-4 2024-03-04T06:47:27.463 INFO:tasks.rados.rados.0.smithi137.stdout:1669: finishing write tid 3 to smithi13777483-4 2024-03-04T06:47:27.463 INFO:tasks.rados.rados.0.smithi137.stdout:1669: finishing write tid 4 to smithi13777483-4 2024-03-04T06:47:27.466 INFO:tasks.rados.rados.0.smithi137.stdout:1669: finishing write tid 5 to smithi13777483-4 2024-03-04T06:47:27.467 INFO:tasks.rados.rados.0.smithi137.stdout:1669: oid 4 updating version 0 to 150 2024-03-04T06:47:27.467 INFO:tasks.rados.rados.0.smithi137.stdout:1669: oid 4 updating version 150 to 151 2024-03-04T06:47:27.467 INFO:tasks.rados.rados.0.smithi137.stdout:1669: oid 4 version 151 is already newer than 149 2024-03-04T06:47:27.467 INFO:tasks.rados.rados.0.smithi137.stdout:1669: oid 4 version 151 is already newer than 148 2024-03-04T06:47:27.467 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 151 (ObjNum 548 snap 156 seq_num 548) dirty exists 2024-03-04T06:47:27.467 INFO:tasks.rados.rados.0.smithi137.stdout:1669: left oid 4 (ObjNum 548 snap 156 seq_num 548) 2024-03-04T06:47:27.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:27 smithi137 ceph-mon[88869]: osdmap e383: 8 total, 8 up, 8 in 2024-03-04T06:47:27.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:27.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:27.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:27 smithi137 ceph-mon[91314]: osdmap e383: 8 total, 8 up, 8 in 2024-03-04T06:47:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:27.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:27.434+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:27.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:27.445+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:27.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:27.445+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:27.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:27.445+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:27 smithi203 ceph-mon[85573]: osdmap e383: 8 total, 8 up, 8 in 2024-03-04T06:47:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset d3=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:28.448 INFO:tasks.rados.rados.0.smithi137.stdout:1669: done (1 left) 2024-03-04T06:47:28.448 INFO:tasks.rados.rados.0.smithi137.stdout:1670: done (0 left) 2024-03-04T06:47:28.448 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 157 2024-03-04T06:47:28.448 INFO:tasks.rados.rados.0.smithi137.stdout:1671: seq_num 549 ranges {0=802816,802816=483328,1286144=434176,1720320=286720} 2024-03-04T06:47:28.453 INFO:tasks.rados.rados.0.smithi137.stdout:1671: writing smithi13777483-45 from 0 to 802816 tid 1 2024-03-04T06:47:28.455 INFO:tasks.rados.rados.0.smithi137.stdout:1671: writing smithi13777483-45 from 802816 to 1286144 tid 2 2024-03-04T06:47:28.458 INFO:tasks.rados.rados.0.smithi137.stdout:1671: writing smithi13777483-45 from 1286144 to 1720320 tid 3 2024-03-04T06:47:28.460 INFO:tasks.rados.rados.0.smithi137.stdout:1671: writing smithi13777483-45 from 1720320 to 2007040 tid 4 2024-03-04T06:47:28.460 INFO:tasks.rados.rados.0.smithi137.stdout:1672: snap_remove snap 154 2024-03-04T06:47:28.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:28.689+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:28.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:28.449+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:28.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:28.449+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[91314]: osdmap e384: 8 total, 8 up, 8 in 2024-03-04T06:47:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset d4=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-04T06:47:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-04T06:47:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[91314]: Upgrade: osd.3 is safe to restart 2024-03-04T06:47:28.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[91314]: pgmap v250: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 204 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 25 op/s 2024-03-04T06:47:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[88869]: osdmap e384: 8 total, 8 up, 8 in 2024-03-04T06:47:28.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset d4=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:28.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:28.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:28.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-04T06:47:28.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-04T06:47:28.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[88869]: Upgrade: osd.3 is safe to restart 2024-03-04T06:47:28.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:28 smithi137 ceph-mon[88869]: pgmap v250: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 204 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 25 op/s 2024-03-04T06:47:28.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:28 smithi203 ceph-mon[85573]: osdmap e384: 8 total, 8 up, 8 in 2024-03-04T06:47:28.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset d4=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:28.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:28.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:28.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:28 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-04T06:47:28.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:28 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-04T06:47:28.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:28 smithi203 ceph-mon[85573]: Upgrade: osd.3 is safe to restart 2024-03-04T06:47:28.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:28 smithi203 ceph-mon[85573]: pgmap v250: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 204 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 25 op/s 2024-03-04T06:47:29.456 INFO:tasks.rados.rados.0.smithi137.stdout:1672: done (1 left) 2024-03-04T06:47:29.456 INFO:tasks.rados.rados.0.smithi137.stdout:1673: copy_from oid 25 from oid 40 current snap is 157 2024-03-04T06:47:29.456 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 29 current snap is 157 2024-03-04T06:47:29.457 INFO:tasks.rados.rados.0.smithi137.stdout:1674: seq_num 550 ranges {3235840=417792,3653632=770048,4423680=638976,5062656=196608} 2024-03-04T06:47:29.476 INFO:tasks.rados.rados.0.smithi137.stdout:1674: writing smithi13777483-29 from 3235840 to 3653632 tid 1 2024-03-04T06:47:29.482 INFO:tasks.rados.rados.0.smithi137.stdout:1674: writing smithi13777483-29 from 3653632 to 4423680 tid 2 2024-03-04T06:47:29.485 INFO:tasks.rados.rados.0.smithi137.stdout:1674: writing smithi13777483-29 from 4423680 to 5062656 tid 3 2024-03-04T06:47:29.487 INFO:tasks.rados.rados.0.smithi137.stdout:1674: writing smithi13777483-29 from 5062656 to 5259264 tid 4 2024-03-04T06:47:29.487 INFO:tasks.rados.rados.0.smithi137.stdout:1675: snap_remove snap 152 2024-03-04T06:47:29.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:29 smithi137 ceph-mon[88869]: osdmap e385: 8 total, 8 up, 8 in 2024-03-04T06:47:29.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:29.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:29.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset d4=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:29.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:29 smithi137 ceph-mon[91314]: osdmap e385: 8 total, 8 up, 8 in 2024-03-04T06:47:29.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:29.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:29.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset d4=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:29.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:29.455+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:29.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:29.466+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:29.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:29.466+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:29.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:29.466+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:29.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:29 smithi203 ceph-mon[85573]: osdmap e385: 8 total, 8 up, 8 in 2024-03-04T06:47:29.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:29.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:29.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset d4=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:30.461 INFO:tasks.rados.rados.0.smithi137.stdout:1675: done (3 left) 2024-03-04T06:47:30.461 INFO:tasks.rados.rados.0.smithi137.stdout:1676: delete oid 17 current snap is 157 2024-03-04T06:47:30.461 INFO:tasks.rados.rados.0.smithi137.stdout:1671: finishing write tid 1 to smithi13777483-45 2024-03-04T06:47:30.461 INFO:tasks.rados.rados.0.smithi137.stdout:1671: finishing write tid 2 to smithi13777483-45 2024-03-04T06:47:30.461 INFO:tasks.rados.rados.0.smithi137.stdout:1671: finishing write tid 3 to smithi13777483-45 2024-03-04T06:47:30.461 INFO:tasks.rados.rados.0.smithi137.stdout:1671: finishing write tid 4 to smithi13777483-45 2024-03-04T06:47:30.461 INFO:tasks.rados.rados.0.smithi137.stdout:1671: finishing write tid 5 to smithi13777483-45 2024-03-04T06:47:30.461 INFO:tasks.rados.rados.0.smithi137.stdout:1671: finishing write tid 6 to smithi13777483-45 2024-03-04T06:47:30.461 INFO:tasks.rados.rados.0.smithi137.stdout:1671: oid 45 updating version 0 to 381 2024-03-04T06:47:30.461 INFO:tasks.rados.rados.0.smithi137.stdout:1671: oid 45 updating version 381 to 384 2024-03-04T06:47:30.461 INFO:tasks.rados.rados.0.smithi137.stdout:1671: oid 45 version 384 is already newer than 383 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1671: oid 45 version 384 is already newer than 382 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1671: oid 45 updating version 384 to 385 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 385 (ObjNum 549 snap 157 seq_num 549) dirty exists 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1671: left oid 45 (ObjNum 549 snap 157 seq_num 549) 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1673: finishing copy_from racing read to smithi13777483-25 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1673: finishing copy_from to smithi13777483-25 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 15453 (ObjNum 544 snap 155 seq_num 544) dirty exists 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1674: finishing write tid 1 to smithi13777483-29 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1674: finishing write tid 2 to smithi13777483-29 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1674: finishing write tid 3 to smithi13777483-29 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1674: finishing write tid 4 to smithi13777483-29 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1674: finishing write tid 5 to smithi13777483-29 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1674: finishing write tid 6 to smithi13777483-29 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1674: oid 29 updating version 0 to 16751 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1674: oid 29 updating version 16751 to 16752 2024-03-04T06:47:30.462 INFO:tasks.rados.rados.0.smithi137.stdout:1674: oid 29 updating version 16752 to 16754 2024-03-04T06:47:30.463 INFO:tasks.rados.rados.0.smithi137.stdout:1674: oid 29 updating version 16754 to 16755 2024-03-04T06:47:30.463 INFO:tasks.rados.rados.0.smithi137.stdout:1674: oid 29 version 16755 is already newer than 16753 2024-03-04T06:47:30.463 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16755 (ObjNum 550 snap 157 seq_num 550) dirty exists 2024-03-04T06:47:30.463 INFO:tasks.rados.rados.0.smithi137.stdout:1674: left oid 29 (ObjNum 550 snap 157 seq_num 550) 2024-03-04T06:47:30.469 INFO:tasks.rados.rados.0.smithi137.stdout:1671: done (3 left) 2024-03-04T06:47:30.469 INFO:tasks.rados.rados.0.smithi137.stdout:1673: done (2 left) 2024-03-04T06:47:30.469 INFO:tasks.rados.rados.0.smithi137.stdout:1674: done (1 left) 2024-03-04T06:47:30.469 INFO:tasks.rados.rados.0.smithi137.stdout:1676: done (0 left) 2024-03-04T06:47:30.469 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 157 2024-03-04T06:47:30.469 INFO:tasks.rados.rados.0.smithi137.stdout:1677: seq_num 552 ranges {0=450560,450560=532480,983040=655360,1638400=417792} 2024-03-04T06:47:30.471 INFO:tasks.rados.rados.0.smithi137.stdout:1677: writing smithi13777483-23 from 0 to 450560 tid 1 2024-03-04T06:47:30.474 INFO:tasks.rados.rados.0.smithi137.stdout:1677: writing smithi13777483-23 from 450560 to 983040 tid 2 2024-03-04T06:47:30.478 INFO:tasks.rados.rados.0.smithi137.stdout:1677: writing smithi13777483-23 from 983040 to 1638400 tid 3 2024-03-04T06:47:30.481 INFO:tasks.rados.rados.0.smithi137.stdout:1677: writing smithi13777483-23 from 1638400 to 2056192 tid 4 2024-03-04T06:47:30.481 INFO:tasks.rados.rados.0.smithi137.stdout:1678: snap_create 2024-03-04T06:47:30.481 INFO:tasks.rados.rados.0.smithi137.stdout:1677: finishing write tid 1 to smithi13777483-23 2024-03-04T06:47:30.481 INFO:tasks.rados.rados.0.smithi137.stdout:1677: finishing write tid 2 to smithi13777483-23 2024-03-04T06:47:30.484 INFO:tasks.rados.rados.0.smithi137.stdout:1677: finishing write tid 3 to smithi13777483-23 2024-03-04T06:47:30.484 INFO:tasks.rados.rados.0.smithi137.stdout:1677: finishing write tid 4 to smithi13777483-23 2024-03-04T06:47:30.484 INFO:tasks.rados.rados.0.smithi137.stdout:1677: finishing write tid 5 to smithi13777483-23 2024-03-04T06:47:30.486 INFO:tasks.rados.rados.0.smithi137.stdout:1677: finishing write tid 6 to smithi13777483-23 2024-03-04T06:47:30.486 INFO:tasks.rados.rados.0.smithi137.stdout:1677: oid 23 updating version 0 to 936 2024-03-04T06:47:30.486 INFO:tasks.rados.rados.0.smithi137.stdout:1677: oid 23 updating version 936 to 937 2024-03-04T06:47:30.486 INFO:tasks.rados.rados.0.smithi137.stdout:1677: oid 23 updating version 937 to 938 2024-03-04T06:47:30.486 INFO:tasks.rados.rados.0.smithi137.stdout:1677: oid 23 version 938 is already newer than 935 2024-03-04T06:47:30.486 INFO:tasks.rados.rados.0.smithi137.stdout:1677: oid 23 updating version 938 to 939 2024-03-04T06:47:30.486 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 939 (ObjNum 552 snap 157 seq_num 552) dirty exists 2024-03-04T06:47:30.486 INFO:tasks.rados.rados.0.smithi137.stdout:1677: left oid 23 (ObjNum 552 snap 157 seq_num 552) 2024-03-04T06:47:30.708 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[88869]: osdmap e386: 8 total, 8 up, 8 in 2024-03-04T06:47:30.709 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset d4=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:30.709 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:30.709 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:30.709 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[88869]: Upgrade: Updating osd.3 2024-03-04T06:47:30.709 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:30.709 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-04T06:47:30.709 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:47:30.709 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[88869]: Deploying daemon osd.3 on smithi137 2024-03-04T06:47:30.709 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[88869]: pgmap v253: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 196 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 MiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-03-04T06:47:30.709 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[91314]: osdmap e386: 8 total, 8 up, 8 in 2024-03-04T06:47:30.709 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset d4=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:30.710 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:30.710 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:30.710 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[91314]: Upgrade: Updating osd.3 2024-03-04T06:47:30.710 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:30.710 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-04T06:47:30.710 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:47:30.710 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[91314]: Deploying daemon osd.3 on smithi137 2024-03-04T06:47:30.710 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-mon[91314]: pgmap v253: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 196 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 MiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-03-04T06:47:30.710 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:30.466+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:30.710 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:30.466+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:30.711 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:30.460+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:30 smithi203 ceph-mon[85573]: osdmap e386: 8 total, 8 up, 8 in 2024-03-04T06:47:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset d4=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:30 smithi203 ceph-mon[85573]: Upgrade: Updating osd.3 2024-03-04T06:47:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-04T06:47:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:47:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:30 smithi203 ceph-mon[85573]: Deploying daemon osd.3 on smithi137 2024-03-04T06:47:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:30 smithi203 ceph-mon[85573]: pgmap v253: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 196 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 MiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-03-04T06:47:31.467 INFO:tasks.rados.rados.0.smithi137.stdout:1677: done (1 left) 2024-03-04T06:47:31.468 INFO:tasks.rados.rados.0.smithi137.stdout:1678: done (0 left) 2024-03-04T06:47:31.468 INFO:tasks.rados.rados.0.smithi137.stdout:1679: read oid 33 snap -1 2024-03-04T06:47:31.468 INFO:tasks.rados.rados.0.smithi137.stdout:1679: expect deleted 2024-03-04T06:47:31.468 INFO:tasks.rados.rados.0.smithi137.stdout:1680: read oid 6 snap -1 2024-03-04T06:47:31.468 INFO:tasks.rados.rados.0.smithi137.stdout:1680: expect deleted 2024-03-04T06:47:31.468 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 158 2024-03-04T06:47:31.468 INFO:tasks.rados.rados.0.smithi137.stdout:1681: seq_num 553 ranges {712704=466944,1179648=417792,1597440=417792,2015232=516096,2531328=253952} 2024-03-04T06:47:31.474 INFO:tasks.rados.rados.0.smithi137.stdout:1681: writing smithi13777483-2 from 712704 to 1179648 tid 1 2024-03-04T06:47:31.477 INFO:tasks.rados.rados.0.smithi137.stdout:1681: writing smithi13777483-2 from 1179648 to 1597440 tid 2 2024-03-04T06:47:31.480 INFO:tasks.rados.rados.0.smithi137.stdout:1681: writing smithi13777483-2 from 1597440 to 2015232 tid 3 2024-03-04T06:47:31.483 INFO:tasks.rados.rados.0.smithi137.stdout:1681: writing smithi13777483-2 from 2015232 to 2531328 tid 4 2024-03-04T06:47:31.485 INFO:tasks.rados.rados.0.smithi137.stdout:1681: writing smithi13777483-2 from 2531328 to 2785280 tid 5 2024-03-04T06:47:31.485 INFO:tasks.rados.rados.0.smithi137.stdout:1682: delete oid 8 current snap is 158 2024-03-04T06:47:31.485 INFO:tasks.rados.rados.0.smithi137.stdout:1681: finishing write tid 1 to smithi13777483-2 2024-03-04T06:47:31.485 INFO:tasks.rados.rados.0.smithi137.stdout:1681: finishing write tid 2 to smithi13777483-2 2024-03-04T06:47:31.485 INFO:tasks.rados.rados.0.smithi137.stdout:1681: finishing write tid 3 to smithi13777483-2 2024-03-04T06:47:31.487 INFO:tasks.rados.rados.0.smithi137.stdout:1681: finishing write tid 4 to smithi13777483-2 2024-03-04T06:47:31.487 INFO:tasks.rados.rados.0.smithi137.stdout:1681: finishing write tid 5 to smithi13777483-2 2024-03-04T06:47:31.489 INFO:tasks.rados.rados.0.smithi137.stdout:1679: done (3 left) 2024-03-04T06:47:31.489 INFO:tasks.rados.rados.0.smithi137.stdout:1680: done (2 left) 2024-03-04T06:47:31.489 INFO:tasks.rados.rados.0.smithi137.stdout:1682: done (1 left) 2024-03-04T06:47:31.489 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 40 current snap is 158 2024-03-04T06:47:31.489 INFO:tasks.rados.rados.0.smithi137.stdout:1683: seq_num 555 ranges {3473408=499712,3973120=638976,4612096=425984,5038080=540672} 2024-03-04T06:47:31.511 INFO:tasks.rados.rados.0.smithi137.stdout:1683: writing smithi13777483-40 from 3473408 to 3973120 tid 1 2024-03-04T06:47:31.514 INFO:tasks.rados.rados.0.smithi137.stdout:1683: writing smithi13777483-40 from 3973120 to 4612096 tid 2 2024-03-04T06:47:31.517 INFO:tasks.rados.rados.0.smithi137.stdout:1683: writing smithi13777483-40 from 4612096 to 5038080 tid 3 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:1683: writing smithi13777483-40 from 5038080 to 5578752 tid 4 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 158 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:1681: finishing write tid 6 to smithi13777483-2 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:1681: finishing write tid 7 to smithi13777483-2 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:1681: oid 2 updating version 0 to 1092 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:1681: oid 2 version 1092 is already newer than 1090 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:1681: oid 2 version 1092 is already newer than 1091 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:1681: oid 2 version 1092 is already newer than 1089 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:1681: oid 2 version 1092 is already newer than 1088 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:1681: oid 2 updating version 1092 to 1093 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 1093 (ObjNum 553 snap 158 seq_num 553) dirty exists 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:1681: left oid 2 (ObjNum 553 snap 158 seq_num 553) 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:1683: finishing write tid 1 to smithi13777483-40 2024-03-04T06:47:31.521 INFO:tasks.rados.rados.0.smithi137.stdout:1684: seq_num 556 ranges {7610368=516096,8126464=524288,8650752=638976,9289728=442368} 2024-03-04T06:47:31.565 INFO:tasks.rados.rados.0.smithi137.stdout:1684: writing smithi13777483-44 from 7610368 to 8126464 tid 1 2024-03-04T06:47:31.568 INFO:tasks.rados.rados.0.smithi137.stdout:1684: writing smithi13777483-44 from 8126464 to 8650752 tid 2 2024-03-04T06:47:31.571 INFO:tasks.rados.rados.0.smithi137.stdout:1684: writing smithi13777483-44 from 8650752 to 9289728 tid 3 2024-03-04T06:47:31.575 INFO:tasks.rados.rados.0.smithi137.stdout:1684: writing smithi13777483-44 from 9289728 to 9732096 tid 4 2024-03-04T06:47:31.575 INFO:tasks.rados.rados.0.smithi137.stdout:1681: done (2 left) 2024-03-04T06:47:31.575 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 158 2024-03-04T06:47:31.575 INFO:tasks.rados.rados.0.smithi137.stdout:1683: finishing write tid 2 to smithi13777483-40 2024-03-04T06:47:31.575 INFO:tasks.rados.rados.0.smithi137.stdout:1683: finishing write tid 3 to smithi13777483-40 2024-03-04T06:47:31.575 INFO:tasks.rados.rados.0.smithi137.stdout:1683: finishing write tid 4 to smithi13777483-40 2024-03-04T06:47:31.575 INFO:tasks.rados.rados.0.smithi137.stdout:1683: finishing write tid 5 to smithi13777483-40 2024-03-04T06:47:31.575 INFO:tasks.rados.rados.0.smithi137.stdout:1683: finishing write tid 6 to smithi13777483-40 2024-03-04T06:47:31.575 INFO:tasks.rados.rados.0.smithi137.stdout:1683: oid 40 updating version 0 to 15458 2024-03-04T06:47:31.576 INFO:tasks.rados.rados.0.smithi137.stdout:1683: oid 40 updating version 15458 to 15459 2024-03-04T06:47:31.576 INFO:tasks.rados.rados.0.smithi137.stdout:1683: oid 40 version 15459 is already newer than 15457 2024-03-04T06:47:31.576 INFO:tasks.rados.rados.0.smithi137.stdout:1683: oid 40 version 15459 is already newer than 15456 2024-03-04T06:47:31.576 INFO:tasks.rados.rados.0.smithi137.stdout:1683: oid 40 updating version 15459 to 15460 2024-03-04T06:47:31.576 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 15460 (ObjNum 555 snap 158 seq_num 555) dirty exists 2024-03-04T06:47:31.576 INFO:tasks.rados.rados.0.smithi137.stdout:1683: left oid 40 (ObjNum 555 snap 158 seq_num 555) 2024-03-04T06:47:31.576 INFO:tasks.rados.rados.0.smithi137.stdout:1685: seq_num 557 ranges {2056192=532480,2588672=802816,3391488=794624,4186112=8192} 2024-03-04T06:47:31.589 INFO:tasks.rados.rados.0.smithi137.stdout:1685: writing smithi13777483-23 from 2056192 to 2588672 tid 1 2024-03-04T06:47:31.593 INFO:tasks.rados.rados.0.smithi137.stdout:1685: writing smithi13777483-23 from 2588672 to 3391488 tid 2 2024-03-04T06:47:31.598 INFO:tasks.rados.rados.0.smithi137.stdout:1685: writing smithi13777483-23 from 3391488 to 4186112 tid 3 2024-03-04T06:47:31.598 INFO:tasks.rados.rados.0.smithi137.stdout:1685: writing smithi13777483-23 from 4186112 to 4194304 tid 4 2024-03-04T06:47:31.598 INFO:tasks.rados.rados.0.smithi137.stdout:1683: done (2 left) 2024-03-04T06:47:31.598 INFO:tasks.rados.rados.0.smithi137.stdout:1686: delete oid 1 current snap is 158 2024-03-04T06:47:31.598 INFO:tasks.rados.rados.0.smithi137.stdout:1684: finishing write tid 1 to smithi13777483-44 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:1684: finishing write tid 2 to smithi13777483-44 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:1684: finishing write tid 3 to smithi13777483-44 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:1684: finishing write tid 4 to smithi13777483-44 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:1684: finishing write tid 5 to smithi13777483-44 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:1684: finishing write tid 6 to smithi13777483-44 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:1684: oid 44 updating version 0 to 16759 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:1684: oid 44 version 16759 is already newer than 16757 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:1684: oid 44 updating version 16759 to 16760 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:1684: oid 44 version 16760 is already newer than 16756 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:1684: oid 44 version 16760 is already newer than 16758 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16760 (ObjNum 556 snap 158 seq_num 556) dirty exists 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:1684: left oid 44 (ObjNum 556 snap 158 seq_num 556) 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:1685: finishing write tid 1 to smithi13777483-23 2024-03-04T06:47:31.599 INFO:tasks.rados.rados.0.smithi137.stdout:1685: finishing write tid 2 to smithi13777483-23 2024-03-04T06:47:31.600 INFO:tasks.rados.rados.0.smithi137.stdout:1684: done (2 left) 2024-03-04T06:47:31.600 INFO:tasks.rados.rados.0.smithi137.stdout:1686: done (1 left) 2024-03-04T06:47:31.600 INFO:tasks.rados.rados.0.smithi137.stdout:1687: rmattr oid 7 current snap is 158 2024-03-04T06:47:31.600 INFO:tasks.rados.rados.0.smithi137.stdout:1687: done (1 left) 2024-03-04T06:47:31.601 INFO:tasks.rados.rados.0.smithi137.stdout:1688: read oid 29 snap -1 2024-03-04T06:47:31.601 INFO:tasks.rados.rados.0.smithi137.stdout:1688: expect (ObjNum 550 snap 157 seq_num 550) 2024-03-04T06:47:31.601 INFO:tasks.rados.rados.0.smithi137.stdout:1689: snap_create 2024-03-04T06:47:31.602 INFO:tasks.rados.rados.0.smithi137.stdout:1685: finishing write tid 3 to smithi13777483-23 2024-03-04T06:47:31.602 INFO:tasks.rados.rados.0.smithi137.stdout:1685: finishing write tid 4 to smithi13777483-23 2024-03-04T06:47:31.603 INFO:tasks.rados.rados.0.smithi137.stdout:1685: finishing write tid 5 to smithi13777483-23 2024-03-04T06:47:31.605 INFO:tasks.rados.rados.0.smithi137.stdout:1685: finishing write tid 6 to smithi13777483-23 2024-03-04T06:47:31.605 INFO:tasks.rados.rados.0.smithi137.stdout:1685: oid 23 updating version 0 to 941 2024-03-04T06:47:31.605 INFO:tasks.rados.rados.0.smithi137.stdout:1685: oid 23 updating version 941 to 942 2024-03-04T06:47:31.605 INFO:tasks.rados.rados.0.smithi137.stdout:1685: oid 23 version 942 is already newer than 940 2024-03-04T06:47:31.605 INFO:tasks.rados.rados.0.smithi137.stdout:1685: oid 23 updating version 942 to 944 2024-03-04T06:47:31.605 INFO:tasks.rados.rados.0.smithi137.stdout:1685: oid 23 version 944 is already newer than 943 2024-03-04T06:47:31.605 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 944 (ObjNum 557 snap 158 seq_num 557) dirty exists 2024-03-04T06:47:31.605 INFO:tasks.rados.rados.0.smithi137.stdout:1685: left oid 23 (ObjNum 557 snap 158 seq_num 557) 2024-03-04T06:47:31.618 INFO:tasks.rados.rados.0.smithi137.stdout:1688: expect (ObjNum 550 snap 157 seq_num 550) 2024-03-04T06:47:31.696 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:31.489+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:31.696 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:31 smithi137 ceph-mon[88869]: osdmap e387: 8 total, 8 up, 8 in 2024-03-04T06:47:31.696 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:31.696 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:31.696 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:31.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:31 smithi137 ceph-mon[91314]: osdmap e387: 8 total, 8 up, 8 in 2024-03-04T06:47:31.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:31.697 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:31.697 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:31.697 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:31.515+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:31.697 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:31.515+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:31.697 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:31.515+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:31.747 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:31 smithi203 ceph-mon[85573]: osdmap e387: 8 total, 8 up, 8 in 2024-03-04T06:47:31.747 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:31.747 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:31.747 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:32.478 INFO:tasks.rados.rados.0.smithi137.stdout:1685: done (2 left) 2024-03-04T06:47:32.478 INFO:tasks.rados.rados.0.smithi137.stdout:1688: done (1 left) 2024-03-04T06:47:32.478 INFO:tasks.rados.rados.0.smithi137.stdout:1689: done (0 left) 2024-03-04T06:47:32.478 INFO:tasks.rados.rados.0.smithi137.stdout:1690: snap_remove snap 158 2024-03-04T06:47:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:32 smithi137 ceph-mon[91314]: osdmap e388: 8 total, 8 up, 8 in 2024-03-04T06:47:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:32 smithi137 ceph-mon[91314]: pgmap v256: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 196 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 MiB/s rd, 2.6 MiB/s wr, 16 op/s 2024-03-04T06:47:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:32 smithi137 ceph-mon[88869]: osdmap e388: 8 total, 8 up, 8 in 2024-03-04T06:47:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:32 smithi137 ceph-mon[88869]: pgmap v256: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 196 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 MiB/s rd, 2.6 MiB/s wr, 16 op/s 2024-03-04T06:47:32.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:32 smithi203 ceph-mon[85573]: osdmap e388: 8 total, 8 up, 8 in 2024-03-04T06:47:32.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:32.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset bf=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:32.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:32.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:32 smithi203 ceph-mon[85573]: pgmap v256: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 196 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 MiB/s rd, 2.6 MiB/s wr, 16 op/s 2024-03-04T06:47:32.928 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:32.751+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:32.928 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:32.752+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d7=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf],d7=[d7,d6,d5,d1,d0]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:32.929 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:32.752+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:33.476 INFO:tasks.rados.rados.0.smithi137.stdout:1690: done (0 left) 2024-03-04T06:47:33.476 INFO:tasks.rados.rados.0.smithi137.stdout:1691: snap_remove snap 155 2024-03-04T06:47:33.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:33 smithi137 ceph-mon[91314]: osdmap e389: 8 total, 8 up, 8 in 2024-03-04T06:47:33.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:33.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:33 smithi137 ceph-mon[88869]: osdmap e389: 8 total, 8 up, 8 in 2024-03-04T06:47:33.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:33.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:33 smithi137 systemd[1]: Stopping Ceph osd.3 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:47:33.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:33.475+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:33.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:33.476+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d7=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf],d7=[d7,d6,d5,d1,d0]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:33.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:33.476+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:33.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:33 smithi203 ceph-mon[85573]: osdmap e389: 8 total, 8 up, 8 in 2024-03-04T06:47:33.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:34.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:33.714+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:34.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[59225]: 2024-03-04T06:47:33.600+0000 7fb28ba95700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:47:34.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[59225]: 2024-03-04T06:47:33.600+0000 7fb28ba95700 -1 osd.3 390 *** Got signal Terminated *** 2024-03-04T06:47:34.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[59225]: 2024-03-04T06:47:33.600+0000 7fb28ba95700 -1 osd.3 390 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T06:47:34.488 INFO:tasks.rados.rados.0.smithi137.stdout:1691: done (0 left) 2024-03-04T06:47:34.489 INFO:tasks.rados.rados.0.smithi137.stdout:1692: rmattr oid 42 current snap is 159 2024-03-04T06:47:34.489 INFO:tasks.rados.rados.0.smithi137.stdout:1692: done (0 left) 2024-03-04T06:47:34.489 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 159 2024-03-04T06:47:34.489 INFO:tasks.rados.rados.0.smithi137.stdout:1693: seq_num 559 ranges {7610368=565248,8175616=573440,8749056=409600,9158656=622592} 2024-03-04T06:47:34.529 INFO:tasks.rados.rados.0.smithi137.stdout:1693: writing smithi13777483-18 from 7610368 to 8175616 tid 1 2024-03-04T06:47:34.532 INFO:tasks.rados.rados.0.smithi137.stdout:1693: writing smithi13777483-18 from 8175616 to 8749056 tid 2 2024-03-04T06:47:34.535 INFO:tasks.rados.rados.0.smithi137.stdout:1693: writing smithi13777483-18 from 8749056 to 9158656 tid 3 2024-03-04T06:47:34.539 INFO:tasks.rados.rados.0.smithi137.stdout:1693: writing smithi13777483-18 from 9158656 to 9781248 tid 4 2024-03-04T06:47:34.539 INFO:tasks.rados.rados.0.smithi137.stdout:1694: read oid 15 snap -1 2024-03-04T06:47:34.539 INFO:tasks.rados.rados.0.smithi137.stdout:1694: expect deleted 2024-03-04T06:47:34.539 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 159 2024-03-04T06:47:34.539 INFO:tasks.rados.rados.0.smithi137.stdout:1695: seq_num 560 ranges {7536640=581632,8118272=458752,8577024=614400,9191424=532480} 2024-03-04T06:47:34.581 INFO:tasks.rados.rados.0.smithi137.stdout:1695: writing smithi13777483-47 from 7536640 to 8118272 tid 1 2024-03-04T06:47:34.584 INFO:tasks.rados.rados.0.smithi137.stdout:1695: writing smithi13777483-47 from 8118272 to 8577024 tid 2 2024-03-04T06:47:34.588 INFO:tasks.rados.rados.0.smithi137.stdout:1695: writing smithi13777483-47 from 8577024 to 9191424 tid 3 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:1695: writing smithi13777483-47 from 9191424 to 9723904 tid 4 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:1696: delete oid 42 current snap is 159 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:1693: finishing write tid 1 to smithi13777483-18 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:1693: finishing write tid 2 to smithi13777483-18 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:1693: finishing write tid 3 to smithi13777483-18 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:1693: finishing write tid 4 to smithi13777483-18 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:1693: finishing write tid 5 to smithi13777483-18 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:1693: finishing write tid 6 to smithi13777483-18 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:1693: oid 18 updating version 0 to 16760 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:1693: oid 18 version 16760 is already newer than 16758 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:1693: oid 18 version 16760 is already newer than 16756 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:1693: oid 18 version 16760 is already newer than 16759 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:1693: oid 18 version 16760 is already newer than 16757 2024-03-04T06:47:34.592 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16760 (ObjNum 559 snap 159 seq_num 559) dirty exists 2024-03-04T06:47:34.593 INFO:tasks.rados.rados.0.smithi137.stdout:1693: left oid 18 (ObjNum 559 snap 159 seq_num 559) 2024-03-04T06:47:34.593 INFO:tasks.rados.rados.0.smithi137.stdout:1695: finishing write tid 1 to smithi13777483-47 2024-03-04T06:47:34.593 INFO:tasks.rados.rados.0.smithi137.stdout:1695: finishing write tid 2 to smithi13777483-47 2024-03-04T06:47:34.594 INFO:tasks.rados.rados.0.smithi137.stdout:1693: done (3 left) 2024-03-04T06:47:34.594 INFO:tasks.rados.rados.0.smithi137.stdout:1694: done (2 left) 2024-03-04T06:47:34.594 INFO:tasks.rados.rados.0.smithi137.stdout:1696: done (1 left) 2024-03-04T06:47:34.594 INFO:tasks.rados.rados.0.smithi137.stdout:1697: read oid 34 snap -1 2024-03-04T06:47:34.594 INFO:tasks.rados.rados.0.smithi137.stdout:1697: expect deleted 2024-03-04T06:47:34.594 INFO:tasks.rados.rados.0.smithi137.stdout:1698: delete oid 36 current snap is 159 2024-03-04T06:47:34.595 INFO:tasks.rados.rados.0.smithi137.stdout:1695: finishing write tid 3 to smithi13777483-47 2024-03-04T06:47:34.595 INFO:tasks.rados.rados.0.smithi137.stdout:1695: finishing write tid 4 to smithi13777483-47 2024-03-04T06:47:34.595 INFO:tasks.rados.rados.0.smithi137.stdout:1695: finishing write tid 5 to smithi13777483-47 2024-03-04T06:47:34.597 INFO:tasks.rados.rados.0.smithi137.stdout:1698: done (2 left) 2024-03-04T06:47:34.597 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 159 2024-03-04T06:47:34.597 INFO:tasks.rados.rados.0.smithi137.stdout:1699: seq_num 563 ranges {6160384=638976,6799360=565248,7364608=794624,8159232=245760} 2024-03-04T06:47:34.632 INFO:tasks.rados.rados.0.smithi137.stdout:1699: writing smithi13777483-31 from 6160384 to 6799360 tid 1 2024-03-04T06:47:34.635 INFO:tasks.rados.rados.0.smithi137.stdout:1699: writing smithi13777483-31 from 6799360 to 7364608 tid 2 2024-03-04T06:47:34.640 INFO:tasks.rados.rados.0.smithi137.stdout:1699: writing smithi13777483-31 from 7364608 to 8159232 tid 3 2024-03-04T06:47:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:1699: writing smithi13777483-31 from 8159232 to 8404992 tid 4 2024-03-04T06:47:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 159 2024-03-04T06:47:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:1695: finishing write tid 6 to smithi13777483-47 2024-03-04T06:47:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:1695: oid 47 updating version 0 to 15457 2024-03-04T06:47:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:1695: oid 47 version 15457 is already newer than 15454 2024-03-04T06:47:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:1695: oid 47 version 15457 is already newer than 15455 2024-03-04T06:47:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:1695: oid 47 updating version 15457 to 15458 2024-03-04T06:47:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:1695: oid 47 version 15458 is already newer than 15456 2024-03-04T06:47:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 15458 (ObjNum 560 snap 159 seq_num 560) dirty exists 2024-03-04T06:47:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:1695: left oid 47 (ObjNum 560 snap 159 seq_num 560) 2024-03-04T06:47:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:1699: finishing write tid 1 to smithi13777483-31 2024-03-04T06:47:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:1699: finishing write tid 2 to smithi13777483-31 2024-03-04T06:47:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:1700: seq_num 564 ranges {9781248=655360,10436608=442368,10878976=598016,11476992=565248} 2024-03-04T06:47:34.696 INFO:tasks.rados.rados.0.smithi137.stdout:1700: writing smithi13777483-18 from 9781248 to 10436608 tid 1 2024-03-04T06:47:34.699 INFO:tasks.rados.rados.0.smithi137.stdout:1700: writing smithi13777483-18 from 10436608 to 10878976 tid 2 2024-03-04T06:47:34.702 INFO:tasks.rados.rados.0.smithi137.stdout:1700: writing smithi13777483-18 from 10878976 to 11476992 tid 3 2024-03-04T06:47:34.706 INFO:tasks.rados.rados.0.smithi137.stdout:1700: writing smithi13777483-18 from 11476992 to 12042240 tid 4 2024-03-04T06:47:34.706 INFO:tasks.rados.rados.0.smithi137.stdout:1695: done (3 left) 2024-03-04T06:47:34.706 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 159 2024-03-04T06:47:34.706 INFO:tasks.rados.rados.0.smithi137.stdout:1699: finishing write tid 3 to smithi13777483-31 2024-03-04T06:47:34.706 INFO:tasks.rados.rados.0.smithi137.stdout:1699: finishing write tid 4 to smithi13777483-31 2024-03-04T06:47:34.706 INFO:tasks.rados.rados.0.smithi137.stdout:1699: finishing write tid 5 to smithi13777483-31 2024-03-04T06:47:34.706 INFO:tasks.rados.rados.0.smithi137.stdout:1701: seq_num 565 ranges {4194304=671744,4866048=729088,5595136=753664,6348800=122880} 2024-03-04T06:47:34.731 INFO:tasks.rados.rados.0.smithi137.stdout:1701: writing smithi13777483-23 from 4194304 to 4866048 tid 1 2024-03-04T06:47:34.735 INFO:tasks.rados.rados.0.smithi137.stdout:1701: writing smithi13777483-23 from 4866048 to 5595136 tid 2 2024-03-04T06:47:34.739 INFO:tasks.rados.rados.0.smithi137.stdout:1701: writing smithi13777483-23 from 5595136 to 6348800 tid 3 2024-03-04T06:47:34.741 INFO:tasks.rados.rados.0.smithi137.stdout:1701: writing smithi13777483-23 from 6348800 to 6471680 tid 4 2024-03-04T06:47:34.741 INFO:tasks.rados.rados.0.smithi137.stdout:1702: read oid 8 snap -1 2024-03-04T06:47:34.741 INFO:tasks.rados.rados.0.smithi137.stdout:1702: expect deleted 2024-03-04T06:47:34.741 INFO:tasks.rados.rados.0.smithi137.stdout:1703: copy_from oid 42 from oid 15 current snap is 159 2024-03-04T06:47:34.741 INFO:tasks.rados.rados.0.smithi137.stdout:1699: finishing write tid 6 to smithi13777483-31 2024-03-04T06:47:34.741 INFO:tasks.rados.rados.0.smithi137.stdout:1699: oid 31 updating version 0 to 791 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1699: oid 31 version 791 is already newer than 788 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1699: oid 31 version 791 is already newer than 789 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1699: oid 31 version 791 is already newer than 790 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1699: oid 31 updating version 791 to 792 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 792 (ObjNum 563 snap 159 seq_num 563) dirty exists 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1699: left oid 31 (ObjNum 563 snap 159 seq_num 563) 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1700: finishing write tid 1 to smithi13777483-18 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1699: done (5 left) 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1704: read oid 35 snap -1 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1704: expect (ObjNum 539 snap 155 seq_num 539) 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1705: read oid 44 snap -1 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1705: expect (ObjNum 556 snap 158 seq_num 556) 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1706: rmattr oid 26 current snap is 159 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1700: finishing write tid 2 to smithi13777483-18 2024-03-04T06:47:34.742 INFO:tasks.rados.rados.0.smithi137.stdout:1700: finishing write tid 3 to smithi13777483-18 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1700: finishing write tid 4 to smithi13777483-18 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1700: finishing write tid 5 to smithi13777483-18 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1700: finishing write tid 6 to smithi13777483-18 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1700: oid 18 updating version 0 to 16764 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1700: oid 18 updating version 16764 to 16765 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1700: oid 18 version 16765 is already newer than 16762 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1700: oid 18 version 16765 is already newer than 16763 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1700: oid 18 version 16765 is already newer than 16761 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16765 (ObjNum 564 snap 159 seq_num 564) dirty exists 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1700: left oid 18 (ObjNum 564 snap 159 seq_num 564) 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1701: finishing write tid 1 to smithi13777483-23 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1701: finishing write tid 2 to smithi13777483-23 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1700: done (7 left) 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1707: delete oid 39 current snap is 159 2024-03-04T06:47:34.743 INFO:tasks.rados.rados.0.smithi137.stdout:1703: finishing copy_from to smithi13777483-42 2024-03-04T06:47:34.744 INFO:tasks.rados.rados.0.smithi137.stdout:1703: got expected ENOENT (src dne) 2024-03-04T06:47:34.744 INFO:tasks.rados.rados.0.smithi137.stdout:1703: finishing copy_from racing read to smithi13777483-42 2024-03-04T06:47:34.746 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16766 (ObjNum 531 snap 150 seq_num 531) dirty exists 2024-03-04T06:47:34.748 INFO:tasks.rados.rados.0.smithi137.stdout:1701: finishing write tid 3 to smithi13777483-23 2024-03-04T06:47:34.748 INFO:tasks.rados.rados.0.smithi137.stdout:1701: finishing write tid 4 to smithi13777483-23 2024-03-04T06:47:34.748 INFO:tasks.rados.rados.0.smithi137.stdout:1701: finishing write tid 5 to smithi13777483-23 2024-03-04T06:47:34.749 INFO:tasks.rados.rados.0.smithi137.stdout:1703: done (7 left) 2024-03-04T06:47:34.749 INFO:tasks.rados.rados.0.smithi137.stdout:1706: done (6 left) 2024-03-04T06:47:34.749 INFO:tasks.rados.rados.0.smithi137.stdout:1707: done (5 left) 2024-03-04T06:47:34.749 INFO:tasks.rados.rados.0.smithi137.stdout:1708: snap_remove snap 157 2024-03-04T06:47:34.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:34.489+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:34.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:34.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset d7=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf],d7=[d7,d6,d5,d1,d0]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:34.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[91314]: osdmap e390: 8 total, 8 up, 8 in 2024-03-04T06:47:34.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset d7=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf],d7=[d7,d6,d5,d1,d0]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[91314]: osd.3 marked itself down and dead 2024-03-04T06:47:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[91314]: pgmap v259: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 211 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-03-04T06:47:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[91314]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:47:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset d7=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf],d7=[d7,d6,d5,d1,d0]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[88869]: osdmap e390: 8 total, 8 up, 8 in 2024-03-04T06:47:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset d7=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf],d7=[d7,d6,d5,d1,d0]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[88869]: osd.3 marked itself down and dead 2024-03-04T06:47:34.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:34.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[88869]: pgmap v259: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 211 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-03-04T06:47:34.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-mon[88869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:47:34.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:34.498+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset d7=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf],d7=[d7,d6,d5,d1,d0]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:34 smithi203 ceph-mon[85573]: osdmap e390: 8 total, 8 up, 8 in 2024-03-04T06:47:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset d7=[]:{a5=[a5,a4,a2,a0,9f,9e],ab=[ab,aa,a9,a8,a7,a6],ad=[ad,ac],b4=[b3,b1,b0,af],be=[be],bf=[bf],d7=[d7,d6,d5,d1,d0]} for object 5:c64b2138:::smithi13777483-44:8a 2024-03-04T06:47:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:34 smithi203 ceph-mon[85573]: osd.3 marked itself down and dead 2024-03-04T06:47:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:34 smithi203 ceph-mon[85573]: pgmap v259: 121 pgs: 3 active+clean+snaptrim_error, 118 active+clean; 211 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-03-04T06:47:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:34 smithi203 ceph-mon[85573]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:47:35.192 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:34 smithi137 podman[111233]: 2024-03-04 06:47:34.916522047 +0000 UTC m=+1.451265266 container died afdbc25c9fba788378f935aa905c1999bd185062831858e35b2e82e6b979313c (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=reef-5cc7a76) 2024-03-04T06:47:35.478 INFO:tasks.rados.rados.0.smithi137.stdout:1708: done (5 left) 2024-03-04T06:47:35.479 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 159 2024-03-04T06:47:35.479 INFO:tasks.rados.rados.0.smithi137.stdout:1701: finishing write tid 6 to smithi13777483-23 2024-03-04T06:47:35.479 INFO:tasks.rados.rados.0.smithi137.stdout:1701: oid 23 updating version 0 to 947 2024-03-04T06:47:35.479 INFO:tasks.rados.rados.0.smithi137.stdout:1701: oid 23 updating version 947 to 949 2024-03-04T06:47:35.479 INFO:tasks.rados.rados.0.smithi137.stdout:1701: oid 23 version 949 is already newer than 948 2024-03-04T06:47:35.479 INFO:tasks.rados.rados.0.smithi137.stdout:1701: oid 23 version 949 is already newer than 945 2024-03-04T06:47:35.479 INFO:tasks.rados.rados.0.smithi137.stdout:1701: oid 23 version 949 is already newer than 946 2024-03-04T06:47:35.479 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 949 (ObjNum 565 snap 159 seq_num 565) dirty exists 2024-03-04T06:47:35.479 INFO:tasks.rados.rados.0.smithi137.stdout:1701: left oid 23 (ObjNum 565 snap 159 seq_num 565) 2024-03-04T06:47:35.479 INFO:tasks.rados.rados.0.smithi137.stdout:1709: seq_num 567 ranges {1990656=704512,2695168=499712,3194880=770048,3964928=335872} 2024-03-04T06:47:35.482 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:47:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:47:35] "GET /metrics HTTP/1.1" 200 36262 "" "Prometheus/2.43.0" 2024-03-04T06:47:35.483 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:35 smithi137 podman[111233]: 2024-03-04 06:47:35.282455503 +0000 UTC m=+1.817198719 container cleanup afdbc25c9fba788378f935aa905c1999bd185062831858e35b2e82e6b979313c (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3, RELEASE=reef-5cc7a76, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:47:35.483 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:35 smithi137 bash[111233]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3 2024-03-04T06:47:35.494 INFO:tasks.rados.rados.0.smithi137.stdout:1709: writing smithi13777483-4 from 1990656 to 2695168 tid 1 2024-03-04T06:47:35.498 INFO:tasks.rados.rados.0.smithi137.stdout:1709: writing smithi13777483-4 from 2695168 to 3194880 tid 2 2024-03-04T06:47:35.502 INFO:tasks.rados.rados.0.smithi137.stdout:1709: writing smithi13777483-4 from 3194880 to 3964928 tid 3 2024-03-04T06:47:35.505 INFO:tasks.rados.rados.0.smithi137.stdout:1709: writing smithi13777483-4 from 3964928 to 4300800 tid 4 2024-03-04T06:47:35.505 INFO:tasks.rados.rados.0.smithi137.stdout:1701: done (5 left) 2024-03-04T06:47:35.505 INFO:tasks.rados.rados.0.smithi137.stdout:1710: read oid 28 snap -1 2024-03-04T06:47:35.505 INFO:tasks.rados.rados.0.smithi137.stdout:1710: expect (ObjNum 407 snap 122 seq_num 407) 2024-03-04T06:47:35.505 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 159 2024-03-04T06:47:35.505 INFO:tasks.rados.rados.0.smithi137.stdout:1711: seq_num 568 ranges {5275648=720896,5996544=786432,6782976=581632,7364608=237568} 2024-03-04T06:47:35.539 INFO:tasks.rados.rados.0.smithi137.stdout:1711: writing smithi13777483-46 from 5275648 to 5996544 tid 1 2024-03-04T06:47:35.545 INFO:tasks.rados.rados.0.smithi137.stdout:1711: writing smithi13777483-46 from 5996544 to 6782976 tid 2 2024-03-04T06:47:35.548 INFO:tasks.rados.rados.0.smithi137.stdout:1711: writing smithi13777483-46 from 6782976 to 7364608 tid 3 2024-03-04T06:47:35.549 INFO:tasks.rados.rados.0.smithi137.stdout:1711: writing smithi13777483-46 from 7364608 to 7602176 tid 4 2024-03-04T06:47:35.549 INFO:tasks.rados.rados.0.smithi137.stdout:1712: rmattr oid 47 current snap is 159 2024-03-04T06:47:35.549 INFO:tasks.rados.rados.0.smithi137.stdout:1704: expect (ObjNum 539 snap 155 seq_num 539) 2024-03-04T06:47:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:35 smithi137 ceph-mon[88869]: osdmap e391: 8 total, 7 up, 8 in 2024-03-04T06:47:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:35.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:35 smithi137 ceph-mon[88869]: osdmap e392: 8 total, 7 up, 8 in 2024-03-04T06:47:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:35 smithi137 ceph-mon[91314]: osdmap e391: 8 total, 7 up, 8 in 2024-03-04T06:47:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:35.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:35 smithi137 ceph-mon[91314]: osdmap e392: 8 total, 7 up, 8 in 2024-03-04T06:47:35.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:35.481+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:35.794 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:35 smithi137 podman[111252]: 2024-03-04 06:47:35.550781747 +0000 UTC m=+0.636501629 container remove afdbc25c9fba788378f935aa905c1999bd185062831858e35b2e82e6b979313c (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3, io.buildah.version=1.33.5, RELEASE=reef-5cc7a76, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS) 2024-03-04T06:47:35.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:35.486+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:35.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:35.486+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:35.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:35 smithi203 ceph-mon[85573]: osdmap e391: 8 total, 7 up, 8 in 2024-03-04T06:47:35.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:35.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:35.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:35 smithi203 ceph-mon[85573]: osdmap e392: 8 total, 7 up, 8 in 2024-03-04T06:47:36.179 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:35 smithi137 podman[111339]: 2024-03-04 06:47:35.801489383 +0000 UTC m=+0.020326962 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:47:36.180 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:35 smithi137 podman[111339]: 2024-03-04 06:47:35.918381047 +0000 UTC m=+0.137218617 container create d7bbfd76a0ba1e2a78e81a37681200e35fff8859785c54d2b55c6c188094a10e (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-04T06:47:36.180 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:36 smithi137 podman[111339]: 2024-03-04 06:47:36.179280144 +0000 UTC m=+0.398117717 container init d7bbfd76a0ba1e2a78e81a37681200e35fff8859785c54d2b55c6c188094a10e (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-deactivate, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-04T06:47:36.205 INFO:tasks.rados.rados.0.smithi137.stdout:1697: done (7 left) 2024-03-04T06:47:36.205 INFO:tasks.rados.rados.0.smithi137.stdout:1702: done (6 left) 2024-03-04T06:47:36.205 INFO:tasks.rados.rados.0.smithi137.stdout:1704: done (5 left) 2024-03-04T06:47:36.205 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 35 current snap is 159 2024-03-04T06:47:36.205 INFO:tasks.rados.rados.0.smithi137.stdout:1709: finishing write tid 1 to smithi13777483-4 2024-03-04T06:47:36.205 INFO:tasks.rados.rados.0.smithi137.stdout:1709: finishing write tid 2 to smithi13777483-4 2024-03-04T06:47:36.205 INFO:tasks.rados.rados.0.smithi137.stdout:1709: finishing write tid 3 to smithi13777483-4 2024-03-04T06:47:36.205 INFO:tasks.rados.rados.0.smithi137.stdout:1709: finishing write tid 4 to smithi13777483-4 2024-03-04T06:47:36.206 INFO:tasks.rados.rados.0.smithi137.stdout:1709: finishing write tid 5 to smithi13777483-4 2024-03-04T06:47:36.206 INFO:tasks.rados.rados.0.smithi137.stdout:1709: finishing write tid 6 to smithi13777483-4 2024-03-04T06:47:36.206 INFO:tasks.rados.rados.0.smithi137.stdout:1709: oid 4 updating version 0 to 154 2024-03-04T06:47:36.206 INFO:tasks.rados.rados.0.smithi137.stdout:1709: oid 4 version 154 is already newer than 153 2024-03-04T06:47:36.206 INFO:tasks.rados.rados.0.smithi137.stdout:1709: oid 4 updating version 154 to 156 2024-03-04T06:47:36.206 INFO:tasks.rados.rados.0.smithi137.stdout:1709: oid 4 version 156 is already newer than 155 2024-03-04T06:47:36.206 INFO:tasks.rados.rados.0.smithi137.stdout:1709: oid 4 version 156 is already newer than 152 2024-03-04T06:47:36.206 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 156 (ObjNum 567 snap 159 seq_num 567) dirty exists 2024-03-04T06:47:36.206 INFO:tasks.rados.rados.0.smithi137.stdout:1709: left oid 4 (ObjNum 567 snap 159 seq_num 567) 2024-03-04T06:47:36.206 INFO:tasks.rados.rados.0.smithi137.stdout:1710: expect (ObjNum 407 snap 122 seq_num 407) 2024-03-04T06:47:36.261 INFO:tasks.rados.rados.0.smithi137.stdout:1711: finishing write tid 1 to smithi13777483-46 2024-03-04T06:47:36.262 INFO:tasks.rados.rados.0.smithi137.stdout:1705: expect (ObjNum 556 snap 158 seq_num 556) 2024-03-04T06:47:36.478 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:36 smithi137 podman[111339]: 2024-03-04 06:47:36.182498666 +0000 UTC m=+0.401336239 container start d7bbfd76a0ba1e2a78e81a37681200e35fff8859785c54d2b55c6c188094a10e (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True) 2024-03-04T06:47:36.478 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:36 smithi137 podman[111339]: 2024-03-04 06:47:36.254180599 +0000 UTC m=+0.473018178 container attach d7bbfd76a0ba1e2a78e81a37681200e35fff8859785c54d2b55c6c188094a10e (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-deactivate, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-03-04T06:47:36.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:36.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:36.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:36 smithi137 ceph-mon[91314]: pgmap v262: 121 pgs: 16 stale+active+clean, 3 active+clean+snaptrim_error, 102 active+clean; 211 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-03-04T06:47:36.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:36.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:36.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:36 smithi137 ceph-mon[88869]: pgmap v262: 121 pgs: 16 stale+active+clean, 3 active+clean+snaptrim_error, 102 active+clean; 211 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-03-04T06:47:36.794 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:36 smithi137 podman[111339]: 2024-03-04 06:47:36.478876104 +0000 UTC m=+0.697713683 container died d7bbfd76a0ba1e2a78e81a37681200e35fff8859785c54d2b55c6c188094a10e (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-deactivate, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-03-04T06:47:36.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:36.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:36.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:36 smithi203 ceph-mon[85573]: pgmap v262: 121 pgs: 16 stale+active+clean, 3 active+clean+snaptrim_error, 102 active+clean; 211 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-03-04T06:47:36.984 INFO:tasks.rados.rados.0.smithi137.stdout:1711: finishing write tid 2 to smithi13777483-46 2024-03-04T06:47:36.984 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 15459 (ObjNum 560 snap 159 seq_num 560) dirty exists 2024-03-04T06:47:36.984 INFO:tasks.rados.rados.0.smithi137.stdout:1711: finishing write tid 3 to smithi13777483-46 2024-03-04T06:47:36.984 INFO:tasks.rados.rados.0.smithi137.stdout:1711: finishing write tid 4 to smithi13777483-46 2024-03-04T06:47:36.984 INFO:tasks.rados.rados.0.smithi137.stdout:1711: finishing write tid 5 to smithi13777483-46 2024-03-04T06:47:36.984 INFO:tasks.rados.rados.0.smithi137.stdout:1711: finishing write tid 6 to smithi13777483-46 2024-03-04T06:47:36.984 INFO:tasks.rados.rados.0.smithi137.stdout:1711: oid 46 updating version 0 to 1182 2024-03-04T06:47:36.984 INFO:tasks.rados.rados.0.smithi137.stdout:1711: oid 46 updating version 1182 to 1186 2024-03-04T06:47:36.984 INFO:tasks.rados.rados.0.smithi137.stdout:1711: oid 46 version 1186 is already newer than 1183 2024-03-04T06:47:36.984 INFO:tasks.rados.rados.0.smithi137.stdout:1711: oid 46 version 1186 is already newer than 1185 2024-03-04T06:47:36.985 INFO:tasks.rados.rados.0.smithi137.stdout:1711: oid 46 version 1186 is already newer than 1184 2024-03-04T06:47:36.985 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 1186 (ObjNum 568 snap 159 seq_num 568) dirty exists 2024-03-04T06:47:36.985 INFO:tasks.rados.rados.0.smithi137.stdout:1711: left oid 46 (ObjNum 568 snap 159 seq_num 568) 2024-03-04T06:47:36.985 INFO:tasks.rados.rados.0.smithi137.stdout:1713: seq_num 569 ranges {9166848=737280,9904128=671744,10575872=737280,11313152=196608} 2024-03-04T06:47:37.036 INFO:tasks.rados.rados.0.smithi137.stdout:1713: writing smithi13777483-35 from 9166848 to 9904128 tid 1 2024-03-04T06:47:37.040 INFO:tasks.rados.rados.0.smithi137.stdout:1713: writing smithi13777483-35 from 9904128 to 10575872 tid 2 2024-03-04T06:47:37.044 INFO:tasks.rados.rados.0.smithi137.stdout:1713: writing smithi13777483-35 from 10575872 to 11313152 tid 3 2024-03-04T06:47:37.046 INFO:tasks.rados.rados.0.smithi137.stdout:1713: writing smithi13777483-35 from 11313152 to 11509760 tid 4 2024-03-04T06:47:37.046 INFO:tasks.rados.rados.0.smithi137.stdout:1705: done (5 left) 2024-03-04T06:47:37.046 INFO:tasks.rados.rados.0.smithi137.stdout:1709: done (4 left) 2024-03-04T06:47:37.046 INFO:tasks.rados.rados.0.smithi137.stdout:1710: done (3 left) 2024-03-04T06:47:37.046 INFO:tasks.rados.rados.0.smithi137.stdout:1711: done (2 left) 2024-03-04T06:47:37.046 INFO:tasks.rados.rados.0.smithi137.stdout:1712: done (1 left) 2024-03-04T06:47:37.046 INFO:tasks.rados.rados.0.smithi137.stdout:1714: copy_from oid 1 from oid 10 current snap is 159 2024-03-04T06:47:37.047 INFO:tasks.rados.rados.0.smithi137.stdout:1713: finishing write tid 1 to smithi13777483-35 2024-03-04T06:47:37.047 INFO:tasks.rados.rados.0.smithi137.stdout:1713: finishing write tid 2 to smithi13777483-35 2024-03-04T06:47:37.047 INFO:tasks.rados.rados.0.smithi137.stdout:1715: read oid 39 snap 156 2024-03-04T06:47:37.047 INFO:tasks.rados.rados.0.smithi137.stdout:1715: expect (ObjNum 526 snap 149 seq_num 526) 2024-03-04T06:47:37.047 INFO:tasks.rados.rados.0.smithi137.stdout:1716: read oid 36 snap -1 2024-03-04T06:47:37.047 INFO:tasks.rados.rados.0.smithi137.stdout:1716: expect deleted 2024-03-04T06:47:37.047 INFO:tasks.rados.rados.0.smithi137.stdout:1717: copy_from oid 2 from oid 40 current snap is 159 2024-03-04T06:47:37.047 INFO:tasks.rados.rados.0.smithi137.stdout:1718: read oid 22 snap -1 2024-03-04T06:47:37.047 INFO:tasks.rados.rados.0.smithi137.stdout:1718: expect deleted 2024-03-04T06:47:37.047 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 159 2024-03-04T06:47:37.047 INFO:tasks.rados.rados.0.smithi137.stdout:1719: seq_num 570 ranges {3727360=753664,4481024=548864,5029888=540672,5570560=516096} 2024-03-04T06:47:37.070 INFO:tasks.rados.rados.0.smithi137.stdout:1719: writing smithi13777483-26 from 3727360 to 4481024 tid 1 2024-03-04T06:47:37.073 INFO:tasks.rados.rados.0.smithi137.stdout:1719: writing smithi13777483-26 from 4481024 to 5029888 tid 2 2024-03-04T06:47:37.076 INFO:tasks.rados.rados.0.smithi137.stdout:1719: writing smithi13777483-26 from 5029888 to 5570560 tid 3 2024-03-04T06:47:37.081 INFO:tasks.rados.rados.0.smithi137.stdout:1719: writing smithi13777483-26 from 5570560 to 6086656 tid 4 2024-03-04T06:47:37.081 INFO:tasks.rados.rados.0.smithi137.stdout:1720: rollback oid 20 current snap is 159 2024-03-04T06:47:37.081 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 20 to 156 2024-03-04T06:47:37.081 INFO:tasks.rados.rados.0.smithi137.stdout:1713: finishing write tid 3 to smithi13777483-35 2024-03-04T06:47:37.081 INFO:tasks.rados.rados.0.smithi137.stdout:1713: finishing write tid 4 to smithi13777483-35 2024-03-04T06:47:37.081 INFO:tasks.rados.rados.0.smithi137.stdout:1713: finishing write tid 5 to smithi13777483-35 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:1713: finishing write tid 6 to smithi13777483-35 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:1713: oid 35 updating version 0 to 798 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:1713: oid 35 updating version 798 to 799 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:1713: oid 35 updating version 799 to 800 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:1713: oid 35 version 800 is already newer than 797 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:1713: oid 35 version 800 is already newer than 796 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 800 (ObjNum 569 snap 159 seq_num 569) dirty exists 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:1713: left oid 35 (ObjNum 569 snap 159 seq_num 569) 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:1714: finishing copy_from racing read to smithi13777483-1 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:1714: finishing copy_from to smithi13777483-1 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 786 (ObjNum 467 snap 134 seq_num 467) dirty exists 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:1717: finishing copy_from racing read to smithi13777483-2 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:1717: finishing copy_from to smithi13777483-2 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 15460 (ObjNum 555 snap 158 seq_num 555) dirty exists 2024-03-04T06:47:37.082 INFO:tasks.rados.rados.0.smithi137.stdout:1719: finishing write tid 1 to smithi13777483-26 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1719: finishing write tid 2 to smithi13777483-26 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1713: done (7 left) 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1714: done (6 left) 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1716: done (5 left) 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1717: done (4 left) 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1718: done (3 left) 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1721: read oid 4 snap -1 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1721: expect (ObjNum 567 snap 159 seq_num 567) 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1722: rollback oid 32 current snap is 159 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 32 to 156 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1719: finishing write tid 3 to smithi13777483-26 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1723: copy_from oid 45 from oid 11 current snap is 159 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1724: read oid 42 snap -1 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1724: expect deleted 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 159 2024-03-04T06:47:37.083 INFO:tasks.rados.rados.0.smithi137.stdout:1725: seq_num 571 ranges {9732096=770048,10502144=483328,10985472=753664,11739136=368640} 2024-03-04T06:47:37.138 INFO:tasks.rados.rados.0.smithi137.stdout:1725: writing smithi13777483-44 from 9732096 to 10502144 tid 1 2024-03-04T06:47:37.141 INFO:tasks.rados.rados.0.smithi137.stdout:1725: writing smithi13777483-44 from 10502144 to 10985472 tid 2 2024-03-04T06:47:37.144 INFO:tasks.rados.rados.0.smithi137.stdout:1725: writing smithi13777483-44 from 10985472 to 11739136 tid 3 2024-03-04T06:47:37.147 INFO:tasks.rados.rados.0.smithi137.stdout:1725: writing smithi13777483-44 from 11739136 to 12107776 tid 4 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:1726: delete oid 17 current snap is 159 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:1720: finishing rollback tid 1 to smithi13777483-20 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:1719: finishing write tid 4 to smithi13777483-26 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:1722: finishing rollback tid 1 to smithi13777483-32 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 0 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:1719: finishing write tid 5 to smithi13777483-26 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:1719: finishing write tid 6 to smithi13777483-26 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:1719: oid 26 updating version 0 to 16767 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:1719: oid 26 updating version 16767 to 16771 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:1719: oid 26 version 16771 is already newer than 16768 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:1719: oid 26 version 16771 is already newer than 16769 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:1719: oid 26 version 16771 is already newer than 16770 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16771 (ObjNum 570 snap 159 seq_num 570) dirty exists 2024-03-04T06:47:37.148 INFO:tasks.rados.rados.0.smithi137.stdout:1719: left oid 26 (ObjNum 570 snap 159 seq_num 570) 2024-03-04T06:47:37.149 INFO:tasks.rados.rados.0.smithi137.stdout:1715: expect (ObjNum 526 snap 149 seq_num 526) 2024-03-04T06:47:37.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:37 smithi137 podman[111365]: 2024-03-04 06:47:37.182939598 +0000 UTC m=+0.698949161 container remove d7bbfd76a0ba1e2a78e81a37681200e35fff8859785c54d2b55c6c188094a10e (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T06:47:37.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:37 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.3.service: Deactivated successfully. 2024-03-04T06:47:37.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:37 smithi137 systemd[1]: Stopped Ceph osd.3 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:47:37.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:37 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.3.service: Consumed 30.261s CPU time. 2024-03-04T06:47:37.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:37 smithi137 systemd[1]: Starting Ceph osd.3 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:47:37.648 INFO:tasks.rados.rados.0.smithi137.stdout:1721: expect (ObjNum 567 snap 159 seq_num 567) 2024-03-04T06:47:37.794 INFO:tasks.rados.rados.0.smithi137.stdout:1723: finishing copy_from racing read to smithi13777483-45 2024-03-04T06:47:37.795 INFO:tasks.rados.rados.0.smithi137.stdout:1723: finishing copy_from to smithi13777483-45 2024-03-04T06:47:37.795 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 15452 (ObjNum 419 snap 125 seq_num 419) dirty exists 2024-03-04T06:47:37.795 INFO:tasks.rados.rados.0.smithi137.stdout:1725: finishing write tid 1 to smithi13777483-44 2024-03-04T06:47:37.795 INFO:tasks.rados.rados.0.smithi137.stdout:1725: finishing write tid 2 to smithi13777483-44 2024-03-04T06:47:37.795 INFO:tasks.rados.rados.0.smithi137.stdout:1715: done (8 left) 2024-03-04T06:47:37.795 INFO:tasks.rados.rados.0.smithi137.stdout:1719: done (7 left) 2024-03-04T06:47:37.795 INFO:tasks.rados.rados.0.smithi137.stdout:1720: done (6 left) 2024-03-04T06:47:37.795 INFO:tasks.rados.rados.0.smithi137.stdout:1721: done (5 left) 2024-03-04T06:47:37.795 INFO:tasks.rados.rados.0.smithi137.stdout:1722: done (4 left) 2024-03-04T06:47:37.795 INFO:tasks.rados.rados.0.smithi137.stdout:1723: done (3 left) 2024-03-04T06:47:37.795 INFO:tasks.rados.rados.0.smithi137.stdout:1724: done (2 left) 2024-03-04T06:47:37.795 INFO:tasks.rados.rados.0.smithi137.stdout:1726: done (1 left) 2024-03-04T06:47:37.795 INFO:tasks.rados.rados.0.smithi137.stdout:1727: delete oid 29 current snap is 159 2024-03-04T06:47:37.796 INFO:tasks.rados.rados.0.smithi137.stdout:1725: finishing write tid 3 to smithi13777483-44 2024-03-04T06:47:37.796 INFO:tasks.rados.rados.0.smithi137.stdout:1725: finishing write tid 4 to smithi13777483-44 2024-03-04T06:47:37.796 INFO:tasks.rados.rados.0.smithi137.stdout:1725: finishing write tid 5 to smithi13777483-44 2024-03-04T06:47:37.796 INFO:tasks.rados.rados.0.smithi137.stdout:1725: finishing write tid 6 to smithi13777483-44 2024-03-04T06:47:37.796 INFO:tasks.rados.rados.0.smithi137.stdout:1725: oid 44 updating version 0 to 16763 2024-03-04T06:47:37.796 INFO:tasks.rados.rados.0.smithi137.stdout:1725: oid 44 updating version 16763 to 16765 2024-03-04T06:47:37.796 INFO:tasks.rados.rados.0.smithi137.stdout:1725: oid 44 version 16765 is already newer than 16764 2024-03-04T06:47:37.796 INFO:tasks.rados.rados.0.smithi137.stdout:1725: oid 44 version 16765 is already newer than 16761 2024-03-04T06:47:37.796 INFO:tasks.rados.rados.0.smithi137.stdout:1725: oid 44 version 16765 is already newer than 16762 2024-03-04T06:47:37.796 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16765 (ObjNum 571 snap 159 seq_num 571) dirty exists 2024-03-04T06:47:37.796 INFO:tasks.rados.rados.0.smithi137.stdout:1725: left oid 44 (ObjNum 571 snap 159 seq_num 571) 2024-03-04T06:47:37.798 INFO:tasks.rados.rados.0.smithi137.stdout:1725: done (1 left) 2024-03-04T06:47:37.798 INFO:tasks.rados.rados.0.smithi137.stdout:1727: done (0 left) 2024-03-04T06:47:37.798 INFO:tasks.rados.rados.0.smithi137.stdout:1728: read oid 32 snap -1 2024-03-04T06:47:37.798 INFO:tasks.rados.rados.0.smithi137.stdout:1728: expect deleted 2024-03-04T06:47:37.798 INFO:tasks.rados.rados.0.smithi137.stdout:1729: copy_from oid 27 from oid 16 current snap is 159 2024-03-04T06:47:37.798 INFO:tasks.rados.rados.0.smithi137.stdout:1730: setattr oid 7 current snap is 159 2024-03-04T06:47:37.799 INFO:tasks.rados.rados.0.smithi137.stdout:1728: done (2 left) 2024-03-04T06:47:37.800 INFO:tasks.rados.rados.0.smithi137.stdout:1731: read oid 45 snap -1 2024-03-04T06:47:37.800 INFO:tasks.rados.rados.0.smithi137.stdout:1731: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:47:37.800 INFO:tasks.rados.rados.0.smithi137.stdout:1732: read oid 9 snap -1 2024-03-04T06:47:37.800 INFO:tasks.rados.rados.0.smithi137.stdout:1732: expect deleted 2024-03-04T06:47:37.800 INFO:tasks.rados.rados.0.smithi137.stdout:1733: snap_create 2024-03-04T06:47:37.803 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 15454 (ObjNum 522 snap 148 seq_num 522) dirty exists 2024-03-04T06:47:37.840 INFO:tasks.rados.rados.0.smithi137.stdout:1729: finishing copy_from racing read to smithi13777483-27 2024-03-04T06:47:37.841 INFO:tasks.rados.rados.0.smithi137.stdout:1729: finishing copy_from to smithi13777483-27 2024-03-04T06:47:37.841 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16754 (ObjNum 419 snap 125 seq_num 419) dirty exists 2024-03-04T06:47:37.848 INFO:tasks.rados.rados.0.smithi137.stdout:1731: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:47:37.911 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:37 smithi137 podman[111466]: 2024-03-04 06:47:37.530354258 +0000 UTC m=+0.021913561 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:47:37.911 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:37 smithi137 podman[111466]: 2024-03-04 06:47:37.667336138 +0000 UTC m=+0.158895425 container create 86ff2338abf2a1cadeff310b2d201952f8c247c7ef542624d53a0a4bb9b98d06 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True) 2024-03-04T06:47:38.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:37.944+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:38.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:37.944+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:38.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:37 smithi137 podman[111466]: 2024-03-04 06:47:37.911552801 +0000 UTC m=+0.403112090 container init 86ff2338abf2a1cadeff310b2d201952f8c247c7ef542624d53a0a4bb9b98d06 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-activate, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS) 2024-03-04T06:47:38.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:37 smithi137 podman[111466]: 2024-03-04 06:47:37.914845173 +0000 UTC m=+0.406404469 container start 86ff2338abf2a1cadeff310b2d201952f8c247c7ef542624d53a0a4bb9b98d06 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-04T06:47:38.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 podman[111466]: 2024-03-04 06:47:38.011752596 +0000 UTC m=+0.503311884 container attach 86ff2338abf2a1cadeff310b2d201952f8c247c7ef542624d53a0a4bb9b98d06 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-03-04T06:47:38.314 INFO:tasks.rados.rados.0.smithi137.stdout:1729: done (4 left) 2024-03-04T06:47:38.314 INFO:tasks.rados.rados.0.smithi137.stdout:1730: done (3 left) 2024-03-04T06:47:38.314 INFO:tasks.rados.rados.0.smithi137.stdout:1731: done (2 left) 2024-03-04T06:47:38.314 INFO:tasks.rados.rados.0.smithi137.stdout:1732: done (1 left) 2024-03-04T06:47:38.314 INFO:tasks.rados.rados.0.smithi137.stdout:1733: done (0 left) 2024-03-04T06:47:38.314 INFO:tasks.rados.rados.0.smithi137.stdout:1734: copy_from oid 43 from oid 29 current snap is 160 2024-03-04T06:47:38.314 INFO:tasks.rados.rados.0.smithi137.stdout:1735: delete oid 37 current snap is 160 2024-03-04T06:47:38.316 INFO:tasks.rados.rados.0.smithi137.stdout:1734: finishing copy_from to smithi13777483-43 2024-03-04T06:47:38.316 INFO:tasks.rados.rados.0.smithi137.stdout:1734: got expected ENOENT (src dne) 2024-03-04T06:47:38.316 INFO:tasks.rados.rados.0.smithi137.stdout:1734: finishing copy_from racing read to smithi13777483-43 2024-03-04T06:47:38.318 INFO:tasks.rados.rados.0.smithi137.stdout:1734: done (1 left) 2024-03-04T06:47:38.318 INFO:tasks.rados.rados.0.smithi137.stdout:1735: done (0 left) 2024-03-04T06:47:38.318 INFO:tasks.rados.rados.0.smithi137.stdout:1736: read oid 35 snap -1 2024-03-04T06:47:38.318 INFO:tasks.rados.rados.0.smithi137.stdout:1736: expect (ObjNum 569 snap 159 seq_num 569) 2024-03-04T06:47:38.318 INFO:tasks.rados.rados.0.smithi137.stdout:1737: copy_from oid 44 from oid 3 current snap is 160 2024-03-04T06:47:38.318 INFO:tasks.rados.rados.0.smithi137.stdout:1738: setattr oid 42 current snap is 160 2024-03-04T06:47:38.318 INFO:tasks.rados.rados.0.smithi137.stdout:1737: finishing copy_from to smithi13777483-44 2024-03-04T06:47:38.319 INFO:tasks.rados.rados.0.smithi137.stdout:1737: got expected ENOENT (src dne) 2024-03-04T06:47:38.319 INFO:tasks.rados.rados.0.smithi137.stdout:1737: finishing copy_from racing read to smithi13777483-44 2024-03-04T06:47:38.319 INFO:tasks.rados.rados.0.smithi137.stdout:1737: done (2 left) 2024-03-04T06:47:38.319 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 160 2024-03-04T06:47:38.319 INFO:tasks.rados.rados.0.smithi137.stdout:1739: seq_num 575 ranges {8626176=32768} 2024-03-04T06:47:38.367 INFO:tasks.rados.rados.0.smithi137.stdout:1739: writing smithi13777483-27 from 8626176 to 8658944 tid 1 2024-03-04T06:47:38.367 INFO:tasks.rados.rados.0.smithi137.stdout:1740: snap_create 2024-03-04T06:47:38.367 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16755 (ObjNum 65 snap 0 seq_num 1465995086) dirty exists 2024-03-04T06:47:38.371 INFO:tasks.rados.rados.0.smithi137.stdout:1736: expect (ObjNum 569 snap 159 seq_num 569) 2024-03-04T06:47:38.699 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-activate[111480]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-04T06:47:38.699 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-activate[111480]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-03-04T06:47:38.699 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 bash[111466]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-04T06:47:38.699 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 bash[111466]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-03-04T06:47:38.699 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 bash[111466]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-03-04T06:47:38.699 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 bash[111466]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-03-04T06:47:38.700 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 bash[111466]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-03-04T06:47:38.700 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 bash[111466]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-04T06:47:38.700 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 bash[111466]: --> ceph-volume raw activate successful for osd ID: 3 2024-03-04T06:47:38.700 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-activate[111480]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-03-04T06:47:38.700 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-activate[111480]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-03-04T06:47:38.700 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-activate[111480]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-03-04T06:47:38.700 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-activate[111480]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-04T06:47:38.700 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-activate[111480]: --> ceph-volume raw activate successful for osd ID: 3 2024-03-04T06:47:38.700 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 podman[111466]: 2024-03-04 06:47:38.403361791 +0000 UTC m=+0.894921084 container died 86ff2338abf2a1cadeff310b2d201952f8c247c7ef542624d53a0a4bb9b98d06 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-activate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:47:38.974 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-mon[88869]: osdmap e393: 8 total, 7 up, 8 in 2024-03-04T06:47:38.974 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:38.974 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-mon[88869]: pgmap v264: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 5 active+undersized+degraded, 11 stale+active+clean, 2 active+clean+snaptrim_error, 14 active+undersized, 88 active+clean; 238 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 9.5 MiB/s rd, 7.6 MiB/s wr, 25 op/s; 39/432 objects degraded (9.028%) 2024-03-04T06:47:38.975 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:38.975 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:47:38.975 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-mon[91314]: osdmap e393: 8 total, 7 up, 8 in 2024-03-04T06:47:38.975 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:38.975 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-mon[91314]: pgmap v264: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 5 active+undersized+degraded, 11 stale+active+clean, 2 active+clean+snaptrim_error, 14 active+undersized, 88 active+clean; 238 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 9.5 MiB/s rd, 7.6 MiB/s wr, 25 op/s; 39/432 objects degraded (9.028%) 2024-03-04T06:47:38.975 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:38.975 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:47:39.230 INFO:tasks.rados.rados.0.smithi137.stdout:1739: finishing write tid 1 to smithi13777483-27 2024-03-04T06:47:39.230 INFO:tasks.rados.rados.0.smithi137.stdout:1739: finishing write tid 2 to smithi13777483-27 2024-03-04T06:47:39.230 INFO:tasks.rados.rados.0.smithi137.stdout:1739: finishing write tid 3 to smithi13777483-27 2024-03-04T06:47:39.230 INFO:tasks.rados.rados.0.smithi137.stdout:1739: oid 27 updating version 0 to 16757 2024-03-04T06:47:39.230 INFO:tasks.rados.rados.0.smithi137.stdout:1739: oid 27 version 16757 is already newer than 16756 2024-03-04T06:47:39.230 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16757 (ObjNum 575 snap 160 seq_num 575) dirty exists 2024-03-04T06:47:39.230 INFO:tasks.rados.rados.0.smithi137.stdout:1739: left oid 27 (ObjNum 575 snap 160 seq_num 575) 2024-03-04T06:47:39.231 INFO:tasks.rados.rados.0.smithi137.stdout:1736: done (3 left) 2024-03-04T06:47:39.231 INFO:tasks.rados.rados.0.smithi137.stdout:1738: done (2 left) 2024-03-04T06:47:39.231 INFO:tasks.rados.rados.0.smithi137.stdout:1739: done (1 left) 2024-03-04T06:47:39.231 INFO:tasks.rados.rados.0.smithi137.stdout:1740: done (0 left) 2024-03-04T06:47:39.231 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 161 2024-03-04T06:47:39.231 INFO:tasks.rados.rados.0.smithi137.stdout:1741: seq_num 576 ranges {0=49152} 2024-03-04T06:47:39.231 INFO:tasks.rados.rados.0.smithi137.stdout:1741: writing smithi13777483-42 from 0 to 49152 tid 1 2024-03-04T06:47:39.231 INFO:tasks.rados.rados.0.smithi137.stdout:1742: snap_create 2024-03-04T06:47:39.235 INFO:tasks.rados.rados.0.smithi137.stdout:1741: finishing write tid 1 to smithi13777483-42 2024-03-04T06:47:39.235 INFO:tasks.rados.rados.0.smithi137.stdout:1741: finishing write tid 2 to smithi13777483-42 2024-03-04T06:47:39.236 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:38 smithi137 podman[111599]: 2024-03-04 06:47:38.974134659 +0000 UTC m=+0.565992851 container remove 86ff2338abf2a1cadeff310b2d201952f8c247c7ef542624d53a0a4bb9b98d06 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-04T06:47:39.236 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:39 smithi137 podman[111659]: 2024-03-04 06:47:39.08907725 +0000 UTC m=+0.018970691 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:47:39.236 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:39 smithi137 podman[111659]: 2024-03-04 06:47:39.200099523 +0000 UTC m=+0.129992960 container create 9acd06dda8ec3b8edc961d2a1a3fc5b2ff0f9b5eeb4a22481203532bcf49df07 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:47:39.237 INFO:tasks.rados.rados.0.smithi137.stdout:1741: finishing write tid 3 to smithi13777483-42 2024-03-04T06:47:39.237 INFO:tasks.rados.rados.0.smithi137.stdout:1741: oid 42 updating version 0 to 16759 2024-03-04T06:47:39.237 INFO:tasks.rados.rados.0.smithi137.stdout:1741: oid 42 version 16759 is already newer than 16758 2024-03-04T06:47:39.237 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16759 (ObjNum 576 snap 161 seq_num 576) dirty exists 2024-03-04T06:47:39.237 INFO:tasks.rados.rados.0.smithi137.stdout:1741: left oid 42 (ObjNum 576 snap 161 seq_num 576) 2024-03-04T06:47:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:38 smithi203 ceph-mon[85573]: osdmap e393: 8 total, 7 up, 8 in 2024-03-04T06:47:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:38 smithi203 ceph-mon[85573]: pgmap v264: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 5 active+undersized+degraded, 11 stale+active+clean, 2 active+clean+snaptrim_error, 14 active+undersized, 88 active+clean; 238 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 9.5 MiB/s rd, 7.6 MiB/s wr, 25 op/s; 39/432 objects degraded (9.028%) 2024-03-04T06:47:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:39.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:47:39.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:39.234+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:39.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:39 smithi137 podman[111659]: 2024-03-04 06:47:39.386104109 +0000 UTC m=+0.315997556 container init 9acd06dda8ec3b8edc961d2a1a3fc5b2ff0f9b5eeb4a22481203532bcf49df07 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-04T06:47:39.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:39 smithi137 podman[111659]: 2024-03-04 06:47:39.389404098 +0000 UTC m=+0.319297532 container start 9acd06dda8ec3b8edc961d2a1a3fc5b2ff0f9b5eeb4a22481203532bcf49df07 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5) 2024-03-04T06:47:39.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-osd[111678]: -- 172.21.15.137:0/1711570079 <== mon.0 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f70555f680 con 0x55f705529000 2024-03-04T06:47:39.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:39 smithi137 bash[111659]: 9acd06dda8ec3b8edc961d2a1a3fc5b2ff0f9b5eeb4a22481203532bcf49df07 2024-03-04T06:47:39.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:39 smithi137 systemd[1]: Started Ceph osd.3 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:47:39.866 INFO:tasks.rados.rados.0.smithi137.stdout:1741: done (1 left) 2024-03-04T06:47:39.866 INFO:tasks.rados.rados.0.smithi137.stdout:1742: done (0 left) 2024-03-04T06:47:39.866 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 162 2024-03-04T06:47:39.866 INFO:tasks.rados.rados.0.smithi137.stdout:1743: seq_num 577 ranges {12042240=65536} 2024-03-04T06:47:39.931 INFO:tasks.rados.rados.0.smithi137.stdout:1743: writing smithi13777483-18 from 12042240 to 12107776 tid 1 2024-03-04T06:47:39.931 INFO:tasks.rados.rados.0.smithi137.stdout:1744: snap_create 2024-03-04T06:47:39.936 INFO:tasks.rados.rados.0.smithi137.stdout:1743: finishing write tid 1 to smithi13777483-18 2024-03-04T06:47:39.936 INFO:tasks.rados.rados.0.smithi137.stdout:1743: finishing write tid 2 to smithi13777483-18 2024-03-04T06:47:39.937 INFO:tasks.rados.rados.0.smithi137.stdout:1743: finishing write tid 3 to smithi13777483-18 2024-03-04T06:47:39.937 INFO:tasks.rados.rados.0.smithi137.stdout:1743: oid 18 updating version 0 to 16774 2024-03-04T06:47:39.937 INFO:tasks.rados.rados.0.smithi137.stdout:1743: oid 18 version 16774 is already newer than 16773 2024-03-04T06:47:39.937 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16774 (ObjNum 577 snap 162 seq_num 577) dirty exists 2024-03-04T06:47:39.937 INFO:tasks.rados.rados.0.smithi137.stdout:1743: left oid 18 (ObjNum 577 snap 162 seq_num 577) 2024-03-04T06:47:39.940 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:39.940 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-mon[88869]: Health check failed: Degraded data redundancy: 39/432 objects degraded (9.028%), 6 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:39.940 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-mon[88869]: osdmap e394: 8 total, 7 up, 8 in 2024-03-04T06:47:39.940 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:39.940 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:39.940 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:47:39.941 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:39.941 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-mon[91314]: Health check failed: Degraded data redundancy: 39/432 objects degraded (9.028%), 6 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:39.941 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-mon[91314]: osdmap e394: 8 total, 7 up, 8 in 2024-03-04T06:47:39.941 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:39.941 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:39.941 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:47:39.941 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:39.642+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:39.941 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:39.642+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:39.941 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:39.888+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:40.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:39.940+0000 7f3cf22b97c0 -1 Falling back to public interface 2024-03-04T06:47:40.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:40.137+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:39 smithi203 ceph-mon[85573]: Health check failed: Degraded data redundancy: 39/432 objects degraded (9.028%), 6 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:39 smithi203 ceph-mon[85573]: osdmap e394: 8 total, 7 up, 8 in 2024-03-04T06:47:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:40.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:47:40.873 INFO:tasks.rados.rados.0.smithi137.stdout:1743: done (1 left) 2024-03-04T06:47:40.873 INFO:tasks.rados.rados.0.smithi137.stdout:1744: done (0 left) 2024-03-04T06:47:40.873 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 163 2024-03-04T06:47:40.873 INFO:tasks.rados.rados.0.smithi137.stdout:1745: seq_num 578 ranges {0=81920} 2024-03-04T06:47:40.873 INFO:tasks.rados.rados.0.smithi137.stdout:1745: writing smithi13777483-17 from 0 to 81920 tid 1 2024-03-04T06:47:40.873 INFO:tasks.rados.rados.0.smithi137.stdout:1746: rollback oid 22 current snap is 163 2024-03-04T06:47:40.873 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 22 to 159 2024-03-04T06:47:40.873 INFO:tasks.rados.rados.0.smithi137.stdout:1747: delete oid 39 current snap is 163 2024-03-04T06:47:40.876 INFO:tasks.rados.rados.0.smithi137.stdout:1745: finishing write tid 1 to smithi13777483-17 2024-03-04T06:47:40.877 INFO:tasks.rados.rados.0.smithi137.stdout:1745: finishing write tid 2 to smithi13777483-17 2024-03-04T06:47:40.877 INFO:tasks.rados.rados.0.smithi137.stdout:1746: finishing rollback tid 1 to smithi13777483-22 2024-03-04T06:47:40.877 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 15454 (ObjNum 193 snap 0 seq_num 3162484112) dirty dne 2024-03-04T06:47:40.879 INFO:tasks.rados.rados.0.smithi137.stdout:1746: done (2 left) 2024-03-04T06:47:40.879 INFO:tasks.rados.rados.0.smithi137.stdout:1747: done (1 left) 2024-03-04T06:47:40.879 INFO:tasks.rados.rados.0.smithi137.stdout:1748: snap_remove snap 151 2024-03-04T06:47:41.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:41.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:41.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-mon[88869]: osdmap e395: 8 total, 7 up, 8 in 2024-03-04T06:47:41.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:41.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-mon[88869]: pgmap v267: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 33 active+undersized, 78 active+clean; 249 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 31 MiB/s rd, 9.4 MiB/s wr, 29 op/s; 46/438 objects degraded (10.502%) 2024-03-04T06:47:41.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:40.951+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:41.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:41.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:41.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-mon[91314]: osdmap e395: 8 total, 7 up, 8 in 2024-03-04T06:47:41.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:41.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-mon[91314]: pgmap v267: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 33 active+undersized, 78 active+clean; 249 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 31 MiB/s rd, 9.4 MiB/s wr, 29 op/s; 46/438 objects degraded (10.502%) 2024-03-04T06:47:41.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:40.876+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:41.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:40.876+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:41.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:41.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:41.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:40 smithi203 ceph-mon[85573]: osdmap e395: 8 total, 7 up, 8 in 2024-03-04T06:47:41.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:41.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:40 smithi203 ceph-mon[85573]: pgmap v267: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 33 active+undersized, 78 active+clean; 249 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 31 MiB/s rd, 9.4 MiB/s wr, 29 op/s; 46/438 objects degraded (10.502%) 2024-03-04T06:47:41.876 INFO:tasks.rados.rados.0.smithi137.stdout:1748: done (1 left) 2024-03-04T06:47:41.876 INFO:tasks.rados.rados.0.smithi137.stdout:1749: snap_create 2024-03-04T06:47:41.876 INFO:tasks.rados.rados.0.smithi137.stdout:1745: finishing write tid 3 to smithi13777483-17 2024-03-04T06:47:41.876 INFO:tasks.rados.rados.0.smithi137.stdout:1745: oid 17 updating version 0 to 640 2024-03-04T06:47:41.876 INFO:tasks.rados.rados.0.smithi137.stdout:1745: oid 17 updating version 640 to 641 2024-03-04T06:47:41.876 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 641 (ObjNum 578 snap 163 seq_num 578) dirty exists 2024-03-04T06:47:41.876 INFO:tasks.rados.rados.0.smithi137.stdout:1745: left oid 17 (ObjNum 578 snap 163 seq_num 578) 2024-03-04T06:47:42.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:42.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:41 smithi137 ceph-mon[88869]: osdmap e396: 8 total, 7 up, 8 in 2024-03-04T06:47:42.184 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:42.184 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:41.882+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:42.184 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:41.882+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:42.185 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:42.185 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:41 smithi137 ceph-mon[91314]: osdmap e396: 8 total, 7 up, 8 in 2024-03-04T06:47:42.185 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:42.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:42.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:41 smithi203 ceph-mon[85573]: osdmap e396: 8 total, 7 up, 8 in 2024-03-04T06:47:42.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:42.891 INFO:tasks.rados.rados.0.smithi137.stdout:1745: done (1 left) 2024-03-04T06:47:42.891 INFO:tasks.rados.rados.0.smithi137.stdout:1749: done (0 left) 2024-03-04T06:47:42.892 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 164 2024-03-04T06:47:42.892 INFO:tasks.rados.rados.0.smithi137.stdout:1750: seq_num 580 ranges {2154496=114688} 2024-03-04T06:47:42.903 INFO:tasks.rados.rados.0.smithi137.stdout:1750: writing smithi13777483-10 from 2154496 to 2269184 tid 1 2024-03-04T06:47:42.903 INFO:tasks.rados.rados.0.smithi137.stdout:1751: snap_create 2024-03-04T06:47:42.907 INFO:tasks.rados.rados.0.smithi137.stdout:1750: finishing write tid 1 to smithi13777483-10 2024-03-04T06:47:42.908 INFO:tasks.rados.rados.0.smithi137.stdout:1750: finishing write tid 2 to smithi13777483-10 2024-03-04T06:47:42.909 INFO:tasks.rados.rados.0.smithi137.stdout:1750: finishing write tid 3 to smithi13777483-10 2024-03-04T06:47:42.909 INFO:tasks.rados.rados.0.smithi137.stdout:1750: oid 10 updating version 0 to 844 2024-03-04T06:47:42.909 INFO:tasks.rados.rados.0.smithi137.stdout:1750: oid 10 version 844 is already newer than 843 2024-03-04T06:47:42.909 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 844 (ObjNum 580 snap 164 seq_num 580) dirty exists 2024-03-04T06:47:42.909 INFO:tasks.rados.rados.0.smithi137.stdout:1750: left oid 10 (ObjNum 580 snap 164 seq_num 580) 2024-03-04T06:47:43.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:42.907+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:43.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:42.907+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:43.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:43.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:42 smithi137 ceph-mon[88869]: osdmap e397: 8 total, 7 up, 8 in 2024-03-04T06:47:43.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:43.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:43.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:42 smithi137 ceph-mon[88869]: pgmap v270: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 33 active+undersized, 78 active+clean; 249 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 3.7 MiB/s wr, 9 op/s; 46/438 objects degraded (10.502%) 2024-03-04T06:47:43.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:43.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:42 smithi137 ceph-mon[91314]: osdmap e397: 8 total, 7 up, 8 in 2024-03-04T06:47:43.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:43.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:43.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:42 smithi137 ceph-mon[91314]: pgmap v270: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 33 active+undersized, 78 active+clean; 249 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 3.7 MiB/s wr, 9 op/s; 46/438 objects degraded (10.502%) 2024-03-04T06:47:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:42 smithi203 ceph-mon[85573]: osdmap e397: 8 total, 7 up, 8 in 2024-03-04T06:47:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:42 smithi203 ceph-mon[85573]: pgmap v270: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 33 active+undersized, 78 active+clean; 249 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 3.7 MiB/s wr, 9 op/s; 46/438 objects degraded (10.502%) 2024-03-04T06:47:43.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:43.390+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:43.895 INFO:tasks.rados.rados.0.smithi137.stdout:1750: done (1 left) 2024-03-04T06:47:43.896 INFO:tasks.rados.rados.0.smithi137.stdout:1751: done (0 left) 2024-03-04T06:47:43.896 INFO:tasks.rados.rados.0.smithi137.stdout:1752: rollback oid 27 current snap is 165 2024-03-04T06:47:43.896 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 27 to 150 2024-03-04T06:47:43.896 INFO:tasks.rados.rados.0.smithi137.stdout:1753: delete oid 39 current snap is 165 2024-03-04T06:47:43.905 INFO:tasks.rados.rados.0.smithi137.stdout:1752: finishing rollback tid 0 to smithi13777483-27 2024-03-04T06:47:43.906 INFO:tasks.rados.rados.0.smithi137.stdout:1753: done (1 left) 2024-03-04T06:47:43.906 INFO:tasks.rados.rados.0.smithi137.stdout:1754: rollback oid 5 current snap is 165 2024-03-04T06:47:43.906 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 5 to 162 2024-03-04T06:47:43.907 INFO:tasks.rados.rados.0.smithi137.stdout:1755: copy_from oid 6 from oid 24 current snap is 165 2024-03-04T06:47:43.907 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 165 2024-03-04T06:47:43.907 INFO:tasks.rados.rados.0.smithi137.stdout:1756: seq_num 582 ranges {81920=155648} 2024-03-04T06:47:43.908 INFO:tasks.rados.rados.0.smithi137.stdout:1756: writing smithi13777483-17 from 81920 to 237568 tid 1 2024-03-04T06:47:43.908 INFO:tasks.rados.rados.0.smithi137.stdout:1757: snap_create 2024-03-04T06:47:43.908 INFO:tasks.rados.rados.0.smithi137.stdout:1752: finishing rollback tid 1 to smithi13777483-27 2024-03-04T06:47:43.908 INFO:tasks.rados.rados.0.smithi137.stdout:1755: finishing copy_from to smithi13777483-6 2024-03-04T06:47:43.908 INFO:tasks.rados.rados.0.smithi137.stdout:1755: got expected ENOENT (src dne) 2024-03-04T06:47:43.908 INFO:tasks.rados.rados.0.smithi137.stdout:1755: finishing copy_from racing read to smithi13777483-6 2024-03-04T06:47:43.908 INFO:tasks.rados.rados.0.smithi137.stdout:1752: finishing rollback tid 2 to smithi13777483-27 2024-03-04T06:47:43.909 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16762 (ObjNum 532 snap 150 seq_num 532) dirty exists 2024-03-04T06:47:43.910 INFO:tasks.rados.rados.0.smithi137.stdout:1756: finishing write tid 1 to smithi13777483-17 2024-03-04T06:47:43.911 INFO:tasks.rados.rados.0.smithi137.stdout:1756: finishing write tid 2 to smithi13777483-17 2024-03-04T06:47:43.911 INFO:tasks.rados.rados.0.smithi137.stdout:1754: finishing rollback tid 0 to smithi13777483-5 2024-03-04T06:47:43.912 INFO:tasks.rados.rados.0.smithi137.stdout:1754: finishing rollback tid 1 to smithi13777483-5 2024-03-04T06:47:43.912 INFO:tasks.rados.rados.0.smithi137.stdout:1754: finishing rollback tid 2 to smithi13777483-5 2024-03-04T06:47:43.912 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 848 (ObjNum 461 snap 133 seq_num 461) dirty exists 2024-03-04T06:47:43.912 INFO:tasks.rados.rados.0.smithi137.stdout:1756: finishing write tid 3 to smithi13777483-17 2024-03-04T06:47:43.912 INFO:tasks.rados.rados.0.smithi137.stdout:1756: oid 17 updating version 0 to 642 2024-03-04T06:47:43.913 INFO:tasks.rados.rados.0.smithi137.stdout:1756: oid 17 updating version 642 to 643 2024-03-04T06:47:43.913 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 643 (ObjNum 582 snap 165 seq_num 582) dirty exists 2024-03-04T06:47:43.913 INFO:tasks.rados.rados.0.smithi137.stdout:1756: left oid 17 (ObjNum 582 snap 165 seq_num 582) 2024-03-04T06:47:44.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:43 smithi137 ceph-mon[91314]: osdmap e398: 8 total, 7 up, 8 in 2024-03-04T06:47:44.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:44.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:43 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:44.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:43 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:43 smithi137 ceph-mon[88869]: osdmap e398: 8 total, 7 up, 8 in 2024-03-04T06:47:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:43 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:43 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:44.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:43.908+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:44.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:43.903+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:44.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:43.921+0000 7f3cf22b97c0 -1 osd.3 390 log_to_monitors true 2024-03-04T06:47:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:43 smithi203 ceph-mon[85573]: osdmap e398: 8 total, 7 up, 8 in 2024-03-04T06:47:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:43 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:43 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:44.905 INFO:tasks.rados.rados.0.smithi137.stdout:1752: done (4 left) 2024-03-04T06:47:44.906 INFO:tasks.rados.rados.0.smithi137.stdout:1754: done (3 left) 2024-03-04T06:47:44.906 INFO:tasks.rados.rados.0.smithi137.stdout:1755: done (2 left) 2024-03-04T06:47:44.906 INFO:tasks.rados.rados.0.smithi137.stdout:1756: done (1 left) 2024-03-04T06:47:44.906 INFO:tasks.rados.rados.0.smithi137.stdout:1757: done (0 left) 2024-03-04T06:47:44.906 INFO:tasks.rados.rados.0.smithi137.stdout:1758: snap_remove snap 161 2024-03-04T06:47:45.155 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:44.905+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:45.155 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:45.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[88869]: osdmap e399: 8 total, 7 up, 8 in 2024-03-04T06:47:45.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:45.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:45.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[88869]: from='osd.3 [v2:172.21.15.137:6826/3153668955,v1:172.21.15.137:6827/3153668955]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-04T06:47:45.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[88869]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-04T06:47:45.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[88869]: pgmap v273: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 33 active+undersized, 78 active+clean; 249 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 122 KiB/s wr, 9 op/s; 47/453 objects degraded (10.375%) 2024-03-04T06:47:45.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:45.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:45.156 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[88869]: Health check update: Degraded data redundancy: 46/438 objects degraded (10.502%), 8 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:45.156 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:45.156 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[91314]: osdmap e399: 8 total, 7 up, 8 in 2024-03-04T06:47:45.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:45.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:45.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[91314]: from='osd.3 [v2:172.21.15.137:6826/3153668955,v1:172.21.15.137:6827/3153668955]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-04T06:47:45.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[91314]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-04T06:47:45.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[91314]: pgmap v273: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 33 active+undersized, 78 active+clean; 249 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 122 KiB/s wr, 9 op/s; 47/453 objects degraded (10.375%) 2024-03-04T06:47:45.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:45.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:45.157 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:44 smithi137 ceph-mon[91314]: Health check update: Degraded data redundancy: 46/438 objects degraded (10.502%), 8 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:44 smithi203 ceph-mon[85573]: osdmap e399: 8 total, 7 up, 8 in 2024-03-04T06:47:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:44 smithi203 ceph-mon[85573]: from='osd.3 [v2:172.21.15.137:6826/3153668955,v1:172.21.15.137:6827/3153668955]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-04T06:47:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:44 smithi203 ceph-mon[85573]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-04T06:47:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:44 smithi203 ceph-mon[85573]: pgmap v273: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 33 active+undersized, 78 active+clean; 249 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 122 KiB/s wr, 9 op/s; 47/453 objects degraded (10.375%) 2024-03-04T06:47:45.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:45.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:45.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:44 smithi203 ceph-mon[85573]: Health check update: Degraded data redundancy: 46/438 objects degraded (10.502%), 8 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:45.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:47:45] "GET /metrics HTTP/1.1" 200 36267 "" "Prometheus/2.43.0" 2024-03-04T06:47:45.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:45.290+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:45.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:45.290+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:45.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:45.366+0000 7f3cdf709700 -1 osd.3 390 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:47:45.913 INFO:tasks.rados.rados.0.smithi137.stdout:1758: done (0 left) 2024-03-04T06:47:45.913 INFO:tasks.rados.rados.0.smithi137.stdout:1759: read oid 42 snap 163 2024-03-04T06:47:45.913 INFO:tasks.rados.rados.0.smithi137.stdout:1759: expect (ObjNum 576 snap 161 seq_num 576) 2024-03-04T06:47:45.913 INFO:tasks.rados.rados.0.smithi137.stdout:1760: snap_remove snap 150 2024-03-04T06:47:46.239 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:45.928+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:46.240 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[88869]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-04T06:47:46.240 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[88869]: osdmap e400: 8 total, 7 up, 8 in 2024-03-04T06:47:46.240 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:46.240 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[88869]: from='osd.3 [v2:172.21.15.137:6826/3153668955,v1:172.21.15.137:6827/3153668955]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:47:46.240 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[88869]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:47:46.240 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:46.240 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[88869]: from='osd.3 ' entity='osd.3' 2024-03-04T06:47:46.241 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[91314]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-04T06:47:46.241 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[91314]: osdmap e400: 8 total, 7 up, 8 in 2024-03-04T06:47:46.241 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:46.241 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[91314]: from='osd.3 [v2:172.21.15.137:6826/3153668955,v1:172.21.15.137:6827/3153668955]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:47:46.241 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[91314]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:47:46.241 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:46.241 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-mon[91314]: from='osd.3 ' entity='osd.3' 2024-03-04T06:47:46.241 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:45.925+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:46.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:45 smithi203 ceph-mon[85573]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-04T06:47:46.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:45 smithi203 ceph-mon[85573]: osdmap e400: 8 total, 7 up, 8 in 2024-03-04T06:47:46.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:46.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:45 smithi203 ceph-mon[85573]: from='osd.3 [v2:172.21.15.137:6826/3153668955,v1:172.21.15.137:6827/3153668955]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:47:46.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:45 smithi203 ceph-mon[85573]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-03-04T06:47:46.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:46.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:45 smithi203 ceph-mon[85573]: from='osd.3 ' entity='osd.3' 2024-03-04T06:47:46.913 INFO:tasks.rados.rados.0.smithi137.stdout:1760: done (1 left) 2024-03-04T06:47:46.913 INFO:tasks.rados.rados.0.smithi137.stdout:1761: snap_create 2024-03-04T06:47:46.913 INFO:tasks.rados.rados.0.smithi137.stdout:1759: expect (ObjNum 576 snap 161 seq_num 576) 2024-03-04T06:47:47.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:46.915+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[88869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:47:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[88869]: osd.3 [v2:172.21.15.137:6826/3153668955,v1:172.21.15.137:6827/3153668955] boot 2024-03-04T06:47:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[88869]: osdmap e401: 8 total, 8 up, 8 in 2024-03-04T06:47:47.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:47:47.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:47.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:47.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[88869]: pgmap v276: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 33 active+undersized, 78 active+clean; 249 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 122 KiB/s wr, 9 op/s; 47/453 objects degraded (10.375%) 2024-03-04T06:47:47.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[88869]: osdmap e402: 8 total, 8 up, 8 in 2024-03-04T06:47:47.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:46.949+0000 7f3cc8edc700 -1 osd.3 pg_epoch: 402 pg[5.1s1( v 399'402 (0'0,399'402] local-lis/les=401/402 n=3 ec=72/72 lis/c=401/401 les/c/f=402/402/0 sis=401) [4,3,7]p4(0) r=1 lpr=401 luod=0'0 crt=399'402 mlcod 0'0 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~2c,d2~3,d8~1]] update_snap_map remove_oid 5:84a107c4:::smithi13777483-17:d4 failed with -2 2024-03-04T06:47:47.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:46.964+0000 7f3cc96dd700 -1 osd.3 pg_epoch: 402 pg[5.0s0( v 402'426 (0'0,402'426] local-lis/les=401/402 n=6 ec=72/72 lis/c=401/401 les/c/f=402/402/0 sis=401) [3,1,4]p3(0) r=0 lpr=401 luod=392'424 crt=392'424 lcod 392'424 mlcod 0'0 active+clean+snaptrim trimq=[d0~2,d5~1,d7~1,db~1] ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~2c,d2~3,d8~1]] update_snap_map remove_oid 5:0ed1097c:::smithi13777483-11:d4 failed with -2 2024-03-04T06:47:47.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:46.966+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:47.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:46.909+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:47.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:46.910+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:47.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:47.043+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:47.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[91314]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:47:47.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[91314]: osd.3 [v2:172.21.15.137:6826/3153668955,v1:172.21.15.137:6827/3153668955] boot 2024-03-04T06:47:47.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[91314]: osdmap e401: 8 total, 8 up, 8 in 2024-03-04T06:47:47.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:47:47.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:47.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:47.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[91314]: pgmap v276: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 33 active+undersized, 78 active+clean; 249 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 122 KiB/s wr, 9 op/s; 47/453 objects degraded (10.375%) 2024-03-04T06:47:47.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:46 smithi137 ceph-mon[91314]: osdmap e402: 8 total, 8 up, 8 in 2024-03-04T06:47:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:46 smithi203 ceph-mon[85573]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:47:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:46 smithi203 ceph-mon[85573]: osd.3 [v2:172.21.15.137:6826/3153668955,v1:172.21.15.137:6827/3153668955] boot 2024-03-04T06:47:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:46 smithi203 ceph-mon[85573]: osdmap e401: 8 total, 8 up, 8 in 2024-03-04T06:47:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:46 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T06:47:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:46 smithi203 ceph-mon[85573]: pgmap v276: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 33 active+undersized, 78 active+clean; 249 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 122 KiB/s wr, 9 op/s; 47/453 objects degraded (10.375%) 2024-03-04T06:47:47.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:46 smithi203 ceph-mon[85573]: osdmap e402: 8 total, 8 up, 8 in 2024-03-04T06:47:47.909 INFO:tasks.rados.rados.0.smithi137.stdout:1759: done (1 left) 2024-03-04T06:47:47.909 INFO:tasks.rados.rados.0.smithi137.stdout:1761: done (0 left) 2024-03-04T06:47:47.909 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 167 2024-03-04T06:47:47.909 INFO:tasks.rados.rados.0.smithi137.stdout:1762: seq_num 583 ranges {6471680=172032} 2024-03-04T06:47:47.945 INFO:tasks.rados.rados.0.smithi137.stdout:1762: writing smithi13777483-23 from 6471680 to 6643712 tid 1 2024-03-04T06:47:47.945 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 35 current snap is 167 2024-03-04T06:47:47.945 INFO:tasks.rados.rados.0.smithi137.stdout:1763: seq_num 584 ranges {11509760=188416} 2024-03-04T06:47:48.007 INFO:tasks.rados.rados.0.smithi137.stdout:1763: writing smithi13777483-35 from 11509760 to 11698176 tid 1 2024-03-04T06:47:48.007 INFO:tasks.rados.rados.0.smithi137.stdout:1764: rollback oid 37 current snap is 167 2024-03-04T06:47:48.008 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 37 to 162 2024-03-04T06:47:48.008 INFO:tasks.rados.rados.0.smithi137.stdout:1762: finishing write tid 1 to smithi13777483-23 2024-03-04T06:47:48.008 INFO:tasks.rados.rados.0.smithi137.stdout:1762: finishing write tid 2 to smithi13777483-23 2024-03-04T06:47:48.008 INFO:tasks.rados.rados.0.smithi137.stdout:1762: finishing write tid 3 to smithi13777483-23 2024-03-04T06:47:48.008 INFO:tasks.rados.rados.0.smithi137.stdout:1762: oid 23 updating version 0 to 950 2024-03-04T06:47:48.008 INFO:tasks.rados.rados.0.smithi137.stdout:1762: oid 23 updating version 950 to 951 2024-03-04T06:47:48.008 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 951 (ObjNum 583 snap 167 seq_num 583) dirty exists 2024-03-04T06:47:48.008 INFO:tasks.rados.rados.0.smithi137.stdout:1762: left oid 23 (ObjNum 583 snap 167 seq_num 583) 2024-03-04T06:47:48.008 INFO:tasks.rados.rados.0.smithi137.stdout:1762: done (2 left) 2024-03-04T06:47:48.008 INFO:tasks.rados.rados.0.smithi137.stdout:1765: setattr oid 26 current snap is 167 2024-03-04T06:47:48.009 INFO:tasks.rados.rados.0.smithi137.stdout:1766: read oid 24 snap -1 2024-03-04T06:47:48.009 INFO:tasks.rados.rados.0.smithi137.stdout:1766: expect deleted 2024-03-04T06:47:48.009 INFO:tasks.rados.rados.0.smithi137.stdout:1767: snap_remove snap 163 2024-03-04T06:47:48.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:47:48.014+0000 7fca9a02c700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-04T06:47:48.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:48.138+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:48.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:48.010+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:48.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:48.010+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:48.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:48.012+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:48.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:48.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:48.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:48.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:48.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:47:48.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:47:48.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:48.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[88869]: osdmap e403: 8 total, 8 up, 8 in 2024-03-04T06:47:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:48.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:48.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:48.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:48.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:48.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:47:48.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:47:48.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:48.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:47 smithi137 ceph-mon[91314]: osdmap e403: 8 total, 8 up, 8 in 2024-03-04T06:47:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:47 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:47 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:47 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:47:48.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:47 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:47:48.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:47 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:48.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:47 smithi203 ceph-mon[85573]: osdmap e403: 8 total, 8 up, 8 in 2024-03-04T06:47:48.937 INFO:tasks.rados.rados.0.smithi137.stdout:1764: finishing rollback tid 1 to smithi13777483-37 2024-03-04T06:47:48.938 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 15461 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-04T06:47:48.938 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16775 (ObjNum 570 snap 159 seq_num 570) dirty exists 2024-03-04T06:47:48.938 INFO:tasks.rados.rados.0.smithi137.stdout:1763: finishing write tid 1 to smithi13777483-35 2024-03-04T06:47:48.938 INFO:tasks.rados.rados.0.smithi137.stdout:1763: finishing write tid 2 to smithi13777483-35 2024-03-04T06:47:48.938 INFO:tasks.rados.rados.0.smithi137.stdout:1763: finishing write tid 3 to smithi13777483-35 2024-03-04T06:47:48.938 INFO:tasks.rados.rados.0.smithi137.stdout:1763: oid 35 updating version 0 to 815 2024-03-04T06:47:48.938 INFO:tasks.rados.rados.0.smithi137.stdout:1763: oid 35 version 815 is already newer than 814 2024-03-04T06:47:48.938 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 815 (ObjNum 584 snap 167 seq_num 584) dirty exists 2024-03-04T06:47:48.938 INFO:tasks.rados.rados.0.smithi137.stdout:1763: left oid 35 (ObjNum 584 snap 167 seq_num 584) 2024-03-04T06:47:48.938 INFO:tasks.rados.rados.0.smithi137.stdout:1763: done (4 left) 2024-03-04T06:47:48.938 INFO:tasks.rados.rados.0.smithi137.stdout:1764: done (3 left) 2024-03-04T06:47:48.939 INFO:tasks.rados.rados.0.smithi137.stdout:1765: done (2 left) 2024-03-04T06:47:48.939 INFO:tasks.rados.rados.0.smithi137.stdout:1766: done (1 left) 2024-03-04T06:47:48.939 INFO:tasks.rados.rados.0.smithi137.stdout:1767: done (0 left) 2024-03-04T06:47:48.939 INFO:tasks.rados.rados.0.smithi137.stdout:1768: delete oid 50 current snap is 167 2024-03-04T06:47:48.947 INFO:tasks.rados.rados.0.smithi137.stdout:1768: done (0 left) 2024-03-04T06:47:48.947 INFO:tasks.rados.rados.0.smithi137.stdout:1769: snap_create 2024-03-04T06:47:49.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:48.938+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:49.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:48.944+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:49.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:48.944+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:49.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:48.945+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:49.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:48.940+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:47:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-04T06:47:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-04T06:47:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[88869]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-04T06:47:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:49.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[88869]: pgmap v279: 121 pgs: 3 active+undersized+degraded, 3 active+clean+snaptrim_error, 23 active+undersized, 92 active+clean; 247 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 55 KiB/s rd, 0 B/s wr, 6 op/s; 15/441 objects degraded (3.401%); 4.7 MiB/s, 0 objects/s recovering 2024-03-04T06:47:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:47:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-04T06:47:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-04T06:47:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[91314]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-04T06:47:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:48 smithi137 ceph-mon[91314]: pgmap v279: 121 pgs: 3 active+undersized+degraded, 3 active+clean+snaptrim_error, 23 active+undersized, 92 active+clean; 247 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 55 KiB/s rd, 0 B/s wr, 6 op/s; 15/441 objects degraded (3.401%); 4.7 MiB/s, 0 objects/s recovering 2024-03-04T06:47:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:48 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:47:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:48 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:48 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:48 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:48 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-04T06:47:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:48 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-04T06:47:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:48 smithi203 ceph-mon[85573]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-04T06:47:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:49.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:48 smithi203 ceph-mon[85573]: pgmap v279: 121 pgs: 3 active+undersized+degraded, 3 active+clean+snaptrim_error, 23 active+undersized, 92 active+clean; 247 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 55 KiB/s rd, 0 B/s wr, 6 op/s; 15/441 objects degraded (3.401%); 4.7 MiB/s, 0 objects/s recovering 2024-03-04T06:47:49.938 INFO:tasks.rados.rados.0.smithi137.stdout:1769: done (0 left) 2024-03-04T06:47:49.939 INFO:tasks.rados.rados.0.smithi137.stdout:1770: read oid 15 snap 156 2024-03-04T06:47:49.939 INFO:tasks.rados.rados.0.smithi137.stdout:1770: expect deleted 2024-03-04T06:47:49.939 INFO:tasks.rados.rados.0.smithi137.stdout:1771: setattr oid 3 current snap is 168 2024-03-04T06:47:49.939 INFO:tasks.rados.rados.0.smithi137.stdout:1772: snap_remove snap 167 2024-03-04T06:47:50.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:49.943+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:50.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:49.944+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:50.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-mon[91314]: osdmap e404: 8 total, 8 up, 8 in 2024-03-04T06:47:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-mon[91314]: Health check update: Degraded data redundancy: 15/441 objects degraded (3.401%), 3 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-mon[88869]: osdmap e404: 8 total, 8 up, 8 in 2024-03-04T06:47:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:50.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:49 smithi137 ceph-mon[88869]: Health check update: Degraded data redundancy: 15/441 objects degraded (3.401%), 3 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:49 smithi203 ceph-mon[85573]: osdmap e404: 8 total, 8 up, 8 in 2024-03-04T06:47:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:49 smithi203 ceph-mon[85573]: Health check update: Degraded data redundancy: 15/441 objects degraded (3.401%), 3 pgs degraded (PG_DEGRADED) 2024-03-04T06:47:50.402 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:47:50.712 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:47:50.712 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (7m) 7s ago 8m 26.4M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:47:50.712 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (8m) 2m ago 8m 87.9M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:47:50.712 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (9m) 7s ago 9m 18.6M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (9m) 2m ago 9m 18.6M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (3m) 2m ago 13m 448M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (4m) 7s ago 14m 506M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (3m) 7s ago 15m 53.0M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (2m) 2m ago 13m 29.9M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (2m) 7s ago 13m 46.8M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (8m) 7s ago 8m 17.3M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (8m) 2m ago 8m 15.6M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (117s) 7s ago 12m 208M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 bd2207652b33 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (81s) 7s ago 12m 142M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 47b5cdaad147 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (46s) 7s ago 12m 114M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 436ae07776d9 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (11s) 7s ago 11m 12.7M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9acd06dda8ec 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (11m) 2m ago 11m 212M 2480M 18.2.1-696-g5cc7a767 540557f94930 d4841ffd0747 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (10m) 2m ago 10m 225M 2480M 18.2.1-696-g5cc7a767 540557f94930 81d21771e157 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (10m) 2m ago 10m 109M 2480M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (10m) 2m ago 10m 136M 2480M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:47:50.713 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (3m) 2m ago 9m 49.8M - 2.43.0 a07b618ecd1d 6a88bdd1023c 2024-03-04T06:47:50.938 INFO:tasks.rados.rados.0.smithi137.stdout:1772: done (2 left) 2024-03-04T06:47:50.938 INFO:tasks.rados.rados.0.smithi137.stdout:1773: read oid 42 snap 166 2024-03-04T06:47:50.938 INFO:tasks.rados.rados.0.smithi137.stdout:1773: expect (ObjNum 576 snap 161 seq_num 576) 2024-03-04T06:47:50.938 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 168 2024-03-04T06:47:50.938 INFO:tasks.rados.rados.0.smithi137.stdout:1774: seq_num 586 ranges {0=221184} 2024-03-04T06:47:50.939 INFO:tasks.rados.rados.0.smithi137.stdout:1774: writing smithi13777483-34 from 0 to 221184 tid 1 2024-03-04T06:47:50.939 INFO:tasks.rados.rados.0.smithi137.stdout:1775: read oid 13 snap -1 2024-03-04T06:47:50.939 INFO:tasks.rados.rados.0.smithi137.stdout:1775: expect (ObjNum 537 snap 155 seq_num 537) 2024-03-04T06:47:50.940 INFO:tasks.rados.rados.0.smithi137.stdout:1776: snap_create 2024-03-04T06:47:50.940 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 863 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:47:50.949 INFO:tasks.rados.rados.0.smithi137.stdout:1773: expect (ObjNum 576 snap 161 seq_num 576) 2024-03-04T06:47:50.955 INFO:tasks.rados.rados.0.smithi137.stdout:1774: finishing write tid 1 to smithi13777483-34 2024-03-04T06:47:50.955 INFO:tasks.rados.rados.0.smithi137.stdout:1775: expect (ObjNum 537 snap 155 seq_num 537) 2024-03-04T06:47:51.004 INFO:tasks.rados.rados.0.smithi137.stdout:1774: finishing write tid 2 to smithi13777483-34 2024-03-04T06:47:51.004 INFO:tasks.rados.rados.0.smithi137.stdout:1774: finishing write tid 3 to smithi13777483-34 2024-03-04T06:47:51.004 INFO:tasks.rados.rados.0.smithi137.stdout:1774: oid 34 updating version 0 to 16766 2024-03-04T06:47:51.004 INFO:tasks.rados.rados.0.smithi137.stdout:1774: oid 34 updating version 16766 to 16767 2024-03-04T06:47:51.004 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16767 (ObjNum 586 snap 168 seq_num 586) dirty exists 2024-03-04T06:47:51.005 INFO:tasks.rados.rados.0.smithi137.stdout:1774: left oid 34 (ObjNum 586 snap 168 seq_num 586) 2024-03-04T06:47:51.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:47:50.941+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 4 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:47:51.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:51.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[88869]: osdmap e405: 8 total, 8 up, 8 in 2024-03-04T06:47:51.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:51.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:51.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[88869]: pgmap v282: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 231 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 55 KiB/s rd, 88 KiB/s wr, 8 op/s; 5.5 MiB/s, 1 objects/s recovering 2024-03-04T06:47:51.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:51.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[88869]: osdmap e406: 8 total, 8 up, 8 in 2024-03-04T06:47:51.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:50.944+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:51.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:50.944+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:51.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:50.952+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:51.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:51.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[91314]: osdmap e405: 8 total, 8 up, 8 in 2024-03-04T06:47:51.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:51.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:51.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[91314]: pgmap v282: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 231 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 55 KiB/s rd, 88 KiB/s wr, 8 op/s; 5.5 MiB/s, 1 objects/s recovering 2024-03-04T06:47:51.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:51.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-mon[91314]: osdmap e406: 8 total, 8 up, 8 in 2024-03-04T06:47:51.045 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:50.950+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:51.045 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:50.857+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:51.116 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:47:51.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:47:51.116 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:47:51.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:47:51.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:47:51.116 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:47:51.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:47:51.116 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:47:51.117 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 4, 2024-03-04T06:47:51.117 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 4 2024-03-04T06:47:51.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:47:51.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:47:51.117 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:47:51.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:47:51.117 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:47:51.117 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 6, 2024-03-04T06:47:51.117 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 9 2024-03-04T06:47:51.117 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:47:51.117 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:47:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:50 smithi203 ceph-mon[85573]: osdmap e405: 8 total, 8 up, 8 in 2024-03-04T06:47:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:50 smithi203 ceph-mon[85573]: pgmap v282: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 231 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 55 KiB/s rd, 88 KiB/s wr, 8 op/s; 5.5 MiB/s, 1 objects/s recovering 2024-03-04T06:47:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:51.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:50 smithi203 ceph-mon[85573]: osdmap e406: 8 total, 8 up, 8 in 2024-03-04T06:47:51.941 INFO:tasks.rados.rados.0.smithi137.stdout:1770: done (5 left) 2024-03-04T06:47:51.941 INFO:tasks.rados.rados.0.smithi137.stdout:1771: done (4 left) 2024-03-04T06:47:51.941 INFO:tasks.rados.rados.0.smithi137.stdout:1773: done (3 left) 2024-03-04T06:47:51.942 INFO:tasks.rados.rados.0.smithi137.stdout:1774: done (2 left) 2024-03-04T06:47:51.942 INFO:tasks.rados.rados.0.smithi137.stdout:1775: done (1 left) 2024-03-04T06:47:51.942 INFO:tasks.rados.rados.0.smithi137.stdout:1776: done (0 left) 2024-03-04T06:47:51.942 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 169 2024-03-04T06:47:51.942 INFO:tasks.rados.rados.0.smithi137.stdout:1777: seq_num 587 ranges {0=237568} 2024-03-04T06:47:51.943 INFO:tasks.rados.rados.0.smithi137.stdout:1777: writing smithi13777483-22 from 0 to 237568 tid 1 2024-03-04T06:47:51.943 INFO:tasks.rados.rados.0.smithi137.stdout:1778: copy_from oid 50 from oid 15 current snap is 169 2024-03-04T06:47:51.943 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 169 2024-03-04T06:47:51.943 INFO:tasks.rados.rados.0.smithi137.stdout:1779: seq_num 588 ranges {0=253952} 2024-03-04T06:47:51.944 INFO:tasks.rados.rados.0.smithi137.stdout:1779: writing smithi13777483-8 from 0 to 253952 tid 1 2024-03-04T06:47:51.944 INFO:tasks.rados.rados.0.smithi137.stdout:1780: copy_from oid 31 from oid 27 current snap is 169 2024-03-04T06:47:51.944 INFO:tasks.rados.rados.0.smithi137.stdout:1781: snap_create 2024-03-04T06:47:51.951 INFO:tasks.rados.rados.0.smithi137.stdout:1777: finishing write tid 1 to smithi13777483-22 2024-03-04T06:47:51.952 INFO:tasks.rados.rados.0.smithi137.stdout:1777: finishing write tid 2 to smithi13777483-22 2024-03-04T06:47:51.952 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:51.639+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:51.953 INFO:tasks.rados.rados.0.smithi137.stdout:1778: finishing copy_from to smithi13777483-50 2024-03-04T06:47:51.953 INFO:tasks.rados.rados.0.smithi137.stdout:1778: got expected ENOENT (src dne) 2024-03-04T06:47:51.953 INFO:tasks.rados.rados.0.smithi137.stdout:1778: finishing copy_from racing read to smithi13777483-50 2024-03-04T06:47:51.953 INFO:tasks.rados.rados.0.smithi137.stdout:1779: finishing write tid 1 to smithi13777483-8 2024-03-04T06:47:51.953 INFO:tasks.rados.rados.0.smithi137.stdout:1777: finishing write tid 3 to smithi13777483-22 2024-03-04T06:47:51.953 INFO:tasks.rados.rados.0.smithi137.stdout:1777: oid 22 updating version 0 to 15463 2024-03-04T06:47:51.953 INFO:tasks.rados.rados.0.smithi137.stdout:1777: oid 22 version 15463 is already newer than 15462 2024-03-04T06:47:51.954 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 15463 (ObjNum 587 snap 169 seq_num 587) dirty exists 2024-03-04T06:47:51.954 INFO:tasks.rados.rados.0.smithi137.stdout:1777: left oid 22 (ObjNum 587 snap 169 seq_num 587) 2024-03-04T06:47:51.954 INFO:tasks.rados.rados.0.smithi137.stdout:1779: finishing write tid 2 to smithi13777483-8 2024-03-04T06:47:51.957 INFO:tasks.rados.rados.0.smithi137.stdout:1779: finishing write tid 3 to smithi13777483-8 2024-03-04T06:47:51.957 INFO:tasks.rados.rados.0.smithi137.stdout:1779: oid 8 updating version 0 to 15455 2024-03-04T06:47:51.957 INFO:tasks.rados.rados.0.smithi137.stdout:1779: oid 8 updating version 15455 to 15456 2024-03-04T06:47:51.957 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 15456 (ObjNum 588 snap 169 seq_num 588) dirty exists 2024-03-04T06:47:51.957 INFO:tasks.rados.rados.0.smithi137.stdout:1779: left oid 8 (ObjNum 588 snap 169 seq_num 588) 2024-03-04T06:47:51.966 INFO:tasks.rados.rados.0.smithi137.stdout:1780: finishing copy_from racing read to smithi13777483-31 2024-03-04T06:47:51.969 INFO:tasks.rados.rados.0.smithi137.stdout:1780: finishing copy_from to smithi13777483-31 2024-03-04T06:47:51.969 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16762 (ObjNum 532 snap 150 seq_num 532) dirty exists 2024-03-04T06:47:52.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:51.953+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:52.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:51.951+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:52.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:51.951+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:52.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:51.951+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[88869]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:47:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[88869]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:47:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[88869]: Health check update: Possible data damage: 4 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:47:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[88869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/441 objects degraded (3.401%), 3 pgs degraded) 2024-03-04T06:47:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/2615044742' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[88869]: osdmap e407: 8 total, 8 up, 8 in 2024-03-04T06:47:52.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[91314]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:47:52.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[91314]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:47:52.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[91314]: Health check update: Possible data damage: 4 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:47:52.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[91314]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/441 objects degraded (3.401%), 3 pgs degraded) 2024-03-04T06:47:52.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:52.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:52.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:52.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/2615044742' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:52.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:52.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:51 smithi137 ceph-mon[91314]: osdmap e407: 8 total, 8 up, 8 in 2024-03-04T06:47:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:51 smithi203 ceph-mon[85573]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:47:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:51 smithi203 ceph-mon[85573]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:47:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:51 smithi203 ceph-mon[85573]: Health check update: Possible data damage: 4 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:47:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:51 smithi203 ceph-mon[85573]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/441 objects degraded (3.401%), 3 pgs degraded) 2024-03-04T06:47:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:51 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/2615044742' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:47:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:52.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:51 smithi203 ceph-mon[85573]: osdmap e407: 8 total, 8 up, 8 in 2024-03-04T06:47:52.944 INFO:tasks.rados.rados.0.smithi137.stdout:1777: done (4 left) 2024-03-04T06:47:52.944 INFO:tasks.rados.rados.0.smithi137.stdout:1778: done (3 left) 2024-03-04T06:47:52.944 INFO:tasks.rados.rados.0.smithi137.stdout:1779: done (2 left) 2024-03-04T06:47:52.944 INFO:tasks.rados.rados.0.smithi137.stdout:1780: done (1 left) 2024-03-04T06:47:52.944 INFO:tasks.rados.rados.0.smithi137.stdout:1781: done (0 left) 2024-03-04T06:47:52.944 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 43 current snap is 170 2024-03-04T06:47:52.945 INFO:tasks.rados.rados.0.smithi137.stdout:1782: seq_num 589 ranges {0=270336} 2024-03-04T06:47:52.945 INFO:tasks.rados.rados.0.smithi137.stdout:1782: writing smithi13777483-43 from 0 to 270336 tid 1 2024-03-04T06:47:52.945 INFO:tasks.rados.rados.0.smithi137.stdout:1783: delete oid 18 current snap is 170 2024-03-04T06:47:52.950 INFO:tasks.rados.rados.0.smithi137.stdout:1783: done (1 left) 2024-03-04T06:47:52.950 INFO:tasks.rados.rados.0.smithi137.stdout:1784: read oid 13 snap -1 2024-03-04T06:47:52.950 INFO:tasks.rados.rados.0.smithi137.stdout:1784: expect (ObjNum 537 snap 155 seq_num 537) 2024-03-04T06:47:52.950 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 170 2024-03-04T06:47:52.950 INFO:tasks.rados.rados.0.smithi137.stdout:1785: seq_num 591 ranges {0=303104} 2024-03-04T06:47:52.951 INFO:tasks.rados.rados.0.smithi137.stdout:1785: writing smithi13777483-39 from 0 to 303104 tid 1 2024-03-04T06:47:52.952 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 170 2024-03-04T06:47:52.952 INFO:tasks.rados.rados.0.smithi137.stdout:1786: seq_num 592 ranges {0=319488} 2024-03-04T06:47:52.954 INFO:tasks.rados.rados.0.smithi137.stdout:1786: writing smithi13777483-30 from 0 to 319488 tid 1 2024-03-04T06:47:52.954 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 170 2024-03-04T06:47:52.954 INFO:tasks.rados.rados.0.smithi137.stdout:1782: finishing write tid 1 to smithi13777483-43 2024-03-04T06:47:52.954 INFO:tasks.rados.rados.0.smithi137.stdout:1782: finishing write tid 2 to smithi13777483-43 2024-03-04T06:47:52.954 INFO:tasks.rados.rados.0.smithi137.stdout:1787: seq_num 593 ranges {253952=335872} 2024-03-04T06:47:52.958 INFO:tasks.rados.rados.0.smithi137.stdout:1787: writing smithi13777483-8 from 253952 to 589824 tid 1 2024-03-04T06:47:52.958 INFO:tasks.rados.rados.0.smithi137.stdout:1788: read oid 1 snap -1 2024-03-04T06:47:52.958 INFO:tasks.rados.rados.0.smithi137.stdout:1788: expect (ObjNum 467 snap 134 seq_num 467) 2024-03-04T06:47:52.958 INFO:tasks.rados.rados.0.smithi137.stdout:1789: snap_remove snap 160 2024-03-04T06:47:53.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:52.962+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:53.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:52.948+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:53.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:52.960+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:53.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:52.960+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:53.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:52.960+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:53.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:53.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:53.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:53.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:53.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-mon[88869]: pgmap v285: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 231 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 88 KiB/s wr, 1 op/s; 834 KiB/s, 0 objects/s recovering 2024-03-04T06:47:53.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-mon[88869]: osdmap e408: 8 total, 8 up, 8 in 2024-03-04T06:47:53.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:53.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:53.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:53.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:53.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-mon[91314]: pgmap v285: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 231 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 88 KiB/s wr, 1 op/s; 834 KiB/s, 0 objects/s recovering 2024-03-04T06:47:53.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:52 smithi137 ceph-mon[91314]: osdmap e408: 8 total, 8 up, 8 in 2024-03-04T06:47:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:52 smithi203 ceph-mon[85573]: pgmap v285: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 231 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 88 KiB/s wr, 1 op/s; 834 KiB/s, 0 objects/s recovering 2024-03-04T06:47:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:52 smithi203 ceph-mon[85573]: osdmap e408: 8 total, 8 up, 8 in 2024-03-04T06:47:53.962 INFO:tasks.rados.rados.0.smithi137.stdout:1789: done (6 left) 2024-03-04T06:47:53.962 INFO:tasks.rados.rados.0.smithi137.stdout:1790: rollback oid 4 current snap is 170 2024-03-04T06:47:53.963 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 4 to 164 2024-03-04T06:47:53.963 INFO:tasks.rados.rados.0.smithi137.stdout:1782: finishing write tid 3 to smithi13777483-43 2024-03-04T06:47:53.963 INFO:tasks.rados.rados.0.smithi137.stdout:1782: oid 43 updating version 0 to 645 2024-03-04T06:47:53.963 INFO:tasks.rados.rados.0.smithi137.stdout:1782: oid 43 version 645 is already newer than 644 2024-03-04T06:47:53.963 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 645 (ObjNum 589 snap 170 seq_num 589) dirty exists 2024-03-04T06:47:53.963 INFO:tasks.rados.rados.0.smithi137.stdout:1782: left oid 43 (ObjNum 589 snap 170 seq_num 589) 2024-03-04T06:47:53.963 INFO:tasks.rados.rados.0.smithi137.stdout:1784: expect (ObjNum 537 snap 155 seq_num 537) 2024-03-04T06:47:54.018 INFO:tasks.rados.rados.0.smithi137.stdout:1785: finishing write tid 1 to smithi13777483-39 2024-03-04T06:47:54.018 INFO:tasks.rados.rados.0.smithi137.stdout:1785: finishing write tid 2 to smithi13777483-39 2024-03-04T06:47:54.018 INFO:tasks.rados.rados.0.smithi137.stdout:1782: done (6 left) 2024-03-04T06:47:54.018 INFO:tasks.rados.rados.0.smithi137.stdout:1784: done (5 left) 2024-03-04T06:47:54.018 INFO:tasks.rados.rados.0.smithi137.stdout:1791: read oid 7 snap -1 2024-03-04T06:47:54.018 INFO:tasks.rados.rados.0.smithi137.stdout:1791: expect (ObjNum 522 snap 148 seq_num 522) 2024-03-04T06:47:54.018 INFO:tasks.rados.rados.0.smithi137.stdout:1792: copy_from oid 18 from oid 21 current snap is 170 2024-03-04T06:47:54.018 INFO:tasks.rados.rados.0.smithi137.stdout:1785: finishing write tid 3 to smithi13777483-39 2024-03-04T06:47:54.018 INFO:tasks.rados.rados.0.smithi137.stdout:1785: oid 39 updating version 0 to 426 2024-03-04T06:47:54.019 INFO:tasks.rados.rados.0.smithi137.stdout:1785: oid 39 version 426 is already newer than 425 2024-03-04T06:47:54.019 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 426 (ObjNum 591 snap 170 seq_num 591) dirty exists 2024-03-04T06:47:54.019 INFO:tasks.rados.rados.0.smithi137.stdout:1785: left oid 39 (ObjNum 591 snap 170 seq_num 591) 2024-03-04T06:47:54.019 INFO:tasks.rados.rados.0.smithi137.stdout:1785: done (6 left) 2024-03-04T06:47:54.019 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 43 current snap is 170 2024-03-04T06:47:54.019 INFO:tasks.rados.rados.0.smithi137.stdout:1786: finishing write tid 1 to smithi13777483-30 2024-03-04T06:47:54.019 INFO:tasks.rados.rados.0.smithi137.stdout:1786: finishing write tid 2 to smithi13777483-30 2024-03-04T06:47:54.019 INFO:tasks.rados.rados.0.smithi137.stdout:1793: seq_num 594 ranges {270336=352256} 2024-03-04T06:47:54.021 INFO:tasks.rados.rados.0.smithi137.stdout:1793: writing smithi13777483-43 from 270336 to 622592 tid 1 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:1794: read oid 34 snap -1 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:1794: expect (ObjNum 586 snap 168 seq_num 586) 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:1787: finishing write tid 1 to smithi13777483-8 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:1787: finishing write tid 2 to smithi13777483-8 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:1786: finishing write tid 3 to smithi13777483-30 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:1786: oid 30 updating version 0 to 16750 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:1786: oid 30 updating version 16750 to 16751 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16751 (ObjNum 592 snap 170 seq_num 592) dirty exists 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:1786: left oid 30 (ObjNum 592 snap 170 seq_num 592) 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:1787: finishing write tid 3 to smithi13777483-8 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:1787: oid 8 updating version 0 to 15458 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:1787: oid 8 version 15458 is already newer than 15457 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 15458 (ObjNum 593 snap 170 seq_num 593) dirty exists 2024-03-04T06:47:54.022 INFO:tasks.rados.rados.0.smithi137.stdout:1787: left oid 8 (ObjNum 593 snap 170 seq_num 593) 2024-03-04T06:47:54.023 INFO:tasks.rados.rados.0.smithi137.stdout:1788: expect (ObjNum 467 snap 134 seq_num 467) 2024-03-04T06:47:54.110 INFO:tasks.rados.rados.0.smithi137.stdout:1790: finishing rollback tid 0 to smithi13777483-4 2024-03-04T06:47:54.110 INFO:tasks.rados.rados.0.smithi137.stdout:1790: finishing rollback tid 1 to smithi13777483-4 2024-03-04T06:47:54.110 INFO:tasks.rados.rados.0.smithi137.stdout:1790: finishing rollback tid 2 to smithi13777483-4 2024-03-04T06:47:54.110 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 159 (ObjNum 567 snap 159 seq_num 567) dirty exists 2024-03-04T06:47:54.110 INFO:tasks.rados.rados.0.smithi137.stdout:1791: expect (ObjNum 522 snap 148 seq_num 522) 2024-03-04T06:47:54.151 INFO:tasks.rados.rados.0.smithi137.stdout:1793: finishing write tid 1 to smithi13777483-43 2024-03-04T06:47:54.151 INFO:tasks.rados.rados.0.smithi137.stdout:1793: finishing write tid 2 to smithi13777483-43 2024-03-04T06:47:54.152 INFO:tasks.rados.rados.0.smithi137.stdout:1794: expect (ObjNum 586 snap 168 seq_num 586) 2024-03-04T06:47:54.157 INFO:tasks.rados.rados.0.smithi137.stdout:1793: finishing write tid 3 to smithi13777483-43 2024-03-04T06:47:54.158 INFO:tasks.rados.rados.0.smithi137.stdout:1793: oid 43 updating version 0 to 647 2024-03-04T06:47:54.158 INFO:tasks.rados.rados.0.smithi137.stdout:1793: oid 43 version 647 is already newer than 646 2024-03-04T06:47:54.158 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 647 (ObjNum 594 snap 170 seq_num 594) dirty exists 2024-03-04T06:47:54.158 INFO:tasks.rados.rados.0.smithi137.stdout:1793: left oid 43 (ObjNum 594 snap 170 seq_num 594) 2024-03-04T06:47:54.158 INFO:tasks.rados.rados.0.smithi137.stdout:1792: finishing copy_from racing read to smithi13777483-18 2024-03-04T06:47:54.158 INFO:tasks.rados.rados.0.smithi137.stdout:1792: finishing copy_from to smithi13777483-18 2024-03-04T06:47:54.158 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 923 (ObjNum 490 snap 140 seq_num 490) dirty exists 2024-03-04T06:47:54.158 INFO:tasks.rados.rados.0.smithi137.stdout:1795: read oid 35 snap -1 2024-03-04T06:47:54.158 INFO:tasks.rados.rados.0.smithi137.stdout:1795: expect (ObjNum 584 snap 167 seq_num 584) 2024-03-04T06:47:54.158 INFO:tasks.rados.rados.0.smithi137.stdout:1786: done (8 left) 2024-03-04T06:47:54.158 INFO:tasks.rados.rados.0.smithi137.stdout:1787: done (7 left) 2024-03-04T06:47:54.158 INFO:tasks.rados.rados.0.smithi137.stdout:1788: done (6 left) 2024-03-04T06:47:54.158 INFO:tasks.rados.rados.0.smithi137.stdout:1790: done (5 left) 2024-03-04T06:47:54.159 INFO:tasks.rados.rados.0.smithi137.stdout:1791: done (4 left) 2024-03-04T06:47:54.159 INFO:tasks.rados.rados.0.smithi137.stdout:1792: done (3 left) 2024-03-04T06:47:54.159 INFO:tasks.rados.rados.0.smithi137.stdout:1793: done (2 left) 2024-03-04T06:47:54.159 INFO:tasks.rados.rados.0.smithi137.stdout:1794: done (1 left) 2024-03-04T06:47:54.159 INFO:tasks.rados.rados.0.smithi137.stdout:1796: setattr oid 41 current snap is 170 2024-03-04T06:47:54.160 INFO:tasks.rados.rados.0.smithi137.stdout:1797: read oid 36 snap 166 2024-03-04T06:47:54.160 INFO:tasks.rados.rados.0.smithi137.stdout:1797: expect deleted 2024-03-04T06:47:54.160 INFO:tasks.rados.rados.0.smithi137.stdout:1798: read oid 43 snap 166 2024-03-04T06:47:54.160 INFO:tasks.rados.rados.0.smithi137.stdout:1798: expect deleted 2024-03-04T06:47:54.160 INFO:tasks.rados.rados.0.smithi137.stdout:1799: read oid 11 snap -1 2024-03-04T06:47:54.160 INFO:tasks.rados.rados.0.smithi137.stdout:1799: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:47:54.160 INFO:tasks.rados.rados.0.smithi137.stdout:1800: read oid 44 snap -1 2024-03-04T06:47:54.160 INFO:tasks.rados.rados.0.smithi137.stdout:1800: expect (ObjNum 571 snap 159 seq_num 571) 2024-03-04T06:47:54.160 INFO:tasks.rados.rados.0.smithi137.stdout:1801: delete oid 10 current snap is 170 2024-03-04T06:47:54.165 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 15453 (ObjNum 289 snap 0 seq_num 1) dirty exists 2024-03-04T06:47:54.182 INFO:tasks.rados.rados.0.smithi137.stdout:1796: done (6 left) 2024-03-04T06:47:54.183 INFO:tasks.rados.rados.0.smithi137.stdout:1797: done (5 left) 2024-03-04T06:47:54.183 INFO:tasks.rados.rados.0.smithi137.stdout:1798: done (4 left) 2024-03-04T06:47:54.183 INFO:tasks.rados.rados.0.smithi137.stdout:1801: done (3 left) 2024-03-04T06:47:54.183 INFO:tasks.rados.rados.0.smithi137.stdout:1802: read oid 12 snap -1 2024-03-04T06:47:54.183 INFO:tasks.rados.rados.0.smithi137.stdout:1802: expect (ObjNum 531 snap 150 seq_num 531) 2024-03-04T06:47:54.183 INFO:tasks.rados.rados.0.smithi137.stdout:1803: rmattr oid 49 current snap is 170 2024-03-04T06:47:54.183 INFO:tasks.rados.rados.0.smithi137.stdout:1804: copy_from oid 43 from oid 19 current snap is 170 2024-03-04T06:47:54.183 INFO:tasks.rados.rados.0.smithi137.stdout:1805: rollback oid 8 current snap is 170 2024-03-04T06:47:54.183 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 8 to 169 2024-03-04T06:47:54.183 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 170 2024-03-04T06:47:54.183 INFO:tasks.rados.rados.0.smithi137.stdout:1806: seq_num 596 ranges {8691712=385024} 2024-03-04T06:47:54.234 INFO:tasks.rados.rados.0.smithi137.stdout:1806: writing smithi13777483-21 from 8691712 to 9076736 tid 1 2024-03-04T06:47:54.234 INFO:tasks.rados.rados.0.smithi137.stdout:1807: setattr oid 30 current snap is 170 2024-03-04T06:47:54.234 INFO:tasks.rados.rados.0.smithi137.stdout:1804: finishing copy_from to smithi13777483-43 2024-03-04T06:47:54.234 INFO:tasks.rados.rados.0.smithi137.stdout:1804: got expected ENOENT (src dne) 2024-03-04T06:47:54.234 INFO:tasks.rados.rados.0.smithi137.stdout:1804: finishing copy_from racing read to smithi13777483-43 2024-03-04T06:47:54.234 INFO:tasks.rados.rados.0.smithi137.stdout:1805: finishing rollback tid 0 to smithi13777483-8 2024-03-04T06:47:54.234 INFO:tasks.rados.rados.0.smithi137.stdout:1799: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:47:54.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:53.959+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:54.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:53.959+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:54.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:53.963+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:54.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:53.990+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:54.679 INFO:tasks.rados.rados.0.smithi137.stdout:1805: finishing rollback tid 1 to smithi13777483-8 2024-03-04T06:47:54.680 INFO:tasks.rados.rados.0.smithi137.stdout:1805: finishing rollback tid 2 to smithi13777483-8 2024-03-04T06:47:54.680 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 15461 (ObjNum 588 snap 169 seq_num 588) dirty exists 2024-03-04T06:47:54.680 INFO:tasks.rados.rados.0.smithi137.stdout:1800: expect (ObjNum 571 snap 159 seq_num 571) 2024-03-04T06:47:54.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:54.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:54.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:54.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:54.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:54.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:47:54.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[88869]: osdmap e409: 8 total, 8 up, 8 in 2024-03-04T06:47:54.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[88869]: pgmap v288: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 236 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2024-03-04T06:47:54.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:54.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:54.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:54.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:54.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:54.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:47:54.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[91314]: osdmap e409: 8 total, 8 up, 8 in 2024-03-04T06:47:54.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:54 smithi137 ceph-mon[91314]: pgmap v288: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 236 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2024-03-04T06:47:54.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:54.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:54.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:54.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:54.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:47:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:54 smithi203 ceph-mon[85573]: osdmap e409: 8 total, 8 up, 8 in 2024-03-04T06:47:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:54 smithi203 ceph-mon[85573]: pgmap v288: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 236 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2024-03-04T06:47:55.600 INFO:tasks.rados.rados.0.smithi137.stdout:1802: expect (ObjNum 531 snap 150 seq_num 531) 2024-03-04T06:47:55.740 INFO:tasks.rados.rados.0.smithi137.stdout:1795: expect (ObjNum 584 snap 167 seq_num 584) 2024-03-04T06:47:55.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:47:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:47:55] "GET /metrics HTTP/1.1" 200 36275 "" "Prometheus/2.43.0" 2024-03-04T06:47:55.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:55.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:55.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:55.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:55.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:55.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:55.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:55.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset d4=[]:{} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:56.754 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16763 (ObjNum 534 snap 152 seq_num 534) dirty exists 2024-03-04T06:47:56.754 INFO:tasks.rados.rados.0.smithi137.stdout:1806: finishing write tid 1 to smithi13777483-21 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1806: finishing write tid 2 to smithi13777483-21 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1806: finishing write tid 3 to smithi13777483-21 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1806: oid 21 updating version 0 to 15461 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1806: oid 21 version 15461 is already newer than 15460 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 15461 (ObjNum 596 snap 170 seq_num 596) dirty exists 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1806: left oid 21 (ObjNum 596 snap 170 seq_num 596) 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1795: done (8 left) 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1799: done (7 left) 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1800: done (6 left) 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1802: done (5 left) 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1803: done (4 left) 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1804: done (3 left) 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1805: done (2 left) 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1806: done (1 left) 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:1808: rollback oid 33 current snap is 170 2024-03-04T06:47:56.755 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 33 to 168 2024-03-04T06:47:56.756 INFO:tasks.rados.rados.0.smithi137.stdout:1809: read oid 16 snap -1 2024-03-04T06:47:56.756 INFO:tasks.rados.rados.0.smithi137.stdout:1809: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:47:56.756 INFO:tasks.rados.rados.0.smithi137.stdout:1810: delete oid 17 current snap is 170 2024-03-04T06:47:56.756 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16752 (ObjNum 592 snap 170 seq_num 592) dirty exists 2024-03-04T06:47:56.756 INFO:tasks.rados.rados.0.smithi137.stdout:1808: finishing rollback tid 1 to smithi13777483-33 2024-03-04T06:47:56.756 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 0 (ObjNum 129 snap 0 seq_num 3131396656) dirty dne 2024-03-04T06:47:56.759 INFO:tasks.rados.rados.0.smithi137.stdout:1807: done (3 left) 2024-03-04T06:47:56.759 INFO:tasks.rados.rados.0.smithi137.stdout:1808: done (2 left) 2024-03-04T06:47:56.759 INFO:tasks.rados.rados.0.smithi137.stdout:1810: done (1 left) 2024-03-04T06:47:56.760 INFO:tasks.rados.rados.0.smithi137.stdout:1811: read oid 27 snap -1 2024-03-04T06:47:56.760 INFO:tasks.rados.rados.0.smithi137.stdout:1811: expect (ObjNum 532 snap 150 seq_num 532) 2024-03-04T06:47:56.760 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 170 2024-03-04T06:47:56.760 INFO:tasks.rados.rados.0.smithi137.stdout:1812: seq_num 598 ranges {237568=417792} 2024-03-04T06:47:56.763 INFO:tasks.rados.rados.0.smithi137.stdout:1812: writing smithi13777483-22 from 237568 to 655360 tid 1 2024-03-04T06:47:56.763 INFO:tasks.rados.rados.0.smithi137.stdout:1813: read oid 35 snap -1 2024-03-04T06:47:56.763 INFO:tasks.rados.rados.0.smithi137.stdout:1813: expect (ObjNum 584 snap 167 seq_num 584) 2024-03-04T06:47:56.763 INFO:tasks.rados.rados.0.smithi137.stdout:1814: copy_from oid 11 from oid 26 current snap is 170 2024-03-04T06:47:56.763 INFO:tasks.rados.rados.0.smithi137.stdout:1815: snap_create 2024-03-04T06:47:56.769 INFO:tasks.rados.rados.0.smithi137.stdout:1812: finishing write tid 1 to smithi13777483-22 2024-03-04T06:47:56.769 INFO:tasks.rados.rados.0.smithi137.stdout:1812: finishing write tid 2 to smithi13777483-22 2024-03-04T06:47:56.771 INFO:tasks.rados.rados.0.smithi137.stdout:1812: finishing write tid 3 to smithi13777483-22 2024-03-04T06:47:56.771 INFO:tasks.rados.rados.0.smithi137.stdout:1812: oid 22 updating version 0 to 15465 2024-03-04T06:47:56.771 INFO:tasks.rados.rados.0.smithi137.stdout:1812: oid 22 version 15465 is already newer than 15464 2024-03-04T06:47:56.771 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 15465 (ObjNum 598 snap 170 seq_num 598) dirty exists 2024-03-04T06:47:56.771 INFO:tasks.rados.rados.0.smithi137.stdout:1812: left oid 22 (ObjNum 598 snap 170 seq_num 598) 2024-03-04T06:47:56.775 INFO:tasks.rados.rados.0.smithi137.stdout:1811: expect (ObjNum 532 snap 150 seq_num 532) 2024-03-04T06:47:56.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:56 smithi137 ceph-mon[88869]: pgmap v289: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 236 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 1.0 MiB/s wr, 20 op/s 2024-03-04T06:47:56.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:56 smithi137 ceph-mon[91314]: pgmap v289: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 236 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 1.0 MiB/s wr, 20 op/s 2024-03-04T06:47:56.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:56 smithi203 ceph-mon[85573]: pgmap v289: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 236 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 1.0 MiB/s wr, 20 op/s 2024-03-04T06:47:56.911 INFO:tasks.rados.rados.0.smithi137.stdout:1809: expect (ObjNum 419 snap 125 seq_num 419) 2024-03-04T06:47:57.354 INFO:tasks.rados.rados.0.smithi137.stdout:1814: finishing copy_from racing read to smithi13777483-11 2024-03-04T06:47:57.354 INFO:tasks.rados.rados.0.smithi137.stdout:1814: finishing copy_from to smithi13777483-11 2024-03-04T06:47:57.354 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16775 (ObjNum 570 snap 159 seq_num 570) dirty exists 2024-03-04T06:47:57.354 INFO:tasks.rados.rados.0.smithi137.stdout:1813: expect (ObjNum 584 snap 167 seq_num 584) 2024-03-04T06:47:58.156 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:57.825+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:58.372 INFO:tasks.rados.rados.0.smithi137.stdout:1809: done (5 left) 2024-03-04T06:47:58.372 INFO:tasks.rados.rados.0.smithi137.stdout:1811: done (4 left) 2024-03-04T06:47:58.372 INFO:tasks.rados.rados.0.smithi137.stdout:1812: done (3 left) 2024-03-04T06:47:58.372 INFO:tasks.rados.rados.0.smithi137.stdout:1813: done (2 left) 2024-03-04T06:47:58.372 INFO:tasks.rados.rados.0.smithi137.stdout:1814: done (1 left) 2024-03-04T06:47:58.372 INFO:tasks.rados.rados.0.smithi137.stdout:1815: done (0 left) 2024-03-04T06:47:58.372 INFO:tasks.rados.rados.0.smithi137.stdout:1816: delete oid 42 current snap is 171 2024-03-04T06:47:58.375 INFO:tasks.rados.rados.0.smithi137.stdout:1816: done (0 left) 2024-03-04T06:47:58.375 INFO:tasks.rados.rados.0.smithi137.stdout:1817: delete oid 48 current snap is 171 2024-03-04T06:47:58.378 INFO:tasks.rados.rados.0.smithi137.stdout:1817: done (0 left) 2024-03-04T06:47:58.378 INFO:tasks.rados.rados.0.smithi137.stdout:1818: rollback oid 47 current snap is 171 2024-03-04T06:47:58.378 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 47 to 162 2024-03-04T06:47:58.378 INFO:tasks.rados.rados.0.smithi137.stdout:1819: read oid 15 snap -1 2024-03-04T06:47:58.378 INFO:tasks.rados.rados.0.smithi137.stdout:1819: expect deleted 2024-03-04T06:47:58.378 INFO:tasks.rados.rados.0.smithi137.stdout:1820: setattr oid 4 current snap is 171 2024-03-04T06:47:58.379 INFO:tasks.rados.rados.0.smithi137.stdout:1819: done (2 left) 2024-03-04T06:47:58.379 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 171 2024-03-04T06:47:58.379 INFO:tasks.rados.rados.0.smithi137.stdout:1821: seq_num 601 ranges {0=475136} 2024-03-04T06:47:58.382 INFO:tasks.rados.rados.0.smithi137.stdout:1821: writing smithi13777483-17 from 0 to 475136 tid 1 2024-03-04T06:47:58.382 INFO:tasks.rados.rados.0.smithi137.stdout:1822: snap_remove snap 164 2024-03-04T06:47:58.406 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-mon[88869]: osdmap e410: 8 total, 8 up, 8 in 2024-03-04T06:47:58.406 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:58.407 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-mon[88869]: pgmap v291: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 245 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 27 MiB/s rd, 2.4 MiB/s wr, 22 op/s 2024-03-04T06:47:58.407 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-mon[91314]: osdmap e410: 8 total, 8 up, 8 in 2024-03-04T06:47:58.407 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:58.407 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-mon[91314]: pgmap v291: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 245 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 27 MiB/s rd, 2.4 MiB/s wr, 22 op/s 2024-03-04T06:47:58.407 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:58.154+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:58.408 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:58.154+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:58.408 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:58.154+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:58.408 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:58.154+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:1822: done (3 left) 2024-03-04T06:47:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:1823: snap_create 2024-03-04T06:47:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 160 (ObjNum 567 snap 159 seq_num 567) dirty exists 2024-03-04T06:47:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:1818: finishing rollback tid 0 to smithi13777483-47 2024-03-04T06:47:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:1818: finishing rollback tid 1 to smithi13777483-47 2024-03-04T06:47:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:1818: finishing rollback tid 2 to smithi13777483-47 2024-03-04T06:47:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 15464 (ObjNum 560 snap 159 seq_num 560) dirty exists 2024-03-04T06:47:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:1821: finishing write tid 1 to smithi13777483-17 2024-03-04T06:47:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:1821: finishing write tid 2 to smithi13777483-17 2024-03-04T06:47:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:1821: finishing write tid 3 to smithi13777483-17 2024-03-04T06:47:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:1821: oid 17 updating version 0 to 649 2024-03-04T06:47:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:1821: oid 17 updating version 649 to 650 2024-03-04T06:47:58.409 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 650 (ObjNum 601 snap 171 seq_num 601) dirty exists 2024-03-04T06:47:58.410 INFO:tasks.rados.rados.0.smithi137.stdout:1821: left oid 17 (ObjNum 601 snap 171 seq_num 601) 2024-03-04T06:47:58.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:58.404+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:58.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:58 smithi203 ceph-mon[85573]: osdmap e410: 8 total, 8 up, 8 in 2024-03-04T06:47:58.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:58.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:58 smithi203 ceph-mon[85573]: pgmap v291: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 245 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 27 MiB/s rd, 2.4 MiB/s wr, 22 op/s 2024-03-04T06:47:59.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:58.793+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:59.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:58.846+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:59.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:58.846+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:59.407 INFO:tasks.rados.rados.0.smithi137.stdout:1818: done (3 left) 2024-03-04T06:47:59.407 INFO:tasks.rados.rados.0.smithi137.stdout:1820: done (2 left) 2024-03-04T06:47:59.407 INFO:tasks.rados.rados.0.smithi137.stdout:1821: done (1 left) 2024-03-04T06:47:59.407 INFO:tasks.rados.rados.0.smithi137.stdout:1823: done (0 left) 2024-03-04T06:47:59.407 INFO:tasks.rados.rados.0.smithi137.stdout:1824: delete oid 38 current snap is 172 2024-03-04T06:47:59.417 INFO:tasks.rados.rados.0.smithi137.stdout:1824: done (0 left) 2024-03-04T06:47:59.417 INFO:tasks.rados.rados.0.smithi137.stdout:1825: snap_remove snap 159 2024-03-04T06:47:59.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:47:59.408+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:59.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:59.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:59.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:59.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[91314]: osdmap e411: 8 total, 8 up, 8 in 2024-03-04T06:47:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:59.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:59.415+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:59.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:59.416+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:47:59.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:47:59.416+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:59.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:59.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:59.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[88869]: osdmap e411: 8 total, 8 up, 8 in 2024-03-04T06:47:59.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:59.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:47:59.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:47:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:47:59.414+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:47:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:47:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:47:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:59 smithi203 ceph-mon[85573]: osdmap e411: 8 total, 8 up, 8 in 2024-03-04T06:47:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:59 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:47:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:47:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:00.433 INFO:tasks.rados.rados.0.smithi137.stdout:1825: done (0 left) 2024-03-04T06:48:00.433 INFO:tasks.rados.rados.0.smithi137.stdout:1826: rmattr oid 12 current snap is 172 2024-03-04T06:48:00.433 INFO:tasks.rados.rados.0.smithi137.stdout:1827: snap_remove snap 170 2024-03-04T06:48:00.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:00.431+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:00.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:00.432+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:00.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:00.446+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[88869]: osdmap e412: 8 total, 8 up, 8 in 2024-03-04T06:48:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:00.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[88869]: pgmap v294: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 252 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-03-04T06:48:00.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:00.430+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[91314]: osdmap e412: 8 total, 8 up, 8 in 2024-03-04T06:48:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:00 smithi137 ceph-mon[91314]: pgmap v294: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 252 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-03-04T06:48:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:00 smithi203 ceph-mon[85573]: osdmap e412: 8 total, 8 up, 8 in 2024-03-04T06:48:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:00.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:00 smithi203 ceph-mon[85573]: pgmap v294: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 252 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-03-04T06:48:01.427 INFO:tasks.rados.rados.0.smithi137.stdout:1827: done (1 left) 2024-03-04T06:48:01.428 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 172 2024-03-04T06:48:01.428 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16753 (ObjNum 531 snap 150 seq_num 531) dirty exists 2024-03-04T06:48:01.428 INFO:tasks.rados.rados.0.smithi137.stdout:1828: seq_num 603 ranges {8626176=507904} 2024-03-04T06:48:01.476 INFO:tasks.rados.rados.0.smithi137.stdout:1828: writing smithi13777483-45 from 8626176 to 9134080 tid 1 2024-03-04T06:48:01.476 INFO:tasks.rados.rados.0.smithi137.stdout:1826: done (1 left) 2024-03-04T06:48:01.476 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 37 current snap is 172 2024-03-04T06:48:01.476 INFO:tasks.rados.rados.0.smithi137.stdout:1829: seq_num 604 ranges {0=524288} 2024-03-04T06:48:01.479 INFO:tasks.rados.rados.0.smithi137.stdout:1829: writing smithi13777483-37 from 0 to 524288 tid 1 2024-03-04T06:48:01.479 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 172 2024-03-04T06:48:01.479 INFO:tasks.rados.rados.0.smithi137.stdout:1830: seq_num 605 ranges {2154496=540672} 2024-03-04T06:48:01.495 INFO:tasks.rados.rados.0.smithi137.stdout:1830: writing smithi13777483-1 from 2154496 to 2695168 tid 1 2024-03-04T06:48:01.495 INFO:tasks.rados.rados.0.smithi137.stdout:1831: rollback oid 33 current snap is 172 2024-03-04T06:48:01.495 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 33 to 165 2024-03-04T06:48:01.495 INFO:tasks.rados.rados.0.smithi137.stdout:1828: finishing write tid 1 to smithi13777483-45 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:1828: finishing write tid 2 to smithi13777483-45 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:1829: finishing write tid 1 to smithi13777483-37 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:1832: rollback oid 7 current snap is 172 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 7 to 162 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:1828: finishing write tid 3 to smithi13777483-45 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:1828: oid 45 updating version 0 to 15455 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:1828: oid 45 version 15455 is already newer than 15454 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 15455 (ObjNum 603 snap 172 seq_num 603) dirty exists 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:1828: left oid 45 (ObjNum 603 snap 172 seq_num 603) 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:1829: finishing write tid 2 to smithi13777483-37 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:1829: finishing write tid 3 to smithi13777483-37 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:1829: oid 37 updating version 0 to 15467 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:1829: oid 37 version 15467 is already newer than 15466 2024-03-04T06:48:01.496 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 15467 (ObjNum 604 snap 172 seq_num 604) dirty exists 2024-03-04T06:48:01.497 INFO:tasks.rados.rados.0.smithi137.stdout:1829: left oid 37 (ObjNum 604 snap 172 seq_num 604) 2024-03-04T06:48:01.497 INFO:tasks.rados.rados.0.smithi137.stdout:1828: done (4 left) 2024-03-04T06:48:01.497 INFO:tasks.rados.rados.0.smithi137.stdout:1829: done (3 left) 2024-03-04T06:48:01.497 INFO:tasks.rados.rados.0.smithi137.stdout:1833: copy_from oid 8 from oid 35 current snap is 172 2024-03-04T06:48:01.497 INFO:tasks.rados.rados.0.smithi137.stdout:1834: read oid 47 snap -1 2024-03-04T06:48:01.497 INFO:tasks.rados.rados.0.smithi137.stdout:1834: expect (ObjNum 560 snap 159 seq_num 560) 2024-03-04T06:48:01.497 INFO:tasks.rados.rados.0.smithi137.stdout:1835: snap_create 2024-03-04T06:48:01.500 INFO:tasks.rados.rados.0.smithi137.stdout:1831: finishing rollback tid 1 to smithi13777483-33 2024-03-04T06:48:01.500 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 0 (ObjNum 129 snap 0 seq_num 3131287208) dirty dne 2024-03-04T06:48:01.500 INFO:tasks.rados.rados.0.smithi137.stdout:1832: finishing rollback tid 0 to smithi13777483-7 2024-03-04T06:48:01.500 INFO:tasks.rados.rados.0.smithi137.stdout:1832: finishing rollback tid 1 to smithi13777483-7 2024-03-04T06:48:01.501 INFO:tasks.rados.rados.0.smithi137.stdout:1830: finishing write tid 1 to smithi13777483-1 2024-03-04T06:48:01.501 INFO:tasks.rados.rados.0.smithi137.stdout:1832: finishing rollback tid 2 to smithi13777483-7 2024-03-04T06:48:01.501 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16778 (ObjNum 522 snap 148 seq_num 522) dirty exists 2024-03-04T06:48:01.501 INFO:tasks.rados.rados.0.smithi137.stdout:1830: finishing write tid 2 to smithi13777483-1 2024-03-04T06:48:01.502 INFO:tasks.rados.rados.0.smithi137.stdout:1830: finishing write tid 3 to smithi13777483-1 2024-03-04T06:48:01.502 INFO:tasks.rados.rados.0.smithi137.stdout:1830: oid 1 updating version 0 to 15463 2024-03-04T06:48:01.502 INFO:tasks.rados.rados.0.smithi137.stdout:1830: oid 1 version 15463 is already newer than 15462 2024-03-04T06:48:01.502 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 15463 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:48:01.502 INFO:tasks.rados.rados.0.smithi137.stdout:1830: left oid 1 (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:48:01.542 INFO:tasks.rados.rados.0.smithi137.stdout:1834: expect (ObjNum 560 snap 159 seq_num 560) 2024-03-04T06:48:01.747 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:01.747 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:01 smithi203 ceph-mon[85573]: osdmap e413: 8 total, 8 up, 8 in 2024-03-04T06:48:01.747 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:01.747 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:01.747 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:01.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:01.484+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:01.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:01.484+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:01.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:01.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-mon[88869]: osdmap e413: 8 total, 8 up, 8 in 2024-03-04T06:48:01.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:01.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:01.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-mon[91314]: osdmap e413: 8 total, 8 up, 8 in 2024-03-04T06:48:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:01.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:01.486+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:01.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:01.486+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:01.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:01.487+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:02.143 INFO:tasks.rados.rados.0.smithi137.stdout:1833: finishing copy_from racing read to smithi13777483-8 2024-03-04T06:48:02.143 INFO:tasks.rados.rados.0.smithi137.stdout:1833: finishing copy_from to smithi13777483-8 2024-03-04T06:48:02.143 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 815 (ObjNum 584 snap 167 seq_num 584) dirty exists 2024-03-04T06:48:02.446 INFO:tasks.rados.rados.0.smithi137.stdout:1830: done (5 left) 2024-03-04T06:48:02.446 INFO:tasks.rados.rados.0.smithi137.stdout:1831: done (4 left) 2024-03-04T06:48:02.446 INFO:tasks.rados.rados.0.smithi137.stdout:1832: done (3 left) 2024-03-04T06:48:02.446 INFO:tasks.rados.rados.0.smithi137.stdout:1833: done (2 left) 2024-03-04T06:48:02.446 INFO:tasks.rados.rados.0.smithi137.stdout:1834: done (1 left) 2024-03-04T06:48:02.446 INFO:tasks.rados.rados.0.smithi137.stdout:1835: done (0 left) 2024-03-04T06:48:02.446 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 173 2024-03-04T06:48:02.446 INFO:tasks.rados.rados.0.smithi137.stdout:1836: seq_num 606 ranges {1802240=557056} 2024-03-04T06:48:02.459 INFO:tasks.rados.rados.0.smithi137.stdout:1836: writing smithi13777483-13 from 1802240 to 2359296 tid 1 2024-03-04T06:48:02.459 INFO:tasks.rados.rados.0.smithi137.stdout:1837: copy_from oid 28 from oid 50 current snap is 173 2024-03-04T06:48:02.459 INFO:tasks.rados.rados.0.smithi137.stdout:1838: rollback oid 38 current snap is 173 2024-03-04T06:48:02.459 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 38 to 171 2024-03-04T06:48:02.459 INFO:tasks.rados.rados.0.smithi137.stdout:1839: read oid 20 snap -1 2024-03-04T06:48:02.459 INFO:tasks.rados.rados.0.smithi137.stdout:1839: expect deleted 2024-03-04T06:48:02.460 INFO:tasks.rados.rados.0.smithi137.stdout:1840: copy_from oid 37 from oid 45 current snap is 173 2024-03-04T06:48:02.460 INFO:tasks.rados.rados.0.smithi137.stdout:1841: copy_from oid 42 from oid 29 current snap is 173 2024-03-04T06:48:02.460 INFO:tasks.rados.rados.0.smithi137.stdout:1842: snap_remove snap 162 2024-03-04T06:48:02.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-mon[91314]: osdmap e414: 8 total, 8 up, 8 in 2024-03-04T06:48:02.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:02.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:02.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:02.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:02.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-mon[91314]: pgmap v297: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 252 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-04T06:48:02.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:02.465+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:02.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:02.466+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-mon[88869]: osdmap e414: 8 total, 8 up, 8 in 2024-03-04T06:48:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-mon[88869]: pgmap v297: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 252 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-04T06:48:02.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:02.464+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:02.795 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:02.443+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:02.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:02 smithi203 ceph-mon[85573]: osdmap e414: 8 total, 8 up, 8 in 2024-03-04T06:48:02.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:02.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:02.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:02.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:02.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:02 smithi203 ceph-mon[85573]: pgmap v297: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 252 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-04T06:48:03.450 INFO:tasks.rados.rados.0.smithi137.stdout:1842: done (6 left) 2024-03-04T06:48:03.450 INFO:tasks.rados.rados.0.smithi137.stdout:1843: read oid 32 snap -1 2024-03-04T06:48:03.450 INFO:tasks.rados.rados.0.smithi137.stdout:1843: expect deleted 2024-03-04T06:48:03.450 INFO:tasks.rados.rados.0.smithi137.stdout:1844: read oid 26 snap 156 2024-03-04T06:48:03.450 INFO:tasks.rados.rados.0.smithi137.stdout:1844: expect (ObjNum 531 snap 150 seq_num 531) 2024-03-04T06:48:03.450 INFO:tasks.rados.rados.0.smithi137.stdout:1845: setattr oid 47 current snap is 173 2024-03-04T06:48:03.451 INFO:tasks.rados.rados.0.smithi137.stdout:1837: finishing copy_from to smithi13777483-28 2024-03-04T06:48:03.451 INFO:tasks.rados.rados.0.smithi137.stdout:1837: got expected ENOENT (src dne) 2024-03-04T06:48:03.451 INFO:tasks.rados.rados.0.smithi137.stdout:1836: finishing write tid 1 to smithi13777483-13 2024-03-04T06:48:03.451 INFO:tasks.rados.rados.0.smithi137.stdout:1836: finishing write tid 2 to smithi13777483-13 2024-03-04T06:48:03.451 INFO:tasks.rados.rados.0.smithi137.stdout:1837: finishing copy_from racing read to smithi13777483-28 2024-03-04T06:48:03.451 INFO:tasks.rados.rados.0.smithi137.stdout:1838: finishing rollback tid 1 to smithi13777483-38 2024-03-04T06:48:03.451 INFO:tasks.rados.rados.0.smithi137.stdout:1838: finishing rollback tid 2 to smithi13777483-38 2024-03-04T06:48:03.451 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 15467 (ObjNum 419 snap 125 seq_num 419) dirty exists 2024-03-04T06:48:03.451 INFO:tasks.rados.rados.0.smithi137.stdout:1841: finishing copy_from to smithi13777483-42 2024-03-04T06:48:03.451 INFO:tasks.rados.rados.0.smithi137.stdout:1841: got expected ENOENT (src dne) 2024-03-04T06:48:03.451 INFO:tasks.rados.rados.0.smithi137.stdout:1841: finishing copy_from racing read to smithi13777483-42 2024-03-04T06:48:03.452 INFO:tasks.rados.rados.0.smithi137.stdout:1836: finishing write tid 3 to smithi13777483-13 2024-03-04T06:48:03.452 INFO:tasks.rados.rados.0.smithi137.stdout:1836: oid 13 updating version 0 to 16766 2024-03-04T06:48:03.452 INFO:tasks.rados.rados.0.smithi137.stdout:1836: oid 13 version 16766 is already newer than 16765 2024-03-04T06:48:03.452 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16766 (ObjNum 606 snap 173 seq_num 606) dirty exists 2024-03-04T06:48:03.452 INFO:tasks.rados.rados.0.smithi137.stdout:1836: left oid 13 (ObjNum 606 snap 173 seq_num 606) 2024-03-04T06:48:03.452 INFO:tasks.rados.rados.0.smithi137.stdout:1840: finishing copy_from racing read to smithi13777483-37 2024-03-04T06:48:03.452 INFO:tasks.rados.rados.0.smithi137.stdout:1840: finishing copy_from to smithi13777483-37 2024-03-04T06:48:03.452 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 15455 (ObjNum 603 snap 172 seq_num 603) dirty exists 2024-03-04T06:48:03.454 INFO:tasks.rados.rados.0.smithi137.stdout:1836: done (8 left) 2024-03-04T06:48:03.454 INFO:tasks.rados.rados.0.smithi137.stdout:1837: done (7 left) 2024-03-04T06:48:03.454 INFO:tasks.rados.rados.0.smithi137.stdout:1838: done (6 left) 2024-03-04T06:48:03.454 INFO:tasks.rados.rados.0.smithi137.stdout:1839: done (5 left) 2024-03-04T06:48:03.454 INFO:tasks.rados.rados.0.smithi137.stdout:1840: done (4 left) 2024-03-04T06:48:03.454 INFO:tasks.rados.rados.0.smithi137.stdout:1841: done (3 left) 2024-03-04T06:48:03.454 INFO:tasks.rados.rados.0.smithi137.stdout:1843: done (2 left) 2024-03-04T06:48:03.454 INFO:tasks.rados.rados.0.smithi137.stdout:1846: read oid 42 snap -1 2024-03-04T06:48:03.454 INFO:tasks.rados.rados.0.smithi137.stdout:1846: expect deleted 2024-03-04T06:48:03.455 INFO:tasks.rados.rados.0.smithi137.stdout:1847: snap_remove snap 169 2024-03-04T06:48:03.745 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:03.745 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:03 smithi203 ceph-mon[85573]: osdmap e415: 8 total, 8 up, 8 in 2024-03-04T06:48:03.745 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:03.745 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:03.746 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:03.746 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:03 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-04T06:48:03.746 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:03 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-04T06:48:03.746 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:03 smithi203 ceph-mon[85573]: Upgrade: osd.4 is safe to restart 2024-03-04T06:48:03.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:03.460+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:03.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[91314]: osdmap e415: 8 total, 8 up, 8 in 2024-03-04T06:48:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-04T06:48:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-04T06:48:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[91314]: Upgrade: osd.4 is safe to restart 2024-03-04T06:48:03.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:03.447+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:03.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:03.447+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:03.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:03.449+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:03.795 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:03.450+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:03.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:03.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[88869]: osdmap e415: 8 total, 8 up, 8 in 2024-03-04T06:48:03.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:03.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:03.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:03.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-04T06:48:03.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-04T06:48:03.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:03 smithi137 ceph-mon[88869]: Upgrade: osd.4 is safe to restart 2024-03-04T06:48:04.458 INFO:tasks.rados.rados.0.smithi137.stdout:1847: done (3 left) 2024-03-04T06:48:04.458 INFO:tasks.rados.rados.0.smithi137.stdout:1848: read oid 22 snap -1 2024-03-04T06:48:04.458 INFO:tasks.rados.rados.0.smithi137.stdout:1848: expect (ObjNum 598 snap 170 seq_num 598) 2024-03-04T06:48:04.458 INFO:tasks.rados.rados.0.smithi137.stdout:1849: read oid 33 snap -1 2024-03-04T06:48:04.458 INFO:tasks.rados.rados.0.smithi137.stdout:1849: expect deleted 2024-03-04T06:48:04.459 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 173 2024-03-04T06:48:04.459 INFO:tasks.rados.rados.0.smithi137.stdout:1850: seq_num 607 ranges {475136=573440} 2024-03-04T06:48:04.465 INFO:tasks.rados.rados.0.smithi137.stdout:1850: writing smithi13777483-17 from 475136 to 1048576 tid 1 2024-03-04T06:48:04.465 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 15468 (ObjNum 560 snap 159 seq_num 560) dirty exists 2024-03-04T06:48:04.465 INFO:tasks.rados.rados.0.smithi137.stdout:1844: expect (ObjNum 531 snap 150 seq_num 531) 2024-03-04T06:48:04.609 INFO:tasks.rados.rados.0.smithi137.stdout:1848: expect (ObjNum 598 snap 170 seq_num 598) 2024-03-04T06:48:04.630 INFO:tasks.rados.rados.0.smithi137.stdout:1850: finishing write tid 1 to smithi13777483-17 2024-03-04T06:48:04.630 INFO:tasks.rados.rados.0.smithi137.stdout:1850: finishing write tid 2 to smithi13777483-17 2024-03-04T06:48:04.630 INFO:tasks.rados.rados.0.smithi137.stdout:1850: finishing write tid 3 to smithi13777483-17 2024-03-04T06:48:04.630 INFO:tasks.rados.rados.0.smithi137.stdout:1850: oid 17 updating version 0 to 651 2024-03-04T06:48:04.630 INFO:tasks.rados.rados.0.smithi137.stdout:1850: oid 17 updating version 651 to 652 2024-03-04T06:48:04.630 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 652 (ObjNum 607 snap 173 seq_num 607) dirty exists 2024-03-04T06:48:04.630 INFO:tasks.rados.rados.0.smithi137.stdout:1850: left oid 17 (ObjNum 607 snap 173 seq_num 607) 2024-03-04T06:48:04.630 INFO:tasks.rados.rados.0.smithi137.stdout:1844: done (5 left) 2024-03-04T06:48:04.630 INFO:tasks.rados.rados.0.smithi137.stdout:1845: done (4 left) 2024-03-04T06:48:04.630 INFO:tasks.rados.rados.0.smithi137.stdout:1846: done (3 left) 2024-03-04T06:48:04.630 INFO:tasks.rados.rados.0.smithi137.stdout:1848: done (2 left) 2024-03-04T06:48:04.630 INFO:tasks.rados.rados.0.smithi137.stdout:1849: done (1 left) 2024-03-04T06:48:04.630 INFO:tasks.rados.rados.0.smithi137.stdout:1850: done (0 left) 2024-03-04T06:48:04.631 INFO:tasks.rados.rados.0.smithi137.stdout:1851: copy_from oid 43 from oid 5 current snap is 173 2024-03-04T06:48:04.631 INFO:tasks.rados.rados.0.smithi137.stdout:1852: read oid 6 snap -1 2024-03-04T06:48:04.631 INFO:tasks.rados.rados.0.smithi137.stdout:1852: expect deleted 2024-03-04T06:48:04.631 INFO:tasks.rados.rados.0.smithi137.stdout:1853: snap_create 2024-03-04T06:48:04.647 INFO:tasks.rados.rados.0.smithi137.stdout:1851: finishing copy_from racing read to smithi13777483-43 2024-03-04T06:48:04.650 INFO:tasks.rados.rados.0.smithi137.stdout:1851: finishing copy_from to smithi13777483-43 2024-03-04T06:48:04.650 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 848 (ObjNum 461 snap 133 seq_num 461) dirty exists 2024-03-04T06:48:04.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-mon[91314]: osdmap e416: 8 total, 8 up, 8 in 2024-03-04T06:48:04.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:04.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:04.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:04.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:04.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-mon[91314]: pgmap v300: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 271 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.0 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2024-03-04T06:48:04.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:04.455+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:04.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-mon[88869]: osdmap e416: 8 total, 8 up, 8 in 2024-03-04T06:48:04.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:04.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:04.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:04.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:04.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-mon[88869]: pgmap v300: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 271 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.0 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2024-03-04T06:48:04.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:04.456+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:04.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:04.456+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:04.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:04.463+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:04.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:04 smithi203 ceph-mon[85573]: osdmap e416: 8 total, 8 up, 8 in 2024-03-04T06:48:04.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:04.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:04.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:04.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:04.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:04 smithi203 ceph-mon[85573]: pgmap v300: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 271 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.0 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2024-03-04T06:48:05.464 INFO:tasks.rados.rados.0.smithi137.stdout:1851: done (2 left) 2024-03-04T06:48:05.464 INFO:tasks.rados.rados.0.smithi137.stdout:1852: done (1 left) 2024-03-04T06:48:05.464 INFO:tasks.rados.rados.0.smithi137.stdout:1853: done (0 left) 2024-03-04T06:48:05.465 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 174 2024-03-04T06:48:05.465 INFO:tasks.rados.rados.0.smithi137.stdout:1854: seq_num 608 ranges {8626176=589824} 2024-03-04T06:48:05.513 INFO:tasks.rados.rados.0.smithi137.stdout:1854: writing smithi13777483-38 from 8626176 to 9216000 tid 1 2024-03-04T06:48:05.513 INFO:tasks.rados.rados.0.smithi137.stdout:1855: delete oid 14 current snap is 174 2024-03-04T06:48:05.516 INFO:tasks.rados.rados.0.smithi137.stdout:1855: done (1 left) 2024-03-04T06:48:05.516 INFO:tasks.rados.rados.0.smithi137.stdout:1856: rollback oid 48 current snap is 174 2024-03-04T06:48:05.516 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 48 to 156 2024-03-04T06:48:05.516 INFO:tasks.rados.rados.0.smithi137.stdout:1857: read oid 36 snap 173 2024-03-04T06:48:05.516 INFO:tasks.rados.rados.0.smithi137.stdout:1857: expect deleted 2024-03-04T06:48:05.516 INFO:tasks.rados.rados.0.smithi137.stdout:1858: setattr oid 27 current snap is 174 2024-03-04T06:48:05.518 INFO:tasks.rados.rados.0.smithi137.stdout:1859: read oid 21 snap -1 2024-03-04T06:48:05.518 INFO:tasks.rados.rados.0.smithi137.stdout:1859: expect (ObjNum 596 snap 170 seq_num 596) 2024-03-04T06:48:05.518 INFO:tasks.rados.rados.0.smithi137.stdout:1860: snap_remove snap 171 2024-03-04T06:48:05.581 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:05 smithi203 ceph-mon[85573]: osdmap e417: 8 total, 8 up, 8 in 2024-03-04T06:48:05.581 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:05.581 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:05.581 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:05.581 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:05.581 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:05 smithi203 ceph-mon[85573]: Upgrade: Updating osd.4 2024-03-04T06:48:05.581 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:05.581 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-04T06:48:05.582 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:48:05.582 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:05 smithi203 ceph-mon[85573]: Deploying daemon osd.4 on smithi203 2024-03-04T06:48:05.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:48:05] "GET /metrics HTTP/1.1" 200 36275 "" "Prometheus/2.43.0" 2024-03-04T06:48:05.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:05.521+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:05.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:05.535+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:05.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:05.518+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:05.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:05.518+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:05.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:05.519+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[88869]: osdmap e417: 8 total, 8 up, 8 in 2024-03-04T06:48:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[88869]: Upgrade: Updating osd.4 2024-03-04T06:48:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-04T06:48:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:48:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[88869]: Deploying daemon osd.4 on smithi203 2024-03-04T06:48:05.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[91314]: osdmap e417: 8 total, 8 up, 8 in 2024-03-04T06:48:05.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:05.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:05.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:05.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:05.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[91314]: Upgrade: Updating osd.4 2024-03-04T06:48:05.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:05.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-04T06:48:05.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:48:05.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:05 smithi137 ceph-mon[91314]: Deploying daemon osd.4 on smithi203 2024-03-04T06:48:06.472 INFO:tasks.rados.rados.0.smithi137.stdout:1856: finishing rollback tid 1 to smithi13777483-48 2024-03-04T06:48:06.472 INFO:tasks.rados.rados.0.smithi137.stdout:1856: finishing rollback tid 2 to smithi13777483-48 2024-03-04T06:48:06.472 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 15465 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:48:06.472 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16767 (ObjNum 532 snap 150 seq_num 532) dirty exists 2024-03-04T06:48:06.472 INFO:tasks.rados.rados.0.smithi137.stdout:1854: finishing write tid 1 to smithi13777483-38 2024-03-04T06:48:06.472 INFO:tasks.rados.rados.0.smithi137.stdout:1854: finishing write tid 2 to smithi13777483-38 2024-03-04T06:48:06.472 INFO:tasks.rados.rados.0.smithi137.stdout:1854: finishing write tid 3 to smithi13777483-38 2024-03-04T06:48:06.472 INFO:tasks.rados.rados.0.smithi137.stdout:1854: oid 38 updating version 0 to 15469 2024-03-04T06:48:06.472 INFO:tasks.rados.rados.0.smithi137.stdout:1854: oid 38 updating version 15469 to 15470 2024-03-04T06:48:06.472 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 15470 (ObjNum 608 snap 174 seq_num 608) dirty exists 2024-03-04T06:48:06.472 INFO:tasks.rados.rados.0.smithi137.stdout:1854: left oid 38 (ObjNum 608 snap 174 seq_num 608) 2024-03-04T06:48:06.473 INFO:tasks.rados.rados.0.smithi137.stdout:1859: expect (ObjNum 596 snap 170 seq_num 596) 2024-03-04T06:48:06.565 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:06 smithi203 ceph-mon[85573]: osdmap e418: 8 total, 8 up, 8 in 2024-03-04T06:48:06.565 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:06.565 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:06.565 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:06 smithi203 ceph-mon[85573]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:06.565 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:06 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:06.565 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:06 smithi203 ceph-mon[85573]: pgmap v303: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 282 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.0 MiB/s rd, 5.5 MiB/s wr, 13 op/s 2024-03-04T06:48:06.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:06.476+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:06.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:06.468+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:06.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-mon[88869]: osdmap e418: 8 total, 8 up, 8 in 2024-03-04T06:48:06.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:06.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:06.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-mon[88869]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:06.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:06.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-mon[88869]: pgmap v303: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 282 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.0 MiB/s rd, 5.5 MiB/s wr, 13 op/s 2024-03-04T06:48:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-mon[91314]: osdmap e418: 8 total, 8 up, 8 in 2024-03-04T06:48:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-mon[91314]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-mon[91314]: pgmap v303: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 282 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.0 MiB/s rd, 5.5 MiB/s wr, 13 op/s 2024-03-04T06:48:06.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:06.474+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:06.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:06.475+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:07.269 INFO:tasks.rados.rados.0.smithi137.stdout:1854: done (5 left) 2024-03-04T06:48:07.269 INFO:tasks.rados.rados.0.smithi137.stdout:1856: done (4 left) 2024-03-04T06:48:07.270 INFO:tasks.rados.rados.0.smithi137.stdout:1857: done (3 left) 2024-03-04T06:48:07.270 INFO:tasks.rados.rados.0.smithi137.stdout:1858: done (2 left) 2024-03-04T06:48:07.270 INFO:tasks.rados.rados.0.smithi137.stdout:1859: done (1 left) 2024-03-04T06:48:07.270 INFO:tasks.rados.rados.0.smithi137.stdout:1860: done (0 left) 2024-03-04T06:48:07.270 INFO:tasks.rados.rados.0.smithi137.stdout:1861: rollback oid 36 current snap is 174 2024-03-04T06:48:07.270 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 36 to 165 2024-03-04T06:48:07.270 INFO:tasks.rados.rados.0.smithi137.stdout:1862: read oid 33 snap -1 2024-03-04T06:48:07.270 INFO:tasks.rados.rados.0.smithi137.stdout:1862: expect deleted 2024-03-04T06:48:07.270 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 174 2024-03-04T06:48:07.270 INFO:tasks.rados.rados.0.smithi137.stdout:1863: seq_num 610 ranges {11698176=622592} 2024-03-04T06:48:07.335 INFO:tasks.rados.rados.0.smithi137.stdout:1863: writing smithi13777483-8 from 11698176 to 12320768 tid 1 2024-03-04T06:48:07.335 INFO:tasks.rados.rados.0.smithi137.stdout:1864: read oid 6 snap -1 2024-03-04T06:48:07.335 INFO:tasks.rados.rados.0.smithi137.stdout:1864: expect deleted 2024-03-04T06:48:07.335 INFO:tasks.rados.rados.0.smithi137.stdout:1865: read oid 35 snap 165 2024-03-04T06:48:07.335 INFO:tasks.rados.rados.0.smithi137.stdout:1865: expect (ObjNum 569 snap 159 seq_num 569) 2024-03-04T06:48:07.335 INFO:tasks.rados.rados.0.smithi137.stdout:1866: delete oid 49 current snap is 174 2024-03-04T06:48:07.335 INFO:tasks.rados.rados.0.smithi137.stdout:1861: finishing rollback tid 1 to smithi13777483-36 2024-03-04T06:48:07.336 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 341 (ObjNum 33 snap 0 seq_num 3130721840) dirty dne 2024-03-04T06:48:07.339 INFO:tasks.rados.rados.0.smithi137.stdout:1863: finishing write tid 1 to smithi13777483-8 2024-03-04T06:48:07.339 INFO:tasks.rados.rados.0.smithi137.stdout:1863: finishing write tid 2 to smithi13777483-8 2024-03-04T06:48:07.341 INFO:tasks.rados.rados.0.smithi137.stdout:1863: finishing write tid 3 to smithi13777483-8 2024-03-04T06:48:07.341 INFO:tasks.rados.rados.0.smithi137.stdout:1863: oid 8 updating version 0 to 16780 2024-03-04T06:48:07.341 INFO:tasks.rados.rados.0.smithi137.stdout:1863: oid 8 version 16780 is already newer than 16779 2024-03-04T06:48:07.341 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16780 (ObjNum 610 snap 174 seq_num 610) dirty exists 2024-03-04T06:48:07.341 INFO:tasks.rados.rados.0.smithi137.stdout:1863: left oid 8 (ObjNum 610 snap 174 seq_num 610) 2024-03-04T06:48:07.384 INFO:tasks.rados.rados.0.smithi137.stdout:1865: expect (ObjNum 569 snap 159 seq_num 569) 2024-03-04T06:48:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:07 smithi203 ceph-mon[85573]: osdmap e419: 8 total, 8 up, 8 in 2024-03-04T06:48:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:07.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:07.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:07 smithi137 ceph-mon[88869]: osdmap e419: 8 total, 8 up, 8 in 2024-03-04T06:48:07.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:07.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:07.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:07.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset e3=[]:{e3=[e3,e2,e0,df,de,dc,d9,d6]} for object 5:0ed1097c:::smithi13777483-11:d4 2024-03-04T06:48:07.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:07 smithi137 ceph-mon[91314]: osdmap e419: 8 total, 8 up, 8 in 2024-03-04T06:48:07.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:07.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:07.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset d6=[]:{ae=[ad,a8],b1=[b1,b0],be=[be],cb=[cb,c9,c8],d3=[d3,d2,d1,d0],d4=[d4],d6=[d6,d5]} for object 5:36653b08:::smithi13777483-25:a2 2024-03-04T06:48:08.215 INFO:tasks.rados.rados.0.smithi137.stdout:1861: done (5 left) 2024-03-04T06:48:08.215 INFO:tasks.rados.rados.0.smithi137.stdout:1862: done (4 left) 2024-03-04T06:48:08.216 INFO:tasks.rados.rados.0.smithi137.stdout:1863: done (3 left) 2024-03-04T06:48:08.216 INFO:tasks.rados.rados.0.smithi137.stdout:1864: done (2 left) 2024-03-04T06:48:08.216 INFO:tasks.rados.rados.0.smithi137.stdout:1865: done (1 left) 2024-03-04T06:48:08.216 INFO:tasks.rados.rados.0.smithi137.stdout:1866: done (0 left) 2024-03-04T06:48:08.216 INFO:tasks.rados.rados.0.smithi137.stdout:1867: rollback oid 4 current snap is 174 2024-03-04T06:48:08.216 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 4 to 172 2024-03-04T06:48:08.216 INFO:tasks.rados.rados.0.smithi137.stdout:1868: copy_from oid 50 from oid 47 current snap is 174 2024-03-04T06:48:08.216 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 174 2024-03-04T06:48:08.216 INFO:tasks.rados.rados.0.smithi137.stdout:1869: seq_num 612 ranges {0=655360} 2024-03-04T06:48:08.219 INFO:tasks.rados.rados.0.smithi137.stdout:1869: writing smithi13777483-14 from 0 to 655360 tid 1 2024-03-04T06:48:08.220 INFO:tasks.rados.rados.0.smithi137.stdout:1870: read oid 2 snap -1 2024-03-04T06:48:08.220 INFO:tasks.rados.rados.0.smithi137.stdout:1870: expect (ObjNum 555 snap 158 seq_num 555) 2024-03-04T06:48:08.220 INFO:tasks.rados.rados.0.smithi137.stdout:1871: rollback oid 39 current snap is 174 2024-03-04T06:48:08.220 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 39 to 156 2024-03-04T06:48:08.220 INFO:tasks.rados.rados.0.smithi137.stdout:1867: finishing rollback tid 0 to smithi13777483-4 2024-03-04T06:48:08.220 INFO:tasks.rados.rados.0.smithi137.stdout:1867: finishing rollback tid 1 to smithi13777483-4 2024-03-04T06:48:08.220 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 174 2024-03-04T06:48:08.220 INFO:tasks.rados.rados.0.smithi137.stdout:1872: seq_num 613 ranges {0=671744} 2024-03-04T06:48:08.224 INFO:tasks.rados.rados.0.smithi137.stdout:1872: writing smithi13777483-20 from 0 to 671744 tid 1 2024-03-04T06:48:08.224 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 174 2024-03-04T06:48:08.224 INFO:tasks.rados.rados.0.smithi137.stdout:1867: finishing rollback tid 2 to smithi13777483-4 2024-03-04T06:48:08.224 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 163 (ObjNum 567 snap 159 seq_num 567) dirty exists 2024-03-04T06:48:08.224 INFO:tasks.rados.rados.0.smithi137.stdout:1873: seq_num 614 ranges {0=688128} 2024-03-04T06:48:08.228 INFO:tasks.rados.rados.0.smithi137.stdout:1873: writing smithi13777483-9 from 0 to 688128 tid 1 2024-03-04T06:48:08.228 INFO:tasks.rados.rados.0.smithi137.stdout:1867: done (6 left) 2024-03-04T06:48:08.229 INFO:tasks.rados.rados.0.smithi137.stdout:1874: snap_create 2024-03-04T06:48:08.229 INFO:tasks.rados.rados.0.smithi137.stdout:1869: finishing write tid 1 to smithi13777483-14 2024-03-04T06:48:08.229 INFO:tasks.rados.rados.0.smithi137.stdout:1869: finishing write tid 2 to smithi13777483-14 2024-03-04T06:48:08.229 INFO:tasks.rados.rados.0.smithi137.stdout:1871: finishing rollback tid 0 to smithi13777483-39 2024-03-04T06:48:08.229 INFO:tasks.rados.rados.0.smithi137.stdout:1871: finishing rollback tid 1 to smithi13777483-39 2024-03-04T06:48:08.229 INFO:tasks.rados.rados.0.smithi137.stdout:1871: finishing rollback tid 2 to smithi13777483-39 2024-03-04T06:48:08.229 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 430 (ObjNum 526 snap 149 seq_num 526) dirty exists 2024-03-04T06:48:08.229 INFO:tasks.rados.rados.0.smithi137.stdout:1872: finishing write tid 1 to smithi13777483-20 2024-03-04T06:48:08.230 INFO:tasks.rados.rados.0.smithi137.stdout:1872: finishing write tid 2 to smithi13777483-20 2024-03-04T06:48:08.232 INFO:tasks.rados.rados.0.smithi137.stdout:1869: finishing write tid 3 to smithi13777483-14 2024-03-04T06:48:08.232 INFO:tasks.rados.rados.0.smithi137.stdout:1869: oid 14 updating version 0 to 954 2024-03-04T06:48:08.233 INFO:tasks.rados.rados.0.smithi137.stdout:1869: oid 14 version 954 is already newer than 953 2024-03-04T06:48:08.233 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 954 (ObjNum 612 snap 174 seq_num 612) dirty exists 2024-03-04T06:48:08.233 INFO:tasks.rados.rados.0.smithi137.stdout:1869: left oid 14 (ObjNum 612 snap 174 seq_num 612) 2024-03-04T06:48:08.233 INFO:tasks.rados.rados.0.smithi137.stdout:1872: finishing write tid 3 to smithi13777483-20 2024-03-04T06:48:08.233 INFO:tasks.rados.rados.0.smithi137.stdout:1872: oid 20 updating version 0 to 955 2024-03-04T06:48:08.233 INFO:tasks.rados.rados.0.smithi137.stdout:1872: oid 20 updating version 955 to 956 2024-03-04T06:48:08.233 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 956 (ObjNum 613 snap 174 seq_num 613) dirty exists 2024-03-04T06:48:08.233 INFO:tasks.rados.rados.0.smithi137.stdout:1872: left oid 20 (ObjNum 613 snap 174 seq_num 613) 2024-03-04T06:48:08.237 INFO:tasks.rados.rados.0.smithi137.stdout:1873: finishing write tid 1 to smithi13777483-9 2024-03-04T06:48:08.237 INFO:tasks.rados.rados.0.smithi137.stdout:1873: finishing write tid 2 to smithi13777483-9 2024-03-04T06:48:08.242 INFO:tasks.rados.rados.0.smithi137.stdout:1870: expect (ObjNum 555 snap 158 seq_num 555) 2024-03-04T06:48:08.254 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:07 smithi203 systemd[1]: Stopping Ceph osd.4 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:48:08.468 INFO:tasks.rados.rados.0.smithi137.stdout:1873: finishing write tid 3 to smithi13777483-9 2024-03-04T06:48:08.468 INFO:tasks.rados.rados.0.smithi137.stdout:1873: oid 9 updating version 0 to 885 2024-03-04T06:48:08.468 INFO:tasks.rados.rados.0.smithi137.stdout:1873: oid 9 version 885 is already newer than 884 2024-03-04T06:48:08.468 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 885 (ObjNum 614 snap 174 seq_num 614) dirty exists 2024-03-04T06:48:08.468 INFO:tasks.rados.rados.0.smithi137.stdout:1873: left oid 9 (ObjNum 614 snap 174 seq_num 614) 2024-03-04T06:48:08.468 INFO:tasks.rados.rados.0.smithi137.stdout:1868: finishing copy_from racing read to smithi13777483-50 2024-03-04T06:48:08.468 INFO:tasks.rados.rados.0.smithi137.stdout:1868: finishing copy_from to smithi13777483-50 2024-03-04T06:48:08.468 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 15468 (ObjNum 560 snap 159 seq_num 560) dirty exists 2024-03-04T06:48:08.478 INFO:tasks.rados.rados.0.smithi137.stdout:1868: done (6 left) 2024-03-04T06:48:08.478 INFO:tasks.rados.rados.0.smithi137.stdout:1869: done (5 left) 2024-03-04T06:48:08.478 INFO:tasks.rados.rados.0.smithi137.stdout:1870: done (4 left) 2024-03-04T06:48:08.478 INFO:tasks.rados.rados.0.smithi137.stdout:1871: done (3 left) 2024-03-04T06:48:08.478 INFO:tasks.rados.rados.0.smithi137.stdout:1872: done (2 left) 2024-03-04T06:48:08.478 INFO:tasks.rados.rados.0.smithi137.stdout:1873: done (1 left) 2024-03-04T06:48:08.478 INFO:tasks.rados.rados.0.smithi137.stdout:1874: done (0 left) 2024-03-04T06:48:08.478 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 175 2024-03-04T06:48:08.479 INFO:tasks.rados.rados.0.smithi137.stdout:1875: seq_num 615 ranges {0=704512} 2024-03-04T06:48:08.482 INFO:tasks.rados.rados.0.smithi137.stdout:1875: writing smithi13777483-49 from 0 to 704512 tid 1 2024-03-04T06:48:08.483 INFO:tasks.rados.rados.0.smithi137.stdout:1876: delete oid 40 current snap is 175 2024-03-04T06:48:08.489 INFO:tasks.rados.rados.0.smithi137.stdout:1875: finishing write tid 1 to smithi13777483-49 2024-03-04T06:48:08.489 INFO:tasks.rados.rados.0.smithi137.stdout:1875: finishing write tid 2 to smithi13777483-49 2024-03-04T06:48:08.491 INFO:tasks.rados.rados.0.smithi137.stdout:1875: finishing write tid 3 to smithi13777483-49 2024-03-04T06:48:08.491 INFO:tasks.rados.rados.0.smithi137.stdout:1875: oid 49 updating version 0 to 16765 2024-03-04T06:48:08.491 INFO:tasks.rados.rados.0.smithi137.stdout:1875: oid 49 updating version 16765 to 16766 2024-03-04T06:48:08.491 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16766 (ObjNum 615 snap 175 seq_num 615) dirty exists 2024-03-04T06:48:08.491 INFO:tasks.rados.rados.0.smithi137.stdout:1875: left oid 49 (ObjNum 615 snap 175 seq_num 615) 2024-03-04T06:48:08.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:08 smithi203 ceph-mon[85573]: osd.4 marked itself down and dead 2024-03-04T06:48:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:08 smithi203 ceph-mon[85573]: pgmap v305: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 287 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 6.4 MiB/s wr, 15 op/s 2024-03-04T06:48:08.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:48:08.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[35700]: 2024-03-04T06:48:08.252+0000 7fcd25582700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:48:08.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[35700]: 2024-03-04T06:48:08.252+0000 7fcd25582700 -1 osd.4 419 *** Got signal Terminated *** 2024-03-04T06:48:08.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[35700]: 2024-03-04T06:48:08.252+0000 7fcd25582700 -1 osd.4 419 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T06:48:08.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:08.487+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:08.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:08 smithi137 ceph-mon[88869]: osd.4 marked itself down and dead 2024-03-04T06:48:08.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:08 smithi137 ceph-mon[88869]: pgmap v305: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 287 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 6.4 MiB/s wr, 15 op/s 2024-03-04T06:48:08.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:48:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:08 smithi137 ceph-mon[91314]: osd.4 marked itself down and dead 2024-03-04T06:48:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:08 smithi137 ceph-mon[91314]: pgmap v305: 121 pgs: 4 active+clean+snaptrim_error, 117 active+clean; 287 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 6.4 MiB/s wr, 15 op/s 2024-03-04T06:48:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:48:09.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:09 smithi203 podman[90600]: 2024-03-04 06:48:09.057998226 +0000 UTC m=+0.918049118 container died d4841ffd0747762476d172bae1dbdc9972b38d8b4f567f892862026ce2bcb86c (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-5cc7a76, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-03-04T06:48:09.501 INFO:tasks.rados.rados.0.smithi137.stdout:1875: done (1 left) 2024-03-04T06:48:09.501 INFO:tasks.rados.rados.0.smithi137.stdout:1876: done (0 left) 2024-03-04T06:48:09.501 INFO:tasks.rados.rados.0.smithi137.stdout:1877: read oid 15 snap 166 2024-03-04T06:48:09.501 INFO:tasks.rados.rados.0.smithi137.stdout:1877: expect deleted 2024-03-04T06:48:09.501 INFO:tasks.rados.rados.0.smithi137.stdout:1878: rollback oid 50 current snap is 175 2024-03-04T06:48:09.501 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 50 to 165 2024-03-04T06:48:09.501 INFO:tasks.rados.rados.0.smithi137.stdout:1879: read oid 9 snap -1 2024-03-04T06:48:09.501 INFO:tasks.rados.rados.0.smithi137.stdout:1879: expect (ObjNum 614 snap 174 seq_num 614) 2024-03-04T06:48:09.501 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 175 2024-03-04T06:48:09.501 INFO:tasks.rados.rados.0.smithi137.stdout:1880: seq_num 617 ranges {8626176=737280} 2024-03-04T06:48:09.551 INFO:tasks.rados.rados.0.smithi137.stdout:1880: writing smithi13777483-16 from 8626176 to 9363456 tid 1 2024-03-04T06:48:09.551 INFO:tasks.rados.rados.0.smithi137.stdout:1881: read oid 5 snap -1 2024-03-04T06:48:09.551 INFO:tasks.rados.rados.0.smithi137.stdout:1881: expect (ObjNum 461 snap 133 seq_num 461) 2024-03-04T06:48:09.551 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 175 2024-03-04T06:48:09.551 INFO:tasks.rados.rados.0.smithi137.stdout:1879: expect (ObjNum 614 snap 174 seq_num 614) 2024-03-04T06:48:09.571 INFO:tasks.rados.rados.0.smithi137.stdout:1878: finishing rollback tid 0 to smithi13777483-50 2024-03-04T06:48:09.571 INFO:tasks.rados.rados.0.smithi137.stdout:1878: finishing rollback tid 1 to smithi13777483-50 2024-03-04T06:48:09.571 INFO:tasks.rados.rados.0.smithi137.stdout:1878: finishing rollback tid 2 to smithi13777483-50 2024-03-04T06:48:09.571 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 16770 (ObjNum 335 snap 106 seq_num 335) dirty exists 2024-03-04T06:48:09.572 INFO:tasks.rados.rados.0.smithi137.stdout:1882: seq_num 618 ranges {6643712=753664} 2024-03-04T06:48:09.611 INFO:tasks.rados.rados.0.smithi137.stdout:1882: writing smithi13777483-23 from 6643712 to 7397376 tid 1 2024-03-04T06:48:09.611 INFO:tasks.rados.rados.0.smithi137.stdout:1877: done (5 left) 2024-03-04T06:48:09.611 INFO:tasks.rados.rados.0.smithi137.stdout:1878: done (4 left) 2024-03-04T06:48:09.611 INFO:tasks.rados.rados.0.smithi137.stdout:1879: done (3 left) 2024-03-04T06:48:09.611 INFO:tasks.rados.rados.0.smithi137.stdout:1883: rollback oid 38 current snap is 175 2024-03-04T06:48:09.611 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 38 to 173 2024-03-04T06:48:09.611 INFO:tasks.rados.rados.0.smithi137.stdout:1880: finishing write tid 1 to smithi13777483-16 2024-03-04T06:48:09.611 INFO:tasks.rados.rados.0.smithi137.stdout:1880: finishing write tid 2 to smithi13777483-16 2024-03-04T06:48:09.611 INFO:tasks.rados.rados.0.smithi137.stdout:1881: expect (ObjNum 461 snap 133 seq_num 461) 2024-03-04T06:48:09.662 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:09 smithi203 ceph-mon[85573]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:48:09.662 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:09 smithi203 ceph-mon[85573]: osdmap e420: 8 total, 7 up, 8 in 2024-03-04T06:48:09.662 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:09.662 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:09 smithi203 podman[90600]: 2024-03-04 06:48:09.436012493 +0000 UTC m=+1.296063385 container cleanup d4841ffd0747762476d172bae1dbdc9972b38d8b4f567f892862026ce2bcb86c (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=reef-5cc7a76, org.label-schema.build-date=20240222, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-04T06:48:09.663 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:09 smithi203 bash[90600]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4 2024-03-04T06:48:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:09 smithi137 ceph-mon[88869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:48:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:09 smithi137 ceph-mon[88869]: osdmap e420: 8 total, 7 up, 8 in 2024-03-04T06:48:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:09 smithi137 ceph-mon[91314]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:48:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:09 smithi137 ceph-mon[91314]: osdmap e420: 8 total, 7 up, 8 in 2024-03-04T06:48:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:09.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:09.493+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:09.807 INFO:tasks.rados.rados.0.smithi137.stdout:1880: finishing write tid 3 to smithi13777483-16 2024-03-04T06:48:09.807 INFO:tasks.rados.rados.0.smithi137.stdout:1880: oid 16 updating version 0 to 16770 2024-03-04T06:48:09.807 INFO:tasks.rados.rados.0.smithi137.stdout:1880: oid 16 version 16770 is already newer than 16769 2024-03-04T06:48:09.807 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16770 (ObjNum 617 snap 175 seq_num 617) dirty exists 2024-03-04T06:48:09.807 INFO:tasks.rados.rados.0.smithi137.stdout:1880: left oid 16 (ObjNum 617 snap 175 seq_num 617) 2024-03-04T06:48:09.807 INFO:tasks.rados.rados.0.smithi137.stdout:1880: done (3 left) 2024-03-04T06:48:09.807 INFO:tasks.rados.rados.0.smithi137.stdout:1881: done (2 left) 2024-03-04T06:48:09.807 INFO:tasks.rados.rados.0.smithi137.stdout:1884: delete oid 37 current snap is 175 2024-03-04T06:48:09.807 INFO:tasks.rados.rados.0.smithi137.stdout:1882: finishing write tid 1 to smithi13777483-23 2024-03-04T06:48:09.807 INFO:tasks.rados.rados.0.smithi137.stdout:1882: finishing write tid 2 to smithi13777483-23 2024-03-04T06:48:09.808 INFO:tasks.rados.rados.0.smithi137.stdout:1883: finishing rollback tid 0 to smithi13777483-38 2024-03-04T06:48:09.808 INFO:tasks.rados.rados.0.smithi137.stdout:1883: finishing rollback tid 1 to smithi13777483-38 2024-03-04T06:48:09.808 INFO:tasks.rados.rados.0.smithi137.stdout:1883: finishing rollback tid 2 to smithi13777483-38 2024-03-04T06:48:09.808 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 15473 (ObjNum 419 snap 125 seq_num 419) dirty exists 2024-03-04T06:48:09.808 INFO:tasks.rados.rados.0.smithi137.stdout:1882: finishing write tid 3 to smithi13777483-23 2024-03-04T06:48:09.808 INFO:tasks.rados.rados.0.smithi137.stdout:1882: oid 23 updating version 0 to 957 2024-03-04T06:48:09.808 INFO:tasks.rados.rados.0.smithi137.stdout:1882: oid 23 updating version 957 to 958 2024-03-04T06:48:09.808 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 958 (ObjNum 618 snap 175 seq_num 618) dirty exists 2024-03-04T06:48:09.808 INFO:tasks.rados.rados.0.smithi137.stdout:1882: left oid 23 (ObjNum 618 snap 175 seq_num 618) 2024-03-04T06:48:09.810 INFO:tasks.rados.rados.0.smithi137.stdout:1882: done (2 left) 2024-03-04T06:48:09.810 INFO:tasks.rados.rados.0.smithi137.stdout:1883: done (1 left) 2024-03-04T06:48:09.810 INFO:tasks.rados.rados.0.smithi137.stdout:1884: done (0 left) 2024-03-04T06:48:09.810 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 175 2024-03-04T06:48:09.810 INFO:tasks.rados.rados.0.smithi137.stdout:1885: seq_num 620 ranges {1548288=794624} 2024-03-04T06:48:09.822 INFO:tasks.rados.rados.0.smithi137.stdout:1885: writing smithi13777483-7 from 1548288 to 2342912 tid 1 2024-03-04T06:48:09.822 INFO:tasks.rados.rados.0.smithi137.stdout:1886: rollback oid 20 current snap is 175 2024-03-04T06:48:09.823 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 20 to 166 2024-03-04T06:48:09.823 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 175 2024-03-04T06:48:09.823 INFO:tasks.rados.rados.0.smithi137.stdout:1887: seq_num 621 ranges {6086656=409600,6496256=401408} 2024-03-04T06:48:09.857 INFO:tasks.rados.rados.0.smithi137.stdout:1887: writing smithi13777483-11 from 6086656 to 6496256 tid 1 2024-03-04T06:48:09.859 INFO:tasks.rados.rados.0.smithi137.stdout:1887: writing smithi13777483-11 from 6496256 to 6897664 tid 2 2024-03-04T06:48:09.859 INFO:tasks.rados.rados.0.smithi137.stdout:1888: rollback oid 44 current snap is 175 2024-03-04T06:48:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 44 to 168 2024-03-04T06:48:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:1886: finishing rollback tid 0 to smithi13777483-20 2024-03-04T06:48:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:1886: finishing rollback tid 1 to smithi13777483-20 2024-03-04T06:48:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 960 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-04T06:48:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:1885: finishing write tid 1 to smithi13777483-7 2024-03-04T06:48:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:1885: finishing write tid 2 to smithi13777483-7 2024-03-04T06:48:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:1885: finishing write tid 3 to smithi13777483-7 2024-03-04T06:48:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:1885: oid 7 updating version 0 to 16781 2024-03-04T06:48:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:1885: oid 7 updating version 16781 to 16782 2024-03-04T06:48:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16782 (ObjNum 620 snap 175 seq_num 620) dirty exists 2024-03-04T06:48:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:1885: left oid 7 (ObjNum 620 snap 175 seq_num 620) 2024-03-04T06:48:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:1885: done (3 left) 2024-03-04T06:48:09.860 INFO:tasks.rados.rados.0.smithi137.stdout:1886: done (2 left) 2024-03-04T06:48:09.861 INFO:tasks.rados.rados.0.smithi137.stdout:1889: snap_create 2024-03-04T06:48:09.862 INFO:tasks.rados.rados.0.smithi137.stdout:1887: finishing write tid 1 to smithi13777483-11 2024-03-04T06:48:09.862 INFO:tasks.rados.rados.0.smithi137.stdout:1887: finishing write tid 2 to smithi13777483-11 2024-03-04T06:48:09.862 INFO:tasks.rados.rados.0.smithi137.stdout:1887: finishing write tid 3 to smithi13777483-11 2024-03-04T06:48:09.864 INFO:tasks.rados.rados.0.smithi137.stdout:1887: finishing write tid 4 to smithi13777483-11 2024-03-04T06:48:09.864 INFO:tasks.rados.rados.0.smithi137.stdout:1887: oid 11 updating version 0 to 16785 2024-03-04T06:48:09.864 INFO:tasks.rados.rados.0.smithi137.stdout:1887: oid 11 version 16785 is already newer than 16784 2024-03-04T06:48:09.864 INFO:tasks.rados.rados.0.smithi137.stdout:1887: oid 11 version 16785 is already newer than 16783 2024-03-04T06:48:09.865 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16785 (ObjNum 621 snap 175 seq_num 621) dirty exists 2024-03-04T06:48:09.865 INFO:tasks.rados.rados.0.smithi137.stdout:1887: left oid 11 (ObjNum 621 snap 175 seq_num 621) 2024-03-04T06:48:09.868 INFO:tasks.rados.rados.0.smithi137.stdout:1888: finishing rollback tid 0 to smithi13777483-44 2024-03-04T06:48:09.868 INFO:tasks.rados.rados.0.smithi137.stdout:1888: finishing rollback tid 1 to smithi13777483-44 2024-03-04T06:48:09.869 INFO:tasks.rados.rados.0.smithi137.stdout:1888: finishing rollback tid 2 to smithi13777483-44 2024-03-04T06:48:09.869 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16774 (ObjNum 571 snap 159 seq_num 571) dirty exists 2024-03-04T06:48:09.988 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:09 smithi203 podman[90627]: 2024-03-04 06:48:09.662731514 +0000 UTC m=+0.599975003 container remove d4841ffd0747762476d172bae1dbdc9972b38d8b4f567f892862026ce2bcb86c (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, RELEASE=reef-5cc7a76, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T06:48:10.257 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:09 smithi203 podman[90716]: 2024-03-04 06:48:09.988763301 +0000 UTC m=+0.114360748 container create ec34b79300c9a9613ddd56ad969daba8ad53d4895cb49cadf66c6094bb76d792 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240222) 2024-03-04T06:48:10.257 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:09 smithi203 podman[90716]: 2024-03-04 06:48:09.892140284 +0000 UTC m=+0.017737738 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:48:10.257 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:10 smithi203 podman[90716]: 2024-03-04 06:48:10.175363169 +0000 UTC m=+0.300960629 container init ec34b79300c9a9613ddd56ad969daba8ad53d4895cb49cadf66c6094bb76d792 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2) 2024-03-04T06:48:10.257 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:10 smithi203 podman[90716]: 2024-03-04 06:48:10.179125477 +0000 UTC m=+0.304722930 container start ec34b79300c9a9613ddd56ad969daba8ad53d4895cb49cadf66c6094bb76d792 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-03-04T06:48:10.257 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:10 smithi203 podman[90716]: 2024-03-04 06:48:10.257501357 +0000 UTC m=+0.383098808 container attach ec34b79300c9a9613ddd56ad969daba8ad53d4895cb49cadf66c6094bb76d792 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T06:48:10.492 INFO:tasks.rados.rados.0.smithi137.stdout:1887: done (2 left) 2024-03-04T06:48:10.493 INFO:tasks.rados.rados.0.smithi137.stdout:1888: done (1 left) 2024-03-04T06:48:10.493 INFO:tasks.rados.rados.0.smithi137.stdout:1889: done (0 left) 2024-03-04T06:48:10.493 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 50 current snap is 176 2024-03-04T06:48:10.493 INFO:tasks.rados.rados.0.smithi137.stdout:1890: seq_num 622 ranges {958464=425984,1384448=401408} 2024-03-04T06:48:10.500 INFO:tasks.rados.rados.0.smithi137.stdout:1890: writing smithi13777483-50 from 958464 to 1384448 tid 1 2024-03-04T06:48:10.503 INFO:tasks.rados.rados.0.smithi137.stdout:1890: writing smithi13777483-50 from 1384448 to 1785856 tid 2 2024-03-04T06:48:10.503 INFO:tasks.rados.rados.0.smithi137.stdout:1891: read oid 28 snap 168 2024-03-04T06:48:10.503 INFO:tasks.rados.rados.0.smithi137.stdout:1891: expect (ObjNum 407 snap 122 seq_num 407) 2024-03-04T06:48:10.503 INFO:tasks.rados.rados.0.smithi137.stdout:1892: setattr oid 14 current snap is 176 2024-03-04T06:48:10.504 INFO:tasks.rados.rados.0.smithi137.stdout:1893: rollback oid 47 current snap is 176 2024-03-04T06:48:10.505 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 47 to 173 2024-03-04T06:48:10.505 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 176 2024-03-04T06:48:10.505 INFO:tasks.rados.rados.0.smithi137.stdout:1894: seq_num 623 ranges {6897664=442368,7340032=401408} 2024-03-04T06:48:10.545 INFO:tasks.rados.rados.0.smithi137.stdout:1894: writing smithi13777483-11 from 6897664 to 7340032 tid 1 2024-03-04T06:48:10.547 INFO:tasks.rados.rados.0.smithi137.stdout:1894: writing smithi13777483-11 from 7340032 to 7741440 tid 2 2024-03-04T06:48:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:1895: copy_from oid 23 from oid 43 current snap is 176 2024-03-04T06:48:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:1890: finishing write tid 1 to smithi13777483-50 2024-03-04T06:48:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:1890: finishing write tid 2 to smithi13777483-50 2024-03-04T06:48:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 176 2024-03-04T06:48:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 961 (ObjNum 612 snap 174 seq_num 612) dirty exists 2024-03-04T06:48:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:1890: finishing write tid 3 to smithi13777483-50 2024-03-04T06:48:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:1890: finishing write tid 4 to smithi13777483-50 2024-03-04T06:48:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:1890: oid 50 updating version 0 to 16773 2024-03-04T06:48:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:1890: oid 50 version 16773 is already newer than 16771 2024-03-04T06:48:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:1890: oid 50 version 16773 is already newer than 16772 2024-03-04T06:48:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 16773 (ObjNum 622 snap 176 seq_num 622) dirty exists 2024-03-04T06:48:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:1890: left oid 50 (ObjNum 622 snap 176 seq_num 622) 2024-03-04T06:48:10.548 INFO:tasks.rados.rados.0.smithi137.stdout:1896: seq_num 624 ranges {0=458752,458752=401408} 2024-03-04T06:48:10.550 INFO:tasks.rados.rados.0.smithi137.stdout:1896: writing smithi13777483-42 from 0 to 458752 tid 1 2024-03-04T06:48:10.552 INFO:tasks.rados.rados.0.smithi137.stdout:1896: writing smithi13777483-42 from 458752 to 860160 tid 2 2024-03-04T06:48:10.552 INFO:tasks.rados.rados.0.smithi137.stdout:1893: finishing rollback tid 0 to smithi13777483-47 2024-03-04T06:48:10.553 INFO:tasks.rados.rados.0.smithi137.stdout:1893: finishing rollback tid 1 to smithi13777483-47 2024-03-04T06:48:10.553 INFO:tasks.rados.rados.0.smithi137.stdout:1890: done (6 left) 2024-03-04T06:48:10.553 INFO:tasks.rados.rados.0.smithi137.stdout:1892: done (5 left) 2024-03-04T06:48:10.553 INFO:tasks.rados.rados.0.smithi137.stdout:1897: snap_remove snap 156 2024-03-04T06:48:10.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:10 smithi203 podman[90716]: 2024-03-04 06:48:10.483005936 +0000 UTC m=+0.608603386 container died ec34b79300c9a9613ddd56ad969daba8ad53d4895cb49cadf66c6094bb76d792 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T06:48:10.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:10 smithi203 ceph-mon[85573]: osdmap e421: 8 total, 7 up, 8 in 2024-03-04T06:48:10.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:10.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:10 smithi203 ceph-mon[85573]: pgmap v308: 121 pgs: 1 active+undersized+degraded, 87 active+clean, 4 active+undersized, 3 active+clean+snaptrim_error, 4 stale+active+clean, 21 peering, 1 active+undersized+degraded+snaptrim_error; 303 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 3.9 MiB/s wr, 18 op/s; 19/513 objects degraded (3.704%) 2024-03-04T06:48:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:10 smithi137 ceph-mon[88869]: osdmap e421: 8 total, 7 up, 8 in 2024-03-04T06:48:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:10 smithi137 ceph-mon[88869]: pgmap v308: 121 pgs: 1 active+undersized+degraded, 87 active+clean, 4 active+undersized, 3 active+clean+snaptrim_error, 4 stale+active+clean, 21 peering, 1 active+undersized+degraded+snaptrim_error; 303 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 3.9 MiB/s wr, 18 op/s; 19/513 objects degraded (3.704%) 2024-03-04T06:48:10.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:10 smithi137 ceph-mon[91314]: osdmap e421: 8 total, 7 up, 8 in 2024-03-04T06:48:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:10 smithi137 ceph-mon[91314]: pgmap v308: 121 pgs: 1 active+undersized+degraded, 87 active+clean, 4 active+undersized, 3 active+clean+snaptrim_error, 4 stale+active+clean, 21 peering, 1 active+undersized+degraded+snaptrim_error; 303 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 3.9 MiB/s wr, 18 op/s; 19/513 objects degraded (3.704%) 2024-03-04T06:48:10.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:10.508+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:11.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:11 smithi203 podman[90742]: 2024-03-04 06:48:11.053209155 +0000 UTC m=+0.564425694 container remove ec34b79300c9a9613ddd56ad969daba8ad53d4895cb49cadf66c6094bb76d792 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:48:11.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:11 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.4.service: Deactivated successfully. 2024-03-04T06:48:11.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:11 smithi203 systemd[1]: Stopped Ceph osd.4 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:48:11.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:11 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.4.service: Consumed 14.765s CPU time. 2024-03-04T06:48:11.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:11 smithi203 systemd[1]: Starting Ceph osd.4 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:48:11.497 INFO:tasks.rados.rados.0.smithi137.stdout:1893: finishing rollback tid 2 to smithi13777483-47 2024-03-04T06:48:11.497 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 15476 (ObjNum 560 snap 159 seq_num 560) dirty exists 2024-03-04T06:48:11.497 INFO:tasks.rados.rados.0.smithi137.stdout:1891: expect (ObjNum 407 snap 122 seq_num 407) 2024-03-04T06:48:11.559 INFO:tasks.rados.rados.0.smithi137.stdout:1894: finishing write tid 1 to smithi13777483-11 2024-03-04T06:48:11.559 INFO:tasks.rados.rados.0.smithi137.stdout:1894: finishing write tid 2 to smithi13777483-11 2024-03-04T06:48:11.559 INFO:tasks.rados.rados.0.smithi137.stdout:1894: finishing write tid 3 to smithi13777483-11 2024-03-04T06:48:11.560 INFO:tasks.rados.rados.0.smithi137.stdout:1894: finishing write tid 4 to smithi13777483-11 2024-03-04T06:48:11.560 INFO:tasks.rados.rados.0.smithi137.stdout:1894: oid 11 updating version 0 to 16787 2024-03-04T06:48:11.560 INFO:tasks.rados.rados.0.smithi137.stdout:1894: oid 11 updating version 16787 to 16788 2024-03-04T06:48:11.560 INFO:tasks.rados.rados.0.smithi137.stdout:1894: oid 11 version 16788 is already newer than 16786 2024-03-04T06:48:11.560 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16788 (ObjNum 623 snap 176 seq_num 623) dirty exists 2024-03-04T06:48:11.560 INFO:tasks.rados.rados.0.smithi137.stdout:1894: left oid 11 (ObjNum 623 snap 176 seq_num 623) 2024-03-04T06:48:11.560 INFO:tasks.rados.rados.0.smithi137.stdout:1896: finishing write tid 1 to smithi13777483-42 2024-03-04T06:48:11.560 INFO:tasks.rados.rados.0.smithi137.stdout:1896: finishing write tid 2 to smithi13777483-42 2024-03-04T06:48:11.560 INFO:tasks.rados.rados.0.smithi137.stdout:1891: done (5 left) 2024-03-04T06:48:11.560 INFO:tasks.rados.rados.0.smithi137.stdout:1893: done (4 left) 2024-03-04T06:48:11.560 INFO:tasks.rados.rados.0.smithi137.stdout:1894: done (3 left) 2024-03-04T06:48:11.560 INFO:tasks.rados.rados.0.smithi137.stdout:1897: done (2 left) 2024-03-04T06:48:11.560 INFO:tasks.rados.rados.0.smithi137.stdout:1898: snap_remove snap 172 2024-03-04T06:48:11.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:11.502+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:11.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:11 smithi137 ceph-mon[88869]: Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-03-04T06:48:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:11 smithi137 ceph-mon[88869]: Health check failed: Degraded data redundancy: 19/513 objects degraded (3.704%), 2 pgs degraded (PG_DEGRADED) 2024-03-04T06:48:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:11 smithi137 ceph-mon[88869]: osdmap e422: 8 total, 7 up, 8 in 2024-03-04T06:48:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:11 smithi137 ceph-mon[91314]: Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-03-04T06:48:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:11 smithi137 ceph-mon[91314]: Health check failed: Degraded data redundancy: 19/513 objects degraded (3.704%), 2 pgs degraded (PG_DEGRADED) 2024-03-04T06:48:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:11 smithi137 ceph-mon[91314]: osdmap e422: 8 total, 7 up, 8 in 2024-03-04T06:48:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:11.815 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:11 smithi203 ceph-mon[85573]: Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-03-04T06:48:11.815 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:11 smithi203 ceph-mon[85573]: Health check failed: Degraded data redundancy: 19/513 objects degraded (3.704%), 2 pgs degraded (PG_DEGRADED) 2024-03-04T06:48:11.815 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:11 smithi203 ceph-mon[85573]: osdmap e422: 8 total, 7 up, 8 in 2024-03-04T06:48:11.815 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:11.816 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:11 smithi203 podman[90846]: 2024-03-04 06:48:11.389029547 +0000 UTC m=+0.018368283 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:48:11.816 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:11 smithi203 podman[90846]: 2024-03-04 06:48:11.561402748 +0000 UTC m=+0.190741466 container create d25e7f0ccd0f64215ead76a114bce6ca06575b85150fd09b26b763bba0f89b61 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-activate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:48:12.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:11 smithi203 podman[90846]: 2024-03-04 06:48:11.81549358 +0000 UTC m=+0.444832304 container init d25e7f0ccd0f64215ead76a114bce6ca06575b85150fd09b26b763bba0f89b61 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-activate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222) 2024-03-04T06:48:12.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:11 smithi203 podman[90846]: 2024-03-04 06:48:11.818898493 +0000 UTC m=+0.448237222 container start d25e7f0ccd0f64215ead76a114bce6ca06575b85150fd09b26b763bba0f89b61 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T06:48:12.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:11 smithi203 podman[90846]: 2024-03-04 06:48:11.915258656 +0000 UTC m=+0.544597382 container attach d25e7f0ccd0f64215ead76a114bce6ca06575b85150fd09b26b763bba0f89b61 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-activate, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5) 2024-03-04T06:48:12.509 INFO:tasks.rados.rados.0.smithi137.stdout:1898: done (2 left) 2024-03-04T06:48:12.509 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 176 2024-03-04T06:48:12.509 INFO:tasks.rados.rados.0.smithi137.stdout:1899: seq_num 625 ranges {0=475136,475136=401408} 2024-03-04T06:48:12.512 INFO:tasks.rados.rados.0.smithi137.stdout:1899: writing smithi13777483-32 from 0 to 475136 tid 1 2024-03-04T06:48:12.515 INFO:tasks.rados.rados.0.smithi137.stdout:1899: writing smithi13777483-32 from 475136 to 876544 tid 2 2024-03-04T06:48:12.515 INFO:tasks.rados.rados.0.smithi137.stdout:1900: setattr oid 14 current snap is 176 2024-03-04T06:48:12.515 INFO:tasks.rados.rados.0.smithi137.stdout:1896: finishing write tid 3 to smithi13777483-42 2024-03-04T06:48:12.515 INFO:tasks.rados.rados.0.smithi137.stdout:1896: finishing write tid 4 to smithi13777483-42 2024-03-04T06:48:12.515 INFO:tasks.rados.rados.0.smithi137.stdout:1896: oid 42 updating version 0 to 16775 2024-03-04T06:48:12.515 INFO:tasks.rados.rados.0.smithi137.stdout:1896: oid 42 version 16775 is already newer than 16774 2024-03-04T06:48:12.515 INFO:tasks.rados.rados.0.smithi137.stdout:1896: oid 42 updating version 16775 to 16776 2024-03-04T06:48:12.515 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16776 (ObjNum 624 snap 176 seq_num 624) dirty exists 2024-03-04T06:48:12.516 INFO:tasks.rados.rados.0.smithi137.stdout:1896: left oid 42 (ObjNum 624 snap 176 seq_num 624) 2024-03-04T06:48:12.516 INFO:tasks.rados.rados.0.smithi137.stdout:1895: finishing copy_from racing read to smithi13777483-23 2024-03-04T06:48:12.516 INFO:tasks.rados.rados.0.smithi137.stdout:1895: finishing copy_from to smithi13777483-23 2024-03-04T06:48:12.516 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 848 (ObjNum 461 snap 133 seq_num 461) dirty exists 2024-03-04T06:48:12.516 INFO:tasks.rados.rados.0.smithi137.stdout:1899: finishing write tid 1 to smithi13777483-32 2024-03-04T06:48:12.517 INFO:tasks.rados.rados.0.smithi137.stdout:1895: done (3 left) 2024-03-04T06:48:12.517 INFO:tasks.rados.rados.0.smithi137.stdout:1896: done (2 left) 2024-03-04T06:48:12.517 INFO:tasks.rados.rados.0.smithi137.stdout:1901: rollback oid 11 current snap is 176 2024-03-04T06:48:12.517 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 11 to 175 2024-03-04T06:48:12.517 INFO:tasks.rados.rados.0.smithi137.stdout:1902: read oid 47 snap -1 2024-03-04T06:48:12.517 INFO:tasks.rados.rados.0.smithi137.stdout:1902: expect (ObjNum 560 snap 159 seq_num 560) 2024-03-04T06:48:12.517 INFO:tasks.rados.rados.0.smithi137.stdout:1903: read oid 50 snap -1 2024-03-04T06:48:12.518 INFO:tasks.rados.rados.0.smithi137.stdout:1903: expect (ObjNum 622 snap 176 seq_num 622) 2024-03-04T06:48:12.518 INFO:tasks.rados.rados.0.smithi137.stdout:1904: copy_from oid 10 from oid 3 current snap is 176 2024-03-04T06:48:12.518 INFO:tasks.rados.rados.0.smithi137.stdout:1905: copy_from oid 30 from oid 5 current snap is 176 2024-03-04T06:48:12.518 INFO:tasks.rados.rados.0.smithi137.stdout:1906: read oid 9 snap 165 2024-03-04T06:48:12.518 INFO:tasks.rados.rados.0.smithi137.stdout:1906: expect deleted 2024-03-04T06:48:12.518 INFO:tasks.rados.rados.0.smithi137.stdout:1907: snap_remove snap 174 2024-03-04T06:48:12.551 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:12 smithi203 ceph-mon[85573]: osdmap e423: 8 total, 7 up, 8 in 2024-03-04T06:48:12.552 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:12.552 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:12 smithi203 ceph-mon[85573]: pgmap v311: 121 pgs: 1 active+undersized+degraded, 87 active+clean, 4 active+undersized, 3 active+clean+snaptrim_error, 4 stale+active+clean, 21 peering, 1 active+undersized+degraded+snaptrim_error; 303 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 2.2 MiB/s wr, 7 op/s; 19/513 objects degraded (3.704%) 2024-03-04T06:48:12.552 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-activate[90861]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-04T06:48:12.552 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-activate[90861]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-04T06:48:12.552 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 bash[90846]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-04T06:48:12.552 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 bash[90846]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-04T06:48:12.552 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 bash[90846]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-04T06:48:12.552 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 bash[90846]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-04T06:48:12.552 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 bash[90846]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-03-04T06:48:12.552 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 bash[90846]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-04T06:48:12.553 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 bash[90846]: --> ceph-volume raw activate successful for osd ID: 4 2024-03-04T06:48:12.553 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-activate[90861]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-04T06:48:12.553 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-activate[90861]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-04T06:48:12.553 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-activate[90861]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-03-04T06:48:12.553 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-activate[90861]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-04T06:48:12.553 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-activate[90861]: --> ceph-volume raw activate successful for osd ID: 4 2024-03-04T06:48:12.553 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 podman[90846]: 2024-03-04 06:48:12.291243537 +0000 UTC m=+0.920582264 container died d25e7f0ccd0f64215ead76a114bce6ca06575b85150fd09b26b763bba0f89b61 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-activate, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux ) 2024-03-04T06:48:12.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:12 smithi137 ceph-mon[88869]: osdmap e423: 8 total, 7 up, 8 in 2024-03-04T06:48:12.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:12.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:12 smithi137 ceph-mon[88869]: pgmap v311: 121 pgs: 1 active+undersized+degraded, 87 active+clean, 4 active+undersized, 3 active+clean+snaptrim_error, 4 stale+active+clean, 21 peering, 1 active+undersized+degraded+snaptrim_error; 303 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 2.2 MiB/s wr, 7 op/s; 19/513 objects degraded (3.704%) 2024-03-04T06:48:12.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:12 smithi137 ceph-mon[91314]: osdmap e423: 8 total, 7 up, 8 in 2024-03-04T06:48:12.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:12.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:12 smithi137 ceph-mon[91314]: pgmap v311: 121 pgs: 1 active+undersized+degraded, 87 active+clean, 4 active+undersized, 3 active+clean+snaptrim_error, 4 stale+active+clean, 21 peering, 1 active+undersized+degraded+snaptrim_error; 303 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 2.2 MiB/s wr, 7 op/s; 19/513 objects degraded (3.704%) 2024-03-04T06:48:12.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:12.508+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:13.221 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:12 smithi203 podman[90993]: 2024-03-04 06:48:12.877520723 +0000 UTC m=+0.576450848 container remove d25e7f0ccd0f64215ead76a114bce6ca06575b85150fd09b26b763bba0f89b61 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-03-04T06:48:13.221 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:13 smithi203 podman[91056]: 2024-03-04 06:48:12.997576505 +0000 UTC m=+0.020161861 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:48:13.221 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:13 smithi203 podman[91056]: 2024-03-04 06:48:13.103453159 +0000 UTC m=+0.126038504 container create 9a246a0996bd6c412ed81e8e4c89c57a7c967a229f70df1505dd010ec2463f29 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T06:48:13.508 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:13 smithi203 podman[91056]: 2024-03-04 06:48:13.323458418 +0000 UTC m=+0.346043755 container init 9a246a0996bd6c412ed81e8e4c89c57a7c967a229f70df1505dd010ec2463f29 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-03-04T06:48:13.508 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:13 smithi203 podman[91056]: 2024-03-04 06:48:13.326576133 +0000 UTC m=+0.349161468 container start 9a246a0996bd6c412ed81e8e4c89c57a7c967a229f70df1505dd010ec2463f29 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.vendor=CentOS, ceph=True) 2024-03-04T06:48:13.508 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:13 smithi203 ceph-osd[91076]: -- 172.21.15.203:0/283145297 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5581c64d7680 con 0x5581c64a1000 2024-03-04T06:48:13.508 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:13 smithi203 bash[91056]: 9a246a0996bd6c412ed81e8e4c89c57a7c967a229f70df1505dd010ec2463f29 2024-03-04T06:48:13.508 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:13 smithi203 systemd[1]: Started Ceph osd.4 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:48:13.515 INFO:tasks.rados.rados.0.smithi137.stdout:1907: done (8 left) 2024-03-04T06:48:13.515 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 176 2024-03-04T06:48:13.516 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 962 (ObjNum 612 snap 174 seq_num 612) dirty exists 2024-03-04T06:48:13.516 INFO:tasks.rados.rados.0.smithi137.stdout:1901: finishing rollback tid 0 to smithi13777483-11 2024-03-04T06:48:13.516 INFO:tasks.rados.rados.0.smithi137.stdout:1904: finishing copy_from racing read to smithi13777483-10 2024-03-04T06:48:13.516 INFO:tasks.rados.rados.0.smithi137.stdout:1901: finishing rollback tid 1 to smithi13777483-11 2024-03-04T06:48:13.516 INFO:tasks.rados.rados.0.smithi137.stdout:1901: finishing rollback tid 2 to smithi13777483-11 2024-03-04T06:48:13.516 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16791 (ObjNum 621 snap 175 seq_num 621) dirty exists 2024-03-04T06:48:13.516 INFO:tasks.rados.rados.0.smithi137.stdout:1904: finishing copy_from to smithi13777483-10 2024-03-04T06:48:13.516 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 863 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-03-04T06:48:13.516 INFO:tasks.rados.rados.0.smithi137.stdout:1903: expect (ObjNum 622 snap 176 seq_num 622) 2024-03-04T06:48:13.581 INFO:tasks.rados.rados.0.smithi137.stdout:1899: finishing write tid 2 to smithi13777483-32 2024-03-04T06:48:13.581 INFO:tasks.rados.rados.0.smithi137.stdout:1899: finishing write tid 3 to smithi13777483-32 2024-03-04T06:48:13.582 INFO:tasks.rados.rados.0.smithi137.stdout:1908: seq_num 626 ranges {0=491520,491520=401408} 2024-03-04T06:48:13.584 INFO:tasks.rados.rados.0.smithi137.stdout:1908: writing smithi13777483-6 from 0 to 491520 tid 1 2024-03-04T06:48:13.587 INFO:tasks.rados.rados.0.smithi137.stdout:1908: writing smithi13777483-6 from 491520 to 892928 tid 2 2024-03-04T06:48:13.587 INFO:tasks.rados.rados.0.smithi137.stdout:1900: done (8 left) 2024-03-04T06:48:13.587 INFO:tasks.rados.rados.0.smithi137.stdout:1901: done (7 left) 2024-03-04T06:48:13.587 INFO:tasks.rados.rados.0.smithi137.stdout:1903: done (6 left) 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:1904: done (5 left) 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:1906: done (4 left) 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:1909: copy_from oid 38 from oid 46 current snap is 176 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:1899: finishing write tid 4 to smithi13777483-32 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:1899: oid 32 updating version 0 to 16779 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:1899: oid 32 version 16779 is already newer than 16777 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:1899: oid 32 version 16779 is already newer than 16778 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16779 (ObjNum 625 snap 176 seq_num 625) dirty exists 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:1899: left oid 32 (ObjNum 625 snap 176 seq_num 625) 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:1899: done (4 left) 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:1910: rmattr oid 16 current snap is 176 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:1910: done (4 left) 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:1911: snap_create 2024-03-04T06:48:13.588 INFO:tasks.rados.rados.0.smithi137.stdout:1905: finishing copy_from racing read to smithi13777483-30 2024-03-04T06:48:13.589 INFO:tasks.rados.rados.0.smithi137.stdout:1905: finishing copy_from to smithi13777483-30 2024-03-04T06:48:13.589 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 848 (ObjNum 461 snap 133 seq_num 461) dirty exists 2024-03-04T06:48:13.589 INFO:tasks.rados.rados.0.smithi137.stdout:1902: expect (ObjNum 560 snap 159 seq_num 560) 2024-03-04T06:48:13.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:13 smithi137 ceph-mon[88869]: osdmap e424: 8 total, 7 up, 8 in 2024-03-04T06:48:13.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:13.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:13 smithi137 ceph-mon[91314]: osdmap e424: 8 total, 7 up, 8 in 2024-03-04T06:48:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:13.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:13.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:13.515+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:13.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:13 smithi203 ceph-mon[85573]: osdmap e424: 8 total, 7 up, 8 in 2024-03-04T06:48:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:14.215 INFO:tasks.rados.rados.0.smithi137.stdout:1908: finishing write tid 1 to smithi13777483-6 2024-03-04T06:48:14.215 INFO:tasks.rados.rados.0.smithi137.stdout:1908: finishing write tid 2 to smithi13777483-6 2024-03-04T06:48:14.215 INFO:tasks.rados.rados.0.smithi137.stdout:1908: finishing write tid 3 to smithi13777483-6 2024-03-04T06:48:14.215 INFO:tasks.rados.rados.0.smithi137.stdout:1908: finishing write tid 4 to smithi13777483-6 2024-03-04T06:48:14.215 INFO:tasks.rados.rados.0.smithi137.stdout:1908: oid 6 updating version 0 to 15470 2024-03-04T06:48:14.215 INFO:tasks.rados.rados.0.smithi137.stdout:1908: oid 6 updating version 15470 to 15471 2024-03-04T06:48:14.216 INFO:tasks.rados.rados.0.smithi137.stdout:1908: oid 6 updating version 15471 to 15472 2024-03-04T06:48:14.216 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 15472 (ObjNum 626 snap 176 seq_num 626) dirty exists 2024-03-04T06:48:14.216 INFO:tasks.rados.rados.0.smithi137.stdout:1908: left oid 6 (ObjNum 626 snap 176 seq_num 626) 2024-03-04T06:48:14.216 INFO:tasks.rados.rados.0.smithi137.stdout:1909: finishing copy_from racing read to smithi13777483-38 2024-03-04T06:48:14.216 INFO:tasks.rados.rados.0.smithi137.stdout:1909: finishing copy_from to smithi13777483-38 2024-03-04T06:48:14.216 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 1186 (ObjNum 568 snap 159 seq_num 568) dirty exists 2024-03-04T06:48:14.319 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:13.866+0000 7f1a6d56b7c0 -1 Falling back to public interface 2024-03-04T06:48:14.516 INFO:tasks.rados.rados.0.smithi137.stdout:1902: done (4 left) 2024-03-04T06:48:14.516 INFO:tasks.rados.rados.0.smithi137.stdout:1905: done (3 left) 2024-03-04T06:48:14.517 INFO:tasks.rados.rados.0.smithi137.stdout:1908: done (2 left) 2024-03-04T06:48:14.517 INFO:tasks.rados.rados.0.smithi137.stdout:1909: done (1 left) 2024-03-04T06:48:14.517 INFO:tasks.rados.rados.0.smithi137.stdout:1911: done (0 left) 2024-03-04T06:48:14.517 INFO:tasks.rados.rados.0.smithi137.stdout:1912: delete oid 9 current snap is 177 2024-03-04T06:48:14.521 INFO:tasks.rados.rados.0.smithi137.stdout:1912: done (0 left) 2024-03-04T06:48:14.521 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 35 current snap is 177 2024-03-04T06:48:14.521 INFO:tasks.rados.rados.0.smithi137.stdout:1913: seq_num 628 ranges {11698176=524288,12222464=401408} 2024-03-04T06:48:14.587 INFO:tasks.rados.rados.0.smithi137.stdout:1913: writing smithi13777483-35 from 11698176 to 12222464 tid 1 2024-03-04T06:48:14.590 INFO:tasks.rados.rados.0.smithi137.stdout:1913: writing smithi13777483-35 from 12222464 to 12623872 tid 2 2024-03-04T06:48:14.590 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 177 2024-03-04T06:48:14.590 INFO:tasks.rados.rados.0.smithi137.stdout:1914: seq_num 629 ranges {892928=540672,1433600=401408} 2024-03-04T06:48:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:14 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:14 smithi203 ceph-mon[85573]: osdmap e425: 8 total, 7 up, 8 in 2024-03-04T06:48:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:14 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:48:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:14 smithi203 ceph-mon[85573]: pgmap v314: 121 pgs: 10 active+undersized+degraded, 74 active+clean, 33 active+undersized, 1 active+clean+snaptrim_error, 3 active+undersized+degraded+snaptrim_error; 300 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 3.2 MiB/s wr, 24 op/s; 95/519 objects degraded (18.304%) 2024-03-04T06:48:14.597 INFO:tasks.rados.rados.0.smithi137.stdout:1914: writing smithi13777483-6 from 892928 to 1433600 tid 1 2024-03-04T06:48:14.600 INFO:tasks.rados.rados.0.smithi137.stdout:1914: writing smithi13777483-6 from 1433600 to 1835008 tid 2 2024-03-04T06:48:14.600 INFO:tasks.rados.rados.0.smithi137.stdout:1915: delete oid 37 current snap is 177 2024-03-04T06:48:14.600 INFO:tasks.rados.rados.0.smithi137.stdout:1913: finishing write tid 1 to smithi13777483-35 2024-03-04T06:48:14.600 INFO:tasks.rados.rados.0.smithi137.stdout:1913: finishing write tid 2 to smithi13777483-35 2024-03-04T06:48:14.600 INFO:tasks.rados.rados.0.smithi137.stdout:1913: finishing write tid 3 to smithi13777483-35 2024-03-04T06:48:14.601 INFO:tasks.rados.rados.0.smithi137.stdout:1913: finishing write tid 4 to smithi13777483-35 2024-03-04T06:48:14.601 INFO:tasks.rados.rados.0.smithi137.stdout:1913: oid 35 updating version 0 to 16768 2024-03-04T06:48:14.601 INFO:tasks.rados.rados.0.smithi137.stdout:1913: oid 35 version 16768 is already newer than 16767 2024-03-04T06:48:14.601 INFO:tasks.rados.rados.0.smithi137.stdout:1913: oid 35 updating version 16768 to 16769 2024-03-04T06:48:14.601 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16769 (ObjNum 628 snap 177 seq_num 628) dirty exists 2024-03-04T06:48:14.601 INFO:tasks.rados.rados.0.smithi137.stdout:1913: left oid 35 (ObjNum 628 snap 177 seq_num 628) 2024-03-04T06:48:14.602 INFO:tasks.rados.rados.0.smithi137.stdout:1914: finishing write tid 1 to smithi13777483-6 2024-03-04T06:48:14.602 INFO:tasks.rados.rados.0.smithi137.stdout:1914: finishing write tid 2 to smithi13777483-6 2024-03-04T06:48:14.603 INFO:tasks.rados.rados.0.smithi137.stdout:1914: finishing write tid 3 to smithi13777483-6 2024-03-04T06:48:14.605 INFO:tasks.rados.rados.0.smithi137.stdout:1914: finishing write tid 4 to smithi13777483-6 2024-03-04T06:48:14.605 INFO:tasks.rados.rados.0.smithi137.stdout:1914: oid 6 updating version 0 to 15473 2024-03-04T06:48:14.605 INFO:tasks.rados.rados.0.smithi137.stdout:1914: oid 6 updating version 15473 to 15475 2024-03-04T06:48:14.605 INFO:tasks.rados.rados.0.smithi137.stdout:1914: oid 6 version 15475 is already newer than 15474 2024-03-04T06:48:14.605 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 15475 (ObjNum 629 snap 177 seq_num 629) dirty exists 2024-03-04T06:48:14.605 INFO:tasks.rados.rados.0.smithi137.stdout:1914: left oid 6 (ObjNum 629 snap 177 seq_num 629) 2024-03-04T06:48:14.605 INFO:tasks.rados.rados.0.smithi137.stdout:1913: done (2 left) 2024-03-04T06:48:14.605 INFO:tasks.rados.rados.0.smithi137.stdout:1914: done (1 left) 2024-03-04T06:48:14.605 INFO:tasks.rados.rados.0.smithi137.stdout:1915: done (0 left) 2024-03-04T06:48:14.605 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 41 current snap is 177 2024-03-04T06:48:14.606 INFO:tasks.rados.rados.0.smithi137.stdout:1916: seq_num 631 ranges {0=573440,573440=401408} 2024-03-04T06:48:14.608 INFO:tasks.rados.rados.0.smithi137.stdout:1916: writing smithi13777483-41 from 0 to 573440 tid 1 2024-03-04T06:48:14.610 INFO:tasks.rados.rados.0.smithi137.stdout:1916: writing smithi13777483-41 from 573440 to 974848 tid 2 2024-03-04T06:48:14.610 INFO:tasks.rados.rados.0.smithi137.stdout:1917: copy_from oid 33 from oid 21 current snap is 177 2024-03-04T06:48:14.611 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 177 2024-03-04T06:48:14.611 INFO:tasks.rados.rados.0.smithi137.stdout:1918: seq_num 632 ranges {0=589824,589824=401408} 2024-03-04T06:48:14.614 INFO:tasks.rados.rados.0.smithi137.stdout:1918: writing smithi13777483-10 from 0 to 589824 tid 1 2024-03-04T06:48:14.616 INFO:tasks.rados.rados.0.smithi137.stdout:1918: writing smithi13777483-10 from 589824 to 991232 tid 2 2024-03-04T06:48:14.617 INFO:tasks.rados.rados.0.smithi137.stdout:1919: copy_from oid 19 from oid 47 current snap is 177 2024-03-04T06:48:14.617 INFO:tasks.rados.rados.0.smithi137.stdout:1916: finishing write tid 1 to smithi13777483-41 2024-03-04T06:48:14.617 INFO:tasks.rados.rados.0.smithi137.stdout:1920: delete oid 13 current snap is 177 2024-03-04T06:48:14.617 INFO:tasks.rados.rados.0.smithi137.stdout:1916: finishing write tid 2 to smithi13777483-41 2024-03-04T06:48:14.617 INFO:tasks.rados.rados.0.smithi137.stdout:1916: finishing write tid 3 to smithi13777483-41 2024-03-04T06:48:14.618 INFO:tasks.rados.rados.0.smithi137.stdout:1916: finishing write tid 4 to smithi13777483-41 2024-03-04T06:48:14.618 INFO:tasks.rados.rados.0.smithi137.stdout:1916: oid 41 updating version 0 to 15458 2024-03-04T06:48:14.618 INFO:tasks.rados.rados.0.smithi137.stdout:1916: oid 41 version 15458 is already newer than 15457 2024-03-04T06:48:14.618 INFO:tasks.rados.rados.0.smithi137.stdout:1916: oid 41 version 15458 is already newer than 15456 2024-03-04T06:48:14.618 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 15458 (ObjNum 631 snap 177 seq_num 631) dirty exists 2024-03-04T06:48:14.618 INFO:tasks.rados.rados.0.smithi137.stdout:1916: left oid 41 (ObjNum 631 snap 177 seq_num 631) 2024-03-04T06:48:14.620 INFO:tasks.rados.rados.0.smithi137.stdout:1916: done (4 left) 2024-03-04T06:48:14.620 INFO:tasks.rados.rados.0.smithi137.stdout:1920: done (3 left) 2024-03-04T06:48:14.620 INFO:tasks.rados.rados.0.smithi137.stdout:1921: snap_remove snap 165 2024-03-04T06:48:14.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:14.521+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:14.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:14 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:14.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:14 smithi137 ceph-mon[91314]: osdmap e425: 8 total, 7 up, 8 in 2024-03-04T06:48:14.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:14.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:14 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:48:14.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:14 smithi137 ceph-mon[91314]: pgmap v314: 121 pgs: 10 active+undersized+degraded, 74 active+clean, 33 active+undersized, 1 active+clean+snaptrim_error, 3 active+undersized+degraded+snaptrim_error; 300 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 3.2 MiB/s wr, 24 op/s; 95/519 objects degraded (18.304%) 2024-03-04T06:48:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:14 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:14 smithi137 ceph-mon[88869]: osdmap e425: 8 total, 7 up, 8 in 2024-03-04T06:48:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:14 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:48:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:14 smithi137 ceph-mon[88869]: pgmap v314: 121 pgs: 10 active+undersized+degraded, 74 active+clean, 33 active+undersized, 1 active+clean+snaptrim_error, 3 active+undersized+degraded+snaptrim_error; 300 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 3.2 MiB/s wr, 24 op/s; 95/519 objects degraded (18.304%) 2024-03-04T06:48:15.522 INFO:tasks.rados.rados.0.smithi137.stdout:1921: done (3 left) 2024-03-04T06:48:15.522 INFO:tasks.rados.rados.0.smithi137.stdout:1922: snap_remove snap 166 2024-03-04T06:48:15.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:48:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:48:15] "GET /metrics HTTP/1.1" 200 36265 "" "Prometheus/2.43.0" 2024-03-04T06:48:15.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:15.529+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:15.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:15 smithi137 ceph-mon[88869]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2024-03-04T06:48:15.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:15 smithi137 ceph-mon[88869]: osdmap e426: 8 total, 7 up, 8 in 2024-03-04T06:48:15.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:15 smithi137 ceph-mon[91314]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2024-03-04T06:48:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:15 smithi137 ceph-mon[91314]: osdmap e426: 8 total, 7 up, 8 in 2024-03-04T06:48:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:15.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:15 smithi203 ceph-mon[85573]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2024-03-04T06:48:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:15 smithi203 ceph-mon[85573]: osdmap e426: 8 total, 7 up, 8 in 2024-03-04T06:48:15.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:16.534 INFO:tasks.rados.rados.0.smithi137.stdout:1922: done (3 left) 2024-03-04T06:48:16.534 INFO:tasks.rados.rados.0.smithi137.stdout:1923: copy_from oid 42 from oid 5 current snap is 177 2024-03-04T06:48:16.534 INFO:tasks.rados.rados.0.smithi137.stdout:1918: finishing write tid 1 to smithi13777483-10 2024-03-04T06:48:16.534 INFO:tasks.rados.rados.0.smithi137.stdout:1918: finishing write tid 2 to smithi13777483-10 2024-03-04T06:48:16.534 INFO:tasks.rados.rados.0.smithi137.stdout:1918: finishing write tid 3 to smithi13777483-10 2024-03-04T06:48:16.534 INFO:tasks.rados.rados.0.smithi137.stdout:1918: finishing write tid 4 to smithi13777483-10 2024-03-04T06:48:16.534 INFO:tasks.rados.rados.0.smithi137.stdout:1918: oid 10 updating version 0 to 894 2024-03-04T06:48:16.534 INFO:tasks.rados.rados.0.smithi137.stdout:1918: oid 10 updating version 894 to 896 2024-03-04T06:48:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:1918: oid 10 version 896 is already newer than 895 2024-03-04T06:48:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 896 (ObjNum 632 snap 177 seq_num 632) dirty exists 2024-03-04T06:48:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:1918: left oid 10 (ObjNum 632 snap 177 seq_num 632) 2024-03-04T06:48:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:1917: finishing copy_from racing read to smithi13777483-33 2024-03-04T06:48:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:1917: finishing copy_from to smithi13777483-33 2024-03-04T06:48:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 15461 (ObjNum 596 snap 170 seq_num 596) dirty exists 2024-03-04T06:48:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:1919: finishing copy_from racing read to smithi13777483-19 2024-03-04T06:48:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:1919: finishing copy_from to smithi13777483-19 2024-03-04T06:48:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 15476 (ObjNum 560 snap 159 seq_num 560) dirty exists 2024-03-04T06:48:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:1917: done (3 left) 2024-03-04T06:48:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:1918: done (2 left) 2024-03-04T06:48:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:1919: done (1 left) 2024-03-04T06:48:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:1924: read oid 21 snap -1 2024-03-04T06:48:16.536 INFO:tasks.rados.rados.0.smithi137.stdout:1924: expect (ObjNum 596 snap 170 seq_num 596) 2024-03-04T06:48:16.536 INFO:tasks.rados.rados.0.smithi137.stdout:1925: setattr oid 28 current snap is 177 2024-03-04T06:48:16.536 INFO:tasks.rados.rados.0.smithi137.stdout:1926: snap_remove snap 175 2024-03-04T06:48:16.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:16.536+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:16.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:16 smithi137 ceph-mon[88869]: osdmap e427: 8 total, 7 up, 8 in 2024-03-04T06:48:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:16 smithi137 ceph-mon[88869]: pgmap v317: 121 pgs: 10 active+undersized+degraded, 74 active+clean, 33 active+undersized, 1 active+clean+snaptrim_error, 3 active+undersized+degraded+snaptrim_error; 300 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 3.4 MiB/s wr, 26 op/s; 96/522 objects degraded (18.391%) 2024-03-04T06:48:16.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:16 smithi137 ceph-mon[91314]: osdmap e427: 8 total, 7 up, 8 in 2024-03-04T06:48:16.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:16.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:16 smithi137 ceph-mon[91314]: pgmap v317: 121 pgs: 10 active+undersized+degraded, 74 active+clean, 33 active+undersized, 1 active+clean+snaptrim_error, 3 active+undersized+degraded+snaptrim_error; 300 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 3.4 MiB/s wr, 26 op/s; 96/522 objects degraded (18.391%) 2024-03-04T06:48:16.827 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:16 smithi203 ceph-mon[85573]: osdmap e427: 8 total, 7 up, 8 in 2024-03-04T06:48:16.827 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:16.827 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:16 smithi203 ceph-mon[85573]: pgmap v317: 121 pgs: 10 active+undersized+degraded, 74 active+clean, 33 active+undersized, 1 active+clean+snaptrim_error, 3 active+undersized+degraded+snaptrim_error; 300 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 3.4 MiB/s wr, 26 op/s; 96/522 objects degraded (18.391%) 2024-03-04T06:48:17.421 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:17.098+0000 7f1a6d56b7c0 -1 osd.4 419 log_to_monitors true 2024-03-04T06:48:17.532 INFO:tasks.rados.rados.0.smithi137.stdout:1926: done (3 left) 2024-03-04T06:48:17.533 INFO:tasks.rados.rados.0.smithi137.stdout:1927: read oid 40 snap 176 2024-03-04T06:48:17.533 INFO:tasks.rados.rados.0.smithi137.stdout:1927: expect deleted 2024-03-04T06:48:17.533 INFO:tasks.rados.rados.0.smithi137.stdout:1928: rmattr oid 29 current snap is 177 2024-03-04T06:48:17.533 INFO:tasks.rados.rados.0.smithi137.stdout:1923: finishing copy_from racing read to smithi13777483-42 2024-03-04T06:48:17.533 INFO:tasks.rados.rados.0.smithi137.stdout:1923: finishing copy_from to smithi13777483-42 2024-03-04T06:48:17.533 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 848 (ObjNum 461 snap 133 seq_num 461) dirty exists 2024-03-04T06:48:17.533 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 15477 (ObjNum 407 snap 122 seq_num 407) dirty exists 2024-03-04T06:48:17.533 INFO:tasks.rados.rados.0.smithi137.stdout:1924: expect (ObjNum 596 snap 170 seq_num 596) 2024-03-04T06:48:17.672 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:17.557+0000 7f1a5e9c3700 -1 osd.4 419 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:48:17.672 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:17 smithi203 ceph-mon[85573]: Health check update: Degraded data redundancy: 96/522 objects degraded (18.391%), 13 pgs degraded (PG_DEGRADED) 2024-03-04T06:48:17.672 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:17 smithi203 ceph-mon[85573]: osdmap e428: 8 total, 7 up, 8 in 2024-03-04T06:48:17.672 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:17.672 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:17 smithi203 ceph-mon[85573]: from='osd.4 [v2:172.21.15.203:6800/3365634036,v1:172.21.15.203:6801/3365634036]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T06:48:17.672 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:17 smithi203 ceph-mon[85573]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T06:48:17.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:17.532+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:17.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:17 smithi137 ceph-mon[88869]: Health check update: Degraded data redundancy: 96/522 objects degraded (18.391%), 13 pgs degraded (PG_DEGRADED) 2024-03-04T06:48:17.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:17 smithi137 ceph-mon[88869]: osdmap e428: 8 total, 7 up, 8 in 2024-03-04T06:48:17.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:17.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:17 smithi137 ceph-mon[88869]: from='osd.4 [v2:172.21.15.203:6800/3365634036,v1:172.21.15.203:6801/3365634036]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T06:48:17.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:17 smithi137 ceph-mon[88869]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T06:48:17.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:17 smithi137 ceph-mon[91314]: Health check update: Degraded data redundancy: 96/522 objects degraded (18.391%), 13 pgs degraded (PG_DEGRADED) 2024-03-04T06:48:17.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:17 smithi137 ceph-mon[91314]: osdmap e428: 8 total, 7 up, 8 in 2024-03-04T06:48:17.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:17.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:17 smithi137 ceph-mon[91314]: from='osd.4 [v2:172.21.15.203:6800/3365634036,v1:172.21.15.203:6801/3365634036]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T06:48:17.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:17 smithi137 ceph-mon[91314]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T06:48:18.337 INFO:tasks.rados.rados.0.smithi137.stdout:1923: done (4 left) 2024-03-04T06:48:18.337 INFO:tasks.rados.rados.0.smithi137.stdout:1924: done (3 left) 2024-03-04T06:48:18.337 INFO:tasks.rados.rados.0.smithi137.stdout:1925: done (2 left) 2024-03-04T06:48:18.337 INFO:tasks.rados.rados.0.smithi137.stdout:1927: done (1 left) 2024-03-04T06:48:18.337 INFO:tasks.rados.rados.0.smithi137.stdout:1928: done (0 left) 2024-03-04T06:48:18.337 INFO:tasks.rados.rados.0.smithi137.stdout:1929: read oid 3 snap -1 2024-03-04T06:48:18.337 INFO:tasks.rados.rados.0.smithi137.stdout:1929: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:48:18.337 INFO:tasks.rados.rados.0.smithi137.stdout:1930: rollback oid 42 current snap is 177 2024-03-04T06:48:18.337 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 42 to 173 2024-03-04T06:48:18.337 INFO:tasks.rados.rados.0.smithi137.stdout:1931: rollback oid 25 current snap is 177 2024-03-04T06:48:18.337 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 25 to 168 2024-03-04T06:48:18.337 INFO:tasks.rados.rados.0.smithi137.stdout:1932: snap_create 2024-03-04T06:48:18.338 INFO:tasks.rados.rados.0.smithi137.stdout:1929: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:48:18.339 INFO:tasks.rados.rados.0.smithi137.stdout:1930: finishing rollback tid 0 to smithi13777483-42 2024-03-04T06:48:18.340 INFO:tasks.rados.rados.0.smithi137.stdout:1930: finishing rollback tid 1 to smithi13777483-42 2024-03-04T06:48:18.340 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16782 (ObjNum 161 snap 0 seq_num 3130947104) dirty dne 2024-03-04T06:48:18.340 INFO:tasks.rados.rados.0.smithi137.stdout:1931: finishing rollback tid 0 to smithi13777483-25 2024-03-04T06:48:18.341 INFO:tasks.rados.rados.0.smithi137.stdout:1931: finishing rollback tid 1 to smithi13777483-25 2024-03-04T06:48:18.341 INFO:tasks.rados.rados.0.smithi137.stdout:1931: finishing rollback tid 2 to smithi13777483-25 2024-03-04T06:48:18.341 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 15480 (ObjNum 544 snap 155 seq_num 544) dirty exists 2024-03-04T06:48:18.535 INFO:tasks.rados.rados.0.smithi137.stdout:1929: done (3 left) 2024-03-04T06:48:18.535 INFO:tasks.rados.rados.0.smithi137.stdout:1930: done (2 left) 2024-03-04T06:48:18.535 INFO:tasks.rados.rados.0.smithi137.stdout:1931: done (1 left) 2024-03-04T06:48:18.535 INFO:tasks.rados.rados.0.smithi137.stdout:1932: done (0 left) 2024-03-04T06:48:18.535 INFO:tasks.rados.rados.0.smithi137.stdout:1933: read oid 42 snap 173 2024-03-04T06:48:18.535 INFO:tasks.rados.rados.0.smithi137.stdout:1933: expect deleted 2024-03-04T06:48:18.535 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 178 2024-03-04T06:48:18.535 INFO:tasks.rados.rados.0.smithi137.stdout:1934: seq_num 634 ranges {3727360=622592,4349952=401408} 2024-03-04T06:48:18.559 INFO:tasks.rados.rados.0.smithi137.stdout:1934: writing smithi13777483-12 from 3727360 to 4349952 tid 1 2024-03-04T06:48:18.562 INFO:tasks.rados.rados.0.smithi137.stdout:1934: writing smithi13777483-12 from 4349952 to 4751360 tid 2 2024-03-04T06:48:18.562 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 178 2024-03-04T06:48:18.562 INFO:tasks.rados.rados.0.smithi137.stdout:1935: seq_num 635 ranges {655360=638976,1294336=401408} 2024-03-04T06:48:18.569 INFO:tasks.rados.rados.0.smithi137.stdout:1935: writing smithi13777483-22 from 655360 to 1294336 tid 1 2024-03-04T06:48:18.572 INFO:tasks.rados.rados.0.smithi137.stdout:1935: writing smithi13777483-22 from 1294336 to 1695744 tid 2 2024-03-04T06:48:18.572 INFO:tasks.rados.rados.0.smithi137.stdout:1936: rollback oid 35 current snap is 178 2024-03-04T06:48:18.572 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 35 to 176 2024-03-04T06:48:18.572 INFO:tasks.rados.rados.0.smithi137.stdout:1934: finishing write tid 1 to smithi13777483-12 2024-03-04T06:48:18.572 INFO:tasks.rados.rados.0.smithi137.stdout:1934: finishing write tid 2 to smithi13777483-12 2024-03-04T06:48:18.572 INFO:tasks.rados.rados.0.smithi137.stdout:1934: finishing write tid 3 to smithi13777483-12 2024-03-04T06:48:18.573 INFO:tasks.rados.rados.0.smithi137.stdout:1934: finishing write tid 4 to smithi13777483-12 2024-03-04T06:48:18.573 INFO:tasks.rados.rados.0.smithi137.stdout:1934: oid 12 updating version 0 to 16754 2024-03-04T06:48:18.573 INFO:tasks.rados.rados.0.smithi137.stdout:1934: oid 12 updating version 16754 to 16755 2024-03-04T06:48:18.573 INFO:tasks.rados.rados.0.smithi137.stdout:1934: oid 12 updating version 16755 to 16756 2024-03-04T06:48:18.573 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16756 (ObjNum 634 snap 178 seq_num 634) dirty exists 2024-03-04T06:48:18.573 INFO:tasks.rados.rados.0.smithi137.stdout:1934: left oid 12 (ObjNum 634 snap 178 seq_num 634) 2024-03-04T06:48:18.573 INFO:tasks.rados.rados.0.smithi137.stdout:1933: done (3 left) 2024-03-04T06:48:18.573 INFO:tasks.rados.rados.0.smithi137.stdout:1934: done (2 left) 2024-03-04T06:48:18.573 INFO:tasks.rados.rados.0.smithi137.stdout:1937: rollback oid 50 current snap is 178 2024-03-04T06:48:18.573 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 50 to 173 2024-03-04T06:48:18.573 INFO:tasks.rados.rados.0.smithi137.stdout:1938: read oid 15 snap -1 2024-03-04T06:48:18.574 INFO:tasks.rados.rados.0.smithi137.stdout:1938: expect deleted 2024-03-04T06:48:18.574 INFO:tasks.rados.rados.0.smithi137.stdout:1939: rmattr oid 2 current snap is 178 2024-03-04T06:48:18.574 INFO:tasks.rados.rados.0.smithi137.stdout:1939: done (4 left) 2024-03-04T06:48:18.574 INFO:tasks.rados.rados.0.smithi137.stdout:1940: setattr oid 48 current snap is 178 2024-03-04T06:48:18.574 INFO:tasks.rados.rados.0.smithi137.stdout:1941: delete oid 14 current snap is 178 2024-03-04T06:48:18.574 INFO:tasks.rados.rados.0.smithi137.stdout:1937: finishing rollback tid 0 to smithi13777483-50 2024-03-04T06:48:18.574 INFO:tasks.rados.rados.0.smithi137.stdout:1937: finishing rollback tid 1 to smithi13777483-50 2024-03-04T06:48:18.575 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 16784 (ObjNum 33 snap 0 seq_num 5) dirty dne 2024-03-04T06:48:18.576 INFO:tasks.rados.rados.0.smithi137.stdout:1936: finishing rollback tid 0 to smithi13777483-35 2024-03-04T06:48:18.576 INFO:tasks.rados.rados.0.smithi137.stdout:1936: finishing rollback tid 1 to smithi13777483-35 2024-03-04T06:48:18.576 INFO:tasks.rados.rados.0.smithi137.stdout:1936: finishing rollback tid 2 to smithi13777483-35 2024-03-04T06:48:18.576 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16772 (ObjNum 584 snap 167 seq_num 584) dirty exists 2024-03-04T06:48:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:18 smithi203 ceph-mon[85573]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-04T06:48:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:18 smithi203 ceph-mon[85573]: osdmap e429: 8 total, 7 up, 8 in 2024-03-04T06:48:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:18 smithi203 ceph-mon[85573]: from='osd.4 [v2:172.21.15.203:6800/3365634036,v1:172.21.15.203:6801/3365634036]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:48:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:18 smithi203 ceph-mon[85573]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:48:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:18 smithi203 ceph-mon[85573]: pgmap v320: 121 pgs: 1 active+clean+snaptrim_error, 10 active+undersized+degraded, 74 active+clean, 33 active+undersized, 3 active+undersized+degraded+snaptrim_error; 311 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.5 MiB/s rd, 5.6 MiB/s wr, 10 op/s; 98/531 objects degraded (18.456%) 2024-03-04T06:48:19.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:18.543+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:19.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[88869]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-04T06:48:19.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[88869]: osdmap e429: 8 total, 7 up, 8 in 2024-03-04T06:48:19.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:19.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[88869]: from='osd.4 [v2:172.21.15.203:6800/3365634036,v1:172.21.15.203:6801/3365634036]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:48:19.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[88869]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:48:19.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:19.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:19.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[88869]: pgmap v320: 121 pgs: 1 active+clean+snaptrim_error, 10 active+undersized+degraded, 74 active+clean, 33 active+undersized, 3 active+undersized+degraded+snaptrim_error; 311 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.5 MiB/s rd, 5.6 MiB/s wr, 10 op/s; 98/531 objects degraded (18.456%) 2024-03-04T06:48:19.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[91314]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-04T06:48:19.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[91314]: osdmap e429: 8 total, 7 up, 8 in 2024-03-04T06:48:19.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:19.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[91314]: from='osd.4 [v2:172.21.15.203:6800/3365634036,v1:172.21.15.203:6801/3365634036]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:48:19.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[91314]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:48:19.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:19.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:19.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:18 smithi137 ceph-mon[91314]: pgmap v320: 121 pgs: 1 active+clean+snaptrim_error, 10 active+undersized+degraded, 74 active+clean, 33 active+undersized, 3 active+undersized+degraded+snaptrim_error; 311 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.5 MiB/s rd, 5.6 MiB/s wr, 10 op/s; 98/531 objects degraded (18.456%) 2024-03-04T06:48:19.564 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 15466 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:48:19.565 INFO:tasks.rados.rados.0.smithi137.stdout:1935: finishing write tid 1 to smithi13777483-22 2024-03-04T06:48:19.566 INFO:tasks.rados.rados.0.smithi137.stdout:1935: finishing write tid 2 to smithi13777483-22 2024-03-04T06:48:19.566 INFO:tasks.rados.rados.0.smithi137.stdout:1935: finishing write tid 3 to smithi13777483-22 2024-03-04T06:48:19.569 INFO:tasks.rados.rados.0.smithi137.stdout:1936: done (5 left) 2024-03-04T06:48:19.569 INFO:tasks.rados.rados.0.smithi137.stdout:1937: done (4 left) 2024-03-04T06:48:19.570 INFO:tasks.rados.rados.0.smithi137.stdout:1940: done (3 left) 2024-03-04T06:48:19.570 INFO:tasks.rados.rados.0.smithi137.stdout:1941: done (2 left) 2024-03-04T06:48:19.570 INFO:tasks.rados.rados.0.smithi137.stdout:1942: copy_from oid 23 from oid 37 current snap is 178 2024-03-04T06:48:19.570 INFO:tasks.rados.rados.0.smithi137.stdout:1943: delete oid 39 current snap is 178 2024-03-04T06:48:19.570 INFO:tasks.rados.rados.0.smithi137.stdout:1935: finishing write tid 4 to smithi13777483-22 2024-03-04T06:48:19.570 INFO:tasks.rados.rados.0.smithi137.stdout:1935: oid 22 updating version 0 to 15476 2024-03-04T06:48:19.570 INFO:tasks.rados.rados.0.smithi137.stdout:1935: oid 22 updating version 15476 to 15477 2024-03-04T06:48:19.570 INFO:tasks.rados.rados.0.smithi137.stdout:1935: oid 22 updating version 15477 to 15478 2024-03-04T06:48:19.571 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 15478 (ObjNum 635 snap 178 seq_num 635) dirty exists 2024-03-04T06:48:19.571 INFO:tasks.rados.rados.0.smithi137.stdout:1935: left oid 22 (ObjNum 635 snap 178 seq_num 635) 2024-03-04T06:48:19.573 INFO:tasks.rados.rados.0.smithi137.stdout:1935: done (3 left) 2024-03-04T06:48:19.573 INFO:tasks.rados.rados.0.smithi137.stdout:1938: done (2 left) 2024-03-04T06:48:19.573 INFO:tasks.rados.rados.0.smithi137.stdout:1943: done (1 left) 2024-03-04T06:48:19.573 INFO:tasks.rados.rados.0.smithi137.stdout:1944: read oid 29 snap -1 2024-03-04T06:48:19.573 INFO:tasks.rados.rados.0.smithi137.stdout:1944: expect deleted 2024-03-04T06:48:19.573 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 178 2024-03-04T06:48:19.573 INFO:tasks.rados.rados.0.smithi137.stdout:1945: seq_num 638 ranges {0=688128,688128=401408} 2024-03-04T06:48:19.576 INFO:tasks.rados.rados.0.smithi137.stdout:1945: writing smithi13777483-20 from 0 to 688128 tid 1 2024-03-04T06:48:19.579 INFO:tasks.rados.rados.0.smithi137.stdout:1945: writing smithi13777483-20 from 688128 to 1089536 tid 2 2024-03-04T06:48:19.579 INFO:tasks.rados.rados.0.smithi137.stdout:1946: read oid 43 snap -1 2024-03-04T06:48:19.579 INFO:tasks.rados.rados.0.smithi137.stdout:1946: expect (ObjNum 461 snap 133 seq_num 461) 2024-03-04T06:48:19.579 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 178 2024-03-04T06:48:19.580 INFO:tasks.rados.rados.0.smithi137.stdout:1947: seq_num 639 ranges {221184=704512,925696=401408} 2024-03-04T06:48:19.584 INFO:tasks.rados.rados.0.smithi137.stdout:1947: writing smithi13777483-34 from 221184 to 925696 tid 1 2024-03-04T06:48:19.587 INFO:tasks.rados.rados.0.smithi137.stdout:1947: writing smithi13777483-34 from 925696 to 1327104 tid 2 2024-03-04T06:48:19.587 INFO:tasks.rados.rados.0.smithi137.stdout:1948: rollback oid 44 current snap is 178 2024-03-04T06:48:19.587 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 44 to 168 2024-03-04T06:48:19.587 INFO:tasks.rados.rados.0.smithi137.stdout:1944: done (5 left) 2024-03-04T06:48:19.587 INFO:tasks.rados.rados.0.smithi137.stdout:1949: delete oid 14 current snap is 178 2024-03-04T06:48:19.593 INFO:tasks.rados.rados.0.smithi137.stdout:1945: finishing write tid 1 to smithi13777483-20 2024-03-04T06:48:19.594 INFO:tasks.rados.rados.0.smithi137.stdout:1947: finishing write tid 1 to smithi13777483-34 2024-03-04T06:48:19.598 INFO:tasks.rados.rados.0.smithi137.stdout:1945: finishing write tid 2 to smithi13777483-20 2024-03-04T06:48:19.598 INFO:tasks.rados.rados.0.smithi137.stdout:1945: finishing write tid 3 to smithi13777483-20 2024-03-04T06:48:19.600 INFO:tasks.rados.rados.0.smithi137.stdout:1946: expect (ObjNum 461 snap 133 seq_num 461) 2024-03-04T06:48:19.811 INFO:tasks.rados.rados.0.smithi137.stdout:1947: finishing write tid 2 to smithi13777483-34 2024-03-04T06:48:19.811 INFO:tasks.rados.rados.0.smithi137.stdout:1947: finishing write tid 3 to smithi13777483-34 2024-03-04T06:48:19.811 INFO:tasks.rados.rados.0.smithi137.stdout:1946: done (5 left) 2024-03-04T06:48:19.811 INFO:tasks.rados.rados.0.smithi137.stdout:1949: done (4 left) 2024-03-04T06:48:19.811 INFO:tasks.rados.rados.0.smithi137.stdout:1950: setattr oid 2 current snap is 178 2024-03-04T06:48:19.811 INFO:tasks.rados.rados.0.smithi137.stdout:1948: finishing rollback tid 0 to smithi13777483-44 2024-03-04T06:48:19.811 INFO:tasks.rados.rados.0.smithi137.stdout:1948: finishing rollback tid 1 to smithi13777483-44 2024-03-04T06:48:19.811 INFO:tasks.rados.rados.0.smithi137.stdout:1947: finishing write tid 4 to smithi13777483-34 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:1947: oid 34 updating version 0 to 16777 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:1947: oid 34 version 16777 is already newer than 16776 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:1947: oid 34 updating version 16777 to 16778 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16778 (ObjNum 639 snap 178 seq_num 639) dirty exists 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:1947: left oid 34 (ObjNum 639 snap 178 seq_num 639) 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:1945: finishing write tid 4 to smithi13777483-20 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:1945: oid 20 updating version 0 to 965 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:1945: oid 20 version 965 is already newer than 964 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:1945: oid 20 updating version 965 to 966 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 966 (ObjNum 638 snap 178 seq_num 638) dirty exists 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:1945: left oid 20 (ObjNum 638 snap 178 seq_num 638) 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:1948: finishing rollback tid 2 to smithi13777483-44 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16782 (ObjNum 571 snap 159 seq_num 571) dirty exists 2024-03-04T06:48:19.812 INFO:tasks.rados.rados.0.smithi137.stdout:1942: finishing copy_from to smithi13777483-23 2024-03-04T06:48:19.813 INFO:tasks.rados.rados.0.smithi137.stdout:1942: got expected ENOENT (src dne) 2024-03-04T06:48:19.813 INFO:tasks.rados.rados.0.smithi137.stdout:1942: finishing copy_from racing read to smithi13777483-23 2024-03-04T06:48:19.813 INFO:tasks.rados.rados.0.smithi137.stdout:1942: done (4 left) 2024-03-04T06:48:19.813 INFO:tasks.rados.rados.0.smithi137.stdout:1945: done (3 left) 2024-03-04T06:48:19.814 INFO:tasks.rados.rados.0.smithi137.stdout:1947: done (2 left) 2024-03-04T06:48:19.814 INFO:tasks.rados.rados.0.smithi137.stdout:1948: done (1 left) 2024-03-04T06:48:19.814 INFO:tasks.rados.rados.0.smithi137.stdout:1951: rollback oid 3 current snap is 178 2024-03-04T06:48:19.814 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 3 to 173 2024-03-04T06:48:19.814 INFO:tasks.rados.rados.0.smithi137.stdout:1952: rollback oid 21 current snap is 178 2024-03-04T06:48:19.814 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 21 to 168 2024-03-04T06:48:19.814 INFO:tasks.rados.rados.0.smithi137.stdout:1953: read oid 43 snap 168 2024-03-04T06:48:19.814 INFO:tasks.rados.rados.0.smithi137.stdout:1953: expect deleted 2024-03-04T06:48:19.814 INFO:tasks.rados.rados.0.smithi137.stdout:1954: delete oid 8 current snap is 178 2024-03-04T06:48:19.814 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 15467 (ObjNum 555 snap 158 seq_num 555) dirty exists 2024-03-04T06:48:19.816 INFO:tasks.rados.rados.0.smithi137.stdout:1951: finishing rollback tid 0 to smithi13777483-3 2024-03-04T06:48:19.816 INFO:tasks.rados.rados.0.smithi137.stdout:1950: done (4 left) 2024-03-04T06:48:19.817 INFO:tasks.rados.rados.0.smithi137.stdout:1953: done (3 left) 2024-03-04T06:48:19.817 INFO:tasks.rados.rados.0.smithi137.stdout:1954: done (2 left) 2024-03-04T06:48:19.817 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 178 2024-03-04T06:48:19.817 INFO:tasks.rados.rados.0.smithi137.stdout:1955: seq_num 642 ranges {12107776=761856,12869632=401408} 2024-03-04T06:48:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-mon[85573]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:48:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-mon[85573]: osd.4 [v2:172.21.15.203:6800/3365634036,v1:172.21.15.203:6801/3365634036] boot 2024-03-04T06:48:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-mon[85573]: osdmap e430: 8 total, 8 up, 8 in 2024-03-04T06:48:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:48:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-mon[85573]: osdmap e431: 8 total, 8 up, 8 in 2024-03-04T06:48:19.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:19.558+0000 7f1a4c19e700 -1 osd.4 pg_epoch: 431 pg[5.1s0( v 419'429 (0'0,419'429] local-lis/les=430/431 n=5 ec=72/72 lis/c=430/430 les/c/f=431/431/0 sis=430) [4,3,7]p4(0) r=0 lpr=430 crt=419'429 lcod 0'0 mlcod 0'0 active+clean+snaptrim trimq=[d6~1,df~2,e6~1,e8~2] ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~32,d7~8,e1~1,e3~3]] update_snap_map remove_oid 5:84a107c4:::smithi13777483-17:d6 failed with -2 2024-03-04T06:48:19.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:19.562+0000 7f1a4b99d700 -1 osd.4 pg_epoch: 431 pg[5.as1( v 431'604 (0'0,431'604] local-lis/les=430/431 n=7 ec=72/72 lis/c=430/430 les/c/f=431/431/0 sis=430) [2,4,3]p2(0) r=1 lpr=430 luod=0'0 crt=419'600 lcod 0'0 mlcod 0'0 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~32,d7~8,e1~1,e3~3]] update_snap_map remove_oid 5:5dee4b52:::smithi13777483-2:d7 failed with -2 2024-03-04T06:48:19.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:19.564+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:19.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:19.564+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:19.847 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:19.566+0000 7f1a47995700 -1 osd.4 pg_epoch: 431 pg[5.as1( v 431'606 (0'0,431'606] local-lis/les=430/431 n=6 ec=72/72 lis/c=430/430 les/c/f=431/431/0 sis=430) [2,4,3]p2(0) r=1 lpr=430 luod=0'0 crt=431'606 mlcod 431'606 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~32,d7~8,e1~1,e3~3]] update_snap_map remove_oid 5:575813cb:::smithi13777483-1:d7 failed with -2 2024-03-04T06:48:19.847 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:19.642+0000 7f1a45190700 -1 osd.4 pg_epoch: 431 pg[5.fs1( v 431'749 (0'0,431'749] local-lis/les=430/431 n=9 ec=72/72 lis/c=430/430 les/c/f=431/431/0 sis=430) [5,4,6]p5(0) r=1 lpr=430 luod=0'0 crt=431'749 mlcod 431'749 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~3b,e1~1,e3~3]] update_snap_map remove_oid 5:f827495c:::smithi13777483-23:e0 failed with -2 2024-03-04T06:48:19.887 INFO:tasks.rados.rados.0.smithi137.stdout:1955: writing smithi13777483-44 from 12107776 to 12869632 tid 1 2024-03-04T06:48:19.889 INFO:tasks.rados.rados.0.smithi137.stdout:1955: writing smithi13777483-44 from 12869632 to 13271040 tid 2 2024-03-04T06:48:19.890 INFO:tasks.rados.rados.0.smithi137.stdout:1956: delete oid 47 current snap is 178 2024-03-04T06:48:19.890 INFO:tasks.rados.rados.0.smithi137.stdout:1952: finishing rollback tid 0 to smithi13777483-21 2024-03-04T06:48:19.890 INFO:tasks.rados.rados.0.smithi137.stdout:1951: finishing rollback tid 1 to smithi13777483-3 2024-03-04T06:48:19.890 INFO:tasks.rados.rados.0.smithi137.stdout:1951: finishing rollback tid 2 to smithi13777483-3 2024-03-04T06:48:19.890 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 15479 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-03-04T06:48:19.890 INFO:tasks.rados.rados.0.smithi137.stdout:1952: finishing rollback tid 1 to smithi13777483-21 2024-03-04T06:48:19.890 INFO:tasks.rados.rados.0.smithi137.stdout:1952: finishing rollback tid 2 to smithi13777483-21 2024-03-04T06:48:19.890 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 15483 (ObjNum 490 snap 140 seq_num 490) dirty exists 2024-03-04T06:48:19.894 INFO:tasks.rados.rados.0.smithi137.stdout:1951: done (3 left) 2024-03-04T06:48:19.894 INFO:tasks.rados.rados.0.smithi137.stdout:1952: done (2 left) 2024-03-04T06:48:19.894 INFO:tasks.rados.rados.0.smithi137.stdout:1956: done (1 left) 2024-03-04T06:48:19.894 INFO:tasks.rados.rados.0.smithi137.stdout:1957: snap_remove snap 176 2024-03-04T06:48:19.909 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:19.716+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:19.909 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[88869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:48:19.910 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[88869]: osd.4 [v2:172.21.15.203:6800/3365634036,v1:172.21.15.203:6801/3365634036] boot 2024-03-04T06:48:19.910 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[88869]: osdmap e430: 8 total, 8 up, 8 in 2024-03-04T06:48:19.910 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:48:19.910 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:19.910 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:19.910 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:19.910 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[88869]: osdmap e431: 8 total, 8 up, 8 in 2024-03-04T06:48:19.910 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:19.543+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:19.910 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:19.560+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:19.910 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:19.561+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:19.911 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[91314]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:48:19.911 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[91314]: osd.4 [v2:172.21.15.203:6800/3365634036,v1:172.21.15.203:6801/3365634036] boot 2024-03-04T06:48:19.911 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[91314]: osdmap e430: 8 total, 8 up, 8 in 2024-03-04T06:48:19.911 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T06:48:19.911 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:19.911 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:19.911 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:19.911 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-mon[91314]: osdmap e431: 8 total, 8 up, 8 in 2024-03-04T06:48:20.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:19.909+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:20.303 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:19.966+0000 7f1a49999700 -1 osd.4 pg_epoch: 431 pg[5.es0( v 431'1025 (0'0,431'1025] local-lis/les=430/431 n=10 ec=72/72 lis/c=430/430 les/c/f=431/431/0 sis=430) [4,5,0]p4(0) r=0 lpr=430 crt=431'1025 mlcod 431'1025 active+clean+snaptrim trimq=[d6~1,df~2,e6~1,e8~2] ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~32,d7~8,e1~1,e3~3]] update_snap_map remove_oid 5:753c0a1a:::smithi13777483-40:d7 failed with -2 2024-03-04T06:48:20.303 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:19.967+0000 7f1a49999700 -1 osd.4 pg_epoch: 431 pg[5.es0( v 431'1027 (0'0,431'1027] local-lis/les=430/431 n=9 ec=72/72 lis/c=430/430 les/c/f=431/431/0 sis=430) [4,5,0]p4(0) r=0 lpr=430 luod=431'1025 crt=431'1025 lcod 431'1025 mlcod 431'1025 active+clean+snaptrim trimq=[d6~1,df~2,e6~1,e8~2] ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~32,d7~8,e1~1,e3~3]] update_snap_map remove_oid 5:73db8a62:::smithi13777483-37:d9 failed with -2 2024-03-04T06:48:20.303 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:19.969+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:20.573 INFO:tasks.rados.rados.0.smithi137.stdout:1957: done (1 left) 2024-03-04T06:48:20.573 INFO:tasks.rados.rados.0.smithi137.stdout:1958: snap_remove snap 168 2024-03-04T06:48:20.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:20.566+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:20.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:20.566+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:20.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:20.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:20 smithi203 ceph-mon[85573]: pgmap v323: 121 pgs: 17 peering, 2 active+clean+snaptrim_error, 8 active+undersized+degraded, 78 active+clean, 14 active+undersized, 2 active+undersized+degraded+snaptrim_error; 322 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.5 MiB/s rd, 8.2 MiB/s wr, 13 op/s; 74/546 objects degraded (13.553%); 5.7 MiB/s, 1 objects/s recovering 2024-03-04T06:48:21.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:20.570+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:21.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:20.574+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:21.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:20.566+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:21.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:20.567+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:21.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:21.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:21.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:21.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:21.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:21.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:21.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[88869]: pgmap v323: 121 pgs: 17 peering, 2 active+clean+snaptrim_error, 8 active+undersized+degraded, 78 active+clean, 14 active+undersized, 2 active+undersized+degraded+snaptrim_error; 322 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.5 MiB/s rd, 8.2 MiB/s wr, 13 op/s; 74/546 objects degraded (13.553%); 5.7 MiB/s, 1 objects/s recovering 2024-03-04T06:48:21.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:21.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:21.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:21.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:21.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:21.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:21.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:20 smithi137 ceph-mon[91314]: pgmap v323: 121 pgs: 17 peering, 2 active+clean+snaptrim_error, 8 active+undersized+degraded, 78 active+clean, 14 active+undersized, 2 active+undersized+degraded+snaptrim_error; 322 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.5 MiB/s rd, 8.2 MiB/s wr, 13 op/s; 74/546 objects degraded (13.553%); 5.7 MiB/s, 1 objects/s recovering 2024-03-04T06:48:21.470 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:48:21.561 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:21.561 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:21.561 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:21.561 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:21.561 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:21 smithi203 ceph-mon[85573]: osdmap e432: 8 total, 8 up, 8 in 2024-03-04T06:48:21.561 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:21.561 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:21.569 INFO:tasks.rados.rados.0.smithi137.stdout:1958: done (1 left) 2024-03-04T06:48:21.569 INFO:tasks.rados.rados.0.smithi137.stdout:1959: rollback oid 38 current snap is 178 2024-03-04T06:48:21.569 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 38 to 177 2024-03-04T06:48:21.569 INFO:tasks.rados.rados.0.smithi137.stdout:1960: snap_remove snap 173 2024-03-04T06:48:21.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:21.578+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[88869]: osdmap e432: 8 total, 8 up, 8 in 2024-03-04T06:48:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[91314]: osdmap e432: 8 total, 8 up, 8 in 2024-03-04T06:48:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:21.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:21.579+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:21.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:21.579+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:21.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:21.580+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:21.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:21.571+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:21.795 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:48:21.795 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (8m) 38s ago 8m 26.4M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (8m) 3s ago 8m 86.9M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (10m) 38s ago 10m 18.6M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (10m) 3s ago 10m 20.2M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (4m) 3s ago 13m 450M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (4m) 38s ago 15m 506M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (3m) 38s ago 15m 53.0M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (3m) 3s ago 14m 43.8M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (3m) 38s ago 13m 46.8M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (8m) 38s ago 8m 17.3M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (8m) 3s ago 8m 15.7M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (2m) 38s ago 13m 208M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 bd2207652b33 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (112s) 38s ago 12m 142M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 47b5cdaad147 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (77s) 38s ago 12m 114M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 436ae07776d9 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (42s) 38s ago 12m 12.7M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9acd06dda8ec 2024-03-04T06:48:21.796 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (8s) 3s ago 11m 11.9M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9a246a0996bd 2024-03-04T06:48:21.797 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (11m) 3s ago 11m 248M 2480M 18.2.1-696-g5cc7a767 540557f94930 81d21771e157 2024-03-04T06:48:21.797 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (10m) 3s ago 10m 190M 2480M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:48:21.797 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (10m) 3s ago 10m 223M 2480M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:48:21.797 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (4m) 3s ago 9m 56.4M - 2.43.0 a07b618ecd1d 6a88bdd1023c 2024-03-04T06:48:21.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:21.574+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:21.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:21.574+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:21.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:21.579+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:22.187 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:48:22.187 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:48:22.187 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:48:22.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:48:22.187 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:48:22.187 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:48:22.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:48:22.187 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:48:22.187 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 3, 2024-03-04T06:48:22.187 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 5 2024-03-04T06:48:22.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:48:22.188 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:48:22.188 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:48:22.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:48:22.188 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:48:22.188 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 5, 2024-03-04T06:48:22.188 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 10 2024-03-04T06:48:22.188 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:48:22.188 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:48:22.583 INFO:tasks.rados.rados.0.smithi137.stdout:1960: done (2 left) 2024-03-04T06:48:22.583 INFO:tasks.rados.rados.0.smithi137.stdout:1961: read oid 45 snap -1 2024-03-04T06:48:22.583 INFO:tasks.rados.rados.0.smithi137.stdout:1961: expect (ObjNum 603 snap 172 seq_num 603) 2024-03-04T06:48:22.584 INFO:tasks.rados.rados.0.smithi137.stdout:1962: snap_create 2024-03-04T06:48:22.584 INFO:tasks.rados.rados.0.smithi137.stdout:1955: finishing write tid 1 to smithi13777483-44 2024-03-04T06:48:22.584 INFO:tasks.rados.rados.0.smithi137.stdout:1955: finishing write tid 2 to smithi13777483-44 2024-03-04T06:48:22.584 INFO:tasks.rados.rados.0.smithi137.stdout:1955: finishing write tid 3 to smithi13777483-44 2024-03-04T06:48:22.584 INFO:tasks.rados.rados.0.smithi137.stdout:1955: finishing write tid 4 to smithi13777483-44 2024-03-04T06:48:22.584 INFO:tasks.rados.rados.0.smithi137.stdout:1955: oid 44 updating version 0 to 16783 2024-03-04T06:48:22.584 INFO:tasks.rados.rados.0.smithi137.stdout:1955: oid 44 updating version 16783 to 16785 2024-03-04T06:48:22.584 INFO:tasks.rados.rados.0.smithi137.stdout:1955: oid 44 version 16785 is already newer than 16784 2024-03-04T06:48:22.584 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16785 (ObjNum 642 snap 178 seq_num 642) dirty exists 2024-03-04T06:48:22.584 INFO:tasks.rados.rados.0.smithi137.stdout:1955: left oid 44 (ObjNum 642 snap 178 seq_num 642) 2024-03-04T06:48:22.584 INFO:tasks.rados.rados.0.smithi137.stdout:1959: finishing rollback tid 0 to smithi13777483-38 2024-03-04T06:48:22.584 INFO:tasks.rados.rados.0.smithi137.stdout:1959: finishing rollback tid 1 to smithi13777483-38 2024-03-04T06:48:22.584 INFO:tasks.rados.rados.0.smithi137.stdout:1959: finishing rollback tid 2 to smithi13777483-38 2024-03-04T06:48:22.585 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 15487 (ObjNum 568 snap 159 seq_num 568) dirty exists 2024-03-04T06:48:22.624 INFO:tasks.rados.rados.0.smithi137.stdout:1961: expect (ObjNum 603 snap 172 seq_num 603) 2024-03-04T06:48:22.722 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:22.575+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:22.722 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:22.575+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:22.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:22 smithi203 ceph-mon[85573]: from='client.34293 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:48:22.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:22 smithi203 ceph-mon[85573]: osdmap e433: 8 total, 8 up, 8 in 2024-03-04T06:48:22.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:22.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:22.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:22.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:22.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:22.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:22.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:22 smithi203 ceph-mon[85573]: from='client.34299 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:48:22.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:22 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/1442756953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:22.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:22 smithi203 ceph-mon[85573]: pgmap v326: 121 pgs: 17 peering, 2 active+clean+snaptrim_error, 8 active+undersized+degraded, 78 active+clean, 14 active+undersized, 2 active+undersized+degraded+snaptrim_error; 322 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 2.9 MiB/s wr, 4 op/s; 74/546 objects degraded (13.553%); 5.7 MiB/s, 1 objects/s recovering 2024-03-04T06:48:22.892 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:22.579+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:22.892 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:22.587+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:22.892 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:22.588+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:22.893 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:22.582+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:22.893 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[88869]: from='client.34293 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:48:22.893 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[88869]: osdmap e433: 8 total, 8 up, 8 in 2024-03-04T06:48:22.893 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:22.893 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:22.893 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:22.893 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:22.893 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:22.893 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:22.893 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[88869]: from='client.34299 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:48:22.893 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/1442756953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:22.894 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[88869]: pgmap v326: 121 pgs: 17 peering, 2 active+clean+snaptrim_error, 8 active+undersized+degraded, 78 active+clean, 14 active+undersized, 2 active+undersized+degraded+snaptrim_error; 322 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 2.9 MiB/s wr, 4 op/s; 74/546 objects degraded (13.553%); 5.7 MiB/s, 1 objects/s recovering 2024-03-04T06:48:22.894 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[91314]: from='client.34293 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:48:22.894 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[91314]: osdmap e433: 8 total, 8 up, 8 in 2024-03-04T06:48:22.894 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:22.894 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:22.894 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:22.894 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:22.894 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:22.894 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:22.894 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[91314]: from='client.34299 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:48:22.894 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/1442756953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:22.894 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-mon[91314]: pgmap v326: 121 pgs: 17 peering, 2 active+clean+snaptrim_error, 8 active+undersized+degraded, 78 active+clean, 14 active+undersized, 2 active+undersized+degraded+snaptrim_error; 322 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 2.9 MiB/s wr, 4 op/s; 74/546 objects degraded (13.553%); 5.7 MiB/s, 1 objects/s recovering 2024-03-04T06:48:23.293 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:48:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:48:22.891+0000 7fca9a02c700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-03-04T06:48:23.582 INFO:tasks.rados.rados.0.smithi137.stdout:1955: done (3 left) 2024-03-04T06:48:23.582 INFO:tasks.rados.rados.0.smithi137.stdout:1959: done (2 left) 2024-03-04T06:48:23.582 INFO:tasks.rados.rados.0.smithi137.stdout:1961: done (1 left) 2024-03-04T06:48:23.582 INFO:tasks.rados.rados.0.smithi137.stdout:1962: done (0 left) 2024-03-04T06:48:23.582 INFO:tasks.rados.rados.0.smithi137.stdout:1963: delete oid 6 current snap is 179 2024-03-04T06:48:23.587 INFO:tasks.rados.rados.0.smithi137.stdout:1963: done (0 left) 2024-03-04T06:48:23.587 INFO:tasks.rados.rados.0.smithi137.stdout:1964: read oid 47 snap -1 2024-03-04T06:48:23.587 INFO:tasks.rados.rados.0.smithi137.stdout:1964: expect deleted 2024-03-04T06:48:23.587 INFO:tasks.rados.rados.0.smithi137.stdout:1965: read oid 2 snap -1 2024-03-04T06:48:23.587 INFO:tasks.rados.rados.0.smithi137.stdout:1965: expect (ObjNum 555 snap 158 seq_num 555) 2024-03-04T06:48:23.587 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 179 2024-03-04T06:48:23.587 INFO:tasks.rados.rados.0.smithi137.stdout:1966: seq_num 645 ranges {6897664=409600,7307264=778240,8085504=24576} 2024-03-04T06:48:23.626 INFO:tasks.rados.rados.0.smithi137.stdout:1966: writing smithi13777483-11 from 6897664 to 7307264 tid 1 2024-03-04T06:48:23.631 INFO:tasks.rados.rados.0.smithi137.stdout:1966: writing smithi13777483-11 from 7307264 to 8085504 tid 2 2024-03-04T06:48:23.631 INFO:tasks.rados.rados.0.smithi137.stdout:1966: writing smithi13777483-11 from 8085504 to 8110080 tid 3 2024-03-04T06:48:23.631 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 179 2024-03-04T06:48:23.631 INFO:tasks.rados.rados.0.smithi137.stdout:1967: seq_num 646 ranges {4210688=425984,4636672=655360,5292032=147456} 2024-03-04T06:48:23.656 INFO:tasks.rados.rados.0.smithi137.stdout:1967: writing smithi13777483-30 from 4210688 to 4636672 tid 1 2024-03-04T06:48:23.660 INFO:tasks.rados.rados.0.smithi137.stdout:1967: writing smithi13777483-30 from 4636672 to 5292032 tid 2 2024-03-04T06:48:23.660 INFO:tasks.rados.rados.0.smithi137.stdout:1967: writing smithi13777483-30 from 5292032 to 5439488 tid 3 2024-03-04T06:48:23.660 INFO:tasks.rados.rados.0.smithi137.stdout:1968: snap_remove snap 178 2024-03-04T06:48:23.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:23.583+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:23.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:23.584+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:23.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:23.585+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: osdmap e434: 8 total, 8 up, 8 in 2024-03-04T06:48:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:48:24.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:23.581+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:24.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:23.586+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:24.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:23.587+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:24.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:23.587+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:24.044 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:23.589+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:24.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:24.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:24.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:24.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: osdmap e434: 8 total, 8 up, 8 in 2024-03-04T06:48:24.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:24.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-03-04T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:24.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:48:24.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:24.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:24.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:24.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: osdmap e434: 8 total, 8 up, 8 in 2024-03-04T06:48:24.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:24.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:24.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:24.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:24.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:24.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:48:24.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:48:24.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:24.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:48:24.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:24.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:24.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:24.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-04T06:48:24.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-04T06:48:24.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-03-04T06:48:24.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:24.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:48:24.587 INFO:tasks.rados.rados.0.smithi137.stdout:1968: done (4 left) 2024-03-04T06:48:24.588 INFO:tasks.rados.rados.0.smithi137.stdout:1969: rollback oid 24 current snap is 179 2024-03-04T06:48:24.588 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 24 to 177 2024-03-04T06:48:24.588 INFO:tasks.rados.rados.0.smithi137.stdout:1965: expect (ObjNum 555 snap 158 seq_num 555) 2024-03-04T06:48:24.763 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:24.591+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:24.763 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:24.591+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:24.763 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:24.591+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:24.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:24.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[91314]: osdmap e435: 8 total, 8 up, 8 in 2024-03-04T06:48:24.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:24.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:24.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:24.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:24.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:24.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[91314]: pgmap v329: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 277 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 1.6 MiB/s wr, 24 op/s; 22 MiB/s, 5 objects/s recovering 2024-03-04T06:48:24.764 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:48:24.578+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 6 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:48:24.764 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:24.765 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[88869]: osdmap e435: 8 total, 8 up, 8 in 2024-03-04T06:48:24.765 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:24.765 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:24.765 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:24.765 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:24.765 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:24.765 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-mon[88869]: pgmap v329: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 277 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 1.6 MiB/s wr, 24 op/s; 22 MiB/s, 5 objects/s recovering 2024-03-04T06:48:24.813 INFO:tasks.rados.rados.0.smithi137.stdout:1966: finishing write tid 1 to smithi13777483-11 2024-03-04T06:48:24.813 INFO:tasks.rados.rados.0.smithi137.stdout:1966: finishing write tid 2 to smithi13777483-11 2024-03-04T06:48:24.813 INFO:tasks.rados.rados.0.smithi137.stdout:1966: finishing write tid 3 to smithi13777483-11 2024-03-04T06:48:24.813 INFO:tasks.rados.rados.0.smithi137.stdout:1966: finishing write tid 4 to smithi13777483-11 2024-03-04T06:48:24.813 INFO:tasks.rados.rados.0.smithi137.stdout:1966: finishing write tid 5 to smithi13777483-11 2024-03-04T06:48:24.813 INFO:tasks.rados.rados.0.smithi137.stdout:1966: oid 11 updating version 0 to 16796 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1966: oid 11 version 16796 is already newer than 16795 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1966: oid 11 version 16796 is already newer than 16793 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1966: oid 11 version 16796 is already newer than 16794 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16796 (ObjNum 645 snap 179 seq_num 645) dirty exists 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1966: left oid 11 (ObjNum 645 snap 179 seq_num 645) 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1967: finishing write tid 1 to smithi13777483-30 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1964: done (4 left) 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1965: done (3 left) 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1966: done (2 left) 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1970: read oid 34 snap -1 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1970: expect (ObjNum 639 snap 178 seq_num 639) 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1971: snap_create 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1967: finishing write tid 2 to smithi13777483-30 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1967: finishing write tid 3 to smithi13777483-30 2024-03-04T06:48:24.814 INFO:tasks.rados.rados.0.smithi137.stdout:1967: finishing write tid 4 to smithi13777483-30 2024-03-04T06:48:24.815 INFO:tasks.rados.rados.0.smithi137.stdout:1967: finishing write tid 5 to smithi13777483-30 2024-03-04T06:48:24.815 INFO:tasks.rados.rados.0.smithi137.stdout:1967: oid 30 updating version 0 to 16759 2024-03-04T06:48:24.815 INFO:tasks.rados.rados.0.smithi137.stdout:1967: oid 30 version 16759 is already newer than 16758 2024-03-04T06:48:24.815 INFO:tasks.rados.rados.0.smithi137.stdout:1967: oid 30 updating version 16759 to 16760 2024-03-04T06:48:24.815 INFO:tasks.rados.rados.0.smithi137.stdout:1967: oid 30 version 16760 is already newer than 16757 2024-03-04T06:48:24.815 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16760 (ObjNum 646 snap 179 seq_num 646) dirty exists 2024-03-04T06:48:24.815 INFO:tasks.rados.rados.0.smithi137.stdout:1967: left oid 30 (ObjNum 646 snap 179 seq_num 646) 2024-03-04T06:48:24.815 INFO:tasks.rados.rados.0.smithi137.stdout:1969: finishing rollback tid 1 to smithi13777483-24 2024-03-04T06:48:24.815 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-03-04T06:48:24.817 INFO:tasks.rados.rados.0.smithi137.stdout:1970: expect (ObjNum 639 snap 178 seq_num 639) 2024-03-04T06:48:24.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:24.587+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:24.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:24.588+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:24 smithi203 ceph-mon[85573]: osdmap e435: 8 total, 8 up, 8 in 2024-03-04T06:48:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:24 smithi203 ceph-mon[85573]: pgmap v329: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 277 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 1.6 MiB/s wr, 24 op/s; 22 MiB/s, 5 objects/s recovering 2024-03-04T06:48:25.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:24.762+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:25.584 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:48:25] "GET /metrics HTTP/1.1" 200 36280 "" "Prometheus/2.43.0" 2024-03-04T06:48:25.592 INFO:tasks.rados.rados.0.smithi137.stdout:1967: done (3 left) 2024-03-04T06:48:25.593 INFO:tasks.rados.rados.0.smithi137.stdout:1969: done (2 left) 2024-03-04T06:48:25.593 INFO:tasks.rados.rados.0.smithi137.stdout:1970: done (1 left) 2024-03-04T06:48:25.593 INFO:tasks.rados.rados.0.smithi137.stdout:1971: done (0 left) 2024-03-04T06:48:25.593 INFO:tasks.rados.rados.0.smithi137.stdout:1972: copy_from oid 21 from oid 50 current snap is 180 2024-03-04T06:48:25.593 INFO:tasks.rados.rados.0.smithi137.stdout:1973: read oid 7 snap -1 2024-03-04T06:48:25.593 INFO:tasks.rados.rados.0.smithi137.stdout:1973: expect (ObjNum 620 snap 175 seq_num 620) 2024-03-04T06:48:25.593 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 180 2024-03-04T06:48:25.593 INFO:tasks.rados.rados.0.smithi137.stdout:1974: seq_num 647 ranges {0=442368,442368=589824,1032192=212992} 2024-03-04T06:48:25.595 INFO:tasks.rados.rados.0.smithi137.stdout:1974: writing smithi13777483-9 from 0 to 442368 tid 1 2024-03-04T06:48:25.599 INFO:tasks.rados.rados.0.smithi137.stdout:1974: writing smithi13777483-9 from 442368 to 1032192 tid 2 2024-03-04T06:48:25.601 INFO:tasks.rados.rados.0.smithi137.stdout:1974: writing smithi13777483-9 from 1032192 to 1245184 tid 3 2024-03-04T06:48:25.601 INFO:tasks.rados.rados.0.smithi137.stdout:1975: snap_create 2024-03-04T06:48:25.601 INFO:tasks.rados.rados.0.smithi137.stdout:1972: finishing copy_from to smithi13777483-21 2024-03-04T06:48:25.601 INFO:tasks.rados.rados.0.smithi137.stdout:1972: got expected ENOENT (src dne) 2024-03-04T06:48:25.601 INFO:tasks.rados.rados.0.smithi137.stdout:1972: finishing copy_from racing read to smithi13777483-21 2024-03-04T06:48:25.601 INFO:tasks.rados.rados.0.smithi137.stdout:1974: finishing write tid 1 to smithi13777483-9 2024-03-04T06:48:25.605 INFO:tasks.rados.rados.0.smithi137.stdout:1973: expect (ObjNum 620 snap 175 seq_num 620) 2024-03-04T06:48:25.692 INFO:tasks.rados.rados.0.smithi137.stdout:1974: finishing write tid 2 to smithi13777483-9 2024-03-04T06:48:25.692 INFO:tasks.rados.rados.0.smithi137.stdout:1974: finishing write tid 3 to smithi13777483-9 2024-03-04T06:48:25.692 INFO:tasks.rados.rados.0.smithi137.stdout:1974: finishing write tid 4 to smithi13777483-9 2024-03-04T06:48:25.692 INFO:tasks.rados.rados.0.smithi137.stdout:1974: finishing write tid 5 to smithi13777483-9 2024-03-04T06:48:25.692 INFO:tasks.rados.rados.0.smithi137.stdout:1974: oid 9 updating version 0 to 15480 2024-03-04T06:48:25.692 INFO:tasks.rados.rados.0.smithi137.stdout:1974: oid 9 updating version 15480 to 15483 2024-03-04T06:48:25.692 INFO:tasks.rados.rados.0.smithi137.stdout:1974: oid 9 version 15483 is already newer than 15482 2024-03-04T06:48:25.692 INFO:tasks.rados.rados.0.smithi137.stdout:1974: oid 9 version 15483 is already newer than 15481 2024-03-04T06:48:25.692 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 15483 (ObjNum 647 snap 180 seq_num 647) dirty exists 2024-03-04T06:48:25.692 INFO:tasks.rados.rados.0.smithi137.stdout:1974: left oid 9 (ObjNum 647 snap 180 seq_num 647) 2024-03-04T06:48:25.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:25.592+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:25.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:25.592+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:25.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:25.592+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:25 smithi203 ceph-mon[85573]: Health check update: Possible data damage: 6 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:48:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:25 smithi203 ceph-mon[85573]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 74/546 objects degraded (13.553%), 10 pgs degraded) 2024-03-04T06:48:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:25 smithi203 ceph-mon[85573]: osdmap e436: 8 total, 8 up, 8 in 2024-03-04T06:48:25.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:25.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:25.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:25.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:25.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:25.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:26.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:25.592+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:26.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:25.604+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:26.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:25.599+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:26.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:25.600+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:26.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:25.600+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:26.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[91314]: Health check update: Possible data damage: 6 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:48:26.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[91314]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 74/546 objects degraded (13.553%), 10 pgs degraded) 2024-03-04T06:48:26.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[91314]: osdmap e436: 8 total, 8 up, 8 in 2024-03-04T06:48:26.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:26.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:26.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:26.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:26.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:26.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:26.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[88869]: Health check update: Possible data damage: 6 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:48:26.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[88869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 74/546 objects degraded (13.553%), 10 pgs degraded) 2024-03-04T06:48:26.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[88869]: osdmap e436: 8 total, 8 up, 8 in 2024-03-04T06:48:26.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:26.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:26.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:26.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:26.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:26.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:26.602 INFO:tasks.rados.rados.0.smithi137.stdout:1972: done (3 left) 2024-03-04T06:48:26.602 INFO:tasks.rados.rados.0.smithi137.stdout:1973: done (2 left) 2024-03-04T06:48:26.602 INFO:tasks.rados.rados.0.smithi137.stdout:1974: done (1 left) 2024-03-04T06:48:26.602 INFO:tasks.rados.rados.0.smithi137.stdout:1975: done (0 left) 2024-03-04T06:48:26.602 INFO:tasks.rados.rados.0.smithi137.stdout:1976: snap_remove snap 177 2024-03-04T06:48:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:26 smithi203 ceph-mon[85573]: osdmap e437: 8 total, 8 up, 8 in 2024-03-04T06:48:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:26 smithi203 ceph-mon[85573]: pgmap v332: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 278 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 1.9 MiB/s wr, 25 op/s; 22 MiB/s, 5 objects/s recovering 2024-03-04T06:48:26.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:26.597+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:26.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:26.597+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:27.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:26.600+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:27.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:26.600+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:27.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:26.643+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:27.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-mon[88869]: osdmap e437: 8 total, 8 up, 8 in 2024-03-04T06:48:27.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:27.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:27.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:27.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:27.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-mon[88869]: pgmap v332: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 278 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 1.9 MiB/s wr, 25 op/s; 22 MiB/s, 5 objects/s recovering 2024-03-04T06:48:27.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-mon[91314]: osdmap e437: 8 total, 8 up, 8 in 2024-03-04T06:48:27.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:27.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:27.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:27.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:27.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:26 smithi137 ceph-mon[91314]: pgmap v332: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 278 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 1.9 MiB/s wr, 25 op/s; 22 MiB/s, 5 objects/s recovering 2024-03-04T06:48:27.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:27.151+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:1976: done (0 left) 2024-03-04T06:48:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:1977: read oid 39 snap -1 2024-03-04T06:48:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:1977: expect deleted 2024-03-04T06:48:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:1978: read oid 18 snap -1 2024-03-04T06:48:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:1978: expect (ObjNum 490 snap 140 seq_num 490) 2024-03-04T06:48:27.604 INFO:tasks.rados.rados.0.smithi137.stdout:1979: delete oid 8 current snap is 181 2024-03-04T06:48:27.607 INFO:tasks.rados.rados.0.smithi137.stdout:1979: done (2 left) 2024-03-04T06:48:27.607 INFO:tasks.rados.rados.0.smithi137.stdout:1980: copy_from oid 28 from oid 12 current snap is 181 2024-03-04T06:48:27.607 INFO:tasks.rados.rados.0.smithi137.stdout:1981: read oid 50 snap -1 2024-03-04T06:48:27.607 INFO:tasks.rados.rados.0.smithi137.stdout:1981: expect deleted 2024-03-04T06:48:27.607 INFO:tasks.rados.rados.0.smithi137.stdout:1982: delete oid 4 current snap is 181 2024-03-04T06:48:27.615 INFO:tasks.rados.rados.0.smithi137.stdout:1977: done (4 left) 2024-03-04T06:48:27.615 INFO:tasks.rados.rados.0.smithi137.stdout:1981: done (3 left) 2024-03-04T06:48:27.615 INFO:tasks.rados.rados.0.smithi137.stdout:1982: done (2 left) 2024-03-04T06:48:27.615 INFO:tasks.rados.rados.0.smithi137.stdout:1983: snap_create 2024-03-04T06:48:27.646 INFO:tasks.rados.rados.0.smithi137.stdout:1980: finishing copy_from racing read to smithi13777483-28 2024-03-04T06:48:27.648 INFO:tasks.rados.rados.0.smithi137.stdout:1980: finishing copy_from to smithi13777483-28 2024-03-04T06:48:27.648 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16756 (ObjNum 634 snap 178 seq_num 634) dirty exists 2024-03-04T06:48:27.649 INFO:tasks.rados.rados.0.smithi137.stdout:1978: expect (ObjNum 490 snap 140 seq_num 490) 2024-03-04T06:48:28.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:27.609+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:28.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:28.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:28.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:28.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:28.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-mon[91314]: osdmap e438: 8 total, 8 up, 8 in 2024-03-04T06:48:28.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:28.044 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:27.603+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:28.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:28.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:28.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:28.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:28.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-mon[88869]: osdmap e438: 8 total, 8 up, 8 in 2024-03-04T06:48:28.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:28.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:27.612+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:28.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:27.613+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:28.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:27.613+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:28.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:28.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:28.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:28.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:28.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:27 smithi203 ceph-mon[85573]: osdmap e438: 8 total, 8 up, 8 in 2024-03-04T06:48:28.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:28.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:27.609+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:28.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:27.609+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:28.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:27.609+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:28.607 INFO:tasks.rados.rados.0.smithi137.stdout:1978: done (2 left) 2024-03-04T06:48:28.607 INFO:tasks.rados.rados.0.smithi137.stdout:1980: done (1 left) 2024-03-04T06:48:28.607 INFO:tasks.rados.rados.0.smithi137.stdout:1983: done (0 left) 2024-03-04T06:48:28.608 INFO:tasks.rados.rados.0.smithi137.stdout:1984: copy_from oid 23 from oid 20 current snap is 182 2024-03-04T06:48:28.608 INFO:tasks.rados.rados.0.smithi137.stdout:1985: rmattr oid 4 current snap is 182 2024-03-04T06:48:28.608 INFO:tasks.rados.rados.0.smithi137.stdout:1985: done (1 left) 2024-03-04T06:48:28.608 INFO:tasks.rados.rados.0.smithi137.stdout:1986: snap_create 2024-03-04T06:48:28.618 INFO:tasks.rados.rados.0.smithi137.stdout:1984: finishing copy_from racing read to smithi13777483-23 2024-03-04T06:48:28.618 INFO:tasks.rados.rados.0.smithi137.stdout:1984: finishing copy_from to smithi13777483-23 2024-03-04T06:48:28.618 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 966 (ObjNum 638 snap 178 seq_num 638) dirty exists 2024-03-04T06:48:29.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:28.607+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:29.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:28.607+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:29.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:29.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:29.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[88869]: osdmap e439: 8 total, 8 up, 8 in 2024-03-04T06:48:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[88869]: pgmap v335: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 282 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 6 op/s 2024-03-04T06:48:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[91314]: osdmap e439: 8 total, 8 up, 8 in 2024-03-04T06:48:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:28 smithi137 ceph-mon[91314]: pgmap v335: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 282 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 6 op/s 2024-03-04T06:48:29.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:28.607+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:29.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:28.608+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:29.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:29.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:29.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:29.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:29.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:28 smithi203 ceph-mon[85573]: osdmap e439: 8 total, 8 up, 8 in 2024-03-04T06:48:29.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:29.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:29.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:29.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:28 smithi203 ceph-mon[85573]: pgmap v335: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 282 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 6 op/s 2024-03-04T06:48:29.609 INFO:tasks.rados.rados.0.smithi137.stdout:1984: done (1 left) 2024-03-04T06:48:29.609 INFO:tasks.rados.rados.0.smithi137.stdout:1986: done (0 left) 2024-03-04T06:48:29.609 INFO:tasks.rados.rados.0.smithi137.stdout:1987: rollback oid 37 current snap is 183 2024-03-04T06:48:29.609 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 37 to 181 2024-03-04T06:48:29.609 INFO:tasks.rados.rados.0.smithi137.stdout:1988: read oid 25 snap -1 2024-03-04T06:48:29.609 INFO:tasks.rados.rados.0.smithi137.stdout:1988: expect (ObjNum 544 snap 155 seq_num 544) 2024-03-04T06:48:29.609 INFO:tasks.rados.rados.0.smithi137.stdout:1989: read oid 28 snap -1 2024-03-04T06:48:29.609 INFO:tasks.rados.rados.0.smithi137.stdout:1989: expect (ObjNum 634 snap 178 seq_num 634) 2024-03-04T06:48:29.609 INFO:tasks.rados.rados.0.smithi137.stdout:1990: setattr oid 36 current snap is 183 2024-03-04T06:48:29.610 INFO:tasks.rados.rados.0.smithi137.stdout:1991: setattr oid 5 current snap is 183 2024-03-04T06:48:29.611 INFO:tasks.rados.rados.0.smithi137.stdout:1992: read oid 32 snap 182 2024-03-04T06:48:29.611 INFO:tasks.rados.rados.0.smithi137.stdout:1992: expect (ObjNum 625 snap 176 seq_num 625) 2024-03-04T06:48:29.611 INFO:tasks.rados.rados.0.smithi137.stdout:1993: rmattr oid 16 current snap is 183 2024-03-04T06:48:29.611 INFO:tasks.rados.rados.0.smithi137.stdout:1993: done (6 left) 2024-03-04T06:48:29.611 INFO:tasks.rados.rados.0.smithi137.stdout:1994: snap_create 2024-03-04T06:48:29.615 INFO:tasks.rados.rados.0.smithi137.stdout:1987: finishing rollback tid 1 to smithi13777483-37 2024-03-04T06:48:29.615 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 15469 (ObjNum 2497 snap 0 seq_num 3162485312) dirty dne 2024-03-04T06:48:29.618 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 342 (ObjNum 1169 snap 0 seq_num 3130664464) dirty exists 2024-03-04T06:48:29.620 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 15484 (ObjNum 461 snap 133 seq_num 461) dirty exists 2024-03-04T06:48:29.622 INFO:tasks.rados.rados.0.smithi137.stdout:1992: expect (ObjNum 625 snap 176 seq_num 625) 2024-03-04T06:48:29.650 INFO:tasks.rados.rados.0.smithi137.stdout:1988: expect (ObjNum 544 snap 155 seq_num 544) 2024-03-04T06:48:29.762 INFO:tasks.rados.rados.0.smithi137.stdout:1989: expect (ObjNum 634 snap 178 seq_num 634) 2024-03-04T06:48:30.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:29.793+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-mon[88869]: osdmap e440: 8 total, 8 up, 8 in 2024-03-04T06:48:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:30.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:30.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:30.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:30.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-mon[91314]: osdmap e440: 8 total, 8 up, 8 in 2024-03-04T06:48:30.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:30.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:30.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:29.615+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:30.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:29.615+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:30.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:29.615+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:30.045 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:29.615+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:30.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:30.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:30.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:29 smithi203 ceph-mon[85573]: osdmap e440: 8 total, 8 up, 8 in 2024-03-04T06:48:30.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:30.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:30.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:29.609+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:30.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:29.609+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:30.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:29.610+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:30.618 INFO:tasks.rados.rados.0.smithi137.stdout:1987: done (6 left) 2024-03-04T06:48:30.618 INFO:tasks.rados.rados.0.smithi137.stdout:1988: done (5 left) 2024-03-04T06:48:30.618 INFO:tasks.rados.rados.0.smithi137.stdout:1989: done (4 left) 2024-03-04T06:48:30.618 INFO:tasks.rados.rados.0.smithi137.stdout:1990: done (3 left) 2024-03-04T06:48:30.618 INFO:tasks.rados.rados.0.smithi137.stdout:1991: done (2 left) 2024-03-04T06:48:30.618 INFO:tasks.rados.rados.0.smithi137.stdout:1992: done (1 left) 2024-03-04T06:48:30.618 INFO:tasks.rados.rados.0.smithi137.stdout:1994: done (0 left) 2024-03-04T06:48:30.618 INFO:tasks.rados.rados.0.smithi137.stdout:1995: read oid 32 snap 179 2024-03-04T06:48:30.618 INFO:tasks.rados.rados.0.smithi137.stdout:1995: expect (ObjNum 625 snap 176 seq_num 625) 2024-03-04T06:48:30.618 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 184 2024-03-04T06:48:30.618 INFO:tasks.rados.rados.0.smithi137.stdout:1996: seq_num 650 ranges {7602176=491520,8093696=647168,8740864=155648} 2024-03-04T06:48:30.661 INFO:tasks.rados.rados.0.smithi137.stdout:1996: writing smithi13777483-46 from 7602176 to 8093696 tid 1 2024-03-04T06:48:30.664 INFO:tasks.rados.rados.0.smithi137.stdout:1996: writing smithi13777483-46 from 8093696 to 8740864 tid 2 2024-03-04T06:48:30.666 INFO:tasks.rados.rados.0.smithi137.stdout:1996: writing smithi13777483-46 from 8740864 to 8896512 tid 3 2024-03-04T06:48:30.666 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 5 current snap is 184 2024-03-04T06:48:30.666 INFO:tasks.rados.rados.0.smithi137.stdout:1997: seq_num 651 ranges {4210688=507904,4718592=532480,5251072=270336} 2024-03-04T06:48:30.691 INFO:tasks.rados.rados.0.smithi137.stdout:1997: writing smithi13777483-5 from 4210688 to 4718592 tid 1 2024-03-04T06:48:30.694 INFO:tasks.rados.rados.0.smithi137.stdout:1997: writing smithi13777483-5 from 4718592 to 5251072 tid 2 2024-03-04T06:48:30.697 INFO:tasks.rados.rados.0.smithi137.stdout:1997: writing smithi13777483-5 from 5251072 to 5521408 tid 3 2024-03-04T06:48:30.697 INFO:tasks.rados.rados.0.smithi137.stdout:1998: read oid 50 snap -1 2024-03-04T06:48:30.697 INFO:tasks.rados.rados.0.smithi137.stdout:1998: expect deleted 2024-03-04T06:48:30.697 INFO:tasks.rados.rados.0.smithi137.stdout:1999: read oid 26 snap -1 2024-03-04T06:48:30.697 INFO:tasks.rados.rados.0.smithi137.stdout:1999: expect (ObjNum 570 snap 159 seq_num 570) 2024-03-04T06:48:30.697 INFO:tasks.rados.rados.0.smithi137.stdout:2000: rollback oid 15 current snap is 184 2024-03-04T06:48:30.697 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 15 to 182 2024-03-04T06:48:30.697 INFO:tasks.rados.rados.0.smithi137.stdout:1995: expect (ObjNum 625 snap 176 seq_num 625) 2024-03-04T06:48:30.725 INFO:tasks.rados.rados.0.smithi137.stdout:1996: finishing write tid 1 to smithi13777483-46 2024-03-04T06:48:30.725 INFO:tasks.rados.rados.0.smithi137.stdout:1996: finishing write tid 2 to smithi13777483-46 2024-03-04T06:48:30.725 INFO:tasks.rados.rados.0.smithi137.stdout:1996: finishing write tid 3 to smithi13777483-46 2024-03-04T06:48:30.725 INFO:tasks.rados.rados.0.smithi137.stdout:1996: finishing write tid 4 to smithi13777483-46 2024-03-04T06:48:30.725 INFO:tasks.rados.rados.0.smithi137.stdout:1996: finishing write tid 5 to smithi13777483-46 2024-03-04T06:48:30.725 INFO:tasks.rados.rados.0.smithi137.stdout:1996: oid 46 updating version 0 to 16788 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:1996: oid 46 version 16788 is already newer than 16785 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:1996: oid 46 version 16788 is already newer than 16787 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:1996: oid 46 version 16788 is already newer than 16786 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 16788 (ObjNum 650 snap 184 seq_num 650) dirty exists 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:1996: left oid 46 (ObjNum 650 snap 184 seq_num 650) 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:1997: finishing write tid 1 to smithi13777483-5 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:1995: done (5 left) 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:1996: done (4 left) 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:2001: copy_from oid 44 from oid 22 current snap is 184 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:1997: finishing write tid 2 to smithi13777483-5 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:2000: finishing rollback tid 1 to smithi13777483-15 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 0 (ObjNum 161 snap 0 seq_num 2) dirty dne 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:1997: finishing write tid 3 to smithi13777483-5 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:1997: finishing write tid 4 to smithi13777483-5 2024-03-04T06:48:30.726 INFO:tasks.rados.rados.0.smithi137.stdout:1997: finishing write tid 5 to smithi13777483-5 2024-03-04T06:48:30.727 INFO:tasks.rados.rados.0.smithi137.stdout:1997: oid 5 updating version 0 to 15487 2024-03-04T06:48:30.727 INFO:tasks.rados.rados.0.smithi137.stdout:1997: oid 5 version 15487 is already newer than 15486 2024-03-04T06:48:30.727 INFO:tasks.rados.rados.0.smithi137.stdout:1997: oid 5 updating version 15487 to 15488 2024-03-04T06:48:30.727 INFO:tasks.rados.rados.0.smithi137.stdout:1997: oid 5 version 15488 is already newer than 15485 2024-03-04T06:48:30.727 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 15488 (ObjNum 651 snap 184 seq_num 651) dirty exists 2024-03-04T06:48:30.727 INFO:tasks.rados.rados.0.smithi137.stdout:1997: left oid 5 (ObjNum 651 snap 184 seq_num 651) 2024-03-04T06:48:30.727 INFO:tasks.rados.rados.0.smithi137.stdout:1999: expect (ObjNum 570 snap 159 seq_num 570) 2024-03-04T06:48:30.988 INFO:tasks.rados.rados.0.smithi137.stdout:2001: finishing copy_from racing read to smithi13777483-44 2024-03-04T06:48:30.988 INFO:tasks.rados.rados.0.smithi137.stdout:2001: finishing copy_from to smithi13777483-44 2024-03-04T06:48:30.988 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 15478 (ObjNum 635 snap 178 seq_num 635) dirty exists 2024-03-04T06:48:30.989 INFO:tasks.rados.rados.0.smithi137.stdout:1997: done (4 left) 2024-03-04T06:48:30.989 INFO:tasks.rados.rados.0.smithi137.stdout:1998: done (3 left) 2024-03-04T06:48:30.989 INFO:tasks.rados.rados.0.smithi137.stdout:1999: done (2 left) 2024-03-04T06:48:30.989 INFO:tasks.rados.rados.0.smithi137.stdout:2000: done (1 left) 2024-03-04T06:48:30.989 INFO:tasks.rados.rados.0.smithi137.stdout:2001: done (0 left) 2024-03-04T06:48:30.989 INFO:tasks.rados.rados.0.smithi137.stdout:2002: read oid 14 snap -1 2024-03-04T06:48:30.989 INFO:tasks.rados.rados.0.smithi137.stdout:2002: expect deleted 2024-03-04T06:48:30.989 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 184 2024-03-04T06:48:30.989 INFO:tasks.rados.rados.0.smithi137.stdout:2003: seq_num 652 ranges {876544=524288,1400832=409600,1810432=393216} 2024-03-04T06:48:30.995 INFO:tasks.rados.rados.0.smithi137.stdout:2003: writing smithi13777483-32 from 876544 to 1400832 tid 1 2024-03-04T06:48:30.998 INFO:tasks.rados.rados.0.smithi137.stdout:2003: writing smithi13777483-32 from 1400832 to 1810432 tid 2 2024-03-04T06:48:31.000 INFO:tasks.rados.rados.0.smithi137.stdout:2003: writing smithi13777483-32 from 1810432 to 2203648 tid 3 2024-03-04T06:48:31.001 INFO:tasks.rados.rados.0.smithi137.stdout:2004: delete oid 9 current snap is 184 2024-03-04T06:48:31.001 INFO:tasks.rados.rados.0.smithi137.stdout:2003: finishing write tid 1 to smithi13777483-32 2024-03-04T06:48:31.001 INFO:tasks.rados.rados.0.smithi137.stdout:2003: finishing write tid 2 to smithi13777483-32 2024-03-04T06:48:31.003 INFO:tasks.rados.rados.0.smithi137.stdout:2002: done (2 left) 2024-03-04T06:48:31.003 INFO:tasks.rados.rados.0.smithi137.stdout:2004: done (1 left) 2024-03-04T06:48:31.003 INFO:tasks.rados.rados.0.smithi137.stdout:2005: setattr oid 13 current snap is 184 2024-03-04T06:48:31.003 INFO:tasks.rados.rados.0.smithi137.stdout:2003: finishing write tid 3 to smithi13777483-32 2024-03-04T06:48:31.004 INFO:tasks.rados.rados.0.smithi137.stdout:2003: finishing write tid 4 to smithi13777483-32 2024-03-04T06:48:31.004 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 184 2024-03-04T06:48:31.005 INFO:tasks.rados.rados.0.smithi137.stdout:2006: seq_num 654 ranges {9723904=557056,10280960=630784,10911744=172032} 2024-03-04T06:48:31.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:30.694+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:31.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:30.695+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:31.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:31.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:31.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[91314]: osdmap e441: 8 total, 8 up, 8 in 2024-03-04T06:48:31.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:31.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:31.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:31.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:31.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[91314]: pgmap v338: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 274 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 1.7 MiB/s wr, 6 op/s 2024-03-04T06:48:31.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:31.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:31.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[88869]: osdmap e441: 8 total, 8 up, 8 in 2024-03-04T06:48:31.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:31.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:31.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:31.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:31.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-mon[88869]: pgmap v338: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 274 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 1.7 MiB/s wr, 6 op/s 2024-03-04T06:48:31.045 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:30.736+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:31.045 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:30.621+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:31.059 INFO:tasks.rados.rados.0.smithi137.stdout:2006: writing smithi13777483-19 from 9723904 to 10280960 tid 1 2024-03-04T06:48:31.063 INFO:tasks.rados.rados.0.smithi137.stdout:2006: writing smithi13777483-19 from 10280960 to 10911744 tid 2 2024-03-04T06:48:31.064 INFO:tasks.rados.rados.0.smithi137.stdout:2006: writing smithi13777483-19 from 10911744 to 11083776 tid 3 2024-03-04T06:48:31.064 INFO:tasks.rados.rados.0.smithi137.stdout:2007: delete oid 46 current snap is 184 2024-03-04T06:48:31.064 INFO:tasks.rados.rados.0.smithi137.stdout:2003: finishing write tid 5 to smithi13777483-32 2024-03-04T06:48:31.064 INFO:tasks.rados.rados.0.smithi137.stdout:2003: oid 32 updating version 0 to 16791 2024-03-04T06:48:31.064 INFO:tasks.rados.rados.0.smithi137.stdout:2003: oid 32 updating version 16791 to 16792 2024-03-04T06:48:31.065 INFO:tasks.rados.rados.0.smithi137.stdout:2003: oid 32 version 16792 is already newer than 16789 2024-03-04T06:48:31.065 INFO:tasks.rados.rados.0.smithi137.stdout:2003: oid 32 version 16792 is already newer than 16790 2024-03-04T06:48:31.065 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16792 (ObjNum 652 snap 184 seq_num 652) dirty exists 2024-03-04T06:48:31.065 INFO:tasks.rados.rados.0.smithi137.stdout:2003: left oid 32 (ObjNum 652 snap 184 seq_num 652) 2024-03-04T06:48:31.065 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16793 (ObjNum 33 snap 0 seq_num 3132330656) dirty exists 2024-03-04T06:48:31.066 INFO:tasks.rados.rados.0.smithi137.stdout:2006: finishing write tid 1 to smithi13777483-19 2024-03-04T06:48:31.066 INFO:tasks.rados.rados.0.smithi137.stdout:2003: done (3 left) 2024-03-04T06:48:31.066 INFO:tasks.rados.rados.0.smithi137.stdout:2005: done (2 left) 2024-03-04T06:48:31.066 INFO:tasks.rados.rados.0.smithi137.stdout:2007: done (1 left) 2024-03-04T06:48:31.066 INFO:tasks.rados.rados.0.smithi137.stdout:2008: read oid 3 snap 181 2024-03-04T06:48:31.066 INFO:tasks.rados.rados.0.smithi137.stdout:2008: expect (ObjNum -1163649136 snap 21906 seq_num 3132075120) 2024-03-04T06:48:31.066 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 184 2024-03-04T06:48:31.066 INFO:tasks.rados.rados.0.smithi137.stdout:2009: seq_num 656 ranges {0=589824,589824=802816} 2024-03-04T06:48:31.069 INFO:tasks.rados.rados.0.smithi137.stdout:2009: writing smithi13777483-6 from 0 to 589824 tid 1 2024-03-04T06:48:31.074 INFO:tasks.rados.rados.0.smithi137.stdout:2009: writing smithi13777483-6 from 589824 to 1392640 tid 2 2024-03-04T06:48:31.074 INFO:tasks.rados.rados.0.smithi137.stdout:2010: snap_remove snap 180 2024-03-04T06:48:31.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:30.617+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:31.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:30.617+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:31.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:31.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:31.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:30 smithi203 ceph-mon[85573]: osdmap e441: 8 total, 8 up, 8 in 2024-03-04T06:48:31.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:31.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:31.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:31.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:31.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:30 smithi203 ceph-mon[85573]: pgmap v338: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 274 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 1.7 MiB/s wr, 6 op/s 2024-03-04T06:48:31.621 INFO:tasks.rados.rados.0.smithi137.stdout:2010: done (3 left) 2024-03-04T06:48:31.621 INFO:tasks.rados.rados.0.smithi137.stdout:2011: rmattr oid 14 current snap is 184 2024-03-04T06:48:31.621 INFO:tasks.rados.rados.0.smithi137.stdout:2011: done (3 left) 2024-03-04T06:48:31.621 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 184 2024-03-04T06:48:31.622 INFO:tasks.rados.rados.0.smithi137.stdout:2012: seq_num 657 ranges {0=606208,606208=688128,1294336=114688} 2024-03-04T06:48:31.624 INFO:tasks.rados.rados.0.smithi137.stdout:2012: writing smithi13777483-4 from 0 to 606208 tid 1 2024-03-04T06:48:31.629 INFO:tasks.rados.rados.0.smithi137.stdout:2012: writing smithi13777483-4 from 606208 to 1294336 tid 2 2024-03-04T06:48:31.630 INFO:tasks.rados.rados.0.smithi137.stdout:2012: writing smithi13777483-4 from 1294336 to 1409024 tid 3 2024-03-04T06:48:31.630 INFO:tasks.rados.rados.0.smithi137.stdout:2013: copy_from oid 41 from oid 46 current snap is 184 2024-03-04T06:48:31.630 INFO:tasks.rados.rados.0.smithi137.stdout:2006: finishing write tid 2 to smithi13777483-19 2024-03-04T06:48:31.630 INFO:tasks.rados.rados.0.smithi137.stdout:2006: finishing write tid 3 to smithi13777483-19 2024-03-04T06:48:31.630 INFO:tasks.rados.rados.0.smithi137.stdout:2006: finishing write tid 4 to smithi13777483-19 2024-03-04T06:48:31.630 INFO:tasks.rados.rados.0.smithi137.stdout:2008: expect (ObjNum -1163649136 snap 21906 seq_num 3132075120) 2024-03-04T06:48:31.632 INFO:tasks.rados.rados.0.smithi137.stdout:2006: finishing write tid 5 to smithi13777483-19 2024-03-04T06:48:31.632 INFO:tasks.rados.rados.0.smithi137.stdout:2006: oid 19 updating version 0 to 15493 2024-03-04T06:48:31.632 INFO:tasks.rados.rados.0.smithi137.stdout:2006: oid 19 version 15493 is already newer than 15491 2024-03-04T06:48:31.632 INFO:tasks.rados.rados.0.smithi137.stdout:2006: oid 19 version 15493 is already newer than 15490 2024-03-04T06:48:31.632 INFO:tasks.rados.rados.0.smithi137.stdout:2006: oid 19 version 15493 is already newer than 15492 2024-03-04T06:48:31.632 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 15493 (ObjNum 654 snap 184 seq_num 654) dirty exists 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:2006: left oid 19 (ObjNum 654 snap 184 seq_num 654) 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:2009: finishing write tid 1 to smithi13777483-6 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:2009: finishing write tid 2 to smithi13777483-6 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:2009: finishing write tid 3 to smithi13777483-6 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:2006: done (4 left) 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:2008: done (3 left) 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:2014: delete oid 43 current snap is 184 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:2009: finishing write tid 4 to smithi13777483-6 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:2009: oid 6 updating version 0 to 15481 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:2009: oid 6 version 15481 is already newer than 15480 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:2009: oid 6 updating version 15481 to 15482 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 15482 (ObjNum 656 snap 184 seq_num 656) dirty exists 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:2009: left oid 6 (ObjNum 656 snap 184 seq_num 656) 2024-03-04T06:48:31.633 INFO:tasks.rados.rados.0.smithi137.stdout:2012: finishing write tid 1 to smithi13777483-4 2024-03-04T06:48:31.635 INFO:tasks.rados.rados.0.smithi137.stdout:2012: finishing write tid 2 to smithi13777483-4 2024-03-04T06:48:31.635 INFO:tasks.rados.rados.0.smithi137.stdout:2009: done (3 left) 2024-03-04T06:48:31.635 INFO:tasks.rados.rados.0.smithi137.stdout:2014: done (2 left) 2024-03-04T06:48:31.635 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 184 2024-03-04T06:48:31.635 INFO:tasks.rados.rados.0.smithi137.stdout:2015: seq_num 659 ranges {9134080=647168,9781248=450560,10231808=352256} 2024-03-04T06:48:31.688 INFO:tasks.rados.rados.0.smithi137.stdout:2015: writing smithi13777483-45 from 9134080 to 9781248 tid 1 2024-03-04T06:48:31.691 INFO:tasks.rados.rados.0.smithi137.stdout:2015: writing smithi13777483-45 from 9781248 to 10231808 tid 2 2024-03-04T06:48:31.693 INFO:tasks.rados.rados.0.smithi137.stdout:2015: writing smithi13777483-45 from 10231808 to 10584064 tid 3 2024-03-04T06:48:31.693 INFO:tasks.rados.rados.0.smithi137.stdout:2016: snap_remove snap 183 2024-03-04T06:48:31.997 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:31.622+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:31.998 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:31.622+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:31.998 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:31.622+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:31.998 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:31.998 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:31.998 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:31 smithi203 ceph-mon[85573]: osdmap e442: 8 total, 8 up, 8 in 2024-03-04T06:48:31.998 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:31.998 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:31.998 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:31.998 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:31.998 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:31.998 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:32.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:31.621+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:32.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:31.627+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:32.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:31.631+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:32.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:31.631+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:32.044 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:31.632+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:32.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:32.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:32.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[91314]: osdmap e442: 8 total, 8 up, 8 in 2024-03-04T06:48:32.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:32.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:32.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:32.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:32.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:32.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[88869]: osdmap e442: 8 total, 8 up, 8 in 2024-03-04T06:48:32.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:32.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:32.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:32.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:32.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:32.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:32.629 INFO:tasks.rados.rados.0.smithi137.stdout:2016: done (3 left) 2024-03-04T06:48:32.629 INFO:tasks.rados.rados.0.smithi137.stdout:2017: delete oid 22 current snap is 184 2024-03-04T06:48:32.629 INFO:tasks.rados.rados.0.smithi137.stdout:2013: finishing copy_from to smithi13777483-41 2024-03-04T06:48:32.629 INFO:tasks.rados.rados.0.smithi137.stdout:2013: got expected ENOENT (src dne) 2024-03-04T06:48:32.629 INFO:tasks.rados.rados.0.smithi137.stdout:2013: finishing copy_from racing read to smithi13777483-41 2024-03-04T06:48:32.629 INFO:tasks.rados.rados.0.smithi137.stdout:2012: finishing write tid 3 to smithi13777483-4 2024-03-04T06:48:32.629 INFO:tasks.rados.rados.0.smithi137.stdout:2012: finishing write tid 4 to smithi13777483-4 2024-03-04T06:48:32.629 INFO:tasks.rados.rados.0.smithi137.stdout:2012: finishing write tid 5 to smithi13777483-4 2024-03-04T06:48:32.629 INFO:tasks.rados.rados.0.smithi137.stdout:2012: oid 4 updating version 0 to 165 2024-03-04T06:48:32.629 INFO:tasks.rados.rados.0.smithi137.stdout:2012: oid 4 updating version 165 to 168 2024-03-04T06:48:32.629 INFO:tasks.rados.rados.0.smithi137.stdout:2012: oid 4 version 168 is already newer than 166 2024-03-04T06:48:32.629 INFO:tasks.rados.rados.0.smithi137.stdout:2012: oid 4 version 168 is already newer than 167 2024-03-04T06:48:32.630 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 168 (ObjNum 657 snap 184 seq_num 657) dirty exists 2024-03-04T06:48:32.630 INFO:tasks.rados.rados.0.smithi137.stdout:2012: left oid 4 (ObjNum 657 snap 184 seq_num 657) 2024-03-04T06:48:32.630 INFO:tasks.rados.rados.0.smithi137.stdout:2015: finishing write tid 1 to smithi13777483-45 2024-03-04T06:48:32.630 INFO:tasks.rados.rados.0.smithi137.stdout:2015: finishing write tid 2 to smithi13777483-45 2024-03-04T06:48:32.630 INFO:tasks.rados.rados.0.smithi137.stdout:2015: finishing write tid 3 to smithi13777483-45 2024-03-04T06:48:32.630 INFO:tasks.rados.rados.0.smithi137.stdout:2015: finishing write tid 4 to smithi13777483-45 2024-03-04T06:48:32.630 INFO:tasks.rados.rados.0.smithi137.stdout:2015: finishing write tid 5 to smithi13777483-45 2024-03-04T06:48:32.630 INFO:tasks.rados.rados.0.smithi137.stdout:2015: oid 45 updating version 0 to 15459 2024-03-04T06:48:32.630 INFO:tasks.rados.rados.0.smithi137.stdout:2015: oid 45 updating version 15459 to 15460 2024-03-04T06:48:32.630 INFO:tasks.rados.rados.0.smithi137.stdout:2015: oid 45 updating version 15460 to 15461 2024-03-04T06:48:32.630 INFO:tasks.rados.rados.0.smithi137.stdout:2015: oid 45 updating version 15461 to 15462 2024-03-04T06:48:32.630 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 15462 (ObjNum 659 snap 184 seq_num 659) dirty exists 2024-03-04T06:48:32.630 INFO:tasks.rados.rados.0.smithi137.stdout:2015: left oid 45 (ObjNum 659 snap 184 seq_num 659) 2024-03-04T06:48:32.634 INFO:tasks.rados.rados.0.smithi137.stdout:2012: done (3 left) 2024-03-04T06:48:32.634 INFO:tasks.rados.rados.0.smithi137.stdout:2013: done (2 left) 2024-03-04T06:48:32.635 INFO:tasks.rados.rados.0.smithi137.stdout:2015: done (1 left) 2024-03-04T06:48:32.635 INFO:tasks.rados.rados.0.smithi137.stdout:2017: done (0 left) 2024-03-04T06:48:32.635 INFO:tasks.rados.rados.0.smithi137.stdout:2018: setattr oid 22 current snap is 184 2024-03-04T06:48:32.636 INFO:tasks.rados.rados.0.smithi137.stdout:2019: snap_create 2024-03-04T06:48:32.639 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 15484 (ObjNum 1169 snap 0 seq_num 3130664464) dirty exists 2024-03-04T06:48:33.013 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:32.629+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:33.013 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:32.631+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:33.014 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:32 smithi203 ceph-mon[85573]: osdmap e443: 8 total, 8 up, 8 in 2024-03-04T06:48:33.014 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:33.014 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:33.014 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:33.014 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:33.014 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:33.014 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:33.014 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:32 smithi203 ceph-mon[85573]: pgmap v341: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 274 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 266 KiB/s wr, 1 op/s 2024-03-04T06:48:33.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:32.633+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:33.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:32.633+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:33.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:32.632+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:33.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:32.626+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[88869]: osdmap e443: 8 total, 8 up, 8 in 2024-03-04T06:48:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[88869]: pgmap v341: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 274 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 266 KiB/s wr, 1 op/s 2024-03-04T06:48:33.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[91314]: osdmap e443: 8 total, 8 up, 8 in 2024-03-04T06:48:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:32 smithi137 ceph-mon[91314]: pgmap v341: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 274 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 266 KiB/s wr, 1 op/s 2024-03-04T06:48:33.630 INFO:tasks.rados.rados.0.smithi137.stdout:2018: done (1 left) 2024-03-04T06:48:33.631 INFO:tasks.rados.rados.0.smithi137.stdout:2019: done (0 left) 2024-03-04T06:48:33.631 INFO:tasks.rados.rados.0.smithi137.stdout:2020: snap_remove snap 182 2024-03-04T06:48:34.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:33.860+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:34.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:33.860+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:34.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:34.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[88869]: osdmap e444: 8 total, 8 up, 8 in 2024-03-04T06:48:34.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:34.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:34.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:34.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:34.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:34.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:34.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:34.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[91314]: osdmap e444: 8 total, 8 up, 8 in 2024-03-04T06:48:34.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:34.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:34.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:34.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:34.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:34.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:34.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:33.861+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:34.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:33.861+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:34.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:33.861+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:34.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:33.629+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:34.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:33.629+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:34.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:33.629+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:34.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:34.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:33 smithi203 ceph-mon[85573]: osdmap e444: 8 total, 8 up, 8 in 2024-03-04T06:48:34.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:34.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:34.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:34.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:34.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:34.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:33 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:34.631 INFO:tasks.rados.rados.0.smithi137.stdout:2020: done (0 left) 2024-03-04T06:48:34.631 INFO:tasks.rados.rados.0.smithi137.stdout:2021: read oid 8 snap -1 2024-03-04T06:48:34.631 INFO:tasks.rados.rados.0.smithi137.stdout:2021: expect deleted 2024-03-04T06:48:34.631 INFO:tasks.rados.rados.0.smithi137.stdout:2022: read oid 35 snap -1 2024-03-04T06:48:34.631 INFO:tasks.rados.rados.0.smithi137.stdout:2022: expect (ObjNum 584 snap 167 seq_num 584) 2024-03-04T06:48:34.631 INFO:tasks.rados.rados.0.smithi137.stdout:2023: rollback oid 48 current snap is 185 2024-03-04T06:48:34.631 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 48 to 179 2024-03-04T06:48:34.632 INFO:tasks.rados.rados.0.smithi137.stdout:2024: read oid 42 snap -1 2024-03-04T06:48:34.632 INFO:tasks.rados.rados.0.smithi137.stdout:2024: expect deleted 2024-03-04T06:48:34.632 INFO:tasks.rados.rados.0.smithi137.stdout:2025: snap_create 2024-03-04T06:48:34.641 INFO:tasks.rados.rados.0.smithi137.stdout:2023: finishing rollback tid 0 to smithi13777483-48 2024-03-04T06:48:34.641 INFO:tasks.rados.rados.0.smithi137.stdout:2023: finishing rollback tid 1 to smithi13777483-48 2024-03-04T06:48:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:2023: finishing rollback tid 2 to smithi13777483-48 2024-03-04T06:48:34.642 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 15470 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:48:34.687 INFO:tasks.rados.rados.0.smithi137.stdout:2022: expect (ObjNum 584 snap 167 seq_num 584) 2024-03-04T06:48:35.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:34.636+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:35.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:34.634+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:35.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:34.636+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:35.044 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:34.637+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:35.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[88869]: osdmap e445: 8 total, 8 up, 8 in 2024-03-04T06:48:35.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:35.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:35.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:35.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:35.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:35.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:35.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[88869]: pgmap v344: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 284 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 2.7 MiB/s wr, 31 op/s 2024-03-04T06:48:35.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[88869]: osdmap e446: 8 total, 8 up, 8 in 2024-03-04T06:48:35.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[91314]: osdmap e445: 8 total, 8 up, 8 in 2024-03-04T06:48:35.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:35.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:35.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:35.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:35.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:35.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:35.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[91314]: pgmap v344: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 284 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 2.7 MiB/s wr, 31 op/s 2024-03-04T06:48:35.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:34 smithi137 ceph-mon[91314]: osdmap e446: 8 total, 8 up, 8 in 2024-03-04T06:48:35.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:34.628+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:35.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:34.629+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:35.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:34 smithi203 ceph-mon[85573]: osdmap e445: 8 total, 8 up, 8 in 2024-03-04T06:48:35.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:35.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:35.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:35.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:35.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:35.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:35.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:34 smithi203 ceph-mon[85573]: pgmap v344: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 284 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 2.7 MiB/s wr, 31 op/s 2024-03-04T06:48:35.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:34 smithi203 ceph-mon[85573]: osdmap e446: 8 total, 8 up, 8 in 2024-03-04T06:48:35.637 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:48:35] "GET /metrics HTTP/1.1" 200 36280 "" "Prometheus/2.43.0" 2024-03-04T06:48:35.714 INFO:tasks.rados.rados.0.smithi137.stdout:2021: done (4 left) 2024-03-04T06:48:35.714 INFO:tasks.rados.rados.0.smithi137.stdout:2022: done (3 left) 2024-03-04T06:48:35.714 INFO:tasks.rados.rados.0.smithi137.stdout:2023: done (2 left) 2024-03-04T06:48:35.714 INFO:tasks.rados.rados.0.smithi137.stdout:2024: done (1 left) 2024-03-04T06:48:35.714 INFO:tasks.rados.rados.0.smithi137.stdout:2025: done (0 left) 2024-03-04T06:48:35.714 INFO:tasks.rados.rados.0.smithi137.stdout:2026: delete oid 37 current snap is 186 2024-03-04T06:48:35.717 INFO:tasks.rados.rados.0.smithi137.stdout:2026: done (0 left) 2024-03-04T06:48:35.717 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 186 2024-03-04T06:48:35.717 INFO:tasks.rados.rados.0.smithi137.stdout:2027: seq_num 662 ranges {1409024=696320,2105344=557056,2662400=245760} 2024-03-04T06:48:35.728 INFO:tasks.rados.rados.0.smithi137.stdout:2027: writing smithi13777483-4 from 1409024 to 2105344 tid 1 2024-03-04T06:48:35.732 INFO:tasks.rados.rados.0.smithi137.stdout:2027: writing smithi13777483-4 from 2105344 to 2662400 tid 2 2024-03-04T06:48:35.733 INFO:tasks.rados.rados.0.smithi137.stdout:2027: writing smithi13777483-4 from 2662400 to 2908160 tid 3 2024-03-04T06:48:35.733 INFO:tasks.rados.rados.0.smithi137.stdout:2028: snap_create 2024-03-04T06:48:35.733 INFO:tasks.rados.rados.0.smithi137.stdout:2027: finishing write tid 1 to smithi13777483-4 2024-03-04T06:48:35.735 INFO:tasks.rados.rados.0.smithi137.stdout:2027: finishing write tid 2 to smithi13777483-4 2024-03-04T06:48:35.735 INFO:tasks.rados.rados.0.smithi137.stdout:2027: finishing write tid 3 to smithi13777483-4 2024-03-04T06:48:35.735 INFO:tasks.rados.rados.0.smithi137.stdout:2027: finishing write tid 4 to smithi13777483-4 2024-03-04T06:48:35.736 INFO:tasks.rados.rados.0.smithi137.stdout:2027: finishing write tid 5 to smithi13777483-4 2024-03-04T06:48:35.736 INFO:tasks.rados.rados.0.smithi137.stdout:2027: oid 4 updating version 0 to 169 2024-03-04T06:48:35.737 INFO:tasks.rados.rados.0.smithi137.stdout:2027: oid 4 updating version 169 to 172 2024-03-04T06:48:35.737 INFO:tasks.rados.rados.0.smithi137.stdout:2027: oid 4 version 172 is already newer than 170 2024-03-04T06:48:35.737 INFO:tasks.rados.rados.0.smithi137.stdout:2027: oid 4 version 172 is already newer than 171 2024-03-04T06:48:35.737 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 172 (ObjNum 662 snap 186 seq_num 662) dirty exists 2024-03-04T06:48:35.737 INFO:tasks.rados.rados.0.smithi137.stdout:2027: left oid 4 (ObjNum 662 snap 186 seq_num 662) 2024-03-04T06:48:36.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:35.717+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:36.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:35.717+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:36.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:35.717+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:36.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:35.635+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:36.044 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:35.732+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:36.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:36.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:36.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:36.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:36.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:36.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:36.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[88869]: osdmap e447: 8 total, 8 up, 8 in 2024-03-04T06:48:36.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:36.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:36.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:36.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:36.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:36.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:36.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:35 smithi137 ceph-mon[91314]: osdmap e447: 8 total, 8 up, 8 in 2024-03-04T06:48:36.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:36.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:36.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:36.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:36.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:36.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:36.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:35 smithi203 ceph-mon[85573]: osdmap e447: 8 total, 8 up, 8 in 2024-03-04T06:48:36.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:35.629+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:36.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:35.629+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:36.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:35.629+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:36.660 INFO:tasks.rados.rados.0.smithi137.stdout:2027: done (1 left) 2024-03-04T06:48:36.660 INFO:tasks.rados.rados.0.smithi137.stdout:2028: done (0 left) 2024-03-04T06:48:36.660 INFO:tasks.rados.rados.0.smithi137.stdout:2029: read oid 39 snap 179 2024-03-04T06:48:36.660 INFO:tasks.rados.rados.0.smithi137.stdout:2029: expect deleted 2024-03-04T06:48:36.660 INFO:tasks.rados.rados.0.smithi137.stdout:2030: snap_remove snap 184 2024-03-04T06:48:37.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:36.804+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:37.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:37.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[88869]: pgmap v347: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 284 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 2.7 MiB/s wr, 31 op/s 2024-03-04T06:48:37.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:37.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:37.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:37.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:37.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-mon[91314]: pgmap v347: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 284 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 2.7 MiB/s wr, 31 op/s 2024-03-04T06:48:37.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:36.795+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:37.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:36.795+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:37.045 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:36.805+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:37.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:36.654+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:37.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:36.654+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:37.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:37.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:37.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:37.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:37.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:36 smithi203 ceph-mon[85573]: pgmap v347: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 284 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 2.7 MiB/s wr, 31 op/s 2024-03-04T06:48:37.664 INFO:tasks.rados.rados.0.smithi137.stdout:2030: done (1 left) 2024-03-04T06:48:37.664 INFO:tasks.rados.rados.0.smithi137.stdout:2031: read oid 22 snap -1 2024-03-04T06:48:37.664 INFO:tasks.rados.rados.0.smithi137.stdout:2031: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:48:37.665 INFO:tasks.rados.rados.0.smithi137.stdout:2032: setattr oid 41 current snap is 187 2024-03-04T06:48:37.667 INFO:tasks.rados.rados.0.smithi137.stdout:2031: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:48:37.668 INFO:tasks.rados.rados.0.smithi137.stdout:2029: done (2 left) 2024-03-04T06:48:37.668 INFO:tasks.rados.rados.0.smithi137.stdout:2031: done (1 left) 2024-03-04T06:48:37.669 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 28 current snap is 187 2024-03-04T06:48:37.669 INFO:tasks.rados.rados.0.smithi137.stdout:2033: seq_num 663 ranges {4751360=712704,5464064=442368,5906432=360448} 2024-03-04T06:48:37.698 INFO:tasks.rados.rados.0.smithi137.stdout:2033: writing smithi13777483-28 from 4751360 to 5464064 tid 1 2024-03-04T06:48:37.700 INFO:tasks.rados.rados.0.smithi137.stdout:2033: writing smithi13777483-28 from 5464064 to 5906432 tid 2 2024-03-04T06:48:37.703 INFO:tasks.rados.rados.0.smithi137.stdout:2033: writing smithi13777483-28 from 5906432 to 6266880 tid 3 2024-03-04T06:48:37.703 INFO:tasks.rados.rados.0.smithi137.stdout:2034: setattr oid 5 current snap is 187 2024-03-04T06:48:37.703 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 15463 (ObjNum 631 snap 177 seq_num 631) dirty exists 2024-03-04T06:48:37.704 INFO:tasks.rados.rados.0.smithi137.stdout:2033: finishing write tid 1 to smithi13777483-28 2024-03-04T06:48:37.706 INFO:tasks.rados.rados.0.smithi137.stdout:2033: finishing write tid 2 to smithi13777483-28 2024-03-04T06:48:37.707 INFO:tasks.rados.rados.0.smithi137.stdout:2033: finishing write tid 3 to smithi13777483-28 2024-03-04T06:48:37.707 INFO:tasks.rados.rados.0.smithi137.stdout:2032: done (2 left) 2024-03-04T06:48:37.707 INFO:tasks.rados.rados.0.smithi137.stdout:2035: rmattr oid 47 current snap is 187 2024-03-04T06:48:37.707 INFO:tasks.rados.rados.0.smithi137.stdout:2035: done (2 left) 2024-03-04T06:48:37.707 INFO:tasks.rados.rados.0.smithi137.stdout:2036: snap_create 2024-03-04T06:48:37.707 INFO:tasks.rados.rados.0.smithi137.stdout:2033: finishing write tid 4 to smithi13777483-28 2024-03-04T06:48:37.709 INFO:tasks.rados.rados.0.smithi137.stdout:2033: finishing write tid 5 to smithi13777483-28 2024-03-04T06:48:37.709 INFO:tasks.rados.rados.0.smithi137.stdout:2033: oid 28 updating version 0 to 16757 2024-03-04T06:48:37.709 INFO:tasks.rados.rados.0.smithi137.stdout:2033: oid 28 updating version 16757 to 16758 2024-03-04T06:48:37.709 INFO:tasks.rados.rados.0.smithi137.stdout:2033: oid 28 updating version 16758 to 16760 2024-03-04T06:48:37.709 INFO:tasks.rados.rados.0.smithi137.stdout:2033: oid 28 version 16760 is already newer than 16759 2024-03-04T06:48:37.709 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16760 (ObjNum 663 snap 187 seq_num 663) dirty exists 2024-03-04T06:48:37.710 INFO:tasks.rados.rados.0.smithi137.stdout:2033: left oid 28 (ObjNum 663 snap 187 seq_num 663) 2024-03-04T06:48:37.711 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 15494 (ObjNum 651 snap 184 seq_num 651) dirty exists 2024-03-04T06:48:38.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:38.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:38.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[88869]: osdmap e448: 8 total, 8 up, 8 in 2024-03-04T06:48:38.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:38.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:38.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:38.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:38.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:38.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:38.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[91314]: osdmap e448: 8 total, 8 up, 8 in 2024-03-04T06:48:38.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:38.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:38.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:38.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:38.045 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:37.667+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:38.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:37.702+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:38.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:37.702+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:38.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:37.702+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:38.045 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:37.667+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:38.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:37.662+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:38.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:37.662+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:38.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:37.662+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:38.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:38.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:38.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:37 smithi203 ceph-mon[85573]: osdmap e448: 8 total, 8 up, 8 in 2024-03-04T06:48:38.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:38.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:38.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:38.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:38.674 INFO:tasks.rados.rados.0.smithi137.stdout:2033: done (2 left) 2024-03-04T06:48:38.674 INFO:tasks.rados.rados.0.smithi137.stdout:2034: done (1 left) 2024-03-04T06:48:38.674 INFO:tasks.rados.rados.0.smithi137.stdout:2036: done (0 left) 2024-03-04T06:48:38.674 INFO:tasks.rados.rados.0.smithi137.stdout:2037: read oid 44 snap 186 2024-03-04T06:48:38.674 INFO:tasks.rados.rados.0.smithi137.stdout:2037: expect (ObjNum 635 snap 178 seq_num 635) 2024-03-04T06:48:38.674 INFO:tasks.rados.rados.0.smithi137.stdout:2038: delete oid 39 current snap is 188 2024-03-04T06:48:38.676 INFO:tasks.rados.rados.0.smithi137.stdout:2038: done (1 left) 2024-03-04T06:48:38.676 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 188 2024-03-04T06:48:38.676 INFO:tasks.rados.rados.0.smithi137.stdout:2039: seq_num 665 ranges {6086656=745472,6832128=606208,7438336=196608} 2024-03-04T06:48:38.712 INFO:tasks.rados.rados.0.smithi137.stdout:2039: writing smithi13777483-26 from 6086656 to 6832128 tid 1 2024-03-04T06:48:38.716 INFO:tasks.rados.rados.0.smithi137.stdout:2039: writing smithi13777483-26 from 6832128 to 7438336 tid 2 2024-03-04T06:48:38.718 INFO:tasks.rados.rados.0.smithi137.stdout:2039: writing smithi13777483-26 from 7438336 to 7634944 tid 3 2024-03-04T06:48:38.718 INFO:tasks.rados.rados.0.smithi137.stdout:2040: snap_remove snap 179 2024-03-04T06:48:38.767 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:38.671+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:38.767 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:38.672+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:38.767 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:38.767 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:38.767 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-mon[85573]: osdmap e449: 8 total, 8 up, 8 in 2024-03-04T06:48:38.767 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:38.767 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:38.767 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:38.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:38.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-04T06:48:38.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-04T06:48:38.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-mon[85573]: Upgrade: osd.5 is safe to restart 2024-03-04T06:48:38.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-mon[85573]: pgmap v350: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 287 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 736 KiB/s wr, 13 op/s 2024-03-04T06:48:38.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:38.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:48:39.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:38.679+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:39.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:38.677+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:39.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:38.679+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:39.044 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:38.907+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:39.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:39.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:39.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[91314]: osdmap e449: 8 total, 8 up, 8 in 2024-03-04T06:48:39.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[91314]: Upgrade: osd.5 is safe to restart 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[91314]: pgmap v350: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 287 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 736 KiB/s wr, 13 op/s 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[88869]: osdmap e449: 8 total, 8 up, 8 in 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:39.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:39.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:39.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:39.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-04T06:48:39.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-04T06:48:39.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[88869]: Upgrade: osd.5 is safe to restart 2024-03-04T06:48:39.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[88869]: pgmap v350: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 287 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 736 KiB/s wr, 13 op/s 2024-03-04T06:48:39.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:39.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:48:39.677 INFO:tasks.rados.rados.0.smithi137.stdout:2040: done (2 left) 2024-03-04T06:48:39.677 INFO:tasks.rados.rados.0.smithi137.stdout:2041: read oid 10 snap -1 2024-03-04T06:48:39.677 INFO:tasks.rados.rados.0.smithi137.stdout:2041: expect (ObjNum 632 snap 177 seq_num 632) 2024-03-04T06:48:39.677 INFO:tasks.rados.rados.0.smithi137.stdout:2042: read oid 23 snap -1 2024-03-04T06:48:39.677 INFO:tasks.rados.rados.0.smithi137.stdout:2042: expect (ObjNum 638 snap 178 seq_num 638) 2024-03-04T06:48:39.677 INFO:tasks.rados.rados.0.smithi137.stdout:2043: rmattr oid 39 current snap is 188 2024-03-04T06:48:39.677 INFO:tasks.rados.rados.0.smithi137.stdout:2037: expect (ObjNum 635 snap 178 seq_num 635) 2024-03-04T06:48:39.741 INFO:tasks.rados.rados.0.smithi137.stdout:2039: finishing write tid 1 to smithi13777483-26 2024-03-04T06:48:39.741 INFO:tasks.rados.rados.0.smithi137.stdout:2039: finishing write tid 2 to smithi13777483-26 2024-03-04T06:48:39.741 INFO:tasks.rados.rados.0.smithi137.stdout:2037: done (4 left) 2024-03-04T06:48:39.741 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 188 2024-03-04T06:48:39.741 INFO:tasks.rados.rados.0.smithi137.stdout:2039: finishing write tid 3 to smithi13777483-26 2024-03-04T06:48:39.741 INFO:tasks.rados.rados.0.smithi137.stdout:2044: seq_num 666 ranges {0=761856,761856=491520,1253376=311296} 2024-03-04T06:48:39.744 INFO:tasks.rados.rados.0.smithi137.stdout:2044: writing smithi13777483-13 from 0 to 761856 tid 1 2024-03-04T06:48:39.747 INFO:tasks.rados.rados.0.smithi137.stdout:2044: writing smithi13777483-13 from 761856 to 1253376 tid 2 2024-03-04T06:48:39.750 INFO:tasks.rados.rados.0.smithi137.stdout:2044: writing smithi13777483-13 from 1253376 to 1564672 tid 3 2024-03-04T06:48:39.750 INFO:tasks.rados.rados.0.smithi137.stdout:2045: delete oid 31 current snap is 188 2024-03-04T06:48:39.750 INFO:tasks.rados.rados.0.smithi137.stdout:2039: finishing write tid 4 to smithi13777483-26 2024-03-04T06:48:39.750 INFO:tasks.rados.rados.0.smithi137.stdout:2039: finishing write tid 5 to smithi13777483-26 2024-03-04T06:48:39.750 INFO:tasks.rados.rados.0.smithi137.stdout:2039: oid 26 updating version 0 to 16777 2024-03-04T06:48:39.750 INFO:tasks.rados.rados.0.smithi137.stdout:2039: oid 26 updating version 16777 to 16779 2024-03-04T06:48:39.750 INFO:tasks.rados.rados.0.smithi137.stdout:2039: oid 26 updating version 16779 to 16780 2024-03-04T06:48:39.751 INFO:tasks.rados.rados.0.smithi137.stdout:2039: oid 26 version 16780 is already newer than 16778 2024-03-04T06:48:39.751 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16780 (ObjNum 665 snap 188 seq_num 665) dirty exists 2024-03-04T06:48:39.751 INFO:tasks.rados.rados.0.smithi137.stdout:2039: left oid 26 (ObjNum 665 snap 188 seq_num 665) 2024-03-04T06:48:39.751 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 0 (ObjNum 33 snap 0 seq_num 3130855696) dirty dne 2024-03-04T06:48:39.751 INFO:tasks.rados.rados.0.smithi137.stdout:2042: expect (ObjNum 638 snap 178 seq_num 638) 2024-03-04T06:48:39.780 INFO:tasks.rados.rados.0.smithi137.stdout:2041: expect (ObjNum 632 snap 177 seq_num 632) 2024-03-04T06:48:39.807 INFO:tasks.rados.rados.0.smithi137.stdout:2044: finishing write tid 1 to smithi13777483-13 2024-03-04T06:48:39.807 INFO:tasks.rados.rados.0.smithi137.stdout:2044: finishing write tid 2 to smithi13777483-13 2024-03-04T06:48:39.807 INFO:tasks.rados.rados.0.smithi137.stdout:2044: finishing write tid 3 to smithi13777483-13 2024-03-04T06:48:39.807 INFO:tasks.rados.rados.0.smithi137.stdout:2044: finishing write tid 4 to smithi13777483-13 2024-03-04T06:48:39.807 INFO:tasks.rados.rados.0.smithi137.stdout:2044: finishing write tid 5 to smithi13777483-13 2024-03-04T06:48:39.807 INFO:tasks.rados.rados.0.smithi137.stdout:2044: oid 13 updating version 0 to 16796 2024-03-04T06:48:39.808 INFO:tasks.rados.rados.0.smithi137.stdout:2044: oid 13 updating version 16796 to 16798 2024-03-04T06:48:39.808 INFO:tasks.rados.rados.0.smithi137.stdout:2044: oid 13 version 16798 is already newer than 16795 2024-03-04T06:48:39.808 INFO:tasks.rados.rados.0.smithi137.stdout:2044: oid 13 version 16798 is already newer than 16797 2024-03-04T06:48:39.808 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16798 (ObjNum 666 snap 188 seq_num 666) dirty exists 2024-03-04T06:48:39.808 INFO:tasks.rados.rados.0.smithi137.stdout:2044: left oid 13 (ObjNum 666 snap 188 seq_num 666) 2024-03-04T06:48:39.808 INFO:tasks.rados.rados.0.smithi137.stdout:2039: done (5 left) 2024-03-04T06:48:39.808 INFO:tasks.rados.rados.0.smithi137.stdout:2041: done (4 left) 2024-03-04T06:48:39.808 INFO:tasks.rados.rados.0.smithi137.stdout:2042: done (3 left) 2024-03-04T06:48:39.808 INFO:tasks.rados.rados.0.smithi137.stdout:2043: done (2 left) 2024-03-04T06:48:39.808 INFO:tasks.rados.rados.0.smithi137.stdout:2044: done (1 left) 2024-03-04T06:48:39.808 INFO:tasks.rados.rados.0.smithi137.stdout:2045: done (0 left) 2024-03-04T06:48:39.808 INFO:tasks.rados.rados.0.smithi137.stdout:2046: setattr oid 40 current snap is 188 2024-03-04T06:48:39.809 INFO:tasks.rados.rados.0.smithi137.stdout:2047: read oid 50 snap -1 2024-03-04T06:48:39.809 INFO:tasks.rados.rados.0.smithi137.stdout:2047: expect deleted 2024-03-04T06:48:39.809 INFO:tasks.rados.rados.0.smithi137.stdout:2048: copy_from oid 6 from oid 18 current snap is 188 2024-03-04T06:48:39.809 INFO:tasks.rados.rados.0.smithi137.stdout:2049: read oid 16 snap -1 2024-03-04T06:48:39.809 INFO:tasks.rados.rados.0.smithi137.stdout:2049: expect (ObjNum 617 snap 175 seq_num 617) 2024-03-04T06:48:39.809 INFO:tasks.rados.rados.0.smithi137.stdout:2050: snap_create 2024-03-04T06:48:39.812 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 15485 (ObjNum 225 snap 0 seq_num 3130855008) dirty exists 2024-03-04T06:48:39.844 INFO:tasks.rados.rados.0.smithi137.stdout:2049: expect (ObjNum 617 snap 175 seq_num 617) 2024-03-04T06:48:39.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:39.677+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:39.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:39.677+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:39.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:39.677+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:39.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:39.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:39.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:39 smithi203 ceph-mon[85573]: osdmap e450: 8 total, 8 up, 8 in 2024-03-04T06:48:39.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:40.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:40.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:40.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[91314]: osdmap e450: 8 total, 8 up, 8 in 2024-03-04T06:48:40.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:40.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:40.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:40.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:40.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:39.685+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:40.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:39.686+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:40.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:39.686+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:40.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:40.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:40.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[88869]: osdmap e450: 8 total, 8 up, 8 in 2024-03-04T06:48:40.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:40.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:40.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:40.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:40.045 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:39.695+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:40.045 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:39.683+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:40.447 INFO:tasks.rados.rados.0.smithi137.stdout:2048: finishing copy_from racing read to smithi13777483-6 2024-03-04T06:48:40.448 INFO:tasks.rados.rados.0.smithi137.stdout:2048: finishing copy_from to smithi13777483-6 2024-03-04T06:48:40.448 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 923 (ObjNum 490 snap 140 seq_num 490) dirty exists 2024-03-04T06:48:40.786 INFO:tasks.rados.rados.0.smithi137.stdout:2046: done (4 left) 2024-03-04T06:48:40.786 INFO:tasks.rados.rados.0.smithi137.stdout:2047: done (3 left) 2024-03-04T06:48:40.786 INFO:tasks.rados.rados.0.smithi137.stdout:2048: done (2 left) 2024-03-04T06:48:40.786 INFO:tasks.rados.rados.0.smithi137.stdout:2049: done (1 left) 2024-03-04T06:48:40.786 INFO:tasks.rados.rados.0.smithi137.stdout:2050: done (0 left) 2024-03-04T06:48:40.786 INFO:tasks.rados.rados.0.smithi137.stdout:2051: snap_create 2024-03-04T06:48:41.027 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:40.782+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset f5=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:41.027 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:40.782+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:41.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-mon[85573]: osdmap e451: 8 total, 8 up, 8 in 2024-03-04T06:48:41.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:41.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:41.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:41.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:41.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:41.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:41.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-mon[85573]: Upgrade: Updating osd.5 2024-03-04T06:48:41.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:41.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-04T06:48:41.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:48:41.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-mon[85573]: Deploying daemon osd.5 on smithi203 2024-03-04T06:48:41.028 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:40 smithi203 ceph-mon[85573]: pgmap v353: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 287 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 736 KiB/s wr, 19 op/s 2024-03-04T06:48:41.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[88869]: osdmap e451: 8 total, 8 up, 8 in 2024-03-04T06:48:41.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:41.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:41.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:41.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:41.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:41.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[88869]: Upgrade: Updating osd.5 2024-03-04T06:48:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-04T06:48:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:48:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[88869]: Deploying daemon osd.5 on smithi203 2024-03-04T06:48:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[88869]: pgmap v353: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 287 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 736 KiB/s wr, 19 op/s 2024-03-04T06:48:41.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[91314]: osdmap e451: 8 total, 8 up, 8 in 2024-03-04T06:48:41.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:41.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset e8=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:41.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:41.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:41.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[91314]: Upgrade: Updating osd.5 2024-03-04T06:48:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-04T06:48:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:48:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[91314]: Deploying daemon osd.5 on smithi203 2024-03-04T06:48:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:40 smithi137 ceph-mon[91314]: pgmap v353: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 287 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 736 KiB/s wr, 19 op/s 2024-03-04T06:48:41.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:41.245+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:41.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:41.296+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:41.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:41.296+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:41.795 INFO:tasks.rados.rados.0.smithi137.stdout:2051: done (0 left) 2024-03-04T06:48:41.795 INFO:tasks.rados.rados.0.smithi137.stdout:2052: delete oid 45 current snap is 190 2024-03-04T06:48:41.798 INFO:tasks.rados.rados.0.smithi137.stdout:2052: done (0 left) 2024-03-04T06:48:41.798 INFO:tasks.rados.rados.0.smithi137.stdout:2053: read oid 40 snap -1 2024-03-04T06:48:41.799 INFO:tasks.rados.rados.0.smithi137.stdout:2053: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:48:41.799 INFO:tasks.rados.rados.0.smithi137.stdout:2054: rmattr oid 10 current snap is 190 2024-03-04T06:48:41.799 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 190 2024-03-04T06:48:41.799 INFO:tasks.rados.rados.0.smithi137.stdout:2055: seq_num 669 ranges {3579904=409600,3989504=548864,4538368=655360} 2024-03-04T06:48:41.819 INFO:tasks.rados.rados.0.smithi137.stdout:2055: writing smithi13777483-27 from 3579904 to 3989504 tid 1 2024-03-04T06:48:41.823 INFO:tasks.rados.rados.0.smithi137.stdout:2055: writing smithi13777483-27 from 3989504 to 4538368 tid 2 2024-03-04T06:48:41.827 INFO:tasks.rados.rados.0.smithi137.stdout:2055: writing smithi13777483-27 from 4538368 to 5193728 tid 3 2024-03-04T06:48:41.827 INFO:tasks.rados.rados.0.smithi137.stdout:2056: delete oid 9 current snap is 190 2024-03-04T06:48:41.827 INFO:tasks.rados.rados.0.smithi137.stdout:2053: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:48:41.831 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15495 (ObjNum 632 snap 177 seq_num 632) dirty exists 2024-03-04T06:48:41.831 INFO:tasks.rados.rados.0.smithi137.stdout:2055: finishing write tid 1 to smithi13777483-27 2024-03-04T06:48:41.831 INFO:tasks.rados.rados.0.smithi137.stdout:2055: finishing write tid 2 to smithi13777483-27 2024-03-04T06:48:41.831 INFO:tasks.rados.rados.0.smithi137.stdout:2053: done (3 left) 2024-03-04T06:48:41.831 INFO:tasks.rados.rados.0.smithi137.stdout:2054: done (2 left) 2024-03-04T06:48:41.831 INFO:tasks.rados.rados.0.smithi137.stdout:2056: done (1 left) 2024-03-04T06:48:41.831 INFO:tasks.rados.rados.0.smithi137.stdout:2057: read oid 47 snap -1 2024-03-04T06:48:41.831 INFO:tasks.rados.rados.0.smithi137.stdout:2057: expect deleted 2024-03-04T06:48:41.831 INFO:tasks.rados.rados.0.smithi137.stdout:2058: snap_create 2024-03-04T06:48:41.832 INFO:tasks.rados.rados.0.smithi137.stdout:2055: finishing write tid 3 to smithi13777483-27 2024-03-04T06:48:41.832 INFO:tasks.rados.rados.0.smithi137.stdout:2055: finishing write tid 4 to smithi13777483-27 2024-03-04T06:48:41.832 INFO:tasks.rados.rados.0.smithi137.stdout:2055: finishing write tid 5 to smithi13777483-27 2024-03-04T06:48:41.832 INFO:tasks.rados.rados.0.smithi137.stdout:2055: oid 27 updating version 0 to 16802 2024-03-04T06:48:41.832 INFO:tasks.rados.rados.0.smithi137.stdout:2055: oid 27 version 16802 is already newer than 16800 2024-03-04T06:48:41.832 INFO:tasks.rados.rados.0.smithi137.stdout:2055: oid 27 version 16802 is already newer than 16799 2024-03-04T06:48:41.833 INFO:tasks.rados.rados.0.smithi137.stdout:2055: oid 27 version 16802 is already newer than 16801 2024-03-04T06:48:41.833 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16802 (ObjNum 669 snap 190 seq_num 669) dirty exists 2024-03-04T06:48:41.833 INFO:tasks.rados.rados.0.smithi137.stdout:2055: left oid 27 (ObjNum 669 snap 190 seq_num 669) 2024-03-04T06:48:41.998 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset f5=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:41.998 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:41.999 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:41 smithi203 ceph-mon[85573]: osdmap e452: 8 total, 8 up, 8 in 2024-03-04T06:48:41.999 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:41.999 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:41.999 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:41.791+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:41.999 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:41.791+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:41.999 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:41.791+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset f5=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:42.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:41.823+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:42.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:41.794+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:42.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset f5=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:42.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:42.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-mon[88869]: osdmap e452: 8 total, 8 up, 8 in 2024-03-04T06:48:42.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:42.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:42.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset f5=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:42.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:42.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-mon[91314]: osdmap e452: 8 total, 8 up, 8 in 2024-03-04T06:48:42.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:42.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:42.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:41.801+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:42.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:41.802+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:42.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:41.802+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:42.799 INFO:tasks.rados.rados.0.smithi137.stdout:2055: done (2 left) 2024-03-04T06:48:42.799 INFO:tasks.rados.rados.0.smithi137.stdout:2057: done (1 left) 2024-03-04T06:48:42.799 INFO:tasks.rados.rados.0.smithi137.stdout:2058: done (0 left) 2024-03-04T06:48:42.799 INFO:tasks.rados.rados.0.smithi137.stdout:2059: read oid 46 snap 186 2024-03-04T06:48:42.799 INFO:tasks.rados.rados.0.smithi137.stdout:2059: expect deleted 2024-03-04T06:48:42.799 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 191 2024-03-04T06:48:42.799 INFO:tasks.rados.rados.0.smithi137.stdout:2060: seq_num 671 ranges {2203648=442368,2646016=761856,3407872=442368} 2024-03-04T06:48:42.813 INFO:tasks.rados.rados.0.smithi137.stdout:2060: writing smithi13777483-32 from 2203648 to 2646016 tid 1 2024-03-04T06:48:42.817 INFO:tasks.rados.rados.0.smithi137.stdout:2060: writing smithi13777483-32 from 2646016 to 3407872 tid 2 2024-03-04T06:48:42.820 INFO:tasks.rados.rados.0.smithi137.stdout:2060: writing smithi13777483-32 from 3407872 to 3850240 tid 3 2024-03-04T06:48:42.820 INFO:tasks.rados.rados.0.smithi137.stdout:2061: read oid 31 snap -1 2024-03-04T06:48:42.820 INFO:tasks.rados.rados.0.smithi137.stdout:2061: expect deleted 2024-03-04T06:48:42.820 INFO:tasks.rados.rados.0.smithi137.stdout:2062: copy_from oid 20 from oid 38 current snap is 191 2024-03-04T06:48:42.820 INFO:tasks.rados.rados.0.smithi137.stdout:2060: finishing write tid 1 to smithi13777483-32 2024-03-04T06:48:42.820 INFO:tasks.rados.rados.0.smithi137.stdout:2059: done (3 left) 2024-03-04T06:48:42.821 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 191 2024-03-04T06:48:42.821 INFO:tasks.rados.rados.0.smithi137.stdout:2063: seq_num 672 ranges {8691712=458752,9150464=647168,9797632=466944,10264576=90112} 2024-03-04T06:48:42.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:42.796+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:42.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:42.797+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset f5=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:42.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:42.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:42.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset f5=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:42.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:42 smithi203 ceph-mon[85573]: osdmap e453: 8 total, 8 up, 8 in 2024-03-04T06:48:42.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:42.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:42.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:42.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:42.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:42 smithi203 ceph-mon[85573]: pgmap v356: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 287 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 0 B/s wr, 5 op/s 2024-03-04T06:48:42.869 INFO:tasks.rados.rados.0.smithi137.stdout:2063: writing smithi13777483-18 from 8691712 to 9150464 tid 1 2024-03-04T06:48:42.873 INFO:tasks.rados.rados.0.smithi137.stdout:2063: writing smithi13777483-18 from 9150464 to 9797632 tid 2 2024-03-04T06:48:42.875 INFO:tasks.rados.rados.0.smithi137.stdout:2063: writing smithi13777483-18 from 9797632 to 10264576 tid 3 2024-03-04T06:48:42.876 INFO:tasks.rados.rados.0.smithi137.stdout:2063: writing smithi13777483-18 from 10264576 to 10354688 tid 4 2024-03-04T06:48:42.876 INFO:tasks.rados.rados.0.smithi137.stdout:2064: snap_remove snap 187 2024-03-04T06:48:43.061 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:42.907+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:43.062 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:42.908+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:43.062 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:42.908+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:43.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:43.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:43.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset f5=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:43.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[88869]: osdmap e453: 8 total, 8 up, 8 in 2024-03-04T06:48:43.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:43.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:43.062 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:43.063 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:43.063 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[88869]: pgmap v356: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 287 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 0 B/s wr, 5 op/s 2024-03-04T06:48:43.063 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:42.817+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:43.063 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:43.063 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:43.063 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset f5=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:43.063 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[91314]: osdmap e453: 8 total, 8 up, 8 in 2024-03-04T06:48:43.063 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:43.063 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:43.064 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:43.064 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:43.064 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:42 smithi137 ceph-mon[91314]: pgmap v356: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 287 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 0 B/s wr, 5 op/s 2024-03-04T06:48:43.190 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:42 smithi203 systemd[1]: Stopping Ceph osd.5 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:48:43.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[41578]: 2024-03-04T06:48:43.188+0000 7f1227f24700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:48:43.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[41578]: 2024-03-04T06:48:43.188+0000 7f1227f24700 -1 osd.5 454 *** Got signal Terminated *** 2024-03-04T06:48:43.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[41578]: 2024-03-04T06:48:43.188+0000 7f1227f24700 -1 osd.5 454 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T06:48:43.803 INFO:tasks.rados.rados.0.smithi137.stdout:2060: finishing write tid 2 to smithi13777483-32 2024-03-04T06:48:43.803 INFO:tasks.rados.rados.0.smithi137.stdout:2060: finishing write tid 3 to smithi13777483-32 2024-03-04T06:48:43.803 INFO:tasks.rados.rados.0.smithi137.stdout:2060: finishing write tid 4 to smithi13777483-32 2024-03-04T06:48:43.803 INFO:tasks.rados.rados.0.smithi137.stdout:2060: finishing write tid 5 to smithi13777483-32 2024-03-04T06:48:43.803 INFO:tasks.rados.rados.0.smithi137.stdout:2060: oid 32 updating version 0 to 16804 2024-03-04T06:48:43.803 INFO:tasks.rados.rados.0.smithi137.stdout:2060: oid 32 updating version 16804 to 16806 2024-03-04T06:48:43.803 INFO:tasks.rados.rados.0.smithi137.stdout:2060: oid 32 version 16806 is already newer than 16805 2024-03-04T06:48:43.804 INFO:tasks.rados.rados.0.smithi137.stdout:2060: oid 32 version 16806 is already newer than 16803 2024-03-04T06:48:43.804 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16806 (ObjNum 671 snap 191 seq_num 671) dirty exists 2024-03-04T06:48:43.804 INFO:tasks.rados.rados.0.smithi137.stdout:2060: left oid 32 (ObjNum 671 snap 191 seq_num 671) 2024-03-04T06:48:43.804 INFO:tasks.rados.rados.0.smithi137.stdout:2062: finishing copy_from racing read to smithi13777483-20 2024-03-04T06:48:43.804 INFO:tasks.rados.rados.0.smithi137.stdout:2062: finishing copy_from to smithi13777483-20 2024-03-04T06:48:43.804 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 15487 (ObjNum 568 snap 159 seq_num 568) dirty exists 2024-03-04T06:48:43.804 INFO:tasks.rados.rados.0.smithi137.stdout:2063: finishing write tid 1 to smithi13777483-18 2024-03-04T06:48:43.804 INFO:tasks.rados.rados.0.smithi137.stdout:2063: finishing write tid 2 to smithi13777483-18 2024-03-04T06:48:43.804 INFO:tasks.rados.rados.0.smithi137.stdout:2063: finishing write tid 3 to smithi13777483-18 2024-03-04T06:48:43.804 INFO:tasks.rados.rados.0.smithi137.stdout:2063: finishing write tid 4 to smithi13777483-18 2024-03-04T06:48:43.804 INFO:tasks.rados.rados.0.smithi137.stdout:2063: finishing write tid 5 to smithi13777483-18 2024-03-04T06:48:43.804 INFO:tasks.rados.rados.0.smithi137.stdout:2063: finishing write tid 6 to smithi13777483-18 2024-03-04T06:48:43.805 INFO:tasks.rados.rados.0.smithi137.stdout:2063: oid 18 updating version 0 to 16783 2024-03-04T06:48:43.805 INFO:tasks.rados.rados.0.smithi137.stdout:2063: oid 18 updating version 16783 to 16784 2024-03-04T06:48:43.805 INFO:tasks.rados.rados.0.smithi137.stdout:2063: oid 18 version 16784 is already newer than 16782 2024-03-04T06:48:43.805 INFO:tasks.rados.rados.0.smithi137.stdout:2063: oid 18 updating version 16784 to 16785 2024-03-04T06:48:43.805 INFO:tasks.rados.rados.0.smithi137.stdout:2063: oid 18 version 16785 is already newer than 16781 2024-03-04T06:48:43.805 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16785 (ObjNum 672 snap 191 seq_num 672) dirty exists 2024-03-04T06:48:43.806 INFO:tasks.rados.rados.0.smithi137.stdout:2063: left oid 18 (ObjNum 672 snap 191 seq_num 672) 2024-03-04T06:48:43.806 INFO:tasks.rados.rados.0.smithi137.stdout:2060: done (4 left) 2024-03-04T06:48:43.806 INFO:tasks.rados.rados.0.smithi137.stdout:2061: done (3 left) 2024-03-04T06:48:43.806 INFO:tasks.rados.rados.0.smithi137.stdout:2062: done (2 left) 2024-03-04T06:48:43.806 INFO:tasks.rados.rados.0.smithi137.stdout:2063: done (1 left) 2024-03-04T06:48:43.806 INFO:tasks.rados.rados.0.smithi137.stdout:2064: done (0 left) 2024-03-04T06:48:43.806 INFO:tasks.rados.rados.0.smithi137.stdout:2065: delete oid 35 current snap is 191 2024-03-04T06:48:43.817 INFO:tasks.rados.rados.0.smithi137.stdout:2065: done (0 left) 2024-03-04T06:48:43.817 INFO:tasks.rados.rados.0.smithi137.stdout:2066: setattr oid 9 current snap is 191 2024-03-04T06:48:43.819 INFO:tasks.rados.rados.0.smithi137.stdout:2067: rollback oid 23 current snap is 191 2024-03-04T06:48:43.819 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 23 to 189 2024-03-04T06:48:43.819 INFO:tasks.rados.rados.0.smithi137.stdout:2068: rollback oid 5 current snap is 191 2024-03-04T06:48:43.819 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 5 to 181 2024-03-04T06:48:43.819 INFO:tasks.rados.rados.0.smithi137.stdout:2069: rmattr oid 22 current snap is 191 2024-03-04T06:48:43.819 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 29 current snap is 191 2024-03-04T06:48:43.819 INFO:tasks.rados.rados.0.smithi137.stdout:2070: seq_num 674 ranges {0=491520,491520=417792,909312=483328,1392640=303104} 2024-03-04T06:48:43.822 INFO:tasks.rados.rados.0.smithi137.stdout:2070: writing smithi13777483-29 from 0 to 491520 tid 1 2024-03-04T06:48:43.825 INFO:tasks.rados.rados.0.smithi137.stdout:2070: writing smithi13777483-29 from 491520 to 909312 tid 2 2024-03-04T06:48:43.829 INFO:tasks.rados.rados.0.smithi137.stdout:2070: writing smithi13777483-29 from 909312 to 1392640 tid 3 2024-03-04T06:48:43.831 INFO:tasks.rados.rados.0.smithi137.stdout:2070: writing smithi13777483-29 from 1392640 to 1695744 tid 4 2024-03-04T06:48:43.831 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 191 2024-03-04T06:48:43.831 INFO:tasks.rados.rados.0.smithi137.stdout:2071: seq_num 675 ranges {0=507904,507904=704512,1212416=499712} 2024-03-04T06:48:43.835 INFO:tasks.rados.rados.0.smithi137.stdout:2071: writing smithi13777483-8 from 0 to 507904 tid 1 2024-03-04T06:48:43.840 INFO:tasks.rados.rados.0.smithi137.stdout:2071: writing smithi13777483-8 from 507904 to 1212416 tid 2 2024-03-04T06:48:43.844 INFO:tasks.rados.rados.0.smithi137.stdout:2071: writing smithi13777483-8 from 1212416 to 1712128 tid 3 2024-03-04T06:48:43.844 INFO:tasks.rados.rados.0.smithi137.stdout:2072: read oid 44 snap -1 2024-03-04T06:48:43.844 INFO:tasks.rados.rados.0.smithi137.stdout:2072: expect (ObjNum 635 snap 178 seq_num 635) 2024-03-04T06:48:43.844 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 191 2024-03-04T06:48:43.844 INFO:tasks.rados.rados.0.smithi137.stdout:2071: finishing write tid 1 to smithi13777483-8 2024-03-04T06:48:43.844 INFO:tasks.rados.rados.0.smithi137.stdout:2071: finishing write tid 2 to smithi13777483-8 2024-03-04T06:48:43.844 INFO:tasks.rados.rados.0.smithi137.stdout:2073: seq_num 676 ranges {991232=524288,1515520=589824,2105344=450560,2555904=163840} 2024-03-04T06:48:43.853 INFO:tasks.rados.rados.0.smithi137.stdout:2073: writing smithi13777483-10 from 991232 to 1515520 tid 1 2024-03-04T06:48:43.857 INFO:tasks.rados.rados.0.smithi137.stdout:2073: writing smithi13777483-10 from 1515520 to 2105344 tid 2 2024-03-04T06:48:43.860 INFO:tasks.rados.rados.0.smithi137.stdout:2073: writing smithi13777483-10 from 2105344 to 2555904 tid 3 2024-03-04T06:48:43.862 INFO:tasks.rados.rados.0.smithi137.stdout:2073: writing smithi13777483-10 from 2555904 to 2719744 tid 4 2024-03-04T06:48:43.862 INFO:tasks.rados.rados.0.smithi137.stdout:2074: copy_from oid 15 from oid 1 current snap is 191 2024-03-04T06:48:43.862 INFO:tasks.rados.rados.0.smithi137.stdout:2071: finishing write tid 3 to smithi13777483-8 2024-03-04T06:48:43.862 INFO:tasks.rados.rados.0.smithi137.stdout:2071: finishing write tid 4 to smithi13777483-8 2024-03-04T06:48:43.862 INFO:tasks.rados.rados.0.smithi137.stdout:2071: finishing write tid 5 to smithi13777483-8 2024-03-04T06:48:43.862 INFO:tasks.rados.rados.0.smithi137.stdout:2071: oid 8 updating version 0 to 16797 2024-03-04T06:48:43.863 INFO:tasks.rados.rados.0.smithi137.stdout:2071: oid 8 updating version 16797 to 16800 2024-03-04T06:48:43.863 INFO:tasks.rados.rados.0.smithi137.stdout:2071: oid 8 version 16800 is already newer than 16799 2024-03-04T06:48:43.863 INFO:tasks.rados.rados.0.smithi137.stdout:2071: oid 8 version 16800 is already newer than 16798 2024-03-04T06:48:43.863 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16800 (ObjNum 675 snap 191 seq_num 675) dirty exists 2024-03-04T06:48:43.863 INFO:tasks.rados.rados.0.smithi137.stdout:2071: left oid 8 (ObjNum 675 snap 191 seq_num 675) 2024-03-04T06:48:43.863 INFO:tasks.rados.rados.0.smithi137.stdout:2072: expect (ObjNum 635 snap 178 seq_num 635) 2024-03-04T06:48:43.921 INFO:tasks.rados.rados.0.smithi137.stdout:2071: done (8 left) 2024-03-04T06:48:43.921 INFO:tasks.rados.rados.0.smithi137.stdout:2072: done (7 left) 2024-03-04T06:48:43.921 INFO:tasks.rados.rados.0.smithi137.stdout:2075: read oid 25 snap -1 2024-03-04T06:48:43.922 INFO:tasks.rados.rados.0.smithi137.stdout:2075: expect (ObjNum 544 snap 155 seq_num 544) 2024-03-04T06:48:43.922 INFO:tasks.rados.rados.0.smithi137.stdout:2076: snap_create 2024-03-04T06:48:43.932 INFO:tasks.rados.rados.0.smithi137.stdout:2075: expect (ObjNum 544 snap 155 seq_num 544) 2024-03-04T06:48:44.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:43.808+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:44.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:43.808+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:43 smithi203 ceph-mon[85573]: osdmap e454: 8 total, 8 up, 8 in 2024-03-04T06:48:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset f5=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:44.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:43 smithi203 ceph-mon[85573]: osd.5 marked itself down and dead 2024-03-04T06:48:44.267 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:43.803+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:44.267 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:43.813+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:44.267 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:43.818+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:44.267 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:43.818+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:44.268 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:44.268 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[88869]: osdmap e454: 8 total, 8 up, 8 in 2024-03-04T06:48:44.268 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset f5=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:44.268 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:44.268 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:44.268 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:44.268 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:44.268 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[88869]: osd.5 marked itself down and dead 2024-03-04T06:48:44.268 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:43.814+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:44.269 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:44.269 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[91314]: osdmap e454: 8 total, 8 up, 8 in 2024-03-04T06:48:44.269 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset f5=[]:{e8=[e8,e7,e6,e2,e0,df]} for object 5:753c0a1a:::smithi13777483-40:d7 2024-03-04T06:48:44.269 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:44.269 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:44.269 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:44.269 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:44.269 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:43 smithi137 ceph-mon[91314]: osd.5 marked itself down and dead 2024-03-04T06:48:44.639 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:44 smithi203 podman[95310]: 2024-03-04 06:48:44.374684485 +0000 UTC m=+1.300995079 container died 81d21771e157d6aa88d1c102e292521f59a911183d13498def9edf804a936ef2 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, RELEASE=reef-5cc7a76, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-04T06:48:44.823 INFO:tasks.rados.rados.0.smithi137.stdout:2075: done (8 left) 2024-03-04T06:48:44.823 INFO:tasks.rados.rados.0.smithi137.stdout:2076: done (7 left) 2024-03-04T06:48:44.823 INFO:tasks.rados.rados.0.smithi137.stdout:2077: delete oid 12 current snap is 192 2024-03-04T06:48:44.828 INFO:tasks.rados.rados.0.smithi137.stdout:2067: finishing rollback tid 0 to smithi13777483-23 2024-03-04T06:48:44.828 INFO:tasks.rados.rados.0.smithi137.stdout:2067: finishing rollback tid 1 to smithi13777483-23 2024-03-04T06:48:44.830 INFO:tasks.rados.rados.0.smithi137.stdout:2067: finishing rollback tid 2 to smithi13777483-23 2024-03-04T06:48:44.830 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 15490 (ObjNum 638 snap 178 seq_num 638) dirty exists 2024-03-04T06:48:44.833 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 15486 (ObjNum 465 snap 0 seq_num 3817719110) dirty exists 2024-03-04T06:48:44.836 INFO:tasks.rados.rados.0.smithi137.stdout:2067: done (7 left) 2024-03-04T06:48:44.836 INFO:tasks.rados.rados.0.smithi137.stdout:2069: done (6 left) 2024-03-04T06:48:44.836 INFO:tasks.rados.rados.0.smithi137.stdout:2077: done (5 left) 2024-03-04T06:48:44.836 INFO:tasks.rados.rados.0.smithi137.stdout:2078: rollback oid 39 current snap is 192 2024-03-04T06:48:44.836 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 39 to 191 2024-03-04T06:48:44.836 INFO:tasks.rados.rados.0.smithi137.stdout:2079: copy_from oid 3 from oid 48 current snap is 192 2024-03-04T06:48:44.836 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 192 2024-03-04T06:48:44.836 INFO:tasks.rados.rados.0.smithi137.stdout:2080: seq_num 678 ranges {8691712=565248,9256960=802816,10059776=401408} 2024-03-04T06:48:44.886 INFO:tasks.rados.rados.0.smithi137.stdout:2080: writing smithi13777483-6 from 8691712 to 9256960 tid 1 2024-03-04T06:48:44.891 INFO:tasks.rados.rados.0.smithi137.stdout:2080: writing smithi13777483-6 from 9256960 to 10059776 tid 2 2024-03-04T06:48:44.895 INFO:tasks.rados.rados.0.smithi137.stdout:2080: writing smithi13777483-6 from 10059776 to 10461184 tid 3 2024-03-04T06:48:44.895 INFO:tasks.rados.rados.0.smithi137.stdout:2081: setattr oid 42 current snap is 192 2024-03-04T06:48:44.895 INFO:tasks.rados.rados.0.smithi137.stdout:2078: finishing rollback tid 1 to smithi13777483-39 2024-03-04T06:48:44.895 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-03-04T06:48:44.895 INFO:tasks.rados.rados.0.smithi137.stdout:2070: finishing write tid 1 to smithi13777483-29 2024-03-04T06:48:44.895 INFO:tasks.rados.rados.0.smithi137.stdout:2070: finishing write tid 2 to smithi13777483-29 2024-03-04T06:48:44.895 INFO:tasks.rados.rados.0.smithi137.stdout:2070: finishing write tid 3 to smithi13777483-29 2024-03-04T06:48:44.895 INFO:tasks.rados.rados.0.smithi137.stdout:2070: finishing write tid 4 to smithi13777483-29 2024-03-04T06:48:44.896 INFO:tasks.rados.rados.0.smithi137.stdout:2070: finishing write tid 5 to smithi13777483-29 2024-03-04T06:48:44.896 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 15496 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-03-04T06:48:44.896 INFO:tasks.rados.rados.0.smithi137.stdout:2070: finishing write tid 6 to smithi13777483-29 2024-03-04T06:48:44.896 INFO:tasks.rados.rados.0.smithi137.stdout:2070: oid 29 updating version 0 to 16788 2024-03-04T06:48:44.896 INFO:tasks.rados.rados.0.smithi137.stdout:2070: oid 29 updating version 16788 to 16789 2024-03-04T06:48:44.896 INFO:tasks.rados.rados.0.smithi137.stdout:2070: oid 29 version 16789 is already newer than 16787 2024-03-04T06:48:44.896 INFO:tasks.rados.rados.0.smithi137.stdout:2070: oid 29 version 16789 is already newer than 16786 2024-03-04T06:48:44.896 INFO:tasks.rados.rados.0.smithi137.stdout:2070: oid 29 updating version 16789 to 16790 2024-03-04T06:48:44.896 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16790 (ObjNum 674 snap 191 seq_num 674) dirty exists 2024-03-04T06:48:44.896 INFO:tasks.rados.rados.0.smithi137.stdout:2070: left oid 29 (ObjNum 674 snap 191 seq_num 674) 2024-03-04T06:48:44.896 INFO:tasks.rados.rados.0.smithi137.stdout:2074: finishing copy_from racing read to smithi13777483-15 2024-03-04T06:48:44.896 INFO:tasks.rados.rados.0.smithi137.stdout:2068: finishing rollback tid 0 to smithi13777483-5 2024-03-04T06:48:44.896 INFO:tasks.rados.rados.0.smithi137.stdout:2074: finishing copy_from to smithi13777483-15 2024-03-04T06:48:44.897 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 15463 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:48:44.897 INFO:tasks.rados.rados.0.smithi137.stdout:2068: finishing rollback tid 1 to smithi13777483-5 2024-03-04T06:48:44.897 INFO:tasks.rados.rados.0.smithi137.stdout:2068: finishing rollback tid 2 to smithi13777483-5 2024-03-04T06:48:44.897 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 15499 (ObjNum 461 snap 133 seq_num 461) dirty exists 2024-03-04T06:48:44.897 INFO:tasks.rados.rados.0.smithi137.stdout:2073: finishing write tid 1 to smithi13777483-10 2024-03-04T06:48:44.897 INFO:tasks.rados.rados.0.smithi137.stdout:2073: finishing write tid 2 to smithi13777483-10 2024-03-04T06:48:44.897 INFO:tasks.rados.rados.0.smithi137.stdout:2073: finishing write tid 3 to smithi13777483-10 2024-03-04T06:48:44.897 INFO:tasks.rados.rados.0.smithi137.stdout:2073: finishing write tid 4 to smithi13777483-10 2024-03-04T06:48:44.897 INFO:tasks.rados.rados.0.smithi137.stdout:2073: finishing write tid 5 to smithi13777483-10 2024-03-04T06:48:44.897 INFO:tasks.rados.rados.0.smithi137.stdout:2073: finishing write tid 6 to smithi13777483-10 2024-03-04T06:48:44.897 INFO:tasks.rados.rados.0.smithi137.stdout:2073: oid 10 updating version 0 to 15500 2024-03-04T06:48:44.897 INFO:tasks.rados.rados.0.smithi137.stdout:2073: oid 10 updating version 15500 to 15502 2024-03-04T06:48:44.897 INFO:tasks.rados.rados.0.smithi137.stdout:2073: oid 10 updating version 15502 to 15504 2024-03-04T06:48:44.898 INFO:tasks.rados.rados.0.smithi137.stdout:2073: oid 10 version 15504 is already newer than 15501 2024-03-04T06:48:44.898 INFO:tasks.rados.rados.0.smithi137.stdout:2073: oid 10 version 15504 is already newer than 15503 2024-03-04T06:48:44.898 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15504 (ObjNum 676 snap 191 seq_num 676) dirty exists 2024-03-04T06:48:44.898 INFO:tasks.rados.rados.0.smithi137.stdout:2073: left oid 10 (ObjNum 676 snap 191 seq_num 676) 2024-03-04T06:48:44.898 INFO:tasks.rados.rados.0.smithi137.stdout:2079: finishing copy_from racing read to smithi13777483-3 2024-03-04T06:48:44.898 INFO:tasks.rados.rados.0.smithi137.stdout:2079: finishing copy_from to smithi13777483-3 2024-03-04T06:48:44.898 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 15470 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:48:44.898 INFO:tasks.rados.rados.0.smithi137.stdout:2080: finishing write tid 1 to smithi13777483-6 2024-03-04T06:48:44.899 INFO:tasks.rados.rados.0.smithi137.stdout:2066: done (8 left) 2024-03-04T06:48:44.899 INFO:tasks.rados.rados.0.smithi137.stdout:2068: done (7 left) 2024-03-04T06:48:44.899 INFO:tasks.rados.rados.0.smithi137.stdout:2070: done (6 left) 2024-03-04T06:48:44.899 INFO:tasks.rados.rados.0.smithi137.stdout:2073: done (5 left) 2024-03-04T06:48:44.899 INFO:tasks.rados.rados.0.smithi137.stdout:2074: done (4 left) 2024-03-04T06:48:44.899 INFO:tasks.rados.rados.0.smithi137.stdout:2078: done (3 left) 2024-03-04T06:48:44.899 INFO:tasks.rados.rados.0.smithi137.stdout:2079: done (2 left) 2024-03-04T06:48:44.899 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 192 2024-03-04T06:48:44.899 INFO:tasks.rados.rados.0.smithi137.stdout:2082: seq_num 679 ranges {10354688=581632,10936320=688128,11624448=516096} 2024-03-04T06:48:44.955 INFO:tasks.rados.rados.0.smithi137.stdout:2082: writing smithi13777483-18 from 10354688 to 10936320 tid 1 2024-03-04T06:48:44.959 INFO:tasks.rados.rados.0.smithi137.stdout:2082: writing smithi13777483-18 from 10936320 to 11624448 tid 2 2024-03-04T06:48:44.963 INFO:tasks.rados.rados.0.smithi137.stdout:2082: writing smithi13777483-18 from 11624448 to 12140544 tid 3 2024-03-04T06:48:44.963 INFO:tasks.rados.rados.0.smithi137.stdout:2083: read oid 46 snap -1 2024-03-04T06:48:44.963 INFO:tasks.rados.rados.0.smithi137.stdout:2083: expect deleted 2024-03-04T06:48:44.963 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 192 2024-03-04T06:48:44.963 INFO:tasks.rados.rados.0.smithi137.stdout:2080: finishing write tid 2 to smithi13777483-6 2024-03-04T06:48:44.964 INFO:tasks.rados.rados.0.smithi137.stdout:2080: finishing write tid 3 to smithi13777483-6 2024-03-04T06:48:44.964 INFO:tasks.rados.rados.0.smithi137.stdout:2080: finishing write tid 4 to smithi13777483-6 2024-03-04T06:48:44.964 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16807 (ObjNum 49 snap 0 seq_num 0) dirty exists 2024-03-04T06:48:44.964 INFO:tasks.rados.rados.0.smithi137.stdout:2080: finishing write tid 5 to smithi13777483-6 2024-03-04T06:48:44.964 INFO:tasks.rados.rados.0.smithi137.stdout:2080: oid 6 updating version 0 to 15487 2024-03-04T06:48:44.964 INFO:tasks.rados.rados.0.smithi137.stdout:2080: oid 6 updating version 15487 to 15490 2024-03-04T06:48:44.964 INFO:tasks.rados.rados.0.smithi137.stdout:2080: oid 6 version 15490 is already newer than 15488 2024-03-04T06:48:44.964 INFO:tasks.rados.rados.0.smithi137.stdout:2080: oid 6 version 15490 is already newer than 15489 2024-03-04T06:48:44.964 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 15490 (ObjNum 678 snap 192 seq_num 678) dirty exists 2024-03-04T06:48:44.964 INFO:tasks.rados.rados.0.smithi137.stdout:2080: left oid 6 (ObjNum 678 snap 192 seq_num 678) 2024-03-04T06:48:44.964 INFO:tasks.rados.rados.0.smithi137.stdout:2082: finishing write tid 1 to smithi13777483-18 2024-03-04T06:48:44.964 INFO:tasks.rados.rados.0.smithi137.stdout:2082: finishing write tid 2 to smithi13777483-18 2024-03-04T06:48:44.964 INFO:tasks.rados.rados.0.smithi137.stdout:2084: seq_num 680 ranges {8110080=598016,8708096=573440,9281536=434176,9715712=196608} 2024-03-04T06:48:45.009 INFO:tasks.rados.rados.0.smithi137.stdout:2084: writing smithi13777483-11 from 8110080 to 8708096 tid 1 2024-03-04T06:48:45.012 INFO:tasks.rados.rados.0.smithi137.stdout:2084: writing smithi13777483-11 from 8708096 to 9281536 tid 2 2024-03-04T06:48:45.014 INFO:tasks.rados.rados.0.smithi137.stdout:2084: writing smithi13777483-11 from 9281536 to 9715712 tid 3 2024-03-04T06:48:45.016 INFO:tasks.rados.rados.0.smithi137.stdout:2084: writing smithi13777483-11 from 9715712 to 9912320 tid 4 2024-03-04T06:48:45.016 INFO:tasks.rados.rados.0.smithi137.stdout:2080: done (4 left) 2024-03-04T06:48:45.016 INFO:tasks.rados.rados.0.smithi137.stdout:2081: done (3 left) 2024-03-04T06:48:45.016 INFO:tasks.rados.rados.0.smithi137.stdout:2085: snap_create 2024-03-04T06:48:45.016 INFO:tasks.rados.rados.0.smithi137.stdout:2082: finishing write tid 3 to smithi13777483-18 2024-03-04T06:48:45.016 INFO:tasks.rados.rados.0.smithi137.stdout:2082: finishing write tid 4 to smithi13777483-18 2024-03-04T06:48:45.016 INFO:tasks.rados.rados.0.smithi137.stdout:2082: finishing write tid 5 to smithi13777483-18 2024-03-04T06:48:45.016 INFO:tasks.rados.rados.0.smithi137.stdout:2082: oid 18 updating version 0 to 16793 2024-03-04T06:48:45.017 INFO:tasks.rados.rados.0.smithi137.stdout:2082: oid 18 version 16793 is already newer than 16791 2024-03-04T06:48:45.017 INFO:tasks.rados.rados.0.smithi137.stdout:2082: oid 18 version 16793 is already newer than 16792 2024-03-04T06:48:45.017 INFO:tasks.rados.rados.0.smithi137.stdout:2082: oid 18 updating version 16793 to 16794 2024-03-04T06:48:45.017 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16794 (ObjNum 679 snap 192 seq_num 679) dirty exists 2024-03-04T06:48:45.017 INFO:tasks.rados.rados.0.smithi137.stdout:2082: left oid 18 (ObjNum 679 snap 192 seq_num 679) 2024-03-04T06:48:45.017 INFO:tasks.rados.rados.0.smithi137.stdout:2084: finishing write tid 1 to smithi13777483-11 2024-03-04T06:48:45.017 INFO:tasks.rados.rados.0.smithi137.stdout:2084: finishing write tid 2 to smithi13777483-11 2024-03-04T06:48:45.018 INFO:tasks.rados.rados.0.smithi137.stdout:2084: finishing write tid 3 to smithi13777483-11 2024-03-04T06:48:45.018 INFO:tasks.rados.rados.0.smithi137.stdout:2084: finishing write tid 4 to smithi13777483-11 2024-03-04T06:48:45.018 INFO:tasks.rados.rados.0.smithi137.stdout:2084: finishing write tid 5 to smithi13777483-11 2024-03-04T06:48:45.020 INFO:tasks.rados.rados.0.smithi137.stdout:2084: finishing write tid 6 to smithi13777483-11 2024-03-04T06:48:45.020 INFO:tasks.rados.rados.0.smithi137.stdout:2084: oid 11 updating version 0 to 16803 2024-03-04T06:48:45.020 INFO:tasks.rados.rados.0.smithi137.stdout:2084: oid 11 updating version 16803 to 16804 2024-03-04T06:48:45.020 INFO:tasks.rados.rados.0.smithi137.stdout:2084: oid 11 version 16804 is already newer than 16802 2024-03-04T06:48:45.020 INFO:tasks.rados.rados.0.smithi137.stdout:2084: oid 11 updating version 16804 to 16805 2024-03-04T06:48:45.020 INFO:tasks.rados.rados.0.smithi137.stdout:2084: oid 11 version 16805 is already newer than 16801 2024-03-04T06:48:45.020 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16805 (ObjNum 680 snap 192 seq_num 680) dirty exists 2024-03-04T06:48:45.020 INFO:tasks.rados.rados.0.smithi137.stdout:2084: left oid 11 (ObjNum 680 snap 192 seq_num 680) 2024-03-04T06:48:45.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:44.814+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:45.096 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:44 smithi203 podman[95310]: 2024-03-04 06:48:44.639227336 +0000 UTC m=+1.565537931 container cleanup 81d21771e157d6aa88d1c102e292521f59a911183d13498def9edf804a936ef2 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=reef-5cc7a76) 2024-03-04T06:48:45.096 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:44 smithi203 bash[95310]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5 2024-03-04T06:48:45.096 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:44 smithi203 podman[95327]: 2024-03-04 06:48:44.840406696 +0000 UTC m=+0.460750311 container remove 81d21771e157d6aa88d1c102e292521f59a911183d13498def9edf804a936ef2 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=reef-5cc7a76) 2024-03-04T06:48:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:44 smithi203 ceph-mon[85573]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:48:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:44 smithi203 ceph-mon[85573]: osdmap e455: 8 total, 7 up, 8 in 2024-03-04T06:48:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:44 smithi203 ceph-mon[85573]: pgmap v359: 121 pgs: 16 peering, 14 stale+active+clean, 6 active+clean+snaptrim_error, 85 active+clean; 303 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.7 MiB/s rd, 4.0 MiB/s wr, 19 op/s 2024-03-04T06:48:45.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:44.831+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:45.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:44.825+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:45.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:44.820+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:45.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:44.826+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:45.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[88869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:48:45.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[88869]: osdmap e455: 8 total, 7 up, 8 in 2024-03-04T06:48:45.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:45.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:45.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:45.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:45.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:45.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[88869]: pgmap v359: 121 pgs: 16 peering, 14 stale+active+clean, 6 active+clean+snaptrim_error, 85 active+clean; 303 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.7 MiB/s rd, 4.0 MiB/s wr, 19 op/s 2024-03-04T06:48:45.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[91314]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:48:45.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[91314]: osdmap e455: 8 total, 7 up, 8 in 2024-03-04T06:48:45.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:45.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:45.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:45.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:45.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:45.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:44 smithi137 ceph-mon[91314]: pgmap v359: 121 pgs: 16 peering, 14 stale+active+clean, 6 active+clean+snaptrim_error, 85 active+clean; 303 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.7 MiB/s rd, 4.0 MiB/s wr, 19 op/s 2024-03-04T06:48:45.553 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:45 smithi203 podman[95420]: 2024-03-04 06:48:45.24974356 +0000 UTC m=+0.103268917 container create 965c56a7a811ccd4cd5ff4e496ce9a8188e422c8dc5eba8ab162c17ea0f963bc (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-04T06:48:45.553 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:45 smithi203 podman[95420]: 2024-03-04 06:48:45.165365807 +0000 UTC m=+0.018891162 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:48:45.553 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:45 smithi203 podman[95420]: 2024-03-04 06:48:45.477418447 +0000 UTC m=+0.330943803 container init 965c56a7a811ccd4cd5ff4e496ce9a8188e422c8dc5eba8ab162c17ea0f963bc (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:48:45.553 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:45 smithi203 podman[95420]: 2024-03-04 06:48:45.480710321 +0000 UTC m=+0.334235684 container start 965c56a7a811ccd4cd5ff4e496ce9a8188e422c8dc5eba8ab162c17ea0f963bc (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-deactivate, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222) 2024-03-04T06:48:45.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:48:45] "GET /metrics HTTP/1.1" 200 36265 "" "Prometheus/2.43.0" 2024-03-04T06:48:45.816 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:45 smithi203 ceph-mon[85573]: Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-03-04T06:48:45.816 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:45.816 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:45 smithi203 ceph-mon[85573]: osdmap e456: 8 total, 7 up, 8 in 2024-03-04T06:48:45.816 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:45.816 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:45.817 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:45.817 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:45.817 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:45 smithi203 podman[95420]: 2024-03-04 06:48:45.552216031 +0000 UTC m=+0.405741390 container attach 965c56a7a811ccd4cd5ff4e496ce9a8188e422c8dc5eba8ab162c17ea0f963bc (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240222, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0) 2024-03-04T06:48:45.817 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:45 smithi203 podman[95420]: 2024-03-04 06:48:45.770135341 +0000 UTC m=+0.623660698 container died 965c56a7a811ccd4cd5ff4e496ce9a8188e422c8dc5eba8ab162c17ea0f963bc (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-04T06:48:45.817 INFO:tasks.rados.rados.0.smithi137.stdout:2082: done (3 left) 2024-03-04T06:48:45.817 INFO:tasks.rados.rados.0.smithi137.stdout:2083: done (2 left) 2024-03-04T06:48:45.818 INFO:tasks.rados.rados.0.smithi137.stdout:2084: done (1 left) 2024-03-04T06:48:45.818 INFO:tasks.rados.rados.0.smithi137.stdout:2085: done (0 left) 2024-03-04T06:48:45.818 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 193 2024-03-04T06:48:45.818 INFO:tasks.rados.rados.0.smithi137.stdout:2086: seq_num 681 ranges {10461184=614400,11075584=458752,11534336=638976,12173312=106496} 2024-03-04T06:48:45.875 INFO:tasks.rados.rados.0.smithi137.stdout:2086: writing smithi13777483-6 from 10461184 to 11075584 tid 1 2024-03-04T06:48:45.877 INFO:tasks.rados.rados.0.smithi137.stdout:2086: writing smithi13777483-6 from 11075584 to 11534336 tid 2 2024-03-04T06:48:45.881 INFO:tasks.rados.rados.0.smithi137.stdout:2086: writing smithi13777483-6 from 11534336 to 12173312 tid 3 2024-03-04T06:48:45.882 INFO:tasks.rados.rados.0.smithi137.stdout:2086: writing smithi13777483-6 from 12173312 to 12279808 tid 4 2024-03-04T06:48:45.882 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 36 current snap is 193 2024-03-04T06:48:45.882 INFO:tasks.rados.rados.0.smithi137.stdout:2086: finishing write tid 1 to smithi13777483-6 2024-03-04T06:48:45.882 INFO:tasks.rados.rados.0.smithi137.stdout:2086: finishing write tid 2 to smithi13777483-6 2024-03-04T06:48:45.882 INFO:tasks.rados.rados.0.smithi137.stdout:2087: seq_num 682 ranges {0=630784,630784=745472,1376256=442368,1818624=16384} 2024-03-04T06:48:45.886 INFO:tasks.rados.rados.0.smithi137.stdout:2087: writing smithi13777483-36 from 0 to 630784 tid 1 2024-03-04T06:48:45.890 INFO:tasks.rados.rados.0.smithi137.stdout:2087: writing smithi13777483-36 from 630784 to 1376256 tid 2 2024-03-04T06:48:45.894 INFO:tasks.rados.rados.0.smithi137.stdout:2087: writing smithi13777483-36 from 1376256 to 1818624 tid 3 2024-03-04T06:48:45.894 INFO:tasks.rados.rados.0.smithi137.stdout:2087: writing smithi13777483-36 from 1818624 to 1835008 tid 4 2024-03-04T06:48:45.894 INFO:tasks.rados.rados.0.smithi137.stdout:2088: snap_create 2024-03-04T06:48:45.894 INFO:tasks.rados.rados.0.smithi137.stdout:2086: finishing write tid 3 to smithi13777483-6 2024-03-04T06:48:45.894 INFO:tasks.rados.rados.0.smithi137.stdout:2086: finishing write tid 4 to smithi13777483-6 2024-03-04T06:48:45.894 INFO:tasks.rados.rados.0.smithi137.stdout:2086: finishing write tid 5 to smithi13777483-6 2024-03-04T06:48:45.894 INFO:tasks.rados.rados.0.smithi137.stdout:2086: finishing write tid 6 to smithi13777483-6 2024-03-04T06:48:45.894 INFO:tasks.rados.rados.0.smithi137.stdout:2086: oid 6 updating version 0 to 15495 2024-03-04T06:48:45.894 INFO:tasks.rados.rados.0.smithi137.stdout:2086: oid 6 version 15495 is already newer than 15493 2024-03-04T06:48:45.894 INFO:tasks.rados.rados.0.smithi137.stdout:2086: oid 6 version 15495 is already newer than 15494 2024-03-04T06:48:45.894 INFO:tasks.rados.rados.0.smithi137.stdout:2086: oid 6 version 15495 is already newer than 15491 2024-03-04T06:48:45.895 INFO:tasks.rados.rados.0.smithi137.stdout:2086: oid 6 version 15495 is already newer than 15492 2024-03-04T06:48:45.895 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 15495 (ObjNum 681 snap 193 seq_num 681) dirty exists 2024-03-04T06:48:45.895 INFO:tasks.rados.rados.0.smithi137.stdout:2086: left oid 6 (ObjNum 681 snap 193 seq_num 681) 2024-03-04T06:48:45.895 INFO:tasks.rados.rados.0.smithi137.stdout:2087: finishing write tid 1 to smithi13777483-36 2024-03-04T06:48:45.895 INFO:tasks.rados.rados.0.smithi137.stdout:2087: finishing write tid 2 to smithi13777483-36 2024-03-04T06:48:45.897 INFO:tasks.rados.rados.0.smithi137.stdout:2087: finishing write tid 3 to smithi13777483-36 2024-03-04T06:48:45.898 INFO:tasks.rados.rados.0.smithi137.stdout:2087: finishing write tid 4 to smithi13777483-36 2024-03-04T06:48:45.898 INFO:tasks.rados.rados.0.smithi137.stdout:2087: finishing write tid 5 to smithi13777483-36 2024-03-04T06:48:45.899 INFO:tasks.rados.rados.0.smithi137.stdout:2087: finishing write tid 6 to smithi13777483-36 2024-03-04T06:48:45.899 INFO:tasks.rados.rados.0.smithi137.stdout:2087: oid 36 updating version 0 to 344 2024-03-04T06:48:45.899 INFO:tasks.rados.rados.0.smithi137.stdout:2087: oid 36 updating version 344 to 345 2024-03-04T06:48:45.899 INFO:tasks.rados.rados.0.smithi137.stdout:2087: oid 36 updating version 345 to 346 2024-03-04T06:48:45.899 INFO:tasks.rados.rados.0.smithi137.stdout:2087: oid 36 updating version 346 to 347 2024-03-04T06:48:45.899 INFO:tasks.rados.rados.0.smithi137.stdout:2087: oid 36 version 347 is already newer than 343 2024-03-04T06:48:45.899 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 347 (ObjNum 682 snap 193 seq_num 682) dirty exists 2024-03-04T06:48:45.899 INFO:tasks.rados.rados.0.smithi137.stdout:2087: left oid 36 (ObjNum 682 snap 193 seq_num 682) 2024-03-04T06:48:46.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:45.814+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:46.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:45.814+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:46.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:45.890+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:46.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:45.879+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:46.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:45.880+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:46.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:45.880+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[91314]: Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-03-04T06:48:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[91314]: osdmap e456: 8 total, 7 up, 8 in 2024-03-04T06:48:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:46.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:46.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[88869]: Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-03-04T06:48:46.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:46.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[88869]: osdmap e456: 8 total, 7 up, 8 in 2024-03-04T06:48:46.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:46.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:46.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:46.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:46.295 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:45.817+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:46.378 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:46 smithi203 podman[95445]: 2024-03-04 06:48:46.355942627 +0000 UTC m=+0.580691238 container remove 965c56a7a811ccd4cd5ff4e496ce9a8188e422c8dc5eba8ab162c17ea0f963bc (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-deactivate, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240222) 2024-03-04T06:48:46.798 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:46 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.5.service: Deactivated successfully. 2024-03-04T06:48:46.798 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:46 smithi203 systemd[1]: Stopped Ceph osd.5 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:48:46.798 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:46 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.5.service: Consumed 17.400s CPU time. 2024-03-04T06:48:46.798 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:46 smithi203 systemd[1]: Starting Ceph osd.5 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:48:46.826 INFO:tasks.rados.rados.0.smithi137.stdout:2086: done (2 left) 2024-03-04T06:48:46.826 INFO:tasks.rados.rados.0.smithi137.stdout:2087: done (1 left) 2024-03-04T06:48:46.826 INFO:tasks.rados.rados.0.smithi137.stdout:2088: done (0 left) 2024-03-04T06:48:46.826 INFO:tasks.rados.rados.0.smithi137.stdout:2089: rmattr oid 11 current snap is 194 2024-03-04T06:48:46.826 INFO:tasks.rados.rados.0.smithi137.stdout:2090: read oid 20 snap -1 2024-03-04T06:48:46.826 INFO:tasks.rados.rados.0.smithi137.stdout:2090: expect (ObjNum 568 snap 159 seq_num 568) 2024-03-04T06:48:46.826 INFO:tasks.rados.rados.0.smithi137.stdout:2091: copy_from oid 23 from oid 37 current snap is 194 2024-03-04T06:48:46.826 INFO:tasks.rados.rados.0.smithi137.stdout:2092: snap_create 2024-03-04T06:48:46.832 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16806 (ObjNum 680 snap 192 seq_num 680) dirty exists 2024-03-04T06:48:46.833 INFO:tasks.rados.rados.0.smithi137.stdout:2091: finishing copy_from to smithi13777483-23 2024-03-04T06:48:46.833 INFO:tasks.rados.rados.0.smithi137.stdout:2091: got expected ENOENT (src dne) 2024-03-04T06:48:46.833 INFO:tasks.rados.rados.0.smithi137.stdout:2091: finishing copy_from racing read to smithi13777483-23 2024-03-04T06:48:46.861 INFO:tasks.rados.rados.0.smithi137.stdout:2090: expect (ObjNum 568 snap 159 seq_num 568) 2024-03-04T06:48:47.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:46.823+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:47.096 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:46 smithi203 podman[95547]: 2024-03-04 06:48:46.701011375 +0000 UTC m=+0.018804674 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:48:47.096 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:46 smithi203 podman[95547]: 2024-03-04 06:48:46.827661831 +0000 UTC m=+0.145455129 container create 8f60acb1013aed738f9f276b3cd0a5cf5776a21ba1494b87e82bb36944d43804 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:48:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:46 smithi203 ceph-mon[85573]: osdmap e457: 8 total, 7 up, 8 in 2024-03-04T06:48:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:46 smithi203 ceph-mon[85573]: pgmap v362: 121 pgs: 9 active+undersized, 16 peering, 8 stale+active+clean, 6 active+clean+snaptrim_error, 82 active+clean; 304 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.7 MiB/s rd, 4.4 MiB/s wr, 20 op/s 2024-03-04T06:48:47.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:46.832+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[88869]: osdmap e457: 8 total, 7 up, 8 in 2024-03-04T06:48:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:47.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:47.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:47.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[88869]: pgmap v362: 121 pgs: 9 active+undersized, 16 peering, 8 stale+active+clean, 6 active+clean+snaptrim_error, 82 active+clean; 304 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.7 MiB/s rd, 4.4 MiB/s wr, 20 op/s 2024-03-04T06:48:47.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:46.830+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[91314]: osdmap e457: 8 total, 7 up, 8 in 2024-03-04T06:48:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:47.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:47.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:47.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:47.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:46 smithi137 ceph-mon[91314]: pgmap v362: 121 pgs: 9 active+undersized, 16 peering, 8 stale+active+clean, 6 active+clean+snaptrim_error, 82 active+clean; 304 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.7 MiB/s rd, 4.4 MiB/s wr, 20 op/s 2024-03-04T06:48:47.546 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 podman[95547]: 2024-03-04 06:48:47.10318587 +0000 UTC m=+0.420979171 container init 8f60acb1013aed738f9f276b3cd0a5cf5776a21ba1494b87e82bb36944d43804 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-03-04T06:48:47.546 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 podman[95547]: 2024-03-04 06:48:47.107224529 +0000 UTC m=+0.425017822 container start 8f60acb1013aed738f9f276b3cd0a5cf5776a21ba1494b87e82bb36944d43804 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-activate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T06:48:47.546 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 podman[95547]: 2024-03-04 06:48:47.218250933 +0000 UTC m=+0.536044247 container attach 8f60acb1013aed738f9f276b3cd0a5cf5776a21ba1494b87e82bb36944d43804 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-activate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5) 2024-03-04T06:48:47.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:47.307+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:47.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:47.307+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:47.822 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-activate[95562]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-04T06:48:47.822 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-activate[95562]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-04T06:48:47.822 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-activate[95562]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-04T06:48:47.822 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-activate[95562]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-04T06:48:47.822 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-activate[95562]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-03-04T06:48:47.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-activate[95562]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-04T06:48:47.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 bash[95547]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-04T06:48:47.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 bash[95547]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-04T06:48:47.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 bash[95547]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-04T06:48:47.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 bash[95547]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-04T06:48:47.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 bash[95547]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-03-04T06:48:47.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 bash[95547]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-04T06:48:47.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 bash[95547]: --> ceph-volume raw activate successful for osd ID: 5 2024-03-04T06:48:47.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-activate[95562]: --> ceph-volume raw activate successful for osd ID: 5 2024-03-04T06:48:47.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:47 smithi203 podman[95547]: 2024-03-04 06:48:47.571373884 +0000 UTC m=+0.889167168 container died 8f60acb1013aed738f9f276b3cd0a5cf5776a21ba1494b87e82bb36944d43804 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-activate, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-04T06:48:47.832 INFO:tasks.rados.rados.0.smithi137.stdout:2089: done (3 left) 2024-03-04T06:48:47.833 INFO:tasks.rados.rados.0.smithi137.stdout:2090: done (2 left) 2024-03-04T06:48:47.833 INFO:tasks.rados.rados.0.smithi137.stdout:2091: done (1 left) 2024-03-04T06:48:47.833 INFO:tasks.rados.rados.0.smithi137.stdout:2092: done (0 left) 2024-03-04T06:48:47.833 INFO:tasks.rados.rados.0.smithi137.stdout:2093: rollback oid 30 current snap is 195 2024-03-04T06:48:47.833 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 30 to 181 2024-03-04T06:48:47.833 INFO:tasks.rados.rados.0.smithi137.stdout:2094: rollback oid 36 current snap is 195 2024-03-04T06:48:47.833 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 36 to 192 2024-03-04T06:48:47.833 INFO:tasks.rados.rados.0.smithi137.stdout:2095: read oid 1 snap -1 2024-03-04T06:48:47.833 INFO:tasks.rados.rados.0.smithi137.stdout:2095: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:48:47.833 INFO:tasks.rados.rados.0.smithi137.stdout:2096: snap_remove snap 193 2024-03-04T06:48:48.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:47.831+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:48.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:47.831+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:48.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:48.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-mon[85573]: osdmap e458: 8 total, 7 up, 8 in 2024-03-04T06:48:48.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:48.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:48.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:48.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:48.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:47.831+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:48.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:47.842+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:48.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:47.842+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:48.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:47.843+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:48.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:48.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-mon[91314]: osdmap e458: 8 total, 7 up, 8 in 2024-03-04T06:48:48.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:48.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:48.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:48.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:48.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:48.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-mon[88869]: osdmap e458: 8 total, 7 up, 8 in 2024-03-04T06:48:48.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:48.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:48.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:48.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:48.295 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:47.836+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:48.422 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:48 smithi203 podman[95679]: 2024-03-04 06:48:48.147052905 +0000 UTC m=+0.570693158 container remove 8f60acb1013aed738f9f276b3cd0a5cf5776a21ba1494b87e82bb36944d43804 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-03-04T06:48:48.423 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:48 smithi203 podman[95745]: 2024-03-04 06:48:48.262888354 +0000 UTC m=+0.017667451 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:48:48.423 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:48 smithi203 podman[95745]: 2024-03-04 06:48:48.422954802 +0000 UTC m=+0.177733960 container create 9e05ca76b1642c020d53db50e67d3d2d97565be866388a17e783b7db018cb1b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222) 2024-03-04T06:48:48.673 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:48 smithi203 podman[95745]: 2024-03-04 06:48:48.650168908 +0000 UTC m=+0.404948001 container init 9e05ca76b1642c020d53db50e67d3d2d97565be866388a17e783b7db018cb1b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0) 2024-03-04T06:48:48.673 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:48 smithi203 podman[95745]: 2024-03-04 06:48:48.654047123 +0000 UTC m=+0.408826216 container start 9e05ca76b1642c020d53db50e67d3d2d97565be866388a17e783b7db018cb1b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:48:48.841 INFO:tasks.rados.rados.0.smithi137.stdout:2096: done (3 left) 2024-03-04T06:48:48.841 INFO:tasks.rados.rados.0.smithi137.stdout:2097: snap_create 2024-03-04T06:48:48.841 INFO:tasks.rados.rados.0.smithi137.stdout:2094: finishing rollback tid 0 to smithi13777483-36 2024-03-04T06:48:48.841 INFO:tasks.rados.rados.0.smithi137.stdout:2094: finishing rollback tid 1 to smithi13777483-36 2024-03-04T06:48:48.841 INFO:tasks.rados.rados.0.smithi137.stdout:2094: finishing rollback tid 2 to smithi13777483-36 2024-03-04T06:48:48.841 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 350 (ObjNum 97 snap 0 seq_num 3162484016) dirty exists 2024-03-04T06:48:48.841 INFO:tasks.rados.rados.0.smithi137.stdout:2093: finishing rollback tid 0 to smithi13777483-30 2024-03-04T06:48:48.841 INFO:tasks.rados.rados.0.smithi137.stdout:2093: finishing rollback tid 1 to smithi13777483-30 2024-03-04T06:48:48.842 INFO:tasks.rados.rados.0.smithi137.stdout:2093: finishing rollback tid 2 to smithi13777483-30 2024-03-04T06:48:48.842 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16764 (ObjNum 646 snap 179 seq_num 646) dirty exists 2024-03-04T06:48:48.842 INFO:tasks.rados.rados.0.smithi137.stdout:2095: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:48:49.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:48.837+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:49.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:49.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:48 smithi203 ceph-mon[85573]: osdmap e459: 8 total, 7 up, 8 in 2024-03-04T06:48:49.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:49.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:49.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:49.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:48 smithi203 ceph-mon[85573]: pgmap v365: 121 pgs: 6 active+undersized+degraded, 1 active+undersized+degraded+snaptrim_error, 26 active+undersized, 16 peering, 5 active+clean+snaptrim_error, 67 active+clean; 327 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.2 MiB/s wr, 28 op/s; 56/597 objects degraded (9.380%) 2024-03-04T06:48:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:48 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:48 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:49.097 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:48 smithi203 ceph-osd[95765]: -- 172.21.15.203:0/549345514 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e0d0231680 con 0x55e0d01fac00 2024-03-04T06:48:49.097 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:48 smithi203 bash[95745]: 9e05ca76b1642c020d53db50e67d3d2d97565be866388a17e783b7db018cb1b9 2024-03-04T06:48:49.097 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:48 smithi203 systemd[1]: Started Ceph osd.5 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:48:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[88869]: osdmap e459: 8 total, 7 up, 8 in 2024-03-04T06:48:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:49.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[88869]: pgmap v365: 121 pgs: 6 active+undersized+degraded, 1 active+undersized+degraded+snaptrim_error, 26 active+undersized, 16 peering, 5 active+clean+snaptrim_error, 67 active+clean; 327 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.2 MiB/s wr, 28 op/s; 56/597 objects degraded (9.380%) 2024-03-04T06:48:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:49.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[91314]: osdmap e459: 8 total, 7 up, 8 in 2024-03-04T06:48:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:49.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[91314]: pgmap v365: 121 pgs: 6 active+undersized+degraded, 1 active+undersized+degraded+snaptrim_error, 26 active+undersized, 16 peering, 5 active+clean+snaptrim_error, 67 active+clean; 327 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.2 MiB/s wr, 28 op/s; 56/597 objects degraded (9.380%) 2024-03-04T06:48:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:49.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:49.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:48.842+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:49.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:48.843+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:49.295 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:48.886+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:49.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:49.192+0000 7f78c047f7c0 -1 Falling back to public interface 2024-03-04T06:48:49.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:49.497+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:49.842 INFO:tasks.rados.rados.0.smithi137.stdout:2093: done (3 left) 2024-03-04T06:48:49.842 INFO:tasks.rados.rados.0.smithi137.stdout:2094: done (2 left) 2024-03-04T06:48:49.842 INFO:tasks.rados.rados.0.smithi137.stdout:2095: done (1 left) 2024-03-04T06:48:49.842 INFO:tasks.rados.rados.0.smithi137.stdout:2097: done (0 left) 2024-03-04T06:48:49.843 INFO:tasks.rados.rados.0.smithi137.stdout:2098: snap_create 2024-03-04T06:48:50.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:49 smithi203 ceph-mon[85573]: Health check failed: Degraded data redundancy: 56/597 objects degraded (9.380%), 7 pgs degraded (PG_DEGRADED) 2024-03-04T06:48:50.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:50.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:49 smithi203 ceph-mon[85573]: osdmap e460: 8 total, 7 up, 8 in 2024-03-04T06:48:50.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:50.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:50.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:49 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:48:50.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:50.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:49.838+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:50.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:49.838+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[88869]: Health check failed: Degraded data redundancy: 56/597 objects degraded (9.380%), 7 pgs degraded (PG_DEGRADED) 2024-03-04T06:48:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[88869]: osdmap e460: 8 total, 7 up, 8 in 2024-03-04T06:48:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:48:50.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[91314]: Health check failed: Degraded data redundancy: 56/597 objects degraded (9.380%), 7 pgs degraded (PG_DEGRADED) 2024-03-04T06:48:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[91314]: osdmap e460: 8 total, 7 up, 8 in 2024-03-04T06:48:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:48:50.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:50.842 INFO:tasks.rados.rados.0.smithi137.stdout:2098: done (0 left) 2024-03-04T06:48:50.842 INFO:tasks.rados.rados.0.smithi137.stdout:2099: setattr oid 22 current snap is 197 2024-03-04T06:48:50.843 INFO:tasks.rados.rados.0.smithi137.stdout:2100: snap_remove snap 195 2024-03-04T06:48:51.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:50.843+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:51.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:51.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:51.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:50 smithi203 ceph-mon[85573]: osdmap e461: 8 total, 7 up, 8 in 2024-03-04T06:48:51.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:50 smithi203 ceph-mon[85573]: pgmap v368: 121 pgs: 10 active+undersized+degraded, 1 active+undersized+degraded+snaptrim_error, 38 active+undersized, 5 active+clean+snaptrim_error, 67 active+clean; 329 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.2 MiB/s wr, 33 op/s; 67/603 objects degraded (11.111%) 2024-03-04T06:48:51.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:50 smithi203 ceph-mon[85573]: osdmap e462: 8 total, 7 up, 8 in 2024-03-04T06:48:51.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:50.807+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:51.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:51.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:51.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-mon[88869]: osdmap e461: 8 total, 7 up, 8 in 2024-03-04T06:48:51.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-mon[88869]: pgmap v368: 121 pgs: 10 active+undersized+degraded, 1 active+undersized+degraded+snaptrim_error, 38 active+undersized, 5 active+clean+snaptrim_error, 67 active+clean; 329 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.2 MiB/s wr, 33 op/s; 67/603 objects degraded (11.111%) 2024-03-04T06:48:51.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-mon[88869]: osdmap e462: 8 total, 7 up, 8 in 2024-03-04T06:48:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-mon[91314]: osdmap e461: 8 total, 7 up, 8 in 2024-03-04T06:48:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-mon[91314]: pgmap v368: 121 pgs: 10 active+undersized+degraded, 1 active+undersized+degraded+snaptrim_error, 38 active+undersized, 5 active+clean+snaptrim_error, 67 active+clean; 329 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.2 MiB/s wr, 33 op/s; 67/603 objects degraded (11.111%) 2024-03-04T06:48:51.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-mon[91314]: osdmap e462: 8 total, 7 up, 8 in 2024-03-04T06:48:51.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:50.809+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:51.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:50.807+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:51.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:50.807+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:51.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:50.808+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:51.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:50.846+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:51.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:50.846+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:51.847 INFO:tasks.rados.rados.0.smithi137.stdout:2100: done (1 left) 2024-03-04T06:48:51.847 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 197 2024-03-04T06:48:51.847 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 15496 (ObjNum 81 snap 0 seq_num 3817183799) dirty exists 2024-03-04T06:48:51.847 INFO:tasks.rados.rados.0.smithi137.stdout:2101: seq_num 683 ranges {9912320=647168,10559488=630784,11190272=573440} 2024-03-04T06:48:51.903 INFO:tasks.rados.rados.0.smithi137.stdout:2101: writing smithi13777483-11 from 9912320 to 10559488 tid 1 2024-03-04T06:48:51.907 INFO:tasks.rados.rados.0.smithi137.stdout:2101: writing smithi13777483-11 from 10559488 to 11190272 tid 2 2024-03-04T06:48:51.911 INFO:tasks.rados.rados.0.smithi137.stdout:2101: writing smithi13777483-11 from 11190272 to 11763712 tid 3 2024-03-04T06:48:51.911 INFO:tasks.rados.rados.0.smithi137.stdout:2099: done (1 left) 2024-03-04T06:48:51.911 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 197 2024-03-04T06:48:51.911 INFO:tasks.rados.rados.0.smithi137.stdout:2101: finishing write tid 1 to smithi13777483-11 2024-03-04T06:48:51.912 INFO:tasks.rados.rados.0.smithi137.stdout:2102: seq_num 684 ranges {1695744=663552,2359296=507904,2867200=409600,3276800=286720} 2024-03-04T06:48:51.924 INFO:tasks.rados.rados.0.smithi137.stdout:2102: writing smithi13777483-44 from 1695744 to 2359296 tid 1 2024-03-04T06:48:51.927 INFO:tasks.rados.rados.0.smithi137.stdout:2102: writing smithi13777483-44 from 2359296 to 2867200 tid 2 2024-03-04T06:48:51.930 INFO:tasks.rados.rados.0.smithi137.stdout:2102: writing smithi13777483-44 from 2867200 to 3276800 tid 3 2024-03-04T06:48:51.932 INFO:tasks.rados.rados.0.smithi137.stdout:2102: writing smithi13777483-44 from 3276800 to 3563520 tid 4 2024-03-04T06:48:51.932 INFO:tasks.rados.rados.0.smithi137.stdout:2103: setattr oid 23 current snap is 197 2024-03-04T06:48:51.932 INFO:tasks.rados.rados.0.smithi137.stdout:2101: finishing write tid 2 to smithi13777483-11 2024-03-04T06:48:51.932 INFO:tasks.rados.rados.0.smithi137.stdout:2101: finishing write tid 3 to smithi13777483-11 2024-03-04T06:48:51.932 INFO:tasks.rados.rados.0.smithi137.stdout:2101: finishing write tid 4 to smithi13777483-11 2024-03-04T06:48:51.933 INFO:tasks.rados.rados.0.smithi137.stdout:2101: finishing write tid 5 to smithi13777483-11 2024-03-04T06:48:51.933 INFO:tasks.rados.rados.0.smithi137.stdout:2101: oid 11 updating version 0 to 16807 2024-03-04T06:48:51.933 INFO:tasks.rados.rados.0.smithi137.stdout:2101: oid 11 updating version 16807 to 16810 2024-03-04T06:48:51.933 INFO:tasks.rados.rados.0.smithi137.stdout:2101: oid 11 version 16810 is already newer than 16808 2024-03-04T06:48:51.933 INFO:tasks.rados.rados.0.smithi137.stdout:2101: oid 11 version 16810 is already newer than 16809 2024-03-04T06:48:51.933 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16810 (ObjNum 683 snap 197 seq_num 683) dirty exists 2024-03-04T06:48:51.933 INFO:tasks.rados.rados.0.smithi137.stdout:2101: left oid 11 (ObjNum 683 snap 197 seq_num 683) 2024-03-04T06:48:51.934 INFO:tasks.rados.rados.0.smithi137.stdout:2101: done (2 left) 2024-03-04T06:48:51.934 INFO:tasks.rados.rados.0.smithi137.stdout:2104: snap_remove snap 190 2024-03-04T06:48:52.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:51.708+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:52.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:51.907+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:52.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:52.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:52.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:52.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:52.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:52.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[88869]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2024-03-04T06:48:52.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:52.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:52.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[88869]: osdmap e463: 8 total, 7 up, 8 in 2024-03-04T06:48:52.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:51.926+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:52.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:51.926+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:52.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:51.931+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:52.045 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:51.709+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:52.045 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:51.885+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:52.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:52.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:52.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:52.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:52.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:52.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[91314]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2024-03-04T06:48:52.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:52.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:52.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:51 smithi137 ceph-mon[91314]: osdmap e463: 8 total, 7 up, 8 in 2024-03-04T06:48:52.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:51.842+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:52.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:51.842+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:52.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:52.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:52.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:52.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:52.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:52.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:51 smithi203 ceph-mon[85573]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2024-03-04T06:48:52.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:52.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:52.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:51 smithi203 ceph-mon[85573]: osdmap e463: 8 total, 7 up, 8 in 2024-03-04T06:48:52.533 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:48:52.847 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:48:52.847 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (8m) 69s ago 9m 26.4M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:48:52.847 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (9m) 34s ago 9m 86.9M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:48:52.847 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (10m) 69s ago 10m 18.6M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:48:52.847 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (10m) 34s ago 10m 20.2M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:48:52.847 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (4m) 34s ago 14m 450M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:48:52.847 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (5m) 69s ago 16m 506M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:48:52.847 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (4m) 69s ago 16m 53.0M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:48:52.847 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (3m) 34s ago 14m 43.8M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:48:52.847 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (3m) 69s ago 14m 46.8M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:48:52.847 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (9m) 69s ago 9m 17.3M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:48:52.848 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (9m) 34s ago 9m 15.7M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:48:52.848 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (2m) 69s ago 13m 208M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 bd2207652b33 2024-03-04T06:48:52.848 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (2m) 69s ago 13m 142M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 47b5cdaad147 2024-03-04T06:48:52.848 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (108s) 69s ago 13m 114M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 436ae07776d9 2024-03-04T06:48:52.848 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (73s) 69s ago 12m 12.7M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9acd06dda8ec 2024-03-04T06:48:52.848 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (39s) 34s ago 12m 11.9M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9a246a0996bd 2024-03-04T06:48:52.848 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 starting - - - 2480M 2024-03-04T06:48:52.848 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (11m) 34s ago 11m 190M 2480M 18.2.1-696-g5cc7a767 540557f94930 f9f5bac59bb2 2024-03-04T06:48:52.848 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (11m) 34s ago 11m 223M 2480M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:48:52.848 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (4m) 34s ago 10m 56.4M - 2.43.0 a07b618ecd1d 6a88bdd1023c 2024-03-04T06:48:52.869 INFO:tasks.rados.rados.0.smithi137.stdout:2104: done (2 left) 2024-03-04T06:48:52.869 INFO:tasks.rados.rados.0.smithi137.stdout:2105: read oid 25 snap -1 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:2105: expect (ObjNum 544 snap 155 seq_num 544) 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:2106: delete oid 30 current snap is 197 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 15491 (ObjNum 638 snap 178 seq_num 638) dirty exists 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:2102: finishing write tid 1 to smithi13777483-44 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:2102: finishing write tid 2 to smithi13777483-44 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:2102: finishing write tid 3 to smithi13777483-44 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:2102: finishing write tid 4 to smithi13777483-44 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:2102: finishing write tid 5 to smithi13777483-44 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:2102: finishing write tid 6 to smithi13777483-44 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:2102: oid 44 updating version 0 to 16792 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:2102: oid 44 version 16792 is already newer than 16791 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:2102: oid 44 version 16792 is already newer than 16789 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:2102: oid 44 updating version 16792 to 16793 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:2102: oid 44 version 16793 is already newer than 16790 2024-03-04T06:48:52.870 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16793 (ObjNum 684 snap 197 seq_num 684) dirty exists 2024-03-04T06:48:52.871 INFO:tasks.rados.rados.0.smithi137.stdout:2102: left oid 44 (ObjNum 684 snap 197 seq_num 684) 2024-03-04T06:48:52.874 INFO:tasks.rados.rados.0.smithi137.stdout:2102: done (3 left) 2024-03-04T06:48:52.874 INFO:tasks.rados.rados.0.smithi137.stdout:2103: done (2 left) 2024-03-04T06:48:52.874 INFO:tasks.rados.rados.0.smithi137.stdout:2106: done (1 left) 2024-03-04T06:48:52.874 INFO:tasks.rados.rados.0.smithi137.stdout:2107: snap_remove snap 181 2024-03-04T06:48:52.884 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:52.884 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:52.884 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:52.884 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:52.884 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:52.884 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:52.884 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:52.884 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:52 smithi203 ceph-mon[85573]: pgmap v371: 121 pgs: 10 active+undersized+degraded, 1 active+undersized+degraded+snaptrim_error, 38 active+undersized, 5 active+clean+snaptrim_error, 67 active+clean; 329 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 440 KiB/s wr, 5 op/s; 67/603 objects degraded (11.111%) 2024-03-04T06:48:52.884 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:52 smithi203 ceph-mon[85573]: from='osd.5 [v2:172.21.15.203:6808/1125048708,v1:172.21.15.203:6809/1125048708]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T06:48:52.884 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:52 smithi203 ceph-mon[85573]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T06:48:52.885 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:52.863+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:52.885 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:52.789+0000 7f78c047f7c0 -1 osd.5 454 log_to_monitors true 2024-03-04T06:48:53.244 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:52.868+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:53.244 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:52.872+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:53.244 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:52.872+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:53.245 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:48:53.245 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:48:53.245 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:48:53.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:48:53.245 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:48:53.245 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:48:53.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:48:53.245 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:48:53.245 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2, 2024-03-04T06:48:53.245 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 5 2024-03-04T06:48:53.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:48:53.245 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:48:53.245 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:48:53.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:48:53.246 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:48:53.246 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 4, 2024-03-04T06:48:53.246 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 10 2024-03-04T06:48:53.246 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:48:53.246 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:48:53.246 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:53.246 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:53.246 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:53.246 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:53.246 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:53.247 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:53.247 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:53.247 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[91314]: pgmap v371: 121 pgs: 10 active+undersized+degraded, 1 active+undersized+degraded+snaptrim_error, 38 active+undersized, 5 active+clean+snaptrim_error, 67 active+clean; 329 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 440 KiB/s wr, 5 op/s; 67/603 objects degraded (11.111%) 2024-03-04T06:48:53.247 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[91314]: from='osd.5 [v2:172.21.15.203:6808/1125048708,v1:172.21.15.203:6809/1125048708]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T06:48:53.247 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[91314]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T06:48:53.247 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:53.247 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:53.247 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:53.247 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:53.248 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:53.248 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:53.248 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:53.248 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[88869]: pgmap v371: 121 pgs: 10 active+undersized+degraded, 1 active+undersized+degraded+snaptrim_error, 38 active+undersized, 5 active+clean+snaptrim_error, 67 active+clean; 329 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 440 KiB/s wr, 5 op/s; 67/603 objects degraded (11.111%) 2024-03-04T06:48:53.248 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[88869]: from='osd.5 [v2:172.21.15.203:6808/1125048708,v1:172.21.15.203:6809/1125048708]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T06:48:53.248 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:52 smithi137 ceph-mon[88869]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T06:48:53.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:52.899+0000 7f78b18d7700 -1 osd.5 454 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:48:53.870 INFO:tasks.rados.rados.0.smithi137.stdout:2105: expect (ObjNum 544 snap 155 seq_num 544) 2024-03-04T06:48:53.992 INFO:tasks.rados.rados.0.smithi137.stdout:2105: done (1 left) 2024-03-04T06:48:53.993 INFO:tasks.rados.rados.0.smithi137.stdout:2107: done (0 left) 2024-03-04T06:48:53.993 INFO:tasks.rados.rados.0.smithi137.stdout:2108: rollback oid 11 current snap is 197 2024-03-04T06:48:53.993 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 11 to 196 2024-03-04T06:48:53.993 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 197 2024-03-04T06:48:53.993 INFO:tasks.rados.rados.0.smithi137.stdout:2109: seq_num 686 ranges {12279808=696320,12976128=729088,13705216=425984,14131200=49152} 2024-03-04T06:48:54.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:53.879+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:54.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:53.873+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:54.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: from='client.34311 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:48:54.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: from='client.44258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:48:54.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-04T06:48:54.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:54.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: from='osd.5 [v2:172.21.15.203:6808/1125048708,v1:172.21.15.203:6809/1125048708]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:48:54.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: osdmap e464: 8 total, 7 up, 8 in 2024-03-04T06:48:54.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:48:54.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:54.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:54.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:54.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:54.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:54.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/1588638964' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:54.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:54.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:48:54.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:53.878+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:54.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:53.878+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:54.045 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:53.882+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:54.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: from='client.34311 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:48:54.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: from='client.44258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:48:54.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-04T06:48:54.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:54.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: from='osd.5 [v2:172.21.15.203:6808/1125048708,v1:172.21.15.203:6809/1125048708]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:48:54.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: osdmap e464: 8 total, 7 up, 8 in 2024-03-04T06:48:54.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:48:54.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:54.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:54.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:54.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:54.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:54.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/1588638964' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:54.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:54.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:53 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:48:54.061 INFO:tasks.rados.rados.0.smithi137.stdout:2109: writing smithi13777483-6 from 12279808 to 12976128 tid 1 2024-03-04T06:48:54.065 INFO:tasks.rados.rados.0.smithi137.stdout:2109: writing smithi13777483-6 from 12976128 to 13705216 tid 2 2024-03-04T06:48:54.068 INFO:tasks.rados.rados.0.smithi137.stdout:2109: writing smithi13777483-6 from 13705216 to 14131200 tid 3 2024-03-04T06:48:54.068 INFO:tasks.rados.rados.0.smithi137.stdout:2109: writing smithi13777483-6 from 14131200 to 14180352 tid 4 2024-03-04T06:48:54.069 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 37 current snap is 197 2024-03-04T06:48:54.069 INFO:tasks.rados.rados.0.smithi137.stdout:2108: finishing rollback tid 0 to smithi13777483-11 2024-03-04T06:48:54.069 INFO:tasks.rados.rados.0.smithi137.stdout:2108: finishing rollback tid 1 to smithi13777483-11 2024-03-04T06:48:54.069 INFO:tasks.rados.rados.0.smithi137.stdout:2108: finishing rollback tid 2 to smithi13777483-11 2024-03-04T06:48:54.069 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16813 (ObjNum 680 snap 192 seq_num 680) dirty exists 2024-03-04T06:48:54.069 INFO:tasks.rados.rados.0.smithi137.stdout:2110: seq_num 687 ranges {0=712704,712704=614400,1327104=589824} 2024-03-04T06:48:54.072 INFO:tasks.rados.rados.0.smithi137.stdout:2110: writing smithi13777483-37 from 0 to 712704 tid 1 2024-03-04T06:48:54.075 INFO:tasks.rados.rados.0.smithi137.stdout:2110: writing smithi13777483-37 from 712704 to 1327104 tid 2 2024-03-04T06:48:54.078 INFO:tasks.rados.rados.0.smithi137.stdout:2110: writing smithi13777483-37 from 1327104 to 1916928 tid 3 2024-03-04T06:48:54.079 INFO:tasks.rados.rados.0.smithi137.stdout:2108: done (2 left) 2024-03-04T06:48:54.079 INFO:tasks.rados.rados.0.smithi137.stdout:2111: snap_create 2024-03-04T06:48:54.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:53.868+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:54.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:53.868+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:54.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: from='client.34311 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:48:54.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: from='client.44258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:48:54.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-04T06:48:54.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:54.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: from='osd.5 [v2:172.21.15.203:6808/1125048708,v1:172.21.15.203:6809/1125048708]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:48:54.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: osdmap e464: 8 total, 7 up, 8 in 2024-03-04T06:48:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:48:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/1588638964' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:53 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:48:54.873 INFO:tasks.rados.rados.0.smithi137.stdout:2111: done (2 left) 2024-03-04T06:48:54.873 INFO:tasks.rados.rados.0.smithi137.stdout:2112: rollback oid 16 current snap is 198 2024-03-04T06:48:54.873 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 16 to 196 2024-03-04T06:48:54.873 INFO:tasks.rados.rados.0.smithi137.stdout:2113: read oid 42 snap -1 2024-03-04T06:48:54.873 INFO:tasks.rados.rados.0.smithi137.stdout:2113: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:48:54.873 INFO:tasks.rados.rados.0.smithi137.stdout:2114: delete oid 30 current snap is 198 2024-03-04T06:48:54.893 INFO:tasks.rados.rados.0.smithi137.stdout:2112: finishing rollback tid 0 to smithi13777483-16 2024-03-04T06:48:54.893 INFO:tasks.rados.rados.0.smithi137.stdout:2112: finishing rollback tid 1 to smithi13777483-16 2024-03-04T06:48:54.896 INFO:tasks.rados.rados.0.smithi137.stdout:2112: finishing rollback tid 2 to smithi13777483-16 2024-03-04T06:48:54.896 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16797 (ObjNum 617 snap 175 seq_num 617) dirty exists 2024-03-04T06:48:54.899 INFO:tasks.rados.rados.0.smithi137.stdout:2113: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:48:54.905 INFO:tasks.rados.rados.0.smithi137.stdout:2110: finishing write tid 1 to smithi13777483-37 2024-03-04T06:48:54.908 INFO:tasks.rados.rados.0.smithi137.stdout:2112: done (4 left) 2024-03-04T06:48:54.908 INFO:tasks.rados.rados.0.smithi137.stdout:2113: done (3 left) 2024-03-04T06:48:54.909 INFO:tasks.rados.rados.0.smithi137.stdout:2114: done (2 left) 2024-03-04T06:48:54.909 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 198 2024-03-04T06:48:54.909 INFO:tasks.rados.rados.0.smithi137.stdout:2115: seq_num 689 ranges {7602176=745472,8347648=786432,9134080=417792} 2024-03-04T06:48:54.954 INFO:tasks.rados.rados.0.smithi137.stdout:2115: writing smithi13777483-38 from 7602176 to 8347648 tid 1 2024-03-04T06:48:54.959 INFO:tasks.rados.rados.0.smithi137.stdout:2115: writing smithi13777483-38 from 8347648 to 9134080 tid 2 2024-03-04T06:48:54.962 INFO:tasks.rados.rados.0.smithi137.stdout:2115: writing smithi13777483-38 from 9134080 to 9551872 tid 3 2024-03-04T06:48:54.962 INFO:tasks.rados.rados.0.smithi137.stdout:2116: copy_from oid 13 from oid 49 current snap is 198 2024-03-04T06:48:54.962 INFO:tasks.rados.rados.0.smithi137.stdout:2110: finishing write tid 2 to smithi13777483-37 2024-03-04T06:48:54.963 INFO:tasks.rados.rados.0.smithi137.stdout:2110: finishing write tid 3 to smithi13777483-37 2024-03-04T06:48:54.963 INFO:tasks.rados.rados.0.smithi137.stdout:2110: finishing write tid 4 to smithi13777483-37 2024-03-04T06:48:54.963 INFO:tasks.rados.rados.0.smithi137.stdout:2110: finishing write tid 5 to smithi13777483-37 2024-03-04T06:48:54.963 INFO:tasks.rados.rados.0.smithi137.stdout:2110: oid 37 updating version 0 to 15497 2024-03-04T06:48:54.963 INFO:tasks.rados.rados.0.smithi137.stdout:2110: oid 37 updating version 15497 to 15500 2024-03-04T06:48:54.963 INFO:tasks.rados.rados.0.smithi137.stdout:2110: oid 37 version 15500 is already newer than 15498 2024-03-04T06:48:54.963 INFO:tasks.rados.rados.0.smithi137.stdout:2110: oid 37 version 15500 is already newer than 15499 2024-03-04T06:48:54.963 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 15500 (ObjNum 687 snap 197 seq_num 687) dirty exists 2024-03-04T06:48:54.963 INFO:tasks.rados.rados.0.smithi137.stdout:2110: left oid 37 (ObjNum 687 snap 197 seq_num 687) 2024-03-04T06:48:54.963 INFO:tasks.rados.rados.0.smithi137.stdout:2109: finishing write tid 1 to smithi13777483-6 2024-03-04T06:48:54.963 INFO:tasks.rados.rados.0.smithi137.stdout:2110: done (3 left) 2024-03-04T06:48:54.963 INFO:tasks.rados.rados.0.smithi137.stdout:2117: snap_remove snap 189 2024-03-04T06:48:55.093 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:54.879+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:55.093 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:55.092+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:55.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-mon[85573]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:48:55.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:55.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-mon[85573]: osd.5 [v2:172.21.15.203:6808/1125048708,v1:172.21.15.203:6809/1125048708] boot 2024-03-04T06:48:55.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-mon[85573]: osdmap e465: 8 total, 8 up, 8 in 2024-03-04T06:48:55.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:48:55.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:55.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:55.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:55.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:55.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:55.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:55.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-mon[85573]: pgmap v374: 121 pgs: 12 peering, 1 active+undersized+degraded+snaptrim_error, 6 active+undersized+degraded, 30 active+undersized, 5 active+clean+snaptrim_error, 67 active+clean; 331 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 MiB/s rd, 456 KiB/s wr, 12 op/s; 59/615 objects degraded (9.593%) 2024-03-04T06:48:55.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:54.898+0000 7f78998a7700 -1 osd.5 pg_epoch: 466 pg[5.4s2( v 466'431 (0'0,466'431] local-lis/les=465/466 n=4 ec=72/72 lis/c=465/465 les/c/f=466/466/0 sis=465) [7,2,5]p7(0) r=2 lpr=465 luod=0'0 crt=453'429 mlcod 0'0 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4b,f0~3]] update_snap_map remove_oid 5:234bd7ea:::smithi13777483-45:f1 failed with -2 2024-03-04T06:48:55.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:54.925+0000 7f78980a4700 -1 osd.5 pg_epoch: 466 pg[5.fs0( v 463'785 (0'0,463'785] local-lis/les=465/466 n=5 ec=72/72 lis/c=465/465 les/c/f=466/466/0 sis=465) [5,4,6]p5(0) r=0 lpr=465 crt=463'785 mlcod 0'0 active+clean+snaptrim trimq=[ef~1,f5~1,f8~1,fb~1,fd~1] ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4b,f0~3]] update_snap_map remove_oid 5:f827495c:::smithi13777483-23:ef failed with -2 2024-03-04T06:48:55.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:54.929+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:55.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:54.875+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:55.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:54.871+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:55.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:54.889+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:55.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:54.881+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[88869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:48:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[88869]: osd.5 [v2:172.21.15.203:6808/1125048708,v1:172.21.15.203:6809/1125048708] boot 2024-03-04T06:48:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[88869]: osdmap e465: 8 total, 8 up, 8 in 2024-03-04T06:48:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:48:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:55.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:55.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[88869]: pgmap v374: 121 pgs: 12 peering, 1 active+undersized+degraded+snaptrim_error, 6 active+undersized+degraded, 30 active+undersized, 5 active+clean+snaptrim_error, 67 active+clean; 331 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 MiB/s rd, 456 KiB/s wr, 12 op/s; 59/615 objects degraded (9.593%) 2024-03-04T06:48:55.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[91314]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:48:55.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:55.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[91314]: osd.5 [v2:172.21.15.203:6808/1125048708,v1:172.21.15.203:6809/1125048708] boot 2024-03-04T06:48:55.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[91314]: osdmap e465: 8 total, 8 up, 8 in 2024-03-04T06:48:55.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T06:48:55.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:55.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:55.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:55.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:55.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:55.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:55.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:54 smithi137 ceph-mon[91314]: pgmap v374: 121 pgs: 12 peering, 1 active+undersized+degraded+snaptrim_error, 6 active+undersized+degraded, 30 active+undersized, 5 active+clean+snaptrim_error, 67 active+clean; 331 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 MiB/s rd, 456 KiB/s wr, 12 op/s; 59/615 objects degraded (9.593%) 2024-03-04T06:48:55.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:55.222+0000 7f789a0a8700 -1 osd.5 pg_epoch: 466 pg[5.bs2( v 466'981 (0'0,466'981] local-lis/les=465/466 n=12 ec=72/72 lis/c=465/465 les/c/f=466/466/0 sis=465) [2,0,5]p2(0) r=2 lpr=465 luod=0'0 crt=456'979 mlcod 0'0 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4b,f0~3]] update_snap_map remove_oid 5:d55e5892:::smithi13777483-9:f1 failed with -2 2024-03-04T06:48:55.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:55.224+0000 7f789a0a8700 -1 osd.5 pg_epoch: 466 pg[5.bs2( v 466'983 (0'0,466'983] local-lis/les=465/466 n=11 ec=72/72 lis/c=465/465 les/c/f=466/466/0 sis=465) [2,0,5]p2(0) r=2 lpr=465 luod=0'0 crt=466'983 mlcod 466'983 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4b,f0~3]] update_snap_map remove_oid 5:d388e496:::smithi13777483-5:f0 failed with -2 2024-03-04T06:48:55.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:55.224+0000 7f78988a5700 -1 osd.5 pg_epoch: 466 pg[5.6s1( v 466'1383 (0'0,466'1383] local-lis/les=465/466 n=9 ec=72/72 lis/c=465/465 les/c/f=466/466/0 sis=465) [2,5,1]p2(0) r=1 lpr=465 luod=0'0 crt=466'1383 mlcod 466'1383 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4b,f0~3]] update_snap_map remove_oid 5:6c4e266a:::smithi13777483-46:f1 failed with -2 2024-03-04T06:48:55.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:55.225+0000 7f789e0b0700 -1 osd.5 pg_epoch: 466 pg[5.bs2( v 466'985 (0'0,466'985] local-lis/les=465/466 n=10 ec=72/72 lis/c=465/465 les/c/f=466/466/0 sis=465) [2,0,5]p2(0) r=2 lpr=465 luod=0'0 crt=466'983 mlcod 466'983 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4b,f0~3]] update_snap_map remove_oid 5:db43246c:::smithi13777483-19:f1 failed with -2 2024-03-04T06:48:55.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:55.229+0000 7f789c8ad700 -1 osd.5 pg_epoch: 466 pg[5.6s1( v 466'1387 (0'0,466'1387] local-lis/les=465/466 n=8 ec=72/72 lis/c=465/465 les/c/f=466/466/0 sis=465) [2,5,1]p2(0) r=1 lpr=465 luod=0'0 crt=466'1387 mlcod 466'1387 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4b,f0~3]] update_snap_map remove_oid 5:6d7516e4:::smithi13777483-32:f1 failed with -2 2024-03-04T06:48:55.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:48:55] "GET /metrics HTTP/1.1" 200 36119 "" "Prometheus/2.43.0" 2024-03-04T06:48:55.887 INFO:tasks.rados.rados.0.smithi137.stdout:2117: done (3 left) 2024-03-04T06:48:55.887 INFO:tasks.rados.rados.0.smithi137.stdout:2118: snap_create 2024-03-04T06:48:55.887 INFO:tasks.rados.rados.0.smithi137.stdout:2109: finishing write tid 2 to smithi13777483-6 2024-03-04T06:48:55.887 INFO:tasks.rados.rados.0.smithi137.stdout:2115: finishing write tid 1 to smithi13777483-38 2024-03-04T06:48:55.887 INFO:tasks.rados.rados.0.smithi137.stdout:2109: finishing write tid 3 to smithi13777483-6 2024-03-04T06:48:55.887 INFO:tasks.rados.rados.0.smithi137.stdout:2109: finishing write tid 4 to smithi13777483-6 2024-03-04T06:48:55.887 INFO:tasks.rados.rados.0.smithi137.stdout:2109: finishing write tid 5 to smithi13777483-6 2024-03-04T06:48:55.887 INFO:tasks.rados.rados.0.smithi137.stdout:2115: finishing write tid 2 to smithi13777483-38 2024-03-04T06:48:55.887 INFO:tasks.rados.rados.0.smithi137.stdout:2109: finishing write tid 6 to smithi13777483-6 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:2109: oid 6 updating version 0 to 15503 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:2109: oid 6 updating version 15503 to 15504 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:2109: oid 6 version 15504 is already newer than 15501 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:2109: oid 6 updating version 15504 to 15505 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:2109: oid 6 version 15505 is already newer than 15502 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 15505 (ObjNum 686 snap 197 seq_num 686) dirty exists 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:2109: left oid 6 (ObjNum 686 snap 197 seq_num 686) 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:2116: finishing copy_from racing read to smithi13777483-13 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:2115: finishing write tid 3 to smithi13777483-38 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:2115: finishing write tid 4 to smithi13777483-38 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:2116: finishing copy_from to smithi13777483-13 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16766 (ObjNum 615 snap 175 seq_num 615) dirty exists 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:2115: finishing write tid 5 to smithi13777483-38 2024-03-04T06:48:55.888 INFO:tasks.rados.rados.0.smithi137.stdout:2115: oid 38 updating version 0 to 16761 2024-03-04T06:48:55.889 INFO:tasks.rados.rados.0.smithi137.stdout:2115: oid 38 updating version 16761 to 16763 2024-03-04T06:48:55.889 INFO:tasks.rados.rados.0.smithi137.stdout:2115: oid 38 version 16763 is already newer than 16762 2024-03-04T06:48:55.889 INFO:tasks.rados.rados.0.smithi137.stdout:2115: oid 38 updating version 16763 to 16764 2024-03-04T06:48:55.889 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16764 (ObjNum 689 snap 198 seq_num 689) dirty exists 2024-03-04T06:48:55.889 INFO:tasks.rados.rados.0.smithi137.stdout:2115: left oid 38 (ObjNum 689 snap 198 seq_num 689) 2024-03-04T06:48:56.096 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:55.892+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:56.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:55.888+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:56.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:55.888+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:56.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:55.888+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:56.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-mon[85573]: osdmap e466: 8 total, 8 up, 8 in 2024-03-04T06:48:56.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:56.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:56.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-mon[85573]: Health check update: Degraded data redundancy: 67/603 objects degraded (11.111%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:48:56.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:56.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:56.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:56.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:56.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:56.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:55.889+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:56.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[91314]: osdmap e466: 8 total, 8 up, 8 in 2024-03-04T06:48:56.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:56.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:56.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[91314]: Health check update: Degraded data redundancy: 67/603 objects degraded (11.111%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:48:56.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:56.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:56.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:56.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:56.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:56.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:55.956+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:56.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:55.885+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:56.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:55.885+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:56.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:55.885+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:56.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[88869]: osdmap e466: 8 total, 8 up, 8 in 2024-03-04T06:48:56.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:56.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:56.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[88869]: Health check update: Degraded data redundancy: 67/603 objects degraded (11.111%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:48:56.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:56.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:56.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:56.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:56.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:56.895 INFO:tasks.rados.rados.0.smithi137.stdout:2109: done (3 left) 2024-03-04T06:48:56.895 INFO:tasks.rados.rados.0.smithi137.stdout:2115: done (2 left) 2024-03-04T06:48:56.895 INFO:tasks.rados.rados.0.smithi137.stdout:2116: done (1 left) 2024-03-04T06:48:56.895 INFO:tasks.rados.rados.0.smithi137.stdout:2118: done (0 left) 2024-03-04T06:48:56.895 INFO:tasks.rados.rados.0.smithi137.stdout:2119: rollback oid 29 current snap is 199 2024-03-04T06:48:56.895 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 29 to 188 2024-03-04T06:48:56.895 INFO:tasks.rados.rados.0.smithi137.stdout:2120: snap_remove snap 198 2024-03-04T06:48:57.173 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:57.173 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:56 smithi203 ceph-mon[85573]: osdmap e467: 8 total, 8 up, 8 in 2024-03-04T06:48:57.173 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:57.174 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:57.174 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:56 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:57.174 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:57.174 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:56 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:57.174 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:56 smithi203 ceph-mon[85573]: pgmap v377: 121 pgs: 12 peering, 1 active+undersized+degraded+snaptrim_error, 6 active+undersized+degraded, 27 active+undersized, 5 active+clean+snaptrim_error, 70 active+clean; 331 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 MiB/s rd, 908 KiB/s wr, 14 op/s; 59/618 objects degraded (9.547%) 2024-03-04T06:48:57.174 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:56.891+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:57.174 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:56.891+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:57.174 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:56.899+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:57.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:57.046+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:57.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:57.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[88869]: osdmap e467: 8 total, 8 up, 8 in 2024-03-04T06:48:57.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:57.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:57.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:57.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:57.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:57.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[88869]: pgmap v377: 121 pgs: 12 peering, 1 active+undersized+degraded+snaptrim_error, 6 active+undersized+degraded, 27 active+undersized, 5 active+clean+snaptrim_error, 70 active+clean; 331 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 MiB/s rd, 908 KiB/s wr, 14 op/s; 59/618 objects degraded (9.547%) 2024-03-04T06:48:57.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:57.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[91314]: osdmap e467: 8 total, 8 up, 8 in 2024-03-04T06:48:57.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:57.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:57.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:57.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:57.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:57.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:56 smithi137 ceph-mon[91314]: pgmap v377: 121 pgs: 12 peering, 1 active+undersized+degraded+snaptrim_error, 6 active+undersized+degraded, 27 active+undersized, 5 active+clean+snaptrim_error, 70 active+clean; 331 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 MiB/s rd, 908 KiB/s wr, 14 op/s; 59/618 objects degraded (9.547%) 2024-03-04T06:48:57.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:48:57.674+0000 7fca9a02c700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-03-04T06:48:57.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:57.453+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:57.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:57.453+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:57.794 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:57.453+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:57.896 INFO:tasks.rados.rados.0.smithi137.stdout:2120: done (1 left) 2024-03-04T06:48:57.896 INFO:tasks.rados.rados.0.smithi137.stdout:2121: rollback oid 42 current snap is 199 2024-03-04T06:48:57.896 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 42 to 185 2024-03-04T06:48:57.896 INFO:tasks.rados.rados.0.smithi137.stdout:2119: finishing rollback tid 0 to smithi13777483-29 2024-03-04T06:48:57.897 INFO:tasks.rados.rados.0.smithi137.stdout:2119: finishing rollback tid 1 to smithi13777483-29 2024-03-04T06:48:57.897 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16796 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-03-04T06:48:57.897 INFO:tasks.rados.rados.0.smithi137.stdout:2119: done (1 left) 2024-03-04T06:48:57.897 INFO:tasks.rados.rados.0.smithi137.stdout:2122: delete oid 11 current snap is 199 2024-03-04T06:48:57.904 INFO:tasks.rados.rados.0.smithi137.stdout:2122: done (1 left) 2024-03-04T06:48:57.904 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 199 2024-03-04T06:48:57.904 INFO:tasks.rados.rados.0.smithi137.stdout:2123: seq_num 691 ranges {704512=778240,1482752=548864,2031616=614400,2646016=40960} 2024-03-04T06:48:57.912 INFO:tasks.rados.rados.0.smithi137.stdout:2123: writing smithi13777483-49 from 704512 to 1482752 tid 1 2024-03-04T06:48:57.915 INFO:tasks.rados.rados.0.smithi137.stdout:2123: writing smithi13777483-49 from 1482752 to 2031616 tid 2 2024-03-04T06:48:57.919 INFO:tasks.rados.rados.0.smithi137.stdout:2123: writing smithi13777483-49 from 2031616 to 2646016 tid 3 2024-03-04T06:48:57.920 INFO:tasks.rados.rados.0.smithi137.stdout:2123: writing smithi13777483-49 from 2646016 to 2686976 tid 4 2024-03-04T06:48:57.921 INFO:tasks.rados.rados.0.smithi137.stdout:2124: rmattr oid 12 current snap is 199 2024-03-04T06:48:57.921 INFO:tasks.rados.rados.0.smithi137.stdout:2124: done (2 left) 2024-03-04T06:48:57.921 INFO:tasks.rados.rados.0.smithi137.stdout:2125: rmattr oid 10 current snap is 199 2024-03-04T06:48:57.921 INFO:tasks.rados.rados.0.smithi137.stdout:2121: finishing rollback tid 0 to smithi13777483-42 2024-03-04T06:48:57.921 INFO:tasks.rados.rados.0.smithi137.stdout:2121: finishing rollback tid 1 to smithi13777483-42 2024-03-04T06:48:57.921 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16809 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-04T06:48:57.921 INFO:tasks.rados.rados.0.smithi137.stdout:2123: finishing write tid 1 to smithi13777483-49 2024-03-04T06:48:57.921 INFO:tasks.rados.rados.0.smithi137.stdout:2123: finishing write tid 2 to smithi13777483-49 2024-03-04T06:48:57.921 INFO:tasks.rados.rados.0.smithi137.stdout:2121: done (2 left) 2024-03-04T06:48:57.921 INFO:tasks.rados.rados.0.smithi137.stdout:2126: copy_from oid 24 from oid 37 current snap is 199 2024-03-04T06:48:57.921 INFO:tasks.rados.rados.0.smithi137.stdout:2127: copy_from oid 12 from oid 50 current snap is 199 2024-03-04T06:48:57.921 INFO:tasks.rados.rados.0.smithi137.stdout:2128: snap_remove snap 194 2024-03-04T06:48:58.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:57.901+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:58.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:57.914+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:58.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:57.915+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:48:58.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:57.915+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:58.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:57.894+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: osdmap e468: 8 total, 8 up, 8 in 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-04T06:48:58.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: osdmap e468: 8 total, 8 up, 8 in 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:58.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:58.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:58.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:57 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-04T06:48:58.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:57.906+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:58.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:57.896+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:48:58.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:57.896+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:58.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:57.897+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: osdmap e468: 8 total, 8 up, 8 in 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:58.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:48:58.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:57 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-04T06:48:58.912 INFO:tasks.rados.rados.0.smithi137.stdout:2128: done (4 left) 2024-03-04T06:48:58.912 INFO:tasks.rados.rados.0.smithi137.stdout:2129: rollback oid 1 current snap is 199 2024-03-04T06:48:58.913 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 1 to 196 2024-03-04T06:48:58.913 INFO:tasks.rados.rados.0.smithi137.stdout:2127: finishing copy_from to smithi13777483-12 2024-03-04T06:48:58.913 INFO:tasks.rados.rados.0.smithi137.stdout:2127: got expected ENOENT (src dne) 2024-03-04T06:48:58.913 INFO:tasks.rados.rados.0.smithi137.stdout:2127: finishing copy_from racing read to smithi13777483-12 2024-03-04T06:48:58.913 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15505 (ObjNum 676 snap 191 seq_num 676) dirty exists 2024-03-04T06:48:58.913 INFO:tasks.rados.rados.0.smithi137.stdout:2123: finishing write tid 3 to smithi13777483-49 2024-03-04T06:48:58.913 INFO:tasks.rados.rados.0.smithi137.stdout:2123: finishing write tid 4 to smithi13777483-49 2024-03-04T06:48:58.913 INFO:tasks.rados.rados.0.smithi137.stdout:2123: finishing write tid 5 to smithi13777483-49 2024-03-04T06:48:58.913 INFO:tasks.rados.rados.0.smithi137.stdout:2123: finishing write tid 6 to smithi13777483-49 2024-03-04T06:48:58.913 INFO:tasks.rados.rados.0.smithi137.stdout:2123: oid 49 updating version 0 to 16778 2024-03-04T06:48:58.913 INFO:tasks.rados.rados.0.smithi137.stdout:2123: oid 49 version 16778 is already newer than 16776 2024-03-04T06:48:58.914 INFO:tasks.rados.rados.0.smithi137.stdout:2123: oid 49 version 16778 is already newer than 16777 2024-03-04T06:48:58.914 INFO:tasks.rados.rados.0.smithi137.stdout:2123: oid 49 version 16778 is already newer than 16775 2024-03-04T06:48:58.914 INFO:tasks.rados.rados.0.smithi137.stdout:2123: oid 49 updating version 16778 to 16779 2024-03-04T06:48:58.914 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16779 (ObjNum 691 snap 199 seq_num 691) dirty exists 2024-03-04T06:48:58.914 INFO:tasks.rados.rados.0.smithi137.stdout:2123: left oid 49 (ObjNum 691 snap 199 seq_num 691) 2024-03-04T06:48:58.914 INFO:tasks.rados.rados.0.smithi137.stdout:2126: finishing copy_from racing read to smithi13777483-24 2024-03-04T06:48:58.914 INFO:tasks.rados.rados.0.smithi137.stdout:2126: finishing copy_from to smithi13777483-24 2024-03-04T06:48:58.915 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 15500 (ObjNum 687 snap 197 seq_num 687) dirty exists 2024-03-04T06:48:58.915 INFO:tasks.rados.rados.0.smithi137.stdout:2123: done (4 left) 2024-03-04T06:48:58.915 INFO:tasks.rados.rados.0.smithi137.stdout:2125: done (3 left) 2024-03-04T06:48:58.915 INFO:tasks.rados.rados.0.smithi137.stdout:2126: done (2 left) 2024-03-04T06:48:58.915 INFO:tasks.rados.rados.0.smithi137.stdout:2127: done (1 left) 2024-03-04T06:48:58.915 INFO:tasks.rados.rados.0.smithi137.stdout:2130: rollback oid 9 current snap is 199 2024-03-04T06:48:58.915 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 9 to 196 2024-03-04T06:48:58.915 INFO:tasks.rados.rados.0.smithi137.stdout:2131: read oid 48 snap -1 2024-03-04T06:48:58.915 INFO:tasks.rados.rados.0.smithi137.stdout:2131: expect (ObjNum 422 snap 126 seq_num 422) 2024-03-04T06:48:58.915 INFO:tasks.rados.rados.0.smithi137.stdout:2132: rmattr oid 34 current snap is 199 2024-03-04T06:48:58.915 INFO:tasks.rados.rados.0.smithi137.stdout:2132: done (3 left) 2024-03-04T06:48:58.915 INFO:tasks.rados.rados.0.smithi137.stdout:2133: delete oid 36 current snap is 199 2024-03-04T06:48:58.922 INFO:tasks.rados.rados.0.smithi137.stdout:2133: done (3 left) 2024-03-04T06:48:58.922 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 199 2024-03-04T06:48:58.922 INFO:tasks.rados.rados.0.smithi137.stdout:2134: seq_num 693 ranges {5193728=409600,5603328=770048,6373376=581632,6955008=253952} 2024-03-04T06:48:58.952 INFO:tasks.rados.rados.0.smithi137.stdout:2134: writing smithi13777483-27 from 5193728 to 5603328 tid 1 2024-03-04T06:48:58.956 INFO:tasks.rados.rados.0.smithi137.stdout:2134: writing smithi13777483-27 from 5603328 to 6373376 tid 2 2024-03-04T06:48:58.960 INFO:tasks.rados.rados.0.smithi137.stdout:2134: writing smithi13777483-27 from 6373376 to 6955008 tid 3 2024-03-04T06:48:58.963 INFO:tasks.rados.rados.0.smithi137.stdout:2134: writing smithi13777483-27 from 6955008 to 7208960 tid 4 2024-03-04T06:48:58.963 INFO:tasks.rados.rados.0.smithi137.stdout:2135: delete oid 38 current snap is 199 2024-03-04T06:48:58.963 INFO:tasks.rados.rados.0.smithi137.stdout:2130: finishing rollback tid 0 to smithi13777483-9 2024-03-04T06:48:58.963 INFO:tasks.rados.rados.0.smithi137.stdout:2130: finishing rollback tid 1 to smithi13777483-9 2024-03-04T06:48:58.963 INFO:tasks.rados.rados.0.smithi137.stdout:2130: finishing rollback tid 2 to smithi13777483-9 2024-03-04T06:48:58.964 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 15508 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-03-04T06:48:58.964 INFO:tasks.rados.rados.0.smithi137.stdout:2129: finishing rollback tid 0 to smithi13777483-1 2024-03-04T06:48:58.964 INFO:tasks.rados.rados.0.smithi137.stdout:2129: finishing rollback tid 1 to smithi13777483-1 2024-03-04T06:48:58.964 INFO:tasks.rados.rados.0.smithi137.stdout:2129: finishing rollback tid 2 to smithi13777483-1 2024-03-04T06:48:58.965 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 15473 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:48:58.965 INFO:tasks.rados.rados.0.smithi137.stdout:2131: expect (ObjNum 422 snap 126 seq_num 422) 2024-03-04T06:48:59.072 INFO:tasks.rados.rados.0.smithi137.stdout:2134: finishing write tid 1 to smithi13777483-27 2024-03-04T06:48:59.072 INFO:tasks.rados.rados.0.smithi137.stdout:2134: finishing write tid 2 to smithi13777483-27 2024-03-04T06:48:59.072 INFO:tasks.rados.rados.0.smithi137.stdout:2129: done (4 left) 2024-03-04T06:48:59.073 INFO:tasks.rados.rados.0.smithi137.stdout:2130: done (3 left) 2024-03-04T06:48:59.073 INFO:tasks.rados.rados.0.smithi137.stdout:2131: done (2 left) 2024-03-04T06:48:59.073 INFO:tasks.rados.rados.0.smithi137.stdout:2135: done (1 left) 2024-03-04T06:48:59.073 INFO:tasks.rados.rados.0.smithi137.stdout:2136: rmattr oid 19 current snap is 199 2024-03-04T06:48:59.073 INFO:tasks.rados.rados.0.smithi137.stdout:2134: finishing write tid 3 to smithi13777483-27 2024-03-04T06:48:59.073 INFO:tasks.rados.rados.0.smithi137.stdout:2134: finishing write tid 4 to smithi13777483-27 2024-03-04T06:48:59.074 INFO:tasks.rados.rados.0.smithi137.stdout:2134: finishing write tid 5 to smithi13777483-27 2024-03-04T06:48:59.074 INFO:tasks.rados.rados.0.smithi137.stdout:2134: finishing write tid 6 to smithi13777483-27 2024-03-04T06:48:59.074 INFO:tasks.rados.rados.0.smithi137.stdout:2134: oid 27 updating version 0 to 16812 2024-03-04T06:48:59.074 INFO:tasks.rados.rados.0.smithi137.stdout:2134: oid 27 version 16812 is already newer than 16811 2024-03-04T06:48:59.074 INFO:tasks.rados.rados.0.smithi137.stdout:2134: oid 27 version 16812 is already newer than 16810 2024-03-04T06:48:59.074 INFO:tasks.rados.rados.0.smithi137.stdout:2134: oid 27 updating version 16812 to 16813 2024-03-04T06:48:59.075 INFO:tasks.rados.rados.0.smithi137.stdout:2134: oid 27 updating version 16813 to 16814 2024-03-04T06:48:59.075 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16814 (ObjNum 693 snap 199 seq_num 693) dirty exists 2024-03-04T06:48:59.075 INFO:tasks.rados.rados.0.smithi137.stdout:2134: left oid 27 (ObjNum 693 snap 199 seq_num 693) 2024-03-04T06:48:59.075 INFO:tasks.rados.rados.0.smithi137.stdout:2134: done (1 left) 2024-03-04T06:48:59.075 INFO:tasks.rados.rados.0.smithi137.stdout:2137: read oid 49 snap 196 2024-03-04T06:48:59.075 INFO:tasks.rados.rados.0.smithi137.stdout:2137: expect (ObjNum 615 snap 175 seq_num 615) 2024-03-04T06:48:59.076 INFO:tasks.rados.rados.0.smithi137.stdout:2138: snap_create 2024-03-04T06:48:59.076 INFO:tasks.rados.rados.0.smithi137.stdout:2137: expect (ObjNum 615 snap 175 seq_num 615) 2024-03-04T06:48:59.093 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 15509 (ObjNum 654 snap 184 seq_num 654) dirty exists 2024-03-04T06:48:59.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:48:58.921+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:59.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:58.909+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:59.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:58.910+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:59.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:58.915+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:59.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:59.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-04T06:48:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[91314]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-03-04T06:48:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[91314]: osdmap e469: 8 total, 8 up, 8 in 2024-03-04T06:48:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[91314]: pgmap v380: 121 pgs: 12 peering, 7 active+clean+snaptrim_error, 102 active+clean; 325 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 29 KiB/s rd, 2.0 MiB/s wr, 9 op/s; 22 MiB/s, 6 objects/s recovering 2024-03-04T06:48:59.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:48:58.897+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 7 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:48:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-04T06:48:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[88869]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-03-04T06:48:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[88869]: osdmap e469: 8 total, 8 up, 8 in 2024-03-04T06:48:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:58 smithi137 ceph-mon[88869]: pgmap v380: 121 pgs: 12 peering, 7 active+clean+snaptrim_error, 102 active+clean; 325 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 29 KiB/s rd, 2.0 MiB/s wr, 9 op/s; 22 MiB/s, 6 objects/s recovering 2024-03-04T06:48:59.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:58.912+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:59.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:58.907+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:59.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:58.907+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:59.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:59.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:59.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-04T06:48:59.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-mon[85573]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-03-04T06:48:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:48:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-mon[85573]: osdmap e469: 8 total, 8 up, 8 in 2024-03-04T06:48:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:48:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:48:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:48:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:48:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:48:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:48:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:58 smithi203 ceph-mon[85573]: pgmap v380: 121 pgs: 12 peering, 7 active+clean+snaptrim_error, 102 active+clean; 325 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 29 KiB/s rd, 2.0 MiB/s wr, 9 op/s; 22 MiB/s, 6 objects/s recovering 2024-03-04T06:48:59.914 INFO:tasks.rados.rados.0.smithi137.stdout:2136: done (2 left) 2024-03-04T06:48:59.914 INFO:tasks.rados.rados.0.smithi137.stdout:2137: done (1 left) 2024-03-04T06:48:59.914 INFO:tasks.rados.rados.0.smithi137.stdout:2138: done (0 left) 2024-03-04T06:48:59.914 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 200 2024-03-04T06:48:59.914 INFO:tasks.rados.rados.0.smithi137.stdout:2139: seq_num 695 ranges {7208960=442368,7651328=540672,8192000=598016,8790016=466944} 2024-03-04T06:48:59.955 INFO:tasks.rados.rados.0.smithi137.stdout:2139: writing smithi13777483-27 from 7208960 to 7651328 tid 1 2024-03-04T06:48:59.959 INFO:tasks.rados.rados.0.smithi137.stdout:2139: writing smithi13777483-27 from 7651328 to 8192000 tid 2 2024-03-04T06:48:59.962 INFO:tasks.rados.rados.0.smithi137.stdout:2139: writing smithi13777483-27 from 8192000 to 8790016 tid 3 2024-03-04T06:48:59.966 INFO:tasks.rados.rados.0.smithi137.stdout:2139: writing smithi13777483-27 from 8790016 to 9256960 tid 4 2024-03-04T06:48:59.966 INFO:tasks.rados.rados.0.smithi137.stdout:2140: setattr oid 31 current snap is 200 2024-03-04T06:48:59.966 INFO:tasks.rados.rados.0.smithi137.stdout:2139: finishing write tid 1 to smithi13777483-27 2024-03-04T06:48:59.966 INFO:tasks.rados.rados.0.smithi137.stdout:2139: finishing write tid 2 to smithi13777483-27 2024-03-04T06:48:59.966 INFO:tasks.rados.rados.0.smithi137.stdout:2139: finishing write tid 3 to smithi13777483-27 2024-03-04T06:48:59.968 INFO:tasks.rados.rados.0.smithi137.stdout:2141: read oid 26 snap -1 2024-03-04T06:48:59.968 INFO:tasks.rados.rados.0.smithi137.stdout:2141: expect (ObjNum 665 snap 188 seq_num 665) 2024-03-04T06:48:59.968 INFO:tasks.rados.rados.0.smithi137.stdout:2142: rollback oid 6 current snap is 200 2024-03-04T06:48:59.968 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 6 to 188 2024-03-04T06:48:59.968 INFO:tasks.rados.rados.0.smithi137.stdout:2143: snap_create 2024-03-04T06:48:59.969 INFO:tasks.rados.rados.0.smithi137.stdout:2139: finishing write tid 4 to smithi13777483-27 2024-03-04T06:48:59.970 INFO:tasks.rados.rados.0.smithi137.stdout:2139: finishing write tid 5 to smithi13777483-27 2024-03-04T06:48:59.972 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16780 (ObjNum 49 snap 0 seq_num 3820409362) dirty exists 2024-03-04T06:48:59.972 INFO:tasks.rados.rados.0.smithi137.stdout:2139: finishing write tid 6 to smithi13777483-27 2024-03-04T06:48:59.972 INFO:tasks.rados.rados.0.smithi137.stdout:2139: oid 27 updating version 0 to 16816 2024-03-04T06:48:59.972 INFO:tasks.rados.rados.0.smithi137.stdout:2139: oid 27 updating version 16816 to 16817 2024-03-04T06:48:59.972 INFO:tasks.rados.rados.0.smithi137.stdout:2139: oid 27 updating version 16817 to 16819 2024-03-04T06:48:59.972 INFO:tasks.rados.rados.0.smithi137.stdout:2139: oid 27 version 16819 is already newer than 16818 2024-03-04T06:48:59.972 INFO:tasks.rados.rados.0.smithi137.stdout:2139: oid 27 version 16819 is already newer than 16815 2024-03-04T06:48:59.973 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16819 (ObjNum 695 snap 200 seq_num 695) dirty exists 2024-03-04T06:48:59.973 INFO:tasks.rados.rados.0.smithi137.stdout:2139: left oid 27 (ObjNum 695 snap 200 seq_num 695) 2024-03-04T06:48:59.974 INFO:tasks.rados.rados.0.smithi137.stdout:2142: finishing rollback tid 0 to smithi13777483-6 2024-03-04T06:48:59.974 INFO:tasks.rados.rados.0.smithi137.stdout:2142: finishing rollback tid 1 to smithi13777483-6 2024-03-04T06:48:59.974 INFO:tasks.rados.rados.0.smithi137.stdout:2142: finishing rollback tid 2 to smithi13777483-6 2024-03-04T06:48:59.974 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 15508 (ObjNum 490 snap 140 seq_num 490) dirty exists 2024-03-04T06:48:59.997 INFO:tasks.rados.rados.0.smithi137.stdout:2141: expect (ObjNum 665 snap 188 seq_num 665) 2024-03-04T06:49:00.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:48:59.961+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:00.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:59.971+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:00.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:59.971+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:00.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:48:59.971+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[88869]: Health check update: Possible data damage: 7 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:49:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[88869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/618 objects degraded (9.547%), 7 pgs degraded) 2024-03-04T06:49:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[88869]: osdmap e470: 8 total, 8 up, 8 in 2024-03-04T06:49:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[91314]: Health check update: Possible data damage: 7 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:49:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[91314]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/618 objects degraded (9.547%), 7 pgs degraded) 2024-03-04T06:49:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[91314]: osdmap e470: 8 total, 8 up, 8 in 2024-03-04T06:49:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:48:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:00.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:48:59.962+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:00.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:59.916+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:00.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:59.916+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:00.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:48:59.916+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-mon[85573]: Health check update: Possible data damage: 7 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:49:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-mon[85573]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/618 objects degraded (9.547%), 7 pgs degraded) 2024-03-04T06:49:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-mon[85573]: osdmap e470: 8 total, 8 up, 8 in 2024-03-04T06:49:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:48:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:00.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:00.352+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:00.923 INFO:tasks.rados.rados.0.smithi137.stdout:2139: done (4 left) 2024-03-04T06:49:00.923 INFO:tasks.rados.rados.0.smithi137.stdout:2140: done (3 left) 2024-03-04T06:49:00.923 INFO:tasks.rados.rados.0.smithi137.stdout:2141: done (2 left) 2024-03-04T06:49:00.923 INFO:tasks.rados.rados.0.smithi137.stdout:2142: done (1 left) 2024-03-04T06:49:00.923 INFO:tasks.rados.rados.0.smithi137.stdout:2143: done (0 left) 2024-03-04T06:49:00.923 INFO:tasks.rados.rados.0.smithi137.stdout:2144: setattr oid 39 current snap is 201 2024-03-04T06:49:00.925 INFO:tasks.rados.rados.0.smithi137.stdout:2145: rmattr oid 7 current snap is 201 2024-03-04T06:49:00.925 INFO:tasks.rados.rados.0.smithi137.stdout:2146: read oid 26 snap -1 2024-03-04T06:49:00.925 INFO:tasks.rados.rados.0.smithi137.stdout:2146: expect (ObjNum 665 snap 188 seq_num 665) 2024-03-04T06:49:00.925 INFO:tasks.rados.rados.0.smithi137.stdout:2147: rollback oid 44 current snap is 201 2024-03-04T06:49:00.925 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 44 to 196 2024-03-04T06:49:00.925 INFO:tasks.rados.rados.0.smithi137.stdout:2148: snap_create 2024-03-04T06:49:00.931 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16815 (ObjNum 620 snap 175 seq_num 620) dirty exists 2024-03-04T06:49:00.932 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 15501 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-03-04T06:49:00.940 INFO:tasks.rados.rados.0.smithi137.stdout:2147: finishing rollback tid 0 to smithi13777483-44 2024-03-04T06:49:00.940 INFO:tasks.rados.rados.0.smithi137.stdout:2147: finishing rollback tid 1 to smithi13777483-44 2024-03-04T06:49:00.941 INFO:tasks.rados.rados.0.smithi137.stdout:2147: finishing rollback tid 2 to smithi13777483-44 2024-03-04T06:49:00.941 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16801 (ObjNum 635 snap 178 seq_num 635) dirty exists 2024-03-04T06:49:00.955 INFO:tasks.rados.rados.0.smithi137.stdout:2146: expect (ObjNum 665 snap 188 seq_num 665) 2024-03-04T06:49:01.247 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:00.929+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:01.247 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:00.930+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:01.248 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:00 smithi203 ceph-mon[85573]: osdmap e471: 8 total, 8 up, 8 in 2024-03-04T06:49:01.248 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:01.248 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:01.248 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:01.248 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:01.248 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:01.248 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:00 smithi203 ceph-mon[85573]: pgmap v383: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 328 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 545 KiB/s rd, 2.5 MiB/s wr, 11 op/s; 22 MiB/s, 6 objects/s recovering 2024-03-04T06:49:01.248 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:00.920+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:01.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:00.928+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:01.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:00.943+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[88869]: osdmap e471: 8 total, 8 up, 8 in 2024-03-04T06:49:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:01.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:01.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[88869]: pgmap v383: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 328 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 545 KiB/s rd, 2.5 MiB/s wr, 11 op/s; 22 MiB/s, 6 objects/s recovering 2024-03-04T06:49:01.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[91314]: osdmap e471: 8 total, 8 up, 8 in 2024-03-04T06:49:01.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:01.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:01.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:01.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:01.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:01.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-mon[91314]: pgmap v383: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 328 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 545 KiB/s rd, 2.5 MiB/s wr, 11 op/s; 22 MiB/s, 6 objects/s recovering 2024-03-04T06:49:01.295 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:00.920+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:01.295 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:00.930+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:01.924 INFO:tasks.rados.rados.0.smithi137.stdout:2144: done (4 left) 2024-03-04T06:49:01.924 INFO:tasks.rados.rados.0.smithi137.stdout:2145: done (3 left) 2024-03-04T06:49:01.924 INFO:tasks.rados.rados.0.smithi137.stdout:2146: done (2 left) 2024-03-04T06:49:01.924 INFO:tasks.rados.rados.0.smithi137.stdout:2147: done (1 left) 2024-03-04T06:49:01.925 INFO:tasks.rados.rados.0.smithi137.stdout:2148: done (0 left) 2024-03-04T06:49:01.925 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 202 2024-03-04T06:49:01.925 INFO:tasks.rados.rados.0.smithi137.stdout:2149: seq_num 696 ranges {3850240=458752,4308992=417792,4726784=753664,5480448=434176} 2024-03-04T06:49:01.947 INFO:tasks.rados.rados.0.smithi137.stdout:2149: writing smithi13777483-32 from 3850240 to 4308992 tid 1 2024-03-04T06:49:01.950 INFO:tasks.rados.rados.0.smithi137.stdout:2149: writing smithi13777483-32 from 4308992 to 4726784 tid 2 2024-03-04T06:49:01.954 INFO:tasks.rados.rados.0.smithi137.stdout:2149: writing smithi13777483-32 from 4726784 to 5480448 tid 3 2024-03-04T06:49:01.957 INFO:tasks.rados.rados.0.smithi137.stdout:2149: writing smithi13777483-32 from 5480448 to 5914624 tid 4 2024-03-04T06:49:01.958 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 202 2024-03-04T06:49:01.958 INFO:tasks.rados.rados.0.smithi137.stdout:2149: finishing write tid 1 to smithi13777483-32 2024-03-04T06:49:01.958 INFO:tasks.rados.rados.0.smithi137.stdout:2150: seq_num 697 ranges {0=475136,475136=704512,1179648=557056,1736704=344064} 2024-03-04T06:49:01.961 INFO:tasks.rados.rados.0.smithi137.stdout:2150: writing smithi13777483-12 from 0 to 475136 tid 1 2024-03-04T06:49:01.965 INFO:tasks.rados.rados.0.smithi137.stdout:2150: writing smithi13777483-12 from 475136 to 1179648 tid 2 2024-03-04T06:49:01.969 INFO:tasks.rados.rados.0.smithi137.stdout:2150: writing smithi13777483-12 from 1179648 to 1736704 tid 3 2024-03-04T06:49:01.972 INFO:tasks.rados.rados.0.smithi137.stdout:2150: writing smithi13777483-12 from 1736704 to 2080768 tid 4 2024-03-04T06:49:01.972 INFO:tasks.rados.rados.0.smithi137.stdout:2151: rmattr oid 2 current snap is 202 2024-03-04T06:49:01.972 INFO:tasks.rados.rados.0.smithi137.stdout:2149: finishing write tid 2 to smithi13777483-32 2024-03-04T06:49:01.972 INFO:tasks.rados.rados.0.smithi137.stdout:2149: finishing write tid 3 to smithi13777483-32 2024-03-04T06:49:01.972 INFO:tasks.rados.rados.0.smithi137.stdout:2149: finishing write tid 4 to smithi13777483-32 2024-03-04T06:49:01.972 INFO:tasks.rados.rados.0.smithi137.stdout:2149: finishing write tid 5 to smithi13777483-32 2024-03-04T06:49:01.972 INFO:tasks.rados.rados.0.smithi137.stdout:2150: finishing write tid 1 to smithi13777483-12 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:2149: finishing write tid 6 to smithi13777483-32 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:2149: oid 32 updating version 0 to 16824 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:2149: oid 32 version 16824 is already newer than 16823 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:2149: oid 32 version 16824 is already newer than 16820 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:2149: oid 32 version 16824 is already newer than 16821 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:2149: oid 32 version 16824 is already newer than 16822 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16824 (ObjNum 696 snap 202 seq_num 696) dirty exists 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:2149: left oid 32 (ObjNum 696 snap 202 seq_num 696) 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:2150: finishing write tid 2 to smithi13777483-12 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:2149: done (2 left) 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:2152: rollback oid 46 current snap is 202 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 46 to 196 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:2153: delete oid 16 current snap is 202 2024-03-04T06:49:01.973 INFO:tasks.rados.rados.0.smithi137.stdout:2152: finishing rollback tid 1 to smithi13777483-46 2024-03-04T06:49:01.974 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 0 (ObjNum 33 snap 0 seq_num 3130723648) dirty dne 2024-03-04T06:49:01.974 INFO:tasks.rados.rados.0.smithi137.stdout:2150: finishing write tid 3 to smithi13777483-12 2024-03-04T06:49:01.976 INFO:tasks.rados.rados.0.smithi137.stdout:2150: finishing write tid 4 to smithi13777483-12 2024-03-04T06:49:01.976 INFO:tasks.rados.rados.0.smithi137.stdout:2150: finishing write tid 5 to smithi13777483-12 2024-03-04T06:49:01.976 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 15474 (ObjNum 555 snap 158 seq_num 555) dirty exists 2024-03-04T06:49:01.977 INFO:tasks.rados.rados.0.smithi137.stdout:2151: done (3 left) 2024-03-04T06:49:01.977 INFO:tasks.rados.rados.0.smithi137.stdout:2152: done (2 left) 2024-03-04T06:49:01.977 INFO:tasks.rados.rados.0.smithi137.stdout:2153: done (1 left) 2024-03-04T06:49:01.977 INFO:tasks.rados.rados.0.smithi137.stdout:2154: setattr oid 47 current snap is 202 2024-03-04T06:49:01.977 INFO:tasks.rados.rados.0.smithi137.stdout:2150: finishing write tid 6 to smithi13777483-12 2024-03-04T06:49:01.977 INFO:tasks.rados.rados.0.smithi137.stdout:2150: oid 12 updating version 0 to 16770 2024-03-04T06:49:01.977 INFO:tasks.rados.rados.0.smithi137.stdout:2150: oid 12 version 16770 is already newer than 16766 2024-03-04T06:49:01.977 INFO:tasks.rados.rados.0.smithi137.stdout:2150: oid 12 version 16770 is already newer than 16767 2024-03-04T06:49:01.977 INFO:tasks.rados.rados.0.smithi137.stdout:2150: oid 12 version 16770 is already newer than 16768 2024-03-04T06:49:01.978 INFO:tasks.rados.rados.0.smithi137.stdout:2150: oid 12 version 16770 is already newer than 16769 2024-03-04T06:49:01.978 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16770 (ObjNum 697 snap 202 seq_num 697) dirty exists 2024-03-04T06:49:01.978 INFO:tasks.rados.rados.0.smithi137.stdout:2150: left oid 12 (ObjNum 697 snap 202 seq_num 697) 2024-03-04T06:49:01.979 INFO:tasks.rados.rados.0.smithi137.stdout:2150: done (1 left) 2024-03-04T06:49:01.979 INFO:tasks.rados.rados.0.smithi137.stdout:2155: rmattr oid 50 current snap is 202 2024-03-04T06:49:01.979 INFO:tasks.rados.rados.0.smithi137.stdout:2155: done (1 left) 2024-03-04T06:49:01.979 INFO:tasks.rados.rados.0.smithi137.stdout:2156: read oid 43 snap -1 2024-03-04T06:49:01.979 INFO:tasks.rados.rados.0.smithi137.stdout:2156: expect deleted 2024-03-04T06:49:01.980 INFO:tasks.rados.rados.0.smithi137.stdout:2157: copy_from oid 45 from oid 34 current snap is 202 2024-03-04T06:49:01.980 INFO:tasks.rados.rados.0.smithi137.stdout:2158: setattr oid 25 current snap is 202 2024-03-04T06:49:01.980 INFO:tasks.rados.rados.0.smithi137.stdout:2156: done (3 left) 2024-03-04T06:49:01.980 INFO:tasks.rados.rados.0.smithi137.stdout:2159: rollback oid 32 current snap is 202 2024-03-04T06:49:01.980 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 32 to 200 2024-03-04T06:49:01.980 INFO:tasks.rados.rados.0.smithi137.stdout:2160: rollback oid 26 current snap is 202 2024-03-04T06:49:01.980 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 26 to 186 2024-03-04T06:49:01.980 INFO:tasks.rados.rados.0.smithi137.stdout:2161: copy_from oid 22 from oid 30 current snap is 202 2024-03-04T06:49:01.980 INFO:tasks.rados.rados.0.smithi137.stdout:2162: read oid 24 snap 199 2024-03-04T06:49:01.980 INFO:tasks.rados.rados.0.smithi137.stdout:2162: expect (ObjNum 687 snap 197 seq_num 687) 2024-03-04T06:49:01.980 INFO:tasks.rados.rados.0.smithi137.stdout:2163: delete oid 37 current snap is 202 2024-03-04T06:49:01.981 INFO:tasks.rados.rados.0.smithi137.stdout:2161: finishing copy_from to smithi13777483-22 2024-03-04T06:49:01.981 INFO:tasks.rados.rados.0.smithi137.stdout:2161: got expected ENOENT (src dne) 2024-03-04T06:49:01.982 INFO:tasks.rados.rados.0.smithi137.stdout:2161: finishing copy_from racing read to smithi13777483-22 2024-03-04T06:49:01.982 INFO:tasks.rados.rados.0.smithi137.stdout:2161: done (7 left) 2024-03-04T06:49:01.982 INFO:tasks.rados.rados.0.smithi137.stdout:2163: done (6 left) 2024-03-04T06:49:01.982 INFO:tasks.rados.rados.0.smithi137.stdout:2164: rmattr oid 36 current snap is 202 2024-03-04T06:49:01.982 INFO:tasks.rados.rados.0.smithi137.stdout:2164: done (6 left) 2024-03-04T06:49:01.982 INFO:tasks.rados.rados.0.smithi137.stdout:2165: delete oid 19 current snap is 202 2024-03-04T06:49:01.983 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16766 (ObjNum -1107821162 snap 32761 seq_num 304) dirty exists 2024-03-04T06:49:01.984 INFO:tasks.rados.rados.0.smithi137.stdout:2159: finishing rollback tid 0 to smithi13777483-32 2024-03-04T06:49:01.984 INFO:tasks.rados.rados.0.smithi137.stdout:2159: finishing rollback tid 1 to smithi13777483-32 2024-03-04T06:49:01.985 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 16767 (ObjNum 544 snap 155 seq_num 544) dirty exists 2024-03-04T06:49:01.985 INFO:tasks.rados.rados.0.smithi137.stdout:2159: finishing rollback tid 2 to smithi13777483-32 2024-03-04T06:49:01.985 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16827 (ObjNum 671 snap 191 seq_num 671) dirty exists 2024-03-04T06:49:01.985 INFO:tasks.rados.rados.0.smithi137.stdout:2160: finishing rollback tid 0 to smithi13777483-26 2024-03-04T06:49:01.987 INFO:tasks.rados.rados.0.smithi137.stdout:2160: finishing rollback tid 1 to smithi13777483-26 2024-03-04T06:49:01.987 INFO:tasks.rados.rados.0.smithi137.stdout:2160: finishing rollback tid 2 to smithi13777483-26 2024-03-04T06:49:01.987 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16799 (ObjNum 570 snap 159 seq_num 570) dirty exists 2024-03-04T06:49:01.987 INFO:tasks.rados.rados.0.smithi137.stdout:2154: done (6 left) 2024-03-04T06:49:01.988 INFO:tasks.rados.rados.0.smithi137.stdout:2158: done (5 left) 2024-03-04T06:49:01.988 INFO:tasks.rados.rados.0.smithi137.stdout:2159: done (4 left) 2024-03-04T06:49:01.988 INFO:tasks.rados.rados.0.smithi137.stdout:2160: done (3 left) 2024-03-04T06:49:01.988 INFO:tasks.rados.rados.0.smithi137.stdout:2165: done (2 left) 2024-03-04T06:49:01.988 INFO:tasks.rados.rados.0.smithi137.stdout:2166: copy_from oid 38 from oid 44 current snap is 202 2024-03-04T06:49:01.988 INFO:tasks.rados.rados.0.smithi137.stdout:2167: read oid 15 snap 199 2024-03-04T06:49:01.988 INFO:tasks.rados.rados.0.smithi137.stdout:2167: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:01.988 INFO:tasks.rados.rados.0.smithi137.stdout:2168: read oid 35 snap -1 2024-03-04T06:49:01.988 INFO:tasks.rados.rados.0.smithi137.stdout:2168: expect deleted 2024-03-04T06:49:01.988 INFO:tasks.rados.rados.0.smithi137.stdout:2169: snap_create 2024-03-04T06:49:01.992 INFO:tasks.rados.rados.0.smithi137.stdout:2157: finishing copy_from racing read to smithi13777483-45 2024-03-04T06:49:01.994 INFO:tasks.rados.rados.0.smithi137.stdout:2157: finishing copy_from to smithi13777483-45 2024-03-04T06:49:01.994 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16778 (ObjNum 639 snap 178 seq_num 639) dirty exists 2024-03-04T06:49:01.995 INFO:tasks.rados.rados.0.smithi137.stdout:2162: expect (ObjNum 687 snap 197 seq_num 687) 2024-03-04T06:49:02.046 INFO:tasks.rados.rados.0.smithi137.stdout:2166: finishing copy_from racing read to smithi13777483-38 2024-03-04T06:49:02.047 INFO:tasks.rados.rados.0.smithi137.stdout:2166: finishing copy_from to smithi13777483-38 2024-03-04T06:49:02.047 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16801 (ObjNum 635 snap 178 seq_num 635) dirty exists 2024-03-04T06:49:02.047 INFO:tasks.rados.rados.0.smithi137.stdout:2167: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:02.258 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:01.953+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:02.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:02.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:02.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:02.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:02.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-mon[85573]: osdmap e472: 8 total, 8 up, 8 in 2024-03-04T06:49:02.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:02.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:02.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:02.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:02.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:02.259 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:01.920+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:02.259 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:01.920+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:02.260 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:01.921+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:02.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:01.975+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:02.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:01.922+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:02.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[88869]: osdmap e472: 8 total, 8 up, 8 in 2024-03-04T06:49:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:02.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:01.963+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:02.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:01.963+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:02.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:01.963+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[91314]: osdmap e472: 8 total, 8 up, 8 in 2024-03-04T06:49:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:02.936 INFO:tasks.rados.rados.0.smithi137.stdout:2157: done (5 left) 2024-03-04T06:49:02.936 INFO:tasks.rados.rados.0.smithi137.stdout:2162: done (4 left) 2024-03-04T06:49:02.936 INFO:tasks.rados.rados.0.smithi137.stdout:2166: done (3 left) 2024-03-04T06:49:02.936 INFO:tasks.rados.rados.0.smithi137.stdout:2167: done (2 left) 2024-03-04T06:49:02.936 INFO:tasks.rados.rados.0.smithi137.stdout:2168: done (1 left) 2024-03-04T06:49:02.937 INFO:tasks.rados.rados.0.smithi137.stdout:2169: done (0 left) 2024-03-04T06:49:02.937 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 24 current snap is 203 2024-03-04T06:49:02.937 INFO:tasks.rados.rados.0.smithi137.stdout:2170: seq_num 701 ranges {1916928=548864,2465792=696320,3162112=540672,3702784=368640} 2024-03-04T06:49:02.949 INFO:tasks.rados.rados.0.smithi137.stdout:2170: writing smithi13777483-24 from 1916928 to 2465792 tid 1 2024-03-04T06:49:02.953 INFO:tasks.rados.rados.0.smithi137.stdout:2170: writing smithi13777483-24 from 2465792 to 3162112 tid 2 2024-03-04T06:49:02.956 INFO:tasks.rados.rados.0.smithi137.stdout:2170: writing smithi13777483-24 from 3162112 to 3702784 tid 3 2024-03-04T06:49:02.959 INFO:tasks.rados.rados.0.smithi137.stdout:2170: writing smithi13777483-24 from 3702784 to 4071424 tid 4 2024-03-04T06:49:02.959 INFO:tasks.rados.rados.0.smithi137.stdout:2171: delete oid 9 current snap is 203 2024-03-04T06:49:02.959 INFO:tasks.rados.rados.0.smithi137.stdout:2170: finishing write tid 1 to smithi13777483-24 2024-03-04T06:49:02.959 INFO:tasks.rados.rados.0.smithi137.stdout:2170: finishing write tid 2 to smithi13777483-24 2024-03-04T06:49:02.959 INFO:tasks.rados.rados.0.smithi137.stdout:2170: finishing write tid 3 to smithi13777483-24 2024-03-04T06:49:02.962 INFO:tasks.rados.rados.0.smithi137.stdout:2170: finishing write tid 4 to smithi13777483-24 2024-03-04T06:49:02.962 INFO:tasks.rados.rados.0.smithi137.stdout:2170: finishing write tid 5 to smithi13777483-24 2024-03-04T06:49:02.963 INFO:tasks.rados.rados.0.smithi137.stdout:2170: finishing write tid 6 to smithi13777483-24 2024-03-04T06:49:02.963 INFO:tasks.rados.rados.0.smithi137.stdout:2170: oid 24 updating version 0 to 15506 2024-03-04T06:49:02.964 INFO:tasks.rados.rados.0.smithi137.stdout:2170: oid 24 version 15506 is already newer than 15503 2024-03-04T06:49:02.964 INFO:tasks.rados.rados.0.smithi137.stdout:2170: oid 24 version 15506 is already newer than 15504 2024-03-04T06:49:02.964 INFO:tasks.rados.rados.0.smithi137.stdout:2170: oid 24 version 15506 is already newer than 15502 2024-03-04T06:49:02.964 INFO:tasks.rados.rados.0.smithi137.stdout:2170: oid 24 version 15506 is already newer than 15505 2024-03-04T06:49:02.964 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 15506 (ObjNum 701 snap 203 seq_num 701) dirty exists 2024-03-04T06:49:02.964 INFO:tasks.rados.rados.0.smithi137.stdout:2170: left oid 24 (ObjNum 701 snap 203 seq_num 701) 2024-03-04T06:49:02.964 INFO:tasks.rados.rados.0.smithi137.stdout:2170: done (1 left) 2024-03-04T06:49:02.964 INFO:tasks.rados.rados.0.smithi137.stdout:2171: done (0 left) 2024-03-04T06:49:02.964 INFO:tasks.rados.rados.0.smithi137.stdout:2172: read oid 25 snap -1 2024-03-04T06:49:02.964 INFO:tasks.rados.rados.0.smithi137.stdout:2172: expect (ObjNum 544 snap 155 seq_num 544) 2024-03-04T06:49:02.964 INFO:tasks.rados.rados.0.smithi137.stdout:2173: read oid 34 snap -1 2024-03-04T06:49:02.964 INFO:tasks.rados.rados.0.smithi137.stdout:2173: expect (ObjNum 639 snap 178 seq_num 639) 2024-03-04T06:49:02.964 INFO:tasks.rados.rados.0.smithi137.stdout:2174: snap_remove snap 197 2024-03-04T06:49:03.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:02.969+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:03.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:02.952+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:03.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:02.952+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:03.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:02.966+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[88869]: osdmap e473: 8 total, 8 up, 8 in 2024-03-04T06:49:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[88869]: pgmap v386: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 328 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 516 KiB/s rd, 952 KiB/s wr, 3 op/s 2024-03-04T06:49:03.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:03.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[91314]: osdmap e473: 8 total, 8 up, 8 in 2024-03-04T06:49:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:02 smithi137 ceph-mon[91314]: pgmap v386: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 328 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 516 KiB/s rd, 952 KiB/s wr, 3 op/s 2024-03-04T06:49:03.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:03.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:03.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:03.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:02 smithi203 ceph-mon[85573]: osdmap e473: 8 total, 8 up, 8 in 2024-03-04T06:49:03.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:03.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:03.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:03.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:02 smithi203 ceph-mon[85573]: pgmap v386: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 328 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 516 KiB/s rd, 952 KiB/s wr, 3 op/s 2024-03-04T06:49:03.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:02.954+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:03.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:02.936+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:03.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:02.936+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:03.941 INFO:tasks.rados.rados.0.smithi137.stdout:2174: done (2 left) 2024-03-04T06:49:03.941 INFO:tasks.rados.rados.0.smithi137.stdout:2175: delete oid 43 current snap is 203 2024-03-04T06:49:03.941 INFO:tasks.rados.rados.0.smithi137.stdout:2173: expect (ObjNum 639 snap 178 seq_num 639) 2024-03-04T06:49:03.981 INFO:tasks.rados.rados.0.smithi137.stdout:2172: expect (ObjNum 544 snap 155 seq_num 544) 2024-03-04T06:49:04.101 INFO:tasks.rados.rados.0.smithi137.stdout:2172: done (2 left) 2024-03-04T06:49:04.101 INFO:tasks.rados.rados.0.smithi137.stdout:2173: done (1 left) 2024-03-04T06:49:04.101 INFO:tasks.rados.rados.0.smithi137.stdout:2175: done (0 left) 2024-03-04T06:49:04.101 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 203 2024-03-04T06:49:04.101 INFO:tasks.rados.rados.0.smithi137.stdout:2176: seq_num 704 ranges {8691712=598016,9289728=745472,10035200=712704,10747904=147456} 2024-03-04T06:49:04.150 INFO:tasks.rados.rados.0.smithi137.stdout:2176: writing smithi13777483-21 from 8691712 to 9289728 tid 1 2024-03-04T06:49:04.154 INFO:tasks.rados.rados.0.smithi137.stdout:2176: writing smithi13777483-21 from 9289728 to 10035200 tid 2 2024-03-04T06:49:04.158 INFO:tasks.rados.rados.0.smithi137.stdout:2176: writing smithi13777483-21 from 10035200 to 10747904 tid 3 2024-03-04T06:49:04.160 INFO:tasks.rados.rados.0.smithi137.stdout:2176: writing smithi13777483-21 from 10747904 to 10895360 tid 4 2024-03-04T06:49:04.160 INFO:tasks.rados.rados.0.smithi137.stdout:2177: rollback oid 24 current snap is 203 2024-03-04T06:49:04.160 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 24 to 191 2024-03-04T06:49:04.160 INFO:tasks.rados.rados.0.smithi137.stdout:2176: finishing write tid 1 to smithi13777483-21 2024-03-04T06:49:04.160 INFO:tasks.rados.rados.0.smithi137.stdout:2176: finishing write tid 2 to smithi13777483-21 2024-03-04T06:49:04.160 INFO:tasks.rados.rados.0.smithi137.stdout:2178: copy_from oid 44 from oid 15 current snap is 203 2024-03-04T06:49:04.160 INFO:tasks.rados.rados.0.smithi137.stdout:2179: rmattr oid 11 current snap is 203 2024-03-04T06:49:04.160 INFO:tasks.rados.rados.0.smithi137.stdout:2179: done (3 left) 2024-03-04T06:49:04.160 INFO:tasks.rados.rados.0.smithi137.stdout:2180: rmattr oid 47 current snap is 203 2024-03-04T06:49:04.160 INFO:tasks.rados.rados.0.smithi137.stdout:2181: delete oid 46 current snap is 203 2024-03-04T06:49:04.162 INFO:tasks.rados.rados.0.smithi137.stdout:2181: done (4 left) 2024-03-04T06:49:04.162 INFO:tasks.rados.rados.0.smithi137.stdout:2177: finishing rollback tid 0 to smithi13777483-24 2024-03-04T06:49:04.162 INFO:tasks.rados.rados.0.smithi137.stdout:2182: read oid 31 snap -1 2024-03-04T06:49:04.162 INFO:tasks.rados.rados.0.smithi137.stdout:2182: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:49:04.162 INFO:tasks.rados.rados.0.smithi137.stdout:2183: snap_create 2024-03-04T06:49:04.162 INFO:tasks.rados.rados.0.smithi137.stdout:2177: finishing rollback tid 1 to smithi13777483-24 2024-03-04T06:49:04.163 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 15508 (ObjNum 97 snap 0 seq_num 260) dirty dne 2024-03-04T06:49:04.163 INFO:tasks.rados.rados.0.smithi137.stdout:2176: finishing write tid 3 to smithi13777483-21 2024-03-04T06:49:04.163 INFO:tasks.rados.rados.0.smithi137.stdout:2182: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:49:04.167 INFO:tasks.rados.rados.0.smithi137.stdout:2176: finishing write tid 4 to smithi13777483-21 2024-03-04T06:49:04.167 INFO:tasks.rados.rados.0.smithi137.stdout:2176: finishing write tid 5 to smithi13777483-21 2024-03-04T06:49:04.167 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16807 (ObjNum 289 snap 0 seq_num 1) dirty exists 2024-03-04T06:49:04.168 INFO:tasks.rados.rados.0.smithi137.stdout:2176: finishing write tid 6 to smithi13777483-21 2024-03-04T06:49:04.168 INFO:tasks.rados.rados.0.smithi137.stdout:2176: oid 21 updating version 0 to 16802 2024-03-04T06:49:04.168 INFO:tasks.rados.rados.0.smithi137.stdout:2176: oid 21 updating version 16802 to 16804 2024-03-04T06:49:04.168 INFO:tasks.rados.rados.0.smithi137.stdout:2176: oid 21 version 16804 is already newer than 16803 2024-03-04T06:49:04.168 INFO:tasks.rados.rados.0.smithi137.stdout:2176: oid 21 updating version 16804 to 16805 2024-03-04T06:49:04.169 INFO:tasks.rados.rados.0.smithi137.stdout:2176: oid 21 updating version 16805 to 16806 2024-03-04T06:49:04.169 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 16806 (ObjNum 704 snap 203 seq_num 704) dirty exists 2024-03-04T06:49:04.169 INFO:tasks.rados.rados.0.smithi137.stdout:2176: left oid 21 (ObjNum 704 snap 203 seq_num 704) 2024-03-04T06:49:04.174 INFO:tasks.rados.rados.0.smithi137.stdout:2178: finishing copy_from racing read to smithi13777483-44 2024-03-04T06:49:04.174 INFO:tasks.rados.rados.0.smithi137.stdout:2178: finishing copy_from to smithi13777483-44 2024-03-04T06:49:04.174 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 15463 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:49:04.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:03.944+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[88869]: osdmap e474: 8 total, 8 up, 8 in 2024-03-04T06:49:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[91314]: osdmap e474: 8 total, 8 up, 8 in 2024-03-04T06:49:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:04.295 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:03.943+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:04.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:03.946+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:04.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:03.946+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:04.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:03.946+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:04.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:04.049+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:03 smithi203 ceph-mon[85573]: osdmap e474: 8 total, 8 up, 8 in 2024-03-04T06:49:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:04.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:03.940+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:04.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:03.940+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:04.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:03.940+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:04.946 INFO:tasks.rados.rados.0.smithi137.stdout:2176: done (5 left) 2024-03-04T06:49:04.946 INFO:tasks.rados.rados.0.smithi137.stdout:2177: done (4 left) 2024-03-04T06:49:04.946 INFO:tasks.rados.rados.0.smithi137.stdout:2178: done (3 left) 2024-03-04T06:49:04.946 INFO:tasks.rados.rados.0.smithi137.stdout:2180: done (2 left) 2024-03-04T06:49:04.946 INFO:tasks.rados.rados.0.smithi137.stdout:2182: done (1 left) 2024-03-04T06:49:04.946 INFO:tasks.rados.rados.0.smithi137.stdout:2183: done (0 left) 2024-03-04T06:49:04.947 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 204 2024-03-04T06:49:04.947 INFO:tasks.rados.rados.0.smithi137.stdout:2184: seq_num 706 ranges {0=630784,630784=516096,1146880=729088,1875968=360448} 2024-03-04T06:49:04.949 INFO:tasks.rados.rados.0.smithi137.stdout:2184: writing smithi13777483-14 from 0 to 630784 tid 1 2024-03-04T06:49:04.952 INFO:tasks.rados.rados.0.smithi137.stdout:2184: writing smithi13777483-14 from 630784 to 1146880 tid 2 2024-03-04T06:49:04.956 INFO:tasks.rados.rados.0.smithi137.stdout:2184: writing smithi13777483-14 from 1146880 to 1875968 tid 3 2024-03-04T06:49:04.959 INFO:tasks.rados.rados.0.smithi137.stdout:2184: writing smithi13777483-14 from 1875968 to 2236416 tid 4 2024-03-04T06:49:04.959 INFO:tasks.rados.rados.0.smithi137.stdout:2185: read oid 25 snap -1 2024-03-04T06:49:04.959 INFO:tasks.rados.rados.0.smithi137.stdout:2185: expect (ObjNum 544 snap 155 seq_num 544) 2024-03-04T06:49:04.959 INFO:tasks.rados.rados.0.smithi137.stdout:2186: read oid 44 snap -1 2024-03-04T06:49:04.960 INFO:tasks.rados.rados.0.smithi137.stdout:2186: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:04.960 INFO:tasks.rados.rados.0.smithi137.stdout:2187: read oid 43 snap 191 2024-03-04T06:49:04.960 INFO:tasks.rados.rados.0.smithi137.stdout:2187: expect deleted 2024-03-04T06:49:04.960 INFO:tasks.rados.rados.0.smithi137.stdout:2188: rmattr oid 12 current snap is 204 2024-03-04T06:49:04.960 INFO:tasks.rados.rados.0.smithi137.stdout:2188: done (4 left) 2024-03-04T06:49:04.960 INFO:tasks.rados.rados.0.smithi137.stdout:2189: read oid 41 snap -1 2024-03-04T06:49:04.960 INFO:tasks.rados.rados.0.smithi137.stdout:2189: expect (ObjNum 631 snap 177 seq_num 631) 2024-03-04T06:49:04.960 INFO:tasks.rados.rados.0.smithi137.stdout:2190: delete oid 38 current snap is 204 2024-03-04T06:49:04.960 INFO:tasks.rados.rados.0.smithi137.stdout:2184: finishing write tid 1 to smithi13777483-14 2024-03-04T06:49:04.960 INFO:tasks.rados.rados.0.smithi137.stdout:2184: finishing write tid 2 to smithi13777483-14 2024-03-04T06:49:04.963 INFO:tasks.rados.rados.0.smithi137.stdout:2184: finishing write tid 3 to smithi13777483-14 2024-03-04T06:49:04.963 INFO:tasks.rados.rados.0.smithi137.stdout:2184: finishing write tid 4 to smithi13777483-14 2024-03-04T06:49:04.963 INFO:tasks.rados.rados.0.smithi137.stdout:2184: finishing write tid 5 to smithi13777483-14 2024-03-04T06:49:04.967 INFO:tasks.rados.rados.0.smithi137.stdout:2184: finishing write tid 6 to smithi13777483-14 2024-03-04T06:49:04.967 INFO:tasks.rados.rados.0.smithi137.stdout:2184: oid 14 updating version 0 to 15495 2024-03-04T06:49:04.967 INFO:tasks.rados.rados.0.smithi137.stdout:2184: oid 14 updating version 15495 to 15496 2024-03-04T06:49:04.967 INFO:tasks.rados.rados.0.smithi137.stdout:2184: oid 14 version 15496 is already newer than 15494 2024-03-04T06:49:04.967 INFO:tasks.rados.rados.0.smithi137.stdout:2184: oid 14 version 15496 is already newer than 15493 2024-03-04T06:49:04.967 INFO:tasks.rados.rados.0.smithi137.stdout:2184: oid 14 version 15496 is already newer than 15492 2024-03-04T06:49:04.967 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 15496 (ObjNum 706 snap 204 seq_num 706) dirty exists 2024-03-04T06:49:04.967 INFO:tasks.rados.rados.0.smithi137.stdout:2184: left oid 14 (ObjNum 706 snap 204 seq_num 706) 2024-03-04T06:49:04.969 INFO:tasks.rados.rados.0.smithi137.stdout:2189: expect (ObjNum 631 snap 177 seq_num 631) 2024-03-04T06:49:05.002 INFO:tasks.rados.rados.0.smithi137.stdout:2186: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:05.135 INFO:tasks.rados.rados.0.smithi137.stdout:2185: expect (ObjNum 544 snap 155 seq_num 544) 2024-03-04T06:49:05.248 INFO:tasks.rados.rados.0.smithi137.stdout:2184: done (5 left) 2024-03-04T06:49:05.249 INFO:tasks.rados.rados.0.smithi137.stdout:2185: done (4 left) 2024-03-04T06:49:05.249 INFO:tasks.rados.rados.0.smithi137.stdout:2186: done (3 left) 2024-03-04T06:49:05.249 INFO:tasks.rados.rados.0.smithi137.stdout:2187: done (2 left) 2024-03-04T06:49:05.249 INFO:tasks.rados.rados.0.smithi137.stdout:2189: done (1 left) 2024-03-04T06:49:05.249 INFO:tasks.rados.rados.0.smithi137.stdout:2190: done (0 left) 2024-03-04T06:49:05.249 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 204 2024-03-04T06:49:05.249 INFO:tasks.rados.rados.0.smithi137.stdout:2191: seq_num 708 ranges {7602176=663552,8265728=737280,9003008=696320,9699328=172032} 2024-03-04T06:49:05.291 INFO:tasks.rados.rados.0.smithi137.stdout:2191: writing smithi13777483-20 from 7602176 to 8265728 tid 1 2024-03-04T06:49:05.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:04.965+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:05.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:04.965+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:05.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:04.960+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:05.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:04.965+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[91314]: osdmap e475: 8 total, 8 up, 8 in 2024-03-04T06:49:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:05.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[91314]: pgmap v389: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 333 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 3.2 MiB/s wr, 49 op/s 2024-03-04T06:49:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:05.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:05.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[88869]: osdmap e475: 8 total, 8 up, 8 in 2024-03-04T06:49:05.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:05.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:05.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:05.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:05.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:05.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:04 smithi137 ceph-mon[88869]: pgmap v389: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 333 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 3.2 MiB/s wr, 49 op/s 2024-03-04T06:49:05.295 INFO:tasks.rados.rados.0.smithi137.stdout:2191: writing smithi13777483-20 from 8265728 to 9003008 tid 2 2024-03-04T06:49:05.299 INFO:tasks.rados.rados.0.smithi137.stdout:2191: writing smithi13777483-20 from 9003008 to 9699328 tid 3 2024-03-04T06:49:05.300 INFO:tasks.rados.rados.0.smithi137.stdout:2191: writing smithi13777483-20 from 9699328 to 9871360 tid 4 2024-03-04T06:49:05.300 INFO:tasks.rados.rados.0.smithi137.stdout:2192: snap_remove snap 191 2024-03-04T06:49:05.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:04.956+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:05.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:04.947+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:05.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:04.948+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:05.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:05.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:04 smithi203 ceph-mon[85573]: osdmap e475: 8 total, 8 up, 8 in 2024-03-04T06:49:05.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:05.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:05.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:05.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:05.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:05.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:04 smithi203 ceph-mon[85573]: pgmap v389: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 333 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 3.2 MiB/s wr, 49 op/s 2024-03-04T06:49:05.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:49:05] "GET /metrics HTTP/1.1" 200 36119 "" "Prometheus/2.43.0" 2024-03-04T06:49:05.948 INFO:tasks.rados.rados.0.smithi137.stdout:2192: done (1 left) 2024-03-04T06:49:05.948 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 204 2024-03-04T06:49:05.948 INFO:tasks.rados.rados.0.smithi137.stdout:2191: finishing write tid 1 to smithi13777483-20 2024-03-04T06:49:05.948 INFO:tasks.rados.rados.0.smithi137.stdout:2193: seq_num 709 ranges {0=679936,679936=614400,1294336=499712,1794048=491520} 2024-03-04T06:49:05.951 INFO:tasks.rados.rados.0.smithi137.stdout:2193: writing smithi13777483-38 from 0 to 679936 tid 1 2024-03-04T06:49:05.955 INFO:tasks.rados.rados.0.smithi137.stdout:2193: writing smithi13777483-38 from 679936 to 1294336 tid 2 2024-03-04T06:49:05.959 INFO:tasks.rados.rados.0.smithi137.stdout:2193: writing smithi13777483-38 from 1294336 to 1794048 tid 3 2024-03-04T06:49:05.962 INFO:tasks.rados.rados.0.smithi137.stdout:2193: writing smithi13777483-38 from 1794048 to 2285568 tid 4 2024-03-04T06:49:05.962 INFO:tasks.rados.rados.0.smithi137.stdout:2194: read oid 42 snap 200 2024-03-04T06:49:05.962 INFO:tasks.rados.rados.0.smithi137.stdout:2194: expect deleted 2024-03-04T06:49:05.962 INFO:tasks.rados.rados.0.smithi137.stdout:2195: delete oid 16 current snap is 204 2024-03-04T06:49:05.962 INFO:tasks.rados.rados.0.smithi137.stdout:2191: finishing write tid 2 to smithi13777483-20 2024-03-04T06:49:05.962 INFO:tasks.rados.rados.0.smithi137.stdout:2191: finishing write tid 3 to smithi13777483-20 2024-03-04T06:49:05.963 INFO:tasks.rados.rados.0.smithi137.stdout:2191: finishing write tid 4 to smithi13777483-20 2024-03-04T06:49:05.963 INFO:tasks.rados.rados.0.smithi137.stdout:2191: finishing write tid 5 to smithi13777483-20 2024-03-04T06:49:05.963 INFO:tasks.rados.rados.0.smithi137.stdout:2191: finishing write tid 6 to smithi13777483-20 2024-03-04T06:49:05.963 INFO:tasks.rados.rados.0.smithi137.stdout:2191: oid 20 updating version 0 to 15498 2024-03-04T06:49:05.963 INFO:tasks.rados.rados.0.smithi137.stdout:2191: oid 20 updating version 15498 to 15499 2024-03-04T06:49:05.963 INFO:tasks.rados.rados.0.smithi137.stdout:2191: oid 20 version 15499 is already newer than 15497 2024-03-04T06:49:05.963 INFO:tasks.rados.rados.0.smithi137.stdout:2191: oid 20 updating version 15499 to 15501 2024-03-04T06:49:05.963 INFO:tasks.rados.rados.0.smithi137.stdout:2191: oid 20 version 15501 is already newer than 15500 2024-03-04T06:49:05.963 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 15501 (ObjNum 708 snap 204 seq_num 708) dirty exists 2024-03-04T06:49:05.963 INFO:tasks.rados.rados.0.smithi137.stdout:2191: left oid 20 (ObjNum 708 snap 204 seq_num 708) 2024-03-04T06:49:05.963 INFO:tasks.rados.rados.0.smithi137.stdout:2193: finishing write tid 1 to smithi13777483-38 2024-03-04T06:49:05.963 INFO:tasks.rados.rados.0.smithi137.stdout:2193: finishing write tid 2 to smithi13777483-38 2024-03-04T06:49:05.963 INFO:tasks.rados.rados.0.smithi137.stdout:2193: finishing write tid 3 to smithi13777483-38 2024-03-04T06:49:05.967 INFO:tasks.rados.rados.0.smithi137.stdout:2193: finishing write tid 4 to smithi13777483-38 2024-03-04T06:49:05.967 INFO:tasks.rados.rados.0.smithi137.stdout:2193: finishing write tid 5 to smithi13777483-38 2024-03-04T06:49:05.969 INFO:tasks.rados.rados.0.smithi137.stdout:2191: done (3 left) 2024-03-04T06:49:05.969 INFO:tasks.rados.rados.0.smithi137.stdout:2194: done (2 left) 2024-03-04T06:49:05.969 INFO:tasks.rados.rados.0.smithi137.stdout:2195: done (1 left) 2024-03-04T06:49:05.969 INFO:tasks.rados.rados.0.smithi137.stdout:2196: delete oid 37 current snap is 204 2024-03-04T06:49:05.970 INFO:tasks.rados.rados.0.smithi137.stdout:2193: finishing write tid 6 to smithi13777483-38 2024-03-04T06:49:05.970 INFO:tasks.rados.rados.0.smithi137.stdout:2193: oid 38 updating version 0 to 16811 2024-03-04T06:49:05.970 INFO:tasks.rados.rados.0.smithi137.stdout:2193: oid 38 version 16811 is already newer than 16809 2024-03-04T06:49:05.970 INFO:tasks.rados.rados.0.smithi137.stdout:2193: oid 38 version 16811 is already newer than 16810 2024-03-04T06:49:05.970 INFO:tasks.rados.rados.0.smithi137.stdout:2193: oid 38 updating version 16811 to 16813 2024-03-04T06:49:05.970 INFO:tasks.rados.rados.0.smithi137.stdout:2193: oid 38 version 16813 is already newer than 16812 2024-03-04T06:49:05.970 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16813 (ObjNum 709 snap 204 seq_num 709) dirty exists 2024-03-04T06:49:05.970 INFO:tasks.rados.rados.0.smithi137.stdout:2193: left oid 38 (ObjNum 709 snap 204 seq_num 709) 2024-03-04T06:49:05.972 INFO:tasks.rados.rados.0.smithi137.stdout:2193: done (1 left) 2024-03-04T06:49:05.972 INFO:tasks.rados.rados.0.smithi137.stdout:2196: done (0 left) 2024-03-04T06:49:05.972 INFO:tasks.rados.rados.0.smithi137.stdout:2197: setattr oid 9 current snap is 204 2024-03-04T06:49:05.975 INFO:tasks.rados.rados.0.smithi137.stdout:2198: snap_remove snap 186 2024-03-04T06:49:06.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:05.950+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:06.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:05.946+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:06.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[88869]: osdmap e476: 8 total, 8 up, 8 in 2024-03-04T06:49:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:06.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:05.955+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:06.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:05.955+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:06.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:05.955+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:06.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:06.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:06.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[91314]: osdmap e476: 8 total, 8 up, 8 in 2024-03-04T06:49:06.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:06.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:06.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:06.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:06.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:06.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:06.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:05.956+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:06.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:05.957+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:06.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:05.957+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:06.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:05.957+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:06.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:05 smithi203 ceph-mon[85573]: osdmap e476: 8 total, 8 up, 8 in 2024-03-04T06:49:06.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:06.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:06.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:06.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:06.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:06.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:06.960 INFO:tasks.rados.rados.0.smithi137.stdout:2198: done (1 left) 2024-03-04T06:49:06.961 INFO:tasks.rados.rados.0.smithi137.stdout:2199: snap_create 2024-03-04T06:49:06.961 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 15512 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-03-04T06:49:07.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:06.963+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:07.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:06.961+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:07.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:06.964+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:07.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:06.957+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:07.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:07.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:07.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[91314]: osdmap e477: 8 total, 8 up, 8 in 2024-03-04T06:49:07.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:07.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:07.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:07.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:07.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:07.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[91314]: pgmap v392: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 333 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 3.2 MiB/s wr, 52 op/s 2024-03-04T06:49:07.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:07.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:07.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[88869]: osdmap e477: 8 total, 8 up, 8 in 2024-03-04T06:49:07.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:07.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:07.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:07.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:07.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:07.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:06 smithi137 ceph-mon[88869]: pgmap v392: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 333 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 3.2 MiB/s wr, 52 op/s 2024-03-04T06:49:07.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:06.960+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:07.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:06.960+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:07.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:06.962+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:07.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:07.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:07.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:06 smithi203 ceph-mon[85573]: osdmap e477: 8 total, 8 up, 8 in 2024-03-04T06:49:07.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:07.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:07.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:06 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:07.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:06 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:07.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:07.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:06 smithi203 ceph-mon[85573]: pgmap v392: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 333 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 3.2 MiB/s wr, 52 op/s 2024-03-04T06:49:07.962 INFO:tasks.rados.rados.0.smithi137.stdout:2197: done (1 left) 2024-03-04T06:49:07.962 INFO:tasks.rados.rados.0.smithi137.stdout:2199: done (0 left) 2024-03-04T06:49:07.962 INFO:tasks.rados.rados.0.smithi137.stdout:2200: read oid 42 snap -1 2024-03-04T06:49:07.963 INFO:tasks.rados.rados.0.smithi137.stdout:2200: expect deleted 2024-03-04T06:49:07.963 INFO:tasks.rados.rados.0.smithi137.stdout:2201: snap_remove snap 202 2024-03-04T06:49:08.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:07.961+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:08.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:07.961+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:08.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:07.961+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[88869]: osdmap e478: 8 total, 8 up, 8 in 2024-03-04T06:49:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:08.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:08.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:08.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:08.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[91314]: osdmap e478: 8 total, 8 up, 8 in 2024-03-04T06:49:08.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:08.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:08.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:08.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:08.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:08.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:08.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:07.963+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:07 smithi203 ceph-mon[85573]: osdmap e478: 8 total, 8 up, 8 in 2024-03-04T06:49:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:08.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:08.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:08.968 INFO:tasks.rados.rados.0.smithi137.stdout:2201: done (1 left) 2024-03-04T06:49:08.968 INFO:tasks.rados.rados.0.smithi137.stdout:2202: copy_from oid 21 from oid 12 current snap is 205 2024-03-04T06:49:08.968 INFO:tasks.rados.rados.0.smithi137.stdout:2200: done (1 left) 2024-03-04T06:49:08.968 INFO:tasks.rados.rados.0.smithi137.stdout:2203: copy_from oid 26 from oid 15 current snap is 205 2024-03-04T06:49:08.968 INFO:tasks.rados.rados.0.smithi137.stdout:2204: delete oid 37 current snap is 205 2024-03-04T06:49:08.972 INFO:tasks.rados.rados.0.smithi137.stdout:2204: done (2 left) 2024-03-04T06:49:08.972 INFO:tasks.rados.rados.0.smithi137.stdout:2205: read oid 32 snap -1 2024-03-04T06:49:08.972 INFO:tasks.rados.rados.0.smithi137.stdout:2205: expect (ObjNum 671 snap 191 seq_num 671) 2024-03-04T06:49:08.972 INFO:tasks.rados.rados.0.smithi137.stdout:2206: snap_remove snap 204 2024-03-04T06:49:09.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:08.869+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:09.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:08.970+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:09.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:08.971+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:09.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:08.869+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:09.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:08.972+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[91314]: osdmap e479: 8 total, 8 up, 8 in 2024-03-04T06:49:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[91314]: pgmap v395: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 345 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.8 MiB/s wr, 18 op/s 2024-03-04T06:49:09.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:09.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:49:09.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:09.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:09.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[88869]: osdmap e479: 8 total, 8 up, 8 in 2024-03-04T06:49:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[88869]: pgmap v395: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 345 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.8 MiB/s wr, 18 op/s 2024-03-04T06:49:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:49:09.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:09.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:09.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:09.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:08.972+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:09.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:08.870+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:09.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:08.870+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:09.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:08.870+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:09.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:08.968+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:09.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:08.968+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:09.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-mon[85573]: osdmap e479: 8 total, 8 up, 8 in 2024-03-04T06:49:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-mon[85573]: pgmap v395: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 345 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.8 MiB/s wr, 18 op/s 2024-03-04T06:49:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:49:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:09.975 INFO:tasks.rados.rados.0.smithi137.stdout:2202: finishing copy_from racing read to smithi13777483-21 2024-03-04T06:49:09.975 INFO:tasks.rados.rados.0.smithi137.stdout:2202: finishing copy_from to smithi13777483-21 2024-03-04T06:49:09.975 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 16770 (ObjNum 697 snap 202 seq_num 697) dirty exists 2024-03-04T06:49:09.975 INFO:tasks.rados.rados.0.smithi137.stdout:2205: expect (ObjNum 671 snap 191 seq_num 671) 2024-03-04T06:49:10.012 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:09.733+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:10.012 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:10.012 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:10.012 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[88869]: osdmap e480: 8 total, 8 up, 8 in 2024-03-04T06:49:10.012 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:10.012 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:10.012 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:10.012 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:10.013 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:10.013 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:10.013 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:10.013 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:10.013 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:10.013 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[91314]: osdmap e480: 8 total, 8 up, 8 in 2024-03-04T06:49:10.013 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:10.013 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:10.013 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:10.013 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:10.013 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:10.013 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:10.013 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:10.123 INFO:tasks.rados.rados.0.smithi137.stdout:2203: finishing copy_from racing read to smithi13777483-26 2024-03-04T06:49:10.123 INFO:tasks.rados.rados.0.smithi137.stdout:2203: finishing copy_from to smithi13777483-26 2024-03-04T06:49:10.123 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 15463 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:49:10.123 INFO:tasks.rados.rados.0.smithi137.stdout:2202: done (3 left) 2024-03-04T06:49:10.123 INFO:tasks.rados.rados.0.smithi137.stdout:2203: done (2 left) 2024-03-04T06:49:10.123 INFO:tasks.rados.rados.0.smithi137.stdout:2205: done (1 left) 2024-03-04T06:49:10.123 INFO:tasks.rados.rados.0.smithi137.stdout:2206: done (0 left) 2024-03-04T06:49:10.123 INFO:tasks.rados.rados.0.smithi137.stdout:2207: copy_from oid 14 from oid 26 current snap is 205 2024-03-04T06:49:10.123 INFO:tasks.rados.rados.0.smithi137.stdout:2208: delete oid 21 current snap is 205 2024-03-04T06:49:10.127 INFO:tasks.rados.rados.0.smithi137.stdout:2208: done (1 left) 2024-03-04T06:49:10.127 INFO:tasks.rados.rados.0.smithi137.stdout:2209: read oid 31 snap -1 2024-03-04T06:49:10.127 INFO:tasks.rados.rados.0.smithi137.stdout:2209: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:49:10.127 INFO:tasks.rados.rados.0.smithi137.stdout:2210: snap_create 2024-03-04T06:49:10.128 INFO:tasks.rados.rados.0.smithi137.stdout:2209: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:49:10.137 INFO:tasks.rados.rados.0.smithi137.stdout:2207: finishing copy_from racing read to smithi13777483-14 2024-03-04T06:49:10.140 INFO:tasks.rados.rados.0.smithi137.stdout:2207: finishing copy_from to smithi13777483-14 2024-03-04T06:49:10.140 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 15463 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:49:10.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:10.210+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:10.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:10.125+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:10.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:10.009+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:10.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:10.010+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:10.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:10.010+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:10.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:09.982+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:10.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:09.980+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:10.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:09.981+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:10.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:09.981+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-mon[85573]: osdmap e480: 8 total, 8 up, 8 in 2024-03-04T06:49:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:10.984 INFO:tasks.rados.rados.0.smithi137.stdout:2207: done (2 left) 2024-03-04T06:49:10.984 INFO:tasks.rados.rados.0.smithi137.stdout:2209: done (1 left) 2024-03-04T06:49:10.984 INFO:tasks.rados.rados.0.smithi137.stdout:2210: done (0 left) 2024-03-04T06:49:10.984 INFO:tasks.rados.rados.0.smithi137.stdout:2211: read oid 47 snap -1 2024-03-04T06:49:10.984 INFO:tasks.rados.rados.0.smithi137.stdout:2211: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:49:10.984 INFO:tasks.rados.rados.0.smithi137.stdout:2212: read oid 41 snap 203 2024-03-04T06:49:10.984 INFO:tasks.rados.rados.0.smithi137.stdout:2212: expect (ObjNum 631 snap 177 seq_num 631) 2024-03-04T06:49:10.984 INFO:tasks.rados.rados.0.smithi137.stdout:2213: read oid 30 snap -1 2024-03-04T06:49:10.984 INFO:tasks.rados.rados.0.smithi137.stdout:2213: expect deleted 2024-03-04T06:49:10.984 INFO:tasks.rados.rados.0.smithi137.stdout:2214: rollback oid 23 current snap is 206 2024-03-04T06:49:10.984 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 23 to 200 2024-03-04T06:49:10.984 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 206 2024-03-04T06:49:10.984 INFO:tasks.rados.rados.0.smithi137.stdout:2215: seq_num 714 ranges {3850240=761856,4612096=442368,5054464=688128,5742592=475136} 2024-03-04T06:49:11.008 INFO:tasks.rados.rados.0.smithi137.stdout:2215: writing smithi13777483-32 from 3850240 to 4612096 tid 1 2024-03-04T06:49:11.011 INFO:tasks.rados.rados.0.smithi137.stdout:2215: writing smithi13777483-32 from 4612096 to 5054464 tid 2 2024-03-04T06:49:11.015 INFO:tasks.rados.rados.0.smithi137.stdout:2215: writing smithi13777483-32 from 5054464 to 5742592 tid 3 2024-03-04T06:49:11.018 INFO:tasks.rados.rados.0.smithi137.stdout:2215: writing smithi13777483-32 from 5742592 to 6217728 tid 4 2024-03-04T06:49:11.018 INFO:tasks.rados.rados.0.smithi137.stdout:2216: rollback oid 14 current snap is 206 2024-03-04T06:49:11.018 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 14 to 196 2024-03-04T06:49:11.018 INFO:tasks.rados.rados.0.smithi137.stdout:2211: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:49:11.019 INFO:tasks.rados.rados.0.smithi137.stdout:2214: finishing rollback tid 0 to smithi13777483-23 2024-03-04T06:49:11.019 INFO:tasks.rados.rados.0.smithi137.stdout:2214: finishing rollback tid 1 to smithi13777483-23 2024-03-04T06:49:11.019 INFO:tasks.rados.rados.0.smithi137.stdout:2214: finishing rollback tid 2 to smithi13777483-23 2024-03-04T06:49:11.019 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 15504 (ObjNum 638 snap 178 seq_num 638) dirty exists 2024-03-04T06:49:11.019 INFO:tasks.rados.rados.0.smithi137.stdout:2212: expect (ObjNum 631 snap 177 seq_num 631) 2024-03-04T06:49:11.052 INFO:tasks.rados.rados.0.smithi137.stdout:2215: finishing write tid 1 to smithi13777483-32 2024-03-04T06:49:11.052 INFO:tasks.rados.rados.0.smithi137.stdout:2215: finishing write tid 2 to smithi13777483-32 2024-03-04T06:49:11.052 INFO:tasks.rados.rados.0.smithi137.stdout:2215: finishing write tid 3 to smithi13777483-32 2024-03-04T06:49:11.052 INFO:tasks.rados.rados.0.smithi137.stdout:2211: done (5 left) 2024-03-04T06:49:11.052 INFO:tasks.rados.rados.0.smithi137.stdout:2212: done (4 left) 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2213: done (3 left) 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2214: done (2 left) 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2217: read oid 25 snap 192 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2217: expect (ObjNum 544 snap 155 seq_num 544) 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2218: read oid 13 snap 199 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2218: expect (ObjNum 615 snap 175 seq_num 615) 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2219: read oid 44 snap -1 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2219: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2220: snap_create 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2216: finishing rollback tid 0 to smithi13777483-14 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2216: finishing rollback tid 1 to smithi13777483-14 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 15506 (ObjNum 145 snap 0 seq_num 3132351488) dirty dne 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2215: finishing write tid 4 to smithi13777483-32 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2215: finishing write tid 5 to smithi13777483-32 2024-03-04T06:49:11.053 INFO:tasks.rados.rados.0.smithi137.stdout:2215: finishing write tid 6 to smithi13777483-32 2024-03-04T06:49:11.054 INFO:tasks.rados.rados.0.smithi137.stdout:2215: oid 32 updating version 0 to 16830 2024-03-04T06:49:11.054 INFO:tasks.rados.rados.0.smithi137.stdout:2215: oid 32 version 16830 is already newer than 16828 2024-03-04T06:49:11.054 INFO:tasks.rados.rados.0.smithi137.stdout:2215: oid 32 updating version 16830 to 16831 2024-03-04T06:49:11.054 INFO:tasks.rados.rados.0.smithi137.stdout:2215: oid 32 updating version 16831 to 16832 2024-03-04T06:49:11.054 INFO:tasks.rados.rados.0.smithi137.stdout:2215: oid 32 version 16832 is already newer than 16829 2024-03-04T06:49:11.054 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16832 (ObjNum 714 snap 206 seq_num 714) dirty exists 2024-03-04T06:49:11.054 INFO:tasks.rados.rados.0.smithi137.stdout:2215: left oid 32 (ObjNum 714 snap 206 seq_num 714) 2024-03-04T06:49:11.057 INFO:tasks.rados.rados.0.smithi137.stdout:2218: expect (ObjNum 615 snap 175 seq_num 615) 2024-03-04T06:49:11.079 INFO:tasks.rados.rados.0.smithi137.stdout:2219: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:11.212 INFO:tasks.rados.rados.0.smithi137.stdout:2217: expect (ObjNum 544 snap 155 seq_num 544) 2024-03-04T06:49:11.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:10.986+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:11.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:11.048+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:11.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:11.049+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:11.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:11.048+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:11.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[88869]: osdmap e481: 8 total, 8 up, 8 in 2024-03-04T06:49:11.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:11.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:11.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:11.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:11.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:11.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:11.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:11.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[88869]: pgmap v398: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 345 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 6.1 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2024-03-04T06:49:11.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[91314]: osdmap e481: 8 total, 8 up, 8 in 2024-03-04T06:49:11.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:11.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:11.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:11.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:11.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:11.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:11.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:11.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:10 smithi137 ceph-mon[91314]: pgmap v398: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 345 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 6.1 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2024-03-04T06:49:11.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:10.990+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:11.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:10.980+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:11.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:10.980+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:10 smithi203 ceph-mon[85573]: osdmap e481: 8 total, 8 up, 8 in 2024-03-04T06:49:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:11.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset fe=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:10 smithi203 ceph-mon[85573]: pgmap v398: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 345 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 6.1 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2024-03-04T06:49:11.981 INFO:tasks.rados.rados.0.smithi137.stdout:2215: done (5 left) 2024-03-04T06:49:11.981 INFO:tasks.rados.rados.0.smithi137.stdout:2216: done (4 left) 2024-03-04T06:49:11.981 INFO:tasks.rados.rados.0.smithi137.stdout:2217: done (3 left) 2024-03-04T06:49:11.981 INFO:tasks.rados.rados.0.smithi137.stdout:2218: done (2 left) 2024-03-04T06:49:11.981 INFO:tasks.rados.rados.0.smithi137.stdout:2219: done (1 left) 2024-03-04T06:49:11.981 INFO:tasks.rados.rados.0.smithi137.stdout:2220: done (0 left) 2024-03-04T06:49:11.981 INFO:tasks.rados.rados.0.smithi137.stdout:2221: copy_from oid 22 from oid 19 current snap is 207 2024-03-04T06:49:11.981 INFO:tasks.rados.rados.0.smithi137.stdout:2222: read oid 11 snap -1 2024-03-04T06:49:11.982 INFO:tasks.rados.rados.0.smithi137.stdout:2222: expect deleted 2024-03-04T06:49:11.982 INFO:tasks.rados.rados.0.smithi137.stdout:2223: snap_create 2024-03-04T06:49:11.990 INFO:tasks.rados.rados.0.smithi137.stdout:2221: finishing copy_from to smithi13777483-22 2024-03-04T06:49:11.990 INFO:tasks.rados.rados.0.smithi137.stdout:2221: got expected ENOENT (src dne) 2024-03-04T06:49:11.990 INFO:tasks.rados.rados.0.smithi137.stdout:2221: finishing copy_from racing read to smithi13777483-22 2024-03-04T06:49:12.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:11.983+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:12.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:12.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:12.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[88869]: osdmap e482: 8 total, 8 up, 8 in 2024-03-04T06:49:12.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:12.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:12.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:12.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[91314]: osdmap e482: 8 total, 8 up, 8 in 2024-03-04T06:49:12.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:12.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:12.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:12.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:12.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:12.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:11.983+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:12.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:11.984+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:12.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:11.984+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:11 smithi203 ceph-mon[85573]: osdmap e482: 8 total, 8 up, 8 in 2024-03-04T06:49:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:12.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:12.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:12.370+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:12.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:12.299+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:12.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:12.299+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:12.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:12.299+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:12.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:12.369+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:12.982 INFO:tasks.rados.rados.0.smithi137.stdout:2221: done (2 left) 2024-03-04T06:49:12.982 INFO:tasks.rados.rados.0.smithi137.stdout:2222: done (1 left) 2024-03-04T06:49:12.982 INFO:tasks.rados.rados.0.smithi137.stdout:2223: done (0 left) 2024-03-04T06:49:12.983 INFO:tasks.rados.rados.0.smithi137.stdout:2224: rmattr oid 34 current snap is 208 2024-03-04T06:49:12.983 INFO:tasks.rados.rados.0.smithi137.stdout:2224: done (0 left) 2024-03-04T06:49:12.983 INFO:tasks.rados.rados.0.smithi137.stdout:2225: setattr oid 27 current snap is 208 2024-03-04T06:49:12.983 INFO:tasks.rados.rados.0.smithi137.stdout:2226: read oid 32 snap -1 2024-03-04T06:49:12.983 INFO:tasks.rados.rados.0.smithi137.stdout:2226: expect (ObjNum 714 snap 206 seq_num 714) 2024-03-04T06:49:12.983 INFO:tasks.rados.rados.0.smithi137.stdout:2227: snap_create 2024-03-04T06:49:13.004 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16833 (ObjNum 695 snap 200 seq_num 695) dirty exists 2024-03-04T06:49:13.014 INFO:tasks.rados.rados.0.smithi137.stdout:2226: expect (ObjNum 714 snap 206 seq_num 714) 2024-03-04T06:49:13.281 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:12.985+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:13.281 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:12.985+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:13.282 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:12.988+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:13.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-mon[85573]: osdmap e483: 8 total, 8 up, 8 in 2024-03-04T06:49:13.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:13.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:13.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:13.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:13.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:13.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-mon[85573]: pgmap v401: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 345 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 746 KiB/s rd, 0 op/s 2024-03-04T06:49:13.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:13.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:13.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-04T06:49:13.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:12 smithi203 ceph-mon[85573]: osdmap e484: 8 total, 8 up, 8 in 2024-03-04T06:49:13.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:12.991+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:13.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:13.156+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:13.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:13.156+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:13.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:13.155+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[88869]: osdmap e483: 8 total, 8 up, 8 in 2024-03-04T06:49:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[88869]: pgmap v401: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 345 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 746 KiB/s rd, 0 op/s 2024-03-04T06:49:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-04T06:49:13.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[88869]: osdmap e484: 8 total, 8 up, 8 in 2024-03-04T06:49:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[91314]: osdmap e483: 8 total, 8 up, 8 in 2024-03-04T06:49:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[91314]: pgmap v401: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 345 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 746 KiB/s rd, 0 op/s 2024-03-04T06:49:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-04T06:49:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:12 smithi137 ceph-mon[91314]: osdmap e484: 8 total, 8 up, 8 in 2024-03-04T06:49:13.985 INFO:tasks.rados.rados.0.smithi137.stdout:2225: done (2 left) 2024-03-04T06:49:13.986 INFO:tasks.rados.rados.0.smithi137.stdout:2226: done (1 left) 2024-03-04T06:49:13.986 INFO:tasks.rados.rados.0.smithi137.stdout:2227: done (0 left) 2024-03-04T06:49:13.986 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 24 current snap is 209 2024-03-04T06:49:13.986 INFO:tasks.rados.rados.0.smithi137.stdout:2228: seq_num 715 ranges {0=778240,778240=770048,1548288=499712,2048000=335872} 2024-03-04T06:49:13.990 INFO:tasks.rados.rados.0.smithi137.stdout:2228: writing smithi13777483-24 from 0 to 778240 tid 1 2024-03-04T06:49:13.994 INFO:tasks.rados.rados.0.smithi137.stdout:2228: writing smithi13777483-24 from 778240 to 1548288 tid 2 2024-03-04T06:49:13.998 INFO:tasks.rados.rados.0.smithi137.stdout:2228: writing smithi13777483-24 from 1548288 to 2048000 tid 3 2024-03-04T06:49:14.002 INFO:tasks.rados.rados.0.smithi137.stdout:2228: writing smithi13777483-24 from 2048000 to 2383872 tid 4 2024-03-04T06:49:14.002 INFO:tasks.rados.rados.0.smithi137.stdout:2229: copy_from oid 30 from oid 12 current snap is 209 2024-03-04T06:49:14.002 INFO:tasks.rados.rados.0.smithi137.stdout:2228: finishing write tid 1 to smithi13777483-24 2024-03-04T06:49:14.002 INFO:tasks.rados.rados.0.smithi137.stdout:2228: finishing write tid 2 to smithi13777483-24 2024-03-04T06:49:14.002 INFO:tasks.rados.rados.0.smithi137.stdout:2230: copy_from oid 43 from oid 16 current snap is 209 2024-03-04T06:49:14.002 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 209 2024-03-04T06:49:14.002 INFO:tasks.rados.rados.0.smithi137.stdout:2231: seq_num 716 ranges {0=794624,794624=655360,1449984=704512,2154496=245760} 2024-03-04T06:49:14.008 INFO:tasks.rados.rados.0.smithi137.stdout:2231: writing smithi13777483-39 from 0 to 794624 tid 1 2024-03-04T06:49:14.014 INFO:tasks.rados.rados.0.smithi137.stdout:2231: writing smithi13777483-39 from 794624 to 1449984 tid 2 2024-03-04T06:49:14.019 INFO:tasks.rados.rados.0.smithi137.stdout:2231: writing smithi13777483-39 from 1449984 to 2154496 tid 3 2024-03-04T06:49:14.021 INFO:tasks.rados.rados.0.smithi137.stdout:2231: writing smithi13777483-39 from 2154496 to 2400256 tid 4 2024-03-04T06:49:14.021 INFO:tasks.rados.rados.0.smithi137.stdout:2232: snap_create 2024-03-04T06:49:14.021 INFO:tasks.rados.rados.0.smithi137.stdout:2228: finishing write tid 3 to smithi13777483-24 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2230: finishing copy_from to smithi13777483-43 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2230: got expected ENOENT (src dne) 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2230: finishing copy_from racing read to smithi13777483-43 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2228: finishing write tid 4 to smithi13777483-24 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2228: finishing write tid 5 to smithi13777483-24 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2228: finishing write tid 6 to smithi13777483-24 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2228: oid 24 updating version 0 to 15512 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2228: oid 24 version 15512 is already newer than 15511 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2228: oid 24 updating version 15512 to 15513 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2228: oid 24 version 15513 is already newer than 15510 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2228: oid 24 version 15513 is already newer than 15509 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 15513 (ObjNum 715 snap 209 seq_num 715) dirty exists 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2228: left oid 24 (ObjNum 715 snap 209 seq_num 715) 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2229: finishing copy_from racing read to smithi13777483-30 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:2229: finishing copy_from to smithi13777483-30 2024-03-04T06:49:14.022 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16770 (ObjNum 697 snap 202 seq_num 697) dirty exists 2024-03-04T06:49:14.023 INFO:tasks.rados.rados.0.smithi137.stdout:2231: finishing write tid 1 to smithi13777483-39 2024-03-04T06:49:14.023 INFO:tasks.rados.rados.0.smithi137.stdout:2231: finishing write tid 2 to smithi13777483-39 2024-03-04T06:49:14.046 INFO:tasks.rados.rados.0.smithi137.stdout:2231: finishing write tid 3 to smithi13777483-39 2024-03-04T06:49:14.046 INFO:tasks.rados.rados.0.smithi137.stdout:2231: finishing write tid 4 to smithi13777483-39 2024-03-04T06:49:14.046 INFO:tasks.rados.rados.0.smithi137.stdout:2231: finishing write tid 5 to smithi13777483-39 2024-03-04T06:49:14.047 INFO:tasks.rados.rados.0.smithi137.stdout:2231: finishing write tid 6 to smithi13777483-39 2024-03-04T06:49:14.047 INFO:tasks.rados.rados.0.smithi137.stdout:2231: oid 39 updating version 0 to 15518 2024-03-04T06:49:14.047 INFO:tasks.rados.rados.0.smithi137.stdout:2231: oid 39 version 15518 is already newer than 15516 2024-03-04T06:49:14.047 INFO:tasks.rados.rados.0.smithi137.stdout:2231: oid 39 version 15518 is already newer than 15517 2024-03-04T06:49:14.047 INFO:tasks.rados.rados.0.smithi137.stdout:2231: oid 39 version 15518 is already newer than 15514 2024-03-04T06:49:14.048 INFO:tasks.rados.rados.0.smithi137.stdout:2231: oid 39 version 15518 is already newer than 15515 2024-03-04T06:49:14.048 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 15518 (ObjNum 716 snap 209 seq_num 716) dirty exists 2024-03-04T06:49:14.048 INFO:tasks.rados.rados.0.smithi137.stdout:2231: left oid 39 (ObjNum 716 snap 209 seq_num 716) 2024-03-04T06:49:14.281 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:13.985+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:14.281 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:13.985+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:14.281 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:13.985+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:14.281 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:13.997+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:14.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-04T06:49:14.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-mon[85573]: Upgrade: osd.6 is safe to restart 2024-03-04T06:49:14.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:14.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:14.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:14.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:14.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:14.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:14.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:14.282 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:13 smithi203 ceph-mon[85573]: osdmap e485: 8 total, 8 up, 8 in 2024-03-04T06:49:14.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:13.985+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:14.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:14.209+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:14.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:14.000+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:14.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:14.000+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:14.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:14.000+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:14.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-04T06:49:14.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[91314]: Upgrade: osd.6 is safe to restart 2024-03-04T06:49:14.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:14.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:14.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:14.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:14.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:14.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:14.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:14.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[91314]: osdmap e485: 8 total, 8 up, 8 in 2024-03-04T06:49:14.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-04T06:49:14.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[88869]: Upgrade: osd.6 is safe to restart 2024-03-04T06:49:14.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:14.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:14.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:14.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:14.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:14.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:14.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:14.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:13 smithi137 ceph-mon[88869]: osdmap e485: 8 total, 8 up, 8 in 2024-03-04T06:49:15.006 INFO:tasks.rados.rados.0.smithi137.stdout:2228: done (4 left) 2024-03-04T06:49:15.006 INFO:tasks.rados.rados.0.smithi137.stdout:2229: done (3 left) 2024-03-04T06:49:15.006 INFO:tasks.rados.rados.0.smithi137.stdout:2230: done (2 left) 2024-03-04T06:49:15.006 INFO:tasks.rados.rados.0.smithi137.stdout:2231: done (1 left) 2024-03-04T06:49:15.006 INFO:tasks.rados.rados.0.smithi137.stdout:2232: done (0 left) 2024-03-04T06:49:15.006 INFO:tasks.rados.rados.0.smithi137.stdout:2233: read oid 8 snap -1 2024-03-04T06:49:15.006 INFO:tasks.rados.rados.0.smithi137.stdout:2233: expect (ObjNum 675 snap 191 seq_num 675) 2024-03-04T06:49:15.006 INFO:tasks.rados.rados.0.smithi137.stdout:2234: read oid 29 snap 196 2024-03-04T06:49:15.007 INFO:tasks.rados.rados.0.smithi137.stdout:2234: expect (ObjNum 674 snap 191 seq_num 674) 2024-03-04T06:49:15.007 INFO:tasks.rados.rados.0.smithi137.stdout:2235: snap_create 2024-03-04T06:49:15.014 INFO:tasks.rados.rados.0.smithi137.stdout:2234: expect (ObjNum 674 snap 191 seq_num 674) 2024-03-04T06:49:15.059 INFO:tasks.rados.rados.0.smithi137.stdout:2233: expect (ObjNum 675 snap 191 seq_num 675) 2024-03-04T06:49:15.226 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:15.005+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:15.226 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:15.006+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:15.226 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:15.100+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:15.227 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:15.227 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:15.227 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:15.227 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:15.227 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:15.227 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:15.227 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:15.227 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:14 smithi203 ceph-mon[85573]: Upgrade: Updating osd.6 2024-03-04T06:49:15.227 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:14 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:15.227 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:14 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-04T06:49:15.227 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:14 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:49:15.228 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:14 smithi203 ceph-mon[85573]: pgmap v404: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 354 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 20 op/s 2024-03-04T06:49:15.228 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:14 smithi203 ceph-mon[85573]: Deploying daemon osd.6 on smithi203 2024-03-04T06:49:15.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:15.017+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:15.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:15.005+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:15.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:15.006+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:15.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:15.012+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:15.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:15.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:15.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:15.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:15.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:15.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:15.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:15.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[88869]: Upgrade: Updating osd.6 2024-03-04T06:49:15.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:15.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-04T06:49:15.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:49:15.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[88869]: pgmap v404: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 354 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 20 op/s 2024-03-04T06:49:15.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[88869]: Deploying daemon osd.6 on smithi203 2024-03-04T06:49:15.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:15.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:15.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:15.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:15.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:15.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:15.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:15.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[91314]: Upgrade: Updating osd.6 2024-03-04T06:49:15.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:15.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-04T06:49:15.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:49:15.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[91314]: pgmap v404: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 354 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 20 op/s 2024-03-04T06:49:15.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:14 smithi137 ceph-mon[91314]: Deploying daemon osd.6 on smithi203 2024-03-04T06:49:15.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:49:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:49:15] "GET /metrics HTTP/1.1" 200 36264 "" "Prometheus/2.43.0" 2024-03-04T06:49:16.005 INFO:tasks.rados.rados.0.smithi137.stdout:2233: done (2 left) 2024-03-04T06:49:16.006 INFO:tasks.rados.rados.0.smithi137.stdout:2234: done (1 left) 2024-03-04T06:49:16.006 INFO:tasks.rados.rados.0.smithi137.stdout:2235: done (0 left) 2024-03-04T06:49:16.006 INFO:tasks.rados.rados.0.smithi137.stdout:2236: snap_create 2024-03-04T06:49:16.149 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:16.008+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:16.150 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:16.008+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:16.150 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:16.008+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:16.150 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:16 smithi203 ceph-mon[85573]: osdmap e486: 8 total, 8 up, 8 in 2024-03-04T06:49:16.150 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:16.150 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:16.150 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:16.150 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:16.150 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:16.150 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:16.150 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:16.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[91314]: osdmap e486: 8 total, 8 up, 8 in 2024-03-04T06:49:16.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:16.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:16.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:16.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:16.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:16.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:16.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[88869]: osdmap e486: 8 total, 8 up, 8 in 2024-03-04T06:49:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:16.509 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:16.194+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:17.008 INFO:tasks.rados.rados.0.smithi137.stdout:2236: done (0 left) 2024-03-04T06:49:17.008 INFO:tasks.rados.rados.0.smithi137.stdout:2237: delete oid 49 current snap is 212 2024-03-04T06:49:17.016 INFO:tasks.rados.rados.0.smithi137.stdout:2237: done (0 left) 2024-03-04T06:49:17.016 INFO:tasks.rados.rados.0.smithi137.stdout:2238: delete oid 41 current snap is 212 2024-03-04T06:49:17.019 INFO:tasks.rados.rados.0.smithi137.stdout:2238: done (0 left) 2024-03-04T06:49:17.020 INFO:tasks.rados.rados.0.smithi137.stdout:2239: copy_from oid 45 from oid 18 current snap is 212 2024-03-04T06:49:17.020 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 212 2024-03-04T06:49:17.020 INFO:tasks.rados.rados.0.smithi137.stdout:2240: seq_num 719 ranges {8691712=49152} 2024-03-04T06:49:17.068 INFO:tasks.rados.rados.0.smithi137.stdout:2240: writing smithi13777483-6 from 8691712 to 8740864 tid 1 2024-03-04T06:49:17.068 INFO:tasks.rados.rados.0.smithi137.stdout:2241: copy_from oid 41 from oid 11 current snap is 212 2024-03-04T06:49:17.068 INFO:tasks.rados.rados.0.smithi137.stdout:2242: setattr oid 37 current snap is 212 2024-03-04T06:49:17.070 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 212 2024-03-04T06:49:17.070 INFO:tasks.rados.rados.0.smithi137.stdout:2243: seq_num 720 ranges {9871360=65536} 2024-03-04T06:49:17.074 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:17.015+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:17.074 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-mon[88869]: osdmap e487: 8 total, 8 up, 8 in 2024-03-04T06:49:17.074 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:17.074 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:17.074 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:17.074 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-mon[88869]: pgmap v407: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 354 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 20 op/s 2024-03-04T06:49:17.074 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-mon[88869]: osdmap e488: 8 total, 8 up, 8 in 2024-03-04T06:49:17.074 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-mon[91314]: osdmap e487: 8 total, 8 up, 8 in 2024-03-04T06:49:17.075 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:17.075 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:17.075 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:17.075 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-mon[91314]: pgmap v407: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 354 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 20 op/s 2024-03-04T06:49:17.075 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-mon[91314]: osdmap e488: 8 total, 8 up, 8 in 2024-03-04T06:49:17.075 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:16.801+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:17.075 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:16.801+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:17.075 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:16.801+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:17.075 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:17.072+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:17.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:17.009+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:17.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:17.010+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:17.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:17 smithi203 ceph-mon[85573]: osdmap e487: 8 total, 8 up, 8 in 2024-03-04T06:49:17.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:17.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:17.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:17.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:17 smithi203 ceph-mon[85573]: pgmap v407: 121 pgs: 7 active+clean+snaptrim_error, 114 active+clean; 354 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 20 op/s 2024-03-04T06:49:17.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:17 smithi203 ceph-mon[85573]: osdmap e488: 8 total, 8 up, 8 in 2024-03-04T06:49:17.097 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:17.019+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:17.124 INFO:tasks.rados.rados.0.smithi137.stdout:2243: writing smithi13777483-20 from 9871360 to 9936896 tid 1 2024-03-04T06:49:17.124 INFO:tasks.rados.rados.0.smithi137.stdout:2244: rollback oid 33 current snap is 212 2024-03-04T06:49:17.124 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 33 to 203 2024-03-04T06:49:17.124 INFO:tasks.rados.rados.0.smithi137.stdout:2239: finishing copy_from racing read to smithi13777483-45 2024-03-04T06:49:17.124 INFO:tasks.rados.rados.0.smithi137.stdout:2245: setattr oid 10 current snap is 212 2024-03-04T06:49:17.124 INFO:tasks.rados.rados.0.smithi137.stdout:2239: finishing copy_from to smithi13777483-45 2024-03-04T06:49:17.124 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16794 (ObjNum 679 snap 192 seq_num 679) dirty exists 2024-03-04T06:49:17.124 INFO:tasks.rados.rados.0.smithi137.stdout:2240: finishing write tid 1 to smithi13777483-6 2024-03-04T06:49:17.124 INFO:tasks.rados.rados.0.smithi137.stdout:2240: finishing write tid 2 to smithi13777483-6 2024-03-04T06:49:17.124 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 15512 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:49:17.124 INFO:tasks.rados.rados.0.smithi137.stdout:2240: finishing write tid 3 to smithi13777483-6 2024-03-04T06:49:17.125 INFO:tasks.rados.rados.0.smithi137.stdout:2240: oid 6 updating version 0 to 15511 2024-03-04T06:49:17.125 INFO:tasks.rados.rados.0.smithi137.stdout:2240: oid 6 version 15511 is already newer than 15510 2024-03-04T06:49:17.125 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 15511 (ObjNum 719 snap 212 seq_num 719) dirty exists 2024-03-04T06:49:17.125 INFO:tasks.rados.rados.0.smithi137.stdout:2240: left oid 6 (ObjNum 719 snap 212 seq_num 719) 2024-03-04T06:49:17.125 INFO:tasks.rados.rados.0.smithi137.stdout:2241: finishing copy_from to smithi13777483-41 2024-03-04T06:49:17.125 INFO:tasks.rados.rados.0.smithi137.stdout:2241: got expected ENOENT (src dne) 2024-03-04T06:49:17.125 INFO:tasks.rados.rados.0.smithi137.stdout:2241: finishing copy_from racing read to smithi13777483-41 2024-03-04T06:49:17.126 INFO:tasks.rados.rados.0.smithi137.stdout:2239: done (6 left) 2024-03-04T06:49:17.126 INFO:tasks.rados.rados.0.smithi137.stdout:2240: done (5 left) 2024-03-04T06:49:17.126 INFO:tasks.rados.rados.0.smithi137.stdout:2241: done (4 left) 2024-03-04T06:49:17.126 INFO:tasks.rados.rados.0.smithi137.stdout:2242: done (3 left) 2024-03-04T06:49:17.126 INFO:tasks.rados.rados.0.smithi137.stdout:2246: copy_from oid 19 from oid 40 current snap is 212 2024-03-04T06:49:17.126 INFO:tasks.rados.rados.0.smithi137.stdout:2247: rmattr oid 6 current snap is 212 2024-03-04T06:49:17.126 INFO:tasks.rados.rados.0.smithi137.stdout:2247: done (4 left) 2024-03-04T06:49:17.126 INFO:tasks.rados.rados.0.smithi137.stdout:2248: copy_from oid 31 from oid 48 current snap is 212 2024-03-04T06:49:17.126 INFO:tasks.rados.rados.0.smithi137.stdout:2249: read oid 44 snap -1 2024-03-04T06:49:17.126 INFO:tasks.rados.rados.0.smithi137.stdout:2249: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:17.126 INFO:tasks.rados.rados.0.smithi137.stdout:2250: delete oid 11 current snap is 212 2024-03-04T06:49:17.128 INFO:tasks.rados.rados.0.smithi137.stdout:2250: done (6 left) 2024-03-04T06:49:17.128 INFO:tasks.rados.rados.0.smithi137.stdout:2251: rmattr oid 37 current snap is 212 2024-03-04T06:49:17.128 INFO:tasks.rados.rados.0.smithi137.stdout:2252: delete oid 46 current snap is 212 2024-03-04T06:49:17.128 INFO:tasks.rados.rados.0.smithi137.stdout:2243: finishing write tid 1 to smithi13777483-20 2024-03-04T06:49:17.128 INFO:tasks.rados.rados.0.smithi137.stdout:2243: finishing write tid 2 to smithi13777483-20 2024-03-04T06:49:17.129 INFO:tasks.rados.rados.0.smithi137.stdout:2244: finishing rollback tid 0 to smithi13777483-33 2024-03-04T06:49:17.129 INFO:tasks.rados.rados.0.smithi137.stdout:2244: finishing rollback tid 1 to smithi13777483-33 2024-03-04T06:49:17.129 INFO:tasks.rados.rados.0.smithi137.stdout:2244: finishing rollback tid 2 to smithi13777483-33 2024-03-04T06:49:17.129 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16784 (ObjNum 596 snap 170 seq_num 596) dirty exists 2024-03-04T06:49:17.131 INFO:tasks.rados.rados.0.smithi137.stdout:2243: finishing write tid 3 to smithi13777483-20 2024-03-04T06:49:17.131 INFO:tasks.rados.rados.0.smithi137.stdout:2243: oid 20 updating version 0 to 15508 2024-03-04T06:49:17.131 INFO:tasks.rados.rados.0.smithi137.stdout:2243: oid 20 version 15508 is already newer than 15507 2024-03-04T06:49:17.131 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 15508 (ObjNum 720 snap 212 seq_num 720) dirty exists 2024-03-04T06:49:17.131 INFO:tasks.rados.rados.0.smithi137.stdout:2243: left oid 20 (ObjNum 720 snap 212 seq_num 720) 2024-03-04T06:49:17.131 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 15513 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:49:17.132 INFO:tasks.rados.rados.0.smithi137.stdout:2243: done (7 left) 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:2244: done (6 left) 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:2251: done (5 left) 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:2252: done (4 left) 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:2253: rollback oid 41 current snap is 212 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 41 to 205 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:2254: rollback oid 32 current snap is 212 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 32 to 199 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:2255: read oid 34 snap 185 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:2255: expect (ObjNum 639 snap 178 seq_num 639) 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:2256: read oid 28 snap 199 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:2256: expect (ObjNum 663 snap 187 seq_num 663) 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 212 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:2257: seq_num 723 ranges {0=114688} 2024-03-04T06:49:17.133 INFO:tasks.rados.rados.0.smithi137.stdout:2257: writing smithi13777483-9 from 0 to 114688 tid 1 2024-03-04T06:49:17.134 INFO:tasks.rados.rados.0.smithi137.stdout:2258: snap_remove snap 211 2024-03-04T06:49:17.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:17.073+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:17.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:17.077+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:17.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:17 smithi203 systemd[1]: Stopping Ceph osd.6 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:49:18.021 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[47437]: 2024-03-04T06:49:17.686+0000 7fe463b92700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:49:18.021 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[47437]: 2024-03-04T06:49:17.686+0000 7fe463b92700 -1 osd.6 488 *** Got signal Terminated *** 2024-03-04T06:49:18.022 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[47437]: 2024-03-04T06:49:17.686+0000 7fe463b92700 -1 osd.6 488 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T06:49:18.030 INFO:tasks.rados.rados.0.smithi137.stdout:2258: done (9 left) 2024-03-04T06:49:18.030 INFO:tasks.rados.rados.0.smithi137.stdout:2259: read oid 18 snap -1 2024-03-04T06:49:18.030 INFO:tasks.rados.rados.0.smithi137.stdout:2259: expect (ObjNum 679 snap 192 seq_num 679) 2024-03-04T06:49:18.030 INFO:tasks.rados.rados.0.smithi137.stdout:2260: snap_create 2024-03-04T06:49:18.030 INFO:tasks.rados.rados.0.smithi137.stdout:2253: finishing rollback tid 1 to smithi13777483-41 2024-03-04T06:49:18.030 INFO:tasks.rados.rados.0.smithi137.stdout:2246: finishing copy_from racing read to smithi13777483-19 2024-03-04T06:49:18.030 INFO:tasks.rados.rados.0.smithi137.stdout:2253: finishing rollback tid 2 to smithi13777483-41 2024-03-04T06:49:18.030 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 16796 (ObjNum 631 snap 177 seq_num 631) dirty exists 2024-03-04T06:49:18.030 INFO:tasks.rados.rados.0.smithi137.stdout:2249: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:18.172 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15513 (ObjNum 676 snap 191 seq_num 676) dirty exists 2024-03-04T06:49:18.172 INFO:tasks.rados.rados.0.smithi137.stdout:2246: finishing copy_from to smithi13777483-19 2024-03-04T06:49:18.172 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 15485 (ObjNum 33 snap 0 seq_num 3817301158) dirty exists 2024-03-04T06:49:18.172 INFO:tasks.rados.rados.0.smithi137.stdout:2254: finishing rollback tid 0 to smithi13777483-32 2024-03-04T06:49:18.172 INFO:tasks.rados.rados.0.smithi137.stdout:2254: finishing rollback tid 1 to smithi13777483-32 2024-03-04T06:49:18.172 INFO:tasks.rados.rados.0.smithi137.stdout:2254: finishing rollback tid 2 to smithi13777483-32 2024-03-04T06:49:18.172 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16836 (ObjNum 671 snap 191 seq_num 671) dirty exists 2024-03-04T06:49:18.173 INFO:tasks.rados.rados.0.smithi137.stdout:2257: finishing write tid 1 to smithi13777483-9 2024-03-04T06:49:18.173 INFO:tasks.rados.rados.0.smithi137.stdout:2255: expect (ObjNum 639 snap 178 seq_num 639) 2024-03-04T06:49:18.209 INFO:tasks.rados.rados.0.smithi137.stdout:2257: finishing write tid 2 to smithi13777483-9 2024-03-04T06:49:18.209 INFO:tasks.rados.rados.0.smithi137.stdout:2248: finishing copy_from racing read to smithi13777483-31 2024-03-04T06:49:18.209 INFO:tasks.rados.rados.0.smithi137.stdout:2257: finishing write tid 3 to smithi13777483-9 2024-03-04T06:49:18.209 INFO:tasks.rados.rados.0.smithi137.stdout:2257: oid 9 updating version 0 to 15514 2024-03-04T06:49:18.209 INFO:tasks.rados.rados.0.smithi137.stdout:2257: oid 9 updating version 15514 to 15515 2024-03-04T06:49:18.209 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 15515 (ObjNum 723 snap 212 seq_num 723) dirty exists 2024-03-04T06:49:18.209 INFO:tasks.rados.rados.0.smithi137.stdout:2257: left oid 9 (ObjNum 723 snap 212 seq_num 723) 2024-03-04T06:49:18.209 INFO:tasks.rados.rados.0.smithi137.stdout:2256: expect (ObjNum 663 snap 187 seq_num 663) 2024-03-04T06:49:18.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:18.038+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:18.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:18.045+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:18.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:18.045+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:18.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:18.038+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:18.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:18.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:18.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:18.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[88869]: osd.6 marked itself down and dead 2024-03-04T06:49:18.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:18.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:18.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:18.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:18.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:18.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:18.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:18.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:18.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:18.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:18 smithi137 ceph-mon[91314]: osd.6 marked itself down and dead 2024-03-04T06:49:18.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:18.031+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:18.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:18.032+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:18.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:18.032+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 107=[]:{f8=[f8,f7,f6,f4,f3],fe=[fe,fc,fa,f9],107=[107,105,103,102,101]} for object 5:f827495c:::smithi13777483-23:ef 2024-03-04T06:49:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:18.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:18 smithi203 ceph-mon[85573]: osd.6 marked itself down and dead 2024-03-04T06:49:18.548 INFO:tasks.rados.rados.0.smithi137.stdout:2248: finishing copy_from to smithi13777483-31 2024-03-04T06:49:18.548 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 15470 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:49:18.548 INFO:tasks.rados.rados.0.smithi137.stdout:2259: expect (ObjNum 679 snap 192 seq_num 679) 2024-03-04T06:49:18.934 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:18 smithi203 podman[99830]: 2024-03-04 06:49:18.633125993 +0000 UTC m=+1.084228119 container died f9f5bac59bb2744dac03e3f90400fb51e3f4cf4cd3a64d58f085777253a4c333 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=reef-5cc7a76) 2024-03-04T06:49:19.259 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:19.031+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:19.259 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:19.032+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:19.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:19 smithi203 ceph-mon[85573]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:49:19.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:19 smithi203 ceph-mon[85573]: osdmap e489: 8 total, 7 up, 8 in 2024-03-04T06:49:19.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:19.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:19.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:19.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:19.259 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:19.260 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:19 smithi203 ceph-mon[85573]: pgmap v410: 121 pgs: 6 peering, 14 stale+active+clean, 7 active+clean+snaptrim_error, 94 active+clean; 357 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 564 KiB/s wr, 20 op/s 2024-03-04T06:49:19.260 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:19 smithi203 podman[99830]: 2024-03-04 06:49:19.034170707 +0000 UTC m=+1.485272837 container cleanup f9f5bac59bb2744dac03e3f90400fb51e3f4cf4cd3a64d58f085777253a4c333 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, ceph=True, RELEASE=reef-5cc7a76, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-04T06:49:19.260 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:19 smithi203 bash[99830]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6 2024-03-04T06:49:19.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:19.043+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:19.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:19.033+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:19.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:19.041+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[88869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:49:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[88869]: osdmap e489: 8 total, 7 up, 8 in 2024-03-04T06:49:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:19.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[88869]: pgmap v410: 121 pgs: 6 peering, 14 stale+active+clean, 7 active+clean+snaptrim_error, 94 active+clean; 357 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 564 KiB/s wr, 20 op/s 2024-03-04T06:49:19.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[91314]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:49:19.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[91314]: osdmap e489: 8 total, 7 up, 8 in 2024-03-04T06:49:19.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:19.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:19.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:19.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:19.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:19.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:19 smithi137 ceph-mon[91314]: pgmap v410: 121 pgs: 6 peering, 14 stale+active+clean, 7 active+clean+snaptrim_error, 94 active+clean; 357 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 564 KiB/s wr, 20 op/s 2024-03-04T06:49:19.585 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:19 smithi203 podman[99858]: 2024-03-04 06:49:19.259299231 +0000 UTC m=+0.623094744 container remove f9f5bac59bb2744dac03e3f90400fb51e3f4cf4cd3a64d58f085777253a4c333 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, RELEASE=reef-5cc7a76, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:49:19.588 INFO:tasks.rados.rados.0.smithi137.stdout:2245: done (10 left) 2024-03-04T06:49:19.588 INFO:tasks.rados.rados.0.smithi137.stdout:2246: done (9 left) 2024-03-04T06:49:19.588 INFO:tasks.rados.rados.0.smithi137.stdout:2248: done (8 left) 2024-03-04T06:49:19.588 INFO:tasks.rados.rados.0.smithi137.stdout:2249: done (7 left) 2024-03-04T06:49:19.588 INFO:tasks.rados.rados.0.smithi137.stdout:2253: done (6 left) 2024-03-04T06:49:19.588 INFO:tasks.rados.rados.0.smithi137.stdout:2254: done (5 left) 2024-03-04T06:49:19.588 INFO:tasks.rados.rados.0.smithi137.stdout:2255: done (4 left) 2024-03-04T06:49:19.588 INFO:tasks.rados.rados.0.smithi137.stdout:2256: done (3 left) 2024-03-04T06:49:19.588 INFO:tasks.rados.rados.0.smithi137.stdout:2257: done (2 left) 2024-03-04T06:49:19.588 INFO:tasks.rados.rados.0.smithi137.stdout:2259: done (1 left) 2024-03-04T06:49:19.588 INFO:tasks.rados.rados.0.smithi137.stdout:2260: done (0 left) 2024-03-04T06:49:19.589 INFO:tasks.rados.rados.0.smithi137.stdout:2261: delete oid 35 current snap is 213 2024-03-04T06:49:19.590 INFO:tasks.rados.rados.0.smithi137.stdout:2261: done (0 left) 2024-03-04T06:49:19.590 INFO:tasks.rados.rados.0.smithi137.stdout:2262: snap_create 2024-03-04T06:49:19.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:19 smithi203 podman[99947]: 2024-03-04 06:49:19.585211273 +0000 UTC m=+0.103235675 container create cd71bb3a0a760a34b0f75eaa689c8ba0a372a74b42757e7f0c097ce118ed2294 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:49:19.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:19 smithi203 podman[99947]: 2024-03-04 06:49:19.500028788 +0000 UTC m=+0.018053192 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:49:19.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:19 smithi203 podman[99947]: 2024-03-04 06:49:19.829199004 +0000 UTC m=+0.347223408 container init cd71bb3a0a760a34b0f75eaa689c8ba0a372a74b42757e7f0c097ce118ed2294 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.schema-version=1.0) 2024-03-04T06:49:19.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:19 smithi203 podman[99947]: 2024-03-04 06:49:19.832416627 +0000 UTC m=+0.350441031 container start cd71bb3a0a760a34b0f75eaa689c8ba0a372a74b42757e7f0c097ce118ed2294 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-04T06:49:20.046 INFO:tasks.rados.rados.0.smithi137.stdout:2262: done (0 left) 2024-03-04T06:49:20.046 INFO:tasks.rados.rados.0.smithi137.stdout:2263: copy_from oid 2 from oid 45 current snap is 214 2024-03-04T06:49:20.046 INFO:tasks.rados.rados.0.smithi137.stdout:2264: rmattr oid 23 current snap is 214 2024-03-04T06:49:20.047 INFO:tasks.rados.rados.0.smithi137.stdout:2265: rmattr oid 38 current snap is 214 2024-03-04T06:49:20.047 INFO:tasks.rados.rados.0.smithi137.stdout:2265: done (2 left) 2024-03-04T06:49:20.047 INFO:tasks.rados.rados.0.smithi137.stdout:2266: delete oid 48 current snap is 214 2024-03-04T06:49:20.052 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 15509 (ObjNum 638 snap 178 seq_num 638) dirty exists 2024-03-04T06:49:20.052 INFO:tasks.rados.rados.0.smithi137.stdout:2264: done (2 left) 2024-03-04T06:49:20.053 INFO:tasks.rados.rados.0.smithi137.stdout:2266: done (1 left) 2024-03-04T06:49:20.053 INFO:tasks.rados.rados.0.smithi137.stdout:2267: snap_remove snap 210 2024-03-04T06:49:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-mon[88869]: osdmap e490: 8 total, 7 up, 8 in 2024-03-04T06:49:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:20.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:20.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:20.051+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-mon[91314]: osdmap e490: 8 total, 7 up, 8 in 2024-03-04T06:49:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:20.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:20.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:20.046+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:20.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:20.046+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:20 smithi203 ceph-mon[85573]: osdmap e490: 8 total, 7 up, 8 in 2024-03-04T06:49:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:20.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:20.046+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:20.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:20.046+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:20.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:20.046+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:20.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:19 smithi203 podman[99947]: 2024-03-04 06:49:19.92944899 +0000 UTC m=+0.447473396 container attach cd71bb3a0a760a34b0f75eaa689c8ba0a372a74b42757e7f0c097ce118ed2294 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-04T06:49:20.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:20 smithi203 podman[99947]: 2024-03-04 06:49:20.133434578 +0000 UTC m=+0.651458982 container died cd71bb3a0a760a34b0f75eaa689c8ba0a372a74b42757e7f0c097ce118ed2294 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-04T06:49:20.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:20.295+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:21.054 INFO:tasks.rados.rados.0.smithi137.stdout:2267: done (1 left) 2024-03-04T06:49:21.054 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 214 2024-03-04T06:49:21.054 INFO:tasks.rados.rados.0.smithi137.stdout:2263: finishing copy_from racing read to smithi13777483-2 2024-03-04T06:49:21.054 INFO:tasks.rados.rados.0.smithi137.stdout:2263: finishing copy_from to smithi13777483-2 2024-03-04T06:49:21.054 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16794 (ObjNum 679 snap 192 seq_num 679) dirty exists 2024-03-04T06:49:21.054 INFO:tasks.rados.rados.0.smithi137.stdout:2268: seq_num 726 ranges {0=163840} 2024-03-04T06:49:21.055 INFO:tasks.rados.rados.0.smithi137.stdout:2268: writing smithi13777483-22 from 0 to 163840 tid 1 2024-03-04T06:49:21.055 INFO:tasks.rados.rados.0.smithi137.stdout:2263: done (1 left) 2024-03-04T06:49:21.055 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 214 2024-03-04T06:49:21.055 INFO:tasks.rados.rados.0.smithi137.stdout:2269: seq_num 727 ranges {704512=180224} 2024-03-04T06:49:21.060 INFO:tasks.rados.rados.0.smithi137.stdout:2269: writing smithi13777483-13 from 704512 to 884736 tid 1 2024-03-04T06:49:21.060 INFO:tasks.rados.rados.0.smithi137.stdout:2270: snap_remove snap 188 2024-03-04T06:49:21.325 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:21.049+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:21.325 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:21.050+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:21.326 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-mon[85573]: osdmap e491: 8 total, 7 up, 8 in 2024-03-04T06:49:21.326 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:21.326 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:21.326 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:21.326 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:21.326 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:21.326 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-mon[85573]: pgmap v413: 121 pgs: 11 active+undersized, 4 active+undersized+degraded, 6 peering, 11 stale+active+clean, 7 active+clean+snaptrim_error, 82 active+clean; 372 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 4.2 MiB/s wr, 23 op/s; 17/738 objects degraded (2.304%) 2024-03-04T06:49:21.327 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:20 smithi203 podman[99973]: 2024-03-04 06:49:20.874868102 +0000 UTC m=+0.735701830 container remove cd71bb3a0a760a34b0f75eaa689c8ba0a372a74b42757e7f0c097ce118ed2294 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-deactivate, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS) 2024-03-04T06:49:21.327 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:20 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.6.service: Deactivated successfully. 2024-03-04T06:49:21.327 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:20 smithi203 systemd[1]: Stopped Ceph osd.6 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:49:21.327 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:20 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.6.service: Consumed 29.505s CPU time. 2024-03-04T06:49:21.327 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 systemd[1]: Starting Ceph osd.6 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:49:21.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:21.057+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:21.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:21.063+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:21.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:21.051+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:21.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[88869]: osdmap e491: 8 total, 7 up, 8 in 2024-03-04T06:49:21.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:21.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:21.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:21.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:21.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:21.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[88869]: pgmap v413: 121 pgs: 11 active+undersized, 4 active+undersized+degraded, 6 peering, 11 stale+active+clean, 7 active+clean+snaptrim_error, 82 active+clean; 372 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 4.2 MiB/s wr, 23 op/s; 17/738 objects degraded (2.304%) 2024-03-04T06:49:21.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[91314]: osdmap e491: 8 total, 7 up, 8 in 2024-03-04T06:49:21.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:21.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:21.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:21.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:21.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:21.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:21 smithi137 ceph-mon[91314]: pgmap v413: 121 pgs: 11 active+undersized, 4 active+undersized+degraded, 6 peering, 11 stale+active+clean, 7 active+clean+snaptrim_error, 82 active+clean; 372 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 4.2 MiB/s wr, 23 op/s; 17/738 objects degraded (2.304%) 2024-03-04T06:49:21.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 podman[100077]: 2024-03-04 06:49:21.32565722 +0000 UTC m=+0.115283468 container create 932a2353146e8246198010b9074642313ee64ceacd061031e92d649a30b1d387 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-activate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:49:21.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 podman[100077]: 2024-03-04 06:49:21.229043029 +0000 UTC m=+0.018669281 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:49:21.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 podman[100077]: 2024-03-04 06:49:21.520601613 +0000 UTC m=+0.310227861 container init 932a2353146e8246198010b9074642313ee64ceacd061031e92d649a30b1d387 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-activate, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-04T06:49:21.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 podman[100077]: 2024-03-04 06:49:21.524487024 +0000 UTC m=+0.314113279 container start 932a2353146e8246198010b9074642313ee64ceacd061031e92d649a30b1d387 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-04T06:49:21.964 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 podman[100077]: 2024-03-04 06:49:21.619619611 +0000 UTC m=+0.409245882 container attach 932a2353146e8246198010b9074642313ee64ceacd061031e92d649a30b1d387 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-activate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T06:49:22.057 INFO:tasks.rados.rados.0.smithi137.stdout:2270: done (2 left) 2024-03-04T06:49:22.057 INFO:tasks.rados.rados.0.smithi137.stdout:2271: setattr oid 10 current snap is 214 2024-03-04T06:49:22.058 INFO:tasks.rados.rados.0.smithi137.stdout:2268: finishing write tid 1 to smithi13777483-22 2024-03-04T06:49:22.058 INFO:tasks.rados.rados.0.smithi137.stdout:2268: finishing write tid 2 to smithi13777483-22 2024-03-04T06:49:22.058 INFO:tasks.rados.rados.0.smithi137.stdout:2268: finishing write tid 3 to smithi13777483-22 2024-03-04T06:49:22.058 INFO:tasks.rados.rados.0.smithi137.stdout:2268: oid 22 updating version 0 to 15515 2024-03-04T06:49:22.058 INFO:tasks.rados.rados.0.smithi137.stdout:2268: oid 22 version 15515 is already newer than 15514 2024-03-04T06:49:22.058 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 15515 (ObjNum 726 snap 214 seq_num 726) dirty exists 2024-03-04T06:49:22.058 INFO:tasks.rados.rados.0.smithi137.stdout:2268: left oid 22 (ObjNum 726 snap 214 seq_num 726) 2024-03-04T06:49:22.058 INFO:tasks.rados.rados.0.smithi137.stdout:2269: finishing write tid 1 to smithi13777483-13 2024-03-04T06:49:22.058 INFO:tasks.rados.rados.0.smithi137.stdout:2269: finishing write tid 2 to smithi13777483-13 2024-03-04T06:49:22.058 INFO:tasks.rados.rados.0.smithi137.stdout:2269: finishing write tid 3 to smithi13777483-13 2024-03-04T06:49:22.058 INFO:tasks.rados.rados.0.smithi137.stdout:2269: oid 13 updating version 0 to 16838 2024-03-04T06:49:22.058 INFO:tasks.rados.rados.0.smithi137.stdout:2269: oid 13 version 16838 is already newer than 16837 2024-03-04T06:49:22.059 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16838 (ObjNum 727 snap 214 seq_num 727) dirty exists 2024-03-04T06:49:22.059 INFO:tasks.rados.rados.0.smithi137.stdout:2269: left oid 13 (ObjNum 727 snap 214 seq_num 727) 2024-03-04T06:49:22.059 INFO:tasks.rados.rados.0.smithi137.stdout:2268: done (2 left) 2024-03-04T06:49:22.060 INFO:tasks.rados.rados.0.smithi137.stdout:2269: done (1 left) 2024-03-04T06:49:22.060 INFO:tasks.rados.rados.0.smithi137.stdout:2272: rmattr oid 39 current snap is 214 2024-03-04T06:49:22.060 INFO:tasks.rados.rados.0.smithi137.stdout:2273: rollback oid 7 current snap is 214 2024-03-04T06:49:22.060 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 7 to 196 2024-03-04T06:49:22.060 INFO:tasks.rados.rados.0.smithi137.stdout:2274: snap_remove snap 192 2024-03-04T06:49:22.297 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:22.056+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:22.298 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:22.056+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:22.298 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:22.056+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:22.298 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:22 smithi203 ceph-mon[85573]: Health check failed: Degraded data redundancy: 17/738 objects degraded (2.304%), 4 pgs degraded (PG_DEGRADED) 2024-03-04T06:49:22.298 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:22.298 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:22.298 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:22.298 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:22 smithi203 ceph-mon[85573]: osdmap e492: 8 total, 7 up, 8 in 2024-03-04T06:49:22.299 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:22.299 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:22.299 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-activate[100092]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-04T06:49:22.299 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-activate[100092]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-04T06:49:22.299 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 bash[100077]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-04T06:49:22.299 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 bash[100077]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-04T06:49:22.299 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 bash[100077]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-04T06:49:22.299 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 bash[100077]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-04T06:49:22.299 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 bash[100077]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-03-04T06:49:22.299 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 bash[100077]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-04T06:49:22.299 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 bash[100077]: --> ceph-volume raw activate successful for osd ID: 6 2024-03-04T06:49:22.299 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-activate[100092]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-04T06:49:22.300 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-activate[100092]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-04T06:49:22.300 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-activate[100092]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-03-04T06:49:22.300 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-activate[100092]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-04T06:49:22.300 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-activate[100092]: --> ceph-volume raw activate successful for osd ID: 6 2024-03-04T06:49:22.300 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:21 smithi203 podman[100077]: 2024-03-04 06:49:21.989184489 +0000 UTC m=+0.778810741 container died 932a2353146e8246198010b9074642313ee64ceacd061031e92d649a30b1d387 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-activate, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:49:22.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:22.066+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:22.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[91314]: Health check failed: Degraded data redundancy: 17/738 objects degraded (2.304%), 4 pgs degraded (PG_DEGRADED) 2024-03-04T06:49:22.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:22.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:22.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:22.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[91314]: osdmap e492: 8 total, 7 up, 8 in 2024-03-04T06:49:22.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:22.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:22.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:22.064+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:22.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:22.063+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:22.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:22.063+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:22.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[88869]: Health check failed: Degraded data redundancy: 17/738 objects degraded (2.304%), 4 pgs degraded (PG_DEGRADED) 2024-03-04T06:49:22.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:22.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:22.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:22.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[88869]: osdmap e492: 8 total, 7 up, 8 in 2024-03-04T06:49:22.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:22.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:23.046 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:22 smithi203 podman[100209]: 2024-03-04 06:49:22.682421157 +0000 UTC m=+0.688173018 container remove 932a2353146e8246198010b9074642313ee64ceacd061031e92d649a30b1d387 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-activate, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-04T06:49:23.046 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:22 smithi203 podman[100276]: 2024-03-04 06:49:22.800586028 +0000 UTC m=+0.017305524 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:49:23.046 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:22 smithi203 podman[100276]: 2024-03-04 06:49:22.916509104 +0000 UTC m=+0.133228604 container create ddb88aa8bce61286e4ccbd382e3e81543589529f5896abeea6663a9d7d0f5914 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240222) 2024-03-04T06:49:23.071 INFO:tasks.rados.rados.0.smithi137.stdout:2274: done (3 left) 2024-03-04T06:49:23.071 INFO:tasks.rados.rados.0.smithi137.stdout:2275: delete oid 43 current snap is 214 2024-03-04T06:49:23.072 INFO:tasks.rados.rados.0.smithi137.stdout:2273: finishing rollback tid 0 to smithi13777483-7 2024-03-04T06:49:23.072 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 15519 (ObjNum 716 snap 209 seq_num 716) dirty exists 2024-03-04T06:49:23.072 INFO:tasks.rados.rados.0.smithi137.stdout:2273: finishing rollback tid 1 to smithi13777483-7 2024-03-04T06:49:23.072 INFO:tasks.rados.rados.0.smithi137.stdout:2273: finishing rollback tid 2 to smithi13777483-7 2024-03-04T06:49:23.072 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16818 (ObjNum 620 snap 175 seq_num 620) dirty exists 2024-03-04T06:49:23.072 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15516 (ObjNum 676 snap 191 seq_num 676) dirty exists 2024-03-04T06:49:23.076 INFO:tasks.rados.rados.0.smithi137.stdout:2271: done (3 left) 2024-03-04T06:49:23.076 INFO:tasks.rados.rados.0.smithi137.stdout:2272: done (2 left) 2024-03-04T06:49:23.076 INFO:tasks.rados.rados.0.smithi137.stdout:2273: done (1 left) 2024-03-04T06:49:23.077 INFO:tasks.rados.rados.0.smithi137.stdout:2275: done (0 left) 2024-03-04T06:49:23.077 INFO:tasks.rados.rados.0.smithi137.stdout:2276: read oid 50 snap -1 2024-03-04T06:49:23.077 INFO:tasks.rados.rados.0.smithi137.stdout:2276: expect deleted 2024-03-04T06:49:23.077 INFO:tasks.rados.rados.0.smithi137.stdout:2277: rollback oid 21 current snap is 214 2024-03-04T06:49:23.077 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 21 to 212 2024-03-04T06:49:23.077 INFO:tasks.rados.rados.0.smithi137.stdout:2278: delete oid 35 current snap is 214 2024-03-04T06:49:23.080 INFO:tasks.rados.rados.0.smithi137.stdout:2277: finishing rollback tid 1 to smithi13777483-21 2024-03-04T06:49:23.080 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 16814 (ObjNum 49 snap 0 seq_num 1953066355) dirty dne 2024-03-04T06:49:23.086 INFO:tasks.rados.rados.0.smithi137.stdout:2276: done (2 left) 2024-03-04T06:49:23.086 INFO:tasks.rados.rados.0.smithi137.stdout:2277: done (1 left) 2024-03-04T06:49:23.086 INFO:tasks.rados.rados.0.smithi137.stdout:2278: done (0 left) 2024-03-04T06:49:23.086 INFO:tasks.rados.rados.0.smithi137.stdout:2279: delete oid 50 current snap is 214 2024-03-04T06:49:23.089 INFO:tasks.rados.rados.0.smithi137.stdout:2279: done (0 left) 2024-03-04T06:49:23.089 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 35 current snap is 214 2024-03-04T06:49:23.089 INFO:tasks.rados.rados.0.smithi137.stdout:2280: seq_num 731 ranges {0=245760} 2024-03-04T06:49:23.091 INFO:tasks.rados.rados.0.smithi137.stdout:2280: writing smithi13777483-35 from 0 to 245760 tid 1 2024-03-04T06:49:23.091 INFO:tasks.rados.rados.0.smithi137.stdout:2281: delete oid 17 current snap is 214 2024-03-04T06:49:23.093 INFO:tasks.rados.rados.0.smithi137.stdout:2281: done (1 left) 2024-03-04T06:49:23.093 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 214 2024-03-04T06:49:23.093 INFO:tasks.rados.rados.0.smithi137.stdout:2282: seq_num 733 ranges {3235840=278528} 2024-03-04T06:49:23.113 INFO:tasks.rados.rados.0.smithi137.stdout:2282: writing smithi13777483-3 from 3235840 to 3514368 tid 1 2024-03-04T06:49:23.113 INFO:tasks.rados.rados.0.smithi137.stdout:2283: snap_create 2024-03-04T06:49:23.113 INFO:tasks.rados.rados.0.smithi137.stdout:2280: finishing write tid 1 to smithi13777483-35 2024-03-04T06:49:23.113 INFO:tasks.rados.rados.0.smithi137.stdout:2280: finishing write tid 2 to smithi13777483-35 2024-03-04T06:49:23.113 INFO:tasks.rados.rados.0.smithi137.stdout:2280: finishing write tid 3 to smithi13777483-35 2024-03-04T06:49:23.113 INFO:tasks.rados.rados.0.smithi137.stdout:2280: oid 35 updating version 0 to 16785 2024-03-04T06:49:23.113 INFO:tasks.rados.rados.0.smithi137.stdout:2280: oid 35 updating version 16785 to 16786 2024-03-04T06:49:23.113 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16786 (ObjNum 731 snap 214 seq_num 731) dirty exists 2024-03-04T06:49:23.113 INFO:tasks.rados.rados.0.smithi137.stdout:2280: left oid 35 (ObjNum 731 snap 214 seq_num 731) 2024-03-04T06:49:23.117 INFO:tasks.rados.rados.0.smithi137.stdout:2282: finishing write tid 1 to smithi13777483-3 2024-03-04T06:49:23.117 INFO:tasks.rados.rados.0.smithi137.stdout:2282: finishing write tid 2 to smithi13777483-3 2024-03-04T06:49:23.118 INFO:tasks.rados.rados.0.smithi137.stdout:2282: finishing write tid 3 to smithi13777483-3 2024-03-04T06:49:23.119 INFO:tasks.rados.rados.0.smithi137.stdout:2282: oid 3 updating version 0 to 15517 2024-03-04T06:49:23.119 INFO:tasks.rados.rados.0.smithi137.stdout:2282: oid 3 updating version 15517 to 15518 2024-03-04T06:49:23.119 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 15518 (ObjNum 733 snap 214 seq_num 733) dirty exists 2024-03-04T06:49:23.119 INFO:tasks.rados.rados.0.smithi137.stdout:2282: left oid 3 (ObjNum 733 snap 214 seq_num 733) 2024-03-04T06:49:23.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:23.073+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:23.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:23.073+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:23 smithi203 ceph-mon[85573]: osdmap e493: 8 total, 7 up, 8 in 2024-03-04T06:49:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:23.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:23 smithi203 ceph-mon[85573]: pgmap v416: 121 pgs: 11 active+undersized, 4 active+undersized+degraded, 6 peering, 11 stale+active+clean, 7 active+clean+snaptrim_error, 82 active+clean; 372 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 3 op/s; 17/738 objects degraded (2.304%) 2024-03-04T06:49:23.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:23 smithi203 podman[100276]: 2024-03-04 06:49:23.195262712 +0000 UTC m=+0.411982224 container init ddb88aa8bce61286e4ccbd382e3e81543589529f5896abeea6663a9d7d0f5914 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.schema-version=1.0) 2024-03-04T06:49:23.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:23 smithi203 podman[100276]: 2024-03-04 06:49:23.19849349 +0000 UTC m=+0.415212986 container start ddb88aa8bce61286e4ccbd382e3e81543589529f5896abeea6663a9d7d0f5914 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:49:23.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:23 smithi203 ceph-osd[100295]: -- 172.21.15.203:0/3847503901 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fe57a87680 con 0x55fe57a50c00 2024-03-04T06:49:23.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:23 smithi203 bash[100276]: ddb88aa8bce61286e4ccbd382e3e81543589529f5896abeea6663a9d7d0f5914 2024-03-04T06:49:23.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:23 smithi203 systemd[1]: Started Ceph osd.6 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:49:23.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:23.074+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:23.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:23.070+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:23.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:23.075+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:23.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[88869]: osdmap e493: 8 total, 7 up, 8 in 2024-03-04T06:49:23.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:23.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:23.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:23.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:23.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:23.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[88869]: pgmap v416: 121 pgs: 11 active+undersized, 4 active+undersized+degraded, 6 peering, 11 stale+active+clean, 7 active+clean+snaptrim_error, 82 active+clean; 372 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 3 op/s; 17/738 objects degraded (2.304%) 2024-03-04T06:49:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[91314]: osdmap e493: 8 total, 7 up, 8 in 2024-03-04T06:49:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:23.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:23.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:23.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:23.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:23.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:23 smithi137 ceph-mon[91314]: pgmap v416: 121 pgs: 11 active+undersized, 4 active+undersized+degraded, 6 peering, 11 stale+active+clean, 7 active+clean+snaptrim_error, 82 active+clean; 372 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 3 op/s; 17/738 objects degraded (2.304%) 2024-03-04T06:49:23.610 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:49:23.922 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:49:23.922 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (9m) 100s ago 10m 26.4M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:49:23.922 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (9m) 30s ago 9m 86.4M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:49:23.922 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (11m) 100s ago 11m 18.6M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:49:23.922 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (11m) 30s ago 11m 20.5M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:49:23.922 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (5m) 30s ago 14m 450M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:49:23.922 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (5m) 100s ago 16m 506M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:49:23.922 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (4m) 100s ago 16m 53.0M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:49:23.923 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (4m) 30s ago 15m 46.8M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:49:23.923 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (4m) 100s ago 14m 46.8M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:49:23.923 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (9m) 100s ago 9m 17.3M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:49:23.923 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (9m) 30s ago 9m 15.5M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:49:23.923 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (3m) 100s ago 14m 208M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 bd2207652b33 2024-03-04T06:49:23.923 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (2m) 100s ago 13m 142M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 47b5cdaad147 2024-03-04T06:49:23.923 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (2m) 100s ago 13m 114M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 436ae07776d9 2024-03-04T06:49:23.923 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (104s) 100s ago 13m 12.7M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9acd06dda8ec 2024-03-04T06:49:23.923 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (70s) 30s ago 12m 121M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9a246a0996bd 2024-03-04T06:49:23.923 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (35s) 30s ago 12m 15.1M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9e05ca76b164 2024-03-04T06:49:23.923 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 starting - - - 2480M 2024-03-04T06:49:23.923 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (11m) 30s ago 11m 232M 2480M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:49:23.923 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (5m) 30s ago 10m 56.4M - 2.43.0 a07b618ecd1d 6a88bdd1023c 2024-03-04T06:49:24.062 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:23.738+0000 7fa0d47c57c0 -1 Falling back to public interface 2024-03-04T06:49:24.078 INFO:tasks.rados.rados.0.smithi137.stdout:2280: done (2 left) 2024-03-04T06:49:24.078 INFO:tasks.rados.rados.0.smithi137.stdout:2282: done (1 left) 2024-03-04T06:49:24.078 INFO:tasks.rados.rados.0.smithi137.stdout:2283: done (0 left) 2024-03-04T06:49:24.078 INFO:tasks.rados.rados.0.smithi137.stdout:2284: delete oid 47 current snap is 215 2024-03-04T06:49:24.083 INFO:tasks.rados.rados.0.smithi137.stdout:2284: done (0 left) 2024-03-04T06:49:24.083 INFO:tasks.rados.rados.0.smithi137.stdout:2285: copy_from oid 37 from oid 34 current snap is 215 2024-03-04T06:49:24.083 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 215 2024-03-04T06:49:24.083 INFO:tasks.rados.rados.0.smithi137.stdout:2286: seq_num 735 ranges {114688=311296} 2024-03-04T06:49:24.086 INFO:tasks.rados.rados.0.smithi137.stdout:2286: writing smithi13777483-9 from 114688 to 425984 tid 1 2024-03-04T06:49:24.086 INFO:tasks.rados.rados.0.smithi137.stdout:2287: rollback oid 27 current snap is 215 2024-03-04T06:49:24.086 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 27 to 199 2024-03-04T06:49:24.086 INFO:tasks.rados.rados.0.smithi137.stdout:2288: delete oid 28 current snap is 215 2024-03-04T06:49:24.089 INFO:tasks.rados.rados.0.smithi137.stdout:2288: done (3 left) 2024-03-04T06:49:24.089 INFO:tasks.rados.rados.0.smithi137.stdout:2289: delete oid 35 current snap is 215 2024-03-04T06:49:24.090 INFO:tasks.rados.rados.0.smithi137.stdout:2285: finishing copy_from racing read to smithi13777483-37 2024-03-04T06:49:24.091 INFO:tasks.rados.rados.0.smithi137.stdout:2285: finishing copy_from to smithi13777483-37 2024-03-04T06:49:24.091 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16778 (ObjNum 639 snap 178 seq_num 639) dirty exists 2024-03-04T06:49:24.092 INFO:tasks.rados.rados.0.smithi137.stdout:2285: done (3 left) 2024-03-04T06:49:24.092 INFO:tasks.rados.rados.0.smithi137.stdout:2289: done (2 left) 2024-03-04T06:49:24.092 INFO:tasks.rados.rados.0.smithi137.stdout:2290: snap_create 2024-03-04T06:49:24.094 INFO:tasks.rados.rados.0.smithi137.stdout:2286: finishing write tid 1 to smithi13777483-9 2024-03-04T06:49:24.095 INFO:tasks.rados.rados.0.smithi137.stdout:2287: finishing rollback tid 0 to smithi13777483-27 2024-03-04T06:49:24.095 INFO:tasks.rados.rados.0.smithi137.stdout:2287: finishing rollback tid 1 to smithi13777483-27 2024-03-04T06:49:24.096 INFO:tasks.rados.rados.0.smithi137.stdout:2286: finishing write tid 2 to smithi13777483-9 2024-03-04T06:49:24.096 INFO:tasks.rados.rados.0.smithi137.stdout:2287: finishing rollback tid 2 to smithi13777483-27 2024-03-04T06:49:24.096 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16841 (ObjNum 693 snap 199 seq_num 693) dirty exists 2024-03-04T06:49:24.097 INFO:tasks.rados.rados.0.smithi137.stdout:2286: finishing write tid 3 to smithi13777483-9 2024-03-04T06:49:24.097 INFO:tasks.rados.rados.0.smithi137.stdout:2286: oid 9 updating version 0 to 15520 2024-03-04T06:49:24.097 INFO:tasks.rados.rados.0.smithi137.stdout:2286: oid 9 version 15520 is already newer than 15519 2024-03-04T06:49:24.097 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 15520 (ObjNum 735 snap 215 seq_num 735) dirty exists 2024-03-04T06:49:24.097 INFO:tasks.rados.rados.0.smithi137.stdout:2286: left oid 9 (ObjNum 735 snap 215 seq_num 735) 2024-03-04T06:49:24.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:24.085+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:24.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:24.081+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:24.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:24.077+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:24.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:24.077+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[88869]: osdmap e494: 8 total, 7 up, 8 in 2024-03-04T06:49:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:49:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:49:24.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:24.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[91314]: osdmap e494: 8 total, 7 up, 8 in 2024-03-04T06:49:24.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:24.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:24.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:24.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:24.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:24.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:24.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:49:24.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:24.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:49:24.326 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:49:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:49:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:49:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:49:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:49:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:49:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:49:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:49:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 1, 2024-03-04T06:49:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 6 2024-03-04T06:49:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:49:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:49:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:49:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:49:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:49:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 3, 2024-03-04T06:49:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 11 2024-03-04T06:49:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:49:24.327 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:49:24.328 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:24.071+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:24.328 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:24.071+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:24.328 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:24.071+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:24.328 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:24.328 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-mon[85573]: osdmap e494: 8 total, 7 up, 8 in 2024-03-04T06:49:24.328 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:24.328 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:24.328 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset e6=[]:{e3=[e2,e0,df],e6=[e6]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:24.328 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:24.329 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:24.329 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:24.329 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:49:24.329 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:24.329 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:49:25.081 INFO:tasks.rados.rados.0.smithi137.stdout:2286: done (2 left) 2024-03-04T06:49:25.081 INFO:tasks.rados.rados.0.smithi137.stdout:2287: done (1 left) 2024-03-04T06:49:25.081 INFO:tasks.rados.rados.0.smithi137.stdout:2290: done (0 left) 2024-03-04T06:49:25.081 INFO:tasks.rados.rados.0.smithi137.stdout:2291: snap_remove snap 205 2024-03-04T06:49:25.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:25.077+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:25.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:25.077+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:25 smithi203 ceph-mon[85573]: from='client.34335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:49:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:25 smithi203 ceph-mon[85573]: from='client.34341 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:49:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:25 smithi203 ceph-mon[85573]: osdmap e495: 8 total, 7 up, 8 in 2024-03-04T06:49:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:25.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:25.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:25 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/386120455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:25.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:25 smithi203 ceph-mon[85573]: pgmap v419: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 34 active+undersized, 7 active+undersized+degraded, 5 active+clean+snaptrim_error, 73 active+clean; 385 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s wr, 11 op/s; 69/762 objects degraded (9.055%) 2024-03-04T06:49:25.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:49:25] "GET /metrics HTTP/1.1" 200 36268 "" "Prometheus/2.43.0" 2024-03-04T06:49:25.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:25.080+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[88869]: from='client.34335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:49:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[88869]: from='client.34341 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:49:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[88869]: osdmap e495: 8 total, 7 up, 8 in 2024-03-04T06:49:25.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:25.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:25.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/386120455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:25.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[88869]: pgmap v419: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 34 active+undersized, 7 active+undersized+degraded, 5 active+clean+snaptrim_error, 73 active+clean; 385 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s wr, 11 op/s; 69/762 objects degraded (9.055%) 2024-03-04T06:49:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[91314]: from='client.34335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:49:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[91314]: from='client.34341 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:49:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:25.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[91314]: osdmap e495: 8 total, 7 up, 8 in 2024-03-04T06:49:25.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:25.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:25.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/386120455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:25.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:25 smithi137 ceph-mon[91314]: pgmap v419: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 34 active+undersized, 7 active+undersized+degraded, 5 active+clean+snaptrim_error, 73 active+clean; 385 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s wr, 11 op/s; 69/762 objects degraded (9.055%) 2024-03-04T06:49:26.084 INFO:tasks.rados.rados.0.smithi137.stdout:2291: done (0 left) 2024-03-04T06:49:26.084 INFO:tasks.rados.rados.0.smithi137.stdout:2292: snap_create 2024-03-04T06:49:26.196 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:26.196 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:26.196 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:26 smithi203 ceph-mon[85573]: osdmap e496: 8 total, 7 up, 8 in 2024-03-04T06:49:26.196 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:26.196 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:26.081+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:26.197 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:26.081+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:26.197 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:26.081+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:26.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:26.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:26.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:26 smithi137 ceph-mon[88869]: osdmap e496: 8 total, 7 up, 8 in 2024-03-04T06:49:26.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:26.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:26.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:26.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:26 smithi137 ceph-mon[91314]: osdmap e496: 8 total, 7 up, 8 in 2024-03-04T06:49:26.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:26.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:26.093+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:26.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:26.093+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:26.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:26.087+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:26.545 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:26.083+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:27.085 INFO:tasks.rados.rados.0.smithi137.stdout:2292: done (0 left) 2024-03-04T06:49:27.086 INFO:tasks.rados.rados.0.smithi137.stdout:2293: snap_remove snap 185 2024-03-04T06:49:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:27 smithi203 ceph-mon[85573]: osdmap e497: 8 total, 7 up, 8 in 2024-03-04T06:49:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:27 smithi203 ceph-mon[85573]: pgmap v422: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 34 active+undersized, 7 active+undersized+degraded, 5 active+clean+snaptrim_error, 73 active+clean; 385 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s wr, 11 op/s; 69/765 objects degraded (9.020%) 2024-03-04T06:49:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:27 smithi203 ceph-mon[85573]: osdmap e498: 8 total, 7 up, 8 in 2024-03-04T06:49:27.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[88869]: osdmap e497: 8 total, 7 up, 8 in 2024-03-04T06:49:27.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:27.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:27.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:27.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:27.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:27.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[88869]: pgmap v422: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 34 active+undersized, 7 active+undersized+degraded, 5 active+clean+snaptrim_error, 73 active+clean; 385 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s wr, 11 op/s; 69/765 objects degraded (9.020%) 2024-03-04T06:49:27.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[88869]: osdmap e498: 8 total, 7 up, 8 in 2024-03-04T06:49:27.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:27.084+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[91314]: osdmap e497: 8 total, 7 up, 8 in 2024-03-04T06:49:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[91314]: pgmap v422: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 34 active+undersized, 7 active+undersized+degraded, 5 active+clean+snaptrim_error, 73 active+clean; 385 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s wr, 11 op/s; 69/765 objects degraded (9.020%) 2024-03-04T06:49:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-mon[91314]: osdmap e498: 8 total, 7 up, 8 in 2024-03-04T06:49:27.839 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:27.438+0000 7fa0d47c57c0 -1 osd.6 488 log_to_monitors true 2024-03-04T06:49:28.088 INFO:tasks.rados.rados.0.smithi137.stdout:2293: done (0 left) 2024-03-04T06:49:28.088 INFO:tasks.rados.rados.0.smithi137.stdout:2294: setattr oid 43 current snap is 217 2024-03-04T06:49:28.088 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:27.803+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:28.088 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:27.837+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:28.090 INFO:tasks.rados.rados.0.smithi137.stdout:2295: setattr oid 29 current snap is 217 2024-03-04T06:49:28.093 INFO:tasks.rados.rados.0.smithi137.stdout:2296: rmattr oid 12 current snap is 217 2024-03-04T06:49:28.093 INFO:tasks.rados.rados.0.smithi137.stdout:2296: done (2 left) 2024-03-04T06:49:28.093 INFO:tasks.rados.rados.0.smithi137.stdout:2297: read oid 3 snap -1 2024-03-04T06:49:28.094 INFO:tasks.rados.rados.0.smithi137.stdout:2297: expect (ObjNum 733 snap 214 seq_num 733) 2024-03-04T06:49:28.094 INFO:tasks.rados.rados.0.smithi137.stdout:2298: rmattr oid 23 current snap is 217 2024-03-04T06:49:28.094 INFO:tasks.rados.rados.0.smithi137.stdout:2299: read oid 31 snap 209 2024-03-04T06:49:28.094 INFO:tasks.rados.rados.0.smithi137.stdout:2299: expect (ObjNum -1164423024 snap 21906 seq_num 3130879040) 2024-03-04T06:49:28.094 INFO:tasks.rados.rados.0.smithi137.stdout:2300: rollback oid 20 current snap is 217 2024-03-04T06:49:28.095 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 20 to 203 2024-03-04T06:49:28.095 INFO:tasks.rados.rados.0.smithi137.stdout:2301: copy_from oid 47 from oid 21 current snap is 217 2024-03-04T06:49:28.095 INFO:tasks.rados.rados.0.smithi137.stdout:2302: snap_remove snap 201 2024-03-04T06:49:28.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:27.837+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:28.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:27.837+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:28.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:28.090+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:28.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:28.090+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:28.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[88869]: Health check update: Degraded data redundancy: 69/765 objects degraded (9.020%), 9 pgs degraded (PG_DEGRADED) 2024-03-04T06:49:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[88869]: from='osd.6 [v2:172.21.15.203:6816/2741919279,v1:172.21.15.203:6817/2741919279]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T06:49:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[88869]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T06:49:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[88869]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-04T06:49:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[88869]: from='osd.6 [v2:172.21.15.203:6816/2741919279,v1:172.21.15.203:6817/2741919279]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:49:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[88869]: osdmap e499: 8 total, 7 up, 8 in 2024-03-04T06:49:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[88869]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:49:28.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:28.094+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[91314]: Health check update: Degraded data redundancy: 69/765 objects degraded (9.020%), 9 pgs degraded (PG_DEGRADED) 2024-03-04T06:49:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[91314]: from='osd.6 [v2:172.21.15.203:6816/2741919279,v1:172.21.15.203:6817/2741919279]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T06:49:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[91314]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T06:49:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[91314]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-04T06:49:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[91314]: from='osd.6 [v2:172.21.15.203:6816/2741919279,v1:172.21.15.203:6817/2741919279]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:49:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[91314]: osdmap e499: 8 total, 7 up, 8 in 2024-03-04T06:49:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-mon[91314]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:49:28.546 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:28.087+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:28.556 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:28.094+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:28.556 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:28.097+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:28.556 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:28.097+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:28.556 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:28.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-mon[85573]: Health check update: Degraded data redundancy: 69/765 objects degraded (9.020%), 9 pgs degraded (PG_DEGRADED) 2024-03-04T06:49:28.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-mon[85573]: from='osd.6 [v2:172.21.15.203:6816/2741919279,v1:172.21.15.203:6817/2741919279]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T06:49:28.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-mon[85573]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T06:49:28.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:28.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:28.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:28.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-mon[85573]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-04T06:49:28.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-mon[85573]: from='osd.6 [v2:172.21.15.203:6816/2741919279,v1:172.21.15.203:6817/2741919279]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:49:28.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-mon[85573]: osdmap e499: 8 total, 7 up, 8 in 2024-03-04T06:49:28.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-mon[85573]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:49:28.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:28.555+0000 7fa0c1c15700 -1 osd.6 488 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:49:29.113 INFO:tasks.rados.rados.0.smithi137.stdout:2302: done (7 left) 2024-03-04T06:49:29.113 INFO:tasks.rados.rados.0.smithi137.stdout:2303: read oid 26 snap -1 2024-03-04T06:49:29.113 INFO:tasks.rados.rados.0.smithi137.stdout:2303: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:29.113 INFO:tasks.rados.rados.0.smithi137.stdout:2304: read oid 13 snap -1 2024-03-04T06:49:29.114 INFO:tasks.rados.rados.0.smithi137.stdout:2304: expect (ObjNum 727 snap 214 seq_num 727) 2024-03-04T06:49:29.114 INFO:tasks.rados.rados.0.smithi137.stdout:2305: rollback oid 42 current snap is 217 2024-03-04T06:49:29.114 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 42 to 207 2024-03-04T06:49:29.114 INFO:tasks.rados.rados.0.smithi137.stdout:2306: read oid 7 snap -1 2024-03-04T06:49:29.114 INFO:tasks.rados.rados.0.smithi137.stdout:2306: expect (ObjNum 620 snap 175 seq_num 620) 2024-03-04T06:49:29.114 INFO:tasks.rados.rados.0.smithi137.stdout:2307: rollback oid 6 current snap is 217 2024-03-04T06:49:29.114 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 6 to 216 2024-03-04T06:49:29.114 INFO:tasks.rados.rados.0.smithi137.stdout:2308: read oid 9 snap -1 2024-03-04T06:49:29.114 INFO:tasks.rados.rados.0.smithi137.stdout:2308: expect (ObjNum 735 snap 215 seq_num 735) 2024-03-04T06:49:29.114 INFO:tasks.rados.rados.0.smithi137.stdout:2309: setattr oid 30 current snap is 217 2024-03-04T06:49:29.115 INFO:tasks.rados.rados.0.smithi137.stdout:2301: finishing copy_from to smithi13777483-47 2024-03-04T06:49:29.115 INFO:tasks.rados.rados.0.smithi137.stdout:2301: got expected ENOENT (src dne) 2024-03-04T06:49:29.115 INFO:tasks.rados.rados.0.smithi137.stdout:2301: finishing copy_from racing read to smithi13777483-47 2024-03-04T06:49:29.115 INFO:tasks.rados.rados.0.smithi137.stdout:2299: expect (ObjNum -1164423024 snap 21906 seq_num 3130879040) 2024-03-04T06:49:29.119 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 15510 (ObjNum 638 snap 178 seq_num 638) dirty exists 2024-03-04T06:49:29.119 INFO:tasks.rados.rados.0.smithi137.stdout:2297: expect (ObjNum 733 snap 214 seq_num 733) 2024-03-04T06:49:29.296 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 851 (ObjNum 289 snap 0 seq_num 1) dirty exists 2024-03-04T06:49:29.297 INFO:tasks.rados.rados.0.smithi137.stdout:2300: finishing rollback tid 0 to smithi13777483-20 2024-03-04T06:49:29.297 INFO:tasks.rados.rados.0.smithi137.stdout:2300: finishing rollback tid 1 to smithi13777483-20 2024-03-04T06:49:29.297 INFO:tasks.rados.rados.0.smithi137.stdout:2300: finishing rollback tid 2 to smithi13777483-20 2024-03-04T06:49:29.297 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 15513 (ObjNum 568 snap 159 seq_num 568) dirty exists 2024-03-04T06:49:29.297 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16800 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-03-04T06:49:29.297 INFO:tasks.rados.rados.0.smithi137.stdout:2307: finishing rollback tid 0 to smithi13777483-6 2024-03-04T06:49:29.297 INFO:tasks.rados.rados.0.smithi137.stdout:2307: finishing rollback tid 1 to smithi13777483-6 2024-03-04T06:49:29.297 INFO:tasks.rados.rados.0.smithi137.stdout:2307: finishing rollback tid 2 to smithi13777483-6 2024-03-04T06:49:29.297 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16781 (ObjNum 719 snap 212 seq_num 719) dirty exists 2024-03-04T06:49:29.297 INFO:tasks.rados.rados.0.smithi137.stdout:2306: expect (ObjNum 620 snap 175 seq_num 620) 2024-03-04T06:49:29.384 INFO:tasks.rados.rados.0.smithi137.stdout:2308: expect (ObjNum 735 snap 215 seq_num 735) 2024-03-04T06:49:29.400 INFO:tasks.rados.rados.0.smithi137.stdout:2303: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:29.532 INFO:tasks.rados.rados.0.smithi137.stdout:2304: expect (ObjNum 727 snap 214 seq_num 727) 2024-03-04T06:49:29.543 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[106841]: 2024-03-04T06:49:29.134+0000 7f5884aa2700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:29.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:29.115+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:29.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:29.109+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:29.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:29.110+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:29.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:29.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:29.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:29.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:29.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:29.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:29.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:29.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:29.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[91314]: pgmap v425: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 34 active+undersized, 7 active+undersized+degraded, 5 active+clean+snaptrim_error, 72 active+clean; 385 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.6 MiB/s rd, 400 KiB/s wr, 9 op/s; 69/759 objects degraded (9.091%) 2024-03-04T06:49:29.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[91314]: from='osd.6 ' entity='osd.6' 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[88869]: pgmap v425: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 34 active+undersized, 7 active+undersized+degraded, 5 active+clean+snaptrim_error, 72 active+clean; 385 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.6 MiB/s rd, 400 KiB/s wr, 9 op/s; 69/759 objects degraded (9.091%) 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[88869]: from='osd.6 ' entity='osd.6' 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:29.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:29 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:29.567 INFO:tasks.rados.rados.0.smithi137.stdout:2305: finishing rollback tid 1 to smithi13777483-42 2024-03-04T06:49:29.567 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16809 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-03-04T06:49:29.567 INFO:tasks.rados.rados.0.smithi137.stdout:2294: done (13 left) 2024-03-04T06:49:29.567 INFO:tasks.rados.rados.0.smithi137.stdout:2295: done (12 left) 2024-03-04T06:49:29.567 INFO:tasks.rados.rados.0.smithi137.stdout:2297: done (11 left) 2024-03-04T06:49:29.567 INFO:tasks.rados.rados.0.smithi137.stdout:2298: done (10 left) 2024-03-04T06:49:29.567 INFO:tasks.rados.rados.0.smithi137.stdout:2299: done (9 left) 2024-03-04T06:49:29.568 INFO:tasks.rados.rados.0.smithi137.stdout:2300: done (8 left) 2024-03-04T06:49:29.568 INFO:tasks.rados.rados.0.smithi137.stdout:2301: done (7 left) 2024-03-04T06:49:29.568 INFO:tasks.rados.rados.0.smithi137.stdout:2303: done (6 left) 2024-03-04T06:49:29.568 INFO:tasks.rados.rados.0.smithi137.stdout:2304: done (5 left) 2024-03-04T06:49:29.568 INFO:tasks.rados.rados.0.smithi137.stdout:2305: done (4 left) 2024-03-04T06:49:29.568 INFO:tasks.rados.rados.0.smithi137.stdout:2306: done (3 left) 2024-03-04T06:49:29.568 INFO:tasks.rados.rados.0.smithi137.stdout:2307: done (2 left) 2024-03-04T06:49:29.568 INFO:tasks.rados.rados.0.smithi137.stdout:2308: done (1 left) 2024-03-04T06:49:29.568 INFO:tasks.rados.rados.0.smithi137.stdout:2310: snap_create 2024-03-04T06:49:29.568 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16771 (ObjNum 697 snap 202 seq_num 697) dirty exists 2024-03-04T06:49:29.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:29.102+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:29.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:29.104+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:29.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:29.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:29.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:29.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:29.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:29.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:29.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:29.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:29.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-mon[85573]: pgmap v425: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 34 active+undersized, 7 active+undersized+degraded, 5 active+clean+snaptrim_error, 72 active+clean; 385 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.6 MiB/s rd, 400 KiB/s wr, 9 op/s; 69/759 objects degraded (9.091%) 2024-03-04T06:49:29.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-mon[85573]: from='osd.6 ' entity='osd.6' 2024-03-04T06:49:29.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:29.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:29 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:30.106 INFO:tasks.rados.rados.0.smithi137.stdout:2309: done (1 left) 2024-03-04T06:49:30.106 INFO:tasks.rados.rados.0.smithi137.stdout:2310: done (0 left) 2024-03-04T06:49:30.106 INFO:tasks.rados.rados.0.smithi137.stdout:2311: snap_create 2024-03-04T06:49:30.268 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:30.239+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:30.268 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:30.112+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:30.268 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:30.112+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:30.268 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:30.113+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:30.269 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-mon[85573]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:49:30.269 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:30.269 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:30.269 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:30.270 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-mon[85573]: osd.6 [v2:172.21.15.203:6816/2741919279,v1:172.21.15.203:6817/2741919279] boot 2024-03-04T06:49:30.270 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-mon[85573]: osdmap e500: 8 total, 8 up, 8 in 2024-03-04T06:49:30.270 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:30.270 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:49:30.270 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:30.271 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.166+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.271 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.173+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.271 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.177+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.271 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.181+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.271 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.185+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.271 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.189+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.271 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.193+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.271 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.197+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.272 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.201+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.272 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.205+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.272 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.208+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.272 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.212+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.272 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.216+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.272 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.219+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.272 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.223+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.272 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.227+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.273 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.231+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.273 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.235+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.273 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.238+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.273 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.242+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.273 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.246+0000 7fa0af3f0700 -1 osd.6 pg_epoch: 501 pg[5.9s1( v 495'943 (0'0,495'943] local-lis/les=500/501 n=10 ec=72/72 lis/c=500/500 les/c/f=501/501/0 sis=500) [7,6,1]p7(0) r=1 lpr=500 luod=0'0 crt=495'943 mlcod 0'0 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4f,f4~2,f7~3,fb~3,ff~2,104~1,106~1]] update_snap_map remove_oid 5:9c196b24:::smithi13777483-31:f5 failed with -2 2024-03-04T06:49:30.273 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.246+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.274 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.251+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.274 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.252+0000 7fa0ab3e8700 -1 osd.6 pg_epoch: 501 pg[5.9s1( v 501'949 (0'0,501'949] local-lis/les=500/501 n=9 ec=72/72 lis/c=500/500 les/c/f=501/501/0 sis=500) [7,6,1]p7(0) r=1 lpr=500 luod=0'0 crt=501'947 mlcod 501'947 active mbc={} ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~4f,f4~2,f7~3,fb~3,ff~2,104~1,106~1]] update_snap_map remove_oid 5:9bf0d325:::smithi13777483-35:f8 failed with -2 2024-03-04T06:49:30.274 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.256+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.274 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.260+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.274 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.263+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.274 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.267+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.520 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.270+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.520 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.274+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.520 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.277+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.520 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.281+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.520 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.285+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.289+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.292+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.296+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.299+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.303+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.306+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.309+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.313+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.316+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.319+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.323+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.326+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.522 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.329+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.522 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.333+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.522 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.337+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.522 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.340+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.522 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.343+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.522 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.346+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.522 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.350+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.353+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.357+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.360+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.364+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.367+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.370+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.374+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.377+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.380+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.383+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.387+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.390+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.394+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.523 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.397+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.401+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.404+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.407+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.411+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.415+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.418+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.422+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.425+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.429+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.432+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.435+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.439+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.443+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.524 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.446+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.525 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.449+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.525 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.453+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.525 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.457+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.525 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.460+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.525 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.464+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.525 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.468+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.525 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.471+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.525 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.475+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.525 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.479+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.525 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.482+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.525 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.486+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.525 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.489+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.525 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.493+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.526 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.497+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.526 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.500+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.526 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.508+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.526 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.511+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.526 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.515+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.526 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.518+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:30.104+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:30.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:30.108+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:30.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:30.109+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:30.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:30.109+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:30.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:30.124+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[88869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:49:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[88869]: osd.6 [v2:172.21.15.203:6816/2741919279,v1:172.21.15.203:6817/2741919279] boot 2024-03-04T06:49:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[88869]: osdmap e500: 8 total, 8 up, 8 in 2024-03-04T06:49:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:49:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[91314]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:49:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[91314]: osd.6 [v2:172.21.15.203:6816/2741919279,v1:172.21.15.203:6817/2741919279] boot 2024-03-04T06:49:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[91314]: osdmap e500: 8 total, 8 up, 8 in 2024-03-04T06:49:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T06:49:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:30.773 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.522+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.774 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.526+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.774 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.529+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.774 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.533+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.774 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.536+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.774 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.540+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.774 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.543+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.774 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.547+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.774 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.551+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.774 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.555+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.774 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.559+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.774 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.562+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.774 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.566+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.775 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.570+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.775 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.573+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.775 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.576+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.775 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.580+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.775 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.584+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.776 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.588+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.776 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.592+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.776 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.595+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.776 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.599+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.776 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.603+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.776 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.607+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.776 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.610+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.776 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.614+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.776 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.617+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.776 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.621+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.776 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.624+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.776 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.628+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.776 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.632+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.777 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.635+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.777 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.639+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.777 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.642+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.777 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.646+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.777 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.650+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.777 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.653+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.777 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.657+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.777 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.660+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.777 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.664+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.777 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.667+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.777 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.671+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.777 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.674+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.679+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.682+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.686+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.689+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.693+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.697+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.701+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.704+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.708+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.712+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.715+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.719+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.723+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.727+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.730+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.734+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.737+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.741+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.745+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.749+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.752+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.756+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.760+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.764+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.768+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:30.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.772+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.026 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.776+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.027 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.780+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.027 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.783+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.027 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.787+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.027 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.791+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.027 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.795+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.027 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.798+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.027 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.802+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.027 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.805+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.027 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.809+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.027 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.813+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.027 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.817+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.028 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.821+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.028 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.824+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.028 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.828+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.028 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.832+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.028 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.835+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.839+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.842+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.846+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.850+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.853+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.857+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.861+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.864+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.868+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.871+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.875+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.879+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.883+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.886+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.890+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.894+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.898+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.902+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.906+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.910+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.913+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.917+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.921+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.926+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.929+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.933+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.937+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.941+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.945+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.948+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.952+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.956+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.959+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.963+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.967+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.971+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.975+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.979+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.982+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.032 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.986+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.032 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.989+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.032 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.993+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.032 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:30.997+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.032 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.001+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.032 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.005+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.032 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.008+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.032 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.013+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.032 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.017+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.032 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.021+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.032 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.025+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.105 INFO:tasks.rados.rados.0.smithi137.stdout:2311: done (0 left) 2024-03-04T06:49:31.105 INFO:tasks.rados.rados.0.smithi137.stdout:2312: snap_remove snap 207 2024-03-04T06:49:31.279 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:31.103+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:31.279 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:31.103+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:31.279 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-mon[85573]: osdmap e501: 8 total, 8 up, 8 in 2024-03-04T06:49:31.279 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:31.280 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:31.280 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:31.280 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:31.280 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:31.280 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:31.280 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:31.280 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-mon[85573]: pgmap v428: 121 pgs: 12 peering, 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 24 active+undersized, 5 active+undersized+degraded, 5 active+clean+snaptrim_error, 72 active+clean; 375 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 4.3 MiB/s rd, 400 KiB/s wr, 9 op/s; 56/753 objects degraded (7.437%) 2024-03-04T06:49:31.280 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-mon[85573]: osdmap e502: 8 total, 8 up, 8 in 2024-03-04T06:49:31.281 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.029+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.281 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.033+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.281 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.037+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.281 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.041+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.281 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.044+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.281 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.048+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.281 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.052+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.056+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.060+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.064+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.068+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.072+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.076+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.080+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.084+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.088+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.092+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.096+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.100+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.106+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.110+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.116+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.282 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.122+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.126+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.130+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.134+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.138+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.142+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.145+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.149+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.153+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.157+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.161+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.165+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.169+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.172+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.178+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.283 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.182+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.187+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.191+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.195+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.200+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.204+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.209+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.213+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.216+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.220+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.224+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.228+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.233+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.238+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.243+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.284 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.248+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.285 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.253+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.285 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.258+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.285 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.263+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.285 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.268+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.285 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.273+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.285 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.278+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.532 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.283+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.532 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.287+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.532 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.291+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.532 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.295+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.532 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.299+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.532 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.302+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.532 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.307+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.532 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.311+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.533 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.315+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.533 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.319+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.533 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.323+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.533 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.328+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.533 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.332+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.533 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.336+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.533 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.340+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.533 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.344+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.533 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.349+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.534 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.353+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.534 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.357+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.534 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.361+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.534 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.365+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.534 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.369+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.534 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.373+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.377+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.381+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.385+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.389+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.393+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.397+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.401+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.406+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.410+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.415+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.419+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.423+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.427+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.430+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.434+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.439+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.443+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.447+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.450+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.454+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.458+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.462+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.466+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.470+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.474+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.478+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.482+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.486+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.490+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.494+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.499+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.503+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.507+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.511+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.515+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.521+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.526+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.538 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.530+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:31.104+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:31.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[91314]: osdmap e501: 8 total, 8 up, 8 in 2024-03-04T06:49:31.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:31.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:31.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:31.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:31.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:31.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[91314]: pgmap v428: 121 pgs: 12 peering, 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 24 active+undersized, 5 active+undersized+degraded, 5 active+clean+snaptrim_error, 72 active+clean; 375 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 4.3 MiB/s rd, 400 KiB/s wr, 9 op/s; 56/753 objects degraded (7.437%) 2024-03-04T06:49:31.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[91314]: osdmap e502: 8 total, 8 up, 8 in 2024-03-04T06:49:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[88869]: osdmap e501: 8 total, 8 up, 8 in 2024-03-04T06:49:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:31.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:31.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[88869]: pgmap v428: 121 pgs: 12 peering, 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 24 active+undersized, 5 active+undersized+degraded, 5 active+clean+snaptrim_error, 72 active+clean; 375 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 4.3 MiB/s rd, 400 KiB/s wr, 9 op/s; 56/753 objects degraded (7.437%) 2024-03-04T06:49:31.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-mon[88869]: osdmap e502: 8 total, 8 up, 8 in 2024-03-04T06:49:31.785 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.534+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.785 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.538+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.786 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.543+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.786 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.547+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.786 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.552+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.786 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.557+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.786 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.561+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.786 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.565+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.786 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.569+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.786 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.574+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.786 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.578+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.786 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.582+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.787 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.586+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.787 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.590+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.787 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.594+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.787 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.598+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.787 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.602+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.788 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.607+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.788 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.611+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.788 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.615+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.788 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.619+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.788 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.624+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.788 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.628+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.788 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.632+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.788 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.638+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.788 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.642+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.788 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.647+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.789 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.651+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.789 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.657+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.789 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.661+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.789 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.666+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.789 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.670+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.789 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.677+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.789 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.682+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.789 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.686+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.789 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.691+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.789 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.696+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.789 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.701+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.789 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.705+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.790 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.709+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.790 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.713+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.790 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.718+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.790 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.723+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.790 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.727+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.790 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.731+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.790 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.736+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.790 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.741+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.790 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.746+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.790 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.750+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.790 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.755+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.790 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.760+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.790 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.764+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.791 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.769+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.791 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.774+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.791 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.778+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:31.791 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.783+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.002 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:31.745+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:32.038 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:32.004+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:32.038 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.789+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.038 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.794+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.038 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.799+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.038 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.804+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.038 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.811+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.039 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.817+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.039 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.822+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.039 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.828+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.039 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.834+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.039 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.840+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.039 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.846+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.039 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.851+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.039 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.856+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.039 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.862+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.039 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.868+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.039 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.874+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.040 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.880+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.040 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.886+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.040 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.891+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.040 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.898+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.040 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.903+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.040 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.909+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.041 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.915+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.041 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.921+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.041 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.928+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.041 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.935+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.041 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.941+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.041 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.946+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.041 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.951+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.041 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.956+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.041 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.962+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.041 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.968+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.042 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.974+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.042 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.980+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.042 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.986+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.042 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.992+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.042 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:31.997+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.042 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.005+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.042 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.012+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.042 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.019+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.042 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.025+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.042 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.030+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.042 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.037+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.106 INFO:tasks.rados.rados.0.smithi137.stdout:2312: done (0 left) 2024-03-04T06:49:32.106 INFO:tasks.rados.rados.0.smithi137.stdout:2313: rmattr oid 25 current snap is 219 2024-03-04T06:49:32.106 INFO:tasks.rados.rados.0.smithi137.stdout:2314: read oid 26 snap -1 2024-03-04T06:49:32.106 INFO:tasks.rados.rados.0.smithi137.stdout:2314: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:32.106 INFO:tasks.rados.rados.0.smithi137.stdout:2315: delete oid 30 current snap is 219 2024-03-04T06:49:32.118 INFO:tasks.rados.rados.0.smithi137.stdout:2315: done (2 left) 2024-03-04T06:49:32.118 INFO:tasks.rados.rados.0.smithi137.stdout:2316: rollback oid 50 current snap is 219 2024-03-04T06:49:32.118 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 50 to 199 2024-03-04T06:49:32.118 INFO:tasks.rados.rados.0.smithi137.stdout:2317: snap_remove snap 215 2024-03-04T06:49:32.290 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:32.108+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:32.290 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:32.108+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:32.290 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:32.108+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:32.290 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:32.290 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:32.290 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:32.291 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:32.291 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-mon[85573]: osdmap e503: 8 total, 8 up, 8 in 2024-03-04T06:49:32.291 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:32.291 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:32.291 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:32.116+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:32.292 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.044+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.292 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.049+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.292 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.055+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.292 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.061+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.292 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.067+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.292 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.073+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.292 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.078+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.292 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.083+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.292 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.089+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.292 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.095+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.293 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.101+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.293 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.124+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.293 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.133+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.293 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.140+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.293 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.145+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.293 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.150+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.293 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.157+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.293 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.163+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.293 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.170+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.293 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.176+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.293 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.183+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.293 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.189+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.293 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.195+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.294 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.201+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.294 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.207+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.294 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.213+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.294 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.220+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.294 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.226+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.294 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.232+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.294 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.239+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.294 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.246+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.294 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.252+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.294 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.258+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.294 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.264+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.294 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.270+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.295 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.276+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.295 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.283+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.295 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.289+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.295 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:32.105+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:32.296 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:32.112+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:32.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:32.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:32.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:32.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:32.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[88869]: osdmap e503: 8 total, 8 up, 8 in 2024-03-04T06:49:32.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:32.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:32.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:32.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:32.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:32.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:32.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[91314]: osdmap e503: 8 total, 8 up, 8 in 2024-03-04T06:49:32.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:32.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:32.297 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:32.000+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:32.298 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:32.001+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:32.298 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:32.117+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:32.298 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:32.117+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:32.298 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:32.117+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:32.544 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.296+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.544 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.303+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.544 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.309+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.545 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.316+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.545 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.322+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.545 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.328+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.545 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.336+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.545 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.342+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.545 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.348+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.545 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.354+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.545 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.359+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.545 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.365+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.545 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.371+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.545 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.378+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.545 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.384+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.545 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.390+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.546 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.396+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.546 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.401+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.546 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.407+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.546 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.412+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.546 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.418+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.546 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.425+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.431+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.437+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.444+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.450+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.456+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.463+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.469+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.475+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.481+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.487+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.493+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.499+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.506+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.548 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.511+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.548 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.518+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.548 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.524+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.548 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.530+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.548 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.537+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.548 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.543+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.798 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.550+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.556+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.562+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.568+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.574+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.580+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.586+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.592+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.598+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.603+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.609+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.615+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.621+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.627+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.800 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.633+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.800 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.639+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.800 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.645+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.800 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.651+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.800 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.657+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.800 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.663+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.800 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.669+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.800 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.676+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.800 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.683+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.800 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.689+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.800 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.695+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.800 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.701+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.801 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.708+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.801 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.715+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.801 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.723+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.801 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.729+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.801 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.735+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.801 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.742+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.801 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.748+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.801 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.755+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.801 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.763+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.801 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.770+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.801 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.776+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.801 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.782+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.801 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.787+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.802 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.792+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:32.802 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.797+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.803+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.808+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.052 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.814+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.052 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.819+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.052 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.825+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.052 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.830+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.052 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.835+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.052 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.840+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.052 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.845+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.052 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.851+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.052 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.856+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.052 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.862+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.052 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.867+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.052 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.873+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.053 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.879+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.053 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.884+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.053 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.890+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.053 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.895+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.053 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.902+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.053 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.907+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.053 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.912+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.053 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.917+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.053 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.923+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.053 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.928+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.053 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.934+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.053 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.939+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.944+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.949+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.955+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.960+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.965+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.971+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.976+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.981+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.987+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.992+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:32.997+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.004+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.055 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.012+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.055 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.019+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.055 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.025+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.055 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.030+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.055 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.036+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.055 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.040+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.055 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.045+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.055 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.050+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.131 INFO:tasks.rados.rados.0.smithi137.stdout:2317: done (3 left) 2024-03-04T06:49:33.131 INFO:tasks.rados.rados.0.smithi137.stdout:2318: copy_from oid 11 from oid 48 current snap is 219 2024-03-04T06:49:33.131 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 16817 (ObjNum 544 snap 155 seq_num 544) dirty exists 2024-03-04T06:49:33.131 INFO:tasks.rados.rados.0.smithi137.stdout:2314: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:33.277 INFO:tasks.rados.rados.0.smithi137.stdout:2316: finishing rollback tid 1 to smithi13777483-50 2024-03-04T06:49:33.277 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 0 (ObjNum 65 snap 0 seq_num 1718570593) dirty dne 2024-03-04T06:49:33.277 INFO:tasks.rados.rados.0.smithi137.stdout:2318: finishing copy_from to smithi13777483-11 2024-03-04T06:49:33.278 INFO:tasks.rados.rados.0.smithi137.stdout:2318: got expected ENOENT (src dne) 2024-03-04T06:49:33.278 INFO:tasks.rados.rados.0.smithi137.stdout:2318: finishing copy_from racing read to smithi13777483-11 2024-03-04T06:49:33.278 INFO:tasks.rados.rados.0.smithi137.stdout:2313: done (3 left) 2024-03-04T06:49:33.278 INFO:tasks.rados.rados.0.smithi137.stdout:2314: done (2 left) 2024-03-04T06:49:33.278 INFO:tasks.rados.rados.0.smithi137.stdout:2316: done (1 left) 2024-03-04T06:49:33.278 INFO:tasks.rados.rados.0.smithi137.stdout:2318: done (0 left) 2024-03-04T06:49:33.278 INFO:tasks.rados.rados.0.smithi137.stdout:2319: read oid 14 snap -1 2024-03-04T06:49:33.278 INFO:tasks.rados.rados.0.smithi137.stdout:2319: expect deleted 2024-03-04T06:49:33.278 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 219 2024-03-04T06:49:33.278 INFO:tasks.rados.rados.0.smithi137.stdout:2320: seq_num 739 ranges {2719744=385024} 2024-03-04T06:49:33.294 INFO:tasks.rados.rados.0.smithi137.stdout:2320: writing smithi13777483-10 from 2719744 to 3104768 tid 1 2024-03-04T06:49:33.294 INFO:tasks.rados.rados.0.smithi137.stdout:2321: snap_remove snap 206 2024-03-04T06:49:33.304 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:33.140+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:33.304 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:33.305 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:33.305 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:33.305 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:33.305 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:33.305 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:33.305 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:33.305 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:33.305 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-mon[85573]: pgmap v431: 121 pgs: 12 peering, 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 24 active+undersized, 5 active+undersized+degraded, 5 active+clean+snaptrim_error, 72 active+clean; 375 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 0 op/s; 56/753 objects degraded (7.437%) 2024-03-04T06:49:33.305 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:33.129+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:33.306 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:33.131+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:33.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.056+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.061+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.066+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.071+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.076+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.082+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.087+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.093+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.098+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.103+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.110+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.116+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.124+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.136+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.144+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.150+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.308 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.156+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.308 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.162+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.308 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.167+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.308 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.173+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.308 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.179+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.308 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.184+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.308 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.191+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.308 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.196+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.308 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.201+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.308 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.207+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.308 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.213+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.309 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.218+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.309 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.224+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.309 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.230+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.309 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.235+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.309 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.241+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.309 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.247+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.309 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.252+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.309 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.259+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.309 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.265+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.309 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.271+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.309 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.277+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.310 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.282+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.310 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.288+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.310 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.293+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.310 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.298+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.310 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.304+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:33.129+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:33.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:33.137+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:33.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:33.138+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:33.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:33.138+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:33.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:33.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:33.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:33.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[91314]: pgmap v431: 121 pgs: 12 peering, 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 24 active+undersized, 5 active+undersized+degraded, 5 active+clean+snaptrim_error, 72 active+clean; 375 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 0 op/s; 56/753 objects degraded (7.437%) 2024-03-04T06:49:33.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:33.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:33.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:33.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:33.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:33.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:33.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:33.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:33.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-mon[88869]: pgmap v431: 121 pgs: 12 peering, 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 24 active+undersized, 5 active+undersized+degraded, 5 active+clean+snaptrim_error, 72 active+clean; 375 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 0 op/s; 56/753 objects degraded (7.437%) 2024-03-04T06:49:33.559 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.310+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.559 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.316+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.559 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.321+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.560 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.326+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.560 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.331+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.560 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.336+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.560 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.341+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.560 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.348+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.560 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.353+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.560 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.359+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.560 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.364+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.560 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.369+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.560 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.374+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.560 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.379+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.561 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.384+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.561 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.389+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.561 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.394+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.561 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.400+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.561 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.404+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.561 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.410+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.562 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.415+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.562 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.420+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.562 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.425+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.562 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.430+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.562 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.435+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.562 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.441+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.562 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.446+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.562 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.451+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.562 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.456+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.562 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.461+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.562 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.466+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.562 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.472+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.562 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.477+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.482+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.487+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.493+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.499+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.505+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.511+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.516+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.521+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.527+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.532+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.537+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.542+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.548+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.563 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.553+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.564 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.559+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.812 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.564+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.812 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.569+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.812 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.574+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.812 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.580+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.812 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.585+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.812 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.591+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.812 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.596+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.812 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.601+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.813 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.607+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.813 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.612+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.813 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.617+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.813 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.622+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.813 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.627+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.813 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.633+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.813 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.638+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.813 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.643+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.813 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.649+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.814 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.654+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.814 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.659+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.814 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.664+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.814 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.670+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.814 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.676+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.814 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.681+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.814 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.686+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.814 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.691+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.815 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.698+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.815 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.706+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.815 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.713+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.815 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.721+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.815 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.728+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.815 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.734+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.815 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.740+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.815 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.746+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.815 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.751+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.815 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.756+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.815 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.761+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.816 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.768+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.816 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.775+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.816 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.783+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.816 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.788+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.816 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.794+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.816 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.800+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.816 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.805+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:33.816 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.811+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.064 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.817+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.064 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.824+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.065 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.830+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.065 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.837+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.065 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.844+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.065 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.850+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.065 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.855+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.065 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.861+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.065 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.866+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.065 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.871+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.065 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.877+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.065 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.882+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.065 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.887+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.065 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.893+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.066 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.899+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.066 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.904+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.066 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.910+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.066 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.915+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.066 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.920+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.066 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.926+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.066 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.931+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.067 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.937+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.067 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.942+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.067 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.948+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.067 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.953+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.067 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.959+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.067 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.964+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.067 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.970+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.067 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.975+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.067 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.980+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.067 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.986+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.067 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.992+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.067 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:33.998+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.068 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.003+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.068 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.009+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.068 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.014+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.068 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.020+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.068 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.025+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.068 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.030+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.068 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.036+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.068 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.041+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.068 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.047+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.068 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.052+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.068 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.058+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.068 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.063+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.137 INFO:tasks.rados.rados.0.smithi137.stdout:2321: done (2 left) 2024-03-04T06:49:34.137 INFO:tasks.rados.rados.0.smithi137.stdout:2322: read oid 27 snap -1 2024-03-04T06:49:34.137 INFO:tasks.rados.rados.0.smithi137.stdout:2322: expect (ObjNum 693 snap 199 seq_num 693) 2024-03-04T06:49:34.137 INFO:tasks.rados.rados.0.smithi137.stdout:2323: snap_remove snap 196 2024-03-04T06:49:34.147 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:49:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T06:49:33.889+0000 7fca9a02c700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-04T06:49:34.147 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:34.136+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:34.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:34.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:34.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: osdmap e504: 8 total, 8 up, 8 in 2024-03-04T06:49:34.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:34.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:34.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:34.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:34.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:34.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:34.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:34.148 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:49:34.149 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:49:34.149 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:34.149 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:49:34.149 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:34.149 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:34.149 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:34.149 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-04T06:49:34.149 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:34.149 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:34.149 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: osdmap e504: 8 total, 8 up, 8 in 2024-03-04T06:49:34.150 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:34.150 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:34.150 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:34.150 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:34.150 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:34.150 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:34.150 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:34.150 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:49:34.150 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:49:34.150 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:34.150 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:49:34.150 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:34.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:34.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:34.151 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-04T06:49:34.320 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:34.144+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:34.320 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:34.137+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:34.320 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:34.137+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:34.320 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:34.138+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: osdmap e504: 8 total, 8 up, 8 in 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:34.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:49:34.322 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:34.322 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:34.322 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:34.322 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-04T06:49:34.322 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.070+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.322 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.075+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.081+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.086+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.092+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.097+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.103+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.108+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.114+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.120+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.126+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.133+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.148+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.158+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.165+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.174+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.323 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.180+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.186+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.191+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.197+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.203+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.208+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.213+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.219+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.224+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.229+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.235+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.240+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.246+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.251+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.258+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.324 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.263+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.325 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.269+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.325 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.274+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.325 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.280+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.325 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.285+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.325 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.291+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.325 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.296+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.325 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.302+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.325 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.307+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.325 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.313+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.325 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.319+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:34.150+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:34.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:34.150+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:34.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:34.151+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:34.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:34.146+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:34.572 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.326+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.573 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.332+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.573 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.338+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.573 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.344+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.573 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.349+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.573 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.355+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.573 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.360+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.573 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.366+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.573 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.371+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.573 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.377+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.573 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.383+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.573 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.389+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.573 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.395+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.573 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.400+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.407+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.413+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.418+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.424+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.429+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.435+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.441+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.447+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.452+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.461+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.468+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.474+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.479+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.485+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.491+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.497+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.503+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.509+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.515+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.520+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.526+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.532+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.537+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.543+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.549+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.555+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.560+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.566+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.571+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.825 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.578+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.825 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.584+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.825 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.590+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.825 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.595+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.825 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.601+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.825 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.607+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.825 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.613+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.825 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.618+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.825 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.624+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.825 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.629+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.826 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.635+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.826 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.641+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.826 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.646+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.826 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.652+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.826 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.659+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.826 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.664+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.826 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.670+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.827 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.676+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.827 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.681+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.827 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.687+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.827 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.693+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.827 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.699+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.827 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.705+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.827 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.710+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.827 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.716+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.827 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.722+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.827 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.728+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.827 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.734+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.827 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.740+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.828 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.746+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.828 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.753+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.828 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.759+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.828 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.765+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.828 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.771+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.828 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.777+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.828 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.783+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.828 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.789+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.828 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.795+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.828 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.801+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.828 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.807+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.828 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.813+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.828 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.818+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:34.829 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.824+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.831+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.837+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.843+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.848+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.854+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.860+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.866+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.872+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.878+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.884+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.891+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.898+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.904+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.910+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.916+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.922+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.928+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.077 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.934+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.940+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.946+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.952+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.958+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.965+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.971+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.978+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.984+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.990+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:34.996+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.002+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.008+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.014+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.020+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.079 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.026+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.079 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.032+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.079 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.039+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.079 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.045+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.079 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.051+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.079 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.057+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.079 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.063+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.079 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.069+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.079 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.075+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.150 INFO:tasks.rados.rados.0.smithi137.stdout:2323: done (3 left) 2024-03-04T06:49:35.150 INFO:tasks.rados.rados.0.smithi137.stdout:2324: copy_from oid 24 from oid 34 current snap is 219 2024-03-04T06:49:35.150 INFO:tasks.rados.rados.0.smithi137.stdout:2320: finishing write tid 1 to smithi13777483-10 2024-03-04T06:49:35.150 INFO:tasks.rados.rados.0.smithi137.stdout:2320: finishing write tid 2 to smithi13777483-10 2024-03-04T06:49:35.150 INFO:tasks.rados.rados.0.smithi137.stdout:2320: finishing write tid 3 to smithi13777483-10 2024-03-04T06:49:35.150 INFO:tasks.rados.rados.0.smithi137.stdout:2320: oid 10 updating version 0 to 15522 2024-03-04T06:49:35.150 INFO:tasks.rados.rados.0.smithi137.stdout:2320: oid 10 version 15522 is already newer than 15521 2024-03-04T06:49:35.150 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15522 (ObjNum 739 snap 219 seq_num 739) dirty exists 2024-03-04T06:49:35.150 INFO:tasks.rados.rados.0.smithi137.stdout:2320: left oid 10 (ObjNum 739 snap 219 seq_num 739) 2024-03-04T06:49:35.150 INFO:tasks.rados.rados.0.smithi137.stdout:2322: expect (ObjNum 693 snap 199 seq_num 693) 2024-03-04T06:49:35.326 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:35.154+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:35.326 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:35.148+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:35.326 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:35.149+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:35.326 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-04T06:49:35.327 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-mon[85573]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-04T06:49:35.327 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-mon[85573]: osdmap e505: 8 total, 8 up, 8 in 2024-03-04T06:49:35.327 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:35.327 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:35.327 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:35.327 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:35.327 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:35.327 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:35.327 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:35.327 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-mon[85573]: pgmap v434: 121 pgs: 6 peering, 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 107 active+clean; 356 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.8 MiB/s rd, 94 KiB/s wr, 21 op/s; 6.2 MiB/s, 2 objects/s recovering 2024-03-04T06:49:35.327 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-mon[85573]: Health check update: Degraded data redundancy: 56/753 objects degraded (7.437%), 7 pgs degraded (PG_DEGRADED) 2024-03-04T06:49:35.327 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.082+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.328 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.088+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.328 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.094+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.328 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.101+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.328 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.107+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.328 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.113+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.328 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.120+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.328 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.126+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.328 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.132+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.328 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.141+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.328 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.158+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.328 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.173+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.328 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.182+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.328 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.188+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.194+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.200+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.206+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.214+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.219+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.226+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.233+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.239+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.245+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.251+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.257+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.263+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.269+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.275+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.281+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.287+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.330 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.294+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.330 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.300+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.330 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.306+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.330 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.313+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.330 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.318+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.330 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.326+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:49:35] "GET /metrics HTTP/1.1" 200 36268 "" "Prometheus/2.43.0" 2024-03-04T06:49:35.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:35.152+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:35.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:35.152+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:35.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:35.156+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:35.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:35.154+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:35.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-04T06:49:35.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[88869]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-04T06:49:35.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[88869]: osdmap e505: 8 total, 8 up, 8 in 2024-03-04T06:49:35.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:35.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:35.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:35.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:35.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[88869]: pgmap v434: 121 pgs: 6 peering, 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 107 active+clean; 356 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.8 MiB/s rd, 94 KiB/s wr, 21 op/s; 6.2 MiB/s, 2 objects/s recovering 2024-03-04T06:49:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[88869]: Health check update: Degraded data redundancy: 56/753 objects degraded (7.437%), 7 pgs degraded (PG_DEGRADED) 2024-03-04T06:49:35.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-04T06:49:35.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[91314]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-04T06:49:35.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[91314]: osdmap e505: 8 total, 8 up, 8 in 2024-03-04T06:49:35.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:35.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:35.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:35.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:35.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:35.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:35.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:35.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[91314]: pgmap v434: 121 pgs: 6 peering, 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 107 active+clean; 356 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.8 MiB/s rd, 94 KiB/s wr, 21 op/s; 6.2 MiB/s, 2 objects/s recovering 2024-03-04T06:49:35.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:35 smithi137 ceph-mon[91314]: Health check update: Degraded data redundancy: 56/753 objects degraded (7.437%), 7 pgs degraded (PG_DEGRADED) 2024-03-04T06:49:35.570 INFO:tasks.rados.rados.0.smithi137.stdout:2324: finishing copy_from racing read to smithi13777483-24 2024-03-04T06:49:35.571 INFO:tasks.rados.rados.0.smithi137.stdout:2324: finishing copy_from to smithi13777483-24 2024-03-04T06:49:35.571 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16778 (ObjNum 639 snap 178 seq_num 639) dirty exists 2024-03-04T06:49:35.571 INFO:tasks.rados.rados.0.smithi137.stdout:2319: done (3 left) 2024-03-04T06:49:35.571 INFO:tasks.rados.rados.0.smithi137.stdout:2320: done (2 left) 2024-03-04T06:49:35.571 INFO:tasks.rados.rados.0.smithi137.stdout:2322: done (1 left) 2024-03-04T06:49:35.571 INFO:tasks.rados.rados.0.smithi137.stdout:2324: done (0 left) 2024-03-04T06:49:35.571 INFO:tasks.rados.rados.0.smithi137.stdout:2325: read oid 21 snap -1 2024-03-04T06:49:35.571 INFO:tasks.rados.rados.0.smithi137.stdout:2325: expect deleted 2024-03-04T06:49:35.571 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 219 2024-03-04T06:49:35.571 INFO:tasks.rados.rados.0.smithi137.stdout:2326: seq_num 740 ranges {2695168=401408} 2024-03-04T06:49:35.578 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.333+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.339+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.346+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.353+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.359+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.365+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.372+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.378+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.385+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.391+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.398+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.404+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.410+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.416+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.423+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.579 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.429+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.580 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.435+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.580 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.441+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.580 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.448+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.580 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.454+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.580 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.461+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.580 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.468+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.580 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.474+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.581 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.480+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.581 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.487+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.581 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.494+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.581 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.500+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.581 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.507+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.581 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.513+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.581 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.520+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.581 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.526+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.581 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.533+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.581 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.540+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.581 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.546+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.581 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.552+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.581 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.558+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.582 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.565+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.582 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.571+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.582 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.578+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.588 INFO:tasks.rados.rados.0.smithi137.stdout:2326: writing smithi13777483-15 from 2695168 to 3096576 tid 1 2024-03-04T06:49:35.588 INFO:tasks.rados.rados.0.smithi137.stdout:2327: rollback oid 8 current snap is 219 2024-03-04T06:49:35.588 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 8 to 209 2024-03-04T06:49:35.588 INFO:tasks.rados.rados.0.smithi137.stdout:2325: done (2 left) 2024-03-04T06:49:35.588 INFO:tasks.rados.rados.0.smithi137.stdout:2328: read oid 46 snap -1 2024-03-04T06:49:35.588 INFO:tasks.rados.rados.0.smithi137.stdout:2328: expect deleted 2024-03-04T06:49:35.588 INFO:tasks.rados.rados.0.smithi137.stdout:2329: copy_from oid 37 from oid 44 current snap is 219 2024-03-04T06:49:35.588 INFO:tasks.rados.rados.0.smithi137.stdout:2330: rollback oid 48 current snap is 219 2024-03-04T06:49:35.588 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 48 to 212 2024-03-04T06:49:35.588 INFO:tasks.rados.rados.0.smithi137.stdout:2331: setattr oid 30 current snap is 219 2024-03-04T06:49:35.590 INFO:tasks.rados.rados.0.smithi137.stdout:2328: done (5 left) 2024-03-04T06:49:35.590 INFO:tasks.rados.rados.0.smithi137.stdout:2332: setattr oid 6 current snap is 219 2024-03-04T06:49:35.591 INFO:tasks.rados.rados.0.smithi137.stdout:2330: finishing rollback tid 1 to smithi13777483-48 2024-03-04T06:49:35.592 INFO:tasks.rados.rados.0.smithi137.stdout:2327: finishing rollback tid 0 to smithi13777483-8 2024-03-04T06:49:35.593 INFO:tasks.rados.rados.0.smithi137.stdout:2333: read oid 24 snap -1 2024-03-04T06:49:35.593 INFO:tasks.rados.rados.0.smithi137.stdout:2333: expect (ObjNum 639 snap 178 seq_num 639) 2024-03-04T06:49:35.593 INFO:tasks.rados.rados.0.smithi137.stdout:2334: rmattr oid 42 current snap is 219 2024-03-04T06:49:35.593 INFO:tasks.rados.rados.0.smithi137.stdout:2334: done (7 left) 2024-03-04T06:49:35.593 INFO:tasks.rados.rados.0.smithi137.stdout:2335: copy_from oid 33 from oid 14 current snap is 219 2024-03-04T06:49:35.593 INFO:tasks.rados.rados.0.smithi137.stdout:2336: delete oid 27 current snap is 219 2024-03-04T06:49:35.593 INFO:tasks.rados.rados.0.smithi137.stdout:2330: finishing rollback tid 2 to smithi13777483-48 2024-03-04T06:49:35.593 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 16796 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:49:35.593 INFO:tasks.rados.rados.0.smithi137.stdout:2327: finishing rollback tid 1 to smithi13777483-8 2024-03-04T06:49:35.594 INFO:tasks.rados.rados.0.smithi137.stdout:2327: finishing rollback tid 2 to smithi13777483-8 2024-03-04T06:49:35.594 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16821 (ObjNum 675 snap 191 seq_num 675) dirty exists 2024-03-04T06:49:35.594 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16773 (ObjNum 33 snap 0 seq_num 4) dirty exists 2024-03-04T06:49:35.594 INFO:tasks.rados.rados.0.smithi137.stdout:2335: finishing copy_from to smithi13777483-33 2024-03-04T06:49:35.594 INFO:tasks.rados.rados.0.smithi137.stdout:2335: got expected ENOENT (src dne) 2024-03-04T06:49:35.594 INFO:tasks.rados.rados.0.smithi137.stdout:2335: finishing copy_from racing read to smithi13777483-33 2024-03-04T06:49:35.596 INFO:tasks.rados.rados.0.smithi137.stdout:2326: finishing write tid 1 to smithi13777483-15 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:2326: finishing write tid 2 to smithi13777483-15 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:2327: done (8 left) 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:2330: done (7 left) 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:2331: done (6 left) 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:2335: done (5 left) 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:2336: done (4 left) 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:2337: rollback oid 14 current snap is 219 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 14 to 218 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:2338: read oid 22 snap -1 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:2338: expect (ObjNum 726 snap 214 seq_num 726) 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:2339: copy_from oid 25 from oid 19 current snap is 219 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:2340: copy_from oid 8 from oid 16 current snap is 219 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 219 2024-03-04T06:49:35.597 INFO:tasks.rados.rados.0.smithi137.stdout:2341: seq_num 742 ranges {2080768=434176} 2024-03-04T06:49:35.611 INFO:tasks.rados.rados.0.smithi137.stdout:2341: writing smithi13777483-12 from 2080768 to 2514944 tid 1 2024-03-04T06:49:35.611 INFO:tasks.rados.rados.0.smithi137.stdout:2342: snap_create 2024-03-04T06:49:35.612 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16784 (ObjNum 719 snap 212 seq_num 719) dirty exists 2024-03-04T06:49:35.612 INFO:tasks.rados.rados.0.smithi137.stdout:2340: finishing copy_from to smithi13777483-8 2024-03-04T06:49:35.612 INFO:tasks.rados.rados.0.smithi137.stdout:2340: got expected ENOENT (src dne) 2024-03-04T06:49:35.612 INFO:tasks.rados.rados.0.smithi137.stdout:2337: finishing rollback tid 1 to smithi13777483-14 2024-03-04T06:49:35.612 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 15506 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-04T06:49:35.612 INFO:tasks.rados.rados.0.smithi137.stdout:2340: finishing copy_from racing read to smithi13777483-8 2024-03-04T06:49:35.612 INFO:tasks.rados.rados.0.smithi137.stdout:2339: finishing copy_from racing read to smithi13777483-25 2024-03-04T06:49:35.612 INFO:tasks.rados.rados.0.smithi137.stdout:2339: finishing copy_from to smithi13777483-25 2024-03-04T06:49:35.612 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 15485 (ObjNum 49 snap 0 seq_num 1953066355) dirty exists 2024-03-04T06:49:35.612 INFO:tasks.rados.rados.0.smithi137.stdout:2333: expect (ObjNum 639 snap 178 seq_num 639) 2024-03-04T06:49:35.652 INFO:tasks.rados.rados.0.smithi137.stdout:2329: finishing copy_from racing read to smithi13777483-37 2024-03-04T06:49:35.652 INFO:tasks.rados.rados.0.smithi137.stdout:2329: finishing copy_from to smithi13777483-37 2024-03-04T06:49:35.652 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 15463 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:49:35.652 INFO:tasks.rados.rados.0.smithi137.stdout:2326: finishing write tid 3 to smithi13777483-15 2024-03-04T06:49:35.652 INFO:tasks.rados.rados.0.smithi137.stdout:2326: oid 15 updating version 0 to 16782 2024-03-04T06:49:35.652 INFO:tasks.rados.rados.0.smithi137.stdout:2326: oid 15 updating version 16782 to 16783 2024-03-04T06:49:35.652 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16783 (ObjNum 740 snap 219 seq_num 740) dirty exists 2024-03-04T06:49:35.653 INFO:tasks.rados.rados.0.smithi137.stdout:2326: left oid 15 (ObjNum 740 snap 219 seq_num 740) 2024-03-04T06:49:35.653 INFO:tasks.rados.rados.0.smithi137.stdout:2338: expect (ObjNum 726 snap 214 seq_num 726) 2024-03-04T06:49:35.659 INFO:tasks.rados.rados.0.smithi137.stdout:2341: finishing write tid 1 to smithi13777483-12 2024-03-04T06:49:35.660 INFO:tasks.rados.rados.0.smithi137.stdout:2341: finishing write tid 2 to smithi13777483-12 2024-03-04T06:49:35.660 INFO:tasks.rados.rados.0.smithi137.stdout:2341: finishing write tid 3 to smithi13777483-12 2024-03-04T06:49:35.660 INFO:tasks.rados.rados.0.smithi137.stdout:2341: oid 12 updating version 0 to 16774 2024-03-04T06:49:35.660 INFO:tasks.rados.rados.0.smithi137.stdout:2341: oid 12 updating version 16774 to 16775 2024-03-04T06:49:35.660 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16775 (ObjNum 742 snap 219 seq_num 742) dirty exists 2024-03-04T06:49:35.660 INFO:tasks.rados.rados.0.smithi137.stdout:2341: left oid 12 (ObjNum 742 snap 219 seq_num 742) 2024-03-04T06:49:35.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.585+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.594+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.610+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.618+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.624+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.630+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.637+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.643+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.650+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.656+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.663+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.669+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.676+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.682+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.688+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.695+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.701+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.836 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.708+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.836 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.714+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.836 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.720+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.836 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.727+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.836 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.733+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.836 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.739+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.836 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.747+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.836 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.753+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.836 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.759+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.836 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.766+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.836 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.773+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.837 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.779+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.837 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.786+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.837 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.793+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.837 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.800+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.837 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.806+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.837 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.813+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.837 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.819+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.837 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.826+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:35.837 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.833+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.085 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.840+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.085 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.846+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.085 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.853+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.085 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.860+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.085 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.866+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.085 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.873+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.085 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.880+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.085 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.887+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.085 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.894+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.085 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.901+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.908+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.914+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.921+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.927+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.934+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.940+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.947+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.953+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.960+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.968+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.974+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.981+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.988+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:35.994+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.086 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.001+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.008+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.015+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.022+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.028+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.036+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.043+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.050+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.057+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.064+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.070+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.077+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.084+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.151 INFO:tasks.rados.rados.0.smithi137.stdout:2326: done (9 left) 2024-03-04T06:49:36.151 INFO:tasks.rados.rados.0.smithi137.stdout:2329: done (8 left) 2024-03-04T06:49:36.151 INFO:tasks.rados.rados.0.smithi137.stdout:2332: done (7 left) 2024-03-04T06:49:36.151 INFO:tasks.rados.rados.0.smithi137.stdout:2333: done (6 left) 2024-03-04T06:49:36.151 INFO:tasks.rados.rados.0.smithi137.stdout:2337: done (5 left) 2024-03-04T06:49:36.151 INFO:tasks.rados.rados.0.smithi137.stdout:2338: done (4 left) 2024-03-04T06:49:36.151 INFO:tasks.rados.rados.0.smithi137.stdout:2339: done (3 left) 2024-03-04T06:49:36.151 INFO:tasks.rados.rados.0.smithi137.stdout:2340: done (2 left) 2024-03-04T06:49:36.151 INFO:tasks.rados.rados.0.smithi137.stdout:2341: done (1 left) 2024-03-04T06:49:36.151 INFO:tasks.rados.rados.0.smithi137.stdout:2342: done (0 left) 2024-03-04T06:49:36.151 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 35 current snap is 220 2024-03-04T06:49:36.151 INFO:tasks.rados.rados.0.smithi137.stdout:2343: seq_num 743 ranges {0=450560} 2024-03-04T06:49:36.153 INFO:tasks.rados.rados.0.smithi137.stdout:2343: writing smithi13777483-35 from 0 to 450560 tid 1 2024-03-04T06:49:36.153 INFO:tasks.rados.rados.0.smithi137.stdout:2344: snap_create 2024-03-04T06:49:36.160 INFO:tasks.rados.rados.0.smithi137.stdout:2343: finishing write tid 1 to smithi13777483-35 2024-03-04T06:49:36.160 INFO:tasks.rados.rados.0.smithi137.stdout:2343: finishing write tid 2 to smithi13777483-35 2024-03-04T06:49:36.161 INFO:tasks.rados.rados.0.smithi137.stdout:2343: finishing write tid 3 to smithi13777483-35 2024-03-04T06:49:36.162 INFO:tasks.rados.rados.0.smithi137.stdout:2343: oid 35 updating version 0 to 16789 2024-03-04T06:49:36.162 INFO:tasks.rados.rados.0.smithi137.stdout:2343: oid 35 version 16789 is already newer than 16788 2024-03-04T06:49:36.162 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16789 (ObjNum 743 snap 220 seq_num 743) dirty exists 2024-03-04T06:49:36.162 INFO:tasks.rados.rados.0.smithi137.stdout:2343: left oid 35 (ObjNum 743 snap 220 seq_num 743) 2024-03-04T06:49:36.336 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:36.160+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:36.337 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:36.151+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:36.337 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:36.151+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:36.337 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:36.152+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:36.337 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-mon[85573]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/753 objects degraded (7.437%), 7 pgs degraded) 2024-03-04T06:49:36.337 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:36.337 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:36.337 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-mon[85573]: osdmap e506: 8 total, 8 up, 8 in 2024-03-04T06:49:36.337 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:36.338 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:36.338 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:36.338 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:36.338 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:36.338 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.091+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.338 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.098+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.338 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.104+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.338 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.111+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.338 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.119+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.338 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.125+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.338 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.132+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.140+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.148+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.163+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.170+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.177+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.184+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.191+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.198+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.205+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.212+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.219+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.225+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.232+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.239+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.339 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.246+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.340 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.253+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.340 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.260+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.340 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.266+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.340 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.274+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.340 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.280+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.340 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.287+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.340 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.294+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.340 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.301+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.340 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.308+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.340 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.315+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.340 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.322+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.340 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.329+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.340 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.336+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:36.159+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:36.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:36.151+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:36.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:36.151+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:36.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:36.151+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:36.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:36.159+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[91314]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/753 objects degraded (7.437%), 7 pgs degraded) 2024-03-04T06:49:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[91314]: osdmap e506: 8 total, 8 up, 8 in 2024-03-04T06:49:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[88869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/753 objects degraded (7.437%), 7 pgs degraded) 2024-03-04T06:49:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:36.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[88869]: osdmap e506: 8 total, 8 up, 8 in 2024-03-04T06:49:36.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:36.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:36.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:36.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:36.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.344+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.351+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.358+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.365+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.372+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.379+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.386+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.394+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.401+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.407+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.415+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.422+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.429+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.437+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.445+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.452+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.459+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.466+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.473+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.479+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.486+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.494+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.502+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.509+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.516+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.523+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.530+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.537+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.544+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.551+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.558+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.565+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.572+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.578+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.585+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.593+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.844 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.601+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.608+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.615+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.622+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.629+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.637+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.643+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.651+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.658+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.665+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.672+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.679+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.686+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.693+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.700+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.707+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.715+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.722+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.729+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.736+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.744+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.751+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.757+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.765+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.772+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.780+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.787+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.794+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.801+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.808+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.815+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.822+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.829+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.837+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:36.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.844+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.852+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.859+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.866+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.873+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.880+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.887+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.895+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.903+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.910+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.917+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.924+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.932+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.939+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.946+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.954+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.961+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.968+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.975+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.982+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.990+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:36.997+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.004+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.011+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.018+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.026+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.033+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.040+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.047+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.054+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.062+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.069+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.076+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.083+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.098 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.091+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.156 INFO:tasks.rados.rados.0.smithi137.stdout:2343: done (1 left) 2024-03-04T06:49:37.156 INFO:tasks.rados.rados.0.smithi137.stdout:2344: done (0 left) 2024-03-04T06:49:37.156 INFO:tasks.rados.rados.0.smithi137.stdout:2345: read oid 2 snap -1 2024-03-04T06:49:37.156 INFO:tasks.rados.rados.0.smithi137.stdout:2345: expect (ObjNum 679 snap 192 seq_num 679) 2024-03-04T06:49:37.156 INFO:tasks.rados.rados.0.smithi137.stdout:2346: snap_create 2024-03-04T06:49:37.201 INFO:tasks.rados.rados.0.smithi137.stdout:2345: expect (ObjNum 679 snap 192 seq_num 679) 2024-03-04T06:49:37.353 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:37.162+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:37.353 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:37.158+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:37.353 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:37.159+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:37.353 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-mon[85573]: osdmap e507: 8 total, 8 up, 8 in 2024-03-04T06:49:37.354 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:37.354 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:37.354 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:37.354 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:37.354 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:37.354 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:37.354 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:37.354 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-mon[85573]: pgmap v437: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 356 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.8 MiB/s rd, 94 KiB/s wr, 21 op/s; 6.2 MiB/s, 2 objects/s recovering 2024-03-04T06:49:37.354 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.099+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.354 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.107+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.114+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.122+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.129+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.136+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.143+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.151+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.164+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.176+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.186+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.195+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.204+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.212+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.220+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.227+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.355 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.234+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.242+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.249+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.257+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.264+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.271+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.278+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.285+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.292+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.301+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.308+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.315+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.323+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.330+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.356 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.338+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.357 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.345+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.357 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.353+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[88869]: osdmap e507: 8 total, 8 up, 8 in 2024-03-04T06:49:37.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:37.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:37.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:37.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:37.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:37.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:37.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:37.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[88869]: pgmap v437: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 356 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.8 MiB/s rd, 94 KiB/s wr, 21 op/s; 6.2 MiB/s, 2 objects/s recovering 2024-03-04T06:49:37.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[91314]: osdmap e507: 8 total, 8 up, 8 in 2024-03-04T06:49:37.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:37.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:37.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:37.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:37.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:37.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:37.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:37.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-mon[91314]: pgmap v437: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 356 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.8 MiB/s rd, 94 KiB/s wr, 21 op/s; 6.2 MiB/s, 2 objects/s recovering 2024-03-04T06:49:37.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:37.298+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:37.545 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:37.297+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:37.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:37.154+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:37.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:37.155+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:37.605 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.361+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.605 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.369+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.605 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.377+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.605 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.384+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.605 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.391+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.605 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.399+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.605 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.406+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.605 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.414+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.605 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.421+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.428+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.436+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.443+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.450+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.458+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.466+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.473+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.481+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.488+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.496+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.503+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.511+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.519+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.526+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.534+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.542+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.549+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.557+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.565+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.573+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.581+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.589+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.596+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.604+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.858 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.613+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.858 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.621+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.858 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.629+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.858 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.637+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.858 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.645+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.858 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.653+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.858 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.661+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.858 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.669+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.858 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.676+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.858 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.684+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.858 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.692+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.858 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.700+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.707+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.715+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.722+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.730+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.737+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.745+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.752+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.761+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.768+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.776+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.784+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.792+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.799+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.811+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.859 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.820+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.860 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.833+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.860 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.842+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.860 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.849+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:37.860 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.857+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.110 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.866+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.874+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.882+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.890+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.898+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.906+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.913+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.921+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.928+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.936+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.943+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.951+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.959+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.968+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.976+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.111 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.983+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.112 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.991+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.112 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:37.999+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.112 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.006+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.112 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.015+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.112 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.023+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.112 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.031+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.112 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.038+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.112 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.047+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.112 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.055+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.112 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.063+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.113 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.070+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.113 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.078+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.113 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.086+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.113 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.094+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.113 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.102+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.113 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.110+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.307 INFO:tasks.rados.rados.0.smithi137.stdout:2345: done (1 left) 2024-03-04T06:49:38.307 INFO:tasks.rados.rados.0.smithi137.stdout:2346: done (0 left) 2024-03-04T06:49:38.307 INFO:tasks.rados.rados.0.smithi137.stdout:2347: snap_create 2024-03-04T06:49:38.370 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:38.155+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:38.370 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:38.155+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:38.370 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:38.155+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:38.370 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:38.370 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:38.370 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-mon[85573]: osdmap e508: 8 total, 8 up, 8 in 2024-03-04T06:49:38.371 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:38.371 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:38.371 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:38.371 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:38.371 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:38.371 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.119+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.371 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.129+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.371 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.138+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.371 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.146+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.371 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.157+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.166+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.174+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.182+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.190+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.198+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.206+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.214+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.223+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.231+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.239+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.247+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.255+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.262+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.372 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.271+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.373 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.279+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.373 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.286+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.373 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.295+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.373 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.304+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.373 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.312+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.373 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.320+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.373 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.328+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.373 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.336+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.373 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.344+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.373 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.352+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.373 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.360+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.373 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.370+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.405 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:38.403+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:38.405 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:38.154+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:38.405 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:38.405 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:38.405 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[88869]: osdmap e508: 8 total, 8 up, 8 in 2024-03-04T06:49:38.405 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:38.406 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:38.406 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:38.406 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:38.406 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:38.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:38.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:38.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[91314]: osdmap e508: 8 total, 8 up, 8 in 2024-03-04T06:49:38.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:38.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:38.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:38.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:38.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:38.623 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:38.397+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:38.624 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.379+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.624 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.386+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.624 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.396+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.624 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.406+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.624 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.415+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.624 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.423+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.624 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.431+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.624 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.439+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.624 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.448+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.624 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.456+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.624 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.465+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.473+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.482+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.489+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.498+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.506+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.514+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.522+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.531+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.540+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.548+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.556+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.565+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.573+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.581+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.589+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.625 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.597+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.626 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.606+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.626 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.615+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.626 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.623+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:38.404+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:38.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:38.404+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:38.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:38.613+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:38.876 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.632+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.876 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.640+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.879 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.648+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.879 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.657+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.879 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.666+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.879 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.675+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.879 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.683+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.879 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.692+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.879 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.700+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.879 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.708+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.879 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.716+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.879 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.724+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.879 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.733+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.879 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.741+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.879 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.750+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.880 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.759+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.880 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.767+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.880 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.776+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.880 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.784+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.880 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.793+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.880 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.801+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.880 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.809+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.880 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.817+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.880 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.826+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.880 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.834+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.881 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.842+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.881 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.850+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.881 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.859+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.881 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.867+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:38.881 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.875+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.134 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.884+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.134 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.893+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.134 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.901+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.134 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.909+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.134 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.918+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.926+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.935+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.944+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.952+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.960+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.968+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.978+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.986+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:38.995+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.003+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.011+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.019+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.028+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.037+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.135 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.045+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.136 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.054+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.136 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.063+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.136 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.072+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.136 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.080+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.136 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.089+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.136 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.097+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.136 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.106+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.136 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.115+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.136 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.125+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.136 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.133+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.171 INFO:tasks.rados.rados.0.smithi137.stdout:2347: done (0 left) 2024-03-04T06:49:39.171 INFO:tasks.rados.rados.0.smithi137.stdout:2348: copy_from oid 41 from oid 34 current snap is 223 2024-03-04T06:49:39.171 INFO:tasks.rados.rados.0.smithi137.stdout:2349: read oid 14 snap 218 2024-03-04T06:49:39.171 INFO:tasks.rados.rados.0.smithi137.stdout:2349: expect deleted 2024-03-04T06:49:39.171 INFO:tasks.rados.rados.0.smithi137.stdout:2350: delete oid 13 current snap is 223 2024-03-04T06:49:39.176 INFO:tasks.rados.rados.0.smithi137.stdout:2349: done (2 left) 2024-03-04T06:49:39.176 INFO:tasks.rados.rados.0.smithi137.stdout:2350: done (1 left) 2024-03-04T06:49:39.176 INFO:tasks.rados.rados.0.smithi137.stdout:2351: rmattr oid 40 current snap is 223 2024-03-04T06:49:39.176 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 223 2024-03-04T06:49:39.176 INFO:tasks.rados.rados.0.smithi137.stdout:2352: seq_num 745 ranges {2514944=483328} 2024-03-04T06:49:39.193 INFO:tasks.rados.rados.0.smithi137.stdout:2352: writing smithi13777483-12 from 2514944 to 2998272 tid 1 2024-03-04T06:49:39.193 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 223 2024-03-04T06:49:39.193 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 16785 (ObjNum 33 snap 0 seq_num 3130758416) dirty exists 2024-03-04T06:49:39.193 INFO:tasks.rados.rados.0.smithi137.stdout:2353: seq_num 746 ranges {12140544=499712} 2024-03-04T06:49:39.262 INFO:tasks.rados.rados.0.smithi137.stdout:2353: writing smithi13777483-18 from 12140544 to 12640256 tid 1 2024-03-04T06:49:39.262 INFO:tasks.rados.rados.0.smithi137.stdout:2351: done (3 left) 2024-03-04T06:49:39.262 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 223 2024-03-04T06:49:39.262 INFO:tasks.rados.rados.0.smithi137.stdout:2348: finishing copy_from racing read to smithi13777483-41 2024-03-04T06:49:39.262 INFO:tasks.rados.rados.0.smithi137.stdout:2348: finishing copy_from to smithi13777483-41 2024-03-04T06:49:39.262 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 16778 (ObjNum 639 snap 178 seq_num 639) dirty exists 2024-03-04T06:49:39.263 INFO:tasks.rados.rados.0.smithi137.stdout:2354: seq_num 747 ranges {3104768=516096} 2024-03-04T06:49:39.282 INFO:tasks.rados.rados.0.smithi137.stdout:2354: writing smithi13777483-10 from 3104768 to 3620864 tid 1 2024-03-04T06:49:39.282 INFO:tasks.rados.rados.0.smithi137.stdout:2348: done (3 left) 2024-03-04T06:49:39.282 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 5 current snap is 223 2024-03-04T06:49:39.282 INFO:tasks.rados.rados.0.smithi137.stdout:2352: finishing write tid 1 to smithi13777483-12 2024-03-04T06:49:39.283 INFO:tasks.rados.rados.0.smithi137.stdout:2352: finishing write tid 2 to smithi13777483-12 2024-03-04T06:49:39.283 INFO:tasks.rados.rados.0.smithi137.stdout:2352: finishing write tid 3 to smithi13777483-12 2024-03-04T06:49:39.283 INFO:tasks.rados.rados.0.smithi137.stdout:2352: oid 12 updating version 0 to 16777 2024-03-04T06:49:39.283 INFO:tasks.rados.rados.0.smithi137.stdout:2352: oid 12 version 16777 is already newer than 16776 2024-03-04T06:49:39.283 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16777 (ObjNum 745 snap 223 seq_num 745) dirty exists 2024-03-04T06:49:39.283 INFO:tasks.rados.rados.0.smithi137.stdout:2352: left oid 12 (ObjNum 745 snap 223 seq_num 745) 2024-03-04T06:49:39.283 INFO:tasks.rados.rados.0.smithi137.stdout:2355: seq_num 748 ranges {4210688=532480} 2024-03-04T06:49:39.310 INFO:tasks.rados.rados.0.smithi137.stdout:2355: writing smithi13777483-5 from 4210688 to 4743168 tid 1 2024-03-04T06:49:39.310 INFO:tasks.rados.rados.0.smithi137.stdout:2352: done (3 left) 2024-03-04T06:49:39.310 INFO:tasks.rados.rados.0.smithi137.stdout:2356: read oid 44 snap 218 2024-03-04T06:49:39.310 INFO:tasks.rados.rados.0.smithi137.stdout:2356: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:39.310 INFO:tasks.rados.rados.0.smithi137.stdout:2357: snap_remove snap 199 2024-03-04T06:49:39.310 INFO:tasks.rados.rados.0.smithi137.stdout:2353: finishing write tid 1 to smithi13777483-18 2024-03-04T06:49:39.310 INFO:tasks.rados.rados.0.smithi137.stdout:2353: finishing write tid 2 to smithi13777483-18 2024-03-04T06:49:39.310 INFO:tasks.rados.rados.0.smithi137.stdout:2353: finishing write tid 3 to smithi13777483-18 2024-03-04T06:49:39.310 INFO:tasks.rados.rados.0.smithi137.stdout:2353: oid 18 updating version 0 to 16802 2024-03-04T06:49:39.310 INFO:tasks.rados.rados.0.smithi137.stdout:2353: oid 18 version 16802 is already newer than 16801 2024-03-04T06:49:39.310 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16802 (ObjNum 746 snap 223 seq_num 746) dirty exists 2024-03-04T06:49:39.310 INFO:tasks.rados.rados.0.smithi137.stdout:2353: left oid 18 (ObjNum 746 snap 223 seq_num 746) 2024-03-04T06:49:39.310 INFO:tasks.rados.rados.0.smithi137.stdout:2354: finishing write tid 1 to smithi13777483-10 2024-03-04T06:49:39.311 INFO:tasks.rados.rados.0.smithi137.stdout:2354: finishing write tid 2 to smithi13777483-10 2024-03-04T06:49:39.311 INFO:tasks.rados.rados.0.smithi137.stdout:2354: finishing write tid 3 to smithi13777483-10 2024-03-04T06:49:39.311 INFO:tasks.rados.rados.0.smithi137.stdout:2354: oid 10 updating version 0 to 15524 2024-03-04T06:49:39.311 INFO:tasks.rados.rados.0.smithi137.stdout:2354: oid 10 version 15524 is already newer than 15523 2024-03-04T06:49:39.311 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15524 (ObjNum 747 snap 223 seq_num 747) dirty exists 2024-03-04T06:49:39.311 INFO:tasks.rados.rados.0.smithi137.stdout:2354: left oid 10 (ObjNum 747 snap 223 seq_num 747) 2024-03-04T06:49:39.390 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:39.164+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:39.391 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:39.165+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:39.391 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:39.174+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:39.391 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:39.391 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-mon[85573]: osdmap e509: 8 total, 8 up, 8 in 2024-03-04T06:49:39.391 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:39.391 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:39.391 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-mon[85573]: pgmap v440: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 356 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-03-04T06:49:39.392 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:39.392 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:49:39.392 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:39.392 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:39.392 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:39.392 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:39.392 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.143+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.392 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.152+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.392 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.162+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.175+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.188+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.199+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.208+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.217+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.226+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.234+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.243+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.252+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.261+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.271+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.280+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.290+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.299+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.393 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.308+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.394 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.319+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.394 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.328+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.394 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.337+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.394 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.346+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.394 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.355+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.394 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.364+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.394 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.373+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.394 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.382+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.394 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.390+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:39.176+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:39.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:39.178+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:39.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:39.178+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:39.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:39.169+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:39.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:39.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[88869]: osdmap e509: 8 total, 8 up, 8 in 2024-03-04T06:49:39.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:39.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:39.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[88869]: pgmap v440: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 356 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-03-04T06:49:39.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:39.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:49:39.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[91314]: osdmap e509: 8 total, 8 up, 8 in 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[91314]: pgmap v440: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 356 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:39.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:39.643 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.400+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.643 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.409+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.643 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.417+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.643 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.426+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.643 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.435+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.643 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.444+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.453+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.461+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.470+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.479+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.489+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.499+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.508+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.517+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.526+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.535+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.543+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.553+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.562+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.644 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.572+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.645 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.580+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.645 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.590+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.645 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.599+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.645 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.607+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.645 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.617+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.645 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.625+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.645 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.634+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.645 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.642+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.651+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.661+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.670+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.679+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.689+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.698+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.706+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.715+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.724+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.733+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.742+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.750+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.759+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.768+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.777+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.786+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.795+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.805+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.813+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.822+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.830+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.839+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.848+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.857+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.866+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.875+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.884+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:39.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.893+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.154 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.902+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.154 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.912+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.154 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.921+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.154 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.929+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.154 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.938+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.154 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.948+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.957+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.966+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.975+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.984+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:39.992+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.001+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.011+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.021+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.030+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.040+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.049+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.057+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.067+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.077+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.086+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.095+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.105+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.114+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.123+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.133+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.143+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.153+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.177 INFO:tasks.rados.rados.0.smithi137.stdout:2355: finishing write tid 1 to smithi13777483-5 2024-03-04T06:49:40.177 INFO:tasks.rados.rados.0.smithi137.stdout:2355: finishing write tid 2 to smithi13777483-5 2024-03-04T06:49:40.177 INFO:tasks.rados.rados.0.smithi137.stdout:2356: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:49:40.321 INFO:tasks.rados.rados.0.smithi137.stdout:2355: finishing write tid 3 to smithi13777483-5 2024-03-04T06:49:40.322 INFO:tasks.rados.rados.0.smithi137.stdout:2355: oid 5 updating version 0 to 15525 2024-03-04T06:49:40.322 INFO:tasks.rados.rados.0.smithi137.stdout:2355: oid 5 updating version 15525 to 15526 2024-03-04T06:49:40.322 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 15526 (ObjNum 748 snap 223 seq_num 748) dirty exists 2024-03-04T06:49:40.322 INFO:tasks.rados.rados.0.smithi137.stdout:2355: left oid 5 (ObjNum 748 snap 223 seq_num 748) 2024-03-04T06:49:40.322 INFO:tasks.rados.rados.0.smithi137.stdout:2353: done (4 left) 2024-03-04T06:49:40.322 INFO:tasks.rados.rados.0.smithi137.stdout:2354: done (3 left) 2024-03-04T06:49:40.322 INFO:tasks.rados.rados.0.smithi137.stdout:2355: done (2 left) 2024-03-04T06:49:40.322 INFO:tasks.rados.rados.0.smithi137.stdout:2356: done (1 left) 2024-03-04T06:49:40.322 INFO:tasks.rados.rados.0.smithi137.stdout:2357: done (0 left) 2024-03-04T06:49:40.322 INFO:tasks.rados.rados.0.smithi137.stdout:2358: snap_create 2024-03-04T06:49:40.411 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:40.171+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:40.411 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:40.182+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:40.412 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:40.182+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:40.412 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:40.183+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:40.412 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:40.412 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:40.412 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:40.412 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-mon[85573]: osdmap e510: 8 total, 8 up, 8 in 2024-03-04T06:49:40.412 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:40.412 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:40.412 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:40.413 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:40.413 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.163+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.413 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.180+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.413 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.195+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.413 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.205+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.413 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.214+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.413 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.223+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.413 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.232+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.413 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.241+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.413 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.251+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.260+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.271+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.280+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.290+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.299+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.308+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.317+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.326+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.336+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.345+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.355+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.364+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.374+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.414 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.383+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.415 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.392+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.415 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.402+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.415 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.411+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:40.184+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:40.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:40.174+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:40.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:40.175+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:40.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:40.176+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:40.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:40.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:40.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:40.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[91314]: osdmap e510: 8 total, 8 up, 8 in 2024-03-04T06:49:40.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:40.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:40.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:40.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:40.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:40.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[88869]: osdmap e510: 8 total, 8 up, 8 in 2024-03-04T06:49:40.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:40.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:40.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:40.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:40.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:40.176+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:40.671 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.421+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.671 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.431+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.671 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.442+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.671 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.452+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.671 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.462+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.671 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.470+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.671 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.480+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.671 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.489+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.672 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.499+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.672 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.509+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.672 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.518+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.672 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.527+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.672 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.536+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.672 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.545+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.672 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.555+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.672 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.564+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.672 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.574+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.672 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.583+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.672 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.594+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.672 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.604+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.672 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.613+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.673 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.623+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.673 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.632+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.673 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.642+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.673 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.651+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.673 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.661+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.673 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.670+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.922 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.680+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.922 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.689+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.922 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.698+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.922 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.707+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.716+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.726+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.735+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.744+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.754+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.763+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.772+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.781+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.790+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.799+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.808+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.818+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.827+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.923 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.837+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.924 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.846+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.924 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.856+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.924 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.865+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.924 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.875+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.924 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.884+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.924 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.894+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.924 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.903+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.924 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.912+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:40.924 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.921+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.176 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.931+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.176 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.941+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.176 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.949+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.959+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.970+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.979+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:40.994+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.004+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.013+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.024+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.033+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.043+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.052+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.061+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.070+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.080+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.089+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.177 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.099+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.178 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.109+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.178 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.119+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.178 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.128+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.178 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.138+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.178 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.147+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.178 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.157+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.178 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.167+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.178 INFO:tasks.rados.rados.0.smithi137.stdout:2358: done (0 left) 2024-03-04T06:49:41.178 INFO:tasks.rados.rados.0.smithi137.stdout:2359: snap_create 2024-03-04T06:49:41.431 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:41.182+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:41.432 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:41.178+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:41.432 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:41.179+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:41.432 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:41.432 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:41.432 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-mon[85573]: osdmap e511: 8 total, 8 up, 8 in 2024-03-04T06:49:41.432 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:41.432 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:41.432 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:41.433 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:41.433 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:41.433 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-mon[85573]: pgmap v443: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 357 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 1.6 MiB/s wr, 19 op/s 2024-03-04T06:49:41.433 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.183+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.433 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.193+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.433 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.202+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.433 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.211+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.433 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.221+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.231+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.240+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.249+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.258+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.267+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.277+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.286+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.295+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.304+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.314+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.323+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.333+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.342+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.434 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.352+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.435 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.361+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.435 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.371+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.435 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.381+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.435 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.390+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.435 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.400+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.435 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.411+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.435 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.422+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.435 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.431+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[88869]: osdmap e511: 8 total, 8 up, 8 in 2024-03-04T06:49:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[88869]: pgmap v443: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 357 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 1.6 MiB/s wr, 19 op/s 2024-03-04T06:49:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[91314]: osdmap e511: 8 total, 8 up, 8 in 2024-03-04T06:49:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-mon[91314]: pgmap v443: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 357 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 1.6 MiB/s wr, 19 op/s 2024-03-04T06:49:41.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:41.177+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:41.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:41.178+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:41.685 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.442+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.685 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.452+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.685 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.462+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.685 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.473+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.685 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.482+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.685 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.491+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.685 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.501+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.685 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.510+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.685 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.519+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.685 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.529+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.538+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.550+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.559+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.569+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.579+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.588+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.597+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.607+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.616+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.626+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.636+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.645+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.655+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.686 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.665+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.687 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.674+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.687 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.684+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.935 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[61483]: logger=cleanup t=2024-03-04T06:49:41.89115581Z level=info msg="Completed cleanup jobs" duration=12.587901ms 2024-03-04T06:49:41.935 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.694+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.935 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.704+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.936 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.714+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.936 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.724+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.936 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.733+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.936 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.742+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.936 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.752+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.936 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.762+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.936 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.771+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.936 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.780+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.936 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.790+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.936 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.800+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.936 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.809+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.936 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.818+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.936 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.828+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.937 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.837+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.937 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.846+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.937 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.855+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.937 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.865+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.937 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.874+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.937 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.885+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.937 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.895+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.937 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.904+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.937 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.915+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.937 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.925+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:41.937 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.935+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:41.544+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:42.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:41.544+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:42.179 INFO:tasks.rados.rados.0.smithi137.stdout:2359: done (0 left) 2024-03-04T06:49:42.179 INFO:tasks.rados.rados.0.smithi137.stdout:2360: delete oid 40 current snap is 225 2024-03-04T06:49:42.185 INFO:tasks.rados.rados.0.smithi137.stdout:2360: done (0 left) 2024-03-04T06:49:42.185 INFO:tasks.rados.rados.0.smithi137.stdout:2361: snap_remove snap 216 2024-03-04T06:49:42.186 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:42.186 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:42.178+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:42.186 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:42.178+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:42.186 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:42.178+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:42.186 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:42.183+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:42.187 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.945+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.187 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.955+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.187 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.965+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.187 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.974+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.187 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.984+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.187 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:41.993+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.187 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.003+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.187 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.012+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.187 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.022+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.187 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.032+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.187 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.041+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.187 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.050+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.188 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.059+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.188 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.068+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.188 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.077+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.188 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.085+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.188 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.095+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.188 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.104+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.188 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.113+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.188 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.123+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.188 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.133+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.188 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.143+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.188 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.153+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.188 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.162+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.188 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.171+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.441 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:42.441 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-mon[85573]: osdmap e512: 8 total, 8 up, 8 in 2024-03-04T06:49:42.441 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:42.441 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:42.441 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:42.441 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:42.441 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:42.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.188+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.199+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.209+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.218+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.227+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.237+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.246+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.256+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.265+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.274+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.284+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.293+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.302+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.311+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.321+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.330+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.340+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.350+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.359+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.369+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.380+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.390+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.400+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.410+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.420+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.430+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.443 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.440+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.499 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:42.182+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:42.499 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:42.182+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:42.499 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:42.182+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:42.499 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:42.499 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:42.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[88869]: osdmap e512: 8 total, 8 up, 8 in 2024-03-04T06:49:42.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:42.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:42.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:42.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:42.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:42.500 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:42.500 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:42.500 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[91314]: osdmap e512: 8 total, 8 up, 8 in 2024-03-04T06:49:42.500 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:42.500 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:42.501 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:42.501 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:42.501 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:42.501 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:42.498+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:42.696 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.450+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.696 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.460+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.696 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.470+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.479+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.489+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.504+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.514+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.523+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.532+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.541+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.552+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.565+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.577+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.588+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.599+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.608+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.697 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.618+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.698 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.627+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.698 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.636+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.698 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.647+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.698 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.656+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.698 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.666+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.698 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.676+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.698 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.686+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.698 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.695+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:42.498+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:42.953 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.705+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.953 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.715+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.954 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.724+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.954 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.733+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.954 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.743+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.954 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.752+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.954 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.761+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.954 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.771+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.954 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.780+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.954 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.790+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.954 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.800+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.954 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.809+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.954 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.819+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.954 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.828+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.954 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.838+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.955 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.848+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.955 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.857+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.955 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.867+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.955 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.876+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.955 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.885+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.955 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.896+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.955 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.906+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.955 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.915+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.955 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.925+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.955 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.934+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.955 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.943+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:42.955 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.952+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.195 INFO:tasks.rados.rados.0.smithi137.stdout:2361: done (0 left) 2024-03-04T06:49:43.196 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 5 current snap is 225 2024-03-04T06:49:43.196 INFO:tasks.rados.rados.0.smithi137.stdout:2362: seq_num 750 ranges {4743168=565248} 2024-03-04T06:49:43.210 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:43.196+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:43.210 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:43.196+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:43.210 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:43.198+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:43.211 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:43.211 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:43.211 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-mon[85573]: osdmap e513: 8 total, 8 up, 8 in 2024-03-04T06:49:43.211 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:43.211 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:43.211 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:43.211 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-mon[85573]: pgmap v446: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 357 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 434 KiB/s wr, 2 op/s 2024-03-04T06:49:43.211 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:43.212 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:43.212 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.963+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.212 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.972+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.212 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.981+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.212 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:42.990+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.212 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.000+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.212 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.009+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.213 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.019+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.213 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.029+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.213 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.039+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.213 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.048+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.213 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.057+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.213 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.066+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.213 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.075+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.213 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.085+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.213 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.094+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.213 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.105+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.213 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.114+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.214 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.123+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.214 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.132+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.214 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.142+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.214 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.152+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.214 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.162+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.214 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.171+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.214 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.180+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.214 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.191+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.214 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.210+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.225 INFO:tasks.rados.rados.0.smithi137.stdout:2362: writing smithi13777483-5 from 4743168 to 5308416 tid 1 2024-03-04T06:49:43.225 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 24 current snap is 225 2024-03-04T06:49:43.225 INFO:tasks.rados.rados.0.smithi137.stdout:2363: seq_num 751 ranges {1327104=581632} 2024-03-04T06:49:43.236 INFO:tasks.rados.rados.0.smithi137.stdout:2363: writing smithi13777483-24 from 1327104 to 1908736 tid 1 2024-03-04T06:49:43.236 INFO:tasks.rados.rados.0.smithi137.stdout:2364: rollback oid 13 current snap is 225 2024-03-04T06:49:43.236 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 13 to 212 2024-03-04T06:49:43.236 INFO:tasks.rados.rados.0.smithi137.stdout:2362: finishing write tid 1 to smithi13777483-5 2024-03-04T06:49:43.236 INFO:tasks.rados.rados.0.smithi137.stdout:2362: finishing write tid 2 to smithi13777483-5 2024-03-04T06:49:43.236 INFO:tasks.rados.rados.0.smithi137.stdout:2362: finishing write tid 3 to smithi13777483-5 2024-03-04T06:49:43.236 INFO:tasks.rados.rados.0.smithi137.stdout:2362: oid 5 updating version 0 to 15527 2024-03-04T06:49:43.237 INFO:tasks.rados.rados.0.smithi137.stdout:2362: oid 5 updating version 15527 to 15528 2024-03-04T06:49:43.237 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 15528 (ObjNum 750 snap 225 seq_num 750) dirty exists 2024-03-04T06:49:43.237 INFO:tasks.rados.rados.0.smithi137.stdout:2362: left oid 5 (ObjNum 750 snap 225 seq_num 750) 2024-03-04T06:49:43.237 INFO:tasks.rados.rados.0.smithi137.stdout:2362: done (2 left) 2024-03-04T06:49:43.237 INFO:tasks.rados.rados.0.smithi137.stdout:2365: delete oid 45 current snap is 225 2024-03-04T06:49:43.238 INFO:tasks.rados.rados.0.smithi137.stdout:2365: done (2 left) 2024-03-04T06:49:43.238 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 225 2024-03-04T06:49:43.238 INFO:tasks.rados.rados.0.smithi137.stdout:2364: finishing rollback tid 1 to smithi13777483-13 2024-03-04T06:49:43.238 INFO:tasks.rados.rados.0.smithi137.stdout:2366: seq_num 753 ranges {425984=614400} 2024-03-04T06:49:43.245 INFO:tasks.rados.rados.0.smithi137.stdout:2366: writing smithi13777483-9 from 425984 to 1040384 tid 1 2024-03-04T06:49:43.245 INFO:tasks.rados.rados.0.smithi137.stdout:2367: delete oid 44 current snap is 225 2024-03-04T06:49:43.245 INFO:tasks.rados.rados.0.smithi137.stdout:2364: finishing rollback tid 2 to smithi13777483-13 2024-03-04T06:49:43.245 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16845 (ObjNum 615 snap 175 seq_num 615) dirty exists 2024-03-04T06:49:43.245 INFO:tasks.rados.rados.0.smithi137.stdout:2363: finishing write tid 1 to smithi13777483-24 2024-03-04T06:49:43.245 INFO:tasks.rados.rados.0.smithi137.stdout:2363: finishing write tid 2 to smithi13777483-24 2024-03-04T06:49:43.249 INFO:tasks.rados.rados.0.smithi137.stdout:2366: finishing write tid 1 to smithi13777483-9 2024-03-04T06:49:43.249 INFO:tasks.rados.rados.0.smithi137.stdout:2364: done (3 left) 2024-03-04T06:49:43.249 INFO:tasks.rados.rados.0.smithi137.stdout:2367: done (2 left) 2024-03-04T06:49:43.249 INFO:tasks.rados.rados.0.smithi137.stdout:2368: snap_remove snap 219 2024-03-04T06:49:43.464 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.220+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.464 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.231+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.464 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.248+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.464 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.260+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.269+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.278+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.292+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.307+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.321+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.334+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.346+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.356+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.366+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.376+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.386+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.396+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.405+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.465 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.415+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.466 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.425+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.466 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.435+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.466 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.444+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.466 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.454+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.466 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.463+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:43.202+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:43.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:43.194+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:43.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:43.204+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:43.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:43.205+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:43.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:43.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:43.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[88869]: osdmap e513: 8 total, 8 up, 8 in 2024-03-04T06:49:43.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:43.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:43.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:43.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[88869]: pgmap v446: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 357 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 434 KiB/s wr, 2 op/s 2024-03-04T06:49:43.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:43.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:43.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:43.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:43.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[91314]: osdmap e513: 8 total, 8 up, 8 in 2024-03-04T06:49:43.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:43.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:43.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:43.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[91314]: pgmap v446: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 357 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 434 KiB/s wr, 2 op/s 2024-03-04T06:49:43.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:43.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:43.723 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.474+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.723 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.483+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.723 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.492+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.723 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.502+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.723 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.512+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.723 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.522+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.723 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.531+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.723 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.541+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.550+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.559+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.569+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.579+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.589+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.598+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.608+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.618+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.627+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.636+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.645+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.654+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.664+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.724 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.675+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.725 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.684+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.725 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.693+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.725 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.702+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.725 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.713+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.725 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.722+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.980 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.731+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.980 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.741+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.980 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.750+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.980 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.760+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.980 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.771+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.980 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.780+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.790+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.799+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.808+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.818+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.827+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.838+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.847+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.857+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.866+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.875+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.885+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.894+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.904+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.914+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.923+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.981 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.932+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.982 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.941+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.982 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.950+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.982 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.960+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.982 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.969+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:43.982 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.979+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.201 INFO:tasks.rados.rados.0.smithi137.stdout:2368: done (2 left) 2024-03-04T06:49:44.201 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 225 2024-03-04T06:49:44.202 INFO:tasks.rados.rados.0.smithi137.stdout:2366: finishing write tid 2 to smithi13777483-9 2024-03-04T06:49:44.202 INFO:tasks.rados.rados.0.smithi137.stdout:2369: seq_num 755 ranges {12140544=647168} 2024-03-04T06:49:44.239 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:44.206+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:44.239 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:44.206+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:44.239 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:44.206+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:44.239 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:44.239 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-mon[85573]: osdmap e514: 8 total, 8 up, 8 in 2024-03-04T06:49:44.239 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:44.239 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:44.239 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:44.239 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:44.239 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:44.239 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:44.240 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:44.240 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:44.208+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:44.240 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.989+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.240 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:43.998+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.240 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.008+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.240 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.017+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.240 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.026+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.036+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.046+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.056+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.065+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.075+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.085+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.095+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.104+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.113+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.123+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.132+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.143+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.152+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.162+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.172+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.242 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.181+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.242 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.190+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.242 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.202+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.242 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.219+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.242 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.228+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.242 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.238+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.272 INFO:tasks.rados.rados.0.smithi137.stdout:2369: writing smithi13777483-2 from 12140544 to 12787712 tid 1 2024-03-04T06:49:44.272 INFO:tasks.rados.rados.0.smithi137.stdout:2370: snap_remove snap 217 2024-03-04T06:49:44.491 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.249+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.491 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.258+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.491 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.268+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.491 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.280+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.492 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.289+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.492 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.298+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.492 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.308+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.492 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.318+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.492 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.327+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.492 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.336+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.492 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.346+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.492 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.356+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.492 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.365+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.492 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.375+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.492 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.385+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.492 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.395+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.492 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.405+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.493 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.414+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.493 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.423+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.493 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.433+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.493 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.442+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.493 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.453+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.493 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.463+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.493 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.472+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.493 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.481+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.493 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.491+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:44.212+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:44.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:44.212+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:44.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:44.212+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:44.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:44.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[91314]: osdmap e514: 8 total, 8 up, 8 in 2024-03-04T06:49:44.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[88869]: osdmap e514: 8 total, 8 up, 8 in 2024-03-04T06:49:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:44.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:44.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:44.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:44.545 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:44.200+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:44.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:44.208+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:44.749 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.500+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.749 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.510+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.749 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.519+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.749 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.529+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.749 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.539+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.749 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.548+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.749 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.557+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.566+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.575+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.585+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.595+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.604+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.614+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.624+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.633+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.644+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.653+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.663+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.672+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.682+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.691+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.701+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.711+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.751 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.720+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.751 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.730+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.751 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.739+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:44.751 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.748+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.001 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.758+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.001 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.769+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.001 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.779+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.001 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.788+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.001 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.797+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.001 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.807+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.001 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.816+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.001 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.825+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.001 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.835+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.845+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.856+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.866+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.875+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.886+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.895+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.904+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.914+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.924+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.933+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.943+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.952+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.962+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.972+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.982+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.002 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:44.991+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.003 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.000+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.214 INFO:tasks.rados.rados.0.smithi137.stdout:2370: done (3 left) 2024-03-04T06:49:45.214 INFO:tasks.rados.rados.0.smithi137.stdout:2371: copy_from oid 30 from oid 36 current snap is 225 2024-03-04T06:49:45.214 INFO:tasks.rados.rados.0.smithi137.stdout:2366: finishing write tid 3 to smithi13777483-9 2024-03-04T06:49:45.214 INFO:tasks.rados.rados.0.smithi137.stdout:2366: oid 9 updating version 0 to 15529 2024-03-04T06:49:45.214 INFO:tasks.rados.rados.0.smithi137.stdout:2366: oid 9 updating version 15529 to 15530 2024-03-04T06:49:45.214 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 15530 (ObjNum 753 snap 225 seq_num 753) dirty exists 2024-03-04T06:49:45.214 INFO:tasks.rados.rados.0.smithi137.stdout:2366: left oid 9 (ObjNum 753 snap 225 seq_num 753) 2024-03-04T06:49:45.214 INFO:tasks.rados.rados.0.smithi137.stdout:2363: finishing write tid 3 to smithi13777483-24 2024-03-04T06:49:45.214 INFO:tasks.rados.rados.0.smithi137.stdout:2363: oid 24 updating version 0 to 16780 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:2363: oid 24 version 16780 is already newer than 16779 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16780 (ObjNum 751 snap 225 seq_num 751) dirty exists 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:2363: left oid 24 (ObjNum 751 snap 225 seq_num 751) 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:2363: done (3 left) 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:2366: done (2 left) 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:2372: read oid 9 snap 221 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:2372: expect (ObjNum 735 snap 215 seq_num 735) 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 5 current snap is 225 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:2369: finishing write tid 1 to smithi13777483-2 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:2369: finishing write tid 2 to smithi13777483-2 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:2369: finishing write tid 3 to smithi13777483-2 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:2369: oid 2 updating version 0 to 16798 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:2369: oid 2 version 16798 is already newer than 16797 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16798 (ObjNum 755 snap 225 seq_num 755) dirty exists 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:2369: left oid 2 (ObjNum 755 snap 225 seq_num 755) 2024-03-04T06:49:45.215 INFO:tasks.rados.rados.0.smithi137.stdout:2373: seq_num 756 ranges {5308416=671744} 2024-03-04T06:49:45.247 INFO:tasks.rados.rados.0.smithi137.stdout:2373: writing smithi13777483-5 from 5308416 to 5980160 tid 1 2024-03-04T06:49:45.247 INFO:tasks.rados.rados.0.smithi137.stdout:2369: done (3 left) 2024-03-04T06:49:45.247 INFO:tasks.rados.rados.0.smithi137.stdout:2374: snap_remove snap 224 2024-03-04T06:49:45.255 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:45.215+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:45.256 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:45.206+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:45.256 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:45.206+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:45.256 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:45.256 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-mon[85573]: osdmap e515: 8 total, 8 up, 8 in 2024-03-04T06:49:45.256 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:45.256 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:45.256 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:45.256 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:45.256 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:45.256 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:45.257 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-mon[85573]: pgmap v449: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 361 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 784 KiB/s wr, 9 op/s 2024-03-04T06:49:45.257 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.010+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.257 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.020+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.257 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.029+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.257 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.039+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.257 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.048+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.257 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.058+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.257 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.068+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.257 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.078+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.257 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.087+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.257 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.097+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.106+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.116+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.126+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.135+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.144+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.153+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.163+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.172+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.181+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.191+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.201+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.223+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.235+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.245+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.258 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.255+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.509 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.265+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.509 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.275+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.509 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.284+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.509 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.294+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.509 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.303+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.509 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.314+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.509 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.323+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.509 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.333+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.509 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.343+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.509 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.353+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.509 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.362+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.509 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.372+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.381+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.391+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.401+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.410+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.419+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.429+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.438+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.448+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.457+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.466+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.476+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.486+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.497+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.508+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:49:45] "GET /metrics HTTP/1.1" 200 36261 "" "Prometheus/2.43.0" 2024-03-04T06:49:45.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:45.211+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:45.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:45.212+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:45.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[88869]: osdmap e515: 8 total, 8 up, 8 in 2024-03-04T06:49:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[88869]: pgmap v449: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 361 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 784 KiB/s wr, 9 op/s 2024-03-04T06:49:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[91314]: osdmap e515: 8 total, 8 up, 8 in 2024-03-04T06:49:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-mon[91314]: pgmap v449: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 361 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 784 KiB/s wr, 9 op/s 2024-03-04T06:49:45.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:45.221+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:45.545 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:45.219+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:45.762 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.517+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.762 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.526+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.762 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.536+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.762 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.545+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.762 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.555+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.762 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.564+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.762 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.574+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.584+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.593+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.602+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.612+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.621+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.630+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.640+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.649+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.658+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.667+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.677+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.686+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.695+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.704+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.763 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.714+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.764 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.723+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.764 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.733+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.764 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.743+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.764 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.752+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:45.764 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.761+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.018 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.771+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.018 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.781+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.018 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.790+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.018 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.800+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.018 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.810+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.018 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.819+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.018 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.828+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.018 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.838+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.019 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.848+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.019 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.857+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.019 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.866+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.019 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.876+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.019 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.886+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.019 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.895+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.019 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.905+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.019 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.914+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.019 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.923+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.019 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.932+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.019 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.942+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.019 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.951+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.020 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.960+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.020 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.970+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.020 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.979+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.020 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.988+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.020 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:45.997+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.020 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.007+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.020 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.017+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.215 INFO:tasks.rados.rados.0.smithi137.stdout:2371: finishing copy_from to smithi13777483-30 2024-03-04T06:49:46.215 INFO:tasks.rados.rados.0.smithi137.stdout:2371: got expected ENOENT (src dne) 2024-03-04T06:49:46.215 INFO:tasks.rados.rados.0.smithi137.stdout:2371: finishing copy_from racing read to smithi13777483-30 2024-03-04T06:49:46.215 INFO:tasks.rados.rados.0.smithi137.stdout:2372: expect (ObjNum 735 snap 215 seq_num 735) 2024-03-04T06:49:46.234 INFO:tasks.rados.rados.0.smithi137.stdout:2373: finishing write tid 1 to smithi13777483-5 2024-03-04T06:49:46.234 INFO:tasks.rados.rados.0.smithi137.stdout:2373: finishing write tid 2 to smithi13777483-5 2024-03-04T06:49:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:2373: finishing write tid 3 to smithi13777483-5 2024-03-04T06:49:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:2373: oid 5 updating version 0 to 15532 2024-03-04T06:49:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:2373: oid 5 version 15532 is already newer than 15531 2024-03-04T06:49:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 15532 (ObjNum 756 snap 225 seq_num 756) dirty exists 2024-03-04T06:49:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:2373: left oid 5 (ObjNum 756 snap 225 seq_num 756) 2024-03-04T06:49:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:2371: done (3 left) 2024-03-04T06:49:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:2372: done (2 left) 2024-03-04T06:49:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:2373: done (1 left) 2024-03-04T06:49:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:2374: done (0 left) 2024-03-04T06:49:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 225 2024-03-04T06:49:46.235 INFO:tasks.rados.rados.0.smithi137.stdout:2375: seq_num 757 ranges {0=688128} 2024-03-04T06:49:46.238 INFO:tasks.rados.rados.0.smithi137.stdout:2375: writing smithi13777483-16 from 0 to 688128 tid 1 2024-03-04T06:49:46.238 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 225 2024-03-04T06:49:46.238 INFO:tasks.rados.rados.0.smithi137.stdout:2376: seq_num 758 ranges {2908160=704512} 2024-03-04T06:49:46.258 INFO:tasks.rados.rados.0.smithi137.stdout:2376: writing smithi13777483-4 from 2908160 to 3612672 tid 1 2024-03-04T06:49:46.258 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 225 2024-03-04T06:49:46.259 INFO:tasks.rados.rados.0.smithi137.stdout:2377: seq_num 759 ranges {0=720896} 2024-03-04T06:49:46.263 INFO:tasks.rados.rados.0.smithi137.stdout:2377: writing smithi13777483-25 from 0 to 720896 tid 1 2024-03-04T06:49:46.263 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 48 current snap is 225 2024-03-04T06:49:46.263 INFO:tasks.rados.rados.0.smithi137.stdout:2375: finishing write tid 1 to smithi13777483-16 2024-03-04T06:49:46.263 INFO:tasks.rados.rados.0.smithi137.stdout:2375: finishing write tid 2 to smithi13777483-16 2024-03-04T06:49:46.264 INFO:tasks.rados.rados.0.smithi137.stdout:2375: finishing write tid 3 to smithi13777483-16 2024-03-04T06:49:46.264 INFO:tasks.rados.rados.0.smithi137.stdout:2375: oid 16 updating version 0 to 16809 2024-03-04T06:49:46.264 INFO:tasks.rados.rados.0.smithi137.stdout:2375: oid 16 updating version 16809 to 16810 2024-03-04T06:49:46.264 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16810 (ObjNum 757 snap 225 seq_num 757) dirty exists 2024-03-04T06:49:46.264 INFO:tasks.rados.rados.0.smithi137.stdout:2375: left oid 16 (ObjNum 757 snap 225 seq_num 757) 2024-03-04T06:49:46.264 INFO:tasks.rados.rados.0.smithi137.stdout:2376: finishing write tid 1 to smithi13777483-4 2024-03-04T06:49:46.264 INFO:tasks.rados.rados.0.smithi137.stdout:2376: finishing write tid 2 to smithi13777483-4 2024-03-04T06:49:46.264 INFO:tasks.rados.rados.0.smithi137.stdout:2378: seq_num 760 ranges {3235840=737280} 2024-03-04T06:49:46.273 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:46.218+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:46.274 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:46.213+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:46.274 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:46.213+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:46.274 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:46.213+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:46.274 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:46.274 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:46.274 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:46.274 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:46.275 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-mon[85573]: osdmap e516: 8 total, 8 up, 8 in 2024-03-04T06:49:46.275 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:46.275 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:46.275 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:46.275 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.027+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.275 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.036+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.275 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.046+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.275 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.056+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.275 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.065+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.275 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.075+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.087+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.097+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.106+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.115+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.127+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.138+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.147+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.157+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.166+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.176+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.185+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.194+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.204+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.276 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.221+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.277 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.231+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.277 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.240+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.277 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.252+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.277 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.262+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.277 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.273+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.286 INFO:tasks.rados.rados.0.smithi137.stdout:2378: writing smithi13777483-48 from 3235840 to 3973120 tid 1 2024-03-04T06:49:46.286 INFO:tasks.rados.rados.0.smithi137.stdout:2375: done (3 left) 2024-03-04T06:49:46.286 INFO:tasks.rados.rados.0.smithi137.stdout:2379: rollback oid 1 current snap is 225 2024-03-04T06:49:46.286 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 1 to 222 2024-03-04T06:49:46.286 INFO:tasks.rados.rados.0.smithi137.stdout:2376: finishing write tid 3 to smithi13777483-4 2024-03-04T06:49:46.286 INFO:tasks.rados.rados.0.smithi137.stdout:2376: oid 4 updating version 0 to 174 2024-03-04T06:49:46.286 INFO:tasks.rados.rados.0.smithi137.stdout:2376: oid 4 version 174 is already newer than 173 2024-03-04T06:49:46.286 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 174 (ObjNum 758 snap 225 seq_num 758) dirty exists 2024-03-04T06:49:46.286 INFO:tasks.rados.rados.0.smithi137.stdout:2376: left oid 4 (ObjNum 758 snap 225 seq_num 758) 2024-03-04T06:49:46.286 INFO:tasks.rados.rados.0.smithi137.stdout:2377: finishing write tid 1 to smithi13777483-25 2024-03-04T06:49:46.286 INFO:tasks.rados.rados.0.smithi137.stdout:2377: finishing write tid 2 to smithi13777483-25 2024-03-04T06:49:46.286 INFO:tasks.rados.rados.0.smithi137.stdout:2377: finishing write tid 3 to smithi13777483-25 2024-03-04T06:49:46.287 INFO:tasks.rados.rados.0.smithi137.stdout:2377: oid 25 updating version 0 to 16818 2024-03-04T06:49:46.287 INFO:tasks.rados.rados.0.smithi137.stdout:2377: oid 25 updating version 16818 to 16819 2024-03-04T06:49:46.287 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 16819 (ObjNum 759 snap 225 seq_num 759) dirty exists 2024-03-04T06:49:46.287 INFO:tasks.rados.rados.0.smithi137.stdout:2377: left oid 25 (ObjNum 759 snap 225 seq_num 759) 2024-03-04T06:49:46.287 INFO:tasks.rados.rados.0.smithi137.stdout:2376: done (3 left) 2024-03-04T06:49:46.287 INFO:tasks.rados.rados.0.smithi137.stdout:2377: done (2 left) 2024-03-04T06:49:46.287 INFO:tasks.rados.rados.0.smithi137.stdout:2380: snap_create 2024-03-04T06:49:46.292 INFO:tasks.rados.rados.0.smithi137.stdout:2378: finishing write tid 1 to smithi13777483-48 2024-03-04T06:49:46.292 INFO:tasks.rados.rados.0.smithi137.stdout:2378: finishing write tid 2 to smithi13777483-48 2024-03-04T06:49:46.292 INFO:tasks.rados.rados.0.smithi137.stdout:2379: finishing rollback tid 0 to smithi13777483-1 2024-03-04T06:49:46.293 INFO:tasks.rados.rados.0.smithi137.stdout:2379: finishing rollback tid 1 to smithi13777483-1 2024-03-04T06:49:46.295 INFO:tasks.rados.rados.0.smithi137.stdout:2378: finishing write tid 3 to smithi13777483-48 2024-03-04T06:49:46.295 INFO:tasks.rados.rados.0.smithi137.stdout:2378: oid 48 updating version 0 to 16799 2024-03-04T06:49:46.295 INFO:tasks.rados.rados.0.smithi137.stdout:2378: oid 48 updating version 16799 to 16800 2024-03-04T06:49:46.295 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 16800 (ObjNum 760 snap 225 seq_num 760) dirty exists 2024-03-04T06:49:46.295 INFO:tasks.rados.rados.0.smithi137.stdout:2378: left oid 48 (ObjNum 760 snap 225 seq_num 760) 2024-03-04T06:49:46.295 INFO:tasks.rados.rados.0.smithi137.stdout:2379: finishing rollback tid 2 to smithi13777483-1 2024-03-04T06:49:46.295 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 16803 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:49:46.528 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.284+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.528 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.296+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.528 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.305+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.528 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.315+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.528 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.325+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.528 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.335+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.528 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.344+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.528 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.354+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.363+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.373+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.382+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.392+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.402+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.411+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.421+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.431+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.440+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.449+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.458+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.468+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.477+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.487+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.496+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.529 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.506+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.530 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.516+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.530 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.527+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:46.216+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:46.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:46.216+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:46.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:46.218+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:46.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:46.219+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:46.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:46.219+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[88869]: osdmap e516: 8 total, 8 up, 8 in 2024-03-04T06:49:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[91314]: osdmap e516: 8 total, 8 up, 8 in 2024-03-04T06:49:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:46.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.537+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.547+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.557+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.566+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.778 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.576+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.586+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.596+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.605+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.615+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.624+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.633+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.643+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.652+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.661+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.670+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.681+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.691+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.700+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.710+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.779 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.720+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.780 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.729+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.780 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.738+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.780 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.747+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.780 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.758+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.780 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.767+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:46.780 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.777+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.787+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.797+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.806+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.815+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.825+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.835+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.844+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.854+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.863+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.873+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.882+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.029 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.892+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.901+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.911+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.920+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.930+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.941+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.951+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.961+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.970+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.980+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.990+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:46.999+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.009+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.018+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.030 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.028+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.218 INFO:tasks.rados.rados.0.smithi137.stdout:2378: done (2 left) 2024-03-04T06:49:47.218 INFO:tasks.rados.rados.0.smithi137.stdout:2379: done (1 left) 2024-03-04T06:49:47.219 INFO:tasks.rados.rados.0.smithi137.stdout:2380: done (0 left) 2024-03-04T06:49:47.219 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 226 2024-03-04T06:49:47.219 INFO:tasks.rados.rados.0.smithi137.stdout:2381: seq_num 761 ranges {3620864=753664} 2024-03-04T06:49:47.243 INFO:tasks.rados.rados.0.smithi137.stdout:2381: writing smithi13777483-10 from 3620864 to 4374528 tid 1 2024-03-04T06:49:47.243 INFO:tasks.rados.rados.0.smithi137.stdout:2382: read oid 21 snap -1 2024-03-04T06:49:47.243 INFO:tasks.rados.rados.0.smithi137.stdout:2382: expect deleted 2024-03-04T06:49:47.243 INFO:tasks.rados.rados.0.smithi137.stdout:2383: snap_remove snap 225 2024-03-04T06:49:47.284 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:47.248+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:47.285 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:47.252+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:47.285 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:47.252+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:47.285 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:47.285 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:47.285 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-mon[85573]: osdmap e517: 8 total, 8 up, 8 in 2024-03-04T06:49:47.285 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:47.285 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:47.285 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:47.285 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:47.285 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:47.286 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-mon[85573]: pgmap v452: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 361 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 784 KiB/s wr, 9 op/s 2024-03-04T06:49:47.286 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.038+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.286 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.047+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.286 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.057+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.286 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.067+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.286 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.077+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.286 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.086+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.286 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.096+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.286 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.105+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.115+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.124+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.133+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.142+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.152+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.161+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.171+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.180+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.190+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.199+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.209+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.222+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.233+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.243+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.287 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.256+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.288 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.265+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.288 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.274+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.288 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.284+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.294+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.304+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.313+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.323+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.535 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.332+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.342+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.351+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.361+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.370+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.380+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.390+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.401+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.411+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.420+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.430+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.439+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.449+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.536 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.459+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.469+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.478+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.488+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.497+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.506+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.516+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.525+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.537 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.534+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:47.248+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:47.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:47.248+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:47.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:47.217+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:47.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:47.247+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[88869]: osdmap e517: 8 total, 8 up, 8 in 2024-03-04T06:49:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[88869]: pgmap v452: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 361 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 784 KiB/s wr, 9 op/s 2024-03-04T06:49:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[91314]: osdmap e517: 8 total, 8 up, 8 in 2024-03-04T06:49:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:47 smithi137 ceph-mon[91314]: pgmap v452: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 361 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 784 KiB/s wr, 9 op/s 2024-03-04T06:49:47.795 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.544+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.795 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.554+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.795 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.565+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.795 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.574+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.795 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.584+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.795 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.594+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.795 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.604+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.795 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.614+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.795 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.623+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.795 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.633+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.796 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.643+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.796 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.652+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.796 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.662+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.796 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.671+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.796 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.681+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.796 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.690+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.796 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.699+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.796 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.708+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.796 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.718+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.796 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.727+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.796 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.736+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.797 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.746+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.797 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.756+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.797 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.765+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.797 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.775+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.797 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.784+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:47.797 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.794+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.049 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.804+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.049 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.814+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.049 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.823+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.050 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.833+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.050 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.843+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.050 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.853+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.050 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.862+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.050 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.872+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.050 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.882+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.050 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.891+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.050 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.901+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.050 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.911+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.050 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.920+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.050 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.929+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.050 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.940+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.950+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.959+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.969+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.978+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.989+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:47.999+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.009+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.019+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.028+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.038+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.048+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.225 INFO:tasks.rados.rados.0.smithi137.stdout:2383: done (2 left) 2024-03-04T06:49:48.225 INFO:tasks.rados.rados.0.smithi137.stdout:2384: read oid 23 snap -1 2024-03-04T06:49:48.225 INFO:tasks.rados.rados.0.smithi137.stdout:2384: expect (ObjNum 638 snap 178 seq_num 638) 2024-03-04T06:49:48.225 INFO:tasks.rados.rados.0.smithi137.stdout:2385: delete oid 32 current snap is 226 2024-03-04T06:49:48.225 INFO:tasks.rados.rados.0.smithi137.stdout:2381: finishing write tid 1 to smithi13777483-10 2024-03-04T06:49:48.225 INFO:tasks.rados.rados.0.smithi137.stdout:2381: finishing write tid 2 to smithi13777483-10 2024-03-04T06:49:48.225 INFO:tasks.rados.rados.0.smithi137.stdout:2381: finishing write tid 3 to smithi13777483-10 2024-03-04T06:49:48.225 INFO:tasks.rados.rados.0.smithi137.stdout:2381: oid 10 updating version 0 to 15534 2024-03-04T06:49:48.225 INFO:tasks.rados.rados.0.smithi137.stdout:2381: oid 10 version 15534 is already newer than 15533 2024-03-04T06:49:48.225 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15534 (ObjNum 761 snap 226 seq_num 761) dirty exists 2024-03-04T06:49:48.225 INFO:tasks.rados.rados.0.smithi137.stdout:2381: left oid 10 (ObjNum 761 snap 226 seq_num 761) 2024-03-04T06:49:48.232 INFO:tasks.rados.rados.0.smithi137.stdout:2381: done (3 left) 2024-03-04T06:49:48.232 INFO:tasks.rados.rados.0.smithi137.stdout:2382: done (2 left) 2024-03-04T06:49:48.232 INFO:tasks.rados.rados.0.smithi137.stdout:2385: done (1 left) 2024-03-04T06:49:48.232 INFO:tasks.rados.rados.0.smithi137.stdout:2386: rmattr oid 2 current snap is 226 2024-03-04T06:49:48.232 INFO:tasks.rados.rados.0.smithi137.stdout:2386: done (1 left) 2024-03-04T06:49:48.232 INFO:tasks.rados.rados.0.smithi137.stdout:2387: read oid 12 snap -1 2024-03-04T06:49:48.232 INFO:tasks.rados.rados.0.smithi137.stdout:2387: expect (ObjNum 745 snap 223 seq_num 745) 2024-03-04T06:49:48.232 INFO:tasks.rados.rados.0.smithi137.stdout:2388: delete oid 47 current snap is 226 2024-03-04T06:49:48.234 INFO:tasks.rados.rados.0.smithi137.stdout:2384: expect (ObjNum 638 snap 178 seq_num 638) 2024-03-04T06:49:48.264 INFO:tasks.rados.rados.0.smithi137.stdout:2387: expect (ObjNum 745 snap 223 seq_num 745) 2024-03-04T06:49:48.303 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:48.231+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:48.304 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:48.229+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:48.304 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:48.229+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:48.304 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:48.229+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:48.304 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:48.304 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-mon[85573]: osdmap e518: 8 total, 8 up, 8 in 2024-03-04T06:49:48.304 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:48.304 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:48.305 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:48.305 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:48.305 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:48.305 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:48.305 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.058+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.305 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.067+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.305 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.077+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.305 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.087+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.305 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.096+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.105+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.115+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.125+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.135+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.144+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.154+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.164+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.173+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.183+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.193+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.202+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.212+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.223+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.306 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.243+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.254+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.263+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.273+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.282+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.291+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.307 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.303+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.421 INFO:tasks.rados.rados.0.smithi137.stdout:2384: done (2 left) 2024-03-04T06:49:48.421 INFO:tasks.rados.rados.0.smithi137.stdout:2387: done (1 left) 2024-03-04T06:49:48.421 INFO:tasks.rados.rados.0.smithi137.stdout:2388: done (0 left) 2024-03-04T06:49:48.421 INFO:tasks.rados.rados.0.smithi137.stdout:2389: setattr oid 38 current snap is 226 2024-03-04T06:49:48.422 INFO:tasks.rados.rados.0.smithi137.stdout:2390: read oid 14 snap -1 2024-03-04T06:49:48.422 INFO:tasks.rados.rados.0.smithi137.stdout:2390: expect deleted 2024-03-04T06:49:48.422 INFO:tasks.rados.rados.0.smithi137.stdout:2391: snap_create 2024-03-04T06:49:48.424 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16820 (ObjNum 709 snap 204 seq_num 709) dirty exists 2024-03-04T06:49:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[88869]: osdmap e518: 8 total, 8 up, 8 in 2024-03-04T06:49:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[91314]: osdmap e518: 8 total, 8 up, 8 in 2024-03-04T06:49:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:48.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:48.228+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:48.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:48.230+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:48.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:48.230+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:48.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:48.230+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:48.557 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.314+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.557 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.323+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.557 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.332+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.557 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.342+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.557 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.351+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.557 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.360+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.370+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.381+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.391+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.400+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.410+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.419+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.429+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.438+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.448+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.458+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.468+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.477+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.487+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.497+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.558 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.507+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.559 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.517+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.559 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.526+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.559 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.536+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.559 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.546+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.559 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.556+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.816 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.566+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.575+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.585+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.594+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.604+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.614+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.623+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.632+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.642+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.651+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.661+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.672+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.682+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.691+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.700+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.817 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.710+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.818 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.719+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.818 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.729+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.818 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.738+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.818 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.748+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.818 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.757+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.818 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.767+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.818 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.777+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.818 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.786+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.818 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.795+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.818 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.806+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:48.818 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.815+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:48.558+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:49.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.825+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.834+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.844+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.854+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.863+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.872+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.881+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.890+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.900+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.911+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.923+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.934+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.946+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.957+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.969+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.982+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:48.993+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.005+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.018+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.032+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.047+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.061+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.076 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.073+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.230 INFO:tasks.rados.rados.0.smithi137.stdout:2389: done (2 left) 2024-03-04T06:49:49.230 INFO:tasks.rados.rados.0.smithi137.stdout:2390: done (1 left) 2024-03-04T06:49:49.230 INFO:tasks.rados.rados.0.smithi137.stdout:2391: done (0 left) 2024-03-04T06:49:49.231 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 227 2024-03-04T06:49:49.231 INFO:tasks.rados.rados.0.smithi137.stdout:2392: seq_num 764 ranges {1089536=802816} 2024-03-04T06:49:49.241 INFO:tasks.rados.rados.0.smithi137.stdout:2392: writing smithi13777483-23 from 1089536 to 1892352 tid 1 2024-03-04T06:49:49.241 INFO:tasks.rados.rados.0.smithi137.stdout:2393: snap_create 2024-03-04T06:49:49.246 INFO:tasks.rados.rados.0.smithi137.stdout:2392: finishing write tid 1 to smithi13777483-23 2024-03-04T06:49:49.246 INFO:tasks.rados.rados.0.smithi137.stdout:2392: finishing write tid 2 to smithi13777483-23 2024-03-04T06:49:49.248 INFO:tasks.rados.rados.0.smithi137.stdout:2392: finishing write tid 3 to smithi13777483-23 2024-03-04T06:49:49.248 INFO:tasks.rados.rados.0.smithi137.stdout:2392: oid 23 updating version 0 to 15515 2024-03-04T06:49:49.248 INFO:tasks.rados.rados.0.smithi137.stdout:2392: oid 23 version 15515 is already newer than 15514 2024-03-04T06:49:49.248 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 15515 (ObjNum 764 snap 227 seq_num 764) dirty exists 2024-03-04T06:49:49.248 INFO:tasks.rados.rados.0.smithi137.stdout:2392: left oid 23 (ObjNum 764 snap 227 seq_num 764) 2024-03-04T06:49:49.324 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:49.230+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:49.324 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:49.231+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:49.324 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:49.234+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:49.325 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-mon[85573]: osdmap e519: 8 total, 8 up, 8 in 2024-03-04T06:49:49.325 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:49.325 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:49.325 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:49.325 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:49.325 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:49.325 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:49.325 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-mon[85573]: pgmap v455: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 366 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 338 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-03-04T06:49:49.325 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:49.325 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-04T06:49:49.326 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.085+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.326 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.096+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.326 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.108+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.326 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.121+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.326 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.134+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.326 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.147+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.326 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.159+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.326 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.170+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.326 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.182+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.326 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.195+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.326 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.206+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.326 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.219+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.326 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.235+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.327 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.248+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.327 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.260+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.327 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.272+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.327 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.285+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.327 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.298+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.327 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.311+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:49.305+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:49.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:49.304+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:49.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:49.229+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:49.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:49.229+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[91314]: osdmap e519: 8 total, 8 up, 8 in 2024-03-04T06:49:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:49.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:49.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[91314]: pgmap v455: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 366 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 338 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-03-04T06:49:49.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:49.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-04T06:49:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[88869]: osdmap e519: 8 total, 8 up, 8 in 2024-03-04T06:49:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[88869]: pgmap v455: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 366 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 338 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-03-04T06:49:49.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:49.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:49 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-04T06:49:49.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.324+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.337+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.350+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.576 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.363+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.576 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.376+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.576 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.389+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.576 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.401+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.576 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.412+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.576 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.424+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.576 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.435+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.576 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.449+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.576 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.462+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.576 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.475+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.576 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.488+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.576 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.501+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.577 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.515+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.577 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.527+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.577 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.537+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.577 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.546+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.577 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.556+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.577 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.565+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.577 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.575+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.833 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.585+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.833 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.595+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.833 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.604+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.833 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.614+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.624+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.633+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.644+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.654+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.663+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.672+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.682+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.691+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.700+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.710+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.719+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.729+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.834 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.741+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.752+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.764+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.775+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.784+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.793+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.804+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.813+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.822+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:49.835 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.831+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.842+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.852+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.087 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.862+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.871+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.883+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.895+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.906+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.919+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.930+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.940+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.952+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.965+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.979+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:49.991+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.004+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.018+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.088 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.029+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.089 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.039+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.089 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.048+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.089 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.058+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.089 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.067+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.089 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.077+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.089 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.086+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.236 INFO:tasks.rados.rados.0.smithi137.stdout:2392: done (1 left) 2024-03-04T06:49:50.236 INFO:tasks.rados.rados.0.smithi137.stdout:2393: done (0 left) 2024-03-04T06:49:50.236 INFO:tasks.rados.rados.0.smithi137.stdout:2394: delete oid 5 current snap is 228 2024-03-04T06:49:50.240 INFO:tasks.rados.rados.0.smithi137.stdout:2394: done (0 left) 2024-03-04T06:49:50.240 INFO:tasks.rados.rados.0.smithi137.stdout:2395: delete oid 6 current snap is 228 2024-03-04T06:49:50.245 INFO:tasks.rados.rados.0.smithi137.stdout:2395: done (0 left) 2024-03-04T06:49:50.245 INFO:tasks.rados.rados.0.smithi137.stdout:2396: read oid 20 snap 222 2024-03-04T06:49:50.245 INFO:tasks.rados.rados.0.smithi137.stdout:2396: expect (ObjNum 568 snap 159 seq_num 568) 2024-03-04T06:49:50.245 INFO:tasks.rados.rados.0.smithi137.stdout:2397: read oid 16 snap -1 2024-03-04T06:49:50.245 INFO:tasks.rados.rados.0.smithi137.stdout:2397: expect (ObjNum 757 snap 225 seq_num 757) 2024-03-04T06:49:50.246 INFO:tasks.rados.rados.0.smithi137.stdout:2398: snap_remove snap 208 2024-03-04T06:49:50.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:50.236+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:50.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:50.242+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:50.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:50.243+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:50.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:50.245+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-04T06:49:50.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-mon[85573]: Upgrade: osd.7 is safe to restart 2024-03-04T06:49:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-mon[85573]: osdmap e520: 8 total, 8 up, 8 in 2024-03-04T06:49:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:50.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.097+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.106+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.117+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.348 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.126+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.348 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.136+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.348 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.146+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.348 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.156+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.348 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.165+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.348 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.176+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.348 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.185+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.348 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.194+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.348 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.203+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.348 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.213+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.348 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.223+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.348 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.234+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.349 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.250+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.349 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.265+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.349 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.278+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.349 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.289+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.349 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.299+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.349 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.309+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.349 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.318+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.349 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.327+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.349 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.336+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.349 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.346+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:50.246+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:50.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:50.235+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:50.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:50.235+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:50.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:50.235+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-04T06:49:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[91314]: Upgrade: osd.7 is safe to restart 2024-03-04T06:49:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[91314]: osdmap e520: 8 total, 8 up, 8 in 2024-03-04T06:49:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-04T06:49:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[88869]: Upgrade: osd.7 is safe to restart 2024-03-04T06:49:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[88869]: osdmap e520: 8 total, 8 up, 8 in 2024-03-04T06:49:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:50.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.355+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.365+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.375+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.385+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.395+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.606 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.404+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.414+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.424+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.434+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.444+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.453+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.462+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.472+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.481+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.490+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.500+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.509+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.519+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.528+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.537+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.607 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.547+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.608 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.557+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.608 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.566+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.608 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.576+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.608 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.585+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.608 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.594+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.608 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.605+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.864 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.615+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.864 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.625+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.865 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.634+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.865 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.644+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.865 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.654+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.865 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.663+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.865 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.674+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.865 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.683+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.865 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.692+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.865 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.701+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.865 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.710+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.865 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.721+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.865 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.730+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.865 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.740+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.865 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.750+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.866 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.760+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.866 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.769+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.866 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.778+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.866 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.788+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.866 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.800+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.866 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.811+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.866 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.824+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.866 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.833+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.866 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.843+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.866 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.853+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:50.866 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.862+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:50.666+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:51.124 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.872+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.124 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.884+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.124 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.897+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.124 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.910+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.124 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.921+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.124 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.933+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.124 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.946+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.124 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.956+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.968+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.980+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:50.991+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.002+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.014+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.027+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.040+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.053+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.064+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.075+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.088+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.099+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.111+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.125 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.123+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.244 INFO:tasks.rados.rados.0.smithi137.stdout:2398: done (2 left) 2024-03-04T06:49:51.244 INFO:tasks.rados.rados.0.smithi137.stdout:2399: copy_from oid 34 from oid 21 current snap is 228 2024-03-04T06:49:51.244 INFO:tasks.rados.rados.0.smithi137.stdout:2397: expect (ObjNum 757 snap 225 seq_num 757) 2024-03-04T06:49:51.270 INFO:tasks.rados.rados.0.smithi137.stdout:2396: expect (ObjNum 568 snap 159 seq_num 568) 2024-03-04T06:49:51.378 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:51.243+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:51.378 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:51.244+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:51.378 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:51.250+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:51.379 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-mon[85573]: osdmap e521: 8 total, 8 up, 8 in 2024-03-04T06:49:51.379 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:51.379 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:51.379 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:51.379 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:51.379 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:51.379 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:51.379 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-mon[85573]: pgmap v458: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 366 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 338 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-03-04T06:49:51.379 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:51.379 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:51.379 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-04T06:49:51.379 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:49:51.380 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.134+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.380 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.146+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.380 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.159+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.380 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.174+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.380 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.185+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.380 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.197+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.380 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.208+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.380 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.219+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.380 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.229+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.380 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.243+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.380 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.263+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.381 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.275+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.381 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.286+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.381 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.296+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.381 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.307+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.381 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.320+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.381 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.332+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.381 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.344+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.381 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.354+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.381 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.365+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.381 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.378+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:51.246+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:51.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:51.250+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:51.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:51.241+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:51.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:51.241+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[88869]: osdmap e521: 8 total, 8 up, 8 in 2024-03-04T06:49:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[88869]: pgmap v458: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 366 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 338 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-03-04T06:49:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-04T06:49:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:49:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[91314]: osdmap e521: 8 total, 8 up, 8 in 2024-03-04T06:49:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[91314]: pgmap v458: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 366 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 338 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-03-04T06:49:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:49:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-04T06:49:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:51 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:49:51.636 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.391+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.409+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.422+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.436+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.455+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.467+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.477+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.487+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.497+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.507+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.517+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.526+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.536+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.546+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.637 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.556+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.638 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.565+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.638 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.575+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.638 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.585+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.638 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.596+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.638 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.605+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.638 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.615+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.638 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.626+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.638 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.636+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.644 INFO:tasks.rados.rados.0.smithi137.stdout:2399: finishing copy_from to smithi13777483-34 2024-03-04T06:49:51.645 INFO:tasks.rados.rados.0.smithi137.stdout:2399: got expected ENOENT (src dne) 2024-03-04T06:49:51.645 INFO:tasks.rados.rados.0.smithi137.stdout:2399: finishing copy_from racing read to smithi13777483-34 2024-03-04T06:49:51.645 INFO:tasks.rados.rados.0.smithi137.stdout:2396: done (2 left) 2024-03-04T06:49:51.645 INFO:tasks.rados.rados.0.smithi137.stdout:2397: done (1 left) 2024-03-04T06:49:51.645 INFO:tasks.rados.rados.0.smithi137.stdout:2399: done (0 left) 2024-03-04T06:49:51.645 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 228 2024-03-04T06:49:51.645 INFO:tasks.rados.rados.0.smithi137.stdout:2400: seq_num 767 ranges {1712128=450560,2162688=401408} 2024-03-04T06:49:51.656 INFO:tasks.rados.rados.0.smithi137.stdout:2400: writing smithi13777483-8 from 1712128 to 2162688 tid 1 2024-03-04T06:49:51.659 INFO:tasks.rados.rados.0.smithi137.stdout:2400: writing smithi13777483-8 from 2162688 to 2564096 tid 2 2024-03-04T06:49:51.659 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 228 2024-03-04T06:49:51.659 INFO:tasks.rados.rados.0.smithi137.stdout:2400: finishing write tid 1 to smithi13777483-8 2024-03-04T06:49:51.659 INFO:tasks.rados.rados.0.smithi137.stdout:2401: seq_num 768 ranges {0=466944,466944=401408} 2024-03-04T06:49:51.662 INFO:tasks.rados.rados.0.smithi137.stdout:2401: writing smithi13777483-30 from 0 to 466944 tid 1 2024-03-04T06:49:51.665 INFO:tasks.rados.rados.0.smithi137.stdout:2401: writing smithi13777483-30 from 466944 to 868352 tid 2 2024-03-04T06:49:51.665 INFO:tasks.rados.rados.0.smithi137.stdout:2402: read oid 44 snap -1 2024-03-04T06:49:51.665 INFO:tasks.rados.rados.0.smithi137.stdout:2402: expect deleted 2024-03-04T06:49:51.665 INFO:tasks.rados.rados.0.smithi137.stdout:2403: snap_remove snap 203 2024-03-04T06:49:51.893 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.646+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.893 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.656+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.893 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.669+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.680+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.693+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.704+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.714+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.723+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.733+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.743+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.752+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.762+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.771+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.781+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.791+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.802+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.815+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.828+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.894 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.843+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.853+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.863+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.873+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.883+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:51.895 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.892+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.903+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.913+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.922+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.933+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.943+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.155 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.952+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.961+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.971+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.981+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:51.990+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.000+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.009+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.019+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.028+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.037+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.047+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.156 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.057+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.157 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.066+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.157 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.076+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.157 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.085+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.157 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.095+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.157 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.104+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.157 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.114+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.157 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.123+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.157 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.133+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.157 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.142+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.157 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.152+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.249 INFO:tasks.rados.rados.0.smithi137.stdout:2403: done (3 left) 2024-03-04T06:49:52.249 INFO:tasks.rados.rados.0.smithi137.stdout:2404: read oid 39 snap 209 2024-03-04T06:49:52.249 INFO:tasks.rados.rados.0.smithi137.stdout:2404: expect (ObjNum 716 snap 209 seq_num 716) 2024-03-04T06:49:52.249 INFO:tasks.rados.rados.0.smithi137.stdout:2405: read oid 48 snap -1 2024-03-04T06:49:52.249 INFO:tasks.rados.rados.0.smithi137.stdout:2405: expect (ObjNum 760 snap 225 seq_num 760) 2024-03-04T06:49:52.249 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 228 2024-03-04T06:49:52.249 INFO:tasks.rados.rados.0.smithi137.stdout:2400: finishing write tid 2 to smithi13777483-8 2024-03-04T06:49:52.249 INFO:tasks.rados.rados.0.smithi137.stdout:2400: finishing write tid 3 to smithi13777483-8 2024-03-04T06:49:52.249 INFO:tasks.rados.rados.0.smithi137.stdout:2401: finishing write tid 1 to smithi13777483-30 2024-03-04T06:49:52.249 INFO:tasks.rados.rados.0.smithi137.stdout:2401: finishing write tid 2 to smithi13777483-30 2024-03-04T06:49:52.249 INFO:tasks.rados.rados.0.smithi137.stdout:2406: seq_num 769 ranges {0=483328,483328=401408} 2024-03-04T06:49:52.251 INFO:tasks.rados.rados.0.smithi137.stdout:2406: writing smithi13777483-14 from 0 to 483328 tid 1 2024-03-04T06:49:52.255 INFO:tasks.rados.rados.0.smithi137.stdout:2406: writing smithi13777483-14 from 483328 to 884736 tid 2 2024-03-04T06:49:52.255 INFO:tasks.rados.rados.0.smithi137.stdout:2402: done (5 left) 2024-03-04T06:49:52.255 INFO:tasks.rados.rados.0.smithi137.stdout:2407: setattr oid 1 current snap is 228 2024-03-04T06:49:52.255 INFO:tasks.rados.rados.0.smithi137.stdout:2401: finishing write tid 3 to smithi13777483-30 2024-03-04T06:49:52.255 INFO:tasks.rados.rados.0.smithi137.stdout:2401: finishing write tid 4 to smithi13777483-30 2024-03-04T06:49:52.255 INFO:tasks.rados.rados.0.smithi137.stdout:2401: oid 30 updating version 0 to 16780 2024-03-04T06:49:52.255 INFO:tasks.rados.rados.0.smithi137.stdout:2401: oid 30 version 16780 is already newer than 16778 2024-03-04T06:49:52.255 INFO:tasks.rados.rados.0.smithi137.stdout:2401: oid 30 version 16780 is already newer than 16779 2024-03-04T06:49:52.255 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16780 (ObjNum 768 snap 228 seq_num 768) dirty exists 2024-03-04T06:49:52.255 INFO:tasks.rados.rados.0.smithi137.stdout:2401: left oid 30 (ObjNum 768 snap 228 seq_num 768) 2024-03-04T06:49:52.255 INFO:tasks.rados.rados.0.smithi137.stdout:2400: finishing write tid 4 to smithi13777483-8 2024-03-04T06:49:52.255 INFO:tasks.rados.rados.0.smithi137.stdout:2400: oid 8 updating version 0 to 16824 2024-03-04T06:49:52.256 INFO:tasks.rados.rados.0.smithi137.stdout:2400: oid 8 version 16824 is already newer than 16823 2024-03-04T06:49:52.256 INFO:tasks.rados.rados.0.smithi137.stdout:2400: oid 8 version 16824 is already newer than 16822 2024-03-04T06:49:52.256 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16824 (ObjNum 767 snap 228 seq_num 767) dirty exists 2024-03-04T06:49:52.256 INFO:tasks.rados.rados.0.smithi137.stdout:2400: left oid 8 (ObjNum 767 snap 228 seq_num 767) 2024-03-04T06:49:52.258 INFO:tasks.rados.rados.0.smithi137.stdout:2400: done (5 left) 2024-03-04T06:49:52.258 INFO:tasks.rados.rados.0.smithi137.stdout:2401: done (4 left) 2024-03-04T06:49:52.258 INFO:tasks.rados.rados.0.smithi137.stdout:2408: rmattr oid 18 current snap is 228 2024-03-04T06:49:52.258 INFO:tasks.rados.rados.0.smithi137.stdout:2408: done (4 left) 2024-03-04T06:49:52.258 INFO:tasks.rados.rados.0.smithi137.stdout:2409: read oid 31 snap -1 2024-03-04T06:49:52.258 INFO:tasks.rados.rados.0.smithi137.stdout:2409: expect (ObjNum 422 snap 126 seq_num 422) 2024-03-04T06:49:52.258 INFO:tasks.rados.rados.0.smithi137.stdout:2410: rollback oid 37 current snap is 228 2024-03-04T06:49:52.258 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 37 to 222 2024-03-04T06:49:52.258 INFO:tasks.rados.rados.0.smithi137.stdout:2411: read oid 35 snap 222 2024-03-04T06:49:52.258 INFO:tasks.rados.rados.0.smithi137.stdout:2411: expect (ObjNum 743 snap 220 seq_num 743) 2024-03-04T06:49:52.258 INFO:tasks.rados.rados.0.smithi137.stdout:2412: rollback oid 23 current snap is 228 2024-03-04T06:49:52.258 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 23 to 223 2024-03-04T06:49:52.259 INFO:tasks.rados.rados.0.smithi137.stdout:2413: read oid 3 snap -1 2024-03-04T06:49:52.259 INFO:tasks.rados.rados.0.smithi137.stdout:2413: expect (ObjNum 733 snap 214 seq_num 733) 2024-03-04T06:49:52.259 INFO:tasks.rados.rados.0.smithi137.stdout:2414: read oid 45 snap 222 2024-03-04T06:49:52.259 INFO:tasks.rados.rados.0.smithi137.stdout:2414: expect (ObjNum 679 snap 192 seq_num 679) 2024-03-04T06:49:52.259 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 228 2024-03-04T06:49:52.259 INFO:tasks.rados.rados.0.smithi137.stdout:2415: seq_num 770 ranges {4374528=499712,4874240=401408} 2024-03-04T06:49:52.288 INFO:tasks.rados.rados.0.smithi137.stdout:2415: writing smithi13777483-10 from 4374528 to 4874240 tid 1 2024-03-04T06:49:52.291 INFO:tasks.rados.rados.0.smithi137.stdout:2415: writing smithi13777483-10 from 4874240 to 5275648 tid 2 2024-03-04T06:49:52.291 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 228 2024-03-04T06:49:52.291 INFO:tasks.rados.rados.0.smithi137.stdout:2406: finishing write tid 1 to smithi13777483-14 2024-03-04T06:49:52.291 INFO:tasks.rados.rados.0.smithi137.stdout:2416: seq_num 771 ranges {0=516096,516096=401408} 2024-03-04T06:49:52.295 INFO:tasks.rados.rados.0.smithi137.stdout:2416: writing smithi13777483-42 from 0 to 516096 tid 1 2024-03-04T06:49:52.298 INFO:tasks.rados.rados.0.smithi137.stdout:2416: writing smithi13777483-42 from 516096 to 917504 tid 2 2024-03-04T06:49:52.298 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 228 2024-03-04T06:49:52.298 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 16804 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:49:52.298 INFO:tasks.rados.rados.0.smithi137.stdout:2406: finishing write tid 2 to smithi13777483-14 2024-03-04T06:49:52.298 INFO:tasks.rados.rados.0.smithi137.stdout:2406: finishing write tid 3 to smithi13777483-14 2024-03-04T06:49:52.298 INFO:tasks.rados.rados.0.smithi137.stdout:2417: seq_num 772 ranges {0=532480,532480=401408} 2024-03-04T06:49:52.301 INFO:tasks.rados.rados.0.smithi137.stdout:2417: writing smithi13777483-46 from 0 to 532480 tid 1 2024-03-04T06:49:52.304 INFO:tasks.rados.rados.0.smithi137.stdout:2417: writing smithi13777483-46 from 532480 to 933888 tid 2 2024-03-04T06:49:52.304 INFO:tasks.rados.rados.0.smithi137.stdout:2407: done (12 left) 2024-03-04T06:49:52.304 INFO:tasks.rados.rados.0.smithi137.stdout:2418: rollback oid 26 current snap is 228 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:2410: finishing rollback tid 0 to smithi13777483-37 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:2412: finishing rollback tid 0 to smithi13777483-23 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:2412: finishing rollback tid 1 to smithi13777483-23 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:2406: finishing write tid 4 to smithi13777483-14 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:2406: oid 14 updating version 0 to 15518 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:2406: oid 14 version 15518 is already newer than 15516 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:2406: oid 14 version 15518 is already newer than 15517 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 15518 (ObjNum 769 snap 228 seq_num 769) dirty exists 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:2406: left oid 14 (ObjNum 769 snap 228 seq_num 769) 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:2410: finishing rollback tid 1 to smithi13777483-37 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:2410: finishing rollback tid 2 to smithi13777483-37 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16790 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:2412: finishing rollback tid 2 to smithi13777483-23 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 15521 (ObjNum 638 snap 178 seq_num 638) dirty exists 2024-03-04T06:49:52.305 INFO:tasks.rados.rados.0.smithi137.stdout:2405: expect (ObjNum 760 snap 225 seq_num 760) 2024-03-04T06:49:52.485 INFO:tasks.rados.rados.0.smithi137.stdout:2404: expect (ObjNum 716 snap 209 seq_num 716) 2024-03-04T06:49:52.540 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:52.269+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:52.541 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:52.245+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:52.541 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:52.246+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:49:52.541 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:52.246+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:52.541 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-mon[85573]: Upgrade: Updating osd.7 2024-03-04T06:49:52.541 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-mon[85573]: Deploying daemon osd.7 on smithi203 2024-03-04T06:49:52.541 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:52.541 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:52.541 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-mon[85573]: osdmap e522: 8 total, 8 up, 8 in 2024-03-04T06:49:52.541 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:52.542 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:52.542 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:52.542 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:52.542 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:52.542 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.163+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.542 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.176+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.542 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.185+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.542 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.195+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.542 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.205+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.542 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.214+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.542 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.224+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.543 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.233+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.543 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.244+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.543 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.277+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:52.543 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:52.277+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:52.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:52.245+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:52.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:52.254+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:52.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:52.254+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:52.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:52.254+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:52.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[88869]: Upgrade: Updating osd.7 2024-03-04T06:49:52.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[88869]: Deploying daemon osd.7 on smithi203 2024-03-04T06:49:52.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:52.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:52.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[88869]: osdmap e522: 8 total, 8 up, 8 in 2024-03-04T06:49:52.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:52.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:52.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:52.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:52.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:52.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:52.249+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:52.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[91314]: Upgrade: Updating osd.7 2024-03-04T06:49:52.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[91314]: Deploying daemon osd.7 on smithi203 2024-03-04T06:49:52.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:52.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:52.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[91314]: osdmap e522: 8 total, 8 up, 8 in 2024-03-04T06:49:52.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:52.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:52.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:52.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:52.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:52.548 INFO:tasks.rados.rados.0.smithi137.stdout:2413: expect (ObjNum 733 snap 214 seq_num 733) 2024-03-04T06:49:52.712 INFO:tasks.rados.rados.0.smithi137.stdout:2409: expect (ObjNum 422 snap 126 seq_num 422) 2024-03-04T06:49:52.819 INFO:tasks.rados.rados.0.smithi137.stdout:2411: expect (ObjNum 743 snap 220 seq_num 743) 2024-03-04T06:49:52.832 INFO:tasks.rados.rados.0.smithi137.stdout:2415: finishing write tid 1 to smithi13777483-10 2024-03-04T06:49:52.832 INFO:tasks.rados.rados.0.smithi137.stdout:2415: finishing write tid 2 to smithi13777483-10 2024-03-04T06:49:52.832 INFO:tasks.rados.rados.0.smithi137.stdout:2415: finishing write tid 3 to smithi13777483-10 2024-03-04T06:49:52.832 INFO:tasks.rados.rados.0.smithi137.stdout:2415: finishing write tid 4 to smithi13777483-10 2024-03-04T06:49:52.832 INFO:tasks.rados.rados.0.smithi137.stdout:2415: oid 10 updating version 0 to 15538 2024-03-04T06:49:52.832 INFO:tasks.rados.rados.0.smithi137.stdout:2415: oid 10 version 15538 is already newer than 15537 2024-03-04T06:49:52.832 INFO:tasks.rados.rados.0.smithi137.stdout:2415: oid 10 version 15538 is already newer than 15536 2024-03-04T06:49:52.832 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15538 (ObjNum 770 snap 228 seq_num 770) dirty exists 2024-03-04T06:49:52.832 INFO:tasks.rados.rados.0.smithi137.stdout:2415: left oid 10 (ObjNum 770 snap 228 seq_num 770) 2024-03-04T06:49:52.832 INFO:tasks.rados.rados.0.smithi137.stdout:2416: finishing write tid 1 to smithi13777483-42 2024-03-04T06:49:52.832 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 26 to 222 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2416: finishing write tid 2 to smithi13777483-42 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2416: finishing write tid 3 to smithi13777483-42 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2417: finishing write tid 1 to smithi13777483-46 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2416: finishing write tid 4 to smithi13777483-42 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2416: oid 42 updating version 0 to 16847 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2416: oid 42 updating version 16847 to 16849 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2416: oid 42 version 16849 is already newer than 16848 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16849 (ObjNum 771 snap 228 seq_num 771) dirty exists 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2416: left oid 42 (ObjNum 771 snap 228 seq_num 771) 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2417: finishing write tid 2 to smithi13777483-46 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2417: finishing write tid 3 to smithi13777483-46 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2417: finishing write tid 4 to smithi13777483-46 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2417: oid 46 updating version 0 to 16852 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2417: oid 46 version 16852 is already newer than 16851 2024-03-04T06:49:52.833 INFO:tasks.rados.rados.0.smithi137.stdout:2417: oid 46 version 16852 is already newer than 16850 2024-03-04T06:49:52.834 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 16852 (ObjNum 772 snap 228 seq_num 772) dirty exists 2024-03-04T06:49:52.834 INFO:tasks.rados.rados.0.smithi137.stdout:2417: left oid 46 (ObjNum 772 snap 228 seq_num 772) 2024-03-04T06:49:52.834 INFO:tasks.rados.rados.0.smithi137.stdout:2414: expect (ObjNum 679 snap 192 seq_num 679) 2024-03-04T06:49:53.518 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:53.518 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:53.518 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:53.518 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:53 smithi203 ceph-mon[85573]: osdmap e523: 8 total, 8 up, 8 in 2024-03-04T06:49:53.518 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:53.518 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:53.518 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:53.519 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:53.519 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:53.519 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:53 smithi203 ceph-mon[85573]: pgmap v461: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 366 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-03-04T06:49:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[88869]: osdmap e523: 8 total, 8 up, 8 in 2024-03-04T06:49:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:53.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:53.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:53.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[88869]: pgmap v461: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 366 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-03-04T06:49:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[91314]: osdmap e523: 8 total, 8 up, 8 in 2024-03-04T06:49:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:53.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:53.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:53 smithi137 ceph-mon[91314]: pgmap v461: 121 pgs: 1 active+clean+snaptrim, 7 active+clean+snaptrim_error, 113 active+clean; 366 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-03-04T06:49:53.868 INFO:tasks.rados.rados.0.smithi137.stdout:2418: finishing rollback tid 0 to smithi13777483-26 2024-03-04T06:49:53.868 INFO:tasks.rados.rados.0.smithi137.stdout:2418: finishing rollback tid 1 to smithi13777483-26 2024-03-04T06:49:53.868 INFO:tasks.rados.rados.0.smithi137.stdout:2418: finishing rollback tid 2 to smithi13777483-26 2024-03-04T06:49:53.868 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16805 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2404: done (12 left) 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2405: done (11 left) 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2406: done (10 left) 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2409: done (9 left) 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2410: done (8 left) 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2411: done (7 left) 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2412: done (6 left) 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2413: done (5 left) 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2414: done (4 left) 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2415: done (3 left) 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2416: done (2 left) 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2417: done (1 left) 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2418: done (0 left) 2024-03-04T06:49:53.869 INFO:tasks.rados.rados.0.smithi137.stdout:2419: delete oid 22 current snap is 228 2024-03-04T06:49:53.871 INFO:tasks.rados.rados.0.smithi137.stdout:2419: done (0 left) 2024-03-04T06:49:53.871 INFO:tasks.rados.rados.0.smithi137.stdout:2420: snap_create 2024-03-04T06:49:54.263 INFO:tasks.rados.rados.0.smithi137.stdout:2420: done (0 left) 2024-03-04T06:49:54.263 INFO:tasks.rados.rados.0.smithi137.stdout:2421: copy_from oid 8 from oid 3 current snap is 229 2024-03-04T06:49:54.263 INFO:tasks.rados.rados.0.smithi137.stdout:2422: setattr oid 13 current snap is 229 2024-03-04T06:49:54.265 INFO:tasks.rados.rados.0.smithi137.stdout:2423: delete oid 23 current snap is 229 2024-03-04T06:49:54.270 INFO:tasks.rados.rados.0.smithi137.stdout:2423: done (2 left) 2024-03-04T06:49:54.271 INFO:tasks.rados.rados.0.smithi137.stdout:2424: copy_from oid 2 from oid 24 current snap is 229 2024-03-04T06:49:54.271 INFO:tasks.rados.rados.0.smithi137.stdout:2425: snap_create 2024-03-04T06:49:54.271 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16853 (ObjNum 615 snap 175 seq_num 615) dirty exists 2024-03-04T06:49:54.279 INFO:tasks.rados.rados.0.smithi137.stdout:2421: finishing copy_from racing read to smithi13777483-8 2024-03-04T06:49:54.281 INFO:tasks.rados.rados.0.smithi137.stdout:2421: finishing copy_from to smithi13777483-8 2024-03-04T06:49:54.281 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 15518 (ObjNum 733 snap 214 seq_num 733) dirty exists 2024-03-04T06:49:54.290 INFO:tasks.rados.rados.0.smithi137.stdout:2424: finishing copy_from racing read to smithi13777483-2 2024-03-04T06:49:54.291 INFO:tasks.rados.rados.0.smithi137.stdout:2424: finishing copy_from to smithi13777483-2 2024-03-04T06:49:54.291 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16780 (ObjNum 751 snap 225 seq_num 751) dirty exists 2024-03-04T06:49:54.509 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:49:54.509 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:54.269+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:54.510 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:54.282+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:54.510 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:54.259+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:54.510 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:54.259+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:54.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:49:54.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:49:54.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:54.262+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:54.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:54.267+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:54.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:54.269+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:54.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:54.269+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:54.670 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:49:54.848 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:54 smithi203 systemd[1]: Stopping Ceph osd.7 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:49:54.986 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:49:54.986 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (9m) 2m ago 10m 26.4M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:49:54.986 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (10m) 26s ago 10m 87.0M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:49:54.986 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (11m) 2m ago 11m 18.6M - 18.2.1-696-g5cc7a767 540557f94930 dd13fbd7ec2f 2024-03-04T06:49:54.986 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (11m) 26s ago 11m 20.9M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:49:54.986 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (5m) 26s ago 15m 451M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:49:54.986 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (6m) 2m ago 17m 506M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:49:54.986 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (5m) 2m ago 17m 53.0M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:49:54.986 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (4m) 26s ago 15m 47.4M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:49:54.986 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (5m) 2m ago 15m 46.8M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:49:54.986 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (10m) 2m ago 10m 17.3M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:49:54.986 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (10m) 26s ago 10m 15.6M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:49:54.987 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (4m) 2m ago 14m 208M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 bd2207652b33 2024-03-04T06:49:54.987 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (3m) 2m ago 14m 142M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 47b5cdaad147 2024-03-04T06:49:54.987 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (2m) 2m ago 14m 114M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 436ae07776d9 2024-03-04T06:49:54.987 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (2m) 2m ago 13m 12.7M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9acd06dda8ec 2024-03-04T06:49:54.987 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (101s) 26s ago 13m 132M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9a246a0996bd 2024-03-04T06:49:54.987 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (66s) 26s ago 12m 133M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9e05ca76b164 2024-03-04T06:49:54.987 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (32s) 26s ago 12m 14.3M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 ddb88aa8bce6 2024-03-04T06:49:54.987 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (12m) 26s ago 12m 244M 2480M 18.2.1-696-g5cc7a767 540557f94930 8ff5b5fc1403 2024-03-04T06:49:54.987 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (5m) 26s ago 11m 56.4M - 2.43.0 a07b618ecd1d 6a88bdd1023c 2024-03-04T06:49:55.264 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[53464]: 2024-03-04T06:49:54.894+0000 7f67fb57a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:49:55.264 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[53464]: 2024-03-04T06:49:54.894+0000 7f67fb57a700 -1 osd.7 524 *** Got signal Terminated *** 2024-03-04T06:49:55.264 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[53464]: 2024-03-04T06:49:54.894+0000 7f67fb57a700 -1 osd.7 524 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T06:49:55.274 INFO:tasks.rados.rados.0.smithi137.stdout:2421: done (3 left) 2024-03-04T06:49:55.274 INFO:tasks.rados.rados.0.smithi137.stdout:2422: done (2 left) 2024-03-04T06:49:55.274 INFO:tasks.rados.rados.0.smithi137.stdout:2424: done (1 left) 2024-03-04T06:49:55.274 INFO:tasks.rados.rados.0.smithi137.stdout:2425: done (0 left) 2024-03-04T06:49:55.274 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 230 2024-03-04T06:49:55.274 INFO:tasks.rados.rados.0.smithi137.stdout:2426: seq_num 775 ranges {2998272=589824,3588096=401408} 2024-03-04T06:49:55.295 INFO:tasks.rados.rados.0.smithi137.stdout:2426: writing smithi13777483-12 from 2998272 to 3588096 tid 1 2024-03-04T06:49:55.299 INFO:tasks.rados.rados.0.smithi137.stdout:2426: writing smithi13777483-12 from 3588096 to 3989504 tid 2 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:2427: read oid 33 snap -1 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:2427: expect (ObjNum 596 snap 170 seq_num 596) 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:2428: rmattr oid 38 current snap is 230 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:2429: rollback oid 10 current snap is 230 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 10 to 214 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:2430: rollback oid 35 current snap is 230 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 35 to 229 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:2431: rollback oid 2 current snap is 230 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 2 to 222 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:2432: read oid 17 snap -1 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:2432: expect deleted 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:2433: rollback oid 31 current snap is 230 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 31 to 229 2024-03-04T06:49:55.300 INFO:tasks.rados.rados.0.smithi137.stdout:2434: snap_remove snap 226 2024-03-04T06:49:55.395 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:49:55.395 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:49:55.395 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:49:55.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:49:55.395 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:49:55.395 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:49:55.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:49:55.395 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:49:55.395 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 7 2024-03-04T06:49:55.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:49:55.395 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:49:55.396 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2 2024-03-04T06:49:55.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:49:55.396 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:49:55.396 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 2, 2024-03-04T06:49:55.396 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 12 2024-03-04T06:49:55.396 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:49:55.396 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:49:55.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:49:55] "GET /metrics HTTP/1.1" 200 36260 "" "Prometheus/2.43.0" 2024-03-04T06:49:55.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:55.276+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:55.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:55.270+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:55.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:55.277+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:55.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:55.277+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:55.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:55.277+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[91314]: osdmap e524: 8 total, 8 up, 8 in 2024-03-04T06:49:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[91314]: pgmap v463: 121 pgs: 8 active+clean+snaptrim_error, 113 active+clean; 371 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 27 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2024-03-04T06:49:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[91314]: osd.7 marked itself down and dead 2024-03-04T06:49:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:55.256+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 8 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:49:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[88869]: osdmap e524: 8 total, 8 up, 8 in 2024-03-04T06:49:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[88869]: pgmap v463: 121 pgs: 8 active+clean+snaptrim_error, 113 active+clean; 371 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 27 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2024-03-04T06:49:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:55 smithi137 ceph-mon[88869]: osd.7 marked itself down and dead 2024-03-04T06:49:55.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:55.268+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:55.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:55.274+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:55.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:55.272+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:55.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:55.272+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{e3=[e2,e0,df],e6=[e6],10f=[10f,10e,10b,10a,109,108,107,105,103,102,101,fe,f3]} for object 5:84a107c4:::smithi13777483-17:d6 2024-03-04T06:49:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-mon[85573]: osdmap e524: 8 total, 8 up, 8 in 2024-03-04T06:49:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-mon[85573]: pgmap v463: 121 pgs: 8 active+clean+snaptrim_error, 113 active+clean; 371 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 27 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2024-03-04T06:49:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:55 smithi203 ceph-mon[85573]: osd.7 marked itself down and dead 2024-03-04T06:49:56.079 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:55 smithi203 podman[104372]: 2024-03-04 06:49:55.824822521 +0000 UTC m=+1.058822299 container died 8ff5b5fc14031c62e9228eb8fdd669bbc5602a39b8833a914df6945678c57e66 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=reef-5cc7a76, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-04T06:49:56.270 INFO:tasks.rados.rados.0.smithi137.stdout:2434: done (8 left) 2024-03-04T06:49:56.270 INFO:tasks.rados.rados.0.smithi137.stdout:2435: delete oid 25 current snap is 230 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:2426: finishing write tid 1 to smithi13777483-12 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:2426: finishing write tid 2 to smithi13777483-12 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:2426: finishing write tid 3 to smithi13777483-12 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:2426: finishing write tid 4 to smithi13777483-12 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:2426: oid 12 updating version 0 to 16782 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:2426: oid 12 version 16782 is already newer than 16781 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:2426: oid 12 updating version 16782 to 16783 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16783 (ObjNum 775 snap 230 seq_num 775) dirty exists 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:2426: left oid 12 (ObjNum 775 snap 230 seq_num 775) 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16821 (ObjNum 709 snap 204 seq_num 709) dirty exists 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:2431: finishing rollback tid 0 to smithi13777483-2 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:2431: finishing rollback tid 1 to smithi13777483-2 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:2431: finishing rollback tid 2 to smithi13777483-2 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16807 (ObjNum 679 snap 192 seq_num 679) dirty exists 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:2429: finishing rollback tid 0 to smithi13777483-10 2024-03-04T06:49:56.271 INFO:tasks.rados.rados.0.smithi137.stdout:2429: finishing rollback tid 1 to smithi13777483-10 2024-03-04T06:49:56.272 INFO:tasks.rados.rados.0.smithi137.stdout:2429: finishing rollback tid 2 to smithi13777483-10 2024-03-04T06:49:56.272 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15541 (ObjNum 676 snap 191 seq_num 676) dirty exists 2024-03-04T06:49:56.290 INFO:tasks.rados.rados.0.smithi137.stdout:2426: done (8 left) 2024-03-04T06:49:56.290 INFO:tasks.rados.rados.0.smithi137.stdout:2428: done (7 left) 2024-03-04T06:49:56.290 INFO:tasks.rados.rados.0.smithi137.stdout:2429: done (6 left) 2024-03-04T06:49:56.290 INFO:tasks.rados.rados.0.smithi137.stdout:2431: done (5 left) 2024-03-04T06:49:56.290 INFO:tasks.rados.rados.0.smithi137.stdout:2432: done (4 left) 2024-03-04T06:49:56.290 INFO:tasks.rados.rados.0.smithi137.stdout:2435: done (3 left) 2024-03-04T06:49:56.290 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 43 current snap is 230 2024-03-04T06:49:56.290 INFO:tasks.rados.rados.0.smithi137.stdout:2436: seq_num 777 ranges {0=622592,622592=401408} 2024-03-04T06:49:56.294 INFO:tasks.rados.rados.0.smithi137.stdout:2436: writing smithi13777483-43 from 0 to 622592 tid 1 2024-03-04T06:49:56.297 INFO:tasks.rados.rados.0.smithi137.stdout:2436: writing smithi13777483-43 from 622592 to 1024000 tid 2 2024-03-04T06:49:56.297 INFO:tasks.rados.rados.0.smithi137.stdout:2437: snap_create 2024-03-04T06:49:56.303 INFO:tasks.rados.rados.0.smithi137.stdout:2436: finishing write tid 1 to smithi13777483-43 2024-03-04T06:49:56.303 INFO:tasks.rados.rados.0.smithi137.stdout:2436: finishing write tid 2 to smithi13777483-43 2024-03-04T06:49:56.303 INFO:tasks.rados.rados.0.smithi137.stdout:2436: finishing write tid 3 to smithi13777483-43 2024-03-04T06:49:56.306 INFO:tasks.rados.rados.0.smithi137.stdout:2436: finishing write tid 4 to smithi13777483-43 2024-03-04T06:49:56.306 INFO:tasks.rados.rados.0.smithi137.stdout:2436: oid 43 updating version 0 to 852 2024-03-04T06:49:56.306 INFO:tasks.rados.rados.0.smithi137.stdout:2436: oid 43 updating version 852 to 853 2024-03-04T06:49:56.306 INFO:tasks.rados.rados.0.smithi137.stdout:2436: oid 43 updating version 853 to 854 2024-03-04T06:49:56.306 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 854 (ObjNum 777 snap 230 seq_num 777) dirty exists 2024-03-04T06:49:56.306 INFO:tasks.rados.rados.0.smithi137.stdout:2436: left oid 43 (ObjNum 777 snap 230 seq_num 777) 2024-03-04T06:49:56.326 INFO:tasks.rados.rados.0.smithi137.stdout:2430: finishing rollback tid 0 to smithi13777483-35 2024-03-04T06:49:56.326 INFO:tasks.rados.rados.0.smithi137.stdout:2430: finishing rollback tid 1 to smithi13777483-35 2024-03-04T06:49:56.326 INFO:tasks.rados.rados.0.smithi137.stdout:2430: finishing rollback tid 2 to smithi13777483-35 2024-03-04T06:49:56.326 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16792 (ObjNum 743 snap 220 seq_num 743) dirty exists 2024-03-04T06:49:56.335 INFO:tasks.rados.rados.0.smithi137.stdout:2427: expect (ObjNum 596 snap 170 seq_num 596) 2024-03-04T06:49:56.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:56.272+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:56.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:56.272+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:56.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:56.273+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:56.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:56 smithi203 podman[104372]: 2024-03-04 06:49:56.171089566 +0000 UTC m=+1.405089342 container cleanup 8ff5b5fc14031c62e9228eb8fdd669bbc5602a39b8833a914df6945678c57e66 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, ceph=True, RELEASE=reef-5cc7a76, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-03-04T06:49:56.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:56 smithi203 bash[104372]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: Health check update: Possible data damage: 8 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: osdmap e525: 8 total, 7 up, 8 in 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:56.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:56 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/3205019140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:56.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:56.282+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:56.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:56.272+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:56.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:56.272+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:56.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:56.276+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:49:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:49:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: Health check update: Possible data damage: 8 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:49:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:49:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-03-04T06:49:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: osdmap e525: 8 total, 7 up, 8 in 2024-03-04T06:49:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:56.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:56.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/3205019140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:49:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:49:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: Health check update: Possible data damage: 8 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:49:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-04T06:49:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-03-04T06:49:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: osdmap e525: 8 total, 7 up, 8 in 2024-03-04T06:49:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:56.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:56.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:56.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:56 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/3205019140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:49:56.838 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:56 smithi203 podman[104389]: 2024-03-04 06:49:56.40624039 +0000 UTC m=+0.576816177 container remove 8ff5b5fc14031c62e9228eb8fdd669bbc5602a39b8833a914df6945678c57e66 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, RELEASE=reef-5cc7a76, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T06:49:57.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:56 smithi203 podman[104479]: 2024-03-04 06:49:56.741360693 +0000 UTC m=+0.018216122 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:49:57.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:56 smithi203 podman[104479]: 2024-03-04 06:49:56.857356828 +0000 UTC m=+0.134212238 container create c7fdd1c86d5c1ae49ae8d696cae6bc3263079119f4a56bc9de11f21f870ee6bd (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-04T06:49:57.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:57 smithi203 podman[104479]: 2024-03-04 06:49:57.076812023 +0000 UTC m=+0.353667437 container init c7fdd1c86d5c1ae49ae8d696cae6bc3263079119f4a56bc9de11f21f870ee6bd (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True) 2024-03-04T06:49:57.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:57 smithi203 podman[104479]: 2024-03-04 06:49:57.08011351 +0000 UTC m=+0.356968920 container start c7fdd1c86d5c1ae49ae8d696cae6bc3263079119f4a56bc9de11f21f870ee6bd (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-deactivate, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-03-04T06:49:57.125 INFO:tasks.rados.rados.0.smithi137.stdout:2433: finishing rollback tid 0 to smithi13777483-31 2024-03-04T06:49:57.125 INFO:tasks.rados.rados.0.smithi137.stdout:2433: finishing rollback tid 1 to smithi13777483-31 2024-03-04T06:49:57.126 INFO:tasks.rados.rados.0.smithi137.stdout:2433: finishing rollback tid 2 to smithi13777483-31 2024-03-04T06:49:57.126 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16795 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:49:57.284 INFO:tasks.rados.rados.0.smithi137.stdout:2427: done (4 left) 2024-03-04T06:49:57.284 INFO:tasks.rados.rados.0.smithi137.stdout:2430: done (3 left) 2024-03-04T06:49:57.284 INFO:tasks.rados.rados.0.smithi137.stdout:2433: done (2 left) 2024-03-04T06:49:57.284 INFO:tasks.rados.rados.0.smithi137.stdout:2436: done (1 left) 2024-03-04T06:49:57.284 INFO:tasks.rados.rados.0.smithi137.stdout:2437: done (0 left) 2024-03-04T06:49:57.284 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 37 current snap is 231 2024-03-04T06:49:57.284 INFO:tasks.rados.rados.0.smithi137.stdout:2438: seq_num 778 ranges {2695168=638976,3334144=401408} 2024-03-04T06:49:57.302 INFO:tasks.rados.rados.0.smithi137.stdout:2438: writing smithi13777483-37 from 2695168 to 3334144 tid 1 2024-03-04T06:49:57.304 INFO:tasks.rados.rados.0.smithi137.stdout:2438: writing smithi13777483-37 from 3334144 to 3735552 tid 2 2024-03-04T06:49:57.304 INFO:tasks.rados.rados.0.smithi137.stdout:2439: rollback oid 2 current snap is 231 2024-03-04T06:49:57.304 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 2 to 200 2024-03-04T06:49:57.304 INFO:tasks.rados.rados.0.smithi137.stdout:2440: delete oid 36 current snap is 231 2024-03-04T06:49:57.308 INFO:tasks.rados.rados.0.smithi137.stdout:2440: done (2 left) 2024-03-04T06:49:57.308 INFO:tasks.rados.rados.0.smithi137.stdout:2441: snap_remove snap 229 2024-03-04T06:49:57.502 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:57.281+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:57.502 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:57.306+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:57.502 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:57 smithi203 podman[104479]: 2024-03-04 06:49:57.17700268 +0000 UTC m=+0.453858100 container attach c7fdd1c86d5c1ae49ae8d696cae6bc3263079119f4a56bc9de11f21f870ee6bd (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-04T06:49:57.502 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:57 smithi203 podman[104479]: 2024-03-04 06:49:57.380462948 +0000 UTC m=+0.657318368 container died c7fdd1c86d5c1ae49ae8d696cae6bc3263079119f4a56bc9de11f21f870ee6bd (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-03-04T06:49:57.503 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:57 smithi203 ceph-mon[85573]: osdmap e526: 8 total, 7 up, 8 in 2024-03-04T06:49:57.503 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:57.503 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:57.503 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:57.503 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:57.503 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:57.503 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:57.503 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:57.503 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:57 smithi203 ceph-mon[85573]: pgmap v466: 121 pgs: 19 stale+active+clean, 8 active+clean+snaptrim_error, 94 active+clean; 375 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 27 MiB/s rd, 2.2 MiB/s wr, 29 op/s 2024-03-04T06:49:57.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:57.308+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:57.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:57.281+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:57.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:57.306+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:57.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:57.306+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:57.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:57.306+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[91314]: osdmap e526: 8 total, 7 up, 8 in 2024-03-04T06:49:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:57.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:57.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[91314]: pgmap v466: 121 pgs: 19 stale+active+clean, 8 active+clean+snaptrim_error, 94 active+clean; 375 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 27 MiB/s rd, 2.2 MiB/s wr, 29 op/s 2024-03-04T06:49:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[88869]: osdmap e526: 8 total, 7 up, 8 in 2024-03-04T06:49:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:57 smithi137 ceph-mon[88869]: pgmap v466: 121 pgs: 19 stale+active+clean, 8 active+clean+snaptrim_error, 94 active+clean; 375 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 27 MiB/s rd, 2.2 MiB/s wr, 29 op/s 2024-03-04T06:49:57.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:57.499+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:57.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:57.499+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:58.281 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:57 smithi203 podman[104505]: 2024-03-04 06:49:57.998065184 +0000 UTC m=+0.612373306 container remove c7fdd1c86d5c1ae49ae8d696cae6bc3263079119f4a56bc9de11f21f870ee6bd (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T06:49:58.281 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:58 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.7.service: Deactivated successfully. 2024-03-04T06:49:58.281 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:58 smithi203 systemd[1]: Stopped Ceph osd.7 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:49:58.281 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:58 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.7.service: Consumed 16.240s CPU time. 2024-03-04T06:49:58.281 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:58 smithi203 systemd[1]: Starting Ceph osd.7 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:49:58.296 INFO:tasks.rados.rados.0.smithi137.stdout:2441: done (2 left) 2024-03-04T06:49:58.296 INFO:tasks.rados.rados.0.smithi137.stdout:2442: rmattr oid 12 current snap is 231 2024-03-04T06:49:58.296 INFO:tasks.rados.rados.0.smithi137.stdout:2442: done (2 left) 2024-03-04T06:49:58.296 INFO:tasks.rados.rados.0.smithi137.stdout:2443: rollback oid 31 current snap is 231 2024-03-04T06:49:58.296 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 31 to 212 2024-03-04T06:49:58.296 INFO:tasks.rados.rados.0.smithi137.stdout:2444: snap_remove snap 222 2024-03-04T06:49:58.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:58.300+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:58.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:58.301+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:58.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:58.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:58.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[91314]: osdmap e527: 8 total, 7 up, 8 in 2024-03-04T06:49:58.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:58.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:58.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:58.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:58.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:58.296+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:58.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:58.298+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:58.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:58.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:58.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[88869]: osdmap e527: 8 total, 7 up, 8 in 2024-03-04T06:49:58.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:58.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:58.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:58.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:58.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:58.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:58.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:58 smithi203 ceph-mon[85573]: osdmap e527: 8 total, 7 up, 8 in 2024-03-04T06:49:58.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:58.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:58.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:58.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:58.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:58.291+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:58.597 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:58.300+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:58.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:58 smithi203 podman[104604]: 2024-03-04 06:49:58.339411069 +0000 UTC m=+0.018074312 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:49:58.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:58 smithi203 podman[104604]: 2024-03-04 06:49:58.465849008 +0000 UTC m=+0.144512233 container create ac0cd277439627a97d8acb7b3edd778f18da057cd059da92949aa3db0b47b047 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-activate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2) 2024-03-04T06:49:58.598 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:58.298+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:59.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:58 smithi203 podman[104604]: 2024-03-04 06:49:58.710922925 +0000 UTC m=+0.389586153 container init ac0cd277439627a97d8acb7b3edd778f18da057cd059da92949aa3db0b47b047 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-activate, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:49:59.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:58 smithi203 podman[104604]: 2024-03-04 06:49:58.714342059 +0000 UTC m=+0.393005287 container start ac0cd277439627a97d8acb7b3edd778f18da057cd059da92949aa3db0b47b047 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-04T06:49:59.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:58 smithi203 podman[104604]: 2024-03-04 06:49:58.793600722 +0000 UTC m=+0.472263953 container attach ac0cd277439627a97d8acb7b3edd778f18da057cd059da92949aa3db0b47b047 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-activate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T06:49:59.303 INFO:tasks.rados.rados.0.smithi137.stdout:2444: done (3 left) 2024-03-04T06:49:59.303 INFO:tasks.rados.rados.0.smithi137.stdout:2445: delete oid 44 current snap is 231 2024-03-04T06:49:59.303 INFO:tasks.rados.rados.0.smithi137.stdout:2438: finishing write tid 1 to smithi13777483-37 2024-03-04T06:49:59.303 INFO:tasks.rados.rados.0.smithi137.stdout:2439: finishing rollback tid 0 to smithi13777483-2 2024-03-04T06:49:59.303 INFO:tasks.rados.rados.0.smithi137.stdout:2438: finishing write tid 2 to smithi13777483-37 2024-03-04T06:49:59.303 INFO:tasks.rados.rados.0.smithi137.stdout:2439: finishing rollback tid 1 to smithi13777483-2 2024-03-04T06:49:59.304 INFO:tasks.rados.rados.0.smithi137.stdout:2438: finishing write tid 3 to smithi13777483-37 2024-03-04T06:49:59.304 INFO:tasks.rados.rados.0.smithi137.stdout:2439: finishing rollback tid 2 to smithi13777483-2 2024-03-04T06:49:59.304 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16810 (ObjNum 555 snap 158 seq_num 555) dirty exists 2024-03-04T06:49:59.304 INFO:tasks.rados.rados.0.smithi137.stdout:2438: finishing write tid 4 to smithi13777483-37 2024-03-04T06:49:59.304 INFO:tasks.rados.rados.0.smithi137.stdout:2438: oid 37 updating version 0 to 16792 2024-03-04T06:49:59.304 INFO:tasks.rados.rados.0.smithi137.stdout:2438: oid 37 updating version 16792 to 16794 2024-03-04T06:49:59.304 INFO:tasks.rados.rados.0.smithi137.stdout:2438: oid 37 version 16794 is already newer than 16793 2024-03-04T06:49:59.304 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16794 (ObjNum 778 snap 231 seq_num 778) dirty exists 2024-03-04T06:49:59.304 INFO:tasks.rados.rados.0.smithi137.stdout:2438: left oid 37 (ObjNum 778 snap 231 seq_num 778) 2024-03-04T06:49:59.304 INFO:tasks.rados.rados.0.smithi137.stdout:2443: finishing rollback tid 0 to smithi13777483-31 2024-03-04T06:49:59.304 INFO:tasks.rados.rados.0.smithi137.stdout:2443: finishing rollback tid 1 to smithi13777483-31 2024-03-04T06:49:59.304 INFO:tasks.rados.rados.0.smithi137.stdout:2443: finishing rollback tid 2 to smithi13777483-31 2024-03-04T06:49:59.304 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16798 (ObjNum 422 snap 126 seq_num 422) dirty exists 2024-03-04T06:49:59.315 INFO:tasks.rados.rados.0.smithi137.stdout:2438: done (3 left) 2024-03-04T06:49:59.315 INFO:tasks.rados.rados.0.smithi137.stdout:2439: done (2 left) 2024-03-04T06:49:59.315 INFO:tasks.rados.rados.0.smithi137.stdout:2443: done (1 left) 2024-03-04T06:49:59.315 INFO:tasks.rados.rados.0.smithi137.stdout:2445: done (0 left) 2024-03-04T06:49:59.315 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 231 2024-03-04T06:49:59.315 INFO:tasks.rados.rados.0.smithi137.stdout:2446: seq_num 781 ranges {2719744=688128,3407872=401408} 2024-03-04T06:49:59.333 INFO:tasks.rados.rados.0.smithi137.stdout:2446: writing smithi13777483-10 from 2719744 to 3407872 tid 1 2024-03-04T06:49:59.336 INFO:tasks.rados.rados.0.smithi137.stdout:2446: writing smithi13777483-10 from 3407872 to 3809280 tid 2 2024-03-04T06:49:59.337 INFO:tasks.rados.rados.0.smithi137.stdout:2447: read oid 6 snap -1 2024-03-04T06:49:59.337 INFO:tasks.rados.rados.0.smithi137.stdout:2447: expect deleted 2024-03-04T06:49:59.337 INFO:tasks.rados.rados.0.smithi137.stdout:2448: rollback oid 37 current snap is 231 2024-03-04T06:49:59.337 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 37 to 228 2024-03-04T06:49:59.337 INFO:tasks.rados.rados.0.smithi137.stdout:2449: read oid 17 snap -1 2024-03-04T06:49:59.337 INFO:tasks.rados.rados.0.smithi137.stdout:2449: expect deleted 2024-03-04T06:49:59.338 INFO:tasks.rados.rados.0.smithi137.stdout:2450: snap_remove snap 213 2024-03-04T06:49:59.573 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:49:59.298+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:59.573 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:49:59.306+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:59.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:59.312+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:49:59.574 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:49:59.312+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:59.575 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:59.575 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:59.575 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-mon[85573]: osdmap e528: 8 total, 7 up, 8 in 2024-03-04T06:49:59.575 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:59.575 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:59.575 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:59.576 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:59.576 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:59.576 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:59.576 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-mon[85573]: pgmap v469: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 33 active+undersized, 10 active+undersized+degraded, 2 stale+active+clean, 7 active+clean+snaptrim_error, 68 active+clean; 395 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s wr, 13 op/s; 39/870 objects degraded (4.483%) 2024-03-04T06:49:59.577 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-activate[104619]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-04T06:49:59.577 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-activate[104619]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-03-04T06:49:59.577 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 bash[104604]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-04T06:49:59.577 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 bash[104604]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-03-04T06:49:59.577 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 bash[104604]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-03-04T06:49:59.577 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 bash[104604]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-03-04T06:49:59.578 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 bash[104604]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-03-04T06:49:59.578 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 bash[104604]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-04T06:49:59.578 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 bash[104604]: --> ceph-volume raw activate successful for osd ID: 7 2024-03-04T06:49:59.578 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-activate[104619]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-03-04T06:49:59.578 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-activate[104619]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-03-04T06:49:59.578 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-activate[104619]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-03-04T06:49:59.579 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-activate[104619]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-04T06:49:59.579 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-activate[104619]: --> ceph-volume raw activate successful for osd ID: 7 2024-03-04T06:49:59.579 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 podman[104604]: 2024-03-04 06:49:59.179134634 +0000 UTC m=+0.857797862 container died ac0cd277439627a97d8acb7b3edd778f18da057cd059da92949aa3db0b47b047 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, org.label-schema.schema-version=1.0) 2024-03-04T06:49:59.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:49:59.300+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:59.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:59.306+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:49:59.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:59.306+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:59.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:49:59.310+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:59.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:59.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:59.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[88869]: osdmap e528: 8 total, 7 up, 8 in 2024-03-04T06:49:59.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:59.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:59.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:59.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:59.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:59.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:59.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[88869]: pgmap v469: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 33 active+undersized, 10 active+undersized+degraded, 2 stale+active+clean, 7 active+clean+snaptrim_error, 68 active+clean; 395 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s wr, 13 op/s; 39/870 objects degraded (4.483%) 2024-03-04T06:49:59.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:59.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:49:59.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[91314]: osdmap e528: 8 total, 7 up, 8 in 2024-03-04T06:49:59.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:49:59.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:49:59.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:49:59.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:49:59.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:49:59.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:49:59.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-mon[91314]: pgmap v469: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 33 active+undersized, 10 active+undersized+degraded, 2 stale+active+clean, 7 active+clean+snaptrim_error, 68 active+clean; 395 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s wr, 13 op/s; 39/870 objects degraded (4.483%) 2024-03-04T06:49:59.799 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:49:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:49:59.310+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:00.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:49:59 smithi203 podman[104735]: 2024-03-04 06:49:59.840012437 +0000 UTC m=+0.655806085 container remove ac0cd277439627a97d8acb7b3edd778f18da057cd059da92949aa3db0b47b047 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:50:00.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:00 smithi203 podman[104799]: 2024-03-04 06:49:59.955358289 +0000 UTC m=+0.017955534 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:50:00.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:00 smithi203 podman[104799]: 2024-03-04 06:50:00.066171426 +0000 UTC m=+0.128768666 container create b9857bcd7602c89f0e007348daa7c21a5e0ab21374e8d28954ce3b080958b861 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T06:50:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Possible data damage: 8 pgs snaptrim_error; Degraded data redundancy: 39/870 objects degraded (4.483%), 11 pgs degraded 2024-03-04T06:50:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : [WRN] OSD_DOWN: 1 osds down 2024-03-04T06:50:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : osd.7 (root=default,host=smithi203) is down 2024-03-04T06:50:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : [WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-03-04T06:50:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : all OSDs are running squid or later but require_osd_release < squid 2024-03-04T06:50:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : [ERR] PG_DAMAGED: Possible data damage: 8 pgs snaptrim_error 2024-03-04T06:50:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.0 is active+clean+snaptrim_error, acting [3,1,4] 2024-03-04T06:50:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.1 is active+undersized+degraded+snaptrim_error, acting [4,3,NONE] 2024-03-04T06:50:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.2 is active+clean+snaptrim_error, acting [6,0,5] 2024-03-04T06:50:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-04T06:50:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-04T06:50:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.c is active+clean+snaptrim_error, acting [1,4,0] 2024-03-04T06:50:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.e is active+clean+snaptrim_error, acting [4,5,0] 2024-03-04T06:50:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.f is active+clean+snaptrim_error, acting [5,4,6] 2024-03-04T06:50:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : [WRN] PG_DEGRADED: Degraded data redundancy: 39/870 objects degraded (4.483%), 11 pgs degraded 2024-03-04T06:50:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 1.0 is active+undersized+degraded, acting [0,6] 2024-03-04T06:50:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 2.7 is active+undersized+degraded, acting [6,2] 2024-03-04T06:50:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 2.b is active+undersized+degraded, acting [4,5] 2024-03-04T06:50:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 2.e is active+undersized+degraded, acting [2,3] 2024-03-04T06:50:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 2.f is active+undersized+degraded, acting [4,0] 2024-03-04T06:50:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 2.1c is active+undersized+degraded, acting [5,2] 2024-03-04T06:50:00.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 2.1f is active+undersized+degraded, acting [0,4] 2024-03-04T06:50:00.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.1 is active+undersized+degraded+snaptrim_error, acting [4,3,NONE] 2024-03-04T06:50:00.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.4 is active+undersized+degraded, acting [NONE,2,5] 2024-03-04T06:50:00.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.9 is active+undersized+degraded, acting [NONE,6,1] 2024-03-04T06:50:00.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:49:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.d is active+undersized+degraded, acting [2,NONE,5] 2024-03-04T06:50:00.312 INFO:tasks.rados.rados.0.smithi137.stdout:2450: done (4 left) 2024-03-04T06:50:00.312 INFO:tasks.rados.rados.0.smithi137.stdout:2451: read oid 7 snap -1 2024-03-04T06:50:00.312 INFO:tasks.rados.rados.0.smithi137.stdout:2451: expect (ObjNum 620 snap 175 seq_num 620) 2024-03-04T06:50:00.312 INFO:tasks.rados.rados.0.smithi137.stdout:2452: delete oid 50 current snap is 231 2024-03-04T06:50:00.312 INFO:tasks.rados.rados.0.smithi137.stdout:2446: finishing write tid 1 to smithi13777483-10 2024-03-04T06:50:00.312 INFO:tasks.rados.rados.0.smithi137.stdout:2448: finishing rollback tid 0 to smithi13777483-37 2024-03-04T06:50:00.312 INFO:tasks.rados.rados.0.smithi137.stdout:2446: finishing write tid 2 to smithi13777483-10 2024-03-04T06:50:00.312 INFO:tasks.rados.rados.0.smithi137.stdout:2448: finishing rollback tid 1 to smithi13777483-37 2024-03-04T06:50:00.312 INFO:tasks.rados.rados.0.smithi137.stdout:2446: finishing write tid 3 to smithi13777483-10 2024-03-04T06:50:00.312 INFO:tasks.rados.rados.0.smithi137.stdout:2448: finishing rollback tid 2 to smithi13777483-37 2024-03-04T06:50:00.312 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16797 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:50:00.313 INFO:tasks.rados.rados.0.smithi137.stdout:2446: finishing write tid 4 to smithi13777483-10 2024-03-04T06:50:00.313 INFO:tasks.rados.rados.0.smithi137.stdout:2446: oid 10 updating version 0 to 15542 2024-03-04T06:50:00.313 INFO:tasks.rados.rados.0.smithi137.stdout:2446: oid 10 updating version 15542 to 15543 2024-03-04T06:50:00.313 INFO:tasks.rados.rados.0.smithi137.stdout:2446: oid 10 updating version 15543 to 15544 2024-03-04T06:50:00.313 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15544 (ObjNum 781 snap 231 seq_num 781) dirty exists 2024-03-04T06:50:00.313 INFO:tasks.rados.rados.0.smithi137.stdout:2446: left oid 10 (ObjNum 781 snap 231 seq_num 781) 2024-03-04T06:50:00.325 INFO:tasks.rados.rados.0.smithi137.stdout:2446: done (5 left) 2024-03-04T06:50:00.325 INFO:tasks.rados.rados.0.smithi137.stdout:2447: done (4 left) 2024-03-04T06:50:00.325 INFO:tasks.rados.rados.0.smithi137.stdout:2448: done (3 left) 2024-03-04T06:50:00.325 INFO:tasks.rados.rados.0.smithi137.stdout:2449: done (2 left) 2024-03-04T06:50:00.325 INFO:tasks.rados.rados.0.smithi137.stdout:2452: done (1 left) 2024-03-04T06:50:00.325 INFO:tasks.rados.rados.0.smithi137.stdout:2453: copy_from oid 43 from oid 13 current snap is 231 2024-03-04T06:50:00.325 INFO:tasks.rados.rados.0.smithi137.stdout:2454: rollback oid 33 current snap is 231 2024-03-04T06:50:00.325 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 33 to 223 2024-03-04T06:50:00.325 INFO:tasks.rados.rados.0.smithi137.stdout:2455: delete oid 8 current snap is 231 2024-03-04T06:50:00.332 INFO:tasks.rados.rados.0.smithi137.stdout:2451: expect (ObjNum 620 snap 175 seq_num 620) 2024-03-04T06:50:00.422 INFO:tasks.rados.rados.0.smithi137.stdout:2454: finishing rollback tid 0 to smithi13777483-33 2024-03-04T06:50:00.422 INFO:tasks.rados.rados.0.smithi137.stdout:2454: finishing rollback tid 1 to smithi13777483-33 2024-03-04T06:50:00.422 INFO:tasks.rados.rados.0.smithi137.stdout:2454: finishing rollback tid 2 to smithi13777483-33 2024-03-04T06:50:00.422 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16801 (ObjNum 596 snap 170 seq_num 596) dirty exists 2024-03-04T06:50:00.422 INFO:tasks.rados.rados.0.smithi137.stdout:2453: finishing copy_from racing read to smithi13777483-43 2024-03-04T06:50:00.422 INFO:tasks.rados.rados.0.smithi137.stdout:2453: finishing copy_from to smithi13777483-43 2024-03-04T06:50:00.422 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16853 (ObjNum 615 snap 175 seq_num 615) dirty exists 2024-03-04T06:50:00.422 INFO:tasks.rados.rados.0.smithi137.stdout:2451: done (3 left) 2024-03-04T06:50:00.422 INFO:tasks.rados.rados.0.smithi137.stdout:2453: done (2 left) 2024-03-04T06:50:00.422 INFO:tasks.rados.rados.0.smithi137.stdout:2454: done (1 left) 2024-03-04T06:50:00.422 INFO:tasks.rados.rados.0.smithi137.stdout:2455: done (0 left) 2024-03-04T06:50:00.422 INFO:tasks.rados.rados.0.smithi137.stdout:2456: read oid 30 snap -1 2024-03-04T06:50:00.423 INFO:tasks.rados.rados.0.smithi137.stdout:2456: expect (ObjNum 768 snap 228 seq_num 768) 2024-03-04T06:50:00.423 INFO:tasks.rados.rados.0.smithi137.stdout:2457: copy_from oid 22 from oid 27 current snap is 231 2024-03-04T06:50:00.423 INFO:tasks.rados.rados.0.smithi137.stdout:2458: read oid 1 snap -1 2024-03-04T06:50:00.423 INFO:tasks.rados.rados.0.smithi137.stdout:2458: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:50:00.423 INFO:tasks.rados.rados.0.smithi137.stdout:2459: setattr oid 50 current snap is 231 2024-03-04T06:50:00.423 INFO:tasks.rados.rados.0.smithi137.stdout:2457: finishing copy_from to smithi13777483-22 2024-03-04T06:50:00.424 INFO:tasks.rados.rados.0.smithi137.stdout:2457: got expected ENOENT (src dne) 2024-03-04T06:50:00.424 INFO:tasks.rados.rados.0.smithi137.stdout:2457: finishing copy_from racing read to smithi13777483-22 2024-03-04T06:50:00.424 INFO:tasks.rados.rados.0.smithi137.stdout:2457: done (3 left) 2024-03-04T06:50:00.424 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 231 2024-03-04T06:50:00.424 INFO:tasks.rados.rados.0.smithi137.stdout:2460: seq_num 784 ranges {2342912=737280,3080192=401408} 2024-03-04T06:50:00.440 INFO:tasks.rados.rados.0.smithi137.stdout:2460: writing smithi13777483-7 from 2342912 to 3080192 tid 1 2024-03-04T06:50:00.442 INFO:tasks.rados.rados.0.smithi137.stdout:2460: writing smithi13777483-7 from 3080192 to 3481600 tid 2 2024-03-04T06:50:00.443 INFO:tasks.rados.rados.0.smithi137.stdout:2461: setattr oid 42 current snap is 231 2024-03-04T06:50:00.443 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 16854 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:50:00.443 INFO:tasks.rados.rados.0.smithi137.stdout:2456: expect (ObjNum 768 snap 228 seq_num 768) 2024-03-04T06:50:00.469 INFO:tasks.rados.rados.0.smithi137.stdout:2458: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:50:00.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:00.315+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:00.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:00.315+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:00.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:00.327+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:00.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:00 smithi203 podman[104799]: 2024-03-04 06:50:00.303048055 +0000 UTC m=+0.365645308 container init b9857bcd7602c89f0e007348daa7c21a5e0ab21374e8d28954ce3b080958b861 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-04T06:50:00.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:00 smithi203 podman[104799]: 2024-03-04 06:50:00.306362673 +0000 UTC m=+0.368959916 container start b9857bcd7602c89f0e007348daa7c21a5e0ab21374e8d28954ce3b080958b861 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-04T06:50:00.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-osd[104820]: -- 172.21.15.203:0/2619525329 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564875ffb680 con 0x564875fc4c00 2024-03-04T06:50:00.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:00 smithi203 bash[104799]: b9857bcd7602c89f0e007348daa7c21a5e0ab21374e8d28954ce3b080958b861 2024-03-04T06:50:00.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:00 smithi203 systemd[1]: Started Ceph osd.7 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:50:00.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: Health check failed: Degraded data redundancy: 39/870 objects degraded (4.483%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:50:00.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:00.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:00.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: osdmap e529: 8 total, 7 up, 8 in 2024-03-04T06:50:00.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: Health detail: HEALTH_ERR 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Possible data damage: 8 pgs snaptrim_error; Degraded data redundancy: 39/870 objects degraded (4.483%), 11 pgs degraded 2024-03-04T06:50:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: [WRN] OSD_DOWN: 1 osds down 2024-03-04T06:50:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: osd.7 (root=default,host=smithi203) is down 2024-03-04T06:50:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: [WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-03-04T06:50:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: all OSDs are running squid or later but require_osd_release < squid 2024-03-04T06:50:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: [ERR] PG_DAMAGED: Possible data damage: 8 pgs snaptrim_error 2024-03-04T06:50:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 5.0 is active+clean+snaptrim_error, acting [3,1,4] 2024-03-04T06:50:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 5.1 is active+undersized+degraded+snaptrim_error, acting [4,3,NONE] 2024-03-04T06:50:00.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 5.2 is active+clean+snaptrim_error, acting [6,0,5] 2024-03-04T06:50:00.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-04T06:50:00.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-04T06:50:00.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 5.c is active+clean+snaptrim_error, acting [1,4,0] 2024-03-04T06:50:00.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 5.e is active+clean+snaptrim_error, acting [4,5,0] 2024-03-04T06:50:00.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 5.f is active+clean+snaptrim_error, acting [5,4,6] 2024-03-04T06:50:00.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: [WRN] PG_DEGRADED: Degraded data redundancy: 39/870 objects degraded (4.483%), 11 pgs degraded 2024-03-04T06:50:00.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 1.0 is active+undersized+degraded, acting [0,6] 2024-03-04T06:50:00.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 2.7 is active+undersized+degraded, acting [6,2] 2024-03-04T06:50:00.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 2.b is active+undersized+degraded, acting [4,5] 2024-03-04T06:50:00.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 2.e is active+undersized+degraded, acting [2,3] 2024-03-04T06:50:00.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 2.f is active+undersized+degraded, acting [4,0] 2024-03-04T06:50:00.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-03-04T06:50:00.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-03-04T06:50:00.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 5.1 is active+undersized+degraded+snaptrim_error, acting [4,3,NONE] 2024-03-04T06:50:00.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 5.4 is active+undersized+degraded, acting [NONE,2,5] 2024-03-04T06:50:00.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 5.9 is active+undersized+degraded, acting [NONE,6,1] 2024-03-04T06:50:00.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-mon[85573]: pg 5.d is active+undersized+degraded, acting [2,NONE,5] 2024-03-04T06:50:00.609 INFO:tasks.rados.rados.0.smithi137.stdout:2460: finishing write tid 1 to smithi13777483-7 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:2460: finishing write tid 2 to smithi13777483-7 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:2460: finishing write tid 3 to smithi13777483-7 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:2460: finishing write tid 4 to smithi13777483-7 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:2460: oid 7 updating version 0 to 16826 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:2460: oid 7 updating version 16826 to 16827 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:2460: oid 7 updating version 16827 to 16828 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16828 (ObjNum 784 snap 231 seq_num 784) dirty exists 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:2460: left oid 7 (ObjNum 784 snap 231 seq_num 784) 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:2456: done (4 left) 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:2458: done (3 left) 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:2459: done (2 left) 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:2460: done (1 left) 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:2462: rollback oid 35 current snap is 231 2024-03-04T06:50:00.610 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 35 to 220 2024-03-04T06:50:00.611 INFO:tasks.rados.rados.0.smithi137.stdout:2463: read oid 22 snap -1 2024-03-04T06:50:00.611 INFO:tasks.rados.rados.0.smithi137.stdout:2463: expect deleted 2024-03-04T06:50:00.611 INFO:tasks.rados.rados.0.smithi137.stdout:2464: read oid 31 snap -1 2024-03-04T06:50:00.611 INFO:tasks.rados.rados.0.smithi137.stdout:2464: expect (ObjNum 422 snap 126 seq_num 422) 2024-03-04T06:50:00.611 INFO:tasks.rados.rados.0.smithi137.stdout:2465: copy_from oid 27 from oid 46 current snap is 231 2024-03-04T06:50:00.611 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 231 2024-03-04T06:50:00.611 INFO:tasks.rados.rados.0.smithi137.stdout:2466: seq_num 785 ranges {1040384=753664,1794048=401408} 2024-03-04T06:50:00.619 INFO:tasks.rados.rados.0.smithi137.stdout:2466: writing smithi13777483-9 from 1040384 to 1794048 tid 1 2024-03-04T06:50:00.622 INFO:tasks.rados.rados.0.smithi137.stdout:2466: writing smithi13777483-9 from 1794048 to 2195456 tid 2 2024-03-04T06:50:00.622 INFO:tasks.rados.rados.0.smithi137.stdout:2467: read oid 37 snap -1 2024-03-04T06:50:00.622 INFO:tasks.rados.rados.0.smithi137.stdout:2467: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:50:00.622 INFO:tasks.rados.rados.0.smithi137.stdout:2468: snap_remove snap 212 2024-03-04T06:50:00.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:00.323+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:00.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:00.314+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:00.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:00.315+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:00.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:00.308+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: Health check failed: Degraded data redundancy: 39/870 objects degraded (4.483%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:50:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: osdmap e529: 8 total, 7 up, 8 in 2024-03-04T06:50:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: Health detail: HEALTH_ERR 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Possible data damage: 8 pgs snaptrim_error; Degraded data redundancy: 39/870 objects degraded (4.483%), 11 pgs degraded 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: [WRN] OSD_DOWN: 1 osds down 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: osd.7 (root=default,host=smithi203) is down 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: [WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: all OSDs are running squid or later but require_osd_release < squid 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: [ERR] PG_DAMAGED: Possible data damage: 8 pgs snaptrim_error 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 5.0 is active+clean+snaptrim_error, acting [3,1,4] 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 5.1 is active+undersized+degraded+snaptrim_error, acting [4,3,NONE] 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 5.2 is active+clean+snaptrim_error, acting [6,0,5] 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 5.c is active+clean+snaptrim_error, acting [1,4,0] 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 5.e is active+clean+snaptrim_error, acting [4,5,0] 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 5.f is active+clean+snaptrim_error, acting [5,4,6] 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: [WRN] PG_DEGRADED: Degraded data redundancy: 39/870 objects degraded (4.483%), 11 pgs degraded 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 1.0 is active+undersized+degraded, acting [0,6] 2024-03-04T06:50:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 2.7 is active+undersized+degraded, acting [6,2] 2024-03-04T06:50:00.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 2.b is active+undersized+degraded, acting [4,5] 2024-03-04T06:50:00.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 2.e is active+undersized+degraded, acting [2,3] 2024-03-04T06:50:00.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 2.f is active+undersized+degraded, acting [4,0] 2024-03-04T06:50:00.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-03-04T06:50:00.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-03-04T06:50:00.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 5.1 is active+undersized+degraded+snaptrim_error, acting [4,3,NONE] 2024-03-04T06:50:00.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 5.4 is active+undersized+degraded, acting [NONE,2,5] 2024-03-04T06:50:00.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 5.9 is active+undersized+degraded, acting [NONE,6,1] 2024-03-04T06:50:00.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[91314]: pg 5.d is active+undersized+degraded, acting [2,NONE,5] 2024-03-04T06:50:00.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: Health check failed: Degraded data redundancy: 39/870 objects degraded (4.483%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:50:00.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:00.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:00.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: osdmap e529: 8 total, 7 up, 8 in 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: Health detail: HEALTH_ERR 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Possible data damage: 8 pgs snaptrim_error; Degraded data redundancy: 39/870 objects degraded (4.483%), 11 pgs degraded 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: [WRN] OSD_DOWN: 1 osds down 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: osd.7 (root=default,host=smithi203) is down 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: [WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: all OSDs are running squid or later but require_osd_release < squid 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: [ERR] PG_DAMAGED: Possible data damage: 8 pgs snaptrim_error 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 5.0 is active+clean+snaptrim_error, acting [3,1,4] 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 5.1 is active+undersized+degraded+snaptrim_error, acting [4,3,NONE] 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 5.2 is active+clean+snaptrim_error, acting [6,0,5] 2024-03-04T06:50:00.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 5.c is active+clean+snaptrim_error, acting [1,4,0] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 5.e is active+clean+snaptrim_error, acting [4,5,0] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 5.f is active+clean+snaptrim_error, acting [5,4,6] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: [WRN] PG_DEGRADED: Degraded data redundancy: 39/870 objects degraded (4.483%), 11 pgs degraded 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 1.0 is active+undersized+degraded, acting [0,6] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 2.7 is active+undersized+degraded, acting [6,2] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 2.b is active+undersized+degraded, acting [4,5] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 2.e is active+undersized+degraded, acting [2,3] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 2.f is active+undersized+degraded, acting [4,0] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 5.1 is active+undersized+degraded+snaptrim_error, acting [4,3,NONE] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 5.4 is active+undersized+degraded, acting [NONE,2,5] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 5.9 is active+undersized+degraded, acting [NONE,6,1] 2024-03-04T06:50:00.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:00 smithi137 ceph-mon[88869]: pg 5.d is active+undersized+degraded, acting [2,NONE,5] 2024-03-04T06:50:01.208 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:00.851+0000 7f310a91c7c0 -1 Falling back to public interface 2024-03-04T06:50:01.439 INFO:tasks.rados.rados.0.smithi137.stdout:2468: done (7 left) 2024-03-04T06:50:01.439 INFO:tasks.rados.rados.0.smithi137.stdout:2469: copy_from oid 41 from oid 11 current snap is 231 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16855 (ObjNum 771 snap 228 seq_num 771) dirty exists 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:2462: finishing rollback tid 0 to smithi13777483-35 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:2462: finishing rollback tid 1 to smithi13777483-35 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:2462: finishing rollback tid 2 to smithi13777483-35 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16804 (ObjNum 743 snap 220 seq_num 743) dirty exists 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:2465: finishing copy_from racing read to smithi13777483-27 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:2465: finishing copy_from to smithi13777483-27 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16852 (ObjNum 772 snap 228 seq_num 772) dirty exists 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:2466: finishing write tid 1 to smithi13777483-9 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:2466: finishing write tid 2 to smithi13777483-9 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:2466: finishing write tid 3 to smithi13777483-9 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:2466: finishing write tid 4 to smithi13777483-9 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:2466: oid 9 updating version 0 to 15547 2024-03-04T06:50:01.440 INFO:tasks.rados.rados.0.smithi137.stdout:2466: oid 9 version 15547 is already newer than 15546 2024-03-04T06:50:01.441 INFO:tasks.rados.rados.0.smithi137.stdout:2466: oid 9 version 15547 is already newer than 15545 2024-03-04T06:50:01.441 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 15547 (ObjNum 785 snap 231 seq_num 785) dirty exists 2024-03-04T06:50:01.441 INFO:tasks.rados.rados.0.smithi137.stdout:2466: left oid 9 (ObjNum 785 snap 231 seq_num 785) 2024-03-04T06:50:01.441 INFO:tasks.rados.rados.0.smithi137.stdout:2464: expect (ObjNum 422 snap 126 seq_num 422) 2024-03-04T06:50:01.552 INFO:tasks.rados.rados.0.smithi137.stdout:2467: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:50:01.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:01.436+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:01.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:01.441+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:01.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:01.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-mon[85573]: osdmap e530: 8 total, 7 up, 8 in 2024-03-04T06:50:01.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:01.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:01.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:01.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:01.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:01.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:01.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-mon[85573]: pgmap v472: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 39 active+undersized, 10 active+undersized+degraded, 7 active+clean+snaptrim_error, 64 active+clean; 395 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 1.2 MiB/s wr, 12 op/s; 39/870 objects degraded (4.483%) 2024-03-04T06:50:01.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:01.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:01.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:01.683 INFO:tasks.rados.rados.0.smithi137.stdout:2469: finishing copy_from to smithi13777483-41 2024-03-04T06:50:01.684 INFO:tasks.rados.rados.0.smithi137.stdout:2469: got expected ENOENT (src dne) 2024-03-04T06:50:01.684 INFO:tasks.rados.rados.0.smithi137.stdout:2469: finishing copy_from racing read to smithi13777483-41 2024-03-04T06:50:01.684 INFO:tasks.rados.rados.0.smithi137.stdout:2461: done (7 left) 2024-03-04T06:50:01.684 INFO:tasks.rados.rados.0.smithi137.stdout:2462: done (6 left) 2024-03-04T06:50:01.684 INFO:tasks.rados.rados.0.smithi137.stdout:2463: done (5 left) 2024-03-04T06:50:01.684 INFO:tasks.rados.rados.0.smithi137.stdout:2464: done (4 left) 2024-03-04T06:50:01.684 INFO:tasks.rados.rados.0.smithi137.stdout:2465: done (3 left) 2024-03-04T06:50:01.684 INFO:tasks.rados.rados.0.smithi137.stdout:2466: done (2 left) 2024-03-04T06:50:01.684 INFO:tasks.rados.rados.0.smithi137.stdout:2467: done (1 left) 2024-03-04T06:50:01.684 INFO:tasks.rados.rados.0.smithi137.stdout:2469: done (0 left) 2024-03-04T06:50:01.684 INFO:tasks.rados.rados.0.smithi137.stdout:2470: read oid 19 snap 221 2024-03-04T06:50:01.685 INFO:tasks.rados.rados.0.smithi137.stdout:2470: expect (ObjNum -1164191632 snap 21906 seq_num 3131424512) 2024-03-04T06:50:01.685 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 231 2024-03-04T06:50:01.685 INFO:tasks.rados.rados.0.smithi137.stdout:2471: seq_num 786 ranges {3235840=770048,4005888=401408} 2024-03-04T06:50:01.704 INFO:tasks.rados.rados.0.smithi137.stdout:2471: writing smithi13777483-31 from 3235840 to 4005888 tid 1 2024-03-04T06:50:01.707 INFO:tasks.rados.rados.0.smithi137.stdout:2471: writing smithi13777483-31 from 4005888 to 4407296 tid 2 2024-03-04T06:50:01.707 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 231 2024-03-04T06:50:01.707 INFO:tasks.rados.rados.0.smithi137.stdout:2472: seq_num 787 ranges {0=786432,786432=401408} 2024-03-04T06:50:01.711 INFO:tasks.rados.rados.0.smithi137.stdout:2472: writing smithi13777483-47 from 0 to 786432 tid 1 2024-03-04T06:50:01.713 INFO:tasks.rados.rados.0.smithi137.stdout:2472: writing smithi13777483-47 from 786432 to 1187840 tid 2 2024-03-04T06:50:01.713 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 231 2024-03-04T06:50:01.713 INFO:tasks.rados.rados.0.smithi137.stdout:2473: seq_num 788 ranges {2695168=802816,3497984=401408} 2024-03-04T06:50:01.732 INFO:tasks.rados.rados.0.smithi137.stdout:2473: writing smithi13777483-1 from 2695168 to 3497984 tid 1 2024-03-04T06:50:01.735 INFO:tasks.rados.rados.0.smithi137.stdout:2473: writing smithi13777483-1 from 3497984 to 3899392 tid 2 2024-03-04T06:50:01.735 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 24 current snap is 231 2024-03-04T06:50:01.735 INFO:tasks.rados.rados.0.smithi137.stdout:2474: seq_num 789 ranges {1908736=417792,2326528=663552,2990080=139264} 2024-03-04T06:50:01.747 INFO:tasks.rados.rados.0.smithi137.stdout:2474: writing smithi13777483-24 from 1908736 to 2326528 tid 1 2024-03-04T06:50:01.750 INFO:tasks.rados.rados.0.smithi137.stdout:2474: writing smithi13777483-24 from 2326528 to 2990080 tid 2 2024-03-04T06:50:01.752 INFO:tasks.rados.rados.0.smithi137.stdout:2474: writing smithi13777483-24 from 2990080 to 3129344 tid 3 2024-03-04T06:50:01.752 INFO:tasks.rados.rados.0.smithi137.stdout:2475: read oid 41 snap -1 2024-03-04T06:50:01.752 INFO:tasks.rados.rados.0.smithi137.stdout:2475: expect (ObjNum 639 snap 178 seq_num 639) 2024-03-04T06:50:01.752 INFO:tasks.rados.rados.0.smithi137.stdout:2476: snap_remove snap 209 2024-03-04T06:50:01.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:01.442+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:01.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:01.443+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:01.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:01.443+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:01.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:01.446+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:01.794 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:01.438+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[91314]: osdmap e530: 8 total, 7 up, 8 in 2024-03-04T06:50:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:01.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:01.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[91314]: pgmap v472: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 39 active+undersized, 10 active+undersized+degraded, 7 active+clean+snaptrim_error, 64 active+clean; 395 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 1.2 MiB/s wr, 12 op/s; 39/870 objects degraded (4.483%) 2024-03-04T06:50:01.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:01.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:01.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[88869]: osdmap e530: 8 total, 7 up, 8 in 2024-03-04T06:50:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:01.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[88869]: pgmap v472: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 39 active+undersized, 10 active+undersized+degraded, 7 active+clean+snaptrim_error, 64 active+clean; 395 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 1.2 MiB/s wr, 12 op/s; 39/870 objects degraded (4.483%) 2024-03-04T06:50:01.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:01.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:01.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:01 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:02.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:01.707+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:02.075 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:01.707+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:02.444 INFO:tasks.rados.rados.0.smithi137.stdout:2470: expect (ObjNum -1164191632 snap 21906 seq_num 3131424512) 2024-03-04T06:50:02.449 INFO:tasks.rados.rados.0.smithi137.stdout:2471: finishing write tid 1 to smithi13777483-31 2024-03-04T06:50:02.449 INFO:tasks.rados.rados.0.smithi137.stdout:2471: finishing write tid 2 to smithi13777483-31 2024-03-04T06:50:02.449 INFO:tasks.rados.rados.0.smithi137.stdout:2471: finishing write tid 3 to smithi13777483-31 2024-03-04T06:50:02.449 INFO:tasks.rados.rados.0.smithi137.stdout:2471: finishing write tid 4 to smithi13777483-31 2024-03-04T06:50:02.449 INFO:tasks.rados.rados.0.smithi137.stdout:2471: oid 31 updating version 0 to 16805 2024-03-04T06:50:02.449 INFO:tasks.rados.rados.0.smithi137.stdout:2471: oid 31 updating version 16805 to 16806 2024-03-04T06:50:02.449 INFO:tasks.rados.rados.0.smithi137.stdout:2471: oid 31 updating version 16806 to 16807 2024-03-04T06:50:02.449 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16807 (ObjNum 786 snap 231 seq_num 786) dirty exists 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2471: left oid 31 (ObjNum 786 snap 231 seq_num 786) 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2472: finishing write tid 1 to smithi13777483-47 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2472: finishing write tid 2 to smithi13777483-47 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2472: finishing write tid 3 to smithi13777483-47 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2472: finishing write tid 4 to smithi13777483-47 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2472: oid 47 updating version 0 to 16823 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2472: oid 47 updating version 16823 to 16825 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2472: oid 47 version 16825 is already newer than 16824 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16825 (ObjNum 787 snap 231 seq_num 787) dirty exists 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2472: left oid 47 (ObjNum 787 snap 231 seq_num 787) 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2473: finishing write tid 1 to smithi13777483-1 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2473: finishing write tid 2 to smithi13777483-1 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2473: finishing write tid 3 to smithi13777483-1 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2473: finishing write tid 4 to smithi13777483-1 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2473: oid 1 updating version 0 to 16812 2024-03-04T06:50:02.450 INFO:tasks.rados.rados.0.smithi137.stdout:2473: oid 1 updating version 16812 to 16813 2024-03-04T06:50:02.451 INFO:tasks.rados.rados.0.smithi137.stdout:2473: oid 1 version 16813 is already newer than 16811 2024-03-04T06:50:02.451 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 16813 (ObjNum 788 snap 231 seq_num 788) dirty exists 2024-03-04T06:50:02.451 INFO:tasks.rados.rados.0.smithi137.stdout:2473: left oid 1 (ObjNum 788 snap 231 seq_num 788) 2024-03-04T06:50:02.451 INFO:tasks.rados.rados.0.smithi137.stdout:2475: expect (ObjNum 639 snap 178 seq_num 639) 2024-03-04T06:50:02.491 INFO:tasks.rados.rados.0.smithi137.stdout:2474: finishing write tid 1 to smithi13777483-24 2024-03-04T06:50:02.491 INFO:tasks.rados.rados.0.smithi137.stdout:2474: finishing write tid 2 to smithi13777483-24 2024-03-04T06:50:02.491 INFO:tasks.rados.rados.0.smithi137.stdout:2474: finishing write tid 3 to smithi13777483-24 2024-03-04T06:50:02.491 INFO:tasks.rados.rados.0.smithi137.stdout:2474: finishing write tid 4 to smithi13777483-24 2024-03-04T06:50:02.491 INFO:tasks.rados.rados.0.smithi137.stdout:2474: finishing write tid 5 to smithi13777483-24 2024-03-04T06:50:02.491 INFO:tasks.rados.rados.0.smithi137.stdout:2474: oid 24 updating version 0 to 16781 2024-03-04T06:50:02.491 INFO:tasks.rados.rados.0.smithi137.stdout:2474: oid 24 updating version 16781 to 16783 2024-03-04T06:50:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:2474: oid 24 updating version 16783 to 16784 2024-03-04T06:50:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:2474: oid 24 version 16784 is already newer than 16782 2024-03-04T06:50:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16784 (ObjNum 789 snap 231 seq_num 789) dirty exists 2024-03-04T06:50:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:2474: left oid 24 (ObjNum 789 snap 231 seq_num 789) 2024-03-04T06:50:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:2470: done (6 left) 2024-03-04T06:50:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:2471: done (5 left) 2024-03-04T06:50:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:2472: done (4 left) 2024-03-04T06:50:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:2473: done (3 left) 2024-03-04T06:50:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:2474: done (2 left) 2024-03-04T06:50:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:2475: done (1 left) 2024-03-04T06:50:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:2476: done (0 left) 2024-03-04T06:50:02.492 INFO:tasks.rados.rados.0.smithi137.stdout:2477: delete oid 15 current snap is 231 2024-03-04T06:50:02.493 INFO:tasks.rados.rados.0.smithi137.stdout:2477: done (0 left) 2024-03-04T06:50:02.493 INFO:tasks.rados.rados.0.smithi137.stdout:2478: delete oid 39 current snap is 231 2024-03-04T06:50:02.498 INFO:tasks.rados.rados.0.smithi137.stdout:2478: done (0 left) 2024-03-04T06:50:02.498 INFO:tasks.rados.rados.0.smithi137.stdout:2479: copy_from oid 18 from oid 48 current snap is 231 2024-03-04T06:50:02.498 INFO:tasks.rados.rados.0.smithi137.stdout:2480: read oid 29 snap -1 2024-03-04T06:50:02.498 INFO:tasks.rados.rados.0.smithi137.stdout:2480: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:50:02.498 INFO:tasks.rados.rados.0.smithi137.stdout:2481: snap_remove snap 220 2024-03-04T06:50:02.771 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:02.442+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:02.772 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:02.447+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:02.772 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:02.772 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:02 smithi203 ceph-mon[85573]: osdmap e531: 8 total, 7 up, 8 in 2024-03-04T06:50:02.772 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:02.772 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:02.772 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:02.772 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:02.772 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:02.773 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:02 smithi203 ceph-mon[85573]: pgmap v474: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 39 active+undersized, 10 active+undersized+degraded, 7 active+clean+snaptrim_error, 64 active+clean; 395 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 456 KiB/s wr, 6 op/s; 39/870 objects degraded (4.483%) 2024-03-04T06:50:02.773 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:02.445+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:02.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:02.446+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:02.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:02.448+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:02.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:02.444+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:02.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:02.458+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[88869]: osdmap e531: 8 total, 7 up, 8 in 2024-03-04T06:50:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[88869]: pgmap v474: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 39 active+undersized, 10 active+undersized+degraded, 7 active+clean+snaptrim_error, 64 active+clean; 395 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 456 KiB/s wr, 6 op/s; 39/870 objects degraded (4.483%) 2024-03-04T06:50:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[91314]: osdmap e531: 8 total, 7 up, 8 in 2024-03-04T06:50:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:02.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:02.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:02.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:02.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:02 smithi137 ceph-mon[91314]: pgmap v474: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 39 active+undersized, 10 active+undersized+degraded, 7 active+clean+snaptrim_error, 64 active+clean; 395 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 456 KiB/s wr, 6 op/s; 39/870 objects degraded (4.483%) 2024-03-04T06:50:03.450 INFO:tasks.rados.rados.0.smithi137.stdout:2480: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:50:03.454 INFO:tasks.rados.rados.0.smithi137.stdout:2479: finishing copy_from racing read to smithi13777483-18 2024-03-04T06:50:03.454 INFO:tasks.rados.rados.0.smithi137.stdout:2479: finishing copy_from to smithi13777483-18 2024-03-04T06:50:03.455 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16800 (ObjNum 760 snap 225 seq_num 760) dirty exists 2024-03-04T06:50:03.455 INFO:tasks.rados.rados.0.smithi137.stdout:2479: done (2 left) 2024-03-04T06:50:03.455 INFO:tasks.rados.rados.0.smithi137.stdout:2480: done (1 left) 2024-03-04T06:50:03.455 INFO:tasks.rados.rados.0.smithi137.stdout:2481: done (0 left) 2024-03-04T06:50:03.455 INFO:tasks.rados.rados.0.smithi137.stdout:2482: snap_remove snap 200 2024-03-04T06:50:03.767 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:03.447+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:03.767 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:03.453+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:03.767 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:03.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:03 smithi203 ceph-mon[85573]: osdmap e532: 8 total, 7 up, 8 in 2024-03-04T06:50:03.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:03.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:03.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:03.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:03.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:03.768 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:03.768 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:03.545+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:03.768 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:03.545+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:03.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:03.449+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:03.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:03.454+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:03.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:03.454+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:03.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:03.456+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:03.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:03.459+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[91314]: osdmap e532: 8 total, 7 up, 8 in 2024-03-04T06:50:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:03.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:03.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[88869]: osdmap e532: 8 total, 7 up, 8 in 2024-03-04T06:50:03.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:03.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:03.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:03.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:03.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:03.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:04.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:04.022+0000 7f310a91c7c0 -1 osd.7 524 log_to_monitors true 2024-03-04T06:50:04.465 INFO:tasks.rados.rados.0.smithi137.stdout:2482: done (0 left) 2024-03-04T06:50:04.465 INFO:tasks.rados.rados.0.smithi137.stdout:2483: delete oid 28 current snap is 231 2024-03-04T06:50:04.473 INFO:tasks.rados.rados.0.smithi137.stdout:2483: done (0 left) 2024-03-04T06:50:04.473 INFO:tasks.rados.rados.0.smithi137.stdout:2484: delete oid 19 current snap is 231 2024-03-04T06:50:04.479 INFO:tasks.rados.rados.0.smithi137.stdout:2484: done (0 left) 2024-03-04T06:50:04.480 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 231 2024-03-04T06:50:04.480 INFO:tasks.rados.rados.0.smithi137.stdout:2485: seq_num 794 ranges {3973120=499712,4472832=532480,5005312=270336} 2024-03-04T06:50:04.504 INFO:tasks.rados.rados.0.smithi137.stdout:2485: writing smithi13777483-18 from 3973120 to 4472832 tid 1 2024-03-04T06:50:04.507 INFO:tasks.rados.rados.0.smithi137.stdout:2485: writing smithi13777483-18 from 4472832 to 5005312 tid 2 2024-03-04T06:50:04.509 INFO:tasks.rados.rados.0.smithi137.stdout:2485: writing smithi13777483-18 from 5005312 to 5275648 tid 3 2024-03-04T06:50:04.509 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 231 2024-03-04T06:50:04.509 INFO:tasks.rados.rados.0.smithi137.stdout:2485: finishing write tid 1 to smithi13777483-18 2024-03-04T06:50:04.509 INFO:tasks.rados.rados.0.smithi137.stdout:2486: seq_num 795 ranges {884736=524288,1409024=417792,1826816=385024} 2024-03-04T06:50:04.516 INFO:tasks.rados.rados.0.smithi137.stdout:2486: writing smithi13777483-14 from 884736 to 1409024 tid 1 2024-03-04T06:50:04.519 INFO:tasks.rados.rados.0.smithi137.stdout:2486: writing smithi13777483-14 from 1409024 to 1826816 tid 2 2024-03-04T06:50:04.521 INFO:tasks.rados.rados.0.smithi137.stdout:2486: writing smithi13777483-14 from 1826816 to 2211840 tid 3 2024-03-04T06:50:04.522 INFO:tasks.rados.rados.0.smithi137.stdout:2487: delete oid 35 current snap is 231 2024-03-04T06:50:04.522 INFO:tasks.rados.rados.0.smithi137.stdout:2485: finishing write tid 2 to smithi13777483-18 2024-03-04T06:50:04.522 INFO:tasks.rados.rados.0.smithi137.stdout:2485: finishing write tid 3 to smithi13777483-18 2024-03-04T06:50:04.522 INFO:tasks.rados.rados.0.smithi137.stdout:2485: finishing write tid 4 to smithi13777483-18 2024-03-04T06:50:04.522 INFO:tasks.rados.rados.0.smithi137.stdout:2485: finishing write tid 5 to smithi13777483-18 2024-03-04T06:50:04.522 INFO:tasks.rados.rados.0.smithi137.stdout:2485: oid 18 updating version 0 to 16808 2024-03-04T06:50:04.522 INFO:tasks.rados.rados.0.smithi137.stdout:2485: oid 18 updating version 16808 to 16809 2024-03-04T06:50:04.522 INFO:tasks.rados.rados.0.smithi137.stdout:2485: oid 18 version 16809 is already newer than 16806 2024-03-04T06:50:04.522 INFO:tasks.rados.rados.0.smithi137.stdout:2485: oid 18 version 16809 is already newer than 16807 2024-03-04T06:50:04.522 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16809 (ObjNum 794 snap 231 seq_num 794) dirty exists 2024-03-04T06:50:04.522 INFO:tasks.rados.rados.0.smithi137.stdout:2485: left oid 18 (ObjNum 794 snap 231 seq_num 794) 2024-03-04T06:50:04.522 INFO:tasks.rados.rados.0.smithi137.stdout:2486: finishing write tid 1 to smithi13777483-14 2024-03-04T06:50:04.523 INFO:tasks.rados.rados.0.smithi137.stdout:2485: done (2 left) 2024-03-04T06:50:04.524 INFO:tasks.rados.rados.0.smithi137.stdout:2487: done (1 left) 2024-03-04T06:50:04.524 INFO:tasks.rados.rados.0.smithi137.stdout:2488: setattr oid 35 current snap is 231 2024-03-04T06:50:04.525 INFO:tasks.rados.rados.0.smithi137.stdout:2486: finishing write tid 2 to smithi13777483-14 2024-03-04T06:50:04.525 INFO:tasks.rados.rados.0.smithi137.stdout:2486: finishing write tid 3 to smithi13777483-14 2024-03-04T06:50:04.525 INFO:tasks.rados.rados.0.smithi137.stdout:2489: copy_from oid 26 from oid 1 current snap is 231 2024-03-04T06:50:04.525 INFO:tasks.rados.rados.0.smithi137.stdout:2490: copy_from oid 17 from oid 29 current snap is 231 2024-03-04T06:50:04.525 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 231 2024-03-04T06:50:04.525 INFO:tasks.rados.rados.0.smithi137.stdout:2486: finishing write tid 4 to smithi13777483-14 2024-03-04T06:50:04.525 INFO:tasks.rados.rados.0.smithi137.stdout:2491: seq_num 797 ranges {933888=557056,1490944=589824,2080768=212992} 2024-03-04T06:50:04.533 INFO:tasks.rados.rados.0.smithi137.stdout:2491: writing smithi13777483-27 from 933888 to 1490944 tid 1 2024-03-04T06:50:04.537 INFO:tasks.rados.rados.0.smithi137.stdout:2491: writing smithi13777483-27 from 1490944 to 2080768 tid 2 2024-03-04T06:50:04.539 INFO:tasks.rados.rados.0.smithi137.stdout:2491: writing smithi13777483-27 from 2080768 to 2293760 tid 3 2024-03-04T06:50:04.539 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 231 2024-03-04T06:50:04.539 INFO:tasks.rados.rados.0.smithi137.stdout:2486: finishing write tid 5 to smithi13777483-14 2024-03-04T06:50:04.539 INFO:tasks.rados.rados.0.smithi137.stdout:2486: oid 14 updating version 0 to 15524 2024-03-04T06:50:04.540 INFO:tasks.rados.rados.0.smithi137.stdout:2486: oid 14 version 15524 is already newer than 15523 2024-03-04T06:50:04.540 INFO:tasks.rados.rados.0.smithi137.stdout:2486: oid 14 updating version 15524 to 15525 2024-03-04T06:50:04.540 INFO:tasks.rados.rados.0.smithi137.stdout:2486: oid 14 updating version 15525 to 15526 2024-03-04T06:50:04.540 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 15526 (ObjNum 795 snap 231 seq_num 795) dirty exists 2024-03-04T06:50:04.540 INFO:tasks.rados.rados.0.smithi137.stdout:2486: left oid 14 (ObjNum 795 snap 231 seq_num 795) 2024-03-04T06:50:04.540 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16809 (ObjNum 33 snap 0 seq_num 2) dirty exists 2024-03-04T06:50:04.540 INFO:tasks.rados.rados.0.smithi137.stdout:2490: finishing copy_from racing read to smithi13777483-17 2024-03-04T06:50:04.540 INFO:tasks.rados.rados.0.smithi137.stdout:2490: finishing copy_from to smithi13777483-17 2024-03-04T06:50:04.540 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16800 (ObjNum 129 snap 0 seq_num 3131036984) dirty exists 2024-03-04T06:50:04.540 INFO:tasks.rados.rados.0.smithi137.stdout:2491: finishing write tid 1 to smithi13777483-27 2024-03-04T06:50:04.540 INFO:tasks.rados.rados.0.smithi137.stdout:2492: seq_num 798 ranges {5578752=573440,6152192=466944,6619136=335872} 2024-03-04T06:50:04.571 INFO:tasks.rados.rados.0.smithi137.stdout:2492: writing smithi13777483-2 from 5578752 to 6152192 tid 1 2024-03-04T06:50:04.574 INFO:tasks.rados.rados.0.smithi137.stdout:2492: writing smithi13777483-2 from 6152192 to 6619136 tid 2 2024-03-04T06:50:04.577 INFO:tasks.rados.rados.0.smithi137.stdout:2492: writing smithi13777483-2 from 6619136 to 6955008 tid 3 2024-03-04T06:50:04.577 INFO:tasks.rados.rados.0.smithi137.stdout:2486: done (5 left) 2024-03-04T06:50:04.577 INFO:tasks.rados.rados.0.smithi137.stdout:2488: done (4 left) 2024-03-04T06:50:04.577 INFO:tasks.rados.rados.0.smithi137.stdout:2490: done (3 left) 2024-03-04T06:50:04.577 INFO:tasks.rados.rados.0.smithi137.stdout:2493: read oid 45 snap -1 2024-03-04T06:50:04.577 INFO:tasks.rados.rados.0.smithi137.stdout:2493: expect deleted 2024-03-04T06:50:04.577 INFO:tasks.rados.rados.0.smithi137.stdout:2494: rmattr oid 36 current snap is 231 2024-03-04T06:50:04.577 INFO:tasks.rados.rados.0.smithi137.stdout:2494: done (4 left) 2024-03-04T06:50:04.577 INFO:tasks.rados.rados.0.smithi137.stdout:2495: rollback oid 29 current snap is 231 2024-03-04T06:50:04.577 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 29 to 221 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:2489: finishing copy_from racing read to smithi13777483-26 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:2489: finishing copy_from to smithi13777483-26 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16813 (ObjNum 788 snap 231 seq_num 788) dirty exists 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:2491: finishing write tid 2 to smithi13777483-27 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:2491: finishing write tid 3 to smithi13777483-27 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:2491: finishing write tid 4 to smithi13777483-27 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:2489: done (4 left) 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 231 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:2491: finishing write tid 5 to smithi13777483-27 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:2491: oid 27 updating version 0 to 16856 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:2491: oid 27 updating version 16856 to 16858 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:2491: oid 27 version 16858 is already newer than 16857 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:2491: oid 27 updating version 16858 to 16859 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16859 (ObjNum 797 snap 231 seq_num 797) dirty exists 2024-03-04T06:50:04.578 INFO:tasks.rados.rados.0.smithi137.stdout:2491: left oid 27 (ObjNum 797 snap 231 seq_num 797) 2024-03-04T06:50:04.579 INFO:tasks.rados.rados.0.smithi137.stdout:2492: finishing write tid 1 to smithi13777483-2 2024-03-04T06:50:04.579 INFO:tasks.rados.rados.0.smithi137.stdout:2496: seq_num 799 ranges {0=589824,589824=802816} 2024-03-04T06:50:04.580 INFO:tasks.rados.rados.0.smithi137.stdout:2496: writing smithi13777483-19 from 0 to 589824 tid 1 2024-03-04T06:50:04.586 INFO:tasks.rados.rados.0.smithi137.stdout:2496: writing smithi13777483-19 from 589824 to 1392640 tid 2 2024-03-04T06:50:04.586 INFO:tasks.rados.rados.0.smithi137.stdout:2491: done (4 left) 2024-03-04T06:50:04.586 INFO:tasks.rados.rados.0.smithi137.stdout:2497: read oid 38 snap -1 2024-03-04T06:50:04.586 INFO:tasks.rados.rados.0.smithi137.stdout:2497: expect (ObjNum 709 snap 204 seq_num 709) 2024-03-04T06:50:04.586 INFO:tasks.rados.rados.0.smithi137.stdout:2498: rollback oid 34 current snap is 231 2024-03-04T06:50:04.586 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 34 to 218 2024-03-04T06:50:04.586 INFO:tasks.rados.rados.0.smithi137.stdout:2492: finishing write tid 2 to smithi13777483-2 2024-03-04T06:50:04.586 INFO:tasks.rados.rados.0.smithi137.stdout:2492: finishing write tid 3 to smithi13777483-2 2024-03-04T06:50:04.586 INFO:tasks.rados.rados.0.smithi137.stdout:2492: finishing write tid 4 to smithi13777483-2 2024-03-04T06:50:04.586 INFO:tasks.rados.rados.0.smithi137.stdout:2495: finishing rollback tid 0 to smithi13777483-29 2024-03-04T06:50:04.586 INFO:tasks.rados.rados.0.smithi137.stdout:2495: finishing rollback tid 1 to smithi13777483-29 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:2495: finishing rollback tid 2 to smithi13777483-29 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16816 (ObjNum 4321 snap 0 seq_num 3131484048) dirty exists 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:2492: finishing write tid 5 to smithi13777483-2 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:2492: oid 2 updating version 0 to 16814 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:2492: oid 2 updating version 16814 to 16816 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:2492: oid 2 updating version 16816 to 16817 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:2492: oid 2 version 16817 is already newer than 16815 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16817 (ObjNum 798 snap 231 seq_num 798) dirty exists 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:2492: left oid 2 (ObjNum 798 snap 231 seq_num 798) 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:2496: finishing write tid 1 to smithi13777483-19 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:2492: done (5 left) 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:2493: done (4 left) 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:2495: done (3 left) 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:2499: rollback oid 28 current snap is 231 2024-03-04T06:50:04.587 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 28 to 228 2024-03-04T06:50:04.588 INFO:tasks.rados.rados.0.smithi137.stdout:2500: read oid 9 snap -1 2024-03-04T06:50:04.588 INFO:tasks.rados.rados.0.smithi137.stdout:2500: expect (ObjNum 785 snap 231 seq_num 785) 2024-03-04T06:50:04.588 INFO:tasks.rados.rados.0.smithi137.stdout:2501: rollback oid 45 current snap is 231 2024-03-04T06:50:04.588 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 45 to 218 2024-03-04T06:50:04.588 INFO:tasks.rados.rados.0.smithi137.stdout:2502: snap_create 2024-03-04T06:50:04.588 INFO:tasks.rados.rados.0.smithi137.stdout:2501: finishing rollback tid 1 to smithi13777483-45 2024-03-04T06:50:04.588 INFO:tasks.rados.rados.0.smithi137.stdout:2501: finishing rollback tid 2 to smithi13777483-45 2024-03-04T06:50:04.589 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16799 (ObjNum 679 snap 192 seq_num 679) dirty exists 2024-03-04T06:50:04.592 INFO:tasks.rados.rados.0.smithi137.stdout:2499: finishing rollback tid 1 to smithi13777483-28 2024-03-04T06:50:04.592 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16816 (ObjNum 1265 snap 0 seq_num 3188666024) dirty dne 2024-03-04T06:50:04.593 INFO:tasks.rados.rados.0.smithi137.stdout:2498: finishing rollback tid 0 to smithi13777483-34 2024-03-04T06:50:04.594 INFO:tasks.rados.rados.0.smithi137.stdout:2497: expect (ObjNum 709 snap 204 seq_num 709) 2024-03-04T06:50:04.656 INFO:tasks.rados.rados.0.smithi137.stdout:2496: finishing write tid 2 to smithi13777483-19 2024-03-04T06:50:04.656 INFO:tasks.rados.rados.0.smithi137.stdout:2496: finishing write tid 3 to smithi13777483-19 2024-03-04T06:50:04.656 INFO:tasks.rados.rados.0.smithi137.stdout:2498: finishing rollback tid 1 to smithi13777483-34 2024-03-04T06:50:04.656 INFO:tasks.rados.rados.0.smithi137.stdout:2498: finishing rollback tid 2 to smithi13777483-34 2024-03-04T06:50:04.656 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16815 (ObjNum 639 snap 178 seq_num 639) dirty exists 2024-03-04T06:50:04.656 INFO:tasks.rados.rados.0.smithi137.stdout:2500: expect (ObjNum 785 snap 231 seq_num 785) 2024-03-04T06:50:04.697 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:04.459+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:04.697 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:04.491+0000 7f30fbd74700 -1 osd.7 524 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T06:50:04.697 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:04.469+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:04.698 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:04.529+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:04.698 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:04.698 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:04.698 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-mon[85573]: osdmap e533: 8 total, 7 up, 8 in 2024-03-04T06:50:04.698 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:04.698 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:04.698 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:04.698 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:04.698 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:04.699 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-mon[85573]: from='osd.7 [v2:172.21.15.203:6824/3615210313,v1:172.21.15.203:6825/3615210313]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T06:50:04.699 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-mon[85573]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T06:50:04.699 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:04 smithi203 ceph-mon[85573]: pgmap v477: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 39 active+undersized, 10 active+undersized+degraded, 7 active+clean+snaptrim_error, 64 active+clean; 404 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 3.0 MiB/s wr, 27 op/s; 44/897 objects degraded (4.905%) 2024-03-04T06:50:04.739 INFO:tasks.rados.rados.0.smithi137.stdout:2496: finishing write tid 4 to smithi13777483-19 2024-03-04T06:50:04.739 INFO:tasks.rados.rados.0.smithi137.stdout:2496: oid 19 updating version 0 to 15550 2024-03-04T06:50:04.740 INFO:tasks.rados.rados.0.smithi137.stdout:2496: oid 19 version 15550 is already newer than 15549 2024-03-04T06:50:04.740 INFO:tasks.rados.rados.0.smithi137.stdout:2496: oid 19 updating version 15550 to 15551 2024-03-04T06:50:04.740 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 15551 (ObjNum 799 snap 231 seq_num 799) dirty exists 2024-03-04T06:50:04.740 INFO:tasks.rados.rados.0.smithi137.stdout:2496: left oid 19 (ObjNum 799 snap 231 seq_num 799) 2024-03-04T06:50:04.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:04.470+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:04.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:04.462+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:04.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:04.462+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:04.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:04.470+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[91314]: osdmap e533: 8 total, 7 up, 8 in 2024-03-04T06:50:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[91314]: from='osd.7 [v2:172.21.15.203:6824/3615210313,v1:172.21.15.203:6825/3615210313]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T06:50:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[91314]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T06:50:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[91314]: pgmap v477: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 39 active+undersized, 10 active+undersized+degraded, 7 active+clean+snaptrim_error, 64 active+clean; 404 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 3.0 MiB/s wr, 27 op/s; 44/897 objects degraded (4.905%) 2024-03-04T06:50:04.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 10f=[]:{10f=[10f,10e,10b]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:04.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:04.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[88869]: osdmap e533: 8 total, 7 up, 8 in 2024-03-04T06:50:04.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:04.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:04.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:04.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:04.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:04.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[88869]: from='osd.7 [v2:172.21.15.203:6824/3615210313,v1:172.21.15.203:6825/3615210313]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T06:50:04.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[88869]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T06:50:04.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:04 smithi137 ceph-mon[88869]: pgmap v477: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 39 active+undersized, 10 active+undersized+degraded, 7 active+clean+snaptrim_error, 64 active+clean; 404 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 3.0 MiB/s wr, 27 op/s; 44/897 objects degraded (4.905%) 2024-03-04T06:50:05.469 INFO:tasks.rados.rados.0.smithi137.stdout:2496: done (6 left) 2024-03-04T06:50:05.469 INFO:tasks.rados.rados.0.smithi137.stdout:2497: done (5 left) 2024-03-04T06:50:05.469 INFO:tasks.rados.rados.0.smithi137.stdout:2498: done (4 left) 2024-03-04T06:50:05.469 INFO:tasks.rados.rados.0.smithi137.stdout:2499: done (3 left) 2024-03-04T06:50:05.469 INFO:tasks.rados.rados.0.smithi137.stdout:2500: done (2 left) 2024-03-04T06:50:05.469 INFO:tasks.rados.rados.0.smithi137.stdout:2501: done (1 left) 2024-03-04T06:50:05.469 INFO:tasks.rados.rados.0.smithi137.stdout:2502: done (0 left) 2024-03-04T06:50:05.469 INFO:tasks.rados.rados.0.smithi137.stdout:2503: read oid 49 snap -1 2024-03-04T06:50:05.469 INFO:tasks.rados.rados.0.smithi137.stdout:2503: expect deleted 2024-03-04T06:50:05.469 INFO:tasks.rados.rados.0.smithi137.stdout:2504: rmattr oid 6 current snap is 232 2024-03-04T06:50:05.470 INFO:tasks.rados.rados.0.smithi137.stdout:2504: done (1 left) 2024-03-04T06:50:05.470 INFO:tasks.rados.rados.0.smithi137.stdout:2505: rollback oid 28 current snap is 232 2024-03-04T06:50:05.470 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 28 to 223 2024-03-04T06:50:05.470 INFO:tasks.rados.rados.0.smithi137.stdout:2506: copy_from oid 34 from oid 35 current snap is 232 2024-03-04T06:50:05.470 INFO:tasks.rados.rados.0.smithi137.stdout:2507: delete oid 27 current snap is 232 2024-03-04T06:50:05.482 INFO:tasks.rados.rados.0.smithi137.stdout:2507: done (3 left) 2024-03-04T06:50:05.482 INFO:tasks.rados.rados.0.smithi137.stdout:2508: read oid 19 snap 231 2024-03-04T06:50:05.482 INFO:tasks.rados.rados.0.smithi137.stdout:2508: expect (ObjNum 799 snap 231 seq_num 799) 2024-03-04T06:50:05.482 INFO:tasks.rados.rados.0.smithi137.stdout:2509: snap_create 2024-03-04T06:50:05.482 INFO:tasks.rados.rados.0.smithi137.stdout:2505: finishing rollback tid 1 to smithi13777483-28 2024-03-04T06:50:05.483 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16816 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-03-04T06:50:05.491 INFO:tasks.rados.rados.0.smithi137.stdout:2508: expect (ObjNum 799 snap 231 seq_num 799) 2024-03-04T06:50:05.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:50:05] "GET /metrics HTTP/1.1" 200 36260 "" "Prometheus/2.43.0" 2024-03-04T06:50:05.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:05.480+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:05.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:05.471+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:05.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:05.472+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:05.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:05.473+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:05.794 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:05.467+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:05.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:05.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: Health check update: Degraded data redundancy: 44/897 objects degraded (4.905%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:50:05.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-04T06:50:05.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:05.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: from='osd.7 [v2:172.21.15.203:6824/3615210313,v1:172.21.15.203:6825/3615210313]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:50:05.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: osdmap e534: 8 total, 7 up, 8 in 2024-03-04T06:50:05.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:05.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:05.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:50:05.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:05.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:05.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:05.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:05.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:05.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: Health check update: Degraded data redundancy: 44/897 objects degraded (4.905%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:50:05.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-04T06:50:05.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:05.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: from='osd.7 [v2:172.21.15.203:6824/3615210313,v1:172.21.15.203:6825/3615210313]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:50:05.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: osdmap e534: 8 total, 7 up, 8 in 2024-03-04T06:50:05.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:05.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:05.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:50:05.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:05.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:05.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:05.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:05.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:05.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:05.463+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:05.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:05.470+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:05.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:05.471+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:05.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:05.471+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:05.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:05.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: Health check update: Degraded data redundancy: 44/897 objects degraded (4.905%), 11 pgs degraded (PG_DEGRADED) 2024-03-04T06:50:05.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-04T06:50:05.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:05.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: from='osd.7 [v2:172.21.15.203:6824/3615210313,v1:172.21.15.203:6825/3615210313]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:50:05.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: osdmap e534: 8 total, 7 up, 8 in 2024-03-04T06:50:05.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:05.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:05.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-03-04T06:50:05.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:05.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:05.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:05.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:05.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:06.474 INFO:tasks.rados.rados.0.smithi137.stdout:2505: done (4 left) 2024-03-04T06:50:06.474 INFO:tasks.rados.rados.0.smithi137.stdout:2508: done (3 left) 2024-03-04T06:50:06.475 INFO:tasks.rados.rados.0.smithi137.stdout:2509: done (2 left) 2024-03-04T06:50:06.475 INFO:tasks.rados.rados.0.smithi137.stdout:2510: rollback oid 28 current snap is 233 2024-03-04T06:50:06.475 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 28 to 221 2024-03-04T06:50:06.475 INFO:tasks.rados.rados.0.smithi137.stdout:2511: copy_from oid 4 from oid 20 current snap is 233 2024-03-04T06:50:06.475 INFO:tasks.rados.rados.0.smithi137.stdout:2512: copy_from oid 31 from oid 46 current snap is 233 2024-03-04T06:50:06.475 INFO:tasks.rados.rados.0.smithi137.stdout:2513: read oid 22 snap 232 2024-03-04T06:50:06.475 INFO:tasks.rados.rados.0.smithi137.stdout:2513: expect deleted 2024-03-04T06:50:06.475 INFO:tasks.rados.rados.0.smithi137.stdout:2514: rmattr oid 12 current snap is 233 2024-03-04T06:50:06.475 INFO:tasks.rados.rados.0.smithi137.stdout:2514: done (6 left) 2024-03-04T06:50:06.475 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 233 2024-03-04T06:50:06.475 INFO:tasks.rados.rados.0.smithi137.stdout:2515: seq_num 801 ranges {2195456=622592,2818048=573440,3391488=229376} 2024-03-04T06:50:06.491 INFO:tasks.rados.rados.0.smithi137.stdout:2515: writing smithi13777483-9 from 2195456 to 2818048 tid 1 2024-03-04T06:50:06.495 INFO:tasks.rados.rados.0.smithi137.stdout:2515: writing smithi13777483-9 from 2818048 to 3391488 tid 2 2024-03-04T06:50:06.497 INFO:tasks.rados.rados.0.smithi137.stdout:2515: writing smithi13777483-9 from 3391488 to 3620864 tid 3 2024-03-04T06:50:06.497 INFO:tasks.rados.rados.0.smithi137.stdout:2516: copy_from oid 6 from oid 25 current snap is 233 2024-03-04T06:50:06.497 INFO:tasks.rados.rados.0.smithi137.stdout:2510: finishing rollback tid 1 to smithi13777483-28 2024-03-04T06:50:06.497 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16816 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-03-04T06:50:06.498 INFO:tasks.rados.rados.0.smithi137.stdout:2510: done (7 left) 2024-03-04T06:50:06.498 INFO:tasks.rados.rados.0.smithi137.stdout:2513: done (6 left) 2024-03-04T06:50:06.498 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 233 2024-03-04T06:50:06.498 INFO:tasks.rados.rados.0.smithi137.stdout:2517: seq_num 802 ranges {0=638976,638976=458752,1097728=344064} 2024-03-04T06:50:06.501 INFO:tasks.rados.rados.0.smithi137.stdout:2517: writing smithi13777483-44 from 0 to 638976 tid 1 2024-03-04T06:50:06.504 INFO:tasks.rados.rados.0.smithi137.stdout:2517: writing smithi13777483-44 from 638976 to 1097728 tid 2 2024-03-04T06:50:06.506 INFO:tasks.rados.rados.0.smithi137.stdout:2517: writing smithi13777483-44 from 1097728 to 1441792 tid 3 2024-03-04T06:50:06.506 INFO:tasks.rados.rados.0.smithi137.stdout:2518: snap_remove snap 227 2024-03-04T06:50:06.761 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:06.470+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:06.761 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:06.656+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:06.761 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:06.656+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:06.761 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:06.468+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:06.762 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:06.467+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:06.762 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:06.615+0000 7f30e954f700 -1 osd.7 pg_epoch: 536 pg[5.9s0( v 536'1016 (0'0,536'1016] local-lis/les=535/536 n=13 ec=72/72 lis/c=535/535 les/c/f=536/536/0 sis=535) [7,6,1]p7(0) r=0 lpr=535 crt=536'1016 mlcod 536'1016 active+clean+snaptrim trimq=[102~1,10b~1,10e~2,116~1,118~1,11c~1,11f~1] ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~5e,103~8,10c~2,111~3,115~1,11a~2]] update_snap_map remove_oid 5:9c196b24:::smithi13777483-31:10d failed with -2 2024-03-04T06:50:06.762 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:06.616+0000 7f30e954f700 -1 osd.7 pg_epoch: 536 pg[5.9s0( v 536'1018 (0'0,536'1018] local-lis/les=535/536 n=11 ec=72/72 lis/c=535/535 les/c/f=536/536/0 sis=535) [7,6,1]p7(0) r=0 lpr=535 luod=536'1016 crt=536'1016 lcod 536'1016 mlcod 536'1016 active+clean+snaptrim trimq=[102~1,10b~1,10e~2,116~1,118~1,11c~1,11f~1] ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~5e,103~8,10c~2,111~3,115~1,11a~2]] update_snap_map remove_oid 5:968444e8:::smithi13777483-49:10d failed with -2 2024-03-04T06:50:06.762 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:06.617+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:06.762 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:06.683+0000 7f30e3d44700 -1 osd.7 pg_epoch: 536 pg[5.4s0( v 534'510 (0'0,534'510] local-lis/les=535/536 n=5 ec=72/72 lis/c=535/535 les/c/f=536/536/0 sis=535) [7,2,5]p7(0) r=0 lpr=535 crt=534'510 mlcod 0'0 active+clean+snaptrim trimq=[102~1,10b~1,10e~2,116~1,118~1,11c~1,11f~1] ps=[8a~1,96~1,99~2,9e~3,a2~1,a4~5e,103~8,10c~2,111~3,115~1,11a~2]] update_snap_map remove_oid 5:20995da8:::smithi13777483-41:10d failed with -2 2024-03-04T06:50:06.762 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:06.685+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:06.762 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:06.685+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:06.762 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: osd.7 [v2:172.21.15.203:6824/3615210313,v1:172.21.15.203:6825/3615210313] boot 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: osdmap e535: 8 total, 8 up, 8 in 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:06.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:06 smithi203 ceph-mon[85573]: pgmap v480: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 39 active+undersized, 10 active+undersized+degraded, 7 active+clean+snaptrim_error, 64 active+clean; 405 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 9.6 MiB/s rd, 3.3 MiB/s wr, 30 op/s; 44/903 objects degraded (4.873%) 2024-03-04T06:50:06.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:06.472+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:06.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:06.480+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:06.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:06.470+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:06.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:06.478+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:50:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: osd.7 [v2:172.21.15.203:6824/3615210313,v1:172.21.15.203:6825/3615210313] boot 2024-03-04T06:50:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: osdmap e535: 8 total, 8 up, 8 in 2024-03-04T06:50:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:50:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[91314]: pgmap v480: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 39 active+undersized, 10 active+undersized+degraded, 7 active+clean+snaptrim_error, 64 active+clean; 405 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 9.6 MiB/s rd, 3.3 MiB/s wr, 30 op/s; 44/903 objects degraded (4.873%) 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: osd.7 [v2:172.21.15.203:6824/3615210313,v1:172.21.15.203:6825/3615210313] boot 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: osdmap e535: 8 total, 8 up, 8 in 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T06:50:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:06.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:06.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:06.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:06.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:06.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:06.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:06.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:06.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:06 smithi137 ceph-mon[88869]: pgmap v480: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 39 active+undersized, 10 active+undersized+degraded, 7 active+clean+snaptrim_error, 64 active+clean; 405 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 9.6 MiB/s rd, 3.3 MiB/s wr, 30 op/s; 44/903 objects degraded (4.873%) 2024-03-04T06:50:07.477 INFO:tasks.rados.rados.0.smithi137.stdout:2515: finishing write tid 1 to smithi13777483-9 2024-03-04T06:50:07.477 INFO:tasks.rados.rados.0.smithi137.stdout:2515: finishing write tid 2 to smithi13777483-9 2024-03-04T06:50:07.477 INFO:tasks.rados.rados.0.smithi137.stdout:2515: finishing write tid 3 to smithi13777483-9 2024-03-04T06:50:07.477 INFO:tasks.rados.rados.0.smithi137.stdout:2516: finishing copy_from to smithi13777483-6 2024-03-04T06:50:07.477 INFO:tasks.rados.rados.0.smithi137.stdout:2516: got expected ENOENT (src dne) 2024-03-04T06:50:07.477 INFO:tasks.rados.rados.0.smithi137.stdout:2516: finishing copy_from racing read to smithi13777483-6 2024-03-04T06:50:07.478 INFO:tasks.rados.rados.0.smithi137.stdout:2515: finishing write tid 4 to smithi13777483-9 2024-03-04T06:50:07.478 INFO:tasks.rados.rados.0.smithi137.stdout:2517: finishing write tid 1 to smithi13777483-44 2024-03-04T06:50:07.478 INFO:tasks.rados.rados.0.smithi137.stdout:2517: finishing write tid 2 to smithi13777483-44 2024-03-04T06:50:07.478 INFO:tasks.rados.rados.0.smithi137.stdout:2515: finishing write tid 5 to smithi13777483-9 2024-03-04T06:50:07.478 INFO:tasks.rados.rados.0.smithi137.stdout:2515: oid 9 updating version 0 to 15552 2024-03-04T06:50:07.478 INFO:tasks.rados.rados.0.smithi137.stdout:2515: oid 9 updating version 15552 to 15554 2024-03-04T06:50:07.478 INFO:tasks.rados.rados.0.smithi137.stdout:2515: oid 9 updating version 15554 to 15555 2024-03-04T06:50:07.478 INFO:tasks.rados.rados.0.smithi137.stdout:2515: oid 9 version 15555 is already newer than 15553 2024-03-04T06:50:07.478 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 15555 (ObjNum 801 snap 233 seq_num 801) dirty exists 2024-03-04T06:50:07.478 INFO:tasks.rados.rados.0.smithi137.stdout:2515: left oid 9 (ObjNum 801 snap 233 seq_num 801) 2024-03-04T06:50:07.478 INFO:tasks.rados.rados.0.smithi137.stdout:2517: finishing write tid 3 to smithi13777483-44 2024-03-04T06:50:07.478 INFO:tasks.rados.rados.0.smithi137.stdout:2517: finishing write tid 4 to smithi13777483-44 2024-03-04T06:50:07.479 INFO:tasks.rados.rados.0.smithi137.stdout:2511: finishing copy_from racing read to smithi13777483-4 2024-03-04T06:50:07.479 INFO:tasks.rados.rados.0.smithi137.stdout:2511: finishing copy_from to smithi13777483-4 2024-03-04T06:50:07.479 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 15513 (ObjNum 568 snap 159 seq_num 568) dirty exists 2024-03-04T06:50:07.479 INFO:tasks.rados.rados.0.smithi137.stdout:2506: finishing copy_from racing read to smithi13777483-34 2024-03-04T06:50:07.479 INFO:tasks.rados.rados.0.smithi137.stdout:2517: finishing write tid 5 to smithi13777483-44 2024-03-04T06:50:07.479 INFO:tasks.rados.rados.0.smithi137.stdout:2517: oid 44 updating version 0 to 16817 2024-03-04T06:50:07.479 INFO:tasks.rados.rados.0.smithi137.stdout:2517: oid 44 updating version 16817 to 16819 2024-03-04T06:50:07.479 INFO:tasks.rados.rados.0.smithi137.stdout:2517: oid 44 version 16819 is already newer than 16816 2024-03-04T06:50:07.479 INFO:tasks.rados.rados.0.smithi137.stdout:2517: oid 44 version 16819 is already newer than 16818 2024-03-04T06:50:07.479 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16819 (ObjNum 802 snap 233 seq_num 802) dirty exists 2024-03-04T06:50:07.479 INFO:tasks.rados.rados.0.smithi137.stdout:2517: left oid 44 (ObjNum 802 snap 233 seq_num 802) 2024-03-04T06:50:07.479 INFO:tasks.rados.rados.0.smithi137.stdout:2506: finishing copy_from to smithi13777483-34 2024-03-04T06:50:07.479 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16809 (ObjNum 65 snap 0 seq_num 1818975589) dirty exists 2024-03-04T06:50:07.480 INFO:tasks.rados.rados.0.smithi137.stdout:2512: finishing copy_from racing read to smithi13777483-31 2024-03-04T06:50:07.480 INFO:tasks.rados.rados.0.smithi137.stdout:2512: finishing copy_from to smithi13777483-31 2024-03-04T06:50:07.480 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16852 (ObjNum 772 snap 228 seq_num 772) dirty exists 2024-03-04T06:50:07.480 INFO:tasks.rados.rados.0.smithi137.stdout:2503: done (7 left) 2024-03-04T06:50:07.480 INFO:tasks.rados.rados.0.smithi137.stdout:2506: done (6 left) 2024-03-04T06:50:07.480 INFO:tasks.rados.rados.0.smithi137.stdout:2511: done (5 left) 2024-03-04T06:50:07.480 INFO:tasks.rados.rados.0.smithi137.stdout:2512: done (4 left) 2024-03-04T06:50:07.480 INFO:tasks.rados.rados.0.smithi137.stdout:2515: done (3 left) 2024-03-04T06:50:07.480 INFO:tasks.rados.rados.0.smithi137.stdout:2516: done (2 left) 2024-03-04T06:50:07.480 INFO:tasks.rados.rados.0.smithi137.stdout:2517: done (1 left) 2024-03-04T06:50:07.480 INFO:tasks.rados.rados.0.smithi137.stdout:2518: done (0 left) 2024-03-04T06:50:07.480 INFO:tasks.rados.rados.0.smithi137.stdout:2519: delete oid 39 current snap is 233 2024-03-04T06:50:07.492 INFO:tasks.rados.rados.0.smithi137.stdout:2519: done (0 left) 2024-03-04T06:50:07.492 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 43 current snap is 233 2024-03-04T06:50:07.492 INFO:tasks.rados.rados.0.smithi137.stdout:2520: seq_num 804 ranges {704512=671744,1376256=622592,1998848=180224} 2024-03-04T06:50:07.500 INFO:tasks.rados.rados.0.smithi137.stdout:2520: writing smithi13777483-43 from 704512 to 1376256 tid 1 2024-03-04T06:50:07.504 INFO:tasks.rados.rados.0.smithi137.stdout:2520: writing smithi13777483-43 from 1376256 to 1998848 tid 2 2024-03-04T06:50:07.505 INFO:tasks.rados.rados.0.smithi137.stdout:2520: writing smithi13777483-43 from 1998848 to 2179072 tid 3 2024-03-04T06:50:07.505 INFO:tasks.rados.rados.0.smithi137.stdout:2521: snap_remove snap 223 2024-03-04T06:50:07.741 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:07.480+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:07.741 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:07.480+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:07.741 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:07.480+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:07.742 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:07.483+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:07.742 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:07.483+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:07.742 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:07.743 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-mon[85573]: osdmap e536: 8 total, 8 up, 8 in 2024-03-04T06:50:07.743 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:07.743 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:07.743 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:07.743 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:07.743 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:07.743 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:07.743 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:07.743 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:07.743 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:07.744 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:07.487+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:07.744 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:07.488+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:07.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:07.479+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:07.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:07.476+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:07.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:07.482+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:07.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:07.482+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:07.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:07.483+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[88869]: osdmap e536: 8 total, 8 up, 8 in 2024-03-04T06:50:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[91314]: osdmap e536: 8 total, 8 up, 8 in 2024-03-04T06:50:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:08.491 INFO:tasks.rados.rados.0.smithi137.stdout:2520: finishing write tid 1 to smithi13777483-43 2024-03-04T06:50:08.491 INFO:tasks.rados.rados.0.smithi137.stdout:2520: finishing write tid 2 to smithi13777483-43 2024-03-04T06:50:08.491 INFO:tasks.rados.rados.0.smithi137.stdout:2520: finishing write tid 3 to smithi13777483-43 2024-03-04T06:50:08.491 INFO:tasks.rados.rados.0.smithi137.stdout:2520: finishing write tid 4 to smithi13777483-43 2024-03-04T06:50:08.491 INFO:tasks.rados.rados.0.smithi137.stdout:2520: finishing write tid 5 to smithi13777483-43 2024-03-04T06:50:08.491 INFO:tasks.rados.rados.0.smithi137.stdout:2520: oid 43 updating version 0 to 16855 2024-03-04T06:50:08.492 INFO:tasks.rados.rados.0.smithi137.stdout:2520: oid 43 updating version 16855 to 16856 2024-03-04T06:50:08.492 INFO:tasks.rados.rados.0.smithi137.stdout:2520: oid 43 version 16856 is already newer than 16854 2024-03-04T06:50:08.492 INFO:tasks.rados.rados.0.smithi137.stdout:2520: oid 43 updating version 16856 to 16857 2024-03-04T06:50:08.492 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16857 (ObjNum 804 snap 233 seq_num 804) dirty exists 2024-03-04T06:50:08.492 INFO:tasks.rados.rados.0.smithi137.stdout:2520: left oid 43 (ObjNum 804 snap 233 seq_num 804) 2024-03-04T06:50:08.492 INFO:tasks.rados.rados.0.smithi137.stdout:2520: done (1 left) 2024-03-04T06:50:08.492 INFO:tasks.rados.rados.0.smithi137.stdout:2521: done (0 left) 2024-03-04T06:50:08.492 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 233 2024-03-04T06:50:08.492 INFO:tasks.rados.rados.0.smithi137.stdout:2522: seq_num 805 ranges {3899392=688128,4587520=507904,5095424=294912} 2024-03-04T06:50:08.517 INFO:tasks.rados.rados.0.smithi137.stdout:2522: writing smithi13777483-26 from 3899392 to 4587520 tid 1 2024-03-04T06:50:08.520 INFO:tasks.rados.rados.0.smithi137.stdout:2522: writing smithi13777483-26 from 4587520 to 5095424 tid 2 2024-03-04T06:50:08.522 INFO:tasks.rados.rados.0.smithi137.stdout:2522: writing smithi13777483-26 from 5095424 to 5390336 tid 3 2024-03-04T06:50:08.522 INFO:tasks.rados.rados.0.smithi137.stdout:2523: rmattr oid 36 current snap is 233 2024-03-04T06:50:08.522 INFO:tasks.rados.rados.0.smithi137.stdout:2523: done (1 left) 2024-03-04T06:50:08.522 INFO:tasks.rados.rados.0.smithi137.stdout:2524: snap_remove snap 232 2024-03-04T06:50:08.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:08.499+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:08.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:08.494+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:08.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:08.495+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:08.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:08.488+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: osdmap e537: 8 total, 8 up, 8 in 2024-03-04T06:50:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:08.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:08.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: pgmap v483: 121 pgs: 18 active+undersized, 5 active+undersized+degraded, 8 active+clean+snaptrim_error, 90 active+clean; 397 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.7 MiB/s wr, 19 op/s; 23/891 objects degraded (2.581%); 6.3 MiB/s, 2 objects/s recovering 2024-03-04T06:50:08.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:08.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:50:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: osdmap e537: 8 total, 8 up, 8 in 2024-03-04T06:50:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:08.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:08.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:08.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: pgmap v483: 121 pgs: 18 active+undersized, 5 active+undersized+degraded, 8 active+clean+snaptrim_error, 90 active+clean; 397 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.7 MiB/s wr, 19 op/s; 23/891 objects degraded (2.581%); 6.3 MiB/s, 2 objects/s recovering 2024-03-04T06:50:08.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:08.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:50:08.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:08.508+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:08.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:08.492+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:08.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: osdmap e537: 8 total, 8 up, 8 in 2024-03-04T06:50:08.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: pgmap v483: 121 pgs: 18 active+undersized, 5 active+undersized+degraded, 8 active+clean+snaptrim_error, 90 active+clean; 397 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.7 MiB/s wr, 19 op/s; 23/891 objects degraded (2.581%); 6.3 MiB/s, 2 objects/s recovering 2024-03-04T06:50:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:50:08.847 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:08.484+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:08.848 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:08.484+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:08.848 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:08.484+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:08.848 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:08.505+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:08.848 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:08.505+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:08.848 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:08.505+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:09.493 INFO:tasks.rados.rados.0.smithi137.stdout:2524: done (1 left) 2024-03-04T06:50:09.493 INFO:tasks.rados.rados.0.smithi137.stdout:2525: snap_remove snap 228 2024-03-04T06:50:09.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:09.576+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:09.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:09.498+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:09.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:09.498+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:09.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:09.498+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:09.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:09.577+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: osdmap e538: 8 total, 8 up, 8 in 2024-03-04T06:50:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: osdmap e538: 8 total, 8 up, 8 in 2024-03-04T06:50:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:50:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:09.845 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:09.499+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:09.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:09.500+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:09.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:09.490+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:09.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:09.490+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:09.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:09.497+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:09.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:09.575+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:09.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:09.575+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: osdmap e538: 8 total, 8 up, 8 in 2024-03-04T06:50:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:09.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:09.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:09.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:09.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:09.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:50:09.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:09.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:10.498 INFO:tasks.rados.rados.0.smithi137.stdout:2525: done (1 left) 2024-03-04T06:50:10.499 INFO:tasks.rados.rados.0.smithi137.stdout:2526: rmattr oid 44 current snap is 233 2024-03-04T06:50:10.499 INFO:tasks.rados.rados.0.smithi137.stdout:2526: done (1 left) 2024-03-04T06:50:10.499 INFO:tasks.rados.rados.0.smithi137.stdout:2527: read oid 37 snap -1 2024-03-04T06:50:10.499 INFO:tasks.rados.rados.0.smithi137.stdout:2527: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:50:10.499 INFO:tasks.rados.rados.0.smithi137.stdout:2528: read oid 45 snap -1 2024-03-04T06:50:10.499 INFO:tasks.rados.rados.0.smithi137.stdout:2528: expect (ObjNum 679 snap 192 seq_num 679) 2024-03-04T06:50:10.499 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 233 2024-03-04T06:50:10.499 INFO:tasks.rados.rados.0.smithi137.stdout:2529: seq_num 806 ranges {3809280=704512,4513792=442368,4956160=360448} 2024-03-04T06:50:10.525 INFO:tasks.rados.rados.0.smithi137.stdout:2529: writing smithi13777483-10 from 3809280 to 4513792 tid 1 2024-03-04T06:50:10.531 INFO:tasks.rados.rados.0.smithi137.stdout:2529: writing smithi13777483-10 from 4513792 to 4956160 tid 2 2024-03-04T06:50:10.531 INFO:tasks.rados.rados.0.smithi137.stdout:2529: writing smithi13777483-10 from 4956160 to 5316608 tid 3 2024-03-04T06:50:10.533 INFO:tasks.rados.rados.0.smithi137.stdout:2522: finishing write tid 1 to smithi13777483-26 2024-03-04T06:50:10.534 INFO:tasks.rados.rados.0.smithi137.stdout:2522: finishing write tid 2 to smithi13777483-26 2024-03-04T06:50:10.534 INFO:tasks.rados.rados.0.smithi137.stdout:2522: finishing write tid 3 to smithi13777483-26 2024-03-04T06:50:10.534 INFO:tasks.rados.rados.0.smithi137.stdout:2522: finishing write tid 4 to smithi13777483-26 2024-03-04T06:50:10.534 INFO:tasks.rados.rados.0.smithi137.stdout:2522: finishing write tid 5 to smithi13777483-26 2024-03-04T06:50:10.534 INFO:tasks.rados.rados.0.smithi137.stdout:2522: oid 26 updating version 0 to 16818 2024-03-04T06:50:10.534 INFO:tasks.rados.rados.0.smithi137.stdout:2522: oid 26 updating version 16818 to 16820 2024-03-04T06:50:10.534 INFO:tasks.rados.rados.0.smithi137.stdout:2522: oid 26 version 16820 is already newer than 16817 2024-03-04T06:50:10.534 INFO:tasks.rados.rados.0.smithi137.stdout:2522: oid 26 version 16820 is already newer than 16819 2024-03-04T06:50:10.534 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16820 (ObjNum 805 snap 233 seq_num 805) dirty exists 2024-03-04T06:50:10.534 INFO:tasks.rados.rados.0.smithi137.stdout:2522: left oid 26 (ObjNum 805 snap 233 seq_num 805) 2024-03-04T06:50:10.534 INFO:tasks.rados.rados.0.smithi137.stdout:2527: expect (ObjNum 605 snap 172 seq_num 605) 2024-03-04T06:50:10.677 INFO:tasks.rados.rados.0.smithi137.stdout:2529: finishing write tid 1 to smithi13777483-10 2024-03-04T06:50:10.677 INFO:tasks.rados.rados.0.smithi137.stdout:2529: finishing write tid 2 to smithi13777483-10 2024-03-04T06:50:10.677 INFO:tasks.rados.rados.0.smithi137.stdout:2529: finishing write tid 3 to smithi13777483-10 2024-03-04T06:50:10.677 INFO:tasks.rados.rados.0.smithi137.stdout:2529: finishing write tid 4 to smithi13777483-10 2024-03-04T06:50:10.677 INFO:tasks.rados.rados.0.smithi137.stdout:2529: finishing write tid 5 to smithi13777483-10 2024-03-04T06:50:10.677 INFO:tasks.rados.rados.0.smithi137.stdout:2529: oid 10 updating version 0 to 15557 2024-03-04T06:50:10.677 INFO:tasks.rados.rados.0.smithi137.stdout:2529: oid 10 updating version 15557 to 15558 2024-03-04T06:50:10.677 INFO:tasks.rados.rados.0.smithi137.stdout:2529: oid 10 version 15558 is already newer than 15556 2024-03-04T06:50:10.677 INFO:tasks.rados.rados.0.smithi137.stdout:2529: oid 10 updating version 15558 to 15559 2024-03-04T06:50:10.677 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15559 (ObjNum 806 snap 233 seq_num 806) dirty exists 2024-03-04T06:50:10.677 INFO:tasks.rados.rados.0.smithi137.stdout:2529: left oid 10 (ObjNum 806 snap 233 seq_num 806) 2024-03-04T06:50:10.677 INFO:tasks.rados.rados.0.smithi137.stdout:2522: done (3 left) 2024-03-04T06:50:10.677 INFO:tasks.rados.rados.0.smithi137.stdout:2527: done (2 left) 2024-03-04T06:50:10.678 INFO:tasks.rados.rados.0.smithi137.stdout:2529: done (1 left) 2024-03-04T06:50:10.678 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 28 current snap is 233 2024-03-04T06:50:10.678 INFO:tasks.rados.rados.0.smithi137.stdout:2528: expect (ObjNum 679 snap 192 seq_num 679) 2024-03-04T06:50:10.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:10.501+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:10.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:10.510+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:10.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:10.512+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:10.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:10.519+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: osdmap e539: 8 total, 8 up, 8 in 2024-03-04T06:50:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: Upgrade: Setting container_image for all osd 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-04T06:50:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-04T06:50:10.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-04T06:50:10.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-04T06:50:10.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-04T06:50:10.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:10.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:10.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:10.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: osdmap e539: 8 total, 8 up, 8 in 2024-03-04T06:50:10.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:10.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: Upgrade: Setting container_image for all osd 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-04T06:50:10.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-04T06:50:10.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-04T06:50:10.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-04T06:50:10.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-04T06:50:10.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-04T06:50:10.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-04T06:50:10.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-03-04T06:50:10.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-03-04T06:50:10.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-03-04T06:50:10.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-03-04T06:50:10.798 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: Upgrade: Setting require_osd_release to 19 squid 2024-03-04T06:50:10.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-04T06:50:10.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:10.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:10.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:10.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: Health check update: Degraded data redundancy: 23/891 objects degraded (2.581%), 5 pgs degraded (PG_DEGRADED) 2024-03-04T06:50:10.799 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[88869]: pgmap v486: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 406 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.2 MiB/s rd, 5.6 MiB/s wr, 22 op/s; 16 MiB/s, 4 objects/s recovering 2024-03-04T06:50:10.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-03-04T06:50:10.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-03-04T06:50:10.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-03-04T06:50:10.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-03-04T06:50:10.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: Upgrade: Setting require_osd_release to 19 squid 2024-03-04T06:50:10.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-04T06:50:10.799 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:10.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:10.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:10.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: Health check update: Degraded data redundancy: 23/891 objects degraded (2.581%), 5 pgs degraded (PG_DEGRADED) 2024-03-04T06:50:10.800 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-mon[91314]: pgmap v486: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 406 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.2 MiB/s rd, 5.6 MiB/s wr, 22 op/s; 16 MiB/s, 4 objects/s recovering 2024-03-04T06:50:10.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:10.716+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:10.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:10.496+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:10.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:10.496+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:10.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:10.496+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:10.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:10.506+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:10.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:10.502+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:10.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:10.519+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:10.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:10.519+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: osdmap e539: 8 total, 8 up, 8 in 2024-03-04T06:50:10.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:10.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:10.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:10.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:10.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:10.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:10.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:10.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: Upgrade: Setting container_image for all osd 2024-03-04T06:50:10.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:10.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:10.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-04T06:50:10.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-04T06:50:10.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: Upgrade: Setting require_osd_release to 19 squid 2024-03-04T06:50:10.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-04T06:50:10.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:10.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:10.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:10.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: Health check update: Degraded data redundancy: 23/891 objects degraded (2.581%), 5 pgs degraded (PG_DEGRADED) 2024-03-04T06:50:10.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:10 smithi203 ceph-mon[85573]: pgmap v486: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 406 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 4.2 MiB/s rd, 5.6 MiB/s wr, 22 op/s; 16 MiB/s, 4 objects/s recovering 2024-03-04T06:50:11.252 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:50:10.898+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 10 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:50:11.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-03-04T06:50:11.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-03-04T06:50:11.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:11.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:11.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: osdmap e540: 8 total, 8 up, 8 in 2024-03-04T06:50:11.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-04T06:50:11.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:11.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: Upgrade: It appears safe to stop mds.a 2024-03-04T06:50:11.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:11.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:11.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:11.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:11.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:11.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:11.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:11.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: Health check update: Possible data damage: 10 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:50:11.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[88869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/891 objects degraded (2.581%), 5 pgs degraded) 2024-03-04T06:50:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: osdmap e540: 8 total, 8 up, 8 in 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: Upgrade: It appears safe to stop mds.a 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:11.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: Health check update: Possible data damage: 10 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:50:11.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:11 smithi137 ceph-mon[91314]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/891 objects degraded (2.581%), 5 pgs degraded) 2024-03-04T06:50:11.740 INFO:tasks.rados.rados.0.smithi137.stdout:2530: seq_num 807 ranges {0=720896,720896=729088,1449984=73728} 2024-03-04T06:50:11.744 INFO:tasks.rados.rados.0.smithi137.stdout:2530: writing smithi13777483-28 from 0 to 720896 tid 1 2024-03-04T06:50:11.748 INFO:tasks.rados.rados.0.smithi137.stdout:2530: writing smithi13777483-28 from 720896 to 1449984 tid 2 2024-03-04T06:50:11.749 INFO:tasks.rados.rados.0.smithi137.stdout:2530: writing smithi13777483-28 from 1449984 to 1523712 tid 3 2024-03-04T06:50:11.749 INFO:tasks.rados.rados.0.smithi137.stdout:2528: done (1 left) 2024-03-04T06:50:11.749 INFO:tasks.rados.rados.0.smithi137.stdout:2531: snap_remove snap 218 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: osdmap e540: 8 total, 8 up, 8 in 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: Upgrade: It appears safe to stop mds.a 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:11.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:11.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: Health check update: Possible data damage: 10 pgs snaptrim_error (PG_DAMAGED) 2024-03-04T06:50:11.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:11 smithi203 ceph-mon[85573]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/891 objects degraded (2.581%), 5 pgs degraded) 2024-03-04T06:50:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:2531: done (1 left) 2024-03-04T06:50:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:2532: copy_from oid 48 from oid 10 current snap is 233 2024-03-04T06:50:12.498 INFO:tasks.rados.rados.0.smithi137.stdout:2533: snap_remove snap 230 2024-03-04T06:50:12.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:12.499+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:12.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:12.501+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:12.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:12.495+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:12.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:12.500+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:12.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:12.502+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:12.754 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:12.496+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:12.754 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:12.502+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:12.754 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:12.500+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:12.754 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:12.500+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:12.754 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:12.501+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:13.182 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:12.846+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:13.183 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:12.846+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:13.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: Upgrade: Updating mds.a 2024-03-04T06:50:13.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:13.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:50:13.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:13.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: Deploying daemon mds.a on smithi137 2024-03-04T06:50:13.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: pgmap v488: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 406 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 18 op/s; 13 MiB/s, 3 objects/s recovering 2024-03-04T06:50:13.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: osdmap e541: 8 total, 8 up, 8 in 2024-03-04T06:50:13.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:13.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:13.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: Upgrade: Updating mds.a 2024-03-04T06:50:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:50:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: Deploying daemon mds.a on smithi137 2024-03-04T06:50:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: pgmap v488: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 406 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 18 op/s; 13 MiB/s, 3 objects/s recovering 2024-03-04T06:50:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: osdmap e541: 8 total, 8 up, 8 in 2024-03-04T06:50:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:13.496 INFO:tasks.rados.rados.0.smithi137.stdout:2533: done (2 left) 2024-03-04T06:50:13.496 INFO:tasks.rados.rados.0.smithi137.stdout:2534: copy_from oid 20 from oid 43 current snap is 233 2024-03-04T06:50:13.496 INFO:tasks.rados.rados.0.smithi137.stdout:2530: finishing write tid 1 to smithi13777483-28 2024-03-04T06:50:13.496 INFO:tasks.rados.rados.0.smithi137.stdout:2530: finishing write tid 2 to smithi13777483-28 2024-03-04T06:50:13.496 INFO:tasks.rados.rados.0.smithi137.stdout:2530: finishing write tid 3 to smithi13777483-28 2024-03-04T06:50:13.497 INFO:tasks.rados.rados.0.smithi137.stdout:2530: finishing write tid 4 to smithi13777483-28 2024-03-04T06:50:13.497 INFO:tasks.rados.rados.0.smithi137.stdout:2530: finishing write tid 5 to smithi13777483-28 2024-03-04T06:50:13.497 INFO:tasks.rados.rados.0.smithi137.stdout:2530: oid 28 updating version 0 to 16828 2024-03-04T06:50:13.497 INFO:tasks.rados.rados.0.smithi137.stdout:2530: oid 28 version 16828 is already newer than 16827 2024-03-04T06:50:13.497 INFO:tasks.rados.rados.0.smithi137.stdout:2530: oid 28 version 16828 is already newer than 16826 2024-03-04T06:50:13.497 INFO:tasks.rados.rados.0.smithi137.stdout:2530: oid 28 updating version 16828 to 16829 2024-03-04T06:50:13.497 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16829 (ObjNum 807 snap 233 seq_num 807) dirty exists 2024-03-04T06:50:13.497 INFO:tasks.rados.rados.0.smithi137.stdout:2530: left oid 28 (ObjNum 807 snap 233 seq_num 807) 2024-03-04T06:50:13.497 INFO:tasks.rados.rados.0.smithi137.stdout:2532: finishing copy_from racing read to smithi13777483-48 2024-03-04T06:50:13.497 INFO:tasks.rados.rados.0.smithi137.stdout:2532: finishing copy_from to smithi13777483-48 2024-03-04T06:50:13.497 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 15559 (ObjNum 806 snap 233 seq_num 806) dirty exists 2024-03-04T06:50:13.497 INFO:tasks.rados.rados.0.smithi137.stdout:2530: done (2 left) 2024-03-04T06:50:13.498 INFO:tasks.rados.rados.0.smithi137.stdout:2532: done (1 left) 2024-03-04T06:50:13.498 INFO:tasks.rados.rados.0.smithi137.stdout:2535: delete oid 16 current snap is 233 2024-03-04T06:50:13.498 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: Upgrade: Updating mds.a 2024-03-04T06:50:13.498 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:13.498 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:50:13.498 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:13.498 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: Deploying daemon mds.a on smithi137 2024-03-04T06:50:13.498 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: pgmap v488: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 406 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 18 op/s; 13 MiB/s, 3 objects/s recovering 2024-03-04T06:50:13.498 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: osdmap e541: 8 total, 8 up, 8 in 2024-03-04T06:50:13.499 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:13.499 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:13.499 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:13.499 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:13.499 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:13.499 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:13.499 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:13.499 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:13.499 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:13.512 INFO:tasks.rados.rados.0.smithi137.stdout:2535: done (1 left) 2024-03-04T06:50:13.512 INFO:tasks.rados.rados.0.smithi137.stdout:2536: snap_remove snap 231 2024-03-04T06:50:13.726 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:13.504+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:13.726 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:13.510+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:13.726 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:13.499+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:13.727 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:13.503+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:13.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:13.499+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:13.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:13.496+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:13.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:13.496+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:13.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:13.496+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:13.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:13.510+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:13.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:13.513+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:13.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:13.514+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:13.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:13.514+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:14.187 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:14.187 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[88869]: osdmap e542: 8 total, 8 up, 8 in 2024-03-04T06:50:14.187 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:14.187 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:14.187 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:14.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:14.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:14.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:14.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:14.188 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:14.188 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[91314]: osdmap e542: 8 total, 8 up, 8 in 2024-03-04T06:50:14.188 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:14.188 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:14.188 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:14.189 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:14 smithi137 systemd[1]: Stopping Ceph mds.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:50:14.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:14.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:14.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:14 smithi203 ceph-mon[85573]: osdmap e542: 8 total, 8 up, 8 in 2024-03-04T06:50:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:14.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:14.793 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a[64350]: 2024-03-04T06:50:14.297+0000 7fab9ca74700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:50:14.793 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a[64350]: 2024-03-04T06:50:14.297+0000 7fab9ca74700 -1 mds.a *** got signal Terminated *** 2024-03-04T06:50:15.196 INFO:tasks.rados.rados.0.smithi137.stdout:2536: done (1 left) 2024-03-04T06:50:15.196 INFO:tasks.rados.rados.0.smithi137.stdout:2537: setattr oid 27 current snap is 233 2024-03-04T06:50:15.197 INFO:tasks.rados.rados.0.smithi137.stdout:2534: finishing copy_from racing read to smithi13777483-20 2024-03-04T06:50:15.197 INFO:tasks.rados.rados.0.smithi137.stdout:2534: finishing copy_from to smithi13777483-20 2024-03-04T06:50:15.197 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16857 (ObjNum 804 snap 233 seq_num 804) dirty exists 2024-03-04T06:50:15.198 INFO:tasks.rados.rados.0.smithi137.stdout:2534: done (1 left) 2024-03-04T06:50:15.198 INFO:tasks.rados.rados.0.smithi137.stdout:2538: snap_create 2024-03-04T06:50:15.204 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16861 (ObjNum 33 snap 0 seq_num 3131267360) dirty exists 2024-03-04T06:50:15.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:15.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:15 smithi137 ceph-mon[88869]: pgmap v491: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 413 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 9 op/s; 8.2 MiB/s, 1 objects/s recovering 2024-03-04T06:50:15.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:15.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:15 smithi137 ceph-mon[91314]: pgmap v491: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 413 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 9 op/s; 8.2 MiB/s, 1 objects/s recovering 2024-03-04T06:50:15.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:15.203+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:15.544 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:50:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:50:15] "GET /metrics HTTP/1.1" 200 36207 "" "Prometheus/2.43.0" 2024-03-04T06:50:15.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:15.195+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:15.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:15.195+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:15.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:15.196+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:15.545 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:15.200+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:15.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:15.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:15 smithi203 ceph-mon[85573]: pgmap v491: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 413 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 9 op/s; 8.2 MiB/s, 1 objects/s recovering 2024-03-04T06:50:15.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:15.202+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:15.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:15.200+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:15.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:15.202+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:15.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:15.207+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:15.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:15.207+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:15.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:15.190+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:15.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:15.190+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:16.209 INFO:tasks.rados.rados.0.smithi137.stdout:2537: done (1 left) 2024-03-04T06:50:16.210 INFO:tasks.rados.rados.0.smithi137.stdout:2538: done (0 left) 2024-03-04T06:50:16.210 INFO:tasks.rados.rados.0.smithi137.stdout:2539: snap_remove snap 233 2024-03-04T06:50:16.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:16.207+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:16.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[88869]: osdmap e543: 8 total, 8 up, 8 in 2024-03-04T06:50:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[88869]: fsmap cephfs:1 {0=b=up:active} 2024-03-04T06:50:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:16.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:16.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:16.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[91314]: osdmap e543: 8 total, 8 up, 8 in 2024-03-04T06:50:16.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:16.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:16.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:16.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:16.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:16.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:16.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:16.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[91314]: fsmap cephfs:1 {0=b=up:active} 2024-03-04T06:50:16.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:16.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:16.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:16.202+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:16.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:16.203+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:16.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:16.203+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-mon[85573]: osdmap e543: 8 total, 8 up, 8 in 2024-03-04T06:50:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-mon[85573]: fsmap cephfs:1 {0=b=up:active} 2024-03-04T06:50:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:17.207 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:16.943+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:17.207 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:16.944+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:17.207 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:16.943+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:17.207 INFO:tasks.rados.rados.0.smithi137.stdout:2539: done (0 left) 2024-03-04T06:50:17.207 INFO:tasks.rados.rados.0.smithi137.stdout:2540: snap_remove snap 214 2024-03-04T06:50:17.208 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:16.944+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:17.208 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:16.943+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:17.208 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:16.945+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:17.208 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:16.945+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:17.208 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:16.945+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:17.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:17.205+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:17.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:17.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:17.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:17.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[88869]: osdmap e544: 8 total, 8 up, 8 in 2024-03-04T06:50:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[88869]: pgmap v494: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 413 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 2.3 MiB/s wr, 6 op/s 2024-03-04T06:50:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[88869]: osdmap e545: 8 total, 8 up, 8 in 2024-03-04T06:50:17.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:17.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:17.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:17.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[91314]: osdmap e544: 8 total, 8 up, 8 in 2024-03-04T06:50:17.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[91314]: pgmap v494: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 413 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 2.3 MiB/s wr, 6 op/s 2024-03-04T06:50:17.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:17.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:17.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:17.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-mon[91314]: osdmap e545: 8 total, 8 up, 8 in 2024-03-04T06:50:17.553 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:17.207+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:17.553 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:17.207+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:17.553 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:17.553 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:17.553 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:17.554 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:17 smithi203 ceph-mon[85573]: osdmap e544: 8 total, 8 up, 8 in 2024-03-04T06:50:17.554 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:17 smithi203 ceph-mon[85573]: pgmap v494: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 413 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 2.3 MiB/s wr, 6 op/s 2024-03-04T06:50:17.554 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:17.554 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:17.554 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:17.554 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:17 smithi203 ceph-mon[85573]: osdmap e545: 8 total, 8 up, 8 in 2024-03-04T06:50:17.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:17.553+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:17.890 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:17 smithi137 podman[116822]: 2024-03-04 06:50:17.617816614 +0000 UTC m=+3.437555123 container died dd13fbd7ec2fdffc702cd7aa5574cb3ea7ef1faaacacbea88eebd72958ca9a13 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a, maintainer=Guillaume Abrioux , RELEASE=reef-5cc7a76, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD) 2024-03-04T06:50:17.890 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:17.725+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:17.891 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:17.810+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:17.891 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:17.810+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:17.891 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:17.810+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:18.207 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:17 smithi137 podman[116822]: 2024-03-04 06:50:17.980979718 +0000 UTC m=+3.800718224 container cleanup dd13fbd7ec2fdffc702cd7aa5574cb3ea7ef1faaacacbea88eebd72958ca9a13 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=reef-5cc7a76, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T06:50:18.207 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:17 smithi137 bash[116822]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a 2024-03-04T06:50:18.207 INFO:tasks.rados.rados.0.smithi137.stdout:2540: done (0 left) 2024-03-04T06:50:18.207 INFO:tasks.rados.rados.0.smithi137.stdout:2541: rollback oid 18 current snap is 234 2024-03-04T06:50:18.207 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 18 to 221 2024-03-04T06:50:18.207 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 234 2024-03-04T06:50:18.208 INFO:tasks.rados.rados.0.smithi137.stdout:2542: seq_num 809 ranges {5316608=753664,6070272=499712,6569984=303104} 2024-03-04T06:50:18.240 INFO:tasks.rados.rados.0.smithi137.stdout:2542: writing smithi13777483-10 from 5316608 to 6070272 tid 1 2024-03-04T06:50:18.243 INFO:tasks.rados.rados.0.smithi137.stdout:2542: writing smithi13777483-10 from 6070272 to 6569984 tid 2 2024-03-04T06:50:18.245 INFO:tasks.rados.rados.0.smithi137.stdout:2542: writing smithi13777483-10 from 6569984 to 6873088 tid 3 2024-03-04T06:50:18.245 INFO:tasks.rados.rados.0.smithi137.stdout:2543: snap_create 2024-03-04T06:50:18.245 INFO:tasks.rados.rados.0.smithi137.stdout:2541: finishing rollback tid 0 to smithi13777483-18 2024-03-04T06:50:18.245 INFO:tasks.rados.rados.0.smithi137.stdout:2541: finishing rollback tid 1 to smithi13777483-18 2024-03-04T06:50:18.246 INFO:tasks.rados.rados.0.smithi137.stdout:2541: finishing rollback tid 2 to smithi13777483-18 2024-03-04T06:50:18.246 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16823 (ObjNum 679 snap 192 seq_num 679) dirty exists 2024-03-04T06:50:18.246 INFO:tasks.rados.rados.0.smithi137.stdout:2542: finishing write tid 1 to smithi13777483-10 2024-03-04T06:50:18.248 INFO:tasks.rados.rados.0.smithi137.stdout:2542: finishing write tid 2 to smithi13777483-10 2024-03-04T06:50:18.248 INFO:tasks.rados.rados.0.smithi137.stdout:2542: finishing write tid 3 to smithi13777483-10 2024-03-04T06:50:18.249 INFO:tasks.rados.rados.0.smithi137.stdout:2542: finishing write tid 4 to smithi13777483-10 2024-03-04T06:50:18.250 INFO:tasks.rados.rados.0.smithi137.stdout:2542: finishing write tid 5 to smithi13777483-10 2024-03-04T06:50:18.250 INFO:tasks.rados.rados.0.smithi137.stdout:2542: oid 10 updating version 0 to 15562 2024-03-04T06:50:18.250 INFO:tasks.rados.rados.0.smithi137.stdout:2542: oid 10 updating version 15562 to 15563 2024-03-04T06:50:18.250 INFO:tasks.rados.rados.0.smithi137.stdout:2542: oid 10 version 15563 is already newer than 15560 2024-03-04T06:50:18.250 INFO:tasks.rados.rados.0.smithi137.stdout:2542: oid 10 version 15563 is already newer than 15561 2024-03-04T06:50:18.250 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15563 (ObjNum 809 snap 234 seq_num 809) dirty exists 2024-03-04T06:50:18.250 INFO:tasks.rados.rados.0.smithi137.stdout:2542: left oid 10 (ObjNum 809 snap 234 seq_num 809) 2024-03-04T06:50:18.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:18.213+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:18.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:18.214+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:18.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:18.213+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:18.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:18.206+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:18.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:18.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:18.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:18.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[91314]: osdmap e546: 8 total, 8 up, 8 in 2024-03-04T06:50:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:18.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:18.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:18.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:18.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:18.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:18 smithi137 ceph-mon[88869]: osdmap e546: 8 total, 8 up, 8 in 2024-03-04T06:50:18.546 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:18 smithi137 podman[116835]: 2024-03-04 06:50:18.240530834 +0000 UTC m=+0.618818796 container remove dd13fbd7ec2fdffc702cd7aa5574cb3ea7ef1faaacacbea88eebd72958ca9a13 (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a, org.label-schema.build-date=20240222, RELEASE=reef-5cc7a76, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-04T06:50:18.546 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:18 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mds.a.service: Deactivated successfully. 2024-03-04T06:50:18.546 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:18 smithi137 systemd[1]: Stopped Ceph mds.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:50:18.546 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:18 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mds.a.service: Consumed 1.125s CPU time. 2024-03-04T06:50:18.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:18.210+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:18.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:18.206+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:18.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:18.206+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:18.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:18.206+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:18.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:18.096+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:18.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:18.096+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:18.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:18.212+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:18.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:18.213+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:18.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:18.213+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-mon[85573]: osdmap e546: 8 total, 8 up, 8 in 2024-03-04T06:50:18.856 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:18 smithi137 systemd[1]: Starting Ceph mds.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:50:18.856 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:18 smithi137 podman[116970]: 2024-03-04 06:50:18.758498196 +0000 UTC m=+0.113357683 container create b6a5f935218297817d5ef54a45bec200c814cf437c7a9cf938d9aa75d811ef2b (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_BRANCH=HEAD) 2024-03-04T06:50:18.856 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:18 smithi137 podman[116970]: 2024-03-04 06:50:18.662761676 +0000 UTC m=+0.017621119 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:50:19.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:18.630+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:19.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:18.630+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:19.227 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:18 smithi137 podman[116970]: 2024-03-04 06:50:18.985954207 +0000 UTC m=+0.340813650 container init b6a5f935218297817d5ef54a45bec200c814cf437c7a9cf938d9aa75d811ef2b (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=) 2024-03-04T06:50:19.227 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:18 smithi137 podman[116970]: 2024-03-04 06:50:18.988926713 +0000 UTC m=+0.343786164 container start b6a5f935218297817d5ef54a45bec200c814cf437c7a9cf938d9aa75d811ef2b (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-04T06:50:19.227 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a[116984]: starting mds.a at 2024-03-04T06:50:19.227 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:19 smithi137 bash[116970]: b6a5f935218297817d5ef54a45bec200c814cf437c7a9cf938d9aa75d811ef2b 2024-03-04T06:50:19.227 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:19 smithi137 systemd[1]: Started Ceph mds.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:50:19.231 INFO:tasks.rados.rados.0.smithi137.stdout:2541: done (2 left) 2024-03-04T06:50:19.231 INFO:tasks.rados.rados.0.smithi137.stdout:2542: done (1 left) 2024-03-04T06:50:19.231 INFO:tasks.rados.rados.0.smithi137.stdout:2543: done (0 left) 2024-03-04T06:50:19.231 INFO:tasks.rados.rados.0.smithi137.stdout:2544: rollback oid 20 current snap is 235 2024-03-04T06:50:19.231 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 20 to 221 2024-03-04T06:50:19.231 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 35 current snap is 235 2024-03-04T06:50:19.231 INFO:tasks.rados.rados.0.smithi137.stdout:2545: seq_num 810 ranges {0=770048,770048=778240,1548288=24576} 2024-03-04T06:50:19.235 INFO:tasks.rados.rados.0.smithi137.stdout:2545: writing smithi13777483-35 from 0 to 770048 tid 1 2024-03-04T06:50:19.240 INFO:tasks.rados.rados.0.smithi137.stdout:2545: writing smithi13777483-35 from 770048 to 1548288 tid 2 2024-03-04T06:50:19.240 INFO:tasks.rados.rados.0.smithi137.stdout:2545: writing smithi13777483-35 from 1548288 to 1572864 tid 3 2024-03-04T06:50:19.240 INFO:tasks.rados.rados.0.smithi137.stdout:2546: delete oid 5 current snap is 235 2024-03-04T06:50:19.240 INFO:tasks.rados.rados.0.smithi137.stdout:2544: finishing rollback tid 0 to smithi13777483-20 2024-03-04T06:50:19.241 INFO:tasks.rados.rados.0.smithi137.stdout:2544: finishing rollback tid 1 to smithi13777483-20 2024-03-04T06:50:19.241 INFO:tasks.rados.rados.0.smithi137.stdout:2544: finishing rollback tid 2 to smithi13777483-20 2024-03-04T06:50:19.241 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16860 (ObjNum 568 snap 159 seq_num 568) dirty exists 2024-03-04T06:50:19.243 INFO:tasks.rados.rados.0.smithi137.stdout:2544: done (2 left) 2024-03-04T06:50:19.243 INFO:tasks.rados.rados.0.smithi137.stdout:2546: done (1 left) 2024-03-04T06:50:19.243 INFO:tasks.rados.rados.0.smithi137.stdout:2547: setattr oid 3 current snap is 235 2024-03-04T06:50:19.245 INFO:tasks.rados.rados.0.smithi137.stdout:2548: rmattr oid 7 current snap is 235 2024-03-04T06:50:19.245 INFO:tasks.rados.rados.0.smithi137.stdout:2549: rmattr oid 1 current snap is 235 2024-03-04T06:50:19.245 INFO:tasks.rados.rados.0.smithi137.stdout:2550: read oid 45 snap 234 2024-03-04T06:50:19.245 INFO:tasks.rados.rados.0.smithi137.stdout:2550: expect (ObjNum 679 snap 192 seq_num 679) 2024-03-04T06:50:19.245 INFO:tasks.rados.rados.0.smithi137.stdout:2551: read oid 6 snap -1 2024-03-04T06:50:19.246 INFO:tasks.rados.rados.0.smithi137.stdout:2551: expect deleted 2024-03-04T06:50:19.246 INFO:tasks.rados.rados.0.smithi137.stdout:2552: delete oid 48 current snap is 235 2024-03-04T06:50:19.249 INFO:tasks.rados.rados.0.smithi137.stdout:2545: finishing write tid 1 to smithi13777483-35 2024-03-04T06:50:19.249 INFO:tasks.rados.rados.0.smithi137.stdout:2545: finishing write tid 2 to smithi13777483-35 2024-03-04T06:50:19.249 INFO:tasks.rados.rados.0.smithi137.stdout:2545: finishing write tid 3 to smithi13777483-35 2024-03-04T06:50:19.250 INFO:tasks.rados.rados.0.smithi137.stdout:2545: finishing write tid 4 to smithi13777483-35 2024-03-04T06:50:19.251 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16829 (ObjNum 784 snap 231 seq_num 784) dirty exists 2024-03-04T06:50:19.251 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 15564 (ObjNum 733 snap 214 seq_num 733) dirty exists 2024-03-04T06:50:19.253 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 16818 (ObjNum 788 snap 231 seq_num 788) dirty exists 2024-03-04T06:50:19.254 INFO:tasks.rados.rados.0.smithi137.stdout:2545: finishing write tid 5 to smithi13777483-35 2024-03-04T06:50:19.254 INFO:tasks.rados.rados.0.smithi137.stdout:2545: oid 35 updating version 0 to 16855 2024-03-04T06:50:19.254 INFO:tasks.rados.rados.0.smithi137.stdout:2545: oid 35 updating version 16855 to 16856 2024-03-04T06:50:19.254 INFO:tasks.rados.rados.0.smithi137.stdout:2545: oid 35 version 16856 is already newer than 16853 2024-03-04T06:50:19.254 INFO:tasks.rados.rados.0.smithi137.stdout:2545: oid 35 version 16856 is already newer than 16854 2024-03-04T06:50:19.254 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16856 (ObjNum 810 snap 235 seq_num 810) dirty exists 2024-03-04T06:50:19.254 INFO:tasks.rados.rados.0.smithi137.stdout:2545: left oid 35 (ObjNum 810 snap 235 seq_num 810) 2024-03-04T06:50:19.254 INFO:tasks.rados.rados.0.smithi137.stdout:2545: done (6 left) 2024-03-04T06:50:19.254 INFO:tasks.rados.rados.0.smithi137.stdout:2547: done (5 left) 2024-03-04T06:50:19.254 INFO:tasks.rados.rados.0.smithi137.stdout:2548: done (4 left) 2024-03-04T06:50:19.254 INFO:tasks.rados.rados.0.smithi137.stdout:2549: done (3 left) 2024-03-04T06:50:19.254 INFO:tasks.rados.rados.0.smithi137.stdout:2551: done (2 left) 2024-03-04T06:50:19.255 INFO:tasks.rados.rados.0.smithi137.stdout:2552: done (1 left) 2024-03-04T06:50:19.255 INFO:tasks.rados.rados.0.smithi137.stdout:2553: snap_create 2024-03-04T06:50:19.303 INFO:tasks.rados.rados.0.smithi137.stdout:2550: expect (ObjNum 679 snap 192 seq_num 679) 2024-03-04T06:50:19.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:19.245+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:19.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:19.243+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:19.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:19.243+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:19.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:19.243+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:19.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:19.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:19.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:19.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:19.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:19.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:19.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:19.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:19.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:19.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: pgmap v497: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 399 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 8.7 MiB/s rd, 912 KiB/s wr, 8 op/s 2024-03-04T06:50:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:19.545 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:19.230+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:19.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: pgmap v497: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 399 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 8.7 MiB/s rd, 912 KiB/s wr, 8 op/s 2024-03-04T06:50:19.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:19.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:19.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:19.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:19.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:19.238+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:19.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:19.240+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:19.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:19.243+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:19.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:19.248+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:19.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:19.231+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:19.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:19.231+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:19.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:19.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:19.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:19.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:19.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:19.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: pgmap v497: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 399 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 8.7 MiB/s rd, 912 KiB/s wr, 8 op/s 2024-03-04T06:50:19.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:19.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:19.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:19.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:20.379 INFO:tasks.rados.rados.0.smithi137.stdout:2550: done (1 left) 2024-03-04T06:50:20.379 INFO:tasks.rados.rados.0.smithi137.stdout:2553: done (0 left) 2024-03-04T06:50:20.379 INFO:tasks.rados.rados.0.smithi137.stdout:2554: snap_remove snap 235 2024-03-04T06:50:20.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:20.242+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:20.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:20.242+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:20.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:20.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:20.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: osdmap e547: 8 total, 8 up, 8 in 2024-03-04T06:50:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: mds.? [v2:172.21.15.137:6834/2007899716,v1:172.21.15.137:6835/2007899716] up:boot 2024-03-04T06:50:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:50:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: osdmap e547: 8 total, 8 up, 8 in 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: mds.? [v2:172.21.15.137:6834/2007899716,v1:172.21.15.137:6835/2007899716] up:boot 2024-03-04T06:50:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:50:20.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:20 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:50:20.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:20.237+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:20.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:20.237+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:20.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:20.238+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:20.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:20.448+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:20.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:20.449+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:20.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:20.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:20.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: osdmap e547: 8 total, 8 up, 8 in 2024-03-04T06:50:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: mds.? [v2:172.21.15.137:6834/2007899716,v1:172.21.15.137:6835/2007899716] up:boot 2024-03-04T06:50:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-04T06:50:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:20 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T06:50:21.240 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:21.119+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:21.240 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:21.118+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:21.244 INFO:tasks.rados.rados.0.smithi137.stdout:2554: done (0 left) 2024-03-04T06:50:21.244 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 236 2024-03-04T06:50:21.245 INFO:tasks.rados.rados.0.smithi137.stdout:2555: seq_num 813 ranges {933888=417792,1351680=434176,1785856=442368,2228224=327680} 2024-03-04T06:50:21.252 INFO:tasks.rados.rados.0.smithi137.stdout:2555: writing smithi13777483-31 from 933888 to 1351680 tid 1 2024-03-04T06:50:21.254 INFO:tasks.rados.rados.0.smithi137.stdout:2555: writing smithi13777483-31 from 1351680 to 1785856 tid 2 2024-03-04T06:50:21.256 INFO:tasks.rados.rados.0.smithi137.stdout:2555: writing smithi13777483-31 from 1785856 to 2228224 tid 3 2024-03-04T06:50:21.259 INFO:tasks.rados.rados.0.smithi137.stdout:2555: writing smithi13777483-31 from 2228224 to 2555904 tid 4 2024-03-04T06:50:21.259 INFO:tasks.rados.rados.0.smithi137.stdout:2556: delete oid 49 current snap is 236 2024-03-04T06:50:21.261 INFO:tasks.rados.rados.0.smithi137.stdout:2555: finishing write tid 1 to smithi13777483-31 2024-03-04T06:50:21.261 INFO:tasks.rados.rados.0.smithi137.stdout:2555: finishing write tid 2 to smithi13777483-31 2024-03-04T06:50:21.263 INFO:tasks.rados.rados.0.smithi137.stdout:2555: finishing write tid 3 to smithi13777483-31 2024-03-04T06:50:21.263 INFO:tasks.rados.rados.0.smithi137.stdout:2555: finishing write tid 4 to smithi13777483-31 2024-03-04T06:50:21.264 INFO:tasks.rados.rados.0.smithi137.stdout:2555: finishing write tid 5 to smithi13777483-31 2024-03-04T06:50:21.265 INFO:tasks.rados.rados.0.smithi137.stdout:2556: done (1 left) 2024-03-04T06:50:21.265 INFO:tasks.rados.rados.0.smithi137.stdout:2557: delete oid 34 current snap is 236 2024-03-04T06:50:21.266 INFO:tasks.rados.rados.0.smithi137.stdout:2555: finishing write tid 6 to smithi13777483-31 2024-03-04T06:50:21.266 INFO:tasks.rados.rados.0.smithi137.stdout:2555: oid 31 updating version 0 to 16860 2024-03-04T06:50:21.266 INFO:tasks.rados.rados.0.smithi137.stdout:2555: oid 31 version 16860 is already newer than 16857 2024-03-04T06:50:21.266 INFO:tasks.rados.rados.0.smithi137.stdout:2555: oid 31 version 16860 is already newer than 16859 2024-03-04T06:50:21.266 INFO:tasks.rados.rados.0.smithi137.stdout:2555: oid 31 version 16860 is already newer than 16858 2024-03-04T06:50:21.266 INFO:tasks.rados.rados.0.smithi137.stdout:2555: oid 31 updating version 16860 to 16861 2024-03-04T06:50:21.266 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16861 (ObjNum 813 snap 236 seq_num 813) dirty exists 2024-03-04T06:50:21.266 INFO:tasks.rados.rados.0.smithi137.stdout:2555: left oid 31 (ObjNum 813 snap 236 seq_num 813) 2024-03-04T06:50:21.269 INFO:tasks.rados.rados.0.smithi137.stdout:2555: done (1 left) 2024-03-04T06:50:21.269 INFO:tasks.rados.rados.0.smithi137.stdout:2557: done (0 left) 2024-03-04T06:50:21.269 INFO:tasks.rados.rados.0.smithi137.stdout:2558: snap_remove snap 221 2024-03-04T06:50:21.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:21.268+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:21.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:21.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:21.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-mon[91314]: osdmap e548: 8 total, 8 up, 8 in 2024-03-04T06:50:21.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:21.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:21.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-mon[91314]: pgmap v500: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 400 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 8.7 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-03-04T06:50:21.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:21.242+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:21.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:21.243+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:21.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:21.243+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:21.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:21.258+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:21.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:21.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:21.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-mon[88869]: osdmap e548: 8 total, 8 up, 8 in 2024-03-04T06:50:21.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:21.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:21.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:21 smithi137 ceph-mon[88869]: pgmap v500: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 400 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 8.7 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-03-04T06:50:21.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:21.242+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:21.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:21.242+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:21.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:21.259+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:21.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:21.119+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:21.597 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:21.310+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:21.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:21.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:21.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-mon[85573]: osdmap e548: 8 total, 8 up, 8 in 2024-03-04T06:50:21.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:21.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:21.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-mon[85573]: pgmap v500: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 400 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 8.7 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-03-04T06:50:21.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:21.119+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:21.598 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:21.119+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:21.598 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:21.120+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:21.598 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:21.255+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:21.598 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:21.265+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:22.252 INFO:tasks.rados.rados.0.smithi137.stdout:2558: done (0 left) 2024-03-04T06:50:22.253 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 236 2024-03-04T06:50:22.253 INFO:tasks.rados.rados.0.smithi137.stdout:2559: seq_num 816 ranges {12140544=475136,12615680=540672,13156352=614400,13770752=49152} 2024-03-04T06:50:22.322 INFO:tasks.rados.rados.0.smithi137.stdout:2559: writing smithi13777483-45 from 12140544 to 12615680 tid 1 2024-03-04T06:50:22.324 INFO:tasks.rados.rados.0.smithi137.stdout:2559: writing smithi13777483-45 from 12615680 to 13156352 tid 2 2024-03-04T06:50:22.328 INFO:tasks.rados.rados.0.smithi137.stdout:2559: writing smithi13777483-45 from 13156352 to 13770752 tid 3 2024-03-04T06:50:22.329 INFO:tasks.rados.rados.0.smithi137.stdout:2559: writing smithi13777483-45 from 13770752 to 13819904 tid 4 2024-03-04T06:50:22.329 INFO:tasks.rados.rados.0.smithi137.stdout:2560: read oid 30 snap -1 2024-03-04T06:50:22.330 INFO:tasks.rados.rados.0.smithi137.stdout:2560: expect (ObjNum 768 snap 228 seq_num 768) 2024-03-04T06:50:22.330 INFO:tasks.rados.rados.0.smithi137.stdout:2561: rmattr oid 8 current snap is 236 2024-03-04T06:50:22.330 INFO:tasks.rados.rados.0.smithi137.stdout:2561: done (2 left) 2024-03-04T06:50:22.330 INFO:tasks.rados.rados.0.smithi137.stdout:2562: copy_from oid 46 from oid 35 current snap is 236 2024-03-04T06:50:22.330 INFO:tasks.rados.rados.0.smithi137.stdout:2559: finishing write tid 1 to smithi13777483-45 2024-03-04T06:50:22.330 INFO:tasks.rados.rados.0.smithi137.stdout:2559: finishing write tid 2 to smithi13777483-45 2024-03-04T06:50:22.330 INFO:tasks.rados.rados.0.smithi137.stdout:2563: rmattr oid 44 current snap is 236 2024-03-04T06:50:22.330 INFO:tasks.rados.rados.0.smithi137.stdout:2563: done (3 left) 2024-03-04T06:50:22.330 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 236 2024-03-04T06:50:22.330 INFO:tasks.rados.rados.0.smithi137.stdout:2564: seq_num 817 ranges {2285568=491520,2777088=417792,3194880=425984,3620864=360448} 2024-03-04T06:50:22.344 INFO:tasks.rados.rados.0.smithi137.stdout:2564: writing smithi13777483-38 from 2285568 to 2777088 tid 1 2024-03-04T06:50:22.347 INFO:tasks.rados.rados.0.smithi137.stdout:2564: writing smithi13777483-38 from 2777088 to 3194880 tid 2 2024-03-04T06:50:22.350 INFO:tasks.rados.rados.0.smithi137.stdout:2564: writing smithi13777483-38 from 3194880 to 3620864 tid 3 2024-03-04T06:50:22.352 INFO:tasks.rados.rados.0.smithi137.stdout:2564: writing smithi13777483-38 from 3620864 to 3981312 tid 4 2024-03-04T06:50:22.352 INFO:tasks.rados.rados.0.smithi137.stdout:2565: delete oid 21 current snap is 236 2024-03-04T06:50:22.352 INFO:tasks.rados.rados.0.smithi137.stdout:2559: finishing write tid 3 to smithi13777483-45 2024-03-04T06:50:22.353 INFO:tasks.rados.rados.0.smithi137.stdout:2559: finishing write tid 4 to smithi13777483-45 2024-03-04T06:50:22.353 INFO:tasks.rados.rados.0.smithi137.stdout:2559: finishing write tid 5 to smithi13777483-45 2024-03-04T06:50:22.353 INFO:tasks.rados.rados.0.smithi137.stdout:2560: expect (ObjNum 768 snap 228 seq_num 768) 2024-03-04T06:50:22.378 INFO:tasks.rados.rados.0.smithi137.stdout:2559: finishing write tid 6 to smithi13777483-45 2024-03-04T06:50:22.378 INFO:tasks.rados.rados.0.smithi137.stdout:2559: oid 45 updating version 0 to 16804 2024-03-04T06:50:22.378 INFO:tasks.rados.rados.0.smithi137.stdout:2559: oid 45 version 16804 is already newer than 16801 2024-03-04T06:50:22.378 INFO:tasks.rados.rados.0.smithi137.stdout:2559: oid 45 version 16804 is already newer than 16802 2024-03-04T06:50:22.379 INFO:tasks.rados.rados.0.smithi137.stdout:2559: oid 45 version 16804 is already newer than 16800 2024-03-04T06:50:22.379 INFO:tasks.rados.rados.0.smithi137.stdout:2559: oid 45 version 16804 is already newer than 16803 2024-03-04T06:50:22.379 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16804 (ObjNum 816 snap 236 seq_num 816) dirty exists 2024-03-04T06:50:22.379 INFO:tasks.rados.rados.0.smithi137.stdout:2559: left oid 45 (ObjNum 816 snap 236 seq_num 816) 2024-03-04T06:50:22.379 INFO:tasks.rados.rados.0.smithi137.stdout:2562: finishing copy_from racing read to smithi13777483-46 2024-03-04T06:50:22.379 INFO:tasks.rados.rados.0.smithi137.stdout:2559: done (4 left) 2024-03-04T06:50:22.379 INFO:tasks.rados.rados.0.smithi137.stdout:2560: done (3 left) 2024-03-04T06:50:22.379 INFO:tasks.rados.rados.0.smithi137.stdout:2565: done (2 left) 2024-03-04T06:50:22.379 INFO:tasks.rados.rados.0.smithi137.stdout:2566: snap_remove snap 234 2024-03-04T06:50:22.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:22.251+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:22.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:22.264+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:22.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:22.264+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:22.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:22.266+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: osdmap e549: 8 total, 8 up, 8 in 2024-03-04T06:50:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:22.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:22.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:22.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:22.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:22.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:22.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:22.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:22.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:22.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:22.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: osdmap e549: 8 total, 8 up, 8 in 2024-03-04T06:50:22.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:22.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:22.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:22.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:22.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:22.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:22.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:22.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:22 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:22.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:22.259+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:22.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:22.335+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:22.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:22.335+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:22.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:22.258+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:22.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:22.259+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:22.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:22.259+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:22.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:22.257+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:22.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:22.257+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:22.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:22.257+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:22.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:22.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:22.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:22.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:22.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 122=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: osdmap e549: 8 total, 8 up, 8 in 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:22.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:22 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:23.263 INFO:tasks.rados.rados.0.smithi137.stdout:2566: done (2 left) 2024-03-04T06:50:23.263 INFO:tasks.rados.rados.0.smithi137.stdout:2567: read oid 16 snap -1 2024-03-04T06:50:23.263 INFO:tasks.rados.rados.0.smithi137.stdout:2567: expect deleted 2024-03-04T06:50:23.263 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 236 2024-03-04T06:50:23.263 INFO:tasks.rados.rados.0.smithi137.stdout:2568: seq_num 819 ranges {0=524288,524288=589824,1114112=614400} 2024-03-04T06:50:23.267 INFO:tasks.rados.rados.0.smithi137.stdout:2568: writing smithi13777483-6 from 0 to 524288 tid 1 2024-03-04T06:50:23.270 INFO:tasks.rados.rados.0.smithi137.stdout:2568: writing smithi13777483-6 from 524288 to 1114112 tid 2 2024-03-04T06:50:23.275 INFO:tasks.rados.rados.0.smithi137.stdout:2568: writing smithi13777483-6 from 1114112 to 1728512 tid 3 2024-03-04T06:50:23.275 INFO:tasks.rados.rados.0.smithi137.stdout:2569: rollback oid 2 current snap is 236 2024-03-04T06:50:23.275 INFO:tasks.rados.rados.0.smithi137.stdout:2569: done (4 left) 2024-03-04T06:50:23.275 INFO:tasks.rados.rados.0.smithi137.stdout:2570: copy_from oid 30 from oid 41 current snap is 236 2024-03-04T06:50:23.275 INFO:tasks.rados.rados.0.smithi137.stdout:2562: finishing copy_from to smithi13777483-46 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 16856 (ObjNum 810 snap 235 seq_num 810) dirty exists 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:2564: finishing write tid 1 to smithi13777483-38 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:2564: finishing write tid 2 to smithi13777483-38 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:2564: finishing write tid 3 to smithi13777483-38 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:2564: finishing write tid 4 to smithi13777483-38 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:2564: finishing write tid 5 to smithi13777483-38 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:2564: finishing write tid 6 to smithi13777483-38 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:2564: oid 38 updating version 0 to 16834 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:2564: oid 38 version 16834 is already newer than 16832 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:2564: oid 38 version 16834 is already newer than 16833 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:2564: oid 38 version 16834 is already newer than 16830 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:2564: oid 38 version 16834 is already newer than 16831 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16834 (ObjNum 817 snap 236 seq_num 817) dirty exists 2024-03-04T06:50:23.276 INFO:tasks.rados.rados.0.smithi137.stdout:2564: left oid 38 (ObjNum 817 snap 236 seq_num 817) 2024-03-04T06:50:23.277 INFO:tasks.rados.rados.0.smithi137.stdout:2568: finishing write tid 1 to smithi13777483-6 2024-03-04T06:50:23.277 INFO:tasks.rados.rados.0.smithi137.stdout:2568: finishing write tid 2 to smithi13777483-6 2024-03-04T06:50:23.277 INFO:tasks.rados.rados.0.smithi137.stdout:2562: done (4 left) 2024-03-04T06:50:23.277 INFO:tasks.rados.rados.0.smithi137.stdout:2564: done (3 left) 2024-03-04T06:50:23.277 INFO:tasks.rados.rados.0.smithi137.stdout:2567: done (2 left) 2024-03-04T06:50:23.277 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 236 2024-03-04T06:50:23.277 INFO:tasks.rados.rados.0.smithi137.stdout:2571: seq_num 820 ranges {1392640=540672,1933312=475136,2408448=598016,3006464=131072} 2024-03-04T06:50:23.285 INFO:tasks.rados.rados.0.smithi137.stdout:2571: writing smithi13777483-19 from 1392640 to 1933312 tid 1 2024-03-04T06:50:23.288 INFO:tasks.rados.rados.0.smithi137.stdout:2571: writing smithi13777483-19 from 1933312 to 2408448 tid 2 2024-03-04T06:50:23.291 INFO:tasks.rados.rados.0.smithi137.stdout:2571: writing smithi13777483-19 from 2408448 to 3006464 tid 3 2024-03-04T06:50:23.292 INFO:tasks.rados.rados.0.smithi137.stdout:2571: writing smithi13777483-19 from 3006464 to 3137536 tid 4 2024-03-04T06:50:23.293 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 29 current snap is 236 2024-03-04T06:50:23.293 INFO:tasks.rados.rados.0.smithi137.stdout:2568: finishing write tid 3 to smithi13777483-6 2024-03-04T06:50:23.293 INFO:tasks.rados.rados.0.smithi137.stdout:2572: seq_num 821 ranges {0=557056,557056=761856,1318912=442368} 2024-03-04T06:50:23.296 INFO:tasks.rados.rados.0.smithi137.stdout:2572: writing smithi13777483-29 from 0 to 557056 tid 1 2024-03-04T06:50:23.300 INFO:tasks.rados.rados.0.smithi137.stdout:2572: writing smithi13777483-29 from 557056 to 1318912 tid 2 2024-03-04T06:50:23.303 INFO:tasks.rados.rados.0.smithi137.stdout:2572: writing smithi13777483-29 from 1318912 to 1761280 tid 3 2024-03-04T06:50:23.304 INFO:tasks.rados.rados.0.smithi137.stdout:2573: setattr oid 33 current snap is 236 2024-03-04T06:50:23.304 INFO:tasks.rados.rados.0.smithi137.stdout:2568: finishing write tid 4 to smithi13777483-6 2024-03-04T06:50:23.304 INFO:tasks.rados.rados.0.smithi137.stdout:2568: finishing write tid 5 to smithi13777483-6 2024-03-04T06:50:23.304 INFO:tasks.rados.rados.0.smithi137.stdout:2568: oid 6 updating version 0 to 16800 2024-03-04T06:50:23.304 INFO:tasks.rados.rados.0.smithi137.stdout:2568: oid 6 version 16800 is already newer than 16799 2024-03-04T06:50:23.304 INFO:tasks.rados.rados.0.smithi137.stdout:2568: oid 6 updating version 16800 to 16801 2024-03-04T06:50:23.304 INFO:tasks.rados.rados.0.smithi137.stdout:2568: oid 6 updating version 16801 to 16802 2024-03-04T06:50:23.304 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16802 (ObjNum 819 snap 236 seq_num 819) dirty exists 2024-03-04T06:50:23.304 INFO:tasks.rados.rados.0.smithi137.stdout:2568: left oid 6 (ObjNum 819 snap 236 seq_num 819) 2024-03-04T06:50:23.304 INFO:tasks.rados.rados.0.smithi137.stdout:2570: finishing copy_from racing read to smithi13777483-30 2024-03-04T06:50:23.304 INFO:tasks.rados.rados.0.smithi137.stdout:2570: finishing copy_from to smithi13777483-30 2024-03-04T06:50:23.304 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16778 (ObjNum 639 snap 178 seq_num 639) dirty exists 2024-03-04T06:50:23.304 INFO:tasks.rados.rados.0.smithi137.stdout:2571: finishing write tid 1 to smithi13777483-19 2024-03-04T06:50:23.305 INFO:tasks.rados.rados.0.smithi137.stdout:2571: finishing write tid 2 to smithi13777483-19 2024-03-04T06:50:23.305 INFO:tasks.rados.rados.0.smithi137.stdout:2571: finishing write tid 3 to smithi13777483-19 2024-03-04T06:50:23.305 INFO:tasks.rados.rados.0.smithi137.stdout:2571: finishing write tid 4 to smithi13777483-19 2024-03-04T06:50:23.305 INFO:tasks.rados.rados.0.smithi137.stdout:2571: finishing write tid 5 to smithi13777483-19 2024-03-04T06:50:23.305 INFO:tasks.rados.rados.0.smithi137.stdout:2571: finishing write tid 6 to smithi13777483-19 2024-03-04T06:50:23.305 INFO:tasks.rados.rados.0.smithi137.stdout:2571: oid 19 updating version 0 to 15566 2024-03-04T06:50:23.305 INFO:tasks.rados.rados.0.smithi137.stdout:2571: oid 19 updating version 15566 to 15567 2024-03-04T06:50:23.305 INFO:tasks.rados.rados.0.smithi137.stdout:2571: oid 19 updating version 15567 to 15568 2024-03-04T06:50:23.305 INFO:tasks.rados.rados.0.smithi137.stdout:2571: oid 19 version 15568 is already newer than 15565 2024-03-04T06:50:23.305 INFO:tasks.rados.rados.0.smithi137.stdout:2571: oid 19 updating version 15568 to 15569 2024-03-04T06:50:23.305 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 15569 (ObjNum 820 snap 236 seq_num 820) dirty exists 2024-03-04T06:50:23.305 INFO:tasks.rados.rados.0.smithi137.stdout:2571: left oid 19 (ObjNum 820 snap 236 seq_num 820) 2024-03-04T06:50:23.305 INFO:tasks.rados.rados.0.smithi137.stdout:2572: finishing write tid 1 to smithi13777483-29 2024-03-04T06:50:23.306 INFO:tasks.rados.rados.0.smithi137.stdout:2572: finishing write tid 2 to smithi13777483-29 2024-03-04T06:50:23.306 INFO:tasks.rados.rados.0.smithi137.stdout:2568: done (4 left) 2024-03-04T06:50:23.306 INFO:tasks.rados.rados.0.smithi137.stdout:2570: done (3 left) 2024-03-04T06:50:23.306 INFO:tasks.rados.rados.0.smithi137.stdout:2571: done (2 left) 2024-03-04T06:50:23.306 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 41 current snap is 236 2024-03-04T06:50:23.306 INFO:tasks.rados.rados.0.smithi137.stdout:2574: seq_num 822 ranges {1327104=573440,1900544=696320,2596864=507904} 2024-03-04T06:50:23.315 INFO:tasks.rados.rados.0.smithi137.stdout:2574: writing smithi13777483-41 from 1327104 to 1900544 tid 1 2024-03-04T06:50:23.319 INFO:tasks.rados.rados.0.smithi137.stdout:2574: writing smithi13777483-41 from 1900544 to 2596864 tid 2 2024-03-04T06:50:23.323 INFO:tasks.rados.rados.0.smithi137.stdout:2574: writing smithi13777483-41 from 2596864 to 3104768 tid 3 2024-03-04T06:50:23.323 INFO:tasks.rados.rados.0.smithi137.stdout:2575: copy_from oid 38 from oid 22 current snap is 236 2024-03-04T06:50:23.323 INFO:tasks.rados.rados.0.smithi137.stdout:2572: finishing write tid 3 to smithi13777483-29 2024-03-04T06:50:23.324 INFO:tasks.rados.rados.0.smithi137.stdout:2572: finishing write tid 4 to smithi13777483-29 2024-03-04T06:50:23.324 INFO:tasks.rados.rados.0.smithi137.stdout:2572: finishing write tid 5 to smithi13777483-29 2024-03-04T06:50:23.324 INFO:tasks.rados.rados.0.smithi137.stdout:2572: oid 29 updating version 0 to 16824 2024-03-04T06:50:23.324 INFO:tasks.rados.rados.0.smithi137.stdout:2572: oid 29 updating version 16824 to 16827 2024-03-04T06:50:23.324 INFO:tasks.rados.rados.0.smithi137.stdout:2572: oid 29 version 16827 is already newer than 16826 2024-03-04T06:50:23.324 INFO:tasks.rados.rados.0.smithi137.stdout:2572: oid 29 version 16827 is already newer than 16825 2024-03-04T06:50:23.324 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16827 (ObjNum 821 snap 236 seq_num 821) dirty exists 2024-03-04T06:50:23.324 INFO:tasks.rados.rados.0.smithi137.stdout:2572: left oid 29 (ObjNum 821 snap 236 seq_num 821) 2024-03-04T06:50:23.324 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16862 (ObjNum 596 snap 170 seq_num 596) dirty exists 2024-03-04T06:50:23.324 INFO:tasks.rados.rados.0.smithi137.stdout:2574: finishing write tid 1 to smithi13777483-41 2024-03-04T06:50:23.324 INFO:tasks.rados.rados.0.smithi137.stdout:2572: done (3 left) 2024-03-04T06:50:23.324 INFO:tasks.rados.rados.0.smithi137.stdout:2573: done (2 left) 2024-03-04T06:50:23.324 INFO:tasks.rados.rados.0.smithi137.stdout:2576: read oid 15 snap -1 2024-03-04T06:50:23.325 INFO:tasks.rados.rados.0.smithi137.stdout:2576: expect deleted 2024-03-04T06:50:23.325 INFO:tasks.rados.rados.0.smithi137.stdout:2577: read oid 10 snap -1 2024-03-04T06:50:23.325 INFO:tasks.rados.rados.0.smithi137.stdout:2577: expect (ObjNum 809 snap 234 seq_num 809) 2024-03-04T06:50:23.325 INFO:tasks.rados.rados.0.smithi137.stdout:2578: snap_create 2024-03-04T06:50:23.325 INFO:tasks.rados.rados.0.smithi137.stdout:2574: finishing write tid 2 to smithi13777483-41 2024-03-04T06:50:23.325 INFO:tasks.rados.rados.0.smithi137.stdout:2575: finishing copy_from to smithi13777483-38 2024-03-04T06:50:23.325 INFO:tasks.rados.rados.0.smithi137.stdout:2575: got expected ENOENT (src dne) 2024-03-04T06:50:23.325 INFO:tasks.rados.rados.0.smithi137.stdout:2575: finishing copy_from racing read to smithi13777483-38 2024-03-04T06:50:23.330 INFO:tasks.rados.rados.0.smithi137.stdout:2574: finishing write tid 3 to smithi13777483-41 2024-03-04T06:50:23.331 INFO:tasks.rados.rados.0.smithi137.stdout:2574: finishing write tid 4 to smithi13777483-41 2024-03-04T06:50:23.332 INFO:tasks.rados.rados.0.smithi137.stdout:2574: finishing write tid 5 to smithi13777483-41 2024-03-04T06:50:23.332 INFO:tasks.rados.rados.0.smithi137.stdout:2574: oid 41 updating version 0 to 16805 2024-03-04T06:50:23.332 INFO:tasks.rados.rados.0.smithi137.stdout:2574: oid 41 updating version 16805 to 16808 2024-03-04T06:50:23.332 INFO:tasks.rados.rados.0.smithi137.stdout:2574: oid 41 version 16808 is already newer than 16806 2024-03-04T06:50:23.332 INFO:tasks.rados.rados.0.smithi137.stdout:2574: oid 41 version 16808 is already newer than 16807 2024-03-04T06:50:23.332 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 16808 (ObjNum 822 snap 236 seq_num 822) dirty exists 2024-03-04T06:50:23.332 INFO:tasks.rados.rados.0.smithi137.stdout:2574: left oid 41 (ObjNum 822 snap 236 seq_num 822) 2024-03-04T06:50:23.344 INFO:tasks.rados.rados.0.smithi137.stdout:2577: expect (ObjNum 809 snap 234 seq_num 809) 2024-03-04T06:50:23.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:23.267+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:23.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:23.267+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:23.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:23.267+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:23.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:23.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: osdmap e550: 8 total, 8 up, 8 in 2024-03-04T06:50:23.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:23.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: pgmap v503: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 400 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 8.7 MiB/s rd, 384 KiB/s wr, 4 op/s 2024-03-04T06:50:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:23.545 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:23.267+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:23.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:23.274+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: osdmap e550: 8 total, 8 up, 8 in 2024-03-04T06:50:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:23.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:23.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:23.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:23.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: pgmap v503: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 400 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 8.7 MiB/s rd, 384 KiB/s wr, 4 op/s 2024-03-04T06:50:23.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:23.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:23.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:23.267+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:23.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:23.264+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:23.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:23.265+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:23.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:23.309+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:23.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:23.259+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:23.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:23.259+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:23.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:23.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: osdmap e550: 8 total, 8 up, 8 in 2024-03-04T06:50:23.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:23.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:23.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:23.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:23.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:23.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:23.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:23.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:23.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:23.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: pgmap v503: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 400 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 8.7 MiB/s rd, 384 KiB/s wr, 4 op/s 2024-03-04T06:50:23.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:23.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:24.274 INFO:tasks.rados.rados.0.smithi137.stdout:2574: done (4 left) 2024-03-04T06:50:24.274 INFO:tasks.rados.rados.0.smithi137.stdout:2575: done (3 left) 2024-03-04T06:50:24.274 INFO:tasks.rados.rados.0.smithi137.stdout:2576: done (2 left) 2024-03-04T06:50:24.274 INFO:tasks.rados.rados.0.smithi137.stdout:2577: done (1 left) 2024-03-04T06:50:24.274 INFO:tasks.rados.rados.0.smithi137.stdout:2578: done (0 left) 2024-03-04T06:50:24.274 INFO:tasks.rados.rados.0.smithi137.stdout:2579: setattr oid 29 current snap is 237 2024-03-04T06:50:24.275 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:24.275 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:24.275 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[88869]: osdmap e551: 8 total, 8 up, 8 in 2024-03-04T06:50:24.275 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:24.275 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:24.275 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:24.275 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:24.275 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:24.275 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:24.275 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:24.275 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:24.276 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:24.276 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:50:24.276 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:24.276 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:24.276 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[91314]: osdmap e551: 8 total, 8 up, 8 in 2024-03-04T06:50:24.276 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:24.276 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:24.276 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:24.276 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:24.276 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:24.277 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:24.277 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:24.277 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:24.277 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:24.277 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:50:24.277 INFO:tasks.rados.rados.0.smithi137.stdout:2580: read oid 12 snap -1 2024-03-04T06:50:24.277 INFO:tasks.rados.rados.0.smithi137.stdout:2580: expect (ObjNum 775 snap 230 seq_num 775) 2024-03-04T06:50:24.278 INFO:tasks.rados.rados.0.smithi137.stdout:2581: rollback oid 32 current snap is 237 2024-03-04T06:50:24.278 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 32 to 236 2024-03-04T06:50:24.278 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 237 2024-03-04T06:50:24.278 INFO:tasks.rados.rados.0.smithi137.stdout:2582: seq_num 823 ranges {0=589824,589824=573440,1163264=630784} 2024-03-04T06:50:24.278 INFO:tasks.rados.rados.0.smithi137.stdout:2582: writing smithi13777483-25 from 0 to 589824 tid 1 2024-03-04T06:50:24.282 INFO:tasks.rados.rados.0.smithi137.stdout:2582: writing smithi13777483-25 from 589824 to 1163264 tid 2 2024-03-04T06:50:24.286 INFO:tasks.rados.rados.0.smithi137.stdout:2582: writing smithi13777483-25 from 1163264 to 1794048 tid 3 2024-03-04T06:50:24.286 INFO:tasks.rados.rados.0.smithi137.stdout:2583: read oid 17 snap -1 2024-03-04T06:50:24.287 INFO:tasks.rados.rados.0.smithi137.stdout:2583: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:50:24.287 INFO:tasks.rados.rados.0.smithi137.stdout:2584: read oid 20 snap 236 2024-03-04T06:50:24.287 INFO:tasks.rados.rados.0.smithi137.stdout:2584: expect (ObjNum 568 snap 159 seq_num 568) 2024-03-04T06:50:24.287 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 237 2024-03-04T06:50:24.287 INFO:tasks.rados.rados.0.smithi137.stdout:2581: finishing rollback tid 1 to smithi13777483-32 2024-03-04T06:50:24.287 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 0 (ObjNum 369 snap 0 seq_num 3130635280) dirty dne 2024-03-04T06:50:24.287 INFO:tasks.rados.rados.0.smithi137.stdout:2585: seq_num 824 ranges {3514368=606208,4120576=458752,4579328=573440,5152768=172032} 2024-03-04T06:50:24.308 INFO:tasks.rados.rados.0.smithi137.stdout:2585: writing smithi13777483-3 from 3514368 to 4120576 tid 1 2024-03-04T06:50:24.311 INFO:tasks.rados.rados.0.smithi137.stdout:2585: writing smithi13777483-3 from 4120576 to 4579328 tid 2 2024-03-04T06:50:24.314 INFO:tasks.rados.rados.0.smithi137.stdout:2585: writing smithi13777483-3 from 4579328 to 5152768 tid 3 2024-03-04T06:50:24.316 INFO:tasks.rados.rados.0.smithi137.stdout:2585: writing smithi13777483-3 from 5152768 to 5324800 tid 4 2024-03-04T06:50:24.316 INFO:tasks.rados.rados.0.smithi137.stdout:2581: done (6 left) 2024-03-04T06:50:24.316 INFO:tasks.rados.rados.0.smithi137.stdout:2586: snap_create 2024-03-04T06:50:24.316 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16828 (ObjNum 821 snap 236 seq_num 821) dirty exists 2024-03-04T06:50:24.316 INFO:tasks.rados.rados.0.smithi137.stdout:2582: finishing write tid 1 to smithi13777483-25 2024-03-04T06:50:24.316 INFO:tasks.rados.rados.0.smithi137.stdout:2582: finishing write tid 2 to smithi13777483-25 2024-03-04T06:50:24.316 INFO:tasks.rados.rados.0.smithi137.stdout:2583: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:50:24.319 INFO:tasks.rados.rados.0.smithi137.stdout:2582: finishing write tid 3 to smithi13777483-25 2024-03-04T06:50:24.319 INFO:tasks.rados.rados.0.smithi137.stdout:2582: finishing write tid 4 to smithi13777483-25 2024-03-04T06:50:24.319 INFO:tasks.rados.rados.0.smithi137.stdout:2582: finishing write tid 5 to smithi13777483-25 2024-03-04T06:50:24.320 INFO:tasks.rados.rados.0.smithi137.stdout:2582: oid 25 updating version 0 to 16835 2024-03-04T06:50:24.320 INFO:tasks.rados.rados.0.smithi137.stdout:2582: oid 25 updating version 16835 to 16837 2024-03-04T06:50:24.320 INFO:tasks.rados.rados.0.smithi137.stdout:2582: oid 25 updating version 16837 to 16838 2024-03-04T06:50:24.320 INFO:tasks.rados.rados.0.smithi137.stdout:2582: oid 25 version 16838 is already newer than 16836 2024-03-04T06:50:24.320 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 16838 (ObjNum 823 snap 237 seq_num 823) dirty exists 2024-03-04T06:50:24.320 INFO:tasks.rados.rados.0.smithi137.stdout:2582: left oid 25 (ObjNum 823 snap 237 seq_num 823) 2024-03-04T06:50:24.320 INFO:tasks.rados.rados.0.smithi137.stdout:2580: expect (ObjNum 775 snap 230 seq_num 775) 2024-03-04T06:50:24.529 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:24.278+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:24.530 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:24.273+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:24.530 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:24.274+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:24.530 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:24.271+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:24.531 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:24.283+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:24.531 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:24.283+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:24.531 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:24.283+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:24.531 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:24.280+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:24.531 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:24.280+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:24.531 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:24.280+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:24.531 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:24.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset 118=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:24.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-mon[85573]: osdmap e551: 8 total, 8 up, 8 in 2024-03-04T06:50:24.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:24.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:24.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:24.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:24.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:24.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:24.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:24.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:24.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:24.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:50:24.549 INFO:tasks.rados.rados.0.smithi137.stdout:2585: finishing write tid 1 to smithi13777483-3 2024-03-04T06:50:24.549 INFO:tasks.rados.rados.0.smithi137.stdout:2585: finishing write tid 2 to smithi13777483-3 2024-03-04T06:50:24.549 INFO:tasks.rados.rados.0.smithi137.stdout:2585: finishing write tid 3 to smithi13777483-3 2024-03-04T06:50:24.549 INFO:tasks.rados.rados.0.smithi137.stdout:2584: expect (ObjNum 568 snap 159 seq_num 568) 2024-03-04T06:50:24.791 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:24.529+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:24.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:24.529+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:24.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:24.529+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:24.909 INFO:tasks.rados.rados.0.smithi137.stdout:2585: finishing write tid 4 to smithi13777483-3 2024-03-04T06:50:24.909 INFO:tasks.rados.rados.0.smithi137.stdout:2585: finishing write tid 5 to smithi13777483-3 2024-03-04T06:50:24.909 INFO:tasks.rados.rados.0.smithi137.stdout:2585: finishing write tid 6 to smithi13777483-3 2024-03-04T06:50:24.909 INFO:tasks.rados.rados.0.smithi137.stdout:2585: oid 3 updating version 0 to 15571 2024-03-04T06:50:24.909 INFO:tasks.rados.rados.0.smithi137.stdout:2585: oid 3 version 15571 is already newer than 15570 2024-03-04T06:50:24.909 INFO:tasks.rados.rados.0.smithi137.stdout:2585: oid 3 updating version 15571 to 15572 2024-03-04T06:50:24.909 INFO:tasks.rados.rados.0.smithi137.stdout:2585: oid 3 updating version 15572 to 15573 2024-03-04T06:50:24.909 INFO:tasks.rados.rados.0.smithi137.stdout:2585: oid 3 updating version 15573 to 15574 2024-03-04T06:50:24.909 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 15574 (ObjNum 824 snap 237 seq_num 824) dirty exists 2024-03-04T06:50:24.909 INFO:tasks.rados.rados.0.smithi137.stdout:2585: left oid 3 (ObjNum 824 snap 237 seq_num 824) 2024-03-04T06:50:25.285 INFO:tasks.rados.rados.0.smithi137.stdout:2579: done (6 left) 2024-03-04T06:50:25.285 INFO:tasks.rados.rados.0.smithi137.stdout:2580: done (5 left) 2024-03-04T06:50:25.285 INFO:tasks.rados.rados.0.smithi137.stdout:2582: done (4 left) 2024-03-04T06:50:25.285 INFO:tasks.rados.rados.0.smithi137.stdout:2583: done (3 left) 2024-03-04T06:50:25.285 INFO:tasks.rados.rados.0.smithi137.stdout:2584: done (2 left) 2024-03-04T06:50:25.285 INFO:tasks.rados.rados.0.smithi137.stdout:2585: done (1 left) 2024-03-04T06:50:25.285 INFO:tasks.rados.rados.0.smithi137.stdout:2586: done (0 left) 2024-03-04T06:50:25.285 INFO:tasks.rados.rados.0.smithi137.stdout:2587: rollback oid 5 current snap is 238 2024-03-04T06:50:25.285 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 5 to 236 2024-03-04T06:50:25.286 INFO:tasks.rados.rados.0.smithi137.stdout:2588: read oid 13 snap -1 2024-03-04T06:50:25.286 INFO:tasks.rados.rados.0.smithi137.stdout:2588: expect (ObjNum 615 snap 175 seq_num 615) 2024-03-04T06:50:25.286 INFO:tasks.rados.rados.0.smithi137.stdout:2589: read oid 36 snap -1 2024-03-04T06:50:25.286 INFO:tasks.rados.rados.0.smithi137.stdout:2589: expect deleted 2024-03-04T06:50:25.286 INFO:tasks.rados.rados.0.smithi137.stdout:2590: delete oid 10 current snap is 238 2024-03-04T06:50:25.286 INFO:tasks.rados.rados.0.smithi137.stdout:2587: finishing rollback tid 1 to smithi13777483-5 2024-03-04T06:50:25.286 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 0 (ObjNum 65 snap 0 seq_num 1818521435) dirty dne 2024-03-04T06:50:25.288 INFO:tasks.rados.rados.0.smithi137.stdout:2588: expect (ObjNum 615 snap 175 seq_num 615) 2024-03-04T06:50:25.313 INFO:tasks.rados.rados.0.smithi137.stdout:2587: done (3 left) 2024-03-04T06:50:25.314 INFO:tasks.rados.rados.0.smithi137.stdout:2588: done (2 left) 2024-03-04T06:50:25.314 INFO:tasks.rados.rados.0.smithi137.stdout:2589: done (1 left) 2024-03-04T06:50:25.314 INFO:tasks.rados.rados.0.smithi137.stdout:2590: done (0 left) 2024-03-04T06:50:25.314 INFO:tasks.rados.rados.0.smithi137.stdout:2591: rmattr oid 7 current snap is 238 2024-03-04T06:50:25.314 INFO:tasks.rados.rados.0.smithi137.stdout:2592: snap_remove snap 236 2024-03-04T06:50:25.429 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:50:25] "GET /metrics HTTP/1.1" 200 36331 "" "Prometheus/2.43.0" 2024-03-04T06:50:25.429 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:25.305+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:25.429 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:25.288+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:25.430 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:25.288+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:25.430 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:25.288+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:25.430 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:25.430 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[88869]: osdmap e552: 8 total, 8 up, 8 in 2024-03-04T06:50:25.430 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:25.430 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:25.430 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:25.430 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:25.430 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:25.430 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:25.430 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:25.431 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[88869]: pgmap v506: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 369 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2024-03-04T06:50:25.431 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:25.431 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:25.431 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[91314]: osdmap e552: 8 total, 8 up, 8 in 2024-03-04T06:50:25.431 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:25.431 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:25.431 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:25.431 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:25.431 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:25.431 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:25.431 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:25.431 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[91314]: pgmap v506: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 369 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2024-03-04T06:50:25.431 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:25.432 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:25.281+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:25.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:25.288+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:25.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:25.278+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:25.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:25.278+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:25.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:25.306+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:25.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:25.305+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:25.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:25.306+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-mon[85573]: osdmap e552: 8 total, 8 up, 8 in 2024-03-04T06:50:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:25.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:25.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:25.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:25.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-mon[85573]: pgmap v506: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 369 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2024-03-04T06:50:25.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:25.749 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:50:26.080 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:50:26.080 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (10m) 4s ago 11m 26.4M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:50:26.081 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (10m) 21s ago 10m 87.7M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:50:26.081 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (7s) 4s ago 12m 14.9M - 19.0.0-1791-gefb04e5e 0c401cd3e778 b6a5f9352182 2024-03-04T06:50:26.081 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (12m) 21s ago 12m 21.2M - 18.2.1-696-g5cc7a767 540557f94930 3c8bab6bae30 2024-03-04T06:50:26.081 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (6m) 21s ago 15m 451M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:50:26.081 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (6m) 4s ago 17m 511M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:50:26.081 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (5m) 4s ago 17m 66.8M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:50:26.081 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (5m) 21s ago 16m 50.5M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:50:26.081 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (5m) 4s ago 16m 55.2M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:50:26.081 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (10m) 4s ago 10m 17.3M - 1.5.0 0da6a335fe13 f011a698fd19 2024-03-04T06:50:26.081 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (10m) 21s ago 10m 15.2M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:50:26.081 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (4m) 4s ago 15m 337M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 bd2207652b33 2024-03-04T06:50:26.081 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (3m) 4s ago 15m 208M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 47b5cdaad147 2024-03-04T06:50:26.082 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (3m) 4s ago 14m 272M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 436ae07776d9 2024-03-04T06:50:26.082 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (2m) 4s ago 14m 143M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9acd06dda8ec 2024-03-04T06:50:26.082 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (2m) 21s ago 13m 155M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9a246a0996bd 2024-03-04T06:50:26.082 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (97s) 21s ago 13m 249M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9e05ca76b164 2024-03-04T06:50:26.082 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (63s) 21s ago 13m 204M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 ddb88aa8bce6 2024-03-04T06:50:26.082 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (26s) 21s ago 12m 15.0M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 b9857bcd7602 2024-03-04T06:50:26.082 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (6m) 21s ago 11m 56.4M - 2.43.0 a07b618ecd1d 6a88bdd1023c 2024-03-04T06:50:26.291 INFO:tasks.rados.rados.0.smithi137.stdout:2592: done (1 left) 2024-03-04T06:50:26.291 INFO:tasks.rados.rados.0.smithi137.stdout:2593: rollback oid 2 current snap is 238 2024-03-04T06:50:26.291 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 2 to 237 2024-03-04T06:50:26.291 INFO:tasks.rados.rados.0.smithi137.stdout:2594: copy_from oid 5 from oid 15 current snap is 238 2024-03-04T06:50:26.291 INFO:tasks.rados.rados.0.smithi137.stdout:2595: read oid 49 snap -1 2024-03-04T06:50:26.291 INFO:tasks.rados.rados.0.smithi137.stdout:2595: expect deleted 2024-03-04T06:50:26.291 INFO:tasks.rados.rados.0.smithi137.stdout:2596: copy_from oid 45 from oid 42 current snap is 238 2024-03-04T06:50:26.291 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16830 (ObjNum 784 snap 231 seq_num 784) dirty exists 2024-03-04T06:50:26.291 INFO:tasks.rados.rados.0.smithi137.stdout:2591: done (4 left) 2024-03-04T06:50:26.291 INFO:tasks.rados.rados.0.smithi137.stdout:2597: read oid 32 snap -1 2024-03-04T06:50:26.291 INFO:tasks.rados.rados.0.smithi137.stdout:2597: expect deleted 2024-03-04T06:50:26.291 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 238 2024-03-04T06:50:26.292 INFO:tasks.rados.rados.0.smithi137.stdout:2598: seq_num 826 ranges {0=638976,638976=630784,1269760=573440} 2024-03-04T06:50:26.294 INFO:tasks.rados.rados.0.smithi137.stdout:2598: writing smithi13777483-22 from 0 to 638976 tid 1 2024-03-04T06:50:26.299 INFO:tasks.rados.rados.0.smithi137.stdout:2598: writing smithi13777483-22 from 638976 to 1269760 tid 2 2024-03-04T06:50:26.303 INFO:tasks.rados.rados.0.smithi137.stdout:2598: writing smithi13777483-22 from 1269760 to 1843200 tid 3 2024-03-04T06:50:26.303 INFO:tasks.rados.rados.0.smithi137.stdout:2599: setattr oid 10 current snap is 238 2024-03-04T06:50:26.303 INFO:tasks.rados.rados.0.smithi137.stdout:2594: finishing copy_from to smithi13777483-5 2024-03-04T06:50:26.303 INFO:tasks.rados.rados.0.smithi137.stdout:2594: got expected ENOENT (src dne) 2024-03-04T06:50:26.304 INFO:tasks.rados.rados.0.smithi137.stdout:2594: finishing copy_from racing read to smithi13777483-5 2024-03-04T06:50:26.304 INFO:tasks.rados.rados.0.smithi137.stdout:2593: finishing rollback tid 0 to smithi13777483-2 2024-03-04T06:50:26.304 INFO:tasks.rados.rados.0.smithi137.stdout:2593: finishing rollback tid 1 to smithi13777483-2 2024-03-04T06:50:26.304 INFO:tasks.rados.rados.0.smithi137.stdout:2593: finishing rollback tid 2 to smithi13777483-2 2024-03-04T06:50:26.304 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16822 (ObjNum 798 snap 231 seq_num 798) dirty exists 2024-03-04T06:50:26.304 INFO:tasks.rados.rados.0.smithi137.stdout:2598: finishing write tid 1 to smithi13777483-22 2024-03-04T06:50:26.304 INFO:tasks.rados.rados.0.smithi137.stdout:2593: done (6 left) 2024-03-04T06:50:26.305 INFO:tasks.rados.rados.0.smithi137.stdout:2594: done (5 left) 2024-03-04T06:50:26.305 INFO:tasks.rados.rados.0.smithi137.stdout:2595: done (4 left) 2024-03-04T06:50:26.305 INFO:tasks.rados.rados.0.smithi137.stdout:2597: done (3 left) 2024-03-04T06:50:26.305 INFO:tasks.rados.rados.0.smithi137.stdout:2600: read oid 13 snap -1 2024-03-04T06:50:26.305 INFO:tasks.rados.rados.0.smithi137.stdout:2600: expect (ObjNum 615 snap 175 seq_num 615) 2024-03-04T06:50:26.305 INFO:tasks.rados.rados.0.smithi137.stdout:2601: snap_remove snap 237 2024-03-04T06:50:26.463 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:26.288+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:26.463 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:26.290+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:26.463 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:26.463 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:26.463 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:26.464 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:26.464 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[88869]: osdmap e553: 8 total, 8 up, 8 in 2024-03-04T06:50:26.464 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:26.464 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:26.464 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:26.464 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:26.464 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:26.464 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:26.464 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:26.464 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:26.464 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:26.465 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:26.465 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:26.465 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[91314]: osdmap e553: 8 total, 8 up, 8 in 2024-03-04T06:50:26.465 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:26.465 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:26.465 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:26.465 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:26.465 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:26.465 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:26.465 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:26.465 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:26.296+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:26.504 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:50:26.504 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 8 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 1, 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 1 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:50:26.505 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 18.2.1-696-g5cc7a767 (5cc7a7679b7ba0f0befea649a39bb50c530f1e24) reef (stable)": 1, 2024-03-04T06:50:26.506 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 14 2024-03-04T06:50:26.506 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:50:26.506 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:50:26.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:26.293+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:26.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:26.285+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:26.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:26.285+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:26.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:26.285+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:26.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:26.348+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:26.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:26.348+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:26.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:26.292+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:26.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:26.293+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:26.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:26.293+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-mon[85573]: osdmap e553: 8 total, 8 up, 8 in 2024-03-04T06:50:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:26.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:26.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:26.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:26.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:26.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:26.644+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:27.293 INFO:tasks.rados.rados.0.smithi137.stdout:2601: done (4 left) 2024-03-04T06:50:27.293 INFO:tasks.rados.rados.0.smithi137.stdout:2602: delete oid 31 current snap is 238 2024-03-04T06:50:27.293 INFO:tasks.rados.rados.0.smithi137.stdout:2598: finishing write tid 2 to smithi13777483-22 2024-03-04T06:50:27.293 INFO:tasks.rados.rados.0.smithi137.stdout:2596: finishing copy_from racing read to smithi13777483-45 2024-03-04T06:50:27.293 INFO:tasks.rados.rados.0.smithi137.stdout:2596: finishing copy_from to smithi13777483-45 2024-03-04T06:50:27.293 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16855 (ObjNum 771 snap 228 seq_num 771) dirty exists 2024-03-04T06:50:27.294 INFO:tasks.rados.rados.0.smithi137.stdout:2600: expect (ObjNum 615 snap 175 seq_num 615) 2024-03-04T06:50:27.317 INFO:tasks.rados.rados.0.smithi137.stdout:2598: finishing write tid 3 to smithi13777483-22 2024-03-04T06:50:27.317 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15576 (ObjNum 10497 snap 0 seq_num 3130609264) dirty exists 2024-03-04T06:50:27.317 INFO:tasks.rados.rados.0.smithi137.stdout:2598: finishing write tid 4 to smithi13777483-22 2024-03-04T06:50:27.317 INFO:tasks.rados.rados.0.smithi137.stdout:2596: done (4 left) 2024-03-04T06:50:27.317 INFO:tasks.rados.rados.0.smithi137.stdout:2599: done (3 left) 2024-03-04T06:50:27.317 INFO:tasks.rados.rados.0.smithi137.stdout:2600: done (2 left) 2024-03-04T06:50:27.318 INFO:tasks.rados.rados.0.smithi137.stdout:2602: done (1 left) 2024-03-04T06:50:27.318 INFO:tasks.rados.rados.0.smithi137.stdout:2603: delete oid 42 current snap is 238 2024-03-04T06:50:27.318 INFO:tasks.rados.rados.0.smithi137.stdout:2598: finishing write tid 5 to smithi13777483-22 2024-03-04T06:50:27.318 INFO:tasks.rados.rados.0.smithi137.stdout:2598: oid 22 updating version 0 to 16806 2024-03-04T06:50:27.318 INFO:tasks.rados.rados.0.smithi137.stdout:2598: oid 22 version 16806 is already newer than 16805 2024-03-04T06:50:27.318 INFO:tasks.rados.rados.0.smithi137.stdout:2598: oid 22 version 16806 is already newer than 16803 2024-03-04T06:50:27.318 INFO:tasks.rados.rados.0.smithi137.stdout:2598: oid 22 version 16806 is already newer than 16804 2024-03-04T06:50:27.318 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 16806 (ObjNum 826 snap 238 seq_num 826) dirty exists 2024-03-04T06:50:27.318 INFO:tasks.rados.rados.0.smithi137.stdout:2598: left oid 22 (ObjNum 826 snap 238 seq_num 826) 2024-03-04T06:50:27.319 INFO:tasks.rados.rados.0.smithi137.stdout:2598: done (1 left) 2024-03-04T06:50:27.319 INFO:tasks.rados.rados.0.smithi137.stdout:2603: done (0 left) 2024-03-04T06:50:27.319 INFO:tasks.rados.rados.0.smithi137.stdout:2604: copy_from oid 13 from oid 17 current snap is 238 2024-03-04T06:50:27.319 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 238 2024-03-04T06:50:27.319 INFO:tasks.rados.rados.0.smithi137.stdout:2605: seq_num 829 ranges {5390336=688128,6078464=729088,6807552=475136} 2024-03-04T06:50:27.352 INFO:tasks.rados.rados.0.smithi137.stdout:2605: writing smithi13777483-26 from 5390336 to 6078464 tid 1 2024-03-04T06:50:27.356 INFO:tasks.rados.rados.0.smithi137.stdout:2605: writing smithi13777483-26 from 6078464 to 6807552 tid 2 2024-03-04T06:50:27.359 INFO:tasks.rados.rados.0.smithi137.stdout:2605: writing smithi13777483-26 from 6807552 to 7282688 tid 3 2024-03-04T06:50:27.359 INFO:tasks.rados.rados.0.smithi137.stdout:2606: snap_create 2024-03-04T06:50:27.359 INFO:tasks.rados.rados.0.smithi137.stdout:2604: finishing copy_from racing read to smithi13777483-13 2024-03-04T06:50:27.359 INFO:tasks.rados.rados.0.smithi137.stdout:2604: finishing copy_from to smithi13777483-13 2024-03-04T06:50:27.359 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16800 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-03-04T06:50:27.360 INFO:tasks.rados.rados.0.smithi137.stdout:2605: finishing write tid 1 to smithi13777483-26 2024-03-04T06:50:27.360 INFO:tasks.rados.rados.0.smithi137.stdout:2605: finishing write tid 2 to smithi13777483-26 2024-03-04T06:50:27.361 INFO:tasks.rados.rados.0.smithi137.stdout:2605: finishing write tid 3 to smithi13777483-26 2024-03-04T06:50:27.362 INFO:tasks.rados.rados.0.smithi137.stdout:2605: finishing write tid 4 to smithi13777483-26 2024-03-04T06:50:27.363 INFO:tasks.rados.rados.0.smithi137.stdout:2605: finishing write tid 5 to smithi13777483-26 2024-03-04T06:50:27.363 INFO:tasks.rados.rados.0.smithi137.stdout:2605: oid 26 updating version 0 to 16829 2024-03-04T06:50:27.363 INFO:tasks.rados.rados.0.smithi137.stdout:2605: oid 26 updating version 16829 to 16830 2024-03-04T06:50:27.363 INFO:tasks.rados.rados.0.smithi137.stdout:2605: oid 26 updating version 16830 to 16831 2024-03-04T06:50:27.363 INFO:tasks.rados.rados.0.smithi137.stdout:2605: oid 26 updating version 16831 to 16832 2024-03-04T06:50:27.363 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16832 (ObjNum 829 snap 238 seq_num 829) dirty exists 2024-03-04T06:50:27.363 INFO:tasks.rados.rados.0.smithi137.stdout:2605: left oid 26 (ObjNum 829 snap 238 seq_num 829) 2024-03-04T06:50:27.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:27.291+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:27.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:27.298+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:27.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:27.294+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:27.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:27.294+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:27.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:27.294+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:50:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:50:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: osdmap e554: 8 total, 8 up, 8 in 2024-03-04T06:50:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: pgmap v509: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 373 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 2.8 MiB/s wr, 24 op/s 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/3982445615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:27.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-04T06:50:27.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:50:27.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:50:27.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:27.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:27.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: osdmap e554: 8 total, 8 up, 8 in 2024-03-04T06:50:27.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:27.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:27.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: pgmap v509: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 373 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 2.8 MiB/s wr, 24 op/s 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/3982445615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:27 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-04T06:50:27.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:27.293+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:27.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:27.298+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:27.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:27.289+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:27.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:27.290+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:27.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:27.296+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:27.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:27.296+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:50:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:50:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: osdmap e554: 8 total, 8 up, 8 in 2024-03-04T06:50:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: pgmap v509: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 373 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 2.8 MiB/s wr, 24 op/s 2024-03-04T06:50:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/3982445615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:50:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:27 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-04T06:50:28.301 INFO:tasks.rados.rados.0.smithi137.stdout:2604: done (2 left) 2024-03-04T06:50:28.301 INFO:tasks.rados.rados.0.smithi137.stdout:2605: done (1 left) 2024-03-04T06:50:28.301 INFO:tasks.rados.rados.0.smithi137.stdout:2606: done (0 left) 2024-03-04T06:50:28.302 INFO:tasks.rados.rados.0.smithi137.stdout:2607: copy_from oid 24 from oid 35 current snap is 239 2024-03-04T06:50:28.302 INFO:tasks.rados.rados.0.smithi137.stdout:2608: read oid 32 snap 238 2024-03-04T06:50:28.302 INFO:tasks.rados.rados.0.smithi137.stdout:2608: expect deleted 2024-03-04T06:50:28.302 INFO:tasks.rados.rados.0.smithi137.stdout:2609: read oid 38 snap -1 2024-03-04T06:50:28.302 INFO:tasks.rados.rados.0.smithi137.stdout:2609: expect (ObjNum 817 snap 236 seq_num 817) 2024-03-04T06:50:28.302 INFO:tasks.rados.rados.0.smithi137.stdout:2610: read oid 49 snap 238 2024-03-04T06:50:28.302 INFO:tasks.rados.rados.0.smithi137.stdout:2610: expect deleted 2024-03-04T06:50:28.302 INFO:tasks.rados.rados.0.smithi137.stdout:2611: snap_create 2024-03-04T06:50:28.313 INFO:tasks.rados.rados.0.smithi137.stdout:2607: finishing copy_from racing read to smithi13777483-24 2024-03-04T06:50:28.317 INFO:tasks.rados.rados.0.smithi137.stdout:2607: finishing copy_from to smithi13777483-24 2024-03-04T06:50:28.317 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16856 (ObjNum 810 snap 235 seq_num 810) dirty exists 2024-03-04T06:50:28.319 INFO:tasks.rados.rados.0.smithi137.stdout:2609: expect (ObjNum 817 snap 236 seq_num 817) 2024-03-04T06:50:28.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:28.312+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:28.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:28.313+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:28.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:28.301+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[88869]: Upgrade: It appears safe to stop mds.b 2024-03-04T06:50:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[88869]: osdmap e555: 8 total, 8 up, 8 in 2024-03-04T06:50:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:28.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:28.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[91314]: Upgrade: It appears safe to stop mds.b 2024-03-04T06:50:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[91314]: osdmap e555: 8 total, 8 up, 8 in 2024-03-04T06:50:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:28.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:28.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:28.311+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:28.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:28.304+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:28.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:28.304+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:28.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:28.296+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:28.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:28.296+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:28.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:28.296+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:28.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:28.304+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:28.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:28.304+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:28.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:28.305+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:28.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-mon[85573]: Upgrade: It appears safe to stop mds.b 2024-03-04T06:50:28.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:28.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:28.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:28.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-mon[85573]: osdmap e555: 8 total, 8 up, 8 in 2024-03-04T06:50:28.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:28.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:28.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:28.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:28.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:28.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:28.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:29.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:28.877+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:29.306 INFO:tasks.rados.rados.0.smithi137.stdout:2607: done (4 left) 2024-03-04T06:50:29.306 INFO:tasks.rados.rados.0.smithi137.stdout:2608: done (3 left) 2024-03-04T06:50:29.306 INFO:tasks.rados.rados.0.smithi137.stdout:2609: done (2 left) 2024-03-04T06:50:29.307 INFO:tasks.rados.rados.0.smithi137.stdout:2610: done (1 left) 2024-03-04T06:50:29.307 INFO:tasks.rados.rados.0.smithi137.stdout:2611: done (0 left) 2024-03-04T06:50:29.307 INFO:tasks.rados.rados.0.smithi137.stdout:2612: copy_from oid 43 from oid 41 current snap is 240 2024-03-04T06:50:29.307 INFO:tasks.rados.rados.0.smithi137.stdout:2613: delete oid 31 current snap is 240 2024-03-04T06:50:29.313 INFO:tasks.rados.rados.0.smithi137.stdout:2613: done (1 left) 2024-03-04T06:50:29.313 INFO:tasks.rados.rados.0.smithi137.stdout:2614: copy_from oid 10 from oid 31 current snap is 240 2024-03-04T06:50:29.313 INFO:tasks.rados.rados.0.smithi137.stdout:2615: read oid 4 snap -1 2024-03-04T06:50:29.313 INFO:tasks.rados.rados.0.smithi137.stdout:2615: expect (ObjNum 568 snap 159 seq_num 568) 2024-03-04T06:50:29.313 INFO:tasks.rados.rados.0.smithi137.stdout:2616: snap_create 2024-03-04T06:50:29.314 INFO:tasks.rados.rados.0.smithi137.stdout:2614: finishing copy_from to smithi13777483-10 2024-03-04T06:50:29.314 INFO:tasks.rados.rados.0.smithi137.stdout:2614: got expected ENOENT (src dne) 2024-03-04T06:50:29.314 INFO:tasks.rados.rados.0.smithi137.stdout:2614: finishing copy_from racing read to smithi13777483-10 2024-03-04T06:50:29.322 INFO:tasks.rados.rados.0.smithi137.stdout:2612: finishing copy_from racing read to smithi13777483-43 2024-03-04T06:50:29.325 INFO:tasks.rados.rados.0.smithi137.stdout:2612: finishing copy_from to smithi13777483-43 2024-03-04T06:50:29.325 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16808 (ObjNum 822 snap 236 seq_num 822) dirty exists 2024-03-04T06:50:29.344 INFO:tasks.rados.rados.0.smithi137.stdout:2615: expect (ObjNum 568 snap 159 seq_num 568) 2024-03-04T06:50:29.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:29.307+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:29.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:29.313+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:29.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:29.310+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:29.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:29.310+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:29.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:29.311+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:29.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:29.312+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:29.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:29.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:29.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: osdmap e556: 8 total, 8 up, 8 in 2024-03-04T06:50:29.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:29.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:29.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:29.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:29.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:29.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:29.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:29.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: pgmap v512: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 374 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 9.4 MiB/s rd, 3.7 MiB/s wr, 32 op/s 2024-03-04T06:50:29.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:29.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:50:29.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:29.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:29.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:29.314+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:29.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:29.322+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:29.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:29.305+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:29.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:29.305+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:29.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:29.305+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: osdmap e556: 8 total, 8 up, 8 in 2024-03-04T06:50:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:29.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:29.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:29.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:29.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:29.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:29.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: pgmap v512: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 374 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 9.4 MiB/s rd, 3.7 MiB/s wr, 32 op/s 2024-03-04T06:50:29.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:29.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:50:29.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:29.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:29.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:29.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:29.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: osdmap e556: 8 total, 8 up, 8 in 2024-03-04T06:50:29.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:29.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:29.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:29.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:29.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:29.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:29.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:29.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: pgmap v512: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 374 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 9.4 MiB/s rd, 3.7 MiB/s wr, 32 op/s 2024-03-04T06:50:29.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:29.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T06:50:29.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:29.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:30.309 INFO:tasks.rados.rados.0.smithi137.stdout:2612: done (3 left) 2024-03-04T06:50:30.309 INFO:tasks.rados.rados.0.smithi137.stdout:2614: done (2 left) 2024-03-04T06:50:30.309 INFO:tasks.rados.rados.0.smithi137.stdout:2615: done (1 left) 2024-03-04T06:50:30.309 INFO:tasks.rados.rados.0.smithi137.stdout:2616: done (0 left) 2024-03-04T06:50:30.309 INFO:tasks.rados.rados.0.smithi137.stdout:2617: snap_remove snap 239 2024-03-04T06:50:30.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:30.307+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:30.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[88869]: Upgrade: Updating mds.b 2024-03-04T06:50:30.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[88869]: Deploying daemon mds.b on smithi203 2024-03-04T06:50:30.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:30.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:30.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[88869]: osdmap e557: 8 total, 8 up, 8 in 2024-03-04T06:50:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:30.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[91314]: Upgrade: Updating mds.b 2024-03-04T06:50:30.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[91314]: Deploying daemon mds.b on smithi203 2024-03-04T06:50:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[91314]: osdmap e557: 8 total, 8 up, 8 in 2024-03-04T06:50:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:30.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:30.592 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:30.309+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:30.592 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:30.310+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:30.592 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:30.310+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:30.592 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-mon[85573]: Upgrade: Updating mds.b 2024-03-04T06:50:30.592 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-mon[85573]: Deploying daemon mds.b on smithi203 2024-03-04T06:50:30.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:30.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:30.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-mon[85573]: osdmap e557: 8 total, 8 up, 8 in 2024-03-04T06:50:30.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:30.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:30.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:30.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:30.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:30.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:30.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:30.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:30.837 INFO:tasks.rados.rados.0.smithi137.stdout:2617: done (0 left) 2024-03-04T06:50:30.837 INFO:tasks.rados.rados.0.smithi137.stdout:2618: read oid 1 snap -1 2024-03-04T06:50:30.837 INFO:tasks.rados.rados.0.smithi137.stdout:2618: expect (ObjNum 788 snap 231 seq_num 788) 2024-03-04T06:50:30.837 INFO:tasks.rados.rados.0.smithi137.stdout:2619: copy_from oid 5 from oid 23 current snap is 241 2024-03-04T06:50:30.838 INFO:tasks.rados.rados.0.smithi137.stdout:2620: read oid 49 snap 238 2024-03-04T06:50:30.838 INFO:tasks.rados.rados.0.smithi137.stdout:2620: expect deleted 2024-03-04T06:50:30.838 INFO:tasks.rados.rados.0.smithi137.stdout:2621: rmattr oid 35 current snap is 241 2024-03-04T06:50:30.838 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 241 2024-03-04T06:50:30.838 INFO:tasks.rados.rados.0.smithi137.stdout:2622: seq_num 831 ranges {1728512=720896,2449408=499712,2949120=704512} 2024-03-04T06:50:30.842 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:30.841+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:30.843 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:30 smithi203 systemd[1]: Stopping Ceph mds.b for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:50:30.843 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b[57861]: 2024-03-04T06:50:30.827+0000 7fd33c9c4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T06:50:30.843 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b[57861]: 2024-03-04T06:50:30.827+0000 7fd33c9c4700 -1 mds.b *** got signal Terminated *** 2024-03-04T06:50:30.843 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:30.831+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:30.843 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:30.832+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:30.843 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:30.730+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:30.844 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:30.730+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:30.851 INFO:tasks.rados.rados.0.smithi137.stdout:2622: writing smithi13777483-6 from 1728512 to 2449408 tid 1 2024-03-04T06:50:30.854 INFO:tasks.rados.rados.0.smithi137.stdout:2622: writing smithi13777483-6 from 2449408 to 2949120 tid 2 2024-03-04T06:50:30.859 INFO:tasks.rados.rados.0.smithi137.stdout:2622: writing smithi13777483-6 from 2949120 to 3653632 tid 3 2024-03-04T06:50:30.859 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 241 2024-03-04T06:50:30.859 INFO:tasks.rados.rados.0.smithi137.stdout:2623: seq_num 832 ranges {3620864=737280,4358144=786432,5144576=417792} 2024-03-04T06:50:30.882 INFO:tasks.rados.rados.0.smithi137.stdout:2623: writing smithi13777483-9 from 3620864 to 4358144 tid 1 2024-03-04T06:50:30.887 INFO:tasks.rados.rados.0.smithi137.stdout:2623: writing smithi13777483-9 from 4358144 to 5144576 tid 2 2024-03-04T06:50:30.889 INFO:tasks.rados.rados.0.smithi137.stdout:2623: writing smithi13777483-9 from 5144576 to 5562368 tid 3 2024-03-04T06:50:30.890 INFO:tasks.rados.rados.0.smithi137.stdout:2624: setattr oid 32 current snap is 241 2024-03-04T06:50:30.890 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16864 (ObjNum 810 snap 235 seq_num 810) dirty exists 2024-03-04T06:50:30.890 INFO:tasks.rados.rados.0.smithi137.stdout:2619: finishing copy_from to smithi13777483-5 2024-03-04T06:50:30.890 INFO:tasks.rados.rados.0.smithi137.stdout:2619: got expected ENOENT (src dne) 2024-03-04T06:50:30.890 INFO:tasks.rados.rados.0.smithi137.stdout:2619: finishing copy_from racing read to smithi13777483-5 2024-03-04T06:50:30.890 INFO:tasks.rados.rados.0.smithi137.stdout:2622: finishing write tid 1 to smithi13777483-6 2024-03-04T06:50:30.890 INFO:tasks.rados.rados.0.smithi137.stdout:2618: expect (ObjNum 788 snap 231 seq_num 788) 2024-03-04T06:50:31.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:50:30.827+0000 7f4397ce1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T06:50:31.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:30.834+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:31.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:30.622+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:31.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:30.843+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:31.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:30.849+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:31.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:30.850+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:31.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:30.846+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:31.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:30.841+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:31.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:30.842+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:31.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:30.844+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:31.099 INFO:tasks.rados.rados.0.smithi137.stdout:2622: finishing write tid 2 to smithi13777483-6 2024-03-04T06:50:31.099 INFO:tasks.rados.rados.0.smithi137.stdout:2622: finishing write tid 3 to smithi13777483-6 2024-03-04T06:50:31.100 INFO:tasks.rados.rados.0.smithi137.stdout:2622: finishing write tid 4 to smithi13777483-6 2024-03-04T06:50:31.100 INFO:tasks.rados.rados.0.smithi137.stdout:2622: finishing write tid 5 to smithi13777483-6 2024-03-04T06:50:31.100 INFO:tasks.rados.rados.0.smithi137.stdout:2622: oid 6 updating version 0 to 16808 2024-03-04T06:50:31.100 INFO:tasks.rados.rados.0.smithi137.stdout:2622: oid 6 updating version 16808 to 16810 2024-03-04T06:50:31.100 INFO:tasks.rados.rados.0.smithi137.stdout:2622: oid 6 version 16810 is already newer than 16807 2024-03-04T06:50:31.100 INFO:tasks.rados.rados.0.smithi137.stdout:2622: oid 6 version 16810 is already newer than 16809 2024-03-04T06:50:31.100 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16810 (ObjNum 831 snap 241 seq_num 831) dirty exists 2024-03-04T06:50:31.100 INFO:tasks.rados.rados.0.smithi137.stdout:2622: left oid 6 (ObjNum 831 snap 241 seq_num 831) 2024-03-04T06:50:31.100 INFO:tasks.rados.rados.0.smithi137.stdout:2623: finishing write tid 1 to smithi13777483-9 2024-03-04T06:50:31.100 INFO:tasks.rados.rados.0.smithi137.stdout:2623: finishing write tid 2 to smithi13777483-9 2024-03-04T06:50:31.101 INFO:tasks.rados.rados.0.smithi137.stdout:2623: finishing write tid 3 to smithi13777483-9 2024-03-04T06:50:31.101 INFO:tasks.rados.rados.0.smithi137.stdout:2623: finishing write tid 4 to smithi13777483-9 2024-03-04T06:50:31.101 INFO:tasks.rados.rados.0.smithi137.stdout:2623: finishing write tid 5 to smithi13777483-9 2024-03-04T06:50:31.101 INFO:tasks.rados.rados.0.smithi137.stdout:2623: oid 9 updating version 0 to 15578 2024-03-04T06:50:31.101 INFO:tasks.rados.rados.0.smithi137.stdout:2623: oid 9 updating version 15578 to 15580 2024-03-04T06:50:31.101 INFO:tasks.rados.rados.0.smithi137.stdout:2623: oid 9 version 15580 is already newer than 15577 2024-03-04T06:50:31.101 INFO:tasks.rados.rados.0.smithi137.stdout:2623: oid 9 version 15580 is already newer than 15579 2024-03-04T06:50:31.101 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 15580 (ObjNum 832 snap 241 seq_num 832) dirty exists 2024-03-04T06:50:31.101 INFO:tasks.rados.rados.0.smithi137.stdout:2623: left oid 9 (ObjNum 832 snap 241 seq_num 832) 2024-03-04T06:50:31.101 INFO:tasks.rados.rados.0.smithi137.stdout:2618: done (6 left) 2024-03-04T06:50:31.101 INFO:tasks.rados.rados.0.smithi137.stdout:2619: done (5 left) 2024-03-04T06:50:31.101 INFO:tasks.rados.rados.0.smithi137.stdout:2620: done (4 left) 2024-03-04T06:50:31.102 INFO:tasks.rados.rados.0.smithi137.stdout:2621: done (3 left) 2024-03-04T06:50:31.102 INFO:tasks.rados.rados.0.smithi137.stdout:2622: done (2 left) 2024-03-04T06:50:31.102 INFO:tasks.rados.rados.0.smithi137.stdout:2623: done (1 left) 2024-03-04T06:50:31.102 INFO:tasks.rados.rados.0.smithi137.stdout:2625: snap_create 2024-03-04T06:50:31.102 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16863 (ObjNum 289 snap 0 seq_num 1) dirty exists 2024-03-04T06:50:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: osdmap e558: 8 total, 8 up, 8 in 2024-03-04T06:50:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: pgmap v515: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 374 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 9.4 MiB/s rd, 2.7 MiB/s wr, 25 op/s 2024-03-04T06:50:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-04T06:50:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T06:50:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: osdmap e559: 8 total, 8 up, 8 in 2024-03-04T06:50:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: Standby daemon mds.a assigned to filesystem cephfs as rank 0 2024-03-04T06:50:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-04T06:50:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-03-04T06:50:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: fsmap cephfs:1/1 {0=a=up:replay} 2024-03-04T06:50:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:31.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:31.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: osdmap e558: 8 total, 8 up, 8 in 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: pgmap v515: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 374 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 9.4 MiB/s rd, 2.7 MiB/s wr, 25 op/s 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: osdmap e559: 8 total, 8 up, 8 in 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: Standby daemon mds.a assigned to filesystem cephfs as rank 0 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:31.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: fsmap cephfs:1/1 {0=a=up:replay} 2024-03-04T06:50:31.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:31.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:31.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:31.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: osdmap e558: 8 total, 8 up, 8 in 2024-03-04T06:50:31.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:31.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:31.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: pgmap v515: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 374 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 9.4 MiB/s rd, 2.7 MiB/s wr, 25 op/s 2024-03-04T06:50:31.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:31.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-04T06:50:31.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T06:50:31.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:31.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:31.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:31.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: osdmap e559: 8 total, 8 up, 8 in 2024-03-04T06:50:31.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: Standby daemon mds.a assigned to filesystem cephfs as rank 0 2024-03-04T06:50:31.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-04T06:50:31.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-03-04T06:50:31.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:31.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: fsmap cephfs:1/1 {0=a=up:replay} 2024-03-04T06:50:31.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:31.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:31.844 INFO:tasks.rados.rados.0.smithi137.stdout:2624: done (1 left) 2024-03-04T06:50:31.844 INFO:tasks.rados.rados.0.smithi137.stdout:2625: done (0 left) 2024-03-04T06:50:31.844 INFO:tasks.rados.rados.0.smithi137.stdout:2626: read oid 18 snap -1 2024-03-04T06:50:31.844 INFO:tasks.rados.rados.0.smithi137.stdout:2626: expect (ObjNum 679 snap 192 seq_num 679) 2024-03-04T06:50:31.844 INFO:tasks.rados.rados.0.smithi137.stdout:2627: read oid 38 snap -1 2024-03-04T06:50:31.844 INFO:tasks.rados.rados.0.smithi137.stdout:2627: expect (ObjNum 817 snap 236 seq_num 817) 2024-03-04T06:50:31.844 INFO:tasks.rados.rados.0.smithi137.stdout:2628: read oid 42 snap -1 2024-03-04T06:50:31.844 INFO:tasks.rados.rados.0.smithi137.stdout:2628: expect deleted 2024-03-04T06:50:31.844 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 242 2024-03-04T06:50:31.845 INFO:tasks.rados.rados.0.smithi137.stdout:2629: seq_num 833 ranges {0=761856,761856=671744,1433600=532480} 2024-03-04T06:50:31.848 INFO:tasks.rados.rados.0.smithi137.stdout:2629: writing smithi13777483-49 from 0 to 761856 tid 1 2024-03-04T06:50:31.853 INFO:tasks.rados.rados.0.smithi137.stdout:2629: writing smithi13777483-49 from 761856 to 1433600 tid 2 2024-03-04T06:50:31.857 INFO:tasks.rados.rados.0.smithi137.stdout:2629: writing smithi13777483-49 from 1433600 to 1966080 tid 3 2024-03-04T06:50:31.857 INFO:tasks.rados.rados.0.smithi137.stdout:2630: read oid 32 snap -1 2024-03-04T06:50:31.857 INFO:tasks.rados.rados.0.smithi137.stdout:2630: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:50:31.857 INFO:tasks.rados.rados.0.smithi137.stdout:2631: rmattr oid 35 current snap is 242 2024-03-04T06:50:31.857 INFO:tasks.rados.rados.0.smithi137.stdout:2629: finishing write tid 1 to smithi13777483-49 2024-03-04T06:50:31.857 INFO:tasks.rados.rados.0.smithi137.stdout:2628: done (5 left) 2024-03-04T06:50:31.857 INFO:tasks.rados.rados.0.smithi137.stdout:2632: rmattr oid 5 current snap is 242 2024-03-04T06:50:31.857 INFO:tasks.rados.rados.0.smithi137.stdout:2632: done (5 left) 2024-03-04T06:50:31.857 INFO:tasks.rados.rados.0.smithi137.stdout:2633: read oid 34 snap 240 2024-03-04T06:50:31.857 INFO:tasks.rados.rados.0.smithi137.stdout:2633: expect deleted 2024-03-04T06:50:31.857 INFO:tasks.rados.rados.0.smithi137.stdout:2634: delete oid 19 current snap is 242 2024-03-04T06:50:31.858 INFO:tasks.rados.rados.0.smithi137.stdout:2630: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:50:31.862 INFO:tasks.rados.rados.0.smithi137.stdout:2629: finishing write tid 2 to smithi13777483-49 2024-03-04T06:50:31.863 INFO:tasks.rados.rados.0.smithi137.stdout:2630: done (6 left) 2024-03-04T06:50:31.864 INFO:tasks.rados.rados.0.smithi137.stdout:2633: done (5 left) 2024-03-04T06:50:31.864 INFO:tasks.rados.rados.0.smithi137.stdout:2634: done (4 left) 2024-03-04T06:50:31.864 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 28 current snap is 242 2024-03-04T06:50:31.864 INFO:tasks.rados.rados.0.smithi137.stdout:2635: seq_num 835 ranges {1523712=794624,2318336=442368,2760704=712704,3473408=49152} 2024-03-04T06:50:31.878 INFO:tasks.rados.rados.0.smithi137.stdout:2635: writing smithi13777483-28 from 1523712 to 2318336 tid 1 2024-03-04T06:50:31.881 INFO:tasks.rados.rados.0.smithi137.stdout:2635: writing smithi13777483-28 from 2318336 to 2760704 tid 2 2024-03-04T06:50:31.885 INFO:tasks.rados.rados.0.smithi137.stdout:2635: writing smithi13777483-28 from 2760704 to 3473408 tid 3 2024-03-04T06:50:31.886 INFO:tasks.rados.rados.0.smithi137.stdout:2635: writing smithi13777483-28 from 3473408 to 3522560 tid 4 2024-03-04T06:50:31.886 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 242 2024-03-04T06:50:31.886 INFO:tasks.rados.rados.0.smithi137.stdout:2629: finishing write tid 3 to smithi13777483-49 2024-03-04T06:50:31.886 INFO:tasks.rados.rados.0.smithi137.stdout:2629: finishing write tid 4 to smithi13777483-49 2024-03-04T06:50:31.886 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16869 (ObjNum 810 snap 235 seq_num 810) dirty exists 2024-03-04T06:50:31.887 INFO:tasks.rados.rados.0.smithi137.stdout:2629: finishing write tid 5 to smithi13777483-49 2024-03-04T06:50:31.887 INFO:tasks.rados.rados.0.smithi137.stdout:2629: oid 49 updating version 0 to 16866 2024-03-04T06:50:31.887 INFO:tasks.rados.rados.0.smithi137.stdout:2629: oid 49 updating version 16866 to 16867 2024-03-04T06:50:31.887 INFO:tasks.rados.rados.0.smithi137.stdout:2629: oid 49 version 16867 is already newer than 16865 2024-03-04T06:50:31.887 INFO:tasks.rados.rados.0.smithi137.stdout:2629: oid 49 updating version 16867 to 16868 2024-03-04T06:50:31.887 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16868 (ObjNum 833 snap 242 seq_num 833) dirty exists 2024-03-04T06:50:31.887 INFO:tasks.rados.rados.0.smithi137.stdout:2629: left oid 49 (ObjNum 833 snap 242 seq_num 833) 2024-03-04T06:50:31.887 INFO:tasks.rados.rados.0.smithi137.stdout:2627: expect (ObjNum 817 snap 236 seq_num 817) 2024-03-04T06:50:32.027 INFO:tasks.rados.rados.0.smithi137.stdout:2635: finishing write tid 1 to smithi13777483-28 2024-03-04T06:50:32.027 INFO:tasks.rados.rados.0.smithi137.stdout:2635: finishing write tid 2 to smithi13777483-28 2024-03-04T06:50:32.027 INFO:tasks.rados.rados.0.smithi137.stdout:2635: finishing write tid 3 to smithi13777483-28 2024-03-04T06:50:32.027 INFO:tasks.rados.rados.0.smithi137.stdout:2635: finishing write tid 4 to smithi13777483-28 2024-03-04T06:50:32.027 INFO:tasks.rados.rados.0.smithi137.stdout:2635: finishing write tid 5 to smithi13777483-28 2024-03-04T06:50:32.027 INFO:tasks.rados.rados.0.smithi137.stdout:2635: finishing write tid 6 to smithi13777483-28 2024-03-04T06:50:32.027 INFO:tasks.rados.rados.0.smithi137.stdout:2635: oid 28 updating version 0 to 16842 2024-03-04T06:50:32.027 INFO:tasks.rados.rados.0.smithi137.stdout:2635: oid 28 version 16842 is already newer than 16839 2024-03-04T06:50:32.027 INFO:tasks.rados.rados.0.smithi137.stdout:2635: oid 28 version 16842 is already newer than 16841 2024-03-04T06:50:32.027 INFO:tasks.rados.rados.0.smithi137.stdout:2635: oid 28 version 16842 is already newer than 16840 2024-03-04T06:50:32.028 INFO:tasks.rados.rados.0.smithi137.stdout:2635: oid 28 updating version 16842 to 16843 2024-03-04T06:50:32.028 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16843 (ObjNum 835 snap 242 seq_num 835) dirty exists 2024-03-04T06:50:32.028 INFO:tasks.rados.rados.0.smithi137.stdout:2635: left oid 28 (ObjNum 835 snap 242 seq_num 835) 2024-03-04T06:50:32.028 INFO:tasks.rados.rados.0.smithi137.stdout:2626: expect (ObjNum 679 snap 192 seq_num 679) 2024-03-04T06:50:32.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:31.861+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:32.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:31.842+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:32.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:31.842+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:32.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:31.847+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:32.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:31.847+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:32.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:31.847+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:32.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:31.854+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:32.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:31.854+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:32.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:31.852+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:32.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:31.861+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:32.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:31.861+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:32.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:31.862+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:32.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:31.842+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:32.363 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:32.363 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:32.363 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:32.363 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:32.363 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:32.363 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:32.363 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:32.363 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: osdmap e560: 8 total, 8 up, 8 in 2024-03-04T06:50:32.363 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:32.363 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: mds.? [v2:172.21.15.137:6834/2007899716,v1:172.21.15.137:6835/2007899716] up:reconnect 2024-03-04T06:50:32.363 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: fsmap cephfs:1/1 {0=a=up:reconnect} 2024-03-04T06:50:32.363 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:32.364 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:32.364 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:32.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:32.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:32.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:32.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:32.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:32.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:32.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:32.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: osdmap e560: 8 total, 8 up, 8 in 2024-03-04T06:50:32.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:32.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: mds.? [v2:172.21.15.137:6834/2007899716,v1:172.21.15.137:6835/2007899716] up:reconnect 2024-03-04T06:50:32.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: fsmap cephfs:1/1 {0=a=up:reconnect} 2024-03-04T06:50:32.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:32.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:32.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:32.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:32.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:32.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:32.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:32.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:32.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:32.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:32.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: osdmap e560: 8 total, 8 up, 8 in 2024-03-04T06:50:32.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:32.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: mds.? [v2:172.21.15.137:6834/2007899716,v1:172.21.15.137:6835/2007899716] up:reconnect 2024-03-04T06:50:32.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: fsmap cephfs:1/1 {0=a=up:reconnect} 2024-03-04T06:50:32.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:32.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:32.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:33.060 INFO:tasks.rados.rados.0.smithi137.stdout:2636: seq_num 836 ranges {5562368=409600,5971968=720896,6692864=516096,7208960=368640} 2024-03-04T06:50:33.092 INFO:tasks.rados.rados.0.smithi137.stdout:2636: writing smithi13777483-9 from 5562368 to 5971968 tid 1 2024-03-04T06:50:33.096 INFO:tasks.rados.rados.0.smithi137.stdout:2636: writing smithi13777483-9 from 5971968 to 6692864 tid 2 2024-03-04T06:50:33.099 INFO:tasks.rados.rados.0.smithi137.stdout:2636: writing smithi13777483-9 from 6692864 to 7208960 tid 3 2024-03-04T06:50:33.102 INFO:tasks.rados.rados.0.smithi137.stdout:2636: writing smithi13777483-9 from 7208960 to 7577600 tid 4 2024-03-04T06:50:33.102 INFO:tasks.rados.rados.0.smithi137.stdout:2626: done (5 left) 2024-03-04T06:50:33.103 INFO:tasks.rados.rados.0.smithi137.stdout:2627: done (4 left) 2024-03-04T06:50:33.103 INFO:tasks.rados.rados.0.smithi137.stdout:2629: done (3 left) 2024-03-04T06:50:33.103 INFO:tasks.rados.rados.0.smithi137.stdout:2631: done (2 left) 2024-03-04T06:50:33.103 INFO:tasks.rados.rados.0.smithi137.stdout:2635: done (1 left) 2024-03-04T06:50:33.103 INFO:tasks.rados.rados.0.smithi137.stdout:2637: read oid 33 snap 238 2024-03-04T06:50:33.103 INFO:tasks.rados.rados.0.smithi137.stdout:2637: expect (ObjNum 596 snap 170 seq_num 596) 2024-03-04T06:50:33.103 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 242 2024-03-04T06:50:33.103 INFO:tasks.rados.rados.0.smithi137.stdout:2636: finishing write tid 1 to smithi13777483-9 2024-03-04T06:50:33.103 INFO:tasks.rados.rados.0.smithi137.stdout:2636: finishing write tid 2 to smithi13777483-9 2024-03-04T06:50:33.103 INFO:tasks.rados.rados.0.smithi137.stdout:2636: finishing write tid 3 to smithi13777483-9 2024-03-04T06:50:33.103 INFO:tasks.rados.rados.0.smithi137.stdout:2638: seq_num 837 ranges {12140544=425984,12566528=655360,13221888=729088,13950976=221184} 2024-03-04T06:50:33.172 INFO:tasks.rados.rados.0.smithi137.stdout:2638: writing smithi13777483-18 from 12140544 to 12566528 tid 1 2024-03-04T06:50:33.176 INFO:tasks.rados.rados.0.smithi137.stdout:2638: writing smithi13777483-18 from 12566528 to 13221888 tid 2 2024-03-04T06:50:33.180 INFO:tasks.rados.rados.0.smithi137.stdout:2638: writing smithi13777483-18 from 13221888 to 13950976 tid 3 2024-03-04T06:50:33.182 INFO:tasks.rados.rados.0.smithi137.stdout:2638: writing smithi13777483-18 from 13950976 to 14172160 tid 4 2024-03-04T06:50:33.182 INFO:tasks.rados.rados.0.smithi137.stdout:2639: rollback oid 10 current snap is 242 2024-03-04T06:50:33.182 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 10 to 240 2024-03-04T06:50:33.182 INFO:tasks.rados.rados.0.smithi137.stdout:2636: finishing write tid 4 to smithi13777483-9 2024-03-04T06:50:33.182 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 242 2024-03-04T06:50:33.182 INFO:tasks.rados.rados.0.smithi137.stdout:2636: finishing write tid 5 to smithi13777483-9 2024-03-04T06:50:33.182 INFO:tasks.rados.rados.0.smithi137.stdout:2640: seq_num 838 ranges {1441792=442368,1884160=540672,2424832=532480,2957312=442368,3399680=90112} 2024-03-04T06:50:33.192 INFO:tasks.rados.rados.0.smithi137.stdout:2640: writing smithi13777483-44 from 1441792 to 1884160 tid 1 2024-03-04T06:50:33.195 INFO:tasks.rados.rados.0.smithi137.stdout:2640: writing smithi13777483-44 from 1884160 to 2424832 tid 2 2024-03-04T06:50:33.199 INFO:tasks.rados.rados.0.smithi137.stdout:2640: writing smithi13777483-44 from 2424832 to 2957312 tid 3 2024-03-04T06:50:33.202 INFO:tasks.rados.rados.0.smithi137.stdout:2640: writing smithi13777483-44 from 2957312 to 3399680 tid 4 2024-03-04T06:50:33.203 INFO:tasks.rados.rados.0.smithi137.stdout:2640: writing smithi13777483-44 from 3399680 to 3489792 tid 5 2024-03-04T06:50:33.203 INFO:tasks.rados.rados.0.smithi137.stdout:2641: delete oid 14 current snap is 242 2024-03-04T06:50:33.203 INFO:tasks.rados.rados.0.smithi137.stdout:2636: finishing write tid 6 to smithi13777483-9 2024-03-04T06:50:33.203 INFO:tasks.rados.rados.0.smithi137.stdout:2636: oid 9 updating version 0 to 15585 2024-03-04T06:50:33.203 INFO:tasks.rados.rados.0.smithi137.stdout:2636: oid 9 version 15585 is already newer than 15582 2024-03-04T06:50:33.203 INFO:tasks.rados.rados.0.smithi137.stdout:2636: oid 9 version 15585 is already newer than 15583 2024-03-04T06:50:33.204 INFO:tasks.rados.rados.0.smithi137.stdout:2636: oid 9 version 15585 is already newer than 15584 2024-03-04T06:50:33.204 INFO:tasks.rados.rados.0.smithi137.stdout:2636: oid 9 updating version 15585 to 15586 2024-03-04T06:50:33.204 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 15586 (ObjNum 836 snap 242 seq_num 836) dirty exists 2024-03-04T06:50:33.204 INFO:tasks.rados.rados.0.smithi137.stdout:2636: left oid 9 (ObjNum 836 snap 242 seq_num 836) 2024-03-04T06:50:33.204 INFO:tasks.rados.rados.0.smithi137.stdout:2637: expect (ObjNum 596 snap 170 seq_num 596) 2024-03-04T06:50:33.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:33.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:33.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:33.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:33.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:33 smithi203 ceph-mon[85573]: pgmap v518: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 374 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 224 KiB/s wr, 1 op/s 2024-03-04T06:50:33.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:33 smithi203 ceph-mon[85573]: mds.? [v2:172.21.15.137:6834/2007899716,v1:172.21.15.137:6835/2007899716] up:rejoin 2024-03-04T06:50:33.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:33 smithi203 ceph-mon[85573]: fsmap cephfs:1/1 {0=a=up:rejoin} 2024-03-04T06:50:33.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:33 smithi203 ceph-mon[85573]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-03-04T06:50:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[88869]: pgmap v518: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 374 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 224 KiB/s wr, 1 op/s 2024-03-04T06:50:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[88869]: mds.? [v2:172.21.15.137:6834/2007899716,v1:172.21.15.137:6835/2007899716] up:rejoin 2024-03-04T06:50:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[88869]: fsmap cephfs:1/1 {0=a=up:rejoin} 2024-03-04T06:50:33.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[88869]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-03-04T06:50:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[91314]: pgmap v518: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 374 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 224 KiB/s wr, 1 op/s 2024-03-04T06:50:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[91314]: mds.? [v2:172.21.15.137:6834/2007899716,v1:172.21.15.137:6835/2007899716] up:rejoin 2024-03-04T06:50:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[91314]: fsmap cephfs:1/1 {0=a=up:rejoin} 2024-03-04T06:50:33.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:33 smithi137 ceph-mon[91314]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-03-04T06:50:34.011 INFO:tasks.rados.rados.0.smithi137.stdout:2638: finishing write tid 1 to smithi13777483-18 2024-03-04T06:50:34.012 INFO:tasks.rados.rados.0.smithi137.stdout:2638: finishing write tid 2 to smithi13777483-18 2024-03-04T06:50:34.012 INFO:tasks.rados.rados.0.smithi137.stdout:2638: finishing write tid 3 to smithi13777483-18 2024-03-04T06:50:34.012 INFO:tasks.rados.rados.0.smithi137.stdout:2638: finishing write tid 4 to smithi13777483-18 2024-03-04T06:50:34.012 INFO:tasks.rados.rados.0.smithi137.stdout:2638: finishing write tid 5 to smithi13777483-18 2024-03-04T06:50:34.012 INFO:tasks.rados.rados.0.smithi137.stdout:2638: finishing write tid 6 to smithi13777483-18 2024-03-04T06:50:34.012 INFO:tasks.rados.rados.0.smithi137.stdout:2638: oid 18 updating version 0 to 16834 2024-03-04T06:50:34.012 INFO:tasks.rados.rados.0.smithi137.stdout:2638: oid 18 updating version 16834 to 16836 2024-03-04T06:50:34.012 INFO:tasks.rados.rados.0.smithi137.stdout:2638: oid 18 updating version 16836 to 16837 2024-03-04T06:50:34.012 INFO:tasks.rados.rados.0.smithi137.stdout:2638: oid 18 version 16837 is already newer than 16833 2024-03-04T06:50:34.012 INFO:tasks.rados.rados.0.smithi137.stdout:2638: oid 18 version 16837 is already newer than 16835 2024-03-04T06:50:34.012 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16837 (ObjNum 837 snap 242 seq_num 837) dirty exists 2024-03-04T06:50:34.013 INFO:tasks.rados.rados.0.smithi137.stdout:2638: left oid 18 (ObjNum 837 snap 242 seq_num 837) 2024-03-04T06:50:34.013 INFO:tasks.rados.rados.0.smithi137.stdout:2639: finishing rollback tid 0 to smithi13777483-10 2024-03-04T06:50:34.013 INFO:tasks.rados.rados.0.smithi137.stdout:2639: finishing rollback tid 1 to smithi13777483-10 2024-03-04T06:50:34.013 INFO:tasks.rados.rados.0.smithi137.stdout:2639: finishing rollback tid 2 to smithi13777483-10 2024-03-04T06:50:34.013 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15589 (ObjNum 65 snap 0 seq_num 1683317079) dirty exists 2024-03-04T06:50:34.013 INFO:tasks.rados.rados.0.smithi137.stdout:2640: finishing write tid 1 to smithi13777483-44 2024-03-04T06:50:34.013 INFO:tasks.rados.rados.0.smithi137.stdout:2640: finishing write tid 2 to smithi13777483-44 2024-03-04T06:50:34.013 INFO:tasks.rados.rados.0.smithi137.stdout:2640: finishing write tid 3 to smithi13777483-44 2024-03-04T06:50:34.013 INFO:tasks.rados.rados.0.smithi137.stdout:2636: done (5 left) 2024-03-04T06:50:34.013 INFO:tasks.rados.rados.0.smithi137.stdout:2637: done (4 left) 2024-03-04T06:50:34.013 INFO:tasks.rados.rados.0.smithi137.stdout:2638: done (3 left) 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:2639: done (2 left) 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:2641: done (1 left) 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:2642: setattr oid 30 current snap is 242 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:2640: finishing write tid 4 to smithi13777483-44 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:2640: finishing write tid 5 to smithi13777483-44 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:2640: finishing write tid 6 to smithi13777483-44 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:2640: finishing write tid 7 to smithi13777483-44 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:2640: oid 44 updating version 0 to 16832 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:2640: oid 44 version 16832 is already newer than 16828 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:2640: oid 44 version 16832 is already newer than 16831 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:2640: oid 44 version 16832 is already newer than 16830 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:2640: oid 44 version 16832 is already newer than 16829 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:2640: oid 44 version 16832 is already newer than 16827 2024-03-04T06:50:34.014 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16832 (ObjNum 838 snap 242 seq_num 838) dirty exists 2024-03-04T06:50:34.015 INFO:tasks.rados.rados.0.smithi137.stdout:2640: left oid 44 (ObjNum 838 snap 242 seq_num 838) 2024-03-04T06:50:34.015 INFO:tasks.rados.rados.0.smithi137.stdout:2640: done (1 left) 2024-03-04T06:50:34.015 INFO:tasks.rados.rados.0.smithi137.stdout:2643: read oid 22 snap -1 2024-03-04T06:50:34.015 INFO:tasks.rados.rados.0.smithi137.stdout:2643: expect (ObjNum 826 snap 238 seq_num 826) 2024-03-04T06:50:34.015 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 33 current snap is 242 2024-03-04T06:50:34.015 INFO:tasks.rados.rados.0.smithi137.stdout:2644: seq_num 840 ranges {9076736=475136,9551872=712704,10264576=499712,10764288=393216} 2024-03-04T06:50:34.064 INFO:tasks.rados.rados.0.smithi137.stdout:2644: writing smithi13777483-33 from 9076736 to 9551872 tid 1 2024-03-04T06:50:34.068 INFO:tasks.rados.rados.0.smithi137.stdout:2644: writing smithi13777483-33 from 9551872 to 10264576 tid 2 2024-03-04T06:50:34.070 INFO:tasks.rados.rados.0.smithi137.stdout:2644: writing smithi13777483-33 from 10264576 to 10764288 tid 3 2024-03-04T06:50:34.073 INFO:tasks.rados.rados.0.smithi137.stdout:2644: writing smithi13777483-33 from 10764288 to 11157504 tid 4 2024-03-04T06:50:34.073 INFO:tasks.rados.rados.0.smithi137.stdout:2645: snap_create 2024-03-04T06:50:34.073 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16784 (ObjNum 639 snap 178 seq_num 639) dirty exists 2024-03-04T06:50:34.073 INFO:tasks.rados.rados.0.smithi137.stdout:2643: expect (ObjNum 826 snap 238 seq_num 826) 2024-03-04T06:50:34.121 INFO:tasks.rados.rados.0.smithi137.stdout:2644: finishing write tid 1 to smithi13777483-33 2024-03-04T06:50:34.121 INFO:tasks.rados.rados.0.smithi137.stdout:2644: finishing write tid 2 to smithi13777483-33 2024-03-04T06:50:34.121 INFO:tasks.rados.rados.0.smithi137.stdout:2644: finishing write tid 3 to smithi13777483-33 2024-03-04T06:50:34.122 INFO:tasks.rados.rados.0.smithi137.stdout:2644: finishing write tid 4 to smithi13777483-33 2024-03-04T06:50:34.122 INFO:tasks.rados.rados.0.smithi137.stdout:2644: finishing write tid 5 to smithi13777483-33 2024-03-04T06:50:34.122 INFO:tasks.rados.rados.0.smithi137.stdout:2644: finishing write tid 6 to smithi13777483-33 2024-03-04T06:50:34.122 INFO:tasks.rados.rados.0.smithi137.stdout:2644: oid 33 updating version 0 to 16871 2024-03-04T06:50:34.122 INFO:tasks.rados.rados.0.smithi137.stdout:2644: oid 33 updating version 16871 to 16874 2024-03-04T06:50:34.122 INFO:tasks.rados.rados.0.smithi137.stdout:2644: oid 33 version 16874 is already newer than 16872 2024-03-04T06:50:34.122 INFO:tasks.rados.rados.0.smithi137.stdout:2644: oid 33 version 16874 is already newer than 16870 2024-03-04T06:50:34.122 INFO:tasks.rados.rados.0.smithi137.stdout:2644: oid 33 version 16874 is already newer than 16873 2024-03-04T06:50:34.122 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16874 (ObjNum 840 snap 242 seq_num 840) dirty exists 2024-03-04T06:50:34.122 INFO:tasks.rados.rados.0.smithi137.stdout:2644: left oid 33 (ObjNum 840 snap 242 seq_num 840) 2024-03-04T06:50:34.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:34 smithi203 ceph-mon[85573]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-04T06:50:34.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:34 smithi203 ceph-mon[85573]: mds.? [v2:172.21.15.137:6834/2007899716,v1:172.21.15.137:6835/2007899716] up:active 2024-03-04T06:50:34.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:34 smithi203 ceph-mon[85573]: fsmap cephfs:1 {0=a=up:active} 2024-03-04T06:50:34.793 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 06:50:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a[116984]: 2024-03-04T06:50:34.480+0000 7fd0f0d33700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-04T06:50:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:34 smithi137 ceph-mon[88869]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-04T06:50:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:34 smithi137 ceph-mon[88869]: mds.? [v2:172.21.15.137:6834/2007899716,v1:172.21.15.137:6835/2007899716] up:active 2024-03-04T06:50:34.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:34 smithi137 ceph-mon[88869]: fsmap cephfs:1 {0=a=up:active} 2024-03-04T06:50:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:34 smithi137 ceph-mon[91314]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-04T06:50:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:34 smithi137 ceph-mon[91314]: mds.? [v2:172.21.15.137:6834/2007899716,v1:172.21.15.137:6835/2007899716] up:active 2024-03-04T06:50:34.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:34 smithi137 ceph-mon[91314]: fsmap cephfs:1 {0=a=up:active} 2024-03-04T06:50:34.852 INFO:tasks.rados.rados.0.smithi137.stdout:2642: done (3 left) 2024-03-04T06:50:34.852 INFO:tasks.rados.rados.0.smithi137.stdout:2643: done (2 left) 2024-03-04T06:50:34.852 INFO:tasks.rados.rados.0.smithi137.stdout:2644: done (1 left) 2024-03-04T06:50:34.853 INFO:tasks.rados.rados.0.smithi137.stdout:2645: done (0 left) 2024-03-04T06:50:34.853 INFO:tasks.rados.rados.0.smithi137.stdout:2646: snap_create 2024-03-04T06:50:35.150 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:34.850+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:35.151 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:34.850+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:35.151 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:34.850+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:35.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:34.852+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:35.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:34.852+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:35.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:35.312+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:35 smithi203 ceph-mon[85573]: pgmap v519: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 388 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 18 MiB/s rd, 2.9 MiB/s wr, 19 op/s 2024-03-04T06:50:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:35 smithi203 ceph-mon[85573]: osdmap e561: 8 total, 8 up, 8 in 2024-03-04T06:50:35.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:35.149+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:35.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:35.311+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:35.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:35.312+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:35.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:50:35] "GET /metrics HTTP/1.1" 200 36331 "" "Prometheus/2.43.0" 2024-03-04T06:50:35.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-mon[91314]: pgmap v519: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 388 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 18 MiB/s rd, 2.9 MiB/s wr, 19 op/s 2024-03-04T06:50:35.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:35.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:35.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-mon[91314]: osdmap e561: 8 total, 8 up, 8 in 2024-03-04T06:50:35.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-mon[88869]: pgmap v519: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 388 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 18 MiB/s rd, 2.9 MiB/s wr, 19 op/s 2024-03-04T06:50:35.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:35.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:35.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-mon[88869]: osdmap e561: 8 total, 8 up, 8 in 2024-03-04T06:50:35.794 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:35.312+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:35.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:35.312+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:35.854 INFO:tasks.rados.rados.0.smithi137.stdout:2646: done (0 left) 2024-03-04T06:50:35.854 INFO:tasks.rados.rados.0.smithi137.stdout:2647: delete oid 14 current snap is 244 2024-03-04T06:50:35.859 INFO:tasks.rados.rados.0.smithi137.stdout:2647: done (0 left) 2024-03-04T06:50:35.859 INFO:tasks.rados.rados.0.smithi137.stdout:2648: snap_create 2024-03-04T06:50:36.252 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:35.858+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:36.252 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:35.854+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:36.252 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:35.854+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:36.253 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:35.860+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:36.253 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:35.860+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:36.253 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:35.853+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:36.253 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:35.853+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:36.253 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:35.854+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:36.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:36.251+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:36.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:36.252+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:36.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:36.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:36.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[91314]: osdmap e562: 8 total, 8 up, 8 in 2024-03-04T06:50:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:36.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:36.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:36.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:36.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:36.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[88869]: osdmap e562: 8 total, 8 up, 8 in 2024-03-04T06:50:36.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:36.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:36.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:36.250+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:36.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:36.250+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:36.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:36.250+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:36.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-mon[85573]: osdmap e562: 8 total, 8 up, 8 in 2024-03-04T06:50:36.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:36.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:36.856 INFO:tasks.rados.rados.0.smithi137.stdout:2648: done (0 left) 2024-03-04T06:50:36.856 INFO:tasks.rados.rados.0.smithi137.stdout:2649: copy_from oid 50 from oid 8 current snap is 245 2024-03-04T06:50:36.856 INFO:tasks.rados.rados.0.smithi137.stdout:2650: copy_from oid 29 from oid 43 current snap is 245 2024-03-04T06:50:36.856 INFO:tasks.rados.rados.0.smithi137.stdout:2651: read oid 40 snap -1 2024-03-04T06:50:36.856 INFO:tasks.rados.rados.0.smithi137.stdout:2651: expect deleted 2024-03-04T06:50:36.856 INFO:tasks.rados.rados.0.smithi137.stdout:2652: read oid 20 snap -1 2024-03-04T06:50:36.857 INFO:tasks.rados.rados.0.smithi137.stdout:2652: expect (ObjNum 568 snap 159 seq_num 568) 2024-03-04T06:50:36.857 INFO:tasks.rados.rados.0.smithi137.stdout:2653: read oid 26 snap -1 2024-03-04T06:50:36.857 INFO:tasks.rados.rados.0.smithi137.stdout:2653: expect (ObjNum 829 snap 238 seq_num 829) 2024-03-04T06:50:36.857 INFO:tasks.rados.rados.0.smithi137.stdout:2654: snap_create 2024-03-04T06:50:36.859 INFO:tasks.rados.rados.0.smithi137.stdout:2649: finishing copy_from to smithi13777483-50 2024-03-04T06:50:36.859 INFO:tasks.rados.rados.0.smithi137.stdout:2649: got expected ENOENT (src dne) 2024-03-04T06:50:36.859 INFO:tasks.rados.rados.0.smithi137.stdout:2649: finishing copy_from racing read to smithi13777483-50 2024-03-04T06:50:36.884 INFO:tasks.rados.rados.0.smithi137.stdout:2650: finishing copy_from racing read to smithi13777483-29 2024-03-04T06:50:36.899 INFO:tasks.rados.rados.0.smithi137.stdout:2653: expect (ObjNum 829 snap 238 seq_num 829) 2024-03-04T06:50:37.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:37.078+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:37.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:36.859+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:37.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:36.855+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:37.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:36.855+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:37.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:37.078+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:37.330 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:36.864+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:37.330 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:36.859+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:37.330 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:36.859+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:37.330 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:36.856+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:37.330 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:36.856+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:37.330 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:36.856+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:37.342 INFO:tasks.rados.rados.0.smithi137.stdout:2650: finishing copy_from to smithi13777483-29 2024-03-04T06:50:37.342 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16808 (ObjNum 822 snap 236 seq_num 822) dirty exists 2024-03-04T06:50:37.342 INFO:tasks.rados.rados.0.smithi137.stdout:2652: expect (ObjNum 568 snap 159 seq_num 568) 2024-03-04T06:50:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:37.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: pgmap v522: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 391 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 MiB/s rd, 3.2 MiB/s wr, 22 op/s 2024-03-04T06:50:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: osdmap e563: 8 total, 8 up, 8 in 2024-03-04T06:50:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: pgmap v522: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 391 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 MiB/s rd, 3.2 MiB/s wr, 22 op/s 2024-03-04T06:50:37.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: osdmap e563: 8 total, 8 up, 8 in 2024-03-04T06:50:37.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:37.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:37.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:37.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:37.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: pgmap v522: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 391 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 MiB/s rd, 3.2 MiB/s wr, 22 op/s 2024-03-04T06:50:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: osdmap e563: 8 total, 8 up, 8 in 2024-03-04T06:50:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:37.856 INFO:tasks.rados.rados.0.smithi137.stdout:2649: done (5 left) 2024-03-04T06:50:37.856 INFO:tasks.rados.rados.0.smithi137.stdout:2650: done (4 left) 2024-03-04T06:50:37.856 INFO:tasks.rados.rados.0.smithi137.stdout:2651: done (3 left) 2024-03-04T06:50:37.857 INFO:tasks.rados.rados.0.smithi137.stdout:2652: done (2 left) 2024-03-04T06:50:37.857 INFO:tasks.rados.rados.0.smithi137.stdout:2653: done (1 left) 2024-03-04T06:50:37.857 INFO:tasks.rados.rados.0.smithi137.stdout:2654: done (0 left) 2024-03-04T06:50:37.857 INFO:tasks.rados.rados.0.smithi137.stdout:2655: rmattr oid 44 current snap is 246 2024-03-04T06:50:37.857 INFO:tasks.rados.rados.0.smithi137.stdout:2655: done (0 left) 2024-03-04T06:50:37.857 INFO:tasks.rados.rados.0.smithi137.stdout:2656: snap_remove snap 242 2024-03-04T06:50:38.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:37.909+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:38.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:37.856+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:38.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:37.908+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:38.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:37.908+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:38.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:37.908+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:38.331 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:37.855+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:38.331 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:37.909+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:38.331 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:37.909+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:38.331 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:37.909+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:38.332 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:37.909+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:38.332 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:37.909+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:38.332 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:37.909+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:38.332 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:37.909+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:38.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-mon[85573]: osdmap e564: 8 total, 8 up, 8 in 2024-03-04T06:50:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:38.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:38.816 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:38.816 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:38.816 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:38.816 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:38.816 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[88869]: osdmap e564: 8 total, 8 up, 8 in 2024-03-04T06:50:38.816 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:38.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:38.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:38.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:38.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:38.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:38.817 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:38.817 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:38.817 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:38.817 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:38.817 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:38.817 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[91314]: osdmap e564: 8 total, 8 up, 8 in 2024-03-04T06:50:38.817 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:38.818 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:38.818 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:38.818 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:38.818 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:38.818 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:38.859 INFO:tasks.rados.rados.0.smithi137.stdout:2656: done (0 left) 2024-03-04T06:50:38.859 INFO:tasks.rados.rados.0.smithi137.stdout:2657: read oid 10 snap -1 2024-03-04T06:50:38.860 INFO:tasks.rados.rados.0.smithi137.stdout:2657: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:50:38.860 INFO:tasks.rados.rados.0.smithi137.stdout:2658: rmattr oid 46 current snap is 246 2024-03-04T06:50:38.860 INFO:tasks.rados.rados.0.smithi137.stdout:2659: copy_from oid 13 from oid 28 current snap is 246 2024-03-04T06:50:38.860 INFO:tasks.rados.rados.0.smithi137.stdout:2660: delete oid 35 current snap is 246 2024-03-04T06:50:38.861 INFO:tasks.rados.rados.0.smithi137.stdout:2657: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:50:38.865 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 16864 (ObjNum 810 snap 235 seq_num 810) dirty exists 2024-03-04T06:50:38.868 INFO:tasks.rados.rados.0.smithi137.stdout:2657: done (3 left) 2024-03-04T06:50:38.868 INFO:tasks.rados.rados.0.smithi137.stdout:2658: done (2 left) 2024-03-04T06:50:38.868 INFO:tasks.rados.rados.0.smithi137.stdout:2660: done (1 left) 2024-03-04T06:50:38.868 INFO:tasks.rados.rados.0.smithi137.stdout:2661: read oid 32 snap -1 2024-03-04T06:50:38.868 INFO:tasks.rados.rados.0.smithi137.stdout:2661: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:50:38.868 INFO:tasks.rados.rados.0.smithi137.stdout:2662: delete oid 24 current snap is 246 2024-03-04T06:50:38.869 INFO:tasks.rados.rados.0.smithi137.stdout:2661: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:50:38.876 INFO:tasks.rados.rados.0.smithi137.stdout:2661: done (2 left) 2024-03-04T06:50:38.876 INFO:tasks.rados.rados.0.smithi137.stdout:2662: done (1 left) 2024-03-04T06:50:38.876 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 246 2024-03-04T06:50:38.876 INFO:tasks.rados.rados.0.smithi137.stdout:2663: seq_num 844 ranges {1966080=540672,2506752=696320,3203072=475136,3678208=434176} 2024-03-04T06:50:38.890 INFO:tasks.rados.rados.0.smithi137.stdout:2663: writing smithi13777483-49 from 1966080 to 2506752 tid 1 2024-03-04T06:50:38.894 INFO:tasks.rados.rados.0.smithi137.stdout:2663: writing smithi13777483-49 from 2506752 to 3203072 tid 2 2024-03-04T06:50:38.897 INFO:tasks.rados.rados.0.smithi137.stdout:2663: writing smithi13777483-49 from 3203072 to 3678208 tid 3 2024-03-04T06:50:38.899 INFO:tasks.rados.rados.0.smithi137.stdout:2663: writing smithi13777483-49 from 3678208 to 4112384 tid 4 2024-03-04T06:50:38.900 INFO:tasks.rados.rados.0.smithi137.stdout:2664: rollback oid 43 current snap is 246 2024-03-04T06:50:38.900 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 43 to 244 2024-03-04T06:50:38.900 INFO:tasks.rados.rados.0.smithi137.stdout:2659: finishing copy_from racing read to smithi13777483-13 2024-03-04T06:50:38.900 INFO:tasks.rados.rados.0.smithi137.stdout:2659: finishing copy_from to smithi13777483-13 2024-03-04T06:50:38.900 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16843 (ObjNum 835 snap 242 seq_num 835) dirty exists 2024-03-04T06:50:38.900 INFO:tasks.rados.rados.0.smithi137.stdout:2663: finishing write tid 1 to smithi13777483-49 2024-03-04T06:50:38.900 INFO:tasks.rados.rados.0.smithi137.stdout:2663: finishing write tid 2 to smithi13777483-49 2024-03-04T06:50:38.900 INFO:tasks.rados.rados.0.smithi137.stdout:2659: done (2 left) 2024-03-04T06:50:38.900 INFO:tasks.rados.rados.0.smithi137.stdout:2665: delete oid 46 current snap is 246 2024-03-04T06:50:38.901 INFO:tasks.rados.rados.0.smithi137.stdout:2663: finishing write tid 3 to smithi13777483-49 2024-03-04T06:50:38.902 INFO:tasks.rados.rados.0.smithi137.stdout:2665: done (2 left) 2024-03-04T06:50:38.902 INFO:tasks.rados.rados.0.smithi137.stdout:2666: read oid 13 snap -1 2024-03-04T06:50:38.902 INFO:tasks.rados.rados.0.smithi137.stdout:2666: expect (ObjNum 835 snap 242 seq_num 835) 2024-03-04T06:50:38.902 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 246 2024-03-04T06:50:38.902 INFO:tasks.rados.rados.0.smithi137.stdout:2667: seq_num 846 ranges {3981312=573440,4554752=466944,5021696=491520,5513216=548864,6062080=98304} 2024-03-04T06:50:38.927 INFO:tasks.rados.rados.0.smithi137.stdout:2667: writing smithi13777483-38 from 3981312 to 4554752 tid 1 2024-03-04T06:50:38.930 INFO:tasks.rados.rados.0.smithi137.stdout:2667: writing smithi13777483-38 from 4554752 to 5021696 tid 2 2024-03-04T06:50:38.932 INFO:tasks.rados.rados.0.smithi137.stdout:2667: writing smithi13777483-38 from 5021696 to 5513216 tid 3 2024-03-04T06:50:38.936 INFO:tasks.rados.rados.0.smithi137.stdout:2667: writing smithi13777483-38 from 5513216 to 6062080 tid 4 2024-03-04T06:50:38.937 INFO:tasks.rados.rados.0.smithi137.stdout:2667: writing smithi13777483-38 from 6062080 to 6160384 tid 5 2024-03-04T06:50:38.937 INFO:tasks.rados.rados.0.smithi137.stdout:2668: read oid 26 snap -1 2024-03-04T06:50:38.937 INFO:tasks.rados.rados.0.smithi137.stdout:2668: expect (ObjNum 829 snap 238 seq_num 829) 2024-03-04T06:50:38.937 INFO:tasks.rados.rados.0.smithi137.stdout:2669: read oid 15 snap -1 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2669: expect deleted 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2670: read oid 8 snap -1 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2670: expect deleted 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2671: snap_create 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2663: finishing write tid 4 to smithi13777483-49 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2664: finishing rollback tid 0 to smithi13777483-43 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2664: finishing rollback tid 1 to smithi13777483-43 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2664: finishing rollback tid 2 to smithi13777483-43 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16860 (ObjNum 822 snap 236 seq_num 822) dirty exists 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2663: finishing write tid 5 to smithi13777483-49 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2663: finishing write tid 6 to smithi13777483-49 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2663: oid 49 updating version 0 to 16880 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2663: oid 49 version 16880 is already newer than 16877 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2663: oid 49 version 16880 is already newer than 16876 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2663: oid 49 version 16880 is already newer than 16878 2024-03-04T06:50:38.938 INFO:tasks.rados.rados.0.smithi137.stdout:2663: oid 49 version 16880 is already newer than 16879 2024-03-04T06:50:38.939 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16880 (ObjNum 844 snap 246 seq_num 844) dirty exists 2024-03-04T06:50:38.939 INFO:tasks.rados.rados.0.smithi137.stdout:2663: left oid 49 (ObjNum 844 snap 246 seq_num 844) 2024-03-04T06:50:38.939 INFO:tasks.rados.rados.0.smithi137.stdout:2666: expect (ObjNum 835 snap 242 seq_num 835) 2024-03-04T06:50:39.054 INFO:tasks.rados.rados.0.smithi137.stdout:2667: finishing write tid 1 to smithi13777483-38 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2667: finishing write tid 2 to smithi13777483-38 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2667: finishing write tid 3 to smithi13777483-38 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2667: finishing write tid 4 to smithi13777483-38 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2667: finishing write tid 5 to smithi13777483-38 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2667: finishing write tid 6 to smithi13777483-38 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2667: finishing write tid 7 to smithi13777483-38 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2667: oid 38 updating version 0 to 16844 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2667: oid 38 updating version 16844 to 16845 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2667: oid 38 updating version 16845 to 16849 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2667: oid 38 version 16849 is already newer than 16847 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2667: oid 38 version 16849 is already newer than 16846 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2667: oid 38 version 16849 is already newer than 16848 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16849 (ObjNum 846 snap 246 seq_num 846) dirty exists 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2667: left oid 38 (ObjNum 846 snap 246 seq_num 846) 2024-03-04T06:50:39.055 INFO:tasks.rados.rados.0.smithi137.stdout:2668: expect (ObjNum 829 snap 238 seq_num 829) 2024-03-04T06:50:39.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:38.859+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:39.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:38.903+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:39.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:38.873+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:39.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:38.873+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:39.336 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:39 smithi203 podman[109263]: 2024-03-04 06:50:39.066542296 +0000 UTC m=+8.334880237 container died 3c8bab6bae3034d421b240579d0e00a3517ecf4bb673c06eec0a111e9a1c2b4b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=reef-5cc7a76, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T06:50:39.336 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:38.861+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:39.336 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:38.866+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:39.337 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:38.857+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:39.337 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:38.857+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:39.337 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:38.857+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:39.337 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:38.864+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:39.337 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:38.867+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:39.588 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:39 smithi203 podman[109263]: 2024-03-04 06:50:39.586280605 +0000 UTC m=+8.854618541 container cleanup 3c8bab6bae3034d421b240579d0e00a3517ecf4bb673c06eec0a111e9a1c2b4b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=reef-5cc7a76, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T06:50:39.588 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:39 smithi203 bash[109263]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b 2024-03-04T06:50:39.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:39.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:39.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:39.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:39.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-mon[85573]: pgmap v525: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 396 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 19 MiB/s rd, 2.2 MiB/s wr, 34 op/s 2024-03-04T06:50:39.589 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:50:39.589 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:39.589 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:39.589 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-mon[85573]: osdmap e565: 8 total, 8 up, 8 in 2024-03-04T06:50:39.589 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:39.589 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:39.589 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:39.589 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:39.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:39.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:39.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:39.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:39.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[88869]: pgmap v525: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 396 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 19 MiB/s rd, 2.2 MiB/s wr, 34 op/s 2024-03-04T06:50:39.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:50:39.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:39.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:39.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[88869]: osdmap e565: 8 total, 8 up, 8 in 2024-03-04T06:50:39.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:39.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[91314]: pgmap v525: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 396 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 19 MiB/s rd, 2.2 MiB/s wr, 34 op/s 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[91314]: osdmap e565: 8 total, 8 up, 8 in 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:39.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:39.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:39.865 INFO:tasks.rados.rados.0.smithi137.stdout:2663: done (7 left) 2024-03-04T06:50:39.865 INFO:tasks.rados.rados.0.smithi137.stdout:2664: done (6 left) 2024-03-04T06:50:39.865 INFO:tasks.rados.rados.0.smithi137.stdout:2666: done (5 left) 2024-03-04T06:50:39.865 INFO:tasks.rados.rados.0.smithi137.stdout:2667: done (4 left) 2024-03-04T06:50:39.865 INFO:tasks.rados.rados.0.smithi137.stdout:2668: done (3 left) 2024-03-04T06:50:39.865 INFO:tasks.rados.rados.0.smithi137.stdout:2669: done (2 left) 2024-03-04T06:50:39.866 INFO:tasks.rados.rados.0.smithi137.stdout:2670: done (1 left) 2024-03-04T06:50:39.866 INFO:tasks.rados.rados.0.smithi137.stdout:2671: done (0 left) 2024-03-04T06:50:39.866 INFO:tasks.rados.rados.0.smithi137.stdout:2672: read oid 32 snap -1 2024-03-04T06:50:39.866 INFO:tasks.rados.rados.0.smithi137.stdout:2672: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:50:39.866 INFO:tasks.rados.rados.0.smithi137.stdout:2673: snap_create 2024-03-04T06:50:39.866 INFO:tasks.rados.rados.0.smithi137.stdout:2672: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:50:40.030 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:39.980+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:40.031 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:39.858+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:40.031 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:39.858+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:40.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:39.978+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:40.031 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:39.978+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:40.031 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:39.980+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:40.032 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:39.980+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:40.032 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:39.980+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:40.032 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:39 smithi203 podman[109289]: 2024-03-04 06:50:39.779277619 +0000 UTC m=+0.712868438 container remove 3c8bab6bae3034d421b240579d0e00a3517ecf4bb673c06eec0a111e9a1c2b4b (image=quay.ceph.io/ceph-ci/ceph@sha256:6e5717880e25b9bad45777125af2d2edf0612e4985175793a7e8de6fe8ceefbc, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=reef-5cc7a76, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-03-04T06:50:40.032 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:40 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mds.b.service: Deactivated successfully. 2024-03-04T06:50:40.032 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:40 smithi203 systemd[1]: Stopped Ceph mds.b for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:50:40.032 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:40 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mds.b.service: Consumed 1.645s CPU time. 2024-03-04T06:50:40.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:39.979+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:40.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:39.979+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:40.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:39.864+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:40.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:39.864+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:40.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:39.864+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:40.340 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:40 smithi203 systemd[1]: Starting Ceph mds.b for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:50:40.595 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:40 smithi203 podman[109422]: 2024-03-04 06:50:40.3400491 +0000 UTC m=+0.018549671 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T06:50:40.595 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:40 smithi203 podman[109422]: 2024-03-04 06:50:40.463835616 +0000 UTC m=+0.142336176 container create 6797a1307e300ff39588d6394d3022111a6ff75ab342bd46fd06dde203c231f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-04T06:50:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-mon[85573]: osdmap e566: 8 total, 8 up, 8 in 2024-03-04T06:50:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:40.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[88869]: osdmap e566: 8 total, 8 up, 8 in 2024-03-04T06:50:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[91314]: osdmap e566: 8 total, 8 up, 8 in 2024-03-04T06:50:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:40.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:40.862 INFO:tasks.rados.rados.0.smithi137.stdout:2672: done (1 left) 2024-03-04T06:50:40.862 INFO:tasks.rados.rados.0.smithi137.stdout:2673: done (0 left) 2024-03-04T06:50:40.862 INFO:tasks.rados.rados.0.smithi137.stdout:2674: delete oid 29 current snap is 248 2024-03-04T06:50:40.866 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:40.864+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:40.866 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:40.864+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:40.866 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:40.864+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:40.866 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:40 smithi203 podman[109422]: 2024-03-04 06:50:40.675163556 +0000 UTC m=+0.353664121 container init 6797a1307e300ff39588d6394d3022111a6ff75ab342bd46fd06dde203c231f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-03-04T06:50:40.866 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:40 smithi203 podman[109422]: 2024-03-04 06:50:40.677855971 +0000 UTC m=+0.356356538 container start 6797a1307e300ff39588d6394d3022111a6ff75ab342bd46fd06dde203c231f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.vendor=CentOS) 2024-03-04T06:50:40.867 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b[109437]: starting mds.b at 2024-03-04T06:50:40.867 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:40 smithi203 bash[109422]: 6797a1307e300ff39588d6394d3022111a6ff75ab342bd46fd06dde203c231f8 2024-03-04T06:50:40.867 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 06:50:40 smithi203 systemd[1]: Started Ceph mds.b for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:50:40.867 INFO:tasks.rados.rados.0.smithi137.stdout:2674: done (0 left) 2024-03-04T06:50:40.867 INFO:tasks.rados.rados.0.smithi137.stdout:2675: setattr oid 4 current snap is 248 2024-03-04T06:50:40.869 INFO:tasks.rados.rados.0.smithi137.stdout:2676: rollback oid 15 current snap is 248 2024-03-04T06:50:40.870 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 15 to 246 2024-03-04T06:50:40.870 INFO:tasks.rados.rados.0.smithi137.stdout:2677: copy_from oid 1 from oid 45 current snap is 248 2024-03-04T06:50:40.870 INFO:tasks.rados.rados.0.smithi137.stdout:2678: rollback oid 36 current snap is 248 2024-03-04T06:50:40.870 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 36 to 243 2024-03-04T06:50:40.870 INFO:tasks.rados.rados.0.smithi137.stdout:2679: read oid 29 snap -1 2024-03-04T06:50:40.870 INFO:tasks.rados.rados.0.smithi137.stdout:2679: expect deleted 2024-03-04T06:50:40.870 INFO:tasks.rados.rados.0.smithi137.stdout:2680: delete oid 39 current snap is 248 2024-03-04T06:50:40.870 INFO:tasks.rados.rados.0.smithi137.stdout:2678: finishing rollback tid 1 to smithi13777483-36 2024-03-04T06:50:40.870 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 0 (ObjNum 33 snap 0 seq_num 3131245824) dirty dne 2024-03-04T06:50:40.872 INFO:tasks.rados.rados.0.smithi137.stdout:2676: finishing rollback tid 1 to smithi13777483-15 2024-03-04T06:50:40.872 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16798 (ObjNum -1163267616 snap 21906 seq_num 304) dirty dne 2024-03-04T06:50:40.876 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 15514 (ObjNum 568 snap 159 seq_num 568) dirty exists 2024-03-04T06:50:40.879 INFO:tasks.rados.rados.0.smithi137.stdout:2677: finishing copy_from racing read to smithi13777483-1 2024-03-04T06:50:40.879 INFO:tasks.rados.rados.0.smithi137.stdout:2675: done (5 left) 2024-03-04T06:50:40.879 INFO:tasks.rados.rados.0.smithi137.stdout:2676: done (4 left) 2024-03-04T06:50:40.879 INFO:tasks.rados.rados.0.smithi137.stdout:2678: done (3 left) 2024-03-04T06:50:40.879 INFO:tasks.rados.rados.0.smithi137.stdout:2679: done (2 left) 2024-03-04T06:50:40.879 INFO:tasks.rados.rados.0.smithi137.stdout:2680: done (1 left) 2024-03-04T06:50:40.879 INFO:tasks.rados.rados.0.smithi137.stdout:2681: setattr oid 34 current snap is 248 2024-03-04T06:50:40.879 INFO:tasks.rados.rados.0.smithi137.stdout:2677: finishing copy_from to smithi13777483-1 2024-03-04T06:50:40.880 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 16855 (ObjNum 771 snap 228 seq_num 771) dirty exists 2024-03-04T06:50:40.880 INFO:tasks.rados.rados.0.smithi137.stdout:2677: done (1 left) 2024-03-04T06:50:40.880 INFO:tasks.rados.rados.0.smithi137.stdout:2682: snap_remove snap 244 2024-03-04T06:50:41.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:40.876+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:41.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:40.861+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:41.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:40.872+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:41.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:40.874+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:41.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:40.865+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:41.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:40.865+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:41.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:40.867+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:41.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:40.874+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:41.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: pgmap v528: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 398 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: osdmap e567: 8 total, 8 up, 8 in 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:41.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:41.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: pgmap v528: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 398 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2024-03-04T06:50:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:41.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: osdmap e567: 8 total, 8 up, 8 in 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:41.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: pgmap v528: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 398 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2024-03-04T06:50:41.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:41.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:41.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:41.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:41.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: osdmap e567: 8 total, 8 up, 8 in 2024-03-04T06:50:41.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:41.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:41.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:41.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:41.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:41.865 INFO:tasks.rados.rados.0.smithi137.stdout:2682: done (1 left) 2024-03-04T06:50:41.865 INFO:tasks.rados.rados.0.smithi137.stdout:2683: read oid 42 snap 240 2024-03-04T06:50:41.865 INFO:tasks.rados.rados.0.smithi137.stdout:2683: expect deleted 2024-03-04T06:50:41.865 INFO:tasks.rados.rados.0.smithi137.stdout:2684: read oid 15 snap -1 2024-03-04T06:50:41.865 INFO:tasks.rados.rados.0.smithi137.stdout:2684: expect deleted 2024-03-04T06:50:41.865 INFO:tasks.rados.rados.0.smithi137.stdout:2685: read oid 35 snap -1 2024-03-04T06:50:41.865 INFO:tasks.rados.rados.0.smithi137.stdout:2685: expect deleted 2024-03-04T06:50:41.865 INFO:tasks.rados.rados.0.smithi137.stdout:2686: copy_from oid 25 from oid 50 current snap is 248 2024-03-04T06:50:41.865 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16833 (ObjNum 33 snap 0 seq_num 3130950960) dirty exists 2024-03-04T06:50:41.865 INFO:tasks.rados.rados.0.smithi137.stdout:2681: done (4 left) 2024-03-04T06:50:41.866 INFO:tasks.rados.rados.0.smithi137.stdout:2687: rollback oid 14 current snap is 248 2024-03-04T06:50:41.866 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 14 to 243 2024-03-04T06:50:41.866 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 248 2024-03-04T06:50:41.866 INFO:tasks.rados.rados.0.smithi137.stdout:2688: seq_num 849 ranges {0=622592,622592=516096,1138688=663552,1802240=425984} 2024-03-04T06:50:41.869 INFO:tasks.rados.rados.0.smithi137.stdout:2688: writing smithi13777483-11 from 0 to 622592 tid 1 2024-03-04T06:50:41.872 INFO:tasks.rados.rados.0.smithi137.stdout:2688: writing smithi13777483-11 from 622592 to 1138688 tid 2 2024-03-04T06:50:41.876 INFO:tasks.rados.rados.0.smithi137.stdout:2688: writing smithi13777483-11 from 1138688 to 1802240 tid 3 2024-03-04T06:50:41.880 INFO:tasks.rados.rados.0.smithi137.stdout:2688: writing smithi13777483-11 from 1802240 to 2228224 tid 4 2024-03-04T06:50:41.880 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 248 2024-03-04T06:50:41.880 INFO:tasks.rados.rados.0.smithi137.stdout:2689: seq_num 850 ranges {0=638976,638976=802816,1441792=475136,1916928=327680} 2024-03-04T06:50:41.883 INFO:tasks.rados.rados.0.smithi137.stdout:2689: writing smithi13777483-16 from 0 to 638976 tid 1 2024-03-04T06:50:41.888 INFO:tasks.rados.rados.0.smithi137.stdout:2689: writing smithi13777483-16 from 638976 to 1441792 tid 2 2024-03-04T06:50:41.890 INFO:tasks.rados.rados.0.smithi137.stdout:2689: writing smithi13777483-16 from 1441792 to 1916928 tid 3 2024-03-04T06:50:41.893 INFO:tasks.rados.rados.0.smithi137.stdout:2689: writing smithi13777483-16 from 1916928 to 2244608 tid 4 2024-03-04T06:50:41.893 INFO:tasks.rados.rados.0.smithi137.stdout:2690: rollback oid 37 current snap is 248 2024-03-04T06:50:41.893 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 37 to 247 2024-03-04T06:50:41.893 INFO:tasks.rados.rados.0.smithi137.stdout:2687: finishing rollback tid 1 to smithi13777483-14 2024-03-04T06:50:41.893 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 16861 (ObjNum 33 snap 0 seq_num 3110921464) dirty dne 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2686: finishing copy_from racing read to smithi13777483-25 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2683: done (7 left) 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2684: done (6 left) 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2685: done (5 left) 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2687: done (4 left) 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2691: copy_from oid 31 from oid 41 current snap is 248 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2686: finishing copy_from to smithi13777483-25 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 16854 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2688: finishing write tid 1 to smithi13777483-11 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2688: finishing write tid 2 to smithi13777483-11 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2688: finishing write tid 3 to smithi13777483-11 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2688: finishing write tid 4 to smithi13777483-11 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2686: done (4 left) 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 248 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2688: finishing write tid 5 to smithi13777483-11 2024-03-04T06:50:41.894 INFO:tasks.rados.rados.0.smithi137.stdout:2692: seq_num 851 ranges {0=655360,655360=688128,1343488=679936,2023424=237568} 2024-03-04T06:50:41.897 INFO:tasks.rados.rados.0.smithi137.stdout:2692: writing smithi13777483-23 from 0 to 655360 tid 1 2024-03-04T06:50:41.900 INFO:tasks.rados.rados.0.smithi137.stdout:2692: writing smithi13777483-23 from 655360 to 1343488 tid 2 2024-03-04T06:50:41.904 INFO:tasks.rados.rados.0.smithi137.stdout:2692: writing smithi13777483-23 from 1343488 to 2023424 tid 3 2024-03-04T06:50:41.907 INFO:tasks.rados.rados.0.smithi137.stdout:2692: writing smithi13777483-23 from 2023424 to 2260992 tid 4 2024-03-04T06:50:41.907 INFO:tasks.rados.rados.0.smithi137.stdout:2693: copy_from oid 24 from oid 35 current snap is 248 2024-03-04T06:50:41.907 INFO:tasks.rados.rados.0.smithi137.stdout:2689: finishing write tid 1 to smithi13777483-16 2024-03-04T06:50:41.907 INFO:tasks.rados.rados.0.smithi137.stdout:2688: finishing write tid 6 to smithi13777483-11 2024-03-04T06:50:41.907 INFO:tasks.rados.rados.0.smithi137.stdout:2688: oid 11 updating version 0 to 16831 2024-03-04T06:50:41.907 INFO:tasks.rados.rados.0.smithi137.stdout:2688: oid 11 updating version 16831 to 16832 2024-03-04T06:50:41.907 INFO:tasks.rados.rados.0.smithi137.stdout:2688: oid 11 updating version 16832 to 16835 2024-03-04T06:50:41.907 INFO:tasks.rados.rados.0.smithi137.stdout:2688: oid 11 version 16835 is already newer than 16833 2024-03-04T06:50:41.907 INFO:tasks.rados.rados.0.smithi137.stdout:2688: oid 11 version 16835 is already newer than 16834 2024-03-04T06:50:41.907 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16835 (ObjNum 849 snap 248 seq_num 849) dirty exists 2024-03-04T06:50:41.907 INFO:tasks.rados.rados.0.smithi137.stdout:2688: left oid 11 (ObjNum 849 snap 248 seq_num 849) 2024-03-04T06:50:41.907 INFO:tasks.rados.rados.0.smithi137.stdout:2690: finishing rollback tid 0 to smithi13777483-37 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:2690: finishing rollback tid 1 to smithi13777483-37 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:2690: finishing rollback tid 2 to smithi13777483-37 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16813 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:2692: finishing write tid 1 to smithi13777483-23 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:2688: done (5 left) 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:2690: done (4 left) 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:2694: rollback oid 46 current snap is 248 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 46 to 243 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:2689: finishing write tid 2 to smithi13777483-16 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:2689: finishing write tid 3 to smithi13777483-16 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:2689: finishing write tid 4 to smithi13777483-16 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:2692: finishing write tid 2 to smithi13777483-23 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:2695: copy_from oid 6 from oid 47 current snap is 248 2024-03-04T06:50:41.908 INFO:tasks.rados.rados.0.smithi137.stdout:2696: snap_create 2024-03-04T06:50:41.909 INFO:tasks.rados.rados.0.smithi137.stdout:2689: finishing write tid 5 to smithi13777483-16 2024-03-04T06:50:41.909 INFO:tasks.rados.rados.0.smithi137.stdout:2691: finishing copy_from racing read to smithi13777483-31 2024-03-04T06:50:41.909 INFO:tasks.rados.rados.0.smithi137.stdout:2693: finishing copy_from to smithi13777483-24 2024-03-04T06:50:41.909 INFO:tasks.rados.rados.0.smithi137.stdout:2693: got expected ENOENT (src dne) 2024-03-04T06:50:41.910 INFO:tasks.rados.rados.0.smithi137.stdout:2693: finishing copy_from racing read to smithi13777483-24 2024-03-04T06:50:41.911 INFO:tasks.rados.rados.0.smithi137.stdout:2692: finishing write tid 3 to smithi13777483-23 2024-03-04T06:50:41.911 INFO:tasks.rados.rados.0.smithi137.stdout:2694: finishing rollback tid 1 to smithi13777483-46 2024-03-04T06:50:41.912 INFO:tasks.rados.rados.0.smithi137.stdout:2692: finishing write tid 4 to smithi13777483-23 2024-03-04T06:50:41.912 INFO:tasks.rados.rados.0.smithi137.stdout:2691: finishing copy_from to smithi13777483-31 2024-03-04T06:50:41.912 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16808 (ObjNum 822 snap 236 seq_num 822) dirty exists 2024-03-04T06:50:41.912 INFO:tasks.rados.rados.0.smithi137.stdout:2694: finishing rollback tid 2 to smithi13777483-46 2024-03-04T06:50:41.912 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 16867 (ObjNum 810 snap 235 seq_num 810) dirty exists 2024-03-04T06:50:41.912 INFO:tasks.rados.rados.0.smithi137.stdout:2689: finishing write tid 6 to smithi13777483-16 2024-03-04T06:50:41.912 INFO:tasks.rados.rados.0.smithi137.stdout:2689: oid 16 updating version 0 to 16834 2024-03-04T06:50:41.912 INFO:tasks.rados.rados.0.smithi137.stdout:2689: oid 16 updating version 16834 to 16836 2024-03-04T06:50:41.912 INFO:tasks.rados.rados.0.smithi137.stdout:2689: oid 16 version 16836 is already newer than 16835 2024-03-04T06:50:41.913 INFO:tasks.rados.rados.0.smithi137.stdout:2689: oid 16 updating version 16836 to 16837 2024-03-04T06:50:41.913 INFO:tasks.rados.rados.0.smithi137.stdout:2689: oid 16 updating version 16837 to 16838 2024-03-04T06:50:41.913 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16838 (ObjNum 850 snap 248 seq_num 850) dirty exists 2024-03-04T06:50:41.913 INFO:tasks.rados.rados.0.smithi137.stdout:2689: left oid 16 (ObjNum 850 snap 248 seq_num 850) 2024-03-04T06:50:41.913 INFO:tasks.rados.rados.0.smithi137.stdout:2692: finishing write tid 5 to smithi13777483-23 2024-03-04T06:50:41.916 INFO:tasks.rados.rados.0.smithi137.stdout:2692: finishing write tid 6 to smithi13777483-23 2024-03-04T06:50:41.916 INFO:tasks.rados.rados.0.smithi137.stdout:2692: oid 23 updating version 0 to 16862 2024-03-04T06:50:41.916 INFO:tasks.rados.rados.0.smithi137.stdout:2692: oid 23 updating version 16862 to 16863 2024-03-04T06:50:41.916 INFO:tasks.rados.rados.0.smithi137.stdout:2692: oid 23 updating version 16863 to 16864 2024-03-04T06:50:41.916 INFO:tasks.rados.rados.0.smithi137.stdout:2692: oid 23 updating version 16864 to 16866 2024-03-04T06:50:41.916 INFO:tasks.rados.rados.0.smithi137.stdout:2692: oid 23 version 16866 is already newer than 16865 2024-03-04T06:50:41.916 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 16866 (ObjNum 851 snap 248 seq_num 851) dirty exists 2024-03-04T06:50:41.916 INFO:tasks.rados.rados.0.smithi137.stdout:2692: left oid 23 (ObjNum 851 snap 248 seq_num 851) 2024-03-04T06:50:41.919 INFO:tasks.rados.rados.0.smithi137.stdout:2695: finishing copy_from racing read to smithi13777483-6 2024-03-04T06:50:41.919 INFO:tasks.rados.rados.0.smithi137.stdout:2695: finishing copy_from to smithi13777483-6 2024-03-04T06:50:41.919 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16825 (ObjNum 787 snap 231 seq_num 787) dirty exists 2024-03-04T06:50:42.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:41.869+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:42.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:41.868+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:42.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:41.868+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:42.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:41.868+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:42.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:41.861+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:42.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:41.861+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:42.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:41.871+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:42.097 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:41.871+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:42.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:41.869+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:42.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:41.862+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:42.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:41.875+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:42.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:41.875+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:42.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:41.876+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:42.567 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:42.567 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:42.567 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:42.567 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:42.567 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: mds.? [v2:172.21.15.203:6832/1009869994,v1:172.21.15.203:6833/1009869994] up:boot 2024-03-04T06:50:42.567 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: fsmap cephfs:1 {0=a=up:active} 1 up:standby 2024-03-04T06:50:42.568 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:50:42.568 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:42.568 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:42.568 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:42.568 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: osdmap e568: 8 total, 8 up, 8 in 2024-03-04T06:50:42.568 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:42.568 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:42.568 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:42.568 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:42.568 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:42.568 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:42.568 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:42.568 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: mds.? [v2:172.21.15.203:6832/1009869994,v1:172.21.15.203:6833/1009869994] up:boot 2024-03-04T06:50:42.569 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: fsmap cephfs:1 {0=a=up:active} 1 up:standby 2024-03-04T06:50:42.569 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:50:42.569 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:42.569 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:42.569 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:42.569 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: osdmap e568: 8 total, 8 up, 8 in 2024-03-04T06:50:42.569 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:42.569 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:42.569 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:42.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:42.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:42.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:42.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:42.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: mds.? [v2:172.21.15.203:6832/1009869994,v1:172.21.15.203:6833/1009869994] up:boot 2024-03-04T06:50:42.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: fsmap cephfs:1 {0=a=up:active} 1 up:standby 2024-03-04T06:50:42.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T06:50:42.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:42.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:42.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:42.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: osdmap e568: 8 total, 8 up, 8 in 2024-03-04T06:50:42.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset 127=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:42.723 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:42.724 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:42.866 INFO:tasks.rados.rados.0.smithi137.stdout:2689: done (6 left) 2024-03-04T06:50:42.866 INFO:tasks.rados.rados.0.smithi137.stdout:2691: done (5 left) 2024-03-04T06:50:42.866 INFO:tasks.rados.rados.0.smithi137.stdout:2692: done (4 left) 2024-03-04T06:50:42.867 INFO:tasks.rados.rados.0.smithi137.stdout:2693: done (3 left) 2024-03-04T06:50:42.867 INFO:tasks.rados.rados.0.smithi137.stdout:2694: done (2 left) 2024-03-04T06:50:42.867 INFO:tasks.rados.rados.0.smithi137.stdout:2695: done (1 left) 2024-03-04T06:50:42.867 INFO:tasks.rados.rados.0.smithi137.stdout:2696: done (0 left) 2024-03-04T06:50:42.867 INFO:tasks.rados.rados.0.smithi137.stdout:2697: setattr oid 22 current snap is 249 2024-03-04T06:50:42.868 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 249 2024-03-04T06:50:42.868 INFO:tasks.rados.rados.0.smithi137.stdout:2698: seq_num 852 ranges {7282688=671744,7954432=622592,8577024=442368,9019392=540672} 2024-03-04T06:50:42.911 INFO:tasks.rados.rados.0.smithi137.stdout:2698: writing smithi13777483-26 from 7282688 to 7954432 tid 1 2024-03-04T06:50:42.915 INFO:tasks.rados.rados.0.smithi137.stdout:2698: writing smithi13777483-26 from 7954432 to 8577024 tid 2 2024-03-04T06:50:42.917 INFO:tasks.rados.rados.0.smithi137.stdout:2698: writing smithi13777483-26 from 8577024 to 9019392 tid 3 2024-03-04T06:50:42.921 INFO:tasks.rados.rados.0.smithi137.stdout:2698: writing smithi13777483-26 from 9019392 to 9560064 tid 4 2024-03-04T06:50:42.921 INFO:tasks.rados.rados.0.smithi137.stdout:2699: read oid 36 snap 241 2024-03-04T06:50:42.921 INFO:tasks.rados.rados.0.smithi137.stdout:2699: expect deleted 2024-03-04T06:50:42.921 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 50 current snap is 249 2024-03-04T06:50:42.921 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 16826 (ObjNum 826 snap 238 seq_num 826) dirty exists 2024-03-04T06:50:42.921 INFO:tasks.rados.rados.0.smithi137.stdout:2700: seq_num 853 ranges {0=696320,696320=507904,1204224=647168,1851392=450560} 2024-03-04T06:50:42.925 INFO:tasks.rados.rados.0.smithi137.stdout:2700: writing smithi13777483-50 from 0 to 696320 tid 1 2024-03-04T06:50:42.928 INFO:tasks.rados.rados.0.smithi137.stdout:2700: writing smithi13777483-50 from 696320 to 1204224 tid 2 2024-03-04T06:50:42.932 INFO:tasks.rados.rados.0.smithi137.stdout:2700: writing smithi13777483-50 from 1204224 to 1851392 tid 3 2024-03-04T06:50:42.935 INFO:tasks.rados.rados.0.smithi137.stdout:2700: writing smithi13777483-50 from 1851392 to 2301952 tid 4 2024-03-04T06:50:42.935 INFO:tasks.rados.rados.0.smithi137.stdout:2697: done (3 left) 2024-03-04T06:50:42.935 INFO:tasks.rados.rados.0.smithi137.stdout:2701: snap_remove snap 243 2024-03-04T06:50:43.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:42.871+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:43.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:42.958+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:43.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:42.861+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:43.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:42.861+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:43.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:42.862+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:43.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:42.915+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:43.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:42.915+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:43.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:42.929+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:43.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:42.864+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:43.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:42.872+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:43.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:42.872+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:43.608 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:43.608 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:43.608 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:43.608 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:43.608 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-mon[85573]: pgmap v531: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 398 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 524 KiB/s wr, 1 op/s 2024-03-04T06:50:43.608 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:43.608 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:43.608 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:43.608 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-mon[85573]: osdmap e569: 8 total, 8 up, 8 in 2024-03-04T06:50:43.608 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:43.608 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:43.608 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:43.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:43.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:43.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:43.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:43.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[88869]: pgmap v531: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 398 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 524 KiB/s wr, 1 op/s 2024-03-04T06:50:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[88869]: osdmap e569: 8 total, 8 up, 8 in 2024-03-04T06:50:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:43.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:43.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:43.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:43.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[91314]: pgmap v531: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 398 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 524 KiB/s wr, 1 op/s 2024-03-04T06:50:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[91314]: osdmap e569: 8 total, 8 up, 8 in 2024-03-04T06:50:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:43.866 INFO:tasks.rados.rados.0.smithi137.stdout:2698: finishing write tid 1 to smithi13777483-26 2024-03-04T06:50:43.866 INFO:tasks.rados.rados.0.smithi137.stdout:2698: finishing write tid 2 to smithi13777483-26 2024-03-04T06:50:43.866 INFO:tasks.rados.rados.0.smithi137.stdout:2698: finishing write tid 3 to smithi13777483-26 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2698: finishing write tid 4 to smithi13777483-26 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2698: finishing write tid 5 to smithi13777483-26 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2698: finishing write tid 6 to smithi13777483-26 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2698: oid 26 updating version 0 to 16841 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2698: oid 26 version 16841 is already newer than 16839 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2698: oid 26 updating version 16841 to 16842 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2698: oid 26 version 16842 is already newer than 16840 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2698: oid 26 updating version 16842 to 16843 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16843 (ObjNum 852 snap 249 seq_num 852) dirty exists 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2698: left oid 26 (ObjNum 852 snap 249 seq_num 852) 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2700: finishing write tid 1 to smithi13777483-50 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2700: finishing write tid 2 to smithi13777483-50 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2698: done (3 left) 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2699: done (2 left) 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2701: done (1 left) 2024-03-04T06:50:43.867 INFO:tasks.rados.rados.0.smithi137.stdout:2702: read oid 5 snap -1 2024-03-04T06:50:43.868 INFO:tasks.rados.rados.0.smithi137.stdout:2702: expect deleted 2024-03-04T06:50:43.868 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 249 2024-03-04T06:50:43.868 INFO:tasks.rados.rados.0.smithi137.stdout:2700: finishing write tid 3 to smithi13777483-50 2024-03-04T06:50:43.868 INFO:tasks.rados.rados.0.smithi137.stdout:2700: finishing write tid 4 to smithi13777483-50 2024-03-04T06:50:43.868 INFO:tasks.rados.rados.0.smithi137.stdout:2703: seq_num 854 ranges {0=712704,712704=794624,1507328=450560,1957888=360448} 2024-03-04T06:50:43.871 INFO:tasks.rados.rados.0.smithi137.stdout:2703: writing smithi13777483-32 from 0 to 712704 tid 1 2024-03-04T06:50:43.876 INFO:tasks.rados.rados.0.smithi137.stdout:2703: writing smithi13777483-32 from 712704 to 1507328 tid 2 2024-03-04T06:50:43.879 INFO:tasks.rados.rados.0.smithi137.stdout:2703: writing smithi13777483-32 from 1507328 to 1957888 tid 3 2024-03-04T06:50:43.882 INFO:tasks.rados.rados.0.smithi137.stdout:2703: writing smithi13777483-32 from 1957888 to 2318336 tid 4 2024-03-04T06:50:43.882 INFO:tasks.rados.rados.0.smithi137.stdout:2704: snap_create 2024-03-04T06:50:43.882 INFO:tasks.rados.rados.0.smithi137.stdout:2700: finishing write tid 5 to smithi13777483-50 2024-03-04T06:50:43.882 INFO:tasks.rados.rados.0.smithi137.stdout:2700: finishing write tid 6 to smithi13777483-50 2024-03-04T06:50:43.882 INFO:tasks.rados.rados.0.smithi137.stdout:2700: oid 50 updating version 0 to 16870 2024-03-04T06:50:43.882 INFO:tasks.rados.rados.0.smithi137.stdout:2700: oid 50 version 16870 is already newer than 16868 2024-03-04T06:50:43.882 INFO:tasks.rados.rados.0.smithi137.stdout:2700: oid 50 updating version 16870 to 16872 2024-03-04T06:50:43.882 INFO:tasks.rados.rados.0.smithi137.stdout:2700: oid 50 version 16872 is already newer than 16871 2024-03-04T06:50:43.882 INFO:tasks.rados.rados.0.smithi137.stdout:2700: oid 50 version 16872 is already newer than 16869 2024-03-04T06:50:43.882 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 16872 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:50:43.882 INFO:tasks.rados.rados.0.smithi137.stdout:2700: left oid 50 (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:50:43.882 INFO:tasks.rados.rados.0.smithi137.stdout:2703: finishing write tid 1 to smithi13777483-32 2024-03-04T06:50:43.883 INFO:tasks.rados.rados.0.smithi137.stdout:2703: finishing write tid 2 to smithi13777483-32 2024-03-04T06:50:43.884 INFO:tasks.rados.rados.0.smithi137.stdout:2703: finishing write tid 3 to smithi13777483-32 2024-03-04T06:50:43.885 INFO:tasks.rados.rados.0.smithi137.stdout:2703: finishing write tid 4 to smithi13777483-32 2024-03-04T06:50:43.885 INFO:tasks.rados.rados.0.smithi137.stdout:2703: finishing write tid 5 to smithi13777483-32 2024-03-04T06:50:43.887 INFO:tasks.rados.rados.0.smithi137.stdout:2703: finishing write tid 6 to smithi13777483-32 2024-03-04T06:50:43.887 INFO:tasks.rados.rados.0.smithi137.stdout:2703: oid 32 updating version 0 to 16876 2024-03-04T06:50:43.887 INFO:tasks.rados.rados.0.smithi137.stdout:2703: oid 32 updating version 16876 to 16877 2024-03-04T06:50:43.887 INFO:tasks.rados.rados.0.smithi137.stdout:2703: oid 32 version 16877 is already newer than 16875 2024-03-04T06:50:43.887 INFO:tasks.rados.rados.0.smithi137.stdout:2703: oid 32 version 16877 is already newer than 16873 2024-03-04T06:50:43.887 INFO:tasks.rados.rados.0.smithi137.stdout:2703: oid 32 version 16877 is already newer than 16874 2024-03-04T06:50:43.887 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16877 (ObjNum 854 snap 249 seq_num 854) dirty exists 2024-03-04T06:50:43.887 INFO:tasks.rados.rados.0.smithi137.stdout:2703: left oid 32 (ObjNum 854 snap 249 seq_num 854) 2024-03-04T06:50:44.164 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:43.867+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:44.164 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:43.868+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:44.164 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:43.869+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:44.165 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:43.979+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:44.165 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:43.979+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:44.165 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:43.863+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:44.165 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:43.863+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:44.165 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:43.863+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:44.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:43.873+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:44.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:43.865+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:44.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:43.877+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:44.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:43.877+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:44.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:43.878+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-mon[85573]: osdmap e570: 8 total, 8 up, 8 in 2024-03-04T06:50:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[88869]: osdmap e570: 8 total, 8 up, 8 in 2024-03-04T06:50:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:44.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:44.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[91314]: osdmap e570: 8 total, 8 up, 8 in 2024-03-04T06:50:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:44.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:44.867 INFO:tasks.rados.rados.0.smithi137.stdout:2700: done (3 left) 2024-03-04T06:50:44.868 INFO:tasks.rados.rados.0.smithi137.stdout:2702: done (2 left) 2024-03-04T06:50:44.868 INFO:tasks.rados.rados.0.smithi137.stdout:2703: done (1 left) 2024-03-04T06:50:44.868 INFO:tasks.rados.rados.0.smithi137.stdout:2704: done (0 left) 2024-03-04T06:50:44.868 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 250 2024-03-04T06:50:44.868 INFO:tasks.rados.rados.0.smithi137.stdout:2705: seq_num 855 ranges {0=729088,729088=671744,1400832=663552,2064384=270336} 2024-03-04T06:50:44.871 INFO:tasks.rados.rados.0.smithi137.stdout:2705: writing smithi13777483-25 from 0 to 729088 tid 1 2024-03-04T06:50:44.876 INFO:tasks.rados.rados.0.smithi137.stdout:2705: writing smithi13777483-25 from 729088 to 1400832 tid 2 2024-03-04T06:50:44.880 INFO:tasks.rados.rados.0.smithi137.stdout:2705: writing smithi13777483-25 from 1400832 to 2064384 tid 3 2024-03-04T06:50:44.882 INFO:tasks.rados.rados.0.smithi137.stdout:2705: writing smithi13777483-25 from 2064384 to 2334720 tid 4 2024-03-04T06:50:44.882 INFO:tasks.rados.rados.0.smithi137.stdout:2706: rmattr oid 5 current snap is 250 2024-03-04T06:50:44.882 INFO:tasks.rados.rados.0.smithi137.stdout:2706: done (1 left) 2024-03-04T06:50:44.882 INFO:tasks.rados.rados.0.smithi137.stdout:2707: snap_create 2024-03-04T06:50:44.882 INFO:tasks.rados.rados.0.smithi137.stdout:2705: finishing write tid 1 to smithi13777483-25 2024-03-04T06:50:44.882 INFO:tasks.rados.rados.0.smithi137.stdout:2705: finishing write tid 2 to smithi13777483-25 2024-03-04T06:50:44.884 INFO:tasks.rados.rados.0.smithi137.stdout:2705: finishing write tid 3 to smithi13777483-25 2024-03-04T06:50:44.885 INFO:tasks.rados.rados.0.smithi137.stdout:2705: finishing write tid 4 to smithi13777483-25 2024-03-04T06:50:44.885 INFO:tasks.rados.rados.0.smithi137.stdout:2705: finishing write tid 5 to smithi13777483-25 2024-03-04T06:50:44.886 INFO:tasks.rados.rados.0.smithi137.stdout:2705: finishing write tid 6 to smithi13777483-25 2024-03-04T06:50:44.886 INFO:tasks.rados.rados.0.smithi137.stdout:2705: oid 25 updating version 0 to 16858 2024-03-04T06:50:44.886 INFO:tasks.rados.rados.0.smithi137.stdout:2705: oid 25 updating version 16858 to 16859 2024-03-04T06:50:44.887 INFO:tasks.rados.rados.0.smithi137.stdout:2705: oid 25 version 16859 is already newer than 16856 2024-03-04T06:50:44.887 INFO:tasks.rados.rados.0.smithi137.stdout:2705: oid 25 version 16859 is already newer than 16855 2024-03-04T06:50:44.887 INFO:tasks.rados.rados.0.smithi137.stdout:2705: oid 25 version 16859 is already newer than 16857 2024-03-04T06:50:44.887 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 16859 (ObjNum 855 snap 250 seq_num 855) dirty exists 2024-03-04T06:50:44.887 INFO:tasks.rados.rados.0.smithi137.stdout:2705: left oid 25 (ObjNum 855 snap 250 seq_num 855) 2024-03-04T06:50:45.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:44.876+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:45.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:44.876+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:45.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:44.867+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:45.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:44.865+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:45.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:44.866+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:45.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:44.866+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:45.761 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:45.531+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:45.761 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:45.531+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:45.761 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:50:45] "GET /metrics HTTP/1.1" 200 36105 "" "Prometheus/2.43.0" 2024-03-04T06:50:45.761 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:45.551+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:45.762 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:45.762 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:45.762 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:45.762 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:45.762 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[88869]: pgmap v534: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 416 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 7.8 MiB/s rd, 4.0 MiB/s wr, 29 op/s 2024-03-04T06:50:45.762 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:45.762 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:45.762 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:45.762 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:45.762 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[88869]: osdmap e571: 8 total, 8 up, 8 in 2024-03-04T06:50:45.762 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-mon[85573]: pgmap v534: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 416 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 7.8 MiB/s rd, 4.0 MiB/s wr, 29 op/s 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-mon[85573]: osdmap e571: 8 total, 8 up, 8 in 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:45.763 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:45.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:45.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[91314]: pgmap v534: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 416 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 7.8 MiB/s rd, 4.0 MiB/s wr, 29 op/s 2024-03-04T06:50:45.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:45.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:45.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:45.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:45.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[91314]: osdmap e571: 8 total, 8 up, 8 in 2024-03-04T06:50:45.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:45.874 INFO:tasks.rados.rados.0.smithi137.stdout:2705: done (1 left) 2024-03-04T06:50:45.874 INFO:tasks.rados.rados.0.smithi137.stdout:2707: done (0 left) 2024-03-04T06:50:45.874 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 40 current snap is 251 2024-03-04T06:50:45.874 INFO:tasks.rados.rados.0.smithi137.stdout:2708: seq_num 856 ranges {0=745472,745472=557056,1302528=417792,1720320=434176,2154496=196608} 2024-03-04T06:50:45.878 INFO:tasks.rados.rados.0.smithi137.stdout:2708: writing smithi13777483-40 from 0 to 745472 tid 1 2024-03-04T06:50:45.881 INFO:tasks.rados.rados.0.smithi137.stdout:2708: writing smithi13777483-40 from 745472 to 1302528 tid 2 2024-03-04T06:50:45.883 INFO:tasks.rados.rados.0.smithi137.stdout:2708: writing smithi13777483-40 from 1302528 to 1720320 tid 3 2024-03-04T06:50:45.886 INFO:tasks.rados.rados.0.smithi137.stdout:2708: writing smithi13777483-40 from 1720320 to 2154496 tid 4 2024-03-04T06:50:45.887 INFO:tasks.rados.rados.0.smithi137.stdout:2708: writing smithi13777483-40 from 2154496 to 2351104 tid 5 2024-03-04T06:50:45.887 INFO:tasks.rados.rados.0.smithi137.stdout:2709: snap_create 2024-03-04T06:50:45.887 INFO:tasks.rados.rados.0.smithi137.stdout:2708: finishing write tid 1 to smithi13777483-40 2024-03-04T06:50:45.887 INFO:tasks.rados.rados.0.smithi137.stdout:2708: finishing write tid 2 to smithi13777483-40 2024-03-04T06:50:45.888 INFO:tasks.rados.rados.0.smithi137.stdout:2708: finishing write tid 3 to smithi13777483-40 2024-03-04T06:50:45.891 INFO:tasks.rados.rados.0.smithi137.stdout:2708: finishing write tid 4 to smithi13777483-40 2024-03-04T06:50:45.891 INFO:tasks.rados.rados.0.smithi137.stdout:2708: finishing write tid 5 to smithi13777483-40 2024-03-04T06:50:45.891 INFO:tasks.rados.rados.0.smithi137.stdout:2708: finishing write tid 6 to smithi13777483-40 2024-03-04T06:50:45.892 INFO:tasks.rados.rados.0.smithi137.stdout:2708: finishing write tid 7 to smithi13777483-40 2024-03-04T06:50:45.893 INFO:tasks.rados.rados.0.smithi137.stdout:2708: oid 40 updating version 0 to 16827 2024-03-04T06:50:45.893 INFO:tasks.rados.rados.0.smithi137.stdout:2708: oid 40 updating version 16827 to 16829 2024-03-04T06:50:45.893 INFO:tasks.rados.rados.0.smithi137.stdout:2708: oid 40 updating version 16829 to 16830 2024-03-04T06:50:45.893 INFO:tasks.rados.rados.0.smithi137.stdout:2708: oid 40 updating version 16830 to 16831 2024-03-04T06:50:45.893 INFO:tasks.rados.rados.0.smithi137.stdout:2708: oid 40 updating version 16831 to 16832 2024-03-04T06:50:45.893 INFO:tasks.rados.rados.0.smithi137.stdout:2708: oid 40 version 16832 is already newer than 16828 2024-03-04T06:50:45.893 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 16832 (ObjNum 856 snap 251 seq_num 856) dirty exists 2024-03-04T06:50:45.893 INFO:tasks.rados.rados.0.smithi137.stdout:2708: left oid 40 (ObjNum 856 snap 251 seq_num 856) 2024-03-04T06:50:46.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:45.884+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:46.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:45.884+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:46.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:45.884+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:46.044 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:45.872+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:46.044 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:45.759+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:46.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:45.759+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:46.096 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:45.867+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:46.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:45.880+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:46.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:45.882+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:46.587 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:46.587 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:46.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:46.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:46.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:46.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:46.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:46.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:46.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-mon[85573]: osdmap e572: 8 total, 8 up, 8 in 2024-03-04T06:50:46.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:46.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:46.588 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:46.677 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:46.677 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:46.677 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:46.677 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:46.677 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:46.677 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:46.677 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:46.677 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:46.677 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[91314]: osdmap e572: 8 total, 8 up, 8 in 2024-03-04T06:50:46.677 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:46.677 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:46.677 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:46.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:46.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:46.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:46.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:46.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:46.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:46.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:46.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:46.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[88869]: osdmap e572: 8 total, 8 up, 8 in 2024-03-04T06:50:46.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:46.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:46.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:46.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:46.822+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:46.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:46.822+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:46.872 INFO:tasks.rados.rados.0.smithi137.stdout:2708: done (1 left) 2024-03-04T06:50:46.872 INFO:tasks.rados.rados.0.smithi137.stdout:2709: done (0 left) 2024-03-04T06:50:46.872 INFO:tasks.rados.rados.0.smithi137.stdout:2710: snap_create 2024-03-04T06:50:47.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:46.870+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:47.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:46.870+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:47.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:46.675+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:47.195 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:46.868+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:47.195 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:46.869+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:47.195 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:46.869+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:47.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:47.233+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:47.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:47.233+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[91314]: pgmap v537: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 421 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 7.8 MiB/s rd, 5.3 MiB/s wr, 31 op/s 2024-03-04T06:50:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[91314]: osdmap e573: 8 total, 8 up, 8 in 2024-03-04T06:50:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[88869]: pgmap v537: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 421 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 7.8 MiB/s rd, 5.3 MiB/s wr, 31 op/s 2024-03-04T06:50:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-mon[88869]: osdmap e573: 8 total, 8 up, 8 in 2024-03-04T06:50:47.569 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:47.232+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:47.569 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:47.570 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:47.570 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:47.570 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:47.570 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-mon[85573]: pgmap v537: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 421 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 7.8 MiB/s rd, 5.3 MiB/s wr, 31 op/s 2024-03-04T06:50:47.570 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:47.570 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:47.570 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:47.570 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-mon[85573]: osdmap e573: 8 total, 8 up, 8 in 2024-03-04T06:50:47.570 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:47.232+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:47.571 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:47.232+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:47.571 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:47.232+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:47.571 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:47.193+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:47.872 INFO:tasks.rados.rados.0.smithi137.stdout:2710: done (0 left) 2024-03-04T06:50:47.872 INFO:tasks.rados.rados.0.smithi137.stdout:2711: setattr oid 37 current snap is 253 2024-03-04T06:50:47.874 INFO:tasks.rados.rados.0.smithi137.stdout:2712: copy_from oid 13 from oid 1 current snap is 253 2024-03-04T06:50:47.874 INFO:tasks.rados.rados.0.smithi137.stdout:2713: delete oid 27 current snap is 253 2024-03-04T06:50:47.878 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16833 (ObjNum 605 snap 172 seq_num 605) dirty exists 2024-03-04T06:50:47.878 INFO:tasks.rados.rados.0.smithi137.stdout:2711: done (2 left) 2024-03-04T06:50:47.878 INFO:tasks.rados.rados.0.smithi137.stdout:2713: done (1 left) 2024-03-04T06:50:47.878 INFO:tasks.rados.rados.0.smithi137.stdout:2714: copy_from oid 18 from oid 34 current snap is 253 2024-03-04T06:50:47.879 INFO:tasks.rados.rados.0.smithi137.stdout:2715: snap_remove snap 240 2024-03-04T06:50:48.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:47.920+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:48.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:47.877+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:48.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:47.877+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:48.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:47.877+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:48.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:47.871+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:48.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:47.877+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:48.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:47.870+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:48.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:47.870+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:48.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:47.920+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:48.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:47.920+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:48.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:47.885+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:48.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:47.885+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:48.792 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:48.792 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:48.792 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:48.792 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:48.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:48.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:48.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:48.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:48.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:48.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:48.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:48.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: osdmap e574: 8 total, 8 up, 8 in 2024-03-04T06:50:48.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:48.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:48.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:48.793 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:48.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:48.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:48.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:48.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:48.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:48.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:48.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:48.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:48.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:48.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:48.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:48.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: osdmap e574: 8 total, 8 up, 8 in 2024-03-04T06:50:48.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:48.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:48.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:48.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:48.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:48.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:48.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:48.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:48.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:48.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:48.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:48.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:48.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:48.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:48.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:48.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: osdmap e574: 8 total, 8 up, 8 in 2024-03-04T06:50:48.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:48.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:48.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:48.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:48.875 INFO:tasks.rados.rados.0.smithi137.stdout:2712: finishing copy_from racing read to smithi13777483-13 2024-03-04T06:50:48.875 INFO:tasks.rados.rados.0.smithi137.stdout:2712: finishing copy_from to smithi13777483-13 2024-03-04T06:50:48.875 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16855 (ObjNum 771 snap 228 seq_num 771) dirty exists 2024-03-04T06:50:48.875 INFO:tasks.rados.rados.0.smithi137.stdout:2714: finishing copy_from racing read to smithi13777483-18 2024-03-04T06:50:48.875 INFO:tasks.rados.rados.0.smithi137.stdout:2714: finishing copy_from to smithi13777483-18 2024-03-04T06:50:48.875 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16833 (ObjNum 113 snap 0 seq_num 3981306310) dirty exists 2024-03-04T06:50:48.875 INFO:tasks.rados.rados.0.smithi137.stdout:2712: done (2 left) 2024-03-04T06:50:48.875 INFO:tasks.rados.rados.0.smithi137.stdout:2714: done (1 left) 2024-03-04T06:50:48.875 INFO:tasks.rados.rados.0.smithi137.stdout:2715: done (0 left) 2024-03-04T06:50:48.876 INFO:tasks.rados.rados.0.smithi137.stdout:2716: rmattr oid 31 current snap is 253 2024-03-04T06:50:48.876 INFO:tasks.rados.rados.0.smithi137.stdout:2716: done (0 left) 2024-03-04T06:50:48.876 INFO:tasks.rados.rados.0.smithi137.stdout:2717: setattr oid 17 current snap is 253 2024-03-04T06:50:48.876 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 253 2024-03-04T06:50:48.877 INFO:tasks.rados.rados.0.smithi137.stdout:2718: seq_num 858 ranges {1187840=778240,1966080=729088,2695168=434176,3129344=442368} 2024-03-04T06:50:48.888 INFO:tasks.rados.rados.0.smithi137.stdout:2718: writing smithi13777483-47 from 1187840 to 1966080 tid 1 2024-03-04T06:50:48.893 INFO:tasks.rados.rados.0.smithi137.stdout:2718: writing smithi13777483-47 from 1966080 to 2695168 tid 2 2024-03-04T06:50:48.896 INFO:tasks.rados.rados.0.smithi137.stdout:2718: writing smithi13777483-47 from 2695168 to 3129344 tid 3 2024-03-04T06:50:48.899 INFO:tasks.rados.rados.0.smithi137.stdout:2718: writing smithi13777483-47 from 3129344 to 3571712 tid 4 2024-03-04T06:50:48.900 INFO:tasks.rados.rados.0.smithi137.stdout:2719: read oid 43 snap -1 2024-03-04T06:50:48.900 INFO:tasks.rados.rados.0.smithi137.stdout:2719: expect (ObjNum 822 snap 236 seq_num 822) 2024-03-04T06:50:48.900 INFO:tasks.rados.rados.0.smithi137.stdout:2720: snap_remove snap 248 2024-03-04T06:50:49.096 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:48.877+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:49.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:48.876+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:49.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:48.878+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:49.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:48.881+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:49.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:48.881+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:49.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:48.882+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:49.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:48.882+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:49.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:48.882+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:49.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:48.882+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:49.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:48.873+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:49.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:48.876+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:49.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:48.877+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:49.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: pgmap v540: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 429 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1023 B/s rd, 3.2 MiB/s wr, 13 op/s 2024-03-04T06:50:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: osdmap e575: 8 total, 8 up, 8 in 2024-03-04T06:50:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:49.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:49.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:49.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:50:49.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:49.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:49.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:49.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:49.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:49.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:49.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:49.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: pgmap v540: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 429 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1023 B/s rd, 3.2 MiB/s wr, 13 op/s 2024-03-04T06:50:49.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: osdmap e575: 8 total, 8 up, 8 in 2024-03-04T06:50:49.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:49.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:49.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:49.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:49.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:49.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:49.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:49.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:49.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:49.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:50:49.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:49.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:49.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:49.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:49.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:49.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:49.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:49.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: pgmap v540: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 429 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1023 B/s rd, 3.2 MiB/s wr, 13 op/s 2024-03-04T06:50:49.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: osdmap e575: 8 total, 8 up, 8 in 2024-03-04T06:50:49.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:49.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:49.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:49.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:49.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:49.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:49.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:49.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:49.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:50:49.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:50:49.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:49.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:49.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:49.876 INFO:tasks.rados.rados.0.smithi137.stdout:2720: done (3 left) 2024-03-04T06:50:49.876 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 253 2024-03-04T06:50:49.877 INFO:tasks.rados.rados.0.smithi137.stdout:2721: seq_num 859 ranges {0=794624,794624=614400,1409024=638976,2048000=352256} 2024-03-04T06:50:49.882 INFO:tasks.rados.rados.0.smithi137.stdout:2721: writing smithi13777483-14 from 0 to 794624 tid 1 2024-03-04T06:50:49.886 INFO:tasks.rados.rados.0.smithi137.stdout:2721: writing smithi13777483-14 from 794624 to 1409024 tid 2 2024-03-04T06:50:49.889 INFO:tasks.rados.rados.0.smithi137.stdout:2721: writing smithi13777483-14 from 1409024 to 2048000 tid 3 2024-03-04T06:50:49.891 INFO:tasks.rados.rados.0.smithi137.stdout:2721: writing smithi13777483-14 from 2048000 to 2400256 tid 4 2024-03-04T06:50:49.892 INFO:tasks.rados.rados.0.smithi137.stdout:2722: snap_remove snap 245 2024-03-04T06:50:50.148 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:49.878+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:50.148 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:49.873+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:50.149 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:49.898+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:50.149 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:49.898+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:50.149 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:49.898+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:50.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:49.878+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:50.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:49.873+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:50.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:49.873+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:50.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:49.886+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:50.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:49.886+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:50.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:49.877+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:50.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:49.877+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: Upgrade: Setting container_image for all mds 2024-03-04T06:50:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]: dispatch 2024-03-04T06:50:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]': finished 2024-03-04T06:50:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]: dispatch 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]': finished 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: Upgrade: Setting container_image for all rgw 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: Upgrade: Setting container_image for all rbd-mirror 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: Upgrade: Setting container_image for all ceph-exporter 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:50.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:50.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:50.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:50.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:50.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: Upgrade: Setting container_image for all mds 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]: dispatch 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]': finished 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]: dispatch 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]': finished 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: Upgrade: Setting container_image for all rgw 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: Upgrade: Setting container_image for all rbd-mirror 2024-03-04T06:50:50.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: Upgrade: Setting container_image for all ceph-exporter 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: osdmap e576: 8 total, 8 up, 8 in 2024-03-04T06:50:50.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:50.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:50.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:50.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:50.549 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:50.549 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: osdmap e576: 8 total, 8 up, 8 in 2024-03-04T06:50:50.549 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:50.549 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:50.549 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:50.549 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: Upgrade: Setting container_image for all mds 2024-03-04T06:50:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]: dispatch 2024-03-04T06:50:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]': finished 2024-03-04T06:50:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]: dispatch 2024-03-04T06:50:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]': finished 2024-03-04T06:50:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: Upgrade: Setting container_image for all rgw 2024-03-04T06:50:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: Upgrade: Setting container_image for all rbd-mirror 2024-03-04T06:50:50.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: Upgrade: Setting container_image for all ceph-exporter 2024-03-04T06:50:50.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:50.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:50.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:50.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:50.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: osdmap e576: 8 total, 8 up, 8 in 2024-03-04T06:50:50.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:50.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:50.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:50.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:50.878 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16861 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:50:50.878 INFO:tasks.rados.rados.0.smithi137.stdout:2718: finishing write tid 1 to smithi13777483-47 2024-03-04T06:50:50.879 INFO:tasks.rados.rados.0.smithi137.stdout:2718: finishing write tid 2 to smithi13777483-47 2024-03-04T06:50:50.879 INFO:tasks.rados.rados.0.smithi137.stdout:2718: finishing write tid 3 to smithi13777483-47 2024-03-04T06:50:50.879 INFO:tasks.rados.rados.0.smithi137.stdout:2718: finishing write tid 4 to smithi13777483-47 2024-03-04T06:50:50.879 INFO:tasks.rados.rados.0.smithi137.stdout:2718: finishing write tid 5 to smithi13777483-47 2024-03-04T06:50:50.879 INFO:tasks.rados.rados.0.smithi137.stdout:2718: finishing write tid 6 to smithi13777483-47 2024-03-04T06:50:50.879 INFO:tasks.rados.rados.0.smithi137.stdout:2718: oid 47 updating version 0 to 16863 2024-03-04T06:50:50.879 INFO:tasks.rados.rados.0.smithi137.stdout:2718: oid 47 version 16863 is already newer than 16861 2024-03-04T06:50:50.879 INFO:tasks.rados.rados.0.smithi137.stdout:2718: oid 47 version 16863 is already newer than 16860 2024-03-04T06:50:50.879 INFO:tasks.rados.rados.0.smithi137.stdout:2718: oid 47 updating version 16863 to 16864 2024-03-04T06:50:50.879 INFO:tasks.rados.rados.0.smithi137.stdout:2718: oid 47 version 16864 is already newer than 16862 2024-03-04T06:50:50.879 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16864 (ObjNum 858 snap 253 seq_num 858) dirty exists 2024-03-04T06:50:50.879 INFO:tasks.rados.rados.0.smithi137.stdout:2718: left oid 47 (ObjNum 858 snap 253 seq_num 858) 2024-03-04T06:50:50.879 INFO:tasks.rados.rados.0.smithi137.stdout:2719: expect (ObjNum 822 snap 236 seq_num 822) 2024-03-04T06:50:50.987 INFO:tasks.rados.rados.0.smithi137.stdout:2721: finishing write tid 1 to smithi13777483-14 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:2721: finishing write tid 2 to smithi13777483-14 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:2717: done (4 left) 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:2718: done (3 left) 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:2719: done (2 left) 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:2722: done (1 left) 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 253 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:2721: finishing write tid 3 to smithi13777483-14 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:2721: finishing write tid 4 to smithi13777483-14 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:2721: finishing write tid 5 to smithi13777483-14 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:2721: finishing write tid 6 to smithi13777483-14 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:2721: oid 14 updating version 0 to 16867 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:2721: oid 14 updating version 16867 to 16869 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:2721: oid 14 updating version 16869 to 16870 2024-03-04T06:50:50.988 INFO:tasks.rados.rados.0.smithi137.stdout:2721: oid 14 version 16870 is already newer than 16868 2024-03-04T06:50:50.989 INFO:tasks.rados.rados.0.smithi137.stdout:2721: oid 14 updating version 16870 to 16871 2024-03-04T06:50:50.989 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 16871 (ObjNum 859 snap 253 seq_num 859) dirty exists 2024-03-04T06:50:50.989 INFO:tasks.rados.rados.0.smithi137.stdout:2721: left oid 14 (ObjNum 859 snap 253 seq_num 859) 2024-03-04T06:50:50.989 INFO:tasks.rados.rados.0.smithi137.stdout:2723: seq_num 860 ranges {0=8192} 2024-03-04T06:50:50.989 INFO:tasks.rados.rados.0.smithi137.stdout:2723: writing smithi13777483-19 from 0 to 8192 tid 1 2024-03-04T06:50:50.989 INFO:tasks.rados.rados.0.smithi137.stdout:2721: done (1 left) 2024-03-04T06:50:50.989 INFO:tasks.rados.rados.0.smithi137.stdout:2724: snap_create 2024-03-04T06:50:50.990 INFO:tasks.rados.rados.0.smithi137.stdout:2723: finishing write tid 1 to smithi13777483-19 2024-03-04T06:50:50.991 INFO:tasks.rados.rados.0.smithi137.stdout:2723: finishing write tid 2 to smithi13777483-19 2024-03-04T06:50:50.992 INFO:tasks.rados.rados.0.smithi137.stdout:2723: finishing write tid 3 to smithi13777483-19 2024-03-04T06:50:50.992 INFO:tasks.rados.rados.0.smithi137.stdout:2723: oid 19 updating version 0 to 15591 2024-03-04T06:50:50.992 INFO:tasks.rados.rados.0.smithi137.stdout:2723: oid 19 version 15591 is already newer than 15590 2024-03-04T06:50:50.992 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 15591 (ObjNum 860 snap 253 seq_num 860) dirty exists 2024-03-04T06:50:50.993 INFO:tasks.rados.rados.0.smithi137.stdout:2723: left oid 19 (ObjNum 860 snap 253 seq_num 860) 2024-03-04T06:50:51.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:50.883+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:51.295 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:50.875+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:51.296 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:50.990+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:51.296 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:50.990+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:51.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:50.883+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:51.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:50.880+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:51.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:50.880+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:51.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:50.880+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:51.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:50.875+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:51.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:50.875+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:51.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:50.875+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:51.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: Upgrade: Setting container_image for all iscsi 2024-03-04T06:50:51.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: Upgrade: Setting container_image for all nfs 2024-03-04T06:50:51.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: Upgrade: Setting container_image for all nvmeof 2024-03-04T06:50:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: pgmap v543: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 429 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 767 B/s rd, 1.9 MiB/s wr, 11 op/s 2024-03-04T06:50:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: osdmap e577: 8 total, 8 up, 8 in 2024-03-04T06:50:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:51.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: Upgrade: Setting container_image for all iscsi 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: Upgrade: Setting container_image for all nfs 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: Upgrade: Setting container_image for all nvmeof 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: pgmap v543: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 429 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 767 B/s rd, 1.9 MiB/s wr, 11 op/s 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: osdmap e577: 8 total, 8 up, 8 in 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:51.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:51.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:51.581+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: Upgrade: Setting container_image for all iscsi 2024-03-04T06:50:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: Upgrade: Setting container_image for all nfs 2024-03-04T06:50:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: Upgrade: Setting container_image for all nvmeof 2024-03-04T06:50:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:51.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: pgmap v543: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 429 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 767 B/s rd, 1.9 MiB/s wr, 11 op/s 2024-03-04T06:50:51.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:51.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:51.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:51.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: osdmap e577: 8 total, 8 up, 8 in 2024-03-04T06:50:51.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:51.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:51.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:51.879 INFO:tasks.rados.rados.0.smithi137.stdout:2723: done (1 left) 2024-03-04T06:50:51.879 INFO:tasks.rados.rados.0.smithi137.stdout:2724: done (0 left) 2024-03-04T06:50:51.879 INFO:tasks.rados.rados.0.smithi137.stdout:2725: read oid 30 snap -1 2024-03-04T06:50:51.879 INFO:tasks.rados.rados.0.smithi137.stdout:2725: expect (ObjNum 639 snap 178 seq_num 639) 2024-03-04T06:50:51.879 INFO:tasks.rados.rados.0.smithi137.stdout:2726: snap_remove snap 246 2024-03-04T06:50:52.083 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:51 smithi137 systemd[1]: Stopping Ceph node-exporter.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:50:52.084 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:51.877+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:52.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:51.881+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:52.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:51.877+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:52.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:51.877+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:52.349 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:52 smithi137 podman[120545]: 2024-03-04 06:50:52.084217649 +0000 UTC m=+0.121232908 container died f011a698fd197a9742cd547860f2303805933e76be0f5c013cf03038869d4345 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-04T06:50:52.793 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:52 smithi137 podman[120545]: 2024-03-04 06:50:52.532559968 +0000 UTC m=+0.569575233 container cleanup f011a698fd197a9742cd547860f2303805933e76be0f5c013cf03038869d4345 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-04T06:50:52.793 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:52 smithi137 bash[120545]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a 2024-03-04T06:50:52.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:52.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:52.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:52.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[88869]: Upgrade: Updating node-exporter.a (1/2) 2024-03-04T06:50:52.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[88869]: Deploying daemon node-exporter.a on smithi137 2024-03-04T06:50:52.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:52.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:52.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[88869]: osdmap e578: 8 total, 8 up, 8 in 2024-03-04T06:50:52.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[91314]: Upgrade: Updating node-exporter.a (1/2) 2024-03-04T06:50:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[91314]: Deploying daemon node-exporter.a on smithi137 2024-03-04T06:50:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[91314]: osdmap e578: 8 total, 8 up, 8 in 2024-03-04T06:50:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:52.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-mon[85573]: Upgrade: Updating node-exporter.a (1/2) 2024-03-04T06:50:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-mon[85573]: Deploying daemon node-exporter.a on smithi137 2024-03-04T06:50:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-mon[85573]: osdmap e578: 8 total, 8 up, 8 in 2024-03-04T06:50:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:52.882 INFO:tasks.rados.rados.0.smithi137.stdout:2726: done (1 left) 2024-03-04T06:50:52.882 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 33 current snap is 254 2024-03-04T06:50:52.882 INFO:tasks.rados.rados.0.smithi137.stdout:2727: seq_num 861 ranges {11157504=24576} 2024-03-04T06:50:52.942 INFO:tasks.rados.rados.0.smithi137.stdout:2727: writing smithi13777483-33 from 11157504 to 11182080 tid 1 2024-03-04T06:50:52.942 INFO:tasks.rados.rados.0.smithi137.stdout:2728: delete oid 16 current snap is 254 2024-03-04T06:50:52.942 INFO:tasks.rados.rados.0.smithi137.stdout:2725: expect (ObjNum 639 snap 178 seq_num 639) 2024-03-04T06:50:52.996 INFO:tasks.rados.rados.0.smithi137.stdout:2727: finishing write tid 1 to smithi13777483-33 2024-03-04T06:50:52.996 INFO:tasks.rados.rados.0.smithi137.stdout:2727: finishing write tid 2 to smithi13777483-33 2024-03-04T06:50:52.996 INFO:tasks.rados.rados.0.smithi137.stdout:2727: finishing write tid 3 to smithi13777483-33 2024-03-04T06:50:52.996 INFO:tasks.rados.rados.0.smithi137.stdout:2727: oid 33 updating version 0 to 16881 2024-03-04T06:50:52.996 INFO:tasks.rados.rados.0.smithi137.stdout:2727: oid 33 updating version 16881 to 16882 2024-03-04T06:50:52.996 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16882 (ObjNum 861 snap 254 seq_num 861) dirty exists 2024-03-04T06:50:52.996 INFO:tasks.rados.rados.0.smithi137.stdout:2727: left oid 33 (ObjNum 861 snap 254 seq_num 861) 2024-03-04T06:50:52.996 INFO:tasks.rados.rados.0.smithi137.stdout:2725: done (2 left) 2024-03-04T06:50:52.996 INFO:tasks.rados.rados.0.smithi137.stdout:2727: done (1 left) 2024-03-04T06:50:52.996 INFO:tasks.rados.rados.0.smithi137.stdout:2728: done (0 left) 2024-03-04T06:50:52.996 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 254 2024-03-04T06:50:52.997 INFO:tasks.rados.rados.0.smithi137.stdout:2729: seq_num 863 ranges {7577600=57344} 2024-03-04T06:50:53.040 INFO:tasks.rados.rados.0.smithi137.stdout:2729: writing smithi13777483-9 from 7577600 to 7634944 tid 1 2024-03-04T06:50:53.040 INFO:tasks.rados.rados.0.smithi137.stdout:2730: snap_remove snap 253 2024-03-04T06:50:53.143 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:52.880+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:53.143 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:52.880+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:53.143 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:52.881+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:53.144 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:52.889+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:53.144 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:52.883+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:53.144 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:52 smithi137 podman[120559]: 2024-03-04 06:50:52.825796627 +0000 UTC m=+0.745799176 container remove f011a698fd197a9742cd547860f2303805933e76be0f5c013cf03038869d4345 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-04T06:50:53.144 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:52 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-03-04T06:50:53.144 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:52 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-03-04T06:50:53.144 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:52 smithi137 systemd[1]: Stopped Ceph node-exporter.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:50:53.144 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:52 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.a.service: Consumed 2.780s CPU time. 2024-03-04T06:50:53.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:52.879+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:53.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:52.879+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:53.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:52.879+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:53.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:52.946+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:53.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:52.946+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:53.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:52.883+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:53.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:52.884+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:53.347 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:52.883+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:53.516 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 systemd[1]: Starting Ceph node-exporter.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:50:53.516 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 podman[120693]: 2024-03-04 06:50:53.276211798 +0000 UTC m=+0.017821012 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-03-04T06:50:53.516 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 podman[120693]: 2024-03-04 06:50:53.393550665 +0000 UTC m=+0.135159870 container create ff9dbbaf9aebe2148a4b815632e0056f1e78e190afedb0a48f3e66fe1559f55c (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-04T06:50:53.516 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:53.516 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:53.516 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[88869]: pgmap v546: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 429 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-03-04T06:50:53.516 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[88869]: osdmap e579: 8 total, 8 up, 8 in 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[91314]: pgmap v546: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 429 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[91314]: osdmap e579: 8 total, 8 up, 8 in 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:53.517 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:53.518 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:53.518 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:53.661 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:53.661 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:53.662 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-mon[85573]: pgmap v546: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 429 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-03-04T06:50:53.662 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-mon[85573]: osdmap e579: 8 total, 8 up, 8 in 2024-03-04T06:50:53.662 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:53.662 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:53.662 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:53.662 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:53.662 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:53.662 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:53.793 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 podman[120693]: 2024-03-04 06:50:53.629319114 +0000 UTC m=+0.370928326 container init ff9dbbaf9aebe2148a4b815632e0056f1e78e190afedb0a48f3e66fe1559f55c (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-04T06:50:53.793 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 podman[120693]: 2024-03-04 06:50:53.632253496 +0000 UTC m=+0.373862703 container start ff9dbbaf9aebe2148a4b815632e0056f1e78e190afedb0a48f3e66fe1559f55c (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-04T06:50:53.793 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.636Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-04T06:50:53.793 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.636Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-04T06:50:53.793 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.636Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-04T06:50:53.794 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.636Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-04T06:50:53.794 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.636Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-04T06:50:53.794 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.636Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-04T06:50:53.794 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-04T06:50:53.794 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=arp 2024-03-04T06:50:53.794 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-04T06:50:53.794 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-04T06:50:53.794 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-04T06:50:53.794 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-04T06:50:53.794 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-04T06:50:53.794 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-04T06:50:53.795 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-04T06:50:53.795 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-04T06:50:53.795 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=edac 2024-03-04T06:50:53.795 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-04T06:50:53.795 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-04T06:50:53.795 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-04T06:50:53.795 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-04T06:50:53.795 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-04T06:50:53.795 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-04T06:50:53.796 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-04T06:50:53.796 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-04T06:50:53.796 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-04T06:50:53.796 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-04T06:50:53.796 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-04T06:50:53.796 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-04T06:50:53.796 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-04T06:50:53.796 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-04T06:50:53.796 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-04T06:50:53.796 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-04T06:50:53.796 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=os 2024-03-04T06:50:53.796 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-04T06:50:53.797 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-04T06:50:53.797 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-04T06:50:53.797 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-04T06:50:53.797 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-04T06:50:53.797 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-04T06:50:53.797 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-04T06:50:53.797 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=stat 2024-03-04T06:50:53.797 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-04T06:50:53.797 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-04T06:50:53.797 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-04T06:50:53.797 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=time 2024-03-04T06:50:53.797 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-04T06:50:53.797 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=uname 2024-03-04T06:50:53.798 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-04T06:50:53.798 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-04T06:50:53.798 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-04T06:50:53.798 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-04T06:50:53.798 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a[120708]: ts=2024-03-04T06:50:53.637Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-04T06:50:53.798 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 bash[120693]: ff9dbbaf9aebe2148a4b815632e0056f1e78e190afedb0a48f3e66fe1559f55c 2024-03-04T06:50:53.798 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 06:50:53 smithi137 systemd[1]: Started Ceph node-exporter.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:50:53.882 INFO:tasks.rados.rados.0.smithi137.stdout:2730: done (1 left) 2024-03-04T06:50:53.882 INFO:tasks.rados.rados.0.smithi137.stdout:2731: rmattr oid 26 current snap is 254 2024-03-04T06:50:53.882 INFO:tasks.rados.rados.0.smithi137.stdout:2732: delete oid 17 current snap is 254 2024-03-04T06:50:53.882 INFO:tasks.rados.rados.0.smithi137.stdout:2729: finishing write tid 1 to smithi13777483-9 2024-03-04T06:50:53.882 INFO:tasks.rados.rados.0.smithi137.stdout:2729: finishing write tid 2 to smithi13777483-9 2024-03-04T06:50:53.883 INFO:tasks.rados.rados.0.smithi137.stdout:2729: finishing write tid 3 to smithi13777483-9 2024-03-04T06:50:53.883 INFO:tasks.rados.rados.0.smithi137.stdout:2729: oid 9 updating version 0 to 15592 2024-03-04T06:50:53.883 INFO:tasks.rados.rados.0.smithi137.stdout:2729: oid 9 updating version 15592 to 15593 2024-03-04T06:50:53.883 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 15593 (ObjNum 863 snap 254 seq_num 863) dirty exists 2024-03-04T06:50:53.883 INFO:tasks.rados.rados.0.smithi137.stdout:2729: left oid 9 (ObjNum 863 snap 254 seq_num 863) 2024-03-04T06:50:53.887 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16844 (ObjNum 852 snap 249 seq_num 852) dirty exists 2024-03-04T06:50:53.888 INFO:tasks.rados.rados.0.smithi137.stdout:2729: done (2 left) 2024-03-04T06:50:53.888 INFO:tasks.rados.rados.0.smithi137.stdout:2731: done (1 left) 2024-03-04T06:50:53.888 INFO:tasks.rados.rados.0.smithi137.stdout:2732: done (0 left) 2024-03-04T06:50:53.888 INFO:tasks.rados.rados.0.smithi137.stdout:2733: rollback oid 41 current snap is 254 2024-03-04T06:50:53.888 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 41 to 249 2024-03-04T06:50:53.888 INFO:tasks.rados.rados.0.smithi137.stdout:2734: read oid 26 snap -1 2024-03-04T06:50:53.888 INFO:tasks.rados.rados.0.smithi137.stdout:2734: expect (ObjNum 852 snap 249 seq_num 852) 2024-03-04T06:50:53.889 INFO:tasks.rados.rados.0.smithi137.stdout:2735: delete oid 43 current snap is 254 2024-03-04T06:50:53.891 INFO:tasks.rados.rados.0.smithi137.stdout:2735: done (2 left) 2024-03-04T06:50:53.891 INFO:tasks.rados.rados.0.smithi137.stdout:2736: read oid 17 snap -1 2024-03-04T06:50:53.891 INFO:tasks.rados.rados.0.smithi137.stdout:2736: expect deleted 2024-03-04T06:50:53.891 INFO:tasks.rados.rados.0.smithi137.stdout:2737: read oid 48 snap 250 2024-03-04T06:50:53.891 INFO:tasks.rados.rados.0.smithi137.stdout:2737: expect deleted 2024-03-04T06:50:53.891 INFO:tasks.rados.rados.0.smithi137.stdout:2738: rollback oid 29 current snap is 254 2024-03-04T06:50:53.891 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 29 to 247 2024-03-04T06:50:53.891 INFO:tasks.rados.rados.0.smithi137.stdout:2739: snap_remove snap 241 2024-03-04T06:50:54.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:53.879+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:54.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:53.885+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:54.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:53.886+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:54.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:53.886+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:54.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:53.886+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:54.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:53.887+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:54.231 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:53.878+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:54.231 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:53.882+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:54.231 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:53.882+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:54.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:54.229+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:54.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:54.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:54.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:54.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:54.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:50:54.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:54.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:54.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:54.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[88869]: osdmap e580: 8 total, 8 up, 8 in 2024-03-04T06:50:54.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:54.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:54.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:54.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:54.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:54.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:54.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:54.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:54.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:50:54.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:54.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:54.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:54.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[91314]: osdmap e580: 8 total, 8 up, 8 in 2024-03-04T06:50:54.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:54.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:54.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:54.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:54.720 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:54.721 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:54.721 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:54.721 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:54.721 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:50:54.721 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:54.721 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:54.721 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:54.721 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-mon[85573]: osdmap e580: 8 total, 8 up, 8 in 2024-03-04T06:50:54.721 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:54.721 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:54.721 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset 125=[]:{118=[118,117,116,114,110,10f,10e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:54.721 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:54.888 INFO:tasks.rados.rados.0.smithi137.stdout:2739: done (5 left) 2024-03-04T06:50:54.889 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 254 2024-03-04T06:50:54.889 INFO:tasks.rados.rados.0.smithi137.stdout:2733: finishing rollback tid 0 to smithi13777483-41 2024-03-04T06:50:54.889 INFO:tasks.rados.rados.0.smithi137.stdout:2733: finishing rollback tid 1 to smithi13777483-41 2024-03-04T06:50:54.889 INFO:tasks.rados.rados.0.smithi137.stdout:2740: seq_num 866 ranges {8192=106496} 2024-03-04T06:50:54.889 INFO:tasks.rados.rados.0.smithi137.stdout:2740: writing smithi13777483-19 from 8192 to 114688 tid 1 2024-03-04T06:50:54.889 INFO:tasks.rados.rados.0.smithi137.stdout:2736: done (5 left) 2024-03-04T06:50:54.890 INFO:tasks.rados.rados.0.smithi137.stdout:2737: done (4 left) 2024-03-04T06:50:54.890 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 254 2024-03-04T06:50:54.890 INFO:tasks.rados.rados.0.smithi137.stdout:2733: finishing rollback tid 2 to smithi13777483-41 2024-03-04T06:50:54.890 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 16858 (ObjNum 822 snap 236 seq_num 822) dirty exists 2024-03-04T06:50:54.890 INFO:tasks.rados.rados.0.smithi137.stdout:2741: seq_num 867 ranges {1572864=122880} 2024-03-04T06:50:54.899 INFO:tasks.rados.rados.0.smithi137.stdout:2741: writing smithi13777483-46 from 1572864 to 1695744 tid 1 2024-03-04T06:50:54.899 INFO:tasks.rados.rados.0.smithi137.stdout:2733: done (4 left) 2024-03-04T06:50:54.899 INFO:tasks.rados.rados.0.smithi137.stdout:2742: setattr oid 32 current snap is 254 2024-03-04T06:50:54.899 INFO:tasks.rados.rados.0.smithi137.stdout:2738: finishing rollback tid 1 to smithi13777483-29 2024-03-04T06:50:54.899 INFO:tasks.rados.rados.0.smithi137.stdout:2738: finishing rollback tid 2 to smithi13777483-29 2024-03-04T06:50:54.899 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16846 (ObjNum 822 snap 236 seq_num 822) dirty exists 2024-03-04T06:50:54.899 INFO:tasks.rados.rados.0.smithi137.stdout:2734: expect (ObjNum 852 snap 249 seq_num 852) 2024-03-04T06:50:55.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:54.893+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:55.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:54.921+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:55.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:54.889+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:55.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:54.889+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:55.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:54.889+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:55.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:54.895+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:55.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:54.895+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:55.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:54.890+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:55.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:54.901+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:55.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:54.896+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:55.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:54.896+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:55.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:54.897+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:55.525 INFO:tasks.rados.rados.0.smithi137.stdout:2740: finishing write tid 1 to smithi13777483-19 2024-03-04T06:50:55.526 INFO:tasks.rados.rados.0.smithi137.stdout:2740: finishing write tid 2 to smithi13777483-19 2024-03-04T06:50:55.526 INFO:tasks.rados.rados.0.smithi137.stdout:2741: finishing write tid 1 to smithi13777483-46 2024-03-04T06:50:55.526 INFO:tasks.rados.rados.0.smithi137.stdout:2741: finishing write tid 2 to smithi13777483-46 2024-03-04T06:50:55.526 INFO:tasks.rados.rados.0.smithi137.stdout:2740: finishing write tid 3 to smithi13777483-19 2024-03-04T06:50:55.526 INFO:tasks.rados.rados.0.smithi137.stdout:2740: oid 19 updating version 0 to 15594 2024-03-04T06:50:55.526 INFO:tasks.rados.rados.0.smithi137.stdout:2740: oid 19 updating version 15594 to 15595 2024-03-04T06:50:55.526 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 15595 (ObjNum 866 snap 254 seq_num 866) dirty exists 2024-03-04T06:50:55.527 INFO:tasks.rados.rados.0.smithi137.stdout:2740: left oid 19 (ObjNum 866 snap 254 seq_num 866) 2024-03-04T06:50:55.527 INFO:tasks.rados.rados.0.smithi137.stdout:2741: finishing write tid 3 to smithi13777483-46 2024-03-04T06:50:55.527 INFO:tasks.rados.rados.0.smithi137.stdout:2741: oid 46 updating version 0 to 16879 2024-03-04T06:50:55.527 INFO:tasks.rados.rados.0.smithi137.stdout:2741: oid 46 updating version 16879 to 16880 2024-03-04T06:50:55.527 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 16880 (ObjNum 867 snap 254 seq_num 867) dirty exists 2024-03-04T06:50:55.527 INFO:tasks.rados.rados.0.smithi137.stdout:2741: left oid 46 (ObjNum 867 snap 254 seq_num 867) 2024-03-04T06:50:55.527 INFO:tasks.rados.rados.0.smithi137.stdout:2734: done (4 left) 2024-03-04T06:50:55.527 INFO:tasks.rados.rados.0.smithi137.stdout:2738: done (3 left) 2024-03-04T06:50:55.527 INFO:tasks.rados.rados.0.smithi137.stdout:2740: done (2 left) 2024-03-04T06:50:55.527 INFO:tasks.rados.rados.0.smithi137.stdout:2741: done (1 left) 2024-03-04T06:50:55.527 INFO:tasks.rados.rados.0.smithi137.stdout:2743: rmattr oid 10 current snap is 254 2024-03-04T06:50:55.527 INFO:tasks.rados.rados.0.smithi137.stdout:2744: copy_from oid 19 from oid 43 current snap is 254 2024-03-04T06:50:55.527 INFO:tasks.rados.rados.0.smithi137.stdout:2745: snap_remove snap 251 2024-03-04T06:50:55.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:55 smithi203 ceph-mon[85573]: pgmap v549: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-03-04T06:50:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:55 smithi203 ceph-mon[85573]: osdmap e581: 8 total, 8 up, 8 in 2024-03-04T06:50:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:55.785 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:50:55] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:50:55.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:55.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:55.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:55.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:55.786 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[91314]: pgmap v549: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-03-04T06:50:55.786 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[91314]: osdmap e581: 8 total, 8 up, 8 in 2024-03-04T06:50:55.786 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:55.786 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:55.786 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:55.786 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:55.786 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:55.786 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:55.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:55.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:55.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:55.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:55.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[88869]: pgmap v549: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-03-04T06:50:55.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[88869]: osdmap e581: 8 total, 8 up, 8 in 2024-03-04T06:50:55.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:55.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:55.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:55.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:55.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:55.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:56.346 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:56 smithi203 systemd[1]: Stopping Ceph node-exporter.b for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:50:56.398 INFO:tasks.rados.rados.0.smithi137.stdout:2745: done (3 left) 2024-03-04T06:50:56.398 INFO:tasks.rados.rados.0.smithi137.stdout:2746: rollback oid 11 current snap is 254 2024-03-04T06:50:56.399 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 11 to 238 2024-03-04T06:50:56.399 INFO:tasks.rados.rados.0.smithi137.stdout:2744: finishing copy_from to smithi13777483-19 2024-03-04T06:50:56.399 INFO:tasks.rados.rados.0.smithi137.stdout:2744: got expected ENOENT (src dne) 2024-03-04T06:50:56.399 INFO:tasks.rados.rados.0.smithi137.stdout:2744: finishing copy_from racing read to smithi13777483-19 2024-03-04T06:50:56.399 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15596 (ObjNum 289 snap 0 seq_num 1) dirty exists 2024-03-04T06:50:56.399 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16881 (ObjNum 854 snap 249 seq_num 854) dirty exists 2024-03-04T06:50:56.399 INFO:tasks.rados.rados.0.smithi137.stdout:2742: done (3 left) 2024-03-04T06:50:56.399 INFO:tasks.rados.rados.0.smithi137.stdout:2743: done (2 left) 2024-03-04T06:50:56.399 INFO:tasks.rados.rados.0.smithi137.stdout:2744: done (1 left) 2024-03-04T06:50:56.399 INFO:tasks.rados.rados.0.smithi137.stdout:2747: rollback oid 27 current snap is 254 2024-03-04T06:50:56.399 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 27 to 238 2024-03-04T06:50:56.399 INFO:tasks.rados.rados.0.smithi137.stdout:2748: rollback oid 29 current snap is 254 2024-03-04T06:50:56.399 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 29 to 238 2024-03-04T06:50:56.400 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 254 2024-03-04T06:50:56.400 INFO:tasks.rados.rados.0.smithi137.stdout:2749: seq_num 868 ranges {6160384=139264} 2024-03-04T06:50:56.434 INFO:tasks.rados.rados.0.smithi137.stdout:2749: writing smithi13777483-38 from 6160384 to 6299648 tid 1 2024-03-04T06:50:56.434 INFO:tasks.rados.rados.0.smithi137.stdout:2750: read oid 49 snap -1 2024-03-04T06:50:56.434 INFO:tasks.rados.rados.0.smithi137.stdout:2750: expect (ObjNum 844 snap 246 seq_num 844) 2024-03-04T06:50:56.434 INFO:tasks.rados.rados.0.smithi137.stdout:2751: snap_remove snap 252 2024-03-04T06:50:56.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:56.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:56.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:56.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:56.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-mon[91314]: Upgrade: Updating node-exporter.b (2/2) 2024-03-04T06:50:56.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-mon[91314]: Deploying daemon node-exporter.b on smithi203 2024-03-04T06:50:56.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:56.402+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:56.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:56.403+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-mon[88869]: Upgrade: Updating node-exporter.b (2/2) 2024-03-04T06:50:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-mon[88869]: Deploying daemon node-exporter.b on smithi203 2024-03-04T06:50:56.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:56.408+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:56.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:56.409+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:56.648 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:56 smithi203 podman[112903]: 2024-03-04 06:50:56.383096017 +0000 UTC m=+0.152814426 container died 927137a7bb60ce80bd333decbee17b9e8366d047f34b9fd831c5b7fb0ec80604 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-04T06:50:56.649 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:56.406+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:56.649 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:56.399+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:56.649 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:56.399+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:56.649 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:56.437+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:56.649 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:56.437+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:56.650 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:56.650 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:56.650 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:56.650 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:56.650 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-mon[85573]: Upgrade: Updating node-exporter.b (2/2) 2024-03-04T06:50:56.650 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-mon[85573]: Deploying daemon node-exporter.b on smithi203 2024-03-04T06:50:56.650 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:56.406+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:56.650 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:56.406+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:56.650 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:56.406+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:56.871 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:50:57.095 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:56 smithi203 podman[112903]: 2024-03-04 06:50:56.764789347 +0000 UTC m=+0.534507756 container cleanup 927137a7bb60ce80bd333decbee17b9e8366d047f34b9fd831c5b7fb0ec80604 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-04T06:50:57.096 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:56 smithi203 bash[112903]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b 2024-03-04T06:50:57.187 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:50:57.187 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (10m) 35s ago 11m 26.4M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:50:57.187 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (11m) 12s ago 11m 88.9M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:50:57.187 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (38s) 35s ago 12m 14.9M - 19.0.0-1791-gefb04e5e 0c401cd3e778 b6a5f9352182 2024-03-04T06:50:57.187 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (16s) 12s ago 12m 11.3M - 19.0.0-1791-gefb04e5e 0c401cd3e778 6797a1307e30 2024-03-04T06:50:57.188 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (6m) 12s ago 16m 451M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:50:57.188 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (7m) 35s ago 18m 511M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:50:57.188 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (6m) 35s ago 18m 66.8M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:50:57.188 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (5m) 12s ago 16m 51.4M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:50:57.188 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (6m) 35s ago 16m 55.2M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:50:57.188 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 starting - - - - 2024-03-04T06:50:57.188 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (11m) 12s ago 11m 15.6M - 1.5.0 0da6a335fe13 927137a7bb60 2024-03-04T06:50:57.188 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (5m) 35s ago 15m 337M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 bd2207652b33 2024-03-04T06:50:57.188 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (4m) 35s ago 15m 208M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 47b5cdaad147 2024-03-04T06:50:57.188 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (3m) 35s ago 15m 272M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 436ae07776d9 2024-03-04T06:50:57.188 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (3m) 35s ago 14m 143M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9acd06dda8ec 2024-03-04T06:50:57.188 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (2m) 12s ago 14m 170M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9a246a0996bd 2024-03-04T06:50:57.189 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (2m) 12s ago 13m 289M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9e05ca76b164 2024-03-04T06:50:57.189 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (94s) 12s ago 13m 211M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 ddb88aa8bce6 2024-03-04T06:50:57.189 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (57s) 12s ago 13m 102M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 b9857bcd7602 2024-03-04T06:50:57.189 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (6m) 12s ago 12m 56.4M - 2.43.0 a07b618ecd1d 6a88bdd1023c 2024-03-04T06:50:57.397 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:57 smithi203 podman[112917]: 2024-03-04 06:50:57.133516584 +0000 UTC m=+0.749839473 container remove 927137a7bb60ce80bd333decbee17b9e8366d047f34b9fd831c5b7fb0ec80604 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-04T06:50:57.397 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:57 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-03-04T06:50:57.397 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:57 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-03-04T06:50:57.397 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:57 smithi203 systemd[1]: Stopped Ceph node-exporter.b for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:50:57.398 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:57 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.b.service: Consumed 2.774s CPU time. 2024-03-04T06:50:57.407 INFO:tasks.rados.rados.0.smithi137.stdout:2751: done (5 left) 2024-03-04T06:50:57.407 INFO:tasks.rados.rados.0.smithi137.stdout:2752: delete oid 40 current snap is 254 2024-03-04T06:50:57.408 INFO:tasks.rados.rados.0.smithi137.stdout:2748: finishing rollback tid 0 to smithi13777483-29 2024-03-04T06:50:57.408 INFO:tasks.rados.rados.0.smithi137.stdout:2746: finishing rollback tid 0 to smithi13777483-11 2024-03-04T06:50:57.408 INFO:tasks.rados.rados.0.smithi137.stdout:2746: finishing rollback tid 1 to smithi13777483-11 2024-03-04T06:50:57.408 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16837 (ObjNum 65 snap 0 seq_num 1496033817) dirty dne 2024-03-04T06:50:57.408 INFO:tasks.rados.rados.0.smithi137.stdout:2747: finishing rollback tid 1 to smithi13777483-27 2024-03-04T06:50:57.408 INFO:tasks.rados.rados.0.smithi137.stdout:2747: finishing rollback tid 2 to smithi13777483-27 2024-03-04T06:50:57.408 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16883 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:50:57.408 INFO:tasks.rados.rados.0.smithi137.stdout:2748: finishing rollback tid 1 to smithi13777483-29 2024-03-04T06:50:57.408 INFO:tasks.rados.rados.0.smithi137.stdout:2748: finishing rollback tid 2 to smithi13777483-29 2024-03-04T06:50:57.408 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16849 (ObjNum 821 snap 236 seq_num 821) dirty exists 2024-03-04T06:50:57.408 INFO:tasks.rados.rados.0.smithi137.stdout:2749: finishing write tid 1 to smithi13777483-38 2024-03-04T06:50:57.408 INFO:tasks.rados.rados.0.smithi137.stdout:2749: finishing write tid 2 to smithi13777483-38 2024-03-04T06:50:57.408 INFO:tasks.rados.rados.0.smithi137.stdout:2749: finishing write tid 3 to smithi13777483-38 2024-03-04T06:50:57.409 INFO:tasks.rados.rados.0.smithi137.stdout:2749: oid 38 updating version 0 to 16866 2024-03-04T06:50:57.409 INFO:tasks.rados.rados.0.smithi137.stdout:2749: oid 38 version 16866 is already newer than 16865 2024-03-04T06:50:57.409 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16866 (ObjNum 868 snap 254 seq_num 868) dirty exists 2024-03-04T06:50:57.409 INFO:tasks.rados.rados.0.smithi137.stdout:2749: left oid 38 (ObjNum 868 snap 254 seq_num 868) 2024-03-04T06:50:57.409 INFO:tasks.rados.rados.0.smithi137.stdout:2750: expect (ObjNum 844 snap 246 seq_num 844) 2024-03-04T06:50:57.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:57.406+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:57.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:57.411+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:57.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:57.412+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:50:57.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:57.412+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:57.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:57.411+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[91314]: pgmap v551: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.0 MiB/s wr, 15 op/s 2024-03-04T06:50:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[91314]: osdmap e582: 8 total, 8 up, 8 in 2024-03-04T06:50:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:57.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:57.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:57.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[88869]: pgmap v551: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.0 MiB/s wr, 15 op/s 2024-03-04T06:50:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[88869]: osdmap e582: 8 total, 8 up, 8 in 2024-03-04T06:50:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:57.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:57.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:57.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:57.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:57.553 INFO:tasks.rados.rados.0.smithi137.stdout:2746: done (5 left) 2024-03-04T06:50:57.554 INFO:tasks.rados.rados.0.smithi137.stdout:2747: done (4 left) 2024-03-04T06:50:57.554 INFO:tasks.rados.rados.0.smithi137.stdout:2748: done (3 left) 2024-03-04T06:50:57.554 INFO:tasks.rados.rados.0.smithi137.stdout:2749: done (2 left) 2024-03-04T06:50:57.554 INFO:tasks.rados.rados.0.smithi137.stdout:2750: done (1 left) 2024-03-04T06:50:57.554 INFO:tasks.rados.rados.0.smithi137.stdout:2752: done (0 left) 2024-03-04T06:50:57.554 INFO:tasks.rados.rados.0.smithi137.stdout:2753: read oid 26 snap -1 2024-03-04T06:50:57.554 INFO:tasks.rados.rados.0.smithi137.stdout:2753: expect (ObjNum 852 snap 249 seq_num 852) 2024-03-04T06:50:57.554 INFO:tasks.rados.rados.0.smithi137.stdout:2754: snap_remove snap 238 2024-03-04T06:50:57.594 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 8 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 15 2024-03-04T06:50:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:50:57.596 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:50:57.747 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:57 smithi203 systemd[1]: Starting Ceph node-exporter.b for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:50:57.748 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:57.412+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:57.748 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:57.614+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:57.748 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:57.410+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:57.748 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:57.410+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:57.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-mon[85573]: pgmap v551: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.0 MiB/s wr, 15 op/s 2024-03-04T06:50:57.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-mon[85573]: osdmap e582: 8 total, 8 up, 8 in 2024-03-04T06:50:57.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:57.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:57.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:57.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:57.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:57.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:57.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:57.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:57.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:57.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:57.749 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:57.404+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:50:57.749 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:57.404+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:57.750 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:57.405+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:58.011 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:57 smithi203 podman[113052]: 2024-03-04 06:50:57.651304559 +0000 UTC m=+0.018040285 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-03-04T06:50:58.012 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:57 smithi203 podman[113052]: 2024-03-04 06:50:57.77674268 +0000 UTC m=+0.143478444 container create 28b7879b0fcbaef5ba2f76850295b3fee635e5a33e15b7d9b5bb7772d4bd4132 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-04T06:50:58.012 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 podman[113052]: 2024-03-04 06:50:58.012313693 +0000 UTC m=+0.379049430 container init 28b7879b0fcbaef5ba2f76850295b3fee635e5a33e15b7d9b5bb7772d4bd4132 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-04T06:50:58.346 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 podman[113052]: 2024-03-04 06:50:58.015270941 +0000 UTC m=+0.382006672 container start 28b7879b0fcbaef5ba2f76850295b3fee635e5a33e15b7d9b5bb7772d4bd4132 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-04T06:50:58.346 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.018Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-04T06:50:58.346 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.018Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-04T06:50:58.346 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.019Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-04T06:50:58.346 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.019Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-04T06:50:58.346 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.019Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-04T06:50:58.346 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.019Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-04T06:50:58.347 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-04T06:50:58.347 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=arp 2024-03-04T06:50:58.347 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-04T06:50:58.347 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-04T06:50:58.347 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-04T06:50:58.347 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-04T06:50:58.347 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-04T06:50:58.347 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-04T06:50:58.347 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-04T06:50:58.347 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-04T06:50:58.348 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=edac 2024-03-04T06:50:58.348 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-04T06:50:58.348 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-04T06:50:58.348 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-04T06:50:58.348 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-04T06:50:58.348 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-04T06:50:58.348 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-04T06:50:58.348 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-04T06:50:58.348 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-04T06:50:58.348 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-04T06:50:58.349 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-04T06:50:58.349 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-04T06:50:58.349 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-04T06:50:58.349 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-04T06:50:58.349 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-04T06:50:58.349 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-04T06:50:58.349 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-04T06:50:58.349 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=os 2024-03-04T06:50:58.349 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-04T06:50:58.349 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-04T06:50:58.349 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-04T06:50:58.349 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-04T06:50:58.349 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=stat 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=time 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=uname 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b[113067]: ts=2024-03-04T06:50:58.020Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-04T06:50:58.350 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 bash[113052]: 28b7879b0fcbaef5ba2f76850295b3fee635e5a33e15b7d9b5bb7772d4bd4132 2024-03-04T06:50:58.351 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 06:50:58 smithi203 systemd[1]: Started Ceph node-exporter.b for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:50:58.415 INFO:tasks.rados.rados.0.smithi137.stdout:2754: done (1 left) 2024-03-04T06:50:58.415 INFO:tasks.rados.rados.0.smithi137.stdout:2755: read oid 28 snap 247 2024-03-04T06:50:58.415 INFO:tasks.rados.rados.0.smithi137.stdout:2755: expect (ObjNum 835 snap 242 seq_num 835) 2024-03-04T06:50:58.415 INFO:tasks.rados.rados.0.smithi137.stdout:2756: rollback oid 35 current snap is 254 2024-03-04T06:50:58.415 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 35 to 247 2024-03-04T06:50:58.415 INFO:tasks.rados.rados.0.smithi137.stdout:2757: delete oid 33 current snap is 254 2024-03-04T06:50:58.415 INFO:tasks.rados.rados.0.smithi137.stdout:2753: expect (ObjNum 852 snap 249 seq_num 852) 2024-03-04T06:50:58.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:50:58.420+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:58.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:58.417+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:58.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:50:58.422+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:58.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:50:58.421+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: from='client.44348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:50:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: from='client.34413 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:50:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: osdmap e583: 8 total, 8 up, 8 in 2024-03-04T06:50:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:58.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:58.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/893705587' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:58.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:58.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:58.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: from='client.44348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:50:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: from='client.34413 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:50:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: osdmap e583: 8 total, 8 up, 8 in 2024-03-04T06:50:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:58.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:58.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:58.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:58.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:58.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/893705587' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:58.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:58.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:58.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:58 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:58.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:58.421+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:58.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:50:58.421+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:58.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:50:58.414+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:58.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: from='client.44348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:50:58.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: from='client.34413 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:50:58.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: osdmap e583: 8 total, 8 up, 8 in 2024-03-04T06:50:58.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:58.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:58.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:58.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:58.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:58.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:58.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:58.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:58.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:58.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/893705587' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:50:58.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:58.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:50:58.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:50:58.848 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:58.422+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:50:58.848 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:50:58.422+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:58.848 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:58.420+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:50:58.848 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:58.420+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:58.848 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:50:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:50:58.422+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:59.058 INFO:tasks.rados.rados.0.smithi137.stdout:2756: finishing rollback tid 1 to smithi13777483-35 2024-03-04T06:50:59.058 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16875 (ObjNum 209 snap 0 seq_num 3131192096) dirty dne 2024-03-04T06:50:59.058 INFO:tasks.rados.rados.0.smithi137.stdout:2755: expect (ObjNum 835 snap 242 seq_num 835) 2024-03-04T06:50:59.176 INFO:tasks.rados.rados.0.smithi137.stdout:2753: done (3 left) 2024-03-04T06:50:59.177 INFO:tasks.rados.rados.0.smithi137.stdout:2755: done (2 left) 2024-03-04T06:50:59.177 INFO:tasks.rados.rados.0.smithi137.stdout:2756: done (1 left) 2024-03-04T06:50:59.177 INFO:tasks.rados.rados.0.smithi137.stdout:2757: done (0 left) 2024-03-04T06:50:59.177 INFO:tasks.rados.rados.0.smithi137.stdout:2758: snap_remove snap 249 2024-03-04T06:50:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:59 smithi203 ceph-mon[85573]: pgmap v554: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 85 KiB/s wr, 14 op/s 2024-03-04T06:50:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:59 smithi203 ceph-mon[85573]: osdmap e584: 8 total, 8 up, 8 in 2024-03-04T06:50:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:59.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:59.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:59.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:50:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[88869]: pgmap v554: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 85 KiB/s wr, 14 op/s 2024-03-04T06:50:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[88869]: osdmap e584: 8 total, 8 up, 8 in 2024-03-04T06:50:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[91314]: pgmap v554: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 85 KiB/s wr, 14 op/s 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[91314]: osdmap e584: 8 total, 8 up, 8 in 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:50:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:50:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:50:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:50:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:50:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:00.184 INFO:tasks.rados.rados.0.smithi137.stdout:2758: done (0 left) 2024-03-04T06:51:00.184 INFO:tasks.rados.rados.0.smithi137.stdout:2759: read oid 23 snap -1 2024-03-04T06:51:00.184 INFO:tasks.rados.rados.0.smithi137.stdout:2759: expect (ObjNum 851 snap 248 seq_num 851) 2024-03-04T06:51:00.184 INFO:tasks.rados.rados.0.smithi137.stdout:2760: setattr oid 34 current snap is 254 2024-03-04T06:51:00.186 INFO:tasks.rados.rados.0.smithi137.stdout:2761: snap_remove snap 250 2024-03-04T06:51:00.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:00.186+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:00.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:00.181+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:00.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:00.185+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:00.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:00.186+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:00.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:00.189+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:00.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:00.189+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:00.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:00.189+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:00.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:00.192+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:00.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:00.188+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:00.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:00.182+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:00.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:00.182+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:00.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:00.183+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:01.190 INFO:tasks.rados.rados.0.smithi137.stdout:2761: done (2 left) 2024-03-04T06:51:01.190 INFO:tasks.rados.rados.0.smithi137.stdout:2762: snap_remove snap 247 2024-03-04T06:51:01.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:01.193+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:01.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:01.187+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[88869]: osdmap e585: 8 total, 8 up, 8 in 2024-03-04T06:51:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[88869]: pgmap v557: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 17 MiB/s rd, 90 KiB/s wr, 16 op/s 2024-03-04T06:51:01.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:01.192+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:01.545 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:01.193+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:01.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:01.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[91314]: osdmap e585: 8 total, 8 up, 8 in 2024-03-04T06:51:01.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:01.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:01.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:01.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:01.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:01.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:01.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:01.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:01.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:01.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:01 smithi137 ceph-mon[91314]: pgmap v557: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 17 MiB/s rd, 90 KiB/s wr, 16 op/s 2024-03-04T06:51:01.546 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:01.192+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:01.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:01.188+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:01.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:01.188+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:01.547 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:01.199+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:01.547 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:01.199+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:01.547 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:01.200+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:01.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:01.223+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:01.547 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:01.223+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:01.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:01.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-mon[85573]: osdmap e585: 8 total, 8 up, 8 in 2024-03-04T06:51:01.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:01.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:01.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:01.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:01.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:01.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:01.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:01.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:01.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:01.549 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:01 smithi203 ceph-mon[85573]: pgmap v557: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 17 MiB/s rd, 90 KiB/s wr, 16 op/s 2024-03-04T06:51:02.193 INFO:tasks.rados.rados.0.smithi137.stdout:2762: done (2 left) 2024-03-04T06:51:02.193 INFO:tasks.rados.rados.0.smithi137.stdout:2763: rollback oid 39 current snap is 254 2024-03-04T06:51:02.193 INFO:tasks.rados.rados.0.smithi137.stdout:2763: done (2 left) 2024-03-04T06:51:02.193 INFO:tasks.rados.rados.0.smithi137.stdout:2764: read oid 50 snap -1 2024-03-04T06:51:02.193 INFO:tasks.rados.rados.0.smithi137.stdout:2764: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:51:02.193 INFO:tasks.rados.rados.0.smithi137.stdout:2765: delete oid 16 current snap is 254 2024-03-04T06:51:02.193 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16842 (ObjNum 81 snap 0 seq_num 1) dirty exists 2024-03-04T06:51:02.193 INFO:tasks.rados.rados.0.smithi137.stdout:2759: expect (ObjNum 851 snap 248 seq_num 851) 2024-03-04T06:51:02.262 INFO:tasks.rados.rados.0.smithi137.stdout:2764: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:51:02.327 INFO:tasks.rados.rados.0.smithi137.stdout:2759: done (3 left) 2024-03-04T06:51:02.327 INFO:tasks.rados.rados.0.smithi137.stdout:2760: done (2 left) 2024-03-04T06:51:02.327 INFO:tasks.rados.rados.0.smithi137.stdout:2764: done (1 left) 2024-03-04T06:51:02.327 INFO:tasks.rados.rados.0.smithi137.stdout:2765: done (0 left) 2024-03-04T06:51:02.327 INFO:tasks.rados.rados.0.smithi137.stdout:2766: read oid 43 snap -1 2024-03-04T06:51:02.327 INFO:tasks.rados.rados.0.smithi137.stdout:2766: expect deleted 2024-03-04T06:51:02.327 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 29 current snap is 254 2024-03-04T06:51:02.327 INFO:tasks.rados.rados.0.smithi137.stdout:2767: seq_num 872 ranges {1761280=212992} 2024-03-04T06:51:02.329 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:02.200+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:02.329 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:02.191+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:02.329 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:02.191+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:02.329 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:02.191+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:02.329 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:02.207+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:02.330 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:02.206+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:02.330 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:02.207+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:02.330 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:02.330 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:02.330 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:02.330 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: osdmap e586: 8 total, 8 up, 8 in 2024-03-04T06:51:02.330 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:02.330 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:02.330 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:02.331 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:02.331 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:02.331 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:02.331 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:02.331 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:02.331 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:02.331 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:02.331 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:02 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:02.337 INFO:tasks.rados.rados.0.smithi137.stdout:2767: writing smithi13777483-29 from 1761280 to 1974272 tid 1 2024-03-04T06:51:02.337 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 254 2024-03-04T06:51:02.337 INFO:tasks.rados.rados.0.smithi137.stdout:2768: seq_num 873 ranges {7602176=229376} 2024-03-04T06:51:02.380 INFO:tasks.rados.rados.0.smithi137.stdout:2768: writing smithi13777483-20 from 7602176 to 7831552 tid 1 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:2769: copy_from oid 5 from oid 36 current snap is 254 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:2767: finishing write tid 1 to smithi13777483-29 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:2767: finishing write tid 2 to smithi13777483-29 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:2767: finishing write tid 3 to smithi13777483-29 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:2767: oid 29 updating version 0 to 16850 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:2767: oid 29 updating version 16850 to 16851 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16851 (ObjNum 872 snap 254 seq_num 872) dirty exists 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:2767: left oid 29 (ObjNum 872 snap 254 seq_num 872) 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:2766: done (3 left) 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:2767: done (2 left) 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:2770: snap_create 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:2769: finishing copy_from to smithi13777483-5 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:2769: got expected ENOENT (src dne) 2024-03-04T06:51:02.381 INFO:tasks.rados.rados.0.smithi137.stdout:2769: finishing copy_from racing read to smithi13777483-5 2024-03-04T06:51:02.383 INFO:tasks.rados.rados.0.smithi137.stdout:2768: finishing write tid 1 to smithi13777483-20 2024-03-04T06:51:02.383 INFO:tasks.rados.rados.0.smithi137.stdout:2768: finishing write tid 2 to smithi13777483-20 2024-03-04T06:51:02.384 INFO:tasks.rados.rados.0.smithi137.stdout:2768: finishing write tid 3 to smithi13777483-20 2024-03-04T06:51:02.385 INFO:tasks.rados.rados.0.smithi137.stdout:2768: oid 20 updating version 0 to 16873 2024-03-04T06:51:02.385 INFO:tasks.rados.rados.0.smithi137.stdout:2768: oid 20 version 16873 is already newer than 16872 2024-03-04T06:51:02.385 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16873 (ObjNum 873 snap 254 seq_num 873) dirty exists 2024-03-04T06:51:02.385 INFO:tasks.rados.rados.0.smithi137.stdout:2768: left oid 20 (ObjNum 873 snap 254 seq_num 873) 2024-03-04T06:51:02.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:02.190+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:02.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:02.198+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:02.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:02.198+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:02.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:02.202+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:02.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:02.191+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:02.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:02.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:02.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:02.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: osdmap e586: 8 total, 8 up, 8 in 2024-03-04T06:51:02.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:02.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:02.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:02.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:02.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:02.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:02.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:02.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: osdmap e586: 8 total, 8 up, 8 in 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:02.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:02.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:02.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:02.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:02.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:02 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:03.243 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:03.243 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:03.243 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:03.243 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: osdmap e587: 8 total, 8 up, 8 in 2024-03-04T06:51:03.243 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:03.243 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:03.243 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:03.244 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:03.244 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:03.244 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:03.244 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:03.244 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:03.244 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:03.244 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: pgmap v560: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.9 MiB/s rd, 0 B/s wr, 1 op/s 2024-03-04T06:51:03.244 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:03.244 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:03.244 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:03.244 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:03.244 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:03.244 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: osdmap e587: 8 total, 8 up, 8 in 2024-03-04T06:51:03.245 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:03.245 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:03.245 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:03.245 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:03.245 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:03.245 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:03.245 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:03.245 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:03.245 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:03.245 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: pgmap v560: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.9 MiB/s rd, 0 B/s wr, 1 op/s 2024-03-04T06:51:03.245 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:03.245 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:03.379 INFO:tasks.rados.rados.0.smithi137.stdout:2768: done (2 left) 2024-03-04T06:51:03.379 INFO:tasks.rados.rados.0.smithi137.stdout:2769: done (1 left) 2024-03-04T06:51:03.379 INFO:tasks.rados.rados.0.smithi137.stdout:2770: done (0 left) 2024-03-04T06:51:03.379 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 255 2024-03-04T06:51:03.379 INFO:tasks.rados.rados.0.smithi137.stdout:2771: seq_num 874 ranges {917504=245760} 2024-03-04T06:51:03.385 INFO:tasks.rados.rados.0.smithi137.stdout:2771: writing smithi13777483-13 from 917504 to 1163264 tid 1 2024-03-04T06:51:03.385 INFO:tasks.rados.rados.0.smithi137.stdout:2772: rollback oid 43 current snap is 255 2024-03-04T06:51:03.385 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 43 to 254 2024-03-04T06:51:03.385 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 255 2024-03-04T06:51:03.385 INFO:tasks.rados.rados.0.smithi137.stdout:2773: seq_num 875 ranges {1327104=262144} 2024-03-04T06:51:03.394 INFO:tasks.rados.rados.0.smithi137.stdout:2773: writing smithi13777483-30 from 1327104 to 1589248 tid 1 2024-03-04T06:51:03.394 INFO:tasks.rados.rados.0.smithi137.stdout:2774: snap_create 2024-03-04T06:51:03.394 INFO:tasks.rados.rados.0.smithi137.stdout:2772: finishing rollback tid 1 to smithi13777483-43 2024-03-04T06:51:03.394 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16863 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-04T06:51:03.394 INFO:tasks.rados.rados.0.smithi137.stdout:2771: finishing write tid 1 to smithi13777483-13 2024-03-04T06:51:03.395 INFO:tasks.rados.rados.0.smithi137.stdout:2771: finishing write tid 2 to smithi13777483-13 2024-03-04T06:51:03.395 INFO:tasks.rados.rados.0.smithi137.stdout:2771: finishing write tid 3 to smithi13777483-13 2024-03-04T06:51:03.395 INFO:tasks.rados.rados.0.smithi137.stdout:2771: oid 13 updating version 0 to 16885 2024-03-04T06:51:03.395 INFO:tasks.rados.rados.0.smithi137.stdout:2771: oid 13 version 16885 is already newer than 16884 2024-03-04T06:51:03.395 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16885 (ObjNum 874 snap 255 seq_num 874) dirty exists 2024-03-04T06:51:03.395 INFO:tasks.rados.rados.0.smithi137.stdout:2771: left oid 13 (ObjNum 874 snap 255 seq_num 874) 2024-03-04T06:51:03.397 INFO:tasks.rados.rados.0.smithi137.stdout:2773: finishing write tid 1 to smithi13777483-30 2024-03-04T06:51:03.397 INFO:tasks.rados.rados.0.smithi137.stdout:2773: finishing write tid 2 to smithi13777483-30 2024-03-04T06:51:03.398 INFO:tasks.rados.rados.0.smithi137.stdout:2773: finishing write tid 3 to smithi13777483-30 2024-03-04T06:51:03.398 INFO:tasks.rados.rados.0.smithi137.stdout:2773: oid 30 updating version 0 to 16785 2024-03-04T06:51:03.398 INFO:tasks.rados.rados.0.smithi137.stdout:2773: oid 30 updating version 16785 to 16786 2024-03-04T06:51:03.398 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16786 (ObjNum 875 snap 255 seq_num 875) dirty exists 2024-03-04T06:51:03.398 INFO:tasks.rados.rados.0.smithi137.stdout:2773: left oid 30 (ObjNum 875 snap 255 seq_num 875) 2024-03-04T06:51:03.514 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:03.378+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:03.514 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:03.378+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:03.515 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:03.389+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:03.515 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:03.390+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:03.515 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:03.390+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:03.515 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:03.390+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:03.515 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:03.515 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:03.515 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:03.516 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: osdmap e587: 8 total, 8 up, 8 in 2024-03-04T06:51:03.516 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:03.516 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:03.516 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:03.516 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:03.516 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:03.516 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:03.516 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:03.516 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:03.516 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:03.516 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: pgmap v560: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 433 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.9 MiB/s rd, 0 B/s wr, 1 op/s 2024-03-04T06:51:03.516 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:03.516 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:03.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:03.388+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:03.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:03.378+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:03.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:03.378+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:03.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:03.388+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:03.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:03.514+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:03.799 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:03.514+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:04.386 INFO:tasks.rados.rados.0.smithi137.stdout:2771: done (3 left) 2024-03-04T06:51:04.415 INFO:tasks.rados.rados.0.smithi137.stdout:2772: done (2 left) 2024-03-04T06:51:04.415 INFO:tasks.rados.rados.0.smithi137.stdout:2773: done (1 left) 2024-03-04T06:51:04.416 INFO:tasks.rados.rados.0.smithi137.stdout:2774: done (0 left) 2024-03-04T06:51:04.416 INFO:tasks.rados.rados.0.smithi137.stdout:2775: snap_remove snap 254 2024-03-04T06:51:04.770 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:04.380+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:04.770 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:04.380+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:04.770 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:04.380+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:04.770 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:04.770 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:04 smithi203 ceph-mon[85573]: osdmap e588: 8 total, 8 up, 8 in 2024-03-04T06:51:04.770 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:04.770 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:04.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:04.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:04.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:04.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:04.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:04.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:04.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:04.382+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:04.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:04.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[88869]: osdmap e588: 8 total, 8 up, 8 in 2024-03-04T06:51:04.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:04.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:04.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:04.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:04.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:04.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:04.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:04.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[91314]: osdmap e588: 8 total, 8 up, 8 in 2024-03-04T06:51:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:04.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:04.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:04.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:05.400 INFO:tasks.rados.rados.0.smithi137.stdout:2775: done (0 left) 2024-03-04T06:51:05.400 INFO:tasks.rados.rados.0.smithi137.stdout:2776: setattr oid 40 current snap is 256 2024-03-04T06:51:05.400 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:05.401 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:05.401 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:05.401 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:05.401 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-mon[88869]: osdmap e589: 8 total, 8 up, 8 in 2024-03-04T06:51:05.401 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-mon[88869]: pgmap v563: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 404 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 108 KiB/s wr, 9 op/s 2024-03-04T06:51:05.401 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:51:05] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:51:05.402 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:05.402 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:05.402 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:05.402 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:05.402 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-mon[91314]: osdmap e589: 8 total, 8 up, 8 in 2024-03-04T06:51:05.402 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-mon[91314]: pgmap v563: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 404 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 108 KiB/s wr, 9 op/s 2024-03-04T06:51:05.403 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:05.397+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:05.403 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:05.397+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:05.403 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:05.400+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:05.404 INFO:tasks.rados.rados.0.smithi137.stdout:2777: read oid 41 snap 255 2024-03-04T06:51:05.404 INFO:tasks.rados.rados.0.smithi137.stdout:2777: expect (ObjNum 822 snap 236 seq_num 822) 2024-03-04T06:51:05.404 INFO:tasks.rados.rados.0.smithi137.stdout:2778: rollback oid 34 current snap is 256 2024-03-04T06:51:05.404 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 34 to 255 2024-03-04T06:51:05.404 INFO:tasks.rados.rados.0.smithi137.stdout:2779: rmattr oid 13 current snap is 256 2024-03-04T06:51:05.404 INFO:tasks.rados.rados.0.smithi137.stdout:2780: setattr oid 17 current snap is 256 2024-03-04T06:51:05.408 INFO:tasks.rados.rados.0.smithi137.stdout:2781: setattr oid 39 current snap is 256 2024-03-04T06:51:05.408 INFO:tasks.rados.rados.0.smithi137.stdout:2782: read oid 10 snap 255 2024-03-04T06:51:05.408 INFO:tasks.rados.rados.0.smithi137.stdout:2782: expect (ObjNum -1163957808 snap 21906 seq_num 3131974432) 2024-03-04T06:51:05.408 INFO:tasks.rados.rados.0.smithi137.stdout:2783: copy_from oid 16 from oid 38 current snap is 256 2024-03-04T06:51:05.408 INFO:tasks.rados.rados.0.smithi137.stdout:2784: copy_from oid 8 from oid 45 current snap is 256 2024-03-04T06:51:05.408 INFO:tasks.rados.rados.0.smithi137.stdout:2785: snap_create 2024-03-04T06:51:05.408 INFO:tasks.rados.rados.0.smithi137.stdout:2782: expect (ObjNum -1163957808 snap 21906 seq_num 3131974432) 2024-03-04T06:51:05.409 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 16835 (ObjNum 81 snap 0 seq_num 3184507192) dirty exists 2024-03-04T06:51:05.409 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16886 (ObjNum 874 snap 255 seq_num 874) dirty exists 2024-03-04T06:51:05.411 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16864 (ObjNum 10993 snap 0 seq_num 3131152448) dirty exists 2024-03-04T06:51:05.414 INFO:tasks.rados.rados.0.smithi137.stdout:2778: finishing rollback tid 0 to smithi13777483-34 2024-03-04T06:51:05.415 INFO:tasks.rados.rados.0.smithi137.stdout:2778: finishing rollback tid 1 to smithi13777483-34 2024-03-04T06:51:05.415 INFO:tasks.rados.rados.0.smithi137.stdout:2778: finishing rollback tid 2 to smithi13777483-34 2024-03-04T06:51:05.415 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16847 (ObjNum 49 snap 0 seq_num 3129943312) dirty exists 2024-03-04T06:51:05.415 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 16858 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-03-04T06:51:05.429 INFO:tasks.rados.rados.0.smithi137.stdout:2784: finishing copy_from racing read to smithi13777483-8 2024-03-04T06:51:05.430 INFO:tasks.rados.rados.0.smithi137.stdout:2777: expect (ObjNum 822 snap 236 seq_num 822) 2024-03-04T06:51:05.536 INFO:tasks.rados.rados.0.smithi137.stdout:2784: finishing copy_from to smithi13777483-8 2024-03-04T06:51:05.536 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16855 (ObjNum 771 snap 228 seq_num 771) dirty exists 2024-03-04T06:51:05.536 INFO:tasks.rados.rados.0.smithi137.stdout:2783: finishing copy_from racing read to smithi13777483-16 2024-03-04T06:51:05.536 INFO:tasks.rados.rados.0.smithi137.stdout:2783: finishing copy_from to smithi13777483-16 2024-03-04T06:51:05.536 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16866 (ObjNum 868 snap 254 seq_num 868) dirty exists 2024-03-04T06:51:05.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:05.413+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:05.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:05.312+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:05.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:05.401+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:05.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:05.414+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:05.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:05.421+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset 120=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:05 smithi203 ceph-mon[85573]: osdmap e589: 8 total, 8 up, 8 in 2024-03-04T06:51:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:05 smithi203 ceph-mon[85573]: pgmap v563: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 404 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 108 KiB/s wr, 9 op/s 2024-03-04T06:51:05.598 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:05.400+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:05.598 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:05.402+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:05.771 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:05.401+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:05.771 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:05.406+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:06.409 INFO:tasks.rados.rados.0.smithi137.stdout:2776: done (9 left) 2024-03-04T06:51:06.409 INFO:tasks.rados.rados.0.smithi137.stdout:2777: done (8 left) 2024-03-04T06:51:06.409 INFO:tasks.rados.rados.0.smithi137.stdout:2778: done (7 left) 2024-03-04T06:51:06.409 INFO:tasks.rados.rados.0.smithi137.stdout:2779: done (6 left) 2024-03-04T06:51:06.409 INFO:tasks.rados.rados.0.smithi137.stdout:2780: done (5 left) 2024-03-04T06:51:06.409 INFO:tasks.rados.rados.0.smithi137.stdout:2781: done (4 left) 2024-03-04T06:51:06.409 INFO:tasks.rados.rados.0.smithi137.stdout:2782: done (3 left) 2024-03-04T06:51:06.410 INFO:tasks.rados.rados.0.smithi137.stdout:2783: done (2 left) 2024-03-04T06:51:06.410 INFO:tasks.rados.rados.0.smithi137.stdout:2784: done (1 left) 2024-03-04T06:51:06.410 INFO:tasks.rados.rados.0.smithi137.stdout:2785: done (0 left) 2024-03-04T06:51:06.410 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 257 2024-03-04T06:51:06.410 INFO:tasks.rados.rados.0.smithi137.stdout:2786: seq_num 876 ranges {0=278528} 2024-03-04T06:51:06.410 INFO:tasks.rados.rados.0.smithi137.stdout:2786: writing smithi13777483-18 from 0 to 278528 tid 1 2024-03-04T06:51:06.410 INFO:tasks.rados.rados.0.smithi137.stdout:2787: snap_create 2024-03-04T06:51:06.415 INFO:tasks.rados.rados.0.smithi137.stdout:2786: finishing write tid 1 to smithi13777483-18 2024-03-04T06:51:06.415 INFO:tasks.rados.rados.0.smithi137.stdout:2786: finishing write tid 2 to smithi13777483-18 2024-03-04T06:51:06.416 INFO:tasks.rados.rados.0.smithi137.stdout:2786: finishing write tid 3 to smithi13777483-18 2024-03-04T06:51:06.416 INFO:tasks.rados.rados.0.smithi137.stdout:2786: oid 18 updating version 0 to 16852 2024-03-04T06:51:06.416 INFO:tasks.rados.rados.0.smithi137.stdout:2786: oid 18 updating version 16852 to 16853 2024-03-04T06:51:06.416 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16853 (ObjNum 876 snap 257 seq_num 876) dirty exists 2024-03-04T06:51:06.416 INFO:tasks.rados.rados.0.smithi137.stdout:2786: left oid 18 (ObjNum 876 snap 257 seq_num 876) 2024-03-04T06:51:06.538 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:06.538 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: osdmap e590: 8 total, 8 up, 8 in 2024-03-04T06:51:06.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:06.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:06.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:06.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:06.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:06.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:06.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:06.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:06.540 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:06.540 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:06.540 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:06.540 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:06.540 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:06.407+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:06.540 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:06.407+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:06.541 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:06.407+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:06.541 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:06.414+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:06.541 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:06.415+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:06.541 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:06.415+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:06.542 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:06.415+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:06.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:06.407+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:06.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:06.408+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:06.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:06.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: osdmap e590: 8 total, 8 up, 8 in 2024-03-04T06:51:06.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:06.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:06.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:06.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:06.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:06.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:06.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: osdmap e590: 8 total, 8 up, 8 in 2024-03-04T06:51:06.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:06.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:06.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:06.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:07.283 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:06.848+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:07.407 INFO:tasks.rados.rados.0.smithi137.stdout:2786: done (1 left) 2024-03-04T06:51:07.408 INFO:tasks.rados.rados.0.smithi137.stdout:2787: done (0 left) 2024-03-04T06:51:07.408 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 258 2024-03-04T06:51:07.408 INFO:tasks.rados.rados.0.smithi137.stdout:2788: seq_num 877 ranges {917504=294912} 2024-03-04T06:51:07.414 INFO:tasks.rados.rados.0.smithi137.stdout:2788: writing smithi13777483-45 from 917504 to 1212416 tid 1 2024-03-04T06:51:07.414 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 258 2024-03-04T06:51:07.414 INFO:tasks.rados.rados.0.smithi137.stdout:2789: seq_num 878 ranges {0=311296} 2024-03-04T06:51:07.416 INFO:tasks.rados.rados.0.smithi137.stdout:2789: writing smithi13777483-17 from 0 to 311296 tid 1 2024-03-04T06:51:07.416 INFO:tasks.rados.rados.0.smithi137.stdout:2790: snap_create 2024-03-04T06:51:07.421 INFO:tasks.rados.rados.0.smithi137.stdout:2789: finishing write tid 1 to smithi13777483-17 2024-03-04T06:51:07.421 INFO:tasks.rados.rados.0.smithi137.stdout:2788: finishing write tid 1 to smithi13777483-45 2024-03-04T06:51:07.421 INFO:tasks.rados.rados.0.smithi137.stdout:2789: finishing write tid 2 to smithi13777483-17 2024-03-04T06:51:07.421 INFO:tasks.rados.rados.0.smithi137.stdout:2788: finishing write tid 2 to smithi13777483-45 2024-03-04T06:51:07.422 INFO:tasks.rados.rados.0.smithi137.stdout:2788: finishing write tid 3 to smithi13777483-45 2024-03-04T06:51:07.423 INFO:tasks.rados.rados.0.smithi137.stdout:2788: oid 45 updating version 0 to 16859 2024-03-04T06:51:07.423 INFO:tasks.rados.rados.0.smithi137.stdout:2788: oid 45 updating version 16859 to 16860 2024-03-04T06:51:07.423 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16860 (ObjNum 877 snap 258 seq_num 877) dirty exists 2024-03-04T06:51:07.423 INFO:tasks.rados.rados.0.smithi137.stdout:2788: left oid 45 (ObjNum 877 snap 258 seq_num 877) 2024-03-04T06:51:07.426 INFO:tasks.rados.rados.0.smithi137.stdout:2789: finishing write tid 3 to smithi13777483-17 2024-03-04T06:51:07.426 INFO:tasks.rados.rados.0.smithi137.stdout:2789: oid 17 updating version 0 to 16865 2024-03-04T06:51:07.426 INFO:tasks.rados.rados.0.smithi137.stdout:2789: oid 17 updating version 16865 to 16866 2024-03-04T06:51:07.426 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16866 (ObjNum 878 snap 258 seq_num 878) dirty exists 2024-03-04T06:51:07.426 INFO:tasks.rados.rados.0.smithi137.stdout:2789: left oid 17 (ObjNum 878 snap 258 seq_num 878) 2024-03-04T06:51:07.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:07.406+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:07.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:07.283+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:07.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:07.461+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:07.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: pgmap v565: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 404 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 103 KiB/s wr, 9 op/s 2024-03-04T06:51:07.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:07.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: osdmap e591: 8 total, 8 up, 8 in 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:07.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: pgmap v565: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 404 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 103 KiB/s wr, 9 op/s 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: osdmap e591: 8 total, 8 up, 8 in 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:07.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:07.406+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:07.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:07.406+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:07.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:07.350+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:07.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:07.350+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:07.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:07.417+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:07.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:07.421+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: pgmap v565: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 404 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 103 KiB/s wr, 9 op/s 2024-03-04T06:51:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: osdmap e591: 8 total, 8 up, 8 in 2024-03-04T06:51:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:07.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:07.599 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:07.421+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:08.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:07.978+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:08.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:07.978+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:08.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:07.979+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:08.421 INFO:tasks.rados.rados.0.smithi137.stdout:2788: done (2 left) 2024-03-04T06:51:08.422 INFO:tasks.rados.rados.0.smithi137.stdout:2789: done (1 left) 2024-03-04T06:51:08.422 INFO:tasks.rados.rados.0.smithi137.stdout:2790: done (0 left) 2024-03-04T06:51:08.422 INFO:tasks.rados.rados.0.smithi137.stdout:2791: rmattr oid 43 current snap is 259 2024-03-04T06:51:08.422 INFO:tasks.rados.rados.0.smithi137.stdout:2791: done (0 left) 2024-03-04T06:51:08.422 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 259 2024-03-04T06:51:08.422 INFO:tasks.rados.rados.0.smithi137.stdout:2792: seq_num 879 ranges {1589248=327680} 2024-03-04T06:51:08.432 INFO:tasks.rados.rados.0.smithi137.stdout:2792: writing smithi13777483-30 from 1589248 to 1916928 tid 1 2024-03-04T06:51:08.432 INFO:tasks.rados.rados.0.smithi137.stdout:2793: read oid 44 snap -1 2024-03-04T06:51:08.432 INFO:tasks.rados.rados.0.smithi137.stdout:2793: expect (ObjNum 838 snap 242 seq_num 838) 2024-03-04T06:51:08.433 INFO:tasks.rados.rados.0.smithi137.stdout:2794: copy_from oid 31 from oid 28 current snap is 259 2024-03-04T06:51:08.433 INFO:tasks.rados.rados.0.smithi137.stdout:2795: copy_from oid 14 from oid 35 current snap is 259 2024-03-04T06:51:08.433 INFO:tasks.rados.rados.0.smithi137.stdout:2796: snap_remove snap 257 2024-03-04T06:51:08.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:08.453+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:08.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:08.439+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:08.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:08.419+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:08.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:08.419+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:08.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:08.419+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:08.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:08.435+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:08.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:08.435+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:08.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:08.436+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:08.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:08.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:08.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:08.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:08.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:08.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-mon[85573]: osdmap e592: 8 total, 8 up, 8 in 2024-03-04T06:51:08.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:08.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:08.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:08.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:08.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-mon[85573]: Upgrade: Updating prometheus.a 2024-03-04T06:51:08.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-mon[85573]: pgmap v568: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 411 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.2 KiB/s rd, 1.8 MiB/s wr, 21 op/s 2024-03-04T06:51:08.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:51:08.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:08.420+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:08.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:08.441+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:08.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:08.435+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:08.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:08.441+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[91314]: osdmap e592: 8 total, 8 up, 8 in 2024-03-04T06:51:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[91314]: Upgrade: Updating prometheus.a 2024-03-04T06:51:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[91314]: pgmap v568: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 411 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.2 KiB/s rd, 1.8 MiB/s wr, 21 op/s 2024-03-04T06:51:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:51:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[88869]: osdmap e592: 8 total, 8 up, 8 in 2024-03-04T06:51:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[88869]: Upgrade: Updating prometheus.a 2024-03-04T06:51:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[88869]: pgmap v568: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 411 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.2 KiB/s rd, 1.8 MiB/s wr, 21 op/s 2024-03-04T06:51:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:51:09.428 INFO:tasks.rados.rados.0.smithi137.stdout:2795: finishing copy_from to smithi13777483-14 2024-03-04T06:51:09.429 INFO:tasks.rados.rados.0.smithi137.stdout:2795: got expected ENOENT (src dne) 2024-03-04T06:51:09.429 INFO:tasks.rados.rados.0.smithi137.stdout:2795: finishing copy_from racing read to smithi13777483-14 2024-03-04T06:51:09.429 INFO:tasks.rados.rados.0.smithi137.stdout:2792: finishing write tid 1 to smithi13777483-30 2024-03-04T06:51:09.429 INFO:tasks.rados.rados.0.smithi137.stdout:2792: finishing write tid 2 to smithi13777483-30 2024-03-04T06:51:09.429 INFO:tasks.rados.rados.0.smithi137.stdout:2792: finishing write tid 3 to smithi13777483-30 2024-03-04T06:51:09.429 INFO:tasks.rados.rados.0.smithi137.stdout:2792: oid 30 updating version 0 to 16788 2024-03-04T06:51:09.429 INFO:tasks.rados.rados.0.smithi137.stdout:2792: oid 30 version 16788 is already newer than 16787 2024-03-04T06:51:09.429 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16788 (ObjNum 879 snap 259 seq_num 879) dirty exists 2024-03-04T06:51:09.429 INFO:tasks.rados.rados.0.smithi137.stdout:2792: left oid 30 (ObjNum 879 snap 259 seq_num 879) 2024-03-04T06:51:09.429 INFO:tasks.rados.rados.0.smithi137.stdout:2793: expect (ObjNum 838 snap 242 seq_num 838) 2024-03-04T06:51:09.540 INFO:tasks.rados.rados.0.smithi137.stdout:2794: finishing copy_from racing read to smithi13777483-31 2024-03-04T06:51:09.540 INFO:tasks.rados.rados.0.smithi137.stdout:2794: finishing copy_from to smithi13777483-31 2024-03-04T06:51:09.540 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16843 (ObjNum 835 snap 242 seq_num 835) dirty exists 2024-03-04T06:51:09.540 INFO:tasks.rados.rados.0.smithi137.stdout:2792: done (4 left) 2024-03-04T06:51:09.540 INFO:tasks.rados.rados.0.smithi137.stdout:2793: done (3 left) 2024-03-04T06:51:09.540 INFO:tasks.rados.rados.0.smithi137.stdout:2794: done (2 left) 2024-03-04T06:51:09.540 INFO:tasks.rados.rados.0.smithi137.stdout:2795: done (1 left) 2024-03-04T06:51:09.541 INFO:tasks.rados.rados.0.smithi137.stdout:2796: done (0 left) 2024-03-04T06:51:09.541 INFO:tasks.rados.rados.0.smithi137.stdout:2797: rmattr oid 40 current snap is 259 2024-03-04T06:51:09.541 INFO:tasks.rados.rados.0.smithi137.stdout:2798: snap_remove snap 255 2024-03-04T06:51:09.763 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:09.546+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:09.763 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:09.543+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:09.763 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:09.544+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:09.764 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:09.427+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:09.764 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:09.427+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:09.764 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:09.764 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:09.764 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:09.765 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:09.765 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:09.765 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-mon[85573]: osdmap e593: 8 total, 8 up, 8 in 2024-03-04T06:51:09.765 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:09.765 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:09.765 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:09.765 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:09.765 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:09.765 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:09.765 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-mon[85573]: Deploying daemon prometheus.a on smithi203 2024-03-04T06:51:09.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:09.544+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:09.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:09.428+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:09.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:09.428+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:09.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:09.428+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:09.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:09.549+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:09.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[88869]: osdmap e593: 8 total, 8 up, 8 in 2024-03-04T06:51:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:09.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[88869]: Deploying daemon prometheus.a on smithi203 2024-03-04T06:51:09.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:09.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:09.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:09.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:09.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:09.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[91314]: osdmap e593: 8 total, 8 up, 8 in 2024-03-04T06:51:09.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:09.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:09.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 131=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:09.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:09.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:09.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:09.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:09 smithi137 ceph-mon[91314]: Deploying daemon prometheus.a on smithi203 2024-03-04T06:51:10.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:09.762+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:10.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:09.762+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:10.434 INFO:tasks.rados.rados.0.smithi137.stdout:2798: done (1 left) 2024-03-04T06:51:10.434 INFO:tasks.rados.rados.0.smithi137.stdout:2799: rollback oid 44 current snap is 259 2024-03-04T06:51:10.434 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 44 to 258 2024-03-04T06:51:10.434 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 16836 (ObjNum 49 snap 0 seq_num 3817381322) dirty exists 2024-03-04T06:51:10.434 INFO:tasks.rados.rados.0.smithi137.stdout:2797: done (1 left) 2024-03-04T06:51:10.434 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 259 2024-03-04T06:51:10.434 INFO:tasks.rados.rados.0.smithi137.stdout:2800: seq_num 880 ranges {7602176=344064} 2024-03-04T06:51:10.477 INFO:tasks.rados.rados.0.smithi137.stdout:2800: writing smithi13777483-4 from 7602176 to 7946240 tid 1 2024-03-04T06:51:10.477 INFO:tasks.rados.rados.0.smithi137.stdout:2801: read oid 19 snap -1 2024-03-04T06:51:10.477 INFO:tasks.rados.rados.0.smithi137.stdout:2801: expect (ObjNum 866 snap 254 seq_num 866) 2024-03-04T06:51:10.478 INFO:tasks.rados.rados.0.smithi137.stdout:2802: delete oid 32 current snap is 259 2024-03-04T06:51:10.478 INFO:tasks.rados.rados.0.smithi137.stdout:2799: finishing rollback tid 0 to smithi13777483-44 2024-03-04T06:51:10.478 INFO:tasks.rados.rados.0.smithi137.stdout:2799: finishing rollback tid 1 to smithi13777483-44 2024-03-04T06:51:10.478 INFO:tasks.rados.rados.0.smithi137.stdout:2799: finishing rollback tid 2 to smithi13777483-44 2024-03-04T06:51:10.478 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16869 (ObjNum 838 snap 242 seq_num 838) dirty exists 2024-03-04T06:51:10.480 INFO:tasks.rados.rados.0.smithi137.stdout:2801: expect (ObjNum 866 snap 254 seq_num 866) 2024-03-04T06:51:10.485 INFO:tasks.rados.rados.0.smithi137.stdout:2800: finishing write tid 1 to smithi13777483-4 2024-03-04T06:51:10.485 INFO:tasks.rados.rados.0.smithi137.stdout:2800: finishing write tid 2 to smithi13777483-4 2024-03-04T06:51:10.485 INFO:tasks.rados.rados.0.smithi137.stdout:2799: done (3 left) 2024-03-04T06:51:10.485 INFO:tasks.rados.rados.0.smithi137.stdout:2801: done (2 left) 2024-03-04T06:51:10.485 INFO:tasks.rados.rados.0.smithi137.stdout:2802: done (1 left) 2024-03-04T06:51:10.485 INFO:tasks.rados.rados.0.smithi137.stdout:2803: rollback oid 5 current snap is 259 2024-03-04T06:51:10.485 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 5 to 256 2024-03-04T06:51:10.485 INFO:tasks.rados.rados.0.smithi137.stdout:2800: finishing write tid 3 to smithi13777483-4 2024-03-04T06:51:10.485 INFO:tasks.rados.rados.0.smithi137.stdout:2800: oid 4 updating version 0 to 15515 2024-03-04T06:51:10.485 INFO:tasks.rados.rados.0.smithi137.stdout:2800: oid 4 updating version 15515 to 15516 2024-03-04T06:51:10.485 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 15516 (ObjNum 880 snap 259 seq_num 880) dirty exists 2024-03-04T06:51:10.486 INFO:tasks.rados.rados.0.smithi137.stdout:2800: left oid 4 (ObjNum 880 snap 259 seq_num 880) 2024-03-04T06:51:10.486 INFO:tasks.rados.rados.0.smithi137.stdout:2800: done (1 left) 2024-03-04T06:51:10.486 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 259 2024-03-04T06:51:10.486 INFO:tasks.rados.rados.0.smithi137.stdout:2804: seq_num 882 ranges {6299648=376832} 2024-03-04T06:51:10.521 INFO:tasks.rados.rados.0.smithi137.stdout:2804: writing smithi13777483-38 from 6299648 to 6676480 tid 1 2024-03-04T06:51:10.521 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 259 2024-03-04T06:51:10.521 INFO:tasks.rados.rados.0.smithi137.stdout:2805: seq_num 883 ranges {7831552=393216} 2024-03-04T06:51:10.564 INFO:tasks.rados.rados.0.smithi137.stdout:2805: writing smithi13777483-20 from 7831552 to 8224768 tid 1 2024-03-04T06:51:10.564 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 259 2024-03-04T06:51:10.565 INFO:tasks.rados.rados.0.smithi137.stdout:2806: seq_num 884 ranges {114688=409600} 2024-03-04T06:51:10.567 INFO:tasks.rados.rados.0.smithi137.stdout:2806: writing smithi13777483-19 from 114688 to 524288 tid 1 2024-03-04T06:51:10.568 INFO:tasks.rados.rados.0.smithi137.stdout:2807: read oid 42 snap -1 2024-03-04T06:51:10.568 INFO:tasks.rados.rados.0.smithi137.stdout:2807: expect deleted 2024-03-04T06:51:10.568 INFO:tasks.rados.rados.0.smithi137.stdout:2808: read oid 36 snap -1 2024-03-04T06:51:10.568 INFO:tasks.rados.rados.0.smithi137.stdout:2808: expect deleted 2024-03-04T06:51:10.568 INFO:tasks.rados.rados.0.smithi137.stdout:2809: snap_remove snap 258 2024-03-04T06:51:10.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:10.438+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:10.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:10.435+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:10.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:10.435+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:10.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:10.437+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:10.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:10.442+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:10.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:10.439+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:10.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:10.439+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:10.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:10.439+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-mon[85573]: osdmap e594: 8 total, 8 up, 8 in 2024-03-04T06:51:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:10.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:10 smithi203 ceph-mon[85573]: pgmap v571: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 415 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 24 op/s 2024-03-04T06:51:10.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:10.434+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:10.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:10.438+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:10.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:10.450+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:10.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:10.442+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[88869]: osdmap e594: 8 total, 8 up, 8 in 2024-03-04T06:51:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[88869]: pgmap v571: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 415 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 24 op/s 2024-03-04T06:51:10.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:10.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[91314]: osdmap e594: 8 total, 8 up, 8 in 2024-03-04T06:51:10.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:10.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:10.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:10.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:10.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:10.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:10.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:10.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:10.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:10.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:10.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:10 smithi137 ceph-mon[91314]: pgmap v571: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 415 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 24 op/s 2024-03-04T06:51:11.439 INFO:tasks.rados.rados.0.smithi137.stdout:2809: done (6 left) 2024-03-04T06:51:11.439 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 35 current snap is 259 2024-03-04T06:51:11.439 INFO:tasks.rados.rados.0.smithi137.stdout:2810: seq_num 885 ranges {0=425984} 2024-03-04T06:51:11.442 INFO:tasks.rados.rados.0.smithi137.stdout:2810: writing smithi13777483-35 from 0 to 425984 tid 1 2024-03-04T06:51:11.442 INFO:tasks.rados.rados.0.smithi137.stdout:2811: read oid 32 snap -1 2024-03-04T06:51:11.442 INFO:tasks.rados.rados.0.smithi137.stdout:2811: expect deleted 2024-03-04T06:51:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:2812: rollback oid 10 current snap is 259 2024-03-04T06:51:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 10 to 256 2024-03-04T06:51:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 259 2024-03-04T06:51:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:2813: seq_num 886 ranges {0=442368} 2024-03-04T06:51:11.447 INFO:tasks.rados.rados.0.smithi137.stdout:2813: writing smithi13777483-34 from 0 to 442368 tid 1 2024-03-04T06:51:11.447 INFO:tasks.rados.rados.0.smithi137.stdout:2814: copy_from oid 30 from oid 4 current snap is 259 2024-03-04T06:51:11.447 INFO:tasks.rados.rados.0.smithi137.stdout:2803: finishing rollback tid 1 to smithi13777483-5 2024-03-04T06:51:11.447 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 0 (ObjNum 225 snap 0 seq_num 3130922976) dirty dne 2024-03-04T06:51:11.447 INFO:tasks.rados.rados.0.smithi137.stdout:2804: finishing write tid 1 to smithi13777483-38 2024-03-04T06:51:11.447 INFO:tasks.rados.rados.0.smithi137.stdout:2804: finishing write tid 2 to smithi13777483-38 2024-03-04T06:51:11.447 INFO:tasks.rados.rados.0.smithi137.stdout:2804: finishing write tid 3 to smithi13777483-38 2024-03-04T06:51:11.447 INFO:tasks.rados.rados.0.smithi137.stdout:2804: oid 38 updating version 0 to 16867 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:2804: oid 38 updating version 16867 to 16868 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16868 (ObjNum 882 snap 259 seq_num 882) dirty exists 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:2804: left oid 38 (ObjNum 882 snap 259 seq_num 882) 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:2805: finishing write tid 1 to smithi13777483-20 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:2805: finishing write tid 2 to smithi13777483-20 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:2805: finishing write tid 3 to smithi13777483-20 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:2805: oid 20 updating version 0 to 16874 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:2805: oid 20 updating version 16874 to 16875 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16875 (ObjNum 883 snap 259 seq_num 883) dirty exists 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:2805: left oid 20 (ObjNum 883 snap 259 seq_num 883) 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:2806: finishing write tid 1 to smithi13777483-19 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:2806: finishing write tid 2 to smithi13777483-19 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:2806: finishing write tid 3 to smithi13777483-19 2024-03-04T06:51:11.448 INFO:tasks.rados.rados.0.smithi137.stdout:2806: oid 19 updating version 0 to 15597 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:2806: oid 19 updating version 15597 to 15598 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 15598 (ObjNum 884 snap 259 seq_num 884) dirty exists 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:2806: left oid 19 (ObjNum 884 snap 259 seq_num 884) 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:2803: done (10 left) 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:2804: done (9 left) 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:2805: done (8 left) 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:2806: done (7 left) 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:2807: done (6 left) 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:2808: done (5 left) 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:2815: read oid 29 snap -1 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:2815: expect (ObjNum 872 snap 254 seq_num 872) 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:2816: read oid 11 snap -1 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:2816: expect deleted 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 259 2024-03-04T06:51:11.449 INFO:tasks.rados.rados.0.smithi137.stdout:2817: seq_num 887 ranges {0=458752} 2024-03-04T06:51:11.451 INFO:tasks.rados.rados.0.smithi137.stdout:2817: writing smithi13777483-39 from 0 to 458752 tid 1 2024-03-04T06:51:11.451 INFO:tasks.rados.rados.0.smithi137.stdout:2818: rollback oid 24 current snap is 259 2024-03-04T06:51:11.451 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 24 to 256 2024-03-04T06:51:11.451 INFO:tasks.rados.rados.0.smithi137.stdout:2819: rollback oid 1 current snap is 259 2024-03-04T06:51:11.451 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 1 to 256 2024-03-04T06:51:11.451 INFO:tasks.rados.rados.0.smithi137.stdout:2820: rmattr oid 2 current snap is 259 2024-03-04T06:51:11.452 INFO:tasks.rados.rados.0.smithi137.stdout:2810: finishing write tid 1 to smithi13777483-35 2024-03-04T06:51:11.452 INFO:tasks.rados.rados.0.smithi137.stdout:2811: done (10 left) 2024-03-04T06:51:11.452 INFO:tasks.rados.rados.0.smithi137.stdout:2816: done (9 left) 2024-03-04T06:51:11.452 INFO:tasks.rados.rados.0.smithi137.stdout:2821: copy_from oid 21 from oid 19 current snap is 259 2024-03-04T06:51:11.452 INFO:tasks.rados.rados.0.smithi137.stdout:2822: read oid 9 snap -1 2024-03-04T06:51:11.452 INFO:tasks.rados.rados.0.smithi137.stdout:2822: expect (ObjNum 863 snap 254 seq_num 863) 2024-03-04T06:51:11.452 INFO:tasks.rados.rados.0.smithi137.stdout:2823: read oid 13 snap -1 2024-03-04T06:51:11.452 INFO:tasks.rados.rados.0.smithi137.stdout:2823: expect (ObjNum 874 snap 255 seq_num 874) 2024-03-04T06:51:11.452 INFO:tasks.rados.rados.0.smithi137.stdout:2824: read oid 8 snap 256 2024-03-04T06:51:11.452 INFO:tasks.rados.rados.0.smithi137.stdout:2824: expect (ObjNum 771 snap 228 seq_num 771) 2024-03-04T06:51:11.452 INFO:tasks.rados.rados.0.smithi137.stdout:2810: finishing write tid 2 to smithi13777483-35 2024-03-04T06:51:11.453 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 259 2024-03-04T06:51:11.453 INFO:tasks.rados.rados.0.smithi137.stdout:2825: seq_num 888 ranges {8224768=475136} 2024-03-04T06:51:11.501 INFO:tasks.rados.rados.0.smithi137.stdout:2825: writing smithi13777483-20 from 8224768 to 8699904 tid 1 2024-03-04T06:51:11.502 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 259 2024-03-04T06:51:11.502 INFO:tasks.rados.rados.0.smithi137.stdout:2810: finishing write tid 3 to smithi13777483-35 2024-03-04T06:51:11.502 INFO:tasks.rados.rados.0.smithi137.stdout:2810: oid 35 updating version 0 to 16884 2024-03-04T06:51:11.502 INFO:tasks.rados.rados.0.smithi137.stdout:2810: oid 35 updating version 16884 to 16885 2024-03-04T06:51:11.502 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16885 (ObjNum 885 snap 259 seq_num 885) dirty exists 2024-03-04T06:51:11.502 INFO:tasks.rados.rados.0.smithi137.stdout:2810: left oid 35 (ObjNum 885 snap 259 seq_num 885) 2024-03-04T06:51:11.502 INFO:tasks.rados.rados.0.smithi137.stdout:2815: expect (ObjNum 872 snap 254 seq_num 872) 2024-03-04T06:51:11.584 INFO:tasks.rados.rados.0.smithi137.stdout:2823: expect (ObjNum 874 snap 255 seq_num 874) 2024-03-04T06:51:11.629 INFO:tasks.rados.rados.0.smithi137.stdout:2817: finishing write tid 1 to smithi13777483-39 2024-03-04T06:51:11.629 INFO:tasks.rados.rados.0.smithi137.stdout:2817: finishing write tid 2 to smithi13777483-39 2024-03-04T06:51:11.629 INFO:tasks.rados.rados.0.smithi137.stdout:2819: finishing rollback tid 0 to smithi13777483-1 2024-03-04T06:51:11.629 INFO:tasks.rados.rados.0.smithi137.stdout:2819: finishing rollback tid 1 to smithi13777483-1 2024-03-04T06:51:11.629 INFO:tasks.rados.rados.0.smithi137.stdout:2819: finishing rollback tid 2 to smithi13777483-1 2024-03-04T06:51:11.629 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 16858 (ObjNum 771 snap 228 seq_num 771) dirty exists 2024-03-04T06:51:11.630 INFO:tasks.rados.rados.0.smithi137.stdout:2813: finishing write tid 1 to smithi13777483-34 2024-03-04T06:51:11.630 INFO:tasks.rados.rados.0.smithi137.stdout:2813: finishing write tid 2 to smithi13777483-34 2024-03-04T06:51:11.630 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16859 (ObjNum 798 snap 231 seq_num 798) dirty exists 2024-03-04T06:51:11.630 INFO:tasks.rados.rados.0.smithi137.stdout:2818: finishing rollback tid 1 to smithi13777483-24 2024-03-04T06:51:11.630 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16857 (ObjNum 33 snap 0 seq_num 0) dirty dne 2024-03-04T06:51:11.630 INFO:tasks.rados.rados.0.smithi137.stdout:2817: finishing write tid 3 to smithi13777483-39 2024-03-04T06:51:11.630 INFO:tasks.rados.rados.0.smithi137.stdout:2817: oid 39 updating version 0 to 16860 2024-03-04T06:51:11.630 INFO:tasks.rados.rados.0.smithi137.stdout:2817: oid 39 version 16860 is already newer than 16859 2024-03-04T06:51:11.630 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 16860 (ObjNum 887 snap 259 seq_num 887) dirty exists 2024-03-04T06:51:11.630 INFO:tasks.rados.rados.0.smithi137.stdout:2817: left oid 39 (ObjNum 887 snap 259 seq_num 887) 2024-03-04T06:51:11.630 INFO:tasks.rados.rados.0.smithi137.stdout:2824: expect (ObjNum 771 snap 228 seq_num 771) 2024-03-04T06:51:11.655 INFO:tasks.rados.rados.0.smithi137.stdout:2813: finishing write tid 3 to smithi13777483-34 2024-03-04T06:51:11.655 INFO:tasks.rados.rados.0.smithi137.stdout:2813: oid 34 updating version 0 to 16870 2024-03-04T06:51:11.655 INFO:tasks.rados.rados.0.smithi137.stdout:2813: oid 34 updating version 16870 to 16871 2024-03-04T06:51:11.655 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16871 (ObjNum 886 snap 259 seq_num 886) dirty exists 2024-03-04T06:51:11.655 INFO:tasks.rados.rados.0.smithi137.stdout:2813: left oid 34 (ObjNum 886 snap 259 seq_num 886) 2024-03-04T06:51:11.655 INFO:tasks.rados.rados.0.smithi137.stdout:2812: finishing rollback tid 0 to smithi13777483-10 2024-03-04T06:51:11.655 INFO:tasks.rados.rados.0.smithi137.stdout:2812: finishing rollback tid 1 to smithi13777483-10 2024-03-04T06:51:11.655 INFO:tasks.rados.rados.0.smithi137.stdout:2826: seq_num 889 ranges {6299648=491520} 2024-03-04T06:51:11.689 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:11.437+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:11.689 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:11.437+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:11.689 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:11.442+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:11.690 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:11.445+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:11.690 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:11.450+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:11.690 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:11.449+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:11.690 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:11.449+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:11.690 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-mon[85573]: osdmap e595: 8 total, 8 up, 8 in 2024-03-04T06:51:11.690 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:11.690 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:11.690 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:11.691 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:11.691 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:11.691 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:11.691 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:11.691 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:11.691 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:11.691 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:11.692 INFO:tasks.rados.rados.0.smithi137.stdout:2826: writing smithi13777483-16 from 6299648 to 6791168 tid 1 2024-03-04T06:51:11.692 INFO:tasks.rados.rados.0.smithi137.stdout:2810: done (14 left) 2024-03-04T06:51:11.692 INFO:tasks.rados.rados.0.smithi137.stdout:2813: done (13 left) 2024-03-04T06:51:11.692 INFO:tasks.rados.rados.0.smithi137.stdout:2815: done (12 left) 2024-03-04T06:51:11.692 INFO:tasks.rados.rados.0.smithi137.stdout:2817: done (11 left) 2024-03-04T06:51:11.692 INFO:tasks.rados.rados.0.smithi137.stdout:2818: done (10 left) 2024-03-04T06:51:11.692 INFO:tasks.rados.rados.0.smithi137.stdout:2819: done (9 left) 2024-03-04T06:51:11.693 INFO:tasks.rados.rados.0.smithi137.stdout:2820: done (8 left) 2024-03-04T06:51:11.693 INFO:tasks.rados.rados.0.smithi137.stdout:2823: done (7 left) 2024-03-04T06:51:11.693 INFO:tasks.rados.rados.0.smithi137.stdout:2824: done (6 left) 2024-03-04T06:51:11.693 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 259 2024-03-04T06:51:11.693 INFO:tasks.rados.rados.0.smithi137.stdout:2812: finishing rollback tid 2 to smithi13777483-10 2024-03-04T06:51:11.693 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 15601 (ObjNum 625 snap 0 seq_num 3818492102) dirty exists 2024-03-04T06:51:11.693 INFO:tasks.rados.rados.0.smithi137.stdout:2814: finishing copy_from racing read to smithi13777483-30 2024-03-04T06:51:11.693 INFO:tasks.rados.rados.0.smithi137.stdout:2827: seq_num 890 ranges {0=507904} 2024-03-04T06:51:11.694 INFO:tasks.rados.rados.0.smithi137.stdout:2827: writing smithi13777483-42 from 0 to 507904 tid 1 2024-03-04T06:51:11.694 INFO:tasks.rados.rados.0.smithi137.stdout:2812: done (6 left) 2024-03-04T06:51:11.694 INFO:tasks.rados.rados.0.smithi137.stdout:2828: setattr oid 31 current snap is 259 2024-03-04T06:51:11.694 INFO:tasks.rados.rados.0.smithi137.stdout:2822: expect (ObjNum 863 snap 254 seq_num 863) 2024-03-04T06:51:11.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:11.438+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:11.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:11.444+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:11.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:11.444+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:11.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:11.444+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:11.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:11.444+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[88869]: osdmap e595: 8 total, 8 up, 8 in 2024-03-04T06:51:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:11.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[91314]: osdmap e595: 8 total, 8 up, 8 in 2024-03-04T06:51:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:11.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:12.217 INFO:tasks.rados.rados.0.smithi137.stdout:2821: finishing copy_from racing read to smithi13777483-21 2024-03-04T06:51:12.217 INFO:tasks.rados.rados.0.smithi137.stdout:2821: finishing copy_from to smithi13777483-21 2024-03-04T06:51:12.217 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 15598 (ObjNum 884 snap 259 seq_num 884) dirty exists 2024-03-04T06:51:12.217 INFO:tasks.rados.rados.0.smithi137.stdout:2814: finishing copy_from to smithi13777483-30 2024-03-04T06:51:12.217 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 15516 (ObjNum 880 snap 259 seq_num 880) dirty exists 2024-03-04T06:51:12.217 INFO:tasks.rados.rados.0.smithi137.stdout:2825: finishing write tid 1 to smithi13777483-20 2024-03-04T06:51:12.217 INFO:tasks.rados.rados.0.smithi137.stdout:2825: finishing write tid 2 to smithi13777483-20 2024-03-04T06:51:12.218 INFO:tasks.rados.rados.0.smithi137.stdout:2825: finishing write tid 3 to smithi13777483-20 2024-03-04T06:51:12.218 INFO:tasks.rados.rados.0.smithi137.stdout:2825: oid 20 updating version 0 to 16877 2024-03-04T06:51:12.218 INFO:tasks.rados.rados.0.smithi137.stdout:2825: oid 20 version 16877 is already newer than 16876 2024-03-04T06:51:12.218 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16877 (ObjNum 888 snap 259 seq_num 888) dirty exists 2024-03-04T06:51:12.218 INFO:tasks.rados.rados.0.smithi137.stdout:2825: left oid 20 (ObjNum 888 snap 259 seq_num 888) 2024-03-04T06:51:12.218 INFO:tasks.rados.rados.0.smithi137.stdout:2827: finishing write tid 1 to smithi13777483-42 2024-03-04T06:51:12.218 INFO:tasks.rados.rados.0.smithi137.stdout:2827: finishing write tid 2 to smithi13777483-42 2024-03-04T06:51:12.218 INFO:tasks.rados.rados.0.smithi137.stdout:2826: finishing write tid 1 to smithi13777483-16 2024-03-04T06:51:12.218 INFO:tasks.rados.rados.0.smithi137.stdout:2826: finishing write tid 2 to smithi13777483-16 2024-03-04T06:51:12.218 INFO:tasks.rados.rados.0.smithi137.stdout:2827: finishing write tid 3 to smithi13777483-42 2024-03-04T06:51:12.218 INFO:tasks.rados.rados.0.smithi137.stdout:2827: oid 42 updating version 0 to 16888 2024-03-04T06:51:12.218 INFO:tasks.rados.rados.0.smithi137.stdout:2827: oid 42 updating version 16888 to 16889 2024-03-04T06:51:12.218 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16889 (ObjNum 890 snap 259 seq_num 890) dirty exists 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:2827: left oid 42 (ObjNum 890 snap 259 seq_num 890) 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:2826: finishing write tid 3 to smithi13777483-16 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:2826: oid 16 updating version 0 to 16872 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:2826: oid 16 updating version 16872 to 16873 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16873 (ObjNum 889 snap 259 seq_num 889) dirty exists 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:2826: left oid 16 (ObjNum 889 snap 259 seq_num 889) 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:2814: done (6 left) 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:2821: done (5 left) 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:2822: done (4 left) 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:2825: done (3 left) 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:2826: done (2 left) 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:2827: done (1 left) 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:2829: copy_from oid 32 from oid 29 current snap is 259 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 259 2024-03-04T06:51:12.219 INFO:tasks.rados.rados.0.smithi137.stdout:2830: seq_num 891 ranges {7946240=532480} 2024-03-04T06:51:12.262 INFO:tasks.rados.rados.0.smithi137.stdout:2830: writing smithi13777483-30 from 7946240 to 8478720 tid 1 2024-03-04T06:51:12.262 INFO:tasks.rados.rados.0.smithi137.stdout:2831: copy_from oid 22 from oid 7 current snap is 259 2024-03-04T06:51:12.262 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16886 (ObjNum 835 snap 242 seq_num 835) dirty exists 2024-03-04T06:51:12.262 INFO:tasks.rados.rados.0.smithi137.stdout:2829: finishing copy_from racing read to smithi13777483-32 2024-03-04T06:51:12.262 INFO:tasks.rados.rados.0.smithi137.stdout:2829: finishing copy_from to smithi13777483-32 2024-03-04T06:51:12.262 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16851 (ObjNum 872 snap 254 seq_num 872) dirty exists 2024-03-04T06:51:12.262 INFO:tasks.rados.rados.0.smithi137.stdout:2828: done (3 left) 2024-03-04T06:51:12.262 INFO:tasks.rados.rados.0.smithi137.stdout:2829: done (2 left) 2024-03-04T06:51:12.262 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 37 current snap is 259 2024-03-04T06:51:12.262 INFO:tasks.rados.rados.0.smithi137.stdout:2832: seq_num 892 ranges {2695168=548864} 2024-03-04T06:51:12.280 INFO:tasks.rados.rados.0.smithi137.stdout:2832: writing smithi13777483-37 from 2695168 to 3244032 tid 1 2024-03-04T06:51:12.280 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 259 2024-03-04T06:51:12.280 INFO:tasks.rados.rados.0.smithi137.stdout:2830: finishing write tid 1 to smithi13777483-30 2024-03-04T06:51:12.280 INFO:tasks.rados.rados.0.smithi137.stdout:2830: finishing write tid 2 to smithi13777483-30 2024-03-04T06:51:12.281 INFO:tasks.rados.rados.0.smithi137.stdout:2830: finishing write tid 3 to smithi13777483-30 2024-03-04T06:51:12.281 INFO:tasks.rados.rados.0.smithi137.stdout:2830: oid 30 updating version 0 to 16789 2024-03-04T06:51:12.281 INFO:tasks.rados.rados.0.smithi137.stdout:2830: oid 30 updating version 16789 to 16790 2024-03-04T06:51:12.281 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16790 (ObjNum 891 snap 259 seq_num 891) dirty exists 2024-03-04T06:51:12.281 INFO:tasks.rados.rados.0.smithi137.stdout:2830: left oid 30 (ObjNum 891 snap 259 seq_num 891) 2024-03-04T06:51:12.281 INFO:tasks.rados.rados.0.smithi137.stdout:2831: finishing copy_from racing read to smithi13777483-22 2024-03-04T06:51:12.281 INFO:tasks.rados.rados.0.smithi137.stdout:2831: finishing copy_from to smithi13777483-22 2024-03-04T06:51:12.281 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 16830 (ObjNum 784 snap 231 seq_num 784) dirty exists 2024-03-04T06:51:12.281 INFO:tasks.rados.rados.0.smithi137.stdout:2833: seq_num 893 ranges {524288=565248} 2024-03-04T06:51:12.286 INFO:tasks.rados.rados.0.smithi137.stdout:2833: writing smithi13777483-21 from 524288 to 1089536 tid 1 2024-03-04T06:51:12.286 INFO:tasks.rados.rados.0.smithi137.stdout:2830: done (3 left) 2024-03-04T06:51:12.286 INFO:tasks.rados.rados.0.smithi137.stdout:2831: done (2 left) 2024-03-04T06:51:12.286 INFO:tasks.rados.rados.0.smithi137.stdout:2834: read oid 23 snap -1 2024-03-04T06:51:12.287 INFO:tasks.rados.rados.0.smithi137.stdout:2834: expect (ObjNum 851 snap 248 seq_num 851) 2024-03-04T06:51:12.287 INFO:tasks.rados.rados.0.smithi137.stdout:2835: delete oid 30 current snap is 259 2024-03-04T06:51:12.287 INFO:tasks.rados.rados.0.smithi137.stdout:2832: finishing write tid 1 to smithi13777483-37 2024-03-04T06:51:12.287 INFO:tasks.rados.rados.0.smithi137.stdout:2832: finishing write tid 2 to smithi13777483-37 2024-03-04T06:51:12.287 INFO:tasks.rados.rados.0.smithi137.stdout:2832: finishing write tid 3 to smithi13777483-37 2024-03-04T06:51:12.287 INFO:tasks.rados.rados.0.smithi137.stdout:2832: oid 37 updating version 0 to 16837 2024-03-04T06:51:12.287 INFO:tasks.rados.rados.0.smithi137.stdout:2832: oid 37 updating version 16837 to 16838 2024-03-04T06:51:12.287 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16838 (ObjNum 892 snap 259 seq_num 892) dirty exists 2024-03-04T06:51:12.287 INFO:tasks.rados.rados.0.smithi137.stdout:2832: left oid 37 (ObjNum 892 snap 259 seq_num 892) 2024-03-04T06:51:12.289 INFO:tasks.rados.rados.0.smithi137.stdout:2833: finishing write tid 1 to smithi13777483-21 2024-03-04T06:51:12.289 INFO:tasks.rados.rados.0.smithi137.stdout:2833: finishing write tid 2 to smithi13777483-21 2024-03-04T06:51:12.291 INFO:tasks.rados.rados.0.smithi137.stdout:2833: finishing write tid 3 to smithi13777483-21 2024-03-04T06:51:12.291 INFO:tasks.rados.rados.0.smithi137.stdout:2833: oid 21 updating version 0 to 16870 2024-03-04T06:51:12.291 INFO:tasks.rados.rados.0.smithi137.stdout:2833: oid 21 version 16870 is already newer than 16869 2024-03-04T06:51:12.291 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 16870 (ObjNum 893 snap 259 seq_num 893) dirty exists 2024-03-04T06:51:12.291 INFO:tasks.rados.rados.0.smithi137.stdout:2833: left oid 21 (ObjNum 893 snap 259 seq_num 893) 2024-03-04T06:51:12.294 INFO:tasks.rados.rados.0.smithi137.stdout:2834: expect (ObjNum 851 snap 248 seq_num 851) 2024-03-04T06:51:12.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 systemd[1]: Stopping Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:51:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:2832: done (3 left) 2024-03-04T06:51:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:2833: done (2 left) 2024-03-04T06:51:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:2834: done (1 left) 2024-03-04T06:51:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:2835: done (0 left) 2024-03-04T06:51:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:2836: read oid 46 snap -1 2024-03-04T06:51:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:2836: expect (ObjNum 867 snap 254 seq_num 867) 2024-03-04T06:51:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:2837: rmattr oid 49 current snap is 259 2024-03-04T06:51:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:2837: done (1 left) 2024-03-04T06:51:12.353 INFO:tasks.rados.rados.0.smithi137.stdout:2838: snap_create 2024-03-04T06:51:12.359 INFO:tasks.rados.rados.0.smithi137.stdout:2836: expect (ObjNum 867 snap 254 seq_num 867) 2024-03-04T06:51:12.445 INFO:tasks.rados.rados.0.smithi137.stdout:2836: done (1 left) 2024-03-04T06:51:12.445 INFO:tasks.rados.rados.0.smithi137.stdout:2838: done (0 left) 2024-03-04T06:51:12.445 INFO:tasks.rados.rados.0.smithi137.stdout:2839: snap_create 2024-03-04T06:51:12.694 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:12.444+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:12.694 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:12.444+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[88869]: osdmap e596: 8 total, 8 up, 8 in 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[88869]: pgmap v574: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 415 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 1.1 MiB/s wr, 2 op/s 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:12.695 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[91314]: osdmap e596: 8 total, 8 up, 8 in 2024-03-04T06:51:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:12 smithi137 ceph-mon[91314]: pgmap v574: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 415 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 1.1 MiB/s wr, 2 op/s 2024-03-04T06:51:12.770 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:12.440+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:12.770 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:12.441+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:12.770 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:12.441+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:12.770 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:12.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:12.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-mon[85573]: osdmap e596: 8 total, 8 up, 8 in 2024-03-04T06:51:12.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:12.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:12.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:12.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:12.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:12.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:12.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 139=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:12.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:12.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-mon[85573]: pgmap v574: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 415 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 1.1 MiB/s wr, 2 op/s 2024-03-04T06:51:12.771 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:51:12.487Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-04T06:51:12.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:51:12.487Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-04T06:51:12.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:51:12.487Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-04T06:51:12.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:51:12.487Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-04T06:51:12.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:51:12.487Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-04T06:51:12.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:51:12.487Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-04T06:51:12.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:51:12.487Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-04T06:51:12.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:51:12.487Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-04T06:51:12.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:51:12.487Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-04T06:51:12.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:51:12.488Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-04T06:51:12.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:51:12.488Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-04T06:51:12.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[76498]: ts=2024-03-04T06:51:12.488Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-04T06:51:12.772 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:12 smithi203 podman[117061]: 2024-03-04 06:51:12.497992222 +0000 UTC m=+0.270759277 container died 6a88bdd1023c75676b0612fafce87598bdf5e91c38c14e90272d00f617631b29 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:51:13.096 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:13 smithi203 podman[117061]: 2024-03-04 06:51:13.003933256 +0000 UTC m=+0.776700309 container cleanup 6a88bdd1023c75676b0612fafce87598bdf5e91c38c14e90272d00f617631b29 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:51:13.096 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:13 smithi203 bash[117061]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a 2024-03-04T06:51:13.440 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:13.328+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:13.440 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:13.328+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:13.441 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:13.328+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:13.441 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:13 smithi203 podman[117076]: 2024-03-04 06:51:13.163580691 +0000 UTC m=+0.668662372 container remove 6a88bdd1023c75676b0612fafce87598bdf5e91c38c14e90272d00f617631b29 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:51:13.441 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:13 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@prometheus.a.service: Deactivated successfully. 2024-03-04T06:51:13.441 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:13 smithi203 systemd[1]: Stopped Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:51:13.441 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:13 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@prometheus.a.service: Consumed 2.564s CPU time. 2024-03-04T06:51:13.441 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:13.326+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:13.442 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:13.327+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:13.451 INFO:tasks.rados.rados.0.smithi137.stdout:2839: done (0 left) 2024-03-04T06:51:13.451 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 261 2024-03-04T06:51:13.451 INFO:tasks.rados.rados.0.smithi137.stdout:2840: seq_num 895 ranges {0=598016} 2024-03-04T06:51:13.455 INFO:tasks.rados.rados.0.smithi137.stdout:2840: writing smithi13777483-15 from 0 to 598016 tid 1 2024-03-04T06:51:13.455 INFO:tasks.rados.rados.0.smithi137.stdout:2841: rollback oid 3 current snap is 261 2024-03-04T06:51:13.455 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 3 to 259 2024-03-04T06:51:13.455 INFO:tasks.rados.rados.0.smithi137.stdout:2842: read oid 50 snap 256 2024-03-04T06:51:13.456 INFO:tasks.rados.rados.0.smithi137.stdout:2842: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:51:13.456 INFO:tasks.rados.rados.0.smithi137.stdout:2843: read oid 24 snap 260 2024-03-04T06:51:13.456 INFO:tasks.rados.rados.0.smithi137.stdout:2843: expect deleted 2024-03-04T06:51:13.456 INFO:tasks.rados.rados.0.smithi137.stdout:2844: read oid 43 snap -1 2024-03-04T06:51:13.456 INFO:tasks.rados.rados.0.smithi137.stdout:2844: expect deleted 2024-03-04T06:51:13.456 INFO:tasks.rados.rados.0.smithi137.stdout:2845: read oid 33 snap 260 2024-03-04T06:51:13.456 INFO:tasks.rados.rados.0.smithi137.stdout:2845: expect deleted 2024-03-04T06:51:13.456 INFO:tasks.rados.rados.0.smithi137.stdout:2846: read oid 48 snap -1 2024-03-04T06:51:13.456 INFO:tasks.rados.rados.0.smithi137.stdout:2846: expect deleted 2024-03-04T06:51:13.456 INFO:tasks.rados.rados.0.smithi137.stdout:2847: rollback oid 30 current snap is 261 2024-03-04T06:51:13.456 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 30 to 260 2024-03-04T06:51:13.456 INFO:tasks.rados.rados.0.smithi137.stdout:2848: setattr oid 5 current snap is 261 2024-03-04T06:51:13.461 INFO:tasks.rados.rados.0.smithi137.stdout:2845: done (8 left) 2024-03-04T06:51:13.461 INFO:tasks.rados.rados.0.smithi137.stdout:2846: done (7 left) 2024-03-04T06:51:13.461 INFO:tasks.rados.rados.0.smithi137.stdout:2849: copy_from oid 12 from oid 8 current snap is 261 2024-03-04T06:51:13.461 INFO:tasks.rados.rados.0.smithi137.stdout:2850: rollback oid 21 current snap is 261 2024-03-04T06:51:13.461 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 21 to 256 2024-03-04T06:51:13.461 INFO:tasks.rados.rados.0.smithi137.stdout:2851: read oid 36 snap -1 2024-03-04T06:51:13.462 INFO:tasks.rados.rados.0.smithi137.stdout:2851: expect deleted 2024-03-04T06:51:13.462 INFO:tasks.rados.rados.0.smithi137.stdout:2852: snap_create 2024-03-04T06:51:13.464 INFO:tasks.rados.rados.0.smithi137.stdout:2840: finishing write tid 1 to smithi13777483-15 2024-03-04T06:51:13.466 INFO:tasks.rados.rados.0.smithi137.stdout:2847: finishing rollback tid 1 to smithi13777483-30 2024-03-04T06:51:13.466 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16791 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-04T06:51:13.466 INFO:tasks.rados.rados.0.smithi137.stdout:2840: finishing write tid 2 to smithi13777483-15 2024-03-04T06:51:13.467 INFO:tasks.rados.rados.0.smithi137.stdout:2842: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:51:13.532 INFO:tasks.rados.rados.0.smithi137.stdout:2841: finishing rollback tid 0 to smithi13777483-3 2024-03-04T06:51:13.532 INFO:tasks.rados.rados.0.smithi137.stdout:2840: finishing write tid 3 to smithi13777483-15 2024-03-04T06:51:13.532 INFO:tasks.rados.rados.0.smithi137.stdout:2840: oid 15 updating version 0 to 16840 2024-03-04T06:51:13.532 INFO:tasks.rados.rados.0.smithi137.stdout:2840: oid 15 version 16840 is already newer than 16839 2024-03-04T06:51:13.532 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16840 (ObjNum 895 snap 261 seq_num 895) dirty exists 2024-03-04T06:51:13.532 INFO:tasks.rados.rados.0.smithi137.stdout:2840: left oid 15 (ObjNum 895 snap 261 seq_num 895) 2024-03-04T06:51:13.532 INFO:tasks.rados.rados.0.smithi137.stdout:2841: finishing rollback tid 1 to smithi13777483-3 2024-03-04T06:51:13.532 INFO:tasks.rados.rados.0.smithi137.stdout:2841: finishing rollback tid 2 to smithi13777483-3 2024-03-04T06:51:13.532 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 15604 (ObjNum 824 snap 237 seq_num 824) dirty exists 2024-03-04T06:51:13.532 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 15605 (ObjNum -1132483360 snap 32761 seq_num 304) dirty exists 2024-03-04T06:51:13.533 INFO:tasks.rados.rados.0.smithi137.stdout:2850: finishing rollback tid 0 to smithi13777483-21 2024-03-04T06:51:13.533 INFO:tasks.rados.rados.0.smithi137.stdout:2850: finishing rollback tid 1 to smithi13777483-21 2024-03-04T06:51:13.533 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 16872 (ObjNum 161 snap 0 seq_num 3162484128) dirty dne 2024-03-04T06:51:13.533 INFO:tasks.rados.rados.0.smithi137.stdout:2849: finishing copy_from racing read to smithi13777483-12 2024-03-04T06:51:13.533 INFO:tasks.rados.rados.0.smithi137.stdout:2849: finishing copy_from to smithi13777483-12 2024-03-04T06:51:13.533 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16855 (ObjNum 771 snap 228 seq_num 771) dirty exists 2024-03-04T06:51:13.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:13.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:13.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-mon[88869]: osdmap e597: 8 total, 8 up, 8 in 2024-03-04T06:51:13.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:13.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:13.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:13.454+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:13.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:13.454+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:13.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:13.455+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:13.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:13.325+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:13.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:13.470+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:13.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:13.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:13.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-mon[91314]: osdmap e597: 8 total, 8 up, 8 in 2024-03-04T06:51:13.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:13.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:13.545 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:13.251+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:13.545 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:13.470+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:13.806 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:13 smithi203 systemd[1]: Starting Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:51:13.807 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:13.451+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:13.807 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:13.452+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:13.807 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:13.462+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:13.807 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:13.807 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:13.807 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-mon[85573]: osdmap e597: 8 total, 8 up, 8 in 2024-03-04T06:51:13.808 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:13.808 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:13.808 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:13.460+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:13.808 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:13.461+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:13.808 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:13.462+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:13.808 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:13.462+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:14.058 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:13 smithi203 podman[117208]: 2024-03-04 06:51:13.711051404 +0000 UTC m=+0.019213254 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-03-04T06:51:14.058 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:13 smithi203 podman[117208]: 2024-03-04 06:51:13.850375344 +0000 UTC m=+0.158537240 container create 85dcb15cec84891aaf4104fcce0f82c39b3c459303e65fb78fda1ed1e38f6b65 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:51:14.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 podman[117208]: 2024-03-04 06:51:14.059005603 +0000 UTC m=+0.367167453 container init 85dcb15cec84891aaf4104fcce0f82c39b3c459303e65fb78fda1ed1e38f6b65 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:51:14.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 podman[117208]: 2024-03-04 06:51:14.061597653 +0000 UTC m=+0.369759514 container start 85dcb15cec84891aaf4104fcce0f82c39b3c459303e65fb78fda1ed1e38f6b65 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T06:51:14.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.085Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-04T06:51:14.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.085Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-04T06:51:14.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.085Z caller=main.go:570 level=info host_details="(Linux 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 x86_64 smithi203 (none))" 2024-03-04T06:51:14.346 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.085Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.086Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.087Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.087Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.088Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.088Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.091Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.091Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.779µs 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.091Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.092Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=4 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.100Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=4 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.102Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=4 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.107Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=4 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.107Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=4 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.107Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=21.128µs wal_replay_duration=16.118241ms wbl_replay_duration=120ns total_replay_duration=16.157149ms 2024-03-04T06:51:14.347 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.109Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-04T06:51:14.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.109Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-04T06:51:14.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.109Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-04T06:51:14.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 bash[117208]: 85dcb15cec84891aaf4104fcce0f82c39b3c459303e65fb78fda1ed1e38f6b65 2024-03-04T06:51:14.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 systemd[1]: Started Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:51:14.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.133Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=24.252716ms db_storage=818ns remote_storage=1.225µs web_handler=375ns query_engine=623ns scrape=380.685µs scrape_sd=260.614µs notify=16.486µs notify_sd=9.609µs rules=23.340605ms tracing=7.721µs 2024-03-04T06:51:14.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.133Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-04T06:51:14.348 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T06:51:14.133Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-04T06:51:14.460 INFO:tasks.rados.rados.0.smithi137.stdout:2840: done (10 left) 2024-03-04T06:51:14.460 INFO:tasks.rados.rados.0.smithi137.stdout:2841: done (9 left) 2024-03-04T06:51:14.460 INFO:tasks.rados.rados.0.smithi137.stdout:2842: done (8 left) 2024-03-04T06:51:14.460 INFO:tasks.rados.rados.0.smithi137.stdout:2843: done (7 left) 2024-03-04T06:51:14.460 INFO:tasks.rados.rados.0.smithi137.stdout:2844: done (6 left) 2024-03-04T06:51:14.460 INFO:tasks.rados.rados.0.smithi137.stdout:2847: done (5 left) 2024-03-04T06:51:14.460 INFO:tasks.rados.rados.0.smithi137.stdout:2848: done (4 left) 2024-03-04T06:51:14.460 INFO:tasks.rados.rados.0.smithi137.stdout:2849: done (3 left) 2024-03-04T06:51:14.460 INFO:tasks.rados.rados.0.smithi137.stdout:2850: done (2 left) 2024-03-04T06:51:14.460 INFO:tasks.rados.rados.0.smithi137.stdout:2851: done (1 left) 2024-03-04T06:51:14.460 INFO:tasks.rados.rados.0.smithi137.stdout:2852: done (0 left) 2024-03-04T06:51:14.461 INFO:tasks.rados.rados.0.smithi137.stdout:2853: delete oid 25 current snap is 262 2024-03-04T06:51:14.464 INFO:tasks.rados.rados.0.smithi137.stdout:2853: done (0 left) 2024-03-04T06:51:14.464 INFO:tasks.rados.rados.0.smithi137.stdout:2854: read oid 49 snap -1 2024-03-04T06:51:14.464 INFO:tasks.rados.rados.0.smithi137.stdout:2854: expect (ObjNum 844 snap 246 seq_num 844) 2024-03-04T06:51:14.465 INFO:tasks.rados.rados.0.smithi137.stdout:2855: delete oid 29 current snap is 262 2024-03-04T06:51:14.472 INFO:tasks.rados.rados.0.smithi137.stdout:2855: done (1 left) 2024-03-04T06:51:14.472 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 262 2024-03-04T06:51:14.473 INFO:tasks.rados.rados.0.smithi137.stdout:2856: seq_num 898 ranges {8699904=647168} 2024-03-04T06:51:14.523 INFO:tasks.rados.rados.0.smithi137.stdout:2856: writing smithi13777483-20 from 8699904 to 9347072 tid 1 2024-03-04T06:51:14.523 INFO:tasks.rados.rados.0.smithi137.stdout:2857: copy_from oid 19 from oid 39 current snap is 262 2024-03-04T06:51:14.523 INFO:tasks.rados.rados.0.smithi137.stdout:2854: expect (ObjNum 844 snap 246 seq_num 844) 2024-03-04T06:51:14.665 INFO:tasks.rados.rados.0.smithi137.stdout:2856: finishing write tid 1 to smithi13777483-20 2024-03-04T06:51:14.665 INFO:tasks.rados.rados.0.smithi137.stdout:2856: finishing write tid 2 to smithi13777483-20 2024-03-04T06:51:14.665 INFO:tasks.rados.rados.0.smithi137.stdout:2856: finishing write tid 3 to smithi13777483-20 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:2856: oid 20 updating version 0 to 16879 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:2856: oid 20 version 16879 is already newer than 16878 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16879 (ObjNum 898 snap 262 seq_num 898) dirty exists 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:2856: left oid 20 (ObjNum 898 snap 262 seq_num 898) 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:2857: finishing copy_from racing read to smithi13777483-19 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:2854: done (2 left) 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:2856: done (1 left) 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:2858: read oid 35 snap 261 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:2858: expect (ObjNum 885 snap 259 seq_num 885) 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:2859: rollback oid 18 current snap is 262 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 18 to 256 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:2857: finishing copy_from to smithi13777483-19 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 16860 (ObjNum 887 snap 259 seq_num 887) dirty exists 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:2857: done (2 left) 2024-03-04T06:51:14.666 INFO:tasks.rados.rados.0.smithi137.stdout:2860: read oid 19 snap -1 2024-03-04T06:51:14.667 INFO:tasks.rados.rados.0.smithi137.stdout:2860: expect (ObjNum 887 snap 259 seq_num 887) 2024-03-04T06:51:14.667 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 262 2024-03-04T06:51:14.667 INFO:tasks.rados.rados.0.smithi137.stdout:2861: seq_num 899 ranges {917504=663552} 2024-03-04T06:51:14.674 INFO:tasks.rados.rados.0.smithi137.stdout:2861: writing smithi13777483-12 from 917504 to 1581056 tid 1 2024-03-04T06:51:14.674 INFO:tasks.rados.rados.0.smithi137.stdout:2862: setattr oid 29 current snap is 262 2024-03-04T06:51:14.674 INFO:tasks.rados.rados.0.smithi137.stdout:2858: expect (ObjNum 885 snap 259 seq_num 885) 2024-03-04T06:51:14.686 INFO:tasks.rados.rados.0.smithi137.stdout:2859: finishing rollback tid 0 to smithi13777483-18 2024-03-04T06:51:14.686 INFO:tasks.rados.rados.0.smithi137.stdout:2859: finishing rollback tid 1 to smithi13777483-18 2024-03-04T06:51:14.686 INFO:tasks.rados.rados.0.smithi137.stdout:2859: finishing rollback tid 2 to smithi13777483-18 2024-03-04T06:51:14.686 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16857 (ObjNum 129 snap 0 seq_num 0) dirty exists 2024-03-04T06:51:14.686 INFO:tasks.rados.rados.0.smithi137.stdout:2860: expect (ObjNum 887 snap 259 seq_num 887) 2024-03-04T06:51:14.700 INFO:tasks.rados.rados.0.smithi137.stdout:2861: finishing write tid 1 to smithi13777483-12 2024-03-04T06:51:14.700 INFO:tasks.rados.rados.0.smithi137.stdout:2861: finishing write tid 2 to smithi13777483-12 2024-03-04T06:51:14.700 INFO:tasks.rados.rados.0.smithi137.stdout:2861: finishing write tid 3 to smithi13777483-12 2024-03-04T06:51:14.701 INFO:tasks.rados.rados.0.smithi137.stdout:2861: oid 12 updating version 0 to 16856 2024-03-04T06:51:14.701 INFO:tasks.rados.rados.0.smithi137.stdout:2861: oid 12 updating version 16856 to 16857 2024-03-04T06:51:14.701 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16857 (ObjNum 899 snap 262 seq_num 899) dirty exists 2024-03-04T06:51:14.701 INFO:tasks.rados.rados.0.smithi137.stdout:2861: left oid 12 (ObjNum 899 snap 262 seq_num 899) 2024-03-04T06:51:14.701 INFO:tasks.rados.rados.0.smithi137.stdout:2858: done (4 left) 2024-03-04T06:51:14.701 INFO:tasks.rados.rados.0.smithi137.stdout:2859: done (3 left) 2024-03-04T06:51:14.701 INFO:tasks.rados.rados.0.smithi137.stdout:2860: done (2 left) 2024-03-04T06:51:14.701 INFO:tasks.rados.rados.0.smithi137.stdout:2861: done (1 left) 2024-03-04T06:51:14.701 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 262 2024-03-04T06:51:14.701 INFO:tasks.rados.rados.0.smithi137.stdout:2863: seq_num 900 ranges {7634944=679936} 2024-03-04T06:51:14.745 INFO:tasks.rados.rados.0.smithi137.stdout:2863: writing smithi13777483-9 from 7634944 to 8314880 tid 1 2024-03-04T06:51:14.745 INFO:tasks.rados.rados.0.smithi137.stdout:2864: read oid 21 snap 261 2024-03-04T06:51:14.746 INFO:tasks.rados.rados.0.smithi137.stdout:2864: expect deleted 2024-03-04T06:51:14.746 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16858 (ObjNum 0 snap 0 seq_num 304) dirty exists 2024-03-04T06:51:14.746 INFO:tasks.rados.rados.0.smithi137.stdout:2865: read oid 48 snap -1 2024-03-04T06:51:14.746 INFO:tasks.rados.rados.0.smithi137.stdout:2865: expect deleted 2024-03-04T06:51:14.746 INFO:tasks.rados.rados.0.smithi137.stdout:2862: done (3 left) 2024-03-04T06:51:14.746 INFO:tasks.rados.rados.0.smithi137.stdout:2866: snap_remove snap 259 2024-03-04T06:51:14.756 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:14.463+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:14.756 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:14.459+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:14.756 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:14.460+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:14.756 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:14.756 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:14.756 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: osdmap e598: 8 total, 8 up, 8 in 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:14.757 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:14.758 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[91314]: pgmap v577: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 426 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 13 MiB/s rd, 4.7 MiB/s wr, 24 op/s 2024-03-04T06:51:14.758 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:14.758 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:14.758 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:14.758 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:14.758 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:14.758 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:14.758 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: osdmap e598: 8 total, 8 up, 8 in 2024-03-04T06:51:14.758 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:14.758 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:14.758 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:14.758 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:14.758 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:14.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:14.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:14.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:14.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:14.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:14.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:14.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:14.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-mon[88869]: pgmap v577: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 426 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 13 MiB/s rd, 4.7 MiB/s wr, 24 op/s 2024-03-04T06:51:14.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:14.471+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:14.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:14.470+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: osdmap e598: 8 total, 8 up, 8 in 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:14.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-mon[85573]: pgmap v577: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 426 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 13 MiB/s rd, 4.7 MiB/s wr, 24 op/s 2024-03-04T06:51:14.848 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:14.458+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:14.848 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:14.458+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:14.848 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:14.458+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:14.848 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:14.467+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:14.848 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:14.467+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:14.848 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:14.468+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:15.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:14.755+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:15.466 INFO:tasks.rados.rados.0.smithi137.stdout:2866: done (3 left) 2024-03-04T06:51:15.467 INFO:tasks.rados.rados.0.smithi137.stdout:2867: delete oid 32 current snap is 262 2024-03-04T06:51:15.467 INFO:tasks.rados.rados.0.smithi137.stdout:2863: finishing write tid 1 to smithi13777483-9 2024-03-04T06:51:15.467 INFO:tasks.rados.rados.0.smithi137.stdout:2863: finishing write tid 2 to smithi13777483-9 2024-03-04T06:51:15.467 INFO:tasks.rados.rados.0.smithi137.stdout:2863: finishing write tid 3 to smithi13777483-9 2024-03-04T06:51:15.467 INFO:tasks.rados.rados.0.smithi137.stdout:2863: oid 9 updating version 0 to 16861 2024-03-04T06:51:15.467 INFO:tasks.rados.rados.0.smithi137.stdout:2863: oid 9 updating version 16861 to 16862 2024-03-04T06:51:15.467 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 16862 (ObjNum 900 snap 262 seq_num 900) dirty exists 2024-03-04T06:51:15.467 INFO:tasks.rados.rados.0.smithi137.stdout:2863: left oid 9 (ObjNum 900 snap 262 seq_num 900) 2024-03-04T06:51:15.473 INFO:tasks.rados.rados.0.smithi137.stdout:2863: done (3 left) 2024-03-04T06:51:15.473 INFO:tasks.rados.rados.0.smithi137.stdout:2864: done (2 left) 2024-03-04T06:51:15.474 INFO:tasks.rados.rados.0.smithi137.stdout:2865: done (1 left) 2024-03-04T06:51:15.474 INFO:tasks.rados.rados.0.smithi137.stdout:2867: done (0 left) 2024-03-04T06:51:15.474 INFO:tasks.rados.rados.0.smithi137.stdout:2868: snap_remove snap 261 2024-03-04T06:51:15.530 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:15.530 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:15.530 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:15.530 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-mon[85573]: osdmap e599: 8 total, 8 up, 8 in 2024-03-04T06:51:15.530 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:15.530 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:15.530 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:15.530 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:15.531 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:15.531 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:15.531 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:15.531 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:15.531 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:15.466+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:15.531 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:15.467+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:15.531 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:15.473+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:15.532 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:15.472+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:15.532 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:15.472+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:15.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:15.472+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:15.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:15.468+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:15.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:15.468+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:15.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:15.468+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:15.794 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:15.478+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[91314]: osdmap e599: 8 total, 8 up, 8 in 2024-03-04T06:51:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:15.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[88869]: osdmap e599: 8 total, 8 up, 8 in 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:15.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:15.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:15.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:16.308 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:16.063+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:16.308 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:16.063+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:16.481 INFO:tasks.rados.rados.0.smithi137.stdout:2868: done (0 left) 2024-03-04T06:51:16.481 INFO:tasks.rados.rados.0.smithi137.stdout:2869: copy_from oid 33 from oid 15 current snap is 262 2024-03-04T06:51:16.481 INFO:tasks.rados.rados.0.smithi137.stdout:2870: copy_from oid 16 from oid 12 current snap is 262 2024-03-04T06:51:16.481 INFO:tasks.rados.rados.0.smithi137.stdout:2871: rmattr oid 8 current snap is 262 2024-03-04T06:51:16.481 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 262 2024-03-04T06:51:16.481 INFO:tasks.rados.rados.0.smithi137.stdout:2872: seq_num 902 ranges {5324800=712704} 2024-03-04T06:51:16.515 INFO:tasks.rados.rados.0.smithi137.stdout:2872: writing smithi13777483-3 from 5324800 to 6037504 tid 1 2024-03-04T06:51:16.515 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 262 2024-03-04T06:51:16.515 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16856 (ObjNum 771 snap 228 seq_num 771) dirty exists 2024-03-04T06:51:16.515 INFO:tasks.rados.rados.0.smithi137.stdout:2869: finishing copy_from racing read to smithi13777483-33 2024-03-04T06:51:16.515 INFO:tasks.rados.rados.0.smithi137.stdout:2869: finishing copy_from to smithi13777483-33 2024-03-04T06:51:16.515 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16840 (ObjNum 895 snap 261 seq_num 895) dirty exists 2024-03-04T06:51:16.515 INFO:tasks.rados.rados.0.smithi137.stdout:2870: finishing copy_from racing read to smithi13777483-16 2024-03-04T06:51:16.515 INFO:tasks.rados.rados.0.smithi137.stdout:2873: seq_num 903 ranges {458752=729088} 2024-03-04T06:51:16.521 INFO:tasks.rados.rados.0.smithi137.stdout:2873: writing smithi13777483-19 from 458752 to 1187840 tid 1 2024-03-04T06:51:16.522 INFO:tasks.rados.rados.0.smithi137.stdout:2869: done (4 left) 2024-03-04T06:51:16.522 INFO:tasks.rados.rados.0.smithi137.stdout:2871: done (3 left) 2024-03-04T06:51:16.522 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 262 2024-03-04T06:51:16.522 INFO:tasks.rados.rados.0.smithi137.stdout:2870: finishing copy_from to smithi13777483-16 2024-03-04T06:51:16.522 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16857 (ObjNum 899 snap 262 seq_num 899) dirty exists 2024-03-04T06:51:16.522 INFO:tasks.rados.rados.0.smithi137.stdout:2872: finishing write tid 1 to smithi13777483-3 2024-03-04T06:51:16.522 INFO:tasks.rados.rados.0.smithi137.stdout:2872: finishing write tid 2 to smithi13777483-3 2024-03-04T06:51:16.522 INFO:tasks.rados.rados.0.smithi137.stdout:2874: seq_num 904 ranges {1695744=745472} 2024-03-04T06:51:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:2874: writing smithi13777483-46 from 1695744 to 2441216 tid 1 2024-03-04T06:51:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:2870: done (3 left) 2024-03-04T06:51:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:2875: snap_create 2024-03-04T06:51:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:2872: finishing write tid 3 to smithi13777483-3 2024-03-04T06:51:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:2872: oid 3 updating version 0 to 16864 2024-03-04T06:51:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:2872: oid 3 version 16864 is already newer than 16863 2024-03-04T06:51:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 16864 (ObjNum 902 snap 262 seq_num 902) dirty exists 2024-03-04T06:51:16.535 INFO:tasks.rados.rados.0.smithi137.stdout:2872: left oid 3 (ObjNum 902 snap 262 seq_num 902) 2024-03-04T06:51:16.536 INFO:tasks.rados.rados.0.smithi137.stdout:2873: finishing write tid 1 to smithi13777483-19 2024-03-04T06:51:16.536 INFO:tasks.rados.rados.0.smithi137.stdout:2873: finishing write tid 2 to smithi13777483-19 2024-03-04T06:51:16.536 INFO:tasks.rados.rados.0.smithi137.stdout:2873: finishing write tid 3 to smithi13777483-19 2024-03-04T06:51:16.536 INFO:tasks.rados.rados.0.smithi137.stdout:2873: oid 19 updating version 0 to 16866 2024-03-04T06:51:16.536 INFO:tasks.rados.rados.0.smithi137.stdout:2873: oid 19 version 16866 is already newer than 16865 2024-03-04T06:51:16.536 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 16866 (ObjNum 903 snap 262 seq_num 903) dirty exists 2024-03-04T06:51:16.536 INFO:tasks.rados.rados.0.smithi137.stdout:2873: left oid 19 (ObjNum 903 snap 262 seq_num 903) 2024-03-04T06:51:16.539 INFO:tasks.rados.rados.0.smithi137.stdout:2874: finishing write tid 1 to smithi13777483-46 2024-03-04T06:51:16.539 INFO:tasks.rados.rados.0.smithi137.stdout:2874: finishing write tid 2 to smithi13777483-46 2024-03-04T06:51:16.541 INFO:tasks.rados.rados.0.smithi137.stdout:2874: finishing write tid 3 to smithi13777483-46 2024-03-04T06:51:16.541 INFO:tasks.rados.rados.0.smithi137.stdout:2874: oid 46 updating version 0 to 16891 2024-03-04T06:51:16.541 INFO:tasks.rados.rados.0.smithi137.stdout:2874: oid 46 updating version 16891 to 16892 2024-03-04T06:51:16.541 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 16892 (ObjNum 904 snap 262 seq_num 904) dirty exists 2024-03-04T06:51:16.541 INFO:tasks.rados.rados.0.smithi137.stdout:2874: left oid 46 (ObjNum 904 snap 262 seq_num 904) 2024-03-04T06:51:16.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:16.494+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:16.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:16.472+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:16.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:16.472+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:16.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:16.472+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:16.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:16.485+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:16.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:16.484+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:16.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:16.484+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:16.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:16.485+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-mon[85573]: osdmap e600: 8 total, 8 up, 8 in 2024-03-04T06:51:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:16.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:16.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:16 smithi203 ceph-mon[85573]: pgmap v580: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 426 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 17 MiB/s rd, 4.8 MiB/s wr, 32 op/s 2024-03-04T06:51:16.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:16.477+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:16.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:16.485+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:16.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:16.488+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:16.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:16.489+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[88869]: osdmap e600: 8 total, 8 up, 8 in 2024-03-04T06:51:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:16.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[88869]: pgmap v580: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 426 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 17 MiB/s rd, 4.8 MiB/s wr, 32 op/s 2024-03-04T06:51:16.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[91314]: osdmap e600: 8 total, 8 up, 8 in 2024-03-04T06:51:16.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:16.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:16.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:16.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:16.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:16.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:16.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:16.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:16.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:16.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:16.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:16 smithi137 ceph-mon[91314]: pgmap v580: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 426 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 17 MiB/s rd, 4.8 MiB/s wr, 32 op/s 2024-03-04T06:51:17.487 INFO:tasks.rados.rados.0.smithi137.stdout:2872: done (3 left) 2024-03-04T06:51:17.487 INFO:tasks.rados.rados.0.smithi137.stdout:2873: done (2 left) 2024-03-04T06:51:17.487 INFO:tasks.rados.rados.0.smithi137.stdout:2874: done (1 left) 2024-03-04T06:51:17.488 INFO:tasks.rados.rados.0.smithi137.stdout:2875: done (0 left) 2024-03-04T06:51:17.488 INFO:tasks.rados.rados.0.smithi137.stdout:2876: rmattr oid 44 current snap is 263 2024-03-04T06:51:17.488 INFO:tasks.rados.rados.0.smithi137.stdout:2876: done (0 left) 2024-03-04T06:51:17.488 INFO:tasks.rados.rados.0.smithi137.stdout:2877: rmattr oid 50 current snap is 263 2024-03-04T06:51:17.488 INFO:tasks.rados.rados.0.smithi137.stdout:2878: read oid 37 snap -1 2024-03-04T06:51:17.488 INFO:tasks.rados.rados.0.smithi137.stdout:2878: expect (ObjNum 892 snap 259 seq_num 892) 2024-03-04T06:51:17.488 INFO:tasks.rados.rados.0.smithi137.stdout:2879: copy_from oid 18 from oid 43 current snap is 263 2024-03-04T06:51:17.488 INFO:tasks.rados.rados.0.smithi137.stdout:2880: copy_from oid 35 from oid 11 current snap is 263 2024-03-04T06:51:17.488 INFO:tasks.rados.rados.0.smithi137.stdout:2881: read oid 40 snap -1 2024-03-04T06:51:17.488 INFO:tasks.rados.rados.0.smithi137.stdout:2881: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:51:17.488 INFO:tasks.rados.rados.0.smithi137.stdout:2882: snap_create 2024-03-04T06:51:17.489 INFO:tasks.rados.rados.0.smithi137.stdout:2879: finishing copy_from to smithi13777483-18 2024-03-04T06:51:17.489 INFO:tasks.rados.rados.0.smithi137.stdout:2879: got expected ENOENT (src dne) 2024-03-04T06:51:17.489 INFO:tasks.rados.rados.0.smithi137.stdout:2879: finishing copy_from racing read to smithi13777483-18 2024-03-04T06:51:17.493 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 16893 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:51:17.495 INFO:tasks.rados.rados.0.smithi137.stdout:2880: finishing copy_from to smithi13777483-35 2024-03-04T06:51:17.495 INFO:tasks.rados.rados.0.smithi137.stdout:2880: got expected ENOENT (src dne) 2024-03-04T06:51:17.495 INFO:tasks.rados.rados.0.smithi137.stdout:2880: finishing copy_from racing read to smithi13777483-35 2024-03-04T06:51:17.495 INFO:tasks.rados.rados.0.smithi137.stdout:2881: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:51:17.504 INFO:tasks.rados.rados.0.smithi137.stdout:2878: expect (ObjNum 892 snap 259 seq_num 892) 2024-03-04T06:51:17.723 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:17.490+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:17.723 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:17.480+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:17.724 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:17.480+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:17.724 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:17.490+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:17.724 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:17.490+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:17.724 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:17.724 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:17.724 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:17.725 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-mon[85573]: osdmap e601: 8 total, 8 up, 8 in 2024-03-04T06:51:17.725 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:17.725 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:17.725 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:17.725 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:17.725 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:17.725 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:17.725 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:17.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:17.487+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:17.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:17.494+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:17.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[88869]: osdmap e601: 8 total, 8 up, 8 in 2024-03-04T06:51:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:17.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:17.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:17.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:17.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:17.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[91314]: osdmap e601: 8 total, 8 up, 8 in 2024-03-04T06:51:17.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:17.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:17.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:17.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:17.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:17.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:17.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:18.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:17.884+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:18.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:17.884+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:18.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:17.884+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:18.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:17.884+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:18.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:17.884+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:2877: done (5 left) 2024-03-04T06:51:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:2878: done (4 left) 2024-03-04T06:51:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:2879: done (3 left) 2024-03-04T06:51:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:2880: done (2 left) 2024-03-04T06:51:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:2881: done (1 left) 2024-03-04T06:51:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:2882: done (0 left) 2024-03-04T06:51:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:2883: read oid 13 snap -1 2024-03-04T06:51:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:2883: expect (ObjNum 874 snap 255 seq_num 874) 2024-03-04T06:51:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 264 2024-03-04T06:51:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:2884: seq_num 905 ranges {3481600=761856} 2024-03-04T06:51:18.514 INFO:tasks.rados.rados.0.smithi137.stdout:2884: writing smithi13777483-22 from 3481600 to 4243456 tid 1 2024-03-04T06:51:18.514 INFO:tasks.rados.rados.0.smithi137.stdout:2885: rollback oid 8 current snap is 264 2024-03-04T06:51:18.514 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 8 to 260 2024-03-04T06:51:18.514 INFO:tasks.rados.rados.0.smithi137.stdout:2883: expect (ObjNum 874 snap 255 seq_num 874) 2024-03-04T06:51:18.564 INFO:tasks.rados.rados.0.smithi137.stdout:2885: finishing rollback tid 0 to smithi13777483-8 2024-03-04T06:51:18.564 INFO:tasks.rados.rados.0.smithi137.stdout:2885: finishing rollback tid 1 to smithi13777483-8 2024-03-04T06:51:18.564 INFO:tasks.rados.rados.0.smithi137.stdout:2885: finishing rollback tid 2 to smithi13777483-8 2024-03-04T06:51:18.564 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16859 (ObjNum 771 snap 228 seq_num 771) dirty exists 2024-03-04T06:51:18.564 INFO:tasks.rados.rados.0.smithi137.stdout:2884: finishing write tid 1 to smithi13777483-22 2024-03-04T06:51:18.564 INFO:tasks.rados.rados.0.smithi137.stdout:2884: finishing write tid 2 to smithi13777483-22 2024-03-04T06:51:18.564 INFO:tasks.rados.rados.0.smithi137.stdout:2884: finishing write tid 3 to smithi13777483-22 2024-03-04T06:51:18.564 INFO:tasks.rados.rados.0.smithi137.stdout:2884: oid 22 updating version 0 to 16841 2024-03-04T06:51:18.565 INFO:tasks.rados.rados.0.smithi137.stdout:2884: oid 22 updating version 16841 to 16842 2024-03-04T06:51:18.565 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 16842 (ObjNum 905 snap 264 seq_num 905) dirty exists 2024-03-04T06:51:18.565 INFO:tasks.rados.rados.0.smithi137.stdout:2884: left oid 22 (ObjNum 905 snap 264 seq_num 905) 2024-03-04T06:51:18.565 INFO:tasks.rados.rados.0.smithi137.stdout:2883: done (2 left) 2024-03-04T06:51:18.565 INFO:tasks.rados.rados.0.smithi137.stdout:2884: done (1 left) 2024-03-04T06:51:18.565 INFO:tasks.rados.rados.0.smithi137.stdout:2885: done (0 left) 2024-03-04T06:51:18.565 INFO:tasks.rados.rados.0.smithi137.stdout:2886: snap_create 2024-03-04T06:51:18.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:18.490+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:18.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:18.520+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:18.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:18.521+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:18.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:18.521+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[88869]: osdmap e602: 8 total, 8 up, 8 in 2024-03-04T06:51:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:18.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:18.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:18.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:18.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[88869]: pgmap v583: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 434 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 1.9 MiB/s wr, 32 op/s 2024-03-04T06:51:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[91314]: osdmap e602: 8 total, 8 up, 8 in 2024-03-04T06:51:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:18.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:18.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:18.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:18.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:18.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:18 smithi137 ceph-mon[91314]: pgmap v583: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 434 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 1.9 MiB/s wr, 32 op/s 2024-03-04T06:51:18.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:18.494+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:18.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:18.517+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:18.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:18.517+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:18.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:18.521+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:18.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:18.493+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:18.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:18.493+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:18.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:18.494+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:18.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-mon[85573]: osdmap e602: 8 total, 8 up, 8 in 2024-03-04T06:51:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-mon[85573]: pgmap v583: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 434 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 1.9 MiB/s wr, 32 op/s 2024-03-04T06:51:19.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:18.872+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:19.496 INFO:tasks.rados.rados.0.smithi137.stdout:2886: done (0 left) 2024-03-04T06:51:19.496 INFO:tasks.rados.rados.0.smithi137.stdout:2887: snap_remove snap 262 2024-03-04T06:51:19.786 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:19.493+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:19.786 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:19.493+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:19.786 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:19.786 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:19.786 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: osdmap e603: 8 total, 8 up, 8 in 2024-03-04T06:51:19.786 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:19.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:19.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:19.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:19.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:19.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:19.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:19.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:19.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:19.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:19.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:19.787 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:19.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:19.495+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:19.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:19.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:19.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: osdmap e603: 8 total, 8 up, 8 in 2024-03-04T06:51:19.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:19.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:19.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:19.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: osdmap e603: 8 total, 8 up, 8 in 2024-03-04T06:51:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:20.084 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:19.955+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:20.084 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:19.955+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:20.502 INFO:tasks.rados.rados.0.smithi137.stdout:2887: done (0 left) 2024-03-04T06:51:20.502 INFO:tasks.rados.rados.0.smithi137.stdout:2888: delete oid 16 current snap is 265 2024-03-04T06:51:20.511 INFO:tasks.rados.rados.0.smithi137.stdout:2888: done (0 left) 2024-03-04T06:51:20.511 INFO:tasks.rados.rados.0.smithi137.stdout:2889: read oid 10 snap -1 2024-03-04T06:51:20.511 INFO:tasks.rados.rados.0.smithi137.stdout:2889: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:51:20.511 INFO:tasks.rados.rados.0.smithi137.stdout:2890: read oid 18 snap -1 2024-03-04T06:51:20.511 INFO:tasks.rados.rados.0.smithi137.stdout:2890: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:51:20.511 INFO:tasks.rados.rados.0.smithi137.stdout:2891: snap_remove snap 260 2024-03-04T06:51:20.754 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:20.456+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:20.754 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:20.504+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:20.755 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:20.508+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:20.755 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:20.499+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:20.755 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:20.499+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:20.755 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:20.499+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:20.756 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:20.456+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:20.756 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:20.457+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:20.756 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:20.752+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:20.756 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:20.752+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:20.756 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:20.752+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:20.756 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:20.756 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:20.756 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-mon[85573]: osdmap e604: 8 total, 8 up, 8 in 2024-03-04T06:51:20.757 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:20.757 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:20.757 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:20 smithi203 ceph-mon[85573]: pgmap v586: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 434 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2024-03-04T06:51:20.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:20.499+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:20.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-mon[88869]: osdmap e604: 8 total, 8 up, 8 in 2024-03-04T06:51:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-mon[88869]: pgmap v586: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 434 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2024-03-04T06:51:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-mon[91314]: osdmap e604: 8 total, 8 up, 8 in 2024-03-04T06:51:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-mon[91314]: pgmap v586: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 434 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2024-03-04T06:51:20.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:20.458+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:20.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:20.506+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:20.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:20.457+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:20.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:20.458+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:20.796 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:20.458+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:20.796 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:20.505+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:20.796 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:20.510+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:21.511 INFO:tasks.rados.rados.0.smithi137.stdout:2889: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:51:21.511 INFO:tasks.rados.rados.0.smithi137.stdout:2890: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:51:21.514 INFO:tasks.rados.rados.0.smithi137.stdout:2889: done (2 left) 2024-03-04T06:51:21.514 INFO:tasks.rados.rados.0.smithi137.stdout:2890: done (1 left) 2024-03-04T06:51:21.514 INFO:tasks.rados.rados.0.smithi137.stdout:2891: done (0 left) 2024-03-04T06:51:21.514 INFO:tasks.rados.rados.0.smithi137.stdout:2892: read oid 29 snap -1 2024-03-04T06:51:21.514 INFO:tasks.rados.rados.0.smithi137.stdout:2892: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:51:21.514 INFO:tasks.rados.rados.0.smithi137.stdout:2893: copy_from oid 44 from oid 13 current snap is 265 2024-03-04T06:51:21.514 INFO:tasks.rados.rados.0.smithi137.stdout:2894: copy_from oid 20 from oid 50 current snap is 265 2024-03-04T06:51:21.514 INFO:tasks.rados.rados.0.smithi137.stdout:2895: delete oid 46 current snap is 265 2024-03-04T06:51:21.516 INFO:tasks.rados.rados.0.smithi137.stdout:2892: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:51:21.521 INFO:tasks.rados.rados.0.smithi137.stdout:2892: done (3 left) 2024-03-04T06:51:21.521 INFO:tasks.rados.rados.0.smithi137.stdout:2895: done (2 left) 2024-03-04T06:51:21.521 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 265 2024-03-04T06:51:21.522 INFO:tasks.rados.rados.0.smithi137.stdout:2896: seq_num 908 ranges {3481600=409600,3891200=401408} 2024-03-04T06:51:21.543 INFO:tasks.rados.rados.0.smithi137.stdout:2896: writing smithi13777483-7 from 3481600 to 3891200 tid 1 2024-03-04T06:51:21.546 INFO:tasks.rados.rados.0.smithi137.stdout:2896: writing smithi13777483-7 from 3891200 to 4292608 tid 2 2024-03-04T06:51:21.546 INFO:tasks.rados.rados.0.smithi137.stdout:2897: copy_from oid 29 from oid 41 current snap is 265 2024-03-04T06:51:21.546 INFO:tasks.rados.rados.0.smithi137.stdout:2894: finishing copy_from racing read to smithi13777483-20 2024-03-04T06:51:21.546 INFO:tasks.rados.rados.0.smithi137.stdout:2893: finishing copy_from racing read to smithi13777483-44 2024-03-04T06:51:21.546 INFO:tasks.rados.rados.0.smithi137.stdout:2894: finishing copy_from to smithi13777483-20 2024-03-04T06:51:21.546 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16893 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:51:21.546 INFO:tasks.rados.rados.0.smithi137.stdout:2893: finishing copy_from to smithi13777483-44 2024-03-04T06:51:21.546 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16886 (ObjNum 874 snap 255 seq_num 874) dirty exists 2024-03-04T06:51:21.546 INFO:tasks.rados.rados.0.smithi137.stdout:2893: done (3 left) 2024-03-04T06:51:21.546 INFO:tasks.rados.rados.0.smithi137.stdout:2894: done (2 left) 2024-03-04T06:51:21.546 INFO:tasks.rados.rados.0.smithi137.stdout:2898: copy_from oid 37 from oid 6 current snap is 265 2024-03-04T06:51:21.546 INFO:tasks.rados.rados.0.smithi137.stdout:2899: snap_remove snap 264 2024-03-04T06:51:21.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:21.528+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:21.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:21.507+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:21.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:21.507+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:21.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:21.508+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:21.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:21.511+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: osdmap e605: 8 total, 8 up, 8 in 2024-03-04T06:51:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: osdmap e605: 8 total, 8 up, 8 in 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:21.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:21.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:21.528+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:21.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:21.529+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:21.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:21.509+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:21.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:21.510+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:21.847 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:21.506+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:21.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:21.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:21.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:21.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:21.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:21.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:21.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:21.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:21.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:21.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: osdmap e605: 8 total, 8 up, 8 in 2024-03-04T06:51:21.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:21.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:21.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:21.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:21.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:21.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:21.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:21.848 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:21.530+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:21.848 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:21.530+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:22.520 INFO:tasks.rados.rados.0.smithi137.stdout:2899: done (3 left) 2024-03-04T06:51:22.520 INFO:tasks.rados.rados.0.smithi137.stdout:2900: copy_from oid 45 from oid 23 current snap is 265 2024-03-04T06:51:22.520 INFO:tasks.rados.rados.0.smithi137.stdout:2896: finishing write tid 1 to smithi13777483-7 2024-03-04T06:51:22.520 INFO:tasks.rados.rados.0.smithi137.stdout:2898: finishing copy_from racing read to smithi13777483-37 2024-03-04T06:51:22.520 INFO:tasks.rados.rados.0.smithi137.stdout:2896: finishing write tid 2 to smithi13777483-7 2024-03-04T06:51:22.520 INFO:tasks.rados.rados.0.smithi137.stdout:2896: finishing write tid 3 to smithi13777483-7 2024-03-04T06:51:22.520 INFO:tasks.rados.rados.0.smithi137.stdout:2898: finishing copy_from to smithi13777483-37 2024-03-04T06:51:22.520 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16825 (ObjNum 787 snap 231 seq_num 787) dirty exists 2024-03-04T06:51:22.520 INFO:tasks.rados.rados.0.smithi137.stdout:2896: finishing write tid 4 to smithi13777483-7 2024-03-04T06:51:22.520 INFO:tasks.rados.rados.0.smithi137.stdout:2896: oid 7 updating version 0 to 16861 2024-03-04T06:51:22.520 INFO:tasks.rados.rados.0.smithi137.stdout:2896: oid 7 updating version 16861 to 16862 2024-03-04T06:51:22.520 INFO:tasks.rados.rados.0.smithi137.stdout:2896: oid 7 version 16862 is already newer than 16860 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16862 (ObjNum 908 snap 265 seq_num 908) dirty exists 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:2896: left oid 7 (ObjNum 908 snap 265 seq_num 908) 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:2897: finishing copy_from racing read to smithi13777483-29 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:2897: finishing copy_from to smithi13777483-29 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16858 (ObjNum 822 snap 236 seq_num 822) dirty exists 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:2896: done (3 left) 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:2897: done (2 left) 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:2898: done (1 left) 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:2901: rmattr oid 42 current snap is 265 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:2901: done (1 left) 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:2902: rollback oid 15 current snap is 265 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 15 to 263 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:2903: copy_from oid 33 from oid 39 current snap is 265 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:2904: read oid 48 snap -1 2024-03-04T06:51:22.521 INFO:tasks.rados.rados.0.smithi137.stdout:2904: expect deleted 2024-03-04T06:51:22.522 INFO:tasks.rados.rados.0.smithi137.stdout:2905: setattr oid 6 current snap is 265 2024-03-04T06:51:22.522 INFO:tasks.rados.rados.0.smithi137.stdout:2904: done (4 left) 2024-03-04T06:51:22.522 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 265 2024-03-04T06:51:22.522 INFO:tasks.rados.rados.0.smithi137.stdout:2906: seq_num 909 ranges {3522560=425984,3948544=401408} 2024-03-04T06:51:22.543 INFO:tasks.rados.rados.0.smithi137.stdout:2906: writing smithi13777483-31 from 3522560 to 3948544 tid 1 2024-03-04T06:51:22.545 INFO:tasks.rados.rados.0.smithi137.stdout:2906: writing smithi13777483-31 from 3948544 to 4349952 tid 2 2024-03-04T06:51:22.545 INFO:tasks.rados.rados.0.smithi137.stdout:2907: read oid 16 snap -1 2024-03-04T06:51:22.545 INFO:tasks.rados.rados.0.smithi137.stdout:2907: expect deleted 2024-03-04T06:51:22.546 INFO:tasks.rados.rados.0.smithi137.stdout:2908: snap_remove snap 256 2024-03-04T06:51:22.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:22.524+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:22.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:22.524+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:22.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:22.521+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:22.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:22.517+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[91314]: osdmap e606: 8 total, 8 up, 8 in 2024-03-04T06:51:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[91314]: pgmap v589: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 434 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 312 KiB/s rd, 146 KiB/s wr, 2 op/s 2024-03-04T06:51:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[88869]: osdmap e606: 8 total, 8 up, 8 in 2024-03-04T06:51:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:22 smithi137 ceph-mon[88869]: pgmap v589: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 434 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 312 KiB/s rd, 146 KiB/s wr, 2 op/s 2024-03-04T06:51:22.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:22.527+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:22.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:22.526+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:22.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:22.520+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:22.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:22.520+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:22.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:22.520+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:22.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:22.518+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:22.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:22.518+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:22.847 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:22.518+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:22.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-mon[85573]: osdmap e606: 8 total, 8 up, 8 in 2024-03-04T06:51:22.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:22.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:22.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:22.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:22.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:22.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:22.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:22.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:22.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:22.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:22.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:22 smithi203 ceph-mon[85573]: pgmap v589: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 434 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 312 KiB/s rd, 146 KiB/s wr, 2 op/s 2024-03-04T06:51:23.524 INFO:tasks.rados.rados.0.smithi137.stdout:2908: done (6 left) 2024-03-04T06:51:23.524 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 265 2024-03-04T06:51:23.524 INFO:tasks.rados.rados.0.smithi137.stdout:2902: finishing rollback tid 0 to smithi13777483-15 2024-03-04T06:51:23.524 INFO:tasks.rados.rados.0.smithi137.stdout:2902: finishing rollback tid 1 to smithi13777483-15 2024-03-04T06:51:23.524 INFO:tasks.rados.rados.0.smithi137.stdout:2909: seq_num 910 ranges {917504=442368,1359872=401408} 2024-03-04T06:51:23.532 INFO:tasks.rados.rados.0.smithi137.stdout:2909: writing smithi13777483-8 from 917504 to 1359872 tid 1 2024-03-04T06:51:23.535 INFO:tasks.rados.rados.0.smithi137.stdout:2909: writing smithi13777483-8 from 1359872 to 1761280 tid 2 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:2910: rollback oid 22 current snap is 265 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 22 to 263 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:2902: finishing rollback tid 2 to smithi13777483-15 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16845 (ObjNum 895 snap 261 seq_num 895) dirty exists 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16846 (ObjNum 787 snap 231 seq_num 787) dirty exists 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:2903: finishing copy_from racing read to smithi13777483-33 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:2903: finishing copy_from to smithi13777483-33 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16860 (ObjNum 887 snap 259 seq_num 887) dirty exists 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:2900: finishing copy_from racing read to smithi13777483-45 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:2900: finishing copy_from to smithi13777483-45 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16866 (ObjNum 851 snap 248 seq_num 851) dirty exists 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:2906: finishing write tid 1 to smithi13777483-31 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:2906: finishing write tid 2 to smithi13777483-31 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:2906: finishing write tid 3 to smithi13777483-31 2024-03-04T06:51:23.536 INFO:tasks.rados.rados.0.smithi137.stdout:2906: finishing write tid 4 to smithi13777483-31 2024-03-04T06:51:23.537 INFO:tasks.rados.rados.0.smithi137.stdout:2906: oid 31 updating version 0 to 16887 2024-03-04T06:51:23.537 INFO:tasks.rados.rados.0.smithi137.stdout:2906: oid 31 updating version 16887 to 16888 2024-03-04T06:51:23.537 INFO:tasks.rados.rados.0.smithi137.stdout:2906: oid 31 updating version 16888 to 16889 2024-03-04T06:51:23.537 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16889 (ObjNum 909 snap 265 seq_num 909) dirty exists 2024-03-04T06:51:23.537 INFO:tasks.rados.rados.0.smithi137.stdout:2906: left oid 31 (ObjNum 909 snap 265 seq_num 909) 2024-03-04T06:51:23.537 INFO:tasks.rados.rados.0.smithi137.stdout:2900: done (7 left) 2024-03-04T06:51:23.537 INFO:tasks.rados.rados.0.smithi137.stdout:2902: done (6 left) 2024-03-04T06:51:23.537 INFO:tasks.rados.rados.0.smithi137.stdout:2903: done (5 left) 2024-03-04T06:51:23.537 INFO:tasks.rados.rados.0.smithi137.stdout:2905: done (4 left) 2024-03-04T06:51:23.537 INFO:tasks.rados.rados.0.smithi137.stdout:2906: done (3 left) 2024-03-04T06:51:23.537 INFO:tasks.rados.rados.0.smithi137.stdout:2907: done (2 left) 2024-03-04T06:51:23.537 INFO:tasks.rados.rados.0.smithi137.stdout:2911: snap_create 2024-03-04T06:51:23.537 INFO:tasks.rados.rados.0.smithi137.stdout:2909: finishing write tid 1 to smithi13777483-8 2024-03-04T06:51:23.539 INFO:tasks.rados.rados.0.smithi137.stdout:2910: finishing rollback tid 0 to smithi13777483-22 2024-03-04T06:51:23.539 INFO:tasks.rados.rados.0.smithi137.stdout:2909: finishing write tid 2 to smithi13777483-8 2024-03-04T06:51:23.539 INFO:tasks.rados.rados.0.smithi137.stdout:2910: finishing rollback tid 1 to smithi13777483-22 2024-03-04T06:51:23.540 INFO:tasks.rados.rados.0.smithi137.stdout:2910: finishing rollback tid 2 to smithi13777483-22 2024-03-04T06:51:23.540 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 16849 (ObjNum 784 snap 231 seq_num 784) dirty exists 2024-03-04T06:51:23.540 INFO:tasks.rados.rados.0.smithi137.stdout:2909: finishing write tid 3 to smithi13777483-8 2024-03-04T06:51:23.542 INFO:tasks.rados.rados.0.smithi137.stdout:2909: finishing write tid 4 to smithi13777483-8 2024-03-04T06:51:23.542 INFO:tasks.rados.rados.0.smithi137.stdout:2909: oid 8 updating version 0 to 16865 2024-03-04T06:51:23.542 INFO:tasks.rados.rados.0.smithi137.stdout:2909: oid 8 version 16865 is already newer than 16863 2024-03-04T06:51:23.542 INFO:tasks.rados.rados.0.smithi137.stdout:2909: oid 8 version 16865 is already newer than 16864 2024-03-04T06:51:23.543 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16865 (ObjNum 910 snap 265 seq_num 910) dirty exists 2024-03-04T06:51:23.543 INFO:tasks.rados.rados.0.smithi137.stdout:2909: left oid 8 (ObjNum 910 snap 265 seq_num 910) 2024-03-04T06:51:23.650 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:23.527+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:23.650 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:23.527+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:23.650 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:23.527+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:23.650 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:23.531+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:23.651 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:23.520+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:23.651 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:23.651 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: osdmap e607: 8 total, 8 up, 8 in 2024-03-04T06:51:23.651 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:23.651 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:23.651 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:23.652 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:23.652 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:23.652 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:23.652 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:23.652 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:23.652 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:23.652 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:23.652 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:23.652 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:51:23.652 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:51:23.652 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:23.652 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:51:23.652 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:51:23.653 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:23.653 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.653 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.653 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.653 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.653 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.653 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.653 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.653 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.653 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.653 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.654 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:23.654 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: osdmap e607: 8 total, 8 up, 8 in 2024-03-04T06:51:23.654 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:23.654 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:23.654 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:23.654 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:23.654 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:23.654 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:23.654 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:23.654 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:23.654 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:23.654 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.656 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.656 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.656 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.656 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.656 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.656 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.656 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:51:23.656 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.656 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.656 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.657 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.657 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:51:23.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:23.531+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:23.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:23.531+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:23.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:23.520+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:23.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:23.520+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:23.847 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:23.526+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:23.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:23.663+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:23.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:23.663+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:23.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:23.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: osdmap e607: 8 total, 8 up, 8 in 2024-03-04T06:51:23.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:23.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:23.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:23.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:23.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:23.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:23.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:23.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:23.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:23.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:23.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:23.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:51:23.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:51:23.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:23.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:51:23.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-04T06:51:23.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:23.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:23.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:51:24.532 INFO:tasks.rados.rados.0.smithi137.stdout:2909: done (2 left) 2024-03-04T06:51:24.532 INFO:tasks.rados.rados.0.smithi137.stdout:2910: done (1 left) 2024-03-04T06:51:24.532 INFO:tasks.rados.rados.0.smithi137.stdout:2911: done (0 left) 2024-03-04T06:51:24.532 INFO:tasks.rados.rados.0.smithi137.stdout:2912: read oid 26 snap 263 2024-03-04T06:51:24.532 INFO:tasks.rados.rados.0.smithi137.stdout:2912: expect (ObjNum 852 snap 249 seq_num 852) 2024-03-04T06:51:24.532 INFO:tasks.rados.rados.0.smithi137.stdout:2913: rollback oid 15 current snap is 266 2024-03-04T06:51:24.532 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 15 to 265 2024-03-04T06:51:24.532 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 266 2024-03-04T06:51:24.532 INFO:tasks.rados.rados.0.smithi137.stdout:2914: seq_num 911 ranges {2400256=466944,2867200=401408} 2024-03-04T06:51:24.550 INFO:tasks.rados.rados.0.smithi137.stdout:2914: writing smithi13777483-14 from 2400256 to 2867200 tid 1 2024-03-04T06:51:24.553 INFO:tasks.rados.rados.0.smithi137.stdout:2914: writing smithi13777483-14 from 2867200 to 3268608 tid 2 2024-03-04T06:51:24.553 INFO:tasks.rados.rados.0.smithi137.stdout:2915: read oid 35 snap -1 2024-03-04T06:51:24.553 INFO:tasks.rados.rados.0.smithi137.stdout:2915: expect (ObjNum 885 snap 259 seq_num 885) 2024-03-04T06:51:24.553 INFO:tasks.rados.rados.0.smithi137.stdout:2916: copy_from oid 39 from oid 34 current snap is 266 2024-03-04T06:51:24.553 INFO:tasks.rados.rados.0.smithi137.stdout:2913: finishing rollback tid 0 to smithi13777483-15 2024-03-04T06:51:24.553 INFO:tasks.rados.rados.0.smithi137.stdout:2913: finishing rollback tid 1 to smithi13777483-15 2024-03-04T06:51:24.553 INFO:tasks.rados.rados.0.smithi137.stdout:2913: finishing rollback tid 2 to smithi13777483-15 2024-03-04T06:51:24.553 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16852 (ObjNum 895 snap 261 seq_num 895) dirty exists 2024-03-04T06:51:24.553 INFO:tasks.rados.rados.0.smithi137.stdout:2913: done (4 left) 2024-03-04T06:51:24.553 INFO:tasks.rados.rados.0.smithi137.stdout:2917: delete oid 29 current snap is 266 2024-03-04T06:51:24.557 INFO:tasks.rados.rados.0.smithi137.stdout:2914: finishing write tid 1 to smithi13777483-14 2024-03-04T06:51:24.557 INFO:tasks.rados.rados.0.smithi137.stdout:2914: finishing write tid 2 to smithi13777483-14 2024-03-04T06:51:24.557 INFO:tasks.rados.rados.0.smithi137.stdout:2914: finishing write tid 3 to smithi13777483-14 2024-03-04T06:51:24.560 INFO:tasks.rados.rados.0.smithi137.stdout:2914: finishing write tid 4 to smithi13777483-14 2024-03-04T06:51:24.560 INFO:tasks.rados.rados.0.smithi137.stdout:2914: oid 14 updating version 0 to 16896 2024-03-04T06:51:24.560 INFO:tasks.rados.rados.0.smithi137.stdout:2914: oid 14 version 16896 is already newer than 16895 2024-03-04T06:51:24.560 INFO:tasks.rados.rados.0.smithi137.stdout:2914: oid 14 version 16896 is already newer than 16894 2024-03-04T06:51:24.560 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 16896 (ObjNum 911 snap 266 seq_num 911) dirty exists 2024-03-04T06:51:24.560 INFO:tasks.rados.rados.0.smithi137.stdout:2914: left oid 14 (ObjNum 911 snap 266 seq_num 911) 2024-03-04T06:51:24.560 INFO:tasks.rados.rados.0.smithi137.stdout:2915: expect (ObjNum 885 snap 259 seq_num 885) 2024-03-04T06:51:24.573 INFO:tasks.rados.rados.0.smithi137.stdout:2916: finishing copy_from racing read to smithi13777483-39 2024-03-04T06:51:24.573 INFO:tasks.rados.rados.0.smithi137.stdout:2916: finishing copy_from to smithi13777483-39 2024-03-04T06:51:24.574 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 16871 (ObjNum 886 snap 259 seq_num 886) dirty exists 2024-03-04T06:51:24.574 INFO:tasks.rados.rados.0.smithi137.stdout:2912: expect (ObjNum 852 snap 249 seq_num 852) 2024-03-04T06:51:24.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:24.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:24.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:24.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[88869]: osdmap e608: 8 total, 8 up, 8 in 2024-03-04T06:51:24.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:24.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:24.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:24.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:24.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[88869]: pgmap v592: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 440 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 907 KiB/s rd, 2.0 MiB/s wr, 12 op/s 2024-03-04T06:51:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[91314]: osdmap e608: 8 total, 8 up, 8 in 2024-03-04T06:51:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-mon[91314]: pgmap v592: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 440 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 907 KiB/s rd, 2.0 MiB/s wr, 12 op/s 2024-03-04T06:51:24.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:24.530+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:24.795 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:24.559+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:24.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:24.535+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:24.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:24.536+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:24.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:24.537+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:24.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:24.555+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:24.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:24.526+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:24.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:24.526+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:24.847 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:24.526+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:24.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:24.534+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:24.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:24.536+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:24.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:24.536+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-mon[85573]: osdmap e608: 8 total, 8 up, 8 in 2024-03-04T06:51:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:24.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:24.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:24.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:24.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:24.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:24.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:24 smithi203 ceph-mon[85573]: pgmap v592: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 440 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 907 KiB/s rd, 2.0 MiB/s wr, 12 op/s 2024-03-04T06:51:25.218 INFO:tasks.rados.rados.0.smithi137.stdout:2912: done (4 left) 2024-03-04T06:51:25.218 INFO:tasks.rados.rados.0.smithi137.stdout:2914: done (3 left) 2024-03-04T06:51:25.218 INFO:tasks.rados.rados.0.smithi137.stdout:2915: done (2 left) 2024-03-04T06:51:25.218 INFO:tasks.rados.rados.0.smithi137.stdout:2916: done (1 left) 2024-03-04T06:51:25.218 INFO:tasks.rados.rados.0.smithi137.stdout:2917: done (0 left) 2024-03-04T06:51:25.218 INFO:tasks.rados.rados.0.smithi137.stdout:2918: snap_remove snap 265 2024-03-04T06:51:25.632 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:51:25] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:51:25.633 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[88869]: Upgrade: Updating alertmanager.a 2024-03-04T06:51:25.633 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[88869]: Deploying daemon alertmanager.a on smithi137 2024-03-04T06:51:25.633 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:25.633 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:25.633 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:25.633 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[88869]: osdmap e609: 8 total, 8 up, 8 in 2024-03-04T06:51:25.633 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:25.633 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:25.633 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:25.633 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:25.634 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:25.634 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:25.634 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:25.634 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[91314]: Upgrade: Updating alertmanager.a 2024-03-04T06:51:25.634 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[91314]: Deploying daemon alertmanager.a on smithi137 2024-03-04T06:51:25.634 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:25.634 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:25.634 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:25.634 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[91314]: osdmap e609: 8 total, 8 up, 8 in 2024-03-04T06:51:25.634 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:25.634 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:25.634 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:25.635 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:25.635 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:25.635 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:25.635 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-mon[85573]: Upgrade: Updating alertmanager.a 2024-03-04T06:51:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-mon[85573]: Deploying daemon alertmanager.a on smithi137 2024-03-04T06:51:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-mon[85573]: osdmap e609: 8 total, 8 up, 8 in 2024-03-04T06:51:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:25.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 13c=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:25.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:25.917 INFO:tasks.rados.rados.0.smithi137.stdout:2918: done (0 left) 2024-03-04T06:51:25.917 INFO:tasks.rados.rados.0.smithi137.stdout:2919: read oid 6 snap 263 2024-03-04T06:51:25.917 INFO:tasks.rados.rados.0.smithi137.stdout:2919: expect (ObjNum 787 snap 231 seq_num 787) 2024-03-04T06:51:25.917 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 266 2024-03-04T06:51:25.917 INFO:tasks.rados.rados.0.smithi137.stdout:2920: seq_num 913 ranges {4112384=499712,4612096=401408} 2024-03-04T06:51:25.941 INFO:tasks.rados.rados.0.smithi137.stdout:2920: writing smithi13777483-49 from 4112384 to 4612096 tid 1 2024-03-04T06:51:25.944 INFO:tasks.rados.rados.0.smithi137.stdout:2920: writing smithi13777483-49 from 4612096 to 5013504 tid 2 2024-03-04T06:51:25.944 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 266 2024-03-04T06:51:25.944 INFO:tasks.rados.rados.0.smithi137.stdout:2921: seq_num 914 ranges {0=516096,516096=401408} 2024-03-04T06:51:25.947 INFO:tasks.rados.rados.0.smithi137.stdout:2921: writing smithi13777483-46 from 0 to 516096 tid 1 2024-03-04T06:51:25.949 INFO:tasks.rados.rados.0.smithi137.stdout:2921: writing smithi13777483-46 from 516096 to 917504 tid 2 2024-03-04T06:51:25.950 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 266 2024-03-04T06:51:25.950 INFO:tasks.rados.rados.0.smithi137.stdout:2922: seq_num 915 ranges {442368=532480,974848=401408} 2024-03-04T06:51:25.955 INFO:tasks.rados.rados.0.smithi137.stdout:2922: writing smithi13777483-39 from 442368 to 974848 tid 1 2024-03-04T06:51:25.957 INFO:tasks.rados.rados.0.smithi137.stdout:2922: writing smithi13777483-39 from 974848 to 1376256 tid 2 2024-03-04T06:51:25.958 INFO:tasks.rados.rados.0.smithi137.stdout:2923: delete oid 35 current snap is 266 2024-03-04T06:51:25.958 INFO:tasks.rados.rados.0.smithi137.stdout:2919: expect (ObjNum 787 snap 231 seq_num 787) 2024-03-04T06:51:25.990 INFO:tasks.rados.rados.0.smithi137.stdout:2920: finishing write tid 1 to smithi13777483-49 2024-03-04T06:51:25.990 INFO:tasks.rados.rados.0.smithi137.stdout:2920: finishing write tid 2 to smithi13777483-49 2024-03-04T06:51:25.990 INFO:tasks.rados.rados.0.smithi137.stdout:2920: finishing write tid 3 to smithi13777483-49 2024-03-04T06:51:25.990 INFO:tasks.rados.rados.0.smithi137.stdout:2920: finishing write tid 4 to smithi13777483-49 2024-03-04T06:51:25.990 INFO:tasks.rados.rados.0.smithi137.stdout:2920: oid 49 updating version 0 to 16891 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2920: oid 49 version 16891 is already newer than 16890 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2920: oid 49 updating version 16891 to 16892 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16892 (ObjNum 913 snap 266 seq_num 913) dirty exists 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2920: left oid 49 (ObjNum 913 snap 266 seq_num 913) 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2921: finishing write tid 1 to smithi13777483-46 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2919: done (4 left) 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2920: done (3 left) 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2923: done (2 left) 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2924: snap_create 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2921: finishing write tid 2 to smithi13777483-46 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2921: finishing write tid 3 to smithi13777483-46 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2921: finishing write tid 4 to smithi13777483-46 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2921: oid 46 updating version 0 to 16895 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2921: oid 46 updating version 16895 to 16896 2024-03-04T06:51:25.991 INFO:tasks.rados.rados.0.smithi137.stdout:2921: oid 46 updating version 16896 to 16897 2024-03-04T06:51:25.992 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 16897 (ObjNum 914 snap 266 seq_num 914) dirty exists 2024-03-04T06:51:25.992 INFO:tasks.rados.rados.0.smithi137.stdout:2921: left oid 46 (ObjNum 914 snap 266 seq_num 914) 2024-03-04T06:51:25.992 INFO:tasks.rados.rados.0.smithi137.stdout:2922: finishing write tid 1 to smithi13777483-39 2024-03-04T06:51:25.992 INFO:tasks.rados.rados.0.smithi137.stdout:2922: finishing write tid 2 to smithi13777483-39 2024-03-04T06:51:25.992 INFO:tasks.rados.rados.0.smithi137.stdout:2922: finishing write tid 3 to smithi13777483-39 2024-03-04T06:51:25.992 INFO:tasks.rados.rados.0.smithi137.stdout:2922: finishing write tid 4 to smithi13777483-39 2024-03-04T06:51:25.992 INFO:tasks.rados.rados.0.smithi137.stdout:2922: oid 39 updating version 0 to 16874 2024-03-04T06:51:25.992 INFO:tasks.rados.rados.0.smithi137.stdout:2922: oid 39 version 16874 is already newer than 16872 2024-03-04T06:51:25.992 INFO:tasks.rados.rados.0.smithi137.stdout:2922: oid 39 version 16874 is already newer than 16873 2024-03-04T06:51:25.992 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 16874 (ObjNum 915 snap 266 seq_num 915) dirty exists 2024-03-04T06:51:25.992 INFO:tasks.rados.rados.0.smithi137.stdout:2922: left oid 39 (ObjNum 915 snap 266 seq_num 915) 2024-03-04T06:51:26.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:25.945+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:26.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:25.959+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:26.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:25.959+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:26.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:25.959+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:26.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:25.916+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:26.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:25.918+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:26.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:25.922+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:26.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:25.925+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:26.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:25.945+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:26.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:25.945+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:26.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:25.921+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:26.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:25.921+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:26.924 INFO:tasks.rados.rados.0.smithi137.stdout:2921: done (2 left) 2024-03-04T06:51:26.924 INFO:tasks.rados.rados.0.smithi137.stdout:2922: done (1 left) 2024-03-04T06:51:26.924 INFO:tasks.rados.rados.0.smithi137.stdout:2924: done (0 left) 2024-03-04T06:51:26.924 INFO:tasks.rados.rados.0.smithi137.stdout:2925: snap_create 2024-03-04T06:51:27.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:26.923+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:27.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[91314]: osdmap e610: 8 total, 8 up, 8 in 2024-03-04T06:51:27.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:27.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:27.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:27.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:27.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:27.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:27.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:27.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:27.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:27.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:27.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[91314]: pgmap v595: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 445 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 908 KiB/s rd, 3.3 MiB/s wr, 16 op/s 2024-03-04T06:51:27.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[88869]: osdmap e610: 8 total, 8 up, 8 in 2024-03-04T06:51:27.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:27.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:27.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:27.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:27.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:27.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:27.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:27.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:27.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:27.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:27.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:26 smithi137 ceph-mon[88869]: pgmap v595: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 445 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 908 KiB/s rd, 3.3 MiB/s wr, 16 op/s 2024-03-04T06:51:27.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:26.921+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:26 smithi203 ceph-mon[85573]: osdmap e610: 8 total, 8 up, 8 in 2024-03-04T06:51:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:27.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:27.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:27.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:27.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:27.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:27.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:27.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:26 smithi203 ceph-mon[85573]: pgmap v595: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 445 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 908 KiB/s rd, 3.3 MiB/s wr, 16 op/s 2024-03-04T06:51:27.928 INFO:tasks.rados.rados.0.smithi137.stdout:2925: done (0 left) 2024-03-04T06:51:27.928 INFO:tasks.rados.rados.0.smithi137.stdout:2926: snap_create 2024-03-04T06:51:27.959 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:51:28.011 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:28.011 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:28.012 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:27 smithi137 ceph-mon[88869]: osdmap e611: 8 total, 8 up, 8 in 2024-03-04T06:51:28.012 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:28.012 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:28.012 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:27 smithi137 ceph-mon[91314]: osdmap e611: 8 total, 8 up, 8 in 2024-03-04T06:51:28.013 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:27.755+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:28.013 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:27.755+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:28.013 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:27.755+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:28.013 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:27.927+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:28.013 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:27.927+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:28.013 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:27.928+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:28.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:27.753+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:28.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:28.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:28.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:27 smithi203 ceph-mon[85573]: osdmap e611: 8 total, 8 up, 8 in 2024-03-04T06:51:28.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:27.754+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:28.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:27.755+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:28.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:27.755+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:28.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:27.755+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:28.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:27.755+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:28.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:27.755+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:28.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:27.925+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:28.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:27.925+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:28.293 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:28 smithi137 systemd[1]: Stopping Ceph alertmanager.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:51:28.298 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:51:28.299 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (11m) 27s ago 12m 26.4M - 0.25.0 c8568f914cd2 0e16db7824eb 2024-03-04T06:51:28.299 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (11m) 10s ago 11m 86.7M - 9.4.7 954c08fa6188 eb19bfb589d8 2024-03-04T06:51:28.299 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (69s) 27s ago 13m 16.2M - 19.0.0-1791-gefb04e5e 0c401cd3e778 b6a5f9352182 2024-03-04T06:51:28.299 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (47s) 10s ago 13m 12.6M - 19.0.0-1791-gefb04e5e 0c401cd3e778 6797a1307e30 2024-03-04T06:51:28.299 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (7m) 10s ago 16m 452M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:51:28.299 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (7m) 27s ago 18m 512M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:51:28.299 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (6m) 27s ago 18m 67.9M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:51:28.299 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (6m) 10s ago 17m 55.2M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:51:28.299 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (6m) 27s ago 17m 59.2M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:51:28.299 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (35s) 27s ago 11m 3577k - 1.5.0 0da6a335fe13 ff9dbbaf9aeb 2024-03-04T06:51:28.299 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (30s) 10s ago 11m 15.7M - 1.5.0 0da6a335fe13 28b7879b0fcb 2024-03-04T06:51:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (5m) 27s ago 16m 347M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 bd2207652b33 2024-03-04T06:51:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (4m) 27s ago 16m 232M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 47b5cdaad147 2024-03-04T06:51:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (4m) 27s ago 15m 284M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 436ae07776d9 2024-03-04T06:51:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (3m) 27s ago 15m 145M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9acd06dda8ec 2024-03-04T06:51:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (3m) 10s ago 14m 173M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9a246a0996bd 2024-03-04T06:51:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (2m) 10s ago 14m 320M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9e05ca76b164 2024-03-04T06:51:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (2m) 10s ago 14m 214M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 ddb88aa8bce6 2024-03-04T06:51:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (88s) 10s ago 13m 123M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 b9857bcd7602 2024-03-04T06:51:28.300 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (14s) 10s ago 12m 35.1M - 2.43.0 a07b618ecd1d 85dcb15cec84 2024-03-04T06:51:28.710 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:51:28.710 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:51:28.710 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:51:28.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:51:28.710 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:51:28.710 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:51:28.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:51:28.710 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:51:28.710 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 8 2024-03-04T06:51:28.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:51:28.711 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:51:28.711 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:51:28.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:51:28.711 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:51:28.711 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 15 2024-03-04T06:51:28.711 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:51:28.711 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:51:28.711 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:28.365+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:28.711 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[73354]: ts=2024-03-04T06:51:28.475Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-03-04T06:51:28.711 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:28 smithi137 podman[124826]: 2024-03-04 06:51:28.516459753 +0000 UTC m=+0.158026188 container stop 0e16db7824eb443c958b1c9925e3748875e240eae394047864166ab2c0ed2e01 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T06:51:28.711 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:28 smithi137 podman[124826]: 2024-03-04 06:51:28.541962165 +0000 UTC m=+0.183528603 container died 0e16db7824eb443c958b1c9925e3748875e240eae394047864166ab2c0ed2e01 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T06:51:28.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:28.557+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:28.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:28.557+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:28.933 INFO:tasks.rados.rados.0.smithi137.stdout:2926: done (0 left) 2024-03-04T06:51:28.933 INFO:tasks.rados.rados.0.smithi137.stdout:2927: snap_create 2024-03-04T06:51:29.043 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:28 smithi137 podman[124826]: 2024-03-04 06:51:28.926223393 +0000 UTC m=+0.567789827 container cleanup 0e16db7824eb443c958b1c9925e3748875e240eae394047864166ab2c0ed2e01 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T06:51:29.043 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:28 smithi137 bash[124826]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a 2024-03-04T06:51:29.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:28.931+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:29.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:29.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:29.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: osdmap e612: 8 total, 8 up, 8 in 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: from='client.44366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: from='client.44372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: pgmap v598: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 435 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-03-04T06:51:29.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/1021277607' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: osdmap e612: 8 total, 8 up, 8 in 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: from='client.44366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:51:29.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: from='client.44372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:51:29.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: pgmap v598: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 435 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-03-04T06:51:29.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:28 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/1021277607' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:29.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:28.931+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:29.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:28.931+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:29.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:28.931+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:29.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:29.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:29.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:29.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:29.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:29.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: osdmap e612: 8 total, 8 up, 8 in 2024-03-04T06:51:29.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:29.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:29.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: from='client.44366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:51:29.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: from='client.44372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:51:29.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: pgmap v598: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 435 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-03-04T06:51:29.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:28 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/1021277607' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:29.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:29 smithi137 podman[124861]: 2024-03-04 06:51:29.178140992 +0000 UTC m=+0.653365991 container remove 0e16db7824eb443c958b1c9925e3748875e240eae394047864166ab2c0ed2e01 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T06:51:29.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:29 smithi137 podman[124861]: 2024-03-04 06:51:29.27034051 +0000 UTC m=+0.745565464 volume remove 2a615738034a7670ed79dc9f9a7713981a9a4fbb5a0cf22551788317ff77a2ce 2024-03-04T06:51:29.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:29 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@alertmanager.a.service: Deactivated successfully. 2024-03-04T06:51:29.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:29 smithi137 systemd[1]: Stopped Ceph alertmanager.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:51:29.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:29 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@alertmanager.a.service: Consumed 1.477s CPU time. 2024-03-04T06:51:29.896 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:29 smithi137 systemd[1]: Starting Ceph alertmanager.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:51:29.896 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:29 smithi137 podman[124994]: 2024-03-04 06:51:29.805026488 +0000 UTC m=+0.109043192 volume create af1ef32b51108f90efe978eb8a935b8cb4433217f4afbd52c53ab4cf127a544a 2024-03-04T06:51:29.896 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:29 smithi137 podman[124994]: 2024-03-04 06:51:29.715343313 +0000 UTC m=+0.019359971 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-03-04T06:51:29.934 INFO:tasks.rados.rados.0.smithi137.stdout:2927: done (0 left) 2024-03-04T06:51:29.934 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 270 2024-03-04T06:51:29.934 INFO:tasks.rados.rados.0.smithi137.stdout:2928: seq_num 917 ranges {311296=565248,876544=401408} 2024-03-04T06:51:29.935 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:29.660+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:29.935 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:29.659+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:29.935 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:29.659+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:29.935 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:29.659+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:29.935 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:29.933+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:29.935 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:29.933+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:29.935 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:29.933+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:29.939 INFO:tasks.rados.rados.0.smithi137.stdout:2928: writing smithi13777483-17 from 311296 to 876544 tid 1 2024-03-04T06:51:29.941 INFO:tasks.rados.rados.0.smithi137.stdout:2928: writing smithi13777483-17 from 876544 to 1277952 tid 2 2024-03-04T06:51:29.941 INFO:tasks.rados.rados.0.smithi137.stdout:2929: rollback oid 40 current snap is 270 2024-03-04T06:51:29.941 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 40 to 267 2024-03-04T06:51:29.941 INFO:tasks.rados.rados.0.smithi137.stdout:2930: snap_remove snap 263 2024-03-04T06:51:30.232 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:29 smithi137 podman[124994]: 2024-03-04 06:51:29.896997323 +0000 UTC m=+0.201013981 container create ce9f080c2c947382dd2d5f440f685d9f34183e5678f02f686b44cc46525e5d9f (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T06:51:30.233 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:29.947+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:30.233 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:29.947+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:30.233 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:30.233 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:30.233 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:30.233 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:30.233 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:30.233 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[88869]: osdmap e613: 8 total, 8 up, 8 in 2024-03-04T06:51:30.234 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:30.234 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:30.234 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:30.234 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:30.234 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:30.234 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:30.234 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[91314]: osdmap e613: 8 total, 8 up, 8 in 2024-03-04T06:51:30.234 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:30.235 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:29.946+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:30.235 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:29.934+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:30.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:29.947+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-mon[85573]: osdmap e613: 8 total, 8 up, 8 in 2024-03-04T06:51:30.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:30.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:29.947+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:30.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:29.948+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:30.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:30.013+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:30.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:30.013+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:30.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:30 smithi137 podman[124994]: 2024-03-04 06:51:30.233081689 +0000 UTC m=+0.537098347 container init ce9f080c2c947382dd2d5f440f685d9f34183e5678f02f686b44cc46525e5d9f (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T06:51:30.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:30 smithi137 podman[124994]: 2024-03-04 06:51:30.236706725 +0000 UTC m=+0.540723386 container start ce9f080c2c947382dd2d5f440f685d9f34183e5678f02f686b44cc46525e5d9f (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T06:51:30.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T06:51:30.248Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-03-04T06:51:30.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T06:51:30.248Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-03-04T06:51:30.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T06:51:30.249Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.137 port=9094 2024-03-04T06:51:30.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T06:51:30.250Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-04T06:51:30.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T06:51:30.273Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-04T06:51:30.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T06:51:30.273Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-04T06:51:30.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T06:51:30.276Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-03-04T06:51:30.544 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T06:51:30.276Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-03-04T06:51:30.544 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:30 smithi137 bash[124994]: ce9f080c2c947382dd2d5f440f685d9f34183e5678f02f686b44cc46525e5d9f 2024-03-04T06:51:30.544 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:30 smithi137 systemd[1]: Started Ceph alertmanager.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:51:30.948 INFO:tasks.rados.rados.0.smithi137.stdout:2930: done (2 left) 2024-03-04T06:51:30.948 INFO:tasks.rados.rados.0.smithi137.stdout:2931: read oid 29 snap 269 2024-03-04T06:51:30.948 INFO:tasks.rados.rados.0.smithi137.stdout:2931: expect deleted 2024-03-04T06:51:30.948 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 270 2024-03-04T06:51:30.948 INFO:tasks.rados.rados.0.smithi137.stdout:2932: seq_num 918 ranges {1187840=581632,1769472=401408} 2024-03-04T06:51:30.958 INFO:tasks.rados.rados.0.smithi137.stdout:2932: writing smithi13777483-19 from 1187840 to 1769472 tid 1 2024-03-04T06:51:30.961 INFO:tasks.rados.rados.0.smithi137.stdout:2932: writing smithi13777483-19 from 1769472 to 2170880 tid 2 2024-03-04T06:51:30.962 INFO:tasks.rados.rados.0.smithi137.stdout:2933: rollback oid 11 current snap is 270 2024-03-04T06:51:30.962 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 11 to 268 2024-03-04T06:51:30.962 INFO:tasks.rados.rados.0.smithi137.stdout:2934: rollback oid 13 current snap is 270 2024-03-04T06:51:30.962 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 13 to 267 2024-03-04T06:51:30.962 INFO:tasks.rados.rados.0.smithi137.stdout:2929: finishing rollback tid 0 to smithi13777483-40 2024-03-04T06:51:30.962 INFO:tasks.rados.rados.0.smithi137.stdout:2929: finishing rollback tid 1 to smithi13777483-40 2024-03-04T06:51:30.962 INFO:tasks.rados.rados.0.smithi137.stdout:2928: finishing write tid 1 to smithi13777483-17 2024-03-04T06:51:30.962 INFO:tasks.rados.rados.0.smithi137.stdout:2929: finishing rollback tid 2 to smithi13777483-40 2024-03-04T06:51:30.962 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 16855 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-03-04T06:51:30.962 INFO:tasks.rados.rados.0.smithi137.stdout:2929: done (5 left) 2024-03-04T06:51:30.962 INFO:tasks.rados.rados.0.smithi137.stdout:2935: snap_create 2024-03-04T06:51:30.963 INFO:tasks.rados.rados.0.smithi137.stdout:2928: finishing write tid 2 to smithi13777483-17 2024-03-04T06:51:30.963 INFO:tasks.rados.rados.0.smithi137.stdout:2928: finishing write tid 3 to smithi13777483-17 2024-03-04T06:51:30.963 INFO:tasks.rados.rados.0.smithi137.stdout:2928: finishing write tid 4 to smithi13777483-17 2024-03-04T06:51:30.963 INFO:tasks.rados.rados.0.smithi137.stdout:2928: oid 17 updating version 0 to 16868 2024-03-04T06:51:30.963 INFO:tasks.rados.rados.0.smithi137.stdout:2928: oid 17 version 16868 is already newer than 16867 2024-03-04T06:51:30.963 INFO:tasks.rados.rados.0.smithi137.stdout:2928: oid 17 updating version 16868 to 16869 2024-03-04T06:51:30.963 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16869 (ObjNum 917 snap 270 seq_num 917) dirty exists 2024-03-04T06:51:30.963 INFO:tasks.rados.rados.0.smithi137.stdout:2928: left oid 17 (ObjNum 917 snap 270 seq_num 917) 2024-03-04T06:51:30.966 INFO:tasks.rados.rados.0.smithi137.stdout:2932: finishing write tid 1 to smithi13777483-19 2024-03-04T06:51:30.967 INFO:tasks.rados.rados.0.smithi137.stdout:2934: finishing rollback tid 0 to smithi13777483-13 2024-03-04T06:51:30.967 INFO:tasks.rados.rados.0.smithi137.stdout:2932: finishing write tid 2 to smithi13777483-19 2024-03-04T06:51:30.968 INFO:tasks.rados.rados.0.smithi137.stdout:2932: finishing write tid 3 to smithi13777483-19 2024-03-04T06:51:30.968 INFO:tasks.rados.rados.0.smithi137.stdout:2934: finishing rollback tid 1 to smithi13777483-13 2024-03-04T06:51:30.968 INFO:tasks.rados.rados.0.smithi137.stdout:2934: finishing rollback tid 2 to smithi13777483-13 2024-03-04T06:51:30.969 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16900 (ObjNum 874 snap 255 seq_num 874) dirty exists 2024-03-04T06:51:30.969 INFO:tasks.rados.rados.0.smithi137.stdout:2933: finishing rollback tid 1 to smithi13777483-11 2024-03-04T06:51:30.969 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16837 (ObjNum 353 snap 0 seq_num 3131900720) dirty dne 2024-03-04T06:51:30.971 INFO:tasks.rados.rados.0.smithi137.stdout:2932: finishing write tid 4 to smithi13777483-19 2024-03-04T06:51:30.971 INFO:tasks.rados.rados.0.smithi137.stdout:2932: oid 19 updating version 0 to 16868 2024-03-04T06:51:30.971 INFO:tasks.rados.rados.0.smithi137.stdout:2932: oid 19 updating version 16868 to 16869 2024-03-04T06:51:30.971 INFO:tasks.rados.rados.0.smithi137.stdout:2932: oid 19 version 16869 is already newer than 16867 2024-03-04T06:51:30.971 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 16869 (ObjNum 918 snap 270 seq_num 918) dirty exists 2024-03-04T06:51:30.971 INFO:tasks.rados.rados.0.smithi137.stdout:2932: left oid 19 (ObjNum 918 snap 270 seq_num 918) 2024-03-04T06:51:31.213 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:30.963+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:31.213 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:30.963+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:31.213 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:30.964+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:31.213 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:31.213 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: osdmap e614: 8 total, 8 up, 8 in 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:31.214 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:31.215 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: pgmap v601: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 435 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 992 KiB/s wr, 9 op/s 2024-03-04T06:51:31.215 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:31.215 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:31.215 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:31.215 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:31.215 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: osdmap e614: 8 total, 8 up, 8 in 2024-03-04T06:51:31.215 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:31.215 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:31.215 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:31.215 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:31.216 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:31.216 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:31.216 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:31.216 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:31.216 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:31.216 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:31.216 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:31.216 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:31.216 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: pgmap v601: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 435 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 992 KiB/s wr, 9 op/s 2024-03-04T06:51:31.216 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:31.216 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:30.968+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:31.217 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:30.948+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:31.248 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:30.951+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:31.248 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:30.947+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:31.248 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:30.948+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:31.248 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:30.948+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:31.249 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:31.037+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:31.249 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:30.951+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:31.249 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:30.951+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:31.249 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:31.249 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:31.249 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:31.249 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: osdmap e614: 8 total, 8 up, 8 in 2024-03-04T06:51:31.249 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:31.249 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:31.250 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:31.250 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:31.250 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:31.250 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:31.250 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:31.250 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:31.250 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:31.250 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:31.250 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:31.250 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:31.250 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: pgmap v601: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 435 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 992 KiB/s wr, 9 op/s 2024-03-04T06:51:31.250 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:30 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:31.958 INFO:tasks.rados.rados.0.smithi137.stdout:2928: done (5 left) 2024-03-04T06:51:31.958 INFO:tasks.rados.rados.0.smithi137.stdout:2931: done (4 left) 2024-03-04T06:51:31.958 INFO:tasks.rados.rados.0.smithi137.stdout:2932: done (3 left) 2024-03-04T06:51:31.958 INFO:tasks.rados.rados.0.smithi137.stdout:2933: done (2 left) 2024-03-04T06:51:31.958 INFO:tasks.rados.rados.0.smithi137.stdout:2934: done (1 left) 2024-03-04T06:51:31.958 INFO:tasks.rados.rados.0.smithi137.stdout:2935: done (0 left) 2024-03-04T06:51:31.958 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 271 2024-03-04T06:51:31.958 INFO:tasks.rados.rados.0.smithi137.stdout:2936: seq_num 919 ranges {0=598016,598016=401408} 2024-03-04T06:51:31.961 INFO:tasks.rados.rados.0.smithi137.stdout:2936: writing smithi13777483-30 from 0 to 598016 tid 1 2024-03-04T06:51:31.964 INFO:tasks.rados.rados.0.smithi137.stdout:2936: writing smithi13777483-30 from 598016 to 999424 tid 2 2024-03-04T06:51:31.964 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 271 2024-03-04T06:51:31.964 INFO:tasks.rados.rados.0.smithi137.stdout:2937: seq_num 920 ranges {6676480=614400,7290880=401408} 2024-03-04T06:51:32.004 INFO:tasks.rados.rados.0.smithi137.stdout:2937: writing smithi13777483-38 from 6676480 to 7290880 tid 1 2024-03-04T06:51:32.006 INFO:tasks.rados.rados.0.smithi137.stdout:2937: writing smithi13777483-38 from 7290880 to 7692288 tid 2 2024-03-04T06:51:32.007 INFO:tasks.rados.rados.0.smithi137.stdout:2936: finishing write tid 1 to smithi13777483-30 2024-03-04T06:51:32.007 INFO:tasks.rados.rados.0.smithi137.stdout:2936: finishing write tid 2 to smithi13777483-30 2024-03-04T06:51:32.007 INFO:tasks.rados.rados.0.smithi137.stdout:2936: finishing write tid 3 to smithi13777483-30 2024-03-04T06:51:32.007 INFO:tasks.rados.rados.0.smithi137.stdout:2936: finishing write tid 4 to smithi13777483-30 2024-03-04T06:51:32.007 INFO:tasks.rados.rados.0.smithi137.stdout:2936: oid 30 updating version 0 to 16859 2024-03-04T06:51:32.007 INFO:tasks.rados.rados.0.smithi137.stdout:2936: oid 30 updating version 16859 to 16860 2024-03-04T06:51:32.007 INFO:tasks.rados.rados.0.smithi137.stdout:2936: oid 30 version 16860 is already newer than 16858 2024-03-04T06:51:32.007 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16860 (ObjNum 919 snap 271 seq_num 919) dirty exists 2024-03-04T06:51:32.007 INFO:tasks.rados.rados.0.smithi137.stdout:2936: left oid 30 (ObjNum 919 snap 271 seq_num 919) 2024-03-04T06:51:32.007 INFO:tasks.rados.rados.0.smithi137.stdout:2936: done (1 left) 2024-03-04T06:51:32.007 INFO:tasks.rados.rados.0.smithi137.stdout:2938: snap_create 2024-03-04T06:51:32.010 INFO:tasks.rados.rados.0.smithi137.stdout:2937: finishing write tid 1 to smithi13777483-38 2024-03-04T06:51:32.010 INFO:tasks.rados.rados.0.smithi137.stdout:2937: finishing write tid 2 to smithi13777483-38 2024-03-04T06:51:32.010 INFO:tasks.rados.rados.0.smithi137.stdout:2937: finishing write tid 3 to smithi13777483-38 2024-03-04T06:51:32.014 INFO:tasks.rados.rados.0.smithi137.stdout:2937: finishing write tid 4 to smithi13777483-38 2024-03-04T06:51:32.014 INFO:tasks.rados.rados.0.smithi137.stdout:2937: oid 38 updating version 0 to 16875 2024-03-04T06:51:32.014 INFO:tasks.rados.rados.0.smithi137.stdout:2937: oid 38 version 16875 is already newer than 16874 2024-03-04T06:51:32.014 INFO:tasks.rados.rados.0.smithi137.stdout:2937: oid 38 updating version 16875 to 16876 2024-03-04T06:51:32.014 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16876 (ObjNum 920 snap 271 seq_num 920) dirty exists 2024-03-04T06:51:32.014 INFO:tasks.rados.rados.0.smithi137.stdout:2937: left oid 38 (ObjNum 920 snap 271 seq_num 920) 2024-03-04T06:51:32.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:31.968+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:32.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:31.969+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:32.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:31.972+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:32.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[88869]: osdmap e615: 8 total, 8 up, 8 in 2024-03-04T06:51:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[91314]: osdmap e615: 8 total, 8 up, 8 in 2024-03-04T06:51:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:32.045 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:31.955+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:32.260 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:31.957+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:32.260 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:31.957+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:32.260 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:31.967+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:32.261 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-mon[85573]: osdmap e615: 8 total, 8 up, 8 in 2024-03-04T06:51:32.261 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:32.261 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:32.261 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:32.261 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:32.261 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:32.261 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:32.261 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:32.261 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:32.261 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:32.262 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:32.137+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:32.262 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:32.138+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:32.262 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:32.138+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:32.505 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T06:51:32.251Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000014587s 2024-03-04T06:51:32.966 INFO:tasks.rados.rados.0.smithi137.stdout:2937: done (1 left) 2024-03-04T06:51:32.966 INFO:tasks.rados.rados.0.smithi137.stdout:2938: done (0 left) 2024-03-04T06:51:32.966 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 272 2024-03-04T06:51:32.966 INFO:tasks.rados.rados.0.smithi137.stdout:2939: seq_num 921 ranges {4349952=630784,4980736=401408} 2024-03-04T06:51:32.993 INFO:tasks.rados.rados.0.smithi137.stdout:2939: writing smithi13777483-31 from 4349952 to 4980736 tid 1 2024-03-04T06:51:32.995 INFO:tasks.rados.rados.0.smithi137.stdout:2939: writing smithi13777483-31 from 4980736 to 5382144 tid 2 2024-03-04T06:51:32.995 INFO:tasks.rados.rados.0.smithi137.stdout:2940: rmattr oid 35 current snap is 272 2024-03-04T06:51:32.995 INFO:tasks.rados.rados.0.smithi137.stdout:2940: done (1 left) 2024-03-04T06:51:32.996 INFO:tasks.rados.rados.0.smithi137.stdout:2941: read oid 29 snap 271 2024-03-04T06:51:32.996 INFO:tasks.rados.rados.0.smithi137.stdout:2941: expect deleted 2024-03-04T06:51:32.996 INFO:tasks.rados.rados.0.smithi137.stdout:2942: copy_from oid 11 from oid 13 current snap is 272 2024-03-04T06:51:32.996 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 272 2024-03-04T06:51:32.996 INFO:tasks.rados.rados.0.smithi137.stdout:2943: seq_num 922 ranges {917504=647168,1564672=401408} 2024-03-04T06:51:33.004 INFO:tasks.rados.rados.0.smithi137.stdout:2943: writing smithi13777483-46 from 917504 to 1564672 tid 1 2024-03-04T06:51:33.008 INFO:tasks.rados.rados.0.smithi137.stdout:2943: writing smithi13777483-46 from 1564672 to 1966080 tid 2 2024-03-04T06:51:33.008 INFO:tasks.rados.rados.0.smithi137.stdout:2944: delete oid 18 current snap is 272 2024-03-04T06:51:33.008 INFO:tasks.rados.rados.0.smithi137.stdout:2939: finishing write tid 1 to smithi13777483-31 2024-03-04T06:51:33.008 INFO:tasks.rados.rados.0.smithi137.stdout:2939: finishing write tid 2 to smithi13777483-31 2024-03-04T06:51:33.008 INFO:tasks.rados.rados.0.smithi137.stdout:2939: finishing write tid 3 to smithi13777483-31 2024-03-04T06:51:33.008 INFO:tasks.rados.rados.0.smithi137.stdout:2939: finishing write tid 4 to smithi13777483-31 2024-03-04T06:51:33.008 INFO:tasks.rados.rados.0.smithi137.stdout:2939: oid 31 updating version 0 to 16896 2024-03-04T06:51:33.008 INFO:tasks.rados.rados.0.smithi137.stdout:2939: oid 31 version 16896 is already newer than 16895 2024-03-04T06:51:33.008 INFO:tasks.rados.rados.0.smithi137.stdout:2939: oid 31 version 16896 is already newer than 16894 2024-03-04T06:51:33.008 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16896 (ObjNum 921 snap 272 seq_num 921) dirty exists 2024-03-04T06:51:33.009 INFO:tasks.rados.rados.0.smithi137.stdout:2939: left oid 31 (ObjNum 921 snap 272 seq_num 921) 2024-03-04T06:51:33.009 INFO:tasks.rados.rados.0.smithi137.stdout:2942: finishing copy_from racing read to smithi13777483-11 2024-03-04T06:51:33.009 INFO:tasks.rados.rados.0.smithi137.stdout:2942: finishing copy_from to smithi13777483-11 2024-03-04T06:51:33.009 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16900 (ObjNum 874 snap 255 seq_num 874) dirty exists 2024-03-04T06:51:33.010 INFO:tasks.rados.rados.0.smithi137.stdout:2939: done (4 left) 2024-03-04T06:51:33.011 INFO:tasks.rados.rados.0.smithi137.stdout:2941: done (3 left) 2024-03-04T06:51:33.011 INFO:tasks.rados.rados.0.smithi137.stdout:2942: done (2 left) 2024-03-04T06:51:33.011 INFO:tasks.rados.rados.0.smithi137.stdout:2944: done (1 left) 2024-03-04T06:51:33.011 INFO:tasks.rados.rados.0.smithi137.stdout:2945: read oid 33 snap -1 2024-03-04T06:51:33.011 INFO:tasks.rados.rados.0.smithi137.stdout:2945: expect (ObjNum 887 snap 259 seq_num 887) 2024-03-04T06:51:33.011 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 272 2024-03-04T06:51:33.011 INFO:tasks.rados.rados.0.smithi137.stdout:2946: seq_num 924 ranges {3571712=679936,4251648=401408} 2024-03-04T06:51:33.034 INFO:tasks.rados.rados.0.smithi137.stdout:2946: writing smithi13777483-47 from 3571712 to 4251648 tid 1 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:2946: writing smithi13777483-47 from 4251648 to 4653056 tid 2 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:2947: read oid 7 snap -1 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:2947: expect (ObjNum 908 snap 265 seq_num 908) 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:2948: rollback oid 1 current snap is 272 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 1 to 268 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:2943: finishing write tid 1 to smithi13777483-46 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:2943: finishing write tid 2 to smithi13777483-46 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:2943: finishing write tid 3 to smithi13777483-46 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:2943: finishing write tid 4 to smithi13777483-46 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:2943: oid 46 updating version 0 to 16901 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:2943: oid 46 updating version 16901 to 16902 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:2943: oid 46 updating version 16902 to 16903 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 16903 (ObjNum 922 snap 272 seq_num 922) dirty exists 2024-03-04T06:51:33.037 INFO:tasks.rados.rados.0.smithi137.stdout:2943: left oid 46 (ObjNum 922 snap 272 seq_num 922) 2024-03-04T06:51:33.038 INFO:tasks.rados.rados.0.smithi137.stdout:2945: expect (ObjNum 887 snap 259 seq_num 887) 2024-03-04T06:51:33.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:32.986+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:33.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:33.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:33.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[88869]: osdmap e616: 8 total, 8 up, 8 in 2024-03-04T06:51:33.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:33.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[88869]: pgmap v604: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 435 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 312 KiB/s rd, 220 KiB/s wr, 2 op/s 2024-03-04T06:51:33.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:32.965+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:33.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:32.965+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:33.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:32.965+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:33.044 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:32.987+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[91314]: osdmap e616: 8 total, 8 up, 8 in 2024-03-04T06:51:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:32 smithi137 ceph-mon[91314]: pgmap v604: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 435 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 312 KiB/s rd, 220 KiB/s wr, 2 op/s 2024-03-04T06:51:33.056 INFO:tasks.rados.rados.0.smithi137.stdout:2946: finishing write tid 1 to smithi13777483-47 2024-03-04T06:51:33.056 INFO:tasks.rados.rados.0.smithi137.stdout:2946: finishing write tid 2 to smithi13777483-47 2024-03-04T06:51:33.056 INFO:tasks.rados.rados.0.smithi137.stdout:2943: done (4 left) 2024-03-04T06:51:33.056 INFO:tasks.rados.rados.0.smithi137.stdout:2945: done (3 left) 2024-03-04T06:51:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:2949: copy_from oid 8 from oid 50 current snap is 272 2024-03-04T06:51:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:2946: finishing write tid 3 to smithi13777483-47 2024-03-04T06:51:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:2948: finishing rollback tid 0 to smithi13777483-1 2024-03-04T06:51:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:2948: finishing rollback tid 1 to smithi13777483-1 2024-03-04T06:51:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:2948: finishing rollback tid 2 to smithi13777483-1 2024-03-04T06:51:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 16862 (ObjNum 771 snap 228 seq_num 771) dirty exists 2024-03-04T06:51:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:2946: finishing write tid 4 to smithi13777483-47 2024-03-04T06:51:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:2946: oid 47 updating version 0 to 16878 2024-03-04T06:51:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:2946: oid 47 updating version 16878 to 16879 2024-03-04T06:51:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:2946: oid 47 version 16879 is already newer than 16877 2024-03-04T06:51:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16879 (ObjNum 924 snap 272 seq_num 924) dirty exists 2024-03-04T06:51:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:2946: left oid 47 (ObjNum 924 snap 272 seq_num 924) 2024-03-04T06:51:33.057 INFO:tasks.rados.rados.0.smithi137.stdout:2947: expect (ObjNum 908 snap 265 seq_num 908) 2024-03-04T06:51:33.288 INFO:tasks.rados.rados.0.smithi137.stdout:2949: finishing copy_from racing read to smithi13777483-8 2024-03-04T06:51:33.288 INFO:tasks.rados.rados.0.smithi137.stdout:2949: finishing copy_from to smithi13777483-8 2024-03-04T06:51:33.288 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16893 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:51:33.289 INFO:tasks.rados.rados.0.smithi137.stdout:2946: done (3 left) 2024-03-04T06:51:33.289 INFO:tasks.rados.rados.0.smithi137.stdout:2947: done (2 left) 2024-03-04T06:51:33.289 INFO:tasks.rados.rados.0.smithi137.stdout:2948: done (1 left) 2024-03-04T06:51:33.289 INFO:tasks.rados.rados.0.smithi137.stdout:2949: done (0 left) 2024-03-04T06:51:33.289 INFO:tasks.rados.rados.0.smithi137.stdout:2950: read oid 11 snap 268 2024-03-04T06:51:33.289 INFO:tasks.rados.rados.0.smithi137.stdout:2950: expect deleted 2024-03-04T06:51:33.289 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 272 2024-03-04T06:51:33.289 INFO:tasks.rados.rados.0.smithi137.stdout:2951: seq_num 925 ranges {3268608=696320,3964928=401408} 2024-03-04T06:51:33.309 INFO:tasks.rados.rados.0.smithi137.stdout:2951: writing smithi13777483-14 from 3268608 to 3964928 tid 1 2024-03-04T06:51:33.311 INFO:tasks.rados.rados.0.smithi137.stdout:2951: writing smithi13777483-14 from 3964928 to 4366336 tid 2 2024-03-04T06:51:33.312 INFO:tasks.rados.rados.0.smithi137.stdout:2952: delete oid 33 current snap is 272 2024-03-04T06:51:33.315 INFO:tasks.rados.rados.0.smithi137.stdout:2950: done (2 left) 2024-03-04T06:51:33.315 INFO:tasks.rados.rados.0.smithi137.stdout:2952: done (1 left) 2024-03-04T06:51:33.315 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 272 2024-03-04T06:51:33.315 INFO:tasks.rados.rados.0.smithi137.stdout:2953: seq_num 927 ranges {5382144=729088,6111232=401408} 2024-03-04T06:51:33.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-mon[85573]: osdmap e616: 8 total, 8 up, 8 in 2024-03-04T06:51:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:33.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-mon[85573]: pgmap v604: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 435 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 312 KiB/s rd, 220 KiB/s wr, 2 op/s 2024-03-04T06:51:33.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:32.960+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:33.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:32.960+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:33.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:32.960+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:33.347 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:32.987+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:33.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:32.913+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:33.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:32.913+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:33.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:32.986+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:33.348 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:32.988+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:33.348 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:32.988+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:33.348 INFO:tasks.rados.rados.0.smithi137.stdout:2953: writing smithi13777483-31 from 5382144 to 6111232 tid 1 2024-03-04T06:51:33.350 INFO:tasks.rados.rados.0.smithi137.stdout:2953: writing smithi13777483-31 from 6111232 to 6512640 tid 2 2024-03-04T06:51:33.350 INFO:tasks.rados.rados.0.smithi137.stdout:2954: snap_create 2024-03-04T06:51:33.350 INFO:tasks.rados.rados.0.smithi137.stdout:2951: finishing write tid 1 to smithi13777483-14 2024-03-04T06:51:33.350 INFO:tasks.rados.rados.0.smithi137.stdout:2951: finishing write tid 2 to smithi13777483-14 2024-03-04T06:51:33.350 INFO:tasks.rados.rados.0.smithi137.stdout:2951: finishing write tid 3 to smithi13777483-14 2024-03-04T06:51:33.350 INFO:tasks.rados.rados.0.smithi137.stdout:2951: finishing write tid 4 to smithi13777483-14 2024-03-04T06:51:33.350 INFO:tasks.rados.rados.0.smithi137.stdout:2951: oid 14 updating version 0 to 16897 2024-03-04T06:51:33.350 INFO:tasks.rados.rados.0.smithi137.stdout:2951: oid 14 updating version 16897 to 16899 2024-03-04T06:51:33.350 INFO:tasks.rados.rados.0.smithi137.stdout:2951: oid 14 version 16899 is already newer than 16898 2024-03-04T06:51:33.350 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 16899 (ObjNum 925 snap 272 seq_num 925) dirty exists 2024-03-04T06:51:33.351 INFO:tasks.rados.rados.0.smithi137.stdout:2951: left oid 14 (ObjNum 925 snap 272 seq_num 925) 2024-03-04T06:51:33.352 INFO:tasks.rados.rados.0.smithi137.stdout:2953: finishing write tid 1 to smithi13777483-31 2024-03-04T06:51:33.353 INFO:tasks.rados.rados.0.smithi137.stdout:2953: finishing write tid 2 to smithi13777483-31 2024-03-04T06:51:33.353 INFO:tasks.rados.rados.0.smithi137.stdout:2953: finishing write tid 3 to smithi13777483-31 2024-03-04T06:51:33.354 INFO:tasks.rados.rados.0.smithi137.stdout:2953: finishing write tid 4 to smithi13777483-31 2024-03-04T06:51:33.354 INFO:tasks.rados.rados.0.smithi137.stdout:2953: oid 31 updating version 0 to 16898 2024-03-04T06:51:33.354 INFO:tasks.rados.rados.0.smithi137.stdout:2953: oid 31 updating version 16898 to 16900 2024-03-04T06:51:33.354 INFO:tasks.rados.rados.0.smithi137.stdout:2953: oid 31 version 16900 is already newer than 16899 2024-03-04T06:51:33.354 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16900 (ObjNum 927 snap 272 seq_num 927) dirty exists 2024-03-04T06:51:33.354 INFO:tasks.rados.rados.0.smithi137.stdout:2953: left oid 31 (ObjNum 927 snap 272 seq_num 927) 2024-03-04T06:51:33.971 INFO:tasks.rados.rados.0.smithi137.stdout:2951: done (2 left) 2024-03-04T06:51:33.971 INFO:tasks.rados.rados.0.smithi137.stdout:2953: done (1 left) 2024-03-04T06:51:33.971 INFO:tasks.rados.rados.0.smithi137.stdout:2954: done (0 left) 2024-03-04T06:51:33.971 INFO:tasks.rados.rados.0.smithi137.stdout:2955: copy_from oid 40 from oid 20 current snap is 273 2024-03-04T06:51:33.971 INFO:tasks.rados.rados.0.smithi137.stdout:2956: rmattr oid 46 current snap is 273 2024-03-04T06:51:33.971 INFO:tasks.rados.rados.0.smithi137.stdout:2956: done (1 left) 2024-03-04T06:51:33.972 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 48 current snap is 273 2024-03-04T06:51:33.972 INFO:tasks.rados.rados.0.smithi137.stdout:2957: seq_num 928 ranges {0=745472,745472=401408} 2024-03-04T06:51:33.976 INFO:tasks.rados.rados.0.smithi137.stdout:2957: writing smithi13777483-48 from 0 to 745472 tid 1 2024-03-04T06:51:33.979 INFO:tasks.rados.rados.0.smithi137.stdout:2957: writing smithi13777483-48 from 745472 to 1146880 tid 2 2024-03-04T06:51:33.979 INFO:tasks.rados.rados.0.smithi137.stdout:2958: snap_create 2024-03-04T06:51:33.981 INFO:tasks.rados.rados.0.smithi137.stdout:2957: finishing write tid 1 to smithi13777483-48 2024-03-04T06:51:33.982 INFO:tasks.rados.rados.0.smithi137.stdout:2957: finishing write tid 2 to smithi13777483-48 2024-03-04T06:51:33.983 INFO:tasks.rados.rados.0.smithi137.stdout:2957: finishing write tid 3 to smithi13777483-48 2024-03-04T06:51:33.983 INFO:tasks.rados.rados.0.smithi137.stdout:2955: finishing copy_from racing read to smithi13777483-40 2024-03-04T06:51:33.985 INFO:tasks.rados.rados.0.smithi137.stdout:2955: finishing copy_from to smithi13777483-40 2024-03-04T06:51:33.985 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 16893 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:51:33.985 INFO:tasks.rados.rados.0.smithi137.stdout:2957: finishing write tid 4 to smithi13777483-48 2024-03-04T06:51:33.985 INFO:tasks.rados.rados.0.smithi137.stdout:2957: oid 48 updating version 0 to 16863 2024-03-04T06:51:33.985 INFO:tasks.rados.rados.0.smithi137.stdout:2957: oid 48 updating version 16863 to 16864 2024-03-04T06:51:33.985 INFO:tasks.rados.rados.0.smithi137.stdout:2957: oid 48 updating version 16864 to 16865 2024-03-04T06:51:33.985 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 16865 (ObjNum 928 snap 273 seq_num 928) dirty exists 2024-03-04T06:51:33.985 INFO:tasks.rados.rados.0.smithi137.stdout:2957: left oid 48 (ObjNum 928 snap 273 seq_num 928) 2024-03-04T06:51:34.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:33.975+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:34.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:33.975+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:34.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:33.980+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:34.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: osdmap e617: 8 total, 8 up, 8 in 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:34.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:34.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:34.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:34.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:34.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:34.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:34.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:34.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:34.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:34.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: osdmap e617: 8 total, 8 up, 8 in 2024-03-04T06:51:34.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:34.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:34.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:34.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:34.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:34.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:34.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:34.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:33 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:34.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:33.973+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:34.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:33.968+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:34.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:33.968+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:34.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: osdmap e617: 8 total, 8 up, 8 in 2024-03-04T06:51:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 142=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:34.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:33 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:34.980 INFO:tasks.rados.rados.0.smithi137.stdout:2955: done (2 left) 2024-03-04T06:51:34.980 INFO:tasks.rados.rados.0.smithi137.stdout:2957: done (1 left) 2024-03-04T06:51:34.980 INFO:tasks.rados.rados.0.smithi137.stdout:2958: done (0 left) 2024-03-04T06:51:34.980 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 274 2024-03-04T06:51:34.980 INFO:tasks.rados.rados.0.smithi137.stdout:2959: seq_num 929 ranges {1376256=761856,2138112=401408} 2024-03-04T06:51:34.993 INFO:tasks.rados.rados.0.smithi137.stdout:2959: writing smithi13777483-39 from 1376256 to 2138112 tid 1 2024-03-04T06:51:34.996 INFO:tasks.rados.rados.0.smithi137.stdout:2959: writing smithi13777483-39 from 2138112 to 2539520 tid 2 2024-03-04T06:51:34.996 INFO:tasks.rados.rados.0.smithi137.stdout:2960: read oid 17 snap -1 2024-03-04T06:51:34.996 INFO:tasks.rados.rados.0.smithi137.stdout:2960: expect (ObjNum 917 snap 270 seq_num 917) 2024-03-04T06:51:34.997 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 274 2024-03-04T06:51:34.997 INFO:tasks.rados.rados.0.smithi137.stdout:2961: seq_num 930 ranges {507904=786432,1294336=401408} 2024-03-04T06:51:35.004 INFO:tasks.rados.rados.0.smithi137.stdout:2961: writing smithi13777483-42 from 507904 to 1294336 tid 1 2024-03-04T06:51:35.007 INFO:tasks.rados.rados.0.smithi137.stdout:2961: writing smithi13777483-42 from 1294336 to 1695744 tid 2 2024-03-04T06:51:35.008 INFO:tasks.rados.rados.0.smithi137.stdout:2960: expect (ObjNum 917 snap 270 seq_num 917) 2024-03-04T06:51:35.061 INFO:tasks.rados.rados.0.smithi137.stdout:2959: finishing write tid 1 to smithi13777483-39 2024-03-04T06:51:35.061 INFO:tasks.rados.rados.0.smithi137.stdout:2961: finishing write tid 1 to smithi13777483-42 2024-03-04T06:51:35.061 INFO:tasks.rados.rados.0.smithi137.stdout:2959: finishing write tid 2 to smithi13777483-39 2024-03-04T06:51:35.061 INFO:tasks.rados.rados.0.smithi137.stdout:2961: finishing write tid 2 to smithi13777483-42 2024-03-04T06:51:35.061 INFO:tasks.rados.rados.0.smithi137.stdout:2961: finishing write tid 3 to smithi13777483-42 2024-03-04T06:51:35.061 INFO:tasks.rados.rados.0.smithi137.stdout:2959: finishing write tid 3 to smithi13777483-39 2024-03-04T06:51:35.061 INFO:tasks.rados.rados.0.smithi137.stdout:2961: finishing write tid 4 to smithi13777483-42 2024-03-04T06:51:35.061 INFO:tasks.rados.rados.0.smithi137.stdout:2961: oid 42 updating version 0 to 16906 2024-03-04T06:51:35.061 INFO:tasks.rados.rados.0.smithi137.stdout:2961: oid 42 version 16906 is already newer than 16904 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:2961: oid 42 version 16906 is already newer than 16905 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16906 (ObjNum 930 snap 274 seq_num 930) dirty exists 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:2961: left oid 42 (ObjNum 930 snap 274 seq_num 930) 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:2959: finishing write tid 4 to smithi13777483-39 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:2959: oid 39 updating version 0 to 16875 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:2959: oid 39 updating version 16875 to 16877 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:2959: oid 39 version 16877 is already newer than 16876 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 16877 (ObjNum 929 snap 274 seq_num 929) dirty exists 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:2959: left oid 39 (ObjNum 929 snap 274 seq_num 929) 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:2959: done (2 left) 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:2960: done (1 left) 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:2961: done (0 left) 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:2962: read oid 33 snap -1 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:2962: expect deleted 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:2963: rollback oid 45 current snap is 274 2024-03-04T06:51:35.062 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 45 to 267 2024-03-04T06:51:35.063 INFO:tasks.rados.rados.0.smithi137.stdout:2964: snap_create 2024-03-04T06:51:35.066 INFO:tasks.rados.rados.0.smithi137.stdout:2963: finishing rollback tid 0 to smithi13777483-45 2024-03-04T06:51:35.067 INFO:tasks.rados.rados.0.smithi137.stdout:2963: finishing rollback tid 1 to smithi13777483-45 2024-03-04T06:51:35.067 INFO:tasks.rados.rados.0.smithi137.stdout:2963: finishing rollback tid 2 to smithi13777483-45 2024-03-04T06:51:35.067 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16869 (ObjNum 851 snap 248 seq_num 851) dirty exists 2024-03-04T06:51:35.270 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:34.976+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:35.270 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:34.959+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:35.270 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:35.009+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:35.271 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:35.000+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:35.271 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:35.000+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:35.271 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:35.000+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:35.271 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:35.271 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:35.271 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:35.272 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[88869]: osdmap e618: 8 total, 8 up, 8 in 2024-03-04T06:51:35.272 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:35.272 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:35.272 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:35.272 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:35.272 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[88869]: pgmap v607: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 439 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.5 MiB/s wr, 7 op/s 2024-03-04T06:51:35.272 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:35.272 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:35.272 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:35.272 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:35.272 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:35.273 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[91314]: osdmap e618: 8 total, 8 up, 8 in 2024-03-04T06:51:35.273 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:35.273 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:35.273 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:35.273 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:35.273 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[91314]: pgmap v607: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 439 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.5 MiB/s wr, 7 op/s 2024-03-04T06:51:35.273 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:35.273 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:34 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:35.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:34.976+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:35.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:34.999+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:35.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:35.001+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:35.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:35.001+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:35.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:34.946+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:35.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:34.946+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:35.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:35.011+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:35.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:34.959+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:35.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:34.959+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:35.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:34.960+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:35.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:35.063+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:35.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:35.067+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:35.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:35.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:35.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:35.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-mon[85573]: osdmap e618: 8 total, 8 up, 8 in 2024-03-04T06:51:35.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:35.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:35.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:35.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:35.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-mon[85573]: pgmap v607: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 439 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.5 MiB/s wr, 7 op/s 2024-03-04T06:51:35.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:35.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:34 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:35.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:51:35] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:51:35.982 INFO:tasks.rados.rados.0.smithi137.stdout:2962: done (2 left) 2024-03-04T06:51:35.982 INFO:tasks.rados.rados.0.smithi137.stdout:2963: done (1 left) 2024-03-04T06:51:35.982 INFO:tasks.rados.rados.0.smithi137.stdout:2964: done (0 left) 2024-03-04T06:51:35.982 INFO:tasks.rados.rados.0.smithi137.stdout:2965: copy_from oid 35 from oid 31 current snap is 275 2024-03-04T06:51:35.982 INFO:tasks.rados.rados.0.smithi137.stdout:2966: snap_remove snap 271 2024-03-04T06:51:36.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:36.018+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:36.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:36.018+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:36.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:36.008+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:36.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:35.980+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:36.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:36.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:36.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:36.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:36.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:36.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:36.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[88869]: osdmap e619: 8 total, 8 up, 8 in 2024-03-04T06:51:36.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:36.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:36.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:36.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:36.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:36.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:36.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:36.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:36.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:36.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:36.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:36.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:36.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[91314]: osdmap e619: 8 total, 8 up, 8 in 2024-03-04T06:51:36.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:36.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:36.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:36.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:36.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:36.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:36.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:35.989+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:36.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:35.989+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:36.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:35.981+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:36.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:36.027+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:36.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:36.027+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:36.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:35.984+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:36.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:35.984+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:36.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:35.984+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:36.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 143=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:36.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:36.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:36.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:36.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:36.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:36.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-mon[85573]: osdmap e619: 8 total, 8 up, 8 in 2024-03-04T06:51:36.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:36.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:36.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:36.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:36.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:36.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:36.990 INFO:tasks.rados.rados.0.smithi137.stdout:2966: done (1 left) 2024-03-04T06:51:36.991 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 275 2024-03-04T06:51:36.991 INFO:tasks.rados.rados.0.smithi137.stdout:2965: finishing copy_from racing read to smithi13777483-35 2024-03-04T06:51:36.991 INFO:tasks.rados.rados.0.smithi137.stdout:2967: seq_num 931 ranges {8314880=802816,9117696=401408} 2024-03-04T06:51:37.040 INFO:tasks.rados.rados.0.smithi137.stdout:2967: writing smithi13777483-9 from 8314880 to 9117696 tid 1 2024-03-04T06:51:37.043 INFO:tasks.rados.rados.0.smithi137.stdout:2967: writing smithi13777483-9 from 9117696 to 9519104 tid 2 2024-03-04T06:51:37.043 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 275 2024-03-04T06:51:37.043 INFO:tasks.rados.rados.0.smithi137.stdout:2965: finishing copy_from to smithi13777483-35 2024-03-04T06:51:37.043 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16900 (ObjNum 927 snap 272 seq_num 927) dirty exists 2024-03-04T06:51:37.043 INFO:tasks.rados.rados.0.smithi137.stdout:2968: seq_num 932 ranges {4653056=417792,5070848=663552,5734400=139264} 2024-03-04T06:51:37.071 INFO:tasks.rados.rados.0.smithi137.stdout:2968: writing smithi13777483-47 from 4653056 to 5070848 tid 1 2024-03-04T06:51:37.075 INFO:tasks.rados.rados.0.smithi137.stdout:2968: writing smithi13777483-47 from 5070848 to 5734400 tid 2 2024-03-04T06:51:37.076 INFO:tasks.rados.rados.0.smithi137.stdout:2968: writing smithi13777483-47 from 5734400 to 5873664 tid 3 2024-03-04T06:51:37.076 INFO:tasks.rados.rados.0.smithi137.stdout:2965: done (2 left) 2024-03-04T06:51:37.076 INFO:tasks.rados.rados.0.smithi137.stdout:2969: setattr oid 18 current snap is 275 2024-03-04T06:51:37.076 INFO:tasks.rados.rados.0.smithi137.stdout:2967: finishing write tid 1 to smithi13777483-9 2024-03-04T06:51:37.077 INFO:tasks.rados.rados.0.smithi137.stdout:2967: finishing write tid 2 to smithi13777483-9 2024-03-04T06:51:37.077 INFO:tasks.rados.rados.0.smithi137.stdout:2967: finishing write tid 3 to smithi13777483-9 2024-03-04T06:51:37.077 INFO:tasks.rados.rados.0.smithi137.stdout:2967: finishing write tid 4 to smithi13777483-9 2024-03-04T06:51:37.077 INFO:tasks.rados.rados.0.smithi137.stdout:2967: oid 9 updating version 0 to 16872 2024-03-04T06:51:37.077 INFO:tasks.rados.rados.0.smithi137.stdout:2967: oid 9 version 16872 is already newer than 16870 2024-03-04T06:51:37.077 INFO:tasks.rados.rados.0.smithi137.stdout:2967: oid 9 version 16872 is already newer than 16871 2024-03-04T06:51:37.077 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 16872 (ObjNum 931 snap 275 seq_num 931) dirty exists 2024-03-04T06:51:37.077 INFO:tasks.rados.rados.0.smithi137.stdout:2967: left oid 9 (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:51:37.077 INFO:tasks.rados.rados.0.smithi137.stdout:2968: finishing write tid 1 to smithi13777483-47 2024-03-04T06:51:37.078 INFO:tasks.rados.rados.0.smithi137.stdout:2967: done (2 left) 2024-03-04T06:51:37.078 INFO:tasks.rados.rados.0.smithi137.stdout:2970: snap_remove snap 268 2024-03-04T06:51:37.254 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:36.986+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:37.254 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:36.986+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:37.254 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:36.987+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:37.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:37.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:37.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:37.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: osdmap e620: 8 total, 8 up, 8 in 2024-03-04T06:51:37.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:37.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:37.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:37.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:37.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:37.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:37.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:37.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:37.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:37.255 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[88869]: pgmap v610: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 444 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-03-04T06:51:37.255 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:37.255 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:37.256 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:37.256 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: osdmap e620: 8 total, 8 up, 8 in 2024-03-04T06:51:37.256 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:37.256 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:37.256 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:37.256 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:37.256 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:37.256 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:37.256 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:37.256 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:37.256 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:37.256 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-mon[91314]: pgmap v610: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 444 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-03-04T06:51:37.257 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:36.990+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:37.257 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:36.995+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:37.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:36.991+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:37.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:36.985+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:37.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:36.985+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:37.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:36.985+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:37.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:36.990+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:37.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:36.992+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:37.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:37.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:37.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:37.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: osdmap e620: 8 total, 8 up, 8 in 2024-03-04T06:51:37.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:37.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:37.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:37.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:37.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:37.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:37.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:37.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:37.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:37.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:36 smithi203 ceph-mon[85573]: pgmap v610: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 444 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-03-04T06:51:37.985 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:37.729+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:37.992 INFO:tasks.rados.rados.0.smithi137.stdout:2968: finishing write tid 2 to smithi13777483-47 2024-03-04T06:51:37.992 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16861 (ObjNum 33 snap 0 seq_num 3131270912) dirty exists 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:2968: finishing write tid 3 to smithi13777483-47 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:2968: finishing write tid 4 to smithi13777483-47 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:2968: finishing write tid 5 to smithi13777483-47 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:2968: oid 47 updating version 0 to 16882 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:2968: oid 47 version 16882 is already newer than 16881 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:2968: oid 47 version 16882 is already newer than 16880 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:2968: oid 47 updating version 16882 to 16883 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16883 (ObjNum 932 snap 275 seq_num 932) dirty exists 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:2968: left oid 47 (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:2968: done (2 left) 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:2969: done (1 left) 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:2970: done (0 left) 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 29 current snap is 275 2024-03-04T06:51:37.993 INFO:tasks.rados.rados.0.smithi137.stdout:2971: seq_num 933 ranges {0=434176,434176=548864,983040=253952} 2024-03-04T06:51:37.995 INFO:tasks.rados.rados.0.smithi137.stdout:2971: writing smithi13777483-29 from 0 to 434176 tid 1 2024-03-04T06:51:37.999 INFO:tasks.rados.rados.0.smithi137.stdout:2971: writing smithi13777483-29 from 434176 to 983040 tid 2 2024-03-04T06:51:38.001 INFO:tasks.rados.rados.0.smithi137.stdout:2971: writing smithi13777483-29 from 983040 to 1236992 tid 3 2024-03-04T06:51:38.001 INFO:tasks.rados.rados.0.smithi137.stdout:2972: read oid 4 snap -1 2024-03-04T06:51:38.001 INFO:tasks.rados.rados.0.smithi137.stdout:2972: expect (ObjNum 880 snap 259 seq_num 880) 2024-03-04T06:51:38.001 INFO:tasks.rados.rados.0.smithi137.stdout:2973: read oid 35 snap -1 2024-03-04T06:51:38.001 INFO:tasks.rados.rados.0.smithi137.stdout:2973: expect (ObjNum 927 snap 272 seq_num 927) 2024-03-04T06:51:38.001 INFO:tasks.rados.rados.0.smithi137.stdout:2974: snap_create 2024-03-04T06:51:38.002 INFO:tasks.rados.rados.0.smithi137.stdout:2971: finishing write tid 1 to smithi13777483-29 2024-03-04T06:51:38.008 INFO:tasks.rados.rados.0.smithi137.stdout:2971: finishing write tid 2 to smithi13777483-29 2024-03-04T06:51:38.008 INFO:tasks.rados.rados.0.smithi137.stdout:2971: finishing write tid 3 to smithi13777483-29 2024-03-04T06:51:38.009 INFO:tasks.rados.rados.0.smithi137.stdout:2971: finishing write tid 4 to smithi13777483-29 2024-03-04T06:51:38.011 INFO:tasks.rados.rados.0.smithi137.stdout:2971: finishing write tid 5 to smithi13777483-29 2024-03-04T06:51:38.012 INFO:tasks.rados.rados.0.smithi137.stdout:2971: oid 29 updating version 0 to 16862 2024-03-04T06:51:38.012 INFO:tasks.rados.rados.0.smithi137.stdout:2971: oid 29 updating version 16862 to 16864 2024-03-04T06:51:38.012 INFO:tasks.rados.rados.0.smithi137.stdout:2971: oid 29 version 16864 is already newer than 16863 2024-03-04T06:51:38.012 INFO:tasks.rados.rados.0.smithi137.stdout:2971: oid 29 updating version 16864 to 16865 2024-03-04T06:51:38.012 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16865 (ObjNum 933 snap 275 seq_num 933) dirty exists 2024-03-04T06:51:38.012 INFO:tasks.rados.rados.0.smithi137.stdout:2971: left oid 29 (ObjNum 933 snap 275 seq_num 933) 2024-03-04T06:51:38.031 INFO:tasks.rados.rados.0.smithi137.stdout:2972: expect (ObjNum 880 snap 259 seq_num 880) 2024-03-04T06:51:38.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:37.991+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:38.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:37.997+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:38.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:37.997+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:38.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:38.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:38.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:38.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:38.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[88869]: osdmap e621: 8 total, 8 up, 8 in 2024-03-04T06:51:38.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:38.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:38.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:38.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:38.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:38.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:38.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:38.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:38.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:38.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[91314]: osdmap e621: 8 total, 8 up, 8 in 2024-03-04T06:51:38.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:38.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:38.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:38.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:38.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:38.295 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:38.006+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:38.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:37.998+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:38.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:37.995+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:38.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:37.995+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:38.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:38.001+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:38.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:38.002+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:38.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:38.002+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:38.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:38.005+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:38.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:38.005+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:38.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:38.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:38.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:38.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:38.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-mon[85573]: osdmap e621: 8 total, 8 up, 8 in 2024-03-04T06:51:38.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:38.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:38.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:38.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:38.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:38.542 INFO:tasks.rados.rados.0.smithi137.stdout:2973: expect (ObjNum 927 snap 272 seq_num 927) 2024-03-04T06:51:39.002 INFO:tasks.rados.rados.0.smithi137.stdout:2971: done (3 left) 2024-03-04T06:51:39.002 INFO:tasks.rados.rados.0.smithi137.stdout:2972: done (2 left) 2024-03-04T06:51:39.002 INFO:tasks.rados.rados.0.smithi137.stdout:2973: done (1 left) 2024-03-04T06:51:39.002 INFO:tasks.rados.rados.0.smithi137.stdout:2974: done (0 left) 2024-03-04T06:51:39.002 INFO:tasks.rados.rados.0.smithi137.stdout:2975: copy_from oid 49 from oid 13 current snap is 276 2024-03-04T06:51:39.002 INFO:tasks.rados.rados.0.smithi137.stdout:2976: copy_from oid 46 from oid 17 current snap is 276 2024-03-04T06:51:39.003 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 276 2024-03-04T06:51:39.003 INFO:tasks.rados.rados.0.smithi137.stdout:2977: seq_num 934 ranges {0=450560,450560=434176,884736=368640} 2024-03-04T06:51:39.004 INFO:tasks.rados.rados.0.smithi137.stdout:2977: writing smithi13777483-25 from 0 to 450560 tid 1 2024-03-04T06:51:39.007 INFO:tasks.rados.rados.0.smithi137.stdout:2977: writing smithi13777483-25 from 450560 to 884736 tid 2 2024-03-04T06:51:39.010 INFO:tasks.rados.rados.0.smithi137.stdout:2977: writing smithi13777483-25 from 884736 to 1253376 tid 3 2024-03-04T06:51:39.010 INFO:tasks.rados.rados.0.smithi137.stdout:2978: read oid 11 snap -1 2024-03-04T06:51:39.010 INFO:tasks.rados.rados.0.smithi137.stdout:2978: expect (ObjNum 874 snap 255 seq_num 874) 2024-03-04T06:51:39.010 INFO:tasks.rados.rados.0.smithi137.stdout:2979: read oid 14 snap -1 2024-03-04T06:51:39.011 INFO:tasks.rados.rados.0.smithi137.stdout:2979: expect (ObjNum 925 snap 272 seq_num 925) 2024-03-04T06:51:39.011 INFO:tasks.rados.rados.0.smithi137.stdout:2980: setattr oid 31 current snap is 276 2024-03-04T06:51:39.011 INFO:tasks.rados.rados.0.smithi137.stdout:2977: finishing write tid 1 to smithi13777483-25 2024-03-04T06:51:39.012 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 276 2024-03-04T06:51:39.012 INFO:tasks.rados.rados.0.smithi137.stdout:2981: seq_num 935 ranges {1695744=466944,2162688=720896,2883584=81920} 2024-03-04T06:51:39.024 INFO:tasks.rados.rados.0.smithi137.stdout:2981: writing smithi13777483-42 from 1695744 to 2162688 tid 1 2024-03-04T06:51:39.029 INFO:tasks.rados.rados.0.smithi137.stdout:2981: writing smithi13777483-42 from 2162688 to 2883584 tid 2 2024-03-04T06:51:39.029 INFO:tasks.rados.rados.0.smithi137.stdout:2981: writing smithi13777483-42 from 2883584 to 2965504 tid 3 2024-03-04T06:51:39.029 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 43 current snap is 276 2024-03-04T06:51:39.029 INFO:tasks.rados.rados.0.smithi137.stdout:2976: finishing copy_from racing read to smithi13777483-46 2024-03-04T06:51:39.029 INFO:tasks.rados.rados.0.smithi137.stdout:2982: seq_num 936 ranges {0=483328,483328=655360,1138688=147456} 2024-03-04T06:51:39.032 INFO:tasks.rados.rados.0.smithi137.stdout:2982: writing smithi13777483-43 from 0 to 483328 tid 1 2024-03-04T06:51:39.036 INFO:tasks.rados.rados.0.smithi137.stdout:2982: writing smithi13777483-43 from 483328 to 1138688 tid 2 2024-03-04T06:51:39.038 INFO:tasks.rados.rados.0.smithi137.stdout:2982: writing smithi13777483-43 from 1138688 to 1286144 tid 3 2024-03-04T06:51:39.038 INFO:tasks.rados.rados.0.smithi137.stdout:2983: delete oid 19 current snap is 276 2024-03-04T06:51:39.038 INFO:tasks.rados.rados.0.smithi137.stdout:2977: finishing write tid 2 to smithi13777483-25 2024-03-04T06:51:39.038 INFO:tasks.rados.rados.0.smithi137.stdout:2977: finishing write tid 3 to smithi13777483-25 2024-03-04T06:51:39.038 INFO:tasks.rados.rados.0.smithi137.stdout:2976: finishing copy_from to smithi13777483-46 2024-03-04T06:51:39.038 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 16869 (ObjNum 917 snap 270 seq_num 917) dirty exists 2024-03-04T06:51:39.038 INFO:tasks.rados.rados.0.smithi137.stdout:2977: finishing write tid 4 to smithi13777483-25 2024-03-04T06:51:39.038 INFO:tasks.rados.rados.0.smithi137.stdout:2978: expect (ObjNum 874 snap 255 seq_num 874) 2024-03-04T06:51:39.050 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:39.007+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:39.050 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:39.004+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:39.051 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:39.005+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:39.051 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:38.998+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:39.051 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:38.998+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:39.051 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:38.998+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:39.051 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:39.018+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:39.052 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:39.052 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:39.052 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: osdmap e622: 8 total, 8 up, 8 in 2024-03-04T06:51:39.052 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:39.052 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:39.052 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:39.052 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:39.052 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:39.052 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:39.052 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:39.052 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:39.053 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:39.053 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:39.053 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:39.053 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:51:39.053 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:51:39.053 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:39.053 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-04T06:51:39.053 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-04T06:51:39.053 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:39.053 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.053 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.053 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.053 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.054 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.054 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.054 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.054 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.054 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.054 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.054 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.054 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.054 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.054 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.054 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.054 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:51:39.054 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:38 smithi203 ceph-mon[85573]: pgmap v613: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 454 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 4.4 MiB/s rd, 3.9 MiB/s wr, 19 op/s 2024-03-04T06:51:39.085 INFO:tasks.rados.rados.0.smithi137.stdout:2977: finishing write tid 5 to smithi13777483-25 2024-03-04T06:51:39.085 INFO:tasks.rados.rados.0.smithi137.stdout:2977: oid 25 updating version 0 to 16884 2024-03-04T06:51:39.085 INFO:tasks.rados.rados.0.smithi137.stdout:2977: oid 25 updating version 16884 to 16885 2024-03-04T06:51:39.085 INFO:tasks.rados.rados.0.smithi137.stdout:2977: oid 25 updating version 16885 to 16887 2024-03-04T06:51:39.085 INFO:tasks.rados.rados.0.smithi137.stdout:2977: oid 25 version 16887 is already newer than 16886 2024-03-04T06:51:39.085 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 16887 (ObjNum 934 snap 276 seq_num 934) dirty exists 2024-03-04T06:51:39.085 INFO:tasks.rados.rados.0.smithi137.stdout:2977: left oid 25 (ObjNum 934 snap 276 seq_num 934) 2024-03-04T06:51:39.085 INFO:tasks.rados.rados.0.smithi137.stdout:2975: finishing copy_from racing read to smithi13777483-49 2024-03-04T06:51:39.085 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16901 (ObjNum 927 snap 272 seq_num 927) dirty exists 2024-03-04T06:51:39.085 INFO:tasks.rados.rados.0.smithi137.stdout:2975: finishing copy_from to smithi13777483-49 2024-03-04T06:51:39.085 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16900 (ObjNum 874 snap 255 seq_num 874) dirty exists 2024-03-04T06:51:39.085 INFO:tasks.rados.rados.0.smithi137.stdout:2981: finishing write tid 1 to smithi13777483-42 2024-03-04T06:51:39.085 INFO:tasks.rados.rados.0.smithi137.stdout:2975: done (8 left) 2024-03-04T06:51:39.086 INFO:tasks.rados.rados.0.smithi137.stdout:2976: done (7 left) 2024-03-04T06:51:39.086 INFO:tasks.rados.rados.0.smithi137.stdout:2977: done (6 left) 2024-03-04T06:51:39.086 INFO:tasks.rados.rados.0.smithi137.stdout:2978: done (5 left) 2024-03-04T06:51:39.086 INFO:tasks.rados.rados.0.smithi137.stdout:2980: done (4 left) 2024-03-04T06:51:39.086 INFO:tasks.rados.rados.0.smithi137.stdout:2983: done (3 left) 2024-03-04T06:51:39.086 INFO:tasks.rados.rados.0.smithi137.stdout:2984: snap_remove snap 269 2024-03-04T06:51:39.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:39.001+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:39.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:39.004+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:39.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:39.008+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:39.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:39.009+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:39.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:39.009+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:39.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:39.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:39.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: osdmap e622: 8 total, 8 up, 8 in 2024-03-04T06:51:39.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:39.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:39.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:39.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:39.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:39.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:39.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:39.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:39.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:39.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:39.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:39.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:51:39.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:51:39.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:39.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-04T06:51:39.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-04T06:51:39.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:39.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:39.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:39.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: osdmap e622: 8 total, 8 up, 8 in 2024-03-04T06:51:39.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:39.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:39.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:39.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:39.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:39.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:39.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:39.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:39.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:39.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:39.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:39.297 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:51:39.299 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[91314]: pgmap v613: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 454 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 4.4 MiB/s rd, 3.9 MiB/s wr, 19 op/s 2024-03-04T06:51:39.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.299 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.300 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.300 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.300 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:51:39.300 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:51:39.300 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:38 smithi137 ceph-mon[88869]: pgmap v613: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 454 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 4.4 MiB/s rd, 3.9 MiB/s wr, 19 op/s 2024-03-04T06:51:40.016 INFO:tasks.rados.rados.0.smithi137.stdout:2984: done (3 left) 2024-03-04T06:51:40.016 INFO:tasks.rados.rados.0.smithi137.stdout:2985: copy_from oid 27 from oid 2 current snap is 276 2024-03-04T06:51:40.016 INFO:tasks.rados.rados.0.smithi137.stdout:2981: finishing write tid 2 to smithi13777483-42 2024-03-04T06:51:40.016 INFO:tasks.rados.rados.0.smithi137.stdout:2979: expect (ObjNum 925 snap 272 seq_num 925) 2024-03-04T06:51:40.223 INFO:tasks.rados.rados.0.smithi137.stdout:2981: finishing write tid 3 to smithi13777483-42 2024-03-04T06:51:40.223 INFO:tasks.rados.rados.0.smithi137.stdout:2981: finishing write tid 4 to smithi13777483-42 2024-03-04T06:51:40.223 INFO:tasks.rados.rados.0.smithi137.stdout:2979: done (3 left) 2024-03-04T06:51:40.223 INFO:tasks.rados.rados.0.smithi137.stdout:2986: snap_remove snap 275 2024-03-04T06:51:40.252 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:40.015+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:40.252 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:40.021+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:40.252 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:40.021+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:40.253 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:40.016+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:40.253 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:40.253 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:40.253 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-mon[88869]: osdmap e623: 8 total, 8 up, 8 in 2024-03-04T06:51:40.253 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:40.253 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-mon[91314]: osdmap e623: 8 total, 8 up, 8 in 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:40.254 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:40.255 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:40.255 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:40.255 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:40.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:40.021+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:40.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:40.008+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:40.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:40.009+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:40.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:40.026+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:40.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:40.026+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:40.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:40.026+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:40.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:40.066+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:40.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:40.066+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:40.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:40.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:40.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-mon[85573]: osdmap e623: 8 total, 8 up, 8 in 2024-03-04T06:51:40.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:40.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:40.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:40.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 149=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:40.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:40.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:40.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:40.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:40.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 06:51:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T06:51:40.252Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.001792957s 2024-03-04T06:51:41.019 INFO:tasks.rados.rados.0.smithi137.stdout:2986: done (3 left) 2024-03-04T06:51:41.020 INFO:tasks.rados.rados.0.smithi137.stdout:2987: read oid 5 snap -1 2024-03-04T06:51:41.020 INFO:tasks.rados.rados.0.smithi137.stdout:2987: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:51:41.020 INFO:tasks.rados.rados.0.smithi137.stdout:2988: copy_from oid 1 from oid 46 current snap is 276 2024-03-04T06:51:41.020 INFO:tasks.rados.rados.0.smithi137.stdout:2981: finishing write tid 5 to smithi13777483-42 2024-03-04T06:51:41.020 INFO:tasks.rados.rados.0.smithi137.stdout:2981: oid 42 updating version 0 to 16910 2024-03-04T06:51:41.020 INFO:tasks.rados.rados.0.smithi137.stdout:2981: oid 42 version 16910 is already newer than 16907 2024-03-04T06:51:41.020 INFO:tasks.rados.rados.0.smithi137.stdout:2981: oid 42 version 16910 is already newer than 16908 2024-03-04T06:51:41.020 INFO:tasks.rados.rados.0.smithi137.stdout:2981: oid 42 version 16910 is already newer than 16909 2024-03-04T06:51:41.020 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16910 (ObjNum 935 snap 276 seq_num 935) dirty exists 2024-03-04T06:51:41.020 INFO:tasks.rados.rados.0.smithi137.stdout:2981: left oid 42 (ObjNum 935 snap 276 seq_num 935) 2024-03-04T06:51:41.020 INFO:tasks.rados.rados.0.smithi137.stdout:2982: finishing write tid 1 to smithi13777483-43 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2982: finishing write tid 2 to smithi13777483-43 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2982: finishing write tid 3 to smithi13777483-43 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2982: finishing write tid 4 to smithi13777483-43 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2982: finishing write tid 5 to smithi13777483-43 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2982: oid 43 updating version 0 to 16872 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2982: oid 43 version 16872 is already newer than 16870 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2982: oid 43 version 16872 is already newer than 16871 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2982: oid 43 updating version 16872 to 16873 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16873 (ObjNum 936 snap 276 seq_num 936) dirty exists 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2982: left oid 43 (ObjNum 936 snap 276 seq_num 936) 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2985: finishing copy_from racing read to smithi13777483-27 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2985: finishing copy_from to smithi13777483-27 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16859 (ObjNum 798 snap 231 seq_num 798) dirty exists 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2981: done (4 left) 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2982: done (3 left) 2024-03-04T06:51:41.021 INFO:tasks.rados.rados.0.smithi137.stdout:2985: done (2 left) 2024-03-04T06:51:41.022 INFO:tasks.rados.rados.0.smithi137.stdout:2989: delete oid 23 current snap is 276 2024-03-04T06:51:41.023 INFO:tasks.rados.rados.0.smithi137.stdout:2987: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:51:41.028 INFO:tasks.rados.rados.0.smithi137.stdout:2987: done (2 left) 2024-03-04T06:51:41.028 INFO:tasks.rados.rados.0.smithi137.stdout:2989: done (1 left) 2024-03-04T06:51:41.028 INFO:tasks.rados.rados.0.smithi137.stdout:2990: delete oid 28 current snap is 276 2024-03-04T06:51:41.031 INFO:tasks.rados.rados.0.smithi137.stdout:2990: done (1 left) 2024-03-04T06:51:41.032 INFO:tasks.rados.rados.0.smithi137.stdout:2991: rollback oid 7 current snap is 276 2024-03-04T06:51:41.032 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 7 to 270 2024-03-04T06:51:41.032 INFO:tasks.rados.rados.0.smithi137.stdout:2992: read oid 25 snap -1 2024-03-04T06:51:41.032 INFO:tasks.rados.rados.0.smithi137.stdout:2992: expect (ObjNum 934 snap 276 seq_num 934) 2024-03-04T06:51:41.032 INFO:tasks.rados.rados.0.smithi137.stdout:2993: copy_from oid 18 from oid 9 current snap is 276 2024-03-04T06:51:41.032 INFO:tasks.rados.rados.0.smithi137.stdout:2994: snap_create 2024-03-04T06:51:41.036 INFO:tasks.rados.rados.0.smithi137.stdout:2988: finishing copy_from racing read to smithi13777483-1 2024-03-04T06:51:41.038 INFO:tasks.rados.rados.0.smithi137.stdout:2988: finishing copy_from to smithi13777483-1 2024-03-04T06:51:41.038 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 16869 (ObjNum 917 snap 270 seq_num 917) dirty exists 2024-03-04T06:51:41.040 INFO:tasks.rados.rados.0.smithi137.stdout:2991: finishing rollback tid 0 to smithi13777483-7 2024-03-04T06:51:41.040 INFO:tasks.rados.rados.0.smithi137.stdout:2991: finishing rollback tid 1 to smithi13777483-7 2024-03-04T06:51:41.041 INFO:tasks.rados.rados.0.smithi137.stdout:2991: finishing rollback tid 2 to smithi13777483-7 2024-03-04T06:51:41.041 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16903 (ObjNum 908 snap 265 seq_num 908) dirty exists 2024-03-04T06:51:41.042 INFO:tasks.rados.rados.0.smithi137.stdout:2992: expect (ObjNum 934 snap 276 seq_num 934) 2024-03-04T06:51:41.082 INFO:tasks.rados.rados.0.smithi137.stdout:2993: finishing copy_from racing read to smithi13777483-18 2024-03-04T06:51:41.082 INFO:tasks.rados.rados.0.smithi137.stdout:2993: finishing copy_from to smithi13777483-18 2024-03-04T06:51:41.082 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16872 (ObjNum 931 snap 275 seq_num 931) dirty exists 2024-03-04T06:51:41.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:41.041+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:41.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:41.023+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:41.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:41.018+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:41.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:41.018+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:41.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:41.018+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:41.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: Upgrade: Updating grafana.a 2024-03-04T06:51:41.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: Deploying daemon grafana.a on smithi203 2024-03-04T06:51:41.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:41.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:41.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: osdmap e624: 8 total, 8 up, 8 in 2024-03-04T06:51:41.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:41.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:41.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:41.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:41.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:41.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:41.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:41.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:41.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[88869]: pgmap v616: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 462 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 4.3 MiB/s wr, 22 op/s 2024-03-04T06:51:41.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: Upgrade: Updating grafana.a 2024-03-04T06:51:41.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: Deploying daemon grafana.a on smithi203 2024-03-04T06:51:41.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:41.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:41.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: osdmap e624: 8 total, 8 up, 8 in 2024-03-04T06:51:41.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:41.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:41.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:41.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:41.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:41.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:41.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:41.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:41.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:41 smithi137 ceph-mon[91314]: pgmap v616: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 462 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 4.3 MiB/s wr, 22 op/s 2024-03-04T06:51:41.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:41.026+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:41.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:41.015+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:41.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:41.015+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:41.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:41.024+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:41.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:41.026+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:41.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:41.027+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:41.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:41.027+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: Upgrade: Updating grafana.a 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: Deploying daemon grafana.a on smithi203 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: osdmap e624: 8 total, 8 up, 8 in 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:41.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:41 smithi203 ceph-mon[85573]: pgmap v616: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 462 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 4.3 MiB/s wr, 22 op/s 2024-03-04T06:51:42.024 INFO:tasks.rados.rados.0.smithi137.stdout:2988: done (4 left) 2024-03-04T06:51:42.025 INFO:tasks.rados.rados.0.smithi137.stdout:2991: done (3 left) 2024-03-04T06:51:42.025 INFO:tasks.rados.rados.0.smithi137.stdout:2992: done (2 left) 2024-03-04T06:51:42.025 INFO:tasks.rados.rados.0.smithi137.stdout:2993: done (1 left) 2024-03-04T06:51:42.025 INFO:tasks.rados.rados.0.smithi137.stdout:2994: done (0 left) 2024-03-04T06:51:42.025 INFO:tasks.rados.rados.0.smithi137.stdout:2995: snap_create 2024-03-04T06:51:42.264 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:42.025+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:42.264 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:42.265 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:42.265 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:42.265 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:42.265 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[88869]: osdmap e625: 8 total, 8 up, 8 in 2024-03-04T06:51:42.265 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:42.265 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:42.265 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:42.265 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:42.265 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:42.265 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:42.265 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:42.266 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:42.266 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:42.266 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:42.266 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[91314]: osdmap e625: 8 total, 8 up, 8 in 2024-03-04T06:51:42.266 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:42.266 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:42.266 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:42.266 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:42.266 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:42.266 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:42.290 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:42.216+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:42.290 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:42.025+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:42.290 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:42.025+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:42.290 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:42.290 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:42.291 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:42.291 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:42.291 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-mon[85573]: osdmap e625: 8 total, 8 up, 8 in 2024-03-04T06:51:42.291 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:42.291 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:42.291 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:42.291 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:42.291 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:42.291 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:42.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:42.288+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:42.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:42.288+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:42.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:42.289+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:42.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:42.289+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:42.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:42.289+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:42.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:42.289+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:42.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:42.289+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:42.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:42.289+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:43.036 INFO:tasks.rados.rados.0.smithi137.stdout:2995: done (0 left) 2024-03-04T06:51:43.036 INFO:tasks.rados.rados.0.smithi137.stdout:2996: snap_create 2024-03-04T06:51:43.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:43.034+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[88869]: osdmap e626: 8 total, 8 up, 8 in 2024-03-04T06:51:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:43.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:43.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:43.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[88869]: pgmap v619: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 462 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 1.8 MiB/s wr, 8 op/s 2024-03-04T06:51:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[91314]: osdmap e626: 8 total, 8 up, 8 in 2024-03-04T06:51:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:43.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:43.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-mon[91314]: pgmap v619: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 462 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 1.8 MiB/s wr, 8 op/s 2024-03-04T06:51:43.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:43.030+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:43.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:43.030+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:43.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:43.031+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-mon[85573]: osdmap e626: 8 total, 8 up, 8 in 2024-03-04T06:51:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:43.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-mon[85573]: pgmap v619: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 462 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 1.8 MiB/s wr, 8 op/s 2024-03-04T06:51:43.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:43.631+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:43.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:43.631+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:43.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:43.630+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:43.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:43.632+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:44.035 INFO:tasks.rados.rados.0.smithi137.stdout:2996: done (0 left) 2024-03-04T06:51:44.035 INFO:tasks.rados.rados.0.smithi137.stdout:2997: rmattr oid 31 current snap is 279 2024-03-04T06:51:44.036 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 37 current snap is 279 2024-03-04T06:51:44.036 INFO:tasks.rados.rados.0.smithi137.stdout:2998: seq_num 940 ranges {1187840=548864,1736704=589824,2326528=212992} 2024-03-04T06:51:44.036 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:43.566+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:44.036 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:43.628+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:44.036 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:43.628+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:44.036 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:43.628+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:44.045 INFO:tasks.rados.rados.0.smithi137.stdout:2998: writing smithi13777483-37 from 1187840 to 1736704 tid 1 2024-03-04T06:51:44.048 INFO:tasks.rados.rados.0.smithi137.stdout:2998: writing smithi13777483-37 from 1736704 to 2326528 tid 2 2024-03-04T06:51:44.050 INFO:tasks.rados.rados.0.smithi137.stdout:2998: writing smithi13777483-37 from 2326528 to 2539520 tid 3 2024-03-04T06:51:44.050 INFO:tasks.rados.rados.0.smithi137.stdout:2999: copy_from oid 2 from oid 39 current snap is 279 2024-03-04T06:51:44.050 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16902 (ObjNum 927 snap 272 seq_num 927) dirty exists 2024-03-04T06:51:44.050 INFO:tasks.rados.rados.0.smithi137.stdout:2997: done (2 left) 2024-03-04T06:51:44.050 INFO:tasks.rados.rados.0.smithi137.stdout:3000: rollback oid 14 current snap is 279 2024-03-04T06:51:44.050 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 14 to 277 2024-03-04T06:51:44.051 INFO:tasks.rados.rados.0.smithi137.stdout:3001: read oid 28 snap -1 2024-03-04T06:51:44.051 INFO:tasks.rados.rados.0.smithi137.stdout:3001: expect deleted 2024-03-04T06:51:44.051 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 50 current snap is 279 2024-03-04T06:51:44.051 INFO:tasks.rados.rados.0.smithi137.stdout:3002: seq_num 941 ranges {2301952=565248,2867200=475136,3342336=327680} 2024-03-04T06:51:44.066 INFO:tasks.rados.rados.0.smithi137.stdout:3002: writing smithi13777483-50 from 2301952 to 2867200 tid 1 2024-03-04T06:51:44.069 INFO:tasks.rados.rados.0.smithi137.stdout:3002: writing smithi13777483-50 from 2867200 to 3342336 tid 2 2024-03-04T06:51:44.071 INFO:tasks.rados.rados.0.smithi137.stdout:3002: writing smithi13777483-50 from 3342336 to 3670016 tid 3 2024-03-04T06:51:44.072 INFO:tasks.rados.rados.0.smithi137.stdout:3003: read oid 20 snap -1 2024-03-04T06:51:44.072 INFO:tasks.rados.rados.0.smithi137.stdout:3003: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:51:44.072 INFO:tasks.rados.rados.0.smithi137.stdout:3004: read oid 23 snap -1 2024-03-04T06:51:44.072 INFO:tasks.rados.rados.0.smithi137.stdout:3004: expect deleted 2024-03-04T06:51:44.072 INFO:tasks.rados.rados.0.smithi137.stdout:3005: copy_from oid 29 from oid 47 current snap is 279 2024-03-04T06:51:44.072 INFO:tasks.rados.rados.0.smithi137.stdout:2998: finishing write tid 1 to smithi13777483-37 2024-03-04T06:51:44.072 INFO:tasks.rados.rados.0.smithi137.stdout:3000: finishing rollback tid 0 to smithi13777483-14 2024-03-04T06:51:44.072 INFO:tasks.rados.rados.0.smithi137.stdout:3000: finishing rollback tid 1 to smithi13777483-14 2024-03-04T06:51:44.072 INFO:tasks.rados.rados.0.smithi137.stdout:3000: finishing rollback tid 2 to smithi13777483-14 2024-03-04T06:51:44.072 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 16903 (ObjNum 925 snap 272 seq_num 925) dirty exists 2024-03-04T06:51:44.072 INFO:tasks.rados.rados.0.smithi137.stdout:2998: finishing write tid 2 to smithi13777483-37 2024-03-04T06:51:44.072 INFO:tasks.rados.rados.0.smithi137.stdout:2998: finishing write tid 3 to smithi13777483-37 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:2998: finishing write tid 4 to smithi13777483-37 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:2998: finishing write tid 5 to smithi13777483-37 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:2998: oid 37 updating version 0 to 16896 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:2998: oid 37 version 16896 is already newer than 16895 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:2998: oid 37 version 16896 is already newer than 16894 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:2998: oid 37 updating version 16896 to 16897 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16897 (ObjNum 940 snap 279 seq_num 940) dirty exists 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:2998: left oid 37 (ObjNum 940 snap 279 seq_num 940) 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:2999: finishing copy_from racing read to smithi13777483-2 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:2999: finishing copy_from to smithi13777483-2 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16877 (ObjNum 929 snap 274 seq_num 929) dirty exists 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:2998: done (7 left) 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:2999: done (6 left) 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:3000: done (5 left) 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:3001: done (4 left) 2024-03-04T06:51:44.073 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 279 2024-03-04T06:51:44.074 INFO:tasks.rados.rados.0.smithi137.stdout:3006: seq_num 942 ranges {1277952=581632,1859584=761856,2621440=40960} 2024-03-04T06:51:44.081 INFO:tasks.rados.rados.0.smithi137.stdout:3006: writing smithi13777483-17 from 1277952 to 1859584 tid 1 2024-03-04T06:51:44.085 INFO:tasks.rados.rados.0.smithi137.stdout:3006: writing smithi13777483-17 from 1859584 to 2621440 tid 2 2024-03-04T06:51:44.086 INFO:tasks.rados.rados.0.smithi137.stdout:3006: writing smithi13777483-17 from 2621440 to 2662400 tid 3 2024-03-04T06:51:44.087 INFO:tasks.rados.rados.0.smithi137.stdout:3007: delete oid 13 current snap is 279 2024-03-04T06:51:44.087 INFO:tasks.rados.rados.0.smithi137.stdout:3002: finishing write tid 1 to smithi13777483-50 2024-03-04T06:51:44.087 INFO:tasks.rados.rados.0.smithi137.stdout:3002: finishing write tid 2 to smithi13777483-50 2024-03-04T06:51:44.087 INFO:tasks.rados.rados.0.smithi137.stdout:3002: finishing write tid 3 to smithi13777483-50 2024-03-04T06:51:44.087 INFO:tasks.rados.rados.0.smithi137.stdout:3002: finishing write tid 4 to smithi13777483-50 2024-03-04T06:51:44.087 INFO:tasks.rados.rados.0.smithi137.stdout:3002: finishing write tid 5 to smithi13777483-50 2024-03-04T06:51:44.087 INFO:tasks.rados.rados.0.smithi137.stdout:3002: oid 50 updating version 0 to 16914 2024-03-04T06:51:44.087 INFO:tasks.rados.rados.0.smithi137.stdout:3002: oid 50 version 16914 is already newer than 16912 2024-03-04T06:51:44.087 INFO:tasks.rados.rados.0.smithi137.stdout:3002: oid 50 version 16914 is already newer than 16911 2024-03-04T06:51:44.087 INFO:tasks.rados.rados.0.smithi137.stdout:3002: oid 50 version 16914 is already newer than 16913 2024-03-04T06:51:44.087 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 16914 (ObjNum 941 snap 279 seq_num 941) dirty exists 2024-03-04T06:51:44.087 INFO:tasks.rados.rados.0.smithi137.stdout:3002: left oid 50 (ObjNum 941 snap 279 seq_num 941) 2024-03-04T06:51:44.087 INFO:tasks.rados.rados.0.smithi137.stdout:3003: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:51:44.150 INFO:tasks.rados.rados.0.smithi137.stdout:3002: done (5 left) 2024-03-04T06:51:44.150 INFO:tasks.rados.rados.0.smithi137.stdout:3003: done (4 left) 2024-03-04T06:51:44.150 INFO:tasks.rados.rados.0.smithi137.stdout:3004: done (3 left) 2024-03-04T06:51:44.150 INFO:tasks.rados.rados.0.smithi137.stdout:3007: done (2 left) 2024-03-04T06:51:44.150 INFO:tasks.rados.rados.0.smithi137.stdout:3008: copy_from oid 26 from oid 34 current snap is 279 2024-03-04T06:51:44.150 INFO:tasks.rados.rados.0.smithi137.stdout:3006: finishing write tid 1 to smithi13777483-17 2024-03-04T06:51:44.150 INFO:tasks.rados.rados.0.smithi137.stdout:3006: finishing write tid 2 to smithi13777483-17 2024-03-04T06:51:44.150 INFO:tasks.rados.rados.0.smithi137.stdout:3006: finishing write tid 3 to smithi13777483-17 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:3006: finishing write tid 4 to smithi13777483-17 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:3006: finishing write tid 5 to smithi13777483-17 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:3006: oid 17 updating version 0 to 16876 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:3006: oid 17 updating version 16876 to 16877 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:3006: oid 17 version 16877 is already newer than 16875 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:3006: oid 17 version 16877 is already newer than 16874 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16877 (ObjNum 942 snap 279 seq_num 942) dirty exists 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:3006: left oid 17 (ObjNum 942 snap 279 seq_num 942) 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:3005: finishing copy_from racing read to smithi13777483-29 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:3005: finishing copy_from to smithi13777483-29 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16883 (ObjNum 932 snap 275 seq_num 932) dirty exists 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:3005: done (2 left) 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:3006: done (1 left) 2024-03-04T06:51:44.151 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 279 2024-03-04T06:51:44.152 INFO:tasks.rados.rados.0.smithi137.stdout:3009: seq_num 944 ranges {598016=614400,1212416=573440,1785856=229376} 2024-03-04T06:51:44.156 INFO:tasks.rados.rados.0.smithi137.stdout:3009: writing smithi13777483-15 from 598016 to 1212416 tid 1 2024-03-04T06:51:44.159 INFO:tasks.rados.rados.0.smithi137.stdout:3009: writing smithi13777483-15 from 1212416 to 1785856 tid 2 2024-03-04T06:51:44.161 INFO:tasks.rados.rados.0.smithi137.stdout:3009: writing smithi13777483-15 from 1785856 to 2015232 tid 3 2024-03-04T06:51:44.161 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 24 current snap is 279 2024-03-04T06:51:44.161 INFO:tasks.rados.rados.0.smithi137.stdout:3008: finishing copy_from racing read to smithi13777483-26 2024-03-04T06:51:44.161 INFO:tasks.rados.rados.0.smithi137.stdout:3008: finishing copy_from to smithi13777483-26 2024-03-04T06:51:44.161 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16871 (ObjNum 886 snap 259 seq_num 886) dirty exists 2024-03-04T06:51:44.161 INFO:tasks.rados.rados.0.smithi137.stdout:3009: finishing write tid 1 to smithi13777483-15 2024-03-04T06:51:44.161 INFO:tasks.rados.rados.0.smithi137.stdout:3010: seq_num 945 ranges {0=630784,630784=458752,1089536=344064} 2024-03-04T06:51:44.164 INFO:tasks.rados.rados.0.smithi137.stdout:3010: writing smithi13777483-24 from 0 to 630784 tid 1 2024-03-04T06:51:44.166 INFO:tasks.rados.rados.0.smithi137.stdout:3010: writing smithi13777483-24 from 630784 to 1089536 tid 2 2024-03-04T06:51:44.169 INFO:tasks.rados.rados.0.smithi137.stdout:3010: writing smithi13777483-24 from 1089536 to 1433600 tid 3 2024-03-04T06:51:44.169 INFO:tasks.rados.rados.0.smithi137.stdout:3008: done (2 left) 2024-03-04T06:51:44.169 INFO:tasks.rados.rados.0.smithi137.stdout:3011: copy_from oid 38 from oid 8 current snap is 279 2024-03-04T06:51:44.169 INFO:tasks.rados.rados.0.smithi137.stdout:3009: finishing write tid 2 to smithi13777483-15 2024-03-04T06:51:44.169 INFO:tasks.rados.rados.0.smithi137.stdout:3009: finishing write tid 3 to smithi13777483-15 2024-03-04T06:51:44.169 INFO:tasks.rados.rados.0.smithi137.stdout:3009: finishing write tid 4 to smithi13777483-15 2024-03-04T06:51:44.169 INFO:tasks.rados.rados.0.smithi137.stdout:3009: finishing write tid 5 to smithi13777483-15 2024-03-04T06:51:44.169 INFO:tasks.rados.rados.0.smithi137.stdout:3009: oid 15 updating version 0 to 16901 2024-03-04T06:51:44.169 INFO:tasks.rados.rados.0.smithi137.stdout:3009: oid 15 version 16901 is already newer than 16899 2024-03-04T06:51:44.169 INFO:tasks.rados.rados.0.smithi137.stdout:3009: oid 15 version 16901 is already newer than 16898 2024-03-04T06:51:44.169 INFO:tasks.rados.rados.0.smithi137.stdout:3009: oid 15 version 16901 is already newer than 16900 2024-03-04T06:51:44.170 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16901 (ObjNum 944 snap 279 seq_num 944) dirty exists 2024-03-04T06:51:44.170 INFO:tasks.rados.rados.0.smithi137.stdout:3009: left oid 15 (ObjNum 944 snap 279 seq_num 944) 2024-03-04T06:51:44.170 INFO:tasks.rados.rados.0.smithi137.stdout:3009: done (2 left) 2024-03-04T06:51:44.170 INFO:tasks.rados.rados.0.smithi137.stdout:3012: snap_create 2024-03-04T06:51:44.175 INFO:tasks.rados.rados.0.smithi137.stdout:3010: finishing write tid 1 to smithi13777483-24 2024-03-04T06:51:44.175 INFO:tasks.rados.rados.0.smithi137.stdout:3010: finishing write tid 2 to smithi13777483-24 2024-03-04T06:51:44.176 INFO:tasks.rados.rados.0.smithi137.stdout:3010: finishing write tid 3 to smithi13777483-24 2024-03-04T06:51:44.179 INFO:tasks.rados.rados.0.smithi137.stdout:3011: finishing copy_from racing read to smithi13777483-38 2024-03-04T06:51:44.180 INFO:tasks.rados.rados.0.smithi137.stdout:3011: finishing copy_from to smithi13777483-38 2024-03-04T06:51:44.180 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16893 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:51:44.182 INFO:tasks.rados.rados.0.smithi137.stdout:3010: finishing write tid 4 to smithi13777483-24 2024-03-04T06:51:44.185 INFO:tasks.rados.rados.0.smithi137.stdout:3010: finishing write tid 5 to smithi13777483-24 2024-03-04T06:51:44.185 INFO:tasks.rados.rados.0.smithi137.stdout:3010: oid 24 updating version 0 to 16878 2024-03-04T06:51:44.185 INFO:tasks.rados.rados.0.smithi137.stdout:3010: oid 24 updating version 16878 to 16879 2024-03-04T06:51:44.185 INFO:tasks.rados.rados.0.smithi137.stdout:3010: oid 24 updating version 16879 to 16881 2024-03-04T06:51:44.185 INFO:tasks.rados.rados.0.smithi137.stdout:3010: oid 24 version 16881 is already newer than 16880 2024-03-04T06:51:44.185 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16881 (ObjNum 945 snap 279 seq_num 945) dirty exists 2024-03-04T06:51:44.185 INFO:tasks.rados.rados.0.smithi137.stdout:3010: left oid 24 (ObjNum 945 snap 279 seq_num 945) 2024-03-04T06:51:44.292 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:44.041+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:44.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:44.062+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:44.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:44.034+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:44.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:44.034+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:44.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[88869]: osdmap e627: 8 total, 8 up, 8 in 2024-03-04T06:51:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:44.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:44.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:44.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:44.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:44.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:44.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[91314]: osdmap e627: 8 total, 8 up, 8 in 2024-03-04T06:51:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:44.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:44.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:44.031+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:44.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:44.032+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:44.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:44.055+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:44.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:44.039+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:44.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:44.039+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:44.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:44.042+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:44.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:44.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:44.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-mon[85573]: osdmap e627: 8 total, 8 up, 8 in 2024-03-04T06:51:44.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:44.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:44.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:44.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:44.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:44.042+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:44.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:44.042+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:45.055 INFO:tasks.rados.rados.0.smithi137.stdout:3010: done (2 left) 2024-03-04T06:51:45.055 INFO:tasks.rados.rados.0.smithi137.stdout:3011: done (1 left) 2024-03-04T06:51:45.055 INFO:tasks.rados.rados.0.smithi137.stdout:3012: done (0 left) 2024-03-04T06:51:45.055 INFO:tasks.rados.rados.0.smithi137.stdout:3013: read oid 38 snap 278 2024-03-04T06:51:45.055 INFO:tasks.rados.rados.0.smithi137.stdout:3013: expect (ObjNum 920 snap 271 seq_num 920) 2024-03-04T06:51:45.055 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 280 2024-03-04T06:51:45.055 INFO:tasks.rados.rados.0.smithi137.stdout:3014: seq_num 946 ranges {6037504=647168,6684672=745472,7430144=57344} 2024-03-04T06:51:45.092 INFO:tasks.rados.rados.0.smithi137.stdout:3014: writing smithi13777483-3 from 6037504 to 6684672 tid 1 2024-03-04T06:51:45.096 INFO:tasks.rados.rados.0.smithi137.stdout:3014: writing smithi13777483-3 from 6684672 to 7430144 tid 2 2024-03-04T06:51:45.097 INFO:tasks.rados.rados.0.smithi137.stdout:3014: writing smithi13777483-3 from 7430144 to 7487488 tid 3 2024-03-04T06:51:45.097 INFO:tasks.rados.rados.0.smithi137.stdout:3015: delete oid 24 current snap is 280 2024-03-04T06:51:45.097 INFO:tasks.rados.rados.0.smithi137.stdout:3013: expect (ObjNum 920 snap 271 seq_num 920) 2024-03-04T06:51:45.305 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:45.051+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:45.305 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:45.062+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:45.305 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:45.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:45.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:45.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:45.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:45.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: osdmap e628: 8 total, 8 up, 8 in 2024-03-04T06:51:45.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:45.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:45.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:45.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:45.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:45.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:45.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:45.306 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[91314]: pgmap v622: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 483 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 9.8 MiB/s rd, 5.4 MiB/s wr, 10 op/s 2024-03-04T06:51:45.307 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:45.096+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:45.307 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:45.096+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:45.307 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:45.098+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: osdmap e628: 8 total, 8 up, 8 in 2024-03-04T06:51:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:45.307 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:45.308 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:45.308 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:45.308 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:45.308 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:45.308 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:45.308 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-mon[88869]: pgmap v622: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 483 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 9.8 MiB/s rd, 5.4 MiB/s wr, 10 op/s 2024-03-04T06:51:45.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:45.267+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:45.448 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:45.268+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:45.449 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:45.049+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:45.449 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:45.049+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:45.449 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:45.049+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:45.450 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:45.450 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:45.450 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14d=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:45.450 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:45.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:45.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: osdmap e628: 8 total, 8 up, 8 in 2024-03-04T06:51:45.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:45.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:45.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:45.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:45.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:45.452 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:45.452 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:45.452 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-mon[85573]: pgmap v622: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 483 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 9.8 MiB/s rd, 5.4 MiB/s wr, 10 op/s 2024-03-04T06:51:45.452 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:45.098+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:45.453 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:45.104+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:45.693 INFO:tasks.rados.rados.0.smithi137.stdout:3014: finishing write tid 1 to smithi13777483-3 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:3014: finishing write tid 2 to smithi13777483-3 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:3014: finishing write tid 3 to smithi13777483-3 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:3014: finishing write tid 4 to smithi13777483-3 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:3014: finishing write tid 5 to smithi13777483-3 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:3014: oid 3 updating version 0 to 16877 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:3014: oid 3 version 16877 is already newer than 16876 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:3014: oid 3 version 16877 is already newer than 16875 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:3014: oid 3 version 16877 is already newer than 16874 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 16877 (ObjNum 946 snap 280 seq_num 946) dirty exists 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:3014: left oid 3 (ObjNum 946 snap 280 seq_num 946) 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:3013: done (2 left) 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:3014: done (1 left) 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:3015: done (0 left) 2024-03-04T06:51:45.694 INFO:tasks.rados.rados.0.smithi137.stdout:3016: delete oid 28 current snap is 280 2024-03-04T06:51:45.695 INFO:tasks.rados.rados.0.smithi137.stdout:3016: done (0 left) 2024-03-04T06:51:45.695 INFO:tasks.rados.rados.0.smithi137.stdout:3017: copy_from oid 7 from oid 33 current snap is 280 2024-03-04T06:51:45.695 INFO:tasks.rados.rados.0.smithi137.stdout:3018: setattr oid 8 current snap is 280 2024-03-04T06:51:45.696 INFO:tasks.rados.rados.0.smithi137.stdout:3017: finishing copy_from to smithi13777483-7 2024-03-04T06:51:45.696 INFO:tasks.rados.rados.0.smithi137.stdout:3017: got expected ENOENT (src dne) 2024-03-04T06:51:45.696 INFO:tasks.rados.rados.0.smithi137.stdout:3017: finishing copy_from racing read to smithi13777483-7 2024-03-04T06:51:45.697 INFO:tasks.rados.rados.0.smithi137.stdout:3017: done (1 left) 2024-03-04T06:51:45.697 INFO:tasks.rados.rados.0.smithi137.stdout:3019: delete oid 16 current snap is 280 2024-03-04T06:51:45.700 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16904 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:51:45.703 INFO:tasks.rados.rados.0.smithi137.stdout:3018: done (1 left) 2024-03-04T06:51:45.703 INFO:tasks.rados.rados.0.smithi137.stdout:3019: done (0 left) 2024-03-04T06:51:45.703 INFO:tasks.rados.rados.0.smithi137.stdout:3020: snap_create 2024-03-04T06:51:45.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:51:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:51:45] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:51:46.052 INFO:tasks.rados.rados.0.smithi137.stdout:3020: done (0 left) 2024-03-04T06:51:46.052 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 281 2024-03-04T06:51:46.052 INFO:tasks.rados.rados.0.smithi137.stdout:3021: seq_num 950 ranges {2260992=720896,2981888=679936,3661824=122880} 2024-03-04T06:51:46.068 INFO:tasks.rados.rados.0.smithi137.stdout:3021: writing smithi13777483-45 from 2260992 to 2981888 tid 1 2024-03-04T06:51:46.072 INFO:tasks.rados.rados.0.smithi137.stdout:3021: writing smithi13777483-45 from 2981888 to 3661824 tid 2 2024-03-04T06:51:46.073 INFO:tasks.rados.rados.0.smithi137.stdout:3021: writing smithi13777483-45 from 3661824 to 3784704 tid 3 2024-03-04T06:51:46.073 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 281 2024-03-04T06:51:46.073 INFO:tasks.rados.rados.0.smithi137.stdout:3022: seq_num 951 ranges {1277952=737280,2015232=614400,2629632=188416} 2024-03-04T06:51:46.083 INFO:tasks.rados.rados.0.smithi137.stdout:3022: writing smithi13777483-1 from 1277952 to 2015232 tid 1 2024-03-04T06:51:46.087 INFO:tasks.rados.rados.0.smithi137.stdout:3022: writing smithi13777483-1 from 2015232 to 2629632 tid 2 2024-03-04T06:51:46.089 INFO:tasks.rados.rados.0.smithi137.stdout:3022: writing smithi13777483-1 from 2629632 to 2818048 tid 3 2024-03-04T06:51:46.089 INFO:tasks.rados.rados.0.smithi137.stdout:3023: snap_remove snap 274 2024-03-04T06:51:46.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:46.051+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:46.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:46.051+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:46.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:46.076+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:46.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:46.140+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:46.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:46.140+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:46.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:46.072+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:46.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:46.074+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:46.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:46.074+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:46.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:46.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:46.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:46.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:46.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-mon[85573]: osdmap e629: 8 total, 8 up, 8 in 2024-03-04T06:51:46.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:46.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:46.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:46.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:46.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:46.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:46.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:46.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:46.050+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:46.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:46.138+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:46.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:46.140+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[88869]: osdmap e629: 8 total, 8 up, 8 in 2024-03-04T06:51:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:46.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:46.139+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[91314]: osdmap e629: 8 total, 8 up, 8 in 2024-03-04T06:51:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:46.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:46.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:46.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:47.067 INFO:tasks.rados.rados.0.smithi137.stdout:3023: done (2 left) 2024-03-04T06:51:47.068 INFO:tasks.rados.rados.0.smithi137.stdout:3024: read oid 9 snap 272 2024-03-04T06:51:47.068 INFO:tasks.rados.rados.0.smithi137.stdout:3024: expect (ObjNum 900 snap 262 seq_num 900) 2024-03-04T06:51:47.068 INFO:tasks.rados.rados.0.smithi137.stdout:3025: read oid 10 snap 276 2024-03-04T06:51:47.068 INFO:tasks.rados.rados.0.smithi137.stdout:3025: expect (ObjNum -1162665776 snap 21906 seq_num 3131831040) 2024-03-04T06:51:47.068 INFO:tasks.rados.rados.0.smithi137.stdout:3026: delete oid 37 current snap is 281 2024-03-04T06:51:47.068 INFO:tasks.rados.rados.0.smithi137.stdout:3021: finishing write tid 1 to smithi13777483-45 2024-03-04T06:51:47.068 INFO:tasks.rados.rados.0.smithi137.stdout:3021: finishing write tid 2 to smithi13777483-45 2024-03-04T06:51:47.068 INFO:tasks.rados.rados.0.smithi137.stdout:3021: finishing write tid 3 to smithi13777483-45 2024-03-04T06:51:47.068 INFO:tasks.rados.rados.0.smithi137.stdout:3021: finishing write tid 4 to smithi13777483-45 2024-03-04T06:51:47.068 INFO:tasks.rados.rados.0.smithi137.stdout:3021: finishing write tid 5 to smithi13777483-45 2024-03-04T06:51:47.068 INFO:tasks.rados.rados.0.smithi137.stdout:3021: oid 45 updating version 0 to 16872 2024-03-04T06:51:47.068 INFO:tasks.rados.rados.0.smithi137.stdout:3021: oid 45 updating version 16872 to 16873 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:3021: oid 45 version 16873 is already newer than 16870 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:3021: oid 45 version 16873 is already newer than 16871 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16873 (ObjNum 950 snap 281 seq_num 950) dirty exists 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:3021: left oid 45 (ObjNum 950 snap 281 seq_num 950) 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:3022: finishing write tid 1 to smithi13777483-1 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:3022: finishing write tid 2 to smithi13777483-1 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:3022: finishing write tid 3 to smithi13777483-1 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:3022: finishing write tid 4 to smithi13777483-1 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:3022: finishing write tid 5 to smithi13777483-1 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:3022: oid 1 updating version 0 to 16879 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:3022: oid 1 version 16879 is already newer than 16878 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:3022: oid 1 updating version 16879 to 16881 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:3022: oid 1 version 16881 is already newer than 16880 2024-03-04T06:51:47.069 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 16881 (ObjNum 951 snap 281 seq_num 951) dirty exists 2024-03-04T06:51:47.070 INFO:tasks.rados.rados.0.smithi137.stdout:3022: left oid 1 (ObjNum 951 snap 281 seq_num 951) 2024-03-04T06:51:47.073 INFO:tasks.rados.rados.0.smithi137.stdout:3021: done (4 left) 2024-03-04T06:51:47.073 INFO:tasks.rados.rados.0.smithi137.stdout:3022: done (3 left) 2024-03-04T06:51:47.073 INFO:tasks.rados.rados.0.smithi137.stdout:3026: done (2 left) 2024-03-04T06:51:47.073 INFO:tasks.rados.rados.0.smithi137.stdout:3027: rmattr oid 40 current snap is 281 2024-03-04T06:51:47.073 INFO:tasks.rados.rados.0.smithi137.stdout:3028: read oid 47 snap 279 2024-03-04T06:51:47.073 INFO:tasks.rados.rados.0.smithi137.stdout:3028: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:51:47.073 INFO:tasks.rados.rados.0.smithi137.stdout:3029: read oid 18 snap -1 2024-03-04T06:51:47.073 INFO:tasks.rados.rados.0.smithi137.stdout:3029: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:51:47.074 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 281 2024-03-04T06:51:47.074 INFO:tasks.rados.rados.0.smithi137.stdout:3030: seq_num 953 ranges {4292608=770048,5062656=786432,5849088=16384} 2024-03-04T06:51:47.103 INFO:tasks.rados.rados.0.smithi137.stdout:3030: writing smithi13777483-7 from 4292608 to 5062656 tid 1 2024-03-04T06:51:47.109 INFO:tasks.rados.rados.0.smithi137.stdout:3030: writing smithi13777483-7 from 5062656 to 5849088 tid 2 2024-03-04T06:51:47.109 INFO:tasks.rados.rados.0.smithi137.stdout:3030: writing smithi13777483-7 from 5849088 to 5865472 tid 3 2024-03-04T06:51:47.109 INFO:tasks.rados.rados.0.smithi137.stdout:3031: copy_from oid 30 from oid 20 current snap is 281 2024-03-04T06:51:47.109 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 16903 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:51:47.109 INFO:tasks.rados.rados.0.smithi137.stdout:3027: done (6 left) 2024-03-04T06:51:47.109 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 281 2024-03-04T06:51:47.110 INFO:tasks.rados.rados.0.smithi137.stdout:3032: seq_num 954 ranges {2301952=786432,3088384=671744,3760128=131072} 2024-03-04T06:51:47.127 INFO:tasks.rados.rados.0.smithi137.stdout:3032: writing smithi13777483-8 from 2301952 to 3088384 tid 1 2024-03-04T06:51:47.131 INFO:tasks.rados.rados.0.smithi137.stdout:3032: writing smithi13777483-8 from 3088384 to 3760128 tid 2 2024-03-04T06:51:47.132 INFO:tasks.rados.rados.0.smithi137.stdout:3032: writing smithi13777483-8 from 3760128 to 3891200 tid 3 2024-03-04T06:51:47.132 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 48 current snap is 281 2024-03-04T06:51:47.132 INFO:tasks.rados.rados.0.smithi137.stdout:3033: seq_num 955 ranges {1146880=802816,1949696=557056,2506752=245760} 2024-03-04T06:51:47.143 INFO:tasks.rados.rados.0.smithi137.stdout:3033: writing smithi13777483-48 from 1146880 to 1949696 tid 1 2024-03-04T06:51:47.147 INFO:tasks.rados.rados.0.smithi137.stdout:3033: writing smithi13777483-48 from 1949696 to 2506752 tid 2 2024-03-04T06:51:47.148 INFO:tasks.rados.rados.0.smithi137.stdout:3033: writing smithi13777483-48 from 2506752 to 2752512 tid 3 2024-03-04T06:51:47.148 INFO:tasks.rados.rados.0.smithi137.stdout:3034: rollback oid 42 current snap is 281 2024-03-04T06:51:47.148 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 42 to 276 2024-03-04T06:51:47.149 INFO:tasks.rados.rados.0.smithi137.stdout:3031: finishing copy_from racing read to smithi13777483-30 2024-03-04T06:51:47.149 INFO:tasks.rados.rados.0.smithi137.stdout:3030: finishing write tid 1 to smithi13777483-7 2024-03-04T06:51:47.149 INFO:tasks.rados.rados.0.smithi137.stdout:3030: finishing write tid 2 to smithi13777483-7 2024-03-04T06:51:47.149 INFO:tasks.rados.rados.0.smithi137.stdout:3030: finishing write tid 3 to smithi13777483-7 2024-03-04T06:51:47.149 INFO:tasks.rados.rados.0.smithi137.stdout:3024: expect (ObjNum 900 snap 262 seq_num 900) 2024-03-04T06:51:47.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:47.069+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:47.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:47.063+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:47.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:47.063+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:47.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:47.063+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:47.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:47.129+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:47.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:47.068+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:47.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:47.069+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:47.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:47.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:47.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-mon[85573]: osdmap e630: 8 total, 8 up, 8 in 2024-03-04T06:51:47.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:47.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:47.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:47.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:47.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:47.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:47.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:47.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:47.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:47 smithi203 ceph-mon[85573]: pgmap v625: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 483 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 9.8 MiB/s rd, 5.4 MiB/s wr, 13 op/s 2024-03-04T06:51:47.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:47.087+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:47.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:47.067+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:47.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:47.063+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:47.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:47.064+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:47.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:47.064+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[91314]: osdmap e630: 8 total, 8 up, 8 in 2024-03-04T06:51:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:47.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[91314]: pgmap v625: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 483 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 9.8 MiB/s rd, 5.4 MiB/s wr, 13 op/s 2024-03-04T06:51:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[88869]: osdmap e630: 8 total, 8 up, 8 in 2024-03-04T06:51:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:47.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:47.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:47.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:47.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:47.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:47.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:47.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:47 smithi137 ceph-mon[88869]: pgmap v625: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 483 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 9.8 MiB/s rd, 5.4 MiB/s wr, 13 op/s 2024-03-04T06:51:47.808 INFO:tasks.rados.rados.0.smithi137.stdout:3030: finishing write tid 4 to smithi13777483-7 2024-03-04T06:51:47.809 INFO:tasks.rados.rados.0.smithi137.stdout:3025: expect (ObjNum -1162665776 snap 21906 seq_num 3131831040) 2024-03-04T06:51:47.809 INFO:tasks.rados.rados.0.smithi137.stdout:3030: finishing write tid 5 to smithi13777483-7 2024-03-04T06:51:47.809 INFO:tasks.rados.rados.0.smithi137.stdout:3030: oid 7 updating version 0 to 16907 2024-03-04T06:51:47.809 INFO:tasks.rados.rados.0.smithi137.stdout:3030: oid 7 version 16907 is already newer than 16905 2024-03-04T06:51:47.809 INFO:tasks.rados.rados.0.smithi137.stdout:3030: oid 7 updating version 16907 to 16908 2024-03-04T06:51:47.810 INFO:tasks.rados.rados.0.smithi137.stdout:3030: oid 7 version 16908 is already newer than 16906 2024-03-04T06:51:47.810 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16908 (ObjNum 953 snap 281 seq_num 953) dirty exists 2024-03-04T06:51:47.810 INFO:tasks.rados.rados.0.smithi137.stdout:3030: left oid 7 (ObjNum 953 snap 281 seq_num 953) 2024-03-04T06:51:47.810 INFO:tasks.rados.rados.0.smithi137.stdout:3031: finishing copy_from to smithi13777483-30 2024-03-04T06:51:47.810 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16893 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:51:47.810 INFO:tasks.rados.rados.0.smithi137.stdout:3028: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:51:48.106 INFO:tasks.rados.rados.0.smithi137.stdout:3029: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:51:48.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:48 smithi203 ceph-mon[85573]: osdmap e631: 8 total, 8 up, 8 in 2024-03-04T06:51:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:48.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[88869]: osdmap e631: 8 total, 8 up, 8 in 2024-03-04T06:51:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:48.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:48.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[91314]: osdmap e631: 8 total, 8 up, 8 in 2024-03-04T06:51:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:48.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 14b=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:48.927 INFO:tasks.rados.rados.0.smithi137.stdout:3032: finishing write tid 1 to smithi13777483-8 2024-03-04T06:51:48.927 INFO:tasks.rados.rados.0.smithi137.stdout:3032: finishing write tid 2 to smithi13777483-8 2024-03-04T06:51:48.927 INFO:tasks.rados.rados.0.smithi137.stdout:3032: finishing write tid 3 to smithi13777483-8 2024-03-04T06:51:48.927 INFO:tasks.rados.rados.0.smithi137.stdout:3032: finishing write tid 4 to smithi13777483-8 2024-03-04T06:51:48.928 INFO:tasks.rados.rados.0.smithi137.stdout:3032: finishing write tid 5 to smithi13777483-8 2024-03-04T06:51:48.928 INFO:tasks.rados.rados.0.smithi137.stdout:3032: oid 8 updating version 0 to 16912 2024-03-04T06:51:48.928 INFO:tasks.rados.rados.0.smithi137.stdout:3032: oid 8 version 16912 is already newer than 16911 2024-03-04T06:51:48.928 INFO:tasks.rados.rados.0.smithi137.stdout:3032: oid 8 version 16912 is already newer than 16910 2024-03-04T06:51:48.928 INFO:tasks.rados.rados.0.smithi137.stdout:3032: oid 8 version 16912 is already newer than 16909 2024-03-04T06:51:48.929 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16912 (ObjNum 954 snap 281 seq_num 954) dirty exists 2024-03-04T06:51:48.929 INFO:tasks.rados.rados.0.smithi137.stdout:3032: left oid 8 (ObjNum 954 snap 281 seq_num 954) 2024-03-04T06:51:48.929 INFO:tasks.rados.rados.0.smithi137.stdout:3033: finishing write tid 1 to smithi13777483-48 2024-03-04T06:51:48.929 INFO:tasks.rados.rados.0.smithi137.stdout:3024: done (8 left) 2024-03-04T06:51:48.929 INFO:tasks.rados.rados.0.smithi137.stdout:3025: done (7 left) 2024-03-04T06:51:48.930 INFO:tasks.rados.rados.0.smithi137.stdout:3028: done (6 left) 2024-03-04T06:51:48.930 INFO:tasks.rados.rados.0.smithi137.stdout:3029: done (5 left) 2024-03-04T06:51:48.930 INFO:tasks.rados.rados.0.smithi137.stdout:3030: done (4 left) 2024-03-04T06:51:48.930 INFO:tasks.rados.rados.0.smithi137.stdout:3031: done (3 left) 2024-03-04T06:51:48.930 INFO:tasks.rados.rados.0.smithi137.stdout:3032: done (2 left) 2024-03-04T06:51:48.931 INFO:tasks.rados.rados.0.smithi137.stdout:3035: rmattr oid 47 current snap is 281 2024-03-04T06:51:48.931 INFO:tasks.rados.rados.0.smithi137.stdout:3035: done (2 left) 2024-03-04T06:51:48.931 INFO:tasks.rados.rados.0.smithi137.stdout:3036: setattr oid 30 current snap is 281 2024-03-04T06:51:48.931 INFO:tasks.rados.rados.0.smithi137.stdout:3033: finishing write tid 2 to smithi13777483-48 2024-03-04T06:51:48.931 INFO:tasks.rados.rados.0.smithi137.stdout:3033: finishing write tid 3 to smithi13777483-48 2024-03-04T06:51:48.932 INFO:tasks.rados.rados.0.smithi137.stdout:3033: finishing write tid 4 to smithi13777483-48 2024-03-04T06:51:48.932 INFO:tasks.rados.rados.0.smithi137.stdout:3033: finishing write tid 5 to smithi13777483-48 2024-03-04T06:51:48.932 INFO:tasks.rados.rados.0.smithi137.stdout:3033: oid 48 updating version 0 to 16883 2024-03-04T06:51:48.932 INFO:tasks.rados.rados.0.smithi137.stdout:3033: oid 48 version 16883 is already newer than 16882 2024-03-04T06:51:48.932 INFO:tasks.rados.rados.0.smithi137.stdout:3033: oid 48 updating version 16883 to 16884 2024-03-04T06:51:48.933 INFO:tasks.rados.rados.0.smithi137.stdout:3033: oid 48 updating version 16884 to 16885 2024-03-04T06:51:48.933 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 16885 (ObjNum 955 snap 281 seq_num 955) dirty exists 2024-03-04T06:51:48.933 INFO:tasks.rados.rados.0.smithi137.stdout:3033: left oid 48 (ObjNum 955 snap 281 seq_num 955) 2024-03-04T06:51:48.933 INFO:tasks.rados.rados.0.smithi137.stdout:3034: finishing rollback tid 0 to smithi13777483-42 2024-03-04T06:51:48.934 INFO:tasks.rados.rados.0.smithi137.stdout:3034: finishing rollback tid 1 to smithi13777483-42 2024-03-04T06:51:48.934 INFO:tasks.rados.rados.0.smithi137.stdout:3034: finishing rollback tid 2 to smithi13777483-42 2024-03-04T06:51:48.934 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16918 (ObjNum 935 snap 276 seq_num 935) dirty exists 2024-03-04T06:51:48.934 INFO:tasks.rados.rados.0.smithi137.stdout:3033: done (2 left) 2024-03-04T06:51:48.934 INFO:tasks.rados.rados.0.smithi137.stdout:3034: done (1 left) 2024-03-04T06:51:48.934 INFO:tasks.rados.rados.0.smithi137.stdout:3037: snap_create 2024-03-04T06:51:48.935 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16894 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:51:49.069 INFO:tasks.rados.rados.0.smithi137.stdout:3036: done (1 left) 2024-03-04T06:51:49.069 INFO:tasks.rados.rados.0.smithi137.stdout:3037: done (0 left) 2024-03-04T06:51:49.069 INFO:tasks.rados.rados.0.smithi137.stdout:3038: delete oid 42 current snap is 282 2024-03-04T06:51:49.073 INFO:tasks.rados.rados.0.smithi137.stdout:3038: done (0 left) 2024-03-04T06:51:49.073 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 282 2024-03-04T06:51:49.073 INFO:tasks.rados.rados.0.smithi137.stdout:3039: seq_num 957 ranges {442368=434176,876544=720896,1597440=483328} 2024-03-04T06:51:49.077 INFO:tasks.rados.rados.0.smithi137.stdout:3039: writing smithi13777483-26 from 442368 to 876544 tid 1 2024-03-04T06:51:49.081 INFO:tasks.rados.rados.0.smithi137.stdout:3039: writing smithi13777483-26 from 876544 to 1597440 tid 2 2024-03-04T06:51:49.085 INFO:tasks.rados.rados.0.smithi137.stdout:3039: writing smithi13777483-26 from 1597440 to 2080768 tid 3 2024-03-04T06:51:49.085 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 282 2024-03-04T06:51:49.085 INFO:tasks.rados.rados.0.smithi137.stdout:3039: finishing write tid 1 to smithi13777483-26 2024-03-04T06:51:49.085 INFO:tasks.rados.rados.0.smithi137.stdout:3040: seq_num 958 ranges {0=450560,450560=655360,1105920=548864} 2024-03-04T06:51:49.086 INFO:tasks.rados.rados.0.smithi137.stdout:3040: writing smithi13777483-42 from 0 to 450560 tid 1 2024-03-04T06:51:49.090 INFO:tasks.rados.rados.0.smithi137.stdout:3040: writing smithi13777483-42 from 450560 to 1105920 tid 2 2024-03-04T06:51:49.094 INFO:tasks.rados.rados.0.smithi137.stdout:3040: writing smithi13777483-42 from 1105920 to 1654784 tid 3 2024-03-04T06:51:49.095 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 282 2024-03-04T06:51:49.095 INFO:tasks.rados.rados.0.smithi137.stdout:3039: finishing write tid 2 to smithi13777483-26 2024-03-04T06:51:49.095 INFO:tasks.rados.rados.0.smithi137.stdout:3039: finishing write tid 3 to smithi13777483-26 2024-03-04T06:51:49.095 INFO:tasks.rados.rados.0.smithi137.stdout:3039: finishing write tid 4 to smithi13777483-26 2024-03-04T06:51:49.095 INFO:tasks.rados.rados.0.smithi137.stdout:3039: finishing write tid 5 to smithi13777483-26 2024-03-04T06:51:49.096 INFO:tasks.rados.rados.0.smithi137.stdout:3039: oid 26 updating version 0 to 16886 2024-03-04T06:51:49.096 INFO:tasks.rados.rados.0.smithi137.stdout:3039: oid 26 version 16886 is already newer than 16885 2024-03-04T06:51:49.096 INFO:tasks.rados.rados.0.smithi137.stdout:3039: oid 26 updating version 16886 to 16887 2024-03-04T06:51:49.096 INFO:tasks.rados.rados.0.smithi137.stdout:3039: oid 26 version 16887 is already newer than 16884 2024-03-04T06:51:49.096 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16887 (ObjNum 957 snap 282 seq_num 957) dirty exists 2024-03-04T06:51:49.096 INFO:tasks.rados.rados.0.smithi137.stdout:3039: left oid 26 (ObjNum 957 snap 282 seq_num 957) 2024-03-04T06:51:49.096 INFO:tasks.rados.rados.0.smithi137.stdout:3040: finishing write tid 1 to smithi13777483-42 2024-03-04T06:51:49.097 INFO:tasks.rados.rados.0.smithi137.stdout:3040: finishing write tid 2 to smithi13777483-42 2024-03-04T06:51:49.097 INFO:tasks.rados.rados.0.smithi137.stdout:3041: seq_num 959 ranges {3481600=466944,3948544=540672,4489216=557056,5046272=106496} 2024-03-04T06:51:49.115 INFO:tasks.rados.rados.0.smithi137.stdout:3041: writing smithi13777483-22 from 3481600 to 3948544 tid 1 2024-03-04T06:51:49.118 INFO:tasks.rados.rados.0.smithi137.stdout:3041: writing smithi13777483-22 from 3948544 to 4489216 tid 2 2024-03-04T06:51:49.121 INFO:tasks.rados.rados.0.smithi137.stdout:3041: writing smithi13777483-22 from 4489216 to 5046272 tid 3 2024-03-04T06:51:49.123 INFO:tasks.rados.rados.0.smithi137.stdout:3041: writing smithi13777483-22 from 5046272 to 5152768 tid 4 2024-03-04T06:51:49.123 INFO:tasks.rados.rados.0.smithi137.stdout:3039: done (2 left) 2024-03-04T06:51:49.123 INFO:tasks.rados.rados.0.smithi137.stdout:3042: delete oid 39 current snap is 282 2024-03-04T06:51:49.123 INFO:tasks.rados.rados.0.smithi137.stdout:3040: finishing write tid 3 to smithi13777483-42 2024-03-04T06:51:49.124 INFO:tasks.rados.rados.0.smithi137.stdout:3040: finishing write tid 4 to smithi13777483-42 2024-03-04T06:51:49.124 INFO:tasks.rados.rados.0.smithi137.stdout:3040: finishing write tid 5 to smithi13777483-42 2024-03-04T06:51:49.124 INFO:tasks.rados.rados.0.smithi137.stdout:3040: oid 42 updating version 0 to 16923 2024-03-04T06:51:49.124 INFO:tasks.rados.rados.0.smithi137.stdout:3040: oid 42 version 16923 is already newer than 16922 2024-03-04T06:51:49.124 INFO:tasks.rados.rados.0.smithi137.stdout:3040: oid 42 version 16923 is already newer than 16920 2024-03-04T06:51:49.124 INFO:tasks.rados.rados.0.smithi137.stdout:3040: oid 42 version 16923 is already newer than 16921 2024-03-04T06:51:49.125 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16923 (ObjNum 958 snap 282 seq_num 958) dirty exists 2024-03-04T06:51:49.125 INFO:tasks.rados.rados.0.smithi137.stdout:3040: left oid 42 (ObjNum 958 snap 282 seq_num 958) 2024-03-04T06:51:49.125 INFO:tasks.rados.rados.0.smithi137.stdout:3041: finishing write tid 1 to smithi13777483-22 2024-03-04T06:51:49.125 INFO:tasks.rados.rados.0.smithi137.stdout:3041: finishing write tid 2 to smithi13777483-22 2024-03-04T06:51:49.127 INFO:tasks.rados.rados.0.smithi137.stdout:3041: finishing write tid 3 to smithi13777483-22 2024-03-04T06:51:49.128 INFO:tasks.rados.rados.0.smithi137.stdout:3041: finishing write tid 4 to smithi13777483-22 2024-03-04T06:51:49.128 INFO:tasks.rados.rados.0.smithi137.stdout:3041: finishing write tid 5 to smithi13777483-22 2024-03-04T06:51:49.130 INFO:tasks.rados.rados.0.smithi137.stdout:3041: finishing write tid 6 to smithi13777483-22 2024-03-04T06:51:49.130 INFO:tasks.rados.rados.0.smithi137.stdout:3041: oid 22 updating version 0 to 16904 2024-03-04T06:51:49.130 INFO:tasks.rados.rados.0.smithi137.stdout:3041: oid 22 updating version 16904 to 16907 2024-03-04T06:51:49.130 INFO:tasks.rados.rados.0.smithi137.stdout:3041: oid 22 version 16907 is already newer than 16905 2024-03-04T06:51:49.130 INFO:tasks.rados.rados.0.smithi137.stdout:3041: oid 22 updating version 16907 to 16908 2024-03-04T06:51:49.131 INFO:tasks.rados.rados.0.smithi137.stdout:3041: oid 22 version 16908 is already newer than 16906 2024-03-04T06:51:49.131 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 16908 (ObjNum 959 snap 282 seq_num 959) dirty exists 2024-03-04T06:51:49.131 INFO:tasks.rados.rados.0.smithi137.stdout:3041: left oid 22 (ObjNum 959 snap 282 seq_num 959) 2024-03-04T06:51:49.132 INFO:tasks.rados.rados.0.smithi137.stdout:3040: done (2 left) 2024-03-04T06:51:49.133 INFO:tasks.rados.rados.0.smithi137.stdout:3041: done (1 left) 2024-03-04T06:51:49.133 INFO:tasks.rados.rados.0.smithi137.stdout:3042: done (0 left) 2024-03-04T06:51:49.133 INFO:tasks.rados.rados.0.smithi137.stdout:3043: read oid 38 snap -1 2024-03-04T06:51:49.133 INFO:tasks.rados.rados.0.smithi137.stdout:3043: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:51:49.133 INFO:tasks.rados.rados.0.smithi137.stdout:3044: read oid 5 snap -1 2024-03-04T06:51:49.133 INFO:tasks.rados.rados.0.smithi137.stdout:3044: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:51:49.134 INFO:tasks.rados.rados.0.smithi137.stdout:3045: copy_from oid 33 from oid 22 current snap is 282 2024-03-04T06:51:49.134 INFO:tasks.rados.rados.0.smithi137.stdout:3046: snap_remove snap 272 2024-03-04T06:51:49.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:49 smithi203 ceph-mon[85573]: pgmap v627: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 507 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 22 MiB/s rd, 5.5 MiB/s wr, 22 op/s 2024-03-04T06:51:49.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:49.068+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:49.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:49.069+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:49.347 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:49.073+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:49.348 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:49.082+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:49.348 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:49.082+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:49.348 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:49.082+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:49.349 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:49.130+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:49.349 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:49.130+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:49.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:49 smithi137 ceph-mon[88869]: pgmap v627: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 507 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 22 MiB/s rd, 5.5 MiB/s wr, 22 op/s 2024-03-04T06:51:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:49 smithi137 ceph-mon[91314]: pgmap v627: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 507 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 22 MiB/s rd, 5.5 MiB/s wr, 22 op/s 2024-03-04T06:51:49.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:49.118+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:49.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:49.118+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:49.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:49.068+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:49.545 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:49.287+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:50.078 INFO:tasks.rados.rados.0.smithi137.stdout:3046: done (3 left) 2024-03-04T06:51:50.079 INFO:tasks.rados.rados.0.smithi137.stdout:3047: rmattr oid 12 current snap is 282 2024-03-04T06:51:50.079 INFO:tasks.rados.rados.0.smithi137.stdout:3048: setattr oid 27 current snap is 282 2024-03-04T06:51:50.079 INFO:tasks.rados.rados.0.smithi137.stdout:3049: read oid 3 snap -1 2024-03-04T06:51:50.079 INFO:tasks.rados.rados.0.smithi137.stdout:3049: expect (ObjNum 946 snap 280 seq_num 946) 2024-03-04T06:51:50.079 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 282 2024-03-04T06:51:50.079 INFO:tasks.rados.rados.0.smithi137.stdout:3050: seq_num 961 ranges {0=499712,499712=712704,1212416=491520} 2024-03-04T06:51:50.083 INFO:tasks.rados.rados.0.smithi137.stdout:3050: writing smithi13777483-32 from 0 to 499712 tid 1 2024-03-04T06:51:50.086 INFO:tasks.rados.rados.0.smithi137.stdout:3050: writing smithi13777483-32 from 499712 to 1212416 tid 2 2024-03-04T06:51:50.089 INFO:tasks.rados.rados.0.smithi137.stdout:3050: writing smithi13777483-32 from 1212416 to 1703936 tid 3 2024-03-04T06:51:50.089 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 282 2024-03-04T06:51:50.089 INFO:tasks.rados.rados.0.smithi137.stdout:3051: seq_num 962 ranges {5865472=516096,6381568=589824,6971392=614400} 2024-03-04T06:51:50.125 INFO:tasks.rados.rados.0.smithi137.stdout:3051: writing smithi13777483-7 from 5865472 to 6381568 tid 1 2024-03-04T06:51:50.128 INFO:tasks.rados.rados.0.smithi137.stdout:3051: writing smithi13777483-7 from 6381568 to 6971392 tid 2 2024-03-04T06:51:50.132 INFO:tasks.rados.rados.0.smithi137.stdout:3051: writing smithi13777483-7 from 6971392 to 7585792 tid 3 2024-03-04T06:51:50.132 INFO:tasks.rados.rados.0.smithi137.stdout:3052: read oid 9 snap 280 2024-03-04T06:51:50.132 INFO:tasks.rados.rados.0.smithi137.stdout:3052: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:51:50.132 INFO:tasks.rados.rados.0.smithi137.stdout:3053: rollback oid 29 current snap is 282 2024-03-04T06:51:50.133 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 29 to 280 2024-03-04T06:51:50.133 INFO:tasks.rados.rados.0.smithi137.stdout:3044: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:51:50.139 INFO:tasks.rados.rados.0.smithi137.stdout:3043: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:51:50.206 INFO:tasks.rados.rados.0.smithi137.stdout:3045: finishing copy_from racing read to smithi13777483-33 2024-03-04T06:51:50.206 INFO:tasks.rados.rados.0.smithi137.stdout:3045: finishing copy_from to smithi13777483-33 2024-03-04T06:51:50.206 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16908 (ObjNum 959 snap 282 seq_num 959) dirty exists 2024-03-04T06:51:50.206 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16895 (ObjNum 899 snap 262 seq_num 899) dirty exists 2024-03-04T06:51:50.206 INFO:tasks.rados.rados.0.smithi137.stdout:3043: done (9 left) 2024-03-04T06:51:50.207 INFO:tasks.rados.rados.0.smithi137.stdout:3044: done (8 left) 2024-03-04T06:51:50.207 INFO:tasks.rados.rados.0.smithi137.stdout:3045: done (7 left) 2024-03-04T06:51:50.207 INFO:tasks.rados.rados.0.smithi137.stdout:3047: done (6 left) 2024-03-04T06:51:50.207 INFO:tasks.rados.rados.0.smithi137.stdout:3054: snap_remove snap 277 2024-03-04T06:51:50.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:50.075+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:50.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:50.080+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:50.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:50.081+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:50.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:50.079+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:50.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:50.079+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:50.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:50.081+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-mon[85573]: osdmap e632: 8 total, 8 up, 8 in 2024-03-04T06:51:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:50.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:50.348 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:50.240+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:50.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:50.081+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:50.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:50.081+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:50.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:50.088+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:50.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:50.074+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:50.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:50.080+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[88869]: osdmap e632: 8 total, 8 up, 8 in 2024-03-04T06:51:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:50.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[91314]: osdmap e632: 8 total, 8 up, 8 in 2024-03-04T06:51:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:50.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:50.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:50.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:51.083 INFO:tasks.rados.rados.0.smithi137.stdout:3054: done (6 left) 2024-03-04T06:51:51.083 INFO:tasks.rados.rados.0.smithi137.stdout:3055: rmattr oid 50 current snap is 282 2024-03-04T06:51:51.083 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 282 2024-03-04T06:51:51.083 INFO:tasks.rados.rados.0.smithi137.stdout:3056: seq_num 963 ranges {7946240=532480,8478720=475136,8953856=532480,9486336=196608} 2024-03-04T06:51:51.128 INFO:tasks.rados.rados.0.smithi137.stdout:3056: writing smithi13777483-4 from 7946240 to 8478720 tid 1 2024-03-04T06:51:51.131 INFO:tasks.rados.rados.0.smithi137.stdout:3056: writing smithi13777483-4 from 8478720 to 8953856 tid 2 2024-03-04T06:51:51.134 INFO:tasks.rados.rados.0.smithi137.stdout:3056: writing smithi13777483-4 from 8953856 to 9486336 tid 3 2024-03-04T06:51:51.135 INFO:tasks.rados.rados.0.smithi137.stdout:3056: writing smithi13777483-4 from 9486336 to 9682944 tid 4 2024-03-04T06:51:51.136 INFO:tasks.rados.rados.0.smithi137.stdout:3057: snap_remove snap 278 2024-03-04T06:51:51.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:51.088+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:51.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:51.082+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:51.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:51.082+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:51.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:51.096+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:51.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:51.096+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:51.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:51.096+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:51.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:51.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:51.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-mon[85573]: osdmap e633: 8 total, 8 up, 8 in 2024-03-04T06:51:51.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:51.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:51.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:51.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:51.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:51.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:51.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:51.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:51.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-mon[85573]: pgmap v630: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 517 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 22 MiB/s rd, 7.6 MiB/s wr, 28 op/s 2024-03-04T06:51:51.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:51.089+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:51.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:51.091+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:51.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:51.081+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:51.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:51.084+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[88869]: osdmap e633: 8 total, 8 up, 8 in 2024-03-04T06:51:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:51.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:51.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:51.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:51.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:51.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:51.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:51.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:51.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[88869]: pgmap v630: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 517 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 22 MiB/s rd, 7.6 MiB/s wr, 28 op/s 2024-03-04T06:51:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[91314]: osdmap e633: 8 total, 8 up, 8 in 2024-03-04T06:51:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:51.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:51.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:51.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:51.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:51.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:51.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:51.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:51.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:51 smithi137 ceph-mon[91314]: pgmap v630: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 517 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 22 MiB/s rd, 7.6 MiB/s wr, 28 op/s 2024-03-04T06:51:51.807 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:51.516+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:51.807 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:51.516+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:52.088 INFO:tasks.rados.rados.0.smithi137.stdout:3057: done (8 left) 2024-03-04T06:51:52.088 INFO:tasks.rados.rados.0.smithi137.stdout:3058: copy_from oid 42 from oid 41 current snap is 282 2024-03-04T06:51:52.088 INFO:tasks.rados.rados.0.smithi137.stdout:3059: copy_from oid 11 from oid 47 current snap is 282 2024-03-04T06:51:52.089 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16924 (ObjNum 798 snap 231 seq_num 798) dirty exists 2024-03-04T06:51:52.089 INFO:tasks.rados.rados.0.smithi137.stdout:3050: finishing write tid 1 to smithi13777483-32 2024-03-04T06:51:52.089 INFO:tasks.rados.rados.0.smithi137.stdout:3050: finishing write tid 2 to smithi13777483-32 2024-03-04T06:51:52.089 INFO:tasks.rados.rados.0.smithi137.stdout:3050: finishing write tid 3 to smithi13777483-32 2024-03-04T06:51:52.089 INFO:tasks.rados.rados.0.smithi137.stdout:3050: finishing write tid 4 to smithi13777483-32 2024-03-04T06:51:52.089 INFO:tasks.rados.rados.0.smithi137.stdout:3050: finishing write tid 5 to smithi13777483-32 2024-03-04T06:51:52.089 INFO:tasks.rados.rados.0.smithi137.stdout:3050: oid 32 updating version 0 to 16928 2024-03-04T06:51:52.089 INFO:tasks.rados.rados.0.smithi137.stdout:3050: oid 32 version 16928 is already newer than 16926 2024-03-04T06:51:52.089 INFO:tasks.rados.rados.0.smithi137.stdout:3050: oid 32 version 16928 is already newer than 16925 2024-03-04T06:51:52.089 INFO:tasks.rados.rados.0.smithi137.stdout:3050: oid 32 version 16928 is already newer than 16927 2024-03-04T06:51:52.089 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16928 (ObjNum 961 snap 282 seq_num 961) dirty exists 2024-03-04T06:51:52.089 INFO:tasks.rados.rados.0.smithi137.stdout:3050: left oid 32 (ObjNum 961 snap 282 seq_num 961) 2024-03-04T06:51:52.089 INFO:tasks.rados.rados.0.smithi137.stdout:3049: expect (ObjNum 946 snap 280 seq_num 946) 2024-03-04T06:51:52.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:52.092+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:52.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:52.086+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:52.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:52.095+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:52.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:52.095+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-mon[85573]: osdmap e634: 8 total, 8 up, 8 in 2024-03-04T06:51:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:52.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:52.091+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:52.348 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:52.092+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:52.348 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:52.092+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:52.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[88869]: osdmap e634: 8 total, 8 up, 8 in 2024-03-04T06:51:52.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:52.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:52.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:52.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:52.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:52.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:52.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:52.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:52.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:52.532 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:52.092+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:52.532 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:52.092+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:52.532 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:52.092+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:52.532 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:52.098+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:52.533 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:52.089+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:52.533 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[91314]: osdmap e634: 8 total, 8 up, 8 in 2024-03-04T06:51:52.533 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:52.533 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:52.533 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:52.533 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:52.533 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:52.533 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:52.533 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:52.533 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:52.533 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:52.605 INFO:tasks.rados.rados.0.smithi137.stdout:3051: finishing write tid 1 to smithi13777483-7 2024-03-04T06:51:52.605 INFO:tasks.rados.rados.0.smithi137.stdout:3051: finishing write tid 2 to smithi13777483-7 2024-03-04T06:51:52.605 INFO:tasks.rados.rados.0.smithi137.stdout:3053: finishing rollback tid 0 to smithi13777483-29 2024-03-04T06:51:52.605 INFO:tasks.rados.rados.0.smithi137.stdout:3053: finishing rollback tid 1 to smithi13777483-29 2024-03-04T06:51:52.605 INFO:tasks.rados.rados.0.smithi137.stdout:3053: finishing rollback tid 2 to smithi13777483-29 2024-03-04T06:51:52.605 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16890 (ObjNum 932 snap 275 seq_num 932) dirty exists 2024-03-04T06:51:52.605 INFO:tasks.rados.rados.0.smithi137.stdout:3048: done (9 left) 2024-03-04T06:51:52.605 INFO:tasks.rados.rados.0.smithi137.stdout:3049: done (8 left) 2024-03-04T06:51:52.605 INFO:tasks.rados.rados.0.smithi137.stdout:3050: done (7 left) 2024-03-04T06:51:52.605 INFO:tasks.rados.rados.0.smithi137.stdout:3053: done (6 left) 2024-03-04T06:51:52.605 INFO:tasks.rados.rados.0.smithi137.stdout:3060: setattr oid 10 current snap is 282 2024-03-04T06:51:52.606 INFO:tasks.rados.rados.0.smithi137.stdout:3051: finishing write tid 3 to smithi13777483-7 2024-03-04T06:51:52.606 INFO:tasks.rados.rados.0.smithi137.stdout:3051: finishing write tid 4 to smithi13777483-7 2024-03-04T06:51:52.606 INFO:tasks.rados.rados.0.smithi137.stdout:3051: finishing write tid 5 to smithi13777483-7 2024-03-04T06:51:52.606 INFO:tasks.rados.rados.0.smithi137.stdout:3051: oid 7 updating version 0 to 16914 2024-03-04T06:51:52.606 INFO:tasks.rados.rados.0.smithi137.stdout:3051: oid 7 updating version 16914 to 16915 2024-03-04T06:51:52.606 INFO:tasks.rados.rados.0.smithi137.stdout:3051: oid 7 updating version 16915 to 16916 2024-03-04T06:51:52.606 INFO:tasks.rados.rados.0.smithi137.stdout:3051: oid 7 version 16916 is already newer than 16913 2024-03-04T06:51:52.606 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16916 (ObjNum 962 snap 282 seq_num 962) dirty exists 2024-03-04T06:51:52.606 INFO:tasks.rados.rados.0.smithi137.stdout:3051: left oid 7 (ObjNum 962 snap 282 seq_num 962) 2024-03-04T06:51:52.606 INFO:tasks.rados.rados.0.smithi137.stdout:3052: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:51:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:53 smithi203 ceph-mon[85573]: osdmap e635: 8 total, 8 up, 8 in 2024-03-04T06:51:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:53 smithi203 ceph-mon[85573]: pgmap v633: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 517 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 2.3 MiB/s wr, 9 op/s 2024-03-04T06:51:53.429 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 16929 (ObjNum 941 snap 279 seq_num 941) dirty exists 2024-03-04T06:51:53.429 INFO:tasks.rados.rados.0.smithi137.stdout:3056: finishing write tid 1 to smithi13777483-4 2024-03-04T06:51:53.429 INFO:tasks.rados.rados.0.smithi137.stdout:3056: finishing write tid 2 to smithi13777483-4 2024-03-04T06:51:53.429 INFO:tasks.rados.rados.0.smithi137.stdout:3056: finishing write tid 3 to smithi13777483-4 2024-03-04T06:51:53.429 INFO:tasks.rados.rados.0.smithi137.stdout:3056: finishing write tid 4 to smithi13777483-4 2024-03-04T06:51:53.429 INFO:tasks.rados.rados.0.smithi137.stdout:3056: finishing write tid 5 to smithi13777483-4 2024-03-04T06:51:53.429 INFO:tasks.rados.rados.0.smithi137.stdout:3056: finishing write tid 6 to smithi13777483-4 2024-03-04T06:51:53.429 INFO:tasks.rados.rados.0.smithi137.stdout:3056: oid 4 updating version 0 to 15518 2024-03-04T06:51:53.429 INFO:tasks.rados.rados.0.smithi137.stdout:3056: oid 4 updating version 15518 to 15521 2024-03-04T06:51:53.429 INFO:tasks.rados.rados.0.smithi137.stdout:3056: oid 4 version 15521 is already newer than 15520 2024-03-04T06:51:53.429 INFO:tasks.rados.rados.0.smithi137.stdout:3056: oid 4 version 15521 is already newer than 15519 2024-03-04T06:51:53.429 INFO:tasks.rados.rados.0.smithi137.stdout:3056: oid 4 version 15521 is already newer than 15517 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 15521 (ObjNum 963 snap 282 seq_num 963) dirty exists 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:3056: left oid 4 (ObjNum 963 snap 282 seq_num 963) 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:3058: finishing copy_from racing read to smithi13777483-42 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:3058: finishing copy_from to smithi13777483-42 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16858 (ObjNum 822 snap 236 seq_num 822) dirty exists 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:3059: finishing copy_from racing read to smithi13777483-11 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:3059: finishing copy_from to smithi13777483-11 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16883 (ObjNum 932 snap 275 seq_num 932) dirty exists 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:3051: done (6 left) 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:3052: done (5 left) 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:3055: done (4 left) 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:3056: done (3 left) 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:3058: done (2 left) 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:3059: done (1 left) 2024-03-04T06:51:53.430 INFO:tasks.rados.rados.0.smithi137.stdout:3061: delete oid 7 current snap is 282 2024-03-04T06:51:53.431 INFO:tasks.rados.rados.0.smithi137.stdout:3061: done (1 left) 2024-03-04T06:51:53.431 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 282 2024-03-04T06:51:53.431 INFO:tasks.rados.rados.0.smithi137.stdout:3062: seq_num 965 ranges {2015232=565248,2580480=647168,3227648=548864,3776512=8192} 2024-03-04T06:51:53.445 INFO:tasks.rados.rados.0.smithi137.stdout:3062: writing smithi13777483-15 from 2015232 to 2580480 tid 1 2024-03-04T06:51:53.448 INFO:tasks.rados.rados.0.smithi137.stdout:3062: writing smithi13777483-15 from 2580480 to 3227648 tid 2 2024-03-04T06:51:53.452 INFO:tasks.rados.rados.0.smithi137.stdout:3062: writing smithi13777483-15 from 3227648 to 3776512 tid 3 2024-03-04T06:51:53.452 INFO:tasks.rados.rados.0.smithi137.stdout:3062: writing smithi13777483-15 from 3776512 to 3784704 tid 4 2024-03-04T06:51:53.452 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 282 2024-03-04T06:51:53.452 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 16878 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:51:53.452 INFO:tasks.rados.rados.0.smithi137.stdout:3062: finishing write tid 1 to smithi13777483-15 2024-03-04T06:51:53.453 INFO:tasks.rados.rados.0.smithi137.stdout:3062: finishing write tid 2 to smithi13777483-15 2024-03-04T06:51:53.453 INFO:tasks.rados.rados.0.smithi137.stdout:3063: seq_num 966 ranges {5873664=581632,6455296=581632,7036928=622592} 2024-03-04T06:51:53.486 INFO:tasks.rados.rados.0.smithi137.stdout:3063: writing smithi13777483-47 from 5873664 to 6455296 tid 1 2024-03-04T06:51:53.490 INFO:tasks.rados.rados.0.smithi137.stdout:3063: writing smithi13777483-47 from 6455296 to 7036928 tid 2 2024-03-04T06:51:53.494 INFO:tasks.rados.rados.0.smithi137.stdout:3063: writing smithi13777483-47 from 7036928 to 7659520 tid 3 2024-03-04T06:51:53.494 INFO:tasks.rados.rados.0.smithi137.stdout:3060: done (2 left) 2024-03-04T06:51:53.494 INFO:tasks.rados.rados.0.smithi137.stdout:3064: setattr oid 36 current snap is 282 2024-03-04T06:51:53.494 INFO:tasks.rados.rados.0.smithi137.stdout:3062: finishing write tid 3 to smithi13777483-15 2024-03-04T06:51:53.494 INFO:tasks.rados.rados.0.smithi137.stdout:3062: finishing write tid 4 to smithi13777483-15 2024-03-04T06:51:53.494 INFO:tasks.rados.rados.0.smithi137.stdout:3062: finishing write tid 5 to smithi13777483-15 2024-03-04T06:51:53.494 INFO:tasks.rados.rados.0.smithi137.stdout:3062: finishing write tid 6 to smithi13777483-15 2024-03-04T06:51:53.495 INFO:tasks.rados.rados.0.smithi137.stdout:3062: oid 15 updating version 0 to 16909 2024-03-04T06:51:53.495 INFO:tasks.rados.rados.0.smithi137.stdout:3062: oid 15 updating version 16909 to 16913 2024-03-04T06:51:53.495 INFO:tasks.rados.rados.0.smithi137.stdout:3062: oid 15 version 16913 is already newer than 16912 2024-03-04T06:51:53.495 INFO:tasks.rados.rados.0.smithi137.stdout:3062: oid 15 version 16913 is already newer than 16910 2024-03-04T06:51:53.495 INFO:tasks.rados.rados.0.smithi137.stdout:3062: oid 15 version 16913 is already newer than 16911 2024-03-04T06:51:53.495 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16913 (ObjNum 965 snap 282 seq_num 965) dirty exists 2024-03-04T06:51:53.495 INFO:tasks.rados.rados.0.smithi137.stdout:3062: left oid 15 (ObjNum 965 snap 282 seq_num 965) 2024-03-04T06:51:53.495 INFO:tasks.rados.rados.0.smithi137.stdout:3063: finishing write tid 1 to smithi13777483-47 2024-03-04T06:51:53.495 INFO:tasks.rados.rados.0.smithi137.stdout:3063: finishing write tid 2 to smithi13777483-47 2024-03-04T06:51:53.495 INFO:tasks.rados.rados.0.smithi137.stdout:3062: done (2 left) 2024-03-04T06:51:53.496 INFO:tasks.rados.rados.0.smithi137.stdout:3065: rollback oid 14 current snap is 282 2024-03-04T06:51:53.496 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 14 to 280 2024-03-04T06:51:53.496 INFO:tasks.rados.rados.0.smithi137.stdout:3066: setattr oid 22 current snap is 282 2024-03-04T06:51:53.496 INFO:tasks.rados.rados.0.smithi137.stdout:3067: snap_create 2024-03-04T06:51:53.497 INFO:tasks.rados.rados.0.smithi137.stdout:3063: finishing write tid 3 to smithi13777483-47 2024-03-04T06:51:53.497 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 352 (ObjNum 65 snap 0 seq_num 3131255232) dirty exists 2024-03-04T06:51:53.498 INFO:tasks.rados.rados.0.smithi137.stdout:3063: finishing write tid 4 to smithi13777483-47 2024-03-04T06:51:53.499 INFO:tasks.rados.rados.0.smithi137.stdout:3063: finishing write tid 5 to smithi13777483-47 2024-03-04T06:51:53.499 INFO:tasks.rados.rados.0.smithi137.stdout:3063: oid 47 updating version 0 to 16894 2024-03-04T06:51:53.499 INFO:tasks.rados.rados.0.smithi137.stdout:3063: oid 47 updating version 16894 to 16895 2024-03-04T06:51:53.499 INFO:tasks.rados.rados.0.smithi137.stdout:3063: oid 47 updating version 16895 to 16897 2024-03-04T06:51:53.499 INFO:tasks.rados.rados.0.smithi137.stdout:3063: oid 47 version 16897 is already newer than 16896 2024-03-04T06:51:53.500 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16897 (ObjNum 966 snap 282 seq_num 966) dirty exists 2024-03-04T06:51:53.500 INFO:tasks.rados.rados.0.smithi137.stdout:3063: left oid 47 (ObjNum 966 snap 282 seq_num 966) 2024-03-04T06:51:53.500 INFO:tasks.rados.rados.0.smithi137.stdout:3065: finishing rollback tid 0 to smithi13777483-14 2024-03-04T06:51:53.500 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 16914 (ObjNum 959 snap 282 seq_num 959) dirty exists 2024-03-04T06:51:53.500 INFO:tasks.rados.rados.0.smithi137.stdout:3065: finishing rollback tid 1 to smithi13777483-14 2024-03-04T06:51:53.501 INFO:tasks.rados.rados.0.smithi137.stdout:3065: finishing rollback tid 2 to smithi13777483-14 2024-03-04T06:51:53.501 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 16906 (ObjNum 925 snap 272 seq_num 925) dirty exists 2024-03-04T06:51:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[88869]: osdmap e635: 8 total, 8 up, 8 in 2024-03-04T06:51:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:53.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:53.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:53.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:53.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[88869]: pgmap v633: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 517 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 2.3 MiB/s wr, 9 op/s 2024-03-04T06:51:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[91314]: osdmap e635: 8 total, 8 up, 8 in 2024-03-04T06:51:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:53.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:53.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:53.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:53.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:53.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:53 smithi137 ceph-mon[91314]: pgmap v633: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 517 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 2.3 MiB/s wr, 9 op/s 2024-03-04T06:51:54.101 INFO:tasks.rados.rados.0.smithi137.stdout:3063: done (4 left) 2024-03-04T06:51:54.101 INFO:tasks.rados.rados.0.smithi137.stdout:3064: done (3 left) 2024-03-04T06:51:54.101 INFO:tasks.rados.rados.0.smithi137.stdout:3065: done (2 left) 2024-03-04T06:51:54.101 INFO:tasks.rados.rados.0.smithi137.stdout:3066: done (1 left) 2024-03-04T06:51:54.102 INFO:tasks.rados.rados.0.smithi137.stdout:3067: done (0 left) 2024-03-04T06:51:54.102 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 283 2024-03-04T06:51:54.102 INFO:tasks.rados.rados.0.smithi137.stdout:3068: seq_num 967 ranges {3784704=598016,4382720=466944,4849664=516096,5365760=221184} 2024-03-04T06:51:54.125 INFO:tasks.rados.rados.0.smithi137.stdout:3068: writing smithi13777483-45 from 3784704 to 4382720 tid 1 2024-03-04T06:51:54.127 INFO:tasks.rados.rados.0.smithi137.stdout:3068: writing smithi13777483-45 from 4382720 to 4849664 tid 2 2024-03-04T06:51:54.130 INFO:tasks.rados.rados.0.smithi137.stdout:3068: writing smithi13777483-45 from 4849664 to 5365760 tid 3 2024-03-04T06:51:54.132 INFO:tasks.rados.rados.0.smithi137.stdout:3068: writing smithi13777483-45 from 5365760 to 5586944 tid 4 2024-03-04T06:51:54.132 INFO:tasks.rados.rados.0.smithi137.stdout:3069: read oid 41 snap 273 2024-03-04T06:51:54.132 INFO:tasks.rados.rados.0.smithi137.stdout:3069: expect (ObjNum 822 snap 236 seq_num 822) 2024-03-04T06:51:54.132 INFO:tasks.rados.rados.0.smithi137.stdout:3070: delete oid 6 current snap is 283 2024-03-04T06:51:54.135 INFO:tasks.rados.rados.0.smithi137.stdout:3068: finishing write tid 1 to smithi13777483-45 2024-03-04T06:51:54.136 INFO:tasks.rados.rados.0.smithi137.stdout:3068: finishing write tid 2 to smithi13777483-45 2024-03-04T06:51:54.136 INFO:tasks.rados.rados.0.smithi137.stdout:3070: done (2 left) 2024-03-04T06:51:54.136 INFO:tasks.rados.rados.0.smithi137.stdout:3071: copy_from oid 5 from oid 32 current snap is 283 2024-03-04T06:51:54.136 INFO:tasks.rados.rados.0.smithi137.stdout:3072: setattr oid 24 current snap is 283 2024-03-04T06:51:54.137 INFO:tasks.rados.rados.0.smithi137.stdout:3068: finishing write tid 3 to smithi13777483-45 2024-03-04T06:51:54.139 INFO:tasks.rados.rados.0.smithi137.stdout:3068: finishing write tid 4 to smithi13777483-45 2024-03-04T06:51:54.139 INFO:tasks.rados.rados.0.smithi137.stdout:3073: read oid 40 snap 273 2024-03-04T06:51:54.139 INFO:tasks.rados.rados.0.smithi137.stdout:3073: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:51:54.139 INFO:tasks.rados.rados.0.smithi137.stdout:3074: delete oid 13 current snap is 283 2024-03-04T06:51:54.139 INFO:tasks.rados.rados.0.smithi137.stdout:3068: finishing write tid 5 to smithi13777483-45 2024-03-04T06:51:54.145 INFO:tasks.rados.rados.0.smithi137.stdout:3074: done (5 left) 2024-03-04T06:51:54.145 INFO:tasks.rados.rados.0.smithi137.stdout:3075: rollback oid 3 current snap is 283 2024-03-04T06:51:54.145 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 3 to 280 2024-03-04T06:51:54.145 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 283 2024-03-04T06:51:54.145 INFO:tasks.rados.rados.0.smithi137.stdout:3076: seq_num 970 ranges {1163264=655360,1818624=516096,2334720=688128} 2024-03-04T06:51:54.155 INFO:tasks.rados.rados.0.smithi137.stdout:3076: writing smithi13777483-49 from 1163264 to 1818624 tid 1 2024-03-04T06:51:54.159 INFO:tasks.rados.rados.0.smithi137.stdout:3076: writing smithi13777483-49 from 1818624 to 2334720 tid 2 2024-03-04T06:51:54.163 INFO:tasks.rados.rados.0.smithi137.stdout:3076: writing smithi13777483-49 from 2334720 to 3022848 tid 3 2024-03-04T06:51:54.163 INFO:tasks.rados.rados.0.smithi137.stdout:3077: snap_create 2024-03-04T06:51:54.163 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16884 (ObjNum 65 snap 0 seq_num 3110921040) dirty exists 2024-03-04T06:51:54.163 INFO:tasks.rados.rados.0.smithi137.stdout:3071: finishing copy_from racing read to smithi13777483-5 2024-03-04T06:51:54.163 INFO:tasks.rados.rados.0.smithi137.stdout:3068: finishing write tid 6 to smithi13777483-45 2024-03-04T06:51:54.163 INFO:tasks.rados.rados.0.smithi137.stdout:3068: oid 45 updating version 0 to 16876 2024-03-04T06:51:54.163 INFO:tasks.rados.rados.0.smithi137.stdout:3068: oid 45 updating version 16876 to 16878 2024-03-04T06:51:54.164 INFO:tasks.rados.rados.0.smithi137.stdout:3068: oid 45 version 16878 is already newer than 16874 2024-03-04T06:51:54.164 INFO:tasks.rados.rados.0.smithi137.stdout:3068: oid 45 version 16878 is already newer than 16875 2024-03-04T06:51:54.164 INFO:tasks.rados.rados.0.smithi137.stdout:3068: oid 45 version 16878 is already newer than 16877 2024-03-04T06:51:54.164 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16878 (ObjNum 967 snap 283 seq_num 967) dirty exists 2024-03-04T06:51:54.164 INFO:tasks.rados.rados.0.smithi137.stdout:3068: left oid 45 (ObjNum 967 snap 283 seq_num 967) 2024-03-04T06:51:54.164 INFO:tasks.rados.rados.0.smithi137.stdout:3071: finishing copy_from to smithi13777483-5 2024-03-04T06:51:54.164 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 16928 (ObjNum 961 snap 282 seq_num 961) dirty exists 2024-03-04T06:51:54.164 INFO:tasks.rados.rados.0.smithi137.stdout:3075: finishing rollback tid 0 to smithi13777483-3 2024-03-04T06:51:54.164 INFO:tasks.rados.rados.0.smithi137.stdout:3075: finishing rollback tid 1 to smithi13777483-3 2024-03-04T06:51:54.164 INFO:tasks.rados.rados.0.smithi137.stdout:3075: finishing rollback tid 2 to smithi13777483-3 2024-03-04T06:51:54.164 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 16931 (ObjNum 946 snap 280 seq_num 946) dirty exists 2024-03-04T06:51:54.164 INFO:tasks.rados.rados.0.smithi137.stdout:3073: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:51:54.225 INFO:tasks.rados.rados.0.smithi137.stdout:3069: expect (ObjNum 822 snap 236 seq_num 822) 2024-03-04T06:51:54.328 INFO:tasks.rados.rados.0.smithi137.stdout:3076: finishing write tid 1 to smithi13777483-49 2024-03-04T06:51:54.328 INFO:tasks.rados.rados.0.smithi137.stdout:3076: finishing write tid 2 to smithi13777483-49 2024-03-04T06:51:54.328 INFO:tasks.rados.rados.0.smithi137.stdout:3076: finishing write tid 3 to smithi13777483-49 2024-03-04T06:51:54.329 INFO:tasks.rados.rados.0.smithi137.stdout:3076: finishing write tid 4 to smithi13777483-49 2024-03-04T06:51:54.329 INFO:tasks.rados.rados.0.smithi137.stdout:3076: finishing write tid 5 to smithi13777483-49 2024-03-04T06:51:54.329 INFO:tasks.rados.rados.0.smithi137.stdout:3076: oid 49 updating version 0 to 16909 2024-03-04T06:51:54.329 INFO:tasks.rados.rados.0.smithi137.stdout:3076: oid 49 updating version 16909 to 16910 2024-03-04T06:51:54.329 INFO:tasks.rados.rados.0.smithi137.stdout:3076: oid 49 updating version 16910 to 16912 2024-03-04T06:51:54.329 INFO:tasks.rados.rados.0.smithi137.stdout:3076: oid 49 version 16912 is already newer than 16911 2024-03-04T06:51:54.329 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16912 (ObjNum 970 snap 283 seq_num 970) dirty exists 2024-03-04T06:51:54.329 INFO:tasks.rados.rados.0.smithi137.stdout:3076: left oid 49 (ObjNum 970 snap 283 seq_num 970) 2024-03-04T06:51:54.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:51:54.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:54.133+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:54.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:54.100+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:54.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:54.101+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:54.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:54.147+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:54.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:54.147+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:54.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:54.129+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:54.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:54.142+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:54.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:54.142+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:54.347 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:54 smithi203 systemd[1]: Stopping Ceph grafana.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:51:54.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:51:54.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:51:54.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:54.219+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:54.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:54.100+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:54.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:54.101+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:54.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:54.141+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:54.648 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:54 smithi203 podman[120989]: 2024-03-04 06:51:54.350377753 +0000 UTC m=+0.114711770 container died eb19bfb589d8f89746907c5d4c93880b681b536cac93664a5210986924d14a8e (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, architecture=x86_64, io.k8s.display-name=Red Hat Universal Base Image 8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.buildah.version=1.32.0, vendor=Red Hat, Inc., release=239.1651231664, vcs-type=git, description=Ceph Grafana Container, distribution-scope=public, io.openshift.tags=base rhel8, build-date=2022-04-29T11:48:11.055897, com.redhat.component=ubi8-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, name=ubi8, io.openshift.expose-services=, summary=Grafana Container configured for Ceph mgr/dashboard integration, version=8.5, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Paul Cuzner ) 2024-03-04T06:51:54.991 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:54 smithi203 podman[120989]: 2024-03-04 06:51:54.73195194 +0000 UTC m=+0.496285956 container cleanup eb19bfb589d8f89746907c5d4c93880b681b536cac93664a5210986924d14a8e (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a, com.redhat.component=ubi8-container, vcs-type=git, vendor=Red Hat, Inc., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base rhel8, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, summary=Grafana Container configured for Ceph mgr/dashboard integration, description=Ceph Grafana Container, build-date=2022-04-29T11:48:11.055897, release=239.1651231664, version=8.5, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, architecture=x86_64, io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, distribution-scope=public, name=ubi8, io.buildah.version=1.32.0) 2024-03-04T06:51:54.991 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:54 smithi203 bash[120989]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a 2024-03-04T06:51:55.110 INFO:tasks.rados.rados.0.smithi137.stdout:3068: done (7 left) 2024-03-04T06:51:55.110 INFO:tasks.rados.rados.0.smithi137.stdout:3069: done (6 left) 2024-03-04T06:51:55.110 INFO:tasks.rados.rados.0.smithi137.stdout:3071: done (5 left) 2024-03-04T06:51:55.111 INFO:tasks.rados.rados.0.smithi137.stdout:3072: done (4 left) 2024-03-04T06:51:55.111 INFO:tasks.rados.rados.0.smithi137.stdout:3073: done (3 left) 2024-03-04T06:51:55.111 INFO:tasks.rados.rados.0.smithi137.stdout:3075: done (2 left) 2024-03-04T06:51:55.111 INFO:tasks.rados.rados.0.smithi137.stdout:3076: done (1 left) 2024-03-04T06:51:55.111 INFO:tasks.rados.rados.0.smithi137.stdout:3077: done (0 left) 2024-03-04T06:51:55.111 INFO:tasks.rados.rados.0.smithi137.stdout:3078: copy_from oid 36 from oid 1 current snap is 284 2024-03-04T06:51:55.111 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 284 2024-03-04T06:51:55.111 INFO:tasks.rados.rados.0.smithi137.stdout:3079: seq_num 971 ranges {1253376=671744,1925120=802816,2727936=401408} 2024-03-04T06:51:55.121 INFO:tasks.rados.rados.0.smithi137.stdout:3079: writing smithi13777483-25 from 1253376 to 1925120 tid 1 2024-03-04T06:51:55.126 INFO:tasks.rados.rados.0.smithi137.stdout:3079: writing smithi13777483-25 from 1925120 to 2727936 tid 2 2024-03-04T06:51:55.129 INFO:tasks.rados.rados.0.smithi137.stdout:3079: writing smithi13777483-25 from 2727936 to 3129344 tid 3 2024-03-04T06:51:55.129 INFO:tasks.rados.rados.0.smithi137.stdout:3080: rollback oid 32 current snap is 284 2024-03-04T06:51:55.129 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 32 to 281 2024-03-04T06:51:55.129 INFO:tasks.rados.rados.0.smithi137.stdout:3078: finishing copy_from racing read to smithi13777483-36 2024-03-04T06:51:55.129 INFO:tasks.rados.rados.0.smithi137.stdout:3078: finishing copy_from to smithi13777483-36 2024-03-04T06:51:55.129 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 16881 (ObjNum 951 snap 281 seq_num 951) dirty exists 2024-03-04T06:51:55.130 INFO:tasks.rados.rados.0.smithi137.stdout:3078: done (2 left) 2024-03-04T06:51:55.130 INFO:tasks.rados.rados.0.smithi137.stdout:3081: snap_remove snap 283 2024-03-04T06:51:55.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:55.133+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:55.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:55.114+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:55.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:55.114+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:55.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:55.114+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-mon[85573]: osdmap e636: 8 total, 8 up, 8 in 2024-03-04T06:51:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:55.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:55.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:55.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:55.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:55.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:55.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:55.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:55.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:55.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-mon[85573]: pgmap v635: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 526 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 22 op/s 2024-03-04T06:51:55.347 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:54 smithi203 podman[121002]: 2024-03-04 06:51:54.991582181 +0000 UTC m=+0.643801898 container remove eb19bfb589d8f89746907c5d4c93880b681b536cac93664a5210986924d14a8e (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a, release=239.1651231664, version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Grafana Container configured for Ceph mgr/dashboard integration, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, distribution-scope=public, maintainer=Paul Cuzner , io.openshift.tags=base rhel8, description=Ceph Grafana Container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, architecture=x86_64, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vendor=Red Hat, Inc., vcs-type=git, name=ubi8, build-date=2022-04-29T11:48:11.055897, com.redhat.component=ubi8-container, io.buildah.version=1.32.0, io.k8s.display-name=Red Hat Universal Base Image 8, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com) 2024-03-04T06:51:55.347 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:54 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-03-04T06:51:55.347 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:55 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-03-04T06:51:55.347 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:55 smithi203 systemd[1]: Stopped Ceph grafana.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:51:55.348 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:55 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@grafana.a.service: Consumed 10.827s CPU time. 2024-03-04T06:51:55.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:51:55] "GET /metrics HTTP/1.1" 200 36342 "" "Prometheus/2.43.0" 2024-03-04T06:51:55.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:55.110+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:55.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:55.123+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:55.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:55.123+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:55.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:55.128+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[91314]: osdmap e636: 8 total, 8 up, 8 in 2024-03-04T06:51:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:55.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[91314]: pgmap v635: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 526 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 22 op/s 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[88869]: osdmap e636: 8 total, 8 up, 8 in 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:55.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:55.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-mon[88869]: pgmap v635: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 526 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 22 op/s 2024-03-04T06:51:55.617 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:55.590+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:55.618 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:55.591+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:55.618 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:55.590+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:55.619 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:55 smithi203 systemd[1]: Starting Ceph grafana.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T06:51:55.619 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:55 smithi203 podman[121128]: 2024-03-04 06:51:55.470137791 +0000 UTC m=+0.017290088 image pull a0ea5e3c46d9434bd173d585b7c2638c7451eaf2543d1d22f9e78442615aaffb quay.io/ceph/ceph-grafana:9.4.12 2024-03-04T06:51:55.619 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:55 smithi203 podman[121128]: 2024-03-04 06:51:55.617939464 +0000 UTC m=+0.165091803 container create 12caa13589e2f6cfc6a85d9c6a215cb5234621ef9ea337356c5fff5079ff1d9d (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a, distribution-scope=public, version=8.5, name=ubi8, io.k8s.display-name=Red Hat Universal Base Image 8, vendor=Red Hat, Inc., vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.component=ubi8-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-04-29T11:48:11.055897, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-type=git, io.openshift.expose-services=, description=Ceph Grafana Container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, architecture=x86_64, io.buildah.version=1.32.0, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=239.1651231664, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base rhel8, maintainer=Paul Cuzner ) 2024-03-04T06:51:56.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:55.589+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:56.117 INFO:tasks.rados.rados.0.smithi137.stdout:3081: done (2 left) 2024-03-04T06:51:56.117 INFO:tasks.rados.rados.0.smithi137.stdout:3082: rollback oid 17 current snap is 284 2024-03-04T06:51:56.117 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 17 to 266 2024-03-04T06:51:56.117 INFO:tasks.rados.rados.0.smithi137.stdout:3079: finishing write tid 1 to smithi13777483-25 2024-03-04T06:51:56.117 INFO:tasks.rados.rados.0.smithi137.stdout:3079: finishing write tid 2 to smithi13777483-25 2024-03-04T06:51:56.118 INFO:tasks.rados.rados.0.smithi137.stdout:3080: finishing rollback tid 0 to smithi13777483-32 2024-03-04T06:51:56.118 INFO:tasks.rados.rados.0.smithi137.stdout:3079: finishing write tid 3 to smithi13777483-25 2024-03-04T06:51:56.118 INFO:tasks.rados.rados.0.smithi137.stdout:3080: finishing rollback tid 1 to smithi13777483-32 2024-03-04T06:51:56.118 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16931 (ObjNum 289 snap 0 seq_num 1) dirty dne 2024-03-04T06:51:56.119 INFO:tasks.rados.rados.0.smithi137.stdout:3079: finishing write tid 4 to smithi13777483-25 2024-03-04T06:51:56.119 INFO:tasks.rados.rados.0.smithi137.stdout:3079: finishing write tid 5 to smithi13777483-25 2024-03-04T06:51:56.119 INFO:tasks.rados.rados.0.smithi137.stdout:3079: oid 25 updating version 0 to 16898 2024-03-04T06:51:56.119 INFO:tasks.rados.rados.0.smithi137.stdout:3079: oid 25 updating version 16898 to 16901 2024-03-04T06:51:56.120 INFO:tasks.rados.rados.0.smithi137.stdout:3079: oid 25 version 16901 is already newer than 16900 2024-03-04T06:51:56.120 INFO:tasks.rados.rados.0.smithi137.stdout:3079: oid 25 version 16901 is already newer than 16899 2024-03-04T06:51:56.120 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 16901 (ObjNum 971 snap 284 seq_num 971) dirty exists 2024-03-04T06:51:56.120 INFO:tasks.rados.rados.0.smithi137.stdout:3079: left oid 25 (ObjNum 971 snap 284 seq_num 971) 2024-03-04T06:51:56.120 INFO:tasks.rados.rados.0.smithi137.stdout:3079: done (2 left) 2024-03-04T06:51:56.121 INFO:tasks.rados.rados.0.smithi137.stdout:3080: done (1 left) 2024-03-04T06:51:56.121 INFO:tasks.rados.rados.0.smithi137.stdout:3083: read oid 20 snap -1 2024-03-04T06:51:56.121 INFO:tasks.rados.rados.0.smithi137.stdout:3083: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:51:56.121 INFO:tasks.rados.rados.0.smithi137.stdout:3084: delete oid 38 current snap is 284 2024-03-04T06:51:56.122 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:56.114+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:56.123 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:56.114+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:56.123 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-mon[85573]: osdmap e637: 8 total, 8 up, 8 in 2024-03-04T06:51:56.124 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:56.124 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:56.124 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:56.124 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:56.125 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:56.125 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:56.125 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:56.125 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-mon[85573]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:56.125 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:56.126 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:56.126 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:56.126 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:56.127 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:55 smithi203 podman[121128]: 2024-03-04 06:51:55.870803402 +0000 UTC m=+0.417955700 container init 12caa13589e2f6cfc6a85d9c6a215cb5234621ef9ea337356c5fff5079ff1d9d (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a, build-date=2022-04-29T11:48:11.055897, summary=Grafana Container configured for Ceph mgr/dashboard integration, description=Ceph Grafana Container, name=ubi8, vcs-type=git, maintainer=Paul Cuzner , architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=239.1651231664, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., io.openshift.tags=base rhel8, io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.component=ubi8-container, io.buildah.version=1.32.0, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, version=8.5, io.k8s.display-name=Red Hat Universal Base Image 8) 2024-03-04T06:51:56.127 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:55 smithi203 podman[121128]: 2024-03-04 06:51:55.873665736 +0000 UTC m=+0.420818039 container start 12caa13589e2f6cfc6a85d9c6a215cb5234621ef9ea337356c5fff5079ff1d9d (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.component=ubi8-container, maintainer=Paul Cuzner , version=8.5, io.k8s.display-name=Red Hat Universal Base Image 8, description=Ceph Grafana Container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base rhel8, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., architecture=x86_64, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, summary=Grafana Container configured for Ceph mgr/dashboard integration, name=ubi8, io.buildah.version=1.32.0, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, build-date=2022-04-29T11:48:11.055897, io.openshift.expose-services=, distribution-scope=public, release=239.1651231664, vcs-type=git) 2024-03-04T06:51:56.128 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:55 smithi203 bash[121128]: 12caa13589e2f6cfc6a85d9c6a215cb5234621ef9ea337356c5fff5079ff1d9d 2024-03-04T06:51:56.128 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:55 smithi203 systemd[1]: Started Ceph grafana.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T06:51:56.128 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.033303591Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-03-04T06:51:56.128 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.033518864Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-03-04T06:51:56.129 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.033539101Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-03-04T06:51:56.129 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.03354671Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-03-04T06:51:56.129 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.033552857Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-03-04T06:51:56.129 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.033559331Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-03-04T06:51:56.129 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.033565073Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-03-04T06:51:56.130 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.033570804Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-03-04T06:51:56.130 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.033576696Z level=info msg="Path Home" path=/usr/share/grafana 2024-03-04T06:51:56.130 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.033582729Z level=info msg="Path Data" path=/var/lib/grafana 2024-03-04T06:51:56.130 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.033588405Z level=info msg="Path Logs" path=/var/log/grafana 2024-03-04T06:51:56.131 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.033593813Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-03-04T06:51:56.131 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.033599389Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-03-04T06:51:56.131 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=settings t=2024-03-04T06:51:56.033605064Z level=info msg="App mode production" 2024-03-04T06:51:56.131 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=sqlstore t=2024-03-04T06:51:56.033649058Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-03-04T06:51:56.131 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=sqlstore t=2024-03-04T06:51:56.033666402Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-03-04T06:51:56.132 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=migrator t=2024-03-04T06:51:56.047326867Z level=info msg="Starting DB migrations" 2024-03-04T06:51:56.132 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=migrator t=2024-03-04T06:51:56.051661045Z level=info msg="migrations completed" performed=0 skipped=481 duration=395.093µs 2024-03-04T06:51:56.132 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=sqlstore t=2024-03-04T06:51:56.051992064Z level=info msg="Created default organization" 2024-03-04T06:51:56.132 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=plugin.loader t=2024-03-04T06:51:56.109056435Z level=info msg="Plugin registered" pluginID=input 2024-03-04T06:51:56.135 INFO:tasks.rados.rados.0.smithi137.stdout:3082: finishing rollback tid 0 to smithi13777483-17 2024-03-04T06:51:56.135 INFO:tasks.rados.rados.0.smithi137.stdout:3084: done (2 left) 2024-03-04T06:51:56.136 INFO:tasks.rados.rados.0.smithi137.stdout:3085: copy_from oid 31 from oid 19 current snap is 284 2024-03-04T06:51:56.136 INFO:tasks.rados.rados.0.smithi137.stdout:3086: setattr oid 30 current snap is 284 2024-03-04T06:51:56.136 INFO:tasks.rados.rados.0.smithi137.stdout:3082: finishing rollback tid 1 to smithi13777483-17 2024-03-04T06:51:56.136 INFO:tasks.rados.rados.0.smithi137.stdout:3085: finishing copy_from to smithi13777483-31 2024-03-04T06:51:56.136 INFO:tasks.rados.rados.0.smithi137.stdout:3085: got expected ENOENT (src dne) 2024-03-04T06:51:56.137 INFO:tasks.rados.rados.0.smithi137.stdout:3082: finishing rollback tid 2 to smithi13777483-17 2024-03-04T06:51:56.137 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16880 (ObjNum 878 snap 258 seq_num 878) dirty exists 2024-03-04T06:51:56.137 INFO:tasks.rados.rados.0.smithi137.stdout:3085: finishing copy_from racing read to smithi13777483-31 2024-03-04T06:51:56.137 INFO:tasks.rados.rados.0.smithi137.stdout:3082: done (3 left) 2024-03-04T06:51:56.138 INFO:tasks.rados.rados.0.smithi137.stdout:3085: done (2 left) 2024-03-04T06:51:56.138 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 284 2024-03-04T06:51:56.138 INFO:tasks.rados.rados.0.smithi137.stdout:3087: seq_num 973 ranges {6512640=704512,7217152=573440,7790592=507904,8298496=122880} 2024-03-04T06:51:56.166 INFO:tasks.rados.rados.0.smithi137.stdout:3087: writing smithi13777483-31 from 6512640 to 7217152 tid 1 2024-03-04T06:51:56.169 INFO:tasks.rados.rados.0.smithi137.stdout:3087: writing smithi13777483-31 from 7217152 to 7790592 tid 2 2024-03-04T06:51:56.172 INFO:tasks.rados.rados.0.smithi137.stdout:3087: writing smithi13777483-31 from 7790592 to 8298496 tid 3 2024-03-04T06:51:56.174 INFO:tasks.rados.rados.0.smithi137.stdout:3087: writing smithi13777483-31 from 8298496 to 8421376 tid 4 2024-03-04T06:51:56.174 INFO:tasks.rados.rados.0.smithi137.stdout:3088: delete oid 21 current snap is 284 2024-03-04T06:51:56.174 INFO:tasks.rados.rados.0.smithi137.stdout:3083: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:51:56.235 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16896 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:51:56.235 INFO:tasks.rados.rados.0.smithi137.stdout:3087: finishing write tid 1 to smithi13777483-31 2024-03-04T06:51:56.235 INFO:tasks.rados.rados.0.smithi137.stdout:3087: finishing write tid 2 to smithi13777483-31 2024-03-04T06:51:56.235 INFO:tasks.rados.rados.0.smithi137.stdout:3087: finishing write tid 3 to smithi13777483-31 2024-03-04T06:51:56.235 INFO:tasks.rados.rados.0.smithi137.stdout:3087: finishing write tid 4 to smithi13777483-31 2024-03-04T06:51:56.235 INFO:tasks.rados.rados.0.smithi137.stdout:3087: finishing write tid 5 to smithi13777483-31 2024-03-04T06:51:56.235 INFO:tasks.rados.rados.0.smithi137.stdout:3087: finishing write tid 6 to smithi13777483-31 2024-03-04T06:51:56.235 INFO:tasks.rados.rados.0.smithi137.stdout:3087: oid 31 updating version 0 to 16914 2024-03-04T06:51:56.235 INFO:tasks.rados.rados.0.smithi137.stdout:3087: oid 31 version 16914 is already newer than 16913 2024-03-04T06:51:56.235 INFO:tasks.rados.rados.0.smithi137.stdout:3087: oid 31 updating version 16914 to 16916 2024-03-04T06:51:56.235 INFO:tasks.rados.rados.0.smithi137.stdout:3087: oid 31 version 16916 is already newer than 16915 2024-03-04T06:51:56.236 INFO:tasks.rados.rados.0.smithi137.stdout:3087: oid 31 updating version 16916 to 16917 2024-03-04T06:51:56.236 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16917 (ObjNum 973 snap 284 seq_num 973) dirty exists 2024-03-04T06:51:56.236 INFO:tasks.rados.rados.0.smithi137.stdout:3087: left oid 31 (ObjNum 973 snap 284 seq_num 973) 2024-03-04T06:51:56.236 INFO:tasks.rados.rados.0.smithi137.stdout:3083: done (3 left) 2024-03-04T06:51:56.236 INFO:tasks.rados.rados.0.smithi137.stdout:3086: done (2 left) 2024-03-04T06:51:56.236 INFO:tasks.rados.rados.0.smithi137.stdout:3087: done (1 left) 2024-03-04T06:51:56.236 INFO:tasks.rados.rados.0.smithi137.stdout:3088: done (0 left) 2024-03-04T06:51:56.236 INFO:tasks.rados.rados.0.smithi137.stdout:3089: rmattr oid 14 current snap is 284 2024-03-04T06:51:56.236 INFO:tasks.rados.rados.0.smithi137.stdout:3089: done (0 left) 2024-03-04T06:51:56.236 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 28 current snap is 284 2024-03-04T06:51:56.236 INFO:tasks.rados.rados.0.smithi137.stdout:3090: seq_num 975 ranges {0=737280,737280=786432,1523712=417792} 2024-03-04T06:51:56.238 INFO:tasks.rados.rados.0.smithi137.stdout:3090: writing smithi13777483-28 from 0 to 737280 tid 1 2024-03-04T06:51:56.243 INFO:tasks.rados.rados.0.smithi137.stdout:3090: writing smithi13777483-28 from 737280 to 1523712 tid 2 2024-03-04T06:51:56.246 INFO:tasks.rados.rados.0.smithi137.stdout:3090: writing smithi13777483-28 from 1523712 to 1941504 tid 3 2024-03-04T06:51:56.246 INFO:tasks.rados.rados.0.smithi137.stdout:3091: snap_create 2024-03-04T06:51:56.246 INFO:tasks.rados.rados.0.smithi137.stdout:3090: finishing write tid 1 to smithi13777483-28 2024-03-04T06:51:56.248 INFO:tasks.rados.rados.0.smithi137.stdout:3090: finishing write tid 2 to smithi13777483-28 2024-03-04T06:51:56.248 INFO:tasks.rados.rados.0.smithi137.stdout:3090: finishing write tid 3 to smithi13777483-28 2024-03-04T06:51:56.249 INFO:tasks.rados.rados.0.smithi137.stdout:3090: finishing write tid 4 to smithi13777483-28 2024-03-04T06:51:56.250 INFO:tasks.rados.rados.0.smithi137.stdout:3090: finishing write tid 5 to smithi13777483-28 2024-03-04T06:51:56.250 INFO:tasks.rados.rados.0.smithi137.stdout:3090: oid 28 updating version 0 to 16905 2024-03-04T06:51:56.250 INFO:tasks.rados.rados.0.smithi137.stdout:3090: oid 28 version 16905 is already newer than 16903 2024-03-04T06:51:56.250 INFO:tasks.rados.rados.0.smithi137.stdout:3090: oid 28 version 16905 is already newer than 16904 2024-03-04T06:51:56.250 INFO:tasks.rados.rados.0.smithi137.stdout:3090: oid 28 updating version 16905 to 16906 2024-03-04T06:51:56.250 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16906 (ObjNum 975 snap 284 seq_num 975) dirty exists 2024-03-04T06:51:56.250 INFO:tasks.rados.rados.0.smithi137.stdout:3090: left oid 28 (ObjNum 975 snap 284 seq_num 975) 2024-03-04T06:51:56.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:56.120+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:56.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:56.120+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:56.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[88869]: osdmap e637: 8 total, 8 up, 8 in 2024-03-04T06:51:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[88869]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:56.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[91314]: osdmap e637: 8 total, 8 up, 8 in 2024-03-04T06:51:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[91314]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:56.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:56.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:51:56.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:51:56.546 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:56.121+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:56.546 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:56.115+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:56.596 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=plugin.loader t=2024-03-04T06:51:56.146982298Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-03-04T06:51:56.596 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=plugin.loader t=2024-03-04T06:51:56.147020174Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-03-04T06:51:56.596 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=secrets t=2024-03-04T06:51:56.147089613Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-03-04T06:51:56.596 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=query_data t=2024-03-04T06:51:56.1492327Z level=info msg="Query Service initialization" 2024-03-04T06:51:56.596 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=live.push_http t=2024-03-04T06:51:56.152164435Z level=info msg="Live Push Gateway initialization" 2024-03-04T06:51:56.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:56.121+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:56.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:56.121+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:56.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:56.124+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:56.597 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:56.123+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:56.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:56.140+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:56.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:56.140+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:57.096 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=infra.usagestats.collector t=2024-03-04T06:51:56.841457028Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-03-04T06:51:57.096 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=provisioning.datasources t=2024-03-04T06:51:56.843702813Z level=info msg="deleted correlations based on configuration" ds_name=Dashboard1 2024-03-04T06:51:57.096 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=provisioning.datasources t=2024-03-04T06:51:56.84371912Z level=info msg="deleted datasource based on configuration" name=Dashboard1 2024-03-04T06:51:57.096 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=provisioning.datasources t=2024-03-04T06:51:56.843829407Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-03-04T06:51:57.096 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=provisioning.alerting t=2024-03-04T06:51:56.865944279Z level=info msg="starting to provision alerting" 2024-03-04T06:51:57.096 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=provisioning.alerting t=2024-03-04T06:51:56.865962684Z level=info msg="finished to provision alerting" 2024-03-04T06:51:57.096 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=ngalert.state.manager t=2024-03-04T06:51:56.866221212Z level=info msg="Warming state cache for startup" 2024-03-04T06:51:57.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=grafanaStorageLogger t=2024-03-04T06:51:56.867053243Z level=info msg="storage starting" 2024-03-04T06:51:57.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=http.server t=2024-03-04T06:51:56.868524819Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-03-04T06:51:57.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=ngalert.state.manager t=2024-03-04T06:51:56.880839948Z level=info msg="State cache has been initialized" states=0 duration=14.618279ms 2024-03-04T06:51:57.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=ticker t=2024-03-04T06:51:56.880898866Z level=info msg=starting first_tick=2024-03-04T06:52:00Z 2024-03-04T06:51:57.097 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 06:51:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=ngalert.multiorg.alertmanager t=2024-03-04T06:51:56.880903388Z level=info msg="starting MultiOrg Alertmanager" 2024-03-04T06:51:57.124 INFO:tasks.rados.rados.0.smithi137.stdout:3090: done (1 left) 2024-03-04T06:51:57.124 INFO:tasks.rados.rados.0.smithi137.stdout:3091: done (0 left) 2024-03-04T06:51:57.124 INFO:tasks.rados.rados.0.smithi137.stdout:3092: delete oid 25 current snap is 285 2024-03-04T06:51:57.129 INFO:tasks.rados.rados.0.smithi137.stdout:3092: done (0 left) 2024-03-04T06:51:57.129 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 285 2024-03-04T06:51:57.129 INFO:tasks.rados.rados.0.smithi137.stdout:3093: seq_num 977 ranges {5586944=770048,6356992=557056,6914048=491520,7405568=155648} 2024-03-04T06:51:57.162 INFO:tasks.rados.rados.0.smithi137.stdout:3093: writing smithi13777483-45 from 5586944 to 6356992 tid 1 2024-03-04T06:51:57.165 INFO:tasks.rados.rados.0.smithi137.stdout:3093: writing smithi13777483-45 from 6356992 to 6914048 tid 2 2024-03-04T06:51:57.168 INFO:tasks.rados.rados.0.smithi137.stdout:3093: writing smithi13777483-45 from 6914048 to 7405568 tid 3 2024-03-04T06:51:57.169 INFO:tasks.rados.rados.0.smithi137.stdout:3093: writing smithi13777483-45 from 7405568 to 7561216 tid 4 2024-03-04T06:51:57.170 INFO:tasks.rados.rados.0.smithi137.stdout:3094: read oid 17 snap -1 2024-03-04T06:51:57.170 INFO:tasks.rados.rados.0.smithi137.stdout:3094: expect (ObjNum 878 snap 258 seq_num 878) 2024-03-04T06:51:57.170 INFO:tasks.rados.rados.0.smithi137.stdout:3095: rollback oid 5 current snap is 285 2024-03-04T06:51:57.170 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 5 to 273 2024-03-04T06:51:57.170 INFO:tasks.rados.rados.0.smithi137.stdout:3096: snap_create 2024-03-04T06:51:57.172 INFO:tasks.rados.rados.0.smithi137.stdout:3093: finishing write tid 1 to smithi13777483-45 2024-03-04T06:51:57.172 INFO:tasks.rados.rados.0.smithi137.stdout:3093: finishing write tid 2 to smithi13777483-45 2024-03-04T06:51:57.174 INFO:tasks.rados.rados.0.smithi137.stdout:3095: finishing rollback tid 0 to smithi13777483-5 2024-03-04T06:51:57.175 INFO:tasks.rados.rados.0.smithi137.stdout:3095: finishing rollback tid 1 to smithi13777483-5 2024-03-04T06:51:57.175 INFO:tasks.rados.rados.0.smithi137.stdout:3093: finishing write tid 3 to smithi13777483-45 2024-03-04T06:51:57.175 INFO:tasks.rados.rados.0.smithi137.stdout:3095: finishing rollback tid 2 to smithi13777483-5 2024-03-04T06:51:57.175 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 16934 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-04T06:51:57.176 INFO:tasks.rados.rados.0.smithi137.stdout:3093: finishing write tid 4 to smithi13777483-45 2024-03-04T06:51:57.176 INFO:tasks.rados.rados.0.smithi137.stdout:3093: finishing write tid 5 to smithi13777483-45 2024-03-04T06:51:57.176 INFO:tasks.rados.rados.0.smithi137.stdout:3094: expect (ObjNum 878 snap 258 seq_num 878) 2024-03-04T06:51:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3093: finishing write tid 6 to smithi13777483-45 2024-03-04T06:51:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3093: oid 45 updating version 0 to 16881 2024-03-04T06:51:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3093: oid 45 updating version 16881 to 16882 2024-03-04T06:51:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3093: oid 45 version 16882 is already newer than 16879 2024-03-04T06:51:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3093: oid 45 updating version 16882 to 16883 2024-03-04T06:51:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3093: oid 45 version 16883 is already newer than 16880 2024-03-04T06:51:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16883 (ObjNum 977 snap 285 seq_num 977) dirty exists 2024-03-04T06:51:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3093: left oid 45 (ObjNum 977 snap 285 seq_num 977) 2024-03-04T06:51:57.376 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:57.118+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:57.376 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:57.118+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:57.376 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:57.118+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:57.376 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:57.377 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:57.377 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:57.377 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-mon[85573]: osdmap e638: 8 total, 8 up, 8 in 2024-03-04T06:51:57.377 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:57.377 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:57.377 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:57.377 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:57.377 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:57.377 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:57.377 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:57.377 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:57.377 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-mon[85573]: pgmap v638: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 535 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 15 MiB/s rd, 5.0 MiB/s wr, 28 op/s 2024-03-04T06:51:57.378 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:57.165+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:57.378 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:57.169+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:57.378 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:57.169+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:57.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:57.122+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:57.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:57.128+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:57.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:57.122+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:57.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:57.122+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:57.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:57.122+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:57.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:57.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:57.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:57.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[88869]: osdmap e638: 8 total, 8 up, 8 in 2024-03-04T06:51:57.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:57.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:57.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:57.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:57.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[88869]: pgmap v638: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 535 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 15 MiB/s rd, 5.0 MiB/s wr, 28 op/s 2024-03-04T06:51:57.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:57.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:57.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:57.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[91314]: osdmap e638: 8 total, 8 up, 8 in 2024-03-04T06:51:57.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:57.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:57.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:57.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:57.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:57.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:57.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 150=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:57.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:57.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:57 smithi137 ceph-mon[91314]: pgmap v638: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 535 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 15 MiB/s rd, 5.0 MiB/s wr, 28 op/s 2024-03-04T06:51:57.956 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:57.630+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:58.127 INFO:tasks.rados.rados.0.smithi137.stdout:3093: done (3 left) 2024-03-04T06:51:58.127 INFO:tasks.rados.rados.0.smithi137.stdout:3094: done (2 left) 2024-03-04T06:51:58.127 INFO:tasks.rados.rados.0.smithi137.stdout:3095: done (1 left) 2024-03-04T06:51:58.127 INFO:tasks.rados.rados.0.smithi137.stdout:3096: done (0 left) 2024-03-04T06:51:58.127 INFO:tasks.rados.rados.0.smithi137.stdout:3097: read oid 15 snap -1 2024-03-04T06:51:58.128 INFO:tasks.rados.rados.0.smithi137.stdout:3097: expect (ObjNum 965 snap 282 seq_num 965) 2024-03-04T06:51:58.128 INFO:tasks.rados.rados.0.smithi137.stdout:3098: read oid 49 snap -1 2024-03-04T06:51:58.128 INFO:tasks.rados.rados.0.smithi137.stdout:3098: expect (ObjNum 970 snap 283 seq_num 970) 2024-03-04T06:51:58.128 INFO:tasks.rados.rados.0.smithi137.stdout:3099: setattr oid 29 current snap is 286 2024-03-04T06:51:58.129 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 41 current snap is 286 2024-03-04T06:51:58.129 INFO:tasks.rados.rados.0.smithi137.stdout:3100: seq_num 978 ranges {3104768=786432,3891200=442368,4333568=647168,4980736=114688} 2024-03-04T06:51:58.150 INFO:tasks.rados.rados.0.smithi137.stdout:3100: writing smithi13777483-41 from 3104768 to 3891200 tid 1 2024-03-04T06:51:58.153 INFO:tasks.rados.rados.0.smithi137.stdout:3100: writing smithi13777483-41 from 3891200 to 4333568 tid 2 2024-03-04T06:51:58.157 INFO:tasks.rados.rados.0.smithi137.stdout:3100: writing smithi13777483-41 from 4333568 to 4980736 tid 3 2024-03-04T06:51:58.158 INFO:tasks.rados.rados.0.smithi137.stdout:3100: writing smithi13777483-41 from 4980736 to 5095424 tid 4 2024-03-04T06:51:58.158 INFO:tasks.rados.rados.0.smithi137.stdout:3101: read oid 50 snap -1 2024-03-04T06:51:58.158 INFO:tasks.rados.rados.0.smithi137.stdout:3101: expect (ObjNum 941 snap 279 seq_num 941) 2024-03-04T06:51:58.158 INFO:tasks.rados.rados.0.smithi137.stdout:3102: delete oid 13 current snap is 286 2024-03-04T06:51:58.158 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16891 (ObjNum 932 snap 275 seq_num 932) dirty exists 2024-03-04T06:51:58.158 INFO:tasks.rados.rados.0.smithi137.stdout:3098: expect (ObjNum 970 snap 283 seq_num 970) 2024-03-04T06:51:58.273 INFO:tasks.rados.rados.0.smithi137.stdout:3097: expect (ObjNum 965 snap 282 seq_num 965) 2024-03-04T06:51:58.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:58.133+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:58.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:58.136+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:51:58.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:58.136+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:58.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:58.131+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:51:58.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:58.131+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:58.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:58.135+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:58.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-mon[85573]: osdmap e639: 8 total, 8 up, 8 in 2024-03-04T06:51:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:58.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:58.124+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:58.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:58.124+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:58.412 INFO:tasks.rados.rados.0.smithi137.stdout:3100: finishing write tid 1 to smithi13777483-41 2024-03-04T06:51:58.412 INFO:tasks.rados.rados.0.smithi137.stdout:3100: finishing write tid 2 to smithi13777483-41 2024-03-04T06:51:58.412 INFO:tasks.rados.rados.0.smithi137.stdout:3097: done (5 left) 2024-03-04T06:51:58.412 INFO:tasks.rados.rados.0.smithi137.stdout:3098: done (4 left) 2024-03-04T06:51:58.412 INFO:tasks.rados.rados.0.smithi137.stdout:3099: done (3 left) 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:3102: done (2 left) 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:3103: rollback oid 14 current snap is 286 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 14 to 284 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:3100: finishing write tid 3 to smithi13777483-41 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:3100: finishing write tid 4 to smithi13777483-41 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:3100: finishing write tid 5 to smithi13777483-41 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:3100: finishing write tid 6 to smithi13777483-41 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:3100: oid 41 updating version 0 to 16885 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:3100: oid 41 updating version 16885 to 16886 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:3100: oid 41 updating version 16886 to 16888 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:3100: oid 41 version 16888 is already newer than 16887 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:3100: oid 41 version 16888 is already newer than 16884 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 16888 (ObjNum 978 snap 286 seq_num 978) dirty exists 2024-03-04T06:51:58.413 INFO:tasks.rados.rados.0.smithi137.stdout:3100: left oid 41 (ObjNum 978 snap 286 seq_num 978) 2024-03-04T06:51:58.414 INFO:tasks.rados.rados.0.smithi137.stdout:3101: expect (ObjNum 941 snap 279 seq_num 941) 2024-03-04T06:51:58.519 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:58.163+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:58.519 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:58.125+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:58.519 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:58.519 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:58.520 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[91314]: osdmap e639: 8 total, 8 up, 8 in 2024-03-04T06:51:58.520 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:58.520 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:58.520 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:58.520 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:58.520 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:58.520 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:58.520 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:58.520 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:58.521 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:58.521 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[88869]: osdmap e639: 8 total, 8 up, 8 in 2024-03-04T06:51:58.521 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:58.521 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:58.521 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:58.521 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:58.521 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:58.521 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:58.521 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:58.547 INFO:tasks.rados.rados.0.smithi137.stdout:3103: finishing rollback tid 0 to smithi13777483-14 2024-03-04T06:51:58.547 INFO:tasks.rados.rados.0.smithi137.stdout:3103: finishing rollback tid 1 to smithi13777483-14 2024-03-04T06:51:58.547 INFO:tasks.rados.rados.0.smithi137.stdout:3100: done (2 left) 2024-03-04T06:51:58.547 INFO:tasks.rados.rados.0.smithi137.stdout:3101: done (1 left) 2024-03-04T06:51:58.547 INFO:tasks.rados.rados.0.smithi137.stdout:3104: read oid 34 snap -1 2024-03-04T06:51:58.547 INFO:tasks.rados.rados.0.smithi137.stdout:3104: expect (ObjNum 886 snap 259 seq_num 886) 2024-03-04T06:51:58.547 INFO:tasks.rados.rados.0.smithi137.stdout:3105: snap_remove snap 276 2024-03-04T06:51:58.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:58.517+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:58.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:58.517+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:59.057 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:51:59.134 INFO:tasks.rados.rados.0.smithi137.stdout:3105: done (2 left) 2024-03-04T06:51:59.134 INFO:tasks.rados.rados.0.smithi137.stdout:3106: snap_create 2024-03-04T06:51:59.134 INFO:tasks.rados.rados.0.smithi137.stdout:3103: finishing rollback tid 2 to smithi13777483-14 2024-03-04T06:51:59.134 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 16909 (ObjNum 925 snap 272 seq_num 925) dirty exists 2024-03-04T06:51:59.134 INFO:tasks.rados.rados.0.smithi137.stdout:3104: expect (ObjNum 886 snap 259 seq_num 886) 2024-03-04T06:51:59.385 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:51:59.141+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:59.385 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:51:59.131+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:59.385 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:59.139+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:51:59.385 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:59.139+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:59.385 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:51:59.141+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:59.386 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:51:59.386 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (29s) 25s ago 12m 16.1M - 0.25.0 c8568f914cd2 ce9f080c2c94 2024-03-04T06:51:59.386 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 starting - - - - 2024-03-04T06:51:59.386 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (100s) 25s ago 13m 16.6M - 19.0.0-1791-gefb04e5e 0c401cd3e778 b6a5f9352182 2024-03-04T06:51:59.386 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (79s) 41s ago 13m 12.6M - 19.0.0-1791-gefb04e5e 0c401cd3e778 6797a1307e30 2024-03-04T06:51:59.386 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (7m) 41s ago 17m 452M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:51:59.386 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (8m) 25s ago 19m 514M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:51:59.386 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (7m) 25s ago 19m 68.9M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:51:59.386 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (6m) 41s ago 17m 55.2M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:51:59.386 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (7m) 25s ago 17m 59.8M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:51:59.386 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (66s) 25s ago 12m 8442k - 1.5.0 0da6a335fe13 ff9dbbaf9aeb 2024-03-04T06:51:59.386 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (61s) 41s ago 12m 15.7M - 1.5.0 0da6a335fe13 28b7879b0fcb 2024-03-04T06:51:59.387 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (6m) 25s ago 16m 369M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 bd2207652b33 2024-03-04T06:51:59.387 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (5m) 25s ago 16m 241M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 47b5cdaad147 2024-03-04T06:51:59.387 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (4m) 25s ago 16m 308M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 436ae07776d9 2024-03-04T06:51:59.387 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (4m) 25s ago 15m 153M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9acd06dda8ec 2024-03-04T06:51:59.387 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (3m) 41s ago 15m 173M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9a246a0996bd 2024-03-04T06:51:59.387 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (3m) 41s ago 14m 320M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9e05ca76b164 2024-03-04T06:51:59.387 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (2m) 41s ago 14m 214M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 ddb88aa8bce6 2024-03-04T06:51:59.387 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (119s) 41s ago 14m 123M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 b9857bcd7602 2024-03-04T06:51:59.387 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (45s) 41s ago 13m 35.1M - 2.43.0 a07b618ecd1d 85dcb15cec84 2024-03-04T06:51:59.387 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:59.387 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:59.388 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:59.388 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:59.388 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[88869]: osdmap e640: 8 total, 8 up, 8 in 2024-03-04T06:51:59.388 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:59.388 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:59.388 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:59.388 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:59.388 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:59.388 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[88869]: pgmap v641: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 546 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 8.4 MiB/s rd, 5.5 MiB/s wr, 49 op/s 2024-03-04T06:51:59.388 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:59.388 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:59.388 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:59.389 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:59.389 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:59.389 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:59.389 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[91314]: osdmap e640: 8 total, 8 up, 8 in 2024-03-04T06:51:59.389 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:59.389 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:59.389 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:59.389 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:59.389 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:59.389 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[91314]: pgmap v641: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 546 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 8.4 MiB/s rd, 5.5 MiB/s wr, 49 op/s 2024-03-04T06:51:59.389 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:59.389 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:51:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:59.446 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:59.148+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:59.446 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:51:59.149+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:59.447 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:59.128+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:51:59.447 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:59.128+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:59.447 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:51:59.128+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:59.447 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:59.447 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:51:59.447 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:51:59.447 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:51:59.447 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-mon[85573]: osdmap e640: 8 total, 8 up, 8 in 2024-03-04T06:51:59.447 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 137=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:51:59.447 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:59.447 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:51:59.448 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:59.448 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:51:59.448 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-mon[85573]: pgmap v641: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 546 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 8.4 MiB/s rd, 5.5 MiB/s wr, 49 op/s 2024-03-04T06:51:59.448 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:51:59.448 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:51:59.448 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:51:59.136+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:51:59.448 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:51:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:51:59.361+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:51:59.772 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:51:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:51:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:51:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:51:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:51:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:51:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:51:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:51:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 8 2024-03-04T06:51:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:51:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:51:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:51:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:51:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:51:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 15 2024-03-04T06:51:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:51:59.773 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:52:00.135 INFO:tasks.rados.rados.0.smithi137.stdout:3103: done (2 left) 2024-03-04T06:52:00.135 INFO:tasks.rados.rados.0.smithi137.stdout:3104: done (1 left) 2024-03-04T06:52:00.135 INFO:tasks.rados.rados.0.smithi137.stdout:3106: done (0 left) 2024-03-04T06:52:00.135 INFO:tasks.rados.rados.0.smithi137.stdout:3107: copy_from oid 20 from oid 30 current snap is 287 2024-03-04T06:52:00.135 INFO:tasks.rados.rados.0.smithi137.stdout:3108: setattr oid 7 current snap is 287 2024-03-04T06:52:00.136 INFO:tasks.rados.rados.0.smithi137.stdout:3109: copy_from oid 15 from oid 11 current snap is 287 2024-03-04T06:52:00.136 INFO:tasks.rados.rados.0.smithi137.stdout:3110: delete oid 25 current snap is 287 2024-03-04T06:52:00.142 INFO:tasks.rados.rados.0.smithi137.stdout:3110: done (3 left) 2024-03-04T06:52:00.142 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 287 2024-03-04T06:52:00.142 INFO:tasks.rados.rados.0.smithi137.stdout:3111: seq_num 981 ranges {7659520=434176,8093696=540672,8634368=466944,9101312=524288,9625600=73728} 2024-03-04T06:52:00.186 INFO:tasks.rados.rados.0.smithi137.stdout:3111: writing smithi13777483-47 from 7659520 to 8093696 tid 1 2024-03-04T06:52:00.189 INFO:tasks.rados.rados.0.smithi137.stdout:3111: writing smithi13777483-47 from 8093696 to 8634368 tid 2 2024-03-04T06:52:00.192 INFO:tasks.rados.rados.0.smithi137.stdout:3111: writing smithi13777483-47 from 8634368 to 9101312 tid 3 2024-03-04T06:52:00.194 INFO:tasks.rados.rados.0.smithi137.stdout:3111: writing smithi13777483-47 from 9101312 to 9625600 tid 4 2024-03-04T06:52:00.196 INFO:tasks.rados.rados.0.smithi137.stdout:3111: writing smithi13777483-47 from 9625600 to 9699328 tid 5 2024-03-04T06:52:00.196 INFO:tasks.rados.rados.0.smithi137.stdout:3112: copy_from oid 43 from oid 40 current snap is 287 2024-03-04T06:52:00.196 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16918 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-03-04T06:52:00.196 INFO:tasks.rados.rados.0.smithi137.stdout:3107: finishing copy_from racing read to smithi13777483-20 2024-03-04T06:52:00.196 INFO:tasks.rados.rados.0.smithi137.stdout:3107: finishing copy_from to smithi13777483-20 2024-03-04T06:52:00.197 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16896 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:52:00.197 INFO:tasks.rados.rados.0.smithi137.stdout:3109: finishing copy_from racing read to smithi13777483-15 2024-03-04T06:52:00.197 INFO:tasks.rados.rados.0.smithi137.stdout:3109: finishing copy_from to smithi13777483-15 2024-03-04T06:52:00.197 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16883 (ObjNum 932 snap 275 seq_num 932) dirty exists 2024-03-04T06:52:00.197 INFO:tasks.rados.rados.0.smithi137.stdout:3111: finishing write tid 1 to smithi13777483-47 2024-03-04T06:52:00.197 INFO:tasks.rados.rados.0.smithi137.stdout:3111: finishing write tid 2 to smithi13777483-47 2024-03-04T06:52:00.197 INFO:tasks.rados.rados.0.smithi137.stdout:3111: finishing write tid 3 to smithi13777483-47 2024-03-04T06:52:00.197 INFO:tasks.rados.rados.0.smithi137.stdout:3107: done (4 left) 2024-03-04T06:52:00.197 INFO:tasks.rados.rados.0.smithi137.stdout:3108: done (3 left) 2024-03-04T06:52:00.197 INFO:tasks.rados.rados.0.smithi137.stdout:3109: done (2 left) 2024-03-04T06:52:00.197 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 287 2024-03-04T06:52:00.198 INFO:tasks.rados.rados.0.smithi137.stdout:3113: seq_num 982 ranges {2301952=450560,2752512=425984,3178496=679936,3858432=466944,4325376=32768} 2024-03-04T06:52:00.210 INFO:tasks.rados.rados.0.smithi137.stdout:3113: writing smithi13777483-30 from 2301952 to 2752512 tid 1 2024-03-04T06:52:00.213 INFO:tasks.rados.rados.0.smithi137.stdout:3113: writing smithi13777483-30 from 2752512 to 3178496 tid 2 2024-03-04T06:52:00.217 INFO:tasks.rados.rados.0.smithi137.stdout:3113: writing smithi13777483-30 from 3178496 to 3858432 tid 3 2024-03-04T06:52:00.220 INFO:tasks.rados.rados.0.smithi137.stdout:3113: writing smithi13777483-30 from 3858432 to 4325376 tid 4 2024-03-04T06:52:00.220 INFO:tasks.rados.rados.0.smithi137.stdout:3113: writing smithi13777483-30 from 4325376 to 4358144 tid 5 2024-03-04T06:52:00.220 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 287 2024-03-04T06:52:00.220 INFO:tasks.rados.rados.0.smithi137.stdout:3111: finishing write tid 4 to smithi13777483-47 2024-03-04T06:52:00.220 INFO:tasks.rados.rados.0.smithi137.stdout:3114: seq_num 983 ranges {9519104=466944,9986048=712704,10698752=434176,11132928=458752} 2024-03-04T06:52:00.272 INFO:tasks.rados.rados.0.smithi137.stdout:3114: writing smithi13777483-18 from 9519104 to 9986048 tid 1 2024-03-04T06:52:00.276 INFO:tasks.rados.rados.0.smithi137.stdout:3114: writing smithi13777483-18 from 9986048 to 10698752 tid 2 2024-03-04T06:52:00.279 INFO:tasks.rados.rados.0.smithi137.stdout:3114: writing smithi13777483-18 from 10698752 to 11132928 tid 3 2024-03-04T06:52:00.283 INFO:tasks.rados.rados.0.smithi137.stdout:3114: writing smithi13777483-18 from 11132928 to 11591680 tid 4 2024-03-04T06:52:00.283 INFO:tasks.rados.rados.0.smithi137.stdout:3115: rmattr oid 32 current snap is 287 2024-03-04T06:52:00.283 INFO:tasks.rados.rados.0.smithi137.stdout:3115: done (4 left) 2024-03-04T06:52:00.283 INFO:tasks.rados.rados.0.smithi137.stdout:3116: snap_create 2024-03-04T06:52:00.283 INFO:tasks.rados.rados.0.smithi137.stdout:3111: finishing write tid 5 to smithi13777483-47 2024-03-04T06:52:00.283 INFO:tasks.rados.rados.0.smithi137.stdout:3111: finishing write tid 6 to smithi13777483-47 2024-03-04T06:52:00.283 INFO:tasks.rados.rados.0.smithi137.stdout:3111: finishing write tid 7 to smithi13777483-47 2024-03-04T06:52:00.283 INFO:tasks.rados.rados.0.smithi137.stdout:3111: oid 47 updating version 0 to 16908 2024-03-04T06:52:00.283 INFO:tasks.rados.rados.0.smithi137.stdout:3111: oid 47 updating version 16908 to 16912 2024-03-04T06:52:00.283 INFO:tasks.rados.rados.0.smithi137.stdout:3111: oid 47 version 16912 is already newer than 16910 2024-03-04T06:52:00.283 INFO:tasks.rados.rados.0.smithi137.stdout:3111: oid 47 version 16912 is already newer than 16911 2024-03-04T06:52:00.284 INFO:tasks.rados.rados.0.smithi137.stdout:3111: oid 47 version 16912 is already newer than 16909 2024-03-04T06:52:00.284 INFO:tasks.rados.rados.0.smithi137.stdout:3111: oid 47 updating version 16912 to 16913 2024-03-04T06:52:00.284 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16913 (ObjNum 981 snap 287 seq_num 981) dirty exists 2024-03-04T06:52:00.284 INFO:tasks.rados.rados.0.smithi137.stdout:3111: left oid 47 (ObjNum 981 snap 287 seq_num 981) 2024-03-04T06:52:00.284 INFO:tasks.rados.rados.0.smithi137.stdout:3112: finishing copy_from racing read to smithi13777483-43 2024-03-04T06:52:00.284 INFO:tasks.rados.rados.0.smithi137.stdout:3112: finishing copy_from to smithi13777483-43 2024-03-04T06:52:00.284 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16903 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:52:00.284 INFO:tasks.rados.rados.0.smithi137.stdout:3113: finishing write tid 1 to smithi13777483-30 2024-03-04T06:52:00.284 INFO:tasks.rados.rados.0.smithi137.stdout:3113: finishing write tid 2 to smithi13777483-30 2024-03-04T06:52:00.284 INFO:tasks.rados.rados.0.smithi137.stdout:3113: finishing write tid 3 to smithi13777483-30 2024-03-04T06:52:00.285 INFO:tasks.rados.rados.0.smithi137.stdout:3113: finishing write tid 4 to smithi13777483-30 2024-03-04T06:52:00.285 INFO:tasks.rados.rados.0.smithi137.stdout:3113: finishing write tid 5 to smithi13777483-30 2024-03-04T06:52:00.285 INFO:tasks.rados.rados.0.smithi137.stdout:3113: finishing write tid 6 to smithi13777483-30 2024-03-04T06:52:00.285 INFO:tasks.rados.rados.0.smithi137.stdout:3113: finishing write tid 7 to smithi13777483-30 2024-03-04T06:52:00.285 INFO:tasks.rados.rados.0.smithi137.stdout:3113: oid 30 updating version 0 to 16902 2024-03-04T06:52:00.285 INFO:tasks.rados.rados.0.smithi137.stdout:3113: oid 30 version 16902 is already newer than 16900 2024-03-04T06:52:00.285 INFO:tasks.rados.rados.0.smithi137.stdout:3113: oid 30 version 16902 is already newer than 16898 2024-03-04T06:52:00.285 INFO:tasks.rados.rados.0.smithi137.stdout:3113: oid 30 version 16902 is already newer than 16897 2024-03-04T06:52:00.285 INFO:tasks.rados.rados.0.smithi137.stdout:3113: oid 30 version 16902 is already newer than 16899 2024-03-04T06:52:00.285 INFO:tasks.rados.rados.0.smithi137.stdout:3113: oid 30 version 16902 is already newer than 16901 2024-03-04T06:52:00.285 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16902 (ObjNum 982 snap 287 seq_num 982) dirty exists 2024-03-04T06:52:00.285 INFO:tasks.rados.rados.0.smithi137.stdout:3113: left oid 30 (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:52:00.286 INFO:tasks.rados.rados.0.smithi137.stdout:3114: finishing write tid 1 to smithi13777483-18 2024-03-04T06:52:00.286 INFO:tasks.rados.rados.0.smithi137.stdout:3114: finishing write tid 2 to smithi13777483-18 2024-03-04T06:52:00.286 INFO:tasks.rados.rados.0.smithi137.stdout:3114: finishing write tid 3 to smithi13777483-18 2024-03-04T06:52:00.287 INFO:tasks.rados.rados.0.smithi137.stdout:3114: finishing write tid 4 to smithi13777483-18 2024-03-04T06:52:00.287 INFO:tasks.rados.rados.0.smithi137.stdout:3114: finishing write tid 5 to smithi13777483-18 2024-03-04T06:52:00.287 INFO:tasks.rados.rados.0.smithi137.stdout:3114: finishing write tid 6 to smithi13777483-18 2024-03-04T06:52:00.287 INFO:tasks.rados.rados.0.smithi137.stdout:3114: oid 18 updating version 0 to 16892 2024-03-04T06:52:00.287 INFO:tasks.rados.rados.0.smithi137.stdout:3114: oid 18 updating version 16892 to 16893 2024-03-04T06:52:00.287 INFO:tasks.rados.rados.0.smithi137.stdout:3114: oid 18 updating version 16893 to 16896 2024-03-04T06:52:00.287 INFO:tasks.rados.rados.0.smithi137.stdout:3114: oid 18 version 16896 is already newer than 16895 2024-03-04T06:52:00.287 INFO:tasks.rados.rados.0.smithi137.stdout:3114: oid 18 version 16896 is already newer than 16894 2024-03-04T06:52:00.287 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16896 (ObjNum 983 snap 287 seq_num 983) dirty exists 2024-03-04T06:52:00.287 INFO:tasks.rados.rados.0.smithi137.stdout:3114: left oid 18 (ObjNum 983 snap 287 seq_num 983) 2024-03-04T06:52:00.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:00.144+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:00.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:00.133+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:00.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:00.133+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:00.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:00.139+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:00.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: from='client.44384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:52:00.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:00.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:00.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:00.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: osdmap e641: 8 total, 8 up, 8 in 2024-03-04T06:52:00.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:00.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:00.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:00.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:00.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:00.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:00.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:00.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: from='client.44390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:52:00.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/2988966250' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:00.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:00.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:00.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: from='client.44384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:52:00.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:00.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:00.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:00.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: osdmap e641: 8 total, 8 up, 8 in 2024-03-04T06:52:00.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:00.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:00.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:00.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:00.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:00.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:00.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:00.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: from='client.44390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:52:00.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/2988966250' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:00.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:00.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:00 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:00.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:00.133+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:00.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:00.148+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:00.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:00.148+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:00.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:00.138+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:00.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:00.138+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:00.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:00.204+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:00.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:00.204+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:00.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:00.204+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:00.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: from='client.44384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:52:00.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:00.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:00.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:00.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: osdmap e641: 8 total, 8 up, 8 in 2024-03-04T06:52:00.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:00.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: from='client.44390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:52:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/2988966250' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:00.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:00 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:01.147 INFO:tasks.rados.rados.0.smithi137.stdout:3111: done (4 left) 2024-03-04T06:52:01.147 INFO:tasks.rados.rados.0.smithi137.stdout:3112: done (3 left) 2024-03-04T06:52:01.147 INFO:tasks.rados.rados.0.smithi137.stdout:3113: done (2 left) 2024-03-04T06:52:01.147 INFO:tasks.rados.rados.0.smithi137.stdout:3114: done (1 left) 2024-03-04T06:52:01.147 INFO:tasks.rados.rados.0.smithi137.stdout:3116: done (0 left) 2024-03-04T06:52:01.147 INFO:tasks.rados.rados.0.smithi137.stdout:3117: delete oid 7 current snap is 288 2024-03-04T06:52:01.150 INFO:tasks.rados.rados.0.smithi137.stdout:3117: done (0 left) 2024-03-04T06:52:01.150 INFO:tasks.rados.rados.0.smithi137.stdout:3118: snap_remove snap 280 2024-03-04T06:52:01.478 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:01.144+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:01.478 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:01.149+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:01.478 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:01.149+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:01.478 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:01.149+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:01.479 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:01.479 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:01.479 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-mon[85573]: osdmap e642: 8 total, 8 up, 8 in 2024-03-04T06:52:01.479 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:01.479 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:01.479 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:01.479 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:01.479 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:01.479 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:01.479 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-mon[85573]: pgmap v644: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 552 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 8.4 MiB/s rd, 4.2 MiB/s wr, 49 op/s 2024-03-04T06:52:01.479 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:01.479 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:01 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:01.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:01.145+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:01.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:01.150+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:01.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:01.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:01.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[91314]: osdmap e642: 8 total, 8 up, 8 in 2024-03-04T06:52:01.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:01.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:01.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:01.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:01.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:01.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:01.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[91314]: pgmap v644: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 552 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 8.4 MiB/s rd, 4.2 MiB/s wr, 49 op/s 2024-03-04T06:52:01.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:01.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:01.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[88869]: osdmap e642: 8 total, 8 up, 8 in 2024-03-04T06:52:01.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:01.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:01.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:01.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:01.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:01.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:01.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[88869]: pgmap v644: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 552 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 8.4 MiB/s rd, 4.2 MiB/s wr, 49 op/s 2024-03-04T06:52:01.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:01.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:01 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:02.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:02.017+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:02.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:02.017+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:02.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:02.017+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:02.157 INFO:tasks.rados.rados.0.smithi137.stdout:3118: done (0 left) 2024-03-04T06:52:02.157 INFO:tasks.rados.rados.0.smithi137.stdout:3119: read oid 20 snap -1 2024-03-04T06:52:02.157 INFO:tasks.rados.rados.0.smithi137.stdout:3119: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:52:02.157 INFO:tasks.rados.rados.0.smithi137.stdout:3120: read oid 14 snap 266 2024-03-04T06:52:02.157 INFO:tasks.rados.rados.0.smithi137.stdout:3120: expect (ObjNum 911 snap 266 seq_num 911) 2024-03-04T06:52:02.157 INFO:tasks.rados.rados.0.smithi137.stdout:3121: setattr oid 25 current snap is 288 2024-03-04T06:52:02.158 INFO:tasks.rados.rados.0.smithi137.stdout:3122: snap_remove snap 267 2024-03-04T06:52:02.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:02.165+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:02.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:02.159+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:02.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:02.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[91314]: osdmap e643: 8 total, 8 up, 8 in 2024-03-04T06:52:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[88869]: osdmap e643: 8 total, 8 up, 8 in 2024-03-04T06:52:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:02.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:02.017+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:02.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:02.017+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:02.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:02.017+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:02.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:02.167+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:02.296 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:02.171+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:02.438 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:02.155+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:02.438 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:02.155+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:02.438 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:02.161+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:02.438 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:02.162+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:02.438 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:02.162+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:02.439 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:02.439 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:02.439 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:02.439 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:02.439 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-mon[85573]: osdmap e643: 8 total, 8 up, 8 in 2024-03-04T06:52:02.439 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:02.439 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:02.439 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:02.439 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:02.439 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:02.440 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:02.172+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:02.440 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:02.330+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:02.440 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:02.330+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:03.163 INFO:tasks.rados.rados.0.smithi137.stdout:3122: done (3 left) 2024-03-04T06:52:03.163 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 37 current snap is 288 2024-03-04T06:52:03.163 INFO:tasks.rados.rados.0.smithi137.stdout:3123: seq_num 985 ranges {0=499712,499712=483328,983040=450560,1433600=581632,2015232=90112} 2024-03-04T06:52:03.166 INFO:tasks.rados.rados.0.smithi137.stdout:3123: writing smithi13777483-37 from 0 to 499712 tid 1 2024-03-04T06:52:03.170 INFO:tasks.rados.rados.0.smithi137.stdout:3123: writing smithi13777483-37 from 499712 to 983040 tid 2 2024-03-04T06:52:03.174 INFO:tasks.rados.rados.0.smithi137.stdout:3123: writing smithi13777483-37 from 983040 to 1433600 tid 3 2024-03-04T06:52:03.177 INFO:tasks.rados.rados.0.smithi137.stdout:3123: writing smithi13777483-37 from 1433600 to 2015232 tid 4 2024-03-04T06:52:03.177 INFO:tasks.rados.rados.0.smithi137.stdout:3123: writing smithi13777483-37 from 2015232 to 2105344 tid 5 2024-03-04T06:52:03.177 INFO:tasks.rados.rados.0.smithi137.stdout:3124: copy_from oid 2 from oid 8 current snap is 288 2024-03-04T06:52:03.177 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 16914 (ObjNum 129 snap 0 seq_num 3132251448) dirty exists 2024-03-04T06:52:03.178 INFO:tasks.rados.rados.0.smithi137.stdout:3119: expect (ObjNum 853 snap 249 seq_num 853) 2024-03-04T06:52:03.247 INFO:tasks.rados.rados.0.smithi137.stdout:3120: expect (ObjNum 911 snap 266 seq_num 911) 2024-03-04T06:52:03.371 INFO:tasks.rados.rados.0.smithi137.stdout:3123: finishing write tid 1 to smithi13777483-37 2024-03-04T06:52:03.371 INFO:tasks.rados.rados.0.smithi137.stdout:3123: finishing write tid 2 to smithi13777483-37 2024-03-04T06:52:03.371 INFO:tasks.rados.rados.0.smithi137.stdout:3123: finishing write tid 3 to smithi13777483-37 2024-03-04T06:52:03.372 INFO:tasks.rados.rados.0.smithi137.stdout:3123: finishing write tid 4 to smithi13777483-37 2024-03-04T06:52:03.372 INFO:tasks.rados.rados.0.smithi137.stdout:3123: finishing write tid 5 to smithi13777483-37 2024-03-04T06:52:03.372 INFO:tasks.rados.rados.0.smithi137.stdout:3123: finishing write tid 6 to smithi13777483-37 2024-03-04T06:52:03.372 INFO:tasks.rados.rados.0.smithi137.stdout:3123: finishing write tid 7 to smithi13777483-37 2024-03-04T06:52:03.372 INFO:tasks.rados.rados.0.smithi137.stdout:3123: oid 37 updating version 0 to 16917 2024-03-04T06:52:03.372 INFO:tasks.rados.rados.0.smithi137.stdout:3123: oid 37 updating version 16917 to 16920 2024-03-04T06:52:03.372 INFO:tasks.rados.rados.0.smithi137.stdout:3123: oid 37 version 16920 is already newer than 16918 2024-03-04T06:52:03.372 INFO:tasks.rados.rados.0.smithi137.stdout:3123: oid 37 updating version 16920 to 16921 2024-03-04T06:52:03.372 INFO:tasks.rados.rados.0.smithi137.stdout:3123: oid 37 version 16921 is already newer than 16919 2024-03-04T06:52:03.372 INFO:tasks.rados.rados.0.smithi137.stdout:3123: oid 37 version 16921 is already newer than 16916 2024-03-04T06:52:03.373 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16921 (ObjNum 985 snap 288 seq_num 985) dirty exists 2024-03-04T06:52:03.373 INFO:tasks.rados.rados.0.smithi137.stdout:3123: left oid 37 (ObjNum 985 snap 288 seq_num 985) 2024-03-04T06:52:03.373 INFO:tasks.rados.rados.0.smithi137.stdout:3124: finishing copy_from racing read to smithi13777483-2 2024-03-04T06:52:03.373 INFO:tasks.rados.rados.0.smithi137.stdout:3124: finishing copy_from to smithi13777483-2 2024-03-04T06:52:03.373 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16912 (ObjNum 954 snap 281 seq_num 954) dirty exists 2024-03-04T06:52:03.373 INFO:tasks.rados.rados.0.smithi137.stdout:3119: done (4 left) 2024-03-04T06:52:03.373 INFO:tasks.rados.rados.0.smithi137.stdout:3120: done (3 left) 2024-03-04T06:52:03.373 INFO:tasks.rados.rados.0.smithi137.stdout:3121: done (2 left) 2024-03-04T06:52:03.373 INFO:tasks.rados.rados.0.smithi137.stdout:3123: done (1 left) 2024-03-04T06:52:03.373 INFO:tasks.rados.rados.0.smithi137.stdout:3124: done (0 left) 2024-03-04T06:52:03.374 INFO:tasks.rados.rados.0.smithi137.stdout:3125: snap_remove snap 270 2024-03-04T06:52:03.531 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:03.165+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:03.531 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:03.190+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:03.532 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:03.188+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:03.532 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:03.188+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:03.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:03.533 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:03.533 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:03.533 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:03.533 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:03.533 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: osdmap e644: 8 total, 8 up, 8 in 2024-03-04T06:52:03.533 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:03.533 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:03.533 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:03.533 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:03.533 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:03.534 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:03.534 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:03.534 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:03.534 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-mon[85573]: pgmap v647: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 552 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2024-03-04T06:52:03.534 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:03.159+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:03.534 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:03.159+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:03.534 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:03.159+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:03.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:03.171+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:03.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:03.167+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:03.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:03.167+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:03.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:03.167+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:03.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:03.159+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:03.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:03.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:03.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:03.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:03.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:03.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: osdmap e644: 8 total, 8 up, 8 in 2024-03-04T06:52:03.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:03.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:03.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:03.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:03.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:03.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:03.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:03.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:03.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[88869]: pgmap v647: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 552 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2024-03-04T06:52:03.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:03.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:03.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:03.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:03.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:03.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: osdmap e644: 8 total, 8 up, 8 in 2024-03-04T06:52:03.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:03.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:03.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:03.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:03.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:03.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:03.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:03.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:03.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:03 smithi137 ceph-mon[91314]: pgmap v647: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 552 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2024-03-04T06:52:04.169 INFO:tasks.rados.rados.0.smithi137.stdout:3125: done (0 left) 2024-03-04T06:52:04.169 INFO:tasks.rados.rados.0.smithi137.stdout:3126: read oid 24 snap 281 2024-03-04T06:52:04.169 INFO:tasks.rados.rados.0.smithi137.stdout:3126: expect deleted 2024-03-04T06:52:04.169 INFO:tasks.rados.rados.0.smithi137.stdout:3127: read oid 34 snap -1 2024-03-04T06:52:04.170 INFO:tasks.rados.rados.0.smithi137.stdout:3127: expect (ObjNum 886 snap 259 seq_num 886) 2024-03-04T06:52:04.170 INFO:tasks.rados.rados.0.smithi137.stdout:3128: delete oid 26 current snap is 288 2024-03-04T06:52:04.175 INFO:tasks.rados.rados.0.smithi137.stdout:3127: expect (ObjNum 886 snap 259 seq_num 886) 2024-03-04T06:52:04.198 INFO:tasks.rados.rados.0.smithi137.stdout:3126: done (2 left) 2024-03-04T06:52:04.198 INFO:tasks.rados.rados.0.smithi137.stdout:3127: done (1 left) 2024-03-04T06:52:04.198 INFO:tasks.rados.rados.0.smithi137.stdout:3128: done (0 left) 2024-03-04T06:52:04.198 INFO:tasks.rados.rados.0.smithi137.stdout:3129: snap_create 2024-03-04T06:52:04.238 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:04.173+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:04.238 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:04.173+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:04.239 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:04.173+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:04.239 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:04.165+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:04.240 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:04.165+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:04.240 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:04.165+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:04.240 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:04.240 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:04.240 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:04.241 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-mon[85573]: osdmap e645: 8 total, 8 up, 8 in 2024-03-04T06:52:04.241 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:04.241 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:04.241 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:04.241 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:04.241 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:04.241 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:04.241 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:04.241 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:04.172+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:04.242 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:04.172+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:04.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:04.167+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:04.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:04.171+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[88869]: osdmap e645: 8 total, 8 up, 8 in 2024-03-04T06:52:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:04.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:04.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:04.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:04.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:04.177+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:04.545 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:04.170+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:04.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:04.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:04.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:04.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[91314]: osdmap e645: 8 total, 8 up, 8 in 2024-03-04T06:52:04.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:04.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:04.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:04.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:04.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:04.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:04.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:05.178 INFO:tasks.rados.rados.0.smithi137.stdout:3129: done (0 left) 2024-03-04T06:52:05.178 INFO:tasks.rados.rados.0.smithi137.stdout:3130: read oid 27 snap 286 2024-03-04T06:52:05.178 INFO:tasks.rados.rados.0.smithi137.stdout:3130: expect (ObjNum 798 snap 231 seq_num 798) 2024-03-04T06:52:05.178 INFO:tasks.rados.rados.0.smithi137.stdout:3131: snap_create 2024-03-04T06:52:05.205 INFO:tasks.rados.rados.0.smithi137.stdout:3130: expect (ObjNum 798 snap 231 seq_num 798) 2024-03-04T06:52:05.542 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:52:05] "GET /metrics HTTP/1.1" 200 36342 "" "Prometheus/2.43.0" 2024-03-04T06:52:05.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:05.177+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:05.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:05.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:05.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: osdmap e646: 8 total, 8 up, 8 in 2024-03-04T06:52:05.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:05.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:05.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:05.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:05.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:05.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:05.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: pgmap v650: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 570 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 7.1 MiB/s rd, 4.9 MiB/s wr, 16 op/s 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-04T06:52:05.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-04T06:52:05.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-04T06:52:05.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-04T06:52:05.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-04T06:52:05.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-04T06:52:05.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-04T06:52:05.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-04T06:52:05.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-04T06:52:05.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-04T06:52:05.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-04T06:52:05.547 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-04T06:52:05.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:05.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:05.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: osdmap e646: 8 total, 8 up, 8 in 2024-03-04T06:52:05.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:05.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:05.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:05.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:05.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:05.548 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: pgmap v650: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 570 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 7.1 MiB/s rd, 4.9 MiB/s wr, 16 op/s 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.550 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.550 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.550 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.550 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-04T06:52:05.550 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.550 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-04T06:52:05.550 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-04T06:52:05.550 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-04T06:52:05.550 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:52:05.551 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:52:05.552 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:52:05.552 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.552 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:52:05.552 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:52:05.552 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:52:05.552 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-04T06:52:05.553 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-04T06:52:05.554 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:52:05.555 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:52:05.556 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.556 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:52:05.556 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:52:05.556 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:52:05.556 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:05.180+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:05.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:05.181+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:05.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: osdmap e646: 8 total, 8 up, 8 in 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: pgmap v650: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 570 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 7.1 MiB/s rd, 4.9 MiB/s wr, 16 op/s 2024-03-04T06:52:05.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-04T06:52:05.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-04T06:52:05.600 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:52:05.601 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:52:05.602 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:06.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:05.769+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:06.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:05.770+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:06.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:05.770+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:06.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:05.770+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:06.095 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:05.770+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:06.095 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:05.770+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:06.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:05.769+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:06.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:05.769+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:06.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:05.770+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:06.180 INFO:tasks.rados.rados.0.smithi137.stdout:3130: done (1 left) 2024-03-04T06:52:06.180 INFO:tasks.rados.rados.0.smithi137.stdout:3131: done (0 left) 2024-03-04T06:52:06.180 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 290 2024-03-04T06:52:06.180 INFO:tasks.rados.rados.0.smithi137.stdout:3132: seq_num 987 ranges {1581056=532480,2113536=647168,2760704=417792,3178496=409600,3588096=131072} 2024-03-04T06:52:06.191 INFO:tasks.rados.rados.0.smithi137.stdout:3132: writing smithi13777483-12 from 1581056 to 2113536 tid 1 2024-03-04T06:52:06.195 INFO:tasks.rados.rados.0.smithi137.stdout:3132: writing smithi13777483-12 from 2113536 to 2760704 tid 2 2024-03-04T06:52:06.197 INFO:tasks.rados.rados.0.smithi137.stdout:3132: writing smithi13777483-12 from 2760704 to 3178496 tid 3 2024-03-04T06:52:06.200 INFO:tasks.rados.rados.0.smithi137.stdout:3132: writing smithi13777483-12 from 3178496 to 3588096 tid 4 2024-03-04T06:52:06.202 INFO:tasks.rados.rados.0.smithi137.stdout:3132: writing smithi13777483-12 from 3588096 to 3719168 tid 5 2024-03-04T06:52:06.202 INFO:tasks.rados.rados.0.smithi137.stdout:3133: rollback oid 35 current snap is 290 2024-03-04T06:52:06.202 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 35 to 289 2024-03-04T06:52:06.202 INFO:tasks.rados.rados.0.smithi137.stdout:3134: setattr oid 30 current snap is 290 2024-03-04T06:52:06.203 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 290 2024-03-04T06:52:06.203 INFO:tasks.rados.rados.0.smithi137.stdout:3135: seq_num 988 ranges {0=557056,557056=532480,1089536=622592,1712128=450560} 2024-03-04T06:52:06.206 INFO:tasks.rados.rados.0.smithi137.stdout:3135: writing smithi13777483-19 from 0 to 557056 tid 1 2024-03-04T06:52:06.210 INFO:tasks.rados.rados.0.smithi137.stdout:3135: writing smithi13777483-19 from 557056 to 1089536 tid 2 2024-03-04T06:52:06.214 INFO:tasks.rados.rados.0.smithi137.stdout:3135: writing smithi13777483-19 from 1089536 to 1712128 tid 3 2024-03-04T06:52:06.217 INFO:tasks.rados.rados.0.smithi137.stdout:3135: writing smithi13777483-19 from 1712128 to 2162688 tid 4 2024-03-04T06:52:06.217 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 290 2024-03-04T06:52:06.217 INFO:tasks.rados.rados.0.smithi137.stdout:3132: finishing write tid 1 to smithi13777483-12 2024-03-04T06:52:06.217 INFO:tasks.rados.rados.0.smithi137.stdout:3132: finishing write tid 2 to smithi13777483-12 2024-03-04T06:52:06.217 INFO:tasks.rados.rados.0.smithi137.stdout:3132: finishing write tid 3 to smithi13777483-12 2024-03-04T06:52:06.217 INFO:tasks.rados.rados.0.smithi137.stdout:3136: seq_num 989 ranges {5873664=573440,6447104=466944,6914048=434176,7348224=638976,7987200=65536} 2024-03-04T06:52:06.251 INFO:tasks.rados.rados.0.smithi137.stdout:3136: writing smithi13777483-11 from 5873664 to 6447104 tid 1 2024-03-04T06:52:06.253 INFO:tasks.rados.rados.0.smithi137.stdout:3136: writing smithi13777483-11 from 6447104 to 6914048 tid 2 2024-03-04T06:52:06.256 INFO:tasks.rados.rados.0.smithi137.stdout:3136: writing smithi13777483-11 from 6914048 to 7348224 tid 3 2024-03-04T06:52:06.261 INFO:tasks.rados.rados.0.smithi137.stdout:3136: writing smithi13777483-11 from 7348224 to 7987200 tid 4 2024-03-04T06:52:06.261 INFO:tasks.rados.rados.0.smithi137.stdout:3136: writing smithi13777483-11 from 7987200 to 8052736 tid 5 2024-03-04T06:52:06.261 INFO:tasks.rados.rados.0.smithi137.stdout:3137: delete oid 49 current snap is 290 2024-03-04T06:52:06.261 INFO:tasks.rados.rados.0.smithi137.stdout:3132: finishing write tid 4 to smithi13777483-12 2024-03-04T06:52:06.261 INFO:tasks.rados.rados.0.smithi137.stdout:3132: finishing write tid 5 to smithi13777483-12 2024-03-04T06:52:06.261 INFO:tasks.rados.rados.0.smithi137.stdout:3132: finishing write tid 6 to smithi13777483-12 2024-03-04T06:52:06.261 INFO:tasks.rados.rados.0.smithi137.stdout:3133: finishing rollback tid 0 to smithi13777483-35 2024-03-04T06:52:06.261 INFO:tasks.rados.rados.0.smithi137.stdout:3133: finishing rollback tid 1 to smithi13777483-35 2024-03-04T06:52:06.261 INFO:tasks.rados.rados.0.smithi137.stdout:3133: finishing rollback tid 2 to smithi13777483-35 2024-03-04T06:52:06.261 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16920 (ObjNum 927 snap 272 seq_num 927) dirty exists 2024-03-04T06:52:06.261 INFO:tasks.rados.rados.0.smithi137.stdout:3132: finishing write tid 7 to smithi13777483-12 2024-03-04T06:52:06.261 INFO:tasks.rados.rados.0.smithi137.stdout:3132: oid 12 updating version 0 to 16905 2024-03-04T06:52:06.261 INFO:tasks.rados.rados.0.smithi137.stdout:3132: oid 12 version 16905 is already newer than 16903 2024-03-04T06:52:06.262 INFO:tasks.rados.rados.0.smithi137.stdout:3132: oid 12 updating version 16905 to 16906 2024-03-04T06:52:06.262 INFO:tasks.rados.rados.0.smithi137.stdout:3132: oid 12 updating version 16906 to 16908 2024-03-04T06:52:06.262 INFO:tasks.rados.rados.0.smithi137.stdout:3132: oid 12 version 16908 is already newer than 16907 2024-03-04T06:52:06.262 INFO:tasks.rados.rados.0.smithi137.stdout:3132: oid 12 version 16908 is already newer than 16904 2024-03-04T06:52:06.262 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16908 (ObjNum 987 snap 290 seq_num 987) dirty exists 2024-03-04T06:52:06.262 INFO:tasks.rados.rados.0.smithi137.stdout:3132: left oid 12 (ObjNum 987 snap 290 seq_num 987) 2024-03-04T06:52:06.262 INFO:tasks.rados.rados.0.smithi137.stdout:3135: finishing write tid 1 to smithi13777483-19 2024-03-04T06:52:06.262 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16909 (ObjNum 982 snap 287 seq_num 982) dirty exists 2024-03-04T06:52:06.262 INFO:tasks.rados.rados.0.smithi137.stdout:3135: finishing write tid 2 to smithi13777483-19 2024-03-04T06:52:06.262 INFO:tasks.rados.rados.0.smithi137.stdout:3135: finishing write tid 3 to smithi13777483-19 2024-03-04T06:52:06.262 INFO:tasks.rados.rados.0.smithi137.stdout:3135: finishing write tid 4 to smithi13777483-19 2024-03-04T06:52:06.262 INFO:tasks.rados.rados.0.smithi137.stdout:3135: finishing write tid 5 to smithi13777483-19 2024-03-04T06:52:06.262 INFO:tasks.rados.rados.0.smithi137.stdout:3135: finishing write tid 6 to smithi13777483-19 2024-03-04T06:52:06.263 INFO:tasks.rados.rados.0.smithi137.stdout:3135: oid 19 updating version 0 to 16935 2024-03-04T06:52:06.263 INFO:tasks.rados.rados.0.smithi137.stdout:3135: oid 19 updating version 16935 to 16936 2024-03-04T06:52:06.263 INFO:tasks.rados.rados.0.smithi137.stdout:3135: oid 19 updating version 16936 to 16938 2024-03-04T06:52:06.263 INFO:tasks.rados.rados.0.smithi137.stdout:3135: oid 19 version 16938 is already newer than 16937 2024-03-04T06:52:06.263 INFO:tasks.rados.rados.0.smithi137.stdout:3135: oid 19 updating version 16938 to 16939 2024-03-04T06:52:06.263 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 16939 (ObjNum 988 snap 290 seq_num 988) dirty exists 2024-03-04T06:52:06.263 INFO:tasks.rados.rados.0.smithi137.stdout:3135: left oid 19 (ObjNum 988 snap 290 seq_num 988) 2024-03-04T06:52:06.263 INFO:tasks.rados.rados.0.smithi137.stdout:3136: finishing write tid 1 to smithi13777483-11 2024-03-04T06:52:06.263 INFO:tasks.rados.rados.0.smithi137.stdout:3136: finishing write tid 2 to smithi13777483-11 2024-03-04T06:52:06.263 INFO:tasks.rados.rados.0.smithi137.stdout:3136: finishing write tid 3 to smithi13777483-11 2024-03-04T06:52:06.264 INFO:tasks.rados.rados.0.smithi137.stdout:3132: done (5 left) 2024-03-04T06:52:06.264 INFO:tasks.rados.rados.0.smithi137.stdout:3133: done (4 left) 2024-03-04T06:52:06.264 INFO:tasks.rados.rados.0.smithi137.stdout:3134: done (3 left) 2024-03-04T06:52:06.264 INFO:tasks.rados.rados.0.smithi137.stdout:3135: done (2 left) 2024-03-04T06:52:06.264 INFO:tasks.rados.rados.0.smithi137.stdout:3137: done (1 left) 2024-03-04T06:52:06.264 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 290 2024-03-04T06:52:06.264 INFO:tasks.rados.rados.0.smithi137.stdout:3138: seq_num 991 ranges {0=606208,606208=638976,1245184=794624,2039808=172032} 2024-03-04T06:52:06.266 INFO:tasks.rados.rados.0.smithi137.stdout:3138: writing smithi13777483-10 from 0 to 606208 tid 1 2024-03-04T06:52:06.271 INFO:tasks.rados.rados.0.smithi137.stdout:3138: writing smithi13777483-10 from 606208 to 1245184 tid 2 2024-03-04T06:52:06.275 INFO:tasks.rados.rados.0.smithi137.stdout:3138: writing smithi13777483-10 from 1245184 to 2039808 tid 3 2024-03-04T06:52:06.277 INFO:tasks.rados.rados.0.smithi137.stdout:3138: writing smithi13777483-10 from 2039808 to 2211840 tid 4 2024-03-04T06:52:06.277 INFO:tasks.rados.rados.0.smithi137.stdout:3139: snap_create 2024-03-04T06:52:06.277 INFO:tasks.rados.rados.0.smithi137.stdout:3136: finishing write tid 4 to smithi13777483-11 2024-03-04T06:52:06.277 INFO:tasks.rados.rados.0.smithi137.stdout:3136: finishing write tid 5 to smithi13777483-11 2024-03-04T06:52:06.277 INFO:tasks.rados.rados.0.smithi137.stdout:3136: finishing write tid 6 to smithi13777483-11 2024-03-04T06:52:06.277 INFO:tasks.rados.rados.0.smithi137.stdout:3136: finishing write tid 7 to smithi13777483-11 2024-03-04T06:52:06.277 INFO:tasks.rados.rados.0.smithi137.stdout:3136: oid 11 updating version 0 to 16924 2024-03-04T06:52:06.277 INFO:tasks.rados.rados.0.smithi137.stdout:3136: oid 11 version 16924 is already newer than 16920 2024-03-04T06:52:06.277 INFO:tasks.rados.rados.0.smithi137.stdout:3136: oid 11 updating version 16924 to 16925 2024-03-04T06:52:06.277 INFO:tasks.rados.rados.0.smithi137.stdout:3136: oid 11 version 16925 is already newer than 16921 2024-03-04T06:52:06.277 INFO:tasks.rados.rados.0.smithi137.stdout:3136: oid 11 version 16925 is already newer than 16923 2024-03-04T06:52:06.277 INFO:tasks.rados.rados.0.smithi137.stdout:3136: oid 11 version 16925 is already newer than 16922 2024-03-04T06:52:06.278 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16925 (ObjNum 989 snap 290 seq_num 989) dirty exists 2024-03-04T06:52:06.278 INFO:tasks.rados.rados.0.smithi137.stdout:3136: left oid 11 (ObjNum 989 snap 290 seq_num 989) 2024-03-04T06:52:06.278 INFO:tasks.rados.rados.0.smithi137.stdout:3138: finishing write tid 1 to smithi13777483-10 2024-03-04T06:52:06.278 INFO:tasks.rados.rados.0.smithi137.stdout:3138: finishing write tid 2 to smithi13777483-10 2024-03-04T06:52:06.280 INFO:tasks.rados.rados.0.smithi137.stdout:3138: finishing write tid 3 to smithi13777483-10 2024-03-04T06:52:06.280 INFO:tasks.rados.rados.0.smithi137.stdout:3138: finishing write tid 4 to smithi13777483-10 2024-03-04T06:52:06.280 INFO:tasks.rados.rados.0.smithi137.stdout:3138: finishing write tid 5 to smithi13777483-10 2024-03-04T06:52:06.283 INFO:tasks.rados.rados.0.smithi137.stdout:3138: finishing write tid 6 to smithi13777483-10 2024-03-04T06:52:06.283 INFO:tasks.rados.rados.0.smithi137.stdout:3138: oid 10 updating version 0 to 16942 2024-03-04T06:52:06.284 INFO:tasks.rados.rados.0.smithi137.stdout:3138: oid 10 updating version 16942 to 16943 2024-03-04T06:52:06.284 INFO:tasks.rados.rados.0.smithi137.stdout:3138: oid 10 version 16943 is already newer than 16941 2024-03-04T06:52:06.284 INFO:tasks.rados.rados.0.smithi137.stdout:3138: oid 10 version 16943 is already newer than 16940 2024-03-04T06:52:06.284 INFO:tasks.rados.rados.0.smithi137.stdout:3138: oid 10 updating version 16943 to 16944 2024-03-04T06:52:06.284 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 16944 (ObjNum 991 snap 290 seq_num 991) dirty exists 2024-03-04T06:52:06.284 INFO:tasks.rados.rados.0.smithi137.stdout:3138: left oid 10 (ObjNum 991 snap 290 seq_num 991) 2024-03-04T06:52:06.542 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:06.200+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:06.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:06.179+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:06.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:06.201+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:06.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:06.201+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:06.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[88869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-04T06:52:06.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[88869]: Upgrade: Finalizing container_image settings 2024-03-04T06:52:06.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[88869]: Upgrade: Complete! 2024-03-04T06:52:06.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[88869]: osdmap e647: 8 total, 8 up, 8 in 2024-03-04T06:52:06.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:06.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:06.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:06.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:06.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:06.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:06.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:06.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:06.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[91314]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-04T06:52:06.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[91314]: Upgrade: Finalizing container_image settings 2024-03-04T06:52:06.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[91314]: Upgrade: Complete! 2024-03-04T06:52:06.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[91314]: osdmap e647: 8 total, 8 up, 8 in 2024-03-04T06:52:06.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:06.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:06.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:06.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:06.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:06.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:06.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:06.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:06 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:06.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:06.195+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:06.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:06.254+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:06.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:06.254+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:06.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:06.205+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:06.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:06.205+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:06.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:06.180+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:06.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:06.180+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:06.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:06.180+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:06.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-mon[85573]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-04T06:52:06.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-mon[85573]: Upgrade: Finalizing container_image settings 2024-03-04T06:52:06.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-mon[85573]: Upgrade: Complete! 2024-03-04T06:52:06.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-mon[85573]: osdmap e647: 8 total, 8 up, 8 in 2024-03-04T06:52:06.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:06.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:06.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:06.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:06.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:06.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:06.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:06.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:06 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:07.199 INFO:tasks.rados.rados.0.smithi137.stdout:3136: done (2 left) 2024-03-04T06:52:07.200 INFO:tasks.rados.rados.0.smithi137.stdout:3138: done (1 left) 2024-03-04T06:52:07.200 INFO:tasks.rados.rados.0.smithi137.stdout:3139: done (0 left) 2024-03-04T06:52:07.200 INFO:tasks.rados.rados.0.smithi137.stdout:3140: read oid 2 snap 288 2024-03-04T06:52:07.200 INFO:tasks.rados.rados.0.smithi137.stdout:3140: expect (ObjNum 954 snap 281 seq_num 954) 2024-03-04T06:52:07.200 INFO:tasks.rados.rados.0.smithi137.stdout:3141: snap_create 2024-03-04T06:52:07.216 INFO:tasks.rados.rados.0.smithi137.stdout:3140: expect (ObjNum 954 snap 281 seq_num 954) 2024-03-04T06:52:07.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:07.198+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:07.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:07.198+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:07.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:07.198+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:07.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: osdmap e648: 8 total, 8 up, 8 in 2024-03-04T06:52:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:07.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[91314]: pgmap v653: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 570 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 7.1 MiB/s rd, 4.9 MiB/s wr, 21 op/s 2024-03-04T06:52:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: osdmap e648: 8 total, 8 up, 8 in 2024-03-04T06:52:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:07.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:07.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-mon[88869]: pgmap v653: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 570 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 7.1 MiB/s rd, 4.9 MiB/s wr, 21 op/s 2024-03-04T06:52:07.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:07.191+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:07.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:07.192+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:07.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:07.192+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: osdmap e648: 8 total, 8 up, 8 in 2024-03-04T06:52:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:07.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:07.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-mon[85573]: pgmap v653: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 570 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 7.1 MiB/s rd, 4.9 MiB/s wr, 21 op/s 2024-03-04T06:52:08.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:07.622+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:08.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:07.622+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:08.096 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:07.624+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:08.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:07.624+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:08.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:07.623+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:08.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:07.623+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:08.199 INFO:tasks.rados.rados.0.smithi137.stdout:3140: done (1 left) 2024-03-04T06:52:08.199 INFO:tasks.rados.rados.0.smithi137.stdout:3141: done (0 left) 2024-03-04T06:52:08.200 INFO:tasks.rados.rados.0.smithi137.stdout:3142: rollback oid 35 current snap is 292 2024-03-04T06:52:08.200 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 35 to 291 2024-03-04T06:52:08.200 INFO:tasks.rados.rados.0.smithi137.stdout:3143: rmattr oid 14 current snap is 292 2024-03-04T06:52:08.200 INFO:tasks.rados.rados.0.smithi137.stdout:3143: done (1 left) 2024-03-04T06:52:08.200 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 28 current snap is 292 2024-03-04T06:52:08.200 INFO:tasks.rados.rados.0.smithi137.stdout:3144: seq_num 992 ranges {1941504=622592,2564096=524288,3088384=606208,3694592=475136} 2024-03-04T06:52:08.213 INFO:tasks.rados.rados.0.smithi137.stdout:3144: writing smithi13777483-28 from 1941504 to 2564096 tid 1 2024-03-04T06:52:08.216 INFO:tasks.rados.rados.0.smithi137.stdout:3144: writing smithi13777483-28 from 2564096 to 3088384 tid 2 2024-03-04T06:52:08.220 INFO:tasks.rados.rados.0.smithi137.stdout:3144: writing smithi13777483-28 from 3088384 to 3694592 tid 3 2024-03-04T06:52:08.223 INFO:tasks.rados.rados.0.smithi137.stdout:3144: writing smithi13777483-28 from 3694592 to 4169728 tid 4 2024-03-04T06:52:08.223 INFO:tasks.rados.rados.0.smithi137.stdout:3145: snap_create 2024-03-04T06:52:08.223 INFO:tasks.rados.rados.0.smithi137.stdout:3142: finishing rollback tid 0 to smithi13777483-35 2024-03-04T06:52:08.223 INFO:tasks.rados.rados.0.smithi137.stdout:3142: finishing rollback tid 1 to smithi13777483-35 2024-03-04T06:52:08.223 INFO:tasks.rados.rados.0.smithi137.stdout:3142: finishing rollback tid 2 to smithi13777483-35 2024-03-04T06:52:08.223 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16924 (ObjNum 927 snap 272 seq_num 927) dirty exists 2024-03-04T06:52:08.224 INFO:tasks.rados.rados.0.smithi137.stdout:3144: finishing write tid 1 to smithi13777483-28 2024-03-04T06:52:08.224 INFO:tasks.rados.rados.0.smithi137.stdout:3144: finishing write tid 2 to smithi13777483-28 2024-03-04T06:52:08.224 INFO:tasks.rados.rados.0.smithi137.stdout:3144: finishing write tid 3 to smithi13777483-28 2024-03-04T06:52:08.226 INFO:tasks.rados.rados.0.smithi137.stdout:3144: finishing write tid 4 to smithi13777483-28 2024-03-04T06:52:08.226 INFO:tasks.rados.rados.0.smithi137.stdout:3144: finishing write tid 5 to smithi13777483-28 2024-03-04T06:52:08.228 INFO:tasks.rados.rados.0.smithi137.stdout:3144: finishing write tid 6 to smithi13777483-28 2024-03-04T06:52:08.228 INFO:tasks.rados.rados.0.smithi137.stdout:3144: oid 28 updating version 0 to 16919 2024-03-04T06:52:08.228 INFO:tasks.rados.rados.0.smithi137.stdout:3144: oid 28 version 16919 is already newer than 16918 2024-03-04T06:52:08.228 INFO:tasks.rados.rados.0.smithi137.stdout:3144: oid 28 version 16919 is already newer than 16917 2024-03-04T06:52:08.228 INFO:tasks.rados.rados.0.smithi137.stdout:3144: oid 28 version 16919 is already newer than 16915 2024-03-04T06:52:08.228 INFO:tasks.rados.rados.0.smithi137.stdout:3144: oid 28 version 16919 is already newer than 16916 2024-03-04T06:52:08.228 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16919 (ObjNum 992 snap 292 seq_num 992) dirty exists 2024-03-04T06:52:08.229 INFO:tasks.rados.rados.0.smithi137.stdout:3144: left oid 28 (ObjNum 992 snap 292 seq_num 992) 2024-03-04T06:52:08.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:08.197+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:08.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:08.198+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:08.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:08.206+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:08.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:08.231+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:08.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:08.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:08.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[91314]: osdmap e649: 8 total, 8 up, 8 in 2024-03-04T06:52:08.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:08.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:08.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:08.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:08.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:08.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:08.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:08.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:08.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:08.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[88869]: osdmap e649: 8 total, 8 up, 8 in 2024-03-04T06:52:08.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:08.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:08.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:08.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:08.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:08.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:08.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:08.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:08.196+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:08.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:08.196+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:08.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:08.231+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:08.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:08.206+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:08.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:08.206+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:08.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:08.204+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:08.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:08.205+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:08.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:08.206+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:08.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:08.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:08.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-mon[85573]: osdmap e649: 8 total, 8 up, 8 in 2024-03-04T06:52:08.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:08.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:08.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:08.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:08.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:08.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:08.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:09.212 INFO:tasks.rados.rados.0.smithi137.stdout:3142: done (2 left) 2024-03-04T06:52:09.212 INFO:tasks.rados.rados.0.smithi137.stdout:3144: done (1 left) 2024-03-04T06:52:09.212 INFO:tasks.rados.rados.0.smithi137.stdout:3145: done (0 left) 2024-03-04T06:52:09.212 INFO:tasks.rados.rados.0.smithi137.stdout:3146: copy_from oid 19 from oid 27 current snap is 293 2024-03-04T06:52:09.212 INFO:tasks.rados.rados.0.smithi137.stdout:3147: snap_remove snap 282 2024-03-04T06:52:09.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:09.269+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:09.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:09.236+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:09.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:09.236+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:09.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:09.236+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:09.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:09.212+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:09.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:09.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:09.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:09.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:09.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: osdmap e650: 8 total, 8 up, 8 in 2024-03-04T06:52:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:52:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: pgmap v656: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 579 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 8.2 MiB/s rd, 2.1 MiB/s wr, 20 op/s 2024-03-04T06:52:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:09.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:09.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:09.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:09.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:09.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: osdmap e650: 8 total, 8 up, 8 in 2024-03-04T06:52:09.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:09.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:09.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:09.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:09.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:09.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:09.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:09.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:52:09.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: pgmap v656: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 579 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 8.2 MiB/s rd, 2.1 MiB/s wr, 20 op/s 2024-03-04T06:52:09.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:09.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:09.215+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:09.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:09.269+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:09.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:09.269+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:09.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:09.270+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:09.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:09.210+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:09.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:09.210+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:09.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:09.210+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:09.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:09.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:09.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:09.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:09.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: osdmap e650: 8 total, 8 up, 8 in 2024-03-04T06:52:09.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:09.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:09.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:09.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:09.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:09.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:09.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:09.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:52:09.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: pgmap v656: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 579 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 8.2 MiB/s rd, 2.1 MiB/s wr, 20 op/s 2024-03-04T06:52:09.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:52:10.215 INFO:tasks.rados.rados.0.smithi137.stdout:3147: done (1 left) 2024-03-04T06:52:10.215 INFO:tasks.rados.rados.0.smithi137.stdout:3148: read oid 21 snap 281 2024-03-04T06:52:10.215 INFO:tasks.rados.rados.0.smithi137.stdout:3148: expect deleted 2024-03-04T06:52:10.215 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 293 2024-03-04T06:52:10.215 INFO:tasks.rados.rados.0.smithi137.stdout:3149: seq_num 993 ranges {0=638976,638976=409600,1048576=409600,1458176=688128,2146304=98304} 2024-03-04T06:52:10.219 INFO:tasks.rados.rados.0.smithi137.stdout:3149: writing smithi13777483-7 from 0 to 638976 tid 1 2024-03-04T06:52:10.222 INFO:tasks.rados.rados.0.smithi137.stdout:3149: writing smithi13777483-7 from 638976 to 1048576 tid 2 2024-03-04T06:52:10.225 INFO:tasks.rados.rados.0.smithi137.stdout:3149: writing smithi13777483-7 from 1048576 to 1458176 tid 3 2024-03-04T06:52:10.230 INFO:tasks.rados.rados.0.smithi137.stdout:3149: writing smithi13777483-7 from 1458176 to 2146304 tid 4 2024-03-04T06:52:10.231 INFO:tasks.rados.rados.0.smithi137.stdout:3149: writing smithi13777483-7 from 2146304 to 2244608 tid 5 2024-03-04T06:52:10.231 INFO:tasks.rados.rados.0.smithi137.stdout:3150: read oid 38 snap 289 2024-03-04T06:52:10.231 INFO:tasks.rados.rados.0.smithi137.stdout:3150: expect deleted 2024-03-04T06:52:10.231 INFO:tasks.rados.rados.0.smithi137.stdout:3151: delete oid 1 current snap is 293 2024-03-04T06:52:10.231 INFO:tasks.rados.rados.0.smithi137.stdout:3146: finishing copy_from racing read to smithi13777483-19 2024-03-04T06:52:10.231 INFO:tasks.rados.rados.0.smithi137.stdout:3146: finishing copy_from to smithi13777483-19 2024-03-04T06:52:10.231 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 16924 (ObjNum 798 snap 231 seq_num 798) dirty exists 2024-03-04T06:52:10.231 INFO:tasks.rados.rados.0.smithi137.stdout:3149: finishing write tid 1 to smithi13777483-7 2024-03-04T06:52:10.232 INFO:tasks.rados.rados.0.smithi137.stdout:3149: finishing write tid 2 to smithi13777483-7 2024-03-04T06:52:10.236 INFO:tasks.rados.rados.0.smithi137.stdout:3146: done (4 left) 2024-03-04T06:52:10.236 INFO:tasks.rados.rados.0.smithi137.stdout:3148: done (3 left) 2024-03-04T06:52:10.236 INFO:tasks.rados.rados.0.smithi137.stdout:3150: done (2 left) 2024-03-04T06:52:10.236 INFO:tasks.rados.rados.0.smithi137.stdout:3151: done (1 left) 2024-03-04T06:52:10.236 INFO:tasks.rados.rados.0.smithi137.stdout:3152: read oid 30 snap -1 2024-03-04T06:52:10.237 INFO:tasks.rados.rados.0.smithi137.stdout:3152: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:52:10.237 INFO:tasks.rados.rados.0.smithi137.stdout:3153: delete oid 50 current snap is 293 2024-03-04T06:52:10.237 INFO:tasks.rados.rados.0.smithi137.stdout:3149: finishing write tid 3 to smithi13777483-7 2024-03-04T06:52:10.237 INFO:tasks.rados.rados.0.smithi137.stdout:3149: finishing write tid 4 to smithi13777483-7 2024-03-04T06:52:10.237 INFO:tasks.rados.rados.0.smithi137.stdout:3149: finishing write tid 5 to smithi13777483-7 2024-03-04T06:52:10.237 INFO:tasks.rados.rados.0.smithi137.stdout:3149: finishing write tid 6 to smithi13777483-7 2024-03-04T06:52:10.240 INFO:tasks.rados.rados.0.smithi137.stdout:3149: finishing write tid 7 to smithi13777483-7 2024-03-04T06:52:10.240 INFO:tasks.rados.rados.0.smithi137.stdout:3149: oid 7 updating version 0 to 16930 2024-03-04T06:52:10.240 INFO:tasks.rados.rados.0.smithi137.stdout:3149: oid 7 updating version 16930 to 16931 2024-03-04T06:52:10.240 INFO:tasks.rados.rados.0.smithi137.stdout:3149: oid 7 version 16931 is already newer than 16926 2024-03-04T06:52:10.240 INFO:tasks.rados.rados.0.smithi137.stdout:3149: oid 7 version 16931 is already newer than 16929 2024-03-04T06:52:10.240 INFO:tasks.rados.rados.0.smithi137.stdout:3149: oid 7 version 16931 is already newer than 16927 2024-03-04T06:52:10.240 INFO:tasks.rados.rados.0.smithi137.stdout:3149: oid 7 version 16931 is already newer than 16928 2024-03-04T06:52:10.240 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16931 (ObjNum 993 snap 293 seq_num 993) dirty exists 2024-03-04T06:52:10.240 INFO:tasks.rados.rados.0.smithi137.stdout:3149: left oid 7 (ObjNum 993 snap 293 seq_num 993) 2024-03-04T06:52:10.241 INFO:tasks.rados.rados.0.smithi137.stdout:3149: done (2 left) 2024-03-04T06:52:10.241 INFO:tasks.rados.rados.0.smithi137.stdout:3153: done (1 left) 2024-03-04T06:52:10.241 INFO:tasks.rados.rados.0.smithi137.stdout:3154: copy_from oid 3 from oid 50 current snap is 293 2024-03-04T06:52:10.241 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 293 2024-03-04T06:52:10.241 INFO:tasks.rados.rados.0.smithi137.stdout:3155: seq_num 996 ranges {9699328=688128,10387456=507904,10895360=581632,11476992=516096} 2024-03-04T06:52:10.296 INFO:tasks.rados.rados.0.smithi137.stdout:3155: writing smithi13777483-47 from 9699328 to 10387456 tid 1 2024-03-04T06:52:10.299 INFO:tasks.rados.rados.0.smithi137.stdout:3155: writing smithi13777483-47 from 10387456 to 10895360 tid 2 2024-03-04T06:52:10.302 INFO:tasks.rados.rados.0.smithi137.stdout:3155: writing smithi13777483-47 from 10895360 to 11476992 tid 3 2024-03-04T06:52:10.305 INFO:tasks.rados.rados.0.smithi137.stdout:3155: writing smithi13777483-47 from 11476992 to 11993088 tid 4 2024-03-04T06:52:10.305 INFO:tasks.rados.rados.0.smithi137.stdout:3156: snap_remove snap 290 2024-03-04T06:52:10.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:10.227+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:10.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:10.213+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:10.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:10.214+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:10.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:10.223+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:10.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:10.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:10.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[88869]: osdmap e651: 8 total, 8 up, 8 in 2024-03-04T06:52:10.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:10.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:10.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:10.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:10.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:10.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:10.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:10.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:10.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:10.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:10.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[91314]: osdmap e651: 8 total, 8 up, 8 in 2024-03-04T06:52:10.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:10.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:10.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:10.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:10.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:10.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:10.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:10.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:10.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:10.218+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:10.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:10.219+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:10.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:10.212+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:10.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:10.233+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:10.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:10.234+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:10.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:10.234+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:10.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:10.431+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:10.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:10.431+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-mon[85573]: osdmap e651: 8 total, 8 up, 8 in 2024-03-04T06:52:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:10.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:11.227 INFO:tasks.rados.rados.0.smithi137.stdout:3154: finishing copy_from to smithi13777483-3 2024-03-04T06:52:11.227 INFO:tasks.rados.rados.0.smithi137.stdout:3154: got expected ENOENT (src dne) 2024-03-04T06:52:11.228 INFO:tasks.rados.rados.0.smithi137.stdout:3154: finishing copy_from racing read to smithi13777483-3 2024-03-04T06:52:11.228 INFO:tasks.rados.rados.0.smithi137.stdout:3152: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:52:11.385 INFO:tasks.rados.rados.0.smithi137.stdout:3155: finishing write tid 1 to smithi13777483-47 2024-03-04T06:52:11.385 INFO:tasks.rados.rados.0.smithi137.stdout:3155: finishing write tid 2 to smithi13777483-47 2024-03-04T06:52:11.385 INFO:tasks.rados.rados.0.smithi137.stdout:3152: done (3 left) 2024-03-04T06:52:11.385 INFO:tasks.rados.rados.0.smithi137.stdout:3154: done (2 left) 2024-03-04T06:52:11.385 INFO:tasks.rados.rados.0.smithi137.stdout:3156: done (1 left) 2024-03-04T06:52:11.385 INFO:tasks.rados.rados.0.smithi137.stdout:3157: snap_create 2024-03-04T06:52:11.385 INFO:tasks.rados.rados.0.smithi137.stdout:3155: finishing write tid 3 to smithi13777483-47 2024-03-04T06:52:11.385 INFO:tasks.rados.rados.0.smithi137.stdout:3155: finishing write tid 4 to smithi13777483-47 2024-03-04T06:52:11.385 INFO:tasks.rados.rados.0.smithi137.stdout:3155: finishing write tid 5 to smithi13777483-47 2024-03-04T06:52:11.385 INFO:tasks.rados.rados.0.smithi137.stdout:3155: finishing write tid 6 to smithi13777483-47 2024-03-04T06:52:11.385 INFO:tasks.rados.rados.0.smithi137.stdout:3155: oid 47 updating version 0 to 16923 2024-03-04T06:52:11.386 INFO:tasks.rados.rados.0.smithi137.stdout:3155: oid 47 version 16923 is already newer than 16922 2024-03-04T06:52:11.386 INFO:tasks.rados.rados.0.smithi137.stdout:3155: oid 47 version 16923 is already newer than 16920 2024-03-04T06:52:11.386 INFO:tasks.rados.rados.0.smithi137.stdout:3155: oid 47 version 16923 is already newer than 16921 2024-03-04T06:52:11.386 INFO:tasks.rados.rados.0.smithi137.stdout:3155: oid 47 updating version 16923 to 16924 2024-03-04T06:52:11.386 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16924 (ObjNum 996 snap 293 seq_num 996) dirty exists 2024-03-04T06:52:11.386 INFO:tasks.rados.rados.0.smithi137.stdout:3155: left oid 47 (ObjNum 996 snap 293 seq_num 996) 2024-03-04T06:52:11.531 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:11.223+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:11.531 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:11.223+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:11.531 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:11.223+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:11.531 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:11.376+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:11.531 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:11.376+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:11.531 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-mon[85573]: osdmap e652: 8 total, 8 up, 8 in 2024-03-04T06:52:11.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:11.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:11.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:11.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:11.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:11.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:11.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:11.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:11.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:11.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-mon[85573]: pgmap v659: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 581 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 8.2 MiB/s rd, 2.6 MiB/s wr, 17 op/s 2024-03-04T06:52:11.532 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:11.532 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:11.230+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:11.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:11.230+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:11.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:11.225+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:11.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:11.225+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:11.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:11.226+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:11.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:11.235+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[91314]: osdmap e652: 8 total, 8 up, 8 in 2024-03-04T06:52:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[91314]: pgmap v659: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 581 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 8.2 MiB/s rd, 2.6 MiB/s wr, 17 op/s 2024-03-04T06:52:11.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[88869]: osdmap e652: 8 total, 8 up, 8 in 2024-03-04T06:52:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:11.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:11.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:11.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[88869]: pgmap v659: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 581 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 8.2 MiB/s rd, 2.6 MiB/s wr, 17 op/s 2024-03-04T06:52:11.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:12.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:11.792+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:12.233 INFO:tasks.rados.rados.0.smithi137.stdout:3155: done (1 left) 2024-03-04T06:52:12.233 INFO:tasks.rados.rados.0.smithi137.stdout:3157: done (0 left) 2024-03-04T06:52:12.234 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 294 2024-03-04T06:52:12.234 INFO:tasks.rados.rados.0.smithi137.stdout:3158: seq_num 997 ranges {311296=704512,1015808=794624,1810432=794624,2605056=16384} 2024-03-04T06:52:12.239 INFO:tasks.rados.rados.0.smithi137.stdout:3158: writing smithi13777483-17 from 311296 to 1015808 tid 1 2024-03-04T06:52:12.243 INFO:tasks.rados.rados.0.smithi137.stdout:3158: writing smithi13777483-17 from 1015808 to 1810432 tid 2 2024-03-04T06:52:12.248 INFO:tasks.rados.rados.0.smithi137.stdout:3158: writing smithi13777483-17 from 1810432 to 2605056 tid 3 2024-03-04T06:52:12.248 INFO:tasks.rados.rados.0.smithi137.stdout:3158: writing smithi13777483-17 from 2605056 to 2621440 tid 4 2024-03-04T06:52:12.249 INFO:tasks.rados.rados.0.smithi137.stdout:3159: read oid 7 snap -1 2024-03-04T06:52:12.249 INFO:tasks.rados.rados.0.smithi137.stdout:3159: expect (ObjNum 993 snap 293 seq_num 993) 2024-03-04T06:52:12.249 INFO:tasks.rados.rados.0.smithi137.stdout:3160: snap_remove snap 266 2024-03-04T06:52:12.520 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:12.242+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:12.520 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:12.245+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:12.520 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:12.520 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:12.520 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:12.521 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:12.521 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-mon[85573]: osdmap e653: 8 total, 8 up, 8 in 2024-03-04T06:52:12.521 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:12.521 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:12.521 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:12.521 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:12.521 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:12.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:12.234+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:12.521 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:12.234+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:12.522 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:12.246+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:12.522 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:12.246+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:12.522 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:12.246+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:12.542 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:12.234+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:12.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:12.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:12.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:12.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:12.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[88869]: osdmap e653: 8 total, 8 up, 8 in 2024-03-04T06:52:12.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:12.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:12.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:12.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:12.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:12.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:12.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:12.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:12.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:12.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[91314]: osdmap e653: 8 total, 8 up, 8 in 2024-03-04T06:52:12.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:12.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:12.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:12.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:12.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:12.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:12.251+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:12.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:12.518+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:13.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:12.770+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:13.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:12.770+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:13.245 INFO:tasks.rados.rados.0.smithi137.stdout:3160: done (2 left) 2024-03-04T06:52:13.245 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 294 2024-03-04T06:52:13.245 INFO:tasks.rados.rados.0.smithi137.stdout:3161: seq_num 998 ranges {0=720896,720896=679936,1400832=598016,1998848=327680} 2024-03-04T06:52:13.250 INFO:tasks.rados.rados.0.smithi137.stdout:3161: writing smithi13777483-16 from 0 to 720896 tid 1 2024-03-04T06:52:13.254 INFO:tasks.rados.rados.0.smithi137.stdout:3161: writing smithi13777483-16 from 720896 to 1400832 tid 2 2024-03-04T06:52:13.259 INFO:tasks.rados.rados.0.smithi137.stdout:3161: writing smithi13777483-16 from 1400832 to 1998848 tid 3 2024-03-04T06:52:13.261 INFO:tasks.rados.rados.0.smithi137.stdout:3161: writing smithi13777483-16 from 1998848 to 2326528 tid 4 2024-03-04T06:52:13.262 INFO:tasks.rados.rados.0.smithi137.stdout:3162: rmattr oid 29 current snap is 294 2024-03-04T06:52:13.262 INFO:tasks.rados.rados.0.smithi137.stdout:3158: finishing write tid 1 to smithi13777483-17 2024-03-04T06:52:13.262 INFO:tasks.rados.rados.0.smithi137.stdout:3158: finishing write tid 2 to smithi13777483-17 2024-03-04T06:52:13.262 INFO:tasks.rados.rados.0.smithi137.stdout:3158: finishing write tid 3 to smithi13777483-17 2024-03-04T06:52:13.262 INFO:tasks.rados.rados.0.smithi137.stdout:3158: finishing write tid 4 to smithi13777483-17 2024-03-04T06:52:13.262 INFO:tasks.rados.rados.0.smithi137.stdout:3158: finishing write tid 5 to smithi13777483-17 2024-03-04T06:52:13.262 INFO:tasks.rados.rados.0.smithi137.stdout:3159: expect (ObjNum 993 snap 293 seq_num 993) 2024-03-04T06:52:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:3158: finishing write tid 6 to smithi13777483-17 2024-03-04T06:52:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:3158: oid 17 updating version 0 to 16907 2024-03-04T06:52:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:3158: oid 17 updating version 16907 to 16908 2024-03-04T06:52:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:3158: oid 17 version 16908 is already newer than 16904 2024-03-04T06:52:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:3158: oid 17 version 16908 is already newer than 16905 2024-03-04T06:52:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:3158: oid 17 version 16908 is already newer than 16906 2024-03-04T06:52:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16908 (ObjNum 997 snap 294 seq_num 997) dirty exists 2024-03-04T06:52:13.354 INFO:tasks.rados.rados.0.smithi137.stdout:3158: left oid 17 (ObjNum 997 snap 294 seq_num 997) 2024-03-04T06:52:13.355 INFO:tasks.rados.rados.0.smithi137.stdout:3158: done (3 left) 2024-03-04T06:52:13.355 INFO:tasks.rados.rados.0.smithi137.stdout:3159: done (2 left) 2024-03-04T06:52:13.355 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 31 current snap is 294 2024-03-04T06:52:13.355 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16898 (ObjNum 932 snap 275 seq_num 932) dirty exists 2024-03-04T06:52:13.355 INFO:tasks.rados.rados.0.smithi137.stdout:3161: finishing write tid 1 to smithi13777483-16 2024-03-04T06:52:13.355 INFO:tasks.rados.rados.0.smithi137.stdout:3161: finishing write tid 2 to smithi13777483-16 2024-03-04T06:52:13.355 INFO:tasks.rados.rados.0.smithi137.stdout:3161: finishing write tid 3 to smithi13777483-16 2024-03-04T06:52:13.355 INFO:tasks.rados.rados.0.smithi137.stdout:3163: seq_num 999 ranges {8421376=737280,9158656=565248,9723904=761856,10485760=278528} 2024-03-04T06:52:13.403 INFO:tasks.rados.rados.0.smithi137.stdout:3163: writing smithi13777483-31 from 8421376 to 9158656 tid 1 2024-03-04T06:52:13.406 INFO:tasks.rados.rados.0.smithi137.stdout:3163: writing smithi13777483-31 from 9158656 to 9723904 tid 2 2024-03-04T06:52:13.410 INFO:tasks.rados.rados.0.smithi137.stdout:3163: writing smithi13777483-31 from 9723904 to 10485760 tid 3 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:3163: writing smithi13777483-31 from 10485760 to 10764288 tid 4 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:3162: done (2 left) 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:3164: delete oid 50 current snap is 294 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:3161: finishing write tid 4 to smithi13777483-16 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:3161: finishing write tid 5 to smithi13777483-16 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:3161: finishing write tid 6 to smithi13777483-16 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:3161: oid 16 updating version 0 to 16888 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:3161: oid 16 updating version 16888 to 16890 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:3161: oid 16 updating version 16890 to 16891 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:3161: oid 16 version 16891 is already newer than 16887 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:3161: oid 16 version 16891 is already newer than 16889 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16891 (ObjNum 998 snap 294 seq_num 998) dirty exists 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:3161: left oid 16 (ObjNum 998 snap 294 seq_num 998) 2024-03-04T06:52:13.413 INFO:tasks.rados.rados.0.smithi137.stdout:3163: finishing write tid 1 to smithi13777483-31 2024-03-04T06:52:13.414 INFO:tasks.rados.rados.0.smithi137.stdout:3163: finishing write tid 2 to smithi13777483-31 2024-03-04T06:52:13.415 INFO:tasks.rados.rados.0.smithi137.stdout:3161: done (2 left) 2024-03-04T06:52:13.415 INFO:tasks.rados.rados.0.smithi137.stdout:3164: done (1 left) 2024-03-04T06:52:13.415 INFO:tasks.rados.rados.0.smithi137.stdout:3165: copy_from oid 35 from oid 7 current snap is 294 2024-03-04T06:52:13.415 INFO:tasks.rados.rados.0.smithi137.stdout:3166: rmattr oid 43 current snap is 294 2024-03-04T06:52:13.416 INFO:tasks.rados.rados.0.smithi137.stdout:3167: snap_remove snap 289 2024-03-04T06:52:13.542 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:13.258+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:13.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:13.243+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:13.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:13.255+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:13.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:13.255+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:13.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:13.290+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:13.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:13.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[88869]: osdmap e654: 8 total, 8 up, 8 in 2024-03-04T06:52:13.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:13.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:13.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:13.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:13.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:13.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:13.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:13.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[88869]: pgmap v662: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 581 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 532 KiB/s wr, 3 op/s 2024-03-04T06:52:13.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:13.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:13.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[91314]: osdmap e654: 8 total, 8 up, 8 in 2024-03-04T06:52:13.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:13.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:13.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:13.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:13.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:13.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:13.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:13.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[91314]: pgmap v662: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 581 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 532 KiB/s wr, 3 op/s 2024-03-04T06:52:13.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:13.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:13.250+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:13.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:13.262+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:13.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:13.249+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:13.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:13.250+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:13.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:13.238+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:13.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:13.238+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:13.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:13.238+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:13.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:13.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-mon[85573]: osdmap e654: 8 total, 8 up, 8 in 2024-03-04T06:52:13.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:13.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:13.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:13.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:13.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:13.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:13.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:13.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-mon[85573]: pgmap v662: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 581 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 532 KiB/s wr, 3 op/s 2024-03-04T06:52:13.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:14.245 INFO:tasks.rados.rados.0.smithi137.stdout:3167: done (3 left) 2024-03-04T06:52:14.245 INFO:tasks.rados.rados.0.smithi137.stdout:3168: setattr oid 34 current snap is 294 2024-03-04T06:52:14.245 INFO:tasks.rados.rados.0.smithi137.stdout:3163: finishing write tid 3 to smithi13777483-31 2024-03-04T06:52:14.245 INFO:tasks.rados.rados.0.smithi137.stdout:3163: finishing write tid 4 to smithi13777483-31 2024-03-04T06:52:14.246 INFO:tasks.rados.rados.0.smithi137.stdout:3163: finishing write tid 5 to smithi13777483-31 2024-03-04T06:52:14.246 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16909 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:52:14.246 INFO:tasks.rados.rados.0.smithi137.stdout:3163: finishing write tid 6 to smithi13777483-31 2024-03-04T06:52:14.246 INFO:tasks.rados.rados.0.smithi137.stdout:3163: oid 31 updating version 0 to 16928 2024-03-04T06:52:14.246 INFO:tasks.rados.rados.0.smithi137.stdout:3163: oid 31 version 16928 is already newer than 16927 2024-03-04T06:52:14.246 INFO:tasks.rados.rados.0.smithi137.stdout:3163: oid 31 updating version 16928 to 16929 2024-03-04T06:52:14.246 INFO:tasks.rados.rados.0.smithi137.stdout:3163: oid 31 version 16929 is already newer than 16926 2024-03-04T06:52:14.246 INFO:tasks.rados.rados.0.smithi137.stdout:3163: oid 31 version 16929 is already newer than 16925 2024-03-04T06:52:14.246 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16929 (ObjNum 999 snap 294 seq_num 999) dirty exists 2024-03-04T06:52:14.246 INFO:tasks.rados.rados.0.smithi137.stdout:3163: left oid 31 (ObjNum 999 snap 294 seq_num 999) 2024-03-04T06:52:14.246 INFO:tasks.rados.rados.0.smithi137.stdout:3165: finishing copy_from racing read to smithi13777483-35 2024-03-04T06:52:14.246 INFO:tasks.rados.rados.0.smithi137.stdout:3165: finishing copy_from to smithi13777483-35 2024-03-04T06:52:14.247 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16931 (ObjNum 993 snap 293 seq_num 993) dirty exists 2024-03-04T06:52:14.247 INFO:tasks.rados.rados.0.smithi137.stdout:3163: done (3 left) 2024-03-04T06:52:14.247 INFO:tasks.rados.rados.0.smithi137.stdout:3165: done (2 left) 2024-03-04T06:52:14.247 INFO:tasks.rados.rados.0.smithi137.stdout:3166: done (1 left) 2024-03-04T06:52:14.247 INFO:tasks.rados.rados.0.smithi137.stdout:3169: copy_from oid 3 from oid 9 current snap is 294 2024-03-04T06:52:14.247 INFO:tasks.rados.rados.0.smithi137.stdout:3170: read oid 44 snap -1 2024-03-04T06:52:14.248 INFO:tasks.rados.rados.0.smithi137.stdout:3170: expect (ObjNum 874 snap 255 seq_num 874) 2024-03-04T06:52:14.248 INFO:tasks.rados.rados.0.smithi137.stdout:3171: delete oid 10 current snap is 294 2024-03-04T06:52:14.264 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16892 (ObjNum 886 snap 259 seq_num 886) dirty exists 2024-03-04T06:52:14.268 INFO:tasks.rados.rados.0.smithi137.stdout:3168: done (3 left) 2024-03-04T06:52:14.268 INFO:tasks.rados.rados.0.smithi137.stdout:3171: done (2 left) 2024-03-04T06:52:14.268 INFO:tasks.rados.rados.0.smithi137.stdout:3172: rmattr oid 33 current snap is 294 2024-03-04T06:52:14.268 INFO:tasks.rados.rados.0.smithi137.stdout:3173: copy_from oid 49 from oid 2 current snap is 294 2024-03-04T06:52:14.268 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 294 2024-03-04T06:52:14.268 INFO:tasks.rados.rados.0.smithi137.stdout:3174: seq_num 1002 ranges {2326528=786432,3112960=614400,3727360=581632,4308992=409600} 2024-03-04T06:52:14.285 INFO:tasks.rados.rados.0.smithi137.stdout:3174: writing smithi13777483-16 from 2326528 to 3112960 tid 1 2024-03-04T06:52:14.289 INFO:tasks.rados.rados.0.smithi137.stdout:3174: writing smithi13777483-16 from 3112960 to 3727360 tid 2 2024-03-04T06:52:14.293 INFO:tasks.rados.rados.0.smithi137.stdout:3174: writing smithi13777483-16 from 3727360 to 4308992 tid 3 2024-03-04T06:52:14.296 INFO:tasks.rados.rados.0.smithi137.stdout:3174: writing smithi13777483-16 from 4308992 to 4718592 tid 4 2024-03-04T06:52:14.296 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 294 2024-03-04T06:52:14.296 INFO:tasks.rados.rados.0.smithi137.stdout:3175: seq_num 1003 ranges {0=802816,802816=499712,1302528=737280,2039808=368640} 2024-03-04T06:52:14.301 INFO:tasks.rados.rados.0.smithi137.stdout:3175: writing smithi13777483-32 from 0 to 802816 tid 1 2024-03-04T06:52:14.304 INFO:tasks.rados.rados.0.smithi137.stdout:3175: writing smithi13777483-32 from 802816 to 1302528 tid 2 2024-03-04T06:52:14.308 INFO:tasks.rados.rados.0.smithi137.stdout:3175: writing smithi13777483-32 from 1302528 to 2039808 tid 3 2024-03-04T06:52:14.311 INFO:tasks.rados.rados.0.smithi137.stdout:3175: writing smithi13777483-32 from 2039808 to 2408448 tid 4 2024-03-04T06:52:14.311 INFO:tasks.rados.rados.0.smithi137.stdout:3176: snap_remove snap 287 2024-03-04T06:52:14.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:14.253+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:14.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:14.268+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:14.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:14.258+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:14.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:14.250+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[88869]: osdmap e655: 8 total, 8 up, 8 in 2024-03-04T06:52:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:14.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:14.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:14.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:14.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:14.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:14.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:14.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:14.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[91314]: osdmap e655: 8 total, 8 up, 8 in 2024-03-04T06:52:14.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:14.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:14.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:14.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:14.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:14.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:14.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:14.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:14.250+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:14.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:14.245+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:14.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:14.246+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:14.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:14.254+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:14.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:14.254+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:14.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:14.256+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:14.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:14.257+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:14.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:14.257+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:14.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:14.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:14.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:14.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:14.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:14.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-mon[85573]: osdmap e655: 8 total, 8 up, 8 in 2024-03-04T06:52:14.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:14.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:14.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 155=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:14.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:14.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:14.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:14.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:15.265 INFO:tasks.rados.rados.0.smithi137.stdout:3176: done (6 left) 2024-03-04T06:52:15.265 INFO:tasks.rados.rados.0.smithi137.stdout:3177: snap_remove snap 288 2024-03-04T06:52:15.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:52:15] "GET /metrics HTTP/1.1" 200 36338 "" "Prometheus/2.43.0" 2024-03-04T06:52:15.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:15.272+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:15.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:15.265+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:15.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:15.263+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:15.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:15.263+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:15.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:15.264+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:15.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[88869]: osdmap e656: 8 total, 8 up, 8 in 2024-03-04T06:52:15.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:15.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:15.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:15.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:15.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:15.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:15.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:15.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:15.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:15.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:15.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[88869]: pgmap v665: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 592 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 7 op/s 2024-03-04T06:52:15.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[91314]: osdmap e656: 8 total, 8 up, 8 in 2024-03-04T06:52:15.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:15.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:15.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:15.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:15.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:15.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:15.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:15.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:15.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:15.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:15.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:15 smithi137 ceph-mon[91314]: pgmap v665: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 592 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 7 op/s 2024-03-04T06:52:15.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:15.267+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:15.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:15.265+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:15.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:15.267+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:15.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:15.257+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:15.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:15.257+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:15.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:15.257+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:15.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-mon[85573]: osdmap e656: 8 total, 8 up, 8 in 2024-03-04T06:52:15.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:15.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:15.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:15.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:15.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:15.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:15.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:15.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:15.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:15.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:15.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-mon[85573]: pgmap v665: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 592 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 7 op/s 2024-03-04T06:52:16.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:15.633+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:16.259 INFO:tasks.rados.rados.0.smithi137.stdout:3170: expect (ObjNum 874 snap 255 seq_num 874) 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16932 (ObjNum 959 snap 282 seq_num 959) dirty exists 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:3173: finishing copy_from racing read to smithi13777483-49 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:3169: finishing copy_from racing read to smithi13777483-3 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:3173: finishing copy_from to smithi13777483-49 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16912 (ObjNum 954 snap 281 seq_num 954) dirty exists 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:3174: finishing write tid 1 to smithi13777483-16 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:3174: finishing write tid 2 to smithi13777483-16 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:3174: finishing write tid 3 to smithi13777483-16 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:3175: finishing write tid 1 to smithi13777483-32 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:3175: finishing write tid 2 to smithi13777483-32 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:3169: finishing copy_from to smithi13777483-3 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 16872 (ObjNum 931 snap 275 seq_num 931) dirty exists 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:3174: finishing write tid 4 to smithi13777483-16 2024-03-04T06:52:16.311 INFO:tasks.rados.rados.0.smithi137.stdout:3169: done (6 left) 2024-03-04T06:52:16.312 INFO:tasks.rados.rados.0.smithi137.stdout:3170: done (5 left) 2024-03-04T06:52:16.312 INFO:tasks.rados.rados.0.smithi137.stdout:3172: done (4 left) 2024-03-04T06:52:16.312 INFO:tasks.rados.rados.0.smithi137.stdout:3173: done (3 left) 2024-03-04T06:52:16.312 INFO:tasks.rados.rados.0.smithi137.stdout:3177: done (2 left) 2024-03-04T06:52:16.312 INFO:tasks.rados.rados.0.smithi137.stdout:3178: snap_remove snap 279 2024-03-04T06:52:16.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:16.263+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:16.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:16.267+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:16.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:16.260+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:16.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:16.270+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:16.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:16.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:16.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[91314]: osdmap e657: 8 total, 8 up, 8 in 2024-03-04T06:52:16.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:16.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:16.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:16.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:16.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:16.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:16.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:16.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:16.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:16.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[88869]: osdmap e657: 8 total, 8 up, 8 in 2024-03-04T06:52:16.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:16.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:16.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:16.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:16.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:16.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:16.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:16.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:16.256+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:16.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:16.256+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:16.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:16.261+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:16.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-mon[85573]: osdmap e657: 8 total, 8 up, 8 in 2024-03-04T06:52:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:16.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:16.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:16.261+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:16.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:16.261+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:16.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:16.262+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:17.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:16.762+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:17.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:16.762+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:17.276 INFO:tasks.rados.rados.0.smithi137.stdout:3178: done (2 left) 2024-03-04T06:52:17.276 INFO:tasks.rados.rados.0.smithi137.stdout:3179: read oid 3 snap -1 2024-03-04T06:52:17.276 INFO:tasks.rados.rados.0.smithi137.stdout:3179: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:52:17.276 INFO:tasks.rados.rados.0.smithi137.stdout:3180: read oid 29 snap 281 2024-03-04T06:52:17.276 INFO:tasks.rados.rados.0.smithi137.stdout:3180: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:52:17.277 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 294 2024-03-04T06:52:17.277 INFO:tasks.rados.rados.0.smithi137.stdout:3181: seq_num 1004 ranges {5873664=16384} 2024-03-04T06:52:17.310 INFO:tasks.rados.rados.0.smithi137.stdout:3181: writing smithi13777483-15 from 5873664 to 5890048 tid 1 2024-03-04T06:52:17.311 INFO:tasks.rados.rados.0.smithi137.stdout:3182: snap_create 2024-03-04T06:52:17.311 INFO:tasks.rados.rados.0.smithi137.stdout:3174: finishing write tid 5 to smithi13777483-16 2024-03-04T06:52:17.311 INFO:tasks.rados.rados.0.smithi137.stdout:3175: finishing write tid 3 to smithi13777483-32 2024-03-04T06:52:17.311 INFO:tasks.rados.rados.0.smithi137.stdout:3175: finishing write tid 4 to smithi13777483-32 2024-03-04T06:52:17.311 INFO:tasks.rados.rados.0.smithi137.stdout:3175: finishing write tid 5 to smithi13777483-32 2024-03-04T06:52:17.311 INFO:tasks.rados.rados.0.smithi137.stdout:3174: finishing write tid 6 to smithi13777483-16 2024-03-04T06:52:17.311 INFO:tasks.rados.rados.0.smithi137.stdout:3174: oid 16 updating version 0 to 16893 2024-03-04T06:52:17.311 INFO:tasks.rados.rados.0.smithi137.stdout:3174: oid 16 updating version 16893 to 16896 2024-03-04T06:52:17.311 INFO:tasks.rados.rados.0.smithi137.stdout:3174: oid 16 version 16896 is already newer than 16895 2024-03-04T06:52:17.311 INFO:tasks.rados.rados.0.smithi137.stdout:3174: oid 16 version 16896 is already newer than 16894 2024-03-04T06:52:17.311 INFO:tasks.rados.rados.0.smithi137.stdout:3174: oid 16 updating version 16896 to 16897 2024-03-04T06:52:17.311 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16897 (ObjNum 1002 snap 294 seq_num 1002) dirty exists 2024-03-04T06:52:17.311 INFO:tasks.rados.rados.0.smithi137.stdout:3174: left oid 16 (ObjNum 1002 snap 294 seq_num 1002) 2024-03-04T06:52:17.312 INFO:tasks.rados.rados.0.smithi137.stdout:3175: finishing write tid 6 to smithi13777483-32 2024-03-04T06:52:17.312 INFO:tasks.rados.rados.0.smithi137.stdout:3175: oid 32 updating version 0 to 16935 2024-03-04T06:52:17.312 INFO:tasks.rados.rados.0.smithi137.stdout:3175: oid 32 updating version 16935 to 16937 2024-03-04T06:52:17.312 INFO:tasks.rados.rados.0.smithi137.stdout:3175: oid 32 version 16937 is already newer than 16933 2024-03-04T06:52:17.312 INFO:tasks.rados.rados.0.smithi137.stdout:3175: oid 32 version 16937 is already newer than 16936 2024-03-04T06:52:17.312 INFO:tasks.rados.rados.0.smithi137.stdout:3175: oid 32 version 16937 is already newer than 16934 2024-03-04T06:52:17.312 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16937 (ObjNum 1003 snap 294 seq_num 1003) dirty exists 2024-03-04T06:52:17.312 INFO:tasks.rados.rados.0.smithi137.stdout:3175: left oid 32 (ObjNum 1003 snap 294 seq_num 1003) 2024-03-04T06:52:17.314 INFO:tasks.rados.rados.0.smithi137.stdout:3181: finishing write tid 1 to smithi13777483-15 2024-03-04T06:52:17.314 INFO:tasks.rados.rados.0.smithi137.stdout:3181: finishing write tid 2 to smithi13777483-15 2024-03-04T06:52:17.315 INFO:tasks.rados.rados.0.smithi137.stdout:3180: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:52:17.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:17.280+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:17.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:17.273+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:17.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:17.273+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:17.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:17.274+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:17.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:17.278+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[88869]: osdmap e658: 8 total, 8 up, 8 in 2024-03-04T06:52:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:17.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:17.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[88869]: pgmap v668: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 603 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 4.8 MiB/s rd, 5.8 MiB/s wr, 13 op/s 2024-03-04T06:52:17.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:17.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:17.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:17.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[91314]: osdmap e658: 8 total, 8 up, 8 in 2024-03-04T06:52:17.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:17.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:17.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:17.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:17.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:17.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:17.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:17.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:17 smithi137 ceph-mon[91314]: pgmap v668: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 603 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 4.8 MiB/s rd, 5.8 MiB/s wr, 13 op/s 2024-03-04T06:52:17.565 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:17.272+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:17.565 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:17.282+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:17.565 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:17.283+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:17.566 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:17.275+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:17.566 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:17.275+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:17.566 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:17.276+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:17.566 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:17.566 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:17.566 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:17.566 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-mon[85573]: osdmap e658: 8 total, 8 up, 8 in 2024-03-04T06:52:17.567 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:17.567 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:17.567 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:17.567 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:17.567 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:17.567 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:17.567 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:17.567 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-mon[85573]: pgmap v668: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 603 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 4.8 MiB/s rd, 5.8 MiB/s wr, 13 op/s 2024-03-04T06:52:17.615 INFO:tasks.rados.rados.0.smithi137.stdout:3181: finishing write tid 3 to smithi13777483-15 2024-03-04T06:52:17.615 INFO:tasks.rados.rados.0.smithi137.stdout:3181: oid 15 updating version 0 to 16923 2024-03-04T06:52:17.615 INFO:tasks.rados.rados.0.smithi137.stdout:3181: oid 15 version 16923 is already newer than 16922 2024-03-04T06:52:17.616 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16923 (ObjNum 1004 snap 294 seq_num 1004) dirty exists 2024-03-04T06:52:17.616 INFO:tasks.rados.rados.0.smithi137.stdout:3181: left oid 15 (ObjNum 1004 snap 294 seq_num 1004) 2024-03-04T06:52:17.616 INFO:tasks.rados.rados.0.smithi137.stdout:3179: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:52:17.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:17.563+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:18.433 INFO:tasks.rados.rados.0.smithi137.stdout:3174: done (5 left) 2024-03-04T06:52:18.433 INFO:tasks.rados.rados.0.smithi137.stdout:3175: done (4 left) 2024-03-04T06:52:18.433 INFO:tasks.rados.rados.0.smithi137.stdout:3179: done (3 left) 2024-03-04T06:52:18.433 INFO:tasks.rados.rados.0.smithi137.stdout:3180: done (2 left) 2024-03-04T06:52:18.433 INFO:tasks.rados.rados.0.smithi137.stdout:3181: done (1 left) 2024-03-04T06:52:18.433 INFO:tasks.rados.rados.0.smithi137.stdout:3182: done (0 left) 2024-03-04T06:52:18.433 INFO:tasks.rados.rados.0.smithi137.stdout:3183: snap_remove snap 273 2024-03-04T06:52:18.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:18.275+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:18.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:18.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[91314]: osdmap e659: 8 total, 8 up, 8 in 2024-03-04T06:52:18.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:18.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:18.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:18.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:18.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:18.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:18.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:18.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:18.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:18.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:18.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[88869]: osdmap e659: 8 total, 8 up, 8 in 2024-03-04T06:52:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:18.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:18.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:18.419+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:18.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:18.275+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:18.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:18.276+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:18.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:18.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-mon[85573]: osdmap e659: 8 total, 8 up, 8 in 2024-03-04T06:52:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:18.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:19.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:18.624+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:19.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:18.624+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:19.284 INFO:tasks.rados.rados.0.smithi137.stdout:3183: done (0 left) 2024-03-04T06:52:19.284 INFO:tasks.rados.rados.0.smithi137.stdout:3184: snap_create 2024-03-04T06:52:19.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:19.286+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:19.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:19.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:19.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[91314]: osdmap e660: 8 total, 8 up, 8 in 2024-03-04T06:52:19.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:19.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:19.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[91314]: pgmap v671: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 618 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 6.5 MiB/s wr, 20 op/s 2024-03-04T06:52:19.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:19.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:19.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:19.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:19.296+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:19.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:19.296+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:19.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:19.296+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:19.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:19.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[88869]: osdmap e660: 8 total, 8 up, 8 in 2024-03-04T06:52:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[88869]: pgmap v671: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 618 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 6.5 MiB/s wr, 20 op/s 2024-03-04T06:52:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:19.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:19.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:19.283+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:19.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:19.290+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:19.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:19.281+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:19.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:19.281+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:19.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:19.286+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:19.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:19.287+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:19.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:19.287+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:19.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:19.289+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:19.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:19.290+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:19.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:19.290+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-mon[85573]: osdmap e660: 8 total, 8 up, 8 in 2024-03-04T06:52:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-mon[85573]: pgmap v671: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 618 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 6.5 MiB/s wr, 20 op/s 2024-03-04T06:52:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:20.287 INFO:tasks.rados.rados.0.smithi137.stdout:3184: done (0 left) 2024-03-04T06:52:20.288 INFO:tasks.rados.rados.0.smithi137.stdout:3185: read oid 11 snap -1 2024-03-04T06:52:20.288 INFO:tasks.rados.rados.0.smithi137.stdout:3185: expect (ObjNum 989 snap 290 seq_num 989) 2024-03-04T06:52:20.288 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 28 current snap is 296 2024-03-04T06:52:20.288 INFO:tasks.rados.rados.0.smithi137.stdout:3186: seq_num 1005 ranges {4169728=32768} 2024-03-04T06:52:20.311 INFO:tasks.rados.rados.0.smithi137.stdout:3186: writing smithi13777483-28 from 4169728 to 4202496 tid 1 2024-03-04T06:52:20.311 INFO:tasks.rados.rados.0.smithi137.stdout:3187: delete oid 46 current snap is 296 2024-03-04T06:52:20.317 INFO:tasks.rados.rados.0.smithi137.stdout:3187: done (2 left) 2024-03-04T06:52:20.317 INFO:tasks.rados.rados.0.smithi137.stdout:3188: read oid 47 snap -1 2024-03-04T06:52:20.317 INFO:tasks.rados.rados.0.smithi137.stdout:3188: expect (ObjNum 996 snap 293 seq_num 996) 2024-03-04T06:52:20.317 INFO:tasks.rados.rados.0.smithi137.stdout:3189: rollback oid 26 current snap is 296 2024-03-04T06:52:20.317 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 26 to 285 2024-03-04T06:52:20.317 INFO:tasks.rados.rados.0.smithi137.stdout:3190: rmattr oid 35 current snap is 296 2024-03-04T06:52:20.317 INFO:tasks.rados.rados.0.smithi137.stdout:3190: done (4 left) 2024-03-04T06:52:20.317 INFO:tasks.rados.rados.0.smithi137.stdout:3191: read oid 29 snap -1 2024-03-04T06:52:20.317 INFO:tasks.rados.rados.0.smithi137.stdout:3191: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:52:20.317 INFO:tasks.rados.rados.0.smithi137.stdout:3192: rollback oid 42 current snap is 296 2024-03-04T06:52:20.317 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 42 to 285 2024-03-04T06:52:20.317 INFO:tasks.rados.rados.0.smithi137.stdout:3193: copy_from oid 7 from oid 41 current snap is 296 2024-03-04T06:52:20.318 INFO:tasks.rados.rados.0.smithi137.stdout:3194: read oid 45 snap -1 2024-03-04T06:52:20.318 INFO:tasks.rados.rados.0.smithi137.stdout:3194: expect (ObjNum 977 snap 285 seq_num 977) 2024-03-04T06:52:20.318 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 296 2024-03-04T06:52:20.318 INFO:tasks.rados.rados.0.smithi137.stdout:3195: seq_num 1007 ranges {1163264=65536} 2024-03-04T06:52:20.324 INFO:tasks.rados.rados.0.smithi137.stdout:3195: writing smithi13777483-44 from 1163264 to 1228800 tid 1 2024-03-04T06:52:20.324 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 40 current snap is 296 2024-03-04T06:52:20.324 INFO:tasks.rados.rados.0.smithi137.stdout:3186: finishing write tid 1 to smithi13777483-28 2024-03-04T06:52:20.324 INFO:tasks.rados.rados.0.smithi137.stdout:3186: finishing write tid 2 to smithi13777483-28 2024-03-04T06:52:20.324 INFO:tasks.rados.rados.0.smithi137.stdout:3196: seq_num 1008 ranges {2301952=90112} 2024-03-04T06:52:20.338 INFO:tasks.rados.rados.0.smithi137.stdout:3196: writing smithi13777483-40 from 2301952 to 2392064 tid 1 2024-03-04T06:52:20.338 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 296 2024-03-04T06:52:20.338 INFO:tasks.rados.rados.0.smithi137.stdout:3185: expect (ObjNum 989 snap 290 seq_num 989) 2024-03-04T06:52:20.542 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:20.286+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:20.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:20.315+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:20.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:20.316+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:20.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:20.322+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:20.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[91314]: osdmap e661: 8 total, 8 up, 8 in 2024-03-04T06:52:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:20.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[88869]: osdmap e661: 8 total, 8 up, 8 in 2024-03-04T06:52:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:20.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:20.330+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:20.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:20.285+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:20.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:20.285+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:20.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:20.316+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:20.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:20.319+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:20.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:20.329+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-mon[85573]: osdmap e661: 8 total, 8 up, 8 in 2024-03-04T06:52:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:20.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:20.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:20.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:20.793 INFO:tasks.rados.rados.0.smithi137.stdout:3192: finishing rollback tid 0 to smithi13777483-42 2024-03-04T06:52:20.793 INFO:tasks.rados.rados.0.smithi137.stdout:3197: seq_num 1009 ranges {2621440=106496} 2024-03-04T06:52:20.808 INFO:tasks.rados.rados.0.smithi137.stdout:3197: writing smithi13777483-17 from 2621440 to 2727936 tid 1 2024-03-04T06:52:20.808 INFO:tasks.rados.rados.0.smithi137.stdout:3185: done (10 left) 2024-03-04T06:52:20.808 INFO:tasks.rados.rados.0.smithi137.stdout:3198: delete oid 20 current snap is 296 2024-03-04T06:52:20.808 INFO:tasks.rados.rados.0.smithi137.stdout:3189: finishing rollback tid 1 to smithi13777483-26 2024-03-04T06:52:20.808 INFO:tasks.rados.rados.0.smithi137.stdout:3192: finishing rollback tid 1 to smithi13777483-42 2024-03-04T06:52:20.808 INFO:tasks.rados.rados.0.smithi137.stdout:3192: finishing rollback tid 2 to smithi13777483-42 2024-03-04T06:52:20.808 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16941 (ObjNum 822 snap 236 seq_num 822) dirty exists 2024-03-04T06:52:20.808 INFO:tasks.rados.rados.0.smithi137.stdout:3195: finishing write tid 1 to smithi13777483-44 2024-03-04T06:52:20.808 INFO:tasks.rados.rados.0.smithi137.stdout:3195: finishing write tid 2 to smithi13777483-44 2024-03-04T06:52:20.808 INFO:tasks.rados.rados.0.smithi137.stdout:3186: finishing write tid 3 to smithi13777483-28 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:3186: oid 28 updating version 0 to 16925 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:3186: oid 28 updating version 16925 to 16926 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16926 (ObjNum 1005 snap 296 seq_num 1005) dirty exists 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:3186: left oid 28 (ObjNum 1005 snap 296 seq_num 1005) 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:3195: finishing write tid 3 to smithi13777483-44 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:3195: oid 44 updating version 0 to 16898 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:3195: oid 44 updating version 16898 to 16899 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16899 (ObjNum 1007 snap 296 seq_num 1007) dirty exists 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:3195: left oid 44 (ObjNum 1007 snap 296 seq_num 1007) 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:3196: finishing write tid 1 to smithi13777483-40 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:3196: finishing write tid 2 to smithi13777483-40 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:3189: finishing rollback tid 2 to smithi13777483-26 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16900 (ObjNum 957 snap 282 seq_num 957) dirty exists 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:3196: finishing write tid 3 to smithi13777483-40 2024-03-04T06:52:20.809 INFO:tasks.rados.rados.0.smithi137.stdout:3196: oid 40 updating version 0 to 16924 2024-03-04T06:52:20.810 INFO:tasks.rados.rados.0.smithi137.stdout:3196: oid 40 updating version 16924 to 16925 2024-03-04T06:52:20.810 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 16925 (ObjNum 1008 snap 296 seq_num 1008) dirty exists 2024-03-04T06:52:20.810 INFO:tasks.rados.rados.0.smithi137.stdout:3196: left oid 40 (ObjNum 1008 snap 296 seq_num 1008) 2024-03-04T06:52:20.810 INFO:tasks.rados.rados.0.smithi137.stdout:3191: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:52:21.106 INFO:tasks.rados.rados.0.smithi137.stdout:3188: expect (ObjNum 996 snap 293 seq_num 996) 2024-03-04T06:52:21.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:21.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:21.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:21.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:21 smithi203 ceph-mon[85573]: osdmap e662: 8 total, 8 up, 8 in 2024-03-04T06:52:21.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:21.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:21.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:21.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:21.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:21.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:21.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:21.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:21 smithi203 ceph-mon[85573]: pgmap v674: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 618 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-03-04T06:52:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[88869]: osdmap e662: 8 total, 8 up, 8 in 2024-03-04T06:52:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[88869]: pgmap v674: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 618 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-03-04T06:52:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[91314]: osdmap e662: 8 total, 8 up, 8 in 2024-03-04T06:52:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:21 smithi137 ceph-mon[91314]: pgmap v674: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 618 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-03-04T06:52:21.923 INFO:tasks.rados.rados.0.smithi137.stdout:3194: expect (ObjNum 977 snap 285 seq_num 977) 2024-03-04T06:52:22.294 INFO:tasks.rados.rados.0.smithi137.stdout:3193: finishing copy_from racing read to smithi13777483-7 2024-03-04T06:52:22.294 INFO:tasks.rados.rados.0.smithi137.stdout:3186: done (10 left) 2024-03-04T06:52:22.294 INFO:tasks.rados.rados.0.smithi137.stdout:3188: done (9 left) 2024-03-04T06:52:22.294 INFO:tasks.rados.rados.0.smithi137.stdout:3189: done (8 left) 2024-03-04T06:52:22.294 INFO:tasks.rados.rados.0.smithi137.stdout:3191: done (7 left) 2024-03-04T06:52:22.294 INFO:tasks.rados.rados.0.smithi137.stdout:3192: done (6 left) 2024-03-04T06:52:22.294 INFO:tasks.rados.rados.0.smithi137.stdout:3194: done (5 left) 2024-03-04T06:52:22.294 INFO:tasks.rados.rados.0.smithi137.stdout:3195: done (4 left) 2024-03-04T06:52:22.295 INFO:tasks.rados.rados.0.smithi137.stdout:3196: done (3 left) 2024-03-04T06:52:22.295 INFO:tasks.rados.rados.0.smithi137.stdout:3198: done (2 left) 2024-03-04T06:52:22.295 INFO:tasks.rados.rados.0.smithi137.stdout:3199: snap_create 2024-03-04T06:52:22.295 INFO:tasks.rados.rados.0.smithi137.stdout:3193: finishing copy_from to smithi13777483-7 2024-03-04T06:52:22.295 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16888 (ObjNum 978 snap 286 seq_num 978) dirty exists 2024-03-04T06:52:22.295 INFO:tasks.rados.rados.0.smithi137.stdout:3197: finishing write tid 1 to smithi13777483-17 2024-03-04T06:52:22.295 INFO:tasks.rados.rados.0.smithi137.stdout:3197: finishing write tid 2 to smithi13777483-17 2024-03-04T06:52:22.295 INFO:tasks.rados.rados.0.smithi137.stdout:3197: finishing write tid 3 to smithi13777483-17 2024-03-04T06:52:22.295 INFO:tasks.rados.rados.0.smithi137.stdout:3197: oid 17 updating version 0 to 16911 2024-03-04T06:52:22.295 INFO:tasks.rados.rados.0.smithi137.stdout:3197: oid 17 version 16911 is already newer than 16910 2024-03-04T06:52:22.295 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16911 (ObjNum 1009 snap 296 seq_num 1009) dirty exists 2024-03-04T06:52:22.295 INFO:tasks.rados.rados.0.smithi137.stdout:3197: left oid 17 (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:52:22.302 INFO:tasks.rados.rados.0.smithi137.stdout:3193: done (2 left) 2024-03-04T06:52:22.302 INFO:tasks.rados.rados.0.smithi137.stdout:3197: done (1 left) 2024-03-04T06:52:22.302 INFO:tasks.rados.rados.0.smithi137.stdout:3199: done (0 left) 2024-03-04T06:52:22.302 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 297 2024-03-04T06:52:22.302 INFO:tasks.rados.rados.0.smithi137.stdout:3200: seq_num 1011 ranges {0=139264} 2024-03-04T06:52:22.303 INFO:tasks.rados.rados.0.smithi137.stdout:3200: writing smithi13777483-20 from 0 to 139264 tid 1 2024-03-04T06:52:22.303 INFO:tasks.rados.rados.0.smithi137.stdout:3201: read oid 7 snap -1 2024-03-04T06:52:22.303 INFO:tasks.rados.rados.0.smithi137.stdout:3201: expect (ObjNum 978 snap 286 seq_num 978) 2024-03-04T06:52:22.304 INFO:tasks.rados.rados.0.smithi137.stdout:3202: rollback oid 37 current snap is 297 2024-03-04T06:52:22.304 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 37 to 291 2024-03-04T06:52:22.304 INFO:tasks.rados.rados.0.smithi137.stdout:3203: snap_create 2024-03-04T06:52:22.307 INFO:tasks.rados.rados.0.smithi137.stdout:3200: finishing write tid 1 to smithi13777483-20 2024-03-04T06:52:22.309 INFO:tasks.rados.rados.0.smithi137.stdout:3200: finishing write tid 2 to smithi13777483-20 2024-03-04T06:52:22.310 INFO:tasks.rados.rados.0.smithi137.stdout:3200: finishing write tid 3 to smithi13777483-20 2024-03-04T06:52:22.310 INFO:tasks.rados.rados.0.smithi137.stdout:3200: oid 20 updating version 0 to 16911 2024-03-04T06:52:22.311 INFO:tasks.rados.rados.0.smithi137.stdout:3200: oid 20 updating version 16911 to 16912 2024-03-04T06:52:22.311 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16912 (ObjNum 1011 snap 297 seq_num 1011) dirty exists 2024-03-04T06:52:22.311 INFO:tasks.rados.rados.0.smithi137.stdout:3200: left oid 20 (ObjNum 1011 snap 297 seq_num 1011) 2024-03-04T06:52:22.312 INFO:tasks.rados.rados.0.smithi137.stdout:3202: finishing rollback tid 0 to smithi13777483-37 2024-03-04T06:52:22.312 INFO:tasks.rados.rados.0.smithi137.stdout:3202: finishing rollback tid 1 to smithi13777483-37 2024-03-04T06:52:22.313 INFO:tasks.rados.rados.0.smithi137.stdout:3202: finishing rollback tid 2 to smithi13777483-37 2024-03-04T06:52:22.313 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16928 (ObjNum 985 snap 288 seq_num 985) dirty exists 2024-03-04T06:52:22.321 INFO:tasks.rados.rados.0.smithi137.stdout:3201: expect (ObjNum 978 snap 286 seq_num 978) 2024-03-04T06:52:22.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:22.303+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:22.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:22.308+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:22.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:22.308+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:22.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:22.313+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:22.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:22.308+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:22.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:22.308+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:22.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:22.320+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:22.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:22.302+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:22.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:22.302+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:22.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:22.302+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:22.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:22.309+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:23.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:22.673+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:23.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:22.673+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:23.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:22.673+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:23.307 INFO:tasks.rados.rados.0.smithi137.stdout:3200: done (3 left) 2024-03-04T06:52:23.308 INFO:tasks.rados.rados.0.smithi137.stdout:3201: done (2 left) 2024-03-04T06:52:23.308 INFO:tasks.rados.rados.0.smithi137.stdout:3202: done (1 left) 2024-03-04T06:52:23.308 INFO:tasks.rados.rados.0.smithi137.stdout:3203: done (0 left) 2024-03-04T06:52:23.308 INFO:tasks.rados.rados.0.smithi137.stdout:3204: snap_create 2024-03-04T06:52:23.495 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:23.307+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:23.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[88869]: osdmap e663: 8 total, 8 up, 8 in 2024-03-04T06:52:23.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:23.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:23.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:23.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:23.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:23.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:23.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:23.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:23.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[88869]: pgmap v676: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 618 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-03-04T06:52:23.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:23.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:23.497 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[91314]: osdmap e663: 8 total, 8 up, 8 in 2024-03-04T06:52:23.497 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:23.497 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:23.497 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:23.497 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:23.498 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:23.498 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:23.498 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:23.498 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:23.498 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[91314]: pgmap v676: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 618 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-03-04T06:52:23.498 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:23.498 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:23.498 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:23.495+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:23.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:23.495+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:23.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:23.311+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:23.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:23.311+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:23.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:23.465+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:23.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:23.495+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:23.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:23.496+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:23.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-mon[85573]: osdmap e663: 8 total, 8 up, 8 in 2024-03-04T06:52:23.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:23.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:23.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:23.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:23.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:23.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:23.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:23.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:23.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-mon[85573]: pgmap v676: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 618 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-03-04T06:52:23.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:23.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:23.754 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:23.495+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:23.755 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:23.495+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:24.310 INFO:tasks.rados.rados.0.smithi137.stdout:3204: done (0 left) 2024-03-04T06:52:24.311 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 299 2024-03-04T06:52:24.311 INFO:tasks.rados.rados.0.smithi137.stdout:3205: seq_num 1012 ranges {3891200=155648} 2024-03-04T06:52:24.332 INFO:tasks.rados.rados.0.smithi137.stdout:3205: writing smithi13777483-8 from 3891200 to 4046848 tid 1 2024-03-04T06:52:24.333 INFO:tasks.rados.rados.0.smithi137.stdout:3206: rollback oid 37 current snap is 299 2024-03-04T06:52:24.333 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 37 to 298 2024-03-04T06:52:24.333 INFO:tasks.rados.rados.0.smithi137.stdout:3207: snap_create 2024-03-04T06:52:24.337 INFO:tasks.rados.rados.0.smithi137.stdout:3205: finishing write tid 1 to smithi13777483-8 2024-03-04T06:52:24.337 INFO:tasks.rados.rados.0.smithi137.stdout:3205: finishing write tid 2 to smithi13777483-8 2024-03-04T06:52:24.338 INFO:tasks.rados.rados.0.smithi137.stdout:3206: finishing rollback tid 0 to smithi13777483-37 2024-03-04T06:52:24.338 INFO:tasks.rados.rados.0.smithi137.stdout:3206: finishing rollback tid 1 to smithi13777483-37 2024-03-04T06:52:24.338 INFO:tasks.rados.rados.0.smithi137.stdout:3206: finishing rollback tid 2 to smithi13777483-37 2024-03-04T06:52:24.338 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16931 (ObjNum 985 snap 288 seq_num 985) dirty exists 2024-03-04T06:52:24.339 INFO:tasks.rados.rados.0.smithi137.stdout:3205: finishing write tid 3 to smithi13777483-8 2024-03-04T06:52:24.339 INFO:tasks.rados.rados.0.smithi137.stdout:3205: oid 8 updating version 0 to 16933 2024-03-04T06:52:24.339 INFO:tasks.rados.rados.0.smithi137.stdout:3205: oid 8 version 16933 is already newer than 16932 2024-03-04T06:52:24.339 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16933 (ObjNum 1012 snap 299 seq_num 1012) dirty exists 2024-03-04T06:52:24.339 INFO:tasks.rados.rados.0.smithi137.stdout:3205: left oid 8 (ObjNum 1012 snap 299 seq_num 1012) 2024-03-04T06:52:24.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:24.337+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:24.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:24.311+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:24.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:24.311+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:24.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:24.311+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:24.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:24.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-mon[85573]: osdmap e664: 8 total, 8 up, 8 in 2024-03-04T06:52:24.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:24.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:24.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:52:24.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:24.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:24.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:24.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:24.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:24.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:24.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:24.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:24.309+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:24.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:24.326+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:24.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:24.326+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:24.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:24.326+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:24.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:24.336+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[91314]: osdmap e664: 8 total, 8 up, 8 in 2024-03-04T06:52:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:52:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:24.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[88869]: osdmap e664: 8 total, 8 up, 8 in 2024-03-04T06:52:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:52:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:24.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:25.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:24.827+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:25.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:24.827+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:25.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:24.827+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:25.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:24.828+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:25.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:24.828+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:25.329 INFO:tasks.rados.rados.0.smithi137.stdout:3205: done (2 left) 2024-03-04T06:52:25.329 INFO:tasks.rados.rados.0.smithi137.stdout:3206: done (1 left) 2024-03-04T06:52:25.329 INFO:tasks.rados.rados.0.smithi137.stdout:3207: done (0 left) 2024-03-04T06:52:25.329 INFO:tasks.rados.rados.0.smithi137.stdout:3208: setattr oid 17 current snap is 300 2024-03-04T06:52:25.330 INFO:tasks.rados.rados.0.smithi137.stdout:3209: snap_create 2024-03-04T06:52:25.334 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16912 (ObjNum 1009 snap 296 seq_num 1009) dirty exists 2024-03-04T06:52:25.565 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:52:25] "GET /metrics HTTP/1.1" 200 36338 "" "Prometheus/2.43.0" 2024-03-04T06:52:25.565 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:25.326+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:25.565 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:25.566 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[88869]: osdmap e665: 8 total, 8 up, 8 in 2024-03-04T06:52:25.566 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:25.566 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:25.566 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:25.566 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:25.566 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:25.566 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:25.566 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[88869]: pgmap v679: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 598 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 103 KiB/s wr, 7 op/s 2024-03-04T06:52:25.566 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:25.566 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:25.566 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:25.566 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[91314]: osdmap e665: 8 total, 8 up, 8 in 2024-03-04T06:52:25.566 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:25.567 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:25.567 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:25.567 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:25.567 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:25.567 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:25.567 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[91314]: pgmap v679: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 598 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 103 KiB/s wr, 7 op/s 2024-03-04T06:52:25.567 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:25.567 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:25.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:25.566+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:25.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:25.328+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:25.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:25.328+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:25.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:25.334+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:25.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:25.335+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:25.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:25.565+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:25.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-mon[85573]: osdmap e665: 8 total, 8 up, 8 in 2024-03-04T06:52:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-mon[85573]: pgmap v679: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 598 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 103 KiB/s wr, 7 op/s 2024-03-04T06:52:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:26.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:25.564+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:26.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:25.565+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:26.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:25.564+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:26.330 INFO:tasks.rados.rados.0.smithi137.stdout:3208: done (1 left) 2024-03-04T06:52:26.330 INFO:tasks.rados.rados.0.smithi137.stdout:3209: done (0 left) 2024-03-04T06:52:26.331 INFO:tasks.rados.rados.0.smithi137.stdout:3210: snap_create 2024-03-04T06:52:26.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:26.365+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:26.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:26.365+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:26.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:26.330+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:26.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:26.330+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:26.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:26.330+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:26.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:26.544+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:26.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:26.544+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:26.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:26.544+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-mon[85573]: osdmap e666: 8 total, 8 up, 8 in 2024-03-04T06:52:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:26.666 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:26.332+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:26.666 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:26.666 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:26.666 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:26.666 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:26.666 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[91314]: osdmap e666: 8 total, 8 up, 8 in 2024-03-04T06:52:26.666 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:26.666 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:26.666 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:26.666 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:26.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:26.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:26.667 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:26.667 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:26.667 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:26.667 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:26.667 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[88869]: osdmap e666: 8 total, 8 up, 8 in 2024-03-04T06:52:26.667 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:26.667 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:26.667 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:26.667 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:26.667 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:26.667 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:27.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:26.665+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:27.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:26.665+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:27.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:26.665+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:27.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:26.665+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:27.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:26.665+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:27.333 INFO:tasks.rados.rados.0.smithi137.stdout:3210: done (0 left) 2024-03-04T06:52:27.333 INFO:tasks.rados.rados.0.smithi137.stdout:3211: read oid 29 snap -1 2024-03-04T06:52:27.333 INFO:tasks.rados.rados.0.smithi137.stdout:3211: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:52:27.333 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 302 2024-03-04T06:52:27.333 INFO:tasks.rados.rados.0.smithi137.stdout:3212: seq_num 1013 ranges {8052736=172032} 2024-03-04T06:52:27.379 INFO:tasks.rados.rados.0.smithi137.stdout:3212: writing smithi13777483-11 from 8052736 to 8224768 tid 1 2024-03-04T06:52:27.379 INFO:tasks.rados.rados.0.smithi137.stdout:3213: copy_from oid 35 from oid 30 current snap is 302 2024-03-04T06:52:27.379 INFO:tasks.rados.rados.0.smithi137.stdout:3211: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:52:27.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:27.397+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:27.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:27.382+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:27.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:27.331+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:27.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:27.331+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:27.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:27.337+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:27.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:27.337+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-mon[85573]: osdmap e667: 8 total, 8 up, 8 in 2024-03-04T06:52:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-mon[85573]: pgmap v682: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 603 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 28 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-03-04T06:52:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:27 smithi203 ceph-mon[85573]: osdmap e668: 8 total, 8 up, 8 in 2024-03-04T06:52:27.684 INFO:tasks.rados.rados.0.smithi137.stdout:3212: finishing write tid 1 to smithi13777483-11 2024-03-04T06:52:27.684 INFO:tasks.rados.rados.0.smithi137.stdout:3212: finishing write tid 2 to smithi13777483-11 2024-03-04T06:52:27.684 INFO:tasks.rados.rados.0.smithi137.stdout:3212: finishing write tid 3 to smithi13777483-11 2024-03-04T06:52:27.684 INFO:tasks.rados.rados.0.smithi137.stdout:3212: oid 11 updating version 0 to 16935 2024-03-04T06:52:27.684 INFO:tasks.rados.rados.0.smithi137.stdout:3212: oid 11 version 16935 is already newer than 16934 2024-03-04T06:52:27.684 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16935 (ObjNum 1013 snap 302 seq_num 1013) dirty exists 2024-03-04T06:52:27.684 INFO:tasks.rados.rados.0.smithi137.stdout:3212: left oid 11 (ObjNum 1013 snap 302 seq_num 1013) 2024-03-04T06:52:27.685 INFO:tasks.rados.rados.0.smithi137.stdout:3213: finishing copy_from racing read to smithi13777483-35 2024-03-04T06:52:27.685 INFO:tasks.rados.rados.0.smithi137.stdout:3213: finishing copy_from to smithi13777483-35 2024-03-04T06:52:27.685 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16909 (ObjNum 982 snap 287 seq_num 982) dirty exists 2024-03-04T06:52:27.685 INFO:tasks.rados.rados.0.smithi137.stdout:3211: done (2 left) 2024-03-04T06:52:27.685 INFO:tasks.rados.rados.0.smithi137.stdout:3212: done (1 left) 2024-03-04T06:52:27.685 INFO:tasks.rados.rados.0.smithi137.stdout:3213: done (0 left) 2024-03-04T06:52:27.685 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 302 2024-03-04T06:52:27.685 INFO:tasks.rados.rados.0.smithi137.stdout:3214: seq_num 1014 ranges {1228800=188416} 2024-03-04T06:52:27.691 INFO:tasks.rados.rados.0.smithi137.stdout:3214: writing smithi13777483-44 from 1228800 to 1417216 tid 1 2024-03-04T06:52:27.691 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 302 2024-03-04T06:52:27.691 INFO:tasks.rados.rados.0.smithi137.stdout:3215: seq_num 1015 ranges {5890048=204800} 2024-03-04T06:52:27.725 INFO:tasks.rados.rados.0.smithi137.stdout:3215: writing smithi13777483-15 from 5890048 to 6094848 tid 1 2024-03-04T06:52:27.725 INFO:tasks.rados.rados.0.smithi137.stdout:3216: read oid 9 snap 297 2024-03-04T06:52:27.725 INFO:tasks.rados.rados.0.smithi137.stdout:3216: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:52:27.725 INFO:tasks.rados.rados.0.smithi137.stdout:3217: copy_from oid 28 from oid 18 current snap is 302 2024-03-04T06:52:27.725 INFO:tasks.rados.rados.0.smithi137.stdout:3214: finishing write tid 1 to smithi13777483-44 2024-03-04T06:52:27.725 INFO:tasks.rados.rados.0.smithi137.stdout:3214: finishing write tid 2 to smithi13777483-44 2024-03-04T06:52:27.725 INFO:tasks.rados.rados.0.smithi137.stdout:3214: finishing write tid 3 to smithi13777483-44 2024-03-04T06:52:27.725 INFO:tasks.rados.rados.0.smithi137.stdout:3214: oid 44 updating version 0 to 16901 2024-03-04T06:52:27.725 INFO:tasks.rados.rados.0.smithi137.stdout:3214: oid 44 version 16901 is already newer than 16900 2024-03-04T06:52:27.725 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16901 (ObjNum 1014 snap 302 seq_num 1014) dirty exists 2024-03-04T06:52:27.725 INFO:tasks.rados.rados.0.smithi137.stdout:3214: left oid 44 (ObjNum 1014 snap 302 seq_num 1014) 2024-03-04T06:52:27.726 INFO:tasks.rados.rados.0.smithi137.stdout:3214: done (3 left) 2024-03-04T06:52:27.726 INFO:tasks.rados.rados.0.smithi137.stdout:3218: copy_from oid 49 from oid 29 current snap is 302 2024-03-04T06:52:27.726 INFO:tasks.rados.rados.0.smithi137.stdout:3219: copy_from oid 13 from oid 16 current snap is 302 2024-03-04T06:52:27.726 INFO:tasks.rados.rados.0.smithi137.stdout:3220: snap_remove snap 285 2024-03-04T06:52:27.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:27.385+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:27.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:27.332+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:27.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:27.332+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:27.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:27.384+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[91314]: osdmap e667: 8 total, 8 up, 8 in 2024-03-04T06:52:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[91314]: pgmap v682: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 603 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 28 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-03-04T06:52:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[91314]: osdmap e668: 8 total, 8 up, 8 in 2024-03-04T06:52:27.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:27.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[88869]: osdmap e667: 8 total, 8 up, 8 in 2024-03-04T06:52:27.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:27.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:27.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:27.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:27.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[88869]: pgmap v682: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 603 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 28 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-03-04T06:52:27.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:27.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:27.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:27.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:27.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:27 smithi137 ceph-mon[88869]: osdmap e668: 8 total, 8 up, 8 in 2024-03-04T06:52:28.356 INFO:tasks.rados.rados.0.smithi137.stdout:3220: done (5 left) 2024-03-04T06:52:28.356 INFO:tasks.rados.rados.0.smithi137.stdout:3221: delete oid 5 current snap is 302 2024-03-04T06:52:28.357 INFO:tasks.rados.rados.0.smithi137.stdout:3215: finishing write tid 1 to smithi13777483-15 2024-03-04T06:52:28.357 INFO:tasks.rados.rados.0.smithi137.stdout:3215: finishing write tid 2 to smithi13777483-15 2024-03-04T06:52:28.357 INFO:tasks.rados.rados.0.smithi137.stdout:3215: finishing write tid 3 to smithi13777483-15 2024-03-04T06:52:28.357 INFO:tasks.rados.rados.0.smithi137.stdout:3215: oid 15 updating version 0 to 16932 2024-03-04T06:52:28.357 INFO:tasks.rados.rados.0.smithi137.stdout:3215: oid 15 updating version 16932 to 16933 2024-03-04T06:52:28.357 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16933 (ObjNum 1015 snap 302 seq_num 1015) dirty exists 2024-03-04T06:52:28.357 INFO:tasks.rados.rados.0.smithi137.stdout:3215: left oid 15 (ObjNum 1015 snap 302 seq_num 1015) 2024-03-04T06:52:28.357 INFO:tasks.rados.rados.0.smithi137.stdout:3219: finishing copy_from racing read to smithi13777483-13 2024-03-04T06:52:28.357 INFO:tasks.rados.rados.0.smithi137.stdout:3219: finishing copy_from to smithi13777483-13 2024-03-04T06:52:28.357 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16897 (ObjNum 1002 snap 294 seq_num 1002) dirty exists 2024-03-04T06:52:28.357 INFO:tasks.rados.rados.0.smithi137.stdout:3218: finishing copy_from racing read to smithi13777483-49 2024-03-04T06:52:28.357 INFO:tasks.rados.rados.0.smithi137.stdout:3216: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:52:28.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:28.360+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:28.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:28.364+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:28.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:28.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:28.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:28.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:28.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:28.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:28.366+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:28.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:28.366+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:28.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:28.369+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:28.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:28.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:28.364+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:28.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:28.363+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:28.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:28.364+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:28.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:28.364+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:28.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:28.355+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:28.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:28.355+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:28.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:28.370+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:28.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:28.370+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:28.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:28.371+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:28.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:28.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:29.182 INFO:tasks.rados.rados.0.smithi137.stdout:3218: finishing copy_from to smithi13777483-49 2024-03-04T06:52:29.182 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16898 (ObjNum 932 snap 275 seq_num 932) dirty exists 2024-03-04T06:52:29.182 INFO:tasks.rados.rados.0.smithi137.stdout:3217: finishing copy_from racing read to smithi13777483-28 2024-03-04T06:52:29.182 INFO:tasks.rados.rados.0.smithi137.stdout:3217: finishing copy_from to smithi13777483-28 2024-03-04T06:52:29.182 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16896 (ObjNum 983 snap 287 seq_num 983) dirty exists 2024-03-04T06:52:29.182 INFO:tasks.rados.rados.0.smithi137.stdout:3215: done (5 left) 2024-03-04T06:52:29.182 INFO:tasks.rados.rados.0.smithi137.stdout:3216: done (4 left) 2024-03-04T06:52:29.182 INFO:tasks.rados.rados.0.smithi137.stdout:3217: done (3 left) 2024-03-04T06:52:29.182 INFO:tasks.rados.rados.0.smithi137.stdout:3218: done (2 left) 2024-03-04T06:52:29.182 INFO:tasks.rados.rados.0.smithi137.stdout:3219: done (1 left) 2024-03-04T06:52:29.182 INFO:tasks.rados.rados.0.smithi137.stdout:3221: done (0 left) 2024-03-04T06:52:29.182 INFO:tasks.rados.rados.0.smithi137.stdout:3222: snap_remove snap 286 2024-03-04T06:52:29.363 INFO:tasks.rados.rados.0.smithi137.stdout:3222: done (0 left) 2024-03-04T06:52:29.363 INFO:tasks.rados.rados.0.smithi137.stdout:3223: read oid 35 snap 301 2024-03-04T06:52:29.363 INFO:tasks.rados.rados.0.smithi137.stdout:3223: expect (ObjNum 993 snap 293 seq_num 993) 2024-03-04T06:52:29.363 INFO:tasks.rados.rados.0.smithi137.stdout:3224: copy_from oid 34 from oid 5 current snap is 302 2024-03-04T06:52:29.363 INFO:tasks.rados.rados.0.smithi137.stdout:3225: setattr oid 47 current snap is 302 2024-03-04T06:52:29.364 INFO:tasks.rados.rados.0.smithi137.stdout:3226: snap_create 2024-03-04T06:52:29.365 INFO:tasks.rados.rados.0.smithi137.stdout:3224: finishing copy_from to smithi13777483-34 2024-03-04T06:52:29.365 INFO:tasks.rados.rados.0.smithi137.stdout:3224: got expected ENOENT (src dne) 2024-03-04T06:52:29.366 INFO:tasks.rados.rados.0.smithi137.stdout:3224: finishing copy_from racing read to smithi13777483-34 2024-03-04T06:52:29.372 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16927 (ObjNum 996 snap 293 seq_num 996) dirty exists 2024-03-04T06:52:29.382 INFO:tasks.rados.rados.0.smithi137.stdout:3223: expect (ObjNum 993 snap 293 seq_num 993) 2024-03-04T06:52:29.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:29.371+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:29.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:29.365+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:29.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:29.363+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:29.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:29.363+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[88869]: osdmap e669: 8 total, 8 up, 8 in 2024-03-04T06:52:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:29.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[88869]: pgmap v685: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 619 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 26 MiB/s rd, 5.2 MiB/s wr, 13 op/s 2024-03-04T06:52:29.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:29.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[91314]: osdmap e669: 8 total, 8 up, 8 in 2024-03-04T06:52:29.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:29.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:29.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:29.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:29.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:29.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:29.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:29.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:29.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:29.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:29 smithi137 ceph-mon[91314]: pgmap v685: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 619 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 26 MiB/s rd, 5.2 MiB/s wr, 13 op/s 2024-03-04T06:52:29.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:29.370+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:29.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:29.361+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:29.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:29.362+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:29.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:29.365+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:29.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:29.368+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:29.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:29.371+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-mon[85573]: osdmap e669: 8 total, 8 up, 8 in 2024-03-04T06:52:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:29 smithi203 ceph-mon[85573]: pgmap v685: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 619 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 26 MiB/s rd, 5.2 MiB/s wr, 13 op/s 2024-03-04T06:52:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:3223: done (3 left) 2024-03-04T06:52:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:3224: done (2 left) 2024-03-04T06:52:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:3225: done (1 left) 2024-03-04T06:52:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:3226: done (0 left) 2024-03-04T06:52:30.367 INFO:tasks.rados.rados.0.smithi137.stdout:3227: delete oid 34 current snap is 303 2024-03-04T06:52:30.371 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:30.371 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:30.371 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[88869]: osdmap e670: 8 total, 8 up, 8 in 2024-03-04T06:52:30.371 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:30.371 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:30.371 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:30.371 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:30.371 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:30.371 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:30.371 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:30.371 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:30.372 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:30.372 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:30.372 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[91314]: osdmap e670: 8 total, 8 up, 8 in 2024-03-04T06:52:30.372 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:30.372 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:30.372 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:30.372 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:30.372 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:30.372 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:30.372 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:30.372 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:30.373 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:30.365+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:30.374 INFO:tasks.rados.rados.0.smithi137.stdout:3227: done (0 left) 2024-03-04T06:52:30.375 INFO:tasks.rados.rados.0.smithi137.stdout:3228: rmattr oid 6 current snap is 303 2024-03-04T06:52:30.375 INFO:tasks.rados.rados.0.smithi137.stdout:3228: done (0 left) 2024-03-04T06:52:30.375 INFO:tasks.rados.rados.0.smithi137.stdout:3229: read oid 36 snap -1 2024-03-04T06:52:30.375 INFO:tasks.rados.rados.0.smithi137.stdout:3229: expect (ObjNum 951 snap 281 seq_num 951) 2024-03-04T06:52:30.375 INFO:tasks.rados.rados.0.smithi137.stdout:3230: delete oid 48 current snap is 303 2024-03-04T06:52:30.377 INFO:tasks.rados.rados.0.smithi137.stdout:3230: done (1 left) 2024-03-04T06:52:30.377 INFO:tasks.rados.rados.0.smithi137.stdout:3231: delete oid 10 current snap is 303 2024-03-04T06:52:30.381 INFO:tasks.rados.rados.0.smithi137.stdout:3231: done (1 left) 2024-03-04T06:52:30.381 INFO:tasks.rados.rados.0.smithi137.stdout:3232: rmattr oid 23 current snap is 303 2024-03-04T06:52:30.381 INFO:tasks.rados.rados.0.smithi137.stdout:3232: done (1 left) 2024-03-04T06:52:30.381 INFO:tasks.rados.rados.0.smithi137.stdout:3233: snap_remove snap 284 2024-03-04T06:52:30.752 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:30.466+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:30.752 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:30.369+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:30.752 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:30.369+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:30.752 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:30.373+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:30.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -e sha1=efb04e5e69d058b0c47e511cb7e10d57a92f59ae -- bash -c 'ceph orch ps' 2024-03-04T06:52:30.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:30.382+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:30.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:30.365+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:30.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:30.365+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:30.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:30.365+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:30.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:30.466+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:30.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:30.466+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:30.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:30.466+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:30.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:30.373+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:30.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:30.373+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-mon[85573]: osdmap e670: 8 total, 8 up, 8 in 2024-03-04T06:52:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:30.983 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:52:31.376 INFO:tasks.rados.rados.0.smithi137.stdout:3233: done (1 left) 2024-03-04T06:52:31.376 INFO:tasks.rados.rados.0.smithi137.stdout:3234: rmattr oid 47 current snap is 303 2024-03-04T06:52:31.376 INFO:tasks.rados.rados.0.smithi137.stdout:3229: expect (ObjNum 951 snap 281 seq_num 951) 2024-03-04T06:52:31.481 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16928 (ObjNum 996 snap 293 seq_num 996) dirty exists 2024-03-04T06:52:31.482 INFO:tasks.rados.rados.0.smithi137.stdout:3229: done (1 left) 2024-03-04T06:52:31.482 INFO:tasks.rados.rados.0.smithi137.stdout:3234: done (0 left) 2024-03-04T06:52:31.482 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 303 2024-03-04T06:52:31.482 INFO:tasks.rados.rados.0.smithi137.stdout:3235: seq_num 1020 ranges {1417216=286720} 2024-03-04T06:52:31.491 INFO:tasks.rados.rados.0.smithi137.stdout:3235: writing smithi13777483-44 from 1417216 to 1703936 tid 1 2024-03-04T06:52:31.491 INFO:tasks.rados.rados.0.smithi137.stdout:3236: rollback oid 4 current snap is 303 2024-03-04T06:52:31.491 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 4 to 299 2024-03-04T06:52:31.491 INFO:tasks.rados.rados.0.smithi137.stdout:3237: read oid 2 snap -1 2024-03-04T06:52:31.491 INFO:tasks.rados.rados.0.smithi137.stdout:3237: expect (ObjNum 954 snap 281 seq_num 954) 2024-03-04T06:52:31.491 INFO:tasks.rados.rados.0.smithi137.stdout:3238: delete oid 25 current snap is 303 2024-03-04T06:52:31.496 INFO:tasks.rados.rados.0.smithi137.stdout:3238: done (3 left) 2024-03-04T06:52:31.496 INFO:tasks.rados.rados.0.smithi137.stdout:3239: snap_create 2024-03-04T06:52:31.496 INFO:tasks.rados.rados.0.smithi137.stdout:3236: finishing rollback tid 0 to smithi13777483-4 2024-03-04T06:52:31.496 INFO:tasks.rados.rados.0.smithi137.stdout:3236: finishing rollback tid 1 to smithi13777483-4 2024-03-04T06:52:31.496 INFO:tasks.rados.rados.0.smithi137.stdout:3236: finishing rollback tid 2 to smithi13777483-4 2024-03-04T06:52:31.497 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 15524 (ObjNum 963 snap 282 seq_num 963) dirty exists 2024-03-04T06:52:31.499 INFO:tasks.rados.rados.0.smithi137.stdout:3235: finishing write tid 1 to smithi13777483-44 2024-03-04T06:52:31.499 INFO:tasks.rados.rados.0.smithi137.stdout:3235: finishing write tid 2 to smithi13777483-44 2024-03-04T06:52:31.503 INFO:tasks.rados.rados.0.smithi137.stdout:3235: finishing write tid 3 to smithi13777483-44 2024-03-04T06:52:31.503 INFO:tasks.rados.rados.0.smithi137.stdout:3235: oid 44 updating version 0 to 16904 2024-03-04T06:52:31.503 INFO:tasks.rados.rados.0.smithi137.stdout:3235: oid 44 version 16904 is already newer than 16903 2024-03-04T06:52:31.503 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16904 (ObjNum 1020 snap 303 seq_num 1020) dirty exists 2024-03-04T06:52:31.504 INFO:tasks.rados.rados.0.smithi137.stdout:3235: left oid 44 (ObjNum 1020 snap 303 seq_num 1020) 2024-03-04T06:52:31.505 INFO:tasks.rados.rados.0.smithi137.stdout:3237: expect (ObjNum 954 snap 281 seq_num 954) 2024-03-04T06:52:31.747 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:31.377+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:31.747 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:31.377+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:31.747 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:31.374+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:31.748 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:31.377+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:31.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-mon[85573]: from='client.34461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:52:31.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:31.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:31.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:31.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-mon[85573]: osdmap e671: 8 total, 8 up, 8 in 2024-03-04T06:52:31.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:31.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:31.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:31.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:31.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-mon[85573]: pgmap v688: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 629 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 6.4 MiB/s wr, 11 op/s 2024-03-04T06:52:31.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:31.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:31.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:31.749 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:31.495+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:31.749 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:31.376+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:31.783 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:31.373+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:31.783 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:31.373+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:31.783 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:31.383+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:31.784 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:31.376+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[88869]: from='client.34461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:52:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[88869]: osdmap e671: 8 total, 8 up, 8 in 2024-03-04T06:52:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[88869]: pgmap v688: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 629 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 6.4 MiB/s wr, 11 op/s 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[91314]: from='client.34461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[91314]: osdmap e671: 8 total, 8 up, 8 in 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[91314]: pgmap v688: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 629 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 6.4 MiB/s wr, 11 op/s 2024-03-04T06:52:31.785 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:31.786 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:31.786 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:32.382 INFO:tasks.rados.rados.0.smithi137.stdout:3235: done (3 left) 2024-03-04T06:52:32.382 INFO:tasks.rados.rados.0.smithi137.stdout:3236: done (2 left) 2024-03-04T06:52:32.382 INFO:tasks.rados.rados.0.smithi137.stdout:3237: done (1 left) 2024-03-04T06:52:32.382 INFO:tasks.rados.rados.0.smithi137.stdout:3239: done (0 left) 2024-03-04T06:52:32.382 INFO:tasks.rados.rados.0.smithi137.stdout:3240: rmattr oid 15 current snap is 304 2024-03-04T06:52:32.382 INFO:tasks.rados.rados.0.smithi137.stdout:3240: done (0 left) 2024-03-04T06:52:32.382 INFO:tasks.rados.rados.0.smithi137.stdout:3241: read oid 37 snap -1 2024-03-04T06:52:32.382 INFO:tasks.rados.rados.0.smithi137.stdout:3241: expect (ObjNum 985 snap 288 seq_num 985) 2024-03-04T06:52:32.382 INFO:tasks.rados.rados.0.smithi137.stdout:3242: read oid 2 snap -1 2024-03-04T06:52:32.382 INFO:tasks.rados.rados.0.smithi137.stdout:3242: expect (ObjNum 954 snap 281 seq_num 954) 2024-03-04T06:52:32.382 INFO:tasks.rados.rados.0.smithi137.stdout:3243: rollback oid 36 current snap is 304 2024-03-04T06:52:32.382 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 36 to 281 2024-03-04T06:52:32.383 INFO:tasks.rados.rados.0.smithi137.stdout:3244: rmattr oid 20 current snap is 304 2024-03-04T06:52:32.385 INFO:tasks.rados.rados.0.smithi137.stdout:3244: done (3 left) 2024-03-04T06:52:32.385 INFO:tasks.rados.rados.0.smithi137.stdout:3245: rmattr oid 42 current snap is 304 2024-03-04T06:52:32.385 INFO:tasks.rados.rados.0.smithi137.stdout:3245: done (3 left) 2024-03-04T06:52:32.385 INFO:tasks.rados.rados.0.smithi137.stdout:3246: read oid 24 snap -1 2024-03-04T06:52:32.386 INFO:tasks.rados.rados.0.smithi137.stdout:3246: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:52:32.386 INFO:tasks.rados.rados.0.smithi137.stdout:3247: read oid 13 snap -1 2024-03-04T06:52:32.386 INFO:tasks.rados.rados.0.smithi137.stdout:3247: expect (ObjNum 1002 snap 294 seq_num 1002) 2024-03-04T06:52:32.386 INFO:tasks.rados.rados.0.smithi137.stdout:3248: copy_from oid 19 from oid 3 current snap is 304 2024-03-04T06:52:32.386 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 304 2024-03-04T06:52:32.386 INFO:tasks.rados.rados.0.smithi137.stdout:3249: seq_num 1022 ranges {11591680=319488} 2024-03-04T06:52:32.449 INFO:tasks.rados.rados.0.smithi137.stdout:3249: writing smithi13777483-18 from 11591680 to 11911168 tid 1 2024-03-04T06:52:32.449 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 304 2024-03-04T06:52:32.449 INFO:tasks.rados.rados.0.smithi137.stdout:3250: seq_num 1023 ranges {3719168=335872} 2024-03-04T06:52:32.471 INFO:tasks.rados.rados.0.smithi137.stdout:3250: writing smithi13777483-12 from 3719168 to 4055040 tid 1 2024-03-04T06:52:32.471 INFO:tasks.rados.rados.0.smithi137.stdout:3251: snap_remove snap 302 2024-03-04T06:52:32.759 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:32.376+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:32.759 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:32.376+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:32.759 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:32.376+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:32.760 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:32.388+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:32.760 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-mon[85573]: osdmap e672: 8 total, 8 up, 8 in 2024-03-04T06:52:32.760 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:32.760 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:32.760 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:32.760 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:32.760 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:32.761 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:32.761 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:32.761 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:32.761 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:32.761 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:32.387+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:32.761 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:32.387+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:32.761 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:32.453+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:32.761 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:32.453+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:32.762 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:32.453+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:32.767 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:32.382+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:32.768 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:32.388+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:32.768 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:32.388+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:32.768 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:32.390+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:32.768 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[88869]: osdmap e672: 8 total, 8 up, 8 in 2024-03-04T06:52:32.768 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:32.768 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:32.769 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:32.769 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:32.769 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:32.769 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:32.769 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:32.769 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:32.769 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:32.769 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[91314]: osdmap e672: 8 total, 8 up, 8 in 2024-03-04T06:52:32.769 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:32.769 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:32.769 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:32.769 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:32.769 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:32.770 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:32.770 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:32.770 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:32.770 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:32.796 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T06:52:32.796 INFO:teuthology.orchestra.run.smithi137.stdout:alertmanager.a smithi137 *:9093,9094 running (63s) 59s ago 13m 16.1M - 0.25.0 c8568f914cd2 ce9f080c2c94 2024-03-04T06:52:32.796 INFO:teuthology.orchestra.run.smithi137.stdout:grafana.a smithi203 *:3000 running (37s) 33s ago 12m 57.4M - 9.4.12 a0ea5e3c46d9 12caa13589e2 2024-03-04T06:52:32.796 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (2m) 59s ago 14m 16.6M - 19.0.0-1791-gefb04e5e 0c401cd3e778 b6a5f9352182 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi203 running (112s) 33s ago 14m 12.9M - 19.0.0-1791-gefb04e5e 0c401cd3e778 6797a1307e30 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi203 *:8443,9283,8765 running (8m) 33s ago 17m 452M - 19.0.0-1791-gefb04e5e 0c401cd3e778 48c66fe4203a 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi137 *:8443,9283,8765 running (8m) 59s ago 19m 514M - 19.0.0-1791-gefb04e5e 0c401cd3e778 766428acf3e5 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (8m) 59s ago 19m 68.9M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 317873ab051e 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi203 running (7m) 33s ago 18m 56.1M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b544783be085 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi137 running (7m) 59s ago 18m 59.8M 2048M 19.0.0-1791-gefb04e5e 0c401cd3e778 b69d9079fc81 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.a smithi137 *:9100 running (99s) 59s ago 12m 8442k - 1.5.0 0da6a335fe13 ff9dbbaf9aeb 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:node-exporter.b smithi203 *:9100 running (95s) 33s ago 12m 15.8M - 1.5.0 0da6a335fe13 28b7879b0fcb 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (6m) 59s ago 17m 369M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 bd2207652b33 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi137 running (6m) 59s ago 17m 241M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 47b5cdaad147 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi137 running (5m) 59s ago 16m 308M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 436ae07776d9 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (4m) 59s ago 16m 153M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9acd06dda8ec 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi203 running (4m) 33s ago 15m 191M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9a246a0996bd 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi203 running (3m) 33s ago 15m 348M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 9e05ca76b164 2024-03-04T06:52:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi203 running (3m) 33s ago 15m 224M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 ddb88aa8bce6 2024-03-04T06:52:32.798 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi203 running (2m) 33s ago 14m 134M 2480M 19.0.0-1791-gefb04e5e 0c401cd3e778 b9857bcd7602 2024-03-04T06:52:32.798 INFO:teuthology.orchestra.run.smithi137.stdout:prometheus.a smithi203 *:9095 running (79s) 33s ago 13m 47.8M - 2.43.0 a07b618ecd1d 85dcb15cec84 2024-03-04T06:52:33.042 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:32.766+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:33.383 INFO:tasks.rados.rados.0.smithi137.stdout:3251: done (8 left) 2024-03-04T06:52:33.383 INFO:tasks.rados.rados.0.smithi137.stdout:3252: snap_remove snap 297 2024-03-04T06:52:33.530 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -e sha1=efb04e5e69d058b0c47e511cb7e10d57a92f59ae -- bash -c 'ceph versions' 2024-03-04T06:52:33.744 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:52:33.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:33.383+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:33.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:33.391+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:33.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:33.386+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:33.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:33.387+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[88869]: osdmap e673: 8 total, 8 up, 8 in 2024-03-04T06:52:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[88869]: pgmap v691: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 629 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 2 op/s 2024-03-04T06:52:33.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:33.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:33.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[91314]: osdmap e673: 8 total, 8 up, 8 in 2024-03-04T06:52:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[91314]: pgmap v691: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 629 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 2 op/s 2024-03-04T06:52:33.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:33.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:33.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:33.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:33.387+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:33.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:33.395+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:33.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:33.381+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:33.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:33.381+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:33.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:33.387+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:33.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:33.388+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:33.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:33.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:33.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:33.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-mon[85573]: osdmap e673: 8 total, 8 up, 8 in 2024-03-04T06:52:33.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:33.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:33.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:33.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:33.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:33.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-mon[85573]: pgmap v691: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 629 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 2 op/s 2024-03-04T06:52:33.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:33.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:33.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:34.388 INFO:tasks.rados.rados.0.smithi137.stdout:3252: done (8 left) 2024-03-04T06:52:34.389 INFO:tasks.rados.rados.0.smithi137.stdout:3253: rollback oid 34 current snap is 304 2024-03-04T06:52:34.389 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 34 to 292 2024-03-04T06:52:34.389 INFO:tasks.rados.rados.0.smithi137.stdout:3246: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:52:34.394 INFO:tasks.rados.rados.0.smithi137.stdout:3243: finishing rollback tid 0 to smithi13777483-36 2024-03-04T06:52:34.394 INFO:tasks.rados.rados.0.smithi137.stdout:3243: finishing rollback tid 1 to smithi13777483-36 2024-03-04T06:52:34.395 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 16883 (ObjNum 289 snap 0 seq_num 1) dirty dne 2024-03-04T06:52:34.395 INFO:tasks.rados.rados.0.smithi137.stdout:3241: expect (ObjNum 985 snap 288 seq_num 985) 2024-03-04T06:52:34.470 INFO:tasks.rados.rados.0.smithi137.stdout:3242: expect (ObjNum 954 snap 281 seq_num 954) 2024-03-04T06:52:34.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:34.388+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:34.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:34.391+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:34.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:34.391+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:34.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:34.402+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:34.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:34.396+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[91314]: from='client.34467 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:52:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[91314]: osdmap e674: 8 total, 8 up, 8 in 2024-03-04T06:52:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:34.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[88869]: from='client.34467 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:52:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[88869]: osdmap e674: 8 total, 8 up, 8 in 2024-03-04T06:52:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:34.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:34.615 INFO:tasks.rados.rados.0.smithi137.stdout:3248: finishing copy_from racing read to smithi13777483-19 2024-03-04T06:52:34.615 INFO:tasks.rados.rados.0.smithi137.stdout:3247: expect (ObjNum 1002 snap 294 seq_num 1002) 2024-03-04T06:52:34.777 INFO:tasks.rados.rados.0.smithi137.stdout:3248: finishing copy_from to smithi13777483-19 2024-03-04T06:52:34.777 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 16872 (ObjNum 931 snap 275 seq_num 931) dirty exists 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:3249: finishing write tid 1 to smithi13777483-18 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:3249: finishing write tid 2 to smithi13777483-18 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:3249: finishing write tid 3 to smithi13777483-18 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:3249: oid 18 updating version 0 to 16901 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:3249: oid 18 updating version 16901 to 16902 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16902 (ObjNum 1022 snap 304 seq_num 1022) dirty exists 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:3249: left oid 18 (ObjNum 1022 snap 304 seq_num 1022) 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:3250: finishing write tid 1 to smithi13777483-12 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:3250: finishing write tid 2 to smithi13777483-12 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:3250: finishing write tid 3 to smithi13777483-12 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:3250: oid 12 updating version 0 to 16910 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:3250: oid 12 updating version 16910 to 16911 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16911 (ObjNum 1023 snap 304 seq_num 1023) dirty exists 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:3250: left oid 12 (ObjNum 1023 snap 304 seq_num 1023) 2024-03-04T06:52:34.778 INFO:tasks.rados.rados.0.smithi137.stdout:3253: finishing rollback tid 1 to smithi13777483-34 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3253: finishing rollback tid 2 to smithi13777483-34 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16906 (ObjNum 886 snap 259 seq_num 886) dirty exists 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3241: done (8 left) 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3242: done (7 left) 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3243: done (6 left) 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3246: done (5 left) 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3247: done (4 left) 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3248: done (3 left) 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3249: done (2 left) 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3250: done (1 left) 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3253: done (0 left) 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3254: rollback oid 32 current snap is 304 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 32 to 296 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3255: read oid 49 snap -1 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3255: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3256: copy_from oid 40 from oid 26 current snap is 304 2024-03-04T06:52:34.779 INFO:tasks.rados.rados.0.smithi137.stdout:3257: copy_from oid 16 from oid 4 current snap is 304 2024-03-04T06:52:34.780 INFO:tasks.rados.rados.0.smithi137.stdout:3258: snap_remove snap 300 2024-03-04T06:52:34.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:34.390+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:34.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:34.402+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:34.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:34.402+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:34.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:34.402+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:34.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:34.387+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:34.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:34.387+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:34.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:34.387+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:34.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:34.398+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:34.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:34.398+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:34.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-mon[85573]: from='client.34467 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T06:52:34.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:34.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:34.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-mon[85573]: osdmap e674: 8 total, 8 up, 8 in 2024-03-04T06:52:34.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:34.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:34.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:34.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:34.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:34.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:34.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:34.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:35.389 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:52:35] "GET /metrics HTTP/1.1" 200 36338 "" "Prometheus/2.43.0" 2024-03-04T06:52:35.396 INFO:tasks.rados.rados.0.smithi137.stdout:3258: done (4 left) 2024-03-04T06:52:35.396 INFO:tasks.rados.rados.0.smithi137.stdout:3259: rollback oid 43 current snap is 304 2024-03-04T06:52:35.396 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 43 to 296 2024-03-04T06:52:35.396 INFO:tasks.rados.rados.0.smithi137.stdout:3254: finishing rollback tid 0 to smithi13777483-32 2024-03-04T06:52:35.396 INFO:tasks.rados.rados.0.smithi137.stdout:3254: finishing rollback tid 1 to smithi13777483-32 2024-03-04T06:52:35.396 INFO:tasks.rados.rados.0.smithi137.stdout:3254: finishing rollback tid 2 to smithi13777483-32 2024-03-04T06:52:35.397 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16944 (ObjNum 1003 snap 294 seq_num 1003) dirty exists 2024-03-04T06:52:35.397 INFO:tasks.rados.rados.0.smithi137.stdout:3256: finishing copy_from racing read to smithi13777483-40 2024-03-04T06:52:35.397 INFO:tasks.rados.rados.0.smithi137.stdout:3256: finishing copy_from to smithi13777483-40 2024-03-04T06:52:35.397 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 16900 (ObjNum 957 snap 282 seq_num 957) dirty exists 2024-03-04T06:52:35.397 INFO:tasks.rados.rados.0.smithi137.stdout:3255: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:52:35.661 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:35.392+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:35.661 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:35.398+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:35.662 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:35.398+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:35.662 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:35.662 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:35.662 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[88869]: osdmap e675: 8 total, 8 up, 8 in 2024-03-04T06:52:35.662 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:35.662 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:35.662 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:35.662 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:35.662 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:35.662 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:35.662 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:35.662 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:35.663 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[88869]: pgmap v694: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 636 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 18 op/s 2024-03-04T06:52:35.663 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:35.396+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:35.663 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:35.663 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:35.663 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[91314]: osdmap e675: 8 total, 8 up, 8 in 2024-03-04T06:52:35.663 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:35.663 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:35.663 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:35.663 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:35.663 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:35.664 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:35.664 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:35.664 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:35.664 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:35 smithi137 ceph-mon[91314]: pgmap v694: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 636 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 18 op/s 2024-03-04T06:52:35.710 INFO:tasks.rados.rados.0.smithi137.stdout:3257: finishing copy_from racing read to smithi13777483-16 2024-03-04T06:52:35.710 INFO:tasks.rados.rados.0.smithi137.stdout:3257: finishing copy_from to smithi13777483-16 2024-03-04T06:52:35.710 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 15524 (ObjNum 963 snap 282 seq_num 963) dirty exists 2024-03-04T06:52:35.710 INFO:tasks.rados.rados.0.smithi137.stdout:3254: done (4 left) 2024-03-04T06:52:35.710 INFO:tasks.rados.rados.0.smithi137.stdout:3255: done (3 left) 2024-03-04T06:52:35.710 INFO:tasks.rados.rados.0.smithi137.stdout:3256: done (2 left) 2024-03-04T06:52:35.710 INFO:tasks.rados.rados.0.smithi137.stdout:3257: done (1 left) 2024-03-04T06:52:35.710 INFO:tasks.rados.rados.0.smithi137.stdout:3260: copy_from oid 12 from oid 25 current snap is 304 2024-03-04T06:52:35.710 INFO:tasks.rados.rados.0.smithi137.stdout:3259: finishing rollback tid 0 to smithi13777483-43 2024-03-04T06:52:35.710 INFO:tasks.rados.rados.0.smithi137.stdout:3259: finishing rollback tid 1 to smithi13777483-43 2024-03-04T06:52:35.710 INFO:tasks.rados.rados.0.smithi137.stdout:3259: finishing rollback tid 2 to smithi13777483-43 2024-03-04T06:52:35.711 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16915 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:52:35.711 INFO:tasks.rados.rados.0.smithi137.stdout:3259: done (1 left) 2024-03-04T06:52:35.711 INFO:tasks.rados.rados.0.smithi137.stdout:3261: rollback oid 48 current snap is 304 2024-03-04T06:52:35.711 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 48 to 299 2024-03-04T06:52:35.711 INFO:tasks.rados.rados.0.smithi137.stdout:3262: delete oid 36 current snap is 304 2024-03-04T06:52:35.712 INFO:tasks.rados.rados.0.smithi137.stdout:3262: done (2 left) 2024-03-04T06:52:35.712 INFO:tasks.rados.rados.0.smithi137.stdout:3263: rollback oid 32 current snap is 304 2024-03-04T06:52:35.712 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 32 to 291 2024-03-04T06:52:35.712 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 35 current snap is 304 2024-03-04T06:52:35.712 INFO:tasks.rados.rados.0.smithi137.stdout:3264: seq_num 1025 ranges {4358144=368640} 2024-03-04T06:52:35.738 INFO:tasks.rados.rados.0.smithi137.stdout:3264: writing smithi13777483-35 from 4358144 to 4726784 tid 1 2024-03-04T06:52:35.738 INFO:tasks.rados.rados.0.smithi137.stdout:3265: snap_create 2024-03-04T06:52:35.738 INFO:tasks.rados.rados.0.smithi137.stdout:3260: finishing copy_from to smithi13777483-12 2024-03-04T06:52:35.738 INFO:tasks.rados.rados.0.smithi137.stdout:3260: got expected ENOENT (src dne) 2024-03-04T06:52:35.738 INFO:tasks.rados.rados.0.smithi137.stdout:3260: finishing copy_from racing read to smithi13777483-12 2024-03-04T06:52:35.738 INFO:tasks.rados.rados.0.smithi137.stdout:3261: finishing rollback tid 1 to smithi13777483-48 2024-03-04T06:52:35.738 INFO:tasks.rados.rados.0.smithi137.stdout:3261: finishing rollback tid 2 to smithi13777483-48 2024-03-04T06:52:35.738 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 16916 (ObjNum 955 snap 281 seq_num 955) dirty exists 2024-03-04T06:52:35.738 INFO:tasks.rados.rados.0.smithi137.stdout:3263: finishing rollback tid 0 to smithi13777483-32 2024-03-04T06:52:35.738 INFO:tasks.rados.rados.0.smithi137.stdout:3263: finishing rollback tid 1 to smithi13777483-32 2024-03-04T06:52:35.738 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16946 (ObjNum 81 snap 0 seq_num 1634489189) dirty dne 2024-03-04T06:52:35.743 INFO:tasks.rados.rados.0.smithi137.stdout:3264: finishing write tid 1 to smithi13777483-35 2024-03-04T06:52:35.743 INFO:tasks.rados.rados.0.smithi137.stdout:3264: finishing write tid 2 to smithi13777483-35 2024-03-04T06:52:35.745 INFO:tasks.rados.rados.0.smithi137.stdout:3264: finishing write tid 3 to smithi13777483-35 2024-03-04T06:52:35.745 INFO:tasks.rados.rados.0.smithi137.stdout:3264: oid 35 updating version 0 to 16933 2024-03-04T06:52:35.745 INFO:tasks.rados.rados.0.smithi137.stdout:3264: oid 35 updating version 16933 to 16934 2024-03-04T06:52:35.745 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16934 (ObjNum 1025 snap 304 seq_num 1025) dirty exists 2024-03-04T06:52:35.745 INFO:tasks.rados.rados.0.smithi137.stdout:3264: left oid 35 (ObjNum 1025 snap 304 seq_num 1025) 2024-03-04T06:52:35.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:35.404+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:35.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:35.401+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:35.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:35.401+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:35.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:35.394+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:35.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:35.394+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:35.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:35.392+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:35.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:35.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:35.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-mon[85573]: osdmap e675: 8 total, 8 up, 8 in 2024-03-04T06:52:35.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:35.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:35.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:35.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:35.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:35.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:35.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:35.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:35.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:35 smithi203 ceph-mon[85573]: pgmap v694: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 636 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 18 op/s 2024-03-04T06:52:35.971 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-03-04T06:52:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": { 2024-03-04T06:52:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 3 2024-03-04T06:52:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:52:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": { 2024-03-04T06:52:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:52:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:52:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": { 2024-03-04T06:52:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 8 2024-03-04T06:52:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:52:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-03-04T06:52:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 2 2024-03-04T06:52:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-03-04T06:52:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: "overall": { 2024-03-04T06:52:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)": 15 2024-03-04T06:52:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-03-04T06:52:35.972 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-03-04T06:52:36.398 INFO:tasks.rados.rados.0.smithi137.stdout:3260: done (4 left) 2024-03-04T06:52:36.398 INFO:tasks.rados.rados.0.smithi137.stdout:3261: done (3 left) 2024-03-04T06:52:36.398 INFO:tasks.rados.rados.0.smithi137.stdout:3263: done (2 left) 2024-03-04T06:52:36.398 INFO:tasks.rados.rados.0.smithi137.stdout:3264: done (1 left) 2024-03-04T06:52:36.398 INFO:tasks.rados.rados.0.smithi137.stdout:3265: done (0 left) 2024-03-04T06:52:36.398 INFO:tasks.rados.rados.0.smithi137.stdout:3266: delete oid 13 current snap is 305 2024-03-04T06:52:36.401 INFO:tasks.rados.rados.0.smithi137.stdout:3266: done (0 left) 2024-03-04T06:52:36.401 INFO:tasks.rados.rados.0.smithi137.stdout:3267: delete oid 2 current snap is 305 2024-03-04T06:52:36.405 INFO:tasks.rados.rados.0.smithi137.stdout:3267: done (0 left) 2024-03-04T06:52:36.405 INFO:tasks.rados.rados.0.smithi137.stdout:3268: snap_create 2024-03-04T06:52:36.665 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:36.574+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:36.665 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:36.574+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:36.665 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:36.574+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:36.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:36.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:36.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:36.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:36.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[88869]: osdmap e676: 8 total, 8 up, 8 in 2024-03-04T06:52:36.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:36.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:36.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:36.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:36.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:36.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:36.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/1278257762' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:36.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:36.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:36.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:36.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:36.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[91314]: osdmap e676: 8 total, 8 up, 8 in 2024-03-04T06:52:36.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:36.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:36.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:36.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:36.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:36.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:36.667 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/1278257762' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:36.668 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:36.398+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:36.668 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:36.405+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:36.687 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -e sha1=efb04e5e69d058b0c47e511cb7e10d57a92f59ae -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-03-04T06:52:36.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:36.402+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:36.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:36.405+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:36.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:36.405+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:36.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:36.405+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:36.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:36.398+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:36.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:36.398+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:36.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:36.398+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:36.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:36.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:36.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:36.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:36.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-mon[85573]: osdmap e676: 8 total, 8 up, 8 in 2024-03-04T06:52:36.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:36.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:36.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:36.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:36.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:36.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:36.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/1278257762' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:36.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:36.574+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:36.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:36.574+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:36.892 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:52:37.407 INFO:tasks.rados.rados.0.smithi137.stdout:3268: done (0 left) 2024-03-04T06:52:37.407 INFO:tasks.rados.rados.0.smithi137.stdout:3269: read oid 49 snap -1 2024-03-04T06:52:37.407 INFO:tasks.rados.rados.0.smithi137.stdout:3269: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:52:37.407 INFO:tasks.rados.rados.0.smithi137.stdout:3270: rollback oid 18 current snap is 306 2024-03-04T06:52:37.407 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 18 to 304 2024-03-04T06:52:37.407 INFO:tasks.rados.rados.0.smithi137.stdout:3271: snap_remove snap 291 2024-03-04T06:52:37.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:37.405+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[88869]: osdmap e677: 8 total, 8 up, 8 in 2024-03-04T06:52:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:37.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:37.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:37.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:37.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:37.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:37.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[88869]: pgmap v697: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 636 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 18 op/s 2024-03-04T06:52:37.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:37.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[91314]: osdmap e677: 8 total, 8 up, 8 in 2024-03-04T06:52:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:37.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[91314]: pgmap v697: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 636 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 18 op/s 2024-03-04T06:52:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:37.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:37.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:37.414+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:37.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:37.403+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:37.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:37.403+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:37.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:37.415+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:37.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:37.411+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:37.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:37.414+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:37.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-mon[85573]: osdmap e677: 8 total, 8 up, 8 in 2024-03-04T06:52:37.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:37.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:37.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:37.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:37.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:37.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:37.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:37.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-mon[85573]: pgmap v697: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 636 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 18 op/s 2024-03-04T06:52:37.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:37.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:38.267 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:37.968+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:38.267 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:37.968+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:38.267 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:37.968+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:38.410 INFO:tasks.rados.rados.0.smithi137.stdout:3271: done (2 left) 2024-03-04T06:52:38.410 INFO:tasks.rados.rados.0.smithi137.stdout:3272: read oid 17 snap -1 2024-03-04T06:52:38.410 INFO:tasks.rados.rados.0.smithi137.stdout:3272: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:52:38.411 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 306 2024-03-04T06:52:38.411 INFO:tasks.rados.rados.0.smithi137.stdout:3273: seq_num 1028 ranges {0=425984} 2024-03-04T06:52:38.414 INFO:tasks.rados.rados.0.smithi137.stdout:3273: writing smithi13777483-23 from 0 to 425984 tid 1 2024-03-04T06:52:38.414 INFO:tasks.rados.rados.0.smithi137.stdout:3274: setattr oid 7 current snap is 306 2024-03-04T06:52:38.416 INFO:tasks.rados.rados.0.smithi137.stdout:3270: finishing rollback tid 0 to smithi13777483-18 2024-03-04T06:52:38.416 INFO:tasks.rados.rados.0.smithi137.stdout:3270: finishing rollback tid 1 to smithi13777483-18 2024-03-04T06:52:38.416 INFO:tasks.rados.rados.0.smithi137.stdout:3270: finishing rollback tid 2 to smithi13777483-18 2024-03-04T06:52:38.416 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16905 (ObjNum 1022 snap 304 seq_num 1022) dirty exists 2024-03-04T06:52:38.416 INFO:tasks.rados.rados.0.smithi137.stdout:3269: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:52:38.542 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:38.411+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:38.542 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:38.413+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:38.542 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:38.413+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:38.542 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:38.413+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[91314]: osdmap e678: 8 total, 8 up, 8 in 2024-03-04T06:52:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:52:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[88869]: osdmap e678: 8 total, 8 up, 8 in 2024-03-04T06:52:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:38.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:38.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:52:38.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:38.408+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:38.734 INFO:tasks.rados.rados.0.smithi137.stdout:3273: finishing write tid 1 to smithi13777483-23 2024-03-04T06:52:38.734 INFO:tasks.rados.rados.0.smithi137.stdout:3273: finishing write tid 2 to smithi13777483-23 2024-03-04T06:52:38.734 INFO:tasks.rados.rados.0.smithi137.stdout:3273: finishing write tid 3 to smithi13777483-23 2024-03-04T06:52:38.734 INFO:tasks.rados.rados.0.smithi137.stdout:3273: oid 23 updating version 0 to 16914 2024-03-04T06:52:38.735 INFO:tasks.rados.rados.0.smithi137.stdout:3273: oid 23 version 16914 is already newer than 16913 2024-03-04T06:52:38.735 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 16914 (ObjNum 1028 snap 306 seq_num 1028) dirty exists 2024-03-04T06:52:38.735 INFO:tasks.rados.rados.0.smithi137.stdout:3273: left oid 23 (ObjNum 1028 snap 306 seq_num 1028) 2024-03-04T06:52:38.735 INFO:tasks.rados.rados.0.smithi137.stdout:3272: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:52:38.838 INFO:teuthology.orchestra.run.smithi137.stdout:true 2024-03-04T06:52:38.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:38.405+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:38.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:38.411+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:38.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:38.414+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:38.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:38.414+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:38.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:38.424+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:38.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:38.424+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:38.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:38.425+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:38.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:38.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:38.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:38.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:38.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-mon[85573]: osdmap e678: 8 total, 8 up, 8 in 2024-03-04T06:52:38.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:38.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:38.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:38.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:38.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:38.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:52:38.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:38.420+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:38.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:38.420+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:38.858 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16936 (ObjNum 978 snap 286 seq_num 978) dirty exists 2024-03-04T06:52:38.858 INFO:tasks.rados.rados.0.smithi137.stdout:3269: done (4 left) 2024-03-04T06:52:38.858 INFO:tasks.rados.rados.0.smithi137.stdout:3270: done (3 left) 2024-03-04T06:52:38.859 INFO:tasks.rados.rados.0.smithi137.stdout:3272: done (2 left) 2024-03-04T06:52:38.859 INFO:tasks.rados.rados.0.smithi137.stdout:3273: done (1 left) 2024-03-04T06:52:38.859 INFO:tasks.rados.rados.0.smithi137.stdout:3274: done (0 left) 2024-03-04T06:52:38.859 INFO:tasks.rados.rados.0.smithi137.stdout:3275: copy_from oid 43 from oid 17 current snap is 306 2024-03-04T06:52:38.859 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 306 2024-03-04T06:52:38.859 INFO:tasks.rados.rados.0.smithi137.stdout:3276: seq_num 1029 ranges {442368=442368} 2024-03-04T06:52:38.863 INFO:tasks.rados.rados.0.smithi137.stdout:3276: writing smithi13777483-34 from 442368 to 884736 tid 1 2024-03-04T06:52:38.863 INFO:tasks.rados.rados.0.smithi137.stdout:3277: delete oid 15 current snap is 306 2024-03-04T06:52:38.867 INFO:tasks.rados.rados.0.smithi137.stdout:3277: done (2 left) 2024-03-04T06:52:38.867 INFO:tasks.rados.rados.0.smithi137.stdout:3278: read oid 23 snap -1 2024-03-04T06:52:38.867 INFO:tasks.rados.rados.0.smithi137.stdout:3278: expect (ObjNum 1028 snap 306 seq_num 1028) 2024-03-04T06:52:38.867 INFO:tasks.rados.rados.0.smithi137.stdout:3279: read oid 30 snap -1 2024-03-04T06:52:38.867 INFO:tasks.rados.rados.0.smithi137.stdout:3279: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:52:38.867 INFO:tasks.rados.rados.0.smithi137.stdout:3280: rollback oid 4 current snap is 306 2024-03-04T06:52:38.867 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 4 to 305 2024-03-04T06:52:38.867 INFO:tasks.rados.rados.0.smithi137.stdout:3281: rollback oid 8 current snap is 306 2024-03-04T06:52:38.867 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 8 to 296 2024-03-04T06:52:38.868 INFO:tasks.rados.rados.0.smithi137.stdout:3282: copy_from oid 5 from oid 39 current snap is 306 2024-03-04T06:52:38.868 INFO:tasks.rados.rados.0.smithi137.stdout:3283: delete oid 47 current snap is 306 2024-03-04T06:52:38.869 INFO:tasks.rados.rados.0.smithi137.stdout:3282: finishing copy_from to smithi13777483-5 2024-03-04T06:52:38.869 INFO:tasks.rados.rados.0.smithi137.stdout:3282: got expected ENOENT (src dne) 2024-03-04T06:52:38.869 INFO:tasks.rados.rados.0.smithi137.stdout:3282: finishing copy_from racing read to smithi13777483-5 2024-03-04T06:52:38.873 INFO:tasks.rados.rados.0.smithi137.stdout:3278: expect (ObjNum 1028 snap 306 seq_num 1028) 2024-03-04T06:52:38.888 INFO:tasks.rados.rados.0.smithi137.stdout:3276: finishing write tid 1 to smithi13777483-34 2024-03-04T06:52:38.888 INFO:tasks.rados.rados.0.smithi137.stdout:3278: done (7 left) 2024-03-04T06:52:38.888 INFO:tasks.rados.rados.0.smithi137.stdout:3282: done (6 left) 2024-03-04T06:52:38.888 INFO:tasks.rados.rados.0.smithi137.stdout:3283: done (5 left) 2024-03-04T06:52:38.888 INFO:tasks.rados.rados.0.smithi137.stdout:3284: snap_remove snap 304 2024-03-04T06:52:39.423 INFO:tasks.rados.rados.0.smithi137.stdout:3284: done (5 left) 2024-03-04T06:52:39.423 INFO:tasks.rados.rados.0.smithi137.stdout:3285: snap_create 2024-03-04T06:52:39.423 INFO:tasks.rados.rados.0.smithi137.stdout:3280: finishing rollback tid 0 to smithi13777483-4 2024-03-04T06:52:39.423 INFO:tasks.rados.rados.0.smithi137.stdout:3275: finishing copy_from racing read to smithi13777483-43 2024-03-04T06:52:39.423 INFO:tasks.rados.rados.0.smithi137.stdout:3280: finishing rollback tid 1 to smithi13777483-4 2024-03-04T06:52:39.423 INFO:tasks.rados.rados.0.smithi137.stdout:3281: finishing rollback tid 0 to smithi13777483-8 2024-03-04T06:52:39.423 INFO:tasks.rados.rados.0.smithi137.stdout:3280: finishing rollback tid 2 to smithi13777483-4 2024-03-04T06:52:39.423 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 15527 (ObjNum 963 snap 282 seq_num 963) dirty exists 2024-03-04T06:52:39.423 INFO:tasks.rados.rados.0.smithi137.stdout:3281: finishing rollback tid 1 to smithi13777483-8 2024-03-04T06:52:39.424 INFO:tasks.rados.rados.0.smithi137.stdout:3276: finishing write tid 2 to smithi13777483-34 2024-03-04T06:52:39.424 INFO:tasks.rados.rados.0.smithi137.stdout:3281: finishing rollback tid 2 to smithi13777483-8 2024-03-04T06:52:39.424 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16939 (ObjNum 954 snap 281 seq_num 954) dirty exists 2024-03-04T06:52:39.424 INFO:tasks.rados.rados.0.smithi137.stdout:3275: finishing copy_from to smithi13777483-43 2024-03-04T06:52:39.424 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16912 (ObjNum 1009 snap 296 seq_num 1009) dirty exists 2024-03-04T06:52:39.424 INFO:tasks.rados.rados.0.smithi137.stdout:3276: finishing write tid 3 to smithi13777483-34 2024-03-04T06:52:39.424 INFO:tasks.rados.rados.0.smithi137.stdout:3276: oid 34 updating version 0 to 16908 2024-03-04T06:52:39.424 INFO:tasks.rados.rados.0.smithi137.stdout:3276: oid 34 version 16908 is already newer than 16907 2024-03-04T06:52:39.424 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16908 (ObjNum 1029 snap 306 seq_num 1029) dirty exists 2024-03-04T06:52:39.424 INFO:tasks.rados.rados.0.smithi137.stdout:3276: left oid 34 (ObjNum 1029 snap 306 seq_num 1029) 2024-03-04T06:52:39.424 INFO:tasks.rados.rados.0.smithi137.stdout:3279: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:52:39.643 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -e sha1=efb04e5e69d058b0c47e511cb7e10d57a92f59ae -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-03-04T06:52:39.668 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:39.423+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:39.668 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:39.437+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:39.668 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:39.437+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:39.669 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:39.669 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:39.669 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:39.669 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: osdmap e679: 8 total, 8 up, 8 in 2024-03-04T06:52:39.669 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:39.669 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:39.669 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:39.669 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:39.669 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:39.669 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:39.670 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: pgmap v700: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 650 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 2.8 MiB/s wr, 4 op/s 2024-03-04T06:52:39.670 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:39.670 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:39.670 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:39.670 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/2775824273' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:39.670 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:39.425+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:39.671 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:39.671 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:39.671 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:39.671 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: osdmap e679: 8 total, 8 up, 8 in 2024-03-04T06:52:39.672 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:39.672 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:39.672 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:39.672 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:39.672 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:39.672 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:39.673 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: pgmap v700: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 650 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 2.8 MiB/s wr, 4 op/s 2024-03-04T06:52:39.673 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:39.673 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:39.673 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:39.673 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:39 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/2775824273' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:39.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:39.427+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:39.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:39.421+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:39.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:39.421+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:39.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:39.425+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:39.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:39.425+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:39.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:39.437+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: osdmap e679: 8 total, 8 up, 8 in 2024-03-04T06:52:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:39.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: pgmap v700: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 650 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 2.8 MiB/s wr, 4 op/s 2024-03-04T06:52:39.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:39.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:39.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:39.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:39 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/2775824273' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:39.849 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:52:40.424 INFO:tasks.rados.rados.0.smithi137.stdout:3275: done (5 left) 2024-03-04T06:52:40.425 INFO:tasks.rados.rados.0.smithi137.stdout:3276: done (4 left) 2024-03-04T06:52:40.425 INFO:tasks.rados.rados.0.smithi137.stdout:3279: done (3 left) 2024-03-04T06:52:40.425 INFO:tasks.rados.rados.0.smithi137.stdout:3280: done (2 left) 2024-03-04T06:52:40.425 INFO:tasks.rados.rados.0.smithi137.stdout:3281: done (1 left) 2024-03-04T06:52:40.425 INFO:tasks.rados.rados.0.smithi137.stdout:3285: done (0 left) 2024-03-04T06:52:40.425 INFO:tasks.rados.rados.0.smithi137.stdout:3286: rollback oid 16 current snap is 307 2024-03-04T06:52:40.425 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 16 to 298 2024-03-04T06:52:40.425 INFO:tasks.rados.rados.0.smithi137.stdout:3287: setattr oid 43 current snap is 307 2024-03-04T06:52:40.427 INFO:tasks.rados.rados.0.smithi137.stdout:3288: delete oid 40 current snap is 307 2024-03-04T06:52:40.436 INFO:tasks.rados.rados.0.smithi137.stdout:3286: finishing rollback tid 0 to smithi13777483-16 2024-03-04T06:52:40.436 INFO:tasks.rados.rados.0.smithi137.stdout:3286: finishing rollback tid 1 to smithi13777483-16 2024-03-04T06:52:40.436 INFO:tasks.rados.rados.0.smithi137.stdout:3286: finishing rollback tid 2 to smithi13777483-16 2024-03-04T06:52:40.436 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16911 (ObjNum 1002 snap 294 seq_num 1002) dirty exists 2024-03-04T06:52:40.439 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16916 (ObjNum 1009 snap 296 seq_num 1009) dirty exists 2024-03-04T06:52:40.439 INFO:tasks.rados.rados.0.smithi137.stdout:3286: done (2 left) 2024-03-04T06:52:40.439 INFO:tasks.rados.rados.0.smithi137.stdout:3287: done (1 left) 2024-03-04T06:52:40.439 INFO:tasks.rados.rados.0.smithi137.stdout:3288: done (0 left) 2024-03-04T06:52:40.439 INFO:tasks.rados.rados.0.smithi137.stdout:3289: copy_from oid 13 from oid 10 current snap is 307 2024-03-04T06:52:40.439 INFO:tasks.rados.rados.0.smithi137.stdout:3290: setattr oid 22 current snap is 307 2024-03-04T06:52:40.440 INFO:tasks.rados.rados.0.smithi137.stdout:3289: finishing copy_from to smithi13777483-13 2024-03-04T06:52:40.440 INFO:tasks.rados.rados.0.smithi137.stdout:3289: got expected ENOENT (src dne) 2024-03-04T06:52:40.440 INFO:tasks.rados.rados.0.smithi137.stdout:3289: finishing copy_from racing read to smithi13777483-13 2024-03-04T06:52:40.441 INFO:tasks.rados.rados.0.smithi137.stdout:3289: done (1 left) 2024-03-04T06:52:40.441 INFO:tasks.rados.rados.0.smithi137.stdout:3291: copy_from oid 25 from oid 40 current snap is 307 2024-03-04T06:52:40.441 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 307 2024-03-04T06:52:40.441 INFO:tasks.rados.rados.0.smithi137.stdout:3292: seq_num 1033 ranges {3891200=507904} 2024-03-04T06:52:40.465 INFO:tasks.rados.rados.0.smithi137.stdout:3292: writing smithi13777483-8 from 3891200 to 4399104 tid 1 2024-03-04T06:52:40.465 INFO:tasks.rados.rados.0.smithi137.stdout:3293: snap_create 2024-03-04T06:52:40.465 INFO:tasks.rados.rados.0.smithi137.stdout:3291: finishing copy_from to smithi13777483-25 2024-03-04T06:52:40.465 INFO:tasks.rados.rados.0.smithi137.stdout:3291: got expected ENOENT (src dne) 2024-03-04T06:52:40.465 INFO:tasks.rados.rados.0.smithi137.stdout:3291: finishing copy_from racing read to smithi13777483-25 2024-03-04T06:52:40.465 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 16936 (ObjNum 959 snap 282 seq_num 959) dirty exists 2024-03-04T06:52:40.468 INFO:tasks.rados.rados.0.smithi137.stdout:3292: finishing write tid 1 to smithi13777483-8 2024-03-04T06:52:40.469 INFO:tasks.rados.rados.0.smithi137.stdout:3292: finishing write tid 2 to smithi13777483-8 2024-03-04T06:52:40.475 INFO:tasks.rados.rados.0.smithi137.stdout:3292: finishing write tid 3 to smithi13777483-8 2024-03-04T06:52:40.476 INFO:tasks.rados.rados.0.smithi137.stdout:3292: oid 8 updating version 0 to 16941 2024-03-04T06:52:40.476 INFO:tasks.rados.rados.0.smithi137.stdout:3292: oid 8 version 16941 is already newer than 16940 2024-03-04T06:52:40.476 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16941 (ObjNum 1033 snap 307 seq_num 1033) dirty exists 2024-03-04T06:52:40.476 INFO:tasks.rados.rados.0.smithi137.stdout:3292: left oid 8 (ObjNum 1033 snap 307 seq_num 1033) 2024-03-04T06:52:40.653 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:40.444+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:40.654 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:40.429+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:40.654 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:40.425+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:40.654 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:40.425+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:40.654 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:40.425+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:40.654 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[88869]: osdmap e680: 8 total, 8 up, 8 in 2024-03-04T06:52:40.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:40.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:40.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:40.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:40.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:40.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:40.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:40.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:40.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:40.655 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:40.655 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[91314]: osdmap e680: 8 total, 8 up, 8 in 2024-03-04T06:52:40.656 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:40.656 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:40.656 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:40.656 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:40.656 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:40.656 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:40.656 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:40.656 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:40.656 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:40.656 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:40.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:40.423+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:40.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:40.437+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:40.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:40.437+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:40.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:40.438+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:40.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:40.438+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:40.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:40.439+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:40.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:40.439+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:40.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-mon[85573]: osdmap e680: 8 total, 8 up, 8 in 2024-03-04T06:52:40.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:40.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:40.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:40.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:40.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:40.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:40.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:40.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:40.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:40.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:40.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:40.429+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:40.848 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:40.429+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:41.438 INFO:tasks.rados.rados.0.smithi137.stdout:3290: done (3 left) 2024-03-04T06:52:41.438 INFO:tasks.rados.rados.0.smithi137.stdout:3291: done (2 left) 2024-03-04T06:52:41.438 INFO:tasks.rados.rados.0.smithi137.stdout:3292: done (1 left) 2024-03-04T06:52:41.438 INFO:tasks.rados.rados.0.smithi137.stdout:3293: done (0 left) 2024-03-04T06:52:41.439 INFO:tasks.rados.rados.0.smithi137.stdout:3294: read oid 10 snap -1 2024-03-04T06:52:41.439 INFO:tasks.rados.rados.0.smithi137.stdout:3294: expect deleted 2024-03-04T06:52:41.439 INFO:tasks.rados.rados.0.smithi137.stdout:3295: snap_create 2024-03-04T06:52:41.542 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:41.436+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[88869]: pgmap v702: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 650 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 8.4 MiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-03-04T06:52:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[88869]: osdmap e681: 8 total, 8 up, 8 in 2024-03-04T06:52:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:41.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[91314]: pgmap v702: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 650 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 8.4 MiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-03-04T06:52:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[91314]: osdmap e681: 8 total, 8 up, 8 in 2024-03-04T06:52:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:41.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:41.757 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph version 19.0.0-1791-gefb04e5e (efb04e5e69d058b0c47e511cb7e10d57a92f59ae) squid (dev)" 2024-03-04T06:52:41.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:41.437+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:41.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:41.437+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-mon[85573]: pgmap v702: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 650 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 8.4 MiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-03-04T06:52:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-mon[85573]: osdmap e681: 8 total, 8 up, 8 in 2024-03-04T06:52:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:41.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:41.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:41.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:41.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:42.448 INFO:tasks.rados.rados.0.smithi137.stdout:3294: done (1 left) 2024-03-04T06:52:42.448 INFO:tasks.rados.rados.0.smithi137.stdout:3295: done (0 left) 2024-03-04T06:52:42.448 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 309 2024-03-04T06:52:42.449 INFO:tasks.rados.rados.0.smithi137.stdout:3296: seq_num 1034 ranges {3104768=524288} 2024-03-04T06:52:42.468 INFO:tasks.rados.rados.0.smithi137.stdout:3296: writing smithi13777483-42 from 3104768 to 3629056 tid 1 2024-03-04T06:52:42.468 INFO:tasks.rados.rados.0.smithi137.stdout:3297: setattr oid 12 current snap is 309 2024-03-04T06:52:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 309 2024-03-04T06:52:42.469 INFO:tasks.rados.rados.0.smithi137.stdout:3298: seq_num 1035 ranges {0=540672} 2024-03-04T06:52:42.472 INFO:tasks.rados.rados.0.smithi137.stdout:3298: writing smithi13777483-25 from 0 to 540672 tid 1 2024-03-04T06:52:42.472 INFO:tasks.rados.rados.0.smithi137.stdout:3299: read oid 23 snap -1 2024-03-04T06:52:42.472 INFO:tasks.rados.rados.0.smithi137.stdout:3299: expect (ObjNum 1028 snap 306 seq_num 1028) 2024-03-04T06:52:42.472 INFO:tasks.rados.rados.0.smithi137.stdout:3300: delete oid 17 current snap is 309 2024-03-04T06:52:42.473 INFO:tasks.rados.rados.0.smithi137.stdout:3296: finishing write tid 1 to smithi13777483-42 2024-03-04T06:52:42.474 INFO:tasks.rados.rados.0.smithi137.stdout:3296: finishing write tid 2 to smithi13777483-42 2024-03-04T06:52:42.476 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16912 (ObjNum 1023 snap 304 seq_num 1023) dirty exists 2024-03-04T06:52:42.477 INFO:tasks.rados.rados.0.smithi137.stdout:3299: expect (ObjNum 1028 snap 306 seq_num 1028) 2024-03-04T06:52:42.489 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-04T06:52:42.490 INFO:teuthology.task.print:**** done end upgrade, wait... 2024-03-04T06:52:42.490 DEBUG:teuthology.parallel:result is None 2024-03-04T06:52:42.491 INFO:tasks.rados.rados.0.smithi137.stdout:3296: finishing write tid 3 to smithi13777483-42 2024-03-04T06:52:42.491 INFO:tasks.rados.rados.0.smithi137.stdout:3296: oid 42 updating version 0 to 16948 2024-03-04T06:52:42.492 INFO:tasks.rados.rados.0.smithi137.stdout:3296: oid 42 updating version 16948 to 16949 2024-03-04T06:52:42.492 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16949 (ObjNum 1034 snap 309 seq_num 1034) dirty exists 2024-03-04T06:52:42.492 INFO:tasks.rados.rados.0.smithi137.stdout:3296: left oid 42 (ObjNum 1034 snap 309 seq_num 1034) 2024-03-04T06:52:42.492 INFO:tasks.rados.rados.0.smithi137.stdout:3298: finishing write tid 1 to smithi13777483-25 2024-03-04T06:52:42.492 INFO:tasks.rados.rados.0.smithi137.stdout:3298: finishing write tid 2 to smithi13777483-25 2024-03-04T06:52:42.492 INFO:tasks.rados.rados.0.smithi137.stdout:3298: finishing write tid 3 to smithi13777483-25 2024-03-04T06:52:42.492 INFO:tasks.rados.rados.0.smithi137.stdout:3298: oid 25 updating version 0 to 16932 2024-03-04T06:52:42.492 INFO:tasks.rados.rados.0.smithi137.stdout:3298: oid 25 version 16932 is already newer than 16931 2024-03-04T06:52:42.492 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 16932 (ObjNum 1035 snap 309 seq_num 1035) dirty exists 2024-03-04T06:52:42.492 INFO:tasks.rados.rados.0.smithi137.stdout:3298: left oid 25 (ObjNum 1035 snap 309 seq_num 1035) 2024-03-04T06:52:42.492 INFO:tasks.rados.rados.0.smithi137.stdout:3296: done (4 left) 2024-03-04T06:52:42.492 INFO:tasks.rados.rados.0.smithi137.stdout:3297: done (3 left) 2024-03-04T06:52:42.492 INFO:tasks.rados.rados.0.smithi137.stdout:3298: done (2 left) 2024-03-04T06:52:42.493 INFO:tasks.rados.rados.0.smithi137.stdout:3299: done (1 left) 2024-03-04T06:52:42.493 INFO:tasks.rados.rados.0.smithi137.stdout:3300: done (0 left) 2024-03-04T06:52:42.493 INFO:tasks.rados.rados.0.smithi137.stdout:3301: setattr oid 15 current snap is 309 2024-03-04T06:52:42.493 INFO:tasks.rados.rados.0.smithi137.stdout:3302: delete oid 16 current snap is 309 2024-03-04T06:52:42.495 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16937 (ObjNum 257 snap 0 seq_num 3162484176) dirty exists 2024-03-04T06:52:42.496 INFO:tasks.rados.rados.0.smithi137.stdout:3301: done (1 left) 2024-03-04T06:52:42.496 INFO:tasks.rados.rados.0.smithi137.stdout:3302: done (0 left) 2024-03-04T06:52:42.496 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 309 2024-03-04T06:52:42.496 INFO:tasks.rados.rados.0.smithi137.stdout:3303: seq_num 1038 ranges {4055040=589824} 2024-03-04T06:52:42.521 INFO:tasks.rados.rados.0.smithi137.stdout:3303: writing smithi13777483-12 from 4055040 to 4644864 tid 1 2024-03-04T06:52:42.521 INFO:tasks.rados.rados.0.smithi137.stdout:3304: snap_remove snap 308 2024-03-04T06:52:42.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:42.475+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:42.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:42.478+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:42.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:42.478+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:42.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:42.337+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:42.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:42.471+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:42.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:42.276+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:42.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:42.444+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:42.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:42.444+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-mon[85573]: osdmap e682: 8 total, 8 up, 8 in 2024-03-04T06:52:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/3506230734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-mon[85573]: pgmap v705: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 650 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 8.4 MiB/s rd, 90 KiB/s wr, 8 op/s 2024-03-04T06:52:42.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:42.338+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:42.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:42.339+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:42.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:42.479+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:42.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:42.479+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:42.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:42.479+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:42.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:42.479+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:42.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:42.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-mon[88869]: osdmap e682: 8 total, 8 up, 8 in 2024-03-04T06:52:42.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:42.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:42.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/3506230734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:42.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-mon[88869]: pgmap v705: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 650 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 8.4 MiB/s rd, 90 KiB/s wr, 8 op/s 2024-03-04T06:52:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-mon[91314]: osdmap e682: 8 total, 8 up, 8 in 2024-03-04T06:52:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/3506230734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-04T06:52:42.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-mon[91314]: pgmap v705: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 650 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 8.4 MiB/s rd, 90 KiB/s wr, 8 op/s 2024-03-04T06:52:42.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:42.337+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:42.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:42.337+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:42.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:42.474+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:42.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:42.475+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:42.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:42.476+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:42.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:42.328+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:42.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:42.446+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:43.460 INFO:tasks.rados.rados.0.smithi137.stdout:3304: done (1 left) 2024-03-04T06:52:43.460 INFO:tasks.rados.rados.0.smithi137.stdout:3305: copy_from oid 28 from oid 33 current snap is 309 2024-03-04T06:52:43.460 INFO:tasks.rados.rados.0.smithi137.stdout:3303: finishing write tid 1 to smithi13777483-12 2024-03-04T06:52:43.461 INFO:tasks.rados.rados.0.smithi137.stdout:3303: finishing write tid 2 to smithi13777483-12 2024-03-04T06:52:43.461 INFO:tasks.rados.rados.0.smithi137.stdout:3303: finishing write tid 3 to smithi13777483-12 2024-03-04T06:52:43.461 INFO:tasks.rados.rados.0.smithi137.stdout:3303: oid 12 updating version 0 to 16914 2024-03-04T06:52:43.461 INFO:tasks.rados.rados.0.smithi137.stdout:3303: oid 12 version 16914 is already newer than 16913 2024-03-04T06:52:43.461 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16914 (ObjNum 1038 snap 309 seq_num 1038) dirty exists 2024-03-04T06:52:43.461 INFO:tasks.rados.rados.0.smithi137.stdout:3303: left oid 12 (ObjNum 1038 snap 309 seq_num 1038) 2024-03-04T06:52:43.461 INFO:tasks.rados.rados.0.smithi137.stdout:3303: done (1 left) 2024-03-04T06:52:43.461 INFO:tasks.rados.rados.0.smithi137.stdout:3306: rollback oid 20 current snap is 309 2024-03-04T06:52:43.461 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 20 to 294 2024-03-04T06:52:43.461 INFO:tasks.rados.rados.0.smithi137.stdout:3307: snap_create 2024-03-04T06:52:43.469 INFO:tasks.rados.rados.0.smithi137.stdout:3306: finishing rollback tid 0 to smithi13777483-20 2024-03-04T06:52:43.469 INFO:tasks.rados.rados.0.smithi137.stdout:3306: finishing rollback tid 1 to smithi13777483-20 2024-03-04T06:52:43.471 INFO:tasks.rados.rados.0.smithi137.stdout:3306: finishing rollback tid 2 to smithi13777483-20 2024-03-04T06:52:43.471 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16917 (ObjNum 853 snap 249 seq_num 853) dirty exists 2024-03-04T06:52:43.494 INFO:tasks.rados.rados.0.smithi137.stdout:3305: finishing copy_from racing read to smithi13777483-28 2024-03-04T06:52:43.498 INFO:tasks.rados.rados.0.smithi137.stdout:3305: finishing copy_from to smithi13777483-28 2024-03-04T06:52:43.498 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16932 (ObjNum 959 snap 282 seq_num 959) dirty exists 2024-03-04T06:52:43.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:43.458+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:43.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:43.459+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:43.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:43.463+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:43.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:43.474+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: osdmap e683: 8 total, 8 up, 8 in 2024-03-04T06:52:43.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:43.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:43.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:43.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:43.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: osdmap e683: 8 total, 8 up, 8 in 2024-03-04T06:52:43.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:43.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:43.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:43.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:43.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:43.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:43.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:43.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:43.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:43.469+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:43.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:43.454+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:43.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:43.454+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:43.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:43.467+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:43.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:43.471+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:43.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:43.466+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:43.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:43.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:43.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:43.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:43.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:43.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:43.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:43.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:43.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:43.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: osdmap e683: 8 total, 8 up, 8 in 2024-03-04T06:52:43.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:43.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:43.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:43.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:43.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:43.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:43.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:43.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:44.464 INFO:tasks.rados.rados.0.smithi137.stdout:3305: done (2 left) 2024-03-04T06:52:44.464 INFO:tasks.rados.rados.0.smithi137.stdout:3306: done (1 left) 2024-03-04T06:52:44.464 INFO:tasks.rados.rados.0.smithi137.stdout:3307: done (0 left) 2024-03-04T06:52:44.464 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 310 2024-03-04T06:52:44.464 INFO:tasks.rados.rados.0.smithi137.stdout:3308: seq_num 1039 ranges {9682944=606208} 2024-03-04T06:52:44.517 INFO:tasks.rados.rados.0.smithi137.stdout:3308: writing smithi13777483-4 from 9682944 to 10289152 tid 1 2024-03-04T06:52:44.517 INFO:tasks.rados.rados.0.smithi137.stdout:3309: snap_remove snap 303 2024-03-04T06:52:44.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:44.520+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:44.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:44.461+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:44.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:44.461+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:44.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:44.461+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[91314]: osdmap e684: 8 total, 8 up, 8 in 2024-03-04T06:52:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:44.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:44.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:44.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:44.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:44.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:44.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[91314]: pgmap v708: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 660 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 5.8 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2024-03-04T06:52:44.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:44.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:44.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[88869]: osdmap e684: 8 total, 8 up, 8 in 2024-03-04T06:52:44.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:44.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:44.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:44.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:44.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:44.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:44.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:44.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:44.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-mon[88869]: pgmap v708: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 660 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 5.8 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2024-03-04T06:52:44.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:44.459+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:44.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:44.459+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:44.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:44.459+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:44.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:44.645+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:44.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:44.645+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:44.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:44.645+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:44.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:44.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:44.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-mon[85573]: osdmap e684: 8 total, 8 up, 8 in 2024-03-04T06:52:44.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:44.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:44.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:44.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:44.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:44.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:44.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:44.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:44.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:44 smithi203 ceph-mon[85573]: pgmap v708: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 660 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 5.8 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2024-03-04T06:52:45.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:44.967+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:45.477 INFO:tasks.rados.rados.0.smithi137.stdout:3309: done (1 left) 2024-03-04T06:52:45.477 INFO:tasks.rados.rados.0.smithi137.stdout:3310: snap_remove snap 295 2024-03-04T06:52:45.477 INFO:tasks.rados.rados.0.smithi137.stdout:3308: finishing write tid 1 to smithi13777483-4 2024-03-04T06:52:45.477 INFO:tasks.rados.rados.0.smithi137.stdout:3308: finishing write tid 2 to smithi13777483-4 2024-03-04T06:52:45.477 INFO:tasks.rados.rados.0.smithi137.stdout:3308: finishing write tid 3 to smithi13777483-4 2024-03-04T06:52:45.477 INFO:tasks.rados.rados.0.smithi137.stdout:3308: oid 4 updating version 0 to 15529 2024-03-04T06:52:45.477 INFO:tasks.rados.rados.0.smithi137.stdout:3308: oid 4 version 15529 is already newer than 15528 2024-03-04T06:52:45.477 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 15529 (ObjNum 1039 snap 310 seq_num 1039) dirty exists 2024-03-04T06:52:45.477 INFO:tasks.rados.rados.0.smithi137.stdout:3308: left oid 4 (ObjNum 1039 snap 310 seq_num 1039) 2024-03-04T06:52:45.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:52:45] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:52:45.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:45.474+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:45.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:45.483+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[91314]: osdmap e685: 8 total, 8 up, 8 in 2024-03-04T06:52:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:45.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:45.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:45.479+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:45.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:45.479+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:45.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:45.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:45.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:45.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:45.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[88869]: osdmap e685: 8 total, 8 up, 8 in 2024-03-04T06:52:45.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:45.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:45.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:45.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:45.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:45.480+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:45.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:45.470+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:45.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:45.470+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:45.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:45.483+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:45.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:45.484+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:45.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:45.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:45.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:45.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:45.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-mon[85573]: osdmap e685: 8 total, 8 up, 8 in 2024-03-04T06:52:45.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:45.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:45.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:45.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:46.480 INFO:tasks.rados.rados.0.smithi137.stdout:3308: done (1 left) 2024-03-04T06:52:46.481 INFO:tasks.rados.rados.0.smithi137.stdout:3310: done (0 left) 2024-03-04T06:52:46.481 INFO:tasks.rados.rados.0.smithi137.stdout:3311: delete oid 49 current snap is 310 2024-03-04T06:52:46.489 INFO:tasks.rados.rados.0.smithi137.stdout:3311: done (0 left) 2024-03-04T06:52:46.490 INFO:tasks.rados.rados.0.smithi137.stdout:3312: snap_remove snap 293 2024-03-04T06:52:46.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:46.480+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:46.846 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:46.482+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:46.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:46.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:46.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:46.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[88869]: osdmap e686: 8 total, 8 up, 8 in 2024-03-04T06:52:46.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:46.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:46.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:46.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:46.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:46.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:46.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[88869]: pgmap v711: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 660 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 5.8 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2024-03-04T06:52:46.847 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:46.478+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:46.848 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:46.478+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:46.848 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:46.478+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:46.848 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:46.848 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:46.848 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:46.848 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[91314]: osdmap e686: 8 total, 8 up, 8 in 2024-03-04T06:52:46.848 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:46.848 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:46.848 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:46.848 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:46.848 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:46.848 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:46.848 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:46 smithi137 ceph-mon[91314]: pgmap v711: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 660 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 5.8 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2024-03-04T06:52:46.849 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:46.490+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:46.849 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:46.477+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:46.849 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:46.477+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:46.849 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:46.477+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:46.850 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:46.483+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:46.850 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:46.483+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:46.850 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:46.486+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:46.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:46.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:46.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:46.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-mon[85573]: osdmap e686: 8 total, 8 up, 8 in 2024-03-04T06:52:46.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:46.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:46.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:46.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:46.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:46.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:46.851 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-mon[85573]: pgmap v711: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 660 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 5.8 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2024-03-04T06:52:46.851 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:46.376+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:46.851 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:46.376+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:46.851 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:46.489+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:47.483 INFO:tasks.rados.rados.0.smithi137.stdout:3312: done (0 left) 2024-03-04T06:52:47.483 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 50 current snap is 310 2024-03-04T06:52:47.483 INFO:tasks.rados.rados.0.smithi137.stdout:3313: seq_num 1041 ranges {0=638976} 2024-03-04T06:52:47.487 INFO:tasks.rados.rados.0.smithi137.stdout:3313: writing smithi13777483-50 from 0 to 638976 tid 1 2024-03-04T06:52:47.487 INFO:tasks.rados.rados.0.smithi137.stdout:3314: delete oid 42 current snap is 310 2024-03-04T06:52:47.495 INFO:tasks.rados.rados.0.smithi137.stdout:3313: finishing write tid 1 to smithi13777483-50 2024-03-04T06:52:47.496 INFO:tasks.rados.rados.0.smithi137.stdout:3313: finishing write tid 2 to smithi13777483-50 2024-03-04T06:52:47.497 INFO:tasks.rados.rados.0.smithi137.stdout:3314: done (1 left) 2024-03-04T06:52:47.497 INFO:tasks.rados.rados.0.smithi137.stdout:3315: snap_create 2024-03-04T06:52:47.499 INFO:tasks.rados.rados.0.smithi137.stdout:3313: finishing write tid 3 to smithi13777483-50 2024-03-04T06:52:47.499 INFO:tasks.rados.rados.0.smithi137.stdout:3313: oid 50 updating version 0 to 16951 2024-03-04T06:52:47.500 INFO:tasks.rados.rados.0.smithi137.stdout:3313: oid 50 version 16951 is already newer than 16950 2024-03-04T06:52:47.500 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 16951 (ObjNum 1041 snap 310 seq_num 1041) dirty exists 2024-03-04T06:52:47.500 INFO:tasks.rados.rados.0.smithi137.stdout:3313: left oid 50 (ObjNum 1041 snap 310 seq_num 1041) 2024-03-04T06:52:47.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:47.487+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:47.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:47.488+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:47.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:47.488+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:47.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:47.483+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:47.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:47.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:47.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:47.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[88869]: osdmap e687: 8 total, 8 up, 8 in 2024-03-04T06:52:47.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:47.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:47.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:47.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:47.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:47.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:47.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:47.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:47.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:47.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:47.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:47.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[91314]: osdmap e687: 8 total, 8 up, 8 in 2024-03-04T06:52:47.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:47.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:47.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:47.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:47.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:47.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:47.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:47.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:47.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:47.494+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:47.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:47.486+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:47.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:47.486+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:47.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:47.493+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:47.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:47.494+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:47.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:47.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:47.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:47.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-mon[85573]: osdmap e687: 8 total, 8 up, 8 in 2024-03-04T06:52:47.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:47.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:47.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:47.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:47.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:47.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:47.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:47.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:48.487 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:48.129+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:48.488 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:48.129+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:48.494 INFO:tasks.rados.rados.0.smithi137.stdout:3313: done (1 left) 2024-03-04T06:52:48.494 INFO:tasks.rados.rados.0.smithi137.stdout:3315: done (0 left) 2024-03-04T06:52:48.494 INFO:tasks.rados.rados.0.smithi137.stdout:3316: snap_create 2024-03-04T06:52:48.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[88869]: osdmap e688: 8 total, 8 up, 8 in 2024-03-04T06:52:48.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:48.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:48.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:48.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:48.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:48.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:48.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:48.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:48.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:48.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:48.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[88869]: pgmap v714: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 664 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 1.6 MiB/s wr, 3 op/s 2024-03-04T06:52:48.742 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[91314]: osdmap e688: 8 total, 8 up, 8 in 2024-03-04T06:52:48.742 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:48.742 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:48.742 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:48.742 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:48.742 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:48.742 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:48.742 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:48.742 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:48.742 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:48.743 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:48.743 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-mon[91314]: pgmap v714: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 664 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 1.6 MiB/s wr, 3 op/s 2024-03-04T06:52:48.743 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:48.493+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:48.743 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-mon[85573]: osdmap e688: 8 total, 8 up, 8 in 2024-03-04T06:52:48.743 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:48.743 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:48.744 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:48.744 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:48.744 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:48.744 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:48.744 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:48.744 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:48.744 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:48.744 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:48.744 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-mon[85573]: pgmap v714: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 664 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 1.6 MiB/s wr, 3 op/s 2024-03-04T06:52:48.744 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:48.489+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:48.744 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:48.489+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:48.745 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:48.489+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:49.042 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:48.738+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:49.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:48.739+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:49.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:48.739+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:49.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:48.739+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:49.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:48.741+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:49.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:48.741+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:49.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:48.739+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:49.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:48.740+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:49.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:48.741+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:49.493 INFO:tasks.rados.rados.0.smithi137.stdout:3316: done (0 left) 2024-03-04T06:52:49.493 INFO:tasks.rados.rados.0.smithi137.stdout:3317: rollback oid 11 current snap is 312 2024-03-04T06:52:49.494 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 11 to 310 2024-03-04T06:52:49.494 INFO:tasks.rados.rados.0.smithi137.stdout:3318: rollback oid 32 current snap is 312 2024-03-04T06:52:49.494 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 32 to 292 2024-03-04T06:52:49.494 INFO:tasks.rados.rados.0.smithi137.stdout:3319: delete oid 15 current snap is 312 2024-03-04T06:52:49.499 INFO:tasks.rados.rados.0.smithi137.stdout:3318: finishing rollback tid 1 to smithi13777483-32 2024-03-04T06:52:49.500 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16946 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-04T06:52:49.500 INFO:tasks.rados.rados.0.smithi137.stdout:3318: done (2 left) 2024-03-04T06:52:49.500 INFO:tasks.rados.rados.0.smithi137.stdout:3319: done (1 left) 2024-03-04T06:52:49.500 INFO:tasks.rados.rados.0.smithi137.stdout:3320: rollback oid 21 current snap is 312 2024-03-04T06:52:49.500 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 21 to 311 2024-03-04T06:52:49.500 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 312 2024-03-04T06:52:49.500 INFO:tasks.rados.rados.0.smithi137.stdout:3321: seq_num 1044 ranges {0=688128} 2024-03-04T06:52:49.505 INFO:tasks.rados.rados.0.smithi137.stdout:3321: writing smithi13777483-17 from 0 to 688128 tid 1 2024-03-04T06:52:49.505 INFO:tasks.rados.rados.0.smithi137.stdout:3322: snap_create 2024-03-04T06:52:49.505 INFO:tasks.rados.rados.0.smithi137.stdout:3320: finishing rollback tid 1 to smithi13777483-21 2024-03-04T06:52:49.505 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 16872 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-03-04T06:52:49.505 INFO:tasks.rados.rados.0.smithi137.stdout:3317: finishing rollback tid 0 to smithi13777483-11 2024-03-04T06:52:49.505 INFO:tasks.rados.rados.0.smithi137.stdout:3317: finishing rollback tid 1 to smithi13777483-11 2024-03-04T06:52:49.505 INFO:tasks.rados.rados.0.smithi137.stdout:3317: finishing rollback tid 2 to smithi13777483-11 2024-03-04T06:52:49.505 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16944 (ObjNum 1013 snap 302 seq_num 1013) dirty exists 2024-03-04T06:52:49.509 INFO:tasks.rados.rados.0.smithi137.stdout:3321: finishing write tid 1 to smithi13777483-17 2024-03-04T06:52:49.510 INFO:tasks.rados.rados.0.smithi137.stdout:3321: finishing write tid 2 to smithi13777483-17 2024-03-04T06:52:49.512 INFO:tasks.rados.rados.0.smithi137.stdout:3321: finishing write tid 3 to smithi13777483-17 2024-03-04T06:52:49.512 INFO:tasks.rados.rados.0.smithi137.stdout:3321: oid 17 updating version 0 to 16919 2024-03-04T06:52:49.512 INFO:tasks.rados.rados.0.smithi137.stdout:3321: oid 17 version 16919 is already newer than 16918 2024-03-04T06:52:49.512 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16919 (ObjNum 1044 snap 312 seq_num 1044) dirty exists 2024-03-04T06:52:49.512 INFO:tasks.rados.rados.0.smithi137.stdout:3321: left oid 17 (ObjNum 1044 snap 312 seq_num 1044) 2024-03-04T06:52:49.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:49.498+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:49.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:49.492+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:49.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:49.492+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:49.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:49.504+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:49.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:49.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:49.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:49.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[91314]: osdmap e689: 8 total, 8 up, 8 in 2024-03-04T06:52:49.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:49.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:49.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:49.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:49.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:49.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:49.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:49.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:49.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[88869]: osdmap e689: 8 total, 8 up, 8 in 2024-03-04T06:52:49.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:49.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:49.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:49.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:49.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:49.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:49.497+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:49.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:49.490+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:49.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:49.490+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-mon[85573]: osdmap e689: 8 total, 8 up, 8 in 2024-03-04T06:52:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:49.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:49.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:49.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:49.508+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:49.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:49.508+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:50.500 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:50.219+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:50.500 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:50.219+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:50.506 INFO:tasks.rados.rados.0.smithi137.stdout:3317: done (3 left) 2024-03-04T06:52:50.507 INFO:tasks.rados.rados.0.smithi137.stdout:3320: done (2 left) 2024-03-04T06:52:50.507 INFO:tasks.rados.rados.0.smithi137.stdout:3321: done (1 left) 2024-03-04T06:52:50.507 INFO:tasks.rados.rados.0.smithi137.stdout:3322: done (0 left) 2024-03-04T06:52:50.507 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 313 2024-03-04T06:52:50.507 INFO:tasks.rados.rados.0.smithi137.stdout:3323: seq_num 1045 ranges {0=704512} 2024-03-04T06:52:50.510 INFO:tasks.rados.rados.0.smithi137.stdout:3323: writing smithi13777483-13 from 0 to 704512 tid 1 2024-03-04T06:52:50.511 INFO:tasks.rados.rados.0.smithi137.stdout:3324: rollback oid 30 current snap is 313 2024-03-04T06:52:50.511 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 30 to 299 2024-03-04T06:52:50.511 INFO:tasks.rados.rados.0.smithi137.stdout:3325: snap_create 2024-03-04T06:52:50.516 INFO:tasks.rados.rados.0.smithi137.stdout:3323: finishing write tid 1 to smithi13777483-13 2024-03-04T06:52:50.516 INFO:tasks.rados.rados.0.smithi137.stdout:3323: finishing write tid 2 to smithi13777483-13 2024-03-04T06:52:50.519 INFO:tasks.rados.rados.0.smithi137.stdout:3324: finishing rollback tid 0 to smithi13777483-30 2024-03-04T06:52:50.520 INFO:tasks.rados.rados.0.smithi137.stdout:3324: finishing rollback tid 1 to smithi13777483-30 2024-03-04T06:52:50.520 INFO:tasks.rados.rados.0.smithi137.stdout:3323: finishing write tid 3 to smithi13777483-13 2024-03-04T06:52:50.520 INFO:tasks.rados.rados.0.smithi137.stdout:3323: oid 13 updating version 0 to 16953 2024-03-04T06:52:50.520 INFO:tasks.rados.rados.0.smithi137.stdout:3323: oid 13 updating version 16953 to 16954 2024-03-04T06:52:50.520 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16954 (ObjNum 1045 snap 313 seq_num 1045) dirty exists 2024-03-04T06:52:50.520 INFO:tasks.rados.rados.0.smithi137.stdout:3323: left oid 13 (ObjNum 1045 snap 313 seq_num 1045) 2024-03-04T06:52:50.521 INFO:tasks.rados.rados.0.smithi137.stdout:3324: finishing rollback tid 2 to smithi13777483-30 2024-03-04T06:52:50.521 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16917 (ObjNum 982 snap 287 seq_num 982) dirty exists 2024-03-04T06:52:50.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:50.514+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:50.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:50.504+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:50.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:50.505+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:50.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:50.505+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:50.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:50.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:50.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:50.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:50.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: osdmap e690: 8 total, 8 up, 8 in 2024-03-04T06:52:50.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:50.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:50.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:50.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:50.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:50.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:50.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:50.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:50.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[91314]: pgmap v717: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 664 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 1.5 MiB/s wr, 3 op/s 2024-03-04T06:52:50.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:50.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:50.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:50.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:50.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: osdmap e690: 8 total, 8 up, 8 in 2024-03-04T06:52:50.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:50.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:50.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:50.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:50.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:50.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:50.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:50.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:50.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-mon[88869]: pgmap v717: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 664 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 1.5 MiB/s wr, 3 op/s 2024-03-04T06:52:50.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:50.517+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:50.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:50.502+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:50.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:50.502+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:50.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:50.502+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: osdmap e690: 8 total, 8 up, 8 in 2024-03-04T06:52:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:50.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:50.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:50 smithi203 ceph-mon[85573]: pgmap v717: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 664 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 1.5 MiB/s wr, 3 op/s 2024-03-04T06:52:51.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:50.868+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:51.505 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:51.124+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:51.506 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:51.125+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:51.506 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:51.125+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:51.506 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:51.125+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:51.507 INFO:tasks.rados.rados.0.smithi137.stdout:3323: done (2 left) 2024-03-04T06:52:51.507 INFO:tasks.rados.rados.0.smithi137.stdout:3324: done (1 left) 2024-03-04T06:52:51.507 INFO:tasks.rados.rados.0.smithi137.stdout:3325: done (0 left) 2024-03-04T06:52:51.507 INFO:tasks.rados.rados.0.smithi137.stdout:3326: read oid 41 snap -1 2024-03-04T06:52:51.507 INFO:tasks.rados.rados.0.smithi137.stdout:3326: expect (ObjNum 978 snap 286 seq_num 978) 2024-03-04T06:52:51.507 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 314 2024-03-04T06:52:51.507 INFO:tasks.rados.rados.0.smithi137.stdout:3327: seq_num 1046 ranges {4399104=729088} 2024-03-04T06:52:51.535 INFO:tasks.rados.rados.0.smithi137.stdout:3327: writing smithi13777483-8 from 4399104 to 5128192 tid 1 2024-03-04T06:52:51.535 INFO:tasks.rados.rados.0.smithi137.stdout:3328: snap_create 2024-03-04T06:52:51.536 INFO:tasks.rados.rados.0.smithi137.stdout:3326: expect (ObjNum 978 snap 286 seq_num 978) 2024-03-04T06:52:51.741 INFO:tasks.rados.rados.0.smithi137.stdout:3327: finishing write tid 1 to smithi13777483-8 2024-03-04T06:52:51.741 INFO:tasks.rados.rados.0.smithi137.stdout:3327: finishing write tid 2 to smithi13777483-8 2024-03-04T06:52:51.741 INFO:tasks.rados.rados.0.smithi137.stdout:3327: finishing write tid 3 to smithi13777483-8 2024-03-04T06:52:51.741 INFO:tasks.rados.rados.0.smithi137.stdout:3327: oid 8 updating version 0 to 16946 2024-03-04T06:52:51.741 INFO:tasks.rados.rados.0.smithi137.stdout:3327: oid 8 version 16946 is already newer than 16945 2024-03-04T06:52:51.742 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16946 (ObjNum 1046 snap 314 seq_num 1046) dirty exists 2024-03-04T06:52:51.742 INFO:tasks.rados.rados.0.smithi137.stdout:3327: left oid 8 (ObjNum 1046 snap 314 seq_num 1046) 2024-03-04T06:52:51.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:51.505+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:51.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:51.539+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[91314]: osdmap e691: 8 total, 8 up, 8 in 2024-03-04T06:52:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:51.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:51.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[88869]: osdmap e691: 8 total, 8 up, 8 in 2024-03-04T06:52:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:51.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:51.504+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:51.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:51.504+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:51.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:51.513+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:51.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:51.515+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-mon[85573]: osdmap e691: 8 total, 8 up, 8 in 2024-03-04T06:52:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:51.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:51.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:51.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:52.292 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:51.834+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:52.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:51.834+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:52.519 INFO:tasks.rados.rados.0.smithi137.stdout:3326: done (2 left) 2024-03-04T06:52:52.519 INFO:tasks.rados.rados.0.smithi137.stdout:3327: done (1 left) 2024-03-04T06:52:52.519 INFO:tasks.rados.rados.0.smithi137.stdout:3328: done (0 left) 2024-03-04T06:52:52.519 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 315 2024-03-04T06:52:52.519 INFO:tasks.rados.rados.0.smithi137.stdout:3329: seq_num 1047 ranges {10289152=745472} 2024-03-04T06:52:52.578 INFO:tasks.rados.rados.0.smithi137.stdout:3329: writing smithi13777483-4 from 10289152 to 11034624 tid 1 2024-03-04T06:52:52.578 INFO:tasks.rados.rados.0.smithi137.stdout:3330: copy_from oid 41 from oid 13 current snap is 315 2024-03-04T06:52:52.578 INFO:tasks.rados.rados.0.smithi137.stdout:3331: setattr oid 47 current snap is 315 2024-03-04T06:52:52.581 INFO:tasks.rados.rados.0.smithi137.stdout:3332: delete oid 37 current snap is 315 2024-03-04T06:52:52.586 INFO:tasks.rados.rados.0.smithi137.stdout:3329: finishing write tid 1 to smithi13777483-4 2024-03-04T06:52:52.586 INFO:tasks.rados.rados.0.smithi137.stdout:3332: done (3 left) 2024-03-04T06:52:52.586 INFO:tasks.rados.rados.0.smithi137.stdout:3333: delete oid 25 current snap is 315 2024-03-04T06:52:52.587 INFO:tasks.rados.rados.0.smithi137.stdout:3329: finishing write tid 2 to smithi13777483-4 2024-03-04T06:52:52.588 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16933 (ObjNum 33 snap 0 seq_num 3131769248) dirty exists 2024-03-04T06:52:52.588 INFO:tasks.rados.rados.0.smithi137.stdout:3331: done (3 left) 2024-03-04T06:52:52.589 INFO:tasks.rados.rados.0.smithi137.stdout:3333: done (2 left) 2024-03-04T06:52:52.589 INFO:tasks.rados.rados.0.smithi137.stdout:3334: snap_remove snap 292 2024-03-04T06:52:52.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:52.518+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:52.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:52.696+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:52.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:52.580+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:52.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:52.584+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:52.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:52.584+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[91314]: osdmap e692: 8 total, 8 up, 8 in 2024-03-04T06:52:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:52.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:52.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:52.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[91314]: pgmap v720: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 664 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-03-04T06:52:52.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:52.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:52.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:52.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:52.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[88869]: osdmap e692: 8 total, 8 up, 8 in 2024-03-04T06:52:52.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:52.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:52.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:52.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:52.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:52 smithi137 ceph-mon[88869]: pgmap v720: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 664 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-03-04T06:52:52.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:52.515+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:52.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:52.515+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:52.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:52.515+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:52.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:52.585+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-mon[85573]: osdmap e692: 8 total, 8 up, 8 in 2024-03-04T06:52:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:52.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:52.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:52.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-mon[85573]: pgmap v720: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 664 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-03-04T06:52:52.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:52.698+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:52.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:52.698+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:52.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:52.580+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:52.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:52.580+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:52.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:52.580+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:53.524 INFO:tasks.rados.rados.0.smithi137.stdout:3329: finishing write tid 3 to smithi13777483-4 2024-03-04T06:52:53.524 INFO:tasks.rados.rados.0.smithi137.stdout:3329: oid 4 updating version 0 to 15530 2024-03-04T06:52:53.525 INFO:tasks.rados.rados.0.smithi137.stdout:3329: oid 4 updating version 15530 to 15531 2024-03-04T06:52:53.525 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 15531 (ObjNum 1047 snap 315 seq_num 1047) dirty exists 2024-03-04T06:52:53.525 INFO:tasks.rados.rados.0.smithi137.stdout:3329: left oid 4 (ObjNum 1047 snap 315 seq_num 1047) 2024-03-04T06:52:53.525 INFO:tasks.rados.rados.0.smithi137.stdout:3330: finishing copy_from racing read to smithi13777483-41 2024-03-04T06:52:53.525 INFO:tasks.rados.rados.0.smithi137.stdout:3330: finishing copy_from to smithi13777483-41 2024-03-04T06:52:53.525 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 16954 (ObjNum 1045 snap 313 seq_num 1045) dirty exists 2024-03-04T06:52:53.525 INFO:tasks.rados.rados.0.smithi137.stdout:3329: done (2 left) 2024-03-04T06:52:53.525 INFO:tasks.rados.rados.0.smithi137.stdout:3330: done (1 left) 2024-03-04T06:52:53.525 INFO:tasks.rados.rados.0.smithi137.stdout:3334: done (0 left) 2024-03-04T06:52:53.525 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 41 current snap is 315 2024-03-04T06:52:53.525 INFO:tasks.rados.rados.0.smithi137.stdout:3335: seq_num 1050 ranges {704512=794624} 2024-03-04T06:52:53.534 INFO:tasks.rados.rados.0.smithi137.stdout:3335: writing smithi13777483-41 from 704512 to 1499136 tid 1 2024-03-04T06:52:53.535 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 315 2024-03-04T06:52:53.535 INFO:tasks.rados.rados.0.smithi137.stdout:3336: seq_num 1051 ranges {6955008=409600,7364608=401408} 2024-03-04T06:52:53.577 INFO:tasks.rados.rados.0.smithi137.stdout:3336: writing smithi13777483-27 from 6955008 to 7364608 tid 1 2024-03-04T06:52:53.581 INFO:tasks.rados.rados.0.smithi137.stdout:3336: writing smithi13777483-27 from 7364608 to 7766016 tid 2 2024-03-04T06:52:53.581 INFO:tasks.rados.rados.0.smithi137.stdout:3337: read oid 3 snap -1 2024-03-04T06:52:53.581 INFO:tasks.rados.rados.0.smithi137.stdout:3337: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:52:53.581 INFO:tasks.rados.rados.0.smithi137.stdout:3338: read oid 1 snap 313 2024-03-04T06:52:53.581 INFO:tasks.rados.rados.0.smithi137.stdout:3338: expect deleted 2024-03-04T06:52:53.581 INFO:tasks.rados.rados.0.smithi137.stdout:3339: delete oid 40 current snap is 315 2024-03-04T06:52:53.581 INFO:tasks.rados.rados.0.smithi137.stdout:3335: finishing write tid 1 to smithi13777483-41 2024-03-04T06:52:53.581 INFO:tasks.rados.rados.0.smithi137.stdout:3335: finishing write tid 2 to smithi13777483-41 2024-03-04T06:52:53.581 INFO:tasks.rados.rados.0.smithi137.stdout:3335: finishing write tid 3 to smithi13777483-41 2024-03-04T06:52:53.581 INFO:tasks.rados.rados.0.smithi137.stdout:3335: oid 41 updating version 0 to 16955 2024-03-04T06:52:53.581 INFO:tasks.rados.rados.0.smithi137.stdout:3335: oid 41 updating version 16955 to 16956 2024-03-04T06:52:53.581 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 16956 (ObjNum 1050 snap 315 seq_num 1050) dirty exists 2024-03-04T06:52:53.582 INFO:tasks.rados.rados.0.smithi137.stdout:3335: left oid 41 (ObjNum 1050 snap 315 seq_num 1050) 2024-03-04T06:52:53.584 INFO:tasks.rados.rados.0.smithi137.stdout:3335: done (4 left) 2024-03-04T06:52:53.584 INFO:tasks.rados.rados.0.smithi137.stdout:3338: done (3 left) 2024-03-04T06:52:53.584 INFO:tasks.rados.rados.0.smithi137.stdout:3339: done (2 left) 2024-03-04T06:52:53.584 INFO:tasks.rados.rados.0.smithi137.stdout:3340: snap_remove snap 298 2024-03-04T06:52:53.770 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:53.540+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:53.770 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:53.538+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:53.770 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:53.543+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:53.770 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:53.521+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:53.771 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:53.521+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:53.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:53.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:53.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:53.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:53.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: osdmap e693: 8 total, 8 up, 8 in 2024-03-04T06:52:53.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:53.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:53.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:53.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:53.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:53.771 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:53.772 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:53.772 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:53.772 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:52:53.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:53.532+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:53.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:53.532+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:53.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:53.522+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:53.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:53.524+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:53.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:53.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:53.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:53.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:53.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: osdmap e693: 8 total, 8 up, 8 in 2024-03-04T06:52:53.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:53.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:53.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:53.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:53.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:53.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:53.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:53.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:53.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:52:53.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:53.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:53.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:53.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:53.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: osdmap e693: 8 total, 8 up, 8 in 2024-03-04T06:52:53.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:53.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:53.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:53.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 157=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:53.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:53.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:53.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:53.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:53.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:53 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:52:54.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:53.768+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:54.532 INFO:tasks.rados.rados.0.smithi137.stdout:3340: done (2 left) 2024-03-04T06:52:54.533 INFO:tasks.rados.rados.0.smithi137.stdout:3341: rollback oid 6 current snap is 315 2024-03-04T06:52:54.533 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 6 to 281 2024-03-04T06:52:54.533 INFO:tasks.rados.rados.0.smithi137.stdout:3336: finishing write tid 1 to smithi13777483-27 2024-03-04T06:52:54.533 INFO:tasks.rados.rados.0.smithi137.stdout:3336: finishing write tid 2 to smithi13777483-27 2024-03-04T06:52:54.533 INFO:tasks.rados.rados.0.smithi137.stdout:3336: finishing write tid 3 to smithi13777483-27 2024-03-04T06:52:54.533 INFO:tasks.rados.rados.0.smithi137.stdout:3336: finishing write tid 4 to smithi13777483-27 2024-03-04T06:52:54.533 INFO:tasks.rados.rados.0.smithi137.stdout:3336: oid 27 updating version 0 to 16956 2024-03-04T06:52:54.533 INFO:tasks.rados.rados.0.smithi137.stdout:3336: oid 27 version 16956 is already newer than 16955 2024-03-04T06:52:54.533 INFO:tasks.rados.rados.0.smithi137.stdout:3336: oid 27 updating version 16956 to 16957 2024-03-04T06:52:54.533 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16957 (ObjNum 1051 snap 315 seq_num 1051) dirty exists 2024-03-04T06:52:54.533 INFO:tasks.rados.rados.0.smithi137.stdout:3336: left oid 27 (ObjNum 1051 snap 315 seq_num 1051) 2024-03-04T06:52:54.533 INFO:tasks.rados.rados.0.smithi137.stdout:3337: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:52:54.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:54.532+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:54.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:54.534+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:54.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:54.530+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:54.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:54.530+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:54.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:54.532+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:54.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:54.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:54.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[91314]: osdmap e694: 8 total, 8 up, 8 in 2024-03-04T06:52:54.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:54.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:54.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:54.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:54.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:54.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:54.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:54.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:54.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[91314]: pgmap v723: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 666 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 522 KiB/s wr, 8 op/s 2024-03-04T06:52:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[88869]: osdmap e694: 8 total, 8 up, 8 in 2024-03-04T06:52:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:54.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:54 smithi137 ceph-mon[88869]: pgmap v723: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 666 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 522 KiB/s wr, 8 op/s 2024-03-04T06:52:54.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:54.532+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:54.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:54.527+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:54.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:54.527+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:54.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:54.527+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:54.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:54.534+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:54.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:54.534+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:54.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:54.535+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:54.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:54.535+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:54.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:54.535+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-mon[85573]: osdmap e694: 8 total, 8 up, 8 in 2024-03-04T06:52:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:54.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:54.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:54 smithi203 ceph-mon[85573]: pgmap v723: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 666 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 522 KiB/s wr, 8 op/s 2024-03-04T06:52:55.355 INFO:tasks.rados.rados.0.smithi137.stdout:3341: finishing rollback tid 1 to smithi13777483-6 2024-03-04T06:52:55.355 INFO:tasks.rados.rados.0.smithi137.stdout:3341: finishing rollback tid 2 to smithi13777483-6 2024-03-04T06:52:55.355 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16941 (ObjNum 787 snap 231 seq_num 787) dirty exists 2024-03-04T06:52:55.355 INFO:tasks.rados.rados.0.smithi137.stdout:3336: done (2 left) 2024-03-04T06:52:55.355 INFO:tasks.rados.rados.0.smithi137.stdout:3337: done (1 left) 2024-03-04T06:52:55.355 INFO:tasks.rados.rados.0.smithi137.stdout:3341: done (0 left) 2024-03-04T06:52:55.355 INFO:tasks.rados.rados.0.smithi137.stdout:3342: copy_from oid 28 from oid 4 current snap is 315 2024-03-04T06:52:55.355 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 315 2024-03-04T06:52:55.355 INFO:tasks.rados.rados.0.smithi137.stdout:3343: seq_num 1053 ranges {2301952=442368,2744320=401408} 2024-03-04T06:52:55.369 INFO:tasks.rados.rados.0.smithi137.stdout:3343: writing smithi13777483-20 from 2301952 to 2744320 tid 1 2024-03-04T06:52:55.372 INFO:tasks.rados.rados.0.smithi137.stdout:3343: writing smithi13777483-20 from 2744320 to 3145728 tid 2 2024-03-04T06:52:55.372 INFO:tasks.rados.rados.0.smithi137.stdout:3344: read oid 16 snap -1 2024-03-04T06:52:55.372 INFO:tasks.rados.rados.0.smithi137.stdout:3344: expect deleted 2024-03-04T06:52:55.372 INFO:tasks.rados.rados.0.smithi137.stdout:3345: snap_remove snap 296 2024-03-04T06:52:55.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:52:55] "GET /metrics HTTP/1.1" 200 36340 "" "Prometheus/2.43.0" 2024-03-04T06:52:55.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:55.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:55.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[91314]: osdmap e695: 8 total, 8 up, 8 in 2024-03-04T06:52:55.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:55.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:55.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:55.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:55.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:55.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:55.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:55.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[88869]: osdmap e695: 8 total, 8 up, 8 in 2024-03-04T06:52:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:55.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:55.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:55.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:55.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:55.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:55.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:55.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-mon[85573]: osdmap e695: 8 total, 8 up, 8 in 2024-03-04T06:52:55.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:55.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:55.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:55.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:55.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:55.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:55.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:55.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:55.934 INFO:tasks.rados.rados.0.smithi137.stdout:3343: finishing write tid 1 to smithi13777483-20 2024-03-04T06:52:55.934 INFO:tasks.rados.rados.0.smithi137.stdout:3343: finishing write tid 2 to smithi13777483-20 2024-03-04T06:52:55.934 INFO:tasks.rados.rados.0.smithi137.stdout:3343: finishing write tid 3 to smithi13777483-20 2024-03-04T06:52:55.934 INFO:tasks.rados.rados.0.smithi137.stdout:3343: finishing write tid 4 to smithi13777483-20 2024-03-04T06:52:55.934 INFO:tasks.rados.rados.0.smithi137.stdout:3343: oid 20 updating version 0 to 16919 2024-03-04T06:52:55.934 INFO:tasks.rados.rados.0.smithi137.stdout:3343: oid 20 updating version 16919 to 16920 2024-03-04T06:52:55.934 INFO:tasks.rados.rados.0.smithi137.stdout:3343: oid 20 version 16920 is already newer than 16918 2024-03-04T06:52:55.934 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16920 (ObjNum 1053 snap 315 seq_num 1053) dirty exists 2024-03-04T06:52:55.934 INFO:tasks.rados.rados.0.smithi137.stdout:3343: left oid 20 (ObjNum 1053 snap 315 seq_num 1053) 2024-03-04T06:52:55.935 INFO:tasks.rados.rados.0.smithi137.stdout:3342: finishing copy_from racing read to smithi13777483-28 2024-03-04T06:52:55.935 INFO:tasks.rados.rados.0.smithi137.stdout:3342: finishing copy_from to smithi13777483-28 2024-03-04T06:52:55.935 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 15531 (ObjNum 1047 snap 315 seq_num 1047) dirty exists 2024-03-04T06:52:55.935 INFO:tasks.rados.rados.0.smithi137.stdout:3342: done (3 left) 2024-03-04T06:52:55.935 INFO:tasks.rados.rados.0.smithi137.stdout:3343: done (2 left) 2024-03-04T06:52:55.935 INFO:tasks.rados.rados.0.smithi137.stdout:3344: done (1 left) 2024-03-04T06:52:55.935 INFO:tasks.rados.rados.0.smithi137.stdout:3345: done (0 left) 2024-03-04T06:52:55.935 INFO:tasks.rados.rados.0.smithi137.stdout:3346: snap_create 2024-03-04T06:52:56.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:55.931+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:56.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:55.935+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:56.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:55.936+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:56.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:55.935+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:56.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:55.930+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:56.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:55.935+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:56.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:55.935+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:56.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:55.936+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:56.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:55.936+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:56.937 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:56.669+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:56.941 INFO:tasks.rados.rados.0.smithi137.stdout:3346: done (0 left) 2024-03-04T06:52:56.941 INFO:tasks.rados.rados.0.smithi137.stdout:3347: snap_remove snap 310 2024-03-04T06:52:57.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:56.940+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:57.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[88869]: osdmap e696: 8 total, 8 up, 8 in 2024-03-04T06:52:57.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:57.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:57.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:57.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:57.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:57.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:57.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:57.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[88869]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:57.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:57.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[88869]: pgmap v726: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 668 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2024-03-04T06:52:57.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[91314]: osdmap e696: 8 total, 8 up, 8 in 2024-03-04T06:52:57.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:57.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:57.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:57.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:57.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:57.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:57.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:57.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[91314]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:57.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:57.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:56 smithi137 ceph-mon[91314]: pgmap v726: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 668 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2024-03-04T06:52:57.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:56.939+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:57.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:56.939+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:57.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:56.941+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:57.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:56.941+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:57.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:56.941+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-mon[85573]: osdmap e696: 8 total, 8 up, 8 in 2024-03-04T06:52:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:57.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:57.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:57.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:57.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-mon[85573]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:57.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:57.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:56 smithi203 ceph-mon[85573]: pgmap v726: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 668 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2024-03-04T06:52:57.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:57.441+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:57.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:57.441+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:57.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:57.441+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:57.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:57.441+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:57.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:57.441+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:57.845 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:57.441+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:57.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:57.441+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:57.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:57.441+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:57.938 INFO:tasks.rados.rados.0.smithi137.stdout:3347: done (0 left) 2024-03-04T06:52:57.938 INFO:tasks.rados.rados.0.smithi137.stdout:3348: snap_create 2024-03-04T06:52:58.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:57.947+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:58.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:57.948+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:58.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:57.939+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:58.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:57.944+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[88869]: osdmap e697: 8 total, 8 up, 8 in 2024-03-04T06:52:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:58.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[91314]: osdmap e697: 8 total, 8 up, 8 in 2024-03-04T06:52:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:58.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:58.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:57.944+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:58.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:57.937+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:58.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:57.937+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:58.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:57.998+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:58.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:57.998+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:58.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:57.999+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-mon[85573]: osdmap e697: 8 total, 8 up, 8 in 2024-03-04T06:52:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:58.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:58.942 INFO:tasks.rados.rados.0.smithi137.stdout:3348: done (0 left) 2024-03-04T06:52:58.942 INFO:tasks.rados.rados.0.smithi137.stdout:3349: read oid 23 snap -1 2024-03-04T06:52:58.942 INFO:tasks.rados.rados.0.smithi137.stdout:3349: expect (ObjNum 1028 snap 306 seq_num 1028) 2024-03-04T06:52:58.942 INFO:tasks.rados.rados.0.smithi137.stdout:3350: delete oid 46 current snap is 317 2024-03-04T06:52:58.947 INFO:tasks.rados.rados.0.smithi137.stdout:3350: done (1 left) 2024-03-04T06:52:58.947 INFO:tasks.rados.rados.0.smithi137.stdout:3351: rmattr oid 46 current snap is 317 2024-03-04T06:52:58.947 INFO:tasks.rados.rados.0.smithi137.stdout:3351: done (1 left) 2024-03-04T06:52:58.947 INFO:tasks.rados.rados.0.smithi137.stdout:3352: rmattr oid 38 current snap is 317 2024-03-04T06:52:58.947 INFO:tasks.rados.rados.0.smithi137.stdout:3352: done (1 left) 2024-03-04T06:52:58.947 INFO:tasks.rados.rados.0.smithi137.stdout:3353: read oid 20 snap 299 2024-03-04T06:52:58.947 INFO:tasks.rados.rados.0.smithi137.stdout:3353: expect (ObjNum 1011 snap 297 seq_num 1011) 2024-03-04T06:52:58.947 INFO:tasks.rados.rados.0.smithi137.stdout:3354: read oid 43 snap 315 2024-03-04T06:52:58.947 INFO:tasks.rados.rados.0.smithi137.stdout:3354: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:52:58.948 INFO:tasks.rados.rados.0.smithi137.stdout:3355: read oid 29 snap 305 2024-03-04T06:52:58.948 INFO:tasks.rados.rados.0.smithi137.stdout:3355: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:52:58.948 INFO:tasks.rados.rados.0.smithi137.stdout:3356: read oid 30 snap 301 2024-03-04T06:52:58.948 INFO:tasks.rados.rados.0.smithi137.stdout:3356: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:52:58.948 INFO:tasks.rados.rados.0.smithi137.stdout:3357: delete oid 46 current snap is 317 2024-03-04T06:52:58.948 INFO:tasks.rados.rados.0.smithi137.stdout:3349: expect (ObjNum 1028 snap 306 seq_num 1028) 2024-03-04T06:52:58.964 INFO:tasks.rados.rados.0.smithi137.stdout:3353: expect (ObjNum 1011 snap 297 seq_num 1011) 2024-03-04T06:52:58.970 INFO:tasks.rados.rados.0.smithi137.stdout:3349: done (5 left) 2024-03-04T06:52:58.970 INFO:tasks.rados.rados.0.smithi137.stdout:3353: done (4 left) 2024-03-04T06:52:58.970 INFO:tasks.rados.rados.0.smithi137.stdout:3357: done (3 left) 2024-03-04T06:52:58.970 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 317 2024-03-04T06:52:58.970 INFO:tasks.rados.rados.0.smithi137.stdout:3358: seq_num 1056 ranges {425984=491520,917504=401408} 2024-03-04T06:52:58.975 INFO:tasks.rados.rados.0.smithi137.stdout:3358: writing smithi13777483-23 from 425984 to 917504 tid 1 2024-03-04T06:52:58.977 INFO:tasks.rados.rados.0.smithi137.stdout:3358: writing smithi13777483-23 from 917504 to 1318912 tid 2 2024-03-04T06:52:58.977 INFO:tasks.rados.rados.0.smithi137.stdout:3359: setattr oid 48 current snap is 317 2024-03-04T06:52:58.978 INFO:tasks.rados.rados.0.smithi137.stdout:3354: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:52:59.099 INFO:tasks.rados.rados.0.smithi137.stdout:3355: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:52:59.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:52:58.945+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:59.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:52:58.950+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:59.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:58.940+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:52:59.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:58.940+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:59.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:58.940+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:59.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:59.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:59.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:59.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: osdmap e698: 8 total, 8 up, 8 in 2024-03-04T06:52:59.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:59.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:59.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:59.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: pgmap v729: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 677 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 10 MiB/s rd, 3.6 MiB/s wr, 7 op/s 2024-03-04T06:52:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[91314]: osdmap e699: 8 total, 8 up, 8 in 2024-03-04T06:52:59.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:59.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: osdmap e698: 8 total, 8 up, 8 in 2024-03-04T06:52:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:59.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: pgmap v729: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 677 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 10 MiB/s rd, 3.6 MiB/s wr, 7 op/s 2024-03-04T06:52:59.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:58 smithi137 ceph-mon[88869]: osdmap e699: 8 total, 8 up, 8 in 2024-03-04T06:52:59.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:52:58.958+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:59.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:58.941+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:52:59.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:58.941+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:59.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:58.941+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:59.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:58.983+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:52:59.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:52:58.984+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:59.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:58.952+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:59.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:58.952+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:52:59.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:52:58.953+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: osdmap e698: 8 total, 8 up, 8 in 2024-03-04T06:52:59.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:52:59.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:52:59.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:52:59.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:52:59.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:52:59.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:52:59.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:52:59.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:52:59.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:52:59.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:52:59.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: pgmap v729: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 677 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 10 MiB/s rd, 3.6 MiB/s wr, 7 op/s 2024-03-04T06:52:59.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:58 smithi203 ceph-mon[85573]: osdmap e699: 8 total, 8 up, 8 in 2024-03-04T06:52:59.399 INFO:tasks.rados.rados.0.smithi137.stdout:3356: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:52:59.553 INFO:tasks.rados.rados.0.smithi137.stdout:3358: finishing write tid 1 to smithi13777483-23 2024-03-04T06:52:59.553 INFO:tasks.rados.rados.0.smithi137.stdout:3358: finishing write tid 2 to smithi13777483-23 2024-03-04T06:52:59.553 INFO:tasks.rados.rados.0.smithi137.stdout:3358: finishing write tid 3 to smithi13777483-23 2024-03-04T06:52:59.553 INFO:tasks.rados.rados.0.smithi137.stdout:3358: finishing write tid 4 to smithi13777483-23 2024-03-04T06:52:59.553 INFO:tasks.rados.rados.0.smithi137.stdout:3358: oid 23 updating version 0 to 16923 2024-03-04T06:52:59.553 INFO:tasks.rados.rados.0.smithi137.stdout:3358: oid 23 version 16923 is already newer than 16921 2024-03-04T06:52:59.553 INFO:tasks.rados.rados.0.smithi137.stdout:3358: oid 23 version 16923 is already newer than 16922 2024-03-04T06:52:59.553 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 16923 (ObjNum 1056 snap 317 seq_num 1056) dirty exists 2024-03-04T06:52:59.553 INFO:tasks.rados.rados.0.smithi137.stdout:3358: left oid 23 (ObjNum 1056 snap 317 seq_num 1056) 2024-03-04T06:52:59.554 INFO:tasks.rados.rados.0.smithi137.stdout:3354: done (4 left) 2024-03-04T06:52:59.554 INFO:tasks.rados.rados.0.smithi137.stdout:3355: done (3 left) 2024-03-04T06:52:59.554 INFO:tasks.rados.rados.0.smithi137.stdout:3356: done (2 left) 2024-03-04T06:52:59.554 INFO:tasks.rados.rados.0.smithi137.stdout:3358: done (1 left) 2024-03-04T06:52:59.554 INFO:tasks.rados.rados.0.smithi137.stdout:3360: snap_create 2024-03-04T06:52:59.555 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 16918 (ObjNum 955 snap 281 seq_num 955) dirty exists 2024-03-04T06:52:59.958 INFO:tasks.rados.rados.0.smithi137.stdout:3359: done (1 left) 2024-03-04T06:52:59.958 INFO:tasks.rados.rados.0.smithi137.stdout:3360: done (0 left) 2024-03-04T06:52:59.958 INFO:tasks.rados.rados.0.smithi137.stdout:3361: snap_remove snap 305 2024-03-04T06:53:00.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:59.957+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:00.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:52:59.957+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:52:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:00.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:59.956+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:00.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:52:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:52:59.956+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:52:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:00.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:00.426+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:00.926 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:00.579+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:00.968 INFO:tasks.rados.rados.0.smithi137.stdout:3361: done (0 left) 2024-03-04T06:53:00.968 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 318 2024-03-04T06:53:00.969 INFO:tasks.rados.rados.0.smithi137.stdout:3362: seq_num 1057 ranges {5095424=507904,5603328=401408} 2024-03-04T06:53:00.999 INFO:tasks.rados.rados.0.smithi137.stdout:3362: writing smithi13777483-7 from 5095424 to 5603328 tid 1 2024-03-04T06:53:01.002 INFO:tasks.rados.rados.0.smithi137.stdout:3362: writing smithi13777483-7 from 5603328 to 6004736 tid 2 2024-03-04T06:53:01.002 INFO:tasks.rados.rados.0.smithi137.stdout:3363: snap_remove snap 313 2024-03-04T06:53:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[88869]: osdmap e700: 8 total, 8 up, 8 in 2024-03-04T06:53:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[88869]: pgmap v732: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 677 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 6.8 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-03-04T06:53:01.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:01.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[91314]: osdmap e700: 8 total, 8 up, 8 in 2024-03-04T06:53:01.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:01.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:01.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:01.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:01.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[91314]: pgmap v732: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 677 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 6.8 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-03-04T06:53:01.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:01.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:00.925+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:01.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:00.968+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:01.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:00.977+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:01.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:00.977+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:01.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:00.977+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:01.295 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:00.975+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:01.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:00.971+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:01.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:00.966+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:01.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:00.966+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:01.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:00.966+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:01.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-mon[85573]: osdmap e700: 8 total, 8 up, 8 in 2024-03-04T06:53:01.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:01.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:01.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:01.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:01.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-mon[85573]: pgmap v732: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 677 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 6.8 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-03-04T06:53:01.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:01.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:00.927+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:01.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:01.047+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:01.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:01.047+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:01.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:00.927+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:01.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:00.928+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:01.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:00.971+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:01.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:00.971+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:01.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:00.971+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:01.978 INFO:tasks.rados.rados.0.smithi137.stdout:3363: done (1 left) 2024-03-04T06:53:01.978 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 41 current snap is 318 2024-03-04T06:53:01.978 INFO:tasks.rados.rados.0.smithi137.stdout:3364: seq_num 1058 ranges {1499136=524288,2023424=401408} 2024-03-04T06:53:01.989 INFO:tasks.rados.rados.0.smithi137.stdout:3364: writing smithi13777483-41 from 1499136 to 2023424 tid 1 2024-03-04T06:53:01.991 INFO:tasks.rados.rados.0.smithi137.stdout:3364: writing smithi13777483-41 from 2023424 to 2424832 tid 2 2024-03-04T06:53:01.992 INFO:tasks.rados.rados.0.smithi137.stdout:3365: read oid 43 snap 312 2024-03-04T06:53:01.992 INFO:tasks.rados.rados.0.smithi137.stdout:3365: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:53:01.992 INFO:tasks.rados.rados.0.smithi137.stdout:3366: snap_create 2024-03-04T06:53:01.992 INFO:tasks.rados.rados.0.smithi137.stdout:3362: finishing write tid 1 to smithi13777483-7 2024-03-04T06:53:01.992 INFO:tasks.rados.rados.0.smithi137.stdout:3362: finishing write tid 2 to smithi13777483-7 2024-03-04T06:53:01.992 INFO:tasks.rados.rados.0.smithi137.stdout:3362: finishing write tid 3 to smithi13777483-7 2024-03-04T06:53:01.992 INFO:tasks.rados.rados.0.smithi137.stdout:3362: finishing write tid 4 to smithi13777483-7 2024-03-04T06:53:01.992 INFO:tasks.rados.rados.0.smithi137.stdout:3362: oid 7 updating version 0 to 16949 2024-03-04T06:53:01.992 INFO:tasks.rados.rados.0.smithi137.stdout:3362: oid 7 version 16949 is already newer than 16947 2024-03-04T06:53:01.992 INFO:tasks.rados.rados.0.smithi137.stdout:3362: oid 7 version 16949 is already newer than 16948 2024-03-04T06:53:01.992 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16949 (ObjNum 1057 snap 318 seq_num 1057) dirty exists 2024-03-04T06:53:01.992 INFO:tasks.rados.rados.0.smithi137.stdout:3362: left oid 7 (ObjNum 1057 snap 318 seq_num 1057) 2024-03-04T06:53:02.000 INFO:tasks.rados.rados.0.smithi137.stdout:3364: finishing write tid 1 to smithi13777483-41 2024-03-04T06:53:02.000 INFO:tasks.rados.rados.0.smithi137.stdout:3364: finishing write tid 2 to smithi13777483-41 2024-03-04T06:53:02.000 INFO:tasks.rados.rados.0.smithi137.stdout:3364: finishing write tid 3 to smithi13777483-41 2024-03-04T06:53:02.005 INFO:tasks.rados.rados.0.smithi137.stdout:3364: finishing write tid 4 to smithi13777483-41 2024-03-04T06:53:02.005 INFO:tasks.rados.rados.0.smithi137.stdout:3364: oid 41 updating version 0 to 16957 2024-03-04T06:53:02.005 INFO:tasks.rados.rados.0.smithi137.stdout:3364: oid 41 updating version 16957 to 16959 2024-03-04T06:53:02.005 INFO:tasks.rados.rados.0.smithi137.stdout:3364: oid 41 version 16959 is already newer than 16958 2024-03-04T06:53:02.005 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 16959 (ObjNum 1058 snap 318 seq_num 1058) dirty exists 2024-03-04T06:53:02.005 INFO:tasks.rados.rados.0.smithi137.stdout:3364: left oid 41 (ObjNum 1058 snap 318 seq_num 1058) 2024-03-04T06:53:02.005 INFO:tasks.rados.rados.0.smithi137.stdout:3365: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:53:02.292 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:01.977+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:02.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:01.982+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:02.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:02.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:02.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:02.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:02.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:02.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:02.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: osdmap e701: 8 total, 8 up, 8 in 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: osdmap e701: 8 total, 8 up, 8 in 2024-03-04T06:53:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:02.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:02.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:01.993+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:02.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:02.004+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:02.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:01.975+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:02.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:01.975+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:02.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:01.982+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:02.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:02.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:02.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:02.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:02.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: osdmap e701: 8 total, 8 up, 8 in 2024-03-04T06:53:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 174=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:02.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:02.571+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:02.979 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:02.627+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:02.979 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:02.627+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:02.984 INFO:tasks.rados.rados.0.smithi137.stdout:3362: done (3 left) 2024-03-04T06:53:02.984 INFO:tasks.rados.rados.0.smithi137.stdout:3364: done (2 left) 2024-03-04T06:53:02.984 INFO:tasks.rados.rados.0.smithi137.stdout:3365: done (1 left) 2024-03-04T06:53:02.984 INFO:tasks.rados.rados.0.smithi137.stdout:3366: done (0 left) 2024-03-04T06:53:02.984 INFO:tasks.rados.rados.0.smithi137.stdout:3367: read oid 36 snap 301 2024-03-04T06:53:02.984 INFO:tasks.rados.rados.0.smithi137.stdout:3367: expect (ObjNum 951 snap 281 seq_num 951) 2024-03-04T06:53:02.984 INFO:tasks.rados.rados.0.smithi137.stdout:3368: read oid 48 snap -1 2024-03-04T06:53:02.984 INFO:tasks.rados.rados.0.smithi137.stdout:3368: expect (ObjNum 955 snap 281 seq_num 955) 2024-03-04T06:53:02.984 INFO:tasks.rados.rados.0.smithi137.stdout:3369: read oid 4 snap -1 2024-03-04T06:53:02.984 INFO:tasks.rados.rados.0.smithi137.stdout:3369: expect (ObjNum 1047 snap 315 seq_num 1047) 2024-03-04T06:53:02.984 INFO:tasks.rados.rados.0.smithi137.stdout:3370: rollback oid 44 current snap is 319 2024-03-04T06:53:02.985 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 44 to 301 2024-03-04T06:53:02.985 INFO:tasks.rados.rados.0.smithi137.stdout:3371: copy_from oid 5 from oid 30 current snap is 319 2024-03-04T06:53:02.985 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 319 2024-03-04T06:53:02.985 INFO:tasks.rados.rados.0.smithi137.stdout:3372: seq_num 1059 ranges {0=540672,540672=401408} 2024-03-04T06:53:02.987 INFO:tasks.rados.rados.0.smithi137.stdout:3372: writing smithi13777483-21 from 0 to 540672 tid 1 2024-03-04T06:53:02.990 INFO:tasks.rados.rados.0.smithi137.stdout:3372: writing smithi13777483-21 from 540672 to 942080 tid 2 2024-03-04T06:53:02.990 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 319 2024-03-04T06:53:02.990 INFO:tasks.rados.rados.0.smithi137.stdout:3373: seq_num 1060 ranges {9519104=557056,10076160=401408} 2024-03-04T06:53:03.047 INFO:tasks.rados.rados.0.smithi137.stdout:3373: writing smithi13777483-9 from 9519104 to 10076160 tid 1 2024-03-04T06:53:03.049 INFO:tasks.rados.rados.0.smithi137.stdout:3373: writing smithi13777483-9 from 10076160 to 10477568 tid 2 2024-03-04T06:53:03.050 INFO:tasks.rados.rados.0.smithi137.stdout:3374: rmattr oid 19 current snap is 319 2024-03-04T06:53:03.050 INFO:tasks.rados.rados.0.smithi137.stdout:3375: snap_remove snap 281 2024-03-04T06:53:03.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:02.983+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:03.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:03.001+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:03.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:03.012+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:03.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:03.035+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:03.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:03.035+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[88869]: osdmap e702: 8 total, 8 up, 8 in 2024-03-04T06:53:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[88869]: pgmap v735: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 677 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail 2024-03-04T06:53:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:03.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:03.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:03.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[91314]: osdmap e702: 8 total, 8 up, 8 in 2024-03-04T06:53:03.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[91314]: pgmap v735: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 677 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail 2024-03-04T06:53:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:03.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:02.988+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:03.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:03.100+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:03.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:03.100+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:03.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:03.100+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:03.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:02.982+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:03.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:02.982+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:03.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:02.982+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:03.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:02.999+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:03.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:02.999+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-mon[85573]: osdmap e702: 8 total, 8 up, 8 in 2024-03-04T06:53:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-mon[85573]: pgmap v735: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 677 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail 2024-03-04T06:53:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:03.990 INFO:tasks.rados.rados.0.smithi137.stdout:3375: done (8 left) 2024-03-04T06:53:03.991 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 319 2024-03-04T06:53:03.991 INFO:tasks.rados.rados.0.smithi137.stdout:3368: expect (ObjNum 955 snap 281 seq_num 955) 2024-03-04T06:53:04.089 INFO:tasks.rados.rados.0.smithi137.stdout:3367: expect (ObjNum 951 snap 281 seq_num 951) 2024-03-04T06:53:04.187 INFO:tasks.rados.rados.0.smithi137.stdout:3370: finishing rollback tid 0 to smithi13777483-44 2024-03-04T06:53:04.187 INFO:tasks.rados.rados.0.smithi137.stdout:3370: finishing rollback tid 1 to smithi13777483-44 2024-03-04T06:53:04.187 INFO:tasks.rados.rados.0.smithi137.stdout:3370: finishing rollback tid 2 to smithi13777483-44 2024-03-04T06:53:04.187 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16915 (ObjNum 1007 snap 296 seq_num 1007) dirty exists 2024-03-04T06:53:04.187 INFO:tasks.rados.rados.0.smithi137.stdout:3372: finishing write tid 1 to smithi13777483-21 2024-03-04T06:53:04.188 INFO:tasks.rados.rados.0.smithi137.stdout:3372: finishing write tid 2 to smithi13777483-21 2024-03-04T06:53:04.188 INFO:tasks.rados.rados.0.smithi137.stdout:3372: finishing write tid 3 to smithi13777483-21 2024-03-04T06:53:04.188 INFO:tasks.rados.rados.0.smithi137.stdout:3371: finishing copy_from racing read to smithi13777483-5 2024-03-04T06:53:04.188 INFO:tasks.rados.rados.0.smithi137.stdout:3372: finishing write tid 4 to smithi13777483-21 2024-03-04T06:53:04.188 INFO:tasks.rados.rados.0.smithi137.stdout:3372: oid 21 updating version 0 to 16935 2024-03-04T06:53:04.188 INFO:tasks.rados.rados.0.smithi137.stdout:3372: oid 21 updating version 16935 to 16937 2024-03-04T06:53:04.188 INFO:tasks.rados.rados.0.smithi137.stdout:3372: oid 21 version 16937 is already newer than 16936 2024-03-04T06:53:04.188 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 16937 (ObjNum 1059 snap 319 seq_num 1059) dirty exists 2024-03-04T06:53:04.188 INFO:tasks.rados.rados.0.smithi137.stdout:3372: left oid 21 (ObjNum 1059 snap 319 seq_num 1059) 2024-03-04T06:53:04.188 INFO:tasks.rados.rados.0.smithi137.stdout:3376: seq_num 1061 ranges {0=573440,573440=401408} 2024-03-04T06:53:04.190 INFO:tasks.rados.rados.0.smithi137.stdout:3376: writing smithi13777483-16 from 0 to 573440 tid 1 2024-03-04T06:53:04.193 INFO:tasks.rados.rados.0.smithi137.stdout:3376: writing smithi13777483-16 from 573440 to 974848 tid 2 2024-03-04T06:53:04.193 INFO:tasks.rados.rados.0.smithi137.stdout:3367: done (8 left) 2024-03-04T06:53:04.194 INFO:tasks.rados.rados.0.smithi137.stdout:3368: done (7 left) 2024-03-04T06:53:04.194 INFO:tasks.rados.rados.0.smithi137.stdout:3370: done (6 left) 2024-03-04T06:53:04.194 INFO:tasks.rados.rados.0.smithi137.stdout:3372: done (5 left) 2024-03-04T06:53:04.194 INFO:tasks.rados.rados.0.smithi137.stdout:3377: snap_remove snap 299 2024-03-04T06:53:04.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:03.999+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:04.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:03.989+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:04.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:03.995+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:04.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:03.995+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[88869]: osdmap e703: 8 total, 8 up, 8 in 2024-03-04T06:53:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:04.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:04.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:04.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:04.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:04.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[91314]: osdmap e703: 8 total, 8 up, 8 in 2024-03-04T06:53:04.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:04.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:04.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:04.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:04.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:04.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:04.012+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:04.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:04.012+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:04.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:03.994+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:04.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:03.996+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:04.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:03.996+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:04.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:03.994+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:04.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:04.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:04.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:04.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:04.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:04.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-mon[85573]: osdmap e703: 8 total, 8 up, 8 in 2024-03-04T06:53:04.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:04.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:04.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:04.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:04.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:04.995 INFO:tasks.rados.rados.0.smithi137.stdout:3377: done (5 left) 2024-03-04T06:53:04.995 INFO:tasks.rados.rados.0.smithi137.stdout:3378: delete oid 20 current snap is 319 2024-03-04T06:53:04.995 INFO:tasks.rados.rados.0.smithi137.stdout:3371: finishing copy_from to smithi13777483-5 2024-03-04T06:53:04.995 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 16917 (ObjNum 982 snap 287 seq_num 982) dirty exists 2024-03-04T06:53:04.996 INFO:tasks.rados.rados.0.smithi137.stdout:3369: expect (ObjNum 1047 snap 315 seq_num 1047) 2024-03-04T06:53:05.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:04.999+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:05.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:04.999+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:05.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:04.999+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:05.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:05.000+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:05.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:05.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: osdmap e704: 8 total, 8 up, 8 in 2024-03-04T06:53:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: pgmap v738: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 684 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 16 MiB/s rd, 1.7 MiB/s wr, 18 op/s 2024-03-04T06:53:05.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:53:05.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:05.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:05.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:05.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:05.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: osdmap e704: 8 total, 8 up, 8 in 2024-03-04T06:53:05.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:05.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:05.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:05.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:05.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:05.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:05.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:05.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:05.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: pgmap v738: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 684 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 16 MiB/s rd, 1.7 MiB/s wr, 18 op/s 2024-03-04T06:53:05.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:53:05.296 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:04.995+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:05.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:05.000+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:05.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:05.001+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:05.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:05.001+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:05.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:05.005+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:05.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:05.005+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:05.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:05.005+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:05.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:04.993+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:05.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:04.993+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:05.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:04.993+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:05.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:05.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:05.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:05.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:05.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: osdmap e704: 8 total, 8 up, 8 in 2024-03-04T06:53:05.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:05.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:05.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:05.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:05.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:05.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:05.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:05.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:05.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: pgmap v738: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 684 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 16 MiB/s rd, 1.7 MiB/s wr, 18 op/s 2024-03-04T06:53:05.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:04 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:53:05.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:53:05] "GET /metrics HTTP/1.1" 200 36340 "" "Prometheus/2.43.0" 2024-03-04T06:53:06.021 INFO:tasks.rados.rados.0.smithi137.stdout:3373: finishing write tid 1 to smithi13777483-9 2024-03-04T06:53:06.021 INFO:tasks.rados.rados.0.smithi137.stdout:3373: finishing write tid 2 to smithi13777483-9 2024-03-04T06:53:06.021 INFO:tasks.rados.rados.0.smithi137.stdout:3373: finishing write tid 3 to smithi13777483-9 2024-03-04T06:53:06.021 INFO:tasks.rados.rados.0.smithi137.stdout:3373: finishing write tid 4 to smithi13777483-9 2024-03-04T06:53:06.021 INFO:tasks.rados.rados.0.smithi137.stdout:3373: oid 9 updating version 0 to 16947 2024-03-04T06:53:06.021 INFO:tasks.rados.rados.0.smithi137.stdout:3373: oid 9 updating version 16947 to 16948 2024-03-04T06:53:06.021 INFO:tasks.rados.rados.0.smithi137.stdout:3373: oid 9 updating version 16948 to 16949 2024-03-04T06:53:06.021 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 16949 (ObjNum 1060 snap 319 seq_num 1060) dirty exists 2024-03-04T06:53:06.021 INFO:tasks.rados.rados.0.smithi137.stdout:3373: left oid 9 (ObjNum 1060 snap 319 seq_num 1060) 2024-03-04T06:53:06.021 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 16950 (ObjNum 931 snap 275 seq_num 931) dirty exists 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3376: finishing write tid 1 to smithi13777483-16 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3369: done (5 left) 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3371: done (4 left) 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3373: done (3 left) 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3374: done (2 left) 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3378: done (1 left) 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3379: rollback oid 42 current snap is 319 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 42 to 316 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3376: finishing write tid 2 to smithi13777483-16 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3376: finishing write tid 3 to smithi13777483-16 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3376: finishing write tid 4 to smithi13777483-16 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3376: oid 16 updating version 0 to 16916 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3376: oid 16 updating version 16916 to 16918 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3376: oid 16 version 16918 is already newer than 16917 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16918 (ObjNum 1061 snap 319 seq_num 1061) dirty exists 2024-03-04T06:53:06.022 INFO:tasks.rados.rados.0.smithi137.stdout:3376: left oid 16 (ObjNum 1061 snap 319 seq_num 1061) 2024-03-04T06:53:06.023 INFO:tasks.rados.rados.0.smithi137.stdout:3376: done (1 left) 2024-03-04T06:53:06.023 INFO:tasks.rados.rados.0.smithi137.stdout:3380: read oid 28 snap -1 2024-03-04T06:53:06.023 INFO:tasks.rados.rados.0.smithi137.stdout:3380: expect (ObjNum 1047 snap 315 seq_num 1047) 2024-03-04T06:53:06.023 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 319 2024-03-04T06:53:06.023 INFO:tasks.rados.rados.0.smithi137.stdout:3381: seq_num 1063 ranges {0=606208,606208=401408} 2024-03-04T06:53:06.023 INFO:tasks.rados.rados.0.smithi137.stdout:3381: writing smithi13777483-2 from 0 to 606208 tid 1 2024-03-04T06:53:06.027 INFO:tasks.rados.rados.0.smithi137.stdout:3381: writing smithi13777483-2 from 606208 to 1007616 tid 2 2024-03-04T06:53:06.027 INFO:tasks.rados.rados.0.smithi137.stdout:3382: read oid 1 snap -1 2024-03-04T06:53:06.027 INFO:tasks.rados.rados.0.smithi137.stdout:3382: expect deleted 2024-03-04T06:53:06.027 INFO:tasks.rados.rados.0.smithi137.stdout:3383: copy_from oid 7 from oid 36 current snap is 319 2024-03-04T06:53:06.027 INFO:tasks.rados.rados.0.smithi137.stdout:3379: finishing rollback tid 1 to smithi13777483-42 2024-03-04T06:53:06.027 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16952 (ObjNum 4113 snap 0 seq_num 1310170247) dirty dne 2024-03-04T06:53:06.027 INFO:tasks.rados.rados.0.smithi137.stdout:3379: done (4 left) 2024-03-04T06:53:06.027 INFO:tasks.rados.rados.0.smithi137.stdout:3384: delete oid 5 current snap is 319 2024-03-04T06:53:06.028 INFO:tasks.rados.rados.0.smithi137.stdout:3383: finishing copy_from to smithi13777483-7 2024-03-04T06:53:06.028 INFO:tasks.rados.rados.0.smithi137.stdout:3383: got expected ENOENT (src dne) 2024-03-04T06:53:06.028 INFO:tasks.rados.rados.0.smithi137.stdout:3383: finishing copy_from racing read to smithi13777483-7 2024-03-04T06:53:06.030 INFO:tasks.rados.rados.0.smithi137.stdout:3381: finishing write tid 1 to smithi13777483-2 2024-03-04T06:53:06.030 INFO:tasks.rados.rados.0.smithi137.stdout:3381: finishing write tid 2 to smithi13777483-2 2024-03-04T06:53:06.031 INFO:tasks.rados.rados.0.smithi137.stdout:3381: finishing write tid 3 to smithi13777483-2 2024-03-04T06:53:06.031 INFO:tasks.rados.rados.0.smithi137.stdout:3382: done (4 left) 2024-03-04T06:53:06.031 INFO:tasks.rados.rados.0.smithi137.stdout:3383: done (3 left) 2024-03-04T06:53:06.031 INFO:tasks.rados.rados.0.smithi137.stdout:3384: done (2 left) 2024-03-04T06:53:06.031 INFO:tasks.rados.rados.0.smithi137.stdout:3385: snap_create 2024-03-04T06:53:06.033 INFO:tasks.rados.rados.0.smithi137.stdout:3381: finishing write tid 4 to smithi13777483-2 2024-03-04T06:53:06.033 INFO:tasks.rados.rados.0.smithi137.stdout:3381: oid 2 updating version 0 to 16921 2024-03-04T06:53:06.033 INFO:tasks.rados.rados.0.smithi137.stdout:3381: oid 2 version 16921 is already newer than 16920 2024-03-04T06:53:06.033 INFO:tasks.rados.rados.0.smithi137.stdout:3381: oid 2 version 16921 is already newer than 16919 2024-03-04T06:53:06.034 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16921 (ObjNum 1063 snap 319 seq_num 1063) dirty exists 2024-03-04T06:53:06.034 INFO:tasks.rados.rados.0.smithi137.stdout:3381: left oid 2 (ObjNum 1063 snap 319 seq_num 1063) 2024-03-04T06:53:06.061 INFO:tasks.rados.rados.0.smithi137.stdout:3380: expect (ObjNum 1047 snap 315 seq_num 1047) 2024-03-04T06:53:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: osdmap e705: 8 total, 8 up, 8 in 2024-03-04T06:53:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: osdmap e705: 8 total, 8 up, 8 in 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:06.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:53:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:53:06.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:05 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:53:06.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:06.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: osdmap e705: 8 total, 8 up, 8 in 2024-03-04T06:53:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:53:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:53:06.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:05 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:53:07.067 INFO:tasks.rados.rados.0.smithi137.stdout:3380: done (2 left) 2024-03-04T06:53:07.067 INFO:tasks.rados.rados.0.smithi137.stdout:3381: done (1 left) 2024-03-04T06:53:07.067 INFO:tasks.rados.rados.0.smithi137.stdout:3385: done (0 left) 2024-03-04T06:53:07.067 INFO:tasks.rados.rados.0.smithi137.stdout:3386: read oid 47 snap 306 2024-03-04T06:53:07.067 INFO:tasks.rados.rados.0.smithi137.stdout:3386: expect deleted 2024-03-04T06:53:07.067 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 36 current snap is 320 2024-03-04T06:53:07.067 INFO:tasks.rados.rados.0.smithi137.stdout:3387: seq_num 1065 ranges {0=638976,638976=401408} 2024-03-04T06:53:07.069 INFO:tasks.rados.rados.0.smithi137.stdout:3387: writing smithi13777483-36 from 0 to 638976 tid 1 2024-03-04T06:53:07.072 INFO:tasks.rados.rados.0.smithi137.stdout:3387: writing smithi13777483-36 from 638976 to 1040384 tid 2 2024-03-04T06:53:07.072 INFO:tasks.rados.rados.0.smithi137.stdout:3388: snap_remove snap 314 2024-03-04T06:53:07.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:06 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:07.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:06 smithi137 ceph-mon[88869]: pgmap v740: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 686 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 14 MiB/s rd, 1.9 MiB/s wr, 18 op/s 2024-03-04T06:53:07.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:06 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:07.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:06 smithi137 ceph-mon[91314]: pgmap v740: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 686 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 14 MiB/s rd, 1.9 MiB/s wr, 18 op/s 2024-03-04T06:53:07.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:07.074+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:07.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:07.074+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:07.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:06.994+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:07.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:07.069+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:07.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:06 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:07.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:06 smithi203 ceph-mon[85573]: pgmap v740: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 686 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 14 MiB/s rd, 1.9 MiB/s wr, 18 op/s 2024-03-04T06:53:07.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:06.991+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:07.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:06.992+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:08.000 INFO:tasks.rados.rados.0.smithi137.stdout:3388: done (2 left) 2024-03-04T06:53:08.000 INFO:tasks.rados.rados.0.smithi137.stdout:3389: delete oid 3 current snap is 320 2024-03-04T06:53:08.000 INFO:tasks.rados.rados.0.smithi137.stdout:3387: finishing write tid 1 to smithi13777483-36 2024-03-04T06:53:08.000 INFO:tasks.rados.rados.0.smithi137.stdout:3387: finishing write tid 2 to smithi13777483-36 2024-03-04T06:53:08.000 INFO:tasks.rados.rados.0.smithi137.stdout:3387: finishing write tid 3 to smithi13777483-36 2024-03-04T06:53:08.000 INFO:tasks.rados.rados.0.smithi137.stdout:3387: finishing write tid 4 to smithi13777483-36 2024-03-04T06:53:08.001 INFO:tasks.rados.rados.0.smithi137.stdout:3387: oid 36 updating version 0 to 16886 2024-03-04T06:53:08.001 INFO:tasks.rados.rados.0.smithi137.stdout:3387: oid 36 version 16886 is already newer than 16884 2024-03-04T06:53:08.001 INFO:tasks.rados.rados.0.smithi137.stdout:3387: oid 36 version 16886 is already newer than 16885 2024-03-04T06:53:08.001 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 16886 (ObjNum 1065 snap 320 seq_num 1065) dirty exists 2024-03-04T06:53:08.001 INFO:tasks.rados.rados.0.smithi137.stdout:3387: left oid 36 (ObjNum 1065 snap 320 seq_num 1065) 2024-03-04T06:53:08.009 INFO:tasks.rados.rados.0.smithi137.stdout:3386: done (2 left) 2024-03-04T06:53:08.009 INFO:tasks.rados.rados.0.smithi137.stdout:3387: done (1 left) 2024-03-04T06:53:08.009 INFO:tasks.rados.rados.0.smithi137.stdout:3389: done (0 left) 2024-03-04T06:53:08.009 INFO:tasks.rados.rados.0.smithi137.stdout:3390: setattr oid 47 current snap is 320 2024-03-04T06:53:08.011 INFO:tasks.rados.rados.0.smithi137.stdout:3391: read oid 49 snap -1 2024-03-04T06:53:08.011 INFO:tasks.rados.rados.0.smithi137.stdout:3391: expect deleted 2024-03-04T06:53:08.011 INFO:tasks.rados.rados.0.smithi137.stdout:3392: copy_from oid 8 from oid 22 current snap is 320 2024-03-04T06:53:08.011 INFO:tasks.rados.rados.0.smithi137.stdout:3393: read oid 14 snap -1 2024-03-04T06:53:08.011 INFO:tasks.rados.rados.0.smithi137.stdout:3393: expect (ObjNum 925 snap 272 seq_num 925) 2024-03-04T06:53:08.011 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 320 2024-03-04T06:53:08.011 INFO:tasks.rados.rados.0.smithi137.stdout:3394: seq_num 1067 ranges {1318912=679936,1998848=401408} 2024-03-04T06:53:08.022 INFO:tasks.rados.rados.0.smithi137.stdout:3394: writing smithi13777483-23 from 1318912 to 1998848 tid 1 2024-03-04T06:53:08.024 INFO:tasks.rados.rados.0.smithi137.stdout:3394: writing smithi13777483-23 from 1998848 to 2400256 tid 2 2024-03-04T06:53:08.024 INFO:tasks.rados.rados.0.smithi137.stdout:3395: read oid 38 snap -1 2024-03-04T06:53:08.025 INFO:tasks.rados.rados.0.smithi137.stdout:3395: expect deleted 2024-03-04T06:53:08.025 INFO:tasks.rados.rados.0.smithi137.stdout:3396: copy_from oid 12 from oid 34 current snap is 320 2024-03-04T06:53:08.025 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16938 (ObjNum 833 snap 0 seq_num 3131420736) dirty exists 2024-03-04T06:53:08.025 INFO:tasks.rados.rados.0.smithi137.stdout:3390: done (6 left) 2024-03-04T06:53:08.025 INFO:tasks.rados.rados.0.smithi137.stdout:3391: done (5 left) 2024-03-04T06:53:08.025 INFO:tasks.rados.rados.0.smithi137.stdout:3397: snap_remove snap 317 2024-03-04T06:53:08.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:08.010+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:08.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:08.004+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:08.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:08.004+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:08.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:08.004+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:08.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:07.999+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:08.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:08.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:08.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:08.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[91314]: osdmap e706: 8 total, 8 up, 8 in 2024-03-04T06:53:08.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:08.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:08.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:08.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:08.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:08.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:08.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[88869]: osdmap e706: 8 total, 8 up, 8 in 2024-03-04T06:53:08.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:08.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:08.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:08.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:07.998+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:08.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:08.004+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:08.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:08.004+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:07 smithi203 ceph-mon[85573]: osdmap e706: 8 total, 8 up, 8 in 2024-03-04T06:53:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:08.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:08.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:08.015+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:08.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:08.015+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:08.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:08.015+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:08.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:07.871+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:08.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:08.033+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:08.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:08.033+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:09.006 INFO:tasks.rados.rados.0.smithi137.stdout:3397: done (5 left) 2024-03-04T06:53:09.007 INFO:tasks.rados.rados.0.smithi137.stdout:3398: read oid 9 snap -1 2024-03-04T06:53:09.007 INFO:tasks.rados.rados.0.smithi137.stdout:3398: expect (ObjNum 1060 snap 319 seq_num 1060) 2024-03-04T06:53:09.007 INFO:tasks.rados.rados.0.smithi137.stdout:3399: rollback oid 26 current snap is 320 2024-03-04T06:53:09.007 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 26 to 319 2024-03-04T06:53:09.007 INFO:tasks.rados.rados.0.smithi137.stdout:3393: expect (ObjNum 925 snap 272 seq_num 925) 2024-03-04T06:53:09.216 INFO:tasks.rados.rados.0.smithi137.stdout:3394: finishing write tid 1 to smithi13777483-23 2024-03-04T06:53:09.216 INFO:tasks.rados.rados.0.smithi137.stdout:3394: finishing write tid 2 to smithi13777483-23 2024-03-04T06:53:09.216 INFO:tasks.rados.rados.0.smithi137.stdout:3393: done (6 left) 2024-03-04T06:53:09.216 INFO:tasks.rados.rados.0.smithi137.stdout:3395: done (5 left) 2024-03-04T06:53:09.216 INFO:tasks.rados.rados.0.smithi137.stdout:3400: delete oid 31 current snap is 320 2024-03-04T06:53:09.216 INFO:tasks.rados.rados.0.smithi137.stdout:3394: finishing write tid 3 to smithi13777483-23 2024-03-04T06:53:09.216 INFO:tasks.rados.rados.0.smithi137.stdout:3394: finishing write tid 4 to smithi13777483-23 2024-03-04T06:53:09.216 INFO:tasks.rados.rados.0.smithi137.stdout:3394: oid 23 updating version 0 to 16927 2024-03-04T06:53:09.216 INFO:tasks.rados.rados.0.smithi137.stdout:3394: oid 23 version 16927 is already newer than 16926 2024-03-04T06:53:09.216 INFO:tasks.rados.rados.0.smithi137.stdout:3394: oid 23 version 16927 is already newer than 16925 2024-03-04T06:53:09.216 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 16927 (ObjNum 1067 snap 320 seq_num 1067) dirty exists 2024-03-04T06:53:09.217 INFO:tasks.rados.rados.0.smithi137.stdout:3394: left oid 23 (ObjNum 1067 snap 320 seq_num 1067) 2024-03-04T06:53:09.217 INFO:tasks.rados.rados.0.smithi137.stdout:3396: finishing copy_from racing read to smithi13777483-12 2024-03-04T06:53:09.217 INFO:tasks.rados.rados.0.smithi137.stdout:3396: finishing copy_from to smithi13777483-12 2024-03-04T06:53:09.217 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16908 (ObjNum 1029 snap 306 seq_num 1029) dirty exists 2024-03-04T06:53:09.217 INFO:tasks.rados.rados.0.smithi137.stdout:3392: finishing copy_from racing read to smithi13777483-8 2024-03-04T06:53:09.217 INFO:tasks.rados.rados.0.smithi137.stdout:3392: finishing copy_from to smithi13777483-8 2024-03-04T06:53:09.217 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16936 (ObjNum 959 snap 282 seq_num 959) dirty exists 2024-03-04T06:53:09.217 INFO:tasks.rados.rados.0.smithi137.stdout:3399: finishing rollback tid 0 to smithi13777483-26 2024-03-04T06:53:09.217 INFO:tasks.rados.rados.0.smithi137.stdout:3399: finishing rollback tid 1 to smithi13777483-26 2024-03-04T06:53:09.217 INFO:tasks.rados.rados.0.smithi137.stdout:3399: finishing rollback tid 2 to smithi13777483-26 2024-03-04T06:53:09.217 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16908 (ObjNum 957 snap 282 seq_num 957) dirty exists 2024-03-04T06:53:09.217 INFO:tasks.rados.rados.0.smithi137.stdout:3398: expect (ObjNum 1060 snap 319 seq_num 1060) 2024-03-04T06:53:09.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:09.011+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:09.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:09.127+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:09.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:09.006+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:09.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:09.006+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: osdmap e707: 8 total, 8 up, 8 in 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:53:09.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[91314]: pgmap v743: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 666 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 14 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: osdmap e707: 8 total, 8 up, 8 in 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:53:09.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:09 smithi137 ceph-mon[88869]: pgmap v743: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 666 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 14 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-03-04T06:53:09.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:09.007+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:09.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:09.127+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:09.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:09.011+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:09.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:09.011+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:09.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:09.002+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:09.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:09.002+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:09.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:09.003+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: osdmap e707: 8 total, 8 up, 8 in 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:53:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:09 smithi203 ceph-mon[85573]: pgmap v743: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 666 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 14 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-03-04T06:53:10.209 INFO:tasks.rados.rados.0.smithi137.stdout:3392: done (5 left) 2024-03-04T06:53:10.209 INFO:tasks.rados.rados.0.smithi137.stdout:3394: done (4 left) 2024-03-04T06:53:10.209 INFO:tasks.rados.rados.0.smithi137.stdout:3396: done (3 left) 2024-03-04T06:53:10.209 INFO:tasks.rados.rados.0.smithi137.stdout:3398: done (2 left) 2024-03-04T06:53:10.210 INFO:tasks.rados.rados.0.smithi137.stdout:3399: done (1 left) 2024-03-04T06:53:10.210 INFO:tasks.rados.rados.0.smithi137.stdout:3400: done (0 left) 2024-03-04T06:53:10.210 INFO:tasks.rados.rados.0.smithi137.stdout:3401: read oid 4 snap -1 2024-03-04T06:53:10.210 INFO:tasks.rados.rados.0.smithi137.stdout:3401: expect (ObjNum 1047 snap 315 seq_num 1047) 2024-03-04T06:53:10.210 INFO:tasks.rados.rados.0.smithi137.stdout:3402: rmattr oid 46 current snap is 320 2024-03-04T06:53:10.210 INFO:tasks.rados.rados.0.smithi137.stdout:3402: done (1 left) 2024-03-04T06:53:10.210 INFO:tasks.rados.rados.0.smithi137.stdout:3403: delete oid 37 current snap is 320 2024-03-04T06:53:10.210 INFO:tasks.rados.rados.0.smithi137.stdout:3403: done (1 left) 2024-03-04T06:53:10.211 INFO:tasks.rados.rados.0.smithi137.stdout:3404: rollback oid 9 current snap is 320 2024-03-04T06:53:10.211 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 9 to 301 2024-03-04T06:53:10.211 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 32 current snap is 320 2024-03-04T06:53:10.211 INFO:tasks.rados.rados.0.smithi137.stdout:3405: seq_num 1070 ranges {0=729088,729088=401408} 2024-03-04T06:53:10.214 INFO:tasks.rados.rados.0.smithi137.stdout:3405: writing smithi13777483-32 from 0 to 729088 tid 1 2024-03-04T06:53:10.217 INFO:tasks.rados.rados.0.smithi137.stdout:3405: writing smithi13777483-32 from 729088 to 1130496 tid 2 2024-03-04T06:53:10.217 INFO:tasks.rados.rados.0.smithi137.stdout:3406: rmattr oid 8 current snap is 320 2024-03-04T06:53:10.218 INFO:tasks.rados.rados.0.smithi137.stdout:3407: copy_from oid 44 from oid 42 current snap is 320 2024-03-04T06:53:10.218 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 37 current snap is 320 2024-03-04T06:53:10.218 INFO:tasks.rados.rados.0.smithi137.stdout:3408: seq_num 1071 ranges {0=745472,745472=401408} 2024-03-04T06:53:10.223 INFO:tasks.rados.rados.0.smithi137.stdout:3408: writing smithi13777483-37 from 0 to 745472 tid 1 2024-03-04T06:53:10.226 INFO:tasks.rados.rados.0.smithi137.stdout:3408: writing smithi13777483-37 from 745472 to 1146880 tid 2 2024-03-04T06:53:10.226 INFO:tasks.rados.rados.0.smithi137.stdout:3409: delete oid 1 current snap is 320 2024-03-04T06:53:10.226 INFO:tasks.rados.rados.0.smithi137.stdout:3404: finishing rollback tid 0 to smithi13777483-9 2024-03-04T06:53:10.226 INFO:tasks.rados.rados.0.smithi137.stdout:3404: finishing rollback tid 1 to smithi13777483-9 2024-03-04T06:53:10.227 INFO:tasks.rados.rados.0.smithi137.stdout:3404: finishing rollback tid 2 to smithi13777483-9 2024-03-04T06:53:10.227 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 16955 (ObjNum 931 snap 275 seq_num 931) dirty exists 2024-03-04T06:53:10.227 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16950 (ObjNum 959 snap 282 seq_num 959) dirty exists 2024-03-04T06:53:10.227 INFO:tasks.rados.rados.0.smithi137.stdout:3405: finishing write tid 1 to smithi13777483-32 2024-03-04T06:53:10.227 INFO:tasks.rados.rados.0.smithi137.stdout:3405: finishing write tid 2 to smithi13777483-32 2024-03-04T06:53:10.227 INFO:tasks.rados.rados.0.smithi137.stdout:3405: finishing write tid 3 to smithi13777483-32 2024-03-04T06:53:10.228 INFO:tasks.rados.rados.0.smithi137.stdout:3405: finishing write tid 4 to smithi13777483-32 2024-03-04T06:53:10.228 INFO:tasks.rados.rados.0.smithi137.stdout:3405: oid 32 updating version 0 to 16958 2024-03-04T06:53:10.228 INFO:tasks.rados.rados.0.smithi137.stdout:3405: oid 32 updating version 16958 to 16960 2024-03-04T06:53:10.228 INFO:tasks.rados.rados.0.smithi137.stdout:3405: oid 32 version 16960 is already newer than 16959 2024-03-04T06:53:10.228 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16960 (ObjNum 1070 snap 320 seq_num 1070) dirty exists 2024-03-04T06:53:10.228 INFO:tasks.rados.rados.0.smithi137.stdout:3405: left oid 32 (ObjNum 1070 snap 320 seq_num 1070) 2024-03-04T06:53:10.229 INFO:tasks.rados.rados.0.smithi137.stdout:3404: done (6 left) 2024-03-04T06:53:10.229 INFO:tasks.rados.rados.0.smithi137.stdout:3405: done (5 left) 2024-03-04T06:53:10.229 INFO:tasks.rados.rados.0.smithi137.stdout:3406: done (4 left) 2024-03-04T06:53:10.229 INFO:tasks.rados.rados.0.smithi137.stdout:3409: done (3 left) 2024-03-04T06:53:10.229 INFO:tasks.rados.rados.0.smithi137.stdout:3410: rollback oid 5 current snap is 320 2024-03-04T06:53:10.230 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 5 to 312 2024-03-04T06:53:10.230 INFO:tasks.rados.rados.0.smithi137.stdout:3411: setattr oid 6 current snap is 320 2024-03-04T06:53:10.230 INFO:tasks.rados.rados.0.smithi137.stdout:3408: finishing write tid 1 to smithi13777483-37 2024-03-04T06:53:10.230 INFO:tasks.rados.rados.0.smithi137.stdout:3408: finishing write tid 2 to smithi13777483-37 2024-03-04T06:53:10.230 INFO:tasks.rados.rados.0.smithi137.stdout:3408: finishing write tid 3 to smithi13777483-37 2024-03-04T06:53:10.231 INFO:tasks.rados.rados.0.smithi137.stdout:3407: finishing copy_from to smithi13777483-44 2024-03-04T06:53:10.231 INFO:tasks.rados.rados.0.smithi137.stdout:3407: got expected ENOENT (src dne) 2024-03-04T06:53:10.231 INFO:tasks.rados.rados.0.smithi137.stdout:3407: finishing copy_from racing read to smithi13777483-44 2024-03-04T06:53:10.231 INFO:tasks.rados.rados.0.smithi137.stdout:3407: done (4 left) 2024-03-04T06:53:10.231 INFO:tasks.rados.rados.0.smithi137.stdout:3412: read oid 26 snap -1 2024-03-04T06:53:10.232 INFO:tasks.rados.rados.0.smithi137.stdout:3412: expect (ObjNum 957 snap 282 seq_num 957) 2024-03-04T06:53:10.232 INFO:tasks.rados.rados.0.smithi137.stdout:3413: rmattr oid 1 current snap is 320 2024-03-04T06:53:10.232 INFO:tasks.rados.rados.0.smithi137.stdout:3413: done (5 left) 2024-03-04T06:53:10.232 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 320 2024-03-04T06:53:10.232 INFO:tasks.rados.rados.0.smithi137.stdout:3414: seq_num 1073 ranges {0=778240,778240=401408} 2024-03-04T06:53:10.236 INFO:tasks.rados.rados.0.smithi137.stdout:3414: writing smithi13777483-49 from 0 to 778240 tid 1 2024-03-04T06:53:10.238 INFO:tasks.rados.rados.0.smithi137.stdout:3414: writing smithi13777483-49 from 778240 to 1179648 tid 2 2024-03-04T06:53:10.238 INFO:tasks.rados.rados.0.smithi137.stdout:3415: snap_remove snap 307 2024-03-04T06:53:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[88869]: osdmap e708: 8 total, 8 up, 8 in 2024-03-04T06:53:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:10.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:10.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[91314]: osdmap e708: 8 total, 8 up, 8 in 2024-03-04T06:53:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:10.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:10.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:10.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:10.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:10 smithi203 ceph-mon[85573]: osdmap e708: 8 total, 8 up, 8 in 2024-03-04T06:53:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 15f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:11.013 INFO:tasks.rados.rados.0.smithi137.stdout:3415: done (6 left) 2024-03-04T06:53:11.013 INFO:tasks.rados.rados.0.smithi137.stdout:3416: snap_create 2024-03-04T06:53:11.013 INFO:tasks.rados.rados.0.smithi137.stdout:3410: finishing rollback tid 1 to smithi13777483-5 2024-03-04T06:53:11.013 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 16951 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-04T06:53:11.013 INFO:tasks.rados.rados.0.smithi137.stdout:3408: finishing write tid 4 to smithi13777483-37 2024-03-04T06:53:11.014 INFO:tasks.rados.rados.0.smithi137.stdout:3408: oid 37 updating version 0 to 16942 2024-03-04T06:53:11.014 INFO:tasks.rados.rados.0.smithi137.stdout:3408: oid 37 updating version 16942 to 16943 2024-03-04T06:53:11.014 INFO:tasks.rados.rados.0.smithi137.stdout:3408: oid 37 updating version 16943 to 16944 2024-03-04T06:53:11.014 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16944 (ObjNum 1071 snap 320 seq_num 1071) dirty exists 2024-03-04T06:53:11.014 INFO:tasks.rados.rados.0.smithi137.stdout:3408: left oid 37 (ObjNum 1071 snap 320 seq_num 1071) 2024-03-04T06:53:11.014 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16945 (ObjNum 787 snap 231 seq_num 787) dirty exists 2024-03-04T06:53:11.014 INFO:tasks.rados.rados.0.smithi137.stdout:3414: finishing write tid 1 to smithi13777483-49 2024-03-04T06:53:11.014 INFO:tasks.rados.rados.0.smithi137.stdout:3414: finishing write tid 2 to smithi13777483-49 2024-03-04T06:53:11.014 INFO:tasks.rados.rados.0.smithi137.stdout:3412: expect (ObjNum 957 snap 282 seq_num 957) 2024-03-04T06:53:11.083 INFO:tasks.rados.rados.0.smithi137.stdout:3414: finishing write tid 3 to smithi13777483-49 2024-03-04T06:53:11.083 INFO:tasks.rados.rados.0.smithi137.stdout:3414: finishing write tid 4 to smithi13777483-49 2024-03-04T06:53:11.083 INFO:tasks.rados.rados.0.smithi137.stdout:3414: oid 49 updating version 0 to 16939 2024-03-04T06:53:11.083 INFO:tasks.rados.rados.0.smithi137.stdout:3414: oid 49 version 16939 is already newer than 16938 2024-03-04T06:53:11.083 INFO:tasks.rados.rados.0.smithi137.stdout:3414: oid 49 version 16939 is already newer than 16937 2024-03-04T06:53:11.083 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16939 (ObjNum 1073 snap 320 seq_num 1073) dirty exists 2024-03-04T06:53:11.083 INFO:tasks.rados.rados.0.smithi137.stdout:3414: left oid 49 (ObjNum 1073 snap 320 seq_num 1073) 2024-03-04T06:53:11.083 INFO:tasks.rados.rados.0.smithi137.stdout:3401: expect (ObjNum 1047 snap 315 seq_num 1047) 2024-03-04T06:53:11.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:11.011+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:11.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:11.021+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:11.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:11.017+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:11.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:11.017+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:11.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:11.018+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:11.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:11.018+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:11.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:11.012+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:11.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:11.012+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:11.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:11.017+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:11.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:11.018+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:11.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:11.018+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:12.013 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:11.681+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:12.013 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:11.681+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:12.086 INFO:tasks.rados.rados.0.smithi137.stdout:3401: done (6 left) 2024-03-04T06:53:12.086 INFO:tasks.rados.rados.0.smithi137.stdout:3408: done (5 left) 2024-03-04T06:53:12.086 INFO:tasks.rados.rados.0.smithi137.stdout:3410: done (4 left) 2024-03-04T06:53:12.086 INFO:tasks.rados.rados.0.smithi137.stdout:3411: done (3 left) 2024-03-04T06:53:12.086 INFO:tasks.rados.rados.0.smithi137.stdout:3412: done (2 left) 2024-03-04T06:53:12.086 INFO:tasks.rados.rados.0.smithi137.stdout:3414: done (1 left) 2024-03-04T06:53:12.086 INFO:tasks.rados.rados.0.smithi137.stdout:3416: done (0 left) 2024-03-04T06:53:12.086 INFO:tasks.rados.rados.0.smithi137.stdout:3417: rollback oid 42 current snap is 321 2024-03-04T06:53:12.086 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 42 to 301 2024-03-04T06:53:12.086 INFO:tasks.rados.rados.0.smithi137.stdout:3418: read oid 27 snap -1 2024-03-04T06:53:12.086 INFO:tasks.rados.rados.0.smithi137.stdout:3418: expect (ObjNum 1051 snap 315 seq_num 1051) 2024-03-04T06:53:12.086 INFO:tasks.rados.rados.0.smithi137.stdout:3419: rollback oid 19 current snap is 321 2024-03-04T06:53:12.087 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 19 to 306 2024-03-04T06:53:12.087 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 321 2024-03-04T06:53:12.087 INFO:tasks.rados.rados.0.smithi137.stdout:3420: seq_num 1074 ranges {1179648=794624,1974272=401408} 2024-03-04T06:53:12.096 INFO:tasks.rados.rados.0.smithi137.stdout:3420: writing smithi13777483-49 from 1179648 to 1974272 tid 1 2024-03-04T06:53:12.099 INFO:tasks.rados.rados.0.smithi137.stdout:3420: writing smithi13777483-49 from 1974272 to 2375680 tid 2 2024-03-04T06:53:12.099 INFO:tasks.rados.rados.0.smithi137.stdout:3421: read oid 43 snap -1 2024-03-04T06:53:12.099 INFO:tasks.rados.rados.0.smithi137.stdout:3421: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:53:12.099 INFO:tasks.rados.rados.0.smithi137.stdout:3422: snap_create 2024-03-04T06:53:12.099 INFO:tasks.rados.rados.0.smithi137.stdout:3417: finishing rollback tid 1 to smithi13777483-42 2024-03-04T06:53:12.099 INFO:tasks.rados.rados.0.smithi137.stdout:3417: finishing rollback tid 2 to smithi13777483-42 2024-03-04T06:53:12.099 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16962 (ObjNum 822 snap 236 seq_num 822) dirty exists 2024-03-04T06:53:12.099 INFO:tasks.rados.rados.0.smithi137.stdout:3419: finishing rollback tid 0 to smithi13777483-19 2024-03-04T06:53:12.099 INFO:tasks.rados.rados.0.smithi137.stdout:3419: finishing rollback tid 1 to smithi13777483-19 2024-03-04T06:53:12.100 INFO:tasks.rados.rados.0.smithi137.stdout:3419: finishing rollback tid 2 to smithi13777483-19 2024-03-04T06:53:12.100 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 16958 (ObjNum 931 snap 275 seq_num 931) dirty exists 2024-03-04T06:53:12.105 INFO:tasks.rados.rados.0.smithi137.stdout:3420: finishing write tid 1 to smithi13777483-49 2024-03-04T06:53:12.105 INFO:tasks.rados.rados.0.smithi137.stdout:3420: finishing write tid 2 to smithi13777483-49 2024-03-04T06:53:12.105 INFO:tasks.rados.rados.0.smithi137.stdout:3420: finishing write tid 3 to smithi13777483-49 2024-03-04T06:53:12.108 INFO:tasks.rados.rados.0.smithi137.stdout:3420: finishing write tid 4 to smithi13777483-49 2024-03-04T06:53:12.108 INFO:tasks.rados.rados.0.smithi137.stdout:3420: oid 49 updating version 0 to 16941 2024-03-04T06:53:12.108 INFO:tasks.rados.rados.0.smithi137.stdout:3420: oid 49 version 16941 is already newer than 16940 2024-03-04T06:53:12.108 INFO:tasks.rados.rados.0.smithi137.stdout:3420: oid 49 updating version 16941 to 16942 2024-03-04T06:53:12.108 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16942 (ObjNum 1074 snap 321 seq_num 1074) dirty exists 2024-03-04T06:53:12.108 INFO:tasks.rados.rados.0.smithi137.stdout:3420: left oid 49 (ObjNum 1074 snap 321 seq_num 1074) 2024-03-04T06:53:12.114 INFO:tasks.rados.rados.0.smithi137.stdout:3421: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:53:12.235 INFO:tasks.rados.rados.0.smithi137.stdout:3418: expect (ObjNum 1051 snap 315 seq_num 1051) 2024-03-04T06:53:12.292 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:12.014+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:12.292 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:12.015+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:12.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:12.043+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:12.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:12.043+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:12.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[88869]: pgmap v745: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 671 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-03-04T06:53:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[88869]: osdmap e709: 8 total, 8 up, 8 in 2024-03-04T06:53:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:12.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:12.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[91314]: pgmap v745: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 671 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-03-04T06:53:12.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:12.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:12.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[91314]: osdmap e709: 8 total, 8 up, 8 in 2024-03-04T06:53:12.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:12.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:12.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:12.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:12.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:12.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:12.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:12.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:12.044+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:12.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:12.044+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:12.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:12.044+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:12.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:12.045+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:12.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:12.012+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:12.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:12.012+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:12.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:12.012+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-mon[85573]: pgmap v745: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 671 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-03-04T06:53:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-mon[85573]: osdmap e709: 8 total, 8 up, 8 in 2024-03-04T06:53:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:13.032 INFO:tasks.rados.rados.0.smithi137.stdout:3417: done (5 left) 2024-03-04T06:53:13.032 INFO:tasks.rados.rados.0.smithi137.stdout:3418: done (4 left) 2024-03-04T06:53:13.032 INFO:tasks.rados.rados.0.smithi137.stdout:3419: done (3 left) 2024-03-04T06:53:13.033 INFO:tasks.rados.rados.0.smithi137.stdout:3420: done (2 left) 2024-03-04T06:53:13.033 INFO:tasks.rados.rados.0.smithi137.stdout:3421: done (1 left) 2024-03-04T06:53:13.033 INFO:tasks.rados.rados.0.smithi137.stdout:3422: done (0 left) 2024-03-04T06:53:13.033 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 322 2024-03-04T06:53:13.033 INFO:tasks.rados.rados.0.smithi137.stdout:3423: seq_num 1075 ranges {9519104=409600,9928704=671744,10600448=131072} 2024-03-04T06:53:13.084 INFO:tasks.rados.rados.0.smithi137.stdout:3423: writing smithi13777483-19 from 9519104 to 9928704 tid 1 2024-03-04T06:53:13.088 INFO:tasks.rados.rados.0.smithi137.stdout:3423: writing smithi13777483-19 from 9928704 to 10600448 tid 2 2024-03-04T06:53:13.090 INFO:tasks.rados.rados.0.smithi137.stdout:3423: writing smithi13777483-19 from 10600448 to 10731520 tid 3 2024-03-04T06:53:13.090 INFO:tasks.rados.rados.0.smithi137.stdout:3424: read oid 12 snap -1 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3424: expect (ObjNum 1029 snap 306 seq_num 1029) 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3425: copy_from oid 47 from oid 5 current snap is 322 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3423: finishing write tid 1 to smithi13777483-19 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3426: read oid 23 snap -1 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3426: expect (ObjNum 1067 snap 320 seq_num 1067) 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3427: copy_from oid 37 from oid 34 current snap is 322 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3428: rmattr oid 41 current snap is 322 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3428: done (5 left) 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3429: read oid 49 snap -1 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3429: expect (ObjNum 1074 snap 321 seq_num 1074) 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3430: read oid 2 snap -1 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3430: expect (ObjNum 1063 snap 319 seq_num 1063) 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3431: rollback oid 38 current snap is 322 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 38 to 321 2024-03-04T06:53:13.091 INFO:tasks.rados.rados.0.smithi137.stdout:3432: rmattr oid 26 current snap is 322 2024-03-04T06:53:13.092 INFO:tasks.rados.rados.0.smithi137.stdout:3433: read oid 42 snap -1 2024-03-04T06:53:13.092 INFO:tasks.rados.rados.0.smithi137.stdout:3433: expect (ObjNum 822 snap 236 seq_num 822) 2024-03-04T06:53:13.092 INFO:tasks.rados.rados.0.smithi137.stdout:3434: copy_from oid 29 from oid 8 current snap is 322 2024-03-04T06:53:13.092 INFO:tasks.rados.rados.0.smithi137.stdout:3435: snap_create 2024-03-04T06:53:13.095 INFO:tasks.rados.rados.0.smithi137.stdout:3431: finishing rollback tid 1 to smithi13777483-38 2024-03-04T06:53:13.095 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16902 (ObjNum 33 snap 0 seq_num 3130698080) dirty dne 2024-03-04T06:53:13.096 INFO:tasks.rados.rados.0.smithi137.stdout:3425: finishing copy_from to smithi13777483-47 2024-03-04T06:53:13.096 INFO:tasks.rados.rados.0.smithi137.stdout:3425: got expected ENOENT (src dne) 2024-03-04T06:53:13.097 INFO:tasks.rados.rados.0.smithi137.stdout:3425: finishing copy_from racing read to smithi13777483-47 2024-03-04T06:53:13.101 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16909 (ObjNum 957 snap 282 seq_num 957) dirty exists 2024-03-04T06:53:13.105 INFO:tasks.rados.rados.0.smithi137.stdout:3430: expect (ObjNum 1063 snap 319 seq_num 1063) 2024-03-04T06:53:13.138 INFO:tasks.rados.rados.0.smithi137.stdout:3424: expect (ObjNum 1029 snap 306 seq_num 1029) 2024-03-04T06:53:13.172 INFO:tasks.rados.rados.0.smithi137.stdout:3427: finishing copy_from racing read to smithi13777483-37 2024-03-04T06:53:13.172 INFO:tasks.rados.rados.0.smithi137.stdout:3427: finishing copy_from to smithi13777483-37 2024-03-04T06:53:13.172 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16908 (ObjNum 1029 snap 306 seq_num 1029) dirty exists 2024-03-04T06:53:13.173 INFO:tasks.rados.rados.0.smithi137.stdout:3423: finishing write tid 2 to smithi13777483-19 2024-03-04T06:53:13.173 INFO:tasks.rados.rados.0.smithi137.stdout:3423: finishing write tid 3 to smithi13777483-19 2024-03-04T06:53:13.173 INFO:tasks.rados.rados.0.smithi137.stdout:3423: finishing write tid 4 to smithi13777483-19 2024-03-04T06:53:13.173 INFO:tasks.rados.rados.0.smithi137.stdout:3426: expect (ObjNum 1067 snap 320 seq_num 1067) 2024-03-04T06:53:13.262 INFO:tasks.rados.rados.0.smithi137.stdout:3433: expect (ObjNum 822 snap 236 seq_num 822) 2024-03-04T06:53:13.292 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:13.032+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:13.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:13.096+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:13.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:13.088+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:13.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:13.088+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:13.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:13.088+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[91314]: osdmap e710: 8 total, 8 up, 8 in 2024-03-04T06:53:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:13.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:13.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:13.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:13.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:13.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:13.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:13.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:13.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[88869]: osdmap e710: 8 total, 8 up, 8 in 2024-03-04T06:53:13.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:13.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:13.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:13.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:13.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:13.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:13.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:13.096+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:13.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:13.096+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:13.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:13.029+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:13.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:13.101+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:13.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:13.101+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:13.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:13.095+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:13.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:13.096+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:13.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:13.101+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:13.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:13.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:13.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:13.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:13.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:13.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-mon[85573]: osdmap e710: 8 total, 8 up, 8 in 2024-03-04T06:53:13.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:13.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:13.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:13.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:13.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:13.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:13.366 INFO:tasks.rados.rados.0.smithi137.stdout:3423: finishing write tid 5 to smithi13777483-19 2024-03-04T06:53:13.366 INFO:tasks.rados.rados.0.smithi137.stdout:3423: oid 19 updating version 0 to 16962 2024-03-04T06:53:13.366 INFO:tasks.rados.rados.0.smithi137.stdout:3423: oid 19 version 16962 is already newer than 16961 2024-03-04T06:53:13.367 INFO:tasks.rados.rados.0.smithi137.stdout:3423: oid 19 version 16962 is already newer than 16960 2024-03-04T06:53:13.367 INFO:tasks.rados.rados.0.smithi137.stdout:3423: oid 19 version 16962 is already newer than 16959 2024-03-04T06:53:13.367 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 16962 (ObjNum 1075 snap 322 seq_num 1075) dirty exists 2024-03-04T06:53:13.367 INFO:tasks.rados.rados.0.smithi137.stdout:3423: left oid 19 (ObjNum 1075 snap 322 seq_num 1075) 2024-03-04T06:53:13.367 INFO:tasks.rados.rados.0.smithi137.stdout:3429: expect (ObjNum 1074 snap 321 seq_num 1074) 2024-03-04T06:53:13.444 INFO:tasks.rados.rados.0.smithi137.stdout:3434: finishing copy_from racing read to smithi13777483-29 2024-03-04T06:53:13.445 INFO:tasks.rados.rados.0.smithi137.stdout:3434: finishing copy_from to smithi13777483-29 2024-03-04T06:53:13.445 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16950 (ObjNum 959 snap 282 seq_num 959) dirty exists 2024-03-04T06:53:14.036 INFO:tasks.rados.rados.0.smithi137.stdout:3423: done (11 left) 2024-03-04T06:53:14.037 INFO:tasks.rados.rados.0.smithi137.stdout:3424: done (10 left) 2024-03-04T06:53:14.037 INFO:tasks.rados.rados.0.smithi137.stdout:3425: done (9 left) 2024-03-04T06:53:14.037 INFO:tasks.rados.rados.0.smithi137.stdout:3426: done (8 left) 2024-03-04T06:53:14.037 INFO:tasks.rados.rados.0.smithi137.stdout:3427: done (7 left) 2024-03-04T06:53:14.037 INFO:tasks.rados.rados.0.smithi137.stdout:3429: done (6 left) 2024-03-04T06:53:14.037 INFO:tasks.rados.rados.0.smithi137.stdout:3430: done (5 left) 2024-03-04T06:53:14.037 INFO:tasks.rados.rados.0.smithi137.stdout:3431: done (4 left) 2024-03-04T06:53:14.037 INFO:tasks.rados.rados.0.smithi137.stdout:3432: done (3 left) 2024-03-04T06:53:14.037 INFO:tasks.rados.rados.0.smithi137.stdout:3433: done (2 left) 2024-03-04T06:53:14.037 INFO:tasks.rados.rados.0.smithi137.stdout:3434: done (1 left) 2024-03-04T06:53:14.037 INFO:tasks.rados.rados.0.smithi137.stdout:3435: done (0 left) 2024-03-04T06:53:14.037 INFO:tasks.rados.rados.0.smithi137.stdout:3436: setattr oid 45 current snap is 323 2024-03-04T06:53:14.038 INFO:tasks.rados.rados.0.smithi137.stdout:3437: copy_from oid 23 from oid 3 current snap is 323 2024-03-04T06:53:14.038 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 323 2024-03-04T06:53:14.038 INFO:tasks.rados.rados.0.smithi137.stdout:3438: seq_num 1076 ranges {2080768=425984,2506752=548864,3055616=253952} 2024-03-04T06:53:14.052 INFO:tasks.rados.rados.0.smithi137.stdout:3438: writing smithi13777483-26 from 2080768 to 2506752 tid 1 2024-03-04T06:53:14.055 INFO:tasks.rados.rados.0.smithi137.stdout:3438: writing smithi13777483-26 from 2506752 to 3055616 tid 2 2024-03-04T06:53:14.057 INFO:tasks.rados.rados.0.smithi137.stdout:3438: writing smithi13777483-26 from 3055616 to 3309568 tid 3 2024-03-04T06:53:14.057 INFO:tasks.rados.rados.0.smithi137.stdout:3439: snap_create 2024-03-04T06:53:14.057 INFO:tasks.rados.rados.0.smithi137.stdout:3437: finishing copy_from to smithi13777483-23 2024-03-04T06:53:14.057 INFO:tasks.rados.rados.0.smithi137.stdout:3437: got expected ENOENT (src dne) 2024-03-04T06:53:14.057 INFO:tasks.rados.rados.0.smithi137.stdout:3437: finishing copy_from racing read to smithi13777483-23 2024-03-04T06:53:14.058 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16960 (ObjNum 977 snap 285 seq_num 977) dirty exists 2024-03-04T06:53:14.058 INFO:tasks.rados.rados.0.smithi137.stdout:3438: finishing write tid 1 to smithi13777483-26 2024-03-04T06:53:14.060 INFO:tasks.rados.rados.0.smithi137.stdout:3438: finishing write tid 2 to smithi13777483-26 2024-03-04T06:53:14.060 INFO:tasks.rados.rados.0.smithi137.stdout:3438: finishing write tid 3 to smithi13777483-26 2024-03-04T06:53:14.060 INFO:tasks.rados.rados.0.smithi137.stdout:3438: finishing write tid 4 to smithi13777483-26 2024-03-04T06:53:14.061 INFO:tasks.rados.rados.0.smithi137.stdout:3438: finishing write tid 5 to smithi13777483-26 2024-03-04T06:53:14.062 INFO:tasks.rados.rados.0.smithi137.stdout:3438: oid 26 updating version 0 to 16952 2024-03-04T06:53:14.062 INFO:tasks.rados.rados.0.smithi137.stdout:3438: oid 26 updating version 16952 to 16953 2024-03-04T06:53:14.062 INFO:tasks.rados.rados.0.smithi137.stdout:3438: oid 26 version 16953 is already newer than 16951 2024-03-04T06:53:14.062 INFO:tasks.rados.rados.0.smithi137.stdout:3438: oid 26 updating version 16953 to 16954 2024-03-04T06:53:14.062 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16954 (ObjNum 1076 snap 323 seq_num 1076) dirty exists 2024-03-04T06:53:14.062 INFO:tasks.rados.rados.0.smithi137.stdout:3438: left oid 26 (ObjNum 1076 snap 323 seq_num 1076) 2024-03-04T06:53:14.296 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:14.040+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:14.296 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:14.231+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:14.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[88869]: pgmap v748: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 671 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-03-04T06:53:14.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:14.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[88869]: osdmap e711: 8 total, 8 up, 8 in 2024-03-04T06:53:14.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:14.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:14.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:14.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:14.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:14.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:14.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:14.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[91314]: pgmap v748: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 671 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-03-04T06:53:14.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:14.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[91314]: osdmap e711: 8 total, 8 up, 8 in 2024-03-04T06:53:14.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:14.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:14.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:14.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:14.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:14.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:14.298 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:14.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:14.036+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:14.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:14.042+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:14.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:14.043+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:14.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:14.045+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:14.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-mon[85573]: pgmap v748: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 671 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-03-04T06:53:14.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:14.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-mon[85573]: osdmap e711: 8 total, 8 up, 8 in 2024-03-04T06:53:14.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:14.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:14.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:14.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:14.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:14.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:14.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:14.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:14.425+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:14.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:14.425+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:14.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:14.428+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:14.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:14.428+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:14.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:14.428+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:15.046 INFO:tasks.rados.rados.0.smithi137.stdout:3436: done (3 left) 2024-03-04T06:53:15.046 INFO:tasks.rados.rados.0.smithi137.stdout:3437: done (2 left) 2024-03-04T06:53:15.046 INFO:tasks.rados.rados.0.smithi137.stdout:3438: done (1 left) 2024-03-04T06:53:15.046 INFO:tasks.rados.rados.0.smithi137.stdout:3439: done (0 left) 2024-03-04T06:53:15.046 INFO:tasks.rados.rados.0.smithi137.stdout:3440: copy_from oid 47 from oid 22 current snap is 324 2024-03-04T06:53:15.046 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 49 current snap is 324 2024-03-04T06:53:15.046 INFO:tasks.rados.rados.0.smithi137.stdout:3441: seq_num 1077 ranges {2375680=442368,2818048=434176,3252224=368640} 2024-03-04T06:53:15.062 INFO:tasks.rados.rados.0.smithi137.stdout:3441: writing smithi13777483-49 from 2375680 to 2818048 tid 1 2024-03-04T06:53:15.065 INFO:tasks.rados.rados.0.smithi137.stdout:3441: writing smithi13777483-49 from 2818048 to 3252224 tid 2 2024-03-04T06:53:15.067 INFO:tasks.rados.rados.0.smithi137.stdout:3441: writing smithi13777483-49 from 3252224 to 3620864 tid 3 2024-03-04T06:53:15.067 INFO:tasks.rados.rados.0.smithi137.stdout:3442: snap_remove snap 322 2024-03-04T06:53:15.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:15.049+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:15.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:15.043+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[91314]: osdmap e712: 8 total, 8 up, 8 in 2024-03-04T06:53:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:15.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:15.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:15.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:15.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:15.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:15.069+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:15.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:15.070+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:15.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:15.070+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:15.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:15.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:15.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[88869]: osdmap e712: 8 total, 8 up, 8 in 2024-03-04T06:53:15.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:15.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:15.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:15.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:15.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:15.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:15.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:15.297 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:15.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:15.043+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:15.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:15.043+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:15.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:15.053+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:15.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:15.069+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:15.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:15.070+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:15.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:15.066+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:15.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:15.066+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:15.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:15.068+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:15.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:15.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:15.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-mon[85573]: osdmap e712: 8 total, 8 up, 8 in 2024-03-04T06:53:15.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:15.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:15.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:15.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:15.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:15.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:15.349 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:15.349 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:15.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:53:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:53:15] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:53:16.052 INFO:tasks.rados.rados.0.smithi137.stdout:3442: done (2 left) 2024-03-04T06:53:16.052 INFO:tasks.rados.rados.0.smithi137.stdout:3443: rmattr oid 16 current snap is 324 2024-03-04T06:53:16.052 INFO:tasks.rados.rados.0.smithi137.stdout:3443: done (2 left) 2024-03-04T06:53:16.052 INFO:tasks.rados.rados.0.smithi137.stdout:3444: delete oid 33 current snap is 324 2024-03-04T06:53:16.052 INFO:tasks.rados.rados.0.smithi137.stdout:3441: finishing write tid 1 to smithi13777483-49 2024-03-04T06:53:16.052 INFO:tasks.rados.rados.0.smithi137.stdout:3441: finishing write tid 2 to smithi13777483-49 2024-03-04T06:53:16.052 INFO:tasks.rados.rados.0.smithi137.stdout:3441: finishing write tid 3 to smithi13777483-49 2024-03-04T06:53:16.052 INFO:tasks.rados.rados.0.smithi137.stdout:3440: finishing copy_from racing read to smithi13777483-47 2024-03-04T06:53:16.052 INFO:tasks.rados.rados.0.smithi137.stdout:3441: finishing write tid 4 to smithi13777483-49 2024-03-04T06:53:16.052 INFO:tasks.rados.rados.0.smithi137.stdout:3441: finishing write tid 5 to smithi13777483-49 2024-03-04T06:53:16.052 INFO:tasks.rados.rados.0.smithi137.stdout:3441: oid 49 updating version 0 to 16945 2024-03-04T06:53:16.053 INFO:tasks.rados.rados.0.smithi137.stdout:3441: oid 49 version 16945 is already newer than 16943 2024-03-04T06:53:16.053 INFO:tasks.rados.rados.0.smithi137.stdout:3441: oid 49 updating version 16945 to 16946 2024-03-04T06:53:16.053 INFO:tasks.rados.rados.0.smithi137.stdout:3441: oid 49 version 16946 is already newer than 16944 2024-03-04T06:53:16.053 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16946 (ObjNum 1077 snap 324 seq_num 1077) dirty exists 2024-03-04T06:53:16.053 INFO:tasks.rados.rados.0.smithi137.stdout:3441: left oid 49 (ObjNum 1077 snap 324 seq_num 1077) 2024-03-04T06:53:16.053 INFO:tasks.rados.rados.0.smithi137.stdout:3440: finishing copy_from to smithi13777483-47 2024-03-04T06:53:16.053 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16936 (ObjNum 959 snap 282 seq_num 959) dirty exists 2024-03-04T06:53:16.059 INFO:tasks.rados.rados.0.smithi137.stdout:3440: done (2 left) 2024-03-04T06:53:16.059 INFO:tasks.rados.rados.0.smithi137.stdout:3441: done (1 left) 2024-03-04T06:53:16.059 INFO:tasks.rados.rados.0.smithi137.stdout:3444: done (0 left) 2024-03-04T06:53:16.059 INFO:tasks.rados.rados.0.smithi137.stdout:3445: rollback oid 27 current snap is 324 2024-03-04T06:53:16.059 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 27 to 294 2024-03-04T06:53:16.059 INFO:tasks.rados.rados.0.smithi137.stdout:3446: snap_remove snap 323 2024-03-04T06:53:16.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:16.059+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:16.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:16.050+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:16.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[88869]: pgmap v751: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 684 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 31 MiB/s rd, 2.5 MiB/s wr, 23 op/s 2024-03-04T06:53:16.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:16.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:16.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[88869]: osdmap e713: 8 total, 8 up, 8 in 2024-03-04T06:53:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:16.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:16.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[91314]: pgmap v751: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 684 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 31 MiB/s rd, 2.5 MiB/s wr, 23 op/s 2024-03-04T06:53:16.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:16.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:16.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:16.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:16.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:16.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[91314]: osdmap e713: 8 total, 8 up, 8 in 2024-03-04T06:53:16.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:16.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:16.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:16.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:16.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:16.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:16.056+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:16.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:16.059+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:16.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:16.058+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:16.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:16.059+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:16.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:16.052+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:16.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:16.052+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:16.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:16.052+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:16.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-mon[85573]: pgmap v751: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 684 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 31 MiB/s rd, 2.5 MiB/s wr, 23 op/s 2024-03-04T06:53:16.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:16.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:16.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:16.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:16.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:16.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-mon[85573]: osdmap e713: 8 total, 8 up, 8 in 2024-03-04T06:53:16.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:16.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:16.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:16.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:16.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:16.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:16.498+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:16.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:16.499+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:17.058 INFO:tasks.rados.rados.0.smithi137.stdout:3446: done (1 left) 2024-03-04T06:53:17.058 INFO:tasks.rados.rados.0.smithi137.stdout:3447: snap_remove snap 311 2024-03-04T06:53:17.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:17.061+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:17.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:17.272+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:17.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:17.272+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:17.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:17.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:17.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:17.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-mon[85573]: osdmap e714: 8 total, 8 up, 8 in 2024-03-04T06:53:17.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:17.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:17.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:17.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:17.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:17.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:17.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:17.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:17.057+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:17.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:17.057+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:17.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:17.057+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:17.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:17.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:17.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:17.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[88869]: osdmap e714: 8 total, 8 up, 8 in 2024-03-04T06:53:17.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:17.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:17.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:17.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:17.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:17.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:17.474 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:17.475 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:17.475 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:17.475 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:17.475 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[91314]: osdmap e714: 8 total, 8 up, 8 in 2024-03-04T06:53:17.475 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:17.475 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:17.475 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:17.475 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:17.475 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:17.475 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:17.475 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:17.476 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:17.057+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:17.476 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:17.060+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:17.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:17.473+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:17.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:17.473+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:17.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:17.473+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:17.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:17.421+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:17.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:17.421+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:18.060 INFO:tasks.rados.rados.0.smithi137.stdout:3447: done (1 left) 2024-03-04T06:53:18.060 INFO:tasks.rados.rados.0.smithi137.stdout:3448: setattr oid 11 current snap is 324 2024-03-04T06:53:18.061 INFO:tasks.rados.rados.0.smithi137.stdout:3445: finishing rollback tid 0 to smithi13777483-27 2024-03-04T06:53:18.061 INFO:tasks.rados.rados.0.smithi137.stdout:3445: finishing rollback tid 1 to smithi13777483-27 2024-03-04T06:53:18.062 INFO:tasks.rados.rados.0.smithi137.stdout:3445: finishing rollback tid 2 to smithi13777483-27 2024-03-04T06:53:18.062 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16965 (ObjNum 798 snap 231 seq_num 798) dirty exists 2024-03-04T06:53:18.062 INFO:tasks.rados.rados.0.smithi137.stdout:3445: done (1 left) 2024-03-04T06:53:18.063 INFO:tasks.rados.rados.0.smithi137.stdout:3449: delete oid 34 current snap is 324 2024-03-04T06:53:18.070 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16951 (ObjNum 1013 snap 302 seq_num 1013) dirty exists 2024-03-04T06:53:18.074 INFO:tasks.rados.rados.0.smithi137.stdout:3448: done (1 left) 2024-03-04T06:53:18.074 INFO:tasks.rados.rados.0.smithi137.stdout:3449: done (0 left) 2024-03-04T06:53:18.074 INFO:tasks.rados.rados.0.smithi137.stdout:3450: read oid 23 snap -1 2024-03-04T06:53:18.074 INFO:tasks.rados.rados.0.smithi137.stdout:3450: expect (ObjNum 1067 snap 320 seq_num 1067) 2024-03-04T06:53:18.074 INFO:tasks.rados.rados.0.smithi137.stdout:3451: rollback oid 39 current snap is 324 2024-03-04T06:53:18.074 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 39 to 319 2024-03-04T06:53:18.075 INFO:tasks.rados.rados.0.smithi137.stdout:3452: read oid 29 snap -1 2024-03-04T06:53:18.075 INFO:tasks.rados.rados.0.smithi137.stdout:3452: expect (ObjNum 959 snap 282 seq_num 959) 2024-03-04T06:53:18.075 INFO:tasks.rados.rados.0.smithi137.stdout:3453: copy_from oid 17 from oid 19 current snap is 324 2024-03-04T06:53:18.075 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 324 2024-03-04T06:53:18.075 INFO:tasks.rados.rados.0.smithi137.stdout:3454: seq_num 1080 ranges {11911168=491520,12402688=540672,12943360=262144} 2024-03-04T06:53:18.142 INFO:tasks.rados.rados.0.smithi137.stdout:3454: writing smithi13777483-18 from 11911168 to 12402688 tid 1 2024-03-04T06:53:18.145 INFO:tasks.rados.rados.0.smithi137.stdout:3454: writing smithi13777483-18 from 12402688 to 12943360 tid 2 2024-03-04T06:53:18.147 INFO:tasks.rados.rados.0.smithi137.stdout:3454: writing smithi13777483-18 from 12943360 to 13205504 tid 3 2024-03-04T06:53:18.147 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 324 2024-03-04T06:53:18.147 INFO:tasks.rados.rados.0.smithi137.stdout:3455: seq_num 1081 ranges {5152768=507904,5660672=425984,6086656=376832} 2024-03-04T06:53:18.177 INFO:tasks.rados.rados.0.smithi137.stdout:3455: writing smithi13777483-8 from 5152768 to 5660672 tid 1 2024-03-04T06:53:18.179 INFO:tasks.rados.rados.0.smithi137.stdout:3455: writing smithi13777483-8 from 5660672 to 6086656 tid 2 2024-03-04T06:53:18.182 INFO:tasks.rados.rados.0.smithi137.stdout:3455: writing smithi13777483-8 from 6086656 to 6463488 tid 3 2024-03-04T06:53:18.182 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 324 2024-03-04T06:53:18.182 INFO:tasks.rados.rados.0.smithi137.stdout:3451: finishing rollback tid 1 to smithi13777483-39 2024-03-04T06:53:18.183 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 16883 (ObjNum 289 snap 0 seq_num 1) dirty dne 2024-03-04T06:53:18.183 INFO:tasks.rados.rados.0.smithi137.stdout:3450: expect (ObjNum 1067 snap 320 seq_num 1067) 2024-03-04T06:53:18.271 INFO:tasks.rados.rados.0.smithi137.stdout:3452: expect (ObjNum 959 snap 282 seq_num 959) 2024-03-04T06:53:18.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:18.057+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:18.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:18.070+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:18.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:18.073+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:18.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:18.073+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:18.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:18.061+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:18.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:18.061+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:18.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:18.061+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:18.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:18.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:18.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-mon[85573]: pgmap v754: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 686 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 32 MiB/s rd, 3.1 MiB/s wr, 37 op/s 2024-03-04T06:53:18.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:18.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-mon[85573]: osdmap e715: 8 total, 8 up, 8 in 2024-03-04T06:53:18.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:18.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:18.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:18.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:18.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:18.522 INFO:tasks.rados.rados.0.smithi137.stdout:3453: finishing copy_from racing read to smithi13777483-17 2024-03-04T06:53:18.522 INFO:tasks.rados.rados.0.smithi137.stdout:3453: finishing copy_from to smithi13777483-17 2024-03-04T06:53:18.522 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16962 (ObjNum 1075 snap 322 seq_num 1075) dirty exists 2024-03-04T06:53:18.522 INFO:tasks.rados.rados.0.smithi137.stdout:3454: finishing write tid 1 to smithi13777483-18 2024-03-04T06:53:18.522 INFO:tasks.rados.rados.0.smithi137.stdout:3454: finishing write tid 2 to smithi13777483-18 2024-03-04T06:53:18.522 INFO:tasks.rados.rados.0.smithi137.stdout:3454: finishing write tid 3 to smithi13777483-18 2024-03-04T06:53:18.523 INFO:tasks.rados.rados.0.smithi137.stdout:3454: finishing write tid 4 to smithi13777483-18 2024-03-04T06:53:18.523 INFO:tasks.rados.rados.0.smithi137.stdout:3454: finishing write tid 5 to smithi13777483-18 2024-03-04T06:53:18.523 INFO:tasks.rados.rados.0.smithi137.stdout:3454: oid 18 updating version 0 to 16955 2024-03-04T06:53:18.523 INFO:tasks.rados.rados.0.smithi137.stdout:3454: oid 18 updating version 16955 to 16957 2024-03-04T06:53:18.523 INFO:tasks.rados.rados.0.smithi137.stdout:3454: oid 18 version 16957 is already newer than 16956 2024-03-04T06:53:18.523 INFO:tasks.rados.rados.0.smithi137.stdout:3454: oid 18 updating version 16957 to 16958 2024-03-04T06:53:18.523 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16958 (ObjNum 1080 snap 324 seq_num 1080) dirty exists 2024-03-04T06:53:18.523 INFO:tasks.rados.rados.0.smithi137.stdout:3454: left oid 18 (ObjNum 1080 snap 324 seq_num 1080) 2024-03-04T06:53:18.523 INFO:tasks.rados.rados.0.smithi137.stdout:3455: finishing write tid 1 to smithi13777483-8 2024-03-04T06:53:18.523 INFO:tasks.rados.rados.0.smithi137.stdout:3455: finishing write tid 2 to smithi13777483-8 2024-03-04T06:53:18.523 INFO:tasks.rados.rados.0.smithi137.stdout:3456: seq_num 1082 ranges {0=524288,524288=704512,1228800=98304} 2024-03-04T06:53:18.525 INFO:tasks.rados.rados.0.smithi137.stdout:3456: writing smithi13777483-20 from 0 to 524288 tid 1 2024-03-04T06:53:18.529 INFO:tasks.rados.rados.0.smithi137.stdout:3456: writing smithi13777483-20 from 524288 to 1228800 tid 2 2024-03-04T06:53:18.530 INFO:tasks.rados.rados.0.smithi137.stdout:3456: writing smithi13777483-20 from 1228800 to 1327104 tid 3 2024-03-04T06:53:18.530 INFO:tasks.rados.rados.0.smithi137.stdout:3450: done (6 left) 2024-03-04T06:53:18.530 INFO:tasks.rados.rados.0.smithi137.stdout:3451: done (5 left) 2024-03-04T06:53:18.530 INFO:tasks.rados.rados.0.smithi137.stdout:3452: done (4 left) 2024-03-04T06:53:18.530 INFO:tasks.rados.rados.0.smithi137.stdout:3453: done (3 left) 2024-03-04T06:53:18.530 INFO:tasks.rados.rados.0.smithi137.stdout:3454: done (2 left) 2024-03-04T06:53:18.531 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 37 current snap is 324 2024-03-04T06:53:18.531 INFO:tasks.rados.rados.0.smithi137.stdout:3455: finishing write tid 3 to smithi13777483-8 2024-03-04T06:53:18.531 INFO:tasks.rados.rados.0.smithi137.stdout:3455: finishing write tid 4 to smithi13777483-8 2024-03-04T06:53:18.531 INFO:tasks.rados.rados.0.smithi137.stdout:3455: finishing write tid 5 to smithi13777483-8 2024-03-04T06:53:18.531 INFO:tasks.rados.rados.0.smithi137.stdout:3455: oid 8 updating version 0 to 16952 2024-03-04T06:53:18.531 INFO:tasks.rados.rados.0.smithi137.stdout:3455: oid 8 updating version 16952 to 16954 2024-03-04T06:53:18.531 INFO:tasks.rados.rados.0.smithi137.stdout:3455: oid 8 updating version 16954 to 16955 2024-03-04T06:53:18.531 INFO:tasks.rados.rados.0.smithi137.stdout:3455: oid 8 version 16955 is already newer than 16953 2024-03-04T06:53:18.531 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16955 (ObjNum 1081 snap 324 seq_num 1081) dirty exists 2024-03-04T06:53:18.531 INFO:tasks.rados.rados.0.smithi137.stdout:3455: left oid 8 (ObjNum 1081 snap 324 seq_num 1081) 2024-03-04T06:53:18.531 INFO:tasks.rados.rados.0.smithi137.stdout:3456: finishing write tid 1 to smithi13777483-20 2024-03-04T06:53:18.531 INFO:tasks.rados.rados.0.smithi137.stdout:3457: seq_num 1083 ranges {884736=540672,1425408=589824,2015232=212992} 2024-03-04T06:53:18.537 INFO:tasks.rados.rados.0.smithi137.stdout:3457: writing smithi13777483-37 from 884736 to 1425408 tid 1 2024-03-04T06:53:18.540 INFO:tasks.rados.rados.0.smithi137.stdout:3457: writing smithi13777483-37 from 1425408 to 2015232 tid 2 2024-03-04T06:53:18.542 INFO:tasks.rados.rados.0.smithi137.stdout:3457: writing smithi13777483-37 from 2015232 to 2228224 tid 3 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:3455: done (2 left) 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:3458: read oid 17 snap -1 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:3458: expect (ObjNum 1075 snap 322 seq_num 1075) 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:3459: snap_create 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:3456: finishing write tid 2 to smithi13777483-20 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:3456: finishing write tid 3 to smithi13777483-20 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:3456: finishing write tid 4 to smithi13777483-20 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:3456: finishing write tid 5 to smithi13777483-20 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:3456: oid 20 updating version 0 to 16931 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:3456: oid 20 version 16931 is already newer than 16929 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:3456: oid 20 version 16931 is already newer than 16930 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:3456: oid 20 version 16931 is already newer than 16928 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16931 (ObjNum 1082 snap 324 seq_num 1082) dirty exists 2024-03-04T06:53:18.543 INFO:tasks.rados.rados.0.smithi137.stdout:3456: left oid 20 (ObjNum 1082 snap 324 seq_num 1082) 2024-03-04T06:53:18.544 INFO:tasks.rados.rados.0.smithi137.stdout:3457: finishing write tid 1 to smithi13777483-37 2024-03-04T06:53:18.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:18.070+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:18.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:18.068+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:18.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:18.072+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[91314]: pgmap v754: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 686 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 32 MiB/s rd, 3.1 MiB/s wr, 37 op/s 2024-03-04T06:53:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[91314]: osdmap e715: 8 total, 8 up, 8 in 2024-03-04T06:53:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:18.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:18.546 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:18.058+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:18.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:18.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:18.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[88869]: pgmap v754: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 686 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 32 MiB/s rd, 3.1 MiB/s wr, 37 op/s 2024-03-04T06:53:18.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:18.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[88869]: osdmap e715: 8 total, 8 up, 8 in 2024-03-04T06:53:18.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:18.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:18.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:18.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:18.547 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:18.548 INFO:tasks.rados.rados.0.smithi137.stdout:3457: finishing write tid 2 to smithi13777483-37 2024-03-04T06:53:18.548 INFO:tasks.rados.rados.0.smithi137.stdout:3457: finishing write tid 3 to smithi13777483-37 2024-03-04T06:53:18.549 INFO:tasks.rados.rados.0.smithi137.stdout:3457: finishing write tid 4 to smithi13777483-37 2024-03-04T06:53:18.551 INFO:tasks.rados.rados.0.smithi137.stdout:3457: finishing write tid 5 to smithi13777483-37 2024-03-04T06:53:18.551 INFO:tasks.rados.rados.0.smithi137.stdout:3457: oid 37 updating version 0 to 16948 2024-03-04T06:53:18.551 INFO:tasks.rados.rados.0.smithi137.stdout:3457: oid 37 version 16948 is already newer than 16947 2024-03-04T06:53:18.551 INFO:tasks.rados.rados.0.smithi137.stdout:3457: oid 37 updating version 16948 to 16949 2024-03-04T06:53:18.551 INFO:tasks.rados.rados.0.smithi137.stdout:3457: oid 37 version 16949 is already newer than 16946 2024-03-04T06:53:18.551 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16949 (ObjNum 1083 snap 324 seq_num 1083) dirty exists 2024-03-04T06:53:18.551 INFO:tasks.rados.rados.0.smithi137.stdout:3457: left oid 37 (ObjNum 1083 snap 324 seq_num 1083) 2024-03-04T06:53:18.592 INFO:tasks.rados.rados.0.smithi137.stdout:3458: expect (ObjNum 1075 snap 322 seq_num 1075) 2024-03-04T06:53:19.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:19.071+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:19.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:19.071+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:19.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:19.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:19.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:19.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:19.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:19.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: osdmap e716: 8 total, 8 up, 8 in 2024-03-04T06:53:19.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:19.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:19.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:19.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:19.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:19.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:19.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:19.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:19.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:19.403 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:19.071+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:19.403 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:19.403 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:19.403 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:19.403 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:19.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:19.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: osdmap e716: 8 total, 8 up, 8 in 2024-03-04T06:53:19.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:19.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:19.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:19.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:19.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:19.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:19.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:19.405 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:19.405 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:19.405 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:19.405 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:19.405 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:19.405 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:19.405 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:19.405 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: osdmap e716: 8 total, 8 up, 8 in 2024-03-04T06:53:19.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:19.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:19.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:19.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:19.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:19.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:19.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:19.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:19.406 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:19.586 INFO:tasks.rados.rados.0.smithi137.stdout:3456: done (3 left) 2024-03-04T06:53:19.586 INFO:tasks.rados.rados.0.smithi137.stdout:3457: done (2 left) 2024-03-04T06:53:19.586 INFO:tasks.rados.rados.0.smithi137.stdout:3458: done (1 left) 2024-03-04T06:53:19.586 INFO:tasks.rados.rados.0.smithi137.stdout:3459: done (0 left) 2024-03-04T06:53:19.586 INFO:tasks.rados.rados.0.smithi137.stdout:3460: delete oid 8 current snap is 325 2024-03-04T06:53:19.589 INFO:tasks.rados.rados.0.smithi137.stdout:3460: done (0 left) 2024-03-04T06:53:19.589 INFO:tasks.rados.rados.0.smithi137.stdout:3461: snap_remove snap 312 2024-03-04T06:53:19.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:19.402+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:19.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:19.402+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:19.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:19.403+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:19.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:19.403+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:19.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:19.404+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:19.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:19.402+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:19.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:19.403+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:19.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:19.403+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:19.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:19.403+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:19.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:19.403+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:20.081 INFO:tasks.rados.rados.0.smithi137.stdout:3461: done (0 left) 2024-03-04T06:53:20.081 INFO:tasks.rados.rados.0.smithi137.stdout:3462: snap_remove snap 324 2024-03-04T06:53:20.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:20.085+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:20.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:20.086+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:20.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:20.086+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:20.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:20.081+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:20.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:20.082+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:20.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:20.082+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-mon[85573]: pgmap v757: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 694 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 7.8 MiB/s rd, 2.6 MiB/s wr, 20 op/s 2024-03-04T06:53:20.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-mon[85573]: osdmap e717: 8 total, 8 up, 8 in 2024-03-04T06:53:20.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:20.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:20.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:20.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:20.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:20.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:20.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:20.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:20.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:20.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:20.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:20.079+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:20.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:20.083+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:20.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:20.084+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:20.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:20.088+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[91314]: pgmap v757: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 694 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 7.8 MiB/s rd, 2.6 MiB/s wr, 20 op/s 2024-03-04T06:53:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[91314]: osdmap e717: 8 total, 8 up, 8 in 2024-03-04T06:53:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:20.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:20.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[88869]: pgmap v757: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 694 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 7.8 MiB/s rd, 2.6 MiB/s wr, 20 op/s 2024-03-04T06:53:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[88869]: osdmap e717: 8 total, 8 up, 8 in 2024-03-04T06:53:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:20.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:20.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:21.083 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:20.671+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:21.088 INFO:tasks.rados.rados.0.smithi137.stdout:3462: done (0 left) 2024-03-04T06:53:21.088 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 325 2024-03-04T06:53:21.088 INFO:tasks.rados.rados.0.smithi137.stdout:3463: seq_num 1085 ranges {942080=581632,1523712=761856,2285568=40960} 2024-03-04T06:53:21.096 INFO:tasks.rados.rados.0.smithi137.stdout:3463: writing smithi13777483-21 from 942080 to 1523712 tid 1 2024-03-04T06:53:21.100 INFO:tasks.rados.rados.0.smithi137.stdout:3463: writing smithi13777483-21 from 1523712 to 2285568 tid 2 2024-03-04T06:53:21.100 INFO:tasks.rados.rados.0.smithi137.stdout:3463: writing smithi13777483-21 from 2285568 to 2326528 tid 3 2024-03-04T06:53:21.101 INFO:tasks.rados.rados.0.smithi137.stdout:3464: setattr oid 11 current snap is 325 2024-03-04T06:53:21.102 INFO:tasks.rados.rados.0.smithi137.stdout:3465: read oid 22 snap -1 2024-03-04T06:53:21.102 INFO:tasks.rados.rados.0.smithi137.stdout:3465: expect (ObjNum 959 snap 282 seq_num 959) 2024-03-04T06:53:21.102 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 325 2024-03-04T06:53:21.102 INFO:tasks.rados.rados.0.smithi137.stdout:3466: seq_num 1086 ranges {7561216=598016,8159232=647168,8806400=155648} 2024-03-04T06:53:21.147 INFO:tasks.rados.rados.0.smithi137.stdout:3466: writing smithi13777483-45 from 7561216 to 8159232 tid 1 2024-03-04T06:53:21.150 INFO:tasks.rados.rados.0.smithi137.stdout:3466: writing smithi13777483-45 from 8159232 to 8806400 tid 2 2024-03-04T06:53:21.151 INFO:tasks.rados.rados.0.smithi137.stdout:3466: writing smithi13777483-45 from 8806400 to 8962048 tid 3 2024-03-04T06:53:21.151 INFO:tasks.rados.rados.0.smithi137.stdout:3467: rmattr oid 8 current snap is 325 2024-03-04T06:53:21.151 INFO:tasks.rados.rados.0.smithi137.stdout:3467: done (4 left) 2024-03-04T06:53:21.152 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 325 2024-03-04T06:53:21.152 INFO:tasks.rados.rados.0.smithi137.stdout:3463: finishing write tid 1 to smithi13777483-21 2024-03-04T06:53:21.152 INFO:tasks.rados.rados.0.smithi137.stdout:3463: finishing write tid 2 to smithi13777483-21 2024-03-04T06:53:21.152 INFO:tasks.rados.rados.0.smithi137.stdout:3468: seq_num 1087 ranges {974848=614400,1589248=532480,2121728=270336} 2024-03-04T06:53:21.160 INFO:tasks.rados.rados.0.smithi137.stdout:3468: writing smithi13777483-16 from 974848 to 1589248 tid 1 2024-03-04T06:53:21.163 INFO:tasks.rados.rados.0.smithi137.stdout:3468: writing smithi13777483-16 from 1589248 to 2121728 tid 2 2024-03-04T06:53:21.165 INFO:tasks.rados.rados.0.smithi137.stdout:3468: writing smithi13777483-16 from 2121728 to 2392064 tid 3 2024-03-04T06:53:21.166 INFO:tasks.rados.rados.0.smithi137.stdout:3469: setattr oid 32 current snap is 325 2024-03-04T06:53:21.166 INFO:tasks.rados.rados.0.smithi137.stdout:3463: finishing write tid 3 to smithi13777483-21 2024-03-04T06:53:21.166 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16957 (ObjNum 1013 snap 302 seq_num 1013) dirty exists 2024-03-04T06:53:21.166 INFO:tasks.rados.rados.0.smithi137.stdout:3463: finishing write tid 4 to smithi13777483-21 2024-03-04T06:53:21.166 INFO:tasks.rados.rados.0.smithi137.stdout:3463: finishing write tid 5 to smithi13777483-21 2024-03-04T06:53:21.166 INFO:tasks.rados.rados.0.smithi137.stdout:3463: oid 21 updating version 0 to 16939 2024-03-04T06:53:21.166 INFO:tasks.rados.rados.0.smithi137.stdout:3463: oid 21 updating version 16939 to 16941 2024-03-04T06:53:21.166 INFO:tasks.rados.rados.0.smithi137.stdout:3463: oid 21 updating version 16941 to 16942 2024-03-04T06:53:21.166 INFO:tasks.rados.rados.0.smithi137.stdout:3463: oid 21 version 16942 is already newer than 16940 2024-03-04T06:53:21.166 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 16942 (ObjNum 1085 snap 325 seq_num 1085) dirty exists 2024-03-04T06:53:21.166 INFO:tasks.rados.rados.0.smithi137.stdout:3463: left oid 21 (ObjNum 1085 snap 325 seq_num 1085) 2024-03-04T06:53:21.166 INFO:tasks.rados.rados.0.smithi137.stdout:3465: expect (ObjNum 959 snap 282 seq_num 959) 2024-03-04T06:53:21.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:21.102+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:21.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:21.105+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:21.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:21.107+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:21.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:21.163+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:21.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:21.163+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:21.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:21.085+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:21.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:21.085+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:21.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:21.085+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:21.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:21.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-mon[85573]: osdmap e718: 8 total, 8 up, 8 in 2024-03-04T06:53:21.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:21.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:21.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:21.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:21.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:21.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:21.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:21.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:21.420 INFO:tasks.rados.rados.0.smithi137.stdout:3466: finishing write tid 1 to smithi13777483-45 2024-03-04T06:53:21.420 INFO:tasks.rados.rados.0.smithi137.stdout:3466: finishing write tid 2 to smithi13777483-45 2024-03-04T06:53:21.420 INFO:tasks.rados.rados.0.smithi137.stdout:3466: finishing write tid 3 to smithi13777483-45 2024-03-04T06:53:21.420 INFO:tasks.rados.rados.0.smithi137.stdout:3466: finishing write tid 4 to smithi13777483-45 2024-03-04T06:53:21.420 INFO:tasks.rados.rados.0.smithi137.stdout:3466: finishing write tid 5 to smithi13777483-45 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3466: oid 45 updating version 0 to 16964 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3466: oid 45 version 16964 is already newer than 16962 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3466: oid 45 version 16964 is already newer than 16963 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3466: oid 45 version 16964 is already newer than 16961 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16964 (ObjNum 1086 snap 325 seq_num 1086) dirty exists 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3466: left oid 45 (ObjNum 1086 snap 325 seq_num 1086) 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3468: finishing write tid 1 to smithi13777483-16 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3468: finishing write tid 2 to smithi13777483-16 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3468: finishing write tid 3 to smithi13777483-16 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3468: finishing write tid 4 to smithi13777483-16 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3468: finishing write tid 5 to smithi13777483-16 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3468: oid 16 updating version 0 to 16922 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3468: oid 16 updating version 16922 to 16923 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3468: oid 16 version 16923 is already newer than 16920 2024-03-04T06:53:21.421 INFO:tasks.rados.rados.0.smithi137.stdout:3468: oid 16 version 16923 is already newer than 16921 2024-03-04T06:53:21.422 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16923 (ObjNum 1087 snap 325 seq_num 1087) dirty exists 2024-03-04T06:53:21.422 INFO:tasks.rados.rados.0.smithi137.stdout:3468: left oid 16 (ObjNum 1087 snap 325 seq_num 1087) 2024-03-04T06:53:21.422 INFO:tasks.rados.rados.0.smithi137.stdout:3463: done (5 left) 2024-03-04T06:53:21.422 INFO:tasks.rados.rados.0.smithi137.stdout:3464: done (4 left) 2024-03-04T06:53:21.422 INFO:tasks.rados.rados.0.smithi137.stdout:3465: done (3 left) 2024-03-04T06:53:21.422 INFO:tasks.rados.rados.0.smithi137.stdout:3466: done (2 left) 2024-03-04T06:53:21.422 INFO:tasks.rados.rados.0.smithi137.stdout:3468: done (1 left) 2024-03-04T06:53:21.422 INFO:tasks.rados.rados.0.smithi137.stdout:3470: read oid 49 snap -1 2024-03-04T06:53:21.422 INFO:tasks.rados.rados.0.smithi137.stdout:3470: expect (ObjNum 1077 snap 324 seq_num 1077) 2024-03-04T06:53:21.422 INFO:tasks.rados.rados.0.smithi137.stdout:3471: delete oid 39 current snap is 325 2024-03-04T06:53:21.423 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 16966 (ObjNum 1070 snap 320 seq_num 1070) dirty exists 2024-03-04T06:53:21.427 INFO:tasks.rados.rados.0.smithi137.stdout:3469: done (2 left) 2024-03-04T06:53:21.428 INFO:tasks.rados.rados.0.smithi137.stdout:3471: done (1 left) 2024-03-04T06:53:21.428 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 16 current snap is 325 2024-03-04T06:53:21.428 INFO:tasks.rados.rados.0.smithi137.stdout:3472: seq_num 1089 ranges {2392064=647168,3039232=745472,3784704=57344} 2024-03-04T06:53:21.444 INFO:tasks.rados.rados.0.smithi137.stdout:3472: writing smithi13777483-16 from 2392064 to 3039232 tid 1 2024-03-04T06:53:21.448 INFO:tasks.rados.rados.0.smithi137.stdout:3472: writing smithi13777483-16 from 3039232 to 3784704 tid 2 2024-03-04T06:53:21.449 INFO:tasks.rados.rados.0.smithi137.stdout:3472: writing smithi13777483-16 from 3784704 to 3842048 tid 3 2024-03-04T06:53:21.449 INFO:tasks.rados.rados.0.smithi137.stdout:3473: rollback oid 42 current snap is 325 2024-03-04T06:53:21.449 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 42 to 315 2024-03-04T06:53:21.449 INFO:tasks.rados.rados.0.smithi137.stdout:3470: expect (ObjNum 1077 snap 324 seq_num 1077) 2024-03-04T06:53:21.542 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:21.101+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:21.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:21.107+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:21.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:21.086+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:21.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:21.086+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:21.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:21.086+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:21.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:21.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[91314]: osdmap e718: 8 total, 8 up, 8 in 2024-03-04T06:53:21.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:21.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:21.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:21.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:21.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:21.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:21.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:21.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:21.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:21.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[88869]: osdmap e718: 8 total, 8 up, 8 in 2024-03-04T06:53:21.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:21.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:21.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:21.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:21.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:21.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:21.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:21.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:21.602 INFO:tasks.rados.rados.0.smithi137.stdout:3472: finishing write tid 1 to smithi13777483-16 2024-03-04T06:53:21.602 INFO:tasks.rados.rados.0.smithi137.stdout:3473: finishing rollback tid 0 to smithi13777483-42 2024-03-04T06:53:21.602 INFO:tasks.rados.rados.0.smithi137.stdout:3473: finishing rollback tid 1 to smithi13777483-42 2024-03-04T06:53:21.602 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16968 (ObjNum 33 snap 0 seq_num 3110921464) dirty dne 2024-03-04T06:53:21.602 INFO:tasks.rados.rados.0.smithi137.stdout:3472: finishing write tid 2 to smithi13777483-16 2024-03-04T06:53:21.602 INFO:tasks.rados.rados.0.smithi137.stdout:3470: done (2 left) 2024-03-04T06:53:21.602 INFO:tasks.rados.rados.0.smithi137.stdout:3473: done (1 left) 2024-03-04T06:53:21.602 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 325 2024-03-04T06:53:21.602 INFO:tasks.rados.rados.0.smithi137.stdout:3472: finishing write tid 3 to smithi13777483-16 2024-03-04T06:53:21.602 INFO:tasks.rados.rados.0.smithi137.stdout:3472: finishing write tid 4 to smithi13777483-16 2024-03-04T06:53:21.603 INFO:tasks.rados.rados.0.smithi137.stdout:3472: finishing write tid 5 to smithi13777483-16 2024-03-04T06:53:21.603 INFO:tasks.rados.rados.0.smithi137.stdout:3472: oid 16 updating version 0 to 16925 2024-03-04T06:53:21.603 INFO:tasks.rados.rados.0.smithi137.stdout:3472: oid 16 updating version 16925 to 16926 2024-03-04T06:53:21.603 INFO:tasks.rados.rados.0.smithi137.stdout:3472: oid 16 version 16926 is already newer than 16924 2024-03-04T06:53:21.603 INFO:tasks.rados.rados.0.smithi137.stdout:3472: oid 16 updating version 16926 to 16927 2024-03-04T06:53:21.603 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 16927 (ObjNum 1089 snap 325 seq_num 1089) dirty exists 2024-03-04T06:53:21.603 INFO:tasks.rados.rados.0.smithi137.stdout:3472: left oid 16 (ObjNum 1089 snap 325 seq_num 1089) 2024-03-04T06:53:21.603 INFO:tasks.rados.rados.0.smithi137.stdout:3474: seq_num 1090 ranges {0=663552,663552=630784,1294336=172032} 2024-03-04T06:53:21.605 INFO:tasks.rados.rados.0.smithi137.stdout:3474: writing smithi13777483-46 from 0 to 663552 tid 1 2024-03-04T06:53:21.609 INFO:tasks.rados.rados.0.smithi137.stdout:3474: writing smithi13777483-46 from 663552 to 1294336 tid 2 2024-03-04T06:53:21.610 INFO:tasks.rados.rados.0.smithi137.stdout:3474: writing smithi13777483-46 from 1294336 to 1466368 tid 3 2024-03-04T06:53:21.610 INFO:tasks.rados.rados.0.smithi137.stdout:3472: done (1 left) 2024-03-04T06:53:21.610 INFO:tasks.rados.rados.0.smithi137.stdout:3475: read oid 7 snap -1 2024-03-04T06:53:21.611 INFO:tasks.rados.rados.0.smithi137.stdout:3475: expect (ObjNum 1057 snap 318 seq_num 1057) 2024-03-04T06:53:21.611 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 33 current snap is 325 2024-03-04T06:53:21.611 INFO:tasks.rados.rados.0.smithi137.stdout:3474: finishing write tid 1 to smithi13777483-46 2024-03-04T06:53:21.611 INFO:tasks.rados.rados.0.smithi137.stdout:3476: seq_num 1091 ranges {0=679936,679936=516096,1196032=286720} 2024-03-04T06:53:21.614 INFO:tasks.rados.rados.0.smithi137.stdout:3476: writing smithi13777483-33 from 0 to 679936 tid 1 2024-03-04T06:53:21.617 INFO:tasks.rados.rados.0.smithi137.stdout:3476: writing smithi13777483-33 from 679936 to 1196032 tid 2 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:3476: writing smithi13777483-33 from 1196032 to 1482752 tid 3 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:3477: rollback oid 29 current snap is 325 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 29 to 316 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:3474: finishing write tid 2 to smithi13777483-46 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:3474: finishing write tid 3 to smithi13777483-46 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:3474: finishing write tid 4 to smithi13777483-46 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:3474: finishing write tid 5 to smithi13777483-46 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:3474: oid 46 updating version 0 to 16972 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:3474: oid 46 version 16972 is already newer than 16971 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:3474: oid 46 version 16972 is already newer than 16969 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:3474: oid 46 version 16972 is already newer than 16970 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 16972 (ObjNum 1090 snap 325 seq_num 1090) dirty exists 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:3474: left oid 46 (ObjNum 1090 snap 325 seq_num 1090) 2024-03-04T06:53:21.620 INFO:tasks.rados.rados.0.smithi137.stdout:3474: done (3 left) 2024-03-04T06:53:21.621 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 3 current snap is 325 2024-03-04T06:53:21.621 INFO:tasks.rados.rados.0.smithi137.stdout:3478: seq_num 1092 ranges {0=696320,696320=802816} 2024-03-04T06:53:21.624 INFO:tasks.rados.rados.0.smithi137.stdout:3478: writing smithi13777483-3 from 0 to 696320 tid 1 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3478: writing smithi13777483-3 from 696320 to 1499136 tid 2 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3479: copy_from oid 23 from oid 43 current snap is 325 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3476: finishing write tid 1 to smithi13777483-33 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3476: finishing write tid 2 to smithi13777483-33 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3476: finishing write tid 3 to smithi13777483-33 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3476: finishing write tid 4 to smithi13777483-33 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3477: finishing rollback tid 0 to smithi13777483-29 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3477: finishing rollback tid 1 to smithi13777483-29 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3480: read oid 32 snap -1 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3480: expect (ObjNum 1070 snap 320 seq_num 1070) 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3481: copy_from oid 28 from oid 15 current snap is 325 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3477: finishing rollback tid 2 to smithi13777483-29 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16961 (ObjNum 932 snap 275 seq_num 932) dirty exists 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3476: finishing write tid 5 to smithi13777483-33 2024-03-04T06:53:21.630 INFO:tasks.rados.rados.0.smithi137.stdout:3476: oid 33 updating version 0 to 16949 2024-03-04T06:53:21.631 INFO:tasks.rados.rados.0.smithi137.stdout:3476: oid 33 updating version 16949 to 16951 2024-03-04T06:53:21.631 INFO:tasks.rados.rados.0.smithi137.stdout:3476: oid 33 version 16951 is already newer than 16948 2024-03-04T06:53:21.631 INFO:tasks.rados.rados.0.smithi137.stdout:3476: oid 33 version 16951 is already newer than 16950 2024-03-04T06:53:21.631 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16951 (ObjNum 1091 snap 325 seq_num 1091) dirty exists 2024-03-04T06:53:21.631 INFO:tasks.rados.rados.0.smithi137.stdout:3476: left oid 33 (ObjNum 1091 snap 325 seq_num 1091) 2024-03-04T06:53:21.631 INFO:tasks.rados.rados.0.smithi137.stdout:3478: finishing write tid 1 to smithi13777483-3 2024-03-04T06:53:21.631 INFO:tasks.rados.rados.0.smithi137.stdout:3476: done (6 left) 2024-03-04T06:53:21.631 INFO:tasks.rados.rados.0.smithi137.stdout:3477: done (5 left) 2024-03-04T06:53:21.631 INFO:tasks.rados.rados.0.smithi137.stdout:3482: delete oid 19 current snap is 325 2024-03-04T06:53:21.631 INFO:tasks.rados.rados.0.smithi137.stdout:3481: finishing copy_from to smithi13777483-28 2024-03-04T06:53:21.631 INFO:tasks.rados.rados.0.smithi137.stdout:3481: got expected ENOENT (src dne) 2024-03-04T06:53:21.632 INFO:tasks.rados.rados.0.smithi137.stdout:3481: finishing copy_from racing read to smithi13777483-28 2024-03-04T06:53:21.634 INFO:tasks.rados.rados.0.smithi137.stdout:3475: expect (ObjNum 1057 snap 318 seq_num 1057) 2024-03-04T06:53:21.940 INFO:tasks.rados.rados.0.smithi137.stdout:3480: expect (ObjNum 1070 snap 320 seq_num 1070) 2024-03-04T06:53:21.971 INFO:tasks.rados.rados.0.smithi137.stdout:3478: finishing write tid 2 to smithi13777483-3 2024-03-04T06:53:21.972 INFO:tasks.rados.rados.0.smithi137.stdout:3478: finishing write tid 3 to smithi13777483-3 2024-03-04T06:53:21.972 INFO:tasks.rados.rados.0.smithi137.stdout:3478: finishing write tid 4 to smithi13777483-3 2024-03-04T06:53:21.972 INFO:tasks.rados.rados.0.smithi137.stdout:3478: oid 3 updating version 0 to 16963 2024-03-04T06:53:21.972 INFO:tasks.rados.rados.0.smithi137.stdout:3478: oid 3 updating version 16963 to 16965 2024-03-04T06:53:21.972 INFO:tasks.rados.rados.0.smithi137.stdout:3478: oid 3 version 16965 is already newer than 16964 2024-03-04T06:53:21.972 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 16965 (ObjNum 1092 snap 325 seq_num 1092) dirty exists 2024-03-04T06:53:21.972 INFO:tasks.rados.rados.0.smithi137.stdout:3478: left oid 3 (ObjNum 1092 snap 325 seq_num 1092) 2024-03-04T06:53:21.972 INFO:tasks.rados.rados.0.smithi137.stdout:3479: finishing copy_from racing read to smithi13777483-23 2024-03-04T06:53:21.972 INFO:tasks.rados.rados.0.smithi137.stdout:3479: finishing copy_from to smithi13777483-23 2024-03-04T06:53:21.972 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 16916 (ObjNum 1009 snap 296 seq_num 1009) dirty exists 2024-03-04T06:53:21.972 INFO:tasks.rados.rados.0.smithi137.stdout:3475: done (5 left) 2024-03-04T06:53:21.972 INFO:tasks.rados.rados.0.smithi137.stdout:3478: done (4 left) 2024-03-04T06:53:21.972 INFO:tasks.rados.rados.0.smithi137.stdout:3479: done (3 left) 2024-03-04T06:53:21.973 INFO:tasks.rados.rados.0.smithi137.stdout:3480: done (2 left) 2024-03-04T06:53:21.973 INFO:tasks.rados.rados.0.smithi137.stdout:3481: done (1 left) 2024-03-04T06:53:21.973 INFO:tasks.rados.rados.0.smithi137.stdout:3482: done (0 left) 2024-03-04T06:53:21.973 INFO:tasks.rados.rados.0.smithi137.stdout:3483: copy_from oid 3 from oid 40 current snap is 325 2024-03-04T06:53:21.973 INFO:tasks.rados.rados.0.smithi137.stdout:3484: snap_create 2024-03-04T06:53:21.973 INFO:tasks.rados.rados.0.smithi137.stdout:3483: finishing copy_from to smithi13777483-3 2024-03-04T06:53:21.973 INFO:tasks.rados.rados.0.smithi137.stdout:3483: got expected ENOENT (src dne) 2024-03-04T06:53:21.973 INFO:tasks.rados.rados.0.smithi137.stdout:3483: finishing copy_from racing read to smithi13777483-3 2024-03-04T06:53:22.089 INFO:tasks.rados.rados.0.smithi137.stdout:3483: done (1 left) 2024-03-04T06:53:22.089 INFO:tasks.rados.rados.0.smithi137.stdout:3484: done (0 left) 2024-03-04T06:53:22.089 INFO:tasks.rados.rados.0.smithi137.stdout:3485: rollback oid 40 current snap is 326 2024-03-04T06:53:22.089 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 40 to 320 2024-03-04T06:53:22.089 INFO:tasks.rados.rados.0.smithi137.stdout:3486: read oid 10 snap -1 2024-03-04T06:53:22.089 INFO:tasks.rados.rados.0.smithi137.stdout:3486: expect deleted 2024-03-04T06:53:22.090 INFO:tasks.rados.rados.0.smithi137.stdout:3487: rollback oid 39 current snap is 326 2024-03-04T06:53:22.090 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 39 to 321 2024-03-04T06:53:22.090 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 50 current snap is 326 2024-03-04T06:53:22.090 INFO:tasks.rados.rados.0.smithi137.stdout:3488: seq_num 1094 ranges {638976=729088,1368064=573440,1941504=229376} 2024-03-04T06:53:22.096 INFO:tasks.rados.rados.0.smithi137.stdout:3488: writing smithi13777483-50 from 638976 to 1368064 tid 1 2024-03-04T06:53:22.100 INFO:tasks.rados.rados.0.smithi137.stdout:3488: writing smithi13777483-50 from 1368064 to 1941504 tid 2 2024-03-04T06:53:22.103 INFO:tasks.rados.rados.0.smithi137.stdout:3488: writing smithi13777483-50 from 1941504 to 2170880 tid 3 2024-03-04T06:53:22.103 INFO:tasks.rados.rados.0.smithi137.stdout:3489: read oid 22 snap -1 2024-03-04T06:53:22.103 INFO:tasks.rados.rados.0.smithi137.stdout:3489: expect (ObjNum 959 snap 282 seq_num 959) 2024-03-04T06:53:22.103 INFO:tasks.rados.rados.0.smithi137.stdout:3490: read oid 45 snap -1 2024-03-04T06:53:22.103 INFO:tasks.rados.rados.0.smithi137.stdout:3490: expect (ObjNum 1086 snap 325 seq_num 1086) 2024-03-04T06:53:22.103 INFO:tasks.rados.rados.0.smithi137.stdout:3491: copy_from oid 9 from oid 19 current snap is 326 2024-03-04T06:53:22.103 INFO:tasks.rados.rados.0.smithi137.stdout:3485: finishing rollback tid 1 to smithi13777483-40 2024-03-04T06:53:22.103 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 16935 (ObjNum 0 snap 0 seq_num 304) dirty dne 2024-03-04T06:53:22.103 INFO:tasks.rados.rados.0.smithi137.stdout:3487: finishing rollback tid 1 to smithi13777483-39 2024-03-04T06:53:22.104 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 16883 (ObjNum 97 snap 0 seq_num 1496034066) dirty dne 2024-03-04T06:53:22.104 INFO:tasks.rados.rados.0.smithi137.stdout:3485: done (6 left) 2024-03-04T06:53:22.104 INFO:tasks.rados.rados.0.smithi137.stdout:3486: done (5 left) 2024-03-04T06:53:22.104 INFO:tasks.rados.rados.0.smithi137.stdout:3487: done (4 left) 2024-03-04T06:53:22.104 INFO:tasks.rados.rados.0.smithi137.stdout:3492: read oid 46 snap -1 2024-03-04T06:53:22.104 INFO:tasks.rados.rados.0.smithi137.stdout:3492: expect (ObjNum 1090 snap 325 seq_num 1090) 2024-03-04T06:53:22.104 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 326 2024-03-04T06:53:22.104 INFO:tasks.rados.rados.0.smithi137.stdout:3493: seq_num 1095 ranges {6955008=745472,7700480=499712,8200192=303104} 2024-03-04T06:53:22.145 INFO:tasks.rados.rados.0.smithi137.stdout:3493: writing smithi13777483-27 from 6955008 to 7700480 tid 1 2024-03-04T06:53:22.148 INFO:tasks.rados.rados.0.smithi137.stdout:3493: writing smithi13777483-27 from 7700480 to 8200192 tid 2 2024-03-04T06:53:22.151 INFO:tasks.rados.rados.0.smithi137.stdout:3493: writing smithi13777483-27 from 8200192 to 8503296 tid 3 2024-03-04T06:53:22.151 INFO:tasks.rados.rados.0.smithi137.stdout:3494: rmattr oid 5 current snap is 326 2024-03-04T06:53:22.151 INFO:tasks.rados.rados.0.smithi137.stdout:3494: done (6 left) 2024-03-04T06:53:22.151 INFO:tasks.rados.rados.0.smithi137.stdout:3495: setattr oid 15 current snap is 326 2024-03-04T06:53:22.151 INFO:tasks.rados.rados.0.smithi137.stdout:3491: finishing copy_from to smithi13777483-9 2024-03-04T06:53:22.151 INFO:tasks.rados.rados.0.smithi137.stdout:3491: got expected ENOENT (src dne) 2024-03-04T06:53:22.151 INFO:tasks.rados.rados.0.smithi137.stdout:3488: finishing write tid 1 to smithi13777483-50 2024-03-04T06:53:22.151 INFO:tasks.rados.rados.0.smithi137.stdout:3491: finishing copy_from racing read to smithi13777483-9 2024-03-04T06:53:22.151 INFO:tasks.rados.rados.0.smithi137.stdout:3488: finishing write tid 2 to smithi13777483-50 2024-03-04T06:53:22.151 INFO:tasks.rados.rados.0.smithi137.stdout:3488: finishing write tid 3 to smithi13777483-50 2024-03-04T06:53:22.151 INFO:tasks.rados.rados.0.smithi137.stdout:3488: finishing write tid 4 to smithi13777483-50 2024-03-04T06:53:22.151 INFO:tasks.rados.rados.0.smithi137.stdout:3492: expect (ObjNum 1090 snap 325 seq_num 1090) 2024-03-04T06:53:22.189 INFO:tasks.rados.rados.0.smithi137.stdout:3488: finishing write tid 5 to smithi13777483-50 2024-03-04T06:53:22.189 INFO:tasks.rados.rados.0.smithi137.stdout:3488: oid 50 updating version 0 to 16974 2024-03-04T06:53:22.189 INFO:tasks.rados.rados.0.smithi137.stdout:3488: oid 50 updating version 16974 to 16976 2024-03-04T06:53:22.189 INFO:tasks.rados.rados.0.smithi137.stdout:3488: oid 50 version 16976 is already newer than 16975 2024-03-04T06:53:22.189 INFO:tasks.rados.rados.0.smithi137.stdout:3488: oid 50 version 16976 is already newer than 16973 2024-03-04T06:53:22.189 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 16976 (ObjNum 1094 snap 326 seq_num 1094) dirty exists 2024-03-04T06:53:22.189 INFO:tasks.rados.rados.0.smithi137.stdout:3488: left oid 50 (ObjNum 1094 snap 326 seq_num 1094) 2024-03-04T06:53:22.189 INFO:tasks.rados.rados.0.smithi137.stdout:3489: expect (ObjNum 959 snap 282 seq_num 959) 2024-03-04T06:53:22.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:22.105+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:22.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:22.136+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:22.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:22.095+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:22.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:22.095+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:22.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:22.096+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:22.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:22.086+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:22.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:22.098+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-mon[85573]: pgmap v760: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 697 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 6.1 MiB/s rd, 2.6 MiB/s wr, 15 op/s 2024-03-04T06:53:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-mon[85573]: osdmap e719: 8 total, 8 up, 8 in 2024-03-04T06:53:22.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:22.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:22.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:22.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:22.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:22.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:22.439 INFO:tasks.rados.rados.0.smithi137.stdout:3493: finishing write tid 1 to smithi13777483-27 2024-03-04T06:53:22.439 INFO:tasks.rados.rados.0.smithi137.stdout:3490: expect (ObjNum 1086 snap 325 seq_num 1086) 2024-03-04T06:53:22.542 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:22.088+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:22.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:22.099+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:22.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:22.099+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:22.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:22.102+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:22.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[88869]: pgmap v760: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 697 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 6.1 MiB/s rd, 2.6 MiB/s wr, 15 op/s 2024-03-04T06:53:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[88869]: osdmap e719: 8 total, 8 up, 8 in 2024-03-04T06:53:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:22.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[91314]: pgmap v760: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 697 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 6.1 MiB/s rd, 2.6 MiB/s wr, 15 op/s 2024-03-04T06:53:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[91314]: osdmap e719: 8 total, 8 up, 8 in 2024-03-04T06:53:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:22.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:22.967 INFO:tasks.rados.rados.0.smithi137.stdout:3493: finishing write tid 2 to smithi13777483-27 2024-03-04T06:53:22.967 INFO:tasks.rados.rados.0.smithi137.stdout:3493: finishing write tid 3 to smithi13777483-27 2024-03-04T06:53:22.967 INFO:tasks.rados.rados.0.smithi137.stdout:3493: finishing write tid 4 to smithi13777483-27 2024-03-04T06:53:22.968 INFO:tasks.rados.rados.0.smithi137.stdout:3493: finishing write tid 5 to smithi13777483-27 2024-03-04T06:53:22.968 INFO:tasks.rados.rados.0.smithi137.stdout:3493: oid 27 updating version 0 to 16980 2024-03-04T06:53:22.968 INFO:tasks.rados.rados.0.smithi137.stdout:3493: oid 27 version 16980 is already newer than 16977 2024-03-04T06:53:22.968 INFO:tasks.rados.rados.0.smithi137.stdout:3493: oid 27 version 16980 is already newer than 16979 2024-03-04T06:53:22.968 INFO:tasks.rados.rados.0.smithi137.stdout:3493: oid 27 version 16980 is already newer than 16978 2024-03-04T06:53:22.968 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16980 (ObjNum 1095 snap 326 seq_num 1095) dirty exists 2024-03-04T06:53:22.968 INFO:tasks.rados.rados.0.smithi137.stdout:3493: left oid 27 (ObjNum 1095 snap 326 seq_num 1095) 2024-03-04T06:53:22.968 INFO:tasks.rados.rados.0.smithi137.stdout:3488: done (6 left) 2024-03-04T06:53:22.968 INFO:tasks.rados.rados.0.smithi137.stdout:3489: done (5 left) 2024-03-04T06:53:22.968 INFO:tasks.rados.rados.0.smithi137.stdout:3490: done (4 left) 2024-03-04T06:53:22.968 INFO:tasks.rados.rados.0.smithi137.stdout:3491: done (3 left) 2024-03-04T06:53:22.968 INFO:tasks.rados.rados.0.smithi137.stdout:3492: done (2 left) 2024-03-04T06:53:22.968 INFO:tasks.rados.rados.0.smithi137.stdout:3493: done (1 left) 2024-03-04T06:53:22.969 INFO:tasks.rados.rados.0.smithi137.stdout:3496: read oid 22 snap -1 2024-03-04T06:53:22.969 INFO:tasks.rados.rados.0.smithi137.stdout:3496: expect (ObjNum 959 snap 282 seq_num 959) 2024-03-04T06:53:22.969 INFO:tasks.rados.rados.0.smithi137.stdout:3497: copy_from oid 24 from oid 8 current snap is 326 2024-03-04T06:53:22.969 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 28 current snap is 326 2024-03-04T06:53:22.969 INFO:tasks.rados.rados.0.smithi137.stdout:3498: seq_num 1096 ranges {11034624=761856,11796480=786432,12582912=16384} 2024-03-04T06:53:23.029 INFO:tasks.rados.rados.0.smithi137.stdout:3498: writing smithi13777483-28 from 11034624 to 11796480 tid 1 2024-03-04T06:53:23.035 INFO:tasks.rados.rados.0.smithi137.stdout:3498: writing smithi13777483-28 from 11796480 to 12582912 tid 2 2024-03-04T06:53:23.035 INFO:tasks.rados.rados.0.smithi137.stdout:3498: writing smithi13777483-28 from 12582912 to 12599296 tid 3 2024-03-04T06:53:23.035 INFO:tasks.rados.rados.0.smithi137.stdout:3499: read oid 19 snap -1 2024-03-04T06:53:23.035 INFO:tasks.rados.rados.0.smithi137.stdout:3499: expect deleted 2024-03-04T06:53:23.035 INFO:tasks.rados.rados.0.smithi137.stdout:3500: rmattr oid 31 current snap is 326 2024-03-04T06:53:23.035 INFO:tasks.rados.rados.0.smithi137.stdout:3500: done (5 left) 2024-03-04T06:53:23.035 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 326 2024-03-04T06:53:23.035 INFO:tasks.rados.rados.0.smithi137.stdout:3497: finishing copy_from to smithi13777483-24 2024-03-04T06:53:23.035 INFO:tasks.rados.rados.0.smithi137.stdout:3497: got expected ENOENT (src dne) 2024-03-04T06:53:23.035 INFO:tasks.rados.rados.0.smithi137.stdout:3497: finishing copy_from racing read to smithi13777483-24 2024-03-04T06:53:23.035 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16950 (ObjNum 33 snap 0 seq_num 3110926128) dirty exists 2024-03-04T06:53:23.035 INFO:tasks.rados.rados.0.smithi137.stdout:3496: expect (ObjNum 959 snap 282 seq_num 959) 2024-03-04T06:53:23.289 INFO:tasks.rados.rados.0.smithi137.stdout:3498: finishing write tid 1 to smithi13777483-28 2024-03-04T06:53:23.289 INFO:tasks.rados.rados.0.smithi137.stdout:3498: finishing write tid 2 to smithi13777483-28 2024-03-04T06:53:23.289 INFO:tasks.rados.rados.0.smithi137.stdout:3498: finishing write tid 3 to smithi13777483-28 2024-03-04T06:53:23.289 INFO:tasks.rados.rados.0.smithi137.stdout:3501: seq_num 1097 ranges {10731520=778240,11509760=671744,12181504=131072} 2024-03-04T06:53:23.349 INFO:tasks.rados.rados.0.smithi137.stdout:3501: writing smithi13777483-17 from 10731520 to 11509760 tid 1 2024-03-04T06:53:23.353 INFO:tasks.rados.rados.0.smithi137.stdout:3501: writing smithi13777483-17 from 11509760 to 12181504 tid 2 2024-03-04T06:53:23.354 INFO:tasks.rados.rados.0.smithi137.stdout:3501: writing smithi13777483-17 from 12181504 to 12312576 tid 3 2024-03-04T06:53:23.354 INFO:tasks.rados.rados.0.smithi137.stdout:3495: done (5 left) 2024-03-04T06:53:23.354 INFO:tasks.rados.rados.0.smithi137.stdout:3496: done (4 left) 2024-03-04T06:53:23.354 INFO:tasks.rados.rados.0.smithi137.stdout:3497: done (3 left) 2024-03-04T06:53:23.354 INFO:tasks.rados.rados.0.smithi137.stdout:3499: done (2 left) 2024-03-04T06:53:23.354 INFO:tasks.rados.rados.0.smithi137.stdout:3502: delete oid 33 current snap is 326 2024-03-04T06:53:23.354 INFO:tasks.rados.rados.0.smithi137.stdout:3498: finishing write tid 4 to smithi13777483-28 2024-03-04T06:53:23.355 INFO:tasks.rados.rados.0.smithi137.stdout:3498: finishing write tid 5 to smithi13777483-28 2024-03-04T06:53:23.355 INFO:tasks.rados.rados.0.smithi137.stdout:3498: oid 28 updating version 0 to 16946 2024-03-04T06:53:23.355 INFO:tasks.rados.rados.0.smithi137.stdout:3498: oid 28 version 16946 is already newer than 16945 2024-03-04T06:53:23.355 INFO:tasks.rados.rados.0.smithi137.stdout:3498: oid 28 version 16946 is already newer than 16943 2024-03-04T06:53:23.355 INFO:tasks.rados.rados.0.smithi137.stdout:3498: oid 28 version 16946 is already newer than 16944 2024-03-04T06:53:23.355 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16946 (ObjNum 1096 snap 326 seq_num 1096) dirty exists 2024-03-04T06:53:23.355 INFO:tasks.rados.rados.0.smithi137.stdout:3498: left oid 28 (ObjNum 1096 snap 326 seq_num 1096) 2024-03-04T06:53:23.356 INFO:tasks.rados.rados.0.smithi137.stdout:3498: done (2 left) 2024-03-04T06:53:23.356 INFO:tasks.rados.rados.0.smithi137.stdout:3502: done (1 left) 2024-03-04T06:53:23.356 INFO:tasks.rados.rados.0.smithi137.stdout:3503: rollback oid 45 current snap is 326 2024-03-04T06:53:23.356 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 45 to 325 2024-03-04T06:53:23.357 INFO:tasks.rados.rados.0.smithi137.stdout:3504: rmattr oid 8 current snap is 326 2024-03-04T06:53:23.357 INFO:tasks.rados.rados.0.smithi137.stdout:3504: done (2 left) 2024-03-04T06:53:23.357 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 326 2024-03-04T06:53:23.357 INFO:tasks.rados.rados.0.smithi137.stdout:3505: seq_num 1099 ranges {1187840=409600,1597440=442368,2039808=720896,2760704=40960} 2024-03-04T06:53:23.365 INFO:tasks.rados.rados.0.smithi137.stdout:3505: writing smithi13777483-6 from 1187840 to 1597440 tid 1 2024-03-04T06:53:23.367 INFO:tasks.rados.rados.0.smithi137.stdout:3505: writing smithi13777483-6 from 1597440 to 2039808 tid 2 2024-03-04T06:53:23.373 INFO:tasks.rados.rados.0.smithi137.stdout:3505: writing smithi13777483-6 from 2039808 to 2760704 tid 3 2024-03-04T06:53:23.373 INFO:tasks.rados.rados.0.smithi137.stdout:3505: writing smithi13777483-6 from 2760704 to 2801664 tid 4 2024-03-04T06:53:23.373 INFO:tasks.rados.rados.0.smithi137.stdout:3506: read oid 15 snap -1 2024-03-04T06:53:23.373 INFO:tasks.rados.rados.0.smithi137.stdout:3506: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:53:23.373 INFO:tasks.rados.rados.0.smithi137.stdout:3507: read oid 40 snap -1 2024-03-04T06:53:23.373 INFO:tasks.rados.rados.0.smithi137.stdout:3507: expect deleted 2024-03-04T06:53:23.373 INFO:tasks.rados.rados.0.smithi137.stdout:3508: rollback oid 26 current snap is 326 2024-03-04T06:53:23.373 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 26 to 320 2024-03-04T06:53:23.373 INFO:tasks.rados.rados.0.smithi137.stdout:3501: finishing write tid 1 to smithi13777483-17 2024-03-04T06:53:23.373 INFO:tasks.rados.rados.0.smithi137.stdout:3501: finishing write tid 2 to smithi13777483-17 2024-03-04T06:53:23.373 INFO:tasks.rados.rados.0.smithi137.stdout:3501: finishing write tid 3 to smithi13777483-17 2024-03-04T06:53:23.374 INFO:tasks.rados.rados.0.smithi137.stdout:3501: finishing write tid 4 to smithi13777483-17 2024-03-04T06:53:23.374 INFO:tasks.rados.rados.0.smithi137.stdout:3503: finishing rollback tid 0 to smithi13777483-45 2024-03-04T06:53:23.374 INFO:tasks.rados.rados.0.smithi137.stdout:3503: finishing rollback tid 1 to smithi13777483-45 2024-03-04T06:53:23.374 INFO:tasks.rados.rados.0.smithi137.stdout:3503: finishing rollback tid 2 to smithi13777483-45 2024-03-04T06:53:23.374 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16967 (ObjNum 1086 snap 325 seq_num 1086) dirty exists 2024-03-04T06:53:23.374 INFO:tasks.rados.rados.0.smithi137.stdout:3501: finishing write tid 5 to smithi13777483-17 2024-03-04T06:53:23.374 INFO:tasks.rados.rados.0.smithi137.stdout:3501: oid 17 updating version 0 to 16963 2024-03-04T06:53:23.374 INFO:tasks.rados.rados.0.smithi137.stdout:3501: oid 17 updating version 16963 to 16965 2024-03-04T06:53:23.374 INFO:tasks.rados.rados.0.smithi137.stdout:3501: oid 17 version 16965 is already newer than 16964 2024-03-04T06:53:23.374 INFO:tasks.rados.rados.0.smithi137.stdout:3501: oid 17 updating version 16965 to 16966 2024-03-04T06:53:23.374 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16966 (ObjNum 1097 snap 326 seq_num 1097) dirty exists 2024-03-04T06:53:23.374 INFO:tasks.rados.rados.0.smithi137.stdout:3501: left oid 17 (ObjNum 1097 snap 326 seq_num 1097) 2024-03-04T06:53:23.375 INFO:tasks.rados.rados.0.smithi137.stdout:3505: finishing write tid 1 to smithi13777483-6 2024-03-04T06:53:23.375 INFO:tasks.rados.rados.0.smithi137.stdout:3505: finishing write tid 2 to smithi13777483-6 2024-03-04T06:53:23.375 INFO:tasks.rados.rados.0.smithi137.stdout:3501: done (5 left) 2024-03-04T06:53:23.375 INFO:tasks.rados.rados.0.smithi137.stdout:3503: done (4 left) 2024-03-04T06:53:23.375 INFO:tasks.rados.rados.0.smithi137.stdout:3509: snap_remove snap 294 2024-03-04T06:53:23.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:23.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:23.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[91314]: osdmap e720: 8 total, 8 up, 8 in 2024-03-04T06:53:23.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:23.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:23.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:23.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:23.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:23.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:23.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:23.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:23.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[88869]: osdmap e720: 8 total, 8 up, 8 in 2024-03-04T06:53:23.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:23.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:23.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:23.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:23.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:23.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:23 smithi203 ceph-mon[85573]: osdmap e720: 8 total, 8 up, 8 in 2024-03-04T06:53:23.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:23.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:23.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:23.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:23.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:23.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:23.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:23.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:24.107 INFO:tasks.rados.rados.0.smithi137.stdout:3509: done (4 left) 2024-03-04T06:53:24.107 INFO:tasks.rados.rados.0.smithi137.stdout:3510: delete oid 50 current snap is 326 2024-03-04T06:53:24.107 INFO:tasks.rados.rados.0.smithi137.stdout:3508: finishing rollback tid 0 to smithi13777483-26 2024-03-04T06:53:24.107 INFO:tasks.rados.rados.0.smithi137.stdout:3508: finishing rollback tid 1 to smithi13777483-26 2024-03-04T06:53:24.107 INFO:tasks.rados.rados.0.smithi137.stdout:3508: finishing rollback tid 2 to smithi13777483-26 2024-03-04T06:53:24.107 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16964 (ObjNum 957 snap 282 seq_num 957) dirty exists 2024-03-04T06:53:24.107 INFO:tasks.rados.rados.0.smithi137.stdout:3505: finishing write tid 3 to smithi13777483-6 2024-03-04T06:53:24.108 INFO:tasks.rados.rados.0.smithi137.stdout:3505: finishing write tid 4 to smithi13777483-6 2024-03-04T06:53:24.108 INFO:tasks.rados.rados.0.smithi137.stdout:3505: finishing write tid 5 to smithi13777483-6 2024-03-04T06:53:24.108 INFO:tasks.rados.rados.0.smithi137.stdout:3506: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:53:24.110 INFO:tasks.rados.rados.0.smithi137.stdout:3505: finishing write tid 6 to smithi13777483-6 2024-03-04T06:53:24.110 INFO:tasks.rados.rados.0.smithi137.stdout:3505: oid 6 updating version 0 to 16952 2024-03-04T06:53:24.110 INFO:tasks.rados.rados.0.smithi137.stdout:3505: oid 6 updating version 16952 to 16954 2024-03-04T06:53:24.110 INFO:tasks.rados.rados.0.smithi137.stdout:3505: oid 6 version 16954 is already newer than 16951 2024-03-04T06:53:24.110 INFO:tasks.rados.rados.0.smithi137.stdout:3505: oid 6 version 16954 is already newer than 16953 2024-03-04T06:53:24.110 INFO:tasks.rados.rados.0.smithi137.stdout:3505: oid 6 updating version 16954 to 16955 2024-03-04T06:53:24.110 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16955 (ObjNum 1099 snap 326 seq_num 1099) dirty exists 2024-03-04T06:53:24.110 INFO:tasks.rados.rados.0.smithi137.stdout:3505: left oid 6 (ObjNum 1099 snap 326 seq_num 1099) 2024-03-04T06:53:24.114 INFO:tasks.rados.rados.0.smithi137.stdout:3505: done (4 left) 2024-03-04T06:53:24.114 INFO:tasks.rados.rados.0.smithi137.stdout:3506: done (3 left) 2024-03-04T06:53:24.114 INFO:tasks.rados.rados.0.smithi137.stdout:3507: done (2 left) 2024-03-04T06:53:24.114 INFO:tasks.rados.rados.0.smithi137.stdout:3508: done (1 left) 2024-03-04T06:53:24.114 INFO:tasks.rados.rados.0.smithi137.stdout:3510: done (0 left) 2024-03-04T06:53:24.114 INFO:tasks.rados.rados.0.smithi137.stdout:3511: read oid 17 snap -1 2024-03-04T06:53:24.114 INFO:tasks.rados.rados.0.smithi137.stdout:3511: expect (ObjNum 1097 snap 326 seq_num 1097) 2024-03-04T06:53:24.114 INFO:tasks.rados.rados.0.smithi137.stdout:3512: snap_create 2024-03-04T06:53:24.178 INFO:tasks.rados.rados.0.smithi137.stdout:3511: expect (ObjNum 1097 snap 326 seq_num 1097) 2024-03-04T06:53:24.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:24 smithi137 ceph-mon[88869]: pgmap v763: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 697 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 624 KiB/s wr, 7 op/s 2024-03-04T06:53:24.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:53:24.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:24 smithi137 ceph-mon[91314]: pgmap v763: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 697 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 624 KiB/s wr, 7 op/s 2024-03-04T06:53:24.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:53:24.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:24.110+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:24.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:24.110+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:24.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:24.114+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:24.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:24.114+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:24.544 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:24.105+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:24 smithi203 ceph-mon[85573]: pgmap v763: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 697 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 624 KiB/s wr, 7 op/s 2024-03-04T06:53:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:53:24.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:24.117+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:24.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:24.147+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:24.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:24.105+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:24.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:24.126+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:24.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:24.126+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:24.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:24.126+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:24.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:24.328+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:24.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:24.328+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:25.388 INFO:tasks.rados.rados.0.smithi137.stdout:3511: done (1 left) 2024-03-04T06:53:25.388 INFO:tasks.rados.rados.0.smithi137.stdout:3512: done (0 left) 2024-03-04T06:53:25.388 INFO:tasks.rados.rados.0.smithi137.stdout:3513: delete oid 50 current snap is 327 2024-03-04T06:53:25.390 INFO:tasks.rados.rados.0.smithi137.stdout:3513: done (0 left) 2024-03-04T06:53:25.390 INFO:tasks.rados.rados.0.smithi137.stdout:3514: delete oid 11 current snap is 327 2024-03-04T06:53:25.394 INFO:tasks.rados.rados.0.smithi137.stdout:3514: done (0 left) 2024-03-04T06:53:25.394 INFO:tasks.rados.rados.0.smithi137.stdout:3515: read oid 33 snap -1 2024-03-04T06:53:25.394 INFO:tasks.rados.rados.0.smithi137.stdout:3515: expect deleted 2024-03-04T06:53:25.394 INFO:tasks.rados.rados.0.smithi137.stdout:3516: read oid 47 snap 319 2024-03-04T06:53:25.394 INFO:tasks.rados.rados.0.smithi137.stdout:3516: expect (ObjNum -1164099312 snap 21906 seq_num 3130954064) 2024-03-04T06:53:25.395 INFO:tasks.rados.rados.0.smithi137.stdout:3517: read oid 16 snap -1 2024-03-04T06:53:25.395 INFO:tasks.rados.rados.0.smithi137.stdout:3517: expect (ObjNum 1089 snap 325 seq_num 1089) 2024-03-04T06:53:25.395 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 327 2024-03-04T06:53:25.395 INFO:tasks.rados.rados.0.smithi137.stdout:3518: seq_num 1103 ranges {13205504=475136,13680640=425984,14106624=696320,14802944=81920} 2024-03-04T06:53:25.467 INFO:tasks.rados.rados.0.smithi137.stdout:3518: writing smithi13777483-18 from 13205504 to 13680640 tid 1 2024-03-04T06:53:25.469 INFO:tasks.rados.rados.0.smithi137.stdout:3518: writing smithi13777483-18 from 13680640 to 14106624 tid 2 2024-03-04T06:53:25.473 INFO:tasks.rados.rados.0.smithi137.stdout:3518: writing smithi13777483-18 from 14106624 to 14802944 tid 3 2024-03-04T06:53:25.474 INFO:tasks.rados.rados.0.smithi137.stdout:3518: writing smithi13777483-18 from 14802944 to 14884864 tid 4 2024-03-04T06:53:25.474 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 41 current snap is 327 2024-03-04T06:53:25.474 INFO:tasks.rados.rados.0.smithi137.stdout:3516: expect (ObjNum -1164099312 snap 21906 seq_num 3130954064) 2024-03-04T06:53:25.480 INFO:tasks.rados.rados.0.smithi137.stdout:3517: expect (ObjNum 1089 snap 325 seq_num 1089) 2024-03-04T06:53:25.542 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:53:25] "GET /metrics HTTP/1.1" 200 36341 "" "Prometheus/2.43.0" 2024-03-04T06:53:25.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:25.302+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:25.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:25.302+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:25.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:25.112+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:25.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:25.113+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[88869]: osdmap e721: 8 total, 8 up, 8 in 2024-03-04T06:53:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:25.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:25.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:25.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:25.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[91314]: osdmap e721: 8 total, 8 up, 8 in 2024-03-04T06:53:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:25.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:25.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:25.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:25.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:25.302+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:25.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:25.304+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:25.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:25.302+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:25.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:25.302+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:25.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-mon[85573]: osdmap e721: 8 total, 8 up, 8 in 2024-03-04T06:53:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:25.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:25.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:25.118+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:25.598 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:25.118+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:25.598 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:25.118+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:25.632 INFO:tasks.rados.rados.0.smithi137.stdout:3518: finishing write tid 1 to smithi13777483-18 2024-03-04T06:53:25.633 INFO:tasks.rados.rados.0.smithi137.stdout:3518: finishing write tid 2 to smithi13777483-18 2024-03-04T06:53:25.633 INFO:tasks.rados.rados.0.smithi137.stdout:3519: seq_num 1104 ranges {2424832=499712,2924544=712704,3637248=491520} 2024-03-04T06:53:25.648 INFO:tasks.rados.rados.0.smithi137.stdout:3519: writing smithi13777483-41 from 2424832 to 2924544 tid 1 2024-03-04T06:53:25.652 INFO:tasks.rados.rados.0.smithi137.stdout:3519: writing smithi13777483-41 from 2924544 to 3637248 tid 2 2024-03-04T06:53:25.655 INFO:tasks.rados.rados.0.smithi137.stdout:3519: writing smithi13777483-41 from 3637248 to 4128768 tid 3 2024-03-04T06:53:25.655 INFO:tasks.rados.rados.0.smithi137.stdout:3515: done (4 left) 2024-03-04T06:53:25.655 INFO:tasks.rados.rados.0.smithi137.stdout:3516: done (3 left) 2024-03-04T06:53:25.655 INFO:tasks.rados.rados.0.smithi137.stdout:3517: done (2 left) 2024-03-04T06:53:25.655 INFO:tasks.rados.rados.0.smithi137.stdout:3520: read oid 15 snap -1 2024-03-04T06:53:25.655 INFO:tasks.rados.rados.0.smithi137.stdout:3520: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:53:25.655 INFO:tasks.rados.rados.0.smithi137.stdout:3521: read oid 13 snap -1 2024-03-04T06:53:25.655 INFO:tasks.rados.rados.0.smithi137.stdout:3521: expect (ObjNum 1045 snap 313 seq_num 1045) 2024-03-04T06:53:25.655 INFO:tasks.rados.rados.0.smithi137.stdout:3522: snap_remove snap 319 2024-03-04T06:53:26.123 INFO:tasks.rados.rados.0.smithi137.stdout:3522: done (4 left) 2024-03-04T06:53:26.123 INFO:tasks.rados.rados.0.smithi137.stdout:3523: delete oid 45 current snap is 327 2024-03-04T06:53:26.123 INFO:tasks.rados.rados.0.smithi137.stdout:3518: finishing write tid 3 to smithi13777483-18 2024-03-04T06:53:26.123 INFO:tasks.rados.rados.0.smithi137.stdout:3518: finishing write tid 4 to smithi13777483-18 2024-03-04T06:53:26.123 INFO:tasks.rados.rados.0.smithi137.stdout:3518: finishing write tid 5 to smithi13777483-18 2024-03-04T06:53:26.124 INFO:tasks.rados.rados.0.smithi137.stdout:3518: finishing write tid 6 to smithi13777483-18 2024-03-04T06:53:26.124 INFO:tasks.rados.rados.0.smithi137.stdout:3518: oid 18 updating version 0 to 16969 2024-03-04T06:53:26.124 INFO:tasks.rados.rados.0.smithi137.stdout:3518: oid 18 version 16969 is already newer than 16966 2024-03-04T06:53:26.124 INFO:tasks.rados.rados.0.smithi137.stdout:3518: oid 18 version 16969 is already newer than 16967 2024-03-04T06:53:26.124 INFO:tasks.rados.rados.0.smithi137.stdout:3518: oid 18 version 16969 is already newer than 16965 2024-03-04T06:53:26.124 INFO:tasks.rados.rados.0.smithi137.stdout:3518: oid 18 version 16969 is already newer than 16968 2024-03-04T06:53:26.124 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16969 (ObjNum 1103 snap 327 seq_num 1103) dirty exists 2024-03-04T06:53:26.124 INFO:tasks.rados.rados.0.smithi137.stdout:3518: left oid 18 (ObjNum 1103 snap 327 seq_num 1103) 2024-03-04T06:53:26.124 INFO:tasks.rados.rados.0.smithi137.stdout:3519: finishing write tid 1 to smithi13777483-41 2024-03-04T06:53:26.124 INFO:tasks.rados.rados.0.smithi137.stdout:3519: finishing write tid 2 to smithi13777483-41 2024-03-04T06:53:26.124 INFO:tasks.rados.rados.0.smithi137.stdout:3520: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:53:26.125 INFO:tasks.rados.rados.0.smithi137.stdout:3521: expect (ObjNum 1045 snap 313 seq_num 1045) 2024-03-04T06:53:26.148 INFO:tasks.rados.rados.0.smithi137.stdout:3519: finishing write tid 3 to smithi13777483-41 2024-03-04T06:53:26.148 INFO:tasks.rados.rados.0.smithi137.stdout:3519: finishing write tid 4 to smithi13777483-41 2024-03-04T06:53:26.148 INFO:tasks.rados.rados.0.smithi137.stdout:3519: finishing write tid 5 to smithi13777483-41 2024-03-04T06:53:26.148 INFO:tasks.rados.rados.0.smithi137.stdout:3519: oid 41 updating version 0 to 16968 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:3519: oid 41 updating version 16968 to 16971 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:3519: oid 41 version 16971 is already newer than 16970 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:3519: oid 41 version 16971 is already newer than 16969 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 16971 (ObjNum 1104 snap 327 seq_num 1104) dirty exists 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:3519: left oid 41 (ObjNum 1104 snap 327 seq_num 1104) 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:3518: done (4 left) 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:3519: done (3 left) 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:3520: done (2 left) 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:3521: done (1 left) 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:3523: done (0 left) 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:3524: rollback oid 47 current snap is 327 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 47 to 326 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 327 2024-03-04T06:53:26.149 INFO:tasks.rados.rados.0.smithi137.stdout:3525: seq_num 1106 ranges {0=532480,532480=483328,1015808=475136,1490944=245760} 2024-03-04T06:53:26.151 INFO:tasks.rados.rados.0.smithi137.stdout:3525: writing smithi13777483-25 from 0 to 532480 tid 1 2024-03-04T06:53:26.154 INFO:tasks.rados.rados.0.smithi137.stdout:3525: writing smithi13777483-25 from 532480 to 1015808 tid 2 2024-03-04T06:53:26.157 INFO:tasks.rados.rados.0.smithi137.stdout:3525: writing smithi13777483-25 from 1015808 to 1490944 tid 3 2024-03-04T06:53:26.159 INFO:tasks.rados.rados.0.smithi137.stdout:3525: writing smithi13777483-25 from 1490944 to 1736704 tid 4 2024-03-04T06:53:26.159 INFO:tasks.rados.rados.0.smithi137.stdout:3526: read oid 6 snap -1 2024-03-04T06:53:26.159 INFO:tasks.rados.rados.0.smithi137.stdout:3526: expect (ObjNum 1099 snap 326 seq_num 1099) 2024-03-04T06:53:26.159 INFO:tasks.rados.rados.0.smithi137.stdout:3527: rmattr oid 3 current snap is 327 2024-03-04T06:53:26.159 INFO:tasks.rados.rados.0.smithi137.stdout:3527: done (3 left) 2024-03-04T06:53:26.159 INFO:tasks.rados.rados.0.smithi137.stdout:3528: snap_create 2024-03-04T06:53:26.159 INFO:tasks.rados.rados.0.smithi137.stdout:3524: finishing rollback tid 0 to smithi13777483-47 2024-03-04T06:53:26.159 INFO:tasks.rados.rados.0.smithi137.stdout:3524: finishing rollback tid 1 to smithi13777483-47 2024-03-04T06:53:26.159 INFO:tasks.rados.rados.0.smithi137.stdout:3524: finishing rollback tid 2 to smithi13777483-47 2024-03-04T06:53:26.159 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16949 (ObjNum 959 snap 282 seq_num 959) dirty exists 2024-03-04T06:53:26.159 INFO:tasks.rados.rados.0.smithi137.stdout:3525: finishing write tid 1 to smithi13777483-25 2024-03-04T06:53:26.160 INFO:tasks.rados.rados.0.smithi137.stdout:3525: finishing write tid 2 to smithi13777483-25 2024-03-04T06:53:26.163 INFO:tasks.rados.rados.0.smithi137.stdout:3525: finishing write tid 3 to smithi13777483-25 2024-03-04T06:53:26.163 INFO:tasks.rados.rados.0.smithi137.stdout:3525: finishing write tid 4 to smithi13777483-25 2024-03-04T06:53:26.163 INFO:tasks.rados.rados.0.smithi137.stdout:3525: finishing write tid 5 to smithi13777483-25 2024-03-04T06:53:26.165 INFO:tasks.rados.rados.0.smithi137.stdout:3525: finishing write tid 6 to smithi13777483-25 2024-03-04T06:53:26.165 INFO:tasks.rados.rados.0.smithi137.stdout:3525: oid 25 updating version 0 to 16950 2024-03-04T06:53:26.165 INFO:tasks.rados.rados.0.smithi137.stdout:3525: oid 25 updating version 16950 to 16954 2024-03-04T06:53:26.165 INFO:tasks.rados.rados.0.smithi137.stdout:3525: oid 25 version 16954 is already newer than 16952 2024-03-04T06:53:26.165 INFO:tasks.rados.rados.0.smithi137.stdout:3525: oid 25 version 16954 is already newer than 16951 2024-03-04T06:53:26.165 INFO:tasks.rados.rados.0.smithi137.stdout:3525: oid 25 version 16954 is already newer than 16953 2024-03-04T06:53:26.165 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 16954 (ObjNum 1106 snap 327 seq_num 1106) dirty exists 2024-03-04T06:53:26.165 INFO:tasks.rados.rados.0.smithi137.stdout:3525: left oid 25 (ObjNum 1106 snap 327 seq_num 1106) 2024-03-04T06:53:26.173 INFO:tasks.rados.rados.0.smithi137.stdout:3526: expect (ObjNum 1099 snap 326 seq_num 1099) 2024-03-04T06:53:26.373 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:26.126+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:26.373 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:26.126+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:26.373 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:26.126+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:26.373 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:26.122+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:26.374 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[88869]: pgmap v765: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 723 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 17 MiB/s rd, 6.1 MiB/s wr, 25 op/s 2024-03-04T06:53:26.374 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:26.374 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:26.374 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[88869]: osdmap e722: 8 total, 8 up, 8 in 2024-03-04T06:53:26.374 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:26.374 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:26.374 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:26.374 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:26.374 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:26.374 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:26.374 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:26.375 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:26.375 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[91314]: pgmap v765: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 723 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 17 MiB/s rd, 6.1 MiB/s wr, 25 op/s 2024-03-04T06:53:26.375 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:26.375 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:26.375 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[91314]: osdmap e722: 8 total, 8 up, 8 in 2024-03-04T06:53:26.375 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:26.375 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:26.375 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:26.375 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:26.375 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:26.375 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:26.375 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:26.375 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:26.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:26.128+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:26.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:26.151+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:26.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:26.151+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:26.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:26.122+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:26.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:26.122+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:26.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:26.126+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:26.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:26.128+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:26.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:26.128+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-mon[85573]: pgmap v765: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 723 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 17 MiB/s rd, 6.1 MiB/s wr, 25 op/s 2024-03-04T06:53:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-mon[85573]: osdmap e722: 8 total, 8 up, 8 in 2024-03-04T06:53:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:26.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 177=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:26.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:26.372+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:27.128 INFO:tasks.rados.rados.0.smithi137.stdout:3524: done (3 left) 2024-03-04T06:53:27.129 INFO:tasks.rados.rados.0.smithi137.stdout:3525: done (2 left) 2024-03-04T06:53:27.129 INFO:tasks.rados.rados.0.smithi137.stdout:3526: done (1 left) 2024-03-04T06:53:27.129 INFO:tasks.rados.rados.0.smithi137.stdout:3528: done (0 left) 2024-03-04T06:53:27.129 INFO:tasks.rados.rados.0.smithi137.stdout:3529: read oid 6 snap -1 2024-03-04T06:53:27.129 INFO:tasks.rados.rados.0.smithi137.stdout:3529: expect (ObjNum 1099 snap 326 seq_num 1099) 2024-03-04T06:53:27.129 INFO:tasks.rados.rados.0.smithi137.stdout:3530: snap_create 2024-03-04T06:53:27.143 INFO:tasks.rados.rados.0.smithi137.stdout:3529: expect (ObjNum 1099 snap 326 seq_num 1099) 2024-03-04T06:53:27.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:27.126+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:27.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[91314]: osdmap e723: 8 total, 8 up, 8 in 2024-03-04T06:53:27.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:27.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:27.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:27.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:27.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:27.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[88869]: osdmap e723: 8 total, 8 up, 8 in 2024-03-04T06:53:27.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:27.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:27.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:27.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:27.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:27.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:27.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:27.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:27.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:27.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:27.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:27.134+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:27.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:27.130+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:27.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:27.130+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:27.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:27.136+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:27.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:27.125+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:27.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:27.125+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-mon[85573]: osdmap e723: 8 total, 8 up, 8 in 2024-03-04T06:53:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:27.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:27.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:28.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:27.829+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:28.124 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:27.830+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:28.124 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:27.831+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:28.124 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:27.831+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:28.134 INFO:tasks.rados.rados.0.smithi137.stdout:3529: done (1 left) 2024-03-04T06:53:28.134 INFO:tasks.rados.rados.0.smithi137.stdout:3530: done (0 left) 2024-03-04T06:53:28.134 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 329 2024-03-04T06:53:28.134 INFO:tasks.rados.rados.0.smithi137.stdout:3531: seq_num 1107 ranges {5152768=548864,5701632=770048,6471680=434176} 2024-03-04T06:53:28.164 INFO:tasks.rados.rados.0.smithi137.stdout:3531: writing smithi13777483-22 from 5152768 to 5701632 tid 1 2024-03-04T06:53:28.168 INFO:tasks.rados.rados.0.smithi137.stdout:3531: writing smithi13777483-22 from 5701632 to 6471680 tid 2 2024-03-04T06:53:28.171 INFO:tasks.rados.rados.0.smithi137.stdout:3531: writing smithi13777483-22 from 6471680 to 6905856 tid 3 2024-03-04T06:53:28.171 INFO:tasks.rados.rados.0.smithi137.stdout:3532: read oid 32 snap -1 2024-03-04T06:53:28.171 INFO:tasks.rados.rados.0.smithi137.stdout:3532: expect (ObjNum 1070 snap 320 seq_num 1070) 2024-03-04T06:53:28.171 INFO:tasks.rados.rados.0.smithi137.stdout:3533: snap_create 2024-03-04T06:53:28.176 INFO:tasks.rados.rados.0.smithi137.stdout:3532: expect (ObjNum 1070 snap 320 seq_num 1070) 2024-03-04T06:53:28.207 INFO:tasks.rados.rados.0.smithi137.stdout:3531: finishing write tid 1 to smithi13777483-22 2024-03-04T06:53:28.207 INFO:tasks.rados.rados.0.smithi137.stdout:3531: finishing write tid 2 to smithi13777483-22 2024-03-04T06:53:28.207 INFO:tasks.rados.rados.0.smithi137.stdout:3531: finishing write tid 3 to smithi13777483-22 2024-03-04T06:53:28.207 INFO:tasks.rados.rados.0.smithi137.stdout:3531: finishing write tid 4 to smithi13777483-22 2024-03-04T06:53:28.207 INFO:tasks.rados.rados.0.smithi137.stdout:3531: finishing write tid 5 to smithi13777483-22 2024-03-04T06:53:28.207 INFO:tasks.rados.rados.0.smithi137.stdout:3531: oid 22 updating version 0 to 16956 2024-03-04T06:53:28.208 INFO:tasks.rados.rados.0.smithi137.stdout:3531: oid 22 updating version 16956 to 16957 2024-03-04T06:53:28.208 INFO:tasks.rados.rados.0.smithi137.stdout:3531: oid 22 updating version 16957 to 16958 2024-03-04T06:53:28.208 INFO:tasks.rados.rados.0.smithi137.stdout:3531: oid 22 updating version 16958 to 16959 2024-03-04T06:53:28.208 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 16959 (ObjNum 1107 snap 329 seq_num 1107) dirty exists 2024-03-04T06:53:28.208 INFO:tasks.rados.rados.0.smithi137.stdout:3531: left oid 22 (ObjNum 1107 snap 329 seq_num 1107) 2024-03-04T06:53:28.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:28.345+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:28.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:28.134+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:28.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:28.134+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:28.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:28.134+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:28.544 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:28.345+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[88869]: pgmap v768: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 726 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 30 MiB/s rd, 6.8 MiB/s wr, 35 op/s 2024-03-04T06:53:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[88869]: osdmap e724: 8 total, 8 up, 8 in 2024-03-04T06:53:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:28.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:28.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[91314]: pgmap v768: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 726 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 30 MiB/s rd, 6.8 MiB/s wr, 35 op/s 2024-03-04T06:53:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[91314]: osdmap e724: 8 total, 8 up, 8 in 2024-03-04T06:53:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:28.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:28.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:28.167+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:28.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:28.171+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:28.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:28.172+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:28.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-mon[85573]: pgmap v768: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 726 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 30 MiB/s rd, 6.8 MiB/s wr, 35 op/s 2024-03-04T06:53:28.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:28.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:28.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:28.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-mon[85573]: osdmap e724: 8 total, 8 up, 8 in 2024-03-04T06:53:28.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:28.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:28.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:28.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:28.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:28.131+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:28.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:28.131+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:28.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:28.344+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:28.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:28.344+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:28.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:28.344+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:29.143 INFO:tasks.rados.rados.0.smithi137.stdout:3531: done (2 left) 2024-03-04T06:53:29.143 INFO:tasks.rados.rados.0.smithi137.stdout:3532: done (1 left) 2024-03-04T06:53:29.143 INFO:tasks.rados.rados.0.smithi137.stdout:3533: done (0 left) 2024-03-04T06:53:29.143 INFO:tasks.rados.rados.0.smithi137.stdout:3534: setattr oid 7 current snap is 330 2024-03-04T06:53:29.144 INFO:tasks.rados.rados.0.smithi137.stdout:3535: snap_remove snap 320 2024-03-04T06:53:29.446 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:29.141+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:29.447 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:29.149+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:29.447 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:29.447 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:29.447 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:29.448 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:29.448 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[91314]: osdmap e725: 8 total, 8 up, 8 in 2024-03-04T06:53:29.448 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:29.448 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:29.448 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:29.448 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:29.448 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:29.448 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:29.448 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:29.449 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:29.449 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:29.449 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:29.449 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:29.449 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[88869]: osdmap e725: 8 total, 8 up, 8 in 2024-03-04T06:53:29.449 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:29.449 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:29.449 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:29.449 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:29.449 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:29.449 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:29.450 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:29.450 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:29.138+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:29.450 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:29.138+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:29.450 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:29.138+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:29.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:29.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:29.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:29.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:29.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-mon[85573]: osdmap e725: 8 total, 8 up, 8 in 2024-03-04T06:53:29.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:29.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:29.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:29.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:29.451 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:29.452 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:29.452 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:29.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:29.446+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:29.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:29.446+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:29.845 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:29.446+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:29.845 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:29.447+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:29.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:29.447+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:29.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:29.446+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:30.140 INFO:tasks.rados.rados.0.smithi137.stdout:3535: done (1 left) 2024-03-04T06:53:30.141 INFO:tasks.rados.rados.0.smithi137.stdout:3536: delete oid 47 current snap is 330 2024-03-04T06:53:30.141 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16959 (ObjNum 1057 snap 318 seq_num 1057) dirty exists 2024-03-04T06:53:30.152 INFO:tasks.rados.rados.0.smithi137.stdout:3534: done (1 left) 2024-03-04T06:53:30.152 INFO:tasks.rados.rados.0.smithi137.stdout:3536: done (0 left) 2024-03-04T06:53:30.152 INFO:tasks.rados.rados.0.smithi137.stdout:3537: rmattr oid 37 current snap is 330 2024-03-04T06:53:30.153 INFO:tasks.rados.rados.0.smithi137.stdout:3538: read oid 36 snap -1 2024-03-04T06:53:30.153 INFO:tasks.rados.rados.0.smithi137.stdout:3538: expect (ObjNum 1065 snap 320 seq_num 1065) 2024-03-04T06:53:30.153 INFO:tasks.rados.rados.0.smithi137.stdout:3539: snap_create 2024-03-04T06:53:30.157 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 37 v 16960 (ObjNum 1083 snap 324 seq_num 1083) dirty exists 2024-03-04T06:53:30.161 INFO:tasks.rados.rados.0.smithi137.stdout:3538: expect (ObjNum 1065 snap 320 seq_num 1065) 2024-03-04T06:53:30.484 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:30.148+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:30.485 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:30.148+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:30.485 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:30.148+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:30.485 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:30.149+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:30.485 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:30.485 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:30.485 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: pgmap v771: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 728 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 34 MiB/s rd, 2.3 MiB/s wr, 33 op/s 2024-03-04T06:53:30.485 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:30.486 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:30.486 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:30.486 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: osdmap e726: 8 total, 8 up, 8 in 2024-03-04T06:53:30.486 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:30.486 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:30.486 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:30.486 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:30.486 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:30.486 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:30.486 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:30.486 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:30.486 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:30.487 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: pgmap v771: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 728 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 34 MiB/s rd, 2.3 MiB/s wr, 33 op/s 2024-03-04T06:53:30.487 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:30.487 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:30.487 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:30.487 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: osdmap e726: 8 total, 8 up, 8 in 2024-03-04T06:53:30.487 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:30.487 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:30.487 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:30.487 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:30.487 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:30.487 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:30.487 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:30.546 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:30.148+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:30.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:30.139+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:30.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:30.139+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:30.546 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:30.145+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:30.547 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:30.146+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:30.547 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:30.146+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:30.547 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:30.547 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:30.547 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: pgmap v771: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 728 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 34 MiB/s rd, 2.3 MiB/s wr, 33 op/s 2024-03-04T06:53:30.547 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:30.547 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:30.547 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:30.547 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: osdmap e726: 8 total, 8 up, 8 in 2024-03-04T06:53:30.547 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:30.547 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:30.547 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:30.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:30.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:30.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:30.548 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:30.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:30.484+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:30.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:30.545+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:30.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:30.545+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:31.157 INFO:tasks.rados.rados.0.smithi137.stdout:3537: done (2 left) 2024-03-04T06:53:31.157 INFO:tasks.rados.rados.0.smithi137.stdout:3538: done (1 left) 2024-03-04T06:53:31.158 INFO:tasks.rados.rados.0.smithi137.stdout:3539: done (0 left) 2024-03-04T06:53:31.158 INFO:tasks.rados.rados.0.smithi137.stdout:3540: setattr oid 19 current snap is 331 2024-03-04T06:53:31.159 INFO:tasks.rados.rados.0.smithi137.stdout:3541: copy_from oid 24 from oid 17 current snap is 331 2024-03-04T06:53:31.159 INFO:tasks.rados.rados.0.smithi137.stdout:3542: snap_create 2024-03-04T06:53:31.164 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 16967 (ObjNum 33 snap 0 seq_num 3130889376) dirty exists 2024-03-04T06:53:31.217 INFO:tasks.rados.rados.0.smithi137.stdout:3541: finishing copy_from racing read to smithi13777483-24 2024-03-04T06:53:31.219 INFO:tasks.rados.rados.0.smithi137.stdout:3541: finishing copy_from to smithi13777483-24 2024-03-04T06:53:31.219 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16966 (ObjNum 1097 snap 326 seq_num 1097) dirty exists 2024-03-04T06:53:31.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:31.203+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:31.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:31.163+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:31.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:31.163+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:31.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:31.157+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[88869]: osdmap e727: 8 total, 8 up, 8 in 2024-03-04T06:53:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:31.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:31.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[91314]: osdmap e727: 8 total, 8 up, 8 in 2024-03-04T06:53:31.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:31.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:31.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:31.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:31.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:31.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:31.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:31.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:31.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:31.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:31.163+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:31.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:31.162+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:31.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:31.204+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:31.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:31.205+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:31.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:31.153+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:31.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:31.153+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:31.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:31.153+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:31.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-mon[85573]: osdmap e727: 8 total, 8 up, 8 in 2024-03-04T06:53:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:31.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:32.156 INFO:tasks.rados.rados.0.smithi137.stdout:3540: done (2 left) 2024-03-04T06:53:32.156 INFO:tasks.rados.rados.0.smithi137.stdout:3541: done (1 left) 2024-03-04T06:53:32.156 INFO:tasks.rados.rados.0.smithi137.stdout:3542: done (0 left) 2024-03-04T06:53:32.157 INFO:tasks.rados.rados.0.smithi137.stdout:3543: read oid 6 snap -1 2024-03-04T06:53:32.157 INFO:tasks.rados.rados.0.smithi137.stdout:3543: expect (ObjNum 1099 snap 326 seq_num 1099) 2024-03-04T06:53:32.157 INFO:tasks.rados.rados.0.smithi137.stdout:3544: snap_remove snap 330 2024-03-04T06:53:32.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:32.159+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:32.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:32.274+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:32.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:32.275+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:32.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:32.275+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:32.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:32.275+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:32.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[88869]: pgmap v774: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 730 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 21 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2024-03-04T06:53:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[88869]: osdmap e728: 8 total, 8 up, 8 in 2024-03-04T06:53:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:32.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:32.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[91314]: pgmap v774: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 730 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 21 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2024-03-04T06:53:32.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:32.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:32.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[91314]: osdmap e728: 8 total, 8 up, 8 in 2024-03-04T06:53:32.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:32.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:32.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:32.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:32.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:32.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:32.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:32.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:32.161+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:32.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:32.158+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:32.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:32.160+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:32.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:32.274+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:32.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:32.274+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:32.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:32.274+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:32.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:32.274+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:32.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:32.274+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:32.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-mon[85573]: pgmap v774: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 730 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 21 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2024-03-04T06:53:32.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:32.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:32.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-mon[85573]: osdmap e728: 8 total, 8 up, 8 in 2024-03-04T06:53:32.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:32.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:32.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:32.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:32.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:32.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:32.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:33.160 INFO:tasks.rados.rados.0.smithi137.stdout:3544: done (1 left) 2024-03-04T06:53:33.160 INFO:tasks.rados.rados.0.smithi137.stdout:3545: read oid 20 snap -1 2024-03-04T06:53:33.160 INFO:tasks.rados.rados.0.smithi137.stdout:3545: expect (ObjNum 1082 snap 324 seq_num 1082) 2024-03-04T06:53:33.160 INFO:tasks.rados.rados.0.smithi137.stdout:3546: delete oid 44 current snap is 332 2024-03-04T06:53:33.160 INFO:tasks.rados.rados.0.smithi137.stdout:3543: expect (ObjNum 1099 snap 326 seq_num 1099) 2024-03-04T06:53:33.259 INFO:tasks.rados.rados.0.smithi137.stdout:3545: expect (ObjNum 1082 snap 324 seq_num 1082) 2024-03-04T06:53:33.294 INFO:tasks.rados.rados.0.smithi137.stdout:3543: done (2 left) 2024-03-04T06:53:33.294 INFO:tasks.rados.rados.0.smithi137.stdout:3545: done (1 left) 2024-03-04T06:53:33.294 INFO:tasks.rados.rados.0.smithi137.stdout:3546: done (0 left) 2024-03-04T06:53:33.294 INFO:tasks.rados.rados.0.smithi137.stdout:3547: rollback oid 11 current snap is 332 2024-03-04T06:53:33.295 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 11 to 301 2024-03-04T06:53:33.295 INFO:tasks.rados.rados.0.smithi137.stdout:3548: delete oid 24 current snap is 332 2024-03-04T06:53:33.297 INFO:tasks.rados.rados.0.smithi137.stdout:3547: finishing rollback tid 1 to smithi13777483-11 2024-03-04T06:53:33.297 INFO:tasks.rados.rados.0.smithi137.stdout:3547: finishing rollback tid 2 to smithi13777483-11 2024-03-04T06:53:33.297 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16961 (ObjNum 989 snap 290 seq_num 989) dirty exists 2024-03-04T06:53:33.302 INFO:tasks.rados.rados.0.smithi137.stdout:3547: done (1 left) 2024-03-04T06:53:33.302 INFO:tasks.rados.rados.0.smithi137.stdout:3548: done (0 left) 2024-03-04T06:53:33.302 INFO:tasks.rados.rados.0.smithi137.stdout:3549: snap_remove snap 318 2024-03-04T06:53:33.500 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:33.170+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:33.500 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:33.159+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:33.500 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:33.159+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:33.500 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:33.159+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:33.501 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:33.167+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:33.501 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:33.501 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:33.501 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-mon[85573]: osdmap e729: 8 total, 8 up, 8 in 2024-03-04T06:53:33.501 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:33.501 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:33.501 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:33.501 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:33.501 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:33.502 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:33.502 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:33.502 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:33.502 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-mon[85573]: osdmap e730: 8 total, 8 up, 8 in 2024-03-04T06:53:33.542 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:33.164+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:33.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:33.170+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:33.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:33.159+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:33.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:33.170+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:33.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:33.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:33.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[88869]: osdmap e729: 8 total, 8 up, 8 in 2024-03-04T06:53:33.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:33.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:33.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:33.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:33.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:33.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:33.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:33.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:33.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[88869]: osdmap e730: 8 total, 8 up, 8 in 2024-03-04T06:53:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[91314]: osdmap e729: 8 total, 8 up, 8 in 2024-03-04T06:53:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:33.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:33 smithi137 ceph-mon[91314]: osdmap e730: 8 total, 8 up, 8 in 2024-03-04T06:53:33.845 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:33.498+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:33.845 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:33.498+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:34.177 INFO:tasks.rados.rados.0.smithi137.stdout:3549: done (0 left) 2024-03-04T06:53:34.177 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 46 current snap is 332 2024-03-04T06:53:34.177 INFO:tasks.rados.rados.0.smithi137.stdout:3550: seq_num 1111 ranges {1466368=614400,2080768=753664,2834432=450560} 2024-03-04T06:53:34.189 INFO:tasks.rados.rados.0.smithi137.stdout:3550: writing smithi13777483-46 from 1466368 to 2080768 tid 1 2024-03-04T06:53:34.194 INFO:tasks.rados.rados.0.smithi137.stdout:3550: writing smithi13777483-46 from 2080768 to 2834432 tid 2 2024-03-04T06:53:34.197 INFO:tasks.rados.rados.0.smithi137.stdout:3550: writing smithi13777483-46 from 2834432 to 3284992 tid 3 2024-03-04T06:53:34.197 INFO:tasks.rados.rados.0.smithi137.stdout:3551: rmattr oid 27 current snap is 332 2024-03-04T06:53:34.198 INFO:tasks.rados.rados.0.smithi137.stdout:3550: finishing write tid 1 to smithi13777483-46 2024-03-04T06:53:34.198 INFO:tasks.rados.rados.0.smithi137.stdout:3552: delete oid 11 current snap is 332 2024-03-04T06:53:34.198 INFO:tasks.rados.rados.0.smithi137.stdout:3550: finishing write tid 2 to smithi13777483-46 2024-03-04T06:53:34.201 INFO:tasks.rados.rados.0.smithi137.stdout:3552: done (2 left) 2024-03-04T06:53:34.201 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 332 2024-03-04T06:53:34.201 INFO:tasks.rados.rados.0.smithi137.stdout:3553: seq_num 1113 ranges {1007616=647168,1654784=524288,2179072=622592,2801664=57344} 2024-03-04T06:53:34.210 INFO:tasks.rados.rados.0.smithi137.stdout:3553: writing smithi13777483-2 from 1007616 to 1654784 tid 1 2024-03-04T06:53:34.213 INFO:tasks.rados.rados.0.smithi137.stdout:3553: writing smithi13777483-2 from 1654784 to 2179072 tid 2 2024-03-04T06:53:34.217 INFO:tasks.rados.rados.0.smithi137.stdout:3553: writing smithi13777483-2 from 2179072 to 2801664 tid 3 2024-03-04T06:53:34.218 INFO:tasks.rados.rados.0.smithi137.stdout:3553: writing smithi13777483-2 from 2801664 to 2859008 tid 4 2024-03-04T06:53:34.218 INFO:tasks.rados.rados.0.smithi137.stdout:3554: read oid 21 snap 315 2024-03-04T06:53:34.218 INFO:tasks.rados.rados.0.smithi137.stdout:3554: expect deleted 2024-03-04T06:53:34.218 INFO:tasks.rados.rados.0.smithi137.stdout:3555: read oid 50 snap -1 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:3555: expect deleted 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:3550: finishing write tid 3 to smithi13777483-46 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:3550: finishing write tid 4 to smithi13777483-46 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:3550: finishing write tid 5 to smithi13777483-46 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:3550: oid 46 updating version 0 to 16984 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:3550: oid 46 version 16984 is already newer than 16982 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:3550: oid 46 updating version 16984 to 16985 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:3550: oid 46 version 16985 is already newer than 16983 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 16985 (ObjNum 1111 snap 332 seq_num 1111) dirty exists 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:3550: left oid 46 (ObjNum 1111 snap 332 seq_num 1111) 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16986 (ObjNum 1095 snap 326 seq_num 1095) dirty exists 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:3553: finishing write tid 1 to smithi13777483-2 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:3553: finishing write tid 2 to smithi13777483-2 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:3556: read oid 41 snap -1 2024-03-04T06:53:34.219 INFO:tasks.rados.rados.0.smithi137.stdout:3556: expect (ObjNum 1104 snap 327 seq_num 1104) 2024-03-04T06:53:34.220 INFO:tasks.rados.rados.0.smithi137.stdout:3550: done (5 left) 2024-03-04T06:53:34.220 INFO:tasks.rados.rados.0.smithi137.stdout:3551: done (4 left) 2024-03-04T06:53:34.220 INFO:tasks.rados.rados.0.smithi137.stdout:3557: read oid 31 snap -1 2024-03-04T06:53:34.220 INFO:tasks.rados.rados.0.smithi137.stdout:3557: expect deleted 2024-03-04T06:53:34.220 INFO:tasks.rados.rados.0.smithi137.stdout:3558: setattr oid 13 current snap is 332 2024-03-04T06:53:34.220 INFO:tasks.rados.rados.0.smithi137.stdout:3554: done (5 left) 2024-03-04T06:53:34.221 INFO:tasks.rados.rados.0.smithi137.stdout:3555: done (4 left) 2024-03-04T06:53:34.221 INFO:tasks.rados.rados.0.smithi137.stdout:3557: done (3 left) 2024-03-04T06:53:34.221 INFO:tasks.rados.rados.0.smithi137.stdout:3559: read oid 27 snap -1 2024-03-04T06:53:34.221 INFO:tasks.rados.rados.0.smithi137.stdout:3559: expect (ObjNum 1095 snap 326 seq_num 1095) 2024-03-04T06:53:34.221 INFO:tasks.rados.rados.0.smithi137.stdout:3560: delete oid 21 current snap is 332 2024-03-04T06:53:34.222 INFO:tasks.rados.rados.0.smithi137.stdout:3553: finishing write tid 3 to smithi13777483-2 2024-03-04T06:53:34.222 INFO:tasks.rados.rados.0.smithi137.stdout:3553: finishing write tid 4 to smithi13777483-2 2024-03-04T06:53:34.223 INFO:tasks.rados.rados.0.smithi137.stdout:3553: finishing write tid 5 to smithi13777483-2 2024-03-04T06:53:34.224 INFO:tasks.rados.rados.0.smithi137.stdout:3560: done (4 left) 2024-03-04T06:53:34.224 INFO:tasks.rados.rados.0.smithi137.stdout:3561: snap_create 2024-03-04T06:53:34.225 INFO:tasks.rados.rados.0.smithi137.stdout:3553: finishing write tid 6 to smithi13777483-2 2024-03-04T06:53:34.225 INFO:tasks.rados.rados.0.smithi137.stdout:3553: oid 2 updating version 0 to 16925 2024-03-04T06:53:34.225 INFO:tasks.rados.rados.0.smithi137.stdout:3553: oid 2 version 16925 is already newer than 16924 2024-03-04T06:53:34.225 INFO:tasks.rados.rados.0.smithi137.stdout:3553: oid 2 updating version 16925 to 16926 2024-03-04T06:53:34.225 INFO:tasks.rados.rados.0.smithi137.stdout:3553: oid 2 version 16926 is already newer than 16923 2024-03-04T06:53:34.225 INFO:tasks.rados.rados.0.smithi137.stdout:3553: oid 2 version 16926 is already newer than 16922 2024-03-04T06:53:34.225 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16926 (ObjNum 1113 snap 332 seq_num 1113) dirty exists 2024-03-04T06:53:34.225 INFO:tasks.rados.rados.0.smithi137.stdout:3553: left oid 2 (ObjNum 1113 snap 332 seq_num 1113) 2024-03-04T06:53:34.228 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16987 (ObjNum 1045 snap 313 seq_num 1045) dirty exists 2024-03-04T06:53:34.249 INFO:tasks.rados.rados.0.smithi137.stdout:3556: expect (ObjNum 1104 snap 327 seq_num 1104) 2024-03-04T06:53:34.428 INFO:tasks.rados.rados.0.smithi137.stdout:3559: expect (ObjNum 1095 snap 326 seq_num 1095) 2024-03-04T06:53:34.542 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:34.182+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:34.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:34.201+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:34.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:34.177+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:34.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:34.178+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:34.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:34.178+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[88869]: pgmap v777: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 730 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 416 KiB/s wr, 6 op/s 2024-03-04T06:53:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:34.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:34.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:34.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:34.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[91314]: pgmap v777: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 730 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 416 KiB/s wr, 6 op/s 2024-03-04T06:53:34.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:34.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:34.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:34.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:34.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:34.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:34.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:34.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:34.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:34.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:34.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:34.182+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:34.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:34.174+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:34.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:34.175+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:34.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:34.334+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:34.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:34.334+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:34.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:34.180+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:34.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:34.182+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:34.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:34.182+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:34.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:34.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:34.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-mon[85573]: pgmap v777: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 730 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 416 KiB/s wr, 6 op/s 2024-03-04T06:53:34.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:34.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:34.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:34.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:34.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:34.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:34.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:34.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:34.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:34.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:35.182 INFO:tasks.rados.rados.0.smithi137.stdout:3553: done (4 left) 2024-03-04T06:53:35.182 INFO:tasks.rados.rados.0.smithi137.stdout:3556: done (3 left) 2024-03-04T06:53:35.182 INFO:tasks.rados.rados.0.smithi137.stdout:3558: done (2 left) 2024-03-04T06:53:35.182 INFO:tasks.rados.rados.0.smithi137.stdout:3559: done (1 left) 2024-03-04T06:53:35.182 INFO:tasks.rados.rados.0.smithi137.stdout:3561: done (0 left) 2024-03-04T06:53:35.182 INFO:tasks.rados.rados.0.smithi137.stdout:3562: copy_from oid 1 from oid 28 current snap is 333 2024-03-04T06:53:35.182 INFO:tasks.rados.rados.0.smithi137.stdout:3563: delete oid 34 current snap is 333 2024-03-04T06:53:35.190 INFO:tasks.rados.rados.0.smithi137.stdout:3563: done (1 left) 2024-03-04T06:53:35.190 INFO:tasks.rados.rados.0.smithi137.stdout:3564: snap_create 2024-03-04T06:53:35.230 INFO:tasks.rados.rados.0.smithi137.stdout:3562: finishing copy_from racing read to smithi13777483-1 2024-03-04T06:53:35.233 INFO:tasks.rados.rados.0.smithi137.stdout:3562: finishing copy_from to smithi13777483-1 2024-03-04T06:53:35.233 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 16946 (ObjNum 1096 snap 326 seq_num 1096) dirty exists 2024-03-04T06:53:35.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:53:35] "GET /metrics HTTP/1.1" 200 36341 "" "Prometheus/2.43.0" 2024-03-04T06:53:35.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:35.187+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:35.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:35.181+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:35.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:35.186+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:35.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:35.188+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[91314]: osdmap e731: 8 total, 8 up, 8 in 2024-03-04T06:53:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:35.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:35.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[88869]: osdmap e731: 8 total, 8 up, 8 in 2024-03-04T06:53:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:35.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:35.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:35.183+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:35.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-mon[85573]: osdmap e731: 8 total, 8 up, 8 in 2024-03-04T06:53:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:35.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:35.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:35.189+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:35.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:35.189+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:35.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:35.189+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:36.179 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:35.847+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:36.180 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:35.846+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:36.180 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:35.847+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:36.190 INFO:tasks.rados.rados.0.smithi137.stdout:3562: done (1 left) 2024-03-04T06:53:36.190 INFO:tasks.rados.rados.0.smithi137.stdout:3564: done (0 left) 2024-03-04T06:53:36.190 INFO:tasks.rados.rados.0.smithi137.stdout:3565: copy_from oid 44 from oid 13 current snap is 334 2024-03-04T06:53:36.191 INFO:tasks.rados.rados.0.smithi137.stdout:3566: snap_remove snap 309 2024-03-04T06:53:36.542 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:36.374+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:36.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:36.190+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:36.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:36.193+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:36.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:36.193+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:36.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:36.194+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[88869]: pgmap v780: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 743 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 13 op/s 2024-03-04T06:53:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[88869]: osdmap e732: 8 total, 8 up, 8 in 2024-03-04T06:53:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:36.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:36.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[91314]: pgmap v780: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 743 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 13 op/s 2024-03-04T06:53:36.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:36.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[91314]: osdmap e732: 8 total, 8 up, 8 in 2024-03-04T06:53:36.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:36.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:36.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:36.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:36.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:36.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:36.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:36.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:36.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:36.196+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:36.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:36.191+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:36.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:36.191+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:36.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:36.374+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:36.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:36.374+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:36.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:36.374+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:36.199+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:36.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:36.199+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-mon[85573]: pgmap v780: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 743 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 13 op/s 2024-03-04T06:53:36.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:36.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-mon[85573]: osdmap e732: 8 total, 8 up, 8 in 2024-03-04T06:53:36.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:36.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:36.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:36.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:36.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:36.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:36.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:36.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:37.198 INFO:tasks.rados.rados.0.smithi137.stdout:3566: done (1 left) 2024-03-04T06:53:37.199 INFO:tasks.rados.rados.0.smithi137.stdout:3567: copy_from oid 12 from oid 17 current snap is 334 2024-03-04T06:53:37.199 INFO:tasks.rados.rados.0.smithi137.stdout:3568: delete oid 3 current snap is 334 2024-03-04T06:53:37.199 INFO:tasks.rados.rados.0.smithi137.stdout:3565: finishing copy_from racing read to smithi13777483-44 2024-03-04T06:53:37.199 INFO:tasks.rados.rados.0.smithi137.stdout:3565: finishing copy_from to smithi13777483-44 2024-03-04T06:53:37.199 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16987 (ObjNum 1045 snap 313 seq_num 1045) dirty exists 2024-03-04T06:53:37.205 INFO:tasks.rados.rados.0.smithi137.stdout:3565: done (2 left) 2024-03-04T06:53:37.205 INFO:tasks.rados.rados.0.smithi137.stdout:3568: done (1 left) 2024-03-04T06:53:37.205 INFO:tasks.rados.rados.0.smithi137.stdout:3569: read oid 47 snap -1 2024-03-04T06:53:37.205 INFO:tasks.rados.rados.0.smithi137.stdout:3569: expect deleted 2024-03-04T06:53:37.205 INFO:tasks.rados.rados.0.smithi137.stdout:3570: read oid 43 snap -1 2024-03-04T06:53:37.205 INFO:tasks.rados.rados.0.smithi137.stdout:3570: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:53:37.205 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 334 2024-03-04T06:53:37.205 INFO:tasks.rados.rados.0.smithi137.stdout:3571: seq_num 1117 ranges {4366336=712704,5079040=458752,5537792=655360,6193152=90112} 2024-03-04T06:53:37.233 INFO:tasks.rados.rados.0.smithi137.stdout:3571: writing smithi13777483-14 from 4366336 to 5079040 tid 1 2024-03-04T06:53:37.236 INFO:tasks.rados.rados.0.smithi137.stdout:3571: writing smithi13777483-14 from 5079040 to 5537792 tid 2 2024-03-04T06:53:37.240 INFO:tasks.rados.rados.0.smithi137.stdout:3571: writing smithi13777483-14 from 5537792 to 6193152 tid 3 2024-03-04T06:53:37.240 INFO:tasks.rados.rados.0.smithi137.stdout:3571: writing smithi13777483-14 from 6193152 to 6283264 tid 4 2024-03-04T06:53:37.241 INFO:tasks.rados.rados.0.smithi137.stdout:3572: snap_create 2024-03-04T06:53:37.241 INFO:tasks.rados.rados.0.smithi137.stdout:3570: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:53:37.362 INFO:tasks.rados.rados.0.smithi137.stdout:3571: finishing write tid 1 to smithi13777483-14 2024-03-04T06:53:37.363 INFO:tasks.rados.rados.0.smithi137.stdout:3571: finishing write tid 2 to smithi13777483-14 2024-03-04T06:53:37.363 INFO:tasks.rados.rados.0.smithi137.stdout:3571: finishing write tid 3 to smithi13777483-14 2024-03-04T06:53:37.363 INFO:tasks.rados.rados.0.smithi137.stdout:3571: finishing write tid 4 to smithi13777483-14 2024-03-04T06:53:37.363 INFO:tasks.rados.rados.0.smithi137.stdout:3571: finishing write tid 5 to smithi13777483-14 2024-03-04T06:53:37.363 INFO:tasks.rados.rados.0.smithi137.stdout:3571: finishing write tid 6 to smithi13777483-14 2024-03-04T06:53:37.363 INFO:tasks.rados.rados.0.smithi137.stdout:3571: oid 14 updating version 0 to 16932 2024-03-04T06:53:37.363 INFO:tasks.rados.rados.0.smithi137.stdout:3571: oid 14 updating version 16932 to 16936 2024-03-04T06:53:37.363 INFO:tasks.rados.rados.0.smithi137.stdout:3571: oid 14 version 16936 is already newer than 16934 2024-03-04T06:53:37.364 INFO:tasks.rados.rados.0.smithi137.stdout:3571: oid 14 version 16936 is already newer than 16935 2024-03-04T06:53:37.364 INFO:tasks.rados.rados.0.smithi137.stdout:3571: oid 14 version 16936 is already newer than 16933 2024-03-04T06:53:37.364 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 16936 (ObjNum 1117 snap 334 seq_num 1117) dirty exists 2024-03-04T06:53:37.364 INFO:tasks.rados.rados.0.smithi137.stdout:3571: left oid 14 (ObjNum 1117 snap 334 seq_num 1117) 2024-03-04T06:53:37.364 INFO:tasks.rados.rados.0.smithi137.stdout:3567: finishing copy_from racing read to smithi13777483-12 2024-03-04T06:53:37.364 INFO:tasks.rados.rados.0.smithi137.stdout:3567: finishing copy_from to smithi13777483-12 2024-03-04T06:53:37.364 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16966 (ObjNum 1097 snap 326 seq_num 1097) dirty exists 2024-03-04T06:53:37.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:37.200+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:37.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:37.203+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:37.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:37.203+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:37.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:37.197+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:37.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:37.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[88869]: osdmap e733: 8 total, 8 up, 8 in 2024-03-04T06:53:37.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:37.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:37.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:37.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:37.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:37.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:37.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:37.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:37.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:37.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:37.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:37.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[91314]: osdmap e733: 8 total, 8 up, 8 in 2024-03-04T06:53:37.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:37.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:37.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:37.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:37.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:37.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:37.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:37.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:37.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:37.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:37.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:37.201+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:37.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:37.197+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:37.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:37.197+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:37.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:37.197+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:37.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:37.209+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:37.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:37.211+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:37.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:37.240+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-mon[85573]: osdmap e733: 8 total, 8 up, 8 in 2024-03-04T06:53:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:37.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:37.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:37.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:37.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:37.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:37.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:38.199 INFO:tasks.rados.rados.0.smithi137.stdout:3567: done (4 left) 2024-03-04T06:53:38.199 INFO:tasks.rados.rados.0.smithi137.stdout:3569: done (3 left) 2024-03-04T06:53:38.199 INFO:tasks.rados.rados.0.smithi137.stdout:3570: done (2 left) 2024-03-04T06:53:38.199 INFO:tasks.rados.rados.0.smithi137.stdout:3571: done (1 left) 2024-03-04T06:53:38.199 INFO:tasks.rados.rados.0.smithi137.stdout:3572: done (0 left) 2024-03-04T06:53:38.199 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 335 2024-03-04T06:53:38.199 INFO:tasks.rados.rados.0.smithi137.stdout:3573: seq_num 1118 ranges {0=729088,729088=794624,1523712=409600} 2024-03-04T06:53:38.203 INFO:tasks.rados.rados.0.smithi137.stdout:3573: writing smithi13777483-42 from 0 to 729088 tid 1 2024-03-04T06:53:38.208 INFO:tasks.rados.rados.0.smithi137.stdout:3573: writing smithi13777483-42 from 729088 to 1523712 tid 2 2024-03-04T06:53:38.211 INFO:tasks.rados.rados.0.smithi137.stdout:3573: writing smithi13777483-42 from 1523712 to 1933312 tid 3 2024-03-04T06:53:38.211 INFO:tasks.rados.rados.0.smithi137.stdout:3574: read oid 41 snap -1 2024-03-04T06:53:38.211 INFO:tasks.rados.rados.0.smithi137.stdout:3574: expect (ObjNum 1104 snap 327 seq_num 1104) 2024-03-04T06:53:38.211 INFO:tasks.rados.rados.0.smithi137.stdout:3575: snap_create 2024-03-04T06:53:38.211 INFO:tasks.rados.rados.0.smithi137.stdout:3573: finishing write tid 1 to smithi13777483-42 2024-03-04T06:53:38.215 INFO:tasks.rados.rados.0.smithi137.stdout:3573: finishing write tid 2 to smithi13777483-42 2024-03-04T06:53:38.215 INFO:tasks.rados.rados.0.smithi137.stdout:3573: finishing write tid 3 to smithi13777483-42 2024-03-04T06:53:38.216 INFO:tasks.rados.rados.0.smithi137.stdout:3573: finishing write tid 4 to smithi13777483-42 2024-03-04T06:53:38.218 INFO:tasks.rados.rados.0.smithi137.stdout:3573: finishing write tid 5 to smithi13777483-42 2024-03-04T06:53:38.218 INFO:tasks.rados.rados.0.smithi137.stdout:3573: oid 42 updating version 0 to 16990 2024-03-04T06:53:38.218 INFO:tasks.rados.rados.0.smithi137.stdout:3573: oid 42 updating version 16990 to 16991 2024-03-04T06:53:38.218 INFO:tasks.rados.rados.0.smithi137.stdout:3573: oid 42 version 16991 is already newer than 16989 2024-03-04T06:53:38.218 INFO:tasks.rados.rados.0.smithi137.stdout:3573: oid 42 version 16991 is already newer than 16988 2024-03-04T06:53:38.218 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16991 (ObjNum 1118 snap 335 seq_num 1118) dirty exists 2024-03-04T06:53:38.218 INFO:tasks.rados.rados.0.smithi137.stdout:3573: left oid 42 (ObjNum 1118 snap 335 seq_num 1118) 2024-03-04T06:53:38.232 INFO:tasks.rados.rados.0.smithi137.stdout:3574: expect (ObjNum 1104 snap 327 seq_num 1104) 2024-03-04T06:53:38.542 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:38.199+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:38.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[88869]: pgmap v783: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 743 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 5.7 MiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-03-04T06:53:38.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:38.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[88869]: osdmap e734: 8 total, 8 up, 8 in 2024-03-04T06:53:38.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:38.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:38.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:38.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:38.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[91314]: pgmap v783: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 743 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 5.7 MiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-03-04T06:53:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[91314]: osdmap e734: 8 total, 8 up, 8 in 2024-03-04T06:53:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:38.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:38.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:38.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:38.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:38.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:38.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:38.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:38.195+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:38.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:38.213+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:38.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:38.216+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:38.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:38.216+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:38.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:38.275+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:38.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:38.275+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-mon[85573]: pgmap v783: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 743 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 5.7 MiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-03-04T06:53:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:38.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-mon[85573]: osdmap e734: 8 total, 8 up, 8 in 2024-03-04T06:53:38.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:38.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:38.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:38.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:38.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:38.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:38.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:38.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:38.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:39.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:38.831+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:39.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:38.831+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:39.210 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:38.831+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:39.210 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:38.832+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:39.210 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:38.832+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:39.210 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:38.832+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:39.215 INFO:tasks.rados.rados.0.smithi137.stdout:3573: done (2 left) 2024-03-04T06:53:39.215 INFO:tasks.rados.rados.0.smithi137.stdout:3574: done (1 left) 2024-03-04T06:53:39.215 INFO:tasks.rados.rados.0.smithi137.stdout:3575: done (0 left) 2024-03-04T06:53:39.215 INFO:tasks.rados.rados.0.smithi137.stdout:3576: copy_from oid 39 from oid 30 current snap is 336 2024-03-04T06:53:39.215 INFO:tasks.rados.rados.0.smithi137.stdout:3577: read oid 40 snap -1 2024-03-04T06:53:39.215 INFO:tasks.rados.rados.0.smithi137.stdout:3577: expect deleted 2024-03-04T06:53:39.216 INFO:tasks.rados.rados.0.smithi137.stdout:3578: read oid 43 snap -1 2024-03-04T06:53:39.216 INFO:tasks.rados.rados.0.smithi137.stdout:3578: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:53:39.216 INFO:tasks.rados.rados.0.smithi137.stdout:3579: snap_remove snap 335 2024-03-04T06:53:39.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:39.213+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:39.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:39.238+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:39.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:39.239+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:39.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:39.225+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[91314]: osdmap e735: 8 total, 8 up, 8 in 2024-03-04T06:53:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:53:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:39.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:39.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[88869]: osdmap e735: 8 total, 8 up, 8 in 2024-03-04T06:53:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:53:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:39.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:39.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:39.222+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:39.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:39.218+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-mon[85573]: osdmap e735: 8 total, 8 up, 8 in 2024-03-04T06:53:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:53:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:39.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:39.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:39.211+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:39.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:39.211+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:39.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:39.211+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:39.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:39.402+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:39.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:39.403+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:40.217 INFO:tasks.rados.rados.0.smithi137.stdout:3579: done (3 left) 2024-03-04T06:53:40.217 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 336 2024-03-04T06:53:40.218 INFO:tasks.rados.rados.0.smithi137.stdout:3580: seq_num 1119 ranges {0=745472,745472=679936,1425408=524288} 2024-03-04T06:53:40.222 INFO:tasks.rados.rados.0.smithi137.stdout:3580: writing smithi13777483-11 from 0 to 745472 tid 1 2024-03-04T06:53:40.226 INFO:tasks.rados.rados.0.smithi137.stdout:3580: writing smithi13777483-11 from 745472 to 1425408 tid 2 2024-03-04T06:53:40.229 INFO:tasks.rados.rados.0.smithi137.stdout:3580: writing smithi13777483-11 from 1425408 to 1949696 tid 3 2024-03-04T06:53:40.230 INFO:tasks.rados.rados.0.smithi137.stdout:3581: snap_create 2024-03-04T06:53:40.230 INFO:tasks.rados.rados.0.smithi137.stdout:3578: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:53:40.351 INFO:tasks.rados.rados.0.smithi137.stdout:3576: finishing copy_from racing read to smithi13777483-39 2024-03-04T06:53:40.352 INFO:tasks.rados.rados.0.smithi137.stdout:3576: finishing copy_from to smithi13777483-39 2024-03-04T06:53:40.352 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 16917 (ObjNum 982 snap 287 seq_num 982) dirty exists 2024-03-04T06:53:40.352 INFO:tasks.rados.rados.0.smithi137.stdout:3580: finishing write tid 1 to smithi13777483-11 2024-03-04T06:53:40.352 INFO:tasks.rados.rados.0.smithi137.stdout:3580: finishing write tid 2 to smithi13777483-11 2024-03-04T06:53:40.352 INFO:tasks.rados.rados.0.smithi137.stdout:3580: finishing write tid 3 to smithi13777483-11 2024-03-04T06:53:40.352 INFO:tasks.rados.rados.0.smithi137.stdout:3580: finishing write tid 4 to smithi13777483-11 2024-03-04T06:53:40.352 INFO:tasks.rados.rados.0.smithi137.stdout:3580: finishing write tid 5 to smithi13777483-11 2024-03-04T06:53:40.352 INFO:tasks.rados.rados.0.smithi137.stdout:3580: oid 11 updating version 0 to 16966 2024-03-04T06:53:40.352 INFO:tasks.rados.rados.0.smithi137.stdout:3580: oid 11 version 16966 is already newer than 16964 2024-03-04T06:53:40.352 INFO:tasks.rados.rados.0.smithi137.stdout:3580: oid 11 version 16966 is already newer than 16965 2024-03-04T06:53:40.352 INFO:tasks.rados.rados.0.smithi137.stdout:3580: oid 11 version 16966 is already newer than 16963 2024-03-04T06:53:40.353 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16966 (ObjNum 1119 snap 336 seq_num 1119) dirty exists 2024-03-04T06:53:40.353 INFO:tasks.rados.rados.0.smithi137.stdout:3580: left oid 11 (ObjNum 1119 snap 336 seq_num 1119) 2024-03-04T06:53:40.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:40.228+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:40.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:40.226+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:40.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:40.218+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:40.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:40.218+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:40.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:40.218+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: pgmap v786: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 774 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 12 MiB/s rd, 7.9 MiB/s wr, 19 op/s 2024-03-04T06:53:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:40.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: osdmap e736: 8 total, 8 up, 8 in 2024-03-04T06:53:40.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:40.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:40.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:40.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:40.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:40.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:40.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:40.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: pgmap v786: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 774 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 12 MiB/s rd, 7.9 MiB/s wr, 19 op/s 2024-03-04T06:53:40.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:40.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:40.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:40.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:40.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:40.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: osdmap e736: 8 total, 8 up, 8 in 2024-03-04T06:53:40.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:40.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:40.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:40.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:40.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:40.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:40.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:40.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:40.215+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:40.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:40.215+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:40.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:40.238+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:40.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:40.236+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:40.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:40.237+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:40.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:40.237+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:40.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:40.237+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:40.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:40.237+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: pgmap v786: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 774 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 12 MiB/s rd, 7.9 MiB/s wr, 19 op/s 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: osdmap e736: 8 total, 8 up, 8 in 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset 153=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:40.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:41.225 INFO:tasks.rados.rados.0.smithi137.stdout:3576: done (4 left) 2024-03-04T06:53:41.225 INFO:tasks.rados.rados.0.smithi137.stdout:3577: done (3 left) 2024-03-04T06:53:41.225 INFO:tasks.rados.rados.0.smithi137.stdout:3578: done (2 left) 2024-03-04T06:53:41.225 INFO:tasks.rados.rados.0.smithi137.stdout:3580: done (1 left) 2024-03-04T06:53:41.225 INFO:tasks.rados.rados.0.smithi137.stdout:3581: done (0 left) 2024-03-04T06:53:41.225 INFO:tasks.rados.rados.0.smithi137.stdout:3582: delete oid 27 current snap is 337 2024-03-04T06:53:41.229 INFO:tasks.rados.rados.0.smithi137.stdout:3582: done (0 left) 2024-03-04T06:53:41.229 INFO:tasks.rados.rados.0.smithi137.stdout:3583: copy_from oid 7 from oid 11 current snap is 337 2024-03-04T06:53:41.229 INFO:tasks.rados.rados.0.smithi137.stdout:3584: snap_create 2024-03-04T06:53:41.241 INFO:tasks.rados.rados.0.smithi137.stdout:3583: finishing copy_from racing read to smithi13777483-7 2024-03-04T06:53:41.243 INFO:tasks.rados.rados.0.smithi137.stdout:3583: finishing copy_from to smithi13777483-7 2024-03-04T06:53:41.243 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16966 (ObjNum 1119 snap 336 seq_num 1119) dirty exists 2024-03-04T06:53:41.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:41.223+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:41.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:41.223+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:41.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:41.228+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:41.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:41.231+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[88869]: osdmap e737: 8 total, 8 up, 8 in 2024-03-04T06:53:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:41.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:41.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:41.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[91314]: osdmap e737: 8 total, 8 up, 8 in 2024-03-04T06:53:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:41.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:41.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:41.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:41.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:41.228+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:41.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:41.223+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:41.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:41.223+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:41.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:41.223+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-mon[85573]: osdmap e737: 8 total, 8 up, 8 in 2024-03-04T06:53:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:41.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:41.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:41.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:41.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:41.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:41.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:41.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:42.236 INFO:tasks.rados.rados.0.smithi137.stdout:3583: done (1 left) 2024-03-04T06:53:42.236 INFO:tasks.rados.rados.0.smithi137.stdout:3584: done (0 left) 2024-03-04T06:53:42.236 INFO:tasks.rados.rados.0.smithi137.stdout:3585: rmattr oid 22 current snap is 338 2024-03-04T06:53:42.236 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 6 current snap is 338 2024-03-04T06:53:42.236 INFO:tasks.rados.rados.0.smithi137.stdout:3586: seq_num 1121 ranges {2801664=778240,3579904=442368,4022272=638976,4661248=122880} 2024-03-04T06:53:42.255 INFO:tasks.rados.rados.0.smithi137.stdout:3586: writing smithi13777483-6 from 2801664 to 3579904 tid 1 2024-03-04T06:53:42.257 INFO:tasks.rados.rados.0.smithi137.stdout:3586: writing smithi13777483-6 from 3579904 to 4022272 tid 2 2024-03-04T06:53:42.261 INFO:tasks.rados.rados.0.smithi137.stdout:3586: writing smithi13777483-6 from 4022272 to 4661248 tid 3 2024-03-04T06:53:42.262 INFO:tasks.rados.rados.0.smithi137.stdout:3586: writing smithi13777483-6 from 4661248 to 4784128 tid 4 2024-03-04T06:53:42.262 INFO:tasks.rados.rados.0.smithi137.stdout:3587: copy_from oid 24 from oid 7 current snap is 338 2024-03-04T06:53:42.262 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 16961 (ObjNum 1107 snap 329 seq_num 1107) dirty exists 2024-03-04T06:53:42.262 INFO:tasks.rados.rados.0.smithi137.stdout:3586: finishing write tid 1 to smithi13777483-6 2024-03-04T06:53:42.262 INFO:tasks.rados.rados.0.smithi137.stdout:3585: done (2 left) 2024-03-04T06:53:42.262 INFO:tasks.rados.rados.0.smithi137.stdout:3588: snap_create 2024-03-04T06:53:42.262 INFO:tasks.rados.rados.0.smithi137.stdout:3586: finishing write tid 2 to smithi13777483-6 2024-03-04T06:53:42.266 INFO:tasks.rados.rados.0.smithi137.stdout:3586: finishing write tid 3 to smithi13777483-6 2024-03-04T06:53:42.268 INFO:tasks.rados.rados.0.smithi137.stdout:3586: finishing write tid 4 to smithi13777483-6 2024-03-04T06:53:42.269 INFO:tasks.rados.rados.0.smithi137.stdout:3586: finishing write tid 5 to smithi13777483-6 2024-03-04T06:53:42.271 INFO:tasks.rados.rados.0.smithi137.stdout:3586: finishing write tid 6 to smithi13777483-6 2024-03-04T06:53:42.271 INFO:tasks.rados.rados.0.smithi137.stdout:3586: oid 6 updating version 0 to 16962 2024-03-04T06:53:42.271 INFO:tasks.rados.rados.0.smithi137.stdout:3586: oid 6 updating version 16962 to 16965 2024-03-04T06:53:42.271 INFO:tasks.rados.rados.0.smithi137.stdout:3586: oid 6 updating version 16965 to 16966 2024-03-04T06:53:42.271 INFO:tasks.rados.rados.0.smithi137.stdout:3586: oid 6 version 16966 is already newer than 16964 2024-03-04T06:53:42.271 INFO:tasks.rados.rados.0.smithi137.stdout:3586: oid 6 version 16966 is already newer than 16963 2024-03-04T06:53:42.271 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16966 (ObjNum 1121 snap 338 seq_num 1121) dirty exists 2024-03-04T06:53:42.271 INFO:tasks.rados.rados.0.smithi137.stdout:3586: left oid 6 (ObjNum 1121 snap 338 seq_num 1121) 2024-03-04T06:53:42.279 INFO:tasks.rados.rados.0.smithi137.stdout:3587: finishing copy_from racing read to smithi13777483-24 2024-03-04T06:53:42.279 INFO:tasks.rados.rados.0.smithi137.stdout:3587: finishing copy_from to smithi13777483-24 2024-03-04T06:53:42.279 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16966 (ObjNum 1119 snap 336 seq_num 1119) dirty exists 2024-03-04T06:53:42.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:42.268+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:42.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:42.241+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:42.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:42.241+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:42.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:42.241+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:42.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:42.233+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:42.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[88869]: pgmap v789: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 774 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 12 MiB/s rd, 7.9 MiB/s wr, 19 op/s 2024-03-04T06:53:42.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:42.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[88869]: osdmap e738: 8 total, 8 up, 8 in 2024-03-04T06:53:42.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:42.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:42.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:42.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:42.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:42.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:42.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[91314]: pgmap v789: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 774 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 12 MiB/s rd, 7.9 MiB/s wr, 19 op/s 2024-03-04T06:53:42.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:42.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[91314]: osdmap e738: 8 total, 8 up, 8 in 2024-03-04T06:53:42.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:42.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:42.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:42.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:42.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:42.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:42.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:42.238+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:42.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:42.242+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:42.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:42.242+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:42.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:42.266+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:42.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:42.234+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:42.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:42.234+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:42.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-mon[85573]: pgmap v789: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 774 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 12 MiB/s rd, 7.9 MiB/s wr, 19 op/s 2024-03-04T06:53:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-mon[85573]: osdmap e738: 8 total, 8 up, 8 in 2024-03-04T06:53:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:42.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:43.240 INFO:tasks.rados.rados.0.smithi137.stdout:3586: done (2 left) 2024-03-04T06:53:43.240 INFO:tasks.rados.rados.0.smithi137.stdout:3587: done (1 left) 2024-03-04T06:53:43.240 INFO:tasks.rados.rados.0.smithi137.stdout:3588: done (0 left) 2024-03-04T06:53:43.240 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 20 current snap is 339 2024-03-04T06:53:43.240 INFO:tasks.rados.rados.0.smithi137.stdout:3589: seq_num 1122 ranges {1327104=794624,2121728=729088,2850816=475136} 2024-03-04T06:53:43.251 INFO:tasks.rados.rados.0.smithi137.stdout:3589: writing smithi13777483-20 from 1327104 to 2121728 tid 1 2024-03-04T06:53:43.255 INFO:tasks.rados.rados.0.smithi137.stdout:3589: writing smithi13777483-20 from 2121728 to 2850816 tid 2 2024-03-04T06:53:43.258 INFO:tasks.rados.rados.0.smithi137.stdout:3589: writing smithi13777483-20 from 2850816 to 3325952 tid 3 2024-03-04T06:53:43.258 INFO:tasks.rados.rados.0.smithi137.stdout:3590: read oid 30 snap -1 2024-03-04T06:53:43.258 INFO:tasks.rados.rados.0.smithi137.stdout:3590: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:53:43.259 INFO:tasks.rados.rados.0.smithi137.stdout:3591: snap_create 2024-03-04T06:53:43.262 INFO:tasks.rados.rados.0.smithi137.stdout:3589: finishing write tid 1 to smithi13777483-20 2024-03-04T06:53:43.265 INFO:tasks.rados.rados.0.smithi137.stdout:3589: finishing write tid 2 to smithi13777483-20 2024-03-04T06:53:43.265 INFO:tasks.rados.rados.0.smithi137.stdout:3589: finishing write tid 3 to smithi13777483-20 2024-03-04T06:53:43.265 INFO:tasks.rados.rados.0.smithi137.stdout:3589: finishing write tid 4 to smithi13777483-20 2024-03-04T06:53:43.267 INFO:tasks.rados.rados.0.smithi137.stdout:3589: finishing write tid 5 to smithi13777483-20 2024-03-04T06:53:43.267 INFO:tasks.rados.rados.0.smithi137.stdout:3589: oid 20 updating version 0 to 16938 2024-03-04T06:53:43.267 INFO:tasks.rados.rados.0.smithi137.stdout:3589: oid 20 updating version 16938 to 16940 2024-03-04T06:53:43.267 INFO:tasks.rados.rados.0.smithi137.stdout:3589: oid 20 version 16940 is already newer than 16939 2024-03-04T06:53:43.268 INFO:tasks.rados.rados.0.smithi137.stdout:3589: oid 20 version 16940 is already newer than 16937 2024-03-04T06:53:43.268 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16940 (ObjNum 1122 snap 339 seq_num 1122) dirty exists 2024-03-04T06:53:43.268 INFO:tasks.rados.rados.0.smithi137.stdout:3589: left oid 20 (ObjNum 1122 snap 339 seq_num 1122) 2024-03-04T06:53:43.286 INFO:tasks.rados.rados.0.smithi137.stdout:3590: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:53:43.504 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:43.268+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:43.504 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:43.237+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:43.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:43.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:43.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[91314]: osdmap e739: 8 total, 8 up, 8 in 2024-03-04T06:53:43.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:43.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:43.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:43.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:43.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:43.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:43.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:43.505 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:43.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:43.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:43.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[88869]: osdmap e739: 8 total, 8 up, 8 in 2024-03-04T06:53:43.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:43.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:43.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:43.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:43.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:43.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:43.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:43.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:43.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:43.259+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:43.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:43.243+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:43.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:43.243+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:43.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:43.243+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:43.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:43.454+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:43.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:43.454+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:43.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:43.454+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:43.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:43.261+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:43.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:43.261+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:43.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:43.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:43.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-mon[85573]: osdmap e739: 8 total, 8 up, 8 in 2024-03-04T06:53:43.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:43.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:43.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:43.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:43.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:43.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:43.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:43.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:43.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:43.502+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:43.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:43.502+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:44.244 INFO:tasks.rados.rados.0.smithi137.stdout:3589: done (2 left) 2024-03-04T06:53:44.244 INFO:tasks.rados.rados.0.smithi137.stdout:3590: done (1 left) 2024-03-04T06:53:44.244 INFO:tasks.rados.rados.0.smithi137.stdout:3591: done (0 left) 2024-03-04T06:53:44.245 INFO:tasks.rados.rados.0.smithi137.stdout:3592: rollback oid 31 current snap is 340 2024-03-04T06:53:44.245 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 31 to 336 2024-03-04T06:53:44.245 INFO:tasks.rados.rados.0.smithi137.stdout:3593: read oid 29 snap -1 2024-03-04T06:53:44.245 INFO:tasks.rados.rados.0.smithi137.stdout:3593: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:53:44.245 INFO:tasks.rados.rados.0.smithi137.stdout:3594: rollback oid 6 current snap is 340 2024-03-04T06:53:44.245 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 6 to 336 2024-03-04T06:53:44.245 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 33 current snap is 340 2024-03-04T06:53:44.245 INFO:tasks.rados.rados.0.smithi137.stdout:3595: seq_num 1123 ranges {0=409600,409600=614400,1024000=598016,1622016=393216} 2024-03-04T06:53:44.246 INFO:tasks.rados.rados.0.smithi137.stdout:3595: writing smithi13777483-33 from 0 to 409600 tid 1 2024-03-04T06:53:44.250 INFO:tasks.rados.rados.0.smithi137.stdout:3595: writing smithi13777483-33 from 409600 to 1024000 tid 2 2024-03-04T06:53:44.253 INFO:tasks.rados.rados.0.smithi137.stdout:3595: writing smithi13777483-33 from 1024000 to 1622016 tid 3 2024-03-04T06:53:44.256 INFO:tasks.rados.rados.0.smithi137.stdout:3595: writing smithi13777483-33 from 1622016 to 2015232 tid 4 2024-03-04T06:53:44.257 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 19 current snap is 340 2024-03-04T06:53:44.257 INFO:tasks.rados.rados.0.smithi137.stdout:3592: finishing rollback tid 1 to smithi13777483-31 2024-03-04T06:53:44.257 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16936 (ObjNum 465 snap 0 seq_num 4609) dirty dne 2024-03-04T06:53:44.257 INFO:tasks.rados.rados.0.smithi137.stdout:3594: finishing rollback tid 0 to smithi13777483-6 2024-03-04T06:53:44.257 INFO:tasks.rados.rados.0.smithi137.stdout:3594: finishing rollback tid 1 to smithi13777483-6 2024-03-04T06:53:44.257 INFO:tasks.rados.rados.0.smithi137.stdout:3594: finishing rollback tid 2 to smithi13777483-6 2024-03-04T06:53:44.257 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16969 (ObjNum 1099 snap 326 seq_num 1099) dirty exists 2024-03-04T06:53:44.257 INFO:tasks.rados.rados.0.smithi137.stdout:3596: seq_num 1124 ranges {0=434176,434176=499712,933888=409600,1343488=663552,2007040=32768} 2024-03-04T06:53:44.259 INFO:tasks.rados.rados.0.smithi137.stdout:3596: writing smithi13777483-19 from 0 to 434176 tid 1 2024-03-04T06:53:44.262 INFO:tasks.rados.rados.0.smithi137.stdout:3596: writing smithi13777483-19 from 434176 to 933888 tid 2 2024-03-04T06:53:44.265 INFO:tasks.rados.rados.0.smithi137.stdout:3596: writing smithi13777483-19 from 933888 to 1343488 tid 3 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3596: writing smithi13777483-19 from 1343488 to 2007040 tid 4 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3596: writing smithi13777483-19 from 2007040 to 2039808 tid 5 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3592: done (4 left) 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3594: done (3 left) 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3597: rmattr oid 7 current snap is 340 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3597: done (3 left) 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3598: copy_from oid 40 from oid 22 current snap is 340 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3595: finishing write tid 1 to smithi13777483-33 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3595: finishing write tid 2 to smithi13777483-33 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3595: finishing write tid 3 to smithi13777483-33 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3595: finishing write tid 4 to smithi13777483-33 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3599: setattr oid 46 current snap is 340 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3595: finishing write tid 5 to smithi13777483-33 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3596: finishing write tid 1 to smithi13777483-19 2024-03-04T06:53:44.270 INFO:tasks.rados.rados.0.smithi137.stdout:3595: finishing write tid 6 to smithi13777483-33 2024-03-04T06:53:44.271 INFO:tasks.rados.rados.0.smithi137.stdout:3595: oid 33 updating version 0 to 16953 2024-03-04T06:53:44.271 INFO:tasks.rados.rados.0.smithi137.stdout:3595: oid 33 updating version 16953 to 16956 2024-03-04T06:53:44.271 INFO:tasks.rados.rados.0.smithi137.stdout:3595: oid 33 version 16956 is already newer than 16954 2024-03-04T06:53:44.271 INFO:tasks.rados.rados.0.smithi137.stdout:3595: oid 33 version 16956 is already newer than 16955 2024-03-04T06:53:44.271 INFO:tasks.rados.rados.0.smithi137.stdout:3595: oid 33 updating version 16956 to 16957 2024-03-04T06:53:44.271 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16957 (ObjNum 1123 snap 340 seq_num 1123) dirty exists 2024-03-04T06:53:44.271 INFO:tasks.rados.rados.0.smithi137.stdout:3595: left oid 33 (ObjNum 1123 snap 340 seq_num 1123) 2024-03-04T06:53:44.272 INFO:tasks.rados.rados.0.smithi137.stdout:3595: done (4 left) 2024-03-04T06:53:44.272 INFO:tasks.rados.rados.0.smithi137.stdout:3600: rollback oid 18 current snap is 340 2024-03-04T06:53:44.272 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 18 to 327 2024-03-04T06:53:44.272 INFO:tasks.rados.rados.0.smithi137.stdout:3601: read oid 23 snap -1 2024-03-04T06:53:44.272 INFO:tasks.rados.rados.0.smithi137.stdout:3601: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:53:44.272 INFO:tasks.rados.rados.0.smithi137.stdout:3602: rmattr oid 6 current snap is 340 2024-03-04T06:53:44.272 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 36 current snap is 340 2024-03-04T06:53:44.272 INFO:tasks.rados.rados.0.smithi137.stdout:3603: seq_num 1125 ranges {1040384=450560,1490944=786432,2277376=614400,2891776=204800} 2024-03-04T06:53:44.280 INFO:tasks.rados.rados.0.smithi137.stdout:3603: writing smithi13777483-36 from 1040384 to 1490944 tid 1 2024-03-04T06:53:44.285 INFO:tasks.rados.rados.0.smithi137.stdout:3603: writing smithi13777483-36 from 1490944 to 2277376 tid 2 2024-03-04T06:53:44.288 INFO:tasks.rados.rados.0.smithi137.stdout:3603: writing smithi13777483-36 from 2277376 to 2891776 tid 3 2024-03-04T06:53:44.290 INFO:tasks.rados.rados.0.smithi137.stdout:3603: writing smithi13777483-36 from 2891776 to 3096576 tid 4 2024-03-04T06:53:44.290 INFO:tasks.rados.rados.0.smithi137.stdout:3604: read oid 27 snap -1 2024-03-04T06:53:44.290 INFO:tasks.rados.rados.0.smithi137.stdout:3604: expect deleted 2024-03-04T06:53:44.290 INFO:tasks.rados.rados.0.smithi137.stdout:3605: snap_create 2024-03-04T06:53:44.291 INFO:tasks.rados.rados.0.smithi137.stdout:3593: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:53:44.542 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:44.250+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:44.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:44.243+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:44.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:44.243+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:44.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:44.243+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:44.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[91314]: pgmap v792: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 774 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 0 op/s 2024-03-04T06:53:44.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:44.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[91314]: osdmap e740: 8 total, 8 up, 8 in 2024-03-04T06:53:44.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:44.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[88869]: pgmap v792: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 774 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 0 op/s 2024-03-04T06:53:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[88869]: osdmap e740: 8 total, 8 up, 8 in 2024-03-04T06:53:44.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:44.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:44.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:44.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:44.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:44.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:44.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:44.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:44.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:44.592 INFO:tasks.rados.rados.0.smithi137.stdout:3596: finishing write tid 2 to smithi13777483-19 2024-03-04T06:53:44.592 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 46 v 16993 (ObjNum 1111 snap 332 seq_num 1111) dirty exists 2024-03-04T06:53:44.592 INFO:tasks.rados.rados.0.smithi137.stdout:3596: finishing write tid 3 to smithi13777483-19 2024-03-04T06:53:44.592 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16970 (ObjNum 1099 snap 326 seq_num 1099) dirty exists 2024-03-04T06:53:44.592 INFO:tasks.rados.rados.0.smithi137.stdout:3603: finishing write tid 1 to smithi13777483-36 2024-03-04T06:53:44.592 INFO:tasks.rados.rados.0.smithi137.stdout:3596: finishing write tid 4 to smithi13777483-19 2024-03-04T06:53:44.592 INFO:tasks.rados.rados.0.smithi137.stdout:3600: finishing rollback tid 0 to smithi13777483-18 2024-03-04T06:53:44.592 INFO:tasks.rados.rados.0.smithi137.stdout:3600: finishing rollback tid 1 to smithi13777483-18 2024-03-04T06:53:44.592 INFO:tasks.rados.rados.0.smithi137.stdout:3596: finishing write tid 5 to smithi13777483-19 2024-03-04T06:53:44.593 INFO:tasks.rados.rados.0.smithi137.stdout:3596: finishing write tid 6 to smithi13777483-19 2024-03-04T06:53:44.593 INFO:tasks.rados.rados.0.smithi137.stdout:3600: finishing rollback tid 2 to smithi13777483-18 2024-03-04T06:53:44.593 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16972 (ObjNum 1103 snap 327 seq_num 1103) dirty exists 2024-03-04T06:53:44.593 INFO:tasks.rados.rados.0.smithi137.stdout:3596: finishing write tid 7 to smithi13777483-19 2024-03-04T06:53:44.593 INFO:tasks.rados.rados.0.smithi137.stdout:3596: oid 19 updating version 0 to 16969 2024-03-04T06:53:44.593 INFO:tasks.rados.rados.0.smithi137.stdout:3596: oid 19 updating version 16969 to 16974 2024-03-04T06:53:44.593 INFO:tasks.rados.rados.0.smithi137.stdout:3596: oid 19 version 16974 is already newer than 16973 2024-03-04T06:53:44.593 INFO:tasks.rados.rados.0.smithi137.stdout:3596: oid 19 version 16974 is already newer than 16972 2024-03-04T06:53:44.593 INFO:tasks.rados.rados.0.smithi137.stdout:3596: oid 19 version 16974 is already newer than 16970 2024-03-04T06:53:44.593 INFO:tasks.rados.rados.0.smithi137.stdout:3596: oid 19 version 16974 is already newer than 16971 2024-03-04T06:53:44.593 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 16974 (ObjNum 1124 snap 340 seq_num 1124) dirty exists 2024-03-04T06:53:44.593 INFO:tasks.rados.rados.0.smithi137.stdout:3596: left oid 19 (ObjNum 1124 snap 340 seq_num 1124) 2024-03-04T06:53:44.593 INFO:tasks.rados.rados.0.smithi137.stdout:3601: expect (ObjNum 1009 snap 296 seq_num 1009) 2024-03-04T06:53:44.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:44.243+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:44.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:44.243+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:44.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:44.251+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:44.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:44.248+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:44.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:44.249+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:44.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:44.252+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-mon[85573]: pgmap v792: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 774 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 0 op/s 2024-03-04T06:53:44.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:44.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-mon[85573]: osdmap e740: 8 total, 8 up, 8 in 2024-03-04T06:53:44.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:44.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:44.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:44.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:44.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:44.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:44.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:44.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:44.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:44.713 INFO:tasks.rados.rados.0.smithi137.stdout:3603: finishing write tid 2 to smithi13777483-36 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:3603: finishing write tid 3 to smithi13777483-36 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:3603: finishing write tid 4 to smithi13777483-36 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:3603: finishing write tid 5 to smithi13777483-36 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:3603: finishing write tid 6 to smithi13777483-36 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:3603: oid 36 updating version 0 to 16889 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:3603: oid 36 updating version 16889 to 16891 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:3603: oid 36 version 16891 is already newer than 16887 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:3603: oid 36 version 16891 is already newer than 16888 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:3603: oid 36 version 16891 is already newer than 16890 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 16891 (ObjNum 1125 snap 340 seq_num 1125) dirty exists 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:3603: left oid 36 (ObjNum 1125 snap 340 seq_num 1125) 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:3598: finishing copy_from racing read to smithi13777483-40 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:3598: finishing copy_from to smithi13777483-40 2024-03-04T06:53:44.714 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 16961 (ObjNum 1107 snap 329 seq_num 1107) dirty exists 2024-03-04T06:53:45.042 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:44.675+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:3593: done (9 left) 2024-03-04T06:53:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:3596: done (8 left) 2024-03-04T06:53:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:3598: done (7 left) 2024-03-04T06:53:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:3599: done (6 left) 2024-03-04T06:53:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:3600: done (5 left) 2024-03-04T06:53:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:3601: done (4 left) 2024-03-04T06:53:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:3602: done (3 left) 2024-03-04T06:53:45.251 INFO:tasks.rados.rados.0.smithi137.stdout:3603: done (2 left) 2024-03-04T06:53:45.252 INFO:tasks.rados.rados.0.smithi137.stdout:3604: done (1 left) 2024-03-04T06:53:45.252 INFO:tasks.rados.rados.0.smithi137.stdout:3605: done (0 left) 2024-03-04T06:53:45.252 INFO:tasks.rados.rados.0.smithi137.stdout:3606: snap_create 2024-03-04T06:53:45.542 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:53:45] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:53:45.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:45.249+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:45.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[88869]: osdmap e741: 8 total, 8 up, 8 in 2024-03-04T06:53:45.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:45.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:45.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:45.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:45.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:45.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[91314]: osdmap e741: 8 total, 8 up, 8 in 2024-03-04T06:53:45.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:45.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:45.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:45.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:45.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:45.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:45.248+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:45.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:45.248+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:45.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:45.248+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-mon[85573]: osdmap e741: 8 total, 8 up, 8 in 2024-03-04T06:53:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:45.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:46.251 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:45.886+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:46.251 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:45.886+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:46.251 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:45.889+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:46.252 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:45.890+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:46.252 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:45.890+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:46.252 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:45.888+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:46.252 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:45.889+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:46.252 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:45.889+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:46.252 INFO:tasks.rados.rados.0.smithi137.stdout:3606: done (0 left) 2024-03-04T06:53:46.253 INFO:tasks.rados.rados.0.smithi137.stdout:3607: copy_from oid 42 from oid 30 current snap is 342 2024-03-04T06:53:46.253 INFO:tasks.rados.rados.0.smithi137.stdout:3608: snap_remove snap 336 2024-03-04T06:53:46.253 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:45.886+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:46.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:46.260+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:46.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:46.249+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:46.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[88869]: pgmap v795: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 782 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 7 op/s 2024-03-04T06:53:46.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:46.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[88869]: osdmap e742: 8 total, 8 up, 8 in 2024-03-04T06:53:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:46.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:46.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[91314]: pgmap v795: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 782 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 7 op/s 2024-03-04T06:53:46.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:46.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:46.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:46.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[91314]: osdmap e742: 8 total, 8 up, 8 in 2024-03-04T06:53:46.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:46.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:46.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:46.250+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:46.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:46.250+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:46.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:46.258+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-mon[85573]: pgmap v795: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 782 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 7 op/s 2024-03-04T06:53:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-mon[85573]: osdmap e742: 8 total, 8 up, 8 in 2024-03-04T06:53:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:46.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:47.253 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:46.876+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:47.253 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:46.876+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:47.253 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:46.877+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:47.253 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:46.875+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:47.253 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:46.875+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:47.253 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:46.875+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:47.258 INFO:tasks.rados.rados.0.smithi137.stdout:3607: finishing copy_from racing read to smithi13777483-42 2024-03-04T06:53:47.258 INFO:tasks.rados.rados.0.smithi137.stdout:3607: finishing copy_from to smithi13777483-42 2024-03-04T06:53:47.258 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 16917 (ObjNum 982 snap 287 seq_num 982) dirty exists 2024-03-04T06:53:47.258 INFO:tasks.rados.rados.0.smithi137.stdout:3607: done (1 left) 2024-03-04T06:53:47.258 INFO:tasks.rados.rados.0.smithi137.stdout:3608: done (0 left) 2024-03-04T06:53:47.258 INFO:tasks.rados.rados.0.smithi137.stdout:3609: copy_from oid 23 from oid 33 current snap is 342 2024-03-04T06:53:47.258 INFO:tasks.rados.rados.0.smithi137.stdout:3610: copy_from oid 11 from oid 18 current snap is 342 2024-03-04T06:53:47.258 INFO:tasks.rados.rados.0.smithi137.stdout:3611: snap_remove snap 331 2024-03-04T06:53:47.543 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[106841]: 2024-03-04T06:53:47.273+0000 7f5888aaa700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 18a after trimming was started 2024-03-04T06:53:47.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:47.257+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:47.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:47.257+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:47.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:47.259+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[88869]: osdmap e743: 8 total, 8 up, 8 in 2024-03-04T06:53:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:47.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:47.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:47.545 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:47.251+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:47.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:47.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:47.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:47.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:47.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[91314]: osdmap e743: 8 total, 8 up, 8 in 2024-03-04T06:53:47.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:47.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:47.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:47.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:47.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:47.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:47.258+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:47.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:47.252+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:47.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:47.252+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:47.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:47.252+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:47.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:47.261+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:47.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:47.261+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:47.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:47.263+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:47.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:47.266+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:47.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:47.266+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:47.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:47.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:47.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:47.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:47.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:47.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:47.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-mon[85573]: osdmap e743: 8 total, 8 up, 8 in 2024-03-04T06:53:47.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:47.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:47.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:47.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:47.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:48.255 INFO:tasks.rados.rados.0.smithi137.stdout:3611: done (2 left) 2024-03-04T06:53:48.255 INFO:tasks.rados.rados.0.smithi137.stdout:3612: read oid 8 snap -1 2024-03-04T06:53:48.255 INFO:tasks.rados.rados.0.smithi137.stdout:3612: expect deleted 2024-03-04T06:53:48.255 INFO:tasks.rados.rados.0.smithi137.stdout:3613: read oid 49 snap 325 2024-03-04T06:53:48.255 INFO:tasks.rados.rados.0.smithi137.stdout:3613: expect (ObjNum 1077 snap 324 seq_num 1077) 2024-03-04T06:53:48.255 INFO:tasks.rados.rados.0.smithi137.stdout:3614: read oid 32 snap -1 2024-03-04T06:53:48.255 INFO:tasks.rados.rados.0.smithi137.stdout:3614: expect (ObjNum 1070 snap 320 seq_num 1070) 2024-03-04T06:53:48.255 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 342 2024-03-04T06:53:48.255 INFO:tasks.rados.rados.0.smithi137.stdout:3615: seq_num 1126 ranges {704512=466944,1171456=720896,1892352=778240,2670592=106496} 2024-03-04T06:53:48.262 INFO:tasks.rados.rados.0.smithi137.stdout:3615: writing smithi13777483-13 from 704512 to 1171456 tid 1 2024-03-04T06:53:48.267 INFO:tasks.rados.rados.0.smithi137.stdout:3615: writing smithi13777483-13 from 1171456 to 1892352 tid 2 2024-03-04T06:53:48.272 INFO:tasks.rados.rados.0.smithi137.stdout:3615: writing smithi13777483-13 from 1892352 to 2670592 tid 3 2024-03-04T06:53:48.273 INFO:tasks.rados.rados.0.smithi137.stdout:3615: writing smithi13777483-13 from 2670592 to 2777088 tid 4 2024-03-04T06:53:48.273 INFO:tasks.rados.rados.0.smithi137.stdout:3616: delete oid 37 current snap is 342 2024-03-04T06:53:48.273 INFO:tasks.rados.rados.0.smithi137.stdout:3609: finishing copy_from racing read to smithi13777483-23 2024-03-04T06:53:48.274 INFO:tasks.rados.rados.0.smithi137.stdout:3609: finishing copy_from to smithi13777483-23 2024-03-04T06:53:48.274 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 16957 (ObjNum 1123 snap 340 seq_num 1123) dirty exists 2024-03-04T06:53:48.274 INFO:tasks.rados.rados.0.smithi137.stdout:3610: finishing copy_from racing read to smithi13777483-11 2024-03-04T06:53:48.274 INFO:tasks.rados.rados.0.smithi137.stdout:3610: finishing copy_from to smithi13777483-11 2024-03-04T06:53:48.274 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16972 (ObjNum 1103 snap 327 seq_num 1103) dirty exists 2024-03-04T06:53:48.274 INFO:tasks.rados.rados.0.smithi137.stdout:3614: expect (ObjNum 1070 snap 320 seq_num 1070) 2024-03-04T06:53:48.309 INFO:tasks.rados.rados.0.smithi137.stdout:3613: expect (ObjNum 1077 snap 324 seq_num 1077) 2024-03-04T06:53:48.458 INFO:tasks.rados.rados.0.smithi137.stdout:3615: finishing write tid 1 to smithi13777483-13 2024-03-04T06:53:48.458 INFO:tasks.rados.rados.0.smithi137.stdout:3615: finishing write tid 2 to smithi13777483-13 2024-03-04T06:53:48.458 INFO:tasks.rados.rados.0.smithi137.stdout:3615: finishing write tid 3 to smithi13777483-13 2024-03-04T06:53:48.459 INFO:tasks.rados.rados.0.smithi137.stdout:3615: finishing write tid 4 to smithi13777483-13 2024-03-04T06:53:48.459 INFO:tasks.rados.rados.0.smithi137.stdout:3615: finishing write tid 5 to smithi13777483-13 2024-03-04T06:53:48.459 INFO:tasks.rados.rados.0.smithi137.stdout:3615: finishing write tid 6 to smithi13777483-13 2024-03-04T06:53:48.459 INFO:tasks.rados.rados.0.smithi137.stdout:3615: oid 13 updating version 0 to 16995 2024-03-04T06:53:48.459 INFO:tasks.rados.rados.0.smithi137.stdout:3615: oid 13 version 16995 is already newer than 16994 2024-03-04T06:53:48.459 INFO:tasks.rados.rados.0.smithi137.stdout:3615: oid 13 updating version 16995 to 16998 2024-03-04T06:53:48.459 INFO:tasks.rados.rados.0.smithi137.stdout:3615: oid 13 version 16998 is already newer than 16996 2024-03-04T06:53:48.459 INFO:tasks.rados.rados.0.smithi137.stdout:3615: oid 13 version 16998 is already newer than 16997 2024-03-04T06:53:48.459 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16998 (ObjNum 1126 snap 342 seq_num 1126) dirty exists 2024-03-04T06:53:48.459 INFO:tasks.rados.rados.0.smithi137.stdout:3615: left oid 13 (ObjNum 1126 snap 342 seq_num 1126) 2024-03-04T06:53:48.459 INFO:tasks.rados.rados.0.smithi137.stdout:3609: done (6 left) 2024-03-04T06:53:48.459 INFO:tasks.rados.rados.0.smithi137.stdout:3610: done (5 left) 2024-03-04T06:53:48.459 INFO:tasks.rados.rados.0.smithi137.stdout:3612: done (4 left) 2024-03-04T06:53:48.460 INFO:tasks.rados.rados.0.smithi137.stdout:3613: done (3 left) 2024-03-04T06:53:48.460 INFO:tasks.rados.rados.0.smithi137.stdout:3614: done (2 left) 2024-03-04T06:53:48.460 INFO:tasks.rados.rados.0.smithi137.stdout:3615: done (1 left) 2024-03-04T06:53:48.460 INFO:tasks.rados.rados.0.smithi137.stdout:3616: done (0 left) 2024-03-04T06:53:48.460 INFO:tasks.rados.rados.0.smithi137.stdout:3617: read oid 27 snap -1 2024-03-04T06:53:48.460 INFO:tasks.rados.rados.0.smithi137.stdout:3617: expect deleted 2024-03-04T06:53:48.460 INFO:tasks.rados.rados.0.smithi137.stdout:3618: delete oid 11 current snap is 342 2024-03-04T06:53:48.460 INFO:tasks.rados.rados.0.smithi137.stdout:3617: done (1 left) 2024-03-04T06:53:48.460 INFO:tasks.rados.rados.0.smithi137.stdout:3618: done (0 left) 2024-03-04T06:53:48.461 INFO:tasks.rados.rados.0.smithi137.stdout:3619: delete oid 25 current snap is 342 2024-03-04T06:53:48.463 INFO:tasks.rados.rados.0.smithi137.stdout:3619: done (0 left) 2024-03-04T06:53:48.463 INFO:tasks.rados.rados.0.smithi137.stdout:3620: snap_create 2024-03-04T06:53:48.543 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[106841]: 2024-03-04T06:53:48.284+0000 7f58842a1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 185 after trimming was started 2024-03-04T06:53:48.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:48.258+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:48.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:48.259+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:48.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:48.253+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:48.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:48.254+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:48.544 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:48.254+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: pgmap v798: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 788 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 10 op/s 2024-03-04T06:53:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:48.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:48.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: osdmap e744: 8 total, 8 up, 8 in 2024-03-04T06:53:48.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:48.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:48.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:48.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:48.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:48.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:48.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:48.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[91314]: osdmap e745: 8 total, 8 up, 8 in 2024-03-04T06:53:48.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: pgmap v798: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 788 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 10 op/s 2024-03-04T06:53:48.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:48.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:48.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:48.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:48.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:48.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:48.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: osdmap e744: 8 total, 8 up, 8 in 2024-03-04T06:53:48.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:48.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:48.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:48.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:48.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:48.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:48.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:48.546 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:48 smithi137 ceph-mon[88869]: osdmap e745: 8 total, 8 up, 8 in 2024-03-04T06:53:48.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:48.263+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:48.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:48.254+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:48.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:48.254+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:48.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:48.262+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:48.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:48.258+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:48.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:48.261+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:48.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: pgmap v798: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 788 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 10 op/s 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: osdmap e744: 8 total, 8 up, 8 in 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:48.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:48.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:48 smithi203 ceph-mon[85573]: osdmap e745: 8 total, 8 up, 8 in 2024-03-04T06:53:49.281 INFO:tasks.rados.rados.0.smithi137.stdout:3620: done (0 left) 2024-03-04T06:53:49.281 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 343 2024-03-04T06:53:49.281 INFO:tasks.rados.rados.0.smithi137.stdout:3621: seq_num 1130 ranges {0=532480,532480=655360,1187840=753664,1941504=196608} 2024-03-04T06:53:49.284 INFO:tasks.rados.rados.0.smithi137.stdout:3621: writing smithi13777483-15 from 0 to 532480 tid 1 2024-03-04T06:53:49.288 INFO:tasks.rados.rados.0.smithi137.stdout:3621: writing smithi13777483-15 from 532480 to 1187840 tid 2 2024-03-04T06:53:49.292 INFO:tasks.rados.rados.0.smithi137.stdout:3621: writing smithi13777483-15 from 1187840 to 1941504 tid 3 2024-03-04T06:53:49.293 INFO:tasks.rados.rados.0.smithi137.stdout:3621: writing smithi13777483-15 from 1941504 to 2138112 tid 4 2024-03-04T06:53:49.293 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 36 current snap is 343 2024-03-04T06:53:49.293 INFO:tasks.rados.rados.0.smithi137.stdout:3621: finishing write tid 1 to smithi13777483-15 2024-03-04T06:53:49.294 INFO:tasks.rados.rados.0.smithi137.stdout:3621: finishing write tid 2 to smithi13777483-15 2024-03-04T06:53:49.294 INFO:tasks.rados.rados.0.smithi137.stdout:3622: seq_num 1131 ranges {3096576=548864,3645440=540672,4186112=565248,4751360=425984,5177344=73728} 2024-03-04T06:53:49.313 INFO:tasks.rados.rados.0.smithi137.stdout:3622: writing smithi13777483-36 from 3096576 to 3645440 tid 1 2024-03-04T06:53:49.316 INFO:tasks.rados.rados.0.smithi137.stdout:3622: writing smithi13777483-36 from 3645440 to 4186112 tid 2 2024-03-04T06:53:49.319 INFO:tasks.rados.rados.0.smithi137.stdout:3622: writing smithi13777483-36 from 4186112 to 4751360 tid 3 2024-03-04T06:53:49.322 INFO:tasks.rados.rados.0.smithi137.stdout:3622: writing smithi13777483-36 from 4751360 to 5177344 tid 4 2024-03-04T06:53:49.323 INFO:tasks.rados.rados.0.smithi137.stdout:3622: writing smithi13777483-36 from 5177344 to 5251072 tid 5 2024-03-04T06:53:49.323 INFO:tasks.rados.rados.0.smithi137.stdout:3623: delete oid 8 current snap is 343 2024-03-04T06:53:49.323 INFO:tasks.rados.rados.0.smithi137.stdout:3621: finishing write tid 3 to smithi13777483-15 2024-03-04T06:53:49.323 INFO:tasks.rados.rados.0.smithi137.stdout:3621: finishing write tid 4 to smithi13777483-15 2024-03-04T06:53:49.323 INFO:tasks.rados.rados.0.smithi137.stdout:3621: finishing write tid 5 to smithi13777483-15 2024-03-04T06:53:49.323 INFO:tasks.rados.rados.0.smithi137.stdout:3621: finishing write tid 6 to smithi13777483-15 2024-03-04T06:53:49.323 INFO:tasks.rados.rados.0.smithi137.stdout:3621: oid 15 updating version 0 to 16976 2024-03-04T06:53:49.323 INFO:tasks.rados.rados.0.smithi137.stdout:3621: oid 15 version 16976 is already newer than 16974 2024-03-04T06:53:49.323 INFO:tasks.rados.rados.0.smithi137.stdout:3621: oid 15 version 16976 is already newer than 16973 2024-03-04T06:53:49.323 INFO:tasks.rados.rados.0.smithi137.stdout:3621: oid 15 version 16976 is already newer than 16972 2024-03-04T06:53:49.323 INFO:tasks.rados.rados.0.smithi137.stdout:3621: oid 15 version 16976 is already newer than 16975 2024-03-04T06:53:49.323 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16976 (ObjNum 1130 snap 343 seq_num 1130) dirty exists 2024-03-04T06:53:49.324 INFO:tasks.rados.rados.0.smithi137.stdout:3621: left oid 15 (ObjNum 1130 snap 343 seq_num 1130) 2024-03-04T06:53:49.324 INFO:tasks.rados.rados.0.smithi137.stdout:3622: finishing write tid 1 to smithi13777483-36 2024-03-04T06:53:49.324 INFO:tasks.rados.rados.0.smithi137.stdout:3622: finishing write tid 2 to smithi13777483-36 2024-03-04T06:53:49.324 INFO:tasks.rados.rados.0.smithi137.stdout:3622: finishing write tid 3 to smithi13777483-36 2024-03-04T06:53:49.326 INFO:tasks.rados.rados.0.smithi137.stdout:3622: finishing write tid 4 to smithi13777483-36 2024-03-04T06:53:49.326 INFO:tasks.rados.rados.0.smithi137.stdout:3622: finishing write tid 5 to smithi13777483-36 2024-03-04T06:53:49.327 INFO:tasks.rados.rados.0.smithi137.stdout:3622: finishing write tid 6 to smithi13777483-36 2024-03-04T06:53:49.327 INFO:tasks.rados.rados.0.smithi137.stdout:3621: done (2 left) 2024-03-04T06:53:49.327 INFO:tasks.rados.rados.0.smithi137.stdout:3623: done (1 left) 2024-03-04T06:53:49.327 INFO:tasks.rados.rados.0.smithi137.stdout:3624: copy_from oid 21 from oid 45 current snap is 343 2024-03-04T06:53:49.328 INFO:tasks.rados.rados.0.smithi137.stdout:3625: snap_remove snap 341 2024-03-04T06:53:49.538 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:49.289+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:49.538 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:49.278+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:49.538 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:49.278+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:49.538 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:49.278+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:49.538 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:49.331+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:49.538 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:49.331+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:49.538 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:49.331+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:49.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:49.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:49.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:49.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:49.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:49.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:49.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:49.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:49.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:49.539 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:49.542 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:49.288+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:49.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:49.288+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:49.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:49.325+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:49.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:49.279+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:49.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:49.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:49.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:49.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:49.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:49.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:49.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:49.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:49.537+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:49.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:49.537+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:50.290 INFO:tasks.rados.rados.0.smithi137.stdout:3625: done (2 left) 2024-03-04T06:53:50.290 INFO:tasks.rados.rados.0.smithi137.stdout:3626: setattr oid 43 current snap is 343 2024-03-04T06:53:50.292 INFO:tasks.rados.rados.0.smithi137.stdout:3622: finishing write tid 7 to smithi13777483-36 2024-03-04T06:53:50.292 INFO:tasks.rados.rados.0.smithi137.stdout:3622: oid 36 updating version 0 to 16893 2024-03-04T06:53:50.292 INFO:tasks.rados.rados.0.smithi137.stdout:3622: oid 36 updating version 16893 to 16897 2024-03-04T06:53:50.292 INFO:tasks.rados.rados.0.smithi137.stdout:3622: oid 36 version 16897 is already newer than 16894 2024-03-04T06:53:50.292 INFO:tasks.rados.rados.0.smithi137.stdout:3622: oid 36 version 16897 is already newer than 16896 2024-03-04T06:53:50.292 INFO:tasks.rados.rados.0.smithi137.stdout:3622: oid 36 version 16897 is already newer than 16895 2024-03-04T06:53:50.292 INFO:tasks.rados.rados.0.smithi137.stdout:3622: oid 36 version 16897 is already newer than 16892 2024-03-04T06:53:50.293 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 16897 (ObjNum 1131 snap 343 seq_num 1131) dirty exists 2024-03-04T06:53:50.293 INFO:tasks.rados.rados.0.smithi137.stdout:3622: left oid 36 (ObjNum 1131 snap 343 seq_num 1131) 2024-03-04T06:53:50.293 INFO:tasks.rados.rados.0.smithi137.stdout:3624: finishing copy_from to smithi13777483-21 2024-03-04T06:53:50.293 INFO:tasks.rados.rados.0.smithi137.stdout:3624: got expected ENOENT (src dne) 2024-03-04T06:53:50.293 INFO:tasks.rados.rados.0.smithi137.stdout:3624: finishing copy_from racing read to smithi13777483-21 2024-03-04T06:53:50.294 INFO:tasks.rados.rados.0.smithi137.stdout:3622: done (2 left) 2024-03-04T06:53:50.294 INFO:tasks.rados.rados.0.smithi137.stdout:3624: done (1 left) 2024-03-04T06:53:50.294 INFO:tasks.rados.rados.0.smithi137.stdout:3627: read oid 40 snap 327 2024-03-04T06:53:50.294 INFO:tasks.rados.rados.0.smithi137.stdout:3627: expect deleted 2024-03-04T06:53:50.294 INFO:tasks.rados.rados.0.smithi137.stdout:3628: read oid 31 snap 339 2024-03-04T06:53:50.294 INFO:tasks.rados.rados.0.smithi137.stdout:3628: expect deleted 2024-03-04T06:53:50.294 INFO:tasks.rados.rados.0.smithi137.stdout:3629: snap_create 2024-03-04T06:53:50.302 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16967 (ObjNum 1009 snap 296 seq_num 1009) dirty exists 2024-03-04T06:53:50.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:50.300+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:50.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:50.294+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:50.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:50.294+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:50.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:50.294+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:50.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:50.289+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[88869]: pgmap v801: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 808 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 10 MiB/s rd, 6.5 MiB/s wr, 23 op/s 2024-03-04T06:53:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[88869]: osdmap e746: 8 total, 8 up, 8 in 2024-03-04T06:53:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:50.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:50.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[91314]: pgmap v801: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 808 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 10 MiB/s rd, 6.5 MiB/s wr, 23 op/s 2024-03-04T06:53:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[91314]: osdmap e746: 8 total, 8 up, 8 in 2024-03-04T06:53:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:50.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:50.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:50.291+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:50.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:50.297+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:50.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:50.301+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:50.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:50.294+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:50.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:50.298+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:50.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:50.298+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:50.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-mon[85573]: pgmap v801: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 808 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 10 MiB/s rd, 6.5 MiB/s wr, 23 op/s 2024-03-04T06:53:50.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:50.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:50.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:50.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-mon[85573]: osdmap e746: 8 total, 8 up, 8 in 2024-03-04T06:53:50.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:50.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:50.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:50.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:50.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:50.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:51.301 INFO:tasks.rados.rados.0.smithi137.stdout:3626: done (3 left) 2024-03-04T06:53:51.301 INFO:tasks.rados.rados.0.smithi137.stdout:3627: done (2 left) 2024-03-04T06:53:51.301 INFO:tasks.rados.rados.0.smithi137.stdout:3628: done (1 left) 2024-03-04T06:53:51.301 INFO:tasks.rados.rados.0.smithi137.stdout:3629: done (0 left) 2024-03-04T06:53:51.301 INFO:tasks.rados.rados.0.smithi137.stdout:3630: snap_remove snap 325 2024-03-04T06:53:51.556 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:51.295+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:51.557 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:51.295+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:51.557 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:51.295+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:51.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:51.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-mon[85573]: osdmap e747: 8 total, 8 up, 8 in 2024-03-04T06:53:51.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:51.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:51.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:51.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:51.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:51.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:51.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:51.557 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:51.558 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:51.558 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:51.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:51.299+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[91314]: osdmap e747: 8 total, 8 up, 8 in 2024-03-04T06:53:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:51.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[88869]: osdmap e747: 8 total, 8 up, 8 in 2024-03-04T06:53:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:51.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:51.845 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:51.556+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:51.845 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:51.556+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:51.845 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:51.556+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:52.302 INFO:tasks.rados.rados.0.smithi137.stdout:3630: done (0 left) 2024-03-04T06:53:52.303 INFO:tasks.rados.rados.0.smithi137.stdout:3631: copy_from oid 38 from oid 7 current snap is 344 2024-03-04T06:53:52.303 INFO:tasks.rados.rados.0.smithi137.stdout:3632: delete oid 47 current snap is 344 2024-03-04T06:53:52.312 INFO:tasks.rados.rados.0.smithi137.stdout:3632: done (1 left) 2024-03-04T06:53:52.312 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 13 current snap is 344 2024-03-04T06:53:52.312 INFO:tasks.rados.rados.0.smithi137.stdout:3633: seq_num 1134 ranges {2777088=598016,3375104=638976,4014080=737280,4751360=229376} 2024-03-04T06:53:52.331 INFO:tasks.rados.rados.0.smithi137.stdout:3633: writing smithi13777483-13 from 2777088 to 3375104 tid 1 2024-03-04T06:53:52.334 INFO:tasks.rados.rados.0.smithi137.stdout:3633: writing smithi13777483-13 from 3375104 to 4014080 tid 2 2024-03-04T06:53:52.338 INFO:tasks.rados.rados.0.smithi137.stdout:3633: writing smithi13777483-13 from 4014080 to 4751360 tid 3 2024-03-04T06:53:52.340 INFO:tasks.rados.rados.0.smithi137.stdout:3633: writing smithi13777483-13 from 4751360 to 4980736 tid 4 2024-03-04T06:53:52.340 INFO:tasks.rados.rados.0.smithi137.stdout:3634: delete oid 1 current snap is 344 2024-03-04T06:53:52.341 INFO:tasks.rados.rados.0.smithi137.stdout:3631: finishing copy_from racing read to smithi13777483-38 2024-03-04T06:53:52.341 INFO:tasks.rados.rados.0.smithi137.stdout:3631: finishing copy_from to smithi13777483-38 2024-03-04T06:53:52.341 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16966 (ObjNum 1119 snap 336 seq_num 1119) dirty exists 2024-03-04T06:53:52.341 INFO:tasks.rados.rados.0.smithi137.stdout:3633: finishing write tid 1 to smithi13777483-13 2024-03-04T06:53:52.341 INFO:tasks.rados.rados.0.smithi137.stdout:3633: finishing write tid 2 to smithi13777483-13 2024-03-04T06:53:52.344 INFO:tasks.rados.rados.0.smithi137.stdout:3631: done (2 left) 2024-03-04T06:53:52.344 INFO:tasks.rados.rados.0.smithi137.stdout:3634: done (1 left) 2024-03-04T06:53:52.344 INFO:tasks.rados.rados.0.smithi137.stdout:3635: read oid 28 snap -1 2024-03-04T06:53:52.344 INFO:tasks.rados.rados.0.smithi137.stdout:3635: expect (ObjNum 1096 snap 326 seq_num 1096) 2024-03-04T06:53:52.344 INFO:tasks.rados.rados.0.smithi137.stdout:3636: read oid 21 snap -1 2024-03-04T06:53:52.344 INFO:tasks.rados.rados.0.smithi137.stdout:3636: expect deleted 2024-03-04T06:53:52.344 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 344 2024-03-04T06:53:52.344 INFO:tasks.rados.rados.0.smithi137.stdout:3637: seq_num 1136 ranges {0=630784,630784=409600,1040384=753664,1794048=417792,2211840=24576} 2024-03-04T06:53:52.347 INFO:tasks.rados.rados.0.smithi137.stdout:3637: writing smithi13777483-27 from 0 to 630784 tid 1 2024-03-04T06:53:52.350 INFO:tasks.rados.rados.0.smithi137.stdout:3637: writing smithi13777483-27 from 630784 to 1040384 tid 2 2024-03-04T06:53:52.354 INFO:tasks.rados.rados.0.smithi137.stdout:3637: writing smithi13777483-27 from 1040384 to 1794048 tid 3 2024-03-04T06:53:52.358 INFO:tasks.rados.rados.0.smithi137.stdout:3637: writing smithi13777483-27 from 1794048 to 2211840 tid 4 2024-03-04T06:53:52.358 INFO:tasks.rados.rados.0.smithi137.stdout:3637: writing smithi13777483-27 from 2211840 to 2236416 tid 5 2024-03-04T06:53:52.358 INFO:tasks.rados.rados.0.smithi137.stdout:3638: read oid 16 snap 321 2024-03-04T06:53:52.358 INFO:tasks.rados.rados.0.smithi137.stdout:3638: expect (ObjNum 1061 snap 319 seq_num 1061) 2024-03-04T06:53:52.358 INFO:tasks.rados.rados.0.smithi137.stdout:3639: snap_create 2024-03-04T06:53:52.358 INFO:tasks.rados.rados.0.smithi137.stdout:3633: finishing write tid 3 to smithi13777483-13 2024-03-04T06:53:52.358 INFO:tasks.rados.rados.0.smithi137.stdout:3633: finishing write tid 4 to smithi13777483-13 2024-03-04T06:53:52.358 INFO:tasks.rados.rados.0.smithi137.stdout:3633: finishing write tid 5 to smithi13777483-13 2024-03-04T06:53:52.358 INFO:tasks.rados.rados.0.smithi137.stdout:3633: finishing write tid 6 to smithi13777483-13 2024-03-04T06:53:52.358 INFO:tasks.rados.rados.0.smithi137.stdout:3633: oid 13 updating version 0 to 17002 2024-03-04T06:53:52.359 INFO:tasks.rados.rados.0.smithi137.stdout:3633: oid 13 version 17002 is already newer than 16999 2024-03-04T06:53:52.359 INFO:tasks.rados.rados.0.smithi137.stdout:3633: oid 13 updating version 17002 to 17003 2024-03-04T06:53:52.359 INFO:tasks.rados.rados.0.smithi137.stdout:3633: oid 13 version 17003 is already newer than 17000 2024-03-04T06:53:52.359 INFO:tasks.rados.rados.0.smithi137.stdout:3633: oid 13 version 17003 is already newer than 17001 2024-03-04T06:53:52.359 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 17003 (ObjNum 1134 snap 344 seq_num 1134) dirty exists 2024-03-04T06:53:52.359 INFO:tasks.rados.rados.0.smithi137.stdout:3633: left oid 13 (ObjNum 1134 snap 344 seq_num 1134) 2024-03-04T06:53:52.359 INFO:tasks.rados.rados.0.smithi137.stdout:3637: finishing write tid 1 to smithi13777483-27 2024-03-04T06:53:52.359 INFO:tasks.rados.rados.0.smithi137.stdout:3637: finishing write tid 2 to smithi13777483-27 2024-03-04T06:53:52.364 INFO:tasks.rados.rados.0.smithi137.stdout:3637: finishing write tid 3 to smithi13777483-27 2024-03-04T06:53:52.364 INFO:tasks.rados.rados.0.smithi137.stdout:3637: finishing write tid 4 to smithi13777483-27 2024-03-04T06:53:52.364 INFO:tasks.rados.rados.0.smithi137.stdout:3637: finishing write tid 5 to smithi13777483-27 2024-03-04T06:53:52.369 INFO:tasks.rados.rados.0.smithi137.stdout:3637: finishing write tid 6 to smithi13777483-27 2024-03-04T06:53:52.371 INFO:tasks.rados.rados.0.smithi137.stdout:3638: expect (ObjNum 1061 snap 319 seq_num 1061) 2024-03-04T06:53:52.398 INFO:tasks.rados.rados.0.smithi137.stdout:3637: finishing write tid 7 to smithi13777483-27 2024-03-04T06:53:52.398 INFO:tasks.rados.rados.0.smithi137.stdout:3637: oid 27 updating version 0 to 17009 2024-03-04T06:53:52.398 INFO:tasks.rados.rados.0.smithi137.stdout:3637: oid 27 version 17009 is already newer than 17008 2024-03-04T06:53:52.398 INFO:tasks.rados.rados.0.smithi137.stdout:3637: oid 27 version 17009 is already newer than 17006 2024-03-04T06:53:52.398 INFO:tasks.rados.rados.0.smithi137.stdout:3637: oid 27 version 17009 is already newer than 17005 2024-03-04T06:53:52.398 INFO:tasks.rados.rados.0.smithi137.stdout:3637: oid 27 version 17009 is already newer than 17004 2024-03-04T06:53:52.398 INFO:tasks.rados.rados.0.smithi137.stdout:3637: oid 27 version 17009 is already newer than 17007 2024-03-04T06:53:52.398 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 17009 (ObjNum 1136 snap 344 seq_num 1136) dirty exists 2024-03-04T06:53:52.398 INFO:tasks.rados.rados.0.smithi137.stdout:3637: left oid 27 (ObjNum 1136 snap 344 seq_num 1136) 2024-03-04T06:53:52.399 INFO:tasks.rados.rados.0.smithi137.stdout:3635: expect (ObjNum 1096 snap 326 seq_num 1096) 2024-03-04T06:53:52.542 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:52.248+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:52.542 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:52.248+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:52.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:52.299+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:52.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:52.299+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:52.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:52.299+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[88869]: pgmap v804: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 808 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 13 MiB/s rd, 8.7 MiB/s wr, 22 op/s 2024-03-04T06:53:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[88869]: osdmap e748: 8 total, 8 up, 8 in 2024-03-04T06:53:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[91314]: pgmap v804: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 808 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 13 MiB/s rd, 8.7 MiB/s wr, 22 op/s 2024-03-04T06:53:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[91314]: osdmap e748: 8 total, 8 up, 8 in 2024-03-04T06:53:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:52.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:52.545 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:52.303+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:52.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:52.249+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:52.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:52.309+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:52.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:52.304+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:52.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:52.304+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:52.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:52.250+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:52.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:52.305+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:52.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-mon[85573]: pgmap v804: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 808 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 13 MiB/s rd, 8.7 MiB/s wr, 22 op/s 2024-03-04T06:53:52.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:52.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:52.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:52.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-mon[85573]: osdmap e748: 8 total, 8 up, 8 in 2024-03-04T06:53:52.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:52.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:52.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:52.312+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:52.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:52.312+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:52.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:52.249+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:52.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:52.249+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:52.597 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:52.299+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:53.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:53.489+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:53.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:53.489+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:53.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:53.317+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:53.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:53.490+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:53.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:53.490+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:53.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:53.490+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:53.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:53.489+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:53.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:53.490+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:53.597 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:53.490+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:53.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:53.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:53.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:53.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:53.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:53.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:53.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: osdmap e749: 8 total, 8 up, 8 in 2024-03-04T06:53:53.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:53.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:53.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:53.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:53.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:53.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:53.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:53.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:53.599 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:53.618 INFO:tasks.rados.rados.0.smithi137.stdout:3633: done (5 left) 2024-03-04T06:53:53.618 INFO:tasks.rados.rados.0.smithi137.stdout:3635: done (4 left) 2024-03-04T06:53:53.619 INFO:tasks.rados.rados.0.smithi137.stdout:3636: done (3 left) 2024-03-04T06:53:53.619 INFO:tasks.rados.rados.0.smithi137.stdout:3637: done (2 left) 2024-03-04T06:53:53.619 INFO:tasks.rados.rados.0.smithi137.stdout:3638: done (1 left) 2024-03-04T06:53:53.619 INFO:tasks.rados.rados.0.smithi137.stdout:3639: done (0 left) 2024-03-04T06:53:53.619 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 345 2024-03-04T06:53:53.619 INFO:tasks.rados.rados.0.smithi137.stdout:3640: seq_num 1137 ranges {2138112=647168,2785280=696320,3481600=557056,4038656=352256} 2024-03-04T06:53:53.633 INFO:tasks.rados.rados.0.smithi137.stdout:3640: writing smithi13777483-15 from 2138112 to 2785280 tid 1 2024-03-04T06:53:53.636 INFO:tasks.rados.rados.0.smithi137.stdout:3640: writing smithi13777483-15 from 2785280 to 3481600 tid 2 2024-03-04T06:53:53.639 INFO:tasks.rados.rados.0.smithi137.stdout:3640: writing smithi13777483-15 from 3481600 to 4038656 tid 3 2024-03-04T06:53:53.642 INFO:tasks.rados.rados.0.smithi137.stdout:3640: writing smithi13777483-15 from 4038656 to 4390912 tid 4 2024-03-04T06:53:53.642 INFO:tasks.rados.rados.0.smithi137.stdout:3641: read oid 5 snap 332 2024-03-04T06:53:53.642 INFO:tasks.rados.rados.0.smithi137.stdout:3641: expect deleted 2024-03-04T06:53:53.642 INFO:tasks.rados.rados.0.smithi137.stdout:3642: snap_create 2024-03-04T06:53:53.642 INFO:tasks.rados.rados.0.smithi137.stdout:3640: finishing write tid 1 to smithi13777483-15 2024-03-04T06:53:53.644 INFO:tasks.rados.rados.0.smithi137.stdout:3640: finishing write tid 2 to smithi13777483-15 2024-03-04T06:53:53.645 INFO:tasks.rados.rados.0.smithi137.stdout:3640: finishing write tid 3 to smithi13777483-15 2024-03-04T06:53:53.646 INFO:tasks.rados.rados.0.smithi137.stdout:3640: finishing write tid 4 to smithi13777483-15 2024-03-04T06:53:53.646 INFO:tasks.rados.rados.0.smithi137.stdout:3640: finishing write tid 5 to smithi13777483-15 2024-03-04T06:53:53.647 INFO:tasks.rados.rados.0.smithi137.stdout:3640: finishing write tid 6 to smithi13777483-15 2024-03-04T06:53:53.648 INFO:tasks.rados.rados.0.smithi137.stdout:3640: oid 15 updating version 0 to 16978 2024-03-04T06:53:53.648 INFO:tasks.rados.rados.0.smithi137.stdout:3640: oid 15 updating version 16978 to 16979 2024-03-04T06:53:53.648 INFO:tasks.rados.rados.0.smithi137.stdout:3640: oid 15 updating version 16979 to 16980 2024-03-04T06:53:53.648 INFO:tasks.rados.rados.0.smithi137.stdout:3640: oid 15 updating version 16980 to 16981 2024-03-04T06:53:53.648 INFO:tasks.rados.rados.0.smithi137.stdout:3640: oid 15 version 16981 is already newer than 16977 2024-03-04T06:53:53.648 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16981 (ObjNum 1137 snap 345 seq_num 1137) dirty exists 2024-03-04T06:53:53.648 INFO:tasks.rados.rados.0.smithi137.stdout:3640: left oid 15 (ObjNum 1137 snap 345 seq_num 1137) 2024-03-04T06:53:53.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:53.486+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:53.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:53.487+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:53.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:53.487+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:53.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:53.312+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:53.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:53.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:53.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:53.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:53.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:53.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:53.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: osdmap e749: 8 total, 8 up, 8 in 2024-03-04T06:53:53.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:53.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:53.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:53.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:53.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:53.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:53.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:53.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:53.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:53.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:53.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:53.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:53.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:53.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:53.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:53.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: osdmap e749: 8 total, 8 up, 8 in 2024-03-04T06:53:53.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:53.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:53.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:53.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:53.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:53.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:53.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:53.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:53.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:54.319 INFO:tasks.rados.rados.0.smithi137.stdout:3640: done (2 left) 2024-03-04T06:53:54.319 INFO:tasks.rados.rados.0.smithi137.stdout:3641: done (1 left) 2024-03-04T06:53:54.319 INFO:tasks.rados.rados.0.smithi137.stdout:3642: done (0 left) 2024-03-04T06:53:54.319 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 24 current snap is 346 2024-03-04T06:53:54.319 INFO:tasks.rados.rados.0.smithi137.stdout:3643: seq_num 1138 ranges {1949696=663552,2613248=581632,3194880=712704,3907584=311296} 2024-03-04T06:53:54.320 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:54.318+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:54.320 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-mon[85573]: pgmap v807: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 808 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 1 op/s 2024-03-04T06:53:54.320 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-mon[85573]: osdmap e750: 8 total, 8 up, 8 in 2024-03-04T06:53:54.320 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:54.320 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:54.320 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:53:54.320 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:54.320 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:54.320 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:54.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:54.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:54.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:54.321 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:54.333 INFO:tasks.rados.rados.0.smithi137.stdout:3643: writing smithi13777483-24 from 1949696 to 2613248 tid 1 2024-03-04T06:53:54.336 INFO:tasks.rados.rados.0.smithi137.stdout:3643: writing smithi13777483-24 from 2613248 to 3194880 tid 2 2024-03-04T06:53:54.340 INFO:tasks.rados.rados.0.smithi137.stdout:3643: writing smithi13777483-24 from 3194880 to 3907584 tid 3 2024-03-04T06:53:54.342 INFO:tasks.rados.rados.0.smithi137.stdout:3643: writing smithi13777483-24 from 3907584 to 4218880 tid 4 2024-03-04T06:53:54.342 INFO:tasks.rados.rados.0.smithi137.stdout:3644: rollback oid 9 current snap is 346 2024-03-04T06:53:54.342 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 9 to 339 2024-03-04T06:53:54.342 INFO:tasks.rados.rados.0.smithi137.stdout:3645: snap_remove snap 315 2024-03-04T06:53:54.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:54.318+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:54.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:54.341+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:54.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:54.342+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:54.678 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:54.318+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:54.678 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:54.339+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:54.679 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:54.339+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:54.679 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:54.339+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:54.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[88869]: pgmap v807: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 808 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 1 op/s 2024-03-04T06:53:54.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[88869]: osdmap e750: 8 total, 8 up, 8 in 2024-03-04T06:53:54.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:54.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:54.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:53:54.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:54.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:54.679 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:54.680 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:54.680 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:54.680 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:54.680 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:54.680 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[91314]: pgmap v807: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 808 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 1 op/s 2024-03-04T06:53:54.680 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[91314]: osdmap e750: 8 total, 8 up, 8 in 2024-03-04T06:53:54.680 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:54.680 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:54.680 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:53:54.680 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:54.680 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:54.680 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:54.680 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:54.681 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:54.681 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:54.681 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:55.042 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:54.677+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:55.095 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:54.678+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:55.095 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:54.678+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:55.330 INFO:tasks.rados.rados.0.smithi137.stdout:3645: done (2 left) 2024-03-04T06:53:55.330 INFO:tasks.rados.rados.0.smithi137.stdout:3646: delete oid 22 current snap is 346 2024-03-04T06:53:55.330 INFO:tasks.rados.rados.0.smithi137.stdout:3644: finishing rollback tid 0 to smithi13777483-9 2024-03-04T06:53:55.330 INFO:tasks.rados.rados.0.smithi137.stdout:3644: finishing rollback tid 1 to smithi13777483-9 2024-03-04T06:53:55.330 INFO:tasks.rados.rados.0.smithi137.stdout:3644: finishing rollback tid 2 to smithi13777483-9 2024-03-04T06:53:55.330 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 16977 (ObjNum 931 snap 275 seq_num 931) dirty exists 2024-03-04T06:53:55.330 INFO:tasks.rados.rados.0.smithi137.stdout:3643: finishing write tid 1 to smithi13777483-24 2024-03-04T06:53:55.331 INFO:tasks.rados.rados.0.smithi137.stdout:3643: finishing write tid 2 to smithi13777483-24 2024-03-04T06:53:55.331 INFO:tasks.rados.rados.0.smithi137.stdout:3643: finishing write tid 3 to smithi13777483-24 2024-03-04T06:53:55.331 INFO:tasks.rados.rados.0.smithi137.stdout:3643: finishing write tid 4 to smithi13777483-24 2024-03-04T06:53:55.331 INFO:tasks.rados.rados.0.smithi137.stdout:3643: finishing write tid 5 to smithi13777483-24 2024-03-04T06:53:55.331 INFO:tasks.rados.rados.0.smithi137.stdout:3643: finishing write tid 6 to smithi13777483-24 2024-03-04T06:53:55.331 INFO:tasks.rados.rados.0.smithi137.stdout:3643: oid 24 updating version 0 to 16971 2024-03-04T06:53:55.331 INFO:tasks.rados.rados.0.smithi137.stdout:3643: oid 24 version 16971 is already newer than 16969 2024-03-04T06:53:55.331 INFO:tasks.rados.rados.0.smithi137.stdout:3643: oid 24 version 16971 is already newer than 16970 2024-03-04T06:53:55.331 INFO:tasks.rados.rados.0.smithi137.stdout:3643: oid 24 updating version 16971 to 16972 2024-03-04T06:53:55.331 INFO:tasks.rados.rados.0.smithi137.stdout:3643: oid 24 version 16972 is already newer than 16968 2024-03-04T06:53:55.331 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16972 (ObjNum 1138 snap 346 seq_num 1138) dirty exists 2024-03-04T06:53:55.331 INFO:tasks.rados.rados.0.smithi137.stdout:3643: left oid 24 (ObjNum 1138 snap 346 seq_num 1138) 2024-03-04T06:53:55.337 INFO:tasks.rados.rados.0.smithi137.stdout:3643: done (2 left) 2024-03-04T06:53:55.337 INFO:tasks.rados.rados.0.smithi137.stdout:3644: done (1 left) 2024-03-04T06:53:55.337 INFO:tasks.rados.rados.0.smithi137.stdout:3646: done (0 left) 2024-03-04T06:53:55.337 INFO:tasks.rados.rados.0.smithi137.stdout:3647: read oid 12 snap -1 2024-03-04T06:53:55.337 INFO:tasks.rados.rados.0.smithi137.stdout:3647: expect (ObjNum 1097 snap 326 seq_num 1097) 2024-03-04T06:53:55.337 INFO:tasks.rados.rados.0.smithi137.stdout:3648: rmattr oid 17 current snap is 346 2024-03-04T06:53:55.338 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 346 2024-03-04T06:53:55.338 INFO:tasks.rados.rados.0.smithi137.stdout:3649: seq_num 1140 ranges {1949696=696320,2646016=745472,3391488=729088,4120576=131072} 2024-03-04T06:53:55.352 INFO:tasks.rados.rados.0.smithi137.stdout:3649: writing smithi13777483-7 from 1949696 to 2646016 tid 1 2024-03-04T06:53:55.357 INFO:tasks.rados.rados.0.smithi137.stdout:3649: writing smithi13777483-7 from 2646016 to 3391488 tid 2 2024-03-04T06:53:55.362 INFO:tasks.rados.rados.0.smithi137.stdout:3649: writing smithi13777483-7 from 3391488 to 4120576 tid 3 2024-03-04T06:53:55.363 INFO:tasks.rados.rados.0.smithi137.stdout:3649: writing smithi13777483-7 from 4120576 to 4251648 tid 4 2024-03-04T06:53:55.363 INFO:tasks.rados.rados.0.smithi137.stdout:3650: copy_from oid 6 from oid 3 current snap is 346 2024-03-04T06:53:55.363 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16968 (ObjNum 1097 snap 326 seq_num 1097) dirty exists 2024-03-04T06:53:55.364 INFO:tasks.rados.rados.0.smithi137.stdout:3649: finishing write tid 1 to smithi13777483-7 2024-03-04T06:53:55.364 INFO:tasks.rados.rados.0.smithi137.stdout:3649: finishing write tid 2 to smithi13777483-7 2024-03-04T06:53:55.364 INFO:tasks.rados.rados.0.smithi137.stdout:3648: done (3 left) 2024-03-04T06:53:55.364 INFO:tasks.rados.rados.0.smithi137.stdout:3651: read oid 22 snap -1 2024-03-04T06:53:55.364 INFO:tasks.rados.rados.0.smithi137.stdout:3651: expect deleted 2024-03-04T06:53:55.364 INFO:tasks.rados.rados.0.smithi137.stdout:3652: read oid 37 snap -1 2024-03-04T06:53:55.364 INFO:tasks.rados.rados.0.smithi137.stdout:3652: expect deleted 2024-03-04T06:53:55.364 INFO:tasks.rados.rados.0.smithi137.stdout:3653: snap_create 2024-03-04T06:53:55.365 INFO:tasks.rados.rados.0.smithi137.stdout:3650: finishing copy_from to smithi13777483-6 2024-03-04T06:53:55.365 INFO:tasks.rados.rados.0.smithi137.stdout:3650: got expected ENOENT (src dne) 2024-03-04T06:53:55.365 INFO:tasks.rados.rados.0.smithi137.stdout:3650: finishing copy_from racing read to smithi13777483-6 2024-03-04T06:53:55.366 INFO:tasks.rados.rados.0.smithi137.stdout:3649: finishing write tid 3 to smithi13777483-7 2024-03-04T06:53:55.366 INFO:tasks.rados.rados.0.smithi137.stdout:3649: finishing write tid 4 to smithi13777483-7 2024-03-04T06:53:55.366 INFO:tasks.rados.rados.0.smithi137.stdout:3649: finishing write tid 5 to smithi13777483-7 2024-03-04T06:53:55.368 INFO:tasks.rados.rados.0.smithi137.stdout:3649: finishing write tid 6 to smithi13777483-7 2024-03-04T06:53:55.368 INFO:tasks.rados.rados.0.smithi137.stdout:3649: oid 7 updating version 0 to 16976 2024-03-04T06:53:55.368 INFO:tasks.rados.rados.0.smithi137.stdout:3649: oid 7 version 16976 is already newer than 16974 2024-03-04T06:53:55.368 INFO:tasks.rados.rados.0.smithi137.stdout:3649: oid 7 updating version 16976 to 16977 2024-03-04T06:53:55.368 INFO:tasks.rados.rados.0.smithi137.stdout:3649: oid 7 updating version 16977 to 16978 2024-03-04T06:53:55.368 INFO:tasks.rados.rados.0.smithi137.stdout:3649: oid 7 version 16978 is already newer than 16975 2024-03-04T06:53:55.368 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16978 (ObjNum 1140 snap 346 seq_num 1140) dirty exists 2024-03-04T06:53:55.368 INFO:tasks.rados.rados.0.smithi137.stdout:3649: left oid 7 (ObjNum 1140 snap 346 seq_num 1140) 2024-03-04T06:53:55.405 INFO:tasks.rados.rados.0.smithi137.stdout:3647: expect (ObjNum 1097 snap 326 seq_num 1097) 2024-03-04T06:53:55.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:55.337+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:55.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:55.336+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:55.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:55.336+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:55.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:55.336+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:55.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:55.325+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:55.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:55.325+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:55.597 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:55.325+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-mon[85573]: osdmap e751: 8 total, 8 up, 8 in 2024-03-04T06:53:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:55.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:55.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:55.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:55.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:55.598 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:55.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:53:55] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:53:55.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:55.330+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:55.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:55.330+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:55.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:55.331+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:55.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:55.341+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[88869]: osdmap e751: 8 total, 8 up, 8 in 2024-03-04T06:53:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:55.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:55.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:55.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:55.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:55.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:55.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:55.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:55.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:55.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:55.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:55.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[91314]: osdmap e751: 8 total, 8 up, 8 in 2024-03-04T06:53:55.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:55.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:55.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:55.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:55.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:55.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:55.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:55.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:56.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:56.407+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:56.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:56.406+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:56.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:56.406+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:56.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:56.378+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:56.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:56.378+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:56.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:56.380+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-mon[85573]: pgmap v810: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 817 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 9.7 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2024-03-04T06:53:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-mon[85573]: osdmap e752: 8 total, 8 up, 8 in 2024-03-04T06:53:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:56.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:56.598 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:56.331+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:56.598 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:56.331+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:56.614 INFO:tasks.rados.rados.0.smithi137.stdout:3647: done (5 left) 2024-03-04T06:53:56.614 INFO:tasks.rados.rados.0.smithi137.stdout:3649: done (4 left) 2024-03-04T06:53:56.614 INFO:tasks.rados.rados.0.smithi137.stdout:3650: done (3 left) 2024-03-04T06:53:56.614 INFO:tasks.rados.rados.0.smithi137.stdout:3651: done (2 left) 2024-03-04T06:53:56.614 INFO:tasks.rados.rados.0.smithi137.stdout:3652: done (1 left) 2024-03-04T06:53:56.614 INFO:tasks.rados.rados.0.smithi137.stdout:3653: done (0 left) 2024-03-04T06:53:56.614 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 347 2024-03-04T06:53:56.614 INFO:tasks.rados.rados.0.smithi137.stdout:3654: seq_num 1141 ranges {2015232=712704,2727936=679936,3407872=540672,3948544=385024} 2024-03-04T06:53:56.628 INFO:tasks.rados.rados.0.smithi137.stdout:3654: writing smithi13777483-23 from 2015232 to 2727936 tid 1 2024-03-04T06:53:56.632 INFO:tasks.rados.rados.0.smithi137.stdout:3654: writing smithi13777483-23 from 2727936 to 3407872 tid 2 2024-03-04T06:53:56.634 INFO:tasks.rados.rados.0.smithi137.stdout:3654: writing smithi13777483-23 from 3407872 to 3948544 tid 3 2024-03-04T06:53:56.637 INFO:tasks.rados.rados.0.smithi137.stdout:3654: writing smithi13777483-23 from 3948544 to 4333568 tid 4 2024-03-04T06:53:56.637 INFO:tasks.rados.rados.0.smithi137.stdout:3655: delete oid 37 current snap is 347 2024-03-04T06:53:56.637 INFO:tasks.rados.rados.0.smithi137.stdout:3654: finishing write tid 1 to smithi13777483-23 2024-03-04T06:53:56.637 INFO:tasks.rados.rados.0.smithi137.stdout:3654: finishing write tid 2 to smithi13777483-23 2024-03-04T06:53:56.639 INFO:tasks.rados.rados.0.smithi137.stdout:3654: finishing write tid 3 to smithi13777483-23 2024-03-04T06:53:56.639 INFO:tasks.rados.rados.0.smithi137.stdout:3655: done (1 left) 2024-03-04T06:53:56.640 INFO:tasks.rados.rados.0.smithi137.stdout:3656: read oid 19 snap -1 2024-03-04T06:53:56.640 INFO:tasks.rados.rados.0.smithi137.stdout:3656: expect (ObjNum 1124 snap 340 seq_num 1124) 2024-03-04T06:53:56.640 INFO:tasks.rados.rados.0.smithi137.stdout:3657: snap_create 2024-03-04T06:53:56.640 INFO:tasks.rados.rados.0.smithi137.stdout:3654: finishing write tid 4 to smithi13777483-23 2024-03-04T06:53:56.640 INFO:tasks.rados.rados.0.smithi137.stdout:3654: finishing write tid 5 to smithi13777483-23 2024-03-04T06:53:56.642 INFO:tasks.rados.rados.0.smithi137.stdout:3654: finishing write tid 6 to smithi13777483-23 2024-03-04T06:53:56.642 INFO:tasks.rados.rados.0.smithi137.stdout:3654: oid 23 updating version 0 to 16962 2024-03-04T06:53:56.642 INFO:tasks.rados.rados.0.smithi137.stdout:3654: oid 23 version 16962 is already newer than 16960 2024-03-04T06:53:56.642 INFO:tasks.rados.rados.0.smithi137.stdout:3654: oid 23 version 16962 is already newer than 16959 2024-03-04T06:53:56.643 INFO:tasks.rados.rados.0.smithi137.stdout:3654: oid 23 version 16962 is already newer than 16961 2024-03-04T06:53:56.643 INFO:tasks.rados.rados.0.smithi137.stdout:3654: oid 23 version 16962 is already newer than 16958 2024-03-04T06:53:56.643 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 16962 (ObjNum 1141 snap 347 seq_num 1141) dirty exists 2024-03-04T06:53:56.643 INFO:tasks.rados.rados.0.smithi137.stdout:3654: left oid 23 (ObjNum 1141 snap 347 seq_num 1141) 2024-03-04T06:53:56.646 INFO:tasks.rados.rados.0.smithi137.stdout:3656: expect (ObjNum 1124 snap 340 seq_num 1124) 2024-03-04T06:53:56.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:56.333+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:56.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:56.404+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:56.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:56.405+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:56.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:56.405+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:56.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:56.405+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:56.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[91314]: pgmap v810: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 817 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 9.7 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2024-03-04T06:53:56.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:56.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:56.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[91314]: osdmap e752: 8 total, 8 up, 8 in 2024-03-04T06:53:56.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:56.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:56.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:56.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:56.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:56.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:56.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:56.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[88869]: pgmap v810: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 817 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 9.7 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2024-03-04T06:53:56.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:56.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:56.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[88869]: osdmap e752: 8 total, 8 up, 8 in 2024-03-04T06:53:56.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:56.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:56.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:56.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:56.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:56.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:56.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:56 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:57.341 INFO:tasks.rados.rados.0.smithi137.stdout:3654: done (2 left) 2024-03-04T06:53:57.341 INFO:tasks.rados.rados.0.smithi137.stdout:3656: done (1 left) 2024-03-04T06:53:57.341 INFO:tasks.rados.rados.0.smithi137.stdout:3657: done (0 left) 2024-03-04T06:53:57.341 INFO:tasks.rados.rados.0.smithi137.stdout:3658: snap_remove snap 339 2024-03-04T06:53:57.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:57.479+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:57.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:57.479+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:57.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:57.340+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:57.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:57.340+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:57.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:57.340+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:57.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-mon[85573]: osdmap e753: 8 total, 8 up, 8 in 2024-03-04T06:53:57.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:57.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:57.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:57.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:57.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:57.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:57.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:57.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:57.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:57.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:57.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:57.640 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:57.488+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:57.640 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:57.339+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:57.640 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[88869]: osdmap e753: 8 total, 8 up, 8 in 2024-03-04T06:53:57.640 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:57.640 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:57.640 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:57.640 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:57.641 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:57.641 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:57.641 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:57.641 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:57.641 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:57.641 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:57.641 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:57.641 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[91314]: osdmap e753: 8 total, 8 up, 8 in 2024-03-04T06:53:57.641 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:57.641 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:57.641 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:57.641 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:57.641 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:57.642 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:57.642 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:57.642 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:57.642 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:57.642 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:57.642 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:58.042 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:57.638+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:58.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:57.638+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:58.335 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:57.879+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:58.335 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:57.878+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:58.335 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:57.878+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:58.335 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:57.878+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:58.347 INFO:tasks.rados.rados.0.smithi137.stdout:3658: done (0 left) 2024-03-04T06:53:58.347 INFO:tasks.rados.rados.0.smithi137.stdout:3659: snap_remove snap 334 2024-03-04T06:53:58.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:58.347+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:58.595 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:58.347+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:58.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:58.358+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:58.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:58.557+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:58.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:58.356+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:58.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:58.358+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:58.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-mon[85573]: pgmap v813: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 817 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 9.7 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2024-03-04T06:53:58.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:58.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:58.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:58.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-mon[85573]: osdmap e754: 8 total, 8 up, 8 in 2024-03-04T06:53:58.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:58.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:58.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:58.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:58.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:58.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:58 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:58.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:58.352+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:58.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:58.352+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:53:58.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:58.352+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:58.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:58.350+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:58.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:58.348+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:58.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[88869]: pgmap v813: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 817 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 9.7 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2024-03-04T06:53:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[88869]: osdmap e754: 8 total, 8 up, 8 in 2024-03-04T06:53:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:58.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:58.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[91314]: pgmap v813: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 817 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 9.7 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2024-03-04T06:53:58.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[91314]: osdmap e754: 8 total, 8 up, 8 in 2024-03-04T06:53:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:58.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:58 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:59.354 INFO:tasks.rados.rados.0.smithi137.stdout:3659: done (0 left) 2024-03-04T06:53:59.354 INFO:tasks.rados.rados.0.smithi137.stdout:3660: snap_create 2024-03-04T06:53:59.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:59.353+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:59.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:53:59.355+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:59.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:53:59.355+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[88869]: osdmap e755: 8 total, 8 up, 8 in 2024-03-04T06:53:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:59.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:59.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[91314]: osdmap e755: 8 total, 8 up, 8 in 2024-03-04T06:53:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:59.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:59.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:59.795 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:53:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:53:59.352+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:59.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:53:59.360+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:59.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:59.578+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:53:59.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:53:59.578+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:53:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-mon[85573]: osdmap e755: 8 total, 8 up, 8 in 2024-03-04T06:53:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:53:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:53:59.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:53:59.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:53:59.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:59.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:53:59.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:53:59.847 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:59.354+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:53:59.847 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:59.354+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:53:59.847 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:53:59.354+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:53:59.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:59.349+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:53:59.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:59.349+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:53:59.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:53:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:53:59.349+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:00.358 INFO:tasks.rados.rados.0.smithi137.stdout:3660: done (0 left) 2024-03-04T06:54:00.358 INFO:tasks.rados.rados.0.smithi137.stdout:3661: rmattr oid 26 current snap is 349 2024-03-04T06:54:00.358 INFO:tasks.rados.rados.0.smithi137.stdout:3662: snap_remove snap 337 2024-03-04T06:54:00.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:00.357+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:00.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:00.389+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:00.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:00.389+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:00.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:00.390+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:00.794 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:00.389+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[91314]: pgmap v816: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 824 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 8 op/s 2024-03-04T06:54:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[91314]: osdmap e756: 8 total, 8 up, 8 in 2024-03-04T06:54:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:00.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:00.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:00.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[88869]: pgmap v816: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 824 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 8 op/s 2024-03-04T06:54:00.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:00.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:00.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:00.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[88869]: osdmap e756: 8 total, 8 up, 8 in 2024-03-04T06:54:00.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:00.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:00.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:00.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:00.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:00.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:00.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:00.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:00.364+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:00.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:00.390+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:00.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:00.358+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:00.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:00.358+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:00.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:00.363+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:00.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:00.364+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:00.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-mon[85573]: pgmap v816: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 824 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 8 op/s 2024-03-04T06:54:00.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:00.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:00.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:00.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-mon[85573]: osdmap e756: 8 total, 8 up, 8 in 2024-03-04T06:54:00.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:00.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:00.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:00.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:00.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:00.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:00.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:01.365 INFO:tasks.rados.rados.0.smithi137.stdout:3662: done (1 left) 2024-03-04T06:54:01.366 INFO:tasks.rados.rados.0.smithi137.stdout:3663: snap_create 2024-03-04T06:54:01.366 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16973 (ObjNum 957 snap 282 seq_num 957) dirty exists 2024-03-04T06:54:01.747 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:01.362+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:01.747 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:01.362+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:01.747 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:01.363+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:01.748 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:01.372+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:01.748 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:01.374+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:01.748 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:01.374+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:01.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:01.748 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-mon[85573]: osdmap e757: 8 total, 8 up, 8 in 2024-03-04T06:54:01.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:01.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:01.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:01.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:01.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:01.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:01.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:01.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:01.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:01.749 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:01.750 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:01.374+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:01.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:01.458+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:01.750 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:01.458+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:01.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:01.369+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:01.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:01.369+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:01.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:01.369+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:01.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:01.363+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[91314]: osdmap e757: 8 total, 8 up, 8 in 2024-03-04T06:54:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:01.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:01.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:01.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[88869]: osdmap e757: 8 total, 8 up, 8 in 2024-03-04T06:54:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:01.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:01.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:01.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:01.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:01.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:02.365 INFO:tasks.rados.rados.0.smithi137.stdout:3661: done (1 left) 2024-03-04T06:54:02.365 INFO:tasks.rados.rados.0.smithi137.stdout:3663: done (0 left) 2024-03-04T06:54:02.365 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 50 current snap is 350 2024-03-04T06:54:02.365 INFO:tasks.rados.rados.0.smithi137.stdout:3664: seq_num 1143 ranges {0=753664,753664=450560,1204224=507904,1712128=589824,2301952=57344} 2024-03-04T06:54:02.369 INFO:tasks.rados.rados.0.smithi137.stdout:3664: writing smithi13777483-50 from 0 to 753664 tid 1 2024-03-04T06:54:02.372 INFO:tasks.rados.rados.0.smithi137.stdout:3664: writing smithi13777483-50 from 753664 to 1204224 tid 2 2024-03-04T06:54:02.375 INFO:tasks.rados.rados.0.smithi137.stdout:3664: writing smithi13777483-50 from 1204224 to 1712128 tid 3 2024-03-04T06:54:02.379 INFO:tasks.rados.rados.0.smithi137.stdout:3664: writing smithi13777483-50 from 1712128 to 2301952 tid 4 2024-03-04T06:54:02.379 INFO:tasks.rados.rados.0.smithi137.stdout:3664: writing smithi13777483-50 from 2301952 to 2359296 tid 5 2024-03-04T06:54:02.379 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 7 current snap is 350 2024-03-04T06:54:02.379 INFO:tasks.rados.rados.0.smithi137.stdout:3664: finishing write tid 1 to smithi13777483-50 2024-03-04T06:54:02.379 INFO:tasks.rados.rados.0.smithi137.stdout:3664: finishing write tid 2 to smithi13777483-50 2024-03-04T06:54:02.380 INFO:tasks.rados.rados.0.smithi137.stdout:3664: finishing write tid 3 to smithi13777483-50 2024-03-04T06:54:02.380 INFO:tasks.rados.rados.0.smithi137.stdout:3665: seq_num 1144 ranges {4251648=770048,5021696=737280,5758976=712704,6471680=155648} 2024-03-04T06:54:02.406 INFO:tasks.rados.rados.0.smithi137.stdout:3665: writing smithi13777483-7 from 4251648 to 5021696 tid 1 2024-03-04T06:54:02.410 INFO:tasks.rados.rados.0.smithi137.stdout:3665: writing smithi13777483-7 from 5021696 to 5758976 tid 2 2024-03-04T06:54:02.415 INFO:tasks.rados.rados.0.smithi137.stdout:3665: writing smithi13777483-7 from 5758976 to 6471680 tid 3 2024-03-04T06:54:02.416 INFO:tasks.rados.rados.0.smithi137.stdout:3665: writing smithi13777483-7 from 6471680 to 6627328 tid 4 2024-03-04T06:54:02.416 INFO:tasks.rados.rados.0.smithi137.stdout:3666: rollback oid 43 current snap is 350 2024-03-04T06:54:02.416 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 43 to 333 2024-03-04T06:54:02.416 INFO:tasks.rados.rados.0.smithi137.stdout:3664: finishing write tid 4 to smithi13777483-50 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3664: finishing write tid 5 to smithi13777483-50 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3664: finishing write tid 6 to smithi13777483-50 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3664: finishing write tid 7 to smithi13777483-50 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3664: oid 50 updating version 0 to 17014 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3664: oid 50 version 17014 is already newer than 17010 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3664: oid 50 version 17014 is already newer than 17011 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3664: oid 50 updating version 17014 to 17015 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3664: oid 50 version 17015 is already newer than 17012 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3664: oid 50 version 17015 is already newer than 17013 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 17015 (ObjNum 1143 snap 350 seq_num 1143) dirty exists 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3664: left oid 50 (ObjNum 1143 snap 350 seq_num 1143) 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3665: finishing write tid 1 to smithi13777483-7 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3665: finishing write tid 2 to smithi13777483-7 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3664: done (2 left) 2024-03-04T06:54:02.417 INFO:tasks.rados.rados.0.smithi137.stdout:3667: delete oid 4 current snap is 350 2024-03-04T06:54:02.419 INFO:tasks.rados.rados.0.smithi137.stdout:3665: finishing write tid 3 to smithi13777483-7 2024-03-04T06:54:02.420 INFO:tasks.rados.rados.0.smithi137.stdout:3665: finishing write tid 4 to smithi13777483-7 2024-03-04T06:54:02.422 INFO:tasks.rados.rados.0.smithi137.stdout:3665: finishing write tid 5 to smithi13777483-7 2024-03-04T06:54:02.423 INFO:tasks.rados.rados.0.smithi137.stdout:3666: finishing rollback tid 0 to smithi13777483-43 2024-03-04T06:54:02.423 INFO:tasks.rados.rados.0.smithi137.stdout:3666: finishing rollback tid 1 to smithi13777483-43 2024-03-04T06:54:02.424 INFO:tasks.rados.rados.0.smithi137.stdout:3667: done (2 left) 2024-03-04T06:54:02.424 INFO:tasks.rados.rados.0.smithi137.stdout:3668: read oid 18 snap 316 2024-03-04T06:54:02.424 INFO:tasks.rados.rados.0.smithi137.stdout:3668: expect (ObjNum 1022 snap 304 seq_num 1022) 2024-03-04T06:54:02.424 INFO:tasks.rados.rados.0.smithi137.stdout:3669: copy_from oid 16 from oid 47 current snap is 350 2024-03-04T06:54:02.424 INFO:tasks.rados.rados.0.smithi137.stdout:3670: copy_from oid 3 from oid 20 current snap is 350 2024-03-04T06:54:02.424 INFO:tasks.rados.rados.0.smithi137.stdout:3666: finishing rollback tid 2 to smithi13777483-43 2024-03-04T06:54:02.424 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16971 (ObjNum 1009 snap 296 seq_num 1009) dirty exists 2024-03-04T06:54:02.424 INFO:tasks.rados.rados.0.smithi137.stdout:3666: done (4 left) 2024-03-04T06:54:02.424 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 350 2024-03-04T06:54:02.424 INFO:tasks.rados.rados.0.smithi137.stdout:3671: seq_num 1146 ranges {0=802816,802816=499712,1302528=679936,1982464=425984} 2024-03-04T06:54:02.428 INFO:tasks.rados.rados.0.smithi137.stdout:3671: writing smithi13777483-11 from 0 to 802816 tid 1 2024-03-04T06:54:02.431 INFO:tasks.rados.rados.0.smithi137.stdout:3671: writing smithi13777483-11 from 802816 to 1302528 tid 2 2024-03-04T06:54:02.435 INFO:tasks.rados.rados.0.smithi137.stdout:3671: writing smithi13777483-11 from 1302528 to 1982464 tid 3 2024-03-04T06:54:02.438 INFO:tasks.rados.rados.0.smithi137.stdout:3671: writing smithi13777483-11 from 1982464 to 2408448 tid 4 2024-03-04T06:54:02.438 INFO:tasks.rados.rados.0.smithi137.stdout:3672: delete oid 23 current snap is 350 2024-03-04T06:54:02.438 INFO:tasks.rados.rados.0.smithi137.stdout:3669: finishing copy_from to smithi13777483-16 2024-03-04T06:54:02.438 INFO:tasks.rados.rados.0.smithi137.stdout:3669: got expected ENOENT (src dne) 2024-03-04T06:54:02.438 INFO:tasks.rados.rados.0.smithi137.stdout:3669: finishing copy_from racing read to smithi13777483-16 2024-03-04T06:54:02.438 INFO:tasks.rados.rados.0.smithi137.stdout:3665: finishing write tid 6 to smithi13777483-7 2024-03-04T06:54:02.438 INFO:tasks.rados.rados.0.smithi137.stdout:3665: oid 7 updating version 0 to 16981 2024-03-04T06:54:02.439 INFO:tasks.rados.rados.0.smithi137.stdout:3665: oid 7 version 16981 is already newer than 16979 2024-03-04T06:54:02.439 INFO:tasks.rados.rados.0.smithi137.stdout:3665: oid 7 updating version 16981 to 16983 2024-03-04T06:54:02.439 INFO:tasks.rados.rados.0.smithi137.stdout:3665: oid 7 version 16983 is already newer than 16980 2024-03-04T06:54:02.439 INFO:tasks.rados.rados.0.smithi137.stdout:3665: oid 7 version 16983 is already newer than 16982 2024-03-04T06:54:02.439 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 7 v 16983 (ObjNum 1144 snap 350 seq_num 1144) dirty exists 2024-03-04T06:54:02.439 INFO:tasks.rados.rados.0.smithi137.stdout:3665: left oid 7 (ObjNum 1144 snap 350 seq_num 1144) 2024-03-04T06:54:02.439 INFO:tasks.rados.rados.0.smithi137.stdout:3671: finishing write tid 1 to smithi13777483-11 2024-03-04T06:54:02.439 INFO:tasks.rados.rados.0.smithi137.stdout:3671: finishing write tid 2 to smithi13777483-11 2024-03-04T06:54:02.441 INFO:tasks.rados.rados.0.smithi137.stdout:3665: done (5 left) 2024-03-04T06:54:02.441 INFO:tasks.rados.rados.0.smithi137.stdout:3669: done (4 left) 2024-03-04T06:54:02.441 INFO:tasks.rados.rados.0.smithi137.stdout:3672: done (3 left) 2024-03-04T06:54:02.441 INFO:tasks.rados.rados.0.smithi137.stdout:3673: snap_create 2024-03-04T06:54:02.442 INFO:tasks.rados.rados.0.smithi137.stdout:3671: finishing write tid 3 to smithi13777483-11 2024-03-04T06:54:02.442 INFO:tasks.rados.rados.0.smithi137.stdout:3671: finishing write tid 4 to smithi13777483-11 2024-03-04T06:54:02.443 INFO:tasks.rados.rados.0.smithi137.stdout:3671: finishing write tid 5 to smithi13777483-11 2024-03-04T06:54:02.445 INFO:tasks.rados.rados.0.smithi137.stdout:3671: finishing write tid 6 to smithi13777483-11 2024-03-04T06:54:02.445 INFO:tasks.rados.rados.0.smithi137.stdout:3671: oid 11 updating version 0 to 16987 2024-03-04T06:54:02.445 INFO:tasks.rados.rados.0.smithi137.stdout:3671: oid 11 updating version 16987 to 16988 2024-03-04T06:54:02.445 INFO:tasks.rados.rados.0.smithi137.stdout:3671: oid 11 version 16988 is already newer than 16985 2024-03-04T06:54:02.445 INFO:tasks.rados.rados.0.smithi137.stdout:3671: oid 11 version 16988 is already newer than 16984 2024-03-04T06:54:02.445 INFO:tasks.rados.rados.0.smithi137.stdout:3671: oid 11 version 16988 is already newer than 16986 2024-03-04T06:54:02.446 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16988 (ObjNum 1146 snap 350 seq_num 1146) dirty exists 2024-03-04T06:54:02.446 INFO:tasks.rados.rados.0.smithi137.stdout:3671: left oid 11 (ObjNum 1146 snap 350 seq_num 1146) 2024-03-04T06:54:02.447 INFO:tasks.rados.rados.0.smithi137.stdout:3670: finishing copy_from racing read to smithi13777483-3 2024-03-04T06:54:02.448 INFO:tasks.rados.rados.0.smithi137.stdout:3670: finishing copy_from to smithi13777483-3 2024-03-04T06:54:02.448 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 16940 (ObjNum 1122 snap 339 seq_num 1122) dirty exists 2024-03-04T06:54:02.473 INFO:tasks.rados.rados.0.smithi137.stdout:3668: expect (ObjNum 1022 snap 304 seq_num 1022) 2024-03-04T06:54:02.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:02.412+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:02.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:02.420+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:02.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:02.422+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:02.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:02.422+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:02.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:02.367+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[91314]: pgmap v819: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 826 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 10 MiB/s rd, 2.2 MiB/s wr, 10 op/s 2024-03-04T06:54:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[91314]: osdmap e758: 8 total, 8 up, 8 in 2024-03-04T06:54:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:02.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:02.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[88869]: pgmap v819: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 826 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 10 MiB/s rd, 2.2 MiB/s wr, 10 op/s 2024-03-04T06:54:02.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:02.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:02.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:02.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[88869]: osdmap e758: 8 total, 8 up, 8 in 2024-03-04T06:54:02.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:02.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:02.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:02.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:02.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:02.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:02.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:02.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:02.442+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:02.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:02.363+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:02.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:02.364+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:02.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:02.375+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:02.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:02.420+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:02.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:02.420+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:02.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-mon[85573]: pgmap v819: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 826 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 10 MiB/s rd, 2.2 MiB/s wr, 10 op/s 2024-03-04T06:54:02.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:02.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:02.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:02.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-mon[85573]: osdmap e758: 8 total, 8 up, 8 in 2024-03-04T06:54:02.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:02.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:02.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:02.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:02.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:02.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:02.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:03.679 INFO:tasks.rados.rados.0.smithi137.stdout:3668: done (3 left) 2024-03-04T06:54:03.680 INFO:tasks.rados.rados.0.smithi137.stdout:3670: done (2 left) 2024-03-04T06:54:03.680 INFO:tasks.rados.rados.0.smithi137.stdout:3671: done (1 left) 2024-03-04T06:54:03.680 INFO:tasks.rados.rados.0.smithi137.stdout:3673: done (0 left) 2024-03-04T06:54:03.680 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 351 2024-03-04T06:54:03.680 INFO:tasks.rados.rados.0.smithi137.stdout:3674: seq_num 1148 ranges {4358144=32768} 2024-03-04T06:54:03.703 INFO:tasks.rados.rados.0.smithi137.stdout:3674: writing smithi13777483-42 from 4358144 to 4390912 tid 1 2024-03-04T06:54:03.703 INFO:tasks.rados.rados.0.smithi137.stdout:3675: rmattr oid 22 current snap is 351 2024-03-04T06:54:03.703 INFO:tasks.rados.rados.0.smithi137.stdout:3675: done (1 left) 2024-03-04T06:54:03.703 INFO:tasks.rados.rados.0.smithi137.stdout:3676: read oid 49 snap 328 2024-03-04T06:54:03.703 INFO:tasks.rados.rados.0.smithi137.stdout:3676: expect (ObjNum 1077 snap 324 seq_num 1077) 2024-03-04T06:54:03.703 INFO:tasks.rados.rados.0.smithi137.stdout:3677: delete oid 4 current snap is 351 2024-03-04T06:54:03.705 INFO:tasks.rados.rados.0.smithi137.stdout:3677: done (2 left) 2024-03-04T06:54:03.705 INFO:tasks.rados.rados.0.smithi137.stdout:3678: read oid 17 snap -1 2024-03-04T06:54:03.705 INFO:tasks.rados.rados.0.smithi137.stdout:3678: expect (ObjNum 1097 snap 326 seq_num 1097) 2024-03-04T06:54:03.705 INFO:tasks.rados.rados.0.smithi137.stdout:3679: rollback oid 36 current snap is 351 2024-03-04T06:54:03.705 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 36 to 350 2024-03-04T06:54:03.705 INFO:tasks.rados.rados.0.smithi137.stdout:3680: read oid 19 snap -1 2024-03-04T06:54:03.705 INFO:tasks.rados.rados.0.smithi137.stdout:3680: expect (ObjNum 1124 snap 340 seq_num 1124) 2024-03-04T06:54:03.705 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 43 current snap is 351 2024-03-04T06:54:03.706 INFO:tasks.rados.rados.0.smithi137.stdout:3681: seq_num 1150 ranges {2727936=65536} 2024-03-04T06:54:03.720 INFO:tasks.rados.rados.0.smithi137.stdout:3681: writing smithi13777483-43 from 2727936 to 2793472 tid 1 2024-03-04T06:54:03.721 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 351 2024-03-04T06:54:03.721 INFO:tasks.rados.rados.0.smithi137.stdout:3682: seq_num 1151 ranges {12312576=81920} 2024-03-04T06:54:03.787 INFO:tasks.rados.rados.0.smithi137.stdout:3682: writing smithi13777483-12 from 12312576 to 12394496 tid 1 2024-03-04T06:54:03.787 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 25 current snap is 351 2024-03-04T06:54:03.787 INFO:tasks.rados.rados.0.smithi137.stdout:3683: seq_num 1152 ranges {0=98304} 2024-03-04T06:54:03.789 INFO:tasks.rados.rados.0.smithi137.stdout:3683: writing smithi13777483-25 from 0 to 98304 tid 1 2024-03-04T06:54:03.789 INFO:tasks.rados.rados.0.smithi137.stdout:3684: read oid 31 snap 342 2024-03-04T06:54:03.789 INFO:tasks.rados.rados.0.smithi137.stdout:3684: expect deleted 2024-03-04T06:54:03.789 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 351 2024-03-04T06:54:03.789 INFO:tasks.rados.rados.0.smithi137.stdout:3679: finishing rollback tid 0 to smithi13777483-36 2024-03-04T06:54:03.789 INFO:tasks.rados.rados.0.smithi137.stdout:3674: finishing write tid 1 to smithi13777483-42 2024-03-04T06:54:03.789 INFO:tasks.rados.rados.0.smithi137.stdout:3679: finishing rollback tid 1 to smithi13777483-36 2024-03-04T06:54:03.789 INFO:tasks.rados.rados.0.smithi137.stdout:3685: seq_num 1153 ranges {0=114688} 2024-03-04T06:54:03.789 INFO:tasks.rados.rados.0.smithi137.stdout:3685: writing smithi13777483-8 from 0 to 114688 tid 1 2024-03-04T06:54:03.789 INFO:tasks.rados.rados.0.smithi137.stdout:3686: snap_remove snap 338 2024-03-04T06:54:03.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:03.377+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:03.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:03.378+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:03.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:03.407+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:03.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:03.406+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:03.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[88869]: osdmap e759: 8 total, 8 up, 8 in 2024-03-04T06:54:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:03.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[91314]: osdmap e759: 8 total, 8 up, 8 in 2024-03-04T06:54:03.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:03.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:03.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:03.408+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:03.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:03.382+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:03.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:03.382+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:03.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:03.382+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:03.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:03.406+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:03.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:03.406+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:03.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:03.407+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:03.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:03.407+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:03.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:03.407+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:03.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-mon[85573]: osdmap e759: 8 total, 8 up, 8 in 2024-03-04T06:54:03.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:03.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:03.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:03.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:03.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:03.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:03.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:03.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:03.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:03.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:04.384 INFO:tasks.rados.rados.0.smithi137.stdout:3686: done (10 left) 2024-03-04T06:54:04.384 INFO:tasks.rados.rados.0.smithi137.stdout:3687: read oid 30 snap -1 2024-03-04T06:54:04.384 INFO:tasks.rados.rados.0.smithi137.stdout:3687: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:54:04.384 INFO:tasks.rados.rados.0.smithi137.stdout:3679: finishing rollback tid 2 to smithi13777483-36 2024-03-04T06:54:04.384 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 36 v 16900 (ObjNum 1131 snap 343 seq_num 1131) dirty exists 2024-03-04T06:54:04.384 INFO:tasks.rados.rados.0.smithi137.stdout:3674: finishing write tid 2 to smithi13777483-42 2024-03-04T06:54:04.385 INFO:tasks.rados.rados.0.smithi137.stdout:3680: expect (ObjNum 1124 snap 340 seq_num 1124) 2024-03-04T06:54:04.448 INFO:tasks.rados.rados.0.smithi137.stdout:3674: finishing write tid 3 to smithi13777483-42 2024-03-04T06:54:04.448 INFO:tasks.rados.rados.0.smithi137.stdout:3674: oid 42 updating version 0 to 17016 2024-03-04T06:54:04.448 INFO:tasks.rados.rados.0.smithi137.stdout:3674: oid 42 updating version 17016 to 17017 2024-03-04T06:54:04.448 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 17017 (ObjNum 1148 snap 351 seq_num 1148) dirty exists 2024-03-04T06:54:04.448 INFO:tasks.rados.rados.0.smithi137.stdout:3674: left oid 42 (ObjNum 1148 snap 351 seq_num 1148) 2024-03-04T06:54:04.448 INFO:tasks.rados.rados.0.smithi137.stdout:3676: expect (ObjNum 1077 snap 324 seq_num 1077) 2024-03-04T06:54:04.595 INFO:tasks.rados.rados.0.smithi137.stdout:3681: finishing write tid 1 to smithi13777483-43 2024-03-04T06:54:04.595 INFO:tasks.rados.rados.0.smithi137.stdout:3678: expect (ObjNum 1097 snap 326 seq_num 1097) 2024-03-04T06:54:04.794 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:04.383+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:04.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:04.391+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:04.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:04.390+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:04.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:04.392+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:04.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:04.392+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:04.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[91314]: pgmap v822: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 826 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 255 B/s rd, 562 KiB/s wr, 1 op/s 2024-03-04T06:54:04.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[91314]: osdmap e760: 8 total, 8 up, 8 in 2024-03-04T06:54:04.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:04.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:04.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:04.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:04.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:04.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:04.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:04.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:04.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:04.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:04.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[88869]: pgmap v822: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 826 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 255 B/s rd, 562 KiB/s wr, 1 op/s 2024-03-04T06:54:04.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[88869]: osdmap e760: 8 total, 8 up, 8 in 2024-03-04T06:54:04.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:04.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:04.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:04.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:04.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:04.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:04.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:04.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:04.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:04.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:04.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:04.392+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:04.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:04.382+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:04.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:04.382+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:04.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:04.398+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:04.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:04.399+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:04.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-mon[85573]: pgmap v822: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 826 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 255 B/s rd, 562 KiB/s wr, 1 op/s 2024-03-04T06:54:04.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-mon[85573]: osdmap e760: 8 total, 8 up, 8 in 2024-03-04T06:54:04.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:04.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:04.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:04.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:04.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:04.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:04.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:04.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:04.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:04.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:05.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:54:05] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:54:05.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[91314]: osdmap e761: 8 total, 8 up, 8 in 2024-03-04T06:54:05.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:05.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:05.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:05.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:05.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:05.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:05.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:05.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:05.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:05.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[88869]: osdmap e761: 8 total, 8 up, 8 in 2024-03-04T06:54:05.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:05.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:05.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:05 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:05.815 INFO:tasks.rados.rados.0.smithi137.stdout:3681: finishing write tid 2 to smithi13777483-43 2024-03-04T06:54:05.815 INFO:tasks.rados.rados.0.smithi137.stdout:3681: finishing write tid 3 to smithi13777483-43 2024-03-04T06:54:05.815 INFO:tasks.rados.rados.0.smithi137.stdout:3681: oid 43 updating version 0 to 16973 2024-03-04T06:54:05.815 INFO:tasks.rados.rados.0.smithi137.stdout:3681: oid 43 version 16973 is already newer than 16972 2024-03-04T06:54:05.816 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16973 (ObjNum 1150 snap 351 seq_num 1150) dirty exists 2024-03-04T06:54:05.816 INFO:tasks.rados.rados.0.smithi137.stdout:3681: left oid 43 (ObjNum 1150 snap 351 seq_num 1150) 2024-03-04T06:54:05.816 INFO:tasks.rados.rados.0.smithi137.stdout:3683: finishing write tid 1 to smithi13777483-25 2024-03-04T06:54:05.816 INFO:tasks.rados.rados.0.smithi137.stdout:3674: done (10 left) 2024-03-04T06:54:05.816 INFO:tasks.rados.rados.0.smithi137.stdout:3676: done (9 left) 2024-03-04T06:54:05.816 INFO:tasks.rados.rados.0.smithi137.stdout:3678: done (8 left) 2024-03-04T06:54:05.816 INFO:tasks.rados.rados.0.smithi137.stdout:3679: done (7 left) 2024-03-04T06:54:05.816 INFO:tasks.rados.rados.0.smithi137.stdout:3680: done (6 left) 2024-03-04T06:54:05.816 INFO:tasks.rados.rados.0.smithi137.stdout:3681: done (5 left) 2024-03-04T06:54:05.816 INFO:tasks.rados.rados.0.smithi137.stdout:3684: done (4 left) 2024-03-04T06:54:05.816 INFO:tasks.rados.rados.0.smithi137.stdout:3688: snap_remove snap 345 2024-03-04T06:54:05.834 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:05 smithi203 ceph-mon[85573]: osdmap e761: 8 total, 8 up, 8 in 2024-03-04T06:54:05.835 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:05.835 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:05.835 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:05.835 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:05.835 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:05.835 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:05.835 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:05 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:05.835 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:05.835 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:05 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:06.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:05.833+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:06.407 INFO:tasks.rados.rados.0.smithi137.stdout:3688: done (4 left) 2024-03-04T06:54:06.407 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 5 current snap is 351 2024-03-04T06:54:06.407 INFO:tasks.rados.rados.0.smithi137.stdout:3689: seq_num 1154 ranges {0=131072} 2024-03-04T06:54:06.407 INFO:tasks.rados.rados.0.smithi137.stdout:3689: writing smithi13777483-5 from 0 to 131072 tid 1 2024-03-04T06:54:06.408 INFO:tasks.rados.rados.0.smithi137.stdout:3690: snap_remove snap 301 2024-03-04T06:54:06.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:06 smithi137 ceph-mon[88869]: pgmap v825: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 832 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 8.5 MiB/s rd, 1.4 MiB/s wr, 7 op/s 2024-03-04T06:54:06.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:06 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:54:06.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:06 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:54:06.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:06 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:54:06.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:06.405+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:06.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:06 smithi137 ceph-mon[91314]: pgmap v825: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 832 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 8.5 MiB/s rd, 1.4 MiB/s wr, 7 op/s 2024-03-04T06:54:06.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:06 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:54:06.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:06 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:54:06.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:06 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:54:06.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:06.410+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:06.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:06.410+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:06.794 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:06.582+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:06.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:06.409+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:06.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:06 smithi203 ceph-mon[85573]: pgmap v825: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 832 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 8.5 MiB/s rd, 1.4 MiB/s wr, 7 op/s 2024-03-04T06:54:06.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:06 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:54:06.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:06 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:54:06.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:06 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:54:06.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:06.398+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:06.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:06.399+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:06.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:06.399+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:06.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:06.414+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:06.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:06.414+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:06.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:06.414+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:07.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:06.940+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:07.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:06.940+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:07.410 INFO:tasks.rados.rados.0.smithi137.stdout:3690: done (5 left) 2024-03-04T06:54:07.410 INFO:tasks.rados.rados.0.smithi137.stdout:3691: rmattr oid 14 current snap is 351 2024-03-04T06:54:07.410 INFO:tasks.rados.rados.0.smithi137.stdout:3691: done (5 left) 2024-03-04T06:54:07.411 INFO:tasks.rados.rados.0.smithi137.stdout:3692: snap_remove snap 344 2024-03-04T06:54:07.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:07.410+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:07.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:07.416+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:07.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:07.416+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:07.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:07.416+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:07.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:07.414+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: osdmap e762: 8 total, 8 up, 8 in 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:54:07.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:54:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: osdmap e762: 8 total, 8 up, 8 in 2024-03-04T06:54:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:54:07.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:54:07.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:54:07.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:07.421+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:07.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:07.409+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:07.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:07.409+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:07.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:07.440+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:07.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:07.422+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:07.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:07.422+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: osdmap e762: 8 total, 8 up, 8 in 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:54:07.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:54:08.414 INFO:tasks.rados.rados.0.smithi137.stdout:3692: done (5 left) 2024-03-04T06:54:08.414 INFO:tasks.rados.rados.0.smithi137.stdout:3693: snap_create 2024-03-04T06:54:08.414 INFO:tasks.rados.rados.0.smithi137.stdout:3682: finishing write tid 1 to smithi13777483-12 2024-03-04T06:54:08.415 INFO:tasks.rados.rados.0.smithi137.stdout:3683: finishing write tid 2 to smithi13777483-25 2024-03-04T06:54:08.415 INFO:tasks.rados.rados.0.smithi137.stdout:3682: finishing write tid 2 to smithi13777483-12 2024-03-04T06:54:08.415 INFO:tasks.rados.rados.0.smithi137.stdout:3685: finishing write tid 1 to smithi13777483-8 2024-03-04T06:54:08.415 INFO:tasks.rados.rados.0.smithi137.stdout:3685: finishing write tid 2 to smithi13777483-8 2024-03-04T06:54:08.415 INFO:tasks.rados.rados.0.smithi137.stdout:3682: finishing write tid 3 to smithi13777483-12 2024-03-04T06:54:08.415 INFO:tasks.rados.rados.0.smithi137.stdout:3682: oid 12 updating version 0 to 16967 2024-03-04T06:54:08.415 INFO:tasks.rados.rados.0.smithi137.stdout:3682: oid 12 updating version 16967 to 16968 2024-03-04T06:54:08.415 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16968 (ObjNum 1151 snap 351 seq_num 1151) dirty exists 2024-03-04T06:54:08.415 INFO:tasks.rados.rados.0.smithi137.stdout:3682: left oid 12 (ObjNum 1151 snap 351 seq_num 1151) 2024-03-04T06:54:08.415 INFO:tasks.rados.rados.0.smithi137.stdout:3685: finishing write tid 3 to smithi13777483-8 2024-03-04T06:54:08.415 INFO:tasks.rados.rados.0.smithi137.stdout:3685: oid 8 updating version 0 to 16989 2024-03-04T06:54:08.415 INFO:tasks.rados.rados.0.smithi137.stdout:3685: oid 8 updating version 16989 to 16990 2024-03-04T06:54:08.415 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16990 (ObjNum 1153 snap 351 seq_num 1153) dirty exists 2024-03-04T06:54:08.416 INFO:tasks.rados.rados.0.smithi137.stdout:3685: left oid 8 (ObjNum 1153 snap 351 seq_num 1153) 2024-03-04T06:54:08.416 INFO:tasks.rados.rados.0.smithi137.stdout:3683: finishing write tid 3 to smithi13777483-25 2024-03-04T06:54:08.416 INFO:tasks.rados.rados.0.smithi137.stdout:3683: oid 25 updating version 0 to 16967 2024-03-04T06:54:08.416 INFO:tasks.rados.rados.0.smithi137.stdout:3683: oid 25 updating version 16967 to 16968 2024-03-04T06:54:08.416 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 16968 (ObjNum 1152 snap 351 seq_num 1152) dirty exists 2024-03-04T06:54:08.416 INFO:tasks.rados.rados.0.smithi137.stdout:3683: left oid 25 (ObjNum 1152 snap 351 seq_num 1152) 2024-03-04T06:54:08.416 INFO:tasks.rados.rados.0.smithi137.stdout:3687: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:54:08.579 INFO:tasks.rados.rados.0.smithi137.stdout:3689: finishing write tid 1 to smithi13777483-5 2024-03-04T06:54:08.579 INFO:tasks.rados.rados.0.smithi137.stdout:3689: finishing write tid 2 to smithi13777483-5 2024-03-04T06:54:08.579 INFO:tasks.rados.rados.0.smithi137.stdout:3689: finishing write tid 3 to smithi13777483-5 2024-03-04T06:54:08.579 INFO:tasks.rados.rados.0.smithi137.stdout:3689: oid 5 updating version 0 to 16979 2024-03-04T06:54:08.579 INFO:tasks.rados.rados.0.smithi137.stdout:3689: oid 5 version 16979 is already newer than 16978 2024-03-04T06:54:08.579 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 16979 (ObjNum 1154 snap 351 seq_num 1154) dirty exists 2024-03-04T06:54:08.579 INFO:tasks.rados.rados.0.smithi137.stdout:3689: left oid 5 (ObjNum 1154 snap 351 seq_num 1154) 2024-03-04T06:54:08.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:08.411+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:08.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:08.423+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:08.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:08.424+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:08.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:08.418+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: pgmap v827: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 836 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-03-04T06:54:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: osdmap e763: 8 total, 8 up, 8 in 2024-03-04T06:54:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:08.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:08.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:08.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:54:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: pgmap v827: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 836 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-03-04T06:54:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: osdmap e763: 8 total, 8 up, 8 in 2024-03-04T06:54:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:08.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:08.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:08.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:08.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:08.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:08.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:54:08.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:08.420+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:08.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:08.409+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:08.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:08.409+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:08.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:08.409+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:08.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:08.419+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:08.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:08.419+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:08.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:08.419+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:08.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: pgmap v827: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 836 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-03-04T06:54:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: osdmap e763: 8 total, 8 up, 8 in 2024-03-04T06:54:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:08.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:54:08.848 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:08.490+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:08.848 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:08.490+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:09.410 INFO:tasks.rados.rados.0.smithi137.stdout:3682: done (5 left) 2024-03-04T06:54:09.411 INFO:tasks.rados.rados.0.smithi137.stdout:3683: done (4 left) 2024-03-04T06:54:09.411 INFO:tasks.rados.rados.0.smithi137.stdout:3685: done (3 left) 2024-03-04T06:54:09.411 INFO:tasks.rados.rados.0.smithi137.stdout:3687: done (2 left) 2024-03-04T06:54:09.411 INFO:tasks.rados.rados.0.smithi137.stdout:3689: done (1 left) 2024-03-04T06:54:09.411 INFO:tasks.rados.rados.0.smithi137.stdout:3693: done (0 left) 2024-03-04T06:54:09.411 INFO:tasks.rados.rados.0.smithi137.stdout:3694: read oid 21 snap -1 2024-03-04T06:54:09.411 INFO:tasks.rados.rados.0.smithi137.stdout:3694: expect deleted 2024-03-04T06:54:09.411 INFO:tasks.rados.rados.0.smithi137.stdout:3695: read oid 23 snap -1 2024-03-04T06:54:09.411 INFO:tasks.rados.rados.0.smithi137.stdout:3695: expect deleted 2024-03-04T06:54:09.411 INFO:tasks.rados.rados.0.smithi137.stdout:3696: snap_create 2024-03-04T06:54:09.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:09.412+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[91314]: osdmap e764: 8 total, 8 up, 8 in 2024-03-04T06:54:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:09.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[91314]: osdmap e765: 8 total, 8 up, 8 in 2024-03-04T06:54:09.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:09.415+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:09.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:09.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:09.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[88869]: osdmap e764: 8 total, 8 up, 8 in 2024-03-04T06:54:09.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:09.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:09.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-mon[88869]: osdmap e765: 8 total, 8 up, 8 in 2024-03-04T06:54:09.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:09.414+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:09.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:09.410+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:09.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:09.410+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:09.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:09.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:09.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-mon[85573]: osdmap e764: 8 total, 8 up, 8 in 2024-03-04T06:54:09.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:09.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:09.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:09.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:09.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-mon[85573]: osdmap e765: 8 total, 8 up, 8 in 2024-03-04T06:54:10.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:09.936+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:10.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:09.936+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:10.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:09.936+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:10.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:09.935+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:10.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:09.935+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:10.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:09.936+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:10.413 INFO:tasks.rados.rados.0.smithi137.stdout:3694: done (2 left) 2024-03-04T06:54:10.413 INFO:tasks.rados.rados.0.smithi137.stdout:3695: done (1 left) 2024-03-04T06:54:10.413 INFO:tasks.rados.rados.0.smithi137.stdout:3696: done (0 left) 2024-03-04T06:54:10.413 INFO:tasks.rados.rados.0.smithi137.stdout:3697: read oid 24 snap -1 2024-03-04T06:54:10.413 INFO:tasks.rados.rados.0.smithi137.stdout:3697: expect (ObjNum 1138 snap 346 seq_num 1138) 2024-03-04T06:54:10.413 INFO:tasks.rados.rados.0.smithi137.stdout:3698: copy_from oid 27 from oid 6 current snap is 353 2024-03-04T06:54:10.413 INFO:tasks.rados.rados.0.smithi137.stdout:3699: copy_from oid 5 from oid 50 current snap is 353 2024-03-04T06:54:10.413 INFO:tasks.rados.rados.0.smithi137.stdout:3700: copy_from oid 28 from oid 29 current snap is 353 2024-03-04T06:54:10.414 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 353 2024-03-04T06:54:10.414 INFO:tasks.rados.rados.0.smithi137.stdout:3701: seq_num 1155 ranges {4390912=147456} 2024-03-04T06:54:10.438 INFO:tasks.rados.rados.0.smithi137.stdout:3701: writing smithi13777483-15 from 4390912 to 4538368 tid 1 2024-03-04T06:54:10.439 INFO:tasks.rados.rados.0.smithi137.stdout:3702: rmattr oid 8 current snap is 353 2024-03-04T06:54:10.439 INFO:tasks.rados.rados.0.smithi137.stdout:3702: done (5 left) 2024-03-04T06:54:10.439 INFO:tasks.rados.rados.0.smithi137.stdout:3703: read oid 8 snap -1 2024-03-04T06:54:10.439 INFO:tasks.rados.rados.0.smithi137.stdout:3703: expect (ObjNum 1153 snap 351 seq_num 1153) 2024-03-04T06:54:10.439 INFO:tasks.rados.rados.0.smithi137.stdout:3704: snap_remove snap 343 2024-03-04T06:54:10.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:10.420+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:10.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:10.450+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:10.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:10.416+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:10.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:10.416+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[91314]: pgmap v830: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 819 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 16 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-03-04T06:54:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:10.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[91314]: osdmap e766: 8 total, 8 up, 8 in 2024-03-04T06:54:10.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[88869]: pgmap v830: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 819 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 16 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-03-04T06:54:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:10.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:10 smithi137 ceph-mon[88869]: osdmap e766: 8 total, 8 up, 8 in 2024-03-04T06:54:10.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:10.419+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:10.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:10.417+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:10.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:10.417+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:10.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:10.418+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:10.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:10.432+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:10.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:10.432+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:10.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:10.425+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:10.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:10.425+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:10.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:10.426+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-mon[85573]: pgmap v830: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 819 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 16 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-03-04T06:54:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:10.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:10 smithi203 ceph-mon[85573]: osdmap e766: 8 total, 8 up, 8 in 2024-03-04T06:54:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:3704: done (6 left) 2024-03-04T06:54:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:3705: read oid 9 snap -1 2024-03-04T06:54:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:3705: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:54:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:3706: read oid 22 snap -1 2024-03-04T06:54:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:3706: expect deleted 2024-03-04T06:54:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:3707: delete oid 25 current snap is 353 2024-03-04T06:54:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:3699: finishing copy_from racing read to smithi13777483-5 2024-03-04T06:54:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:3699: finishing copy_from to smithi13777483-5 2024-03-04T06:54:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 17015 (ObjNum 1143 snap 350 seq_num 1143) dirty exists 2024-03-04T06:54:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:3698: finishing copy_from racing read to smithi13777483-27 2024-03-04T06:54:11.443 INFO:tasks.rados.rados.0.smithi137.stdout:3698: finishing copy_from to smithi13777483-27 2024-03-04T06:54:11.444 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16970 (ObjNum 1099 snap 326 seq_num 1099) dirty exists 2024-03-04T06:54:11.444 INFO:tasks.rados.rados.0.smithi137.stdout:3701: finishing write tid 1 to smithi13777483-15 2024-03-04T06:54:11.444 INFO:tasks.rados.rados.0.smithi137.stdout:3701: finishing write tid 2 to smithi13777483-15 2024-03-04T06:54:11.444 INFO:tasks.rados.rados.0.smithi137.stdout:3697: expect (ObjNum 1138 snap 346 seq_num 1138) 2024-03-04T06:54:11.593 INFO:tasks.rados.rados.0.smithi137.stdout:3701: finishing write tid 3 to smithi13777483-15 2024-03-04T06:54:11.593 INFO:tasks.rados.rados.0.smithi137.stdout:3701: oid 15 updating version 0 to 16984 2024-03-04T06:54:11.593 INFO:tasks.rados.rados.0.smithi137.stdout:3701: oid 15 version 16984 is already newer than 16983 2024-03-04T06:54:11.593 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16984 (ObjNum 1155 snap 353 seq_num 1155) dirty exists 2024-03-04T06:54:11.593 INFO:tasks.rados.rados.0.smithi137.stdout:3701: left oid 15 (ObjNum 1155 snap 353 seq_num 1155) 2024-03-04T06:54:11.593 INFO:tasks.rados.rados.0.smithi137.stdout:3703: expect (ObjNum 1153 snap 351 seq_num 1153) 2024-03-04T06:54:11.596 INFO:tasks.rados.rados.0.smithi137.stdout:3700: finishing copy_from racing read to smithi13777483-28 2024-03-04T06:54:11.596 INFO:tasks.rados.rados.0.smithi137.stdout:3700: finishing copy_from to smithi13777483-28 2024-03-04T06:54:11.596 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16961 (ObjNum 932 snap 275 seq_num 932) dirty exists 2024-03-04T06:54:11.596 INFO:tasks.rados.rados.0.smithi137.stdout:3705: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:54:11.792 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[106841]: 2024-03-04T06:54:11.480+0000 7f5889aac700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 191 after trimming was started 2024-03-04T06:54:11.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:11.444+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:11.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:11.444+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:11.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:11.445+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:11.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:11.451+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:11.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:11.440+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:11.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:11.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:11.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:11.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:11.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:11.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:11.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:11.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:11.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:11.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:11.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:11.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:11.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:11.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:11.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:11.457+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:11.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:11.437+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:11.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:11.437+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:11.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:11.464+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:11.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:11.464+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:11.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:11.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:11.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:11.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:11.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:11.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:12.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:12.050+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:12.412 INFO:tasks.rados.rados.0.smithi137.stdout:3697: done (8 left) 2024-03-04T06:54:12.413 INFO:tasks.rados.rados.0.smithi137.stdout:3698: done (7 left) 2024-03-04T06:54:12.413 INFO:tasks.rados.rados.0.smithi137.stdout:3699: done (6 left) 2024-03-04T06:54:12.413 INFO:tasks.rados.rados.0.smithi137.stdout:3700: done (5 left) 2024-03-04T06:54:12.413 INFO:tasks.rados.rados.0.smithi137.stdout:3701: done (4 left) 2024-03-04T06:54:12.413 INFO:tasks.rados.rados.0.smithi137.stdout:3703: done (3 left) 2024-03-04T06:54:12.413 INFO:tasks.rados.rados.0.smithi137.stdout:3705: done (2 left) 2024-03-04T06:54:12.413 INFO:tasks.rados.rados.0.smithi137.stdout:3706: done (1 left) 2024-03-04T06:54:12.413 INFO:tasks.rados.rados.0.smithi137.stdout:3707: done (0 left) 2024-03-04T06:54:12.413 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 33 current snap is 353 2024-03-04T06:54:12.413 INFO:tasks.rados.rados.0.smithi137.stdout:3708: seq_num 1157 ranges {2015232=180224} 2024-03-04T06:54:12.424 INFO:tasks.rados.rados.0.smithi137.stdout:3708: writing smithi13777483-33 from 2015232 to 2195456 tid 1 2024-03-04T06:54:12.424 INFO:tasks.rados.rados.0.smithi137.stdout:3709: snap_remove snap 321 2024-03-04T06:54:12.441 INFO:tasks.rados.rados.0.smithi137.stdout:3708: finishing write tid 1 to smithi13777483-33 2024-03-04T06:54:12.441 INFO:tasks.rados.rados.0.smithi137.stdout:3708: finishing write tid 2 to smithi13777483-33 2024-03-04T06:54:12.441 INFO:tasks.rados.rados.0.smithi137.stdout:3708: finishing write tid 3 to smithi13777483-33 2024-03-04T06:54:12.441 INFO:tasks.rados.rados.0.smithi137.stdout:3708: oid 33 updating version 0 to 16958 2024-03-04T06:54:12.441 INFO:tasks.rados.rados.0.smithi137.stdout:3708: oid 33 updating version 16958 to 16959 2024-03-04T06:54:12.441 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16959 (ObjNum 1157 snap 353 seq_num 1157) dirty exists 2024-03-04T06:54:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:3708: left oid 33 (ObjNum 1157 snap 353 seq_num 1157) 2024-03-04T06:54:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:3708: done (1 left) 2024-03-04T06:54:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:3709: done (0 left) 2024-03-04T06:54:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:3710: rollback oid 44 current snap is 353 2024-03-04T06:54:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 44 to 329 2024-03-04T06:54:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:3711: copy_from oid 19 from oid 49 current snap is 353 2024-03-04T06:54:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 8 current snap is 353 2024-03-04T06:54:12.442 INFO:tasks.rados.rados.0.smithi137.stdout:3712: seq_num 1158 ranges {114688=196608} 2024-03-04T06:54:12.443 INFO:tasks.rados.rados.0.smithi137.stdout:3712: writing smithi13777483-8 from 114688 to 311296 tid 1 2024-03-04T06:54:12.443 INFO:tasks.rados.rados.0.smithi137.stdout:3713: snap_create 2024-03-04T06:54:12.450 INFO:tasks.rados.rados.0.smithi137.stdout:3712: finishing write tid 1 to smithi13777483-8 2024-03-04T06:54:12.450 INFO:tasks.rados.rados.0.smithi137.stdout:3712: finishing write tid 2 to smithi13777483-8 2024-03-04T06:54:12.452 INFO:tasks.rados.rados.0.smithi137.stdout:3712: finishing write tid 3 to smithi13777483-8 2024-03-04T06:54:12.452 INFO:tasks.rados.rados.0.smithi137.stdout:3712: oid 8 updating version 0 to 16992 2024-03-04T06:54:12.452 INFO:tasks.rados.rados.0.smithi137.stdout:3712: oid 8 version 16992 is already newer than 16991 2024-03-04T06:54:12.452 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16992 (ObjNum 1158 snap 353 seq_num 1158) dirty exists 2024-03-04T06:54:12.453 INFO:tasks.rados.rados.0.smithi137.stdout:3712: left oid 8 (ObjNum 1158 snap 353 seq_num 1158) 2024-03-04T06:54:12.460 INFO:tasks.rados.rados.0.smithi137.stdout:3710: finishing rollback tid 0 to smithi13777483-44 2024-03-04T06:54:12.461 INFO:tasks.rados.rados.0.smithi137.stdout:3710: finishing rollback tid 1 to smithi13777483-44 2024-03-04T06:54:12.462 INFO:tasks.rados.rados.0.smithi137.stdout:3710: finishing rollback tid 2 to smithi13777483-44 2024-03-04T06:54:12.462 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16990 (ObjNum 1007 snap 296 seq_num 1007) dirty exists 2024-03-04T06:54:12.471 INFO:tasks.rados.rados.0.smithi137.stdout:3711: finishing copy_from racing read to smithi13777483-19 2024-03-04T06:54:12.472 INFO:tasks.rados.rados.0.smithi137.stdout:3711: finishing copy_from to smithi13777483-19 2024-03-04T06:54:12.472 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 19 v 16946 (ObjNum 1077 snap 324 seq_num 1077) dirty exists 2024-03-04T06:54:12.694 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:12.447+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:12.694 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:12.442+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:12.694 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:12.447+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:12.694 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:12.462+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[88869]: pgmap v833: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 819 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 MiB/s rd, 100 KiB/s wr, 7 op/s 2024-03-04T06:54:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[88869]: osdmap e767: 8 total, 8 up, 8 in 2024-03-04T06:54:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:12.695 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[91314]: pgmap v833: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 819 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 MiB/s rd, 100 KiB/s wr, 7 op/s 2024-03-04T06:54:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[91314]: osdmap e767: 8 total, 8 up, 8 in 2024-03-04T06:54:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:12.696 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:12.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:12.447+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:12.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:12.440+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:12.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:12.440+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:12.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:12.440+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:12.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:12.453+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:12.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:12.453+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:12.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:12.454+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:12.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:12.454+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:12.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:12.454+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:12.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-mon[85573]: pgmap v833: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 819 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 MiB/s rd, 100 KiB/s wr, 7 op/s 2024-03-04T06:54:12.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:12.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:12.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-mon[85573]: osdmap e767: 8 total, 8 up, 8 in 2024-03-04T06:54:12.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:12.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:12.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:12.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:12.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:12.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:12.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:13.450 INFO:tasks.rados.rados.0.smithi137.stdout:3710: done (3 left) 2024-03-04T06:54:13.451 INFO:tasks.rados.rados.0.smithi137.stdout:3711: done (2 left) 2024-03-04T06:54:13.451 INFO:tasks.rados.rados.0.smithi137.stdout:3712: done (1 left) 2024-03-04T06:54:13.451 INFO:tasks.rados.rados.0.smithi137.stdout:3713: done (0 left) 2024-03-04T06:54:13.451 INFO:tasks.rados.rados.0.smithi137.stdout:3714: snap_remove snap 329 2024-03-04T06:54:13.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:13.450+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:13.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:13.450+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:13.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:13.450+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[91314]: pgmap v836: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 819 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:54:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[91314]: osdmap e768: 8 total, 8 up, 8 in 2024-03-04T06:54:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:13.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[88869]: pgmap v836: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 819 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[88869]: osdmap e768: 8 total, 8 up, 8 in 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:13.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:13.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:13.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:13.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:13.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:13.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:13.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:13.449+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:13.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:13.449+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-mon[85573]: pgmap v836: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 819 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:54:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-mon[85573]: osdmap e768: 8 total, 8 up, 8 in 2024-03-04T06:54:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:13.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:14.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:13.936+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:14.460 INFO:tasks.rados.rados.0.smithi137.stdout:3714: done (0 left) 2024-03-04T06:54:14.460 INFO:tasks.rados.rados.0.smithi137.stdout:3715: delete oid 2 current snap is 354 2024-03-04T06:54:14.465 INFO:tasks.rados.rados.0.smithi137.stdout:3715: done (0 left) 2024-03-04T06:54:14.465 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 33 current snap is 354 2024-03-04T06:54:14.465 INFO:tasks.rados.rados.0.smithi137.stdout:3716: seq_num 1160 ranges {2195456=229376} 2024-03-04T06:54:14.479 INFO:tasks.rados.rados.0.smithi137.stdout:3716: writing smithi13777483-33 from 2195456 to 2424832 tid 1 2024-03-04T06:54:14.479 INFO:tasks.rados.rados.0.smithi137.stdout:3717: read oid 39 snap -1 2024-03-04T06:54:14.480 INFO:tasks.rados.rados.0.smithi137.stdout:3717: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:54:14.480 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 354 2024-03-04T06:54:14.480 INFO:tasks.rados.rados.0.smithi137.stdout:3718: seq_num 1161 ranges {1949696=245760} 2024-03-04T06:54:14.493 INFO:tasks.rados.rados.0.smithi137.stdout:3718: writing smithi13777483-38 from 1949696 to 2195456 tid 1 2024-03-04T06:54:14.493 INFO:tasks.rados.rados.0.smithi137.stdout:3719: snap_create 2024-03-04T06:54:14.493 INFO:tasks.rados.rados.0.smithi137.stdout:3716: finishing write tid 1 to smithi13777483-33 2024-03-04T06:54:14.493 INFO:tasks.rados.rados.0.smithi137.stdout:3716: finishing write tid 2 to smithi13777483-33 2024-03-04T06:54:14.493 INFO:tasks.rados.rados.0.smithi137.stdout:3716: finishing write tid 3 to smithi13777483-33 2024-03-04T06:54:14.493 INFO:tasks.rados.rados.0.smithi137.stdout:3716: oid 33 updating version 0 to 16961 2024-03-04T06:54:14.493 INFO:tasks.rados.rados.0.smithi137.stdout:3716: oid 33 version 16961 is already newer than 16960 2024-03-04T06:54:14.493 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16961 (ObjNum 1160 snap 354 seq_num 1160) dirty exists 2024-03-04T06:54:14.493 INFO:tasks.rados.rados.0.smithi137.stdout:3716: left oid 33 (ObjNum 1160 snap 354 seq_num 1160) 2024-03-04T06:54:14.498 INFO:tasks.rados.rados.0.smithi137.stdout:3718: finishing write tid 1 to smithi13777483-38 2024-03-04T06:54:14.498 INFO:tasks.rados.rados.0.smithi137.stdout:3718: finishing write tid 2 to smithi13777483-38 2024-03-04T06:54:14.500 INFO:tasks.rados.rados.0.smithi137.stdout:3718: finishing write tid 3 to smithi13777483-38 2024-03-04T06:54:14.500 INFO:tasks.rados.rados.0.smithi137.stdout:3718: oid 38 updating version 0 to 16971 2024-03-04T06:54:14.500 INFO:tasks.rados.rados.0.smithi137.stdout:3718: oid 38 version 16971 is already newer than 16970 2024-03-04T06:54:14.500 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16971 (ObjNum 1161 snap 354 seq_num 1161) dirty exists 2024-03-04T06:54:14.500 INFO:tasks.rados.rados.0.smithi137.stdout:3718: left oid 38 (ObjNum 1161 snap 354 seq_num 1161) 2024-03-04T06:54:14.510 INFO:tasks.rados.rados.0.smithi137.stdout:3717: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:54:14.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:14.463+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:14.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:14.465+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:14.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:14.460+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:14.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:14.465+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:14.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:14.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-mon[91314]: osdmap e769: 8 total, 8 up, 8 in 2024-03-04T06:54:14.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:14.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:14.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-mon[88869]: osdmap e769: 8 total, 8 up, 8 in 2024-03-04T06:54:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:14.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:14.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:14.488+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:14.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:14.467+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:14 smithi203 ceph-mon[85573]: osdmap e769: 8 total, 8 up, 8 in 2024-03-04T06:54:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:14.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:14.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:14.470+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:14.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:14.470+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:14.847 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:14.457+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:14.847 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:14.457+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:14.847 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:14.457+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:15.462 INFO:tasks.rados.rados.0.smithi137.stdout:3716: done (3 left) 2024-03-04T06:54:15.463 INFO:tasks.rados.rados.0.smithi137.stdout:3717: done (2 left) 2024-03-04T06:54:15.463 INFO:tasks.rados.rados.0.smithi137.stdout:3718: done (1 left) 2024-03-04T06:54:15.463 INFO:tasks.rados.rados.0.smithi137.stdout:3719: done (0 left) 2024-03-04T06:54:15.463 INFO:tasks.rados.rados.0.smithi137.stdout:3720: rollback oid 41 current snap is 355 2024-03-04T06:54:15.463 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 41 to 327 2024-03-04T06:54:15.463 INFO:tasks.rados.rados.0.smithi137.stdout:3721: rollback oid 49 current snap is 355 2024-03-04T06:54:15.464 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 49 to 332 2024-03-04T06:54:15.464 INFO:tasks.rados.rados.0.smithi137.stdout:3722: rmattr oid 32 current snap is 355 2024-03-04T06:54:15.464 INFO:tasks.rados.rados.0.smithi137.stdout:3723: setattr oid 8 current snap is 355 2024-03-04T06:54:15.464 INFO:tasks.rados.rados.0.smithi137.stdout:3724: read oid 42 snap -1 2024-03-04T06:54:15.464 INFO:tasks.rados.rados.0.smithi137.stdout:3724: expect (ObjNum 1148 snap 351 seq_num 1148) 2024-03-04T06:54:15.464 INFO:tasks.rados.rados.0.smithi137.stdout:3725: snap_create 2024-03-04T06:54:15.468 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 16993 (ObjNum 1158 snap 353 seq_num 1158) dirty exists 2024-03-04T06:54:15.473 INFO:tasks.rados.rados.0.smithi137.stdout:3721: finishing rollback tid 0 to smithi13777483-49 2024-03-04T06:54:15.473 INFO:tasks.rados.rados.0.smithi137.stdout:3720: finishing rollback tid 0 to smithi13777483-41 2024-03-04T06:54:15.473 INFO:tasks.rados.rados.0.smithi137.stdout:3721: finishing rollback tid 1 to smithi13777483-49 2024-03-04T06:54:15.474 INFO:tasks.rados.rados.0.smithi137.stdout:3720: finishing rollback tid 1 to smithi13777483-41 2024-03-04T06:54:15.474 INFO:tasks.rados.rados.0.smithi137.stdout:3720: finishing rollback tid 2 to smithi13777483-41 2024-03-04T06:54:15.474 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 16975 (ObjNum 1104 snap 327 seq_num 1104) dirty exists 2024-03-04T06:54:15.475 INFO:tasks.rados.rados.0.smithi137.stdout:3721: finishing rollback tid 2 to smithi13777483-49 2024-03-04T06:54:15.475 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16964 (ObjNum 1077 snap 324 seq_num 1077) dirty exists 2024-03-04T06:54:15.481 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 17018 (ObjNum 1070 snap 320 seq_num 1070) dirty exists 2024-03-04T06:54:15.488 INFO:tasks.rados.rados.0.smithi137.stdout:3724: expect (ObjNum 1148 snap 351 seq_num 1148) 2024-03-04T06:54:15.682 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:54:15] "GET /metrics HTTP/1.1" 200 36336 "" "Prometheus/2.43.0" 2024-03-04T06:54:15.682 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:15.461+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:15.683 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:15.683 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[88869]: pgmap v838: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 831 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 9.8 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-03-04T06:54:15.683 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[88869]: osdmap e770: 8 total, 8 up, 8 in 2024-03-04T06:54:15.683 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:15.683 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:15.683 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:15.683 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:15.683 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:15.683 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:15.683 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:15.683 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:15.684 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[88869]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:15.684 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:15.467+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:15.685 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:15.685 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[91314]: pgmap v838: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 831 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 9.8 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-03-04T06:54:15.685 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[91314]: osdmap e770: 8 total, 8 up, 8 in 2024-03-04T06:54:15.685 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:15.685 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:15.685 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:15.685 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:15.685 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:15.685 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:15.685 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:15.685 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:15.685 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-mon[91314]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:15.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:15.460+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:15.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:15.460+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:15.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:15.471+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:15.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:15.471+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:15.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:15.471+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:15.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:15.471+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:15.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:15.471+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:15.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:15.472+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:15.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:15.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-mon[85573]: pgmap v838: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 831 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 9.8 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-03-04T06:54:15.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-mon[85573]: osdmap e770: 8 total, 8 up, 8 in 2024-03-04T06:54:15.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:15.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:15.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:15.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:15.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:15.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:15.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:15.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:15.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:15 smithi203 ceph-mon[85573]: No clone_snaps in snapset 180=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:16.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:15.681+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:16.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:15.681+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:16.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:15.681+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:16.471 INFO:tasks.rados.rados.0.smithi137.stdout:3720: done (5 left) 2024-03-04T06:54:16.471 INFO:tasks.rados.rados.0.smithi137.stdout:3721: done (4 left) 2024-03-04T06:54:16.471 INFO:tasks.rados.rados.0.smithi137.stdout:3722: done (3 left) 2024-03-04T06:54:16.472 INFO:tasks.rados.rados.0.smithi137.stdout:3723: done (2 left) 2024-03-04T06:54:16.472 INFO:tasks.rados.rados.0.smithi137.stdout:3724: done (1 left) 2024-03-04T06:54:16.472 INFO:tasks.rados.rados.0.smithi137.stdout:3725: done (0 left) 2024-03-04T06:54:16.472 INFO:tasks.rados.rados.0.smithi137.stdout:3726: snap_remove snap 352 2024-03-04T06:54:16.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:16.471+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:16.795 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:16.471+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:16.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:16.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[88869]: osdmap e771: 8 total, 8 up, 8 in 2024-03-04T06:54:16.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:16.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:16.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:16.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:16.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:16.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:16.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:16.797 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:16.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:16.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[91314]: osdmap e771: 8 total, 8 up, 8 in 2024-03-04T06:54:16.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:16.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:16.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:16.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:16.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:16.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:16.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:16.798 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:16 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:16.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:16.467+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:16 smithi203 ceph-mon[85573]: osdmap e771: 8 total, 8 up, 8 in 2024-03-04T06:54:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:16 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:16.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:16 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:17.471 INFO:tasks.rados.rados.0.smithi137.stdout:3726: done (0 left) 2024-03-04T06:54:17.472 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 43 current snap is 356 2024-03-04T06:54:17.472 INFO:tasks.rados.rados.0.smithi137.stdout:3727: seq_num 1162 ranges {2793472=270336} 2024-03-04T06:54:17.488 INFO:tasks.rados.rados.0.smithi137.stdout:3727: writing smithi13777483-43 from 2793472 to 3063808 tid 1 2024-03-04T06:54:17.489 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 356 2024-03-04T06:54:17.489 INFO:tasks.rados.rados.0.smithi137.stdout:3728: seq_num 1163 ranges {14884864=286720} 2024-03-04T06:54:17.569 INFO:tasks.rados.rados.0.smithi137.stdout:3728: writing smithi13777483-18 from 14884864 to 15171584 tid 1 2024-03-04T06:54:17.569 INFO:tasks.rados.rados.0.smithi137.stdout:3729: rollback oid 30 current snap is 356 2024-03-04T06:54:17.569 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 30 to 355 2024-03-04T06:54:17.570 INFO:tasks.rados.rados.0.smithi137.stdout:3727: finishing write tid 1 to smithi13777483-43 2024-03-04T06:54:17.570 INFO:tasks.rados.rados.0.smithi137.stdout:3727: finishing write tid 2 to smithi13777483-43 2024-03-04T06:54:17.570 INFO:tasks.rados.rados.0.smithi137.stdout:3727: finishing write tid 3 to smithi13777483-43 2024-03-04T06:54:17.570 INFO:tasks.rados.rados.0.smithi137.stdout:3727: oid 43 updating version 0 to 16974 2024-03-04T06:54:17.570 INFO:tasks.rados.rados.0.smithi137.stdout:3727: oid 43 updating version 16974 to 16975 2024-03-04T06:54:17.570 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16975 (ObjNum 1162 snap 356 seq_num 1162) dirty exists 2024-03-04T06:54:17.570 INFO:tasks.rados.rados.0.smithi137.stdout:3727: left oid 43 (ObjNum 1162 snap 356 seq_num 1162) 2024-03-04T06:54:17.570 INFO:tasks.rados.rados.0.smithi137.stdout:3727: done (2 left) 2024-03-04T06:54:17.570 INFO:tasks.rados.rados.0.smithi137.stdout:3730: rmattr oid 34 current snap is 356 2024-03-04T06:54:17.570 INFO:tasks.rados.rados.0.smithi137.stdout:3730: done (2 left) 2024-03-04T06:54:17.570 INFO:tasks.rados.rados.0.smithi137.stdout:3731: read oid 32 snap -1 2024-03-04T06:54:17.570 INFO:tasks.rados.rados.0.smithi137.stdout:3731: expect (ObjNum 1070 snap 320 seq_num 1070) 2024-03-04T06:54:17.571 INFO:tasks.rados.rados.0.smithi137.stdout:3732: rollback oid 50 current snap is 356 2024-03-04T06:54:17.571 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 50 to 327 2024-03-04T06:54:17.571 INFO:tasks.rados.rados.0.smithi137.stdout:3733: snap_create 2024-03-04T06:54:17.574 INFO:tasks.rados.rados.0.smithi137.stdout:3728: finishing write tid 1 to smithi13777483-18 2024-03-04T06:54:17.575 INFO:tasks.rados.rados.0.smithi137.stdout:3729: finishing rollback tid 0 to smithi13777483-30 2024-03-04T06:54:17.575 INFO:tasks.rados.rados.0.smithi137.stdout:3728: finishing write tid 2 to smithi13777483-18 2024-03-04T06:54:17.575 INFO:tasks.rados.rados.0.smithi137.stdout:3729: finishing rollback tid 1 to smithi13777483-30 2024-03-04T06:54:17.576 INFO:tasks.rados.rados.0.smithi137.stdout:3729: finishing rollback tid 2 to smithi13777483-30 2024-03-04T06:54:17.576 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16971 (ObjNum 982 snap 287 seq_num 982) dirty exists 2024-03-04T06:54:17.576 INFO:tasks.rados.rados.0.smithi137.stdout:3732: finishing rollback tid 0 to smithi13777483-50 2024-03-04T06:54:17.578 INFO:tasks.rados.rados.0.smithi137.stdout:3728: finishing write tid 3 to smithi13777483-18 2024-03-04T06:54:17.578 INFO:tasks.rados.rados.0.smithi137.stdout:3728: oid 18 updating version 0 to 16975 2024-03-04T06:54:17.578 INFO:tasks.rados.rados.0.smithi137.stdout:3728: oid 18 version 16975 is already newer than 16974 2024-03-04T06:54:17.578 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16975 (ObjNum 1163 snap 356 seq_num 1163) dirty exists 2024-03-04T06:54:17.578 INFO:tasks.rados.rados.0.smithi137.stdout:3728: left oid 18 (ObjNum 1163 snap 356 seq_num 1163) 2024-03-04T06:54:17.578 INFO:tasks.rados.rados.0.smithi137.stdout:3731: expect (ObjNum 1070 snap 320 seq_num 1070) 2024-03-04T06:54:17.608 INFO:tasks.rados.rados.0.smithi137.stdout:3732: finishing rollback tid 1 to smithi13777483-50 2024-03-04T06:54:17.608 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 17020 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-03-04T06:54:17.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:17.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:17.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[91314]: pgmap v841: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 832 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 9.9 MiB/s rd, 3.7 MiB/s wr, 8 op/s 2024-03-04T06:54:17.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:17.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:17.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[91314]: osdmap e772: 8 total, 8 up, 8 in 2024-03-04T06:54:17.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:17.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:17.478+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:17.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:17.478+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:17.794 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:17.478+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:17.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:17.443+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:17.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:17.483+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:17.795 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:17.442+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:17.795 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:17.469+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:17.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:17.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:17.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[88869]: pgmap v841: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 832 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 9.9 MiB/s rd, 3.7 MiB/s wr, 8 op/s 2024-03-04T06:54:17.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:17.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:17.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[88869]: osdmap e772: 8 total, 8 up, 8 in 2024-03-04T06:54:17.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:17 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:17.796 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:17.475+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:17.797 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:17.797 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:17.797 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-mon[85573]: pgmap v841: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 832 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 9.9 MiB/s rd, 3.7 MiB/s wr, 8 op/s 2024-03-04T06:54:17.797 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:17.797 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:17.797 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-mon[85573]: osdmap e772: 8 total, 8 up, 8 in 2024-03-04T06:54:17.798 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:17.798 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:17.443+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:17.798 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:17.792+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:17.798 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:17.351+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:17.799 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:17.351+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:17.799 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:17.351+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:17.799 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:17.469+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:17.799 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:17.469+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:17.799 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:17.441+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:17.799 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:17.442+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:17.799 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:17.493+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:17.800 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:17.493+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:17.800 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:17.493+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:18.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:17.792+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:18.487 INFO:tasks.rados.rados.0.smithi137.stdout:3728: done (4 left) 2024-03-04T06:54:18.487 INFO:tasks.rados.rados.0.smithi137.stdout:3729: done (3 left) 2024-03-04T06:54:18.487 INFO:tasks.rados.rados.0.smithi137.stdout:3731: done (2 left) 2024-03-04T06:54:18.487 INFO:tasks.rados.rados.0.smithi137.stdout:3732: done (1 left) 2024-03-04T06:54:18.487 INFO:tasks.rados.rados.0.smithi137.stdout:3733: done (0 left) 2024-03-04T06:54:18.487 INFO:tasks.rados.rados.0.smithi137.stdout:3734: setattr oid 42 current snap is 357 2024-03-04T06:54:18.488 INFO:tasks.rados.rados.0.smithi137.stdout:3735: rollback oid 32 current snap is 357 2024-03-04T06:54:18.489 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 32 to 353 2024-03-04T06:54:18.489 INFO:tasks.rados.rados.0.smithi137.stdout:3736: rmattr oid 44 current snap is 357 2024-03-04T06:54:18.489 INFO:tasks.rados.rados.0.smithi137.stdout:3737: read oid 47 snap -1 2024-03-04T06:54:18.489 INFO:tasks.rados.rados.0.smithi137.stdout:3737: expect deleted 2024-03-04T06:54:18.489 INFO:tasks.rados.rados.0.smithi137.stdout:3738: read oid 46 snap -1 2024-03-04T06:54:18.489 INFO:tasks.rados.rados.0.smithi137.stdout:3738: expect (ObjNum 1111 snap 332 seq_num 1111) 2024-03-04T06:54:18.489 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 357 2024-03-04T06:54:18.489 INFO:tasks.rados.rados.0.smithi137.stdout:3739: seq_num 1164 ranges {0=303104} 2024-03-04T06:54:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:3739: writing smithi13777483-21 from 0 to 303104 tid 1 2024-03-04T06:54:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:3740: read oid 36 snap 354 2024-03-04T06:54:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:3740: expect (ObjNum 1131 snap 343 seq_num 1131) 2024-03-04T06:54:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:3741: read oid 27 snap -1 2024-03-04T06:54:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:3741: expect (ObjNum 1099 snap 326 seq_num 1099) 2024-03-04T06:54:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 357 2024-03-04T06:54:18.491 INFO:tasks.rados.rados.0.smithi137.stdout:3742: seq_num 1165 ranges {2408448=319488} 2024-03-04T06:54:18.507 INFO:tasks.rados.rados.0.smithi137.stdout:3742: writing smithi13777483-11 from 2408448 to 2727936 tid 1 2024-03-04T06:54:18.507 INFO:tasks.rados.rados.0.smithi137.stdout:3743: rollback oid 33 current snap is 357 2024-03-04T06:54:18.507 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 33 to 355 2024-03-04T06:54:18.508 INFO:tasks.rados.rados.0.smithi137.stdout:3739: finishing write tid 1 to smithi13777483-21 2024-03-04T06:54:18.508 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16991 (ObjNum 1007 snap 296 seq_num 1007) dirty exists 2024-03-04T06:54:18.508 INFO:tasks.rados.rados.0.smithi137.stdout:3739: finishing write tid 2 to smithi13777483-21 2024-03-04T06:54:18.508 INFO:tasks.rados.rados.0.smithi137.stdout:3739: finishing write tid 3 to smithi13777483-21 2024-03-04T06:54:18.508 INFO:tasks.rados.rados.0.smithi137.stdout:3739: oid 21 updating version 0 to 16973 2024-03-04T06:54:18.508 INFO:tasks.rados.rados.0.smithi137.stdout:3739: oid 21 version 16973 is already newer than 16972 2024-03-04T06:54:18.508 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 16973 (ObjNum 1164 snap 357 seq_num 1164) dirty exists 2024-03-04T06:54:18.508 INFO:tasks.rados.rados.0.smithi137.stdout:3739: left oid 21 (ObjNum 1164 snap 357 seq_num 1164) 2024-03-04T06:54:18.508 INFO:tasks.rados.rados.0.smithi137.stdout:3736: done (9 left) 2024-03-04T06:54:18.508 INFO:tasks.rados.rados.0.smithi137.stdout:3737: done (8 left) 2024-03-04T06:54:18.508 INFO:tasks.rados.rados.0.smithi137.stdout:3739: done (7 left) 2024-03-04T06:54:18.508 INFO:tasks.rados.rados.0.smithi137.stdout:3744: rollback oid 15 current snap is 357 2024-03-04T06:54:18.508 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 15 to 349 2024-03-04T06:54:18.509 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 357 2024-03-04T06:54:18.509 INFO:tasks.rados.rados.0.smithi137.stdout:3745: seq_num 1166 ranges {0=335872} 2024-03-04T06:54:18.510 INFO:tasks.rados.rados.0.smithi137.stdout:3745: writing smithi13777483-34 from 0 to 335872 tid 1 2024-03-04T06:54:18.510 INFO:tasks.rados.rados.0.smithi137.stdout:3746: read oid 26 snap -1 2024-03-04T06:54:18.510 INFO:tasks.rados.rados.0.smithi137.stdout:3746: expect (ObjNum 957 snap 282 seq_num 957) 2024-03-04T06:54:18.510 INFO:tasks.rados.rados.0.smithi137.stdout:3747: snap_create 2024-03-04T06:54:18.510 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 17021 (ObjNum 1148 snap 351 seq_num 1148) dirty exists 2024-03-04T06:54:18.510 INFO:tasks.rados.rados.0.smithi137.stdout:3735: finishing rollback tid 0 to smithi13777483-32 2024-03-04T06:54:18.510 INFO:tasks.rados.rados.0.smithi137.stdout:3735: finishing rollback tid 1 to smithi13777483-32 2024-03-04T06:54:18.510 INFO:tasks.rados.rados.0.smithi137.stdout:3735: finishing rollback tid 2 to smithi13777483-32 2024-03-04T06:54:18.510 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 17024 (ObjNum 1070 snap 320 seq_num 1070) dirty exists 2024-03-04T06:54:18.514 INFO:tasks.rados.rados.0.smithi137.stdout:3742: finishing write tid 1 to smithi13777483-11 2024-03-04T06:54:18.515 INFO:tasks.rados.rados.0.smithi137.stdout:3742: finishing write tid 2 to smithi13777483-11 2024-03-04T06:54:18.516 INFO:tasks.rados.rados.0.smithi137.stdout:3743: finishing rollback tid 0 to smithi13777483-33 2024-03-04T06:54:18.516 INFO:tasks.rados.rados.0.smithi137.stdout:3743: finishing rollback tid 1 to smithi13777483-33 2024-03-04T06:54:18.517 INFO:tasks.rados.rados.0.smithi137.stdout:3744: finishing rollback tid 0 to smithi13777483-15 2024-03-04T06:54:18.517 INFO:tasks.rados.rados.0.smithi137.stdout:3744: finishing rollback tid 1 to smithi13777483-15 2024-03-04T06:54:18.517 INFO:tasks.rados.rados.0.smithi137.stdout:3744: finishing rollback tid 2 to smithi13777483-15 2024-03-04T06:54:18.518 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16987 (ObjNum 1137 snap 345 seq_num 1137) dirty exists 2024-03-04T06:54:18.518 INFO:tasks.rados.rados.0.smithi137.stdout:3743: finishing rollback tid 2 to smithi13777483-33 2024-03-04T06:54:18.518 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16967 (ObjNum 1160 snap 354 seq_num 1160) dirty exists 2024-03-04T06:54:18.519 INFO:tasks.rados.rados.0.smithi137.stdout:3742: finishing write tid 3 to smithi13777483-11 2024-03-04T06:54:18.519 INFO:tasks.rados.rados.0.smithi137.stdout:3742: oid 11 updating version 0 to 16995 2024-03-04T06:54:18.519 INFO:tasks.rados.rados.0.smithi137.stdout:3742: oid 11 version 16995 is already newer than 16994 2024-03-04T06:54:18.519 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 16995 (ObjNum 1165 snap 357 seq_num 1165) dirty exists 2024-03-04T06:54:18.520 INFO:tasks.rados.rados.0.smithi137.stdout:3742: left oid 11 (ObjNum 1165 snap 357 seq_num 1165) 2024-03-04T06:54:18.520 INFO:tasks.rados.rados.0.smithi137.stdout:3745: finishing write tid 1 to smithi13777483-34 2024-03-04T06:54:18.520 INFO:tasks.rados.rados.0.smithi137.stdout:3745: finishing write tid 2 to smithi13777483-34 2024-03-04T06:54:18.524 INFO:tasks.rados.rados.0.smithi137.stdout:3740: expect (ObjNum 1131 snap 343 seq_num 1131) 2024-03-04T06:54:18.725 INFO:tasks.rados.rados.0.smithi137.stdout:3745: finishing write tid 3 to smithi13777483-34 2024-03-04T06:54:18.725 INFO:tasks.rados.rados.0.smithi137.stdout:3745: oid 34 updating version 0 to 16992 2024-03-04T06:54:18.725 INFO:tasks.rados.rados.0.smithi137.stdout:3745: oid 34 updating version 16992 to 16993 2024-03-04T06:54:18.725 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16993 (ObjNum 1166 snap 357 seq_num 1166) dirty exists 2024-03-04T06:54:18.725 INFO:tasks.rados.rados.0.smithi137.stdout:3745: left oid 34 (ObjNum 1166 snap 357 seq_num 1166) 2024-03-04T06:54:18.726 INFO:tasks.rados.rados.0.smithi137.stdout:3746: expect (ObjNum 957 snap 282 seq_num 957) 2024-03-04T06:54:18.788 INFO:tasks.rados.rados.0.smithi137.stdout:3738: expect (ObjNum 1111 snap 332 seq_num 1111) 2024-03-04T06:54:18.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:18.486+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:18.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:18.487+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:18.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:18.499+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:18.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:18.499+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:18.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:18.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:18.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: osdmap e773: 8 total, 8 up, 8 in 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:18.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: osdmap e773: 8 total, 8 up, 8 in 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:18.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:18.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:18.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:18.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:18 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:18.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:18.493+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:18.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:18.510+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:18.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:18.516+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:18.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:18.483+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:18.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:18.483+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:18.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:18.483+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:18.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:18.494+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: osdmap e773: 8 total, 8 up, 8 in 2024-03-04T06:54:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:18.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:18.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:18 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:18.895 INFO:tasks.rados.rados.0.smithi137.stdout:3741: expect (ObjNum 1099 snap 326 seq_num 1099) 2024-03-04T06:54:19.491 INFO:tasks.rados.rados.0.smithi137.stdout:3734: done (10 left) 2024-03-04T06:54:19.491 INFO:tasks.rados.rados.0.smithi137.stdout:3735: done (9 left) 2024-03-04T06:54:19.491 INFO:tasks.rados.rados.0.smithi137.stdout:3738: done (8 left) 2024-03-04T06:54:19.491 INFO:tasks.rados.rados.0.smithi137.stdout:3740: done (7 left) 2024-03-04T06:54:19.491 INFO:tasks.rados.rados.0.smithi137.stdout:3741: done (6 left) 2024-03-04T06:54:19.491 INFO:tasks.rados.rados.0.smithi137.stdout:3742: done (5 left) 2024-03-04T06:54:19.491 INFO:tasks.rados.rados.0.smithi137.stdout:3743: done (4 left) 2024-03-04T06:54:19.491 INFO:tasks.rados.rados.0.smithi137.stdout:3744: done (3 left) 2024-03-04T06:54:19.491 INFO:tasks.rados.rados.0.smithi137.stdout:3745: done (2 left) 2024-03-04T06:54:19.491 INFO:tasks.rados.rados.0.smithi137.stdout:3746: done (1 left) 2024-03-04T06:54:19.491 INFO:tasks.rados.rados.0.smithi137.stdout:3747: done (0 left) 2024-03-04T06:54:19.491 INFO:tasks.rados.rados.0.smithi137.stdout:3748: copy_from oid 13 from oid 38 current snap is 358 2024-03-04T06:54:19.491 INFO:tasks.rados.rados.0.smithi137.stdout:3749: setattr oid 31 current snap is 358 2024-03-04T06:54:19.492 INFO:tasks.rados.rados.0.smithi137.stdout:3750: rollback oid 23 current snap is 358 2024-03-04T06:54:19.493 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 23 to 327 2024-03-04T06:54:19.493 INFO:tasks.rados.rados.0.smithi137.stdout:3751: snap_remove snap 354 2024-03-04T06:54:19.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:19.489+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:19.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:19.652+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:19.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:19.652+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:19.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:19.652+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:19.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:19.494+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[91314]: pgmap v844: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 832 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 7.3 MiB/s rd, 344 KiB/s wr, 11 op/s 2024-03-04T06:54:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[91314]: osdmap e774: 8 total, 8 up, 8 in 2024-03-04T06:54:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[88869]: pgmap v844: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 832 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 7.3 MiB/s rd, 344 KiB/s wr, 11 op/s 2024-03-04T06:54:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[88869]: osdmap e774: 8 total, 8 up, 8 in 2024-03-04T06:54:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:19.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:19.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:19.502+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:19.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:19.497+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:19.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:19.497+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:19.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:19.488+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:19.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:19.488+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:19.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:19.496+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:19.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:19.497+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:19.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:19.499+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-mon[85573]: pgmap v844: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 832 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 7.3 MiB/s rd, 344 KiB/s wr, 11 op/s 2024-03-04T06:54:19.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:19.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:19.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:19.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-mon[85573]: osdmap e774: 8 total, 8 up, 8 in 2024-03-04T06:54:19.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:19.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:19.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:19.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:19.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:19.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 179=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:20.506 INFO:tasks.rados.rados.0.smithi137.stdout:3751: done (3 left) 2024-03-04T06:54:20.506 INFO:tasks.rados.rados.0.smithi137.stdout:3752: read oid 25 snap -1 2024-03-04T06:54:20.506 INFO:tasks.rados.rados.0.smithi137.stdout:3752: expect deleted 2024-03-04T06:54:20.506 INFO:tasks.rados.rados.0.smithi137.stdout:3753: setattr oid 14 current snap is 358 2024-03-04T06:54:20.506 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16968 (ObjNum 33 snap 0 seq_num 3132033216) dirty exists 2024-03-04T06:54:20.506 INFO:tasks.rados.rados.0.smithi137.stdout:3750: finishing rollback tid 1 to smithi13777483-23 2024-03-04T06:54:20.506 INFO:tasks.rados.rados.0.smithi137.stdout:3750: finishing rollback tid 2 to smithi13777483-23 2024-03-04T06:54:20.507 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 16965 (ObjNum 1009 snap 296 seq_num 1009) dirty exists 2024-03-04T06:54:20.507 INFO:tasks.rados.rados.0.smithi137.stdout:3748: finishing copy_from racing read to smithi13777483-13 2024-03-04T06:54:20.507 INFO:tasks.rados.rados.0.smithi137.stdout:3748: finishing copy_from to smithi13777483-13 2024-03-04T06:54:20.507 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16971 (ObjNum 1161 snap 354 seq_num 1161) dirty exists 2024-03-04T06:54:20.509 INFO:tasks.rados.rados.0.smithi137.stdout:3748: done (4 left) 2024-03-04T06:54:20.509 INFO:tasks.rados.rados.0.smithi137.stdout:3749: done (3 left) 2024-03-04T06:54:20.509 INFO:tasks.rados.rados.0.smithi137.stdout:3750: done (2 left) 2024-03-04T06:54:20.509 INFO:tasks.rados.rados.0.smithi137.stdout:3754: delete oid 7 current snap is 358 2024-03-04T06:54:20.513 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 16966 (ObjNum 1117 snap 334 seq_num 1117) dirty exists 2024-03-04T06:54:20.515 INFO:tasks.rados.rados.0.smithi137.stdout:3752: done (2 left) 2024-03-04T06:54:20.515 INFO:tasks.rados.rados.0.smithi137.stdout:3753: done (1 left) 2024-03-04T06:54:20.515 INFO:tasks.rados.rados.0.smithi137.stdout:3754: done (0 left) 2024-03-04T06:54:20.515 INFO:tasks.rados.rados.0.smithi137.stdout:3755: delete oid 30 current snap is 358 2024-03-04T06:54:20.520 INFO:tasks.rados.rados.0.smithi137.stdout:3755: done (0 left) 2024-03-04T06:54:20.520 INFO:tasks.rados.rados.0.smithi137.stdout:3756: rollback oid 21 current snap is 358 2024-03-04T06:54:20.520 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 21 to 346 2024-03-04T06:54:20.520 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 50 current snap is 358 2024-03-04T06:54:20.520 INFO:tasks.rados.rados.0.smithi137.stdout:3757: seq_num 1169 ranges {0=385024} 2024-03-04T06:54:20.522 INFO:tasks.rados.rados.0.smithi137.stdout:3757: writing smithi13777483-50 from 0 to 385024 tid 1 2024-03-04T06:54:20.522 INFO:tasks.rados.rados.0.smithi137.stdout:3758: rollback oid 12 current snap is 358 2024-03-04T06:54:20.522 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 12 to 333 2024-03-04T06:54:20.522 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 48 current snap is 358 2024-03-04T06:54:20.523 INFO:tasks.rados.rados.0.smithi137.stdout:3759: seq_num 1170 ranges {2752512=401408} 2024-03-04T06:54:20.540 INFO:tasks.rados.rados.0.smithi137.stdout:3759: writing smithi13777483-48 from 2752512 to 3153920 tid 1 2024-03-04T06:54:20.540 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 33 current snap is 358 2024-03-04T06:54:20.540 INFO:tasks.rados.rados.0.smithi137.stdout:3756: finishing rollback tid 0 to smithi13777483-21 2024-03-04T06:54:20.540 INFO:tasks.rados.rados.0.smithi137.stdout:3756: finishing rollback tid 1 to smithi13777483-21 2024-03-04T06:54:20.540 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 16975 (ObjNum 33 snap 0 seq_num 3130659744) dirty dne 2024-03-04T06:54:20.540 INFO:tasks.rados.rados.0.smithi137.stdout:3758: finishing rollback tid 0 to smithi13777483-12 2024-03-04T06:54:20.541 INFO:tasks.rados.rados.0.smithi137.stdout:3758: finishing rollback tid 1 to smithi13777483-12 2024-03-04T06:54:20.541 INFO:tasks.rados.rados.0.smithi137.stdout:3757: finishing write tid 1 to smithi13777483-50 2024-03-04T06:54:20.541 INFO:tasks.rados.rados.0.smithi137.stdout:3758: finishing rollback tid 2 to smithi13777483-12 2024-03-04T06:54:20.541 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16975 (ObjNum 1029 snap 306 seq_num 1029) dirty exists 2024-03-04T06:54:20.541 INFO:tasks.rados.rados.0.smithi137.stdout:3757: finishing write tid 2 to smithi13777483-50 2024-03-04T06:54:20.541 INFO:tasks.rados.rados.0.smithi137.stdout:3757: finishing write tid 3 to smithi13777483-50 2024-03-04T06:54:20.541 INFO:tasks.rados.rados.0.smithi137.stdout:3757: oid 50 updating version 0 to 17025 2024-03-04T06:54:20.541 INFO:tasks.rados.rados.0.smithi137.stdout:3757: oid 50 updating version 17025 to 17026 2024-03-04T06:54:20.541 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 17026 (ObjNum 1169 snap 358 seq_num 1169) dirty exists 2024-03-04T06:54:20.541 INFO:tasks.rados.rados.0.smithi137.stdout:3757: left oid 50 (ObjNum 1169 snap 358 seq_num 1169) 2024-03-04T06:54:20.541 INFO:tasks.rados.rados.0.smithi137.stdout:3760: seq_num 1171 ranges {2424832=417792} 2024-03-04T06:54:20.556 INFO:tasks.rados.rados.0.smithi137.stdout:3760: writing smithi13777483-33 from 2424832 to 2842624 tid 1 2024-03-04T06:54:20.556 INFO:tasks.rados.rados.0.smithi137.stdout:3756: done (4 left) 2024-03-04T06:54:20.556 INFO:tasks.rados.rados.0.smithi137.stdout:3757: done (3 left) 2024-03-04T06:54:20.556 INFO:tasks.rados.rados.0.smithi137.stdout:3758: done (2 left) 2024-03-04T06:54:20.556 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 358 2024-03-04T06:54:20.556 INFO:tasks.rados.rados.0.smithi137.stdout:3759: finishing write tid 1 to smithi13777483-48 2024-03-04T06:54:20.556 INFO:tasks.rados.rados.0.smithi137.stdout:3759: finishing write tid 2 to smithi13777483-48 2024-03-04T06:54:20.556 INFO:tasks.rados.rados.0.smithi137.stdout:3759: finishing write tid 3 to smithi13777483-48 2024-03-04T06:54:20.556 INFO:tasks.rados.rados.0.smithi137.stdout:3759: oid 48 updating version 0 to 16949 2024-03-04T06:54:20.556 INFO:tasks.rados.rados.0.smithi137.stdout:3759: oid 48 updating version 16949 to 16950 2024-03-04T06:54:20.556 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 16950 (ObjNum 1170 snap 358 seq_num 1170) dirty exists 2024-03-04T06:54:20.556 INFO:tasks.rados.rados.0.smithi137.stdout:3759: left oid 48 (ObjNum 1170 snap 358 seq_num 1170) 2024-03-04T06:54:20.557 INFO:tasks.rados.rados.0.smithi137.stdout:3761: seq_num 1172 ranges {6283264=434176} 2024-03-04T06:54:20.591 INFO:tasks.rados.rados.0.smithi137.stdout:3761: writing smithi13777483-14 from 6283264 to 6717440 tid 1 2024-03-04T06:54:20.591 INFO:tasks.rados.rados.0.smithi137.stdout:3759: done (2 left) 2024-03-04T06:54:20.591 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 358 2024-03-04T06:54:20.591 INFO:tasks.rados.rados.0.smithi137.stdout:3762: seq_num 1173 ranges {4390912=450560} 2024-03-04T06:54:20.617 INFO:tasks.rados.rados.0.smithi137.stdout:3762: writing smithi13777483-42 from 4390912 to 4841472 tid 1 2024-03-04T06:54:20.617 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 45 current snap is 358 2024-03-04T06:54:20.617 INFO:tasks.rados.rados.0.smithi137.stdout:3763: seq_num 1174 ranges {0=466944} 2024-03-04T06:54:20.620 INFO:tasks.rados.rados.0.smithi137.stdout:3763: writing smithi13777483-45 from 0 to 466944 tid 1 2024-03-04T06:54:20.620 INFO:tasks.rados.rados.0.smithi137.stdout:3764: rollback oid 28 current snap is 358 2024-03-04T06:54:20.620 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 28 to 348 2024-03-04T06:54:20.620 INFO:tasks.rados.rados.0.smithi137.stdout:3760: finishing write tid 1 to smithi13777483-33 2024-03-04T06:54:20.620 INFO:tasks.rados.rados.0.smithi137.stdout:3760: finishing write tid 2 to smithi13777483-33 2024-03-04T06:54:20.620 INFO:tasks.rados.rados.0.smithi137.stdout:3760: finishing write tid 3 to smithi13777483-33 2024-03-04T06:54:20.620 INFO:tasks.rados.rados.0.smithi137.stdout:3760: oid 33 updating version 0 to 16970 2024-03-04T06:54:20.620 INFO:tasks.rados.rados.0.smithi137.stdout:3760: oid 33 version 16970 is already newer than 16969 2024-03-04T06:54:20.620 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16970 (ObjNum 1171 snap 358 seq_num 1171) dirty exists 2024-03-04T06:54:20.620 INFO:tasks.rados.rados.0.smithi137.stdout:3760: left oid 33 (ObjNum 1171 snap 358 seq_num 1171) 2024-03-04T06:54:20.620 INFO:tasks.rados.rados.0.smithi137.stdout:3761: finishing write tid 1 to smithi13777483-14 2024-03-04T06:54:20.620 INFO:tasks.rados.rados.0.smithi137.stdout:3761: finishing write tid 2 to smithi13777483-14 2024-03-04T06:54:20.621 INFO:tasks.rados.rados.0.smithi137.stdout:3761: finishing write tid 3 to smithi13777483-14 2024-03-04T06:54:20.621 INFO:tasks.rados.rados.0.smithi137.stdout:3761: oid 14 updating version 0 to 16967 2024-03-04T06:54:20.621 INFO:tasks.rados.rados.0.smithi137.stdout:3761: oid 14 updating version 16967 to 16968 2024-03-04T06:54:20.621 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 16968 (ObjNum 1172 snap 358 seq_num 1172) dirty exists 2024-03-04T06:54:20.621 INFO:tasks.rados.rados.0.smithi137.stdout:3761: left oid 14 (ObjNum 1172 snap 358 seq_num 1172) 2024-03-04T06:54:20.621 INFO:tasks.rados.rados.0.smithi137.stdout:3760: done (4 left) 2024-03-04T06:54:20.621 INFO:tasks.rados.rados.0.smithi137.stdout:3761: done (3 left) 2024-03-04T06:54:20.621 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 358 2024-03-04T06:54:20.621 INFO:tasks.rados.rados.0.smithi137.stdout:3765: seq_num 1175 ranges {884736=483328} 2024-03-04T06:54:20.629 INFO:tasks.rados.rados.0.smithi137.stdout:3765: writing smithi13777483-12 from 884736 to 1368064 tid 1 2024-03-04T06:54:20.629 INFO:tasks.rados.rados.0.smithi137.stdout:3766: copy_from oid 44 from oid 3 current snap is 358 2024-03-04T06:54:20.629 INFO:tasks.rados.rados.0.smithi137.stdout:3762: finishing write tid 1 to smithi13777483-42 2024-03-04T06:54:20.629 INFO:tasks.rados.rados.0.smithi137.stdout:3762: finishing write tid 2 to smithi13777483-42 2024-03-04T06:54:20.629 INFO:tasks.rados.rados.0.smithi137.stdout:3763: finishing write tid 1 to smithi13777483-45 2024-03-04T06:54:20.629 INFO:tasks.rados.rados.0.smithi137.stdout:3763: finishing write tid 2 to smithi13777483-45 2024-03-04T06:54:20.629 INFO:tasks.rados.rados.0.smithi137.stdout:3763: finishing write tid 3 to smithi13777483-45 2024-03-04T06:54:20.629 INFO:tasks.rados.rados.0.smithi137.stdout:3763: oid 45 updating version 0 to 16976 2024-03-04T06:54:20.629 INFO:tasks.rados.rados.0.smithi137.stdout:3763: oid 45 updating version 16976 to 16977 2024-03-04T06:54:20.629 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16977 (ObjNum 1174 snap 358 seq_num 1174) dirty exists 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:3763: left oid 45 (ObjNum 1174 snap 358 seq_num 1174) 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:3763: done (4 left) 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:3767: copy_from oid 22 from oid 11 current snap is 358 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:3762: finishing write tid 3 to smithi13777483-42 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:3762: oid 42 updating version 0 to 17028 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:3762: oid 42 version 17028 is already newer than 17027 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 17028 (ObjNum 1173 snap 358 seq_num 1173) dirty exists 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:3762: left oid 42 (ObjNum 1173 snap 358 seq_num 1173) 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:3764: finishing rollback tid 0 to smithi13777483-28 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:3764: finishing rollback tid 1 to smithi13777483-28 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:3764: finishing rollback tid 2 to smithi13777483-28 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16978 (ObjNum 1096 snap 326 seq_num 1096) dirty exists 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:3762: done (4 left) 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:3764: done (3 left) 2024-03-04T06:54:20.630 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 358 2024-03-04T06:54:20.631 INFO:tasks.rados.rados.0.smithi137.stdout:3768: seq_num 1176 ranges {0=499712} 2024-03-04T06:54:20.631 INFO:tasks.rados.rados.0.smithi137.stdout:3768: writing smithi13777483-47 from 0 to 499712 tid 1 2024-03-04T06:54:20.631 INFO:tasks.rados.rados.0.smithi137.stdout:3769: snap_create 2024-03-04T06:54:20.633 INFO:tasks.rados.rados.0.smithi137.stdout:3765: finishing write tid 1 to smithi13777483-12 2024-03-04T06:54:20.633 INFO:tasks.rados.rados.0.smithi137.stdout:3765: finishing write tid 2 to smithi13777483-12 2024-03-04T06:54:20.634 INFO:tasks.rados.rados.0.smithi137.stdout:3765: finishing write tid 3 to smithi13777483-12 2024-03-04T06:54:20.634 INFO:tasks.rados.rados.0.smithi137.stdout:3765: oid 12 updating version 0 to 16977 2024-03-04T06:54:20.635 INFO:tasks.rados.rados.0.smithi137.stdout:3765: oid 12 version 16977 is already newer than 16976 2024-03-04T06:54:20.635 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16977 (ObjNum 1175 snap 358 seq_num 1175) dirty exists 2024-03-04T06:54:20.635 INFO:tasks.rados.rados.0.smithi137.stdout:3765: left oid 12 (ObjNum 1175 snap 358 seq_num 1175) 2024-03-04T06:54:20.636 INFO:tasks.rados.rados.0.smithi137.stdout:3768: finishing write tid 1 to smithi13777483-47 2024-03-04T06:54:20.636 INFO:tasks.rados.rados.0.smithi137.stdout:3768: finishing write tid 2 to smithi13777483-47 2024-03-04T06:54:20.638 INFO:tasks.rados.rados.0.smithi137.stdout:3768: finishing write tid 3 to smithi13777483-47 2024-03-04T06:54:20.638 INFO:tasks.rados.rados.0.smithi137.stdout:3768: oid 47 updating version 0 to 16980 2024-03-04T06:54:20.638 INFO:tasks.rados.rados.0.smithi137.stdout:3768: oid 47 version 16980 is already newer than 16979 2024-03-04T06:54:20.638 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16980 (ObjNum 1176 snap 358 seq_num 1176) dirty exists 2024-03-04T06:54:20.639 INFO:tasks.rados.rados.0.smithi137.stdout:3768: left oid 47 (ObjNum 1176 snap 358 seq_num 1176) 2024-03-04T06:54:20.643 INFO:tasks.rados.rados.0.smithi137.stdout:3767: finishing copy_from racing read to smithi13777483-22 2024-03-04T06:54:20.644 INFO:tasks.rados.rados.0.smithi137.stdout:3767: finishing copy_from to smithi13777483-22 2024-03-04T06:54:20.645 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 16995 (ObjNum 1165 snap 357 seq_num 1165) dirty exists 2024-03-04T06:54:20.645 INFO:tasks.rados.rados.0.smithi137.stdout:3766: finishing copy_from racing read to smithi13777483-44 2024-03-04T06:54:20.647 INFO:tasks.rados.rados.0.smithi137.stdout:3766: finishing copy_from to smithi13777483-44 2024-03-04T06:54:20.647 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16940 (ObjNum 1122 snap 339 seq_num 1122) dirty exists 2024-03-04T06:54:20.792 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:20.510+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:20.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:20.503+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:20.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:20.514+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:20.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:20.514+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:20.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:20.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[88869]: osdmap e775: 8 total, 8 up, 8 in 2024-03-04T06:54:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[91314]: osdmap e775: 8 total, 8 up, 8 in 2024-03-04T06:54:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:20.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:20.508+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:20.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:20.513+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:20.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:20.507+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:20.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:20.508+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:20.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:20.498+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:20.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:20.498+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:20.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:20.498+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:20.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-mon[85573]: osdmap e775: 8 total, 8 up, 8 in 2024-03-04T06:54:20.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:20.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:20.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:20.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:20.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:20.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:20.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:20.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:21.508 INFO:tasks.rados.rados.0.smithi137.stdout:3765: done (4 left) 2024-03-04T06:54:21.508 INFO:tasks.rados.rados.0.smithi137.stdout:3766: done (3 left) 2024-03-04T06:54:21.508 INFO:tasks.rados.rados.0.smithi137.stdout:3767: done (2 left) 2024-03-04T06:54:21.508 INFO:tasks.rados.rados.0.smithi137.stdout:3768: done (1 left) 2024-03-04T06:54:21.508 INFO:tasks.rados.rados.0.smithi137.stdout:3769: done (0 left) 2024-03-04T06:54:21.508 INFO:tasks.rados.rados.0.smithi137.stdout:3770: rollback oid 20 current snap is 359 2024-03-04T06:54:21.508 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 20 to 348 2024-03-04T06:54:21.508 INFO:tasks.rados.rados.0.smithi137.stdout:3771: read oid 37 snap -1 2024-03-04T06:54:21.508 INFO:tasks.rados.rados.0.smithi137.stdout:3771: expect deleted 2024-03-04T06:54:21.509 INFO:tasks.rados.rados.0.smithi137.stdout:3772: read oid 29 snap -1 2024-03-04T06:54:21.509 INFO:tasks.rados.rados.0.smithi137.stdout:3772: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:54:21.509 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 26 current snap is 359 2024-03-04T06:54:21.509 INFO:tasks.rados.rados.0.smithi137.stdout:3773: seq_num 1177 ranges {2080768=516096} 2024-03-04T06:54:21.521 INFO:tasks.rados.rados.0.smithi137.stdout:3773: writing smithi13777483-26 from 2080768 to 2596864 tid 1 2024-03-04T06:54:21.522 INFO:tasks.rados.rados.0.smithi137.stdout:3774: snap_remove snap 346 2024-03-04T06:54:21.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:21.506+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[91314]: pgmap v847: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 833 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 7.2 MiB/s rd, 274 KiB/s wr, 20 op/s 2024-03-04T06:54:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[91314]: osdmap e776: 8 total, 8 up, 8 in 2024-03-04T06:54:21.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[88869]: pgmap v847: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 833 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 7.2 MiB/s rd, 274 KiB/s wr, 20 op/s 2024-03-04T06:54:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[88869]: osdmap e776: 8 total, 8 up, 8 in 2024-03-04T06:54:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:21.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:21.847 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:21.518+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:21.847 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:21.505+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:21.847 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:21.505+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:21.848 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:21.516+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:21.848 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:21.516+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:21.848 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:21.510+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:21.848 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:21.511+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:21.848 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:21.511+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:21.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:21.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-mon[85573]: pgmap v847: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 833 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 7.2 MiB/s rd, 274 KiB/s wr, 20 op/s 2024-03-04T06:54:21.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:21.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:21.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:21.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-mon[85573]: osdmap e776: 8 total, 8 up, 8 in 2024-03-04T06:54:21.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:21.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:21.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:21.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:21.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:21.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:21.850 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:22.292 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:21.954+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:22.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:21.953+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:22.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:21.953+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:22.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:21.953+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:22.515 INFO:tasks.rados.rados.0.smithi137.stdout:3770: finishing rollback tid 0 to smithi13777483-20 2024-03-04T06:54:22.515 INFO:tasks.rados.rados.0.smithi137.stdout:3770: finishing rollback tid 1 to smithi13777483-20 2024-03-04T06:54:22.515 INFO:tasks.rados.rados.0.smithi137.stdout:3770: finishing rollback tid 2 to smithi13777483-20 2024-03-04T06:54:22.515 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 20 v 16971 (ObjNum 1122 snap 339 seq_num 1122) dirty exists 2024-03-04T06:54:22.515 INFO:tasks.rados.rados.0.smithi137.stdout:3772: expect (ObjNum 932 snap 275 seq_num 932) 2024-03-04T06:54:22.792 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:22.516+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:22.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:22.519+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:22.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:22.512+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:22.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:22.512+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:22.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[91314]: osdmap e777: 8 total, 8 up, 8 in 2024-03-04T06:54:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:22.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:22.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[88869]: osdmap e777: 8 total, 8 up, 8 in 2024-03-04T06:54:22.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:22.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:22 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:22.819 INFO:tasks.rados.rados.0.smithi137.stdout:3773: finishing write tid 1 to smithi13777483-26 2024-03-04T06:54:22.819 INFO:tasks.rados.rados.0.smithi137.stdout:3773: finishing write tid 2 to smithi13777483-26 2024-03-04T06:54:22.819 INFO:tasks.rados.rados.0.smithi137.stdout:3773: finishing write tid 3 to smithi13777483-26 2024-03-04T06:54:22.819 INFO:tasks.rados.rados.0.smithi137.stdout:3773: oid 26 updating version 0 to 16976 2024-03-04T06:54:22.819 INFO:tasks.rados.rados.0.smithi137.stdout:3773: oid 26 updating version 16976 to 16977 2024-03-04T06:54:22.819 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16977 (ObjNum 1177 snap 359 seq_num 1177) dirty exists 2024-03-04T06:54:22.819 INFO:tasks.rados.rados.0.smithi137.stdout:3773: left oid 26 (ObjNum 1177 snap 359 seq_num 1177) 2024-03-04T06:54:22.819 INFO:tasks.rados.rados.0.smithi137.stdout:3770: done (4 left) 2024-03-04T06:54:22.819 INFO:tasks.rados.rados.0.smithi137.stdout:3771: done (3 left) 2024-03-04T06:54:22.820 INFO:tasks.rados.rados.0.smithi137.stdout:3772: done (2 left) 2024-03-04T06:54:22.820 INFO:tasks.rados.rados.0.smithi137.stdout:3773: done (1 left) 2024-03-04T06:54:22.820 INFO:tasks.rados.rados.0.smithi137.stdout:3774: done (0 left) 2024-03-04T06:54:22.820 INFO:tasks.rados.rados.0.smithi137.stdout:3775: rollback oid 24 current snap is 359 2024-03-04T06:54:22.820 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 24 to 349 2024-03-04T06:54:22.820 INFO:tasks.rados.rados.0.smithi137.stdout:3776: read oid 10 snap -1 2024-03-04T06:54:22.820 INFO:tasks.rados.rados.0.smithi137.stdout:3776: expect deleted 2024-03-04T06:54:22.820 INFO:tasks.rados.rados.0.smithi137.stdout:3777: snap_remove snap 340 2024-03-04T06:54:22.832 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:22.521+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:22.833 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:22.525+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:22.833 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:22.525+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:22.833 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-mon[85573]: osdmap e777: 8 total, 8 up, 8 in 2024-03-04T06:54:22.833 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:22.833 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:22.834 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:22.834 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:22.834 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:22.834 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:22.834 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:22.834 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:22.834 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:22.513+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:22.834 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:22.513+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:22.834 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:22.513+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:23.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:22.832+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:23.517 INFO:tasks.rados.rados.0.smithi137.stdout:3775: finishing rollback tid 0 to smithi13777483-24 2024-03-04T06:54:23.517 INFO:tasks.rados.rados.0.smithi137.stdout:3775: finishing rollback tid 1 to smithi13777483-24 2024-03-04T06:54:23.517 INFO:tasks.rados.rados.0.smithi137.stdout:3775: finishing rollback tid 2 to smithi13777483-24 2024-03-04T06:54:23.517 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16975 (ObjNum 1138 snap 346 seq_num 1138) dirty exists 2024-03-04T06:54:23.517 INFO:tasks.rados.rados.0.smithi137.stdout:3775: done (2 left) 2024-03-04T06:54:23.517 INFO:tasks.rados.rados.0.smithi137.stdout:3776: done (1 left) 2024-03-04T06:54:23.517 INFO:tasks.rados.rados.0.smithi137.stdout:3777: done (0 left) 2024-03-04T06:54:23.517 INFO:tasks.rados.rados.0.smithi137.stdout:3778: setattr oid 48 current snap is 359 2024-03-04T06:54:23.520 INFO:tasks.rados.rados.0.smithi137.stdout:3779: copy_from oid 6 from oid 18 current snap is 359 2024-03-04T06:54:23.520 INFO:tasks.rados.rados.0.smithi137.stdout:3780: read oid 24 snap -1 2024-03-04T06:54:23.520 INFO:tasks.rados.rados.0.smithi137.stdout:3780: expect (ObjNum 1138 snap 346 seq_num 1138) 2024-03-04T06:54:23.520 INFO:tasks.rados.rados.0.smithi137.stdout:3781: read oid 32 snap -1 2024-03-04T06:54:23.520 INFO:tasks.rados.rados.0.smithi137.stdout:3781: expect (ObjNum 1070 snap 320 seq_num 1070) 2024-03-04T06:54:23.520 INFO:tasks.rados.rados.0.smithi137.stdout:3782: snap_remove snap 348 2024-03-04T06:54:23.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:23.529+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:23.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:23.520+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:23.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:23.516+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:23.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:23.516+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:23.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:23.519+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: pgmap v850: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 833 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 255 B/s rd, 78 KiB/s wr, 12 op/s 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: osdmap e778: 8 total, 8 up, 8 in 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:23.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:23.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:54:23.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:23.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:23.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: pgmap v850: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 833 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 255 B/s rd, 78 KiB/s wr, 12 op/s 2024-03-04T06:54:23.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:23.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: osdmap e778: 8 total, 8 up, 8 in 2024-03-04T06:54:23.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:23.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:23.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:23.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:23.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:23.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:23.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:23.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:23.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:23.796 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:54:23.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:23.514+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:23.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:23.514+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:23.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:23.518+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:23.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:23.537+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:23.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:23.537+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:23.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:23.525+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:23.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:23.526+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:23.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:23.526+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:23.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: pgmap v850: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 833 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 255 B/s rd, 78 KiB/s wr, 12 op/s 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: osdmap e778: 8 total, 8 up, 8 in 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:23.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:54:24.529 INFO:tasks.rados.rados.0.smithi137.stdout:3782: done (4 left) 2024-03-04T06:54:24.530 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 28 current snap is 359 2024-03-04T06:54:24.530 INFO:tasks.rados.rados.0.smithi137.stdout:3783: seq_num 1178 ranges {12599296=532480} 2024-03-04T06:54:24.600 INFO:tasks.rados.rados.0.smithi137.stdout:3783: writing smithi13777483-28 from 12599296 to 13131776 tid 1 2024-03-04T06:54:24.601 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 359 2024-03-04T06:54:24.601 INFO:tasks.rados.rados.0.smithi137.stdout:3784: seq_num 1179 ranges {499712=548864} 2024-03-04T06:54:24.607 INFO:tasks.rados.rados.0.smithi137.stdout:3784: writing smithi13777483-47 from 499712 to 1048576 tid 1 2024-03-04T06:54:24.607 INFO:tasks.rados.rados.0.smithi137.stdout:3785: snap_remove snap 333 2024-03-04T06:54:24.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:24.532+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:24.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:24.530+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:24.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:24.532+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:24.793 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:24.532+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[88869]: osdmap e779: 8 total, 8 up, 8 in 2024-03-04T06:54:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:24.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[91314]: osdmap e779: 8 total, 8 up, 8 in 2024-03-04T06:54:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:24.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:24 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:24.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:24.537+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:24.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:24.523+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:24.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:24.523+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:24.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:24.523+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:24.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:24.536+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:24.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:24.537+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:24.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-mon[85573]: osdmap e779: 8 total, 8 up, 8 in 2024-03-04T06:54:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:24.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:24 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:25.533 INFO:tasks.rados.rados.0.smithi137.stdout:3785: done (6 left) 2024-03-04T06:54:25.534 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 16951 (ObjNum 1170 snap 358 seq_num 1170) dirty exists 2024-03-04T06:54:25.534 INFO:tasks.rados.rados.0.smithi137.stdout:3781: expect (ObjNum 1070 snap 320 seq_num 1070) 2024-03-04T06:54:25.573 INFO:tasks.rados.rados.0.smithi137.stdout:3780: expect (ObjNum 1138 snap 346 seq_num 1138) 2024-03-04T06:54:25.682 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:25.539+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:25.682 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:25.539+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:25.682 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:25.540+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:25.683 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:25.393+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:25.683 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:25.682+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:25.683 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:25.538+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:25.683 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:25.538+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:25.683 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:25.538+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:25.683 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-mon[85573]: pgmap v853: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 860 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 14 MiB/s rd, 2.9 MiB/s wr, 30 op/s 2024-03-04T06:54:25.683 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:25.683 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:25.683 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-mon[85573]: osdmap e780: 8 total, 8 up, 8 in 2024-03-04T06:54:25.684 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:25.684 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:25.684 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:25.684 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:25.684 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:25.684 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:25.684 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:25.684 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:25.712 INFO:tasks.rados.rados.0.smithi137.stdout:3779: finishing copy_from racing read to smithi13777483-6 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3779: finishing copy_from to smithi13777483-6 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16975 (ObjNum 1163 snap 356 seq_num 1163) dirty exists 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3783: finishing write tid 1 to smithi13777483-28 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3783: finishing write tid 2 to smithi13777483-28 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3786: read oid 12 snap -1 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3786: expect (ObjNum 1175 snap 358 seq_num 1175) 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3778: done (6 left) 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3779: done (5 left) 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3780: done (4 left) 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3781: done (3 left) 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3787: delete oid 2 current snap is 359 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3784: finishing write tid 1 to smithi13777483-47 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3783: finishing write tid 3 to smithi13777483-28 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3783: oid 28 updating version 0 to 16982 2024-03-04T06:54:25.713 INFO:tasks.rados.rados.0.smithi137.stdout:3783: oid 28 version 16982 is already newer than 16981 2024-03-04T06:54:25.714 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16982 (ObjNum 1178 snap 359 seq_num 1178) dirty exists 2024-03-04T06:54:25.714 INFO:tasks.rados.rados.0.smithi137.stdout:3783: left oid 28 (ObjNum 1178 snap 359 seq_num 1178) 2024-03-04T06:54:25.714 INFO:tasks.rados.rados.0.smithi137.stdout:3784: finishing write tid 2 to smithi13777483-47 2024-03-04T06:54:25.714 INFO:tasks.rados.rados.0.smithi137.stdout:3784: finishing write tid 3 to smithi13777483-47 2024-03-04T06:54:25.714 INFO:tasks.rados.rados.0.smithi137.stdout:3784: oid 47 updating version 0 to 16983 2024-03-04T06:54:25.714 INFO:tasks.rados.rados.0.smithi137.stdout:3784: oid 47 updating version 16983 to 16984 2024-03-04T06:54:25.714 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16984 (ObjNum 1179 snap 359 seq_num 1179) dirty exists 2024-03-04T06:54:25.714 INFO:tasks.rados.rados.0.smithi137.stdout:3784: left oid 47 (ObjNum 1179 snap 359 seq_num 1179) 2024-03-04T06:54:25.715 INFO:tasks.rados.rados.0.smithi137.stdout:3783: done (3 left) 2024-03-04T06:54:25.715 INFO:tasks.rados.rados.0.smithi137.stdout:3784: done (2 left) 2024-03-04T06:54:25.715 INFO:tasks.rados.rados.0.smithi137.stdout:3787: done (1 left) 2024-03-04T06:54:25.715 INFO:tasks.rados.rados.0.smithi137.stdout:3788: rollback oid 29 current snap is 359 2024-03-04T06:54:25.715 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 29 to 350 2024-03-04T06:54:25.715 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 39 current snap is 359 2024-03-04T06:54:25.715 INFO:tasks.rados.rados.0.smithi137.stdout:3789: seq_num 1181 ranges {4358144=581632} 2024-03-04T06:54:25.741 INFO:tasks.rados.rados.0.smithi137.stdout:3789: writing smithi13777483-39 from 4358144 to 4939776 tid 1 2024-03-04T06:54:25.742 INFO:tasks.rados.rados.0.smithi137.stdout:3790: delete oid 35 current snap is 359 2024-03-04T06:54:25.742 INFO:tasks.rados.rados.0.smithi137.stdout:3786: expect (ObjNum 1175 snap 358 seq_num 1175) 2024-03-04T06:54:25.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:54:25] "GET /metrics HTTP/1.1" 200 36342 "" "Prometheus/2.43.0" 2024-03-04T06:54:25.792 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:25.534+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:25.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:25.548+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:25.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:25.537+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:25.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:25.537+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:25.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:25.537+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:25.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[91314]: pgmap v853: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 860 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 14 MiB/s rd, 2.9 MiB/s wr, 30 op/s 2024-03-04T06:54:25.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[91314]: osdmap e780: 8 total, 8 up, 8 in 2024-03-04T06:54:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:25.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:25.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[88869]: pgmap v853: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 860 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 14 MiB/s rd, 2.9 MiB/s wr, 30 op/s 2024-03-04T06:54:25.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:25.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:25.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[88869]: osdmap e780: 8 total, 8 up, 8 in 2024-03-04T06:54:25.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:25.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:25.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:25.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:25.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:25.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:25.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:25.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:25 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:25.804 INFO:tasks.rados.rados.0.smithi137.stdout:3788: finishing rollback tid 0 to smithi13777483-29 2024-03-04T06:54:25.804 INFO:tasks.rados.rados.0.smithi137.stdout:3788: finishing rollback tid 1 to smithi13777483-29 2024-03-04T06:54:25.804 INFO:tasks.rados.rados.0.smithi137.stdout:3788: finishing rollback tid 2 to smithi13777483-29 2024-03-04T06:54:25.804 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16980 (ObjNum 932 snap 275 seq_num 932) dirty exists 2024-03-04T06:54:25.804 INFO:tasks.rados.rados.0.smithi137.stdout:3789: finishing write tid 1 to smithi13777483-39 2024-03-04T06:54:25.804 INFO:tasks.rados.rados.0.smithi137.stdout:3789: finishing write tid 2 to smithi13777483-39 2024-03-04T06:54:25.804 INFO:tasks.rados.rados.0.smithi137.stdout:3786: done (3 left) 2024-03-04T06:54:25.804 INFO:tasks.rados.rados.0.smithi137.stdout:3788: done (2 left) 2024-03-04T06:54:25.804 INFO:tasks.rados.rados.0.smithi137.stdout:3790: done (1 left) 2024-03-04T06:54:25.804 INFO:tasks.rados.rados.0.smithi137.stdout:3791: setattr oid 24 current snap is 359 2024-03-04T06:54:25.804 INFO:tasks.rados.rados.0.smithi137.stdout:3789: finishing write tid 3 to smithi13777483-39 2024-03-04T06:54:25.804 INFO:tasks.rados.rados.0.smithi137.stdout:3789: oid 39 updating version 0 to 16977 2024-03-04T06:54:25.804 INFO:tasks.rados.rados.0.smithi137.stdout:3789: oid 39 version 16977 is already newer than 16976 2024-03-04T06:54:25.805 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 16977 (ObjNum 1181 snap 359 seq_num 1181) dirty exists 2024-03-04T06:54:25.805 INFO:tasks.rados.rados.0.smithi137.stdout:3789: left oid 39 (ObjNum 1181 snap 359 seq_num 1181) 2024-03-04T06:54:25.805 INFO:tasks.rados.rados.0.smithi137.stdout:3789: done (1 left) 2024-03-04T06:54:25.805 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 22 current snap is 359 2024-03-04T06:54:25.805 INFO:tasks.rados.rados.0.smithi137.stdout:3792: seq_num 1183 ranges {2727936=622592} 2024-03-04T06:54:25.823 INFO:tasks.rados.rados.0.smithi137.stdout:3792: writing smithi13777483-22 from 2727936 to 3350528 tid 1 2024-03-04T06:54:25.823 INFO:tasks.rados.rados.0.smithi137.stdout:3793: rollback oid 34 current snap is 359 2024-03-04T06:54:25.823 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 34 to 332 2024-03-04T06:54:25.823 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16978 (ObjNum 1138 snap 346 seq_num 1138) dirty exists 2024-03-04T06:54:25.823 INFO:tasks.rados.rados.0.smithi137.stdout:3791: done (2 left) 2024-03-04T06:54:25.823 INFO:tasks.rados.rados.0.smithi137.stdout:3794: delete oid 11 current snap is 359 2024-03-04T06:54:25.825 INFO:tasks.rados.rados.0.smithi137.stdout:3794: done (2 left) 2024-03-04T06:54:25.825 INFO:tasks.rados.rados.0.smithi137.stdout:3795: snap_create 2024-03-04T06:54:25.828 INFO:tasks.rados.rados.0.smithi137.stdout:3792: finishing write tid 1 to smithi13777483-22 2024-03-04T06:54:25.828 INFO:tasks.rados.rados.0.smithi137.stdout:3792: finishing write tid 2 to smithi13777483-22 2024-03-04T06:54:25.829 INFO:tasks.rados.rados.0.smithi137.stdout:3793: finishing rollback tid 0 to smithi13777483-34 2024-03-04T06:54:25.830 INFO:tasks.rados.rados.0.smithi137.stdout:3793: finishing rollback tid 1 to smithi13777483-34 2024-03-04T06:54:25.830 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16995 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-04T06:54:25.830 INFO:tasks.rados.rados.0.smithi137.stdout:3792: finishing write tid 3 to smithi13777483-22 2024-03-04T06:54:25.830 INFO:tasks.rados.rados.0.smithi137.stdout:3792: oid 22 updating version 0 to 16997 2024-03-04T06:54:25.830 INFO:tasks.rados.rados.0.smithi137.stdout:3792: oid 22 version 16997 is already newer than 16996 2024-03-04T06:54:25.830 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 22 v 16997 (ObjNum 1183 snap 359 seq_num 1183) dirty exists 2024-03-04T06:54:25.830 INFO:tasks.rados.rados.0.smithi137.stdout:3792: left oid 22 (ObjNum 1183 snap 359 seq_num 1183) 2024-03-04T06:54:26.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:25.682+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:26.539 INFO:tasks.rados.rados.0.smithi137.stdout:3792: done (2 left) 2024-03-04T06:54:26.539 INFO:tasks.rados.rados.0.smithi137.stdout:3793: done (1 left) 2024-03-04T06:54:26.539 INFO:tasks.rados.rados.0.smithi137.stdout:3795: done (0 left) 2024-03-04T06:54:26.539 INFO:tasks.rados.rados.0.smithi137.stdout:3796: read oid 10 snap -1 2024-03-04T06:54:26.539 INFO:tasks.rados.rados.0.smithi137.stdout:3796: expect deleted 2024-03-04T06:54:26.539 INFO:tasks.rados.rados.0.smithi137.stdout:3797: snap_remove snap 349 2024-03-04T06:54:26.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:26.539+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[91314]: osdmap e781: 8 total, 8 up, 8 in 2024-03-04T06:54:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[91314]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:26.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[88869]: osdmap e781: 8 total, 8 up, 8 in 2024-03-04T06:54:26.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:26.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:26.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:26.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:26.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:26.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:26.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:26.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:26.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:26.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-mon[88869]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:26.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:26.537+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:26.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:26.537+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:26.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:26.538+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-mon[85573]: osdmap e781: 8 total, 8 up, 8 in 2024-03-04T06:54:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:26.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-mon[85573]: No clone_snaps in snapset 189=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:27.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:26.910+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:27.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:26.909+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:27.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:26.910+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:27.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:26.911+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:27.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:26.910+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:27.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:26.910+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:27.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:26.911+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:27.545 INFO:tasks.rados.rados.0.smithi137.stdout:3797: done (1 left) 2024-03-04T06:54:27.545 INFO:tasks.rados.rados.0.smithi137.stdout:3798: read oid 27 snap -1 2024-03-04T06:54:27.545 INFO:tasks.rados.rados.0.smithi137.stdout:3798: expect (ObjNum 1099 snap 326 seq_num 1099) 2024-03-04T06:54:27.545 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 17 current snap is 360 2024-03-04T06:54:27.545 INFO:tasks.rados.rados.0.smithi137.stdout:3799: seq_num 1185 ranges {12312576=655360} 2024-03-04T06:54:27.615 INFO:tasks.rados.rados.0.smithi137.stdout:3799: writing smithi13777483-17 from 12312576 to 12967936 tid 1 2024-03-04T06:54:27.615 INFO:tasks.rados.rados.0.smithi137.stdout:3800: rollback oid 26 current snap is 360 2024-03-04T06:54:27.615 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 26 to 357 2024-03-04T06:54:27.615 INFO:tasks.rados.rados.0.smithi137.stdout:3798: expect (ObjNum 1099 snap 326 seq_num 1099) 2024-03-04T06:54:27.709 INFO:tasks.rados.rados.0.smithi137.stdout:3800: finishing rollback tid 0 to smithi13777483-26 2024-03-04T06:54:27.709 INFO:tasks.rados.rados.0.smithi137.stdout:3800: finishing rollback tid 1 to smithi13777483-26 2024-03-04T06:54:27.709 INFO:tasks.rados.rados.0.smithi137.stdout:3796: done (3 left) 2024-03-04T06:54:27.709 INFO:tasks.rados.rados.0.smithi137.stdout:3798: done (2 left) 2024-03-04T06:54:27.709 INFO:tasks.rados.rados.0.smithi137.stdout:3801: snap_remove snap 356 2024-03-04T06:54:27.792 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:27.558+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:27.793 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:27.544+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:27.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:27.553+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:27.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:27.555+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:27.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:27.556+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:27.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[91314]: pgmap v856: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 861 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 14 MiB/s rd, 3.1 MiB/s wr, 32 op/s 2024-03-04T06:54:27.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:27.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:27.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[91314]: osdmap e782: 8 total, 8 up, 8 in 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a0=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[88869]: pgmap v856: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 861 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 14 MiB/s rd, 3.1 MiB/s wr, 32 op/s 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[88869]: osdmap e782: 8 total, 8 up, 8 in 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a0=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:27.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:27 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:27.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:27.550+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:27.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:27.549+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:27.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:27.549+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-mon[85573]: pgmap v856: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 861 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 14 MiB/s rd, 3.1 MiB/s wr, 32 op/s 2024-03-04T06:54:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-mon[85573]: osdmap e782: 8 total, 8 up, 8 in 2024-03-04T06:54:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a0=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:27.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:27.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:27.564+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:27.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:27.564+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:27.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:27.564+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:27.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:27.543+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:27.847 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:27.543+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:28.553 INFO:tasks.rados.rados.0.smithi137.stdout:3801: done (2 left) 2024-03-04T06:54:28.554 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 360 2024-03-04T06:54:28.554 INFO:tasks.rados.rados.0.smithi137.stdout:3802: seq_num 1186 ranges {0=671744} 2024-03-04T06:54:28.558 INFO:tasks.rados.rados.0.smithi137.stdout:3802: writing smithi13777483-34 from 0 to 671744 tid 1 2024-03-04T06:54:28.558 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 18 current snap is 360 2024-03-04T06:54:28.558 INFO:tasks.rados.rados.0.smithi137.stdout:3803: seq_num 1187 ranges {15171584=688128} 2024-03-04T06:54:28.644 INFO:tasks.rados.rados.0.smithi137.stdout:3803: writing smithi13777483-18 from 15171584 to 15859712 tid 1 2024-03-04T06:54:28.644 INFO:tasks.rados.rados.0.smithi137.stdout:3804: copy_from oid 39 from oid 43 current snap is 360 2024-03-04T06:54:28.644 INFO:tasks.rados.rados.0.smithi137.stdout:3800: finishing rollback tid 2 to smithi13777483-26 2024-03-04T06:54:28.644 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 26 v 16983 (ObjNum 957 snap 282 seq_num 957) dirty exists 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3799: finishing write tid 1 to smithi13777483-17 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3800: done (4 left) 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3805: read oid 50 snap -1 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3805: expect (ObjNum 1169 snap 358 seq_num 1169) 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3799: finishing write tid 2 to smithi13777483-17 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3799: finishing write tid 3 to smithi13777483-17 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3799: oid 17 updating version 0 to 16976 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3799: oid 17 updating version 16976 to 16977 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 17 v 16977 (ObjNum 1185 snap 360 seq_num 1185) dirty exists 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3799: left oid 17 (ObjNum 1185 snap 360 seq_num 1185) 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3802: finishing write tid 1 to smithi13777483-34 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3802: finishing write tid 2 to smithi13777483-34 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3802: finishing write tid 3 to smithi13777483-34 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3802: oid 34 updating version 0 to 16997 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:3802: oid 34 version 16997 is already newer than 16996 2024-03-04T06:54:28.645 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 16997 (ObjNum 1186 snap 360 seq_num 1186) dirty exists 2024-03-04T06:54:28.646 INFO:tasks.rados.rados.0.smithi137.stdout:3802: left oid 34 (ObjNum 1186 snap 360 seq_num 1186) 2024-03-04T06:54:28.646 INFO:tasks.rados.rados.0.smithi137.stdout:3806: read oid 25 snap -1 2024-03-04T06:54:28.646 INFO:tasks.rados.rados.0.smithi137.stdout:3806: expect deleted 2024-03-04T06:54:28.646 INFO:tasks.rados.rados.0.smithi137.stdout:3799: done (5 left) 2024-03-04T06:54:28.646 INFO:tasks.rados.rados.0.smithi137.stdout:3802: done (4 left) 2024-03-04T06:54:28.646 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 44 current snap is 360 2024-03-04T06:54:28.646 INFO:tasks.rados.rados.0.smithi137.stdout:3807: seq_num 1188 ranges {3325952=704512} 2024-03-04T06:54:28.666 INFO:tasks.rados.rados.0.smithi137.stdout:3807: writing smithi13777483-44 from 3325952 to 4030464 tid 1 2024-03-04T06:54:28.666 INFO:tasks.rados.rados.0.smithi137.stdout:3808: copy_from oid 14 from oid 13 current snap is 360 2024-03-04T06:54:28.667 INFO:tasks.rados.rados.0.smithi137.stdout:3805: expect (ObjNum 1169 snap 358 seq_num 1169) 2024-03-04T06:54:28.679 INFO:tasks.rados.rados.0.smithi137.stdout:3803: finishing write tid 1 to smithi13777483-18 2024-03-04T06:54:28.679 INFO:tasks.rados.rados.0.smithi137.stdout:3803: finishing write tid 2 to smithi13777483-18 2024-03-04T06:54:28.679 INFO:tasks.rados.rados.0.smithi137.stdout:3805: done (5 left) 2024-03-04T06:54:28.679 INFO:tasks.rados.rados.0.smithi137.stdout:3806: done (4 left) 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:3809: copy_from oid 33 from oid 48 current snap is 360 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:3803: finishing write tid 3 to smithi13777483-18 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:3803: oid 18 updating version 0 to 16985 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:3803: oid 18 version 16985 is already newer than 16984 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16985 (ObjNum 1187 snap 360 seq_num 1187) dirty exists 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:3803: left oid 18 (ObjNum 1187 snap 360 seq_num 1187) 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:3804: finishing copy_from racing read to smithi13777483-39 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:3804: finishing copy_from to smithi13777483-39 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 16975 (ObjNum 1162 snap 356 seq_num 1162) dirty exists 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:3807: finishing write tid 1 to smithi13777483-44 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:3803: done (4 left) 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:3804: done (3 left) 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:3810: read oid 32 snap -1 2024-03-04T06:54:28.680 INFO:tasks.rados.rados.0.smithi137.stdout:3810: expect (ObjNum 1070 snap 320 seq_num 1070) 2024-03-04T06:54:28.681 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 23 current snap is 360 2024-03-04T06:54:28.681 INFO:tasks.rados.rados.0.smithi137.stdout:3807: finishing write tid 2 to smithi13777483-44 2024-03-04T06:54:28.681 INFO:tasks.rados.rados.0.smithi137.stdout:3807: finishing write tid 3 to smithi13777483-44 2024-03-04T06:54:28.681 INFO:tasks.rados.rados.0.smithi137.stdout:3807: oid 44 updating version 0 to 16998 2024-03-04T06:54:28.681 INFO:tasks.rados.rados.0.smithi137.stdout:3807: oid 44 updating version 16998 to 16999 2024-03-04T06:54:28.681 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 16999 (ObjNum 1188 snap 360 seq_num 1188) dirty exists 2024-03-04T06:54:28.681 INFO:tasks.rados.rados.0.smithi137.stdout:3807: left oid 44 (ObjNum 1188 snap 360 seq_num 1188) 2024-03-04T06:54:28.681 INFO:tasks.rados.rados.0.smithi137.stdout:3808: finishing copy_from racing read to smithi13777483-14 2024-03-04T06:54:28.681 INFO:tasks.rados.rados.0.smithi137.stdout:3811: seq_num 1189 ranges {2727936=720896} 2024-03-04T06:54:28.698 INFO:tasks.rados.rados.0.smithi137.stdout:3811: writing smithi13777483-23 from 2727936 to 3448832 tid 1 2024-03-04T06:54:28.698 INFO:tasks.rados.rados.0.smithi137.stdout:3807: done (4 left) 2024-03-04T06:54:28.698 INFO:tasks.rados.rados.0.smithi137.stdout:3812: read oid 35 snap -1 2024-03-04T06:54:28.698 INFO:tasks.rados.rados.0.smithi137.stdout:3812: expect deleted 2024-03-04T06:54:28.698 INFO:tasks.rados.rados.0.smithi137.stdout:3813: copy_from oid 29 from oid 43 current snap is 360 2024-03-04T06:54:28.698 INFO:tasks.rados.rados.0.smithi137.stdout:3808: finishing copy_from to smithi13777483-14 2024-03-04T06:54:28.699 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 16971 (ObjNum 1161 snap 354 seq_num 1161) dirty exists 2024-03-04T06:54:28.699 INFO:tasks.rados.rados.0.smithi137.stdout:3810: expect (ObjNum 1070 snap 320 seq_num 1070) 2024-03-04T06:54:28.732 INFO:tasks.rados.rados.0.smithi137.stdout:3809: finishing copy_from racing read to smithi13777483-33 2024-03-04T06:54:28.733 INFO:tasks.rados.rados.0.smithi137.stdout:3809: finishing copy_from to smithi13777483-33 2024-03-04T06:54:28.733 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16951 (ObjNum 1170 snap 358 seq_num 1170) dirty exists 2024-03-04T06:54:28.733 INFO:tasks.rados.rados.0.smithi137.stdout:3811: finishing write tid 1 to smithi13777483-23 2024-03-04T06:54:28.733 INFO:tasks.rados.rados.0.smithi137.stdout:3811: finishing write tid 2 to smithi13777483-23 2024-03-04T06:54:28.733 INFO:tasks.rados.rados.0.smithi137.stdout:3808: done (5 left) 2024-03-04T06:54:28.733 INFO:tasks.rados.rados.0.smithi137.stdout:3809: done (4 left) 2024-03-04T06:54:28.733 INFO:tasks.rados.rados.0.smithi137.stdout:3810: done (3 left) 2024-03-04T06:54:28.733 INFO:tasks.rados.rados.0.smithi137.stdout:3812: done (2 left) 2024-03-04T06:54:28.733 INFO:tasks.rados.rados.0.smithi137.stdout:3814: read oid 9 snap -1 2024-03-04T06:54:28.733 INFO:tasks.rados.rados.0.smithi137.stdout:3814: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:54:28.733 INFO:tasks.rados.rados.0.smithi137.stdout:3815: snap_remove snap 358 2024-03-04T06:54:28.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:28.567+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:28.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:28.551+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:28.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:28.551+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:28.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:28.551+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:28.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:28.558+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:28.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:28.560+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:28.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:28.561+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:28.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a0=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: osdmap e783: 8 total, 8 up, 8 in 2024-03-04T06:54:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:28.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:28 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:29.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:28.557+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:29.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:28.563+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:29.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:28.575+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:29.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:28.554+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a0=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: osdmap e783: 8 total, 8 up, 8 in 2024-03-04T06:54:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:29.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:29.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:29.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:29.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:29.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:29.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a0=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:29.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: osdmap e783: 8 total, 8 up, 8 in 2024-03-04T06:54:29.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:29.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:29.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:29.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:29.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:29.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:29.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:29.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:29.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:28 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:29.559 INFO:tasks.rados.rados.0.smithi137.stdout:3815: done (3 left) 2024-03-04T06:54:29.559 INFO:tasks.rados.rados.0.smithi137.stdout:3816: read oid 40 snap -1 2024-03-04T06:54:29.559 INFO:tasks.rados.rados.0.smithi137.stdout:3816: expect (ObjNum 1107 snap 329 seq_num 1107) 2024-03-04T06:54:29.559 INFO:tasks.rados.rados.0.smithi137.stdout:3817: snap_create 2024-03-04T06:54:29.559 INFO:tasks.rados.rados.0.smithi137.stdout:3811: finishing write tid 3 to smithi13777483-23 2024-03-04T06:54:29.559 INFO:tasks.rados.rados.0.smithi137.stdout:3811: oid 23 updating version 0 to 16972 2024-03-04T06:54:29.559 INFO:tasks.rados.rados.0.smithi137.stdout:3811: oid 23 updating version 16972 to 16973 2024-03-04T06:54:29.559 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 23 v 16973 (ObjNum 1189 snap 360 seq_num 1189) dirty exists 2024-03-04T06:54:29.559 INFO:tasks.rados.rados.0.smithi137.stdout:3811: left oid 23 (ObjNum 1189 snap 360 seq_num 1189) 2024-03-04T06:54:29.559 INFO:tasks.rados.rados.0.smithi137.stdout:3813: finishing copy_from racing read to smithi13777483-29 2024-03-04T06:54:29.559 INFO:tasks.rados.rados.0.smithi137.stdout:3813: finishing copy_from to smithi13777483-29 2024-03-04T06:54:29.560 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16975 (ObjNum 1162 snap 356 seq_num 1162) dirty exists 2024-03-04T06:54:29.560 INFO:tasks.rados.rados.0.smithi137.stdout:3814: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:54:29.809 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:29.557+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:29.810 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:29.742+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:29.810 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:29.743+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:29.810 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:29.743+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:29.810 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[88869]: pgmap v859: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 875 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 6.9 MiB/s rd, 4.4 MiB/s wr, 20 op/s 2024-03-04T06:54:29.810 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:29.810 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:29.810 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[88869]: osdmap e784: 8 total, 8 up, 8 in 2024-03-04T06:54:29.810 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:29.811 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:29.811 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:29.811 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:29.811 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:29.811 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:29.811 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a0=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:29.811 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:29.811 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[91314]: pgmap v859: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 875 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 6.9 MiB/s rd, 4.4 MiB/s wr, 20 op/s 2024-03-04T06:54:29.811 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:29.811 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:29.811 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[91314]: osdmap e784: 8 total, 8 up, 8 in 2024-03-04T06:54:29.811 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:29.812 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:29.812 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:29.812 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:29.812 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:29.812 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:29.812 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a0=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:29.812 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:29.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:29.567+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:29.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:29.557+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:29.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:29.557+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:29.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:29.566+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:29.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:29.566+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:29.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:29.566+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:29.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:29.683+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:29.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:29.683+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:29.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-mon[85573]: pgmap v859: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 875 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 6.9 MiB/s rd, 4.4 MiB/s wr, 20 op/s 2024-03-04T06:54:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-mon[85573]: osdmap e784: 8 total, 8 up, 8 in 2024-03-04T06:54:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a0=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:29.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:29 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:30.292 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:29 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:29.808+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:30.378 INFO:tasks.rados.rados.0.smithi137.stdout:3816: expect (ObjNum 1107 snap 329 seq_num 1107) 2024-03-04T06:54:30.758 INFO:tasks.rados.rados.0.smithi137.stdout:3811: done (4 left) 2024-03-04T06:54:30.758 INFO:tasks.rados.rados.0.smithi137.stdout:3813: done (3 left) 2024-03-04T06:54:30.758 INFO:tasks.rados.rados.0.smithi137.stdout:3814: done (2 left) 2024-03-04T06:54:30.758 INFO:tasks.rados.rados.0.smithi137.stdout:3816: done (1 left) 2024-03-04T06:54:30.758 INFO:tasks.rados.rados.0.smithi137.stdout:3817: done (0 left) 2024-03-04T06:54:30.759 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 10 current snap is 361 2024-03-04T06:54:30.759 INFO:tasks.rados.rados.0.smithi137.stdout:3818: seq_num 1190 ranges {0=737280} 2024-03-04T06:54:30.762 INFO:tasks.rados.rados.0.smithi137.stdout:3818: writing smithi13777483-10 from 0 to 737280 tid 1 2024-03-04T06:54:30.762 INFO:tasks.rados.rados.0.smithi137.stdout:3819: copy_from oid 24 from oid 18 current snap is 361 2024-03-04T06:54:30.762 INFO:tasks.rados.rados.0.smithi137.stdout:3820: snap_remove snap 353 2024-03-04T06:54:30.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:30.767+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:30.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:30.562+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:30.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:30.562+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:30.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:30.562+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:30.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:30.760+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:30.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:30.760+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:30.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:30.766+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:30.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-mon[85573]: osdmap e785: 8 total, 8 up, 8 in 2024-03-04T06:54:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:30.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:30 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:31.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:30.594+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:31.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:30.563+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:31.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:30.766+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:31.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:30.766+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:31.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:31.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:31.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:31.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[91314]: osdmap e785: 8 total, 8 up, 8 in 2024-03-04T06:54:31.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:31.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:31.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:31.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:31.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:31.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:31.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:31.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:31.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[88869]: osdmap e785: 8 total, 8 up, 8 in 2024-03-04T06:54:31.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:31.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:31.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:31.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:31.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:30 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:31.576 INFO:tasks.rados.rados.0.smithi137.stdout:3820: done (2 left) 2024-03-04T06:54:31.576 INFO:tasks.rados.rados.0.smithi137.stdout:3821: rollback oid 6 current snap is 361 2024-03-04T06:54:31.576 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 6 to 350 2024-03-04T06:54:31.576 INFO:tasks.rados.rados.0.smithi137.stdout:3822: rmattr oid 48 current snap is 361 2024-03-04T06:54:31.576 INFO:tasks.rados.rados.0.smithi137.stdout:3823: snap_remove snap 327 2024-03-04T06:54:31.846 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:31.581+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:31.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:31.575+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:31.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:31.575+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:31.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:31.581+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:31.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:31.582+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:31.847 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:31.582+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:31.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:31.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:31.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-mon[85573]: pgmap v862: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 878 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 6.9 MiB/s rd, 4.9 MiB/s wr, 20 op/s 2024-03-04T06:54:31.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:31.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:31.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:31.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-mon[85573]: osdmap e786: 8 total, 8 up, 8 in 2024-03-04T06:54:31.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:31.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:31.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:31.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:31.848 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:31 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:32.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:31.579+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:32.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:31.587+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:32.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:31.575+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:32.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:31.575+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:32.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:31.575+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[88869]: pgmap v862: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 878 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 6.9 MiB/s rd, 4.9 MiB/s wr, 20 op/s 2024-03-04T06:54:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[88869]: osdmap e786: 8 total, 8 up, 8 in 2024-03-04T06:54:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:32.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:32.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:32.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:32.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[91314]: pgmap v862: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 878 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 6.9 MiB/s rd, 4.9 MiB/s wr, 20 op/s 2024-03-04T06:54:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:32.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[91314]: osdmap e786: 8 total, 8 up, 8 in 2024-03-04T06:54:32.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:32.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:32.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:32.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:32.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:31 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:32.575 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:32.110+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:32.576 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:32.110+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:32.581 INFO:tasks.rados.rados.0.smithi137.stdout:3823: done (4 left) 2024-03-04T06:54:32.581 INFO:tasks.rados.rados.0.smithi137.stdout:3824: snap_remove snap 332 2024-03-04T06:54:32.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:32.591+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:32.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:32.592+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:32.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:32.592+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:32.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:32.578+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:32.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:32.578+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:32.846 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:32.578+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:32.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:32.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:32.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-mon[85573]: osdmap e787: 8 total, 8 up, 8 in 2024-03-04T06:54:32.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:32.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:32.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:32.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:32.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:32.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:32.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:32.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:32.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:32.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:32 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:33.042 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:32.578+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:33.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:32.585+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:33.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:32.586+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:33.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:32.585+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:33.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:33.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:33.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[88869]: osdmap e787: 8 total, 8 up, 8 in 2024-03-04T06:54:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:33.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[91314]: osdmap e787: 8 total, 8 up, 8 in 2024-03-04T06:54:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:33.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:32 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:33.580 INFO:tasks.rados.rados.0.smithi137.stdout:3824: done (4 left) 2024-03-04T06:54:33.580 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 35 current snap is 361 2024-03-04T06:54:33.580 INFO:tasks.rados.rados.0.smithi137.stdout:3818: finishing write tid 1 to smithi13777483-10 2024-03-04T06:54:33.580 INFO:tasks.rados.rados.0.smithi137.stdout:3825: seq_num 1191 ranges {0=753664} 2024-03-04T06:54:33.586 INFO:tasks.rados.rados.0.smithi137.stdout:3825: writing smithi13777483-35 from 0 to 753664 tid 1 2024-03-04T06:54:33.586 INFO:tasks.rados.rados.0.smithi137.stdout:3826: read oid 30 snap 350 2024-03-04T06:54:33.586 INFO:tasks.rados.rados.0.smithi137.stdout:3826: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:54:33.586 INFO:tasks.rados.rados.0.smithi137.stdout:3827: rollback oid 13 current snap is 361 2024-03-04T06:54:33.587 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 13 to 306 2024-03-04T06:54:33.587 INFO:tasks.rados.rados.0.smithi137.stdout:3828: delete oid 43 current snap is 361 2024-03-04T06:54:33.587 INFO:tasks.rados.rados.0.smithi137.stdout:3818: finishing write tid 2 to smithi13777483-10 2024-03-04T06:54:33.587 INFO:tasks.rados.rados.0.smithi137.stdout:3818: finishing write tid 3 to smithi13777483-10 2024-03-04T06:54:33.587 INFO:tasks.rados.rados.0.smithi137.stdout:3818: oid 10 updating version 0 to 17016 2024-03-04T06:54:33.587 INFO:tasks.rados.rados.0.smithi137.stdout:3818: oid 10 updating version 17016 to 17017 2024-03-04T06:54:33.587 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 17017 (ObjNum 1190 snap 361 seq_num 1190) dirty exists 2024-03-04T06:54:33.587 INFO:tasks.rados.rados.0.smithi137.stdout:3818: left oid 10 (ObjNum 1190 snap 361 seq_num 1190) 2024-03-04T06:54:33.587 INFO:tasks.rados.rados.0.smithi137.stdout:3819: finishing copy_from racing read to smithi13777483-24 2024-03-04T06:54:33.587 INFO:tasks.rados.rados.0.smithi137.stdout:3819: finishing copy_from to smithi13777483-24 2024-03-04T06:54:33.587 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16985 (ObjNum 1187 snap 360 seq_num 1187) dirty exists 2024-03-04T06:54:33.587 INFO:tasks.rados.rados.0.smithi137.stdout:3821: finishing rollback tid 0 to smithi13777483-6 2024-03-04T06:54:33.587 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 16952 (ObjNum 1170 snap 358 seq_num 1170) dirty exists 2024-03-04T06:54:33.588 INFO:tasks.rados.rados.0.smithi137.stdout:3821: finishing rollback tid 1 to smithi13777483-6 2024-03-04T06:54:33.588 INFO:tasks.rados.rados.0.smithi137.stdout:3821: finishing rollback tid 2 to smithi13777483-6 2024-03-04T06:54:33.588 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 17000 (ObjNum 1099 snap 326 seq_num 1099) dirty exists 2024-03-04T06:54:33.592 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:33.580+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:33.593 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:33.580+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:33.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-mon[85573]: pgmap v865: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 878 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 0 B/s rd, 770 KiB/s wr, 1 op/s 2024-03-04T06:54:33.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:33.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:33.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:33.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-mon[85573]: osdmap e788: 8 total, 8 up, 8 in 2024-03-04T06:54:33.593 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:33.594 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:33.594 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:33.594 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:33.594 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:33.594 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:33.594 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:33.594 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:33.338+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:33.594 INFO:tasks.rados.rados.0.smithi137.stdout:3827: finishing rollback tid 0 to smithi13777483-13 2024-03-04T06:54:33.596 INFO:tasks.rados.rados.0.smithi137.stdout:3827: finishing rollback tid 1 to smithi13777483-13 2024-03-04T06:54:33.597 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 17030 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-04T06:54:33.597 INFO:tasks.rados.rados.0.smithi137.stdout:3818: done (7 left) 2024-03-04T06:54:33.597 INFO:tasks.rados.rados.0.smithi137.stdout:3819: done (6 left) 2024-03-04T06:54:33.597 INFO:tasks.rados.rados.0.smithi137.stdout:3821: done (5 left) 2024-03-04T06:54:33.597 INFO:tasks.rados.rados.0.smithi137.stdout:3822: done (4 left) 2024-03-04T06:54:33.597 INFO:tasks.rados.rados.0.smithi137.stdout:3827: done (3 left) 2024-03-04T06:54:33.597 INFO:tasks.rados.rados.0.smithi137.stdout:3828: done (2 left) 2024-03-04T06:54:33.597 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 15 current snap is 361 2024-03-04T06:54:33.597 INFO:tasks.rados.rados.0.smithi137.stdout:3829: seq_num 1193 ranges {4390912=786432} 2024-03-04T06:54:33.627 INFO:tasks.rados.rados.0.smithi137.stdout:3829: writing smithi13777483-15 from 4390912 to 5177344 tid 1 2024-03-04T06:54:33.627 INFO:tasks.rados.rados.0.smithi137.stdout:3830: snap_create 2024-03-04T06:54:33.627 INFO:tasks.rados.rados.0.smithi137.stdout:3825: finishing write tid 1 to smithi13777483-35 2024-03-04T06:54:33.627 INFO:tasks.rados.rados.0.smithi137.stdout:3825: finishing write tid 2 to smithi13777483-35 2024-03-04T06:54:33.627 INFO:tasks.rados.rados.0.smithi137.stdout:3825: finishing write tid 3 to smithi13777483-35 2024-03-04T06:54:33.627 INFO:tasks.rados.rados.0.smithi137.stdout:3825: oid 35 updating version 0 to 16972 2024-03-04T06:54:33.627 INFO:tasks.rados.rados.0.smithi137.stdout:3825: oid 35 updating version 16972 to 16973 2024-03-04T06:54:33.627 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16973 (ObjNum 1191 snap 361 seq_num 1191) dirty exists 2024-03-04T06:54:33.627 INFO:tasks.rados.rados.0.smithi137.stdout:3825: left oid 35 (ObjNum 1191 snap 361 seq_num 1191) 2024-03-04T06:54:33.628 INFO:tasks.rados.rados.0.smithi137.stdout:3826: expect (ObjNum 982 snap 287 seq_num 982) 2024-03-04T06:54:33.783 INFO:tasks.rados.rados.0.smithi137.stdout:3829: finishing write tid 1 to smithi13777483-15 2024-03-04T06:54:33.783 INFO:tasks.rados.rados.0.smithi137.stdout:3829: finishing write tid 2 to smithi13777483-15 2024-03-04T06:54:33.783 INFO:tasks.rados.rados.0.smithi137.stdout:3829: finishing write tid 3 to smithi13777483-15 2024-03-04T06:54:33.783 INFO:tasks.rados.rados.0.smithi137.stdout:3829: oid 15 updating version 0 to 17002 2024-03-04T06:54:33.783 INFO:tasks.rados.rados.0.smithi137.stdout:3829: oid 15 version 17002 is already newer than 17001 2024-03-04T06:54:33.783 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 17002 (ObjNum 1193 snap 361 seq_num 1193) dirty exists 2024-03-04T06:54:33.783 INFO:tasks.rados.rados.0.smithi137.stdout:3829: left oid 15 (ObjNum 1193 snap 361 seq_num 1193) 2024-03-04T06:54:33.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:33.611+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:33.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:33.592+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:33.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:33.592+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:33.846 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:33.596+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:33.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:33.599+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:33.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:33 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:33.599+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:34.042 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:33.590+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:34.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:33.584+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:34.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:33.587+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:34.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:33.587+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:34.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:33.588+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:34.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[91314]: pgmap v865: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 878 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 0 B/s rd, 770 KiB/s wr, 1 op/s 2024-03-04T06:54:34.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:34.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:34.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:34.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[91314]: osdmap e788: 8 total, 8 up, 8 in 2024-03-04T06:54:34.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:34.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:34.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:34.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:34.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:34.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:34.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:34.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[88869]: pgmap v865: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 878 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 0 B/s rd, 770 KiB/s wr, 1 op/s 2024-03-04T06:54:34.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:34.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:34.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:34.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[88869]: osdmap e788: 8 total, 8 up, 8 in 2024-03-04T06:54:34.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:34.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:34.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:34.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:34.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:34.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:34.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:33 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:34.602 INFO:tasks.rados.rados.0.smithi137.stdout:3825: done (3 left) 2024-03-04T06:54:34.602 INFO:tasks.rados.rados.0.smithi137.stdout:3826: done (2 left) 2024-03-04T06:54:34.602 INFO:tasks.rados.rados.0.smithi137.stdout:3829: done (1 left) 2024-03-04T06:54:34.602 INFO:tasks.rados.rados.0.smithi137.stdout:3830: done (0 left) 2024-03-04T06:54:34.602 INFO:tasks.rados.rados.0.smithi137.stdout:3831: snap_remove snap 355 2024-03-04T06:54:34.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:34 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:34.596+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:34 smithi203 ceph-mon[85573]: osdmap e789: 8 total, 8 up, 8 in 2024-03-04T06:54:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:34 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:34.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:34 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:34.983 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:34.601+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:34.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[88869]: osdmap e789: 8 total, 8 up, 8 in 2024-03-04T06:54:34.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:34.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:34.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:34.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:34.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:34.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:34.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:34.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:34.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:34.984 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:34.985 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[91314]: osdmap e789: 8 total, 8 up, 8 in 2024-03-04T06:54:34.985 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:34.985 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:34.985 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:34.985 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:34.985 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:34.985 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:34.985 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:34.985 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:34.985 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:34.985 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:35.292 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:34.983+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:35.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:35.010+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:35.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:35.010+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:35.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:35.013+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:35.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:35.012+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:35.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:35.012+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:35.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:35.012+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:35.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:35.011+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:35.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:35.012+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:35.601 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:54:35] "GET /metrics HTTP/1.1" 200 36342 "" "Prometheus/2.43.0" 2024-03-04T06:54:35.603 INFO:tasks.rados.rados.0.smithi137.stdout:3831: done (0 left) 2024-03-04T06:54:35.604 INFO:tasks.rados.rados.0.smithi137.stdout:3832: copy_from oid 10 from oid 17 current snap is 362 2024-03-04T06:54:35.604 INFO:tasks.rados.rados.0.smithi137.stdout:3833: read oid 42 snap -1 2024-03-04T06:54:35.604 INFO:tasks.rados.rados.0.smithi137.stdout:3833: expect (ObjNum 1173 snap 358 seq_num 1173) 2024-03-04T06:54:35.604 INFO:tasks.rados.rados.0.smithi137.stdout:3834: copy_from oid 5 from oid 9 current snap is 362 2024-03-04T06:54:35.604 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 50 current snap is 362 2024-03-04T06:54:35.604 INFO:tasks.rados.rados.0.smithi137.stdout:3835: seq_num 1194 ranges {385024=802816} 2024-03-04T06:54:35.611 INFO:tasks.rados.rados.0.smithi137.stdout:3835: writing smithi13777483-50 from 385024 to 1187840 tid 1 2024-03-04T06:54:35.612 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 362 2024-03-04T06:54:35.612 INFO:tasks.rados.rados.0.smithi137.stdout:3836: seq_num 1195 ranges {0=417792,417792=401408} 2024-03-04T06:54:35.615 INFO:tasks.rados.rados.0.smithi137.stdout:3836: writing smithi13777483-4 from 0 to 417792 tid 1 2024-03-04T06:54:35.618 INFO:tasks.rados.rados.0.smithi137.stdout:3836: writing smithi13777483-4 from 417792 to 819200 tid 2 2024-03-04T06:54:35.618 INFO:tasks.rados.rados.0.smithi137.stdout:3837: copy_from oid 39 from oid 44 current snap is 362 2024-03-04T06:54:35.618 INFO:tasks.rados.rados.0.smithi137.stdout:3838: snap_remove snap 361 2024-03-04T06:54:36.042 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:35.601+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:36.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:35.618+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:36.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:35.616+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:36.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:35.616+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:36.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:35.617+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:36.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[91314]: pgmap v868: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 908 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 6.8 MiB/s wr, 14 op/s 2024-03-04T06:54:36.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:36.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:36.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[91314]: osdmap e790: 8 total, 8 up, 8 in 2024-03-04T06:54:36.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:36.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:36.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:36.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:36.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:36.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[88869]: pgmap v868: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 908 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 6.8 MiB/s wr, 14 op/s 2024-03-04T06:54:36.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:36.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:36.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[88869]: osdmap e790: 8 total, 8 up, 8 in 2024-03-04T06:54:36.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:36.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:36.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:36.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:36.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:35 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:36.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:35.608+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:36.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:35.597+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:36.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:35.597+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:36.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:35.622+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:36.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:35.622+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:36.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:35.608+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:36.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:35.608+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:36.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:35.608+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:36.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-mon[85573]: pgmap v868: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 908 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 6.8 MiB/s wr, 14 op/s 2024-03-04T06:54:36.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:36.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:36.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-mon[85573]: osdmap e790: 8 total, 8 up, 8 in 2024-03-04T06:54:36.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:36.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:36.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:36.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:36.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:35 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:36.623 INFO:tasks.rados.rados.0.smithi137.stdout:3838: done (6 left) 2024-03-04T06:54:36.623 INFO:tasks.rados.rados.0.smithi137.stdout:3839: copy_from oid 43 from oid 33 current snap is 362 2024-03-04T06:54:36.623 INFO:tasks.rados.rados.0.smithi137.stdout:3836: finishing write tid 1 to smithi13777483-4 2024-03-04T06:54:36.624 INFO:tasks.rados.rados.0.smithi137.stdout:3836: finishing write tid 2 to smithi13777483-4 2024-03-04T06:54:36.624 INFO:tasks.rados.rados.0.smithi137.stdout:3836: finishing write tid 3 to smithi13777483-4 2024-03-04T06:54:36.624 INFO:tasks.rados.rados.0.smithi137.stdout:3836: finishing write tid 4 to smithi13777483-4 2024-03-04T06:54:36.624 INFO:tasks.rados.rados.0.smithi137.stdout:3836: oid 4 updating version 0 to 15534 2024-03-04T06:54:36.624 INFO:tasks.rados.rados.0.smithi137.stdout:3836: oid 4 updating version 15534 to 15535 2024-03-04T06:54:36.624 INFO:tasks.rados.rados.0.smithi137.stdout:3836: oid 4 version 15535 is already newer than 15533 2024-03-04T06:54:36.624 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 15535 (ObjNum 1195 snap 362 seq_num 1195) dirty exists 2024-03-04T06:54:36.624 INFO:tasks.rados.rados.0.smithi137.stdout:3836: left oid 4 (ObjNum 1195 snap 362 seq_num 1195) 2024-03-04T06:54:36.624 INFO:tasks.rados.rados.0.smithi137.stdout:3835: finishing write tid 1 to smithi13777483-50 2024-03-04T06:54:36.624 INFO:tasks.rados.rados.0.smithi137.stdout:3835: finishing write tid 2 to smithi13777483-50 2024-03-04T06:54:36.624 INFO:tasks.rados.rados.0.smithi137.stdout:3833: expect (ObjNum 1173 snap 358 seq_num 1173) 2024-03-04T06:54:36.930 INFO:tasks.rados.rados.0.smithi137.stdout:3835: finishing write tid 3 to smithi13777483-50 2024-03-04T06:54:36.930 INFO:tasks.rados.rados.0.smithi137.stdout:3835: oid 50 updating version 0 to 17031 2024-03-04T06:54:36.930 INFO:tasks.rados.rados.0.smithi137.stdout:3835: oid 50 updating version 17031 to 17032 2024-03-04T06:54:36.930 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 50 v 17032 (ObjNum 1194 snap 362 seq_num 1194) dirty exists 2024-03-04T06:54:36.930 INFO:tasks.rados.rados.0.smithi137.stdout:3835: left oid 50 (ObjNum 1194 snap 362 seq_num 1194) 2024-03-04T06:54:36.930 INFO:tasks.rados.rados.0.smithi137.stdout:3837: finishing copy_from racing read to smithi13777483-39 2024-03-04T06:54:36.930 INFO:tasks.rados.rados.0.smithi137.stdout:3837: finishing copy_from to smithi13777483-39 2024-03-04T06:54:36.930 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 16999 (ObjNum 1188 snap 360 seq_num 1188) dirty exists 2024-03-04T06:54:36.930 INFO:tasks.rados.rados.0.smithi137.stdout:3834: finishing copy_from racing read to smithi13777483-5 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:3834: finishing copy_from to smithi13777483-5 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 5 v 16977 (ObjNum 931 snap 275 seq_num 931) dirty exists 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:3832: finishing copy_from racing read to smithi13777483-10 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:3832: finishing copy_from to smithi13777483-10 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 16977 (ObjNum 1185 snap 360 seq_num 1185) dirty exists 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:3832: done (6 left) 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:3833: done (5 left) 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:3834: done (4 left) 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:3835: done (3 left) 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:3836: done (2 left) 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:3837: done (1 left) 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:3840: setattr oid 9 current snap is 362 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:3839: finishing copy_from racing read to smithi13777483-43 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:3839: finishing copy_from to smithi13777483-43 2024-03-04T06:54:36.931 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 43 v 16951 (ObjNum 1170 snap 358 seq_num 1170) dirty exists 2024-03-04T06:54:36.932 INFO:tasks.rados.rados.0.smithi137.stdout:3839: done (1 left) 2024-03-04T06:54:36.932 INFO:tasks.rados.rados.0.smithi137.stdout:3841: rmattr oid 19 current snap is 362 2024-03-04T06:54:36.932 INFO:tasks.rados.rados.0.smithi137.stdout:3841: done (1 left) 2024-03-04T06:54:36.932 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 42 current snap is 362 2024-03-04T06:54:36.932 INFO:tasks.rados.rados.0.smithi137.stdout:3842: seq_num 1196 ranges {4841472=434176,5275648=401408} 2024-03-04T06:54:36.959 INFO:tasks.rados.rados.0.smithi137.stdout:3842: writing smithi13777483-42 from 4841472 to 5275648 tid 1 2024-03-04T06:54:36.961 INFO:tasks.rados.rados.0.smithi137.stdout:3842: writing smithi13777483-42 from 5275648 to 5677056 tid 2 2024-03-04T06:54:36.962 INFO:tasks.rados.rados.0.smithi137.stdout:3843: rollback oid 3 current snap is 362 2024-03-04T06:54:36.962 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 3 to 350 2024-03-04T06:54:36.962 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 17018 (ObjNum 931 snap 275 seq_num 931) dirty exists 2024-03-04T06:54:36.962 INFO:tasks.rados.rados.0.smithi137.stdout:3840: done (2 left) 2024-03-04T06:54:36.962 INFO:tasks.rados.rados.0.smithi137.stdout:3844: snap_create 2024-03-04T06:54:36.967 INFO:tasks.rados.rados.0.smithi137.stdout:3843: finishing rollback tid 0 to smithi13777483-3 2024-03-04T06:54:36.968 INFO:tasks.rados.rados.0.smithi137.stdout:3842: finishing write tid 1 to smithi13777483-42 2024-03-04T06:54:36.968 INFO:tasks.rados.rados.0.smithi137.stdout:3843: finishing rollback tid 1 to smithi13777483-3 2024-03-04T06:54:36.968 INFO:tasks.rados.rados.0.smithi137.stdout:3842: finishing write tid 2 to smithi13777483-42 2024-03-04T06:54:36.968 INFO:tasks.rados.rados.0.smithi137.stdout:3843: finishing rollback tid 2 to smithi13777483-3 2024-03-04T06:54:36.968 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 17021 (ObjNum 1122 snap 339 seq_num 1122) dirty exists 2024-03-04T06:54:36.968 INFO:tasks.rados.rados.0.smithi137.stdout:3842: finishing write tid 3 to smithi13777483-42 2024-03-04T06:54:36.970 INFO:tasks.rados.rados.0.smithi137.stdout:3842: finishing write tid 4 to smithi13777483-42 2024-03-04T06:54:36.970 INFO:tasks.rados.rados.0.smithi137.stdout:3842: oid 42 updating version 0 to 17033 2024-03-04T06:54:36.970 INFO:tasks.rados.rados.0.smithi137.stdout:3842: oid 42 updating version 17033 to 17034 2024-03-04T06:54:36.970 INFO:tasks.rados.rados.0.smithi137.stdout:3842: oid 42 updating version 17034 to 17035 2024-03-04T06:54:36.970 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 42 v 17035 (ObjNum 1196 snap 362 seq_num 1196) dirty exists 2024-03-04T06:54:36.970 INFO:tasks.rados.rados.0.smithi137.stdout:3842: left oid 42 (ObjNum 1196 snap 362 seq_num 1196) 2024-03-04T06:54:37.042 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:36.623+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:37.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:36.620+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:37.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:36.623+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:37.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:36.640+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:37.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:37.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: osdmap e791: 8 total, 8 up, 8 in 2024-03-04T06:54:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:37.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: osdmap e791: 8 total, 8 up, 8 in 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:37.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:36 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:37.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:36.624+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:37.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:36.618+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:37.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:36.630+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:37.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:36.630+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:37.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:36.627+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:37.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:36.627+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:37.097 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:36.627+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: osdmap e791: 8 total, 8 up, 8 in 2024-03-04T06:54:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:37.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:37.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:37.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:37.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:37.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:36 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:37.621 INFO:tasks.rados.rados.0.smithi137.stdout:3842: done (2 left) 2024-03-04T06:54:37.621 INFO:tasks.rados.rados.0.smithi137.stdout:3843: done (1 left) 2024-03-04T06:54:37.621 INFO:tasks.rados.rados.0.smithi137.stdout:3844: done (0 left) 2024-03-04T06:54:37.621 INFO:tasks.rados.rados.0.smithi137.stdout:3845: snap_create 2024-03-04T06:54:38.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:37.783+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:38.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:37.784+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:38.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:37.784+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:38.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:37.620+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:38.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:37.783+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[88869]: pgmap v871: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 909 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 6.9 MiB/s wr, 15 op/s 2024-03-04T06:54:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[88869]: osdmap e792: 8 total, 8 up, 8 in 2024-03-04T06:54:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:38.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:38.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:38.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:38.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[91314]: pgmap v871: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 909 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 6.9 MiB/s wr, 15 op/s 2024-03-04T06:54:38.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:38.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[91314]: osdmap e792: 8 total, 8 up, 8 in 2024-03-04T06:54:38.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:38.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:38.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:38.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:38.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:38.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:38.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:38.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:38.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:37 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:38.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:37.787+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:38.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:37.622+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:38.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:37.622+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:38.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:37.787+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:38.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:37.787+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:38.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:37.785+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:38.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:37.785+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:38.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:37.786+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:38.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-mon[85573]: pgmap v871: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 909 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 13 MiB/s rd, 6.9 MiB/s wr, 15 op/s 2024-03-04T06:54:38.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:38.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-mon[85573]: osdmap e792: 8 total, 8 up, 8 in 2024-03-04T06:54:38.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:38.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:38.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:38.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:38.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:38.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:38.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:38.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:38.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:37 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:38.623 INFO:tasks.rados.rados.0.smithi137.stdout:3845: done (0 left) 2024-03-04T06:54:38.623 INFO:tasks.rados.rados.0.smithi137.stdout:3846: setattr oid 45 current snap is 364 2024-03-04T06:54:38.624 INFO:tasks.rados.rados.0.smithi137.stdout:3847: copy_from oid 13 from oid 16 current snap is 364 2024-03-04T06:54:38.624 INFO:tasks.rados.rados.0.smithi137.stdout:3848: snap_remove snap 347 2024-03-04T06:54:39.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:38.634+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:39.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:38.635+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:39.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:38.622+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:39.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:38.647+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:39.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[88869]: osdmap e793: 8 total, 8 up, 8 in 2024-03-04T06:54:39.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:39.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:39.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:39.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:39.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:39.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:39.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:39.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:39.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:54:39.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[88869]: osdmap e794: 8 total, 8 up, 8 in 2024-03-04T06:54:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[91314]: osdmap e793: 8 total, 8 up, 8 in 2024-03-04T06:54:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:54:39.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:38 smithi137 ceph-mon[91314]: osdmap e794: 8 total, 8 up, 8 in 2024-03-04T06:54:39.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:38.796+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:39.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:38.622+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:39.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:38.630+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:39.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:38.632+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:39.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:38.796+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:39.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:38.796+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:39.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:38.796+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:39.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-mon[85573]: osdmap e793: 8 total, 8 up, 8 in 2024-03-04T06:54:39.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:39.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:39.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:39.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:39.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:39.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:39.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:39.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:39.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:54:39.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:38 smithi203 ceph-mon[85573]: osdmap e794: 8 total, 8 up, 8 in 2024-03-04T06:54:39.632 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 45 v 16978 (ObjNum 1174 snap 358 seq_num 1174) dirty exists 2024-03-04T06:54:39.633 INFO:tasks.rados.rados.0.smithi137.stdout:3847: finishing copy_from racing read to smithi13777483-13 2024-03-04T06:54:39.633 INFO:tasks.rados.rados.0.smithi137.stdout:3847: finishing copy_from to smithi13777483-13 2024-03-04T06:54:39.633 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 13 v 16927 (ObjNum 1089 snap 325 seq_num 1089) dirty exists 2024-03-04T06:54:39.633 INFO:tasks.rados.rados.0.smithi137.stdout:3846: done (2 left) 2024-03-04T06:54:39.633 INFO:tasks.rados.rados.0.smithi137.stdout:3847: done (1 left) 2024-03-04T06:54:39.633 INFO:tasks.rados.rados.0.smithi137.stdout:3848: done (0 left) 2024-03-04T06:54:39.633 INFO:tasks.rados.rados.0.smithi137.stdout:3849: snap_remove snap 326 2024-03-04T06:54:40.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:39.630+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:40.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:39.636+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:40.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:39.637+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:40.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:39.638+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:40.044 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:39.636+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:40.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:40.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:40.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[91314]: pgmap v874: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 939 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 6.7 MiB/s rd, 8.0 MiB/s wr, 14 op/s 2024-03-04T06:54:40.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:40.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:40.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:40.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:40.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:40.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:40.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:40.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:40.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:40.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:40.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:40.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:40.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[88869]: pgmap v874: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 939 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 6.7 MiB/s rd, 8.0 MiB/s wr, 14 op/s 2024-03-04T06:54:40.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:40.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:40.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:40.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:40.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:40.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:40.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:40.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:40.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:40.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:39 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:40.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:39.645+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:40.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:39.630+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:40.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:39.630+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:40.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:39.645+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:40.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:39.645+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:40.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:39.645+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:40.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:40.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:40.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-mon[85573]: pgmap v874: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 939 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 6.7 MiB/s rd, 8.0 MiB/s wr, 14 op/s 2024-03-04T06:54:40.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:40.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:40.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:40.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:40.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:40.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:40.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:40.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:40.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:40.098 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:39 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:40.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:40.161+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:40.596 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:40.161+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:40.631 INFO:tasks.rados.rados.0.smithi137.stdout:3849: done (0 left) 2024-03-04T06:54:40.631 INFO:tasks.rados.rados.0.smithi137.stdout:3850: delete oid 26 current snap is 364 2024-03-04T06:54:40.642 INFO:tasks.rados.rados.0.smithi137.stdout:3850: done (0 left) 2024-03-04T06:54:40.642 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 364 2024-03-04T06:54:40.642 INFO:tasks.rados.rados.0.smithi137.stdout:3851: seq_num 1198 ranges {1368064=466944,1835008=401408} 2024-03-04T06:54:40.653 INFO:tasks.rados.rados.0.smithi137.stdout:3851: writing smithi13777483-12 from 1368064 to 1835008 tid 1 2024-03-04T06:54:40.656 INFO:tasks.rados.rados.0.smithi137.stdout:3851: writing smithi13777483-12 from 1835008 to 2236416 tid 2 2024-03-04T06:54:40.656 INFO:tasks.rados.rados.0.smithi137.stdout:3852: copy_from oid 9 from oid 13 current snap is 364 2024-03-04T06:54:40.656 INFO:tasks.rados.rados.0.smithi137.stdout:3853: read oid 27 snap -1 2024-03-04T06:54:40.656 INFO:tasks.rados.rados.0.smithi137.stdout:3853: expect (ObjNum 1099 snap 326 seq_num 1099) 2024-03-04T06:54:40.657 INFO:tasks.rados.rados.0.smithi137.stdout:3854: rmattr oid 36 current snap is 364 2024-03-04T06:54:40.657 INFO:tasks.rados.rados.0.smithi137.stdout:3854: done (3 left) 2024-03-04T06:54:40.657 INFO:tasks.rados.rados.0.smithi137.stdout:3855: setattr oid 35 current snap is 364 2024-03-04T06:54:40.658 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 364 2024-03-04T06:54:40.658 INFO:tasks.rados.rados.0.smithi137.stdout:3856: seq_num 1199 ranges {0=483328,483328=401408} 2024-03-04T06:54:40.661 INFO:tasks.rados.rados.0.smithi137.stdout:3856: writing smithi13777483-1 from 0 to 483328 tid 1 2024-03-04T06:54:40.665 INFO:tasks.rados.rados.0.smithi137.stdout:3856: writing smithi13777483-1 from 483328 to 884736 tid 2 2024-03-04T06:54:40.665 INFO:tasks.rados.rados.0.smithi137.stdout:3857: read oid 17 snap -1 2024-03-04T06:54:40.665 INFO:tasks.rados.rados.0.smithi137.stdout:3857: expect (ObjNum 1185 snap 360 seq_num 1185) 2024-03-04T06:54:40.665 INFO:tasks.rados.rados.0.smithi137.stdout:3858: read oid 47 snap -1 2024-03-04T06:54:40.665 INFO:tasks.rados.rados.0.smithi137.stdout:3858: expect (ObjNum 1179 snap 359 seq_num 1179) 2024-03-04T06:54:40.665 INFO:tasks.rados.rados.0.smithi137.stdout:3859: copy_from oid 21 from oid 16 current snap is 364 2024-03-04T06:54:40.666 INFO:tasks.rados.rados.0.smithi137.stdout:3860: read oid 7 snap -1 2024-03-04T06:54:40.666 INFO:tasks.rados.rados.0.smithi137.stdout:3860: expect deleted 2024-03-04T06:54:40.666 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 33 current snap is 364 2024-03-04T06:54:40.666 INFO:tasks.rados.rados.0.smithi137.stdout:3851: finishing write tid 1 to smithi13777483-12 2024-03-04T06:54:40.666 INFO:tasks.rados.rados.0.smithi137.stdout:3851: finishing write tid 2 to smithi13777483-12 2024-03-04T06:54:40.666 INFO:tasks.rados.rados.0.smithi137.stdout:3851: finishing write tid 3 to smithi13777483-12 2024-03-04T06:54:40.666 INFO:tasks.rados.rados.0.smithi137.stdout:3861: seq_num 1200 ranges {3153920=499712,3653632=401408} 2024-03-04T06:54:40.686 INFO:tasks.rados.rados.0.smithi137.stdout:3861: writing smithi13777483-33 from 3153920 to 3653632 tid 1 2024-03-04T06:54:40.689 INFO:tasks.rados.rados.0.smithi137.stdout:3861: writing smithi13777483-33 from 3653632 to 4055040 tid 2 2024-03-04T06:54:40.690 INFO:tasks.rados.rados.0.smithi137.stdout:3862: read oid 29 snap -1 2024-03-04T06:54:40.690 INFO:tasks.rados.rados.0.smithi137.stdout:3862: expect (ObjNum 1162 snap 356 seq_num 1162) 2024-03-04T06:54:40.690 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 364 2024-03-04T06:54:40.690 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16974 (ObjNum 1191 snap 361 seq_num 1191) dirty exists 2024-03-04T06:54:40.690 INFO:tasks.rados.rados.0.smithi137.stdout:3851: finishing write tid 4 to smithi13777483-12 2024-03-04T06:54:40.690 INFO:tasks.rados.rados.0.smithi137.stdout:3851: oid 12 updating version 0 to 16980 2024-03-04T06:54:40.690 INFO:tasks.rados.rados.0.smithi137.stdout:3851: oid 12 version 16980 is already newer than 16978 2024-03-04T06:54:40.690 INFO:tasks.rados.rados.0.smithi137.stdout:3851: oid 12 version 16980 is already newer than 16979 2024-03-04T06:54:40.690 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16980 (ObjNum 1198 snap 364 seq_num 1198) dirty exists 2024-03-04T06:54:40.691 INFO:tasks.rados.rados.0.smithi137.stdout:3851: left oid 12 (ObjNum 1198 snap 364 seq_num 1198) 2024-03-04T06:54:40.691 INFO:tasks.rados.rados.0.smithi137.stdout:3863: seq_num 1201 ranges {0=524288,524288=401408} 2024-03-04T06:54:40.692 INFO:tasks.rados.rados.0.smithi137.stdout:3863: writing smithi13777483-2 from 0 to 524288 tid 1 2024-03-04T06:54:40.696 INFO:tasks.rados.rados.0.smithi137.stdout:3863: writing smithi13777483-2 from 524288 to 925696 tid 2 2024-03-04T06:54:40.696 INFO:tasks.rados.rados.0.smithi137.stdout:3851: done (11 left) 2024-03-04T06:54:40.696 INFO:tasks.rados.rados.0.smithi137.stdout:3855: done (10 left) 2024-03-04T06:54:40.696 INFO:tasks.rados.rados.0.smithi137.stdout:3864: rollback oid 35 current snap is 364 2024-03-04T06:54:40.696 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 35 to 363 2024-03-04T06:54:40.696 INFO:tasks.rados.rados.0.smithi137.stdout:3865: read oid 14 snap -1 2024-03-04T06:54:40.696 INFO:tasks.rados.rados.0.smithi137.stdout:3865: expect (ObjNum 1161 snap 354 seq_num 1161) 2024-03-04T06:54:40.696 INFO:tasks.rados.rados.0.smithi137.stdout:3866: read oid 42 snap -1 2024-03-04T06:54:40.697 INFO:tasks.rados.rados.0.smithi137.stdout:3866: expect (ObjNum 1196 snap 362 seq_num 1196) 2024-03-04T06:54:40.697 INFO:tasks.rados.rados.0.smithi137.stdout:3867: snap_remove snap 328 2024-03-04T06:54:41.042 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:40.639+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:41.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:40.634+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:41.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:40.635+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:41.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:40.639+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:41.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:41.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[88869]: osdmap e795: 8 total, 8 up, 8 in 2024-03-04T06:54:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:41.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[88869]: osdmap e796: 8 total, 8 up, 8 in 2024-03-04T06:54:41.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[91314]: osdmap e795: 8 total, 8 up, 8 in 2024-03-04T06:54:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:41.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:40 smithi137 ceph-mon[91314]: osdmap e796: 8 total, 8 up, 8 in 2024-03-04T06:54:41.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:40.662+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:41.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:40.640+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:41.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:40.640+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:41.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:40.641+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:41.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:40.631+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:41.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:40.631+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:41.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:40.632+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:41.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:41.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:41.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-mon[85573]: osdmap e795: 8 total, 8 up, 8 in 2024-03-04T06:54:41.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:41.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:41.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:41.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:41.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:41.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:41.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:41.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:41.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:40 smithi203 ceph-mon[85573]: osdmap e796: 8 total, 8 up, 8 in 2024-03-04T06:54:41.657 INFO:tasks.rados.rados.0.smithi137.stdout:3856: finishing write tid 1 to smithi13777483-1 2024-03-04T06:54:41.657 INFO:tasks.rados.rados.0.smithi137.stdout:3856: finishing write tid 2 to smithi13777483-1 2024-03-04T06:54:41.657 INFO:tasks.rados.rados.0.smithi137.stdout:3856: finishing write tid 3 to smithi13777483-1 2024-03-04T06:54:41.657 INFO:tasks.rados.rados.0.smithi137.stdout:3858: expect (ObjNum 1179 snap 359 seq_num 1179) 2024-03-04T06:54:41.698 INFO:tasks.rados.rados.0.smithi137.stdout:3856: finishing write tid 4 to smithi13777483-1 2024-03-04T06:54:41.698 INFO:tasks.rados.rados.0.smithi137.stdout:3856: oid 1 updating version 0 to 16954 2024-03-04T06:54:41.698 INFO:tasks.rados.rados.0.smithi137.stdout:3856: oid 1 version 16954 is already newer than 16953 2024-03-04T06:54:41.698 INFO:tasks.rados.rados.0.smithi137.stdout:3856: oid 1 updating version 16954 to 16955 2024-03-04T06:54:41.699 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 16955 (ObjNum 1199 snap 364 seq_num 1199) dirty exists 2024-03-04T06:54:41.699 INFO:tasks.rados.rados.0.smithi137.stdout:3856: left oid 1 (ObjNum 1199 snap 364 seq_num 1199) 2024-03-04T06:54:41.699 INFO:tasks.rados.rados.0.smithi137.stdout:3853: expect (ObjNum 1099 snap 326 seq_num 1099) 2024-03-04T06:54:41.790 INFO:tasks.rados.rados.0.smithi137.stdout:3859: finishing copy_from racing read to smithi13777483-21 2024-03-04T06:54:41.790 INFO:tasks.rados.rados.0.smithi137.stdout:3852: finishing copy_from racing read to smithi13777483-9 2024-03-04T06:54:41.790 INFO:tasks.rados.rados.0.smithi137.stdout:3861: finishing write tid 1 to smithi13777483-33 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:3859: finishing copy_from to smithi13777483-21 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 16927 (ObjNum 1089 snap 325 seq_num 1089) dirty exists 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:3863: finishing write tid 1 to smithi13777483-2 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:3863: finishing write tid 2 to smithi13777483-2 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:3863: finishing write tid 3 to smithi13777483-2 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:3861: finishing write tid 2 to smithi13777483-33 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:3861: finishing write tid 3 to smithi13777483-33 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:3853: done (13 left) 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:3856: done (12 left) 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:3858: done (11 left) 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:3859: done (10 left) 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:3860: done (9 left) 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:3867: done (8 left) 2024-03-04T06:54:41.791 INFO:tasks.rados.rados.0.smithi137.stdout:3868: copy_from oid 47 from oid 49 current snap is 364 2024-03-04T06:54:41.792 INFO:tasks.rados.rados.0.smithi137.stdout:3864: finishing rollback tid 0 to smithi13777483-35 2024-03-04T06:54:41.792 INFO:tasks.rados.rados.0.smithi137.stdout:3864: finishing rollback tid 1 to smithi13777483-35 2024-03-04T06:54:41.792 INFO:tasks.rados.rados.0.smithi137.stdout:3862: expect (ObjNum 1162 snap 356 seq_num 1162) 2024-03-04T06:54:42.007 INFO:tasks.rados.rados.0.smithi137.stdout:3863: finishing write tid 4 to smithi13777483-2 2024-03-04T06:54:42.008 INFO:tasks.rados.rados.0.smithi137.stdout:3863: oid 2 updating version 0 to 16957 2024-03-04T06:54:42.008 INFO:tasks.rados.rados.0.smithi137.stdout:3863: oid 2 updating version 16957 to 16958 2024-03-04T06:54:42.008 INFO:tasks.rados.rados.0.smithi137.stdout:3863: oid 2 version 16958 is already newer than 16956 2024-03-04T06:54:42.008 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16958 (ObjNum 1201 snap 364 seq_num 1201) dirty exists 2024-03-04T06:54:42.008 INFO:tasks.rados.rados.0.smithi137.stdout:3863: left oid 2 (ObjNum 1201 snap 364 seq_num 1201) 2024-03-04T06:54:42.008 INFO:tasks.rados.rados.0.smithi137.stdout:3864: finishing rollback tid 2 to smithi13777483-35 2024-03-04T06:54:42.008 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16980 (ObjNum 1191 snap 361 seq_num 1191) dirty exists 2024-03-04T06:54:42.008 INFO:tasks.rados.rados.0.smithi137.stdout:3861: finishing write tid 4 to smithi13777483-33 2024-03-04T06:54:42.008 INFO:tasks.rados.rados.0.smithi137.stdout:3861: oid 33 updating version 0 to 16977 2024-03-04T06:54:42.008 INFO:tasks.rados.rados.0.smithi137.stdout:3861: oid 33 version 16977 is already newer than 16976 2024-03-04T06:54:42.008 INFO:tasks.rados.rados.0.smithi137.stdout:3861: oid 33 version 16977 is already newer than 16975 2024-03-04T06:54:42.008 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16977 (ObjNum 1200 snap 364 seq_num 1200) dirty exists 2024-03-04T06:54:42.009 INFO:tasks.rados.rados.0.smithi137.stdout:3861: left oid 33 (ObjNum 1200 snap 364 seq_num 1200) 2024-03-04T06:54:42.009 INFO:tasks.rados.rados.0.smithi137.stdout:3852: finishing copy_from to smithi13777483-9 2024-03-04T06:54:42.009 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 16927 (ObjNum 1089 snap 325 seq_num 1089) dirty exists 2024-03-04T06:54:42.009 INFO:tasks.rados.rados.0.smithi137.stdout:3852: done (8 left) 2024-03-04T06:54:42.009 INFO:tasks.rados.rados.0.smithi137.stdout:3861: done (7 left) 2024-03-04T06:54:42.009 INFO:tasks.rados.rados.0.smithi137.stdout:3862: done (6 left) 2024-03-04T06:54:42.009 INFO:tasks.rados.rados.0.smithi137.stdout:3863: done (5 left) 2024-03-04T06:54:42.009 INFO:tasks.rados.rados.0.smithi137.stdout:3864: done (4 left) 2024-03-04T06:54:42.009 INFO:tasks.rados.rados.0.smithi137.stdout:3869: snap_remove snap 363 2024-03-04T06:54:42.042 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:41.660+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:42.042 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:41.660+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:42.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:41.663+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:42.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:41.660+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:42.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:41.656+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:42.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[91314]: pgmap v877: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 939 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 6.7 MiB/s rd, 7.8 MiB/s wr, 18 op/s 2024-03-04T06:54:42.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:42.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:42.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:42.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:42.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:42.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:42.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:42.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:42.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:42.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:42.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[88869]: pgmap v877: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 939 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 6.7 MiB/s rd, 7.8 MiB/s wr, 18 op/s 2024-03-04T06:54:42.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:42.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:42.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:42.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:42.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:42.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:42.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:42.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:42.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:42.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:41 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:42.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:41.655+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:42.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:41.655+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:42.095 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:41.672+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:42.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:41.672+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:42.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:41.673+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:42.096 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:41.660+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:42.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:41.795+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:42.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:41.795+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:42.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-mon[85573]: pgmap v877: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 939 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 6.7 MiB/s rd, 7.8 MiB/s wr, 18 op/s 2024-03-04T06:54:42.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:42.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:42.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:42.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:42.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:42.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:42.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:42.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:42.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:42.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:41 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:42.662 INFO:tasks.rados.rados.0.smithi137.stdout:3869: done (4 left) 2024-03-04T06:54:42.663 INFO:tasks.rados.rados.0.smithi137.stdout:3870: snap_remove snap 350 2024-03-04T06:54:42.944 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:42.944 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:42.944 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[88869]: osdmap e797: 8 total, 8 up, 8 in 2024-03-04T06:54:42.944 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:42.944 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:42.944 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:42.944 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:42.944 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:42.945 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:42.945 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:42.945 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:42.945 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[91314]: osdmap e797: 8 total, 8 up, 8 in 2024-03-04T06:54:42.945 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:42.945 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:42.945 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:42.945 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:42.945 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:42.945 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:42.946 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:42.670+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:42.946 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:42.660+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:42.946 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:42 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:42.661+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:43.085 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:42.667+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:43.085 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:42.668+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:43.085 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:42.668+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:43.086 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:43.086 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:43.086 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-mon[85573]: osdmap e797: 8 total, 8 up, 8 in 2024-03-04T06:54:43.086 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:43.086 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:43.086 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:43.086 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:43.086 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:43.086 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:43.086 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:42.663+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:43.086 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:42.663+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:43.086 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:42 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:42.663+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:43.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:43.085+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:43.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:43.210+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:43.663 INFO:tasks.rados.rados.0.smithi137.stdout:3870: done (4 left) 2024-03-04T06:54:43.664 INFO:tasks.rados.rados.0.smithi137.stdout:3871: snap_create 2024-03-04T06:54:43.664 INFO:tasks.rados.rados.0.smithi137.stdout:3865: expect (ObjNum 1161 snap 354 seq_num 1161) 2024-03-04T06:54:43.759 INFO:tasks.rados.rados.0.smithi137.stdout:3866: expect (ObjNum 1196 snap 362 seq_num 1196) 2024-03-04T06:54:44.042 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:43.668+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:44.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:43.661+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:44.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:43.670+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:44.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:43.670+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:44.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:43.670+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:44.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:44.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:44.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[88869]: pgmap v880: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 939 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 4 op/s 2024-03-04T06:54:44.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[88869]: osdmap e798: 8 total, 8 up, 8 in 2024-03-04T06:54:44.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:44.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:44.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:44.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:44.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:44.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:44.045 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:44.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:44.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:44.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[91314]: pgmap v880: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 939 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 4 op/s 2024-03-04T06:54:44.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[91314]: osdmap e798: 8 total, 8 up, 8 in 2024-03-04T06:54:44.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:44.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:44.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:44.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:44.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:44.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:44.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:43 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:44.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:44.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:44.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-mon[85573]: pgmap v880: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 939 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 4 op/s 2024-03-04T06:54:44.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-mon[85573]: osdmap e798: 8 total, 8 up, 8 in 2024-03-04T06:54:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:44.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:44.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:43.663+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:44.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:43.663+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:44.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:43.678+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:44.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:43.678+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:44.097 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:43.678+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:44.097 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:43 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:43.674+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:44.163 INFO:tasks.rados.rados.0.smithi137.stdout:3857: expect (ObjNum 1185 snap 360 seq_num 1185) 2024-03-04T06:54:44.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:44.095+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:44.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:44.095+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:45.042 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:44.855+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:45.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:44.663+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:45.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:44.854+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:45.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:44.854+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:45.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: osdmap e799: 8 total, 8 up, 8 in 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:45.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[88869]: osdmap e800: 8 total, 8 up, 8 in 2024-03-04T06:54:45.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:45.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:45.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:45.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:45.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: osdmap e799: 8 total, 8 up, 8 in 2024-03-04T06:54:45.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:45.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:45.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:45.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:45.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:45.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:45.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:45.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:45.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:45.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:44 smithi137 ceph-mon[91314]: osdmap e800: 8 total, 8 up, 8 in 2024-03-04T06:54:45.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:44.857+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:45.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:44.663+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:45.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:44.663+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:45.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:44.663+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:45.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:44.855+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:45.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:44.856+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:45.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:44.856+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:45.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: osdmap e799: 8 total, 8 up, 8 in 2024-03-04T06:54:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:45.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:44 smithi203 ceph-mon[85573]: osdmap e800: 8 total, 8 up, 8 in 2024-03-04T06:54:45.580 INFO:tasks.rados.rados.0.smithi137.stdout:3868: finishing copy_from racing read to smithi13777483-47 2024-03-04T06:54:45.580 INFO:tasks.rados.rados.0.smithi137.stdout:3868: finishing copy_from to smithi13777483-47 2024-03-04T06:54:45.580 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16964 (ObjNum 1077 snap 324 seq_num 1077) dirty exists 2024-03-04T06:54:45.580 INFO:tasks.rados.rados.0.smithi137.stdout:3857: done (4 left) 2024-03-04T06:54:45.580 INFO:tasks.rados.rados.0.smithi137.stdout:3865: done (3 left) 2024-03-04T06:54:45.580 INFO:tasks.rados.rados.0.smithi137.stdout:3866: done (2 left) 2024-03-04T06:54:45.580 INFO:tasks.rados.rados.0.smithi137.stdout:3868: done (1 left) 2024-03-04T06:54:45.580 INFO:tasks.rados.rados.0.smithi137.stdout:3871: done (0 left) 2024-03-04T06:54:45.580 INFO:tasks.rados.rados.0.smithi137.stdout:3872: rollback oid 8 current snap is 365 2024-03-04T06:54:45.580 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 8 to 359 2024-03-04T06:54:45.581 INFO:tasks.rados.rados.0.smithi137.stdout:3873: copy_from oid 25 from oid 38 current snap is 365 2024-03-04T06:54:45.581 INFO:tasks.rados.rados.0.smithi137.stdout:3874: snap_create 2024-03-04T06:54:45.583 INFO:tasks.rados.rados.0.smithi137.stdout:3872: finishing rollback tid 0 to smithi13777483-8 2024-03-04T06:54:45.583 INFO:tasks.rados.rados.0.smithi137.stdout:3872: finishing rollback tid 1 to smithi13777483-8 2024-03-04T06:54:45.583 INFO:tasks.rados.rados.0.smithi137.stdout:3872: finishing rollback tid 2 to smithi13777483-8 2024-03-04T06:54:45.584 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 8 v 17000 (ObjNum 1158 snap 353 seq_num 1158) dirty exists 2024-03-04T06:54:45.588 INFO:tasks.rados.rados.0.smithi137.stdout:3873: finishing copy_from racing read to smithi13777483-25 2024-03-04T06:54:45.589 INFO:tasks.rados.rados.0.smithi137.stdout:3873: finishing copy_from to smithi13777483-25 2024-03-04T06:54:45.589 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 25 v 16971 (ObjNum 1161 snap 354 seq_num 1161) dirty exists 2024-03-04T06:54:45.669 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:54:45] "GET /metrics HTTP/1.1" 200 36342 "" "Prometheus/2.43.0" 2024-03-04T06:54:45.677 INFO:tasks.rados.rados.0.smithi137.stdout:3872: done (2 left) 2024-03-04T06:54:45.677 INFO:tasks.rados.rados.0.smithi137.stdout:3873: done (1 left) 2024-03-04T06:54:45.677 INFO:tasks.rados.rados.0.smithi137.stdout:3874: done (0 left) 2024-03-04T06:54:45.677 INFO:tasks.rados.rados.0.smithi137.stdout:3875: snap_create 2024-03-04T06:54:46.042 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:45.677+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:46.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:45.795+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:46.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:45.795+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:46.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:45.796+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:46.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:45.796+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:46.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[88869]: pgmap v883: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 953 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 20 MiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-03-04T06:54:46.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:46.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:46.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:46.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:46.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:46.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:46.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:46.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:46.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:46.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[91314]: pgmap v883: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 953 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 20 MiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-03-04T06:54:46.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:46.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:46.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:46.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:46.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:46.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:46.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:46.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:46.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:45 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:46.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:45.675+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:46.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:45.675+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:46.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:45.797+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:46.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:45.798+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:46.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:45.798+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:46.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:45.798+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:46.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:45.797+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:46.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:45.797+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-mon[85573]: pgmap v883: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 953 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 20 MiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-03-04T06:54:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:46.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:45 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:46.679 INFO:tasks.rados.rados.0.smithi137.stdout:3875: done (0 left) 2024-03-04T06:54:46.680 INFO:tasks.rados.rados.0.smithi137.stdout:3876: delete oid 3 current snap is 367 2024-03-04T06:54:46.684 INFO:tasks.rados.rados.0.smithi137.stdout:3876: done (0 left) 2024-03-04T06:54:46.685 INFO:tasks.rados.rados.0.smithi137.stdout:3877: setattr oid 11 current snap is 367 2024-03-04T06:54:46.686 INFO:tasks.rados.rados.0.smithi137.stdout:3878: delete oid 10 current snap is 367 2024-03-04T06:54:46.690 INFO:tasks.rados.rados.0.smithi137.stdout:3878: done (1 left) 2024-03-04T06:54:46.691 INFO:tasks.rados.rados.0.smithi137.stdout:3879: read oid 13 snap -1 2024-03-04T06:54:46.691 INFO:tasks.rados.rados.0.smithi137.stdout:3879: expect (ObjNum 1089 snap 325 seq_num 1089) 2024-03-04T06:54:46.691 INFO:tasks.rados.rados.0.smithi137.stdout:3880: delete oid 38 current snap is 367 2024-03-04T06:54:46.691 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 17001 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-03-04T06:54:46.694 INFO:tasks.rados.rados.0.smithi137.stdout:3877: done (2 left) 2024-03-04T06:54:46.694 INFO:tasks.rados.rados.0.smithi137.stdout:3880: done (1 left) 2024-03-04T06:54:46.694 INFO:tasks.rados.rados.0.smithi137.stdout:3881: copy_from oid 2 from oid 36 current snap is 367 2024-03-04T06:54:46.694 INFO:tasks.rados.rados.0.smithi137.stdout:3882: rmattr oid 19 current snap is 367 2024-03-04T06:54:46.694 INFO:tasks.rados.rados.0.smithi137.stdout:3882: done (2 left) 2024-03-04T06:54:46.695 INFO:tasks.rados.rados.0.smithi137.stdout:3883: read oid 3 snap 362 2024-03-04T06:54:46.695 INFO:tasks.rados.rados.0.smithi137.stdout:3883: expect (ObjNum 1122 snap 339 seq_num 1122) 2024-03-04T06:54:46.695 INFO:tasks.rados.rados.0.smithi137.stdout:3884: snap_remove snap 366 2024-03-04T06:54:47.042 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:46.684+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:47.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:46.685+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:47.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:46.679+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:47.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:46.690+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:47.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:47.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:47.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:47.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[88869]: osdmap e801: 8 total, 8 up, 8 in 2024-03-04T06:54:47.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:47.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:47.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:47.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:47.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:47.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:47.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:47.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:47.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:47.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:47.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:47.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[91314]: osdmap e801: 8 total, 8 up, 8 in 2024-03-04T06:54:47.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:47.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:47.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:47.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:47.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:47.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:47.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:47.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:46 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:47.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:46.683+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:47.095 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:46.713+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:47.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:46.713+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:47.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:46.678+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:47.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:46.678+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:47.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:46.678+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:47.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:46.717+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:47.096 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-mon[85573]: osdmap e801: 8 total, 8 up, 8 in 2024-03-04T06:54:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:47.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:46 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:47.694 INFO:tasks.rados.rados.0.smithi137.stdout:3884: done (3 left) 2024-03-04T06:54:47.694 INFO:tasks.rados.rados.0.smithi137.stdout:3885: read oid 24 snap 351 2024-03-04T06:54:47.694 INFO:tasks.rados.rados.0.smithi137.stdout:3885: expect (ObjNum 1138 snap 346 seq_num 1138) 2024-03-04T06:54:47.694 INFO:tasks.rados.rados.0.smithi137.stdout:3886: rollback oid 33 current snap is 367 2024-03-04T06:54:47.695 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 33 to 360 2024-03-04T06:54:47.695 INFO:tasks.rados.rados.0.smithi137.stdout:3879: expect (ObjNum 1089 snap 325 seq_num 1089) 2024-03-04T06:54:47.849 INFO:tasks.rados.rados.0.smithi137.stdout:3883: expect (ObjNum 1122 snap 339 seq_num 1122) 2024-03-04T06:54:47.955 INFO:tasks.rados.rados.0.smithi137.stdout:3881: finishing copy_from racing read to smithi13777483-2 2024-03-04T06:54:47.955 INFO:tasks.rados.rados.0.smithi137.stdout:3881: finishing copy_from to smithi13777483-2 2024-03-04T06:54:47.955 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16900 (ObjNum 1131 snap 343 seq_num 1131) dirty exists 2024-03-04T06:54:47.955 INFO:tasks.rados.rados.0.smithi137.stdout:3886: finishing rollback tid 0 to smithi13777483-33 2024-03-04T06:54:47.955 INFO:tasks.rados.rados.0.smithi137.stdout:3886: finishing rollback tid 1 to smithi13777483-33 2024-03-04T06:54:47.955 INFO:tasks.rados.rados.0.smithi137.stdout:3879: done (4 left) 2024-03-04T06:54:47.955 INFO:tasks.rados.rados.0.smithi137.stdout:3881: done (3 left) 2024-03-04T06:54:47.956 INFO:tasks.rados.rados.0.smithi137.stdout:3883: done (2 left) 2024-03-04T06:54:47.956 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 21 current snap is 367 2024-03-04T06:54:47.956 INFO:tasks.rados.rados.0.smithi137.stdout:3886: finishing rollback tid 2 to smithi13777483-33 2024-03-04T06:54:47.956 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16983 (ObjNum 1170 snap 358 seq_num 1170) dirty exists 2024-03-04T06:54:47.956 INFO:tasks.rados.rados.0.smithi137.stdout:3885: expect (ObjNum 1138 snap 346 seq_num 1138) 2024-03-04T06:54:48.042 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:47.691+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:48.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:47.705+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:48.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:47.697+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:48.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:47.697+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:48.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:47.697+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:48.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[88869]: pgmap v886: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 954 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 20 MiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-03-04T06:54:48.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[88869]: osdmap e802: 8 total, 8 up, 8 in 2024-03-04T06:54:48.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:48.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:48.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:48.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:48.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:48.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:48.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:48.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:48.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:48.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:48.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[91314]: pgmap v886: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 954 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 20 MiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-03-04T06:54:48.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[91314]: osdmap e802: 8 total, 8 up, 8 in 2024-03-04T06:54:48.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:48.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:48.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:48.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:48.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:48.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:48.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:48.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:48.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:48.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:47 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:48.093 INFO:tasks.rados.rados.0.smithi137.stdout:3887: seq_num 1205 ranges {3842048=589824,4431872=401408} 2024-03-04T06:54:48.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:47.696+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:48.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:47.696+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:48.096 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:47.699+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:48.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:47.700+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:48.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:47.701+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:48.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:47.708+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:48.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:47.716+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:48.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:47.716+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:48.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-mon[85573]: pgmap v886: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 954 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 20 MiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-03-04T06:54:48.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-mon[85573]: osdmap e802: 8 total, 8 up, 8 in 2024-03-04T06:54:48.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:48.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:48.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:48.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:48.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:48.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:48.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:48.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:48.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:48.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:47 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:48.116 INFO:tasks.rados.rados.0.smithi137.stdout:3887: writing smithi13777483-21 from 3842048 to 4431872 tid 1 2024-03-04T06:54:48.119 INFO:tasks.rados.rados.0.smithi137.stdout:3887: writing smithi13777483-21 from 4431872 to 4833280 tid 2 2024-03-04T06:54:48.119 INFO:tasks.rados.rados.0.smithi137.stdout:3885: done (2 left) 2024-03-04T06:54:48.119 INFO:tasks.rados.rados.0.smithi137.stdout:3886: done (1 left) 2024-03-04T06:54:48.119 INFO:tasks.rados.rados.0.smithi137.stdout:3888: rmattr oid 40 current snap is 367 2024-03-04T06:54:48.119 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 27 current snap is 367 2024-03-04T06:54:48.119 INFO:tasks.rados.rados.0.smithi137.stdout:3889: seq_num 1206 ranges {2801664=606208,3407872=401408} 2024-03-04T06:54:48.137 INFO:tasks.rados.rados.0.smithi137.stdout:3889: writing smithi13777483-27 from 2801664 to 3407872 tid 1 2024-03-04T06:54:48.139 INFO:tasks.rados.rados.0.smithi137.stdout:3889: writing smithi13777483-27 from 3407872 to 3809280 tid 2 2024-03-04T06:54:48.140 INFO:tasks.rados.rados.0.smithi137.stdout:3890: snap_remove snap 359 2024-03-04T06:54:48.706 INFO:tasks.rados.rados.0.smithi137.stdout:3890: done (3 left) 2024-03-04T06:54:48.706 INFO:tasks.rados.rados.0.smithi137.stdout:3891: delete oid 35 current snap is 367 2024-03-04T06:54:48.706 INFO:tasks.rados.rados.0.smithi137.stdout:3887: finishing write tid 1 to smithi13777483-21 2024-03-04T06:54:48.706 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 40 v 17003 (ObjNum 1107 snap 329 seq_num 1107) dirty exists 2024-03-04T06:54:48.706 INFO:tasks.rados.rados.0.smithi137.stdout:3887: finishing write tid 2 to smithi13777483-21 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:3887: finishing write tid 3 to smithi13777483-21 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:3887: finishing write tid 4 to smithi13777483-21 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:3887: oid 21 updating version 0 to 16986 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:3887: oid 21 updating version 16986 to 16988 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:3887: oid 21 version 16988 is already newer than 16987 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 21 v 16988 (ObjNum 1205 snap 367 seq_num 1205) dirty exists 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:3887: left oid 21 (ObjNum 1205 snap 367 seq_num 1205) 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:3889: finishing write tid 1 to smithi13777483-27 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:3889: finishing write tid 2 to smithi13777483-27 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:3889: finishing write tid 3 to smithi13777483-27 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:3889: finishing write tid 4 to smithi13777483-27 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:3889: oid 27 updating version 0 to 17036 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:3889: oid 27 updating version 17036 to 17037 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:3889: oid 27 updating version 17037 to 17038 2024-03-04T06:54:48.707 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 17038 (ObjNum 1206 snap 367 seq_num 1206) dirty exists 2024-03-04T06:54:48.708 INFO:tasks.rados.rados.0.smithi137.stdout:3889: left oid 27 (ObjNum 1206 snap 367 seq_num 1206) 2024-03-04T06:54:48.718 INFO:tasks.rados.rados.0.smithi137.stdout:3887: done (3 left) 2024-03-04T06:54:48.718 INFO:tasks.rados.rados.0.smithi137.stdout:3888: done (2 left) 2024-03-04T06:54:48.718 INFO:tasks.rados.rados.0.smithi137.stdout:3889: done (1 left) 2024-03-04T06:54:48.718 INFO:tasks.rados.rados.0.smithi137.stdout:3891: done (0 left) 2024-03-04T06:54:48.718 INFO:tasks.rados.rados.0.smithi137.stdout:3892: read oid 29 snap -1 2024-03-04T06:54:48.718 INFO:tasks.rados.rados.0.smithi137.stdout:3892: expect (ObjNum 1162 snap 356 seq_num 1162) 2024-03-04T06:54:48.718 INFO:tasks.rados.rados.0.smithi137.stdout:3893: snap_remove snap 306 2024-03-04T06:54:49.042 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:48.713+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:49.043 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:48.714+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:49.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:48.704+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:49.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:48.715+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:49.043 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:49.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[88869]: osdmap e803: 8 total, 8 up, 8 in 2024-03-04T06:54:49.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:49.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:49.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:49.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:49.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:49.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:49.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:49.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:49.044 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:49.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:49.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[91314]: osdmap e803: 8 total, 8 up, 8 in 2024-03-04T06:54:49.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:49.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:49.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:49.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:49.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:49.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:49.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:49.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:49.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:48 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:49.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:48.711+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:49.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:48.710+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:49.096 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:48.712+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:49.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:48.698+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:49.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:48.698+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:49.096 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:48.698+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:49.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:48.714+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-mon[85573]: osdmap e803: 8 total, 8 up, 8 in 2024-03-04T06:54:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:49.097 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:48 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:49.706 INFO:tasks.rados.rados.0.smithi137.stdout:3893: done (1 left) 2024-03-04T06:54:49.706 INFO:tasks.rados.rados.0.smithi137.stdout:3894: read oid 20 snap -1 2024-03-04T06:54:49.707 INFO:tasks.rados.rados.0.smithi137.stdout:3894: expect (ObjNum 1122 snap 339 seq_num 1122) 2024-03-04T06:54:49.707 INFO:tasks.rados.rados.0.smithi137.stdout:3895: rollback oid 3 current snap is 367 2024-03-04T06:54:49.707 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 3 to 316 2024-03-04T06:54:49.707 INFO:tasks.rados.rados.0.smithi137.stdout:3892: expect (ObjNum 1162 snap 356 seq_num 1162) 2024-03-04T06:54:49.931 INFO:tasks.rados.rados.0.smithi137.stdout:3895: finishing rollback tid 1 to smithi13777483-3 2024-03-04T06:54:49.932 INFO:tasks.rados.rados.0.smithi137.stdout:3895: finishing rollback tid 2 to smithi13777483-3 2024-03-04T06:54:49.932 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 17025 (ObjNum 931 snap 275 seq_num 931) dirty exists 2024-03-04T06:54:49.932 INFO:tasks.rados.rados.0.smithi137.stdout:3894: expect (ObjNum 1122 snap 339 seq_num 1122) 2024-03-04T06:54:50.039 INFO:tasks.rados.rados.0.smithi137.stdout:3892: done (2 left) 2024-03-04T06:54:50.039 INFO:tasks.rados.rados.0.smithi137.stdout:3894: done (1 left) 2024-03-04T06:54:50.039 INFO:tasks.rados.rados.0.smithi137.stdout:3895: done (0 left) 2024-03-04T06:54:50.039 INFO:tasks.rados.rados.0.smithi137.stdout:3896: read oid 1 snap -1 2024-03-04T06:54:50.039 INFO:tasks.rados.rados.0.smithi137.stdout:3896: expect (ObjNum 1199 snap 364 seq_num 1199) 2024-03-04T06:54:50.039 INFO:tasks.rados.rados.0.smithi137.stdout:3897: snap_create 2024-03-04T06:54:50.042 INFO:tasks.rados.rados.0.smithi137.stdout:3896: expect (ObjNum 1199 snap 364 seq_num 1199) 2024-03-04T06:54:50.043 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:49.712+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:50.043 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:49.710+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:50.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:49.712+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:50.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:49.712+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:50.044 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:49.714+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:50.044 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[91314]: pgmap v889: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 963 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 8.1 MiB/s rd, 2.5 MiB/s wr, 13 op/s 2024-03-04T06:54:50.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:50.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:50.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:50.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[91314]: osdmap e804: 8 total, 8 up, 8 in 2024-03-04T06:54:50.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:50.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:50.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:50.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:50.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:50.045 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:50.046 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:50.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[88869]: pgmap v889: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 963 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 8.1 MiB/s rd, 2.5 MiB/s wr, 13 op/s 2024-03-04T06:54:50.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:50.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:50.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:50.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[88869]: osdmap e804: 8 total, 8 up, 8 in 2024-03-04T06:54:50.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:50.046 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:50.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:50.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:50.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:50.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:50.047 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:49 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:50.086 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:49.720+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:50.087 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:49.705+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:50.087 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:49.705+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:50.087 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:49.721+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:50.087 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:49.721+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:50.088 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:49.721+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:50.088 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-mon[85573]: pgmap v889: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 963 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 8.1 MiB/s rd, 2.5 MiB/s wr, 13 op/s 2024-03-04T06:54:50.088 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:50.088 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:50.088 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:50.088 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-mon[85573]: osdmap e804: 8 total, 8 up, 8 in 2024-03-04T06:54:50.088 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:50.089 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:50.089 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:50.089 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:50.089 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:50.089 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:50.089 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:49 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:50.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:50.085+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:50.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:50.085+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:50.959 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-mon[85573]: osdmap e805: 8 total, 8 up, 8 in 2024-03-04T06:54:50.959 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:50.959 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:50.959 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:50.959 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:50.959 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:50.959 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:50.959 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:50.959 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:50.960 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:50.960 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:50.961 INFO:tasks.rados.rados.0.smithi137.stdout:3896: done (1 left) 2024-03-04T06:54:50.961 INFO:tasks.rados.rados.0.smithi137.stdout:3897: done (0 left) 2024-03-04T06:54:50.961 INFO:tasks.rados.rados.0.smithi137.stdout:3898: read oid 39 snap -1 2024-03-04T06:54:50.961 INFO:tasks.rados.rados.0.smithi137.stdout:3898: expect (ObjNum 1188 snap 360 seq_num 1188) 2024-03-04T06:54:50.961 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 368 2024-03-04T06:54:50.961 INFO:tasks.rados.rados.0.smithi137.stdout:3899: seq_num 1208 ranges {884736=638976,1523712=401408} 2024-03-04T06:54:50.962 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[91314]: osdmap e805: 8 total, 8 up, 8 in 2024-03-04T06:54:50.962 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:50.962 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:50.962 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:50.962 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:50.962 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:50.962 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:50.963 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:50.963 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:50.963 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:50.963 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:50.963 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[88869]: osdmap e805: 8 total, 8 up, 8 in 2024-03-04T06:54:50.963 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:50.964 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:50.964 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:50.964 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:50.964 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:50.964 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:50.964 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:50.964 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:50.964 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:50.964 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:50.968 INFO:tasks.rados.rados.0.smithi137.stdout:3899: writing smithi13777483-1 from 884736 to 1523712 tid 1 2024-03-04T06:54:50.971 INFO:tasks.rados.rados.0.smithi137.stdout:3899: writing smithi13777483-1 from 1523712 to 1925120 tid 2 2024-03-04T06:54:50.972 INFO:tasks.rados.rados.0.smithi137.stdout:3900: rollback oid 44 current snap is 368 2024-03-04T06:54:50.972 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 44 to 367 2024-03-04T06:54:50.972 INFO:tasks.rados.rados.0.smithi137.stdout:3901: copy_from oid 15 from oid 20 current snap is 368 2024-03-04T06:54:50.972 INFO:tasks.rados.rados.0.smithi137.stdout:3902: setattr oid 41 current snap is 368 2024-03-04T06:54:50.972 INFO:tasks.rados.rados.0.smithi137.stdout:3903: snap_remove snap 362 2024-03-04T06:54:51.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:51.185+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:51.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:50.973+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:51.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:50.959+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:51.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:50.959+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:51.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:50.979+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:51.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:50.966+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:51.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:50.957+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:51.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:50.957+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:51.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:50.974+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:51.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:50.974+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:51.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:50 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:50.975+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:51.968 INFO:tasks.rados.rados.0.smithi137.stdout:3903: done (5 left) 2024-03-04T06:54:51.968 INFO:tasks.rados.rados.0.smithi137.stdout:3904: delete oid 43 current snap is 368 2024-03-04T06:54:51.968 INFO:tasks.rados.rados.0.smithi137.stdout:3899: finishing write tid 1 to smithi13777483-1 2024-03-04T06:54:51.968 INFO:tasks.rados.rados.0.smithi137.stdout:3899: finishing write tid 2 to smithi13777483-1 2024-03-04T06:54:51.968 INFO:tasks.rados.rados.0.smithi137.stdout:3899: finishing write tid 3 to smithi13777483-1 2024-03-04T06:54:51.968 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 16979 (ObjNum 1104 snap 327 seq_num 1104) dirty exists 2024-03-04T06:54:51.968 INFO:tasks.rados.rados.0.smithi137.stdout:3899: finishing write tid 4 to smithi13777483-1 2024-03-04T06:54:51.968 INFO:tasks.rados.rados.0.smithi137.stdout:3899: oid 1 updating version 0 to 16961 2024-03-04T06:54:51.968 INFO:tasks.rados.rados.0.smithi137.stdout:3899: oid 1 version 16961 is already newer than 16959 2024-03-04T06:54:51.969 INFO:tasks.rados.rados.0.smithi137.stdout:3899: oid 1 version 16961 is already newer than 16960 2024-03-04T06:54:51.969 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 16961 (ObjNum 1208 snap 368 seq_num 1208) dirty exists 2024-03-04T06:54:51.969 INFO:tasks.rados.rados.0.smithi137.stdout:3899: left oid 1 (ObjNum 1208 snap 368 seq_num 1208) 2024-03-04T06:54:51.969 INFO:tasks.rados.rados.0.smithi137.stdout:3900: finishing rollback tid 0 to smithi13777483-44 2024-03-04T06:54:51.969 INFO:tasks.rados.rados.0.smithi137.stdout:3900: finishing rollback tid 1 to smithi13777483-44 2024-03-04T06:54:51.969 INFO:tasks.rados.rados.0.smithi137.stdout:3900: finishing rollback tid 2 to smithi13777483-44 2024-03-04T06:54:51.969 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 44 v 17002 (ObjNum 1188 snap 360 seq_num 1188) dirty exists 2024-03-04T06:54:51.969 INFO:tasks.rados.rados.0.smithi137.stdout:3898: expect (ObjNum 1188 snap 360 seq_num 1188) 2024-03-04T06:54:52.150 INFO:tasks.rados.rados.0.smithi137.stdout:3901: finishing copy_from racing read to smithi13777483-15 2024-03-04T06:54:52.150 INFO:tasks.rados.rados.0.smithi137.stdout:3901: finishing copy_from to smithi13777483-15 2024-03-04T06:54:52.150 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 16971 (ObjNum 1122 snap 339 seq_num 1122) dirty exists 2024-03-04T06:54:52.150 INFO:tasks.rados.rados.0.smithi137.stdout:3898: done (5 left) 2024-03-04T06:54:52.150 INFO:tasks.rados.rados.0.smithi137.stdout:3899: done (4 left) 2024-03-04T06:54:52.150 INFO:tasks.rados.rados.0.smithi137.stdout:3900: done (3 left) 2024-03-04T06:54:52.150 INFO:tasks.rados.rados.0.smithi137.stdout:3901: done (2 left) 2024-03-04T06:54:52.150 INFO:tasks.rados.rados.0.smithi137.stdout:3902: done (1 left) 2024-03-04T06:54:52.150 INFO:tasks.rados.rados.0.smithi137.stdout:3904: done (0 left) 2024-03-04T06:54:52.150 INFO:tasks.rados.rados.0.smithi137.stdout:3905: copy_from oid 24 from oid 39 current snap is 368 2024-03-04T06:54:52.150 INFO:tasks.rados.rados.0.smithi137.stdout:3906: copy_from oid 6 from oid 13 current snap is 368 2024-03-04T06:54:52.150 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 368 2024-03-04T06:54:52.150 INFO:tasks.rados.rados.0.smithi137.stdout:3907: seq_num 1210 ranges {671744=671744,1343488=401408} 2024-03-04T06:54:52.157 INFO:tasks.rados.rados.0.smithi137.stdout:3907: writing smithi13777483-34 from 671744 to 1343488 tid 1 2024-03-04T06:54:52.159 INFO:tasks.rados.rados.0.smithi137.stdout:3907: writing smithi13777483-34 from 1343488 to 1744896 tid 2 2024-03-04T06:54:52.160 INFO:tasks.rados.rados.0.smithi137.stdout:3908: delete oid 14 current snap is 368 2024-03-04T06:54:52.164 INFO:tasks.rados.rados.0.smithi137.stdout:3908: done (3 left) 2024-03-04T06:54:52.164 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 368 2024-03-04T06:54:52.164 INFO:tasks.rados.rados.0.smithi137.stdout:3909: seq_num 1212 ranges {0=704512,704512=401408} 2024-03-04T06:54:52.168 INFO:tasks.rados.rados.0.smithi137.stdout:3909: writing smithi13777483-30 from 0 to 704512 tid 1 2024-03-04T06:54:52.171 INFO:tasks.rados.rados.0.smithi137.stdout:3909: writing smithi13777483-30 from 704512 to 1105920 tid 2 2024-03-04T06:54:52.171 INFO:tasks.rados.rados.0.smithi137.stdout:3910: rmattr oid 14 current snap is 368 2024-03-04T06:54:52.171 INFO:tasks.rados.rados.0.smithi137.stdout:3910: done (4 left) 2024-03-04T06:54:52.171 INFO:tasks.rados.rados.0.smithi137.stdout:3911: snap_create 2024-03-04T06:54:52.171 INFO:tasks.rados.rados.0.smithi137.stdout:3907: finishing write tid 1 to smithi13777483-34 2024-03-04T06:54:52.171 INFO:tasks.rados.rados.0.smithi137.stdout:3907: finishing write tid 2 to smithi13777483-34 2024-03-04T06:54:52.171 INFO:tasks.rados.rados.0.smithi137.stdout:3907: finishing write tid 3 to smithi13777483-34 2024-03-04T06:54:52.172 INFO:tasks.rados.rados.0.smithi137.stdout:3907: finishing write tid 4 to smithi13777483-34 2024-03-04T06:54:52.172 INFO:tasks.rados.rados.0.smithi137.stdout:3907: oid 34 updating version 0 to 17004 2024-03-04T06:54:52.172 INFO:tasks.rados.rados.0.smithi137.stdout:3907: oid 34 updating version 17004 to 17005 2024-03-04T06:54:52.172 INFO:tasks.rados.rados.0.smithi137.stdout:3907: oid 34 version 17005 is already newer than 17003 2024-03-04T06:54:52.172 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 17005 (ObjNum 1210 snap 368 seq_num 1210) dirty exists 2024-03-04T06:54:52.172 INFO:tasks.rados.rados.0.smithi137.stdout:3907: left oid 34 (ObjNum 1210 snap 368 seq_num 1210) 2024-03-04T06:54:52.173 INFO:tasks.rados.rados.0.smithi137.stdout:3906: finishing copy_from racing read to smithi13777483-6 2024-03-04T06:54:52.176 INFO:tasks.rados.rados.0.smithi137.stdout:3905: finishing copy_from racing read to smithi13777483-24 2024-03-04T06:54:52.179 INFO:tasks.rados.rados.0.smithi137.stdout:3906: finishing copy_from to smithi13777483-6 2024-03-04T06:54:52.179 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 6 v 16927 (ObjNum 1089 snap 325 seq_num 1089) dirty exists 2024-03-04T06:54:52.180 INFO:tasks.rados.rados.0.smithi137.stdout:3909: finishing write tid 1 to smithi13777483-30 2024-03-04T06:54:52.180 INFO:tasks.rados.rados.0.smithi137.stdout:3909: finishing write tid 2 to smithi13777483-30 2024-03-04T06:54:52.180 INFO:tasks.rados.rados.0.smithi137.stdout:3905: finishing copy_from to smithi13777483-24 2024-03-04T06:54:52.180 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 24 v 16999 (ObjNum 1188 snap 360 seq_num 1188) dirty exists 2024-03-04T06:54:52.180 INFO:tasks.rados.rados.0.smithi137.stdout:3909: finishing write tid 3 to smithi13777483-30 2024-03-04T06:54:52.182 INFO:tasks.rados.rados.0.smithi137.stdout:3909: finishing write tid 4 to smithi13777483-30 2024-03-04T06:54:52.182 INFO:tasks.rados.rados.0.smithi137.stdout:3909: oid 30 updating version 0 to 16981 2024-03-04T06:54:52.182 INFO:tasks.rados.rados.0.smithi137.stdout:3909: oid 30 updating version 16981 to 16983 2024-03-04T06:54:52.182 INFO:tasks.rados.rados.0.smithi137.stdout:3909: oid 30 version 16983 is already newer than 16982 2024-03-04T06:54:52.182 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16983 (ObjNum 1212 snap 368 seq_num 1212) dirty exists 2024-03-04T06:54:52.182 INFO:tasks.rados.rados.0.smithi137.stdout:3909: left oid 30 (ObjNum 1212 snap 368 seq_num 1212) 2024-03-04T06:54:52.292 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:51.972+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:52.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:51.977+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:52.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:51.977+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:52.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:51.978+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:52.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:51.972+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:52.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[91314]: pgmap v892: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 963 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 8.1 MiB/s rd, 2.3 MiB/s wr, 13 op/s 2024-03-04T06:54:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[91314]: osdmap e806: 8 total, 8 up, 8 in 2024-03-04T06:54:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:52.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:52.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[88869]: pgmap v892: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 963 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 8.1 MiB/s rd, 2.3 MiB/s wr, 13 op/s 2024-03-04T06:54:52.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[88869]: osdmap e806: 8 total, 8 up, 8 in 2024-03-04T06:54:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:52.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:51 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:52.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:51.975+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:52.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:51.967+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:52.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:51.967+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:52.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:51.971+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:52.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:51.971+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:52.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:51.971+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a9=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:52.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:52.153+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:52.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:52.153+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-mon[85573]: pgmap v892: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 963 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 8.1 MiB/s rd, 2.3 MiB/s wr, 13 op/s 2024-03-04T06:54:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19c=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-mon[85573]: osdmap e806: 8 total, 8 up, 8 in 2024-03-04T06:54:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:52.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:51 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:3905: done (4 left) 2024-03-04T06:54:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:3906: done (3 left) 2024-03-04T06:54:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:3907: done (2 left) 2024-03-04T06:54:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:3909: done (1 left) 2024-03-04T06:54:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:3911: done (0 left) 2024-03-04T06:54:52.981 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 2 current snap is 369 2024-03-04T06:54:52.982 INFO:tasks.rados.rados.0.smithi137.stdout:3912: seq_num 1213 ranges {5251072=720896,5971968=401408} 2024-03-04T06:54:53.012 INFO:tasks.rados.rados.0.smithi137.stdout:3912: writing smithi13777483-2 from 5251072 to 5971968 tid 1 2024-03-04T06:54:53.015 INFO:tasks.rados.rados.0.smithi137.stdout:3912: writing smithi13777483-2 from 5971968 to 6373376 tid 2 2024-03-04T06:54:53.015 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 33 current snap is 369 2024-03-04T06:54:53.015 INFO:tasks.rados.rados.0.smithi137.stdout:3913: seq_num 1214 ranges {3153920=737280,3891200=401408} 2024-03-04T06:54:53.036 INFO:tasks.rados.rados.0.smithi137.stdout:3913: writing smithi13777483-33 from 3153920 to 3891200 tid 1 2024-03-04T06:54:53.039 INFO:tasks.rados.rados.0.smithi137.stdout:3913: writing smithi13777483-33 from 3891200 to 4292608 tid 2 2024-03-04T06:54:53.039 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 369 2024-03-04T06:54:53.039 INFO:tasks.rados.rados.0.smithi137.stdout:3912: finishing write tid 1 to smithi13777483-2 2024-03-04T06:54:53.039 INFO:tasks.rados.rados.0.smithi137.stdout:3912: finishing write tid 2 to smithi13777483-2 2024-03-04T06:54:53.039 INFO:tasks.rados.rados.0.smithi137.stdout:3912: finishing write tid 3 to smithi13777483-2 2024-03-04T06:54:53.039 INFO:tasks.rados.rados.0.smithi137.stdout:3914: seq_num 1215 ranges {1744896=753664,2498560=401408} 2024-03-04T06:54:53.052 INFO:tasks.rados.rados.0.smithi137.stdout:3914: writing smithi13777483-34 from 1744896 to 2498560 tid 1 2024-03-04T06:54:53.055 INFO:tasks.rados.rados.0.smithi137.stdout:3914: writing smithi13777483-34 from 2498560 to 2899968 tid 2 2024-03-04T06:54:53.055 INFO:tasks.rados.rados.0.smithi137.stdout:3915: read oid 3 snap -1 2024-03-04T06:54:53.055 INFO:tasks.rados.rados.0.smithi137.stdout:3915: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:54:53.055 INFO:tasks.rados.rados.0.smithi137.stdout:3916: read oid 11 snap -1 2024-03-04T06:54:53.055 INFO:tasks.rados.rados.0.smithi137.stdout:3916: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:54:53.055 INFO:tasks.rados.rados.0.smithi137.stdout:3917: read oid 18 snap -1 2024-03-04T06:54:53.055 INFO:tasks.rados.rados.0.smithi137.stdout:3917: expect (ObjNum 1187 snap 360 seq_num 1187) 2024-03-04T06:54:53.056 INFO:tasks.rados.rados.0.smithi137.stdout:3918: snap_remove snap 360 2024-03-04T06:54:53.292 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:53.043+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:53.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:52.978+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:53.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:53.055+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:53.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:53.079+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:53.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:53.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[91314]: osdmap e807: 8 total, 8 up, 8 in 2024-03-04T06:54:53.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:53.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:53.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:53.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a9=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:53.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:53.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:53.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:53.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:53.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:53.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:53.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:53.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[88869]: osdmap e807: 8 total, 8 up, 8 in 2024-03-04T06:54:53.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:53.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:53.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:53.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a9=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:53.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:53.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:53.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:53.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:53.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:53.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:52 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:53.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:52.976+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:53.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:53.042+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a9=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:53.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:53.048+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:53.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:53.017+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:53.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:53.017+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:53.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:53.017+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-mon[85573]: osdmap e807: 8 total, 8 up, 8 in 2024-03-04T06:54:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:53.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:53.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a9=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:53.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:53.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:53.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:53.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:53.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:53.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:52 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:53.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:53.397+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:53.984 INFO:tasks.rados.rados.0.smithi137.stdout:3912: finishing write tid 4 to smithi13777483-2 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:3912: oid 2 updating version 0 to 16964 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:3912: oid 2 version 16964 is already newer than 16962 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:3912: oid 2 version 16964 is already newer than 16963 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16964 (ObjNum 1213 snap 369 seq_num 1213) dirty exists 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:3912: left oid 2 (ObjNum 1213 snap 369 seq_num 1213) 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:3913: finishing write tid 1 to smithi13777483-33 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:3913: finishing write tid 2 to smithi13777483-33 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:3912: done (6 left) 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:3918: done (5 left) 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 4 current snap is 369 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:3913: finishing write tid 3 to smithi13777483-33 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:3913: finishing write tid 4 to smithi13777483-33 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:3913: oid 33 updating version 0 to 16985 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:3913: oid 33 updating version 16985 to 16986 2024-03-04T06:54:53.985 INFO:tasks.rados.rados.0.smithi137.stdout:3913: oid 33 updating version 16986 to 16987 2024-03-04T06:54:53.986 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 33 v 16987 (ObjNum 1214 snap 369 seq_num 1214) dirty exists 2024-03-04T06:54:53.986 INFO:tasks.rados.rados.0.smithi137.stdout:3913: left oid 33 (ObjNum 1214 snap 369 seq_num 1214) 2024-03-04T06:54:53.986 INFO:tasks.rados.rados.0.smithi137.stdout:3916: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-04T06:54:53.987 INFO:tasks.rados.rados.0.smithi137.stdout:3914: finishing write tid 1 to smithi13777483-34 2024-03-04T06:54:53.987 INFO:tasks.rados.rados.0.smithi137.stdout:3914: finishing write tid 2 to smithi13777483-34 2024-03-04T06:54:53.987 INFO:tasks.rados.rados.0.smithi137.stdout:3914: finishing write tid 3 to smithi13777483-34 2024-03-04T06:54:53.987 INFO:tasks.rados.rados.0.smithi137.stdout:3914: finishing write tid 4 to smithi13777483-34 2024-03-04T06:54:53.987 INFO:tasks.rados.rados.0.smithi137.stdout:3914: oid 34 updating version 0 to 17007 2024-03-04T06:54:53.988 INFO:tasks.rados.rados.0.smithi137.stdout:3914: oid 34 updating version 17007 to 17008 2024-03-04T06:54:53.988 INFO:tasks.rados.rados.0.smithi137.stdout:3914: oid 34 version 17008 is already newer than 17006 2024-03-04T06:54:53.988 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 17008 (ObjNum 1215 snap 369 seq_num 1215) dirty exists 2024-03-04T06:54:53.988 INFO:tasks.rados.rados.0.smithi137.stdout:3914: left oid 34 (ObjNum 1215 snap 369 seq_num 1215) 2024-03-04T06:54:53.988 INFO:tasks.rados.rados.0.smithi137.stdout:3915: expect (ObjNum 931 snap 275 seq_num 931) 2024-03-04T06:54:54.292 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:53.993+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:54.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:53.987+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:54.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:53.983+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:54.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:53.983+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:54.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:53.983+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:54.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[88869]: pgmap v895: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 963 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 6 op/s 2024-03-04T06:54:54.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:54.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:54.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[88869]: osdmap e808: 8 total, 8 up, 8 in 2024-03-04T06:54:54.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:54.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:54.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a9=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:54.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:54.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:54.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:54.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:54:54.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[91314]: pgmap v895: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 963 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 6 op/s 2024-03-04T06:54:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[91314]: osdmap e808: 8 total, 8 up, 8 in 2024-03-04T06:54:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a9=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:54.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:54:54.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:53 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:54.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:53.989+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:54.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:53.987+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:54.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:53.988+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:54.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:54.001+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:54.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:54.001+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:54.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:54.001+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a9=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:54.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-mon[85573]: pgmap v895: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 963 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 6 op/s 2024-03-04T06:54:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-mon[85573]: osdmap e808: 8 total, 8 up, 8 in 2024-03-04T06:54:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a9=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:54:54.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:53 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:54.813 INFO:tasks.rados.rados.0.smithi137.stdout:3917: expect (ObjNum 1187 snap 360 seq_num 1187) 2024-03-04T06:54:54.988 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:54.657+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:54.988 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:54.657+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:55.292 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:55.292 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[91314]: osdmap e809: 8 total, 8 up, 8 in 2024-03-04T06:54:55.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:55.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:55.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:55.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:55.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:55.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:55.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:55.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:55.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a9=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:55.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:55.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[88869]: osdmap e809: 8 total, 8 up, 8 in 2024-03-04T06:54:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:55.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:54 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a9=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:55.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:55.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-mon[85573]: osdmap e809: 8 total, 8 up, 8 in 2024-03-04T06:54:55.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:55.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:55.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:55.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:54 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a9=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:55.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:54:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:54:55] "GET /metrics HTTP/1.1" 200 36342 "" "Prometheus/2.43.0" 2024-03-04T06:54:56.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:55 smithi137 ceph-mon[88869]: pgmap v898: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 983 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 26 MiB/s rd, 3.7 MiB/s wr, 15 op/s 2024-03-04T06:54:56.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:55 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:56.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:55 smithi137 ceph-mon[91314]: pgmap v898: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 983 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 26 MiB/s rd, 3.7 MiB/s wr, 15 op/s 2024-03-04T06:54:56.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:55 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:56.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:55 smithi203 ceph-mon[85573]: pgmap v898: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 983 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 26 MiB/s rd, 3.7 MiB/s wr, 15 op/s 2024-03-04T06:54:56.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:55 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:56.989 INFO:tasks.rados.rados.0.smithi137.stdout:3919: seq_num 1216 ranges {819200=770048,1589248=401408} 2024-03-04T06:54:56.997 INFO:tasks.rados.rados.0.smithi137.stdout:3919: writing smithi13777483-4 from 819200 to 1589248 tid 1 2024-03-04T06:54:57.000 INFO:tasks.rados.rados.0.smithi137.stdout:3919: writing smithi13777483-4 from 1589248 to 1990656 tid 2 2024-03-04T06:54:57.000 INFO:tasks.rados.rados.0.smithi137.stdout:3913: done (5 left) 2024-03-04T06:54:57.000 INFO:tasks.rados.rados.0.smithi137.stdout:3914: done (4 left) 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:3915: done (3 left) 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:3916: done (2 left) 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:3917: done (1 left) 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:3920: rmattr oid 47 current snap is 369 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:3920: done (1 left) 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:3921: read oid 15 snap -1 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:3921: expect (ObjNum 1122 snap 339 seq_num 1122) 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:3922: read oid 38 snap 351 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:3922: expect (ObjNum 1119 snap 336 seq_num 1119) 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:3923: rollback oid 16 current snap is 369 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 16 to 367 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:3924: rollback oid 41 current snap is 369 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 41 to 351 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:3925: copy_from oid 12 from oid 17 current snap is 369 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 34 current snap is 369 2024-03-04T06:54:57.001 INFO:tasks.rados.rados.0.smithi137.stdout:3926: seq_num 1217 ranges {2899968=786432,3686400=401408} 2024-03-04T06:54:57.022 INFO:tasks.rados.rados.0.smithi137.stdout:3926: writing smithi13777483-34 from 2899968 to 3686400 tid 1 2024-03-04T06:54:57.025 INFO:tasks.rados.rados.0.smithi137.stdout:3926: writing smithi13777483-34 from 3686400 to 4087808 tid 2 2024-03-04T06:54:57.025 INFO:tasks.rados.rados.0.smithi137.stdout:3927: setattr oid 2 current snap is 369 2024-03-04T06:54:57.025 INFO:tasks.rados.rados.0.smithi137.stdout:3919: finishing write tid 1 to smithi13777483-4 2024-03-04T06:54:57.025 INFO:tasks.rados.rados.0.smithi137.stdout:3919: finishing write tid 2 to smithi13777483-4 2024-03-04T06:54:57.025 INFO:tasks.rados.rados.0.smithi137.stdout:3919: finishing write tid 3 to smithi13777483-4 2024-03-04T06:54:57.026 INFO:tasks.rados.rados.0.smithi137.stdout:3919: finishing write tid 4 to smithi13777483-4 2024-03-04T06:54:57.026 INFO:tasks.rados.rados.0.smithi137.stdout:3919: oid 4 updating version 0 to 15536 2024-03-04T06:54:57.026 INFO:tasks.rados.rados.0.smithi137.stdout:3919: oid 4 updating version 15536 to 15538 2024-03-04T06:54:57.026 INFO:tasks.rados.rados.0.smithi137.stdout:3919: oid 4 version 15538 is already newer than 15537 2024-03-04T06:54:57.026 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 15538 (ObjNum 1216 snap 369 seq_num 1216) dirty exists 2024-03-04T06:54:57.026 INFO:tasks.rados.rados.0.smithi137.stdout:3919: left oid 4 (ObjNum 1216 snap 369 seq_num 1216) 2024-03-04T06:54:57.026 INFO:tasks.rados.rados.0.smithi137.stdout:3924: finishing rollback tid 0 to smithi13777483-41 2024-03-04T06:54:57.026 INFO:tasks.rados.rados.0.smithi137.stdout:3924: finishing rollback tid 1 to smithi13777483-41 2024-03-04T06:54:57.026 INFO:tasks.rados.rados.0.smithi137.stdout:3924: finishing rollback tid 2 to smithi13777483-41 2024-03-04T06:54:57.026 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 41 v 16982 (ObjNum 1104 snap 327 seq_num 1104) dirty exists 2024-03-04T06:54:57.026 INFO:tasks.rados.rados.0.smithi137.stdout:3922: expect (ObjNum 1119 snap 336 seq_num 1119) 2024-03-04T06:54:57.082 INFO:tasks.rados.rados.0.smithi137.stdout:3923: finishing rollback tid 0 to smithi13777483-16 2024-03-04T06:54:57.082 INFO:tasks.rados.rados.0.smithi137.stdout:3923: finishing rollback tid 1 to smithi13777483-16 2024-03-04T06:54:57.082 INFO:tasks.rados.rados.0.smithi137.stdout:3923: finishing rollback tid 2 to smithi13777483-16 2024-03-04T06:54:57.082 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 16 v 17011 (ObjNum 1089 snap 325 seq_num 1089) dirty exists 2024-03-04T06:54:57.082 INFO:tasks.rados.rados.0.smithi137.stdout:3921: expect (ObjNum 1122 snap 339 seq_num 1122) 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3926: finishing write tid 1 to smithi13777483-34 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3926: finishing write tid 2 to smithi13777483-34 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3926: finishing write tid 3 to smithi13777483-34 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3926: finishing write tid 4 to smithi13777483-34 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3926: oid 34 updating version 0 to 17012 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3926: oid 34 updating version 17012 to 17013 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3926: oid 34 updating version 17013 to 17014 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 34 v 17014 (ObjNum 1217 snap 369 seq_num 1217) dirty exists 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3926: left oid 34 (ObjNum 1217 snap 369 seq_num 1217) 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3925: finishing copy_from racing read to smithi13777483-12 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3925: finishing copy_from to smithi13777483-12 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16977 (ObjNum 1185 snap 360 seq_num 1185) dirty exists 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3919: done (7 left) 2024-03-04T06:54:57.187 INFO:tasks.rados.rados.0.smithi137.stdout:3921: done (6 left) 2024-03-04T06:54:57.188 INFO:tasks.rados.rados.0.smithi137.stdout:3922: done (5 left) 2024-03-04T06:54:57.188 INFO:tasks.rados.rados.0.smithi137.stdout:3923: done (4 left) 2024-03-04T06:54:57.188 INFO:tasks.rados.rados.0.smithi137.stdout:3924: done (3 left) 2024-03-04T06:54:57.188 INFO:tasks.rados.rados.0.smithi137.stdout:3925: done (2 left) 2024-03-04T06:54:57.188 INFO:tasks.rados.rados.0.smithi137.stdout:3926: done (1 left) 2024-03-04T06:54:57.188 INFO:tasks.rados.rados.0.smithi137.stdout:3928: delete oid 24 current snap is 369 2024-03-04T06:54:57.189 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16965 (ObjNum 1213 snap 369 seq_num 1213) dirty exists 2024-03-04T06:54:57.191 INFO:tasks.rados.rados.0.smithi137.stdout:3927: done (1 left) 2024-03-04T06:54:57.191 INFO:tasks.rados.rados.0.smithi137.stdout:3928: done (0 left) 2024-03-04T06:54:57.191 INFO:tasks.rados.rados.0.smithi137.stdout:3929: snap_create 2024-03-04T06:54:57.999 INFO:tasks.rados.rados.0.smithi137.stdout:3929: done (0 left) 2024-03-04T06:54:57.999 INFO:tasks.rados.rados.0.smithi137.stdout:3930: read oid 14 snap -1 2024-03-04T06:54:57.999 INFO:tasks.rados.rados.0.smithi137.stdout:3930: expect deleted 2024-03-04T06:54:58.000 INFO:tasks.rados.rados.0.smithi137.stdout:3931: rollback oid 4 current snap is 370 2024-03-04T06:54:58.000 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 4 to 365 2024-03-04T06:54:58.000 INFO:tasks.rados.rados.0.smithi137.stdout:3932: snap_create 2024-03-04T06:54:58.005 INFO:tasks.rados.rados.0.smithi137.stdout:3931: finishing rollback tid 0 to smithi13777483-4 2024-03-04T06:54:58.005 INFO:tasks.rados.rados.0.smithi137.stdout:3931: finishing rollback tid 1 to smithi13777483-4 2024-03-04T06:54:58.006 INFO:tasks.rados.rados.0.smithi137.stdout:3931: finishing rollback tid 2 to smithi13777483-4 2024-03-04T06:54:58.006 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 4 v 15541 (ObjNum 1195 snap 362 seq_num 1195) dirty exists 2024-03-04T06:54:58.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:57 smithi137 ceph-mon[88869]: pgmap v899: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 984 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 19 MiB/s rd, 2.9 MiB/s wr, 16 op/s 2024-03-04T06:54:58.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:57 smithi137 ceph-mon[91314]: pgmap v899: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 984 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 19 MiB/s rd, 2.9 MiB/s wr, 16 op/s 2024-03-04T06:54:58.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:58.005+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:58.295 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:57 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:57.997+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:58.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:58.001+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:58.295 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:58 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:58.005+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:58.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:57 smithi203 ceph-mon[85573]: pgmap v899: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 984 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 19 MiB/s rd, 2.9 MiB/s wr, 16 op/s 2024-03-04T06:54:58.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:58.002+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:58.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:57.996+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:54:58.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:57.997+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:58.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:57.997+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:58.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:58.153+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:58.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:58.186+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:58.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:58.186+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:59.005 INFO:tasks.rados.rados.0.smithi137.stdout:3930: done (2 left) 2024-03-04T06:54:59.005 INFO:tasks.rados.rados.0.smithi137.stdout:3931: done (1 left) 2024-03-04T06:54:59.005 INFO:tasks.rados.rados.0.smithi137.stdout:3932: done (0 left) 2024-03-04T06:54:59.005 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 38 current snap is 371 2024-03-04T06:54:59.005 INFO:tasks.rados.rados.0.smithi137.stdout:3933: seq_num 1219 ranges {0=417792,417792=557056,974848=245760} 2024-03-04T06:54:59.007 INFO:tasks.rados.rados.0.smithi137.stdout:3933: writing smithi13777483-38 from 0 to 417792 tid 1 2024-03-04T06:54:59.011 INFO:tasks.rados.rados.0.smithi137.stdout:3933: writing smithi13777483-38 from 417792 to 974848 tid 2 2024-03-04T06:54:59.012 INFO:tasks.rados.rados.0.smithi137.stdout:3933: writing smithi13777483-38 from 974848 to 1220608 tid 3 2024-03-04T06:54:59.012 INFO:tasks.rados.rados.0.smithi137.stdout:3934: delete oid 44 current snap is 371 2024-03-04T06:54:59.017 INFO:tasks.rados.rados.0.smithi137.stdout:3933: finishing write tid 1 to smithi13777483-38 2024-03-04T06:54:59.017 INFO:tasks.rados.rados.0.smithi137.stdout:3933: finishing write tid 2 to smithi13777483-38 2024-03-04T06:54:59.018 INFO:tasks.rados.rados.0.smithi137.stdout:3934: done (1 left) 2024-03-04T06:54:59.018 INFO:tasks.rados.rados.0.smithi137.stdout:3935: delete oid 2 current snap is 371 2024-03-04T06:54:59.019 INFO:tasks.rados.rados.0.smithi137.stdout:3933: finishing write tid 3 to smithi13777483-38 2024-03-04T06:54:59.019 INFO:tasks.rados.rados.0.smithi137.stdout:3933: finishing write tid 4 to smithi13777483-38 2024-03-04T06:54:59.022 INFO:tasks.rados.rados.0.smithi137.stdout:3935: done (1 left) 2024-03-04T06:54:59.022 INFO:tasks.rados.rados.0.smithi137.stdout:3936: delete oid 40 current snap is 371 2024-03-04T06:54:59.022 INFO:tasks.rados.rados.0.smithi137.stdout:3933: finishing write tid 5 to smithi13777483-38 2024-03-04T06:54:59.022 INFO:tasks.rados.rados.0.smithi137.stdout:3933: oid 38 updating version 0 to 16990 2024-03-04T06:54:59.022 INFO:tasks.rados.rados.0.smithi137.stdout:3933: oid 38 updating version 16990 to 16991 2024-03-04T06:54:59.022 INFO:tasks.rados.rados.0.smithi137.stdout:3933: oid 38 version 16991 is already newer than 16989 2024-03-04T06:54:59.022 INFO:tasks.rados.rados.0.smithi137.stdout:3933: oid 38 updating version 16991 to 16992 2024-03-04T06:54:59.022 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 16992 (ObjNum 1219 snap 371 seq_num 1219) dirty exists 2024-03-04T06:54:59.022 INFO:tasks.rados.rados.0.smithi137.stdout:3933: left oid 38 (ObjNum 1219 snap 371 seq_num 1219) 2024-03-04T06:54:59.025 INFO:tasks.rados.rados.0.smithi137.stdout:3933: done (1 left) 2024-03-04T06:54:59.025 INFO:tasks.rados.rados.0.smithi137.stdout:3936: done (0 left) 2024-03-04T06:54:59.026 INFO:tasks.rados.rados.0.smithi137.stdout:3937: read oid 29 snap 369 2024-03-04T06:54:59.026 INFO:tasks.rados.rados.0.smithi137.stdout:3937: expect (ObjNum 1162 snap 356 seq_num 1162) 2024-03-04T06:54:59.026 INFO:tasks.rados.rados.0.smithi137.stdout:3938: delete oid 50 current snap is 371 2024-03-04T06:54:59.028 INFO:tasks.rados.rados.0.smithi137.stdout:3938: done (1 left) 2024-03-04T06:54:59.028 INFO:tasks.rados.rados.0.smithi137.stdout:3939: snap_create 2024-03-04T06:54:59.039 INFO:tasks.rados.rados.0.smithi137.stdout:3937: expect (ObjNum 1162 snap 356 seq_num 1162) 2024-03-04T06:54:59.292 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:54:59.004+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:59.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:54:59.012+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:54:59.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:59.015+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:54:59.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:59.015+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:59.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:54:59.018+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:59.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:59.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:59.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[88869]: osdmap e810: 8 total, 8 up, 8 in 2024-03-04T06:54:59.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:59.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:59.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:59.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:59.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:59.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:59.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:59.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[91314]: osdmap e810: 8 total, 8 up, 8 in 2024-03-04T06:54:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:59.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:54:59 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:59.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:54:59.025+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:59.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:59.002+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:59.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:54:59.002+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:59.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:59.028+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:54:59.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:59.028+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:54:59.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:54:59.028+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:54:59.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:59.016+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:54:59.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:54:59.016+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:54:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:54:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:54:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-mon[85573]: osdmap e810: 8 total, 8 up, 8 in 2024-03-04T06:54:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:54:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:54:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:54:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:54:59.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:54:59 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:00.012 INFO:tasks.rados.rados.0.smithi137.stdout:3937: done (1 left) 2024-03-04T06:55:00.012 INFO:tasks.rados.rados.0.smithi137.stdout:3939: done (0 left) 2024-03-04T06:55:00.012 INFO:tasks.rados.rados.0.smithi137.stdout:3940: rmattr oid 32 current snap is 372 2024-03-04T06:55:00.012 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 9 current snap is 372 2024-03-04T06:55:00.012 INFO:tasks.rados.rados.0.smithi137.stdout:3941: seq_num 1224 ranges {3842048=507904,4349952=425984,4775936=376832} 2024-03-04T06:55:00.035 INFO:tasks.rados.rados.0.smithi137.stdout:3941: writing smithi13777483-9 from 3842048 to 4349952 tid 1 2024-03-04T06:55:00.037 INFO:tasks.rados.rados.0.smithi137.stdout:3941: writing smithi13777483-9 from 4349952 to 4775936 tid 2 2024-03-04T06:55:00.040 INFO:tasks.rados.rados.0.smithi137.stdout:3941: writing smithi13777483-9 from 4775936 to 5152768 tid 3 2024-03-04T06:55:00.041 INFO:tasks.rados.rados.0.smithi137.stdout:3942: read oid 27 snap -1 2024-03-04T06:55:00.041 INFO:tasks.rados.rados.0.smithi137.stdout:3942: expect (ObjNum 1206 snap 367 seq_num 1206) 2024-03-04T06:55:00.041 INFO:tasks.rados.rados.0.smithi137.stdout:3943: snap_create 2024-03-04T06:55:00.041 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 32 v 17040 (ObjNum 1070 snap 320 seq_num 1070) dirty exists 2024-03-04T06:55:00.044 INFO:tasks.rados.rados.0.smithi137.stdout:3941: finishing write tid 1 to smithi13777483-9 2024-03-04T06:55:00.045 INFO:tasks.rados.rados.0.smithi137.stdout:3941: finishing write tid 2 to smithi13777483-9 2024-03-04T06:55:00.045 INFO:tasks.rados.rados.0.smithi137.stdout:3941: finishing write tid 3 to smithi13777483-9 2024-03-04T06:55:00.045 INFO:tasks.rados.rados.0.smithi137.stdout:3941: finishing write tid 4 to smithi13777483-9 2024-03-04T06:55:00.047 INFO:tasks.rados.rados.0.smithi137.stdout:3941: finishing write tid 5 to smithi13777483-9 2024-03-04T06:55:00.047 INFO:tasks.rados.rados.0.smithi137.stdout:3941: oid 9 updating version 0 to 17028 2024-03-04T06:55:00.047 INFO:tasks.rados.rados.0.smithi137.stdout:3941: oid 9 version 17028 is already newer than 17026 2024-03-04T06:55:00.048 INFO:tasks.rados.rados.0.smithi137.stdout:3941: oid 9 version 17028 is already newer than 17027 2024-03-04T06:55:00.048 INFO:tasks.rados.rados.0.smithi137.stdout:3941: oid 9 updating version 17028 to 17029 2024-03-04T06:55:00.048 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 9 v 17029 (ObjNum 1224 snap 372 seq_num 1224) dirty exists 2024-03-04T06:55:00.048 INFO:tasks.rados.rados.0.smithi137.stdout:3941: left oid 9 (ObjNum 1224 snap 372 seq_num 1224) 2024-03-04T06:55:00.056 INFO:tasks.rados.rados.0.smithi137.stdout:3942: expect (ObjNum 1206 snap 367 seq_num 1206) 2024-03-04T06:55:00.292 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:55:00.010+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:00.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:00.040+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:00.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:00.040+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:00.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:55:00.016+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: pgmap v901: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 998 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 20 MiB/s rd, 5.3 MiB/s wr, 22 op/s 2024-03-04T06:55:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: osdmap e811: 8 total, 8 up, 8 in 2024-03-04T06:55:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: pgmap v901: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 998 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 20 MiB/s rd, 5.3 MiB/s wr, 22 op/s 2024-03-04T06:55:00.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:00.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:00.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:00.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: osdmap e811: 8 total, 8 up, 8 in 2024-03-04T06:55:00.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:00.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:00.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:00.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:00.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:00.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:00.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:00 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:00.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:55:00.010+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:00.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:00.213+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:00.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:00.213+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:55:00.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:00.213+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:00.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:00.214+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:00.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:00.214+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:00.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:00.214+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:00.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: pgmap v901: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 998 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 20 MiB/s rd, 5.3 MiB/s wr, 22 op/s 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: osdmap e811: 8 total, 8 up, 8 in 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:00.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:00 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:01.027 INFO:tasks.rados.rados.0.smithi137.stdout:3940: done (3 left) 2024-03-04T06:55:01.028 INFO:tasks.rados.rados.0.smithi137.stdout:3941: done (2 left) 2024-03-04T06:55:01.028 INFO:tasks.rados.rados.0.smithi137.stdout:3942: done (1 left) 2024-03-04T06:55:01.028 INFO:tasks.rados.rados.0.smithi137.stdout:3943: done (0 left) 2024-03-04T06:55:01.028 INFO:tasks.rados.rados.0.smithi137.stdout:3944: snap_remove snap 365 2024-03-04T06:55:01.293 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:55:01.244+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:01.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:01.023+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:55:01.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:01.023+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:01.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:01.024+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:01.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:55:01.243+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:01.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:01.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[88869]: osdmap e812: 8 total, 8 up, 8 in 2024-03-04T06:55:01.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:01.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:01.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:01.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:01.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:01.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:01.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[91314]: osdmap e812: 8 total, 8 up, 8 in 2024-03-04T06:55:01.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:01.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:01.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:01.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:01.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:01 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:01.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:01.242+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:01.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:01.243+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:01.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:55:01.019+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:01.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:01.243+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:55:01.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:01.243+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:01.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:01.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-mon[85573]: osdmap e812: 8 total, 8 up, 8 in 2024-03-04T06:55:01.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:01.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:01.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:01.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:01.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:01.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:01.244+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:55:01.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:01.244+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:01.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:01.245+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:02.022 INFO:tasks.rados.rados.0.smithi137.stdout:3944: done (0 left) 2024-03-04T06:55:02.023 INFO:tasks.rados.rados.0.smithi137.stdout:3945: setattr oid 15 current snap is 373 2024-03-04T06:55:02.025 INFO:tasks.rados.rados.0.smithi137.stdout:3946: snap_create 2024-03-04T06:55:02.034 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 15 v 17005 (ObjNum 1122 snap 339 seq_num 1122) dirty exists 2024-03-04T06:55:02.292 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:55:02.032+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:02.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:02.022+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:02.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:02.022+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:02.293 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:55:02.026+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[88869]: pgmap v904: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 998 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-03-04T06:55:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[88869]: osdmap e813: 8 total, 8 up, 8 in 2024-03-04T06:55:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:02.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[91314]: pgmap v904: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 998 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-03-04T06:55:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[91314]: osdmap e813: 8 total, 8 up, 8 in 2024-03-04T06:55:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:02.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:02 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:02.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:55:02.026+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:02.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:02.024+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:55:02.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:02.024+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:02.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:02.024+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:02.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:02.147+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:02.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:02.018+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:02.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:02.018+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-mon[85573]: pgmap v904: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 998 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-03-04T06:55:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-mon[85573]: osdmap e813: 8 total, 8 up, 8 in 2024-03-04T06:55:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:02.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:02 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:03.037 INFO:tasks.rados.rados.0.smithi137.stdout:3945: done (1 left) 2024-03-04T06:55:03.037 INFO:tasks.rados.rados.0.smithi137.stdout:3946: done (0 left) 2024-03-04T06:55:03.037 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 47 current snap is 374 2024-03-04T06:55:03.037 INFO:tasks.rados.rados.0.smithi137.stdout:3947: seq_num 1225 ranges {3620864=524288,4145152=712704,4857856=90112} 2024-03-04T06:55:03.059 INFO:tasks.rados.rados.0.smithi137.stdout:3947: writing smithi13777483-47 from 3620864 to 4145152 tid 1 2024-03-04T06:55:03.063 INFO:tasks.rados.rados.0.smithi137.stdout:3947: writing smithi13777483-47 from 4145152 to 4857856 tid 2 2024-03-04T06:55:03.064 INFO:tasks.rados.rados.0.smithi137.stdout:3947: writing smithi13777483-47 from 4857856 to 4947968 tid 3 2024-03-04T06:55:03.064 INFO:tasks.rados.rados.0.smithi137.stdout:3948: read oid 14 snap -1 2024-03-04T06:55:03.064 INFO:tasks.rados.rados.0.smithi137.stdout:3948: expect deleted 2024-03-04T06:55:03.064 INFO:tasks.rados.rados.0.smithi137.stdout:3949: delete oid 35 current snap is 374 2024-03-04T06:55:03.064 INFO:tasks.rados.rados.0.smithi137.stdout:3947: finishing write tid 1 to smithi13777483-47 2024-03-04T06:55:03.068 INFO:tasks.rados.rados.0.smithi137.stdout:3947: finishing write tid 2 to smithi13777483-47 2024-03-04T06:55:03.068 INFO:tasks.rados.rados.0.smithi137.stdout:3947: finishing write tid 3 to smithi13777483-47 2024-03-04T06:55:03.068 INFO:tasks.rados.rados.0.smithi137.stdout:3947: finishing write tid 4 to smithi13777483-47 2024-03-04T06:55:03.071 INFO:tasks.rados.rados.0.smithi137.stdout:3947: finishing write tid 5 to smithi13777483-47 2024-03-04T06:55:03.071 INFO:tasks.rados.rados.0.smithi137.stdout:3947: oid 47 updating version 0 to 16995 2024-03-04T06:55:03.071 INFO:tasks.rados.rados.0.smithi137.stdout:3947: oid 47 updating version 16995 to 16996 2024-03-04T06:55:03.071 INFO:tasks.rados.rados.0.smithi137.stdout:3947: oid 47 version 16996 is already newer than 16994 2024-03-04T06:55:03.071 INFO:tasks.rados.rados.0.smithi137.stdout:3947: oid 47 version 16996 is already newer than 16993 2024-03-04T06:55:03.071 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 47 v 16996 (ObjNum 1225 snap 374 seq_num 1225) dirty exists 2024-03-04T06:55:03.072 INFO:tasks.rados.rados.0.smithi137.stdout:3947: left oid 47 (ObjNum 1225 snap 374 seq_num 1225) 2024-03-04T06:55:03.072 INFO:tasks.rados.rados.0.smithi137.stdout:3947: done (2 left) 2024-03-04T06:55:03.072 INFO:tasks.rados.rados.0.smithi137.stdout:3948: done (1 left) 2024-03-04T06:55:03.072 INFO:tasks.rados.rados.0.smithi137.stdout:3949: done (0 left) 2024-03-04T06:55:03.072 INFO:tasks.rados.rados.0.smithi137.stdout:3950: copy_from oid 2 from oid 1 current snap is 374 2024-03-04T06:55:03.072 INFO:tasks.rados.rados.0.smithi137.stdout:3951: read oid 18 snap -1 2024-03-04T06:55:03.072 INFO:tasks.rados.rados.0.smithi137.stdout:3951: expect (ObjNum 1187 snap 360 seq_num 1187) 2024-03-04T06:55:03.072 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 374 2024-03-04T06:55:03.072 INFO:tasks.rados.rados.0.smithi137.stdout:3952: seq_num 1227 ranges {12967936=557056,13524992=483328,14008320=319488} 2024-03-04T06:55:03.145 INFO:tasks.rados.rados.0.smithi137.stdout:3952: writing smithi13777483-12 from 12967936 to 13524992 tid 1 2024-03-04T06:55:03.147 INFO:tasks.rados.rados.0.smithi137.stdout:3952: writing smithi13777483-12 from 13524992 to 14008320 tid 2 2024-03-04T06:55:03.150 INFO:tasks.rados.rados.0.smithi137.stdout:3952: writing smithi13777483-12 from 14008320 to 14327808 tid 3 2024-03-04T06:55:03.150 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 29 current snap is 374 2024-03-04T06:55:03.150 INFO:tasks.rados.rados.0.smithi137.stdout:3950: finishing copy_from racing read to smithi13777483-2 2024-03-04T06:55:03.150 INFO:tasks.rados.rados.0.smithi137.stdout:3950: finishing copy_from to smithi13777483-2 2024-03-04T06:55:03.150 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 2 v 16961 (ObjNum 1208 snap 368 seq_num 1208) dirty exists 2024-03-04T06:55:03.150 INFO:tasks.rados.rados.0.smithi137.stdout:3951: expect (ObjNum 1187 snap 360 seq_num 1187) 2024-03-04T06:55:03.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:03.063+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:55:03.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:03.063+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:03.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:03.064+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:03.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:03.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:03.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: osdmap e814: 8 total, 8 up, 8 in 2024-03-04T06:55:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:03.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:03.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:55:03.081+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:03.295 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:55:03.036+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: osdmap e814: 8 total, 8 up, 8 in 2024-03-04T06:55:03.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:03.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:03.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:03.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:03.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:03.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:03.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:03.296 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:03 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:03.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:03.034+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:03.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:03.034+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:03.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:55:03.068+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:03.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:03.071+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:55:03.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:03.071+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:03.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:03.067+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:55:03.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:03.067+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:03.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:03.069+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: osdmap e814: 8 total, 8 up, 8 in 2024-03-04T06:55:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:03.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:03.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:03.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:03 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[88869]: pgmap v907: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 998 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-04T06:55:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[88869]: osdmap e815: 8 total, 8 up, 8 in 2024-03-04T06:55:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:04.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:04.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[91314]: pgmap v907: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 998 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-04T06:55:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[91314]: osdmap e815: 8 total, 8 up, 8 in 2024-03-04T06:55:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:04.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:04.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:04.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:04.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:04 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:04.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:04 smithi203 ceph-mon[85573]: pgmap v907: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 998 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-04T06:55:04.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:04.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:04 smithi203 ceph-mon[85573]: osdmap e815: 8 total, 8 up, 8 in 2024-03-04T06:55:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:04 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:04.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:04 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:05.317 INFO:tasks.rados.rados.0.smithi137.stdout:3952: finishing write tid 1 to smithi13777483-12 2024-03-04T06:55:05.317 INFO:tasks.rados.rados.0.smithi137.stdout:3952: finishing write tid 2 to smithi13777483-12 2024-03-04T06:55:05.317 INFO:tasks.rados.rados.0.smithi137.stdout:3952: finishing write tid 3 to smithi13777483-12 2024-03-04T06:55:05.317 INFO:tasks.rados.rados.0.smithi137.stdout:3952: finishing write tid 4 to smithi13777483-12 2024-03-04T06:55:05.317 INFO:tasks.rados.rados.0.smithi137.stdout:3952: finishing write tid 5 to smithi13777483-12 2024-03-04T06:55:05.317 INFO:tasks.rados.rados.0.smithi137.stdout:3952: oid 12 updating version 0 to 16986 2024-03-04T06:55:05.317 INFO:tasks.rados.rados.0.smithi137.stdout:3952: oid 12 version 16986 is already newer than 16984 2024-03-04T06:55:05.317 INFO:tasks.rados.rados.0.smithi137.stdout:3952: oid 12 version 16986 is already newer than 16985 2024-03-04T06:55:05.318 INFO:tasks.rados.rados.0.smithi137.stdout:3952: oid 12 updating version 16986 to 16987 2024-03-04T06:55:05.318 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16987 (ObjNum 1227 snap 374 seq_num 1227) dirty exists 2024-03-04T06:55:05.318 INFO:tasks.rados.rados.0.smithi137.stdout:3952: left oid 12 (ObjNum 1227 snap 374 seq_num 1227) 2024-03-04T06:55:05.318 INFO:tasks.rados.rados.0.smithi137.stdout:3953: seq_num 1228 ranges {3063808=573440,3637248=761856,4399104=40960} 2024-03-04T06:55:05.335 INFO:tasks.rados.rados.0.smithi137.stdout:3953: writing smithi13777483-29 from 3063808 to 3637248 tid 1 2024-03-04T06:55:05.341 INFO:tasks.rados.rados.0.smithi137.stdout:3953: writing smithi13777483-29 from 3637248 to 4399104 tid 2 2024-03-04T06:55:05.341 INFO:tasks.rados.rados.0.smithi137.stdout:3953: writing smithi13777483-29 from 4399104 to 4440064 tid 3 2024-03-04T06:55:05.341 INFO:tasks.rados.rados.0.smithi137.stdout:3950: done (3 left) 2024-03-04T06:55:05.341 INFO:tasks.rados.rados.0.smithi137.stdout:3951: done (2 left) 2024-03-04T06:55:05.341 INFO:tasks.rados.rados.0.smithi137.stdout:3952: done (1 left) 2024-03-04T06:55:05.341 INFO:tasks.rados.rados.0.smithi137.stdout:3954: read oid 40 snap -1 2024-03-04T06:55:05.342 INFO:tasks.rados.rados.0.smithi137.stdout:3954: expect deleted 2024-03-04T06:55:05.342 INFO:tasks.rados.rados.0.smithi137.stdout:3955: rollback oid 10 current snap is 374 2024-03-04T06:55:05.342 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 10 to 364 2024-03-04T06:55:05.342 INFO:tasks.rados.rados.0.smithi137.stdout:3956: copy_from oid 35 from oid 25 current snap is 374 2024-03-04T06:55:05.342 INFO:tasks.rados.rados.0.smithi137.stdout:3957: read oid 20 snap -1 2024-03-04T06:55:05.342 INFO:tasks.rados.rados.0.smithi137.stdout:3957: expect (ObjNum 1122 snap 339 seq_num 1122) 2024-03-04T06:55:05.342 INFO:tasks.rados.rados.0.smithi137.stdout:3958: read oid 33 snap -1 2024-03-04T06:55:05.342 INFO:tasks.rados.rados.0.smithi137.stdout:3958: expect (ObjNum 1214 snap 369 seq_num 1214) 2024-03-04T06:55:05.342 INFO:tasks.rados.rados.0.smithi137.stdout:3959: read oid 46 snap -1 2024-03-04T06:55:05.342 INFO:tasks.rados.rados.0.smithi137.stdout:3959: expect (ObjNum 1111 snap 332 seq_num 1111) 2024-03-04T06:55:05.342 INFO:tasks.rados.rados.0.smithi137.stdout:3960: read oid 21 snap 367 2024-03-04T06:55:05.342 INFO:tasks.rados.rados.0.smithi137.stdout:3960: expect (ObjNum 1205 snap 367 seq_num 1205) 2024-03-04T06:55:05.343 INFO:tasks.rados.rados.0.smithi137.stdout:3961: snap_remove snap 357 2024-03-04T06:55:05.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:55:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:55:05] "GET /metrics HTTP/1.1" 200 36342 "" "Prometheus/2.43.0" 2024-03-04T06:55:06.049 INFO:tasks.rados.rados.0.smithi137.stdout:3961: done (8 left) 2024-03-04T06:55:06.049 INFO:tasks.rados.rados.0.smithi137.stdout:3962: snap_remove snap 369 2024-03-04T06:55:06.049 INFO:tasks.rados.rados.0.smithi137.stdout:3953: finishing write tid 1 to smithi13777483-29 2024-03-04T06:55:06.049 INFO:tasks.rados.rados.0.smithi137.stdout:3955: finishing rollback tid 1 to smithi13777483-10 2024-03-04T06:55:06.050 INFO:tasks.rados.rados.0.smithi137.stdout:3953: finishing write tid 2 to smithi13777483-29 2024-03-04T06:55:06.050 INFO:tasks.rados.rados.0.smithi137.stdout:3955: finishing rollback tid 2 to smithi13777483-10 2024-03-04T06:55:06.050 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 10 v 17031 (ObjNum 1185 snap 360 seq_num 1185) dirty exists 2024-03-04T06:55:06.050 INFO:tasks.rados.rados.0.smithi137.stdout:3953: finishing write tid 3 to smithi13777483-29 2024-03-04T06:55:06.050 INFO:tasks.rados.rados.0.smithi137.stdout:3953: finishing write tid 4 to smithi13777483-29 2024-03-04T06:55:06.050 INFO:tasks.rados.rados.0.smithi137.stdout:3953: finishing write tid 5 to smithi13777483-29 2024-03-04T06:55:06.050 INFO:tasks.rados.rados.0.smithi137.stdout:3953: oid 29 updating version 0 to 16990 2024-03-04T06:55:06.050 INFO:tasks.rados.rados.0.smithi137.stdout:3953: oid 29 version 16990 is already newer than 16988 2024-03-04T06:55:06.050 INFO:tasks.rados.rados.0.smithi137.stdout:3953: oid 29 version 16990 is already newer than 16987 2024-03-04T06:55:06.050 INFO:tasks.rados.rados.0.smithi137.stdout:3953: oid 29 version 16990 is already newer than 16989 2024-03-04T06:55:06.051 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16990 (ObjNum 1228 snap 374 seq_num 1228) dirty exists 2024-03-04T06:55:06.051 INFO:tasks.rados.rados.0.smithi137.stdout:3953: left oid 29 (ObjNum 1228 snap 374 seq_num 1228) 2024-03-04T06:55:06.051 INFO:tasks.rados.rados.0.smithi137.stdout:3959: expect (ObjNum 1111 snap 332 seq_num 1111) 2024-03-04T06:55:06.166 INFO:tasks.rados.rados.0.smithi137.stdout:3960: expect (ObjNum 1205 snap 367 seq_num 1205) 2024-03-04T06:55:06.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:06 smithi137 ceph-mon[88869]: pgmap v909: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1003 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 15 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-03-04T06:55:06.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:06 smithi137 ceph-mon[91314]: pgmap v909: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1003 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 15 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-03-04T06:55:06.294 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:55:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:55:06.049+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:06.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:06.054+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:06.294 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:06.054+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:06.294 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:55:06 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:55:06.056+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:06.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:06 smithi203 ceph-mon[85573]: pgmap v909: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1003 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 15 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-03-04T06:55:06.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:55:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:55:06.049+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:06.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:06.053+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:06.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:06.053+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:06.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:06.143+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:06.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:06.051+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:55:06.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:06.052+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:06.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:06.052+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:06.402 INFO:tasks.rados.rados.0.smithi137.stdout:3957: expect (ObjNum 1122 snap 339 seq_num 1122) 2024-03-04T06:55:06.507 INFO:tasks.rados.rados.0.smithi137.stdout:3958: expect (ObjNum 1214 snap 369 seq_num 1214) 2024-03-04T06:55:06.731 INFO:tasks.rados.rados.0.smithi137.stdout:3956: finishing copy_from racing read to smithi13777483-35 2024-03-04T06:55:06.731 INFO:tasks.rados.rados.0.smithi137.stdout:3956: finishing copy_from to smithi13777483-35 2024-03-04T06:55:06.732 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 35 v 16971 (ObjNum 1161 snap 354 seq_num 1161) dirty exists 2024-03-04T06:55:07.055 INFO:tasks.rados.rados.0.smithi137.stdout:3953: done (8 left) 2024-03-04T06:55:07.055 INFO:tasks.rados.rados.0.smithi137.stdout:3954: done (7 left) 2024-03-04T06:55:07.056 INFO:tasks.rados.rados.0.smithi137.stdout:3955: done (6 left) 2024-03-04T06:55:07.056 INFO:tasks.rados.rados.0.smithi137.stdout:3956: done (5 left) 2024-03-04T06:55:07.056 INFO:tasks.rados.rados.0.smithi137.stdout:3957: done (4 left) 2024-03-04T06:55:07.056 INFO:tasks.rados.rados.0.smithi137.stdout:3958: done (3 left) 2024-03-04T06:55:07.056 INFO:tasks.rados.rados.0.smithi137.stdout:3959: done (2 left) 2024-03-04T06:55:07.056 INFO:tasks.rados.rados.0.smithi137.stdout:3960: done (1 left) 2024-03-04T06:55:07.056 INFO:tasks.rados.rados.0.smithi137.stdout:3962: done (0 left) 2024-03-04T06:55:07.056 INFO:tasks.rados.rados.0.smithi137.stdout:3963: delete oid 17 current snap is 374 2024-03-04T06:55:07.060 INFO:tasks.rados.rados.0.smithi137.stdout:3963: done (0 left) 2024-03-04T06:55:07.060 INFO:tasks.rados.rados.0.smithi137.stdout:3964: read oid 24 snap -1 2024-03-04T06:55:07.061 INFO:tasks.rados.rados.0.smithi137.stdout:3964: expect deleted 2024-03-04T06:55:07.063 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 29 current snap is 374 2024-03-04T06:55:07.063 INFO:tasks.rados.rados.0.smithi137.stdout:3965: seq_num 1230 ranges {4440064=606208,5046272=532480,5578752=270336} 2024-03-04T06:55:07.088 INFO:tasks.rados.rados.0.smithi137.stdout:3965: writing smithi13777483-29 from 4440064 to 5046272 tid 1 2024-03-04T06:55:07.091 INFO:tasks.rados.rados.0.smithi137.stdout:3965: writing smithi13777483-29 from 5046272 to 5578752 tid 2 2024-03-04T06:55:07.093 INFO:tasks.rados.rados.0.smithi137.stdout:3965: writing smithi13777483-29 from 5578752 to 5849088 tid 3 2024-03-04T06:55:07.093 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 374 2024-03-04T06:55:07.094 INFO:tasks.rados.rados.0.smithi137.stdout:3966: seq_num 1231 ranges {1105920=622592,1728512=417792,2146304=385024} 2024-03-04T06:55:07.102 INFO:tasks.rados.rados.0.smithi137.stdout:3966: writing smithi13777483-30 from 1105920 to 1728512 tid 1 2024-03-04T06:55:07.105 INFO:tasks.rados.rados.0.smithi137.stdout:3966: writing smithi13777483-30 from 1728512 to 2146304 tid 2 2024-03-04T06:55:07.108 INFO:tasks.rados.rados.0.smithi137.stdout:3966: writing smithi13777483-30 from 2146304 to 2531328 tid 3 2024-03-04T06:55:07.109 INFO:tasks.rados.rados.0.smithi137.stdout:3967: rollback oid 39 current snap is 374 2024-03-04T06:55:07.109 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 39 to 372 2024-03-04T06:55:07.109 INFO:tasks.rados.rados.0.smithi137.stdout:3965: finishing write tid 1 to smithi13777483-29 2024-03-04T06:55:07.109 INFO:tasks.rados.rados.0.smithi137.stdout:3965: finishing write tid 2 to smithi13777483-29 2024-03-04T06:55:07.109 INFO:tasks.rados.rados.0.smithi137.stdout:3965: finishing write tid 3 to smithi13777483-29 2024-03-04T06:55:07.109 INFO:tasks.rados.rados.0.smithi137.stdout:3965: finishing write tid 4 to smithi13777483-29 2024-03-04T06:55:07.109 INFO:tasks.rados.rados.0.smithi137.stdout:3965: finishing write tid 5 to smithi13777483-29 2024-03-04T06:55:07.109 INFO:tasks.rados.rados.0.smithi137.stdout:3965: oid 29 updating version 0 to 16993 2024-03-04T06:55:07.109 INFO:tasks.rados.rados.0.smithi137.stdout:3965: oid 29 updating version 16993 to 16994 2024-03-04T06:55:07.109 INFO:tasks.rados.rados.0.smithi137.stdout:3965: oid 29 version 16994 is already newer than 16991 2024-03-04T06:55:07.109 INFO:tasks.rados.rados.0.smithi137.stdout:3965: oid 29 version 16994 is already newer than 16992 2024-03-04T06:55:07.110 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16994 (ObjNum 1230 snap 374 seq_num 1230) dirty exists 2024-03-04T06:55:07.110 INFO:tasks.rados.rados.0.smithi137.stdout:3965: left oid 29 (ObjNum 1230 snap 374 seq_num 1230) 2024-03-04T06:55:07.110 INFO:tasks.rados.rados.0.smithi137.stdout:3966: finishing write tid 1 to smithi13777483-30 2024-03-04T06:55:07.110 INFO:tasks.rados.rados.0.smithi137.stdout:3964: done (3 left) 2024-03-04T06:55:07.110 INFO:tasks.rados.rados.0.smithi137.stdout:3965: done (2 left) 2024-03-04T06:55:07.110 INFO:tasks.rados.rados.0.smithi137.stdout:3968: snap_remove snap 368 2024-03-04T06:55:07.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:07.052+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:07.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:07.052+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:07.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:55:07.059+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:07.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:07.060+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:55:07.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:07.060+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:07.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:07.060+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:07.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:07.067+0000 7fa0aabe7700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:55:07.347 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:07.067+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:07.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-mon[85573]: osdmap e816: 8 total, 8 up, 8 in 2024-03-04T06:55:07.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:07.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:07.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:07.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:07.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:07.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:07.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:07.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:07.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:07.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:07.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:07 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:55:07.542 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:55:07.059+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:07.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:55:07.060+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:07.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:07.053+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:55:07.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:07.053+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:07.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:07.054+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:07.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[88869]: osdmap e816: 8 total, 8 up, 8 in 2024-03-04T06:55:07.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:07.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:07.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:07.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:07.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:07.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:07.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:07.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:07.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:07.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:07.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:55:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[91314]: osdmap e816: 8 total, 8 up, 8 in 2024-03-04T06:55:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:07.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:07.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:07.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:07.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:07 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:55:08.061 INFO:tasks.rados.rados.0.smithi137.stdout:3968: done (2 left) 2024-03-04T06:55:08.062 INFO:tasks.rados.rados.0.smithi137.stdout:3969: rollback oid 28 current snap is 374 2024-03-04T06:55:08.062 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 28 to 373 2024-03-04T06:55:08.062 INFO:tasks.rados.rados.0.smithi137.stdout:3970: read oid 34 snap 316 2024-03-04T06:55:08.062 INFO:tasks.rados.rados.0.smithi137.stdout:3970: expect (ObjNum 1029 snap 306 seq_num 1029) 2024-03-04T06:55:08.062 INFO:tasks.rados.rados.0.smithi137.stdout:3971: read oid 24 snap -1 2024-03-04T06:55:08.062 INFO:tasks.rados.rados.0.smithi137.stdout:3971: expect deleted 2024-03-04T06:55:08.062 INFO:tasks.rados.rados.0.smithi137.stdout:3972: copy_from oid 27 from oid 2 current snap is 374 2024-03-04T06:55:08.062 INFO:tasks.rados.rados.0.smithi137.stdout:3973: rmattr oid 25 current snap is 374 2024-03-04T06:55:08.062 INFO:tasks.rados.rados.0.smithi137.stdout:3973: done (6 left) 2024-03-04T06:55:08.062 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 12 current snap is 374 2024-03-04T06:55:08.062 INFO:tasks.rados.rados.0.smithi137.stdout:3974: seq_num 1232 ranges {14327808=638976,14966784=753664,15720448=49152} 2024-03-04T06:55:08.141 INFO:tasks.rados.rados.0.smithi137.stdout:3974: writing smithi13777483-12 from 14327808 to 14966784 tid 1 2024-03-04T06:55:08.146 INFO:tasks.rados.rados.0.smithi137.stdout:3974: writing smithi13777483-12 from 14966784 to 15720448 tid 2 2024-03-04T06:55:08.146 INFO:tasks.rados.rados.0.smithi137.stdout:3974: writing smithi13777483-12 from 15720448 to 15769600 tid 3 2024-03-04T06:55:08.146 INFO:tasks.rados.rados.0.smithi137.stdout:3975: snap_remove snap 342 2024-03-04T06:55:08.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:55:08.065+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:08.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:08.063+0000 7f1a48196700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:55:08.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:08.063+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:08.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:08.063+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:08.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:08.067+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:08.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:08.076+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:08.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:08.076+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:08.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: pgmap v911: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1003 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-03-04T06:55:08.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:08.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:08.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:08.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:08.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: osdmap e817: 8 total, 8 up, 8 in 2024-03-04T06:55:08.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:08.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:08.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:08.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:08.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:08.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:08.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:55:08.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:55:08.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:55:08.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:55:08.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:55:08.542 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:55:08.069+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:08.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:08.067+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:08.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:08.075+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:08.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: pgmap v911: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1003 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-03-04T06:55:08.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:08.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:08.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:08.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:08.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: osdmap e817: 8 total, 8 up, 8 in 2024-03-04T06:55:08.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:08.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:08.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:08.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:08.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:08.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:08.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:55:08.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:55:08.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:55:08.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:55:08.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:55:08.545 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:55:08.072+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:08.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: pgmap v911: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1003 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-03-04T06:55:08.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:08.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:08.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:08.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:08.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: osdmap e817: 8 total, 8 up, 8 in 2024-03-04T06:55:08.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:08.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:08.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:08.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:08.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:08.545 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1a3=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:08.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:55:08.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:55:08.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:55:08.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:55:08.546 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:55:09.072 INFO:tasks.rados.rados.0.smithi137.stdout:3966: finishing write tid 2 to smithi13777483-30 2024-03-04T06:55:09.072 INFO:tasks.rados.rados.0.smithi137.stdout:3966: finishing write tid 3 to smithi13777483-30 2024-03-04T06:55:09.072 INFO:tasks.rados.rados.0.smithi137.stdout:3966: finishing write tid 4 to smithi13777483-30 2024-03-04T06:55:09.072 INFO:tasks.rados.rados.0.smithi137.stdout:3966: finishing write tid 5 to smithi13777483-30 2024-03-04T06:55:09.072 INFO:tasks.rados.rados.0.smithi137.stdout:3966: oid 30 updating version 0 to 16989 2024-03-04T06:55:09.072 INFO:tasks.rados.rados.0.smithi137.stdout:3966: oid 30 updating version 16989 to 16991 2024-03-04T06:55:09.072 INFO:tasks.rados.rados.0.smithi137.stdout:3966: oid 30 version 16991 is already newer than 16988 2024-03-04T06:55:09.073 INFO:tasks.rados.rados.0.smithi137.stdout:3966: oid 30 version 16991 is already newer than 16990 2024-03-04T06:55:09.073 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16991 (ObjNum 1231 snap 374 seq_num 1231) dirty exists 2024-03-04T06:55:09.073 INFO:tasks.rados.rados.0.smithi137.stdout:3966: left oid 30 (ObjNum 1231 snap 374 seq_num 1231) 2024-03-04T06:55:09.073 INFO:tasks.rados.rados.0.smithi137.stdout:3967: finishing rollback tid 0 to smithi13777483-39 2024-03-04T06:55:09.073 INFO:tasks.rados.rados.0.smithi137.stdout:3967: finishing rollback tid 1 to smithi13777483-39 2024-03-04T06:55:09.073 INFO:tasks.rados.rados.0.smithi137.stdout:3967: finishing rollback tid 2 to smithi13777483-39 2024-03-04T06:55:09.073 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 17003 (ObjNum 1188 snap 360 seq_num 1188) dirty exists 2024-03-04T06:55:09.073 INFO:tasks.rados.rados.0.smithi137.stdout:3969: finishing rollback tid 0 to smithi13777483-28 2024-03-04T06:55:09.073 INFO:tasks.rados.rados.0.smithi137.stdout:3969: finishing rollback tid 1 to smithi13777483-28 2024-03-04T06:55:09.073 INFO:tasks.rados.rados.0.smithi137.stdout:3969: finishing rollback tid 2 to smithi13777483-28 2024-03-04T06:55:09.073 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 28 v 16999 (ObjNum 1178 snap 359 seq_num 1178) dirty exists 2024-03-04T06:55:09.074 INFO:tasks.rados.rados.0.smithi137.stdout:3970: expect (ObjNum 1029 snap 306 seq_num 1029) 2024-03-04T06:55:09.114 INFO:tasks.rados.rados.0.smithi137.stdout:3972: finishing copy_from racing read to smithi13777483-27 2024-03-04T06:55:09.115 INFO:tasks.rados.rados.0.smithi137.stdout:3972: finishing copy_from to smithi13777483-27 2024-03-04T06:55:09.115 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 27 v 16961 (ObjNum 1208 snap 368 seq_num 1208) dirty exists 2024-03-04T06:55:09.115 INFO:tasks.rados.rados.0.smithi137.stdout:3974: finishing write tid 1 to smithi13777483-12 2024-03-04T06:55:09.115 INFO:tasks.rados.rados.0.smithi137.stdout:3974: finishing write tid 2 to smithi13777483-12 2024-03-04T06:55:09.115 INFO:tasks.rados.rados.0.smithi137.stdout:3974: finishing write tid 3 to smithi13777483-12 2024-03-04T06:55:09.115 INFO:tasks.rados.rados.0.smithi137.stdout:3974: finishing write tid 4 to smithi13777483-12 2024-03-04T06:55:09.115 INFO:tasks.rados.rados.0.smithi137.stdout:3974: finishing write tid 5 to smithi13777483-12 2024-03-04T06:55:09.115 INFO:tasks.rados.rados.0.smithi137.stdout:3974: oid 12 updating version 0 to 16992 2024-03-04T06:55:09.115 INFO:tasks.rados.rados.0.smithi137.stdout:3974: oid 12 updating version 16992 to 16995 2024-03-04T06:55:09.115 INFO:tasks.rados.rados.0.smithi137.stdout:3974: oid 12 version 16995 is already newer than 16993 2024-03-04T06:55:09.115 INFO:tasks.rados.rados.0.smithi137.stdout:3974: oid 12 version 16995 is already newer than 16994 2024-03-04T06:55:09.115 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 12 v 16995 (ObjNum 1232 snap 374 seq_num 1232) dirty exists 2024-03-04T06:55:09.116 INFO:tasks.rados.rados.0.smithi137.stdout:3974: left oid 12 (ObjNum 1232 snap 374 seq_num 1232) 2024-03-04T06:55:09.116 INFO:tasks.rados.rados.0.smithi137.stdout:3966: done (7 left) 2024-03-04T06:55:09.116 INFO:tasks.rados.rados.0.smithi137.stdout:3967: done (6 left) 2024-03-04T06:55:09.116 INFO:tasks.rados.rados.0.smithi137.stdout:3969: done (5 left) 2024-03-04T06:55:09.116 INFO:tasks.rados.rados.0.smithi137.stdout:3970: done (4 left) 2024-03-04T06:55:09.116 INFO:tasks.rados.rados.0.smithi137.stdout:3971: done (3 left) 2024-03-04T06:55:09.116 INFO:tasks.rados.rados.0.smithi137.stdout:3972: done (2 left) 2024-03-04T06:55:09.116 INFO:tasks.rados.rados.0.smithi137.stdout:3974: done (1 left) 2024-03-04T06:55:09.116 INFO:tasks.rados.rados.0.smithi137.stdout:3975: done (0 left) 2024-03-04T06:55:09.116 INFO:tasks.rados.rados.0.smithi137.stdout:3976: rollback oid 38 current snap is 374 2024-03-04T06:55:09.116 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 38 to 370 2024-03-04T06:55:09.116 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 14 current snap is 374 2024-03-04T06:55:09.116 INFO:tasks.rados.rados.0.smithi137.stdout:3977: seq_num 1233 ranges {0=655360,655360=638976,1294336=163840} 2024-03-04T06:55:09.118 INFO:tasks.rados.rados.0.smithi137.stdout:3977: writing smithi13777483-14 from 0 to 655360 tid 1 2024-03-04T06:55:09.121 INFO:tasks.rados.rados.0.smithi137.stdout:3977: writing smithi13777483-14 from 655360 to 1294336 tid 2 2024-03-04T06:55:09.123 INFO:tasks.rados.rados.0.smithi137.stdout:3977: writing smithi13777483-14 from 1294336 to 1458176 tid 3 2024-03-04T06:55:09.123 INFO:tasks.rados.rados.0.smithi137.stdout:3978: delete oid 21 current snap is 374 2024-03-04T06:55:09.123 INFO:tasks.rados.rados.0.smithi137.stdout:3976: finishing rollback tid 0 to smithi13777483-38 2024-03-04T06:55:09.123 INFO:tasks.rados.rados.0.smithi137.stdout:3976: finishing rollback tid 1 to smithi13777483-38 2024-03-04T06:55:09.123 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 38 v 17001 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-03-04T06:55:09.123 INFO:tasks.rados.rados.0.smithi137.stdout:3977: finishing write tid 1 to smithi13777483-14 2024-03-04T06:55:09.125 INFO:tasks.rados.rados.0.smithi137.stdout:3976: done (2 left) 2024-03-04T06:55:09.126 INFO:tasks.rados.rados.0.smithi137.stdout:3978: done (1 left) 2024-03-04T06:55:09.126 INFO:tasks.rados.rados.0.smithi137.stdout:3979: read oid 2 snap -1 2024-03-04T06:55:09.126 INFO:tasks.rados.rados.0.smithi137.stdout:3979: expect (ObjNum 1208 snap 368 seq_num 1208) 2024-03-04T06:55:09.126 INFO:tasks.rados.rados.0.smithi137.stdout:3980: read oid 43 snap -1 2024-03-04T06:55:09.126 INFO:tasks.rados.rados.0.smithi137.stdout:3980: expect deleted 2024-03-04T06:55:09.126 INFO:tasks.rados.rados.0.smithi137.stdout:3981: copy_from oid 48 from oid 18 current snap is 374 2024-03-04T06:55:09.126 INFO:tasks.rados.rados.0.smithi137.stdout:3982: snap_remove snap 372 2024-03-04T06:55:09.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:55:09.073+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:09.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:09.080+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:09.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:09.080+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:09.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:09.068+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:55:09.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:09.068+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:09.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:09.084+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:09.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:09.084+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:55:09.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:09.084+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-mon[85573]: osdmap e818: 8 total, 8 up, 8 in 2024-03-04T06:55:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:09.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:09.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:09.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:55:09.542 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:55:09.071+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:09.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:55:09.082+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:09.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:09.074+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:55:09.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:09.075+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:09.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:09.076+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:09.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[91314]: osdmap e818: 8 total, 8 up, 8 in 2024-03-04T06:55:09.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:09.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:09.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:09.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:09.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:09.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:09.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:09.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:09.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:09.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:09.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:55:09.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[88869]: osdmap e818: 8 total, 8 up, 8 in 2024-03-04T06:55:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:09.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:55:10.084 INFO:tasks.rados.rados.0.smithi137.stdout:3982: done (4 left) 2024-03-04T06:55:10.084 INFO:tasks.rados.rados.0.smithi137.stdout:3983: copy_from oid 3 from oid 1 current snap is 374 2024-03-04T06:55:10.084 INFO:tasks.rados.rados.0.smithi137.stdout:3977: finishing write tid 2 to smithi13777483-14 2024-03-04T06:55:10.084 INFO:tasks.rados.rados.0.smithi137.stdout:3977: finishing write tid 3 to smithi13777483-14 2024-03-04T06:55:10.084 INFO:tasks.rados.rados.0.smithi137.stdout:3977: finishing write tid 4 to smithi13777483-14 2024-03-04T06:55:10.084 INFO:tasks.rados.rados.0.smithi137.stdout:3977: finishing write tid 5 to smithi13777483-14 2024-03-04T06:55:10.085 INFO:tasks.rados.rados.0.smithi137.stdout:3977: oid 14 updating version 0 to 16978 2024-03-04T06:55:10.085 INFO:tasks.rados.rados.0.smithi137.stdout:3977: oid 14 version 16978 is already newer than 16976 2024-03-04T06:55:10.085 INFO:tasks.rados.rados.0.smithi137.stdout:3977: oid 14 version 16978 is already newer than 16977 2024-03-04T06:55:10.085 INFO:tasks.rados.rados.0.smithi137.stdout:3977: oid 14 version 16978 is already newer than 16975 2024-03-04T06:55:10.085 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 14 v 16978 (ObjNum 1233 snap 374 seq_num 1233) dirty exists 2024-03-04T06:55:10.085 INFO:tasks.rados.rados.0.smithi137.stdout:3977: left oid 14 (ObjNum 1233 snap 374 seq_num 1233) 2024-03-04T06:55:10.085 INFO:tasks.rados.rados.0.smithi137.stdout:3979: expect (ObjNum 1208 snap 368 seq_num 1208) 2024-03-04T06:55:10.152 INFO:tasks.rados.rados.0.smithi137.stdout:3981: finishing copy_from racing read to smithi13777483-48 2024-03-04T06:55:10.152 INFO:tasks.rados.rados.0.smithi137.stdout:3981: finishing copy_from to smithi13777483-48 2024-03-04T06:55:10.152 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 48 v 16985 (ObjNum 1187 snap 360 seq_num 1187) dirty exists 2024-03-04T06:55:10.152 INFO:tasks.rados.rados.0.smithi137.stdout:3983: finishing copy_from racing read to smithi13777483-3 2024-03-04T06:55:10.153 INFO:tasks.rados.rados.0.smithi137.stdout:3983: finishing copy_from to smithi13777483-3 2024-03-04T06:55:10.153 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 3 v 16961 (ObjNum 1208 snap 368 seq_num 1208) dirty exists 2024-03-04T06:55:10.153 INFO:tasks.rados.rados.0.smithi137.stdout:3977: done (4 left) 2024-03-04T06:55:10.153 INFO:tasks.rados.rados.0.smithi137.stdout:3979: done (3 left) 2024-03-04T06:55:10.153 INFO:tasks.rados.rados.0.smithi137.stdout:3980: done (2 left) 2024-03-04T06:55:10.153 INFO:tasks.rados.rados.0.smithi137.stdout:3981: done (1 left) 2024-03-04T06:55:10.153 INFO:tasks.rados.rados.0.smithi137.stdout:3983: done (0 left) 2024-03-04T06:55:10.153 INFO:tasks.rados.rados.0.smithi137.stdout:3984: read oid 28 snap -1 2024-03-04T06:55:10.153 INFO:tasks.rados.rados.0.smithi137.stdout:3984: expect (ObjNum 1178 snap 359 seq_num 1178) 2024-03-04T06:55:10.153 INFO:tasks.rados.rados.0.smithi137.stdout:3985: snap_create 2024-03-04T06:55:10.202 INFO:tasks.rados.rados.0.smithi137.stdout:3984: expect (ObjNum 1178 snap 359 seq_num 1178) 2024-03-04T06:55:10.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:55:10.090+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:10.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:10.088+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:10.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:10.090+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:10.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:10.080+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:55:10.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:10.080+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:10.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:10.080+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:10.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-mon[85573]: pgmap v914: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1020 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 18 MiB/s rd, 2.3 MiB/s wr, 14 op/s 2024-03-04T06:55:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-mon[85573]: osdmap e819: 8 total, 8 up, 8 in 2024-03-04T06:55:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:10.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:10.542 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:10.094+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:10.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:10.094+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:10.543 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:55:10.087+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:10.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:55:10.084+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:10.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[91314]: pgmap v914: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1020 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 18 MiB/s rd, 2.3 MiB/s wr, 14 op/s 2024-03-04T06:55:10.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:10.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[91314]: osdmap e819: 8 total, 8 up, 8 in 2024-03-04T06:55:10.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:10.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:10.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:10.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:10.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:10.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:10.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:10.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[88869]: pgmap v914: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1020 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 18 MiB/s rd, 2.3 MiB/s wr, 14 op/s 2024-03-04T06:55:10.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:10.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[88869]: osdmap e819: 8 total, 8 up, 8 in 2024-03-04T06:55:10.544 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:10.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:10.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:10.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:10.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:10.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:10.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:10 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:10.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:10.466+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:11.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:11.085+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:11.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:11.085+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:11.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:55:11.091+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:11.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:11.090+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:55:11.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:11.090+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:11.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:11.090+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:11.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:11.091+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:55:11.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:11.091+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-mon[85573]: osdmap e820: 8 total, 8 up, 8 in 2024-03-04T06:55:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:11.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:11.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:11.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:11.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:11 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:11.542 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:55:11.085+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:11.543 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:55:11.089+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:11.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:11.089+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:55:11.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:11.089+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:11.543 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:11.089+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:11.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[91314]: osdmap e820: 8 total, 8 up, 8 in 2024-03-04T06:55:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:11.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[88869]: osdmap e820: 8 total, 8 up, 8 in 2024-03-04T06:55:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:11.545 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:11 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:11.629 INFO:tasks.rados.rados.0.smithi137.stdout:3984: done (1 left) 2024-03-04T06:55:11.629 INFO:tasks.rados.rados.0.smithi137.stdout:3985: done (0 left) 2024-03-04T06:55:11.629 INFO:tasks.rados.rados.0.smithi137.stdout:3986: snap_remove snap 370 2024-03-04T06:55:12.091 INFO:tasks.rados.rados.0.smithi137.stdout:3986: done (0 left) 2024-03-04T06:55:12.091 INFO:tasks.rados.rados.0.smithi137.stdout:3987: rmattr oid 31 current snap is 375 2024-03-04T06:55:12.092 INFO:tasks.rados.rados.0.smithi137.stdout:3988: delete oid 37 current snap is 375 2024-03-04T06:55:12.096 INFO:tasks.rados.rados.0.smithi137.stdout:3988: done (1 left) 2024-03-04T06:55:12.096 INFO:tasks.rados.rados.0.smithi137.stdout:3989: snap_create 2024-03-04T06:55:12.100 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 31 v 16988 (ObjNum 33 snap 0 seq_num 3184499752) dirty exists 2024-03-04T06:55:12.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:12.095+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:12.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:12.099+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:12.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:12.091+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:12.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:12.091+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T06:55:12.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:12.091+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:12.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:55:12.097+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:12.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:12.100+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: pgmap v917: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1023 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 11 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-03-04T06:55:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: osdmap e821: 8 total, 8 up, 8 in 2024-03-04T06:55:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:12.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:12.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:12 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:12.444 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:12.095+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:12.444 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:12.095+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:12.444 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:55:12.091+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:12.444 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:55:12.095+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:12.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:12.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:12.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: pgmap v917: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1023 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 11 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-03-04T06:55:12.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:12.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:12.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:12.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: osdmap e821: 8 total, 8 up, 8 in 2024-03-04T06:55:12.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:12.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:12.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:12.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:12.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:12.445 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:12.446 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:12.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:12.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:12.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: pgmap v917: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1023 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 11 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-03-04T06:55:12.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:12.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:12.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:12.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: osdmap e821: 8 total, 8 up, 8 in 2024-03-04T06:55:12.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:12.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:12.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:12.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:12.446 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 19f=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:12.447 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:12.447 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:12 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:13.099 INFO:tasks.rados.rados.0.smithi137.stdout:3987: done (1 left) 2024-03-04T06:55:13.099 INFO:tasks.rados.rados.0.smithi137.stdout:3989: done (0 left) 2024-03-04T06:55:13.099 INFO:tasks.rados.rados.0.smithi137.stdout:3990: read oid 37 snap -1 2024-03-04T06:55:13.099 INFO:tasks.rados.rados.0.smithi137.stdout:3990: expect deleted 2024-03-04T06:55:13.099 INFO:tasks.rados.rados.0.smithi137.stdout:3991: read oid 15 snap -1 2024-03-04T06:55:13.099 INFO:tasks.rados.rados.0.smithi137.stdout:3991: expect (ObjNum 1122 snap 339 seq_num 1122) 2024-03-04T06:55:13.099 INFO:tasks.rados.rados.0.smithi137.stdout:3992: copy_from oid 18 from oid 45 current snap is 376 2024-03-04T06:55:13.100 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 30 current snap is 376 2024-03-04T06:55:13.100 INFO:tasks.rados.rados.0.smithi137.stdout:3993: seq_num 1236 ranges {2531328=704512,3235840=688128,3923968=114688} 2024-03-04T06:55:13.117 INFO:tasks.rados.rados.0.smithi137.stdout:3993: writing smithi13777483-30 from 2531328 to 3235840 tid 1 2024-03-04T06:55:13.121 INFO:tasks.rados.rados.0.smithi137.stdout:3993: writing smithi13777483-30 from 3235840 to 3923968 tid 2 2024-03-04T06:55:13.122 INFO:tasks.rados.rados.0.smithi137.stdout:3993: writing smithi13777483-30 from 3923968 to 4038656 tid 3 2024-03-04T06:55:13.122 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 29 current snap is 376 2024-03-04T06:55:13.122 INFO:tasks.rados.rados.0.smithi137.stdout:3994: seq_num 1237 ranges {5849088=720896,6569984=573440,7143424=229376} 2024-03-04T06:55:13.157 INFO:tasks.rados.rados.0.smithi137.stdout:3994: writing smithi13777483-29 from 5849088 to 6569984 tid 1 2024-03-04T06:55:13.160 INFO:tasks.rados.rados.0.smithi137.stdout:3994: writing smithi13777483-29 from 6569984 to 7143424 tid 2 2024-03-04T06:55:13.162 INFO:tasks.rados.rados.0.smithi137.stdout:3994: writing smithi13777483-29 from 7143424 to 7372800 tid 3 2024-03-04T06:55:13.162 INFO:tasks.rados.rados.0.smithi137.stdout:3995: rollback oid 39 current snap is 376 2024-03-04T06:55:13.162 INFO:tasks.rados.rados.0.smithi137.stdout:rollback oid 39 to 373 2024-03-04T06:55:13.162 INFO:tasks.rados.rados.0.smithi137.stdout:3992: finishing copy_from racing read to smithi13777483-18 2024-03-04T06:55:13.162 INFO:tasks.rados.rados.0.smithi137.stdout:3992: finishing copy_from to smithi13777483-18 2024-03-04T06:55:13.162 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 18 v 16978 (ObjNum 1174 snap 358 seq_num 1174) dirty exists 2024-03-04T06:55:13.162 INFO:tasks.rados.rados.0.smithi137.stdout:3991: expect (ObjNum 1122 snap 339 seq_num 1122) 2024-03-04T06:55:13.273 INFO:tasks.rados.rados.0.smithi137.stdout:3993: finishing write tid 1 to smithi13777483-30 2024-03-04T06:55:13.273 INFO:tasks.rados.rados.0.smithi137.stdout:3990: done (5 left) 2024-03-04T06:55:13.273 INFO:tasks.rados.rados.0.smithi137.stdout:3991: done (4 left) 2024-03-04T06:55:13.273 INFO:tasks.rados.rados.0.smithi137.stdout:3992: done (3 left) 2024-03-04T06:55:13.273 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 1 current snap is 376 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:3993: finishing write tid 2 to smithi13777483-30 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:3993: finishing write tid 3 to smithi13777483-30 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:3993: finishing write tid 4 to smithi13777483-30 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:3993: finishing write tid 5 to smithi13777483-30 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:3993: oid 30 updating version 0 to 16997 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:3993: oid 30 updating version 16997 to 16998 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:3993: oid 30 updating version 16998 to 16999 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:3993: oid 30 version 16999 is already newer than 16996 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 30 v 16999 (ObjNum 1236 snap 376 seq_num 1236) dirty exists 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:3993: left oid 30 (ObjNum 1236 snap 376 seq_num 1236) 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:3994: finishing write tid 1 to smithi13777483-29 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:3994: finishing write tid 2 to smithi13777483-29 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:3994: finishing write tid 3 to smithi13777483-29 2024-03-04T06:55:13.274 INFO:tasks.rados.rados.0.smithi137.stdout:3994: finishing write tid 4 to smithi13777483-29 2024-03-04T06:55:13.275 INFO:tasks.rados.rados.0.smithi137.stdout:3994: finishing write tid 5 to smithi13777483-29 2024-03-04T06:55:13.275 INFO:tasks.rados.rados.0.smithi137.stdout:3994: oid 29 updating version 0 to 16997 2024-03-04T06:55:13.275 INFO:tasks.rados.rados.0.smithi137.stdout:3994: oid 29 updating version 16997 to 16998 2024-03-04T06:55:13.275 INFO:tasks.rados.rados.0.smithi137.stdout:3994: oid 29 version 16998 is already newer than 16995 2024-03-04T06:55:13.275 INFO:tasks.rados.rados.0.smithi137.stdout:3994: oid 29 version 16998 is already newer than 16996 2024-03-04T06:55:13.275 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 29 v 16998 (ObjNum 1237 snap 376 seq_num 1237) dirty exists 2024-03-04T06:55:13.275 INFO:tasks.rados.rados.0.smithi137.stdout:3994: left oid 29 (ObjNum 1237 snap 376 seq_num 1237) 2024-03-04T06:55:13.275 INFO:tasks.rados.rados.0.smithi137.stdout:3995: finishing rollback tid 0 to smithi13777483-39 2024-03-04T06:55:13.275 INFO:tasks.rados.rados.0.smithi137.stdout:3995: finishing rollback tid 1 to smithi13777483-39 2024-03-04T06:55:13.275 INFO:tasks.rados.rados.0.smithi137.stdout:3995: finishing rollback tid 2 to smithi13777483-39 2024-03-04T06:55:13.275 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 39 v 17006 (ObjNum 1188 snap 360 seq_num 1188) dirty exists 2024-03-04T06:55:13.275 INFO:tasks.rados.rados.0.smithi137.stdout:3996: seq_num 1238 ranges {1925120=737280,2662400=458752,3121152=344064} 2024-03-04T06:55:13.287 INFO:tasks.rados.rados.0.smithi137.stdout:3996: writing smithi13777483-1 from 1925120 to 2662400 tid 1 2024-03-04T06:55:13.290 INFO:tasks.rados.rados.0.smithi137.stdout:3996: writing smithi13777483-1 from 2662400 to 3121152 tid 2 2024-03-04T06:55:13.292 INFO:tasks.rados.rados.0.smithi137.stdout:3996: writing smithi13777483-1 from 3121152 to 3465216 tid 3 2024-03-04T06:55:13.292 INFO:tasks.rados.rados.0.smithi137.stdout:3993: done (3 left) 2024-03-04T06:55:13.293 INFO:tasks.rados.rados.0.smithi137.stdout:3994: done (2 left) 2024-03-04T06:55:13.293 INFO:tasks.rados.rados.0.smithi137.stdout:3995: done (1 left) 2024-03-04T06:55:13.293 INFO:tasks.rados.rados.0.smithi137.stdout:append oid 11 current snap is 376 2024-03-04T06:55:13.293 INFO:tasks.rados.rados.0.smithi137.stdout:3996: finishing write tid 1 to smithi13777483-1 2024-03-04T06:55:13.293 INFO:tasks.rados.rados.0.smithi137.stdout:3997: seq_num 1239 ranges {0=753664,753664=745472,1499136=57344} 2024-03-04T06:55:13.296 INFO:tasks.rados.rados.0.smithi137.stdout:3997: writing smithi13777483-11 from 0 to 753664 tid 1 2024-03-04T06:55:13.301 INFO:tasks.rados.rados.0.smithi137.stdout:3997: writing smithi13777483-11 from 753664 to 1499136 tid 2 2024-03-04T06:55:13.302 INFO:tasks.rados.rados.0.smithi137.stdout:3997: writing smithi13777483-11 from 1499136 to 1556480 tid 3 2024-03-04T06:55:13.302 INFO:tasks.rados.rados.0.smithi137.stdout:3998: copy_from oid 49 from oid 2 current snap is 376 2024-03-04T06:55:13.302 INFO:tasks.rados.rados.0.smithi137.stdout:3996: finishing write tid 2 to smithi13777483-1 2024-03-04T06:55:13.302 INFO:tasks.rados.rados.0.smithi137.stdout:3996: finishing write tid 3 to smithi13777483-1 2024-03-04T06:55:13.302 INFO:tasks.rados.rados.0.smithi137.stdout:3996: finishing write tid 4 to smithi13777483-1 2024-03-04T06:55:13.302 INFO:tasks.rados.rados.0.smithi137.stdout:3996: finishing write tid 5 to smithi13777483-1 2024-03-04T06:55:13.302 INFO:tasks.rados.rados.0.smithi137.stdout:3996: oid 1 updating version 0 to 16987 2024-03-04T06:55:13.303 INFO:tasks.rados.rados.0.smithi137.stdout:3996: oid 1 updating version 16987 to 16989 2024-03-04T06:55:13.303 INFO:tasks.rados.rados.0.smithi137.stdout:3996: oid 1 version 16989 is already newer than 16988 2024-03-04T06:55:13.303 INFO:tasks.rados.rados.0.smithi137.stdout:3996: oid 1 version 16989 is already newer than 16986 2024-03-04T06:55:13.303 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 1 v 16989 (ObjNum 1238 snap 376 seq_num 1238) dirty exists 2024-03-04T06:55:13.303 INFO:tasks.rados.rados.0.smithi137.stdout:3996: left oid 1 (ObjNum 1238 snap 376 seq_num 1238) 2024-03-04T06:55:13.303 INFO:tasks.rados.rados.0.smithi137.stdout:3997: finishing write tid 1 to smithi13777483-11 2024-03-04T06:55:13.303 INFO:tasks.rados.rados.0.smithi137.stdout:3996: done (2 left) 2024-03-04T06:55:13.303 INFO:tasks.rados.rados.0.smithi137.stdout:3999: read oid 1 snap -1 2024-03-04T06:55:13.303 INFO:tasks.rados.rados.0.smithi137.stdout:3999: expect (ObjNum 1238 snap 376 seq_num 1238) 2024-03-04T06:55:13.303 INFO:tasks.rados.rados.0.smithi137.stdout: waiting on 3 2024-03-04T06:55:13.305 INFO:tasks.rados.rados.0.smithi137.stdout:3997: finishing write tid 2 to smithi13777483-11 2024-03-04T06:55:13.305 INFO:tasks.rados.rados.0.smithi137.stdout:3997: finishing write tid 3 to smithi13777483-11 2024-03-04T06:55:13.306 INFO:tasks.rados.rados.0.smithi137.stdout:3997: finishing write tid 4 to smithi13777483-11 2024-03-04T06:55:13.310 INFO:tasks.rados.rados.0.smithi137.stdout:3997: finishing write tid 5 to smithi13777483-11 2024-03-04T06:55:13.311 INFO:tasks.rados.rados.0.smithi137.stdout:3997: oid 11 updating version 0 to 17005 2024-03-04T06:55:13.311 INFO:tasks.rados.rados.0.smithi137.stdout:3997: oid 11 version 17005 is already newer than 17004 2024-03-04T06:55:13.311 INFO:tasks.rados.rados.0.smithi137.stdout:3997: oid 11 version 17005 is already newer than 17003 2024-03-04T06:55:13.311 INFO:tasks.rados.rados.0.smithi137.stdout:3997: oid 11 version 17005 is already newer than 17002 2024-03-04T06:55:13.311 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 11 v 17005 (ObjNum 1239 snap 376 seq_num 1239) dirty exists 2024-03-04T06:55:13.311 INFO:tasks.rados.rados.0.smithi137.stdout:3997: left oid 11 (ObjNum 1239 snap 376 seq_num 1239) 2024-03-04T06:55:13.311 INFO:tasks.rados.rados.0.smithi137.stdout:3997: done (2 left) 2024-03-04T06:55:13.311 INFO:tasks.rados.rados.0.smithi137.stdout: waiting on 2 2024-03-04T06:55:13.314 INFO:tasks.rados.rados.0.smithi137.stdout:3999: expect (ObjNum 1238 snap 376 seq_num 1238) 2024-03-04T06:55:13.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:13.096+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:13.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T06:55:13.096+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:13.346 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T06:55:13.106+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:13.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:13.114+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T06:55:13.346 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T06:55:13.115+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:13.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:13.103+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:13.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:13.106+0000 7f30e3d44700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T06:55:13.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T06:55:13.106+0000 7f30e3d44700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:13.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-mon[85573]: osdmap e822: 8 total, 8 up, 8 in 2024-03-04T06:55:13.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:13.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:13.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:13.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:13.347 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:13.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:13.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:13.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:13.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:13.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:13 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:13.448 INFO:tasks.rados.rados.0.smithi137.stdout:3998: finishing copy_from racing read to smithi13777483-49 2024-03-04T06:55:13.448 INFO:tasks.rados.rados.0.smithi137.stdout:3998: finishing copy_from to smithi13777483-49 2024-03-04T06:55:13.448 INFO:tasks.rados.rados.0.smithi137.stdout:update_object_version oid 49 v 16961 (ObjNum 1208 snap 368 seq_num 1208) dirty exists 2024-03-04T06:55:13.448 INFO:tasks.rados.rados.0.smithi137.stdout:3998: done (1 left) 2024-03-04T06:55:13.448 INFO:tasks.rados.rados.0.smithi137.stdout:3999: done (0 left) 2024-03-04T06:55:13.450 INFO:tasks.rados.rados.0.smithi137.stderr:0 errors. 2024-03-04T06:55:13.450 INFO:tasks.rados.rados.0.smithi137.stderr: 2024-03-04T06:55:13.455 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph osd dump --format=json 2024-03-04T06:55:13.480 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T06:55:13.097+0000 7f3cc96dd700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:13.480 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T06:55:13.116+0000 7fb3c1174700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:13.481 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:13.116+0000 7f5c54099700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T06:55:13.481 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:13.116+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:13.481 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T06:55:13.117+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:13.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[88869]: osdmap e822: 8 total, 8 up, 8 in 2024-03-04T06:55:13.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:13.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:13.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:13.481 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:13.482 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:13.482 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:13.482 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:13.482 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:13.482 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:13.482 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:13.482 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[91314]: osdmap e822: 8 total, 8 up, 8 in 2024-03-04T06:55:13.482 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:13.482 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:13.482 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:13.482 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:13.483 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:13.483 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:13.483 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:13.483 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:13.483 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:13.483 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:13 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:13.660 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:55:14.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:14 smithi203 ceph-mon[85573]: pgmap v920: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1023 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 536 KiB/s wr, 1 op/s 2024-03-04T06:55:14.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:14.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:14 smithi203 ceph-mon[85573]: osdmap e823: 8 total, 8 up, 8 in 2024-03-04T06:55:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:14 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:14.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:14 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[88869]: pgmap v920: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1023 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 536 KiB/s wr, 1 op/s 2024-03-04T06:55:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[88869]: osdmap e823: 8 total, 8 up, 8 in 2024-03-04T06:55:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[91314]: pgmap v920: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1023 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 536 KiB/s wr, 1 op/s 2024-03-04T06:55:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T06:55:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T06:55:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T06:55:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[91314]: osdmap e823: 8 total, 8 up, 8 in 2024-03-04T06:55:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T06:55:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T06:55:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T06:55:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1af=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T06:55:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T06:55:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T06:55:14.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:14 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T06:55:15.542 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:55:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:55:15] "GET /metrics HTTP/1.1" 200 36340 "" "Prometheus/2.43.0" 2024-03-04T06:55:15.672 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:55:15.672 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":823,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:55:13.088643+0000","last_up_change":"2024-03-04T06:50:05.457349+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T06:38:11.049505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T06:38:12.066145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-04T06:38:45.908437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"unique_pool_0","create_time":"2024-03-04T06:42:04.104800+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"823","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":433,"snap_epoch":823,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"teuthologyprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":286,"up_from":297,"up_thru":535,"down_at":287,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3821842792},{"type":"v1","addr":"172.21.15.137:6803","nonce":3821842792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3821842792},{"type":"v1","addr":"172.21.15.137:6805","nonce":3821842792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3821842792},{"type":"v1","addr":"172.21.15.137:6809","nonce":3821842792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3821842792},{"type":"v1","addr":"172.21.15.137:6807","nonce":3821842792}]},"public_addr":"172.21.15.137:6803/3821842792","cluster_addr":"172.21.15.137:6805/3821842792","heartbeat_back_addr":"172.21.15.137:6809/3821842792","heartbeat_front_addr":"172.21.15.137:6807/3821842792","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":321,"up_from":332,"up_thru":535,"down_at":322,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3966921225},{"type":"v1","addr":"172.21.15.137:6811","nonce":3966921225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3966921225},{"type":"v1","addr":"172.21.15.137:6813","nonce":3966921225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3966921225},{"type":"v1","addr":"172.21.15.137:6817","nonce":3966921225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3966921225},{"type":"v1","addr":"172.21.15.137:6815","nonce":3966921225}]},"public_addr":"172.21.15.137:6811/3966921225","cluster_addr":"172.21.15.137:6813/3966921225","heartbeat_back_addr":"172.21.15.137:6817/3966921225","heartbeat_front_addr":"172.21.15.137:6815/3966921225","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":18,"last_clean_end":356,"up_from":367,"up_thru":535,"down_at":357,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2721042151},{"type":"v1","addr":"172.21.15.137:6819","nonce":2721042151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2721042151},{"type":"v1","addr":"172.21.15.137:6821","nonce":2721042151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2721042151},{"type":"v1","addr":"172.21.15.137:6825","nonce":2721042151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2721042151},{"type":"v1","addr":"172.21.15.137:6823","nonce":2721042151}]},"public_addr":"172.21.15.137:6819/2721042151","cluster_addr":"172.21.15.137:6821/2721042151","heartbeat_back_addr":"172.21.15.137:6825/2721042151","heartbeat_front_addr":"172.21.15.137:6823/2721042151","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":390,"up_from":401,"up_thru":535,"down_at":391,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3153668955},{"type":"v1","addr":"172.21.15.137:6827","nonce":3153668955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3153668955},{"type":"v1","addr":"172.21.15.137:6829","nonce":3153668955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3153668955},{"type":"v1","addr":"172.21.15.137:6833","nonce":3153668955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3153668955},{"type":"v1","addr":"172.21.15.137:6831","nonce":3153668955}]},"public_addr":"172.21.15.137:6827/3153668955","cluster_addr":"172.21.15.137:6829/3153668955","heartbeat_back_addr":"172.21.15.137:6833/3153668955","heartbeat_front_addr":"172.21.15.137:6831/3153668955","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":30,"last_clean_end":419,"up_from":430,"up_thru":535,"down_at":420,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3365634036},{"type":"v1","addr":"172.21.15.203:6801","nonce":3365634036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3365634036},{"type":"v1","addr":"172.21.15.203:6803","nonce":3365634036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3365634036},{"type":"v1","addr":"172.21.15.203:6807","nonce":3365634036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3365634036},{"type":"v1","addr":"172.21.15.203:6805","nonce":3365634036}]},"public_addr":"172.21.15.203:6801/3365634036","cluster_addr":"172.21.15.203:6803/3365634036","heartbeat_back_addr":"172.21.15.203:6807/3365634036","heartbeat_front_addr":"172.21.15.203:6805/3365634036","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":38,"last_clean_end":454,"up_from":465,"up_thru":535,"down_at":455,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1125048708},{"type":"v1","addr":"172.21.15.203:6809","nonce":1125048708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1125048708},{"type":"v1","addr":"172.21.15.203:6811","nonce":1125048708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1125048708},{"type":"v1","addr":"172.21.15.203:6815","nonce":1125048708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1125048708},{"type":"v1","addr":"172.21.15.203:6813","nonce":1125048708}]},"public_addr":"172.21.15.203:6809/1125048708","cluster_addr":"172.21.15.203:6811/1125048708","heartbeat_back_addr":"172.21.15.203:6815/1125048708","heartbeat_front_addr":"172.21.15.203:6813/1125048708","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":46,"last_clean_end":488,"up_from":500,"up_thru":535,"down_at":489,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2741919279},{"type":"v1","addr":"172.21.15.203:6817","nonce":2741919279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2741919279},{"type":"v1","addr":"172.21.15.203:6819","nonce":2741919279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2741919279},{"type":"v1","addr":"172.21.15.203:6823","nonce":2741919279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2741919279},{"type":"v1","addr":"172.21.15.203:6821","nonce":2741919279}]},"public_addr":"172.21.15.203:6817/2741919279","cluster_addr":"172.21.15.203:6819/2741919279","heartbeat_back_addr":"172.21.15.203:6823/2741919279","heartbeat_front_addr":"172.21.15.203:6821/2741919279","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":54,"last_clean_end":524,"up_from":535,"up_thru":535,"down_at":525,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3615210313},{"type":"v1","addr":"172.21.15.203:6825","nonce":3615210313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3615210313},{"type":"v1","addr":"172.21.15.203:6827","nonce":3615210313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3615210313},{"type":"v1","addr":"172.21.15.203:6831","nonce":3615210313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3615210313},{"type":"v1","addr":"172.21.15.203:6829","nonce":3615210313}]},"public_addr":"172.21.15.203:6825/3615210313","cluster_addr":"172.21.15.203:6827/3615210313","heartbeat_back_addr":"172.21.15.203:6831/3615210313","heartbeat_front_addr":"172.21.15.203:6829/3615210313","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":286},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":321},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":356},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":390},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":419},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":454},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":488},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":524}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1","mappings":[{"from":0,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.13","mappings":[{"from":4,"to":3}]},{"pgid":"3.15","mappings":[{"from":4,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/3119089659":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/424246608":"2024-03-05T06:43:18.287977+0000","172.21.15.137:6801/2093655337":"2024-03-05T06:44:38.286834+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/1351645377":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/1807684977":"2024-03-05T06:43:18.287977+0000","172.21.15.203:6832/3636376444":"2024-03-05T06:50:30.828153+0000","172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/3975833893":"2024-03-05T06:44:38.286834+0000","172.21.15.137:0/736127774":"2024-03-05T06:43:18.287977+0000","172.21.15.137:6800/2093655337":"2024-03-05T06:44:38.286834+0000","172.21.15.203:6835/4072386315":"2024-03-05T06:43:53.917439+0000","172.21.15.203:0/2570160789":"2024-03-05T06:43:53.917439+0000","172.21.15.137:6801/3917348362":"2024-03-05T06:43:18.287977+0000","172.21.15.203:6834/4072386315":"2024-03-05T06:43:53.917439+0000","172.21.15.137:6800/3917348362":"2024-03-05T06:43:18.287977+0000","172.21.15.203:0/2441156393":"2024-03-05T06:43:53.917439+0000","172.21.15.137:6800/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.203:0/2213464466":"2024-03-05T06:43:53.917439+0000","172.21.15.137:6801/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.203:6833/3636376444":"2024-03-05T06:50:30.828153+0000","172.21.15.137:0/797688047":"2024-03-05T06:44:38.286834+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3274678870":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/79102074":"2024-03-05T06:43:18.287977+0000","172.21.15.203:0/2182695332":"2024-03-05T06:43:53.917439+0000","172.21.15.137:0/3761145235":"2024-03-05T06:44:38.286834+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/95681481":"2024-03-05T06:43:18.287977+0000","172.21.15.137:0/2769280127":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/1341717720":"2024-03-05T06:44:38.286834+0000","172.21.15.137:0/3483460019":"2024-03-05T06:44:38.286834+0000","172.21.15.137:0/1880969692":"2024-03-05T06:44:38.286834+0000","172.21.15.203:0/2387075949":"2024-03-05T06:43:53.917439+0000","172.21.15.203:0/956633836":"2024-03-05T06:43:53.917439+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"teuthologyprofile":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":138,"length":1},{"begin":150,"length":1},{"begin":153,"length":2},{"begin":158,"length":3},{"begin":162,"length":1},{"begin":164,"length":210},{"begin":375,"length":34},{"begin":410,"length":12},{"begin":423,"length":2},{"begin":426,"length":3},{"begin":430,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T06:55:16.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:16 smithi137 ceph-mon[88869]: pgmap v922: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 13 MiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-03-04T06:55:16.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:16 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/3428023829' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:55:16.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:16 smithi137 ceph-mon[91314]: pgmap v922: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 13 MiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-03-04T06:55:16.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:16 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/3428023829' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:55:16.349 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:55:16.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:16 smithi203 ceph-mon[85573]: pgmap v922: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 13 MiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-03-04T06:55:16.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:16 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/3428023829' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T06:55:16.601 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:55:18.540 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:55:18.541 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:18 smithi137 ceph-mon[88869]: pgmap v923: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 9.3 MiB/s rd, 4.4 MiB/s wr, 10 op/s 2024-03-04T06:55:18.541 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:18 smithi137 ceph-mon[91314]: pgmap v923: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 9.3 MiB/s rd, 4.4 MiB/s wr, 10 op/s 2024-03-04T06:55:18.548 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:55:18.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:18 smithi203 ceph-mon[85573]: pgmap v923: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 9.3 MiB/s rd, 4.4 MiB/s wr, 10 op/s 2024-03-04T06:55:19.289 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":924,"stamp":"2024-03-04T06:55:18.457710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15482880,"num_objects":4,"num_object_clones":4,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":31,"num_read_kb":66905,"num_write":41,"num_write_kb":28520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.374756"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103288+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103288+0000","last_peered":"2024-03-04T06:55:13.103288+0000","last_clean":"2024-03-04T06:55:13.103288+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103288+0000","last_undegraded":"2024-03-04T06:55:13.103288+0000","last_fullsized":"2024-03-04T06:55:13.103288+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116955+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.116955+0000","last_peered":"2024-03-04T06:55:13.116955+0000","last_clean":"2024-03-04T06:55:13.116955+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.116955+0000","last_undegraded":"2024-03-04T06:55:13.116955+0000","last_fullsized":"2024-03-04T06:55:13.116955+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115370+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115370+0000","last_peered":"2024-03-04T06:55:13.115370+0000","last_clean":"2024-03-04T06:55:13.115370+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115370+0000","last_undegraded":"2024-03-04T06:55:13.115370+0000","last_fullsized":"2024-03-04T06:55:13.115370+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106086+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106086+0000","last_peered":"2024-03-04T06:55:13.106086+0000","last_clean":"2024-03-04T06:55:13.106086+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106086+0000","last_undegraded":"2024-03-04T06:55:13.106086+0000","last_fullsized":"2024-03-04T06:55:13.106086+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101948+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.101948+0000","last_peered":"2024-03-04T06:55:13.101948+0000","last_clean":"2024-03-04T06:55:13.101948+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.101948+0000","last_undegraded":"2024-03-04T06:55:13.101948+0000","last_fullsized":"2024-03-04T06:55:13.101948+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106042+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106042+0000","last_peered":"2024-03-04T06:55:13.106042+0000","last_clean":"2024-03-04T06:55:13.106042+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106042+0000","last_undegraded":"2024-03-04T06:55:13.106042+0000","last_fullsized":"2024-03-04T06:55:13.106042+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101755+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101755+0000","last_peered":"2024-03-04T06:55:13.101755+0000","last_clean":"2024-03-04T06:55:13.101755+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101755+0000","last_undegraded":"2024-03-04T06:55:13.101755+0000","last_fullsized":"2024-03-04T06:55:13.101755+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097051+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:13.097051+0000","last_peered":"2024-03-04T06:55:13.097051+0000","last_clean":"2024-03-04T06:55:13.097051+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:13.097051+0000","last_undegraded":"2024-03-04T06:55:13.097051+0000","last_fullsized":"2024-03-04T06:55:13.097051+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1063,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102987+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.102987+0000","last_peered":"2024-03-04T06:55:13.102987+0000","last_clean":"2024-03-04T06:55:13.102987+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.102987+0000","last_undegraded":"2024-03-04T06:55:13.102987+0000","last_fullsized":"2024-03-04T06:55:13.102987+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114958+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.114958+0000","last_peered":"2024-03-04T06:55:13.114958+0000","last_clean":"2024-03-04T06:55:13.114958+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.114958+0000","last_undegraded":"2024-03-04T06:55:13.114958+0000","last_fullsized":"2024-03-04T06:55:13.114958+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114806+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114806+0000","last_peered":"2024-03-04T06:55:13.114806+0000","last_clean":"2024-03-04T06:55:13.114806+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114806+0000","last_undegraded":"2024-03-04T06:55:13.114806+0000","last_fullsized":"2024-03-04T06:55:13.114806+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1153,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095907+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:13.095907+0000","last_peered":"2024-03-04T06:55:13.095907+0000","last_clean":"2024-03-04T06:55:13.095907+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:13.095907+0000","last_undegraded":"2024-03-04T06:55:13.095907+0000","last_fullsized":"2024-03-04T06:55:13.095907+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1198,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098969+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.098969+0000","last_peered":"2024-03-04T06:55:13.098969+0000","last_clean":"2024-03-04T06:55:13.098969+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.098969+0000","last_undegraded":"2024-03-04T06:55:13.098969+0000","last_fullsized":"2024-03-04T06:55:13.098969+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115324+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:13.115324+0000","last_peered":"2024-03-04T06:55:13.115324+0000","last_clean":"2024-03-04T06:55:13.115324+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:13.115324+0000","last_undegraded":"2024-03-04T06:55:13.115324+0000","last_fullsized":"2024-03-04T06:55:13.115324+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115685+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115685+0000","last_peered":"2024-03-04T06:55:13.115685+0000","last_clean":"2024-03-04T06:55:13.115685+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115685+0000","last_undegraded":"2024-03-04T06:55:13.115685+0000","last_fullsized":"2024-03-04T06:55:13.115685+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104938+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104938+0000","last_peered":"2024-03-04T06:55:13.104938+0000","last_clean":"2024-03-04T06:55:13.104938+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104938+0000","last_undegraded":"2024-03-04T06:55:13.104938+0000","last_fullsized":"2024-03-04T06:55:13.104938+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1124,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106955+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.106955+0000","last_peered":"2024-03-04T06:55:13.106955+0000","last_clean":"2024-03-04T06:55:13.106955+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.106955+0000","last_undegraded":"2024-03-04T06:55:13.106955+0000","last_fullsized":"2024-03-04T06:55:13.106955+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096883+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096883+0000","last_peered":"2024-03-04T06:55:13.096883+0000","last_clean":"2024-03-04T06:55:13.096883+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096883+0000","last_undegraded":"2024-03-04T06:55:13.096883+0000","last_fullsized":"2024-03-04T06:55:13.096883+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102246+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102246+0000","last_peered":"2024-03-04T06:55:13.102246+0000","last_clean":"2024-03-04T06:55:13.102246+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102246+0000","last_undegraded":"2024-03-04T06:55:13.102246+0000","last_fullsized":"2024-03-04T06:55:13.102246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116560+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116560+0000","last_peered":"2024-03-04T06:55:13.116560+0000","last_clean":"2024-03-04T06:55:13.116560+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116560+0000","last_undegraded":"2024-03-04T06:55:13.116560+0000","last_fullsized":"2024-03-04T06:55:13.116560+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1192,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097564+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:13.097564+0000","last_peered":"2024-03-04T06:55:13.097564+0000","last_clean":"2024-03-04T06:55:13.097564+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:13.097564+0000","last_undegraded":"2024-03-04T06:55:13.097564+0000","last_fullsized":"2024-03-04T06:55:13.097564+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097791+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:13.097791+0000","last_peered":"2024-03-04T06:55:13.097791+0000","last_clean":"2024-03-04T06:55:13.097791+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:13.097791+0000","last_undegraded":"2024-03-04T06:55:13.097791+0000","last_fullsized":"2024-03-04T06:55:13.097791+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115577+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.115577+0000","last_peered":"2024-03-04T06:55:13.115577+0000","last_clean":"2024-03-04T06:55:13.115577+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.115577+0000","last_undegraded":"2024-03-04T06:55:13.115577+0000","last_fullsized":"2024-03-04T06:55:13.115577+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1233,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098515+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098515+0000","last_peered":"2024-03-04T06:55:13.098515+0000","last_clean":"2024-03-04T06:55:13.098515+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098515+0000","last_undegraded":"2024-03-04T06:55:13.098515+0000","last_fullsized":"2024-03-04T06:55:13.098515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1220,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097456+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097456+0000","last_peered":"2024-03-04T06:55:13.097456+0000","last_clean":"2024-03-04T06:55:13.097456+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097456+0000","last_undegraded":"2024-03-04T06:55:13.097456+0000","last_fullsized":"2024-03-04T06:55:13.097456+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1068,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102398+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102398+0000","last_peered":"2024-03-04T06:55:13.102398+0000","last_clean":"2024-03-04T06:55:13.102398+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102398+0000","last_undegraded":"2024-03-04T06:55:13.102398+0000","last_fullsized":"2024-03-04T06:55:13.102398+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1124,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106153+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106153+0000","last_peered":"2024-03-04T06:55:13.106153+0000","last_clean":"2024-03-04T06:55:13.106153+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106153+0000","last_undegraded":"2024-03-04T06:55:13.106153+0000","last_fullsized":"2024-03-04T06:55:13.106153+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098905+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:13.098905+0000","last_peered":"2024-03-04T06:55:13.098905+0000","last_clean":"2024-03-04T06:55:13.098905+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:13.098905+0000","last_undegraded":"2024-03-04T06:55:13.098905+0000","last_fullsized":"2024-03-04T06:55:13.098905+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1187,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095993+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.095993+0000","last_peered":"2024-03-04T06:55:13.095993+0000","last_clean":"2024-03-04T06:55:13.095993+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.095993+0000","last_undegraded":"2024-03-04T06:55:13.095993+0000","last_fullsized":"2024-03-04T06:55:13.095993+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114659+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114659+0000","last_peered":"2024-03-04T06:55:13.114659+0000","last_clean":"2024-03-04T06:55:13.114659+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114659+0000","last_undegraded":"2024-03-04T06:55:13.114659+0000","last_fullsized":"2024-03-04T06:55:13.114659+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1294,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117725+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.117725+0000","last_peered":"2024-03-04T06:55:13.117725+0000","last_clean":"2024-03-04T06:55:13.117725+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.117725+0000","last_undegraded":"2024-03-04T06:55:13.117725+0000","last_fullsized":"2024-03-04T06:55:13.117725+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096686+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096686+0000","last_peered":"2024-03-04T06:55:13.096686+0000","last_clean":"2024-03-04T06:55:13.096686+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096686+0000","last_undegraded":"2024-03-04T06:55:13.096686+0000","last_fullsized":"2024-03-04T06:55:13.096686+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097180+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097180+0000","last_peered":"2024-03-04T06:55:13.097180+0000","last_clean":"2024-03-04T06:55:13.097180+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097180+0000","last_undegraded":"2024-03-04T06:55:13.097180+0000","last_fullsized":"2024-03-04T06:55:13.097180+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105539+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105539+0000","last_peered":"2024-03-04T06:55:13.105539+0000","last_clean":"2024-03-04T06:55:13.105539+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105539+0000","last_undegraded":"2024-03-04T06:55:13.105539+0000","last_fullsized":"2024-03-04T06:55:13.105539+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115781+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115781+0000","last_peered":"2024-03-04T06:55:13.115781+0000","last_clean":"2024-03-04T06:55:13.115781+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115781+0000","last_undegraded":"2024-03-04T06:55:13.115781+0000","last_fullsized":"2024-03-04T06:55:13.115781+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115093+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115093+0000","last_peered":"2024-03-04T06:55:13.115093+0000","last_clean":"2024-03-04T06:55:13.115093+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115093+0000","last_undegraded":"2024-03-04T06:55:13.115093+0000","last_fullsized":"2024-03-04T06:55:13.115093+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1109,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105408+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105408+0000","last_peered":"2024-03-04T06:55:13.105408+0000","last_clean":"2024-03-04T06:55:13.105408+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105408+0000","last_undegraded":"2024-03-04T06:55:13.105408+0000","last_fullsized":"2024-03-04T06:55:13.105408+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105858+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105858+0000","last_peered":"2024-03-04T06:55:13.105858+0000","last_clean":"2024-03-04T06:55:13.105858+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105858+0000","last_undegraded":"2024-03-04T06:55:13.105858+0000","last_fullsized":"2024-03-04T06:55:13.105858+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1294,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116105+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116105+0000","last_peered":"2024-03-04T06:55:13.116105+0000","last_clean":"2024-03-04T06:55:13.116105+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116105+0000","last_undegraded":"2024-03-04T06:55:13.116105+0000","last_fullsized":"2024-03-04T06:55:13.116105+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116036+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116036+0000","last_peered":"2024-03-04T06:55:13.116036+0000","last_clean":"2024-03-04T06:55:13.116036+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116036+0000","last_undegraded":"2024-03-04T06:55:13.116036+0000","last_fullsized":"2024-03-04T06:55:13.116036+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096448+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:13.096448+0000","last_peered":"2024-03-04T06:55:13.096448+0000","last_clean":"2024-03-04T06:55:13.096448+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:13.096448+0000","last_undegraded":"2024-03-04T06:55:13.096448+0000","last_fullsized":"2024-03-04T06:55:13.096448+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114921+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114921+0000","last_peered":"2024-03-04T06:55:13.114921+0000","last_clean":"2024-03-04T06:55:13.114921+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114921+0000","last_undegraded":"2024-03-04T06:55:13.114921+0000","last_fullsized":"2024-03-04T06:55:13.114921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102608+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102608+0000","last_peered":"2024-03-04T06:55:13.102608+0000","last_clean":"2024-03-04T06:55:13.102608+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102608+0000","last_undegraded":"2024-03-04T06:55:13.102608+0000","last_fullsized":"2024-03-04T06:55:13.102608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117741+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:13.117741+0000","last_peered":"2024-03-04T06:55:13.117741+0000","last_clean":"2024-03-04T06:55:13.117741+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:13.117741+0000","last_undegraded":"2024-03-04T06:55:13.117741+0000","last_fullsized":"2024-03-04T06:55:13.117741+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098491+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098491+0000","last_peered":"2024-03-04T06:55:13.098491+0000","last_clean":"2024-03-04T06:55:13.098491+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098491+0000","last_undegraded":"2024-03-04T06:55:13.098491+0000","last_fullsized":"2024-03-04T06:55:13.098491+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105849+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105849+0000","last_peered":"2024-03-04T06:55:13.105849+0000","last_clean":"2024-03-04T06:55:13.105849+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105849+0000","last_undegraded":"2024-03-04T06:55:13.105849+0000","last_fullsized":"2024-03-04T06:55:13.105849+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102507+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102507+0000","last_peered":"2024-03-04T06:55:13.102507+0000","last_clean":"2024-03-04T06:55:13.102507+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102507+0000","last_undegraded":"2024-03-04T06:55:13.102507+0000","last_fullsized":"2024-03-04T06:55:13.102507+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114409+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114409+0000","last_peered":"2024-03-04T06:55:13.114409+0000","last_clean":"2024-03-04T06:55:13.114409+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114409+0000","last_undegraded":"2024-03-04T06:55:13.114409+0000","last_fullsized":"2024-03-04T06:55:13.114409+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114411+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114411+0000","last_peered":"2024-03-04T06:55:13.114411+0000","last_clean":"2024-03-04T06:55:13.114411+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114411+0000","last_undegraded":"2024-03-04T06:55:13.114411+0000","last_fullsized":"2024-03-04T06:55:13.114411+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1251,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096553+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096553+0000","last_peered":"2024-03-04T06:55:13.096553+0000","last_clean":"2024-03-04T06:55:13.096553+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096553+0000","last_undegraded":"2024-03-04T06:55:13.096553+0000","last_fullsized":"2024-03-04T06:55:13.096553+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101772+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101772+0000","last_peered":"2024-03-04T06:55:13.101772+0000","last_clean":"2024-03-04T06:55:13.101772+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101772+0000","last_undegraded":"2024-03-04T06:55:13.101772+0000","last_fullsized":"2024-03-04T06:55:13.101772+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3575,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096388+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:13.096388+0000","last_peered":"2024-03-04T06:55:13.096388+0000","last_clean":"2024-03-04T06:55:13.096388+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:13.096388+0000","last_undegraded":"2024-03-04T06:55:13.096388+0000","last_fullsized":"2024-03-04T06:55:13.096388+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096934+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096934+0000","last_peered":"2024-03-04T06:55:13.096934+0000","last_clean":"2024-03-04T06:55:13.096934+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096934+0000","last_undegraded":"2024-03-04T06:55:13.096934+0000","last_fullsized":"2024-03-04T06:55:13.096934+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102885+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102885+0000","last_peered":"2024-03-04T06:55:13.102885+0000","last_clean":"2024-03-04T06:55:13.102885+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102885+0000","last_undegraded":"2024-03-04T06:55:13.102885+0000","last_fullsized":"2024-03-04T06:55:13.102885+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17114,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117468+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117468+0000","last_peered":"2024-03-04T06:55:13.117468+0000","last_clean":"2024-03-04T06:55:13.117468+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117468+0000","last_undegraded":"2024-03-04T06:55:13.117468+0000","last_fullsized":"2024-03-04T06:55:13.117468+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115048+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115048+0000","last_peered":"2024-03-04T06:55:13.115048+0000","last_clean":"2024-03-04T06:55:13.115048+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115048+0000","last_undegraded":"2024-03-04T06:55:13.115048+0000","last_fullsized":"2024-03-04T06:55:13.115048+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116658+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116658+0000","last_peered":"2024-03-04T06:55:13.116658+0000","last_clean":"2024-03-04T06:55:13.116658+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116658+0000","last_undegraded":"2024-03-04T06:55:13.116658+0000","last_fullsized":"2024-03-04T06:55:13.116658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105904+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.105904+0000","last_peered":"2024-03-04T06:55:13.105904+0000","last_clean":"2024-03-04T06:55:13.105904+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.105904+0000","last_undegraded":"2024-03-04T06:55:13.105904+0000","last_fullsized":"2024-03-04T06:55:13.105904+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4384,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.116730+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.116730+0000","last_peered":"2024-03-04T06:55:13.116730+0000","last_clean":"2024-03-04T06:55:13.116730+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.116730+0000","last_undegraded":"2024-03-04T06:55:13.116730+0000","last_fullsized":"2024-03-04T06:55:13.116730+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115924+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115924+0000","last_peered":"2024-03-04T06:55:13.115924+0000","last_clean":"2024-03-04T06:55:13.115924+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115924+0000","last_undegraded":"2024-03-04T06:55:13.115924+0000","last_fullsized":"2024-03-04T06:55:13.115924+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105684+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105684+0000","last_peered":"2024-03-04T06:55:13.105684+0000","last_clean":"2024-03-04T06:55:13.105684+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105684+0000","last_undegraded":"2024-03-04T06:55:13.105684+0000","last_fullsized":"2024-03-04T06:55:13.105684+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096227+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096227+0000","last_peered":"2024-03-04T06:55:13.096227+0000","last_clean":"2024-03-04T06:55:13.096227+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096227+0000","last_undegraded":"2024-03-04T06:55:13.096227+0000","last_fullsized":"2024-03-04T06:55:13.096227+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5637,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097231+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:13.097231+0000","last_peered":"2024-03-04T06:55:13.097231+0000","last_clean":"2024-03-04T06:55:13.097231+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:13.097231+0000","last_undegraded":"2024-03-04T06:55:13.097231+0000","last_fullsized":"2024-03-04T06:55:13.097231+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116182+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.116182+0000","last_peered":"2024-03-04T06:55:13.116182+0000","last_clean":"2024-03-04T06:55:13.116182+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.116182+0000","last_undegraded":"2024-03-04T06:55:13.116182+0000","last_fullsized":"2024-03-04T06:55:13.116182+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114108+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114108+0000","last_peered":"2024-03-04T06:55:13.114108+0000","last_clean":"2024-03-04T06:55:13.114108+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114108+0000","last_undegraded":"2024-03-04T06:55:13.114108+0000","last_fullsized":"2024-03-04T06:55:13.114108+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096488+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:13.096488+0000","last_peered":"2024-03-04T06:55:13.096488+0000","last_clean":"2024-03-04T06:55:13.096488+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:13.096488+0000","last_undegraded":"2024-03-04T06:55:13.096488+0000","last_fullsized":"2024-03-04T06:55:13.096488+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4013,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.106850+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.106850+0000","last_peered":"2024-03-04T06:55:13.106850+0000","last_clean":"2024-03-04T06:55:13.106850+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.106850+0000","last_undegraded":"2024-03-04T06:55:13.106850+0000","last_fullsized":"2024-03-04T06:55:13.106850+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1089,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115029+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:13.115029+0000","last_peered":"2024-03-04T06:55:13.115029+0000","last_clean":"2024-03-04T06:55:13.115029+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:13.115029+0000","last_undegraded":"2024-03-04T06:55:13.115029+0000","last_fullsized":"2024-03-04T06:55:13.115029+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098368+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098368+0000","last_peered":"2024-03-04T06:55:13.098368+0000","last_clean":"2024-03-04T06:55:13.098368+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098368+0000","last_undegraded":"2024-03-04T06:55:13.098368+0000","last_fullsized":"2024-03-04T06:55:13.098368+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105176+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105176+0000","last_peered":"2024-03-04T06:55:13.105176+0000","last_clean":"2024-03-04T06:55:13.105176+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105176+0000","last_undegraded":"2024-03-04T06:55:13.105176+0000","last_fullsized":"2024-03-04T06:55:13.105176+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1548,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101670+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101670+0000","last_peered":"2024-03-04T06:55:13.101670+0000","last_clean":"2024-03-04T06:55:13.101670+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101670+0000","last_undegraded":"2024-03-04T06:55:13.101670+0000","last_fullsized":"2024-03-04T06:55:13.101670+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3948,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.127072+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:13.127072+0000","last_peered":"2024-03-04T06:55:13.127072+0000","last_clean":"2024-03-04T06:55:13.127072+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:13.127072+0000","last_undegraded":"2024-03-04T06:55:13.127072+0000","last_fullsized":"2024-03-04T06:55:13.127072+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117334+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117334+0000","last_peered":"2024-03-04T06:55:13.117334+0000","last_clean":"2024-03-04T06:55:13.117334+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117334+0000","last_undegraded":"2024-03-04T06:55:13.117334+0000","last_fullsized":"2024-03-04T06:55:13.117334+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096258+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:13.096258+0000","last_peered":"2024-03-04T06:55:13.096258+0000","last_clean":"2024-03-04T06:55:13.096258+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:13.096258+0000","last_undegraded":"2024-03-04T06:55:13.096258+0000","last_fullsized":"2024-03-04T06:55:13.096258+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1055,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101642+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101642+0000","last_peered":"2024-03-04T06:55:13.101642+0000","last_clean":"2024-03-04T06:55:13.101642+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101642+0000","last_undegraded":"2024-03-04T06:55:13.101642+0000","last_fullsized":"2024-03-04T06:55:13.101642+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15289,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.174017+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:13.174017+0000","last_peered":"2024-03-04T06:55:13.174017+0000","last_clean":"2024-03-04T06:55:13.174017+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:13.174017+0000","last_undegraded":"2024-03-04T06:55:13.174017+0000","last_fullsized":"2024-03-04T06:55:13.174017+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117486+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117486+0000","last_peered":"2024-03-04T06:55:13.117486+0000","last_clean":"2024-03-04T06:55:13.117486+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117486+0000","last_undegraded":"2024-03-04T06:55:13.117486+0000","last_fullsized":"2024-03-04T06:55:13.117486+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102522+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102522+0000","last_peered":"2024-03-04T06:55:13.102522+0000","last_clean":"2024-03-04T06:55:13.102522+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102522+0000","last_undegraded":"2024-03-04T06:55:13.102522+0000","last_fullsized":"2024-03-04T06:55:13.102522+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116017+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116017+0000","last_peered":"2024-03-04T06:55:13.116017+0000","last_clean":"2024-03-04T06:55:13.116017+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116017+0000","last_undegraded":"2024-03-04T06:55:13.116017+0000","last_fullsized":"2024-03-04T06:55:13.116017+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4377,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097266+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097266+0000","last_peered":"2024-03-04T06:55:13.097266+0000","last_clean":"2024-03-04T06:55:13.097266+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097266+0000","last_undegraded":"2024-03-04T06:55:13.097266+0000","last_fullsized":"2024-03-04T06:55:13.097266+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097555+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:13.097555+0000","last_peered":"2024-03-04T06:55:13.097555+0000","last_clean":"2024-03-04T06:55:13.097555+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:13.097555+0000","last_undegraded":"2024-03-04T06:55:13.097555+0000","last_fullsized":"2024-03-04T06:55:13.097555+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117221+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.117221+0000","last_peered":"2024-03-04T06:55:13.117221+0000","last_clean":"2024-03-04T06:55:13.117221+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.117221+0000","last_undegraded":"2024-03-04T06:55:13.117221+0000","last_fullsized":"2024-03-04T06:55:13.117221+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097200+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097200+0000","last_peered":"2024-03-04T06:55:13.097200+0000","last_clean":"2024-03-04T06:55:13.097200+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097200+0000","last_undegraded":"2024-03-04T06:55:13.097200+0000","last_fullsized":"2024-03-04T06:55:13.097200+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4607,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.307314+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:13.307314+0000","last_peered":"2024-03-04T06:55:13.307314+0000","last_clean":"2024-03-04T06:55:13.307314+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:13.307314+0000","last_undegraded":"2024-03-04T06:55:13.307314+0000","last_fullsized":"2024-03-04T06:55:13.307314+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095643+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095643+0000","last_peered":"2024-03-04T06:55:13.095643+0000","last_clean":"2024-03-04T06:55:13.095643+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095643+0000","last_undegraded":"2024-03-04T06:55:13.095643+0000","last_fullsized":"2024-03-04T06:55:13.095643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1076,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115089+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115089+0000","last_peered":"2024-03-04T06:55:13.115089+0000","last_clean":"2024-03-04T06:55:13.115089+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115089+0000","last_undegraded":"2024-03-04T06:55:13.115089+0000","last_fullsized":"2024-03-04T06:55:13.115089+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115325+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115325+0000","last_peered":"2024-03-04T06:55:13.115325+0000","last_clean":"2024-03-04T06:55:13.115325+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115325+0000","last_undegraded":"2024-03-04T06:55:13.115325+0000","last_fullsized":"2024-03-04T06:55:13.115325+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4632,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107104+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:13.107104+0000","last_peered":"2024-03-04T06:55:13.107104+0000","last_clean":"2024-03-04T06:55:13.107104+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:13.107104+0000","last_undegraded":"2024-03-04T06:55:13.107104+0000","last_fullsized":"2024-03-04T06:55:13.107104+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1055,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101919+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101919+0000","last_peered":"2024-03-04T06:55:13.101919+0000","last_clean":"2024-03-04T06:55:13.101919+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101919+0000","last_undegraded":"2024-03-04T06:55:13.101919+0000","last_fullsized":"2024-03-04T06:55:13.101919+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1183,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095626+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095626+0000","last_peered":"2024-03-04T06:55:13.095626+0000","last_clean":"2024-03-04T06:55:13.095626+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095626+0000","last_undegraded":"2024-03-04T06:55:13.095626+0000","last_fullsized":"2024-03-04T06:55:13.095626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5156,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.111062+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.111062+0000","last_peered":"2024-03-04T06:55:13.111062+0000","last_clean":"2024-03-04T06:55:13.111062+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.111062+0000","last_undegraded":"2024-03-04T06:55:13.111062+0000","last_fullsized":"2024-03-04T06:55:13.111062+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116686+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.116686+0000","last_peered":"2024-03-04T06:55:13.116686+0000","last_clean":"2024-03-04T06:55:13.116686+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.116686+0000","last_undegraded":"2024-03-04T06:55:13.116686+0000","last_fullsized":"2024-03-04T06:55:13.116686+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097769+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097769+0000","last_peered":"2024-03-04T06:55:13.097769+0000","last_clean":"2024-03-04T06:55:13.097769+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097769+0000","last_undegraded":"2024-03-04T06:55:13.097769+0000","last_fullsized":"2024-03-04T06:55:13.097769+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4717,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.167577+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.167577+0000","last_peered":"2024-03-04T06:55:13.167577+0000","last_clean":"2024-03-04T06:55:13.167577+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.167577+0000","last_undegraded":"2024-03-04T06:55:13.167577+0000","last_fullsized":"2024-03-04T06:55:13.167577+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114842+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.114842+0000","last_peered":"2024-03-04T06:55:13.114842+0000","last_clean":"2024-03-04T06:55:13.114842+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.114842+0000","last_undegraded":"2024-03-04T06:55:13.114842+0000","last_fullsized":"2024-03-04T06:55:13.114842+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098787+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098787+0000","last_peered":"2024-03-04T06:55:13.098787+0000","last_clean":"2024-03-04T06:55:13.098787+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098787+0000","last_undegraded":"2024-03-04T06:55:13.098787+0000","last_fullsized":"2024-03-04T06:55:13.098787+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5552,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.116584+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:13.116584+0000","last_peered":"2024-03-04T06:55:13.116584+0000","last_clean":"2024-03-04T06:55:13.116584+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:13.116584+0000","last_undegraded":"2024-03-04T06:55:13.116584+0000","last_fullsized":"2024-03-04T06:55:13.116584+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102342+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102342+0000","last_peered":"2024-03-04T06:55:13.102342+0000","last_clean":"2024-03-04T06:55:13.102342+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102342+0000","last_undegraded":"2024-03-04T06:55:13.102342+0000","last_fullsized":"2024-03-04T06:55:13.102342+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114629+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114629+0000","last_peered":"2024-03-04T06:55:13.114629+0000","last_clean":"2024-03-04T06:55:13.114629+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114629+0000","last_undegraded":"2024-03-04T06:55:13.114629+0000","last_fullsized":"2024-03-04T06:55:13.114629+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096744+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096744+0000","last_peered":"2024-03-04T06:55:13.096744+0000","last_clean":"2024-03-04T06:55:13.096744+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096744+0000","last_undegraded":"2024-03-04T06:55:13.096744+0000","last_fullsized":"2024-03-04T06:55:13.096744+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097188+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097188+0000","last_peered":"2024-03-04T06:55:13.097188+0000","last_clean":"2024-03-04T06:55:13.097188+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097188+0000","last_undegraded":"2024-03-04T06:55:13.097188+0000","last_fullsized":"2024-03-04T06:55:13.097188+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102416+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102416+0000","last_peered":"2024-03-04T06:55:13.102416+0000","last_clean":"2024-03-04T06:55:13.102416+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102416+0000","last_undegraded":"2024-03-04T06:55:13.102416+0000","last_fullsized":"2024-03-04T06:55:13.102416+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4364,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.314051+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:13.314051+0000","last_peered":"2024-03-04T06:55:13.314051+0000","last_clean":"2024-03-04T06:55:13.314051+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:13.314051+0000","last_undegraded":"2024-03-04T06:55:13.314051+0000","last_fullsized":"2024-03-04T06:55:13.314051+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115486+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:13.115486+0000","last_peered":"2024-03-04T06:55:13.115486+0000","last_clean":"2024-03-04T06:55:13.115486+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:13.115486+0000","last_undegraded":"2024-03-04T06:55:13.115486+0000","last_fullsized":"2024-03-04T06:55:13.115486+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1137,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105774+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:13.105774+0000","last_peered":"2024-03-04T06:55:13.105774+0000","last_clean":"2024-03-04T06:55:13.105774+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:13.105774+0000","last_undegraded":"2024-03-04T06:55:13.105774+0000","last_fullsized":"2024-03-04T06:55:13.105774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4598,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.321650+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.321650+0000","last_peered":"2024-03-04T06:55:13.321650+0000","last_clean":"2024-03-04T06:55:13.321650+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.321650+0000","last_undegraded":"2024-03-04T06:55:13.321650+0000","last_fullsized":"2024-03-04T06:55:13.321650+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097451+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097451+0000","last_peered":"2024-03-04T06:55:13.097451+0000","last_clean":"2024-03-04T06:55:13.097451+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097451+0000","last_undegraded":"2024-03-04T06:55:13.097451+0000","last_fullsized":"2024-03-04T06:55:13.097451+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104831+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.104831+0000","last_peered":"2024-03-04T06:55:13.104831+0000","last_clean":"2024-03-04T06:55:13.104831+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.104831+0000","last_undegraded":"2024-03-04T06:55:13.104831+0000","last_fullsized":"2024-03-04T06:55:13.104831+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114405+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:13.114405+0000","last_peered":"2024-03-04T06:55:13.114405+0000","last_clean":"2024-03-04T06:55:13.114405+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:13.114405+0000","last_undegraded":"2024-03-04T06:55:13.114405+0000","last_fullsized":"2024-03-04T06:55:13.114405+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096592+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:13.096592+0000","last_peered":"2024-03-04T06:55:13.096592+0000","last_clean":"2024-03-04T06:55:13.096592+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:13.096592+0000","last_undegraded":"2024-03-04T06:55:13.096592+0000","last_fullsized":"2024-03-04T06:55:13.096592+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105999+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.105999+0000","last_peered":"2024-03-04T06:55:13.105999+0000","last_clean":"2024-03-04T06:55:13.105999+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.105999+0000","last_undegraded":"2024-03-04T06:55:13.105999+0000","last_fullsized":"2024-03-04T06:55:13.105999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117074+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117074+0000","last_peered":"2024-03-04T06:55:13.117074+0000","last_clean":"2024-03-04T06:55:13.117074+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117074+0000","last_undegraded":"2024-03-04T06:55:13.117074+0000","last_fullsized":"2024-03-04T06:55:13.117074+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096759+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096759+0000","last_peered":"2024-03-04T06:55:13.096759+0000","last_clean":"2024-03-04T06:55:13.096759+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096759+0000","last_undegraded":"2024-03-04T06:55:13.096759+0000","last_fullsized":"2024-03-04T06:55:13.096759+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115428+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.115428+0000","last_peered":"2024-03-04T06:55:13.115428+0000","last_clean":"2024-03-04T06:55:13.115428+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.115428+0000","last_undegraded":"2024-03-04T06:55:13.115428+0000","last_fullsized":"2024-03-04T06:55:13.115428+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115239+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115239+0000","last_peered":"2024-03-04T06:55:13.115239+0000","last_clean":"2024-03-04T06:55:13.115239+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115239+0000","last_undegraded":"2024-03-04T06:55:13.115239+0000","last_fullsized":"2024-03-04T06:55:13.115239+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1192,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097432+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097432+0000","last_peered":"2024-03-04T06:55:13.097432+0000","last_clean":"2024-03-04T06:55:13.097432+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097432+0000","last_undegraded":"2024-03-04T06:55:13.097432+0000","last_fullsized":"2024-03-04T06:55:13.097432+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1143,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105228+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:13.105228+0000","last_peered":"2024-03-04T06:55:13.105228+0000","last_clean":"2024-03-04T06:55:13.105228+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:13.105228+0000","last_undegraded":"2024-03-04T06:55:13.105228+0000","last_fullsized":"2024-03-04T06:55:13.105228+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096564+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096564+0000","last_peered":"2024-03-04T06:55:13.096564+0000","last_clean":"2024-03-04T06:55:13.096564+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096564+0000","last_undegraded":"2024-03-04T06:55:13.096564+0000","last_fullsized":"2024-03-04T06:55:13.096564+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105520+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:13.105520+0000","last_peered":"2024-03-04T06:55:13.105520+0000","last_clean":"2024-03-04T06:55:13.105520+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:13.105520+0000","last_undegraded":"2024-03-04T06:55:13.105520+0000","last_fullsized":"2024-03-04T06:55:13.105520+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116864+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116864+0000","last_peered":"2024-03-04T06:55:13.116864+0000","last_clean":"2024-03-04T06:55:13.116864+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116864+0000","last_undegraded":"2024-03-04T06:55:13.116864+0000","last_fullsized":"2024-03-04T06:55:13.116864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114786+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114786+0000","last_peered":"2024-03-04T06:55:13.114786+0000","last_clean":"2024-03-04T06:55:13.114786+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114786+0000","last_undegraded":"2024-03-04T06:55:13.114786+0000","last_fullsized":"2024-03-04T06:55:13.114786+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503423,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648071,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142378,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287025,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997731,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885787,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937365,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792718,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:55:19.295 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:19.295 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:19.295 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:19.295 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:19.295 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:19.295 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:19.295 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:19.295 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:19.295 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:19.295 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:19.295 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:55:20.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:20 smithi137 ceph-mon[88869]: pgmap v924: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 8.9 MiB/s rd, 3.8 MiB/s wr, 9 op/s 2024-03-04T06:55:20.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:20 smithi137 ceph-mon[88869]: from='client.44438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:55:20.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:20 smithi137 ceph-mon[91314]: pgmap v924: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 8.9 MiB/s rd, 3.8 MiB/s wr, 9 op/s 2024-03-04T06:55:20.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:20 smithi137 ceph-mon[91314]: from='client.44438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:55:20.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:20 smithi203 ceph-mon[85573]: pgmap v924: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 8.9 MiB/s rd, 3.8 MiB/s wr, 9 op/s 2024-03-04T06:55:20.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:20 smithi203 ceph-mon[85573]: from='client.44438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:55:22.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:22 smithi137 ceph-mon[88869]: pgmap v925: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 7.8 MiB/s rd, 3.3 MiB/s wr, 8 op/s 2024-03-04T06:55:22.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:22 smithi137 ceph-mon[91314]: pgmap v925: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 7.8 MiB/s rd, 3.3 MiB/s wr, 8 op/s 2024-03-04T06:55:22.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:22 smithi203 ceph-mon[85573]: pgmap v925: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 7.8 MiB/s rd, 3.3 MiB/s wr, 8 op/s 2024-03-04T06:55:24.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:24 smithi137 ceph-mon[88869]: pgmap v926: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 6.5 MiB/s rd, 2.8 MiB/s wr, 7 op/s 2024-03-04T06:55:24.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:55:24.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:24 smithi137 ceph-mon[91314]: pgmap v926: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 6.5 MiB/s rd, 2.8 MiB/s wr, 7 op/s 2024-03-04T06:55:24.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:55:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:24 smithi203 ceph-mon[85573]: pgmap v926: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 6.5 MiB/s rd, 2.8 MiB/s wr, 7 op/s 2024-03-04T06:55:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:55:25.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:55:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:55:25] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:55:26.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:26 smithi137 ceph-mon[88869]: pgmap v927: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 5.5 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-03-04T06:55:26.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:26 smithi137 ceph-mon[91314]: pgmap v927: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 5.5 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-03-04T06:55:26.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:26 smithi203 ceph-mon[85573]: pgmap v927: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 5.5 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-03-04T06:55:28.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:28 smithi137 ceph-mon[88869]: pgmap v928: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 819 KiB/s rd, 406 KiB/s wr, 1 op/s 2024-03-04T06:55:28.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:28 smithi137 ceph-mon[91314]: pgmap v928: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 819 KiB/s rd, 406 KiB/s wr, 1 op/s 2024-03-04T06:55:28.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:28 smithi203 ceph-mon[85573]: pgmap v928: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 819 KiB/s rd, 406 KiB/s wr, 1 op/s 2024-03-04T06:55:29.296 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:55:29.519 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:55:30.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:30 smithi137 ceph-mon[88869]: pgmap v929: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 819 KiB/s rd, 123 KiB/s wr, 0 op/s 2024-03-04T06:55:30.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:30 smithi137 ceph-mon[91314]: pgmap v929: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 819 KiB/s rd, 123 KiB/s wr, 0 op/s 2024-03-04T06:55:30.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:30 smithi203 ceph-mon[85573]: pgmap v929: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 819 KiB/s rd, 123 KiB/s wr, 0 op/s 2024-03-04T06:55:31.423 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:55:31.425 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:55:32.093 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":930,"stamp":"2024-03-04T06:55:30.461664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003953"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103288+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103288+0000","last_peered":"2024-03-04T06:55:13.103288+0000","last_clean":"2024-03-04T06:55:13.103288+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103288+0000","last_undegraded":"2024-03-04T06:55:13.103288+0000","last_fullsized":"2024-03-04T06:55:13.103288+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116955+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.116955+0000","last_peered":"2024-03-04T06:55:13.116955+0000","last_clean":"2024-03-04T06:55:13.116955+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.116955+0000","last_undegraded":"2024-03-04T06:55:13.116955+0000","last_fullsized":"2024-03-04T06:55:13.116955+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115370+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115370+0000","last_peered":"2024-03-04T06:55:13.115370+0000","last_clean":"2024-03-04T06:55:13.115370+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115370+0000","last_undegraded":"2024-03-04T06:55:13.115370+0000","last_fullsized":"2024-03-04T06:55:13.115370+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106086+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106086+0000","last_peered":"2024-03-04T06:55:13.106086+0000","last_clean":"2024-03-04T06:55:13.106086+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106086+0000","last_undegraded":"2024-03-04T06:55:13.106086+0000","last_fullsized":"2024-03-04T06:55:13.106086+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101948+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.101948+0000","last_peered":"2024-03-04T06:55:13.101948+0000","last_clean":"2024-03-04T06:55:13.101948+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.101948+0000","last_undegraded":"2024-03-04T06:55:13.101948+0000","last_fullsized":"2024-03-04T06:55:13.101948+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106042+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106042+0000","last_peered":"2024-03-04T06:55:13.106042+0000","last_clean":"2024-03-04T06:55:13.106042+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106042+0000","last_undegraded":"2024-03-04T06:55:13.106042+0000","last_fullsized":"2024-03-04T06:55:13.106042+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101755+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101755+0000","last_peered":"2024-03-04T06:55:13.101755+0000","last_clean":"2024-03-04T06:55:13.101755+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101755+0000","last_undegraded":"2024-03-04T06:55:13.101755+0000","last_fullsized":"2024-03-04T06:55:13.101755+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097051+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:13.097051+0000","last_peered":"2024-03-04T06:55:13.097051+0000","last_clean":"2024-03-04T06:55:13.097051+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:13.097051+0000","last_undegraded":"2024-03-04T06:55:13.097051+0000","last_fullsized":"2024-03-04T06:55:13.097051+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1063,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102987+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.102987+0000","last_peered":"2024-03-04T06:55:13.102987+0000","last_clean":"2024-03-04T06:55:13.102987+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.102987+0000","last_undegraded":"2024-03-04T06:55:13.102987+0000","last_fullsized":"2024-03-04T06:55:13.102987+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114958+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.114958+0000","last_peered":"2024-03-04T06:55:13.114958+0000","last_clean":"2024-03-04T06:55:13.114958+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.114958+0000","last_undegraded":"2024-03-04T06:55:13.114958+0000","last_fullsized":"2024-03-04T06:55:13.114958+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114806+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114806+0000","last_peered":"2024-03-04T06:55:13.114806+0000","last_clean":"2024-03-04T06:55:13.114806+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114806+0000","last_undegraded":"2024-03-04T06:55:13.114806+0000","last_fullsized":"2024-03-04T06:55:13.114806+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1153,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095907+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:13.095907+0000","last_peered":"2024-03-04T06:55:13.095907+0000","last_clean":"2024-03-04T06:55:13.095907+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:13.095907+0000","last_undegraded":"2024-03-04T06:55:13.095907+0000","last_fullsized":"2024-03-04T06:55:13.095907+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1198,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098969+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.098969+0000","last_peered":"2024-03-04T06:55:13.098969+0000","last_clean":"2024-03-04T06:55:13.098969+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.098969+0000","last_undegraded":"2024-03-04T06:55:13.098969+0000","last_fullsized":"2024-03-04T06:55:13.098969+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115324+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:13.115324+0000","last_peered":"2024-03-04T06:55:13.115324+0000","last_clean":"2024-03-04T06:55:13.115324+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:13.115324+0000","last_undegraded":"2024-03-04T06:55:13.115324+0000","last_fullsized":"2024-03-04T06:55:13.115324+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115685+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115685+0000","last_peered":"2024-03-04T06:55:13.115685+0000","last_clean":"2024-03-04T06:55:13.115685+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115685+0000","last_undegraded":"2024-03-04T06:55:13.115685+0000","last_fullsized":"2024-03-04T06:55:13.115685+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104938+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104938+0000","last_peered":"2024-03-04T06:55:13.104938+0000","last_clean":"2024-03-04T06:55:13.104938+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104938+0000","last_undegraded":"2024-03-04T06:55:13.104938+0000","last_fullsized":"2024-03-04T06:55:13.104938+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1124,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106955+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.106955+0000","last_peered":"2024-03-04T06:55:13.106955+0000","last_clean":"2024-03-04T06:55:13.106955+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.106955+0000","last_undegraded":"2024-03-04T06:55:13.106955+0000","last_fullsized":"2024-03-04T06:55:13.106955+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096883+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096883+0000","last_peered":"2024-03-04T06:55:13.096883+0000","last_clean":"2024-03-04T06:55:13.096883+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096883+0000","last_undegraded":"2024-03-04T06:55:13.096883+0000","last_fullsized":"2024-03-04T06:55:13.096883+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102246+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102246+0000","last_peered":"2024-03-04T06:55:13.102246+0000","last_clean":"2024-03-04T06:55:13.102246+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102246+0000","last_undegraded":"2024-03-04T06:55:13.102246+0000","last_fullsized":"2024-03-04T06:55:13.102246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116560+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116560+0000","last_peered":"2024-03-04T06:55:13.116560+0000","last_clean":"2024-03-04T06:55:13.116560+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116560+0000","last_undegraded":"2024-03-04T06:55:13.116560+0000","last_fullsized":"2024-03-04T06:55:13.116560+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1192,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097564+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:13.097564+0000","last_peered":"2024-03-04T06:55:13.097564+0000","last_clean":"2024-03-04T06:55:13.097564+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:13.097564+0000","last_undegraded":"2024-03-04T06:55:13.097564+0000","last_fullsized":"2024-03-04T06:55:13.097564+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097791+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:13.097791+0000","last_peered":"2024-03-04T06:55:13.097791+0000","last_clean":"2024-03-04T06:55:13.097791+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:13.097791+0000","last_undegraded":"2024-03-04T06:55:13.097791+0000","last_fullsized":"2024-03-04T06:55:13.097791+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115577+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.115577+0000","last_peered":"2024-03-04T06:55:13.115577+0000","last_clean":"2024-03-04T06:55:13.115577+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.115577+0000","last_undegraded":"2024-03-04T06:55:13.115577+0000","last_fullsized":"2024-03-04T06:55:13.115577+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1233,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098515+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098515+0000","last_peered":"2024-03-04T06:55:13.098515+0000","last_clean":"2024-03-04T06:55:13.098515+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098515+0000","last_undegraded":"2024-03-04T06:55:13.098515+0000","last_fullsized":"2024-03-04T06:55:13.098515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1220,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097456+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097456+0000","last_peered":"2024-03-04T06:55:13.097456+0000","last_clean":"2024-03-04T06:55:13.097456+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097456+0000","last_undegraded":"2024-03-04T06:55:13.097456+0000","last_fullsized":"2024-03-04T06:55:13.097456+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1068,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102398+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102398+0000","last_peered":"2024-03-04T06:55:13.102398+0000","last_clean":"2024-03-04T06:55:13.102398+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102398+0000","last_undegraded":"2024-03-04T06:55:13.102398+0000","last_fullsized":"2024-03-04T06:55:13.102398+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1124,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106153+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106153+0000","last_peered":"2024-03-04T06:55:13.106153+0000","last_clean":"2024-03-04T06:55:13.106153+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106153+0000","last_undegraded":"2024-03-04T06:55:13.106153+0000","last_fullsized":"2024-03-04T06:55:13.106153+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098905+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:13.098905+0000","last_peered":"2024-03-04T06:55:13.098905+0000","last_clean":"2024-03-04T06:55:13.098905+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:13.098905+0000","last_undegraded":"2024-03-04T06:55:13.098905+0000","last_fullsized":"2024-03-04T06:55:13.098905+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1187,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095993+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.095993+0000","last_peered":"2024-03-04T06:55:13.095993+0000","last_clean":"2024-03-04T06:55:13.095993+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.095993+0000","last_undegraded":"2024-03-04T06:55:13.095993+0000","last_fullsized":"2024-03-04T06:55:13.095993+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114659+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114659+0000","last_peered":"2024-03-04T06:55:13.114659+0000","last_clean":"2024-03-04T06:55:13.114659+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114659+0000","last_undegraded":"2024-03-04T06:55:13.114659+0000","last_fullsized":"2024-03-04T06:55:13.114659+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1294,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117725+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.117725+0000","last_peered":"2024-03-04T06:55:13.117725+0000","last_clean":"2024-03-04T06:55:13.117725+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.117725+0000","last_undegraded":"2024-03-04T06:55:13.117725+0000","last_fullsized":"2024-03-04T06:55:13.117725+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096686+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096686+0000","last_peered":"2024-03-04T06:55:13.096686+0000","last_clean":"2024-03-04T06:55:13.096686+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096686+0000","last_undegraded":"2024-03-04T06:55:13.096686+0000","last_fullsized":"2024-03-04T06:55:13.096686+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097180+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097180+0000","last_peered":"2024-03-04T06:55:13.097180+0000","last_clean":"2024-03-04T06:55:13.097180+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097180+0000","last_undegraded":"2024-03-04T06:55:13.097180+0000","last_fullsized":"2024-03-04T06:55:13.097180+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105539+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105539+0000","last_peered":"2024-03-04T06:55:13.105539+0000","last_clean":"2024-03-04T06:55:13.105539+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105539+0000","last_undegraded":"2024-03-04T06:55:13.105539+0000","last_fullsized":"2024-03-04T06:55:13.105539+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115781+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115781+0000","last_peered":"2024-03-04T06:55:13.115781+0000","last_clean":"2024-03-04T06:55:13.115781+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115781+0000","last_undegraded":"2024-03-04T06:55:13.115781+0000","last_fullsized":"2024-03-04T06:55:13.115781+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115093+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115093+0000","last_peered":"2024-03-04T06:55:13.115093+0000","last_clean":"2024-03-04T06:55:13.115093+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115093+0000","last_undegraded":"2024-03-04T06:55:13.115093+0000","last_fullsized":"2024-03-04T06:55:13.115093+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1109,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105408+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105408+0000","last_peered":"2024-03-04T06:55:13.105408+0000","last_clean":"2024-03-04T06:55:13.105408+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105408+0000","last_undegraded":"2024-03-04T06:55:13.105408+0000","last_fullsized":"2024-03-04T06:55:13.105408+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105858+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105858+0000","last_peered":"2024-03-04T06:55:13.105858+0000","last_clean":"2024-03-04T06:55:13.105858+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105858+0000","last_undegraded":"2024-03-04T06:55:13.105858+0000","last_fullsized":"2024-03-04T06:55:13.105858+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1294,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116105+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116105+0000","last_peered":"2024-03-04T06:55:13.116105+0000","last_clean":"2024-03-04T06:55:13.116105+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116105+0000","last_undegraded":"2024-03-04T06:55:13.116105+0000","last_fullsized":"2024-03-04T06:55:13.116105+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116036+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116036+0000","last_peered":"2024-03-04T06:55:13.116036+0000","last_clean":"2024-03-04T06:55:13.116036+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116036+0000","last_undegraded":"2024-03-04T06:55:13.116036+0000","last_fullsized":"2024-03-04T06:55:13.116036+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096448+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:13.096448+0000","last_peered":"2024-03-04T06:55:13.096448+0000","last_clean":"2024-03-04T06:55:13.096448+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:13.096448+0000","last_undegraded":"2024-03-04T06:55:13.096448+0000","last_fullsized":"2024-03-04T06:55:13.096448+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114921+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114921+0000","last_peered":"2024-03-04T06:55:13.114921+0000","last_clean":"2024-03-04T06:55:13.114921+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114921+0000","last_undegraded":"2024-03-04T06:55:13.114921+0000","last_fullsized":"2024-03-04T06:55:13.114921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102608+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102608+0000","last_peered":"2024-03-04T06:55:13.102608+0000","last_clean":"2024-03-04T06:55:13.102608+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102608+0000","last_undegraded":"2024-03-04T06:55:13.102608+0000","last_fullsized":"2024-03-04T06:55:13.102608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117741+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:13.117741+0000","last_peered":"2024-03-04T06:55:13.117741+0000","last_clean":"2024-03-04T06:55:13.117741+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:13.117741+0000","last_undegraded":"2024-03-04T06:55:13.117741+0000","last_fullsized":"2024-03-04T06:55:13.117741+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098491+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098491+0000","last_peered":"2024-03-04T06:55:13.098491+0000","last_clean":"2024-03-04T06:55:13.098491+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098491+0000","last_undegraded":"2024-03-04T06:55:13.098491+0000","last_fullsized":"2024-03-04T06:55:13.098491+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105849+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105849+0000","last_peered":"2024-03-04T06:55:13.105849+0000","last_clean":"2024-03-04T06:55:13.105849+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105849+0000","last_undegraded":"2024-03-04T06:55:13.105849+0000","last_fullsized":"2024-03-04T06:55:13.105849+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102507+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102507+0000","last_peered":"2024-03-04T06:55:13.102507+0000","last_clean":"2024-03-04T06:55:13.102507+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102507+0000","last_undegraded":"2024-03-04T06:55:13.102507+0000","last_fullsized":"2024-03-04T06:55:13.102507+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114409+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114409+0000","last_peered":"2024-03-04T06:55:13.114409+0000","last_clean":"2024-03-04T06:55:13.114409+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114409+0000","last_undegraded":"2024-03-04T06:55:13.114409+0000","last_fullsized":"2024-03-04T06:55:13.114409+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114411+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114411+0000","last_peered":"2024-03-04T06:55:13.114411+0000","last_clean":"2024-03-04T06:55:13.114411+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114411+0000","last_undegraded":"2024-03-04T06:55:13.114411+0000","last_fullsized":"2024-03-04T06:55:13.114411+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1251,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096553+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096553+0000","last_peered":"2024-03-04T06:55:13.096553+0000","last_clean":"2024-03-04T06:55:13.096553+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096553+0000","last_undegraded":"2024-03-04T06:55:13.096553+0000","last_fullsized":"2024-03-04T06:55:13.096553+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101772+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101772+0000","last_peered":"2024-03-04T06:55:13.101772+0000","last_clean":"2024-03-04T06:55:13.101772+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101772+0000","last_undegraded":"2024-03-04T06:55:13.101772+0000","last_fullsized":"2024-03-04T06:55:13.101772+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3575,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096388+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:13.096388+0000","last_peered":"2024-03-04T06:55:13.096388+0000","last_clean":"2024-03-04T06:55:13.096388+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:13.096388+0000","last_undegraded":"2024-03-04T06:55:13.096388+0000","last_fullsized":"2024-03-04T06:55:13.096388+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096934+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096934+0000","last_peered":"2024-03-04T06:55:13.096934+0000","last_clean":"2024-03-04T06:55:13.096934+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096934+0000","last_undegraded":"2024-03-04T06:55:13.096934+0000","last_fullsized":"2024-03-04T06:55:13.096934+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102885+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102885+0000","last_peered":"2024-03-04T06:55:13.102885+0000","last_clean":"2024-03-04T06:55:13.102885+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102885+0000","last_undegraded":"2024-03-04T06:55:13.102885+0000","last_fullsized":"2024-03-04T06:55:13.102885+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17114,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117468+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117468+0000","last_peered":"2024-03-04T06:55:13.117468+0000","last_clean":"2024-03-04T06:55:13.117468+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117468+0000","last_undegraded":"2024-03-04T06:55:13.117468+0000","last_fullsized":"2024-03-04T06:55:13.117468+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115048+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115048+0000","last_peered":"2024-03-04T06:55:13.115048+0000","last_clean":"2024-03-04T06:55:13.115048+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115048+0000","last_undegraded":"2024-03-04T06:55:13.115048+0000","last_fullsized":"2024-03-04T06:55:13.115048+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116658+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116658+0000","last_peered":"2024-03-04T06:55:13.116658+0000","last_clean":"2024-03-04T06:55:13.116658+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116658+0000","last_undegraded":"2024-03-04T06:55:13.116658+0000","last_fullsized":"2024-03-04T06:55:13.116658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105904+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.105904+0000","last_peered":"2024-03-04T06:55:13.105904+0000","last_clean":"2024-03-04T06:55:13.105904+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.105904+0000","last_undegraded":"2024-03-04T06:55:13.105904+0000","last_fullsized":"2024-03-04T06:55:13.105904+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4384,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.116730+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.116730+0000","last_peered":"2024-03-04T06:55:13.116730+0000","last_clean":"2024-03-04T06:55:13.116730+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.116730+0000","last_undegraded":"2024-03-04T06:55:13.116730+0000","last_fullsized":"2024-03-04T06:55:13.116730+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115924+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115924+0000","last_peered":"2024-03-04T06:55:13.115924+0000","last_clean":"2024-03-04T06:55:13.115924+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115924+0000","last_undegraded":"2024-03-04T06:55:13.115924+0000","last_fullsized":"2024-03-04T06:55:13.115924+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105684+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105684+0000","last_peered":"2024-03-04T06:55:13.105684+0000","last_clean":"2024-03-04T06:55:13.105684+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105684+0000","last_undegraded":"2024-03-04T06:55:13.105684+0000","last_fullsized":"2024-03-04T06:55:13.105684+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096227+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096227+0000","last_peered":"2024-03-04T06:55:13.096227+0000","last_clean":"2024-03-04T06:55:13.096227+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096227+0000","last_undegraded":"2024-03-04T06:55:13.096227+0000","last_fullsized":"2024-03-04T06:55:13.096227+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5637,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097231+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:13.097231+0000","last_peered":"2024-03-04T06:55:13.097231+0000","last_clean":"2024-03-04T06:55:13.097231+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:13.097231+0000","last_undegraded":"2024-03-04T06:55:13.097231+0000","last_fullsized":"2024-03-04T06:55:13.097231+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116182+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.116182+0000","last_peered":"2024-03-04T06:55:13.116182+0000","last_clean":"2024-03-04T06:55:13.116182+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.116182+0000","last_undegraded":"2024-03-04T06:55:13.116182+0000","last_fullsized":"2024-03-04T06:55:13.116182+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114108+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114108+0000","last_peered":"2024-03-04T06:55:13.114108+0000","last_clean":"2024-03-04T06:55:13.114108+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114108+0000","last_undegraded":"2024-03-04T06:55:13.114108+0000","last_fullsized":"2024-03-04T06:55:13.114108+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096536+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:13.096536+0000","last_peered":"2024-03-04T06:55:13.096536+0000","last_clean":"2024-03-04T06:55:13.096536+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:13.096536+0000","last_undegraded":"2024-03-04T06:55:13.096536+0000","last_fullsized":"2024-03-04T06:55:13.096536+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4013,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.106850+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.106850+0000","last_peered":"2024-03-04T06:55:13.106850+0000","last_clean":"2024-03-04T06:55:13.106850+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.106850+0000","last_undegraded":"2024-03-04T06:55:13.106850+0000","last_fullsized":"2024-03-04T06:55:13.106850+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1089,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115029+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:13.115029+0000","last_peered":"2024-03-04T06:55:13.115029+0000","last_clean":"2024-03-04T06:55:13.115029+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:13.115029+0000","last_undegraded":"2024-03-04T06:55:13.115029+0000","last_fullsized":"2024-03-04T06:55:13.115029+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098368+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098368+0000","last_peered":"2024-03-04T06:55:13.098368+0000","last_clean":"2024-03-04T06:55:13.098368+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098368+0000","last_undegraded":"2024-03-04T06:55:13.098368+0000","last_fullsized":"2024-03-04T06:55:13.098368+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105176+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105176+0000","last_peered":"2024-03-04T06:55:13.105176+0000","last_clean":"2024-03-04T06:55:13.105176+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105176+0000","last_undegraded":"2024-03-04T06:55:13.105176+0000","last_fullsized":"2024-03-04T06:55:13.105176+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1548,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101670+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101670+0000","last_peered":"2024-03-04T06:55:13.101670+0000","last_clean":"2024-03-04T06:55:13.101670+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101670+0000","last_undegraded":"2024-03-04T06:55:13.101670+0000","last_fullsized":"2024-03-04T06:55:13.101670+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3949,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.128010+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:13.128010+0000","last_peered":"2024-03-04T06:55:13.128010+0000","last_clean":"2024-03-04T06:55:13.128010+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:13.128010+0000","last_undegraded":"2024-03-04T06:55:13.128010+0000","last_fullsized":"2024-03-04T06:55:13.128010+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117334+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117334+0000","last_peered":"2024-03-04T06:55:13.117334+0000","last_clean":"2024-03-04T06:55:13.117334+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117334+0000","last_undegraded":"2024-03-04T06:55:13.117334+0000","last_fullsized":"2024-03-04T06:55:13.117334+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096315+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:13.096315+0000","last_peered":"2024-03-04T06:55:13.096315+0000","last_clean":"2024-03-04T06:55:13.096315+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:13.096315+0000","last_undegraded":"2024-03-04T06:55:13.096315+0000","last_fullsized":"2024-03-04T06:55:13.096315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1055,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101642+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101642+0000","last_peered":"2024-03-04T06:55:13.101642+0000","last_clean":"2024-03-04T06:55:13.101642+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101642+0000","last_undegraded":"2024-03-04T06:55:13.101642+0000","last_fullsized":"2024-03-04T06:55:13.101642+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15289,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.174017+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:13.174017+0000","last_peered":"2024-03-04T06:55:13.174017+0000","last_clean":"2024-03-04T06:55:13.174017+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:13.174017+0000","last_undegraded":"2024-03-04T06:55:13.174017+0000","last_fullsized":"2024-03-04T06:55:13.174017+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117486+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117486+0000","last_peered":"2024-03-04T06:55:13.117486+0000","last_clean":"2024-03-04T06:55:13.117486+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117486+0000","last_undegraded":"2024-03-04T06:55:13.117486+0000","last_fullsized":"2024-03-04T06:55:13.117486+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102522+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102522+0000","last_peered":"2024-03-04T06:55:13.102522+0000","last_clean":"2024-03-04T06:55:13.102522+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102522+0000","last_undegraded":"2024-03-04T06:55:13.102522+0000","last_fullsized":"2024-03-04T06:55:13.102522+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116017+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116017+0000","last_peered":"2024-03-04T06:55:13.116017+0000","last_clean":"2024-03-04T06:55:13.116017+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116017+0000","last_undegraded":"2024-03-04T06:55:13.116017+0000","last_fullsized":"2024-03-04T06:55:13.116017+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4377,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097266+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097266+0000","last_peered":"2024-03-04T06:55:13.097266+0000","last_clean":"2024-03-04T06:55:13.097266+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097266+0000","last_undegraded":"2024-03-04T06:55:13.097266+0000","last_fullsized":"2024-03-04T06:55:13.097266+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097555+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:13.097555+0000","last_peered":"2024-03-04T06:55:13.097555+0000","last_clean":"2024-03-04T06:55:13.097555+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:13.097555+0000","last_undegraded":"2024-03-04T06:55:13.097555+0000","last_fullsized":"2024-03-04T06:55:13.097555+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117221+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.117221+0000","last_peered":"2024-03-04T06:55:13.117221+0000","last_clean":"2024-03-04T06:55:13.117221+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.117221+0000","last_undegraded":"2024-03-04T06:55:13.117221+0000","last_fullsized":"2024-03-04T06:55:13.117221+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097200+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097200+0000","last_peered":"2024-03-04T06:55:13.097200+0000","last_clean":"2024-03-04T06:55:13.097200+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097200+0000","last_undegraded":"2024-03-04T06:55:13.097200+0000","last_fullsized":"2024-03-04T06:55:13.097200+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4607,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.307314+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:13.307314+0000","last_peered":"2024-03-04T06:55:13.307314+0000","last_clean":"2024-03-04T06:55:13.307314+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:13.307314+0000","last_undegraded":"2024-03-04T06:55:13.307314+0000","last_fullsized":"2024-03-04T06:55:13.307314+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095643+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095643+0000","last_peered":"2024-03-04T06:55:13.095643+0000","last_clean":"2024-03-04T06:55:13.095643+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095643+0000","last_undegraded":"2024-03-04T06:55:13.095643+0000","last_fullsized":"2024-03-04T06:55:13.095643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1076,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115089+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115089+0000","last_peered":"2024-03-04T06:55:13.115089+0000","last_clean":"2024-03-04T06:55:13.115089+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115089+0000","last_undegraded":"2024-03-04T06:55:13.115089+0000","last_fullsized":"2024-03-04T06:55:13.115089+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115325+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115325+0000","last_peered":"2024-03-04T06:55:13.115325+0000","last_clean":"2024-03-04T06:55:13.115325+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115325+0000","last_undegraded":"2024-03-04T06:55:13.115325+0000","last_fullsized":"2024-03-04T06:55:13.115325+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4632,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107104+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:13.107104+0000","last_peered":"2024-03-04T06:55:13.107104+0000","last_clean":"2024-03-04T06:55:13.107104+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:13.107104+0000","last_undegraded":"2024-03-04T06:55:13.107104+0000","last_fullsized":"2024-03-04T06:55:13.107104+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1055,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101919+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101919+0000","last_peered":"2024-03-04T06:55:13.101919+0000","last_clean":"2024-03-04T06:55:13.101919+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101919+0000","last_undegraded":"2024-03-04T06:55:13.101919+0000","last_fullsized":"2024-03-04T06:55:13.101919+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1183,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095626+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095626+0000","last_peered":"2024-03-04T06:55:13.095626+0000","last_clean":"2024-03-04T06:55:13.095626+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095626+0000","last_undegraded":"2024-03-04T06:55:13.095626+0000","last_fullsized":"2024-03-04T06:55:13.095626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5156,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.111062+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.111062+0000","last_peered":"2024-03-04T06:55:13.111062+0000","last_clean":"2024-03-04T06:55:13.111062+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.111062+0000","last_undegraded":"2024-03-04T06:55:13.111062+0000","last_fullsized":"2024-03-04T06:55:13.111062+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116686+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.116686+0000","last_peered":"2024-03-04T06:55:13.116686+0000","last_clean":"2024-03-04T06:55:13.116686+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.116686+0000","last_undegraded":"2024-03-04T06:55:13.116686+0000","last_fullsized":"2024-03-04T06:55:13.116686+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097769+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097769+0000","last_peered":"2024-03-04T06:55:13.097769+0000","last_clean":"2024-03-04T06:55:13.097769+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097769+0000","last_undegraded":"2024-03-04T06:55:13.097769+0000","last_fullsized":"2024-03-04T06:55:13.097769+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4717,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.167577+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.167577+0000","last_peered":"2024-03-04T06:55:13.167577+0000","last_clean":"2024-03-04T06:55:13.167577+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.167577+0000","last_undegraded":"2024-03-04T06:55:13.167577+0000","last_fullsized":"2024-03-04T06:55:13.167577+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114842+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.114842+0000","last_peered":"2024-03-04T06:55:13.114842+0000","last_clean":"2024-03-04T06:55:13.114842+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.114842+0000","last_undegraded":"2024-03-04T06:55:13.114842+0000","last_fullsized":"2024-03-04T06:55:13.114842+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098787+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098787+0000","last_peered":"2024-03-04T06:55:13.098787+0000","last_clean":"2024-03-04T06:55:13.098787+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098787+0000","last_undegraded":"2024-03-04T06:55:13.098787+0000","last_fullsized":"2024-03-04T06:55:13.098787+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5552,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.116584+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:13.116584+0000","last_peered":"2024-03-04T06:55:13.116584+0000","last_clean":"2024-03-04T06:55:13.116584+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:13.116584+0000","last_undegraded":"2024-03-04T06:55:13.116584+0000","last_fullsized":"2024-03-04T06:55:13.116584+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102342+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102342+0000","last_peered":"2024-03-04T06:55:13.102342+0000","last_clean":"2024-03-04T06:55:13.102342+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102342+0000","last_undegraded":"2024-03-04T06:55:13.102342+0000","last_fullsized":"2024-03-04T06:55:13.102342+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114629+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114629+0000","last_peered":"2024-03-04T06:55:13.114629+0000","last_clean":"2024-03-04T06:55:13.114629+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114629+0000","last_undegraded":"2024-03-04T06:55:13.114629+0000","last_fullsized":"2024-03-04T06:55:13.114629+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096744+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096744+0000","last_peered":"2024-03-04T06:55:13.096744+0000","last_clean":"2024-03-04T06:55:13.096744+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096744+0000","last_undegraded":"2024-03-04T06:55:13.096744+0000","last_fullsized":"2024-03-04T06:55:13.096744+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097188+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097188+0000","last_peered":"2024-03-04T06:55:13.097188+0000","last_clean":"2024-03-04T06:55:13.097188+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097188+0000","last_undegraded":"2024-03-04T06:55:13.097188+0000","last_fullsized":"2024-03-04T06:55:13.097188+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102416+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102416+0000","last_peered":"2024-03-04T06:55:13.102416+0000","last_clean":"2024-03-04T06:55:13.102416+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102416+0000","last_undegraded":"2024-03-04T06:55:13.102416+0000","last_fullsized":"2024-03-04T06:55:13.102416+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4364,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.314051+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:13.314051+0000","last_peered":"2024-03-04T06:55:13.314051+0000","last_clean":"2024-03-04T06:55:13.314051+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:13.314051+0000","last_undegraded":"2024-03-04T06:55:13.314051+0000","last_fullsized":"2024-03-04T06:55:13.314051+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115486+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:13.115486+0000","last_peered":"2024-03-04T06:55:13.115486+0000","last_clean":"2024-03-04T06:55:13.115486+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:13.115486+0000","last_undegraded":"2024-03-04T06:55:13.115486+0000","last_fullsized":"2024-03-04T06:55:13.115486+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1137,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105774+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:13.105774+0000","last_peered":"2024-03-04T06:55:13.105774+0000","last_clean":"2024-03-04T06:55:13.105774+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:13.105774+0000","last_undegraded":"2024-03-04T06:55:13.105774+0000","last_fullsized":"2024-03-04T06:55:13.105774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4598,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.321650+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.321650+0000","last_peered":"2024-03-04T06:55:13.321650+0000","last_clean":"2024-03-04T06:55:13.321650+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.321650+0000","last_undegraded":"2024-03-04T06:55:13.321650+0000","last_fullsized":"2024-03-04T06:55:13.321650+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097451+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097451+0000","last_peered":"2024-03-04T06:55:13.097451+0000","last_clean":"2024-03-04T06:55:13.097451+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097451+0000","last_undegraded":"2024-03-04T06:55:13.097451+0000","last_fullsized":"2024-03-04T06:55:13.097451+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104831+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.104831+0000","last_peered":"2024-03-04T06:55:13.104831+0000","last_clean":"2024-03-04T06:55:13.104831+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.104831+0000","last_undegraded":"2024-03-04T06:55:13.104831+0000","last_fullsized":"2024-03-04T06:55:13.104831+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114405+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:13.114405+0000","last_peered":"2024-03-04T06:55:13.114405+0000","last_clean":"2024-03-04T06:55:13.114405+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:13.114405+0000","last_undegraded":"2024-03-04T06:55:13.114405+0000","last_fullsized":"2024-03-04T06:55:13.114405+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096648+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:13.096648+0000","last_peered":"2024-03-04T06:55:13.096648+0000","last_clean":"2024-03-04T06:55:13.096648+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:13.096648+0000","last_undegraded":"2024-03-04T06:55:13.096648+0000","last_fullsized":"2024-03-04T06:55:13.096648+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105999+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.105999+0000","last_peered":"2024-03-04T06:55:13.105999+0000","last_clean":"2024-03-04T06:55:13.105999+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.105999+0000","last_undegraded":"2024-03-04T06:55:13.105999+0000","last_fullsized":"2024-03-04T06:55:13.105999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117074+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117074+0000","last_peered":"2024-03-04T06:55:13.117074+0000","last_clean":"2024-03-04T06:55:13.117074+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117074+0000","last_undegraded":"2024-03-04T06:55:13.117074+0000","last_fullsized":"2024-03-04T06:55:13.117074+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096759+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096759+0000","last_peered":"2024-03-04T06:55:13.096759+0000","last_clean":"2024-03-04T06:55:13.096759+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096759+0000","last_undegraded":"2024-03-04T06:55:13.096759+0000","last_fullsized":"2024-03-04T06:55:13.096759+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115428+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.115428+0000","last_peered":"2024-03-04T06:55:13.115428+0000","last_clean":"2024-03-04T06:55:13.115428+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.115428+0000","last_undegraded":"2024-03-04T06:55:13.115428+0000","last_fullsized":"2024-03-04T06:55:13.115428+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115239+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115239+0000","last_peered":"2024-03-04T06:55:13.115239+0000","last_clean":"2024-03-04T06:55:13.115239+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115239+0000","last_undegraded":"2024-03-04T06:55:13.115239+0000","last_fullsized":"2024-03-04T06:55:13.115239+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1192,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097432+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097432+0000","last_peered":"2024-03-04T06:55:13.097432+0000","last_clean":"2024-03-04T06:55:13.097432+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097432+0000","last_undegraded":"2024-03-04T06:55:13.097432+0000","last_fullsized":"2024-03-04T06:55:13.097432+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105275+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:13.105275+0000","last_peered":"2024-03-04T06:55:13.105275+0000","last_clean":"2024-03-04T06:55:13.105275+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:13.105275+0000","last_undegraded":"2024-03-04T06:55:13.105275+0000","last_fullsized":"2024-03-04T06:55:13.105275+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096564+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096564+0000","last_peered":"2024-03-04T06:55:13.096564+0000","last_clean":"2024-03-04T06:55:13.096564+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096564+0000","last_undegraded":"2024-03-04T06:55:13.096564+0000","last_fullsized":"2024-03-04T06:55:13.096564+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105520+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:13.105520+0000","last_peered":"2024-03-04T06:55:13.105520+0000","last_clean":"2024-03-04T06:55:13.105520+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:13.105520+0000","last_undegraded":"2024-03-04T06:55:13.105520+0000","last_fullsized":"2024-03-04T06:55:13.105520+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116864+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116864+0000","last_peered":"2024-03-04T06:55:13.116864+0000","last_clean":"2024-03-04T06:55:13.116864+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116864+0000","last_undegraded":"2024-03-04T06:55:13.116864+0000","last_fullsized":"2024-03-04T06:55:13.116864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114786+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114786+0000","last_peered":"2024-03-04T06:55:13.114786+0000","last_clean":"2024-03-04T06:55:13.114786+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114786+0000","last_undegraded":"2024-03-04T06:55:13.114786+0000","last_fullsized":"2024-03-04T06:55:13.114786+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503426,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648073,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142380,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287027,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997733,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885790,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937367,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792720,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:55:32.098 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:32.098 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:32.098 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:32.098 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:32.098 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:32.098 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:32.098 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:32.098 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:32.099 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:32.099 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:32.099 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:55:32.398 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:32 smithi203 ceph-mon[85573]: pgmap v930: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:32.398 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:32 smithi203 ceph-mon[85573]: from='client.44444 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:55:32.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:32 smithi137 ceph-mon[88869]: pgmap v930: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:32.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:32 smithi137 ceph-mon[88869]: from='client.44444 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:55:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:32 smithi137 ceph-mon[91314]: pgmap v930: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:32 smithi137 ceph-mon[91314]: from='client.44444 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:55:34.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:34 smithi137 ceph-mon[88869]: pgmap v931: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:34.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:34 smithi137 ceph-mon[91314]: pgmap v931: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:34.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:34 smithi203 ceph-mon[85573]: pgmap v931: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:35.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:55:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:55:35] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:55:36.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:36 smithi137 ceph-mon[88869]: pgmap v932: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:36.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:36 smithi137 ceph-mon[91314]: pgmap v932: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:36.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:36 smithi203 ceph-mon[85573]: pgmap v932: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:38.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:38 smithi137 ceph-mon[88869]: pgmap v933: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:38 smithi137 ceph-mon[91314]: pgmap v933: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:38.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:38 smithi203 ceph-mon[85573]: pgmap v933: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:39.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:55:39.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:55:39.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:55:40.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:40 smithi137 ceph-mon[88869]: pgmap v934: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:40.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:40 smithi137 ceph-mon[91314]: pgmap v934: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:40.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:40 smithi203 ceph-mon[85573]: pgmap v934: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:42.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:55:42.320 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:55:42.442 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:42 smithi137 ceph-mon[88869]: pgmap v935: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:42.442 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:42 smithi137 ceph-mon[91314]: pgmap v935: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:42.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:42 smithi203 ceph-mon[85573]: pgmap v935: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:44.111 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:55:44.113 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:55:44.483 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:44 smithi137 ceph-mon[88869]: pgmap v936: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:44.483 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:44 smithi137 ceph-mon[91314]: pgmap v936: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:44.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:44 smithi203 ceph-mon[85573]: pgmap v936: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:44.749 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":936,"stamp":"2024-03-04T06:55:42.465699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004035"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103288+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103288+0000","last_peered":"2024-03-04T06:55:13.103288+0000","last_clean":"2024-03-04T06:55:13.103288+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103288+0000","last_undegraded":"2024-03-04T06:55:13.103288+0000","last_fullsized":"2024-03-04T06:55:13.103288+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116955+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.116955+0000","last_peered":"2024-03-04T06:55:13.116955+0000","last_clean":"2024-03-04T06:55:13.116955+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.116955+0000","last_undegraded":"2024-03-04T06:55:13.116955+0000","last_fullsized":"2024-03-04T06:55:13.116955+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115370+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115370+0000","last_peered":"2024-03-04T06:55:13.115370+0000","last_clean":"2024-03-04T06:55:13.115370+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115370+0000","last_undegraded":"2024-03-04T06:55:13.115370+0000","last_fullsized":"2024-03-04T06:55:13.115370+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106086+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106086+0000","last_peered":"2024-03-04T06:55:13.106086+0000","last_clean":"2024-03-04T06:55:13.106086+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106086+0000","last_undegraded":"2024-03-04T06:55:13.106086+0000","last_fullsized":"2024-03-04T06:55:13.106086+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101948+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.101948+0000","last_peered":"2024-03-04T06:55:13.101948+0000","last_clean":"2024-03-04T06:55:13.101948+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.101948+0000","last_undegraded":"2024-03-04T06:55:13.101948+0000","last_fullsized":"2024-03-04T06:55:13.101948+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106042+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106042+0000","last_peered":"2024-03-04T06:55:13.106042+0000","last_clean":"2024-03-04T06:55:13.106042+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106042+0000","last_undegraded":"2024-03-04T06:55:13.106042+0000","last_fullsized":"2024-03-04T06:55:13.106042+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101755+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101755+0000","last_peered":"2024-03-04T06:55:13.101755+0000","last_clean":"2024-03-04T06:55:13.101755+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101755+0000","last_undegraded":"2024-03-04T06:55:13.101755+0000","last_fullsized":"2024-03-04T06:55:13.101755+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097051+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:13.097051+0000","last_peered":"2024-03-04T06:55:13.097051+0000","last_clean":"2024-03-04T06:55:13.097051+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:13.097051+0000","last_undegraded":"2024-03-04T06:55:13.097051+0000","last_fullsized":"2024-03-04T06:55:13.097051+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1063,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102987+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.102987+0000","last_peered":"2024-03-04T06:55:13.102987+0000","last_clean":"2024-03-04T06:55:13.102987+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.102987+0000","last_undegraded":"2024-03-04T06:55:13.102987+0000","last_fullsized":"2024-03-04T06:55:13.102987+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114958+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.114958+0000","last_peered":"2024-03-04T06:55:13.114958+0000","last_clean":"2024-03-04T06:55:13.114958+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.114958+0000","last_undegraded":"2024-03-04T06:55:13.114958+0000","last_fullsized":"2024-03-04T06:55:13.114958+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114806+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114806+0000","last_peered":"2024-03-04T06:55:13.114806+0000","last_clean":"2024-03-04T06:55:13.114806+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114806+0000","last_undegraded":"2024-03-04T06:55:13.114806+0000","last_fullsized":"2024-03-04T06:55:13.114806+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1154,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095971+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:13.095971+0000","last_peered":"2024-03-04T06:55:13.095971+0000","last_clean":"2024-03-04T06:55:13.095971+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:13.095971+0000","last_undegraded":"2024-03-04T06:55:13.095971+0000","last_fullsized":"2024-03-04T06:55:13.095971+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1198,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098969+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.098969+0000","last_peered":"2024-03-04T06:55:13.098969+0000","last_clean":"2024-03-04T06:55:13.098969+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.098969+0000","last_undegraded":"2024-03-04T06:55:13.098969+0000","last_fullsized":"2024-03-04T06:55:13.098969+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115324+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:13.115324+0000","last_peered":"2024-03-04T06:55:13.115324+0000","last_clean":"2024-03-04T06:55:13.115324+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:13.115324+0000","last_undegraded":"2024-03-04T06:55:13.115324+0000","last_fullsized":"2024-03-04T06:55:13.115324+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115685+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115685+0000","last_peered":"2024-03-04T06:55:13.115685+0000","last_clean":"2024-03-04T06:55:13.115685+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115685+0000","last_undegraded":"2024-03-04T06:55:13.115685+0000","last_fullsized":"2024-03-04T06:55:13.115685+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104938+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104938+0000","last_peered":"2024-03-04T06:55:13.104938+0000","last_clean":"2024-03-04T06:55:13.104938+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104938+0000","last_undegraded":"2024-03-04T06:55:13.104938+0000","last_fullsized":"2024-03-04T06:55:13.104938+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1124,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106955+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.106955+0000","last_peered":"2024-03-04T06:55:13.106955+0000","last_clean":"2024-03-04T06:55:13.106955+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.106955+0000","last_undegraded":"2024-03-04T06:55:13.106955+0000","last_fullsized":"2024-03-04T06:55:13.106955+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096883+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096883+0000","last_peered":"2024-03-04T06:55:13.096883+0000","last_clean":"2024-03-04T06:55:13.096883+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096883+0000","last_undegraded":"2024-03-04T06:55:13.096883+0000","last_fullsized":"2024-03-04T06:55:13.096883+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102246+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102246+0000","last_peered":"2024-03-04T06:55:13.102246+0000","last_clean":"2024-03-04T06:55:13.102246+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102246+0000","last_undegraded":"2024-03-04T06:55:13.102246+0000","last_fullsized":"2024-03-04T06:55:13.102246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116560+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116560+0000","last_peered":"2024-03-04T06:55:13.116560+0000","last_clean":"2024-03-04T06:55:13.116560+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116560+0000","last_undegraded":"2024-03-04T06:55:13.116560+0000","last_fullsized":"2024-03-04T06:55:13.116560+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1192,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097564+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:13.097564+0000","last_peered":"2024-03-04T06:55:13.097564+0000","last_clean":"2024-03-04T06:55:13.097564+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:13.097564+0000","last_undegraded":"2024-03-04T06:55:13.097564+0000","last_fullsized":"2024-03-04T06:55:13.097564+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097791+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:13.097791+0000","last_peered":"2024-03-04T06:55:13.097791+0000","last_clean":"2024-03-04T06:55:13.097791+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:13.097791+0000","last_undegraded":"2024-03-04T06:55:13.097791+0000","last_fullsized":"2024-03-04T06:55:13.097791+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115577+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.115577+0000","last_peered":"2024-03-04T06:55:13.115577+0000","last_clean":"2024-03-04T06:55:13.115577+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.115577+0000","last_undegraded":"2024-03-04T06:55:13.115577+0000","last_fullsized":"2024-03-04T06:55:13.115577+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1233,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098515+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098515+0000","last_peered":"2024-03-04T06:55:13.098515+0000","last_clean":"2024-03-04T06:55:13.098515+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098515+0000","last_undegraded":"2024-03-04T06:55:13.098515+0000","last_fullsized":"2024-03-04T06:55:13.098515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1220,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097456+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097456+0000","last_peered":"2024-03-04T06:55:13.097456+0000","last_clean":"2024-03-04T06:55:13.097456+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097456+0000","last_undegraded":"2024-03-04T06:55:13.097456+0000","last_fullsized":"2024-03-04T06:55:13.097456+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1068,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102398+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102398+0000","last_peered":"2024-03-04T06:55:13.102398+0000","last_clean":"2024-03-04T06:55:13.102398+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102398+0000","last_undegraded":"2024-03-04T06:55:13.102398+0000","last_fullsized":"2024-03-04T06:55:13.102398+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1124,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106153+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106153+0000","last_peered":"2024-03-04T06:55:13.106153+0000","last_clean":"2024-03-04T06:55:13.106153+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106153+0000","last_undegraded":"2024-03-04T06:55:13.106153+0000","last_fullsized":"2024-03-04T06:55:13.106153+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098905+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:13.098905+0000","last_peered":"2024-03-04T06:55:13.098905+0000","last_clean":"2024-03-04T06:55:13.098905+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:13.098905+0000","last_undegraded":"2024-03-04T06:55:13.098905+0000","last_fullsized":"2024-03-04T06:55:13.098905+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1187,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095993+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.095993+0000","last_peered":"2024-03-04T06:55:13.095993+0000","last_clean":"2024-03-04T06:55:13.095993+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.095993+0000","last_undegraded":"2024-03-04T06:55:13.095993+0000","last_fullsized":"2024-03-04T06:55:13.095993+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114659+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114659+0000","last_peered":"2024-03-04T06:55:13.114659+0000","last_clean":"2024-03-04T06:55:13.114659+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114659+0000","last_undegraded":"2024-03-04T06:55:13.114659+0000","last_fullsized":"2024-03-04T06:55:13.114659+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1294,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117725+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.117725+0000","last_peered":"2024-03-04T06:55:13.117725+0000","last_clean":"2024-03-04T06:55:13.117725+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.117725+0000","last_undegraded":"2024-03-04T06:55:13.117725+0000","last_fullsized":"2024-03-04T06:55:13.117725+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096686+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096686+0000","last_peered":"2024-03-04T06:55:13.096686+0000","last_clean":"2024-03-04T06:55:13.096686+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096686+0000","last_undegraded":"2024-03-04T06:55:13.096686+0000","last_fullsized":"2024-03-04T06:55:13.096686+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097180+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097180+0000","last_peered":"2024-03-04T06:55:13.097180+0000","last_clean":"2024-03-04T06:55:13.097180+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097180+0000","last_undegraded":"2024-03-04T06:55:13.097180+0000","last_fullsized":"2024-03-04T06:55:13.097180+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105539+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105539+0000","last_peered":"2024-03-04T06:55:13.105539+0000","last_clean":"2024-03-04T06:55:13.105539+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105539+0000","last_undegraded":"2024-03-04T06:55:13.105539+0000","last_fullsized":"2024-03-04T06:55:13.105539+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115781+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115781+0000","last_peered":"2024-03-04T06:55:13.115781+0000","last_clean":"2024-03-04T06:55:13.115781+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115781+0000","last_undegraded":"2024-03-04T06:55:13.115781+0000","last_fullsized":"2024-03-04T06:55:13.115781+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115093+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115093+0000","last_peered":"2024-03-04T06:55:13.115093+0000","last_clean":"2024-03-04T06:55:13.115093+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115093+0000","last_undegraded":"2024-03-04T06:55:13.115093+0000","last_fullsized":"2024-03-04T06:55:13.115093+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1109,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105408+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105408+0000","last_peered":"2024-03-04T06:55:13.105408+0000","last_clean":"2024-03-04T06:55:13.105408+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105408+0000","last_undegraded":"2024-03-04T06:55:13.105408+0000","last_fullsized":"2024-03-04T06:55:13.105408+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105858+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105858+0000","last_peered":"2024-03-04T06:55:13.105858+0000","last_clean":"2024-03-04T06:55:13.105858+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105858+0000","last_undegraded":"2024-03-04T06:55:13.105858+0000","last_fullsized":"2024-03-04T06:55:13.105858+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116155+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116155+0000","last_peered":"2024-03-04T06:55:13.116155+0000","last_clean":"2024-03-04T06:55:13.116155+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116155+0000","last_undegraded":"2024-03-04T06:55:13.116155+0000","last_fullsized":"2024-03-04T06:55:13.116155+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116036+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116036+0000","last_peered":"2024-03-04T06:55:13.116036+0000","last_clean":"2024-03-04T06:55:13.116036+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116036+0000","last_undegraded":"2024-03-04T06:55:13.116036+0000","last_fullsized":"2024-03-04T06:55:13.116036+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096448+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:13.096448+0000","last_peered":"2024-03-04T06:55:13.096448+0000","last_clean":"2024-03-04T06:55:13.096448+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:13.096448+0000","last_undegraded":"2024-03-04T06:55:13.096448+0000","last_fullsized":"2024-03-04T06:55:13.096448+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114921+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114921+0000","last_peered":"2024-03-04T06:55:13.114921+0000","last_clean":"2024-03-04T06:55:13.114921+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114921+0000","last_undegraded":"2024-03-04T06:55:13.114921+0000","last_fullsized":"2024-03-04T06:55:13.114921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102608+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102608+0000","last_peered":"2024-03-04T06:55:13.102608+0000","last_clean":"2024-03-04T06:55:13.102608+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102608+0000","last_undegraded":"2024-03-04T06:55:13.102608+0000","last_fullsized":"2024-03-04T06:55:13.102608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117741+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:13.117741+0000","last_peered":"2024-03-04T06:55:13.117741+0000","last_clean":"2024-03-04T06:55:13.117741+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:13.117741+0000","last_undegraded":"2024-03-04T06:55:13.117741+0000","last_fullsized":"2024-03-04T06:55:13.117741+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098491+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098491+0000","last_peered":"2024-03-04T06:55:13.098491+0000","last_clean":"2024-03-04T06:55:13.098491+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098491+0000","last_undegraded":"2024-03-04T06:55:13.098491+0000","last_fullsized":"2024-03-04T06:55:13.098491+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105849+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105849+0000","last_peered":"2024-03-04T06:55:13.105849+0000","last_clean":"2024-03-04T06:55:13.105849+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105849+0000","last_undegraded":"2024-03-04T06:55:13.105849+0000","last_fullsized":"2024-03-04T06:55:13.105849+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102507+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102507+0000","last_peered":"2024-03-04T06:55:13.102507+0000","last_clean":"2024-03-04T06:55:13.102507+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102507+0000","last_undegraded":"2024-03-04T06:55:13.102507+0000","last_fullsized":"2024-03-04T06:55:13.102507+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114409+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114409+0000","last_peered":"2024-03-04T06:55:13.114409+0000","last_clean":"2024-03-04T06:55:13.114409+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114409+0000","last_undegraded":"2024-03-04T06:55:13.114409+0000","last_fullsized":"2024-03-04T06:55:13.114409+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114411+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114411+0000","last_peered":"2024-03-04T06:55:13.114411+0000","last_clean":"2024-03-04T06:55:13.114411+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114411+0000","last_undegraded":"2024-03-04T06:55:13.114411+0000","last_fullsized":"2024-03-04T06:55:13.114411+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1251,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096553+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096553+0000","last_peered":"2024-03-04T06:55:13.096553+0000","last_clean":"2024-03-04T06:55:13.096553+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096553+0000","last_undegraded":"2024-03-04T06:55:13.096553+0000","last_fullsized":"2024-03-04T06:55:13.096553+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101772+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101772+0000","last_peered":"2024-03-04T06:55:13.101772+0000","last_clean":"2024-03-04T06:55:13.101772+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101772+0000","last_undegraded":"2024-03-04T06:55:13.101772+0000","last_fullsized":"2024-03-04T06:55:13.101772+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3575,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096388+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:13.096388+0000","last_peered":"2024-03-04T06:55:13.096388+0000","last_clean":"2024-03-04T06:55:13.096388+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:13.096388+0000","last_undegraded":"2024-03-04T06:55:13.096388+0000","last_fullsized":"2024-03-04T06:55:13.096388+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096934+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096934+0000","last_peered":"2024-03-04T06:55:13.096934+0000","last_clean":"2024-03-04T06:55:13.096934+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096934+0000","last_undegraded":"2024-03-04T06:55:13.096934+0000","last_fullsized":"2024-03-04T06:55:13.096934+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102885+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102885+0000","last_peered":"2024-03-04T06:55:13.102885+0000","last_clean":"2024-03-04T06:55:13.102885+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102885+0000","last_undegraded":"2024-03-04T06:55:13.102885+0000","last_fullsized":"2024-03-04T06:55:13.102885+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17114,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117468+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117468+0000","last_peered":"2024-03-04T06:55:13.117468+0000","last_clean":"2024-03-04T06:55:13.117468+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117468+0000","last_undegraded":"2024-03-04T06:55:13.117468+0000","last_fullsized":"2024-03-04T06:55:13.117468+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115048+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115048+0000","last_peered":"2024-03-04T06:55:13.115048+0000","last_clean":"2024-03-04T06:55:13.115048+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115048+0000","last_undegraded":"2024-03-04T06:55:13.115048+0000","last_fullsized":"2024-03-04T06:55:13.115048+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116658+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116658+0000","last_peered":"2024-03-04T06:55:13.116658+0000","last_clean":"2024-03-04T06:55:13.116658+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116658+0000","last_undegraded":"2024-03-04T06:55:13.116658+0000","last_fullsized":"2024-03-04T06:55:13.116658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105904+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.105904+0000","last_peered":"2024-03-04T06:55:13.105904+0000","last_clean":"2024-03-04T06:55:13.105904+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.105904+0000","last_undegraded":"2024-03-04T06:55:13.105904+0000","last_fullsized":"2024-03-04T06:55:13.105904+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4384,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.116730+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.116730+0000","last_peered":"2024-03-04T06:55:13.116730+0000","last_clean":"2024-03-04T06:55:13.116730+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.116730+0000","last_undegraded":"2024-03-04T06:55:13.116730+0000","last_fullsized":"2024-03-04T06:55:13.116730+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115924+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115924+0000","last_peered":"2024-03-04T06:55:13.115924+0000","last_clean":"2024-03-04T06:55:13.115924+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115924+0000","last_undegraded":"2024-03-04T06:55:13.115924+0000","last_fullsized":"2024-03-04T06:55:13.115924+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105684+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105684+0000","last_peered":"2024-03-04T06:55:13.105684+0000","last_clean":"2024-03-04T06:55:13.105684+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105684+0000","last_undegraded":"2024-03-04T06:55:13.105684+0000","last_fullsized":"2024-03-04T06:55:13.105684+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096227+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096227+0000","last_peered":"2024-03-04T06:55:13.096227+0000","last_clean":"2024-03-04T06:55:13.096227+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096227+0000","last_undegraded":"2024-03-04T06:55:13.096227+0000","last_fullsized":"2024-03-04T06:55:13.096227+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5637,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097231+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:13.097231+0000","last_peered":"2024-03-04T06:55:13.097231+0000","last_clean":"2024-03-04T06:55:13.097231+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:13.097231+0000","last_undegraded":"2024-03-04T06:55:13.097231+0000","last_fullsized":"2024-03-04T06:55:13.097231+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116182+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.116182+0000","last_peered":"2024-03-04T06:55:13.116182+0000","last_clean":"2024-03-04T06:55:13.116182+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.116182+0000","last_undegraded":"2024-03-04T06:55:13.116182+0000","last_fullsized":"2024-03-04T06:55:13.116182+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114108+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114108+0000","last_peered":"2024-03-04T06:55:13.114108+0000","last_clean":"2024-03-04T06:55:13.114108+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114108+0000","last_undegraded":"2024-03-04T06:55:13.114108+0000","last_fullsized":"2024-03-04T06:55:13.114108+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096536+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:13.096536+0000","last_peered":"2024-03-04T06:55:13.096536+0000","last_clean":"2024-03-04T06:55:13.096536+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:13.096536+0000","last_undegraded":"2024-03-04T06:55:13.096536+0000","last_fullsized":"2024-03-04T06:55:13.096536+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4013,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.106850+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.106850+0000","last_peered":"2024-03-04T06:55:13.106850+0000","last_clean":"2024-03-04T06:55:13.106850+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.106850+0000","last_undegraded":"2024-03-04T06:55:13.106850+0000","last_fullsized":"2024-03-04T06:55:13.106850+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1089,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115029+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:13.115029+0000","last_peered":"2024-03-04T06:55:13.115029+0000","last_clean":"2024-03-04T06:55:13.115029+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:13.115029+0000","last_undegraded":"2024-03-04T06:55:13.115029+0000","last_fullsized":"2024-03-04T06:55:13.115029+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098368+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098368+0000","last_peered":"2024-03-04T06:55:13.098368+0000","last_clean":"2024-03-04T06:55:13.098368+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098368+0000","last_undegraded":"2024-03-04T06:55:13.098368+0000","last_fullsized":"2024-03-04T06:55:13.098368+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105176+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105176+0000","last_peered":"2024-03-04T06:55:13.105176+0000","last_clean":"2024-03-04T06:55:13.105176+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105176+0000","last_undegraded":"2024-03-04T06:55:13.105176+0000","last_fullsized":"2024-03-04T06:55:13.105176+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1548,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101670+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101670+0000","last_peered":"2024-03-04T06:55:13.101670+0000","last_clean":"2024-03-04T06:55:13.101670+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101670+0000","last_undegraded":"2024-03-04T06:55:13.101670+0000","last_fullsized":"2024-03-04T06:55:13.101670+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3949,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.128010+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:13.128010+0000","last_peered":"2024-03-04T06:55:13.128010+0000","last_clean":"2024-03-04T06:55:13.128010+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:13.128010+0000","last_undegraded":"2024-03-04T06:55:13.128010+0000","last_fullsized":"2024-03-04T06:55:13.128010+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117334+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117334+0000","last_peered":"2024-03-04T06:55:13.117334+0000","last_clean":"2024-03-04T06:55:13.117334+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117334+0000","last_undegraded":"2024-03-04T06:55:13.117334+0000","last_fullsized":"2024-03-04T06:55:13.117334+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096315+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:13.096315+0000","last_peered":"2024-03-04T06:55:13.096315+0000","last_clean":"2024-03-04T06:55:13.096315+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:13.096315+0000","last_undegraded":"2024-03-04T06:55:13.096315+0000","last_fullsized":"2024-03-04T06:55:13.096315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1055,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101642+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101642+0000","last_peered":"2024-03-04T06:55:13.101642+0000","last_clean":"2024-03-04T06:55:13.101642+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101642+0000","last_undegraded":"2024-03-04T06:55:13.101642+0000","last_fullsized":"2024-03-04T06:55:13.101642+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15289,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.174017+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:13.174017+0000","last_peered":"2024-03-04T06:55:13.174017+0000","last_clean":"2024-03-04T06:55:13.174017+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:13.174017+0000","last_undegraded":"2024-03-04T06:55:13.174017+0000","last_fullsized":"2024-03-04T06:55:13.174017+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117486+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117486+0000","last_peered":"2024-03-04T06:55:13.117486+0000","last_clean":"2024-03-04T06:55:13.117486+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117486+0000","last_undegraded":"2024-03-04T06:55:13.117486+0000","last_fullsized":"2024-03-04T06:55:13.117486+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102522+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102522+0000","last_peered":"2024-03-04T06:55:13.102522+0000","last_clean":"2024-03-04T06:55:13.102522+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102522+0000","last_undegraded":"2024-03-04T06:55:13.102522+0000","last_fullsized":"2024-03-04T06:55:13.102522+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116017+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116017+0000","last_peered":"2024-03-04T06:55:13.116017+0000","last_clean":"2024-03-04T06:55:13.116017+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116017+0000","last_undegraded":"2024-03-04T06:55:13.116017+0000","last_fullsized":"2024-03-04T06:55:13.116017+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4377,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097266+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097266+0000","last_peered":"2024-03-04T06:55:13.097266+0000","last_clean":"2024-03-04T06:55:13.097266+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097266+0000","last_undegraded":"2024-03-04T06:55:13.097266+0000","last_fullsized":"2024-03-04T06:55:13.097266+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097555+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:13.097555+0000","last_peered":"2024-03-04T06:55:13.097555+0000","last_clean":"2024-03-04T06:55:13.097555+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:13.097555+0000","last_undegraded":"2024-03-04T06:55:13.097555+0000","last_fullsized":"2024-03-04T06:55:13.097555+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117221+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.117221+0000","last_peered":"2024-03-04T06:55:13.117221+0000","last_clean":"2024-03-04T06:55:13.117221+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.117221+0000","last_undegraded":"2024-03-04T06:55:13.117221+0000","last_fullsized":"2024-03-04T06:55:13.117221+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097200+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097200+0000","last_peered":"2024-03-04T06:55:13.097200+0000","last_clean":"2024-03-04T06:55:13.097200+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097200+0000","last_undegraded":"2024-03-04T06:55:13.097200+0000","last_fullsized":"2024-03-04T06:55:13.097200+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4607,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.307314+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:13.307314+0000","last_peered":"2024-03-04T06:55:13.307314+0000","last_clean":"2024-03-04T06:55:13.307314+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:13.307314+0000","last_undegraded":"2024-03-04T06:55:13.307314+0000","last_fullsized":"2024-03-04T06:55:13.307314+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095643+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095643+0000","last_peered":"2024-03-04T06:55:13.095643+0000","last_clean":"2024-03-04T06:55:13.095643+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095643+0000","last_undegraded":"2024-03-04T06:55:13.095643+0000","last_fullsized":"2024-03-04T06:55:13.095643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1076,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115089+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115089+0000","last_peered":"2024-03-04T06:55:13.115089+0000","last_clean":"2024-03-04T06:55:13.115089+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115089+0000","last_undegraded":"2024-03-04T06:55:13.115089+0000","last_fullsized":"2024-03-04T06:55:13.115089+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115325+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115325+0000","last_peered":"2024-03-04T06:55:13.115325+0000","last_clean":"2024-03-04T06:55:13.115325+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115325+0000","last_undegraded":"2024-03-04T06:55:13.115325+0000","last_fullsized":"2024-03-04T06:55:13.115325+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4633,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107390+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:13.107390+0000","last_peered":"2024-03-04T06:55:13.107390+0000","last_clean":"2024-03-04T06:55:13.107390+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:13.107390+0000","last_undegraded":"2024-03-04T06:55:13.107390+0000","last_fullsized":"2024-03-04T06:55:13.107390+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1055,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101919+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101919+0000","last_peered":"2024-03-04T06:55:13.101919+0000","last_clean":"2024-03-04T06:55:13.101919+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101919+0000","last_undegraded":"2024-03-04T06:55:13.101919+0000","last_fullsized":"2024-03-04T06:55:13.101919+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1183,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095626+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095626+0000","last_peered":"2024-03-04T06:55:13.095626+0000","last_clean":"2024-03-04T06:55:13.095626+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095626+0000","last_undegraded":"2024-03-04T06:55:13.095626+0000","last_fullsized":"2024-03-04T06:55:13.095626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5156,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.111062+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.111062+0000","last_peered":"2024-03-04T06:55:13.111062+0000","last_clean":"2024-03-04T06:55:13.111062+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.111062+0000","last_undegraded":"2024-03-04T06:55:13.111062+0000","last_fullsized":"2024-03-04T06:55:13.111062+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116686+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.116686+0000","last_peered":"2024-03-04T06:55:13.116686+0000","last_clean":"2024-03-04T06:55:13.116686+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.116686+0000","last_undegraded":"2024-03-04T06:55:13.116686+0000","last_fullsized":"2024-03-04T06:55:13.116686+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097769+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097769+0000","last_peered":"2024-03-04T06:55:13.097769+0000","last_clean":"2024-03-04T06:55:13.097769+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097769+0000","last_undegraded":"2024-03-04T06:55:13.097769+0000","last_fullsized":"2024-03-04T06:55:13.097769+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4717,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.167577+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.167577+0000","last_peered":"2024-03-04T06:55:13.167577+0000","last_clean":"2024-03-04T06:55:13.167577+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.167577+0000","last_undegraded":"2024-03-04T06:55:13.167577+0000","last_fullsized":"2024-03-04T06:55:13.167577+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114842+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.114842+0000","last_peered":"2024-03-04T06:55:13.114842+0000","last_clean":"2024-03-04T06:55:13.114842+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.114842+0000","last_undegraded":"2024-03-04T06:55:13.114842+0000","last_fullsized":"2024-03-04T06:55:13.114842+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098787+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098787+0000","last_peered":"2024-03-04T06:55:13.098787+0000","last_clean":"2024-03-04T06:55:13.098787+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098787+0000","last_undegraded":"2024-03-04T06:55:13.098787+0000","last_fullsized":"2024-03-04T06:55:13.098787+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5553,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117009+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:13.117009+0000","last_peered":"2024-03-04T06:55:13.117009+0000","last_clean":"2024-03-04T06:55:13.117009+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:13.117009+0000","last_undegraded":"2024-03-04T06:55:13.117009+0000","last_fullsized":"2024-03-04T06:55:13.117009+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102342+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102342+0000","last_peered":"2024-03-04T06:55:13.102342+0000","last_clean":"2024-03-04T06:55:13.102342+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102342+0000","last_undegraded":"2024-03-04T06:55:13.102342+0000","last_fullsized":"2024-03-04T06:55:13.102342+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114629+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114629+0000","last_peered":"2024-03-04T06:55:13.114629+0000","last_clean":"2024-03-04T06:55:13.114629+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114629+0000","last_undegraded":"2024-03-04T06:55:13.114629+0000","last_fullsized":"2024-03-04T06:55:13.114629+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096744+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096744+0000","last_peered":"2024-03-04T06:55:13.096744+0000","last_clean":"2024-03-04T06:55:13.096744+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096744+0000","last_undegraded":"2024-03-04T06:55:13.096744+0000","last_fullsized":"2024-03-04T06:55:13.096744+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097188+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097188+0000","last_peered":"2024-03-04T06:55:13.097188+0000","last_clean":"2024-03-04T06:55:13.097188+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097188+0000","last_undegraded":"2024-03-04T06:55:13.097188+0000","last_fullsized":"2024-03-04T06:55:13.097188+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102416+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102416+0000","last_peered":"2024-03-04T06:55:13.102416+0000","last_clean":"2024-03-04T06:55:13.102416+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102416+0000","last_undegraded":"2024-03-04T06:55:13.102416+0000","last_fullsized":"2024-03-04T06:55:13.102416+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4364,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.314051+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:13.314051+0000","last_peered":"2024-03-04T06:55:13.314051+0000","last_clean":"2024-03-04T06:55:13.314051+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:13.314051+0000","last_undegraded":"2024-03-04T06:55:13.314051+0000","last_fullsized":"2024-03-04T06:55:13.314051+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115541+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:13.115541+0000","last_peered":"2024-03-04T06:55:13.115541+0000","last_clean":"2024-03-04T06:55:13.115541+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:13.115541+0000","last_undegraded":"2024-03-04T06:55:13.115541+0000","last_fullsized":"2024-03-04T06:55:13.115541+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105888+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:13.105888+0000","last_peered":"2024-03-04T06:55:13.105888+0000","last_clean":"2024-03-04T06:55:13.105888+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:13.105888+0000","last_undegraded":"2024-03-04T06:55:13.105888+0000","last_fullsized":"2024-03-04T06:55:13.105888+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4598,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.321650+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.321650+0000","last_peered":"2024-03-04T06:55:13.321650+0000","last_clean":"2024-03-04T06:55:13.321650+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.321650+0000","last_undegraded":"2024-03-04T06:55:13.321650+0000","last_fullsized":"2024-03-04T06:55:13.321650+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097451+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097451+0000","last_peered":"2024-03-04T06:55:13.097451+0000","last_clean":"2024-03-04T06:55:13.097451+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097451+0000","last_undegraded":"2024-03-04T06:55:13.097451+0000","last_fullsized":"2024-03-04T06:55:13.097451+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104831+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.104831+0000","last_peered":"2024-03-04T06:55:13.104831+0000","last_clean":"2024-03-04T06:55:13.104831+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.104831+0000","last_undegraded":"2024-03-04T06:55:13.104831+0000","last_fullsized":"2024-03-04T06:55:13.104831+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114405+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:13.114405+0000","last_peered":"2024-03-04T06:55:13.114405+0000","last_clean":"2024-03-04T06:55:13.114405+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:13.114405+0000","last_undegraded":"2024-03-04T06:55:13.114405+0000","last_fullsized":"2024-03-04T06:55:13.114405+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096648+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:13.096648+0000","last_peered":"2024-03-04T06:55:13.096648+0000","last_clean":"2024-03-04T06:55:13.096648+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:13.096648+0000","last_undegraded":"2024-03-04T06:55:13.096648+0000","last_fullsized":"2024-03-04T06:55:13.096648+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105999+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.105999+0000","last_peered":"2024-03-04T06:55:13.105999+0000","last_clean":"2024-03-04T06:55:13.105999+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.105999+0000","last_undegraded":"2024-03-04T06:55:13.105999+0000","last_fullsized":"2024-03-04T06:55:13.105999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117074+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117074+0000","last_peered":"2024-03-04T06:55:13.117074+0000","last_clean":"2024-03-04T06:55:13.117074+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117074+0000","last_undegraded":"2024-03-04T06:55:13.117074+0000","last_fullsized":"2024-03-04T06:55:13.117074+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096759+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096759+0000","last_peered":"2024-03-04T06:55:13.096759+0000","last_clean":"2024-03-04T06:55:13.096759+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096759+0000","last_undegraded":"2024-03-04T06:55:13.096759+0000","last_fullsized":"2024-03-04T06:55:13.096759+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115428+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.115428+0000","last_peered":"2024-03-04T06:55:13.115428+0000","last_clean":"2024-03-04T06:55:13.115428+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.115428+0000","last_undegraded":"2024-03-04T06:55:13.115428+0000","last_fullsized":"2024-03-04T06:55:13.115428+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115239+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115239+0000","last_peered":"2024-03-04T06:55:13.115239+0000","last_clean":"2024-03-04T06:55:13.115239+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115239+0000","last_undegraded":"2024-03-04T06:55:13.115239+0000","last_fullsized":"2024-03-04T06:55:13.115239+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1192,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097432+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097432+0000","last_peered":"2024-03-04T06:55:13.097432+0000","last_clean":"2024-03-04T06:55:13.097432+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097432+0000","last_undegraded":"2024-03-04T06:55:13.097432+0000","last_fullsized":"2024-03-04T06:55:13.097432+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105275+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:13.105275+0000","last_peered":"2024-03-04T06:55:13.105275+0000","last_clean":"2024-03-04T06:55:13.105275+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:13.105275+0000","last_undegraded":"2024-03-04T06:55:13.105275+0000","last_fullsized":"2024-03-04T06:55:13.105275+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096564+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096564+0000","last_peered":"2024-03-04T06:55:13.096564+0000","last_clean":"2024-03-04T06:55:13.096564+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096564+0000","last_undegraded":"2024-03-04T06:55:13.096564+0000","last_fullsized":"2024-03-04T06:55:13.096564+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105576+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:13.105576+0000","last_peered":"2024-03-04T06:55:13.105576+0000","last_clean":"2024-03-04T06:55:13.105576+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:13.105576+0000","last_undegraded":"2024-03-04T06:55:13.105576+0000","last_fullsized":"2024-03-04T06:55:13.105576+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116864+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116864+0000","last_peered":"2024-03-04T06:55:13.116864+0000","last_clean":"2024-03-04T06:55:13.116864+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116864+0000","last_undegraded":"2024-03-04T06:55:13.116864+0000","last_fullsized":"2024-03-04T06:55:13.116864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114786+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114786+0000","last_peered":"2024-03-04T06:55:13.114786+0000","last_clean":"2024-03-04T06:55:13.114786+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114786+0000","last_undegraded":"2024-03-04T06:55:13.114786+0000","last_fullsized":"2024-03-04T06:55:13.114786+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503428,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648075,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142382,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287029,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997735,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885792,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937369,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792722,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:55:44.753 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:44.753 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:44.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:44.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:44.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:44.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:44.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:44.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:44.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:44.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:44.754 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:55:45.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:45 smithi137 ceph-mon[88869]: from='client.34509 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:55:45.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:45 smithi137 ceph-mon[91314]: from='client.34509 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:55:45.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:55:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:55:45] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:55:45.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:45 smithi203 ceph-mon[85573]: from='client.34509 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:55:46.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:46 smithi137 ceph-mon[88869]: pgmap v937: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:46.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:46 smithi137 ceph-mon[91314]: pgmap v937: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:46.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:46 smithi203 ceph-mon[85573]: pgmap v937: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:48 smithi137 ceph-mon[88869]: pgmap v938: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:48.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:48 smithi137 ceph-mon[91314]: pgmap v938: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:48.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:48 smithi203 ceph-mon[85573]: pgmap v938: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:50.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:50 smithi137 ceph-mon[88869]: pgmap v939: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:50.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:50 smithi137 ceph-mon[91314]: pgmap v939: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:50.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:50 smithi203 ceph-mon[85573]: pgmap v939: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:52 smithi137 ceph-mon[88869]: pgmap v940: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:52.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:52 smithi137 ceph-mon[91314]: pgmap v940: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:52.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:52 smithi203 ceph-mon[85573]: pgmap v940: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:54.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:54 smithi137 ceph-mon[88869]: pgmap v941: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:54.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:55:54.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:54 smithi137 ceph-mon[91314]: pgmap v941: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:54.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:55:54.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:54 smithi203 ceph-mon[85573]: pgmap v941: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:54.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:55:54.755 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:55:54.976 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:55:55.437 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:55:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:55:55] "GET /metrics HTTP/1.1" 200 36338 "" "Prometheus/2.43.0" 2024-03-04T06:55:56.391 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:56 smithi137 ceph-mon[88869]: pgmap v942: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:56.392 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:56 smithi137 ceph-mon[91314]: pgmap v942: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:56.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:56 smithi203 ceph-mon[85573]: pgmap v942: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:55:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:55:57.619 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":943,"stamp":"2024-03-04T06:55:56.470118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003849"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103288+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103288+0000","last_peered":"2024-03-04T06:55:13.103288+0000","last_clean":"2024-03-04T06:55:13.103288+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103288+0000","last_undegraded":"2024-03-04T06:55:13.103288+0000","last_fullsized":"2024-03-04T06:55:13.103288+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116955+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.116955+0000","last_peered":"2024-03-04T06:55:13.116955+0000","last_clean":"2024-03-04T06:55:13.116955+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.116955+0000","last_undegraded":"2024-03-04T06:55:13.116955+0000","last_fullsized":"2024-03-04T06:55:13.116955+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115370+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115370+0000","last_peered":"2024-03-04T06:55:13.115370+0000","last_clean":"2024-03-04T06:55:13.115370+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115370+0000","last_undegraded":"2024-03-04T06:55:13.115370+0000","last_fullsized":"2024-03-04T06:55:13.115370+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106086+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106086+0000","last_peered":"2024-03-04T06:55:13.106086+0000","last_clean":"2024-03-04T06:55:13.106086+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106086+0000","last_undegraded":"2024-03-04T06:55:13.106086+0000","last_fullsized":"2024-03-04T06:55:13.106086+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101948+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.101948+0000","last_peered":"2024-03-04T06:55:13.101948+0000","last_clean":"2024-03-04T06:55:13.101948+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.101948+0000","last_undegraded":"2024-03-04T06:55:13.101948+0000","last_fullsized":"2024-03-04T06:55:13.101948+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106042+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106042+0000","last_peered":"2024-03-04T06:55:13.106042+0000","last_clean":"2024-03-04T06:55:13.106042+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106042+0000","last_undegraded":"2024-03-04T06:55:13.106042+0000","last_fullsized":"2024-03-04T06:55:13.106042+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101755+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101755+0000","last_peered":"2024-03-04T06:55:13.101755+0000","last_clean":"2024-03-04T06:55:13.101755+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101755+0000","last_undegraded":"2024-03-04T06:55:13.101755+0000","last_fullsized":"2024-03-04T06:55:13.101755+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097051+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:13.097051+0000","last_peered":"2024-03-04T06:55:13.097051+0000","last_clean":"2024-03-04T06:55:13.097051+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:13.097051+0000","last_undegraded":"2024-03-04T06:55:13.097051+0000","last_fullsized":"2024-03-04T06:55:13.097051+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1063,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102987+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.102987+0000","last_peered":"2024-03-04T06:55:13.102987+0000","last_clean":"2024-03-04T06:55:13.102987+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.102987+0000","last_undegraded":"2024-03-04T06:55:13.102987+0000","last_fullsized":"2024-03-04T06:55:13.102987+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114958+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.114958+0000","last_peered":"2024-03-04T06:55:13.114958+0000","last_clean":"2024-03-04T06:55:13.114958+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.114958+0000","last_undegraded":"2024-03-04T06:55:13.114958+0000","last_fullsized":"2024-03-04T06:55:13.114958+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114806+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114806+0000","last_peered":"2024-03-04T06:55:13.114806+0000","last_clean":"2024-03-04T06:55:13.114806+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114806+0000","last_undegraded":"2024-03-04T06:55:13.114806+0000","last_fullsized":"2024-03-04T06:55:13.114806+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1154,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095971+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:13.095971+0000","last_peered":"2024-03-04T06:55:13.095971+0000","last_clean":"2024-03-04T06:55:13.095971+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:13.095971+0000","last_undegraded":"2024-03-04T06:55:13.095971+0000","last_fullsized":"2024-03-04T06:55:13.095971+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1198,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098969+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.098969+0000","last_peered":"2024-03-04T06:55:13.098969+0000","last_clean":"2024-03-04T06:55:13.098969+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.098969+0000","last_undegraded":"2024-03-04T06:55:13.098969+0000","last_fullsized":"2024-03-04T06:55:13.098969+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115324+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:13.115324+0000","last_peered":"2024-03-04T06:55:13.115324+0000","last_clean":"2024-03-04T06:55:13.115324+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:13.115324+0000","last_undegraded":"2024-03-04T06:55:13.115324+0000","last_fullsized":"2024-03-04T06:55:13.115324+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115730+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115730+0000","last_peered":"2024-03-04T06:55:13.115730+0000","last_clean":"2024-03-04T06:55:13.115730+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115730+0000","last_undegraded":"2024-03-04T06:55:13.115730+0000","last_fullsized":"2024-03-04T06:55:13.115730+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104995+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104995+0000","last_peered":"2024-03-04T06:55:13.104995+0000","last_clean":"2024-03-04T06:55:13.104995+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104995+0000","last_undegraded":"2024-03-04T06:55:13.104995+0000","last_fullsized":"2024-03-04T06:55:13.104995+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.107002+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.107002+0000","last_peered":"2024-03-04T06:55:13.107002+0000","last_clean":"2024-03-04T06:55:13.107002+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.107002+0000","last_undegraded":"2024-03-04T06:55:13.107002+0000","last_fullsized":"2024-03-04T06:55:13.107002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096883+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096883+0000","last_peered":"2024-03-04T06:55:13.096883+0000","last_clean":"2024-03-04T06:55:13.096883+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096883+0000","last_undegraded":"2024-03-04T06:55:13.096883+0000","last_fullsized":"2024-03-04T06:55:13.096883+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102246+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102246+0000","last_peered":"2024-03-04T06:55:13.102246+0000","last_clean":"2024-03-04T06:55:13.102246+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102246+0000","last_undegraded":"2024-03-04T06:55:13.102246+0000","last_fullsized":"2024-03-04T06:55:13.102246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116560+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116560+0000","last_peered":"2024-03-04T06:55:13.116560+0000","last_clean":"2024-03-04T06:55:13.116560+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116560+0000","last_undegraded":"2024-03-04T06:55:13.116560+0000","last_fullsized":"2024-03-04T06:55:13.116560+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097609+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:13.097609+0000","last_peered":"2024-03-04T06:55:13.097609+0000","last_clean":"2024-03-04T06:55:13.097609+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:13.097609+0000","last_undegraded":"2024-03-04T06:55:13.097609+0000","last_fullsized":"2024-03-04T06:55:13.097609+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097848+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:13.097848+0000","last_peered":"2024-03-04T06:55:13.097848+0000","last_clean":"2024-03-04T06:55:13.097848+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:13.097848+0000","last_undegraded":"2024-03-04T06:55:13.097848+0000","last_fullsized":"2024-03-04T06:55:13.097848+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115577+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.115577+0000","last_peered":"2024-03-04T06:55:13.115577+0000","last_clean":"2024-03-04T06:55:13.115577+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.115577+0000","last_undegraded":"2024-03-04T06:55:13.115577+0000","last_fullsized":"2024-03-04T06:55:13.115577+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1233,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098515+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098515+0000","last_peered":"2024-03-04T06:55:13.098515+0000","last_clean":"2024-03-04T06:55:13.098515+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098515+0000","last_undegraded":"2024-03-04T06:55:13.098515+0000","last_fullsized":"2024-03-04T06:55:13.098515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1220,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097456+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097456+0000","last_peered":"2024-03-04T06:55:13.097456+0000","last_clean":"2024-03-04T06:55:13.097456+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097456+0000","last_undegraded":"2024-03-04T06:55:13.097456+0000","last_fullsized":"2024-03-04T06:55:13.097456+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1068,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102398+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102398+0000","last_peered":"2024-03-04T06:55:13.102398+0000","last_clean":"2024-03-04T06:55:13.102398+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102398+0000","last_undegraded":"2024-03-04T06:55:13.102398+0000","last_fullsized":"2024-03-04T06:55:13.102398+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1124,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106153+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106153+0000","last_peered":"2024-03-04T06:55:13.106153+0000","last_clean":"2024-03-04T06:55:13.106153+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106153+0000","last_undegraded":"2024-03-04T06:55:13.106153+0000","last_fullsized":"2024-03-04T06:55:13.106153+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098905+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:13.098905+0000","last_peered":"2024-03-04T06:55:13.098905+0000","last_clean":"2024-03-04T06:55:13.098905+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:13.098905+0000","last_undegraded":"2024-03-04T06:55:13.098905+0000","last_fullsized":"2024-03-04T06:55:13.098905+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1188,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096052+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.096052+0000","last_peered":"2024-03-04T06:55:13.096052+0000","last_clean":"2024-03-04T06:55:13.096052+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.096052+0000","last_undegraded":"2024-03-04T06:55:13.096052+0000","last_fullsized":"2024-03-04T06:55:13.096052+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114659+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114659+0000","last_peered":"2024-03-04T06:55:13.114659+0000","last_clean":"2024-03-04T06:55:13.114659+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114659+0000","last_undegraded":"2024-03-04T06:55:13.114659+0000","last_fullsized":"2024-03-04T06:55:13.114659+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1294,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117725+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.117725+0000","last_peered":"2024-03-04T06:55:13.117725+0000","last_clean":"2024-03-04T06:55:13.117725+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.117725+0000","last_undegraded":"2024-03-04T06:55:13.117725+0000","last_fullsized":"2024-03-04T06:55:13.117725+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096686+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096686+0000","last_peered":"2024-03-04T06:55:13.096686+0000","last_clean":"2024-03-04T06:55:13.096686+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096686+0000","last_undegraded":"2024-03-04T06:55:13.096686+0000","last_fullsized":"2024-03-04T06:55:13.096686+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097180+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097180+0000","last_peered":"2024-03-04T06:55:13.097180+0000","last_clean":"2024-03-04T06:55:13.097180+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097180+0000","last_undegraded":"2024-03-04T06:55:13.097180+0000","last_fullsized":"2024-03-04T06:55:13.097180+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105539+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105539+0000","last_peered":"2024-03-04T06:55:13.105539+0000","last_clean":"2024-03-04T06:55:13.105539+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105539+0000","last_undegraded":"2024-03-04T06:55:13.105539+0000","last_fullsized":"2024-03-04T06:55:13.105539+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115781+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115781+0000","last_peered":"2024-03-04T06:55:13.115781+0000","last_clean":"2024-03-04T06:55:13.115781+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115781+0000","last_undegraded":"2024-03-04T06:55:13.115781+0000","last_fullsized":"2024-03-04T06:55:13.115781+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115093+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115093+0000","last_peered":"2024-03-04T06:55:13.115093+0000","last_clean":"2024-03-04T06:55:13.115093+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115093+0000","last_undegraded":"2024-03-04T06:55:13.115093+0000","last_fullsized":"2024-03-04T06:55:13.115093+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1109,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105408+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105408+0000","last_peered":"2024-03-04T06:55:13.105408+0000","last_clean":"2024-03-04T06:55:13.105408+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105408+0000","last_undegraded":"2024-03-04T06:55:13.105408+0000","last_fullsized":"2024-03-04T06:55:13.105408+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105858+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105858+0000","last_peered":"2024-03-04T06:55:13.105858+0000","last_clean":"2024-03-04T06:55:13.105858+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105858+0000","last_undegraded":"2024-03-04T06:55:13.105858+0000","last_fullsized":"2024-03-04T06:55:13.105858+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116155+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116155+0000","last_peered":"2024-03-04T06:55:13.116155+0000","last_clean":"2024-03-04T06:55:13.116155+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116155+0000","last_undegraded":"2024-03-04T06:55:13.116155+0000","last_fullsized":"2024-03-04T06:55:13.116155+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116036+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116036+0000","last_peered":"2024-03-04T06:55:13.116036+0000","last_clean":"2024-03-04T06:55:13.116036+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116036+0000","last_undegraded":"2024-03-04T06:55:13.116036+0000","last_fullsized":"2024-03-04T06:55:13.116036+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096448+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:13.096448+0000","last_peered":"2024-03-04T06:55:13.096448+0000","last_clean":"2024-03-04T06:55:13.096448+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:13.096448+0000","last_undegraded":"2024-03-04T06:55:13.096448+0000","last_fullsized":"2024-03-04T06:55:13.096448+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114921+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114921+0000","last_peered":"2024-03-04T06:55:13.114921+0000","last_clean":"2024-03-04T06:55:13.114921+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114921+0000","last_undegraded":"2024-03-04T06:55:13.114921+0000","last_fullsized":"2024-03-04T06:55:13.114921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102608+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102608+0000","last_peered":"2024-03-04T06:55:13.102608+0000","last_clean":"2024-03-04T06:55:13.102608+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102608+0000","last_undegraded":"2024-03-04T06:55:13.102608+0000","last_fullsized":"2024-03-04T06:55:13.102608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117741+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:13.117741+0000","last_peered":"2024-03-04T06:55:13.117741+0000","last_clean":"2024-03-04T06:55:13.117741+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:13.117741+0000","last_undegraded":"2024-03-04T06:55:13.117741+0000","last_fullsized":"2024-03-04T06:55:13.117741+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098491+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098491+0000","last_peered":"2024-03-04T06:55:13.098491+0000","last_clean":"2024-03-04T06:55:13.098491+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098491+0000","last_undegraded":"2024-03-04T06:55:13.098491+0000","last_fullsized":"2024-03-04T06:55:13.098491+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105922+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105922+0000","last_peered":"2024-03-04T06:55:13.105922+0000","last_clean":"2024-03-04T06:55:13.105922+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105922+0000","last_undegraded":"2024-03-04T06:55:13.105922+0000","last_fullsized":"2024-03-04T06:55:13.105922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102507+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102507+0000","last_peered":"2024-03-04T06:55:13.102507+0000","last_clean":"2024-03-04T06:55:13.102507+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102507+0000","last_undegraded":"2024-03-04T06:55:13.102507+0000","last_fullsized":"2024-03-04T06:55:13.102507+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114409+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114409+0000","last_peered":"2024-03-04T06:55:13.114409+0000","last_clean":"2024-03-04T06:55:13.114409+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114409+0000","last_undegraded":"2024-03-04T06:55:13.114409+0000","last_fullsized":"2024-03-04T06:55:13.114409+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114411+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114411+0000","last_peered":"2024-03-04T06:55:13.114411+0000","last_clean":"2024-03-04T06:55:13.114411+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114411+0000","last_undegraded":"2024-03-04T06:55:13.114411+0000","last_fullsized":"2024-03-04T06:55:13.114411+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1251,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096553+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096553+0000","last_peered":"2024-03-04T06:55:13.096553+0000","last_clean":"2024-03-04T06:55:13.096553+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096553+0000","last_undegraded":"2024-03-04T06:55:13.096553+0000","last_fullsized":"2024-03-04T06:55:13.096553+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101772+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101772+0000","last_peered":"2024-03-04T06:55:13.101772+0000","last_clean":"2024-03-04T06:55:13.101772+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101772+0000","last_undegraded":"2024-03-04T06:55:13.101772+0000","last_fullsized":"2024-03-04T06:55:13.101772+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3576,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096470+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:13.096470+0000","last_peered":"2024-03-04T06:55:13.096470+0000","last_clean":"2024-03-04T06:55:13.096470+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:13.096470+0000","last_undegraded":"2024-03-04T06:55:13.096470+0000","last_fullsized":"2024-03-04T06:55:13.096470+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096934+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096934+0000","last_peered":"2024-03-04T06:55:13.096934+0000","last_clean":"2024-03-04T06:55:13.096934+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096934+0000","last_undegraded":"2024-03-04T06:55:13.096934+0000","last_fullsized":"2024-03-04T06:55:13.096934+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102885+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102885+0000","last_peered":"2024-03-04T06:55:13.102885+0000","last_clean":"2024-03-04T06:55:13.102885+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102885+0000","last_undegraded":"2024-03-04T06:55:13.102885+0000","last_fullsized":"2024-03-04T06:55:13.102885+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17114,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117468+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117468+0000","last_peered":"2024-03-04T06:55:13.117468+0000","last_clean":"2024-03-04T06:55:13.117468+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117468+0000","last_undegraded":"2024-03-04T06:55:13.117468+0000","last_fullsized":"2024-03-04T06:55:13.117468+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115048+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115048+0000","last_peered":"2024-03-04T06:55:13.115048+0000","last_clean":"2024-03-04T06:55:13.115048+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115048+0000","last_undegraded":"2024-03-04T06:55:13.115048+0000","last_fullsized":"2024-03-04T06:55:13.115048+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116658+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116658+0000","last_peered":"2024-03-04T06:55:13.116658+0000","last_clean":"2024-03-04T06:55:13.116658+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116658+0000","last_undegraded":"2024-03-04T06:55:13.116658+0000","last_fullsized":"2024-03-04T06:55:13.116658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105904+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.105904+0000","last_peered":"2024-03-04T06:55:13.105904+0000","last_clean":"2024-03-04T06:55:13.105904+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.105904+0000","last_undegraded":"2024-03-04T06:55:13.105904+0000","last_fullsized":"2024-03-04T06:55:13.105904+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4384,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.116730+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.116730+0000","last_peered":"2024-03-04T06:55:13.116730+0000","last_clean":"2024-03-04T06:55:13.116730+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.116730+0000","last_undegraded":"2024-03-04T06:55:13.116730+0000","last_fullsized":"2024-03-04T06:55:13.116730+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115924+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115924+0000","last_peered":"2024-03-04T06:55:13.115924+0000","last_clean":"2024-03-04T06:55:13.115924+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115924+0000","last_undegraded":"2024-03-04T06:55:13.115924+0000","last_fullsized":"2024-03-04T06:55:13.115924+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105684+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105684+0000","last_peered":"2024-03-04T06:55:13.105684+0000","last_clean":"2024-03-04T06:55:13.105684+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105684+0000","last_undegraded":"2024-03-04T06:55:13.105684+0000","last_fullsized":"2024-03-04T06:55:13.105684+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096227+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096227+0000","last_peered":"2024-03-04T06:55:13.096227+0000","last_clean":"2024-03-04T06:55:13.096227+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096227+0000","last_undegraded":"2024-03-04T06:55:13.096227+0000","last_fullsized":"2024-03-04T06:55:13.096227+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5638,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097306+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:13.097306+0000","last_peered":"2024-03-04T06:55:13.097306+0000","last_clean":"2024-03-04T06:55:13.097306+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:13.097306+0000","last_undegraded":"2024-03-04T06:55:13.097306+0000","last_fullsized":"2024-03-04T06:55:13.097306+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116182+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.116182+0000","last_peered":"2024-03-04T06:55:13.116182+0000","last_clean":"2024-03-04T06:55:13.116182+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.116182+0000","last_undegraded":"2024-03-04T06:55:13.116182+0000","last_fullsized":"2024-03-04T06:55:13.116182+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114108+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114108+0000","last_peered":"2024-03-04T06:55:13.114108+0000","last_clean":"2024-03-04T06:55:13.114108+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114108+0000","last_undegraded":"2024-03-04T06:55:13.114108+0000","last_fullsized":"2024-03-04T06:55:13.114108+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096536+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:13.096536+0000","last_peered":"2024-03-04T06:55:13.096536+0000","last_clean":"2024-03-04T06:55:13.096536+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:13.096536+0000","last_undegraded":"2024-03-04T06:55:13.096536+0000","last_fullsized":"2024-03-04T06:55:13.096536+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4013,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.106850+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.106850+0000","last_peered":"2024-03-04T06:55:13.106850+0000","last_clean":"2024-03-04T06:55:13.106850+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.106850+0000","last_undegraded":"2024-03-04T06:55:13.106850+0000","last_fullsized":"2024-03-04T06:55:13.106850+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1090,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115070+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:13.115070+0000","last_peered":"2024-03-04T06:55:13.115070+0000","last_clean":"2024-03-04T06:55:13.115070+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:13.115070+0000","last_undegraded":"2024-03-04T06:55:13.115070+0000","last_fullsized":"2024-03-04T06:55:13.115070+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098368+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098368+0000","last_peered":"2024-03-04T06:55:13.098368+0000","last_clean":"2024-03-04T06:55:13.098368+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098368+0000","last_undegraded":"2024-03-04T06:55:13.098368+0000","last_fullsized":"2024-03-04T06:55:13.098368+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105176+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105176+0000","last_peered":"2024-03-04T06:55:13.105176+0000","last_clean":"2024-03-04T06:55:13.105176+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105176+0000","last_undegraded":"2024-03-04T06:55:13.105176+0000","last_fullsized":"2024-03-04T06:55:13.105176+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1548,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101670+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101670+0000","last_peered":"2024-03-04T06:55:13.101670+0000","last_clean":"2024-03-04T06:55:13.101670+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101670+0000","last_undegraded":"2024-03-04T06:55:13.101670+0000","last_fullsized":"2024-03-04T06:55:13.101670+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3949,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.128010+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:13.128010+0000","last_peered":"2024-03-04T06:55:13.128010+0000","last_clean":"2024-03-04T06:55:13.128010+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:13.128010+0000","last_undegraded":"2024-03-04T06:55:13.128010+0000","last_fullsized":"2024-03-04T06:55:13.128010+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117334+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117334+0000","last_peered":"2024-03-04T06:55:13.117334+0000","last_clean":"2024-03-04T06:55:13.117334+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117334+0000","last_undegraded":"2024-03-04T06:55:13.117334+0000","last_fullsized":"2024-03-04T06:55:13.117334+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096315+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:13.096315+0000","last_peered":"2024-03-04T06:55:13.096315+0000","last_clean":"2024-03-04T06:55:13.096315+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:13.096315+0000","last_undegraded":"2024-03-04T06:55:13.096315+0000","last_fullsized":"2024-03-04T06:55:13.096315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1055,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101642+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101642+0000","last_peered":"2024-03-04T06:55:13.101642+0000","last_clean":"2024-03-04T06:55:13.101642+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101642+0000","last_undegraded":"2024-03-04T06:55:13.101642+0000","last_fullsized":"2024-03-04T06:55:13.101642+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15290,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.174192+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:13.174192+0000","last_peered":"2024-03-04T06:55:13.174192+0000","last_clean":"2024-03-04T06:55:13.174192+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:13.174192+0000","last_undegraded":"2024-03-04T06:55:13.174192+0000","last_fullsized":"2024-03-04T06:55:13.174192+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117486+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117486+0000","last_peered":"2024-03-04T06:55:13.117486+0000","last_clean":"2024-03-04T06:55:13.117486+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117486+0000","last_undegraded":"2024-03-04T06:55:13.117486+0000","last_fullsized":"2024-03-04T06:55:13.117486+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102522+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102522+0000","last_peered":"2024-03-04T06:55:13.102522+0000","last_clean":"2024-03-04T06:55:13.102522+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102522+0000","last_undegraded":"2024-03-04T06:55:13.102522+0000","last_fullsized":"2024-03-04T06:55:13.102522+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116017+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116017+0000","last_peered":"2024-03-04T06:55:13.116017+0000","last_clean":"2024-03-04T06:55:13.116017+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116017+0000","last_undegraded":"2024-03-04T06:55:13.116017+0000","last_fullsized":"2024-03-04T06:55:13.116017+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4377,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097266+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097266+0000","last_peered":"2024-03-04T06:55:13.097266+0000","last_clean":"2024-03-04T06:55:13.097266+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097266+0000","last_undegraded":"2024-03-04T06:55:13.097266+0000","last_fullsized":"2024-03-04T06:55:13.097266+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097599+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:13.097599+0000","last_peered":"2024-03-04T06:55:13.097599+0000","last_clean":"2024-03-04T06:55:13.097599+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:13.097599+0000","last_undegraded":"2024-03-04T06:55:13.097599+0000","last_fullsized":"2024-03-04T06:55:13.097599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117221+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.117221+0000","last_peered":"2024-03-04T06:55:13.117221+0000","last_clean":"2024-03-04T06:55:13.117221+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.117221+0000","last_undegraded":"2024-03-04T06:55:13.117221+0000","last_fullsized":"2024-03-04T06:55:13.117221+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097200+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097200+0000","last_peered":"2024-03-04T06:55:13.097200+0000","last_clean":"2024-03-04T06:55:13.097200+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097200+0000","last_undegraded":"2024-03-04T06:55:13.097200+0000","last_fullsized":"2024-03-04T06:55:13.097200+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4608,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.311904+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:13.311904+0000","last_peered":"2024-03-04T06:55:13.311904+0000","last_clean":"2024-03-04T06:55:13.311904+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:13.311904+0000","last_undegraded":"2024-03-04T06:55:13.311904+0000","last_fullsized":"2024-03-04T06:55:13.311904+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095643+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095643+0000","last_peered":"2024-03-04T06:55:13.095643+0000","last_clean":"2024-03-04T06:55:13.095643+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095643+0000","last_undegraded":"2024-03-04T06:55:13.095643+0000","last_fullsized":"2024-03-04T06:55:13.095643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1076,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115089+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115089+0000","last_peered":"2024-03-04T06:55:13.115089+0000","last_clean":"2024-03-04T06:55:13.115089+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115089+0000","last_undegraded":"2024-03-04T06:55:13.115089+0000","last_fullsized":"2024-03-04T06:55:13.115089+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115325+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115325+0000","last_peered":"2024-03-04T06:55:13.115325+0000","last_clean":"2024-03-04T06:55:13.115325+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115325+0000","last_undegraded":"2024-03-04T06:55:13.115325+0000","last_fullsized":"2024-03-04T06:55:13.115325+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4633,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107390+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:13.107390+0000","last_peered":"2024-03-04T06:55:13.107390+0000","last_clean":"2024-03-04T06:55:13.107390+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:13.107390+0000","last_undegraded":"2024-03-04T06:55:13.107390+0000","last_fullsized":"2024-03-04T06:55:13.107390+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1055,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101919+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101919+0000","last_peered":"2024-03-04T06:55:13.101919+0000","last_clean":"2024-03-04T06:55:13.101919+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101919+0000","last_undegraded":"2024-03-04T06:55:13.101919+0000","last_fullsized":"2024-03-04T06:55:13.101919+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1183,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095626+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095626+0000","last_peered":"2024-03-04T06:55:13.095626+0000","last_clean":"2024-03-04T06:55:13.095626+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095626+0000","last_undegraded":"2024-03-04T06:55:13.095626+0000","last_fullsized":"2024-03-04T06:55:13.095626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5156,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.111062+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.111062+0000","last_peered":"2024-03-04T06:55:13.111062+0000","last_clean":"2024-03-04T06:55:13.111062+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.111062+0000","last_undegraded":"2024-03-04T06:55:13.111062+0000","last_fullsized":"2024-03-04T06:55:13.111062+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116686+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.116686+0000","last_peered":"2024-03-04T06:55:13.116686+0000","last_clean":"2024-03-04T06:55:13.116686+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.116686+0000","last_undegraded":"2024-03-04T06:55:13.116686+0000","last_fullsized":"2024-03-04T06:55:13.116686+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097769+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097769+0000","last_peered":"2024-03-04T06:55:13.097769+0000","last_clean":"2024-03-04T06:55:13.097769+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097769+0000","last_undegraded":"2024-03-04T06:55:13.097769+0000","last_fullsized":"2024-03-04T06:55:13.097769+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4717,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.167577+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.167577+0000","last_peered":"2024-03-04T06:55:13.167577+0000","last_clean":"2024-03-04T06:55:13.167577+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.167577+0000","last_undegraded":"2024-03-04T06:55:13.167577+0000","last_fullsized":"2024-03-04T06:55:13.167577+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114842+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.114842+0000","last_peered":"2024-03-04T06:55:13.114842+0000","last_clean":"2024-03-04T06:55:13.114842+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.114842+0000","last_undegraded":"2024-03-04T06:55:13.114842+0000","last_fullsized":"2024-03-04T06:55:13.114842+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098787+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098787+0000","last_peered":"2024-03-04T06:55:13.098787+0000","last_clean":"2024-03-04T06:55:13.098787+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098787+0000","last_undegraded":"2024-03-04T06:55:13.098787+0000","last_fullsized":"2024-03-04T06:55:13.098787+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5553,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117009+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:13.117009+0000","last_peered":"2024-03-04T06:55:13.117009+0000","last_clean":"2024-03-04T06:55:13.117009+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:13.117009+0000","last_undegraded":"2024-03-04T06:55:13.117009+0000","last_fullsized":"2024-03-04T06:55:13.117009+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102342+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102342+0000","last_peered":"2024-03-04T06:55:13.102342+0000","last_clean":"2024-03-04T06:55:13.102342+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102342+0000","last_undegraded":"2024-03-04T06:55:13.102342+0000","last_fullsized":"2024-03-04T06:55:13.102342+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114629+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114629+0000","last_peered":"2024-03-04T06:55:13.114629+0000","last_clean":"2024-03-04T06:55:13.114629+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114629+0000","last_undegraded":"2024-03-04T06:55:13.114629+0000","last_fullsized":"2024-03-04T06:55:13.114629+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096744+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096744+0000","last_peered":"2024-03-04T06:55:13.096744+0000","last_clean":"2024-03-04T06:55:13.096744+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096744+0000","last_undegraded":"2024-03-04T06:55:13.096744+0000","last_fullsized":"2024-03-04T06:55:13.096744+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097188+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097188+0000","last_peered":"2024-03-04T06:55:13.097188+0000","last_clean":"2024-03-04T06:55:13.097188+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097188+0000","last_undegraded":"2024-03-04T06:55:13.097188+0000","last_fullsized":"2024-03-04T06:55:13.097188+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102416+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102416+0000","last_peered":"2024-03-04T06:55:13.102416+0000","last_clean":"2024-03-04T06:55:13.102416+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102416+0000","last_undegraded":"2024-03-04T06:55:13.102416+0000","last_fullsized":"2024-03-04T06:55:13.102416+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4365,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.315099+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:13.315099+0000","last_peered":"2024-03-04T06:55:13.315099+0000","last_clean":"2024-03-04T06:55:13.315099+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:13.315099+0000","last_undegraded":"2024-03-04T06:55:13.315099+0000","last_fullsized":"2024-03-04T06:55:13.315099+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115541+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:13.115541+0000","last_peered":"2024-03-04T06:55:13.115541+0000","last_clean":"2024-03-04T06:55:13.115541+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:13.115541+0000","last_undegraded":"2024-03-04T06:55:13.115541+0000","last_fullsized":"2024-03-04T06:55:13.115541+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105888+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:13.105888+0000","last_peered":"2024-03-04T06:55:13.105888+0000","last_clean":"2024-03-04T06:55:13.105888+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:13.105888+0000","last_undegraded":"2024-03-04T06:55:13.105888+0000","last_fullsized":"2024-03-04T06:55:13.105888+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4598,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.321650+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.321650+0000","last_peered":"2024-03-04T06:55:13.321650+0000","last_clean":"2024-03-04T06:55:13.321650+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.321650+0000","last_undegraded":"2024-03-04T06:55:13.321650+0000","last_fullsized":"2024-03-04T06:55:13.321650+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097451+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097451+0000","last_peered":"2024-03-04T06:55:13.097451+0000","last_clean":"2024-03-04T06:55:13.097451+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097451+0000","last_undegraded":"2024-03-04T06:55:13.097451+0000","last_fullsized":"2024-03-04T06:55:13.097451+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104831+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.104831+0000","last_peered":"2024-03-04T06:55:13.104831+0000","last_clean":"2024-03-04T06:55:13.104831+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.104831+0000","last_undegraded":"2024-03-04T06:55:13.104831+0000","last_fullsized":"2024-03-04T06:55:13.104831+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114524+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:13.114524+0000","last_peered":"2024-03-04T06:55:13.114524+0000","last_clean":"2024-03-04T06:55:13.114524+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:13.114524+0000","last_undegraded":"2024-03-04T06:55:13.114524+0000","last_fullsized":"2024-03-04T06:55:13.114524+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096648+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:13.096648+0000","last_peered":"2024-03-04T06:55:13.096648+0000","last_clean":"2024-03-04T06:55:13.096648+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:13.096648+0000","last_undegraded":"2024-03-04T06:55:13.096648+0000","last_fullsized":"2024-03-04T06:55:13.096648+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105999+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.105999+0000","last_peered":"2024-03-04T06:55:13.105999+0000","last_clean":"2024-03-04T06:55:13.105999+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.105999+0000","last_undegraded":"2024-03-04T06:55:13.105999+0000","last_fullsized":"2024-03-04T06:55:13.105999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117074+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117074+0000","last_peered":"2024-03-04T06:55:13.117074+0000","last_clean":"2024-03-04T06:55:13.117074+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117074+0000","last_undegraded":"2024-03-04T06:55:13.117074+0000","last_fullsized":"2024-03-04T06:55:13.117074+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096759+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096759+0000","last_peered":"2024-03-04T06:55:13.096759+0000","last_clean":"2024-03-04T06:55:13.096759+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096759+0000","last_undegraded":"2024-03-04T06:55:13.096759+0000","last_fullsized":"2024-03-04T06:55:13.096759+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115428+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.115428+0000","last_peered":"2024-03-04T06:55:13.115428+0000","last_clean":"2024-03-04T06:55:13.115428+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.115428+0000","last_undegraded":"2024-03-04T06:55:13.115428+0000","last_fullsized":"2024-03-04T06:55:13.115428+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115239+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115239+0000","last_peered":"2024-03-04T06:55:13.115239+0000","last_clean":"2024-03-04T06:55:13.115239+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115239+0000","last_undegraded":"2024-03-04T06:55:13.115239+0000","last_fullsized":"2024-03-04T06:55:13.115239+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1192,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097432+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097432+0000","last_peered":"2024-03-04T06:55:13.097432+0000","last_clean":"2024-03-04T06:55:13.097432+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097432+0000","last_undegraded":"2024-03-04T06:55:13.097432+0000","last_fullsized":"2024-03-04T06:55:13.097432+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105275+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:13.105275+0000","last_peered":"2024-03-04T06:55:13.105275+0000","last_clean":"2024-03-04T06:55:13.105275+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:13.105275+0000","last_undegraded":"2024-03-04T06:55:13.105275+0000","last_fullsized":"2024-03-04T06:55:13.105275+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096564+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096564+0000","last_peered":"2024-03-04T06:55:13.096564+0000","last_clean":"2024-03-04T06:55:13.096564+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096564+0000","last_undegraded":"2024-03-04T06:55:13.096564+0000","last_fullsized":"2024-03-04T06:55:13.096564+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105576+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:13.105576+0000","last_peered":"2024-03-04T06:55:13.105576+0000","last_clean":"2024-03-04T06:55:13.105576+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:13.105576+0000","last_undegraded":"2024-03-04T06:55:13.105576+0000","last_fullsized":"2024-03-04T06:55:13.105576+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116864+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116864+0000","last_peered":"2024-03-04T06:55:13.116864+0000","last_clean":"2024-03-04T06:55:13.116864+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116864+0000","last_undegraded":"2024-03-04T06:55:13.116864+0000","last_fullsized":"2024-03-04T06:55:13.116864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114786+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114786+0000","last_peered":"2024-03-04T06:55:13.114786+0000","last_clean":"2024-03-04T06:55:13.114786+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114786+0000","last_undegraded":"2024-03-04T06:55:13.114786+0000","last_fullsized":"2024-03-04T06:55:13.114786+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503431,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648078,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142385,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287032,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997738,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885795,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937372,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792725,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:55:57.625 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:57.625 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:57.625 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:57.625 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:57.625 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:57.625 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:57.625 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:57.625 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:57.625 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:57.625 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:55:57.626 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:55:58.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:58 smithi137 ceph-mon[91314]: pgmap v943: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:58.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:55:58 smithi137 ceph-mon[91314]: from='client.34515 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:55:58.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:58 smithi137 ceph-mon[88869]: pgmap v943: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:58.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:55:58 smithi137 ceph-mon[88869]: from='client.34515 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:55:58.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:58 smithi203 ceph-mon[85573]: pgmap v943: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:55:58.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:55:58 smithi203 ceph-mon[85573]: from='client.34515 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:56:00.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:00 smithi137 ceph-mon[88869]: pgmap v944: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:00.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:00 smithi137 ceph-mon[91314]: pgmap v944: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:00.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:00 smithi203 ceph-mon[85573]: pgmap v944: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:02.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:02 smithi137 ceph-mon[88869]: pgmap v945: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:02.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:02 smithi137 ceph-mon[91314]: pgmap v945: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:02.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:02 smithi203 ceph-mon[85573]: pgmap v945: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:04.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:04 smithi137 ceph-mon[88869]: pgmap v946: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:04.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:04 smithi137 ceph-mon[91314]: pgmap v946: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:04.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:04 smithi203 ceph-mon[85573]: pgmap v946: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:05.794 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:56:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:56:05] "GET /metrics HTTP/1.1" 200 36338 "" "Prometheus/2.43.0" 2024-03-04T06:56:06.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:06 smithi137 ceph-mon[88869]: pgmap v947: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:06.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:06 smithi137 ceph-mon[91314]: pgmap v947: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:06.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:06 smithi203 ceph-mon[85573]: pgmap v947: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:07.627 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:56:07.848 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:56:08.226 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:08 smithi137 ceph-mon[88869]: pgmap v948: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:08.226 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:56:08.226 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:08 smithi137 ceph-mon[91314]: pgmap v948: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:08.226 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:56:08.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:08 smithi203 ceph-mon[85573]: pgmap v948: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:08.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:56:09.441 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:56:09.441 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:56:09.441 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:56:09.441 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:56:09.442 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:56:09.442 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:56:09.442 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:56:09.442 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:56:09.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:56:09.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:56:09.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:56:09.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:56:09.752 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:56:09.754 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:56:10.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:10 smithi137 ceph-mon[88869]: pgmap v949: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:10.292 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:10 smithi137 ceph-mon[91314]: pgmap v949: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:10.341 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":949,"stamp":"2024-03-04T06:56:08.473863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003744"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103288+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103288+0000","last_peered":"2024-03-04T06:55:13.103288+0000","last_clean":"2024-03-04T06:55:13.103288+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103288+0000","last_undegraded":"2024-03-04T06:55:13.103288+0000","last_fullsized":"2024-03-04T06:55:13.103288+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116955+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.116955+0000","last_peered":"2024-03-04T06:55:13.116955+0000","last_clean":"2024-03-04T06:55:13.116955+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.116955+0000","last_undegraded":"2024-03-04T06:55:13.116955+0000","last_fullsized":"2024-03-04T06:55:13.116955+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115370+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115370+0000","last_peered":"2024-03-04T06:55:13.115370+0000","last_clean":"2024-03-04T06:55:13.115370+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115370+0000","last_undegraded":"2024-03-04T06:55:13.115370+0000","last_fullsized":"2024-03-04T06:55:13.115370+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106086+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106086+0000","last_peered":"2024-03-04T06:55:13.106086+0000","last_clean":"2024-03-04T06:55:13.106086+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106086+0000","last_undegraded":"2024-03-04T06:55:13.106086+0000","last_fullsized":"2024-03-04T06:55:13.106086+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101948+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.101948+0000","last_peered":"2024-03-04T06:55:13.101948+0000","last_clean":"2024-03-04T06:55:13.101948+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.101948+0000","last_undegraded":"2024-03-04T06:55:13.101948+0000","last_fullsized":"2024-03-04T06:55:13.101948+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106042+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106042+0000","last_peered":"2024-03-04T06:55:13.106042+0000","last_clean":"2024-03-04T06:55:13.106042+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106042+0000","last_undegraded":"2024-03-04T06:55:13.106042+0000","last_fullsized":"2024-03-04T06:55:13.106042+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101755+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101755+0000","last_peered":"2024-03-04T06:55:13.101755+0000","last_clean":"2024-03-04T06:55:13.101755+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101755+0000","last_undegraded":"2024-03-04T06:55:13.101755+0000","last_fullsized":"2024-03-04T06:55:13.101755+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097051+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:13.097051+0000","last_peered":"2024-03-04T06:55:13.097051+0000","last_clean":"2024-03-04T06:55:13.097051+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:13.097051+0000","last_undegraded":"2024-03-04T06:55:13.097051+0000","last_fullsized":"2024-03-04T06:55:13.097051+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1063,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102987+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.102987+0000","last_peered":"2024-03-04T06:55:13.102987+0000","last_clean":"2024-03-04T06:55:13.102987+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.102987+0000","last_undegraded":"2024-03-04T06:55:13.102987+0000","last_fullsized":"2024-03-04T06:55:13.102987+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114958+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.114958+0000","last_peered":"2024-03-04T06:55:13.114958+0000","last_clean":"2024-03-04T06:55:13.114958+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.114958+0000","last_undegraded":"2024-03-04T06:55:13.114958+0000","last_fullsized":"2024-03-04T06:55:13.114958+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114806+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114806+0000","last_peered":"2024-03-04T06:55:13.114806+0000","last_clean":"2024-03-04T06:55:13.114806+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114806+0000","last_undegraded":"2024-03-04T06:55:13.114806+0000","last_fullsized":"2024-03-04T06:55:13.114806+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1154,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095971+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:13.095971+0000","last_peered":"2024-03-04T06:55:13.095971+0000","last_clean":"2024-03-04T06:55:13.095971+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:13.095971+0000","last_undegraded":"2024-03-04T06:55:13.095971+0000","last_fullsized":"2024-03-04T06:55:13.095971+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1198,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098969+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.098969+0000","last_peered":"2024-03-04T06:55:13.098969+0000","last_clean":"2024-03-04T06:55:13.098969+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.098969+0000","last_undegraded":"2024-03-04T06:55:13.098969+0000","last_fullsized":"2024-03-04T06:55:13.098969+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115324+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:13.115324+0000","last_peered":"2024-03-04T06:55:13.115324+0000","last_clean":"2024-03-04T06:55:13.115324+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:13.115324+0000","last_undegraded":"2024-03-04T06:55:13.115324+0000","last_fullsized":"2024-03-04T06:55:13.115324+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115730+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115730+0000","last_peered":"2024-03-04T06:55:13.115730+0000","last_clean":"2024-03-04T06:55:13.115730+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115730+0000","last_undegraded":"2024-03-04T06:55:13.115730+0000","last_fullsized":"2024-03-04T06:55:13.115730+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104995+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104995+0000","last_peered":"2024-03-04T06:55:13.104995+0000","last_clean":"2024-03-04T06:55:13.104995+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104995+0000","last_undegraded":"2024-03-04T06:55:13.104995+0000","last_fullsized":"2024-03-04T06:55:13.104995+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.107002+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.107002+0000","last_peered":"2024-03-04T06:55:13.107002+0000","last_clean":"2024-03-04T06:55:13.107002+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.107002+0000","last_undegraded":"2024-03-04T06:55:13.107002+0000","last_fullsized":"2024-03-04T06:55:13.107002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096883+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096883+0000","last_peered":"2024-03-04T06:55:13.096883+0000","last_clean":"2024-03-04T06:55:13.096883+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096883+0000","last_undegraded":"2024-03-04T06:55:13.096883+0000","last_fullsized":"2024-03-04T06:55:13.096883+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102246+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102246+0000","last_peered":"2024-03-04T06:55:13.102246+0000","last_clean":"2024-03-04T06:55:13.102246+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102246+0000","last_undegraded":"2024-03-04T06:55:13.102246+0000","last_fullsized":"2024-03-04T06:55:13.102246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116560+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116560+0000","last_peered":"2024-03-04T06:55:13.116560+0000","last_clean":"2024-03-04T06:55:13.116560+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116560+0000","last_undegraded":"2024-03-04T06:55:13.116560+0000","last_fullsized":"2024-03-04T06:55:13.116560+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097609+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:13.097609+0000","last_peered":"2024-03-04T06:55:13.097609+0000","last_clean":"2024-03-04T06:55:13.097609+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:13.097609+0000","last_undegraded":"2024-03-04T06:55:13.097609+0000","last_fullsized":"2024-03-04T06:55:13.097609+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097848+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:13.097848+0000","last_peered":"2024-03-04T06:55:13.097848+0000","last_clean":"2024-03-04T06:55:13.097848+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:13.097848+0000","last_undegraded":"2024-03-04T06:55:13.097848+0000","last_fullsized":"2024-03-04T06:55:13.097848+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115577+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.115577+0000","last_peered":"2024-03-04T06:55:13.115577+0000","last_clean":"2024-03-04T06:55:13.115577+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.115577+0000","last_undegraded":"2024-03-04T06:55:13.115577+0000","last_fullsized":"2024-03-04T06:55:13.115577+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1233,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098515+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098515+0000","last_peered":"2024-03-04T06:55:13.098515+0000","last_clean":"2024-03-04T06:55:13.098515+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098515+0000","last_undegraded":"2024-03-04T06:55:13.098515+0000","last_fullsized":"2024-03-04T06:55:13.098515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1220,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097456+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097456+0000","last_peered":"2024-03-04T06:55:13.097456+0000","last_clean":"2024-03-04T06:55:13.097456+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097456+0000","last_undegraded":"2024-03-04T06:55:13.097456+0000","last_fullsized":"2024-03-04T06:55:13.097456+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1068,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102398+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102398+0000","last_peered":"2024-03-04T06:55:13.102398+0000","last_clean":"2024-03-04T06:55:13.102398+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102398+0000","last_undegraded":"2024-03-04T06:55:13.102398+0000","last_fullsized":"2024-03-04T06:55:13.102398+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1124,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106153+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106153+0000","last_peered":"2024-03-04T06:55:13.106153+0000","last_clean":"2024-03-04T06:55:13.106153+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106153+0000","last_undegraded":"2024-03-04T06:55:13.106153+0000","last_fullsized":"2024-03-04T06:55:13.106153+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098905+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:13.098905+0000","last_peered":"2024-03-04T06:55:13.098905+0000","last_clean":"2024-03-04T06:55:13.098905+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:13.098905+0000","last_undegraded":"2024-03-04T06:55:13.098905+0000","last_fullsized":"2024-03-04T06:55:13.098905+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1188,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096052+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.096052+0000","last_peered":"2024-03-04T06:55:13.096052+0000","last_clean":"2024-03-04T06:55:13.096052+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.096052+0000","last_undegraded":"2024-03-04T06:55:13.096052+0000","last_fullsized":"2024-03-04T06:55:13.096052+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114659+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114659+0000","last_peered":"2024-03-04T06:55:13.114659+0000","last_clean":"2024-03-04T06:55:13.114659+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114659+0000","last_undegraded":"2024-03-04T06:55:13.114659+0000","last_fullsized":"2024-03-04T06:55:13.114659+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.118051+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.118051+0000","last_peered":"2024-03-04T06:55:13.118051+0000","last_clean":"2024-03-04T06:55:13.118051+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.118051+0000","last_undegraded":"2024-03-04T06:55:13.118051+0000","last_fullsized":"2024-03-04T06:55:13.118051+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096686+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096686+0000","last_peered":"2024-03-04T06:55:13.096686+0000","last_clean":"2024-03-04T06:55:13.096686+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096686+0000","last_undegraded":"2024-03-04T06:55:13.096686+0000","last_fullsized":"2024-03-04T06:55:13.096686+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097180+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097180+0000","last_peered":"2024-03-04T06:55:13.097180+0000","last_clean":"2024-03-04T06:55:13.097180+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097180+0000","last_undegraded":"2024-03-04T06:55:13.097180+0000","last_fullsized":"2024-03-04T06:55:13.097180+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105593+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105593+0000","last_peered":"2024-03-04T06:55:13.105593+0000","last_clean":"2024-03-04T06:55:13.105593+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105593+0000","last_undegraded":"2024-03-04T06:55:13.105593+0000","last_fullsized":"2024-03-04T06:55:13.105593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115781+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115781+0000","last_peered":"2024-03-04T06:55:13.115781+0000","last_clean":"2024-03-04T06:55:13.115781+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115781+0000","last_undegraded":"2024-03-04T06:55:13.115781+0000","last_fullsized":"2024-03-04T06:55:13.115781+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115093+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115093+0000","last_peered":"2024-03-04T06:55:13.115093+0000","last_clean":"2024-03-04T06:55:13.115093+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115093+0000","last_undegraded":"2024-03-04T06:55:13.115093+0000","last_fullsized":"2024-03-04T06:55:13.115093+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1110,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105468+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105468+0000","last_peered":"2024-03-04T06:55:13.105468+0000","last_clean":"2024-03-04T06:55:13.105468+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105468+0000","last_undegraded":"2024-03-04T06:55:13.105468+0000","last_fullsized":"2024-03-04T06:55:13.105468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105915+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105915+0000","last_peered":"2024-03-04T06:55:13.105915+0000","last_clean":"2024-03-04T06:55:13.105915+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105915+0000","last_undegraded":"2024-03-04T06:55:13.105915+0000","last_fullsized":"2024-03-04T06:55:13.105915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116155+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116155+0000","last_peered":"2024-03-04T06:55:13.116155+0000","last_clean":"2024-03-04T06:55:13.116155+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116155+0000","last_undegraded":"2024-03-04T06:55:13.116155+0000","last_fullsized":"2024-03-04T06:55:13.116155+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116036+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116036+0000","last_peered":"2024-03-04T06:55:13.116036+0000","last_clean":"2024-03-04T06:55:13.116036+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116036+0000","last_undegraded":"2024-03-04T06:55:13.116036+0000","last_fullsized":"2024-03-04T06:55:13.116036+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096448+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:13.096448+0000","last_peered":"2024-03-04T06:55:13.096448+0000","last_clean":"2024-03-04T06:55:13.096448+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:13.096448+0000","last_undegraded":"2024-03-04T06:55:13.096448+0000","last_fullsized":"2024-03-04T06:55:13.096448+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114921+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114921+0000","last_peered":"2024-03-04T06:55:13.114921+0000","last_clean":"2024-03-04T06:55:13.114921+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114921+0000","last_undegraded":"2024-03-04T06:55:13.114921+0000","last_fullsized":"2024-03-04T06:55:13.114921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102608+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102608+0000","last_peered":"2024-03-04T06:55:13.102608+0000","last_clean":"2024-03-04T06:55:13.102608+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102608+0000","last_undegraded":"2024-03-04T06:55:13.102608+0000","last_fullsized":"2024-03-04T06:55:13.102608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117741+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:13.117741+0000","last_peered":"2024-03-04T06:55:13.117741+0000","last_clean":"2024-03-04T06:55:13.117741+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:13.117741+0000","last_undegraded":"2024-03-04T06:55:13.117741+0000","last_fullsized":"2024-03-04T06:55:13.117741+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098491+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098491+0000","last_peered":"2024-03-04T06:55:13.098491+0000","last_clean":"2024-03-04T06:55:13.098491+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098491+0000","last_undegraded":"2024-03-04T06:55:13.098491+0000","last_fullsized":"2024-03-04T06:55:13.098491+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105922+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105922+0000","last_peered":"2024-03-04T06:55:13.105922+0000","last_clean":"2024-03-04T06:55:13.105922+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105922+0000","last_undegraded":"2024-03-04T06:55:13.105922+0000","last_fullsized":"2024-03-04T06:55:13.105922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102507+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102507+0000","last_peered":"2024-03-04T06:55:13.102507+0000","last_clean":"2024-03-04T06:55:13.102507+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102507+0000","last_undegraded":"2024-03-04T06:55:13.102507+0000","last_fullsized":"2024-03-04T06:55:13.102507+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114409+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114409+0000","last_peered":"2024-03-04T06:55:13.114409+0000","last_clean":"2024-03-04T06:55:13.114409+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114409+0000","last_undegraded":"2024-03-04T06:55:13.114409+0000","last_fullsized":"2024-03-04T06:55:13.114409+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114411+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114411+0000","last_peered":"2024-03-04T06:55:13.114411+0000","last_clean":"2024-03-04T06:55:13.114411+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114411+0000","last_undegraded":"2024-03-04T06:55:13.114411+0000","last_fullsized":"2024-03-04T06:55:13.114411+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1251,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096553+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096553+0000","last_peered":"2024-03-04T06:55:13.096553+0000","last_clean":"2024-03-04T06:55:13.096553+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096553+0000","last_undegraded":"2024-03-04T06:55:13.096553+0000","last_fullsized":"2024-03-04T06:55:13.096553+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101772+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101772+0000","last_peered":"2024-03-04T06:55:13.101772+0000","last_clean":"2024-03-04T06:55:13.101772+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101772+0000","last_undegraded":"2024-03-04T06:55:13.101772+0000","last_fullsized":"2024-03-04T06:55:13.101772+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3576,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096470+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:13.096470+0000","last_peered":"2024-03-04T06:55:13.096470+0000","last_clean":"2024-03-04T06:55:13.096470+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:13.096470+0000","last_undegraded":"2024-03-04T06:55:13.096470+0000","last_fullsized":"2024-03-04T06:55:13.096470+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096934+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096934+0000","last_peered":"2024-03-04T06:55:13.096934+0000","last_clean":"2024-03-04T06:55:13.096934+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096934+0000","last_undegraded":"2024-03-04T06:55:13.096934+0000","last_fullsized":"2024-03-04T06:55:13.096934+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102885+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102885+0000","last_peered":"2024-03-04T06:55:13.102885+0000","last_clean":"2024-03-04T06:55:13.102885+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102885+0000","last_undegraded":"2024-03-04T06:55:13.102885+0000","last_fullsized":"2024-03-04T06:55:13.102885+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17114,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117468+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117468+0000","last_peered":"2024-03-04T06:55:13.117468+0000","last_clean":"2024-03-04T06:55:13.117468+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117468+0000","last_undegraded":"2024-03-04T06:55:13.117468+0000","last_fullsized":"2024-03-04T06:55:13.117468+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115048+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115048+0000","last_peered":"2024-03-04T06:55:13.115048+0000","last_clean":"2024-03-04T06:55:13.115048+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115048+0000","last_undegraded":"2024-03-04T06:55:13.115048+0000","last_fullsized":"2024-03-04T06:55:13.115048+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116658+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116658+0000","last_peered":"2024-03-04T06:55:13.116658+0000","last_clean":"2024-03-04T06:55:13.116658+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116658+0000","last_undegraded":"2024-03-04T06:55:13.116658+0000","last_fullsized":"2024-03-04T06:55:13.116658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105904+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.105904+0000","last_peered":"2024-03-04T06:55:13.105904+0000","last_clean":"2024-03-04T06:55:13.105904+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.105904+0000","last_undegraded":"2024-03-04T06:55:13.105904+0000","last_fullsized":"2024-03-04T06:55:13.105904+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4384,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.116730+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.116730+0000","last_peered":"2024-03-04T06:55:13.116730+0000","last_clean":"2024-03-04T06:55:13.116730+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.116730+0000","last_undegraded":"2024-03-04T06:55:13.116730+0000","last_fullsized":"2024-03-04T06:55:13.116730+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115924+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115924+0000","last_peered":"2024-03-04T06:55:13.115924+0000","last_clean":"2024-03-04T06:55:13.115924+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115924+0000","last_undegraded":"2024-03-04T06:55:13.115924+0000","last_fullsized":"2024-03-04T06:55:13.115924+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105684+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105684+0000","last_peered":"2024-03-04T06:55:13.105684+0000","last_clean":"2024-03-04T06:55:13.105684+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105684+0000","last_undegraded":"2024-03-04T06:55:13.105684+0000","last_fullsized":"2024-03-04T06:55:13.105684+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096227+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096227+0000","last_peered":"2024-03-04T06:55:13.096227+0000","last_clean":"2024-03-04T06:55:13.096227+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096227+0000","last_undegraded":"2024-03-04T06:55:13.096227+0000","last_fullsized":"2024-03-04T06:55:13.096227+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5638,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097306+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:13.097306+0000","last_peered":"2024-03-04T06:55:13.097306+0000","last_clean":"2024-03-04T06:55:13.097306+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:13.097306+0000","last_undegraded":"2024-03-04T06:55:13.097306+0000","last_fullsized":"2024-03-04T06:55:13.097306+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116182+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.116182+0000","last_peered":"2024-03-04T06:55:13.116182+0000","last_clean":"2024-03-04T06:55:13.116182+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.116182+0000","last_undegraded":"2024-03-04T06:55:13.116182+0000","last_fullsized":"2024-03-04T06:55:13.116182+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114108+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114108+0000","last_peered":"2024-03-04T06:55:13.114108+0000","last_clean":"2024-03-04T06:55:13.114108+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114108+0000","last_undegraded":"2024-03-04T06:55:13.114108+0000","last_fullsized":"2024-03-04T06:55:13.114108+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096536+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:13.096536+0000","last_peered":"2024-03-04T06:55:13.096536+0000","last_clean":"2024-03-04T06:55:13.096536+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:13.096536+0000","last_undegraded":"2024-03-04T06:55:13.096536+0000","last_fullsized":"2024-03-04T06:55:13.096536+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4013,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.106850+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.106850+0000","last_peered":"2024-03-04T06:55:13.106850+0000","last_clean":"2024-03-04T06:55:13.106850+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.106850+0000","last_undegraded":"2024-03-04T06:55:13.106850+0000","last_fullsized":"2024-03-04T06:55:13.106850+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1090,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115070+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:13.115070+0000","last_peered":"2024-03-04T06:55:13.115070+0000","last_clean":"2024-03-04T06:55:13.115070+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:13.115070+0000","last_undegraded":"2024-03-04T06:55:13.115070+0000","last_fullsized":"2024-03-04T06:55:13.115070+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098424+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098424+0000","last_peered":"2024-03-04T06:55:13.098424+0000","last_clean":"2024-03-04T06:55:13.098424+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098424+0000","last_undegraded":"2024-03-04T06:55:13.098424+0000","last_fullsized":"2024-03-04T06:55:13.098424+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105176+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105176+0000","last_peered":"2024-03-04T06:55:13.105176+0000","last_clean":"2024-03-04T06:55:13.105176+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105176+0000","last_undegraded":"2024-03-04T06:55:13.105176+0000","last_fullsized":"2024-03-04T06:55:13.105176+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1549,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101736+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101736+0000","last_peered":"2024-03-04T06:55:13.101736+0000","last_clean":"2024-03-04T06:55:13.101736+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101736+0000","last_undegraded":"2024-03-04T06:55:13.101736+0000","last_fullsized":"2024-03-04T06:55:13.101736+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3949,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.128010+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:13.128010+0000","last_peered":"2024-03-04T06:55:13.128010+0000","last_clean":"2024-03-04T06:55:13.128010+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:13.128010+0000","last_undegraded":"2024-03-04T06:55:13.128010+0000","last_fullsized":"2024-03-04T06:55:13.128010+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117334+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117334+0000","last_peered":"2024-03-04T06:55:13.117334+0000","last_clean":"2024-03-04T06:55:13.117334+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117334+0000","last_undegraded":"2024-03-04T06:55:13.117334+0000","last_fullsized":"2024-03-04T06:55:13.117334+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096315+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:13.096315+0000","last_peered":"2024-03-04T06:55:13.096315+0000","last_clean":"2024-03-04T06:55:13.096315+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:13.096315+0000","last_undegraded":"2024-03-04T06:55:13.096315+0000","last_fullsized":"2024-03-04T06:55:13.096315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101691+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101691+0000","last_peered":"2024-03-04T06:55:13.101691+0000","last_clean":"2024-03-04T06:55:13.101691+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101691+0000","last_undegraded":"2024-03-04T06:55:13.101691+0000","last_fullsized":"2024-03-04T06:55:13.101691+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15290,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.174192+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:13.174192+0000","last_peered":"2024-03-04T06:55:13.174192+0000","last_clean":"2024-03-04T06:55:13.174192+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:13.174192+0000","last_undegraded":"2024-03-04T06:55:13.174192+0000","last_fullsized":"2024-03-04T06:55:13.174192+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117486+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117486+0000","last_peered":"2024-03-04T06:55:13.117486+0000","last_clean":"2024-03-04T06:55:13.117486+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117486+0000","last_undegraded":"2024-03-04T06:55:13.117486+0000","last_fullsized":"2024-03-04T06:55:13.117486+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102522+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102522+0000","last_peered":"2024-03-04T06:55:13.102522+0000","last_clean":"2024-03-04T06:55:13.102522+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102522+0000","last_undegraded":"2024-03-04T06:55:13.102522+0000","last_fullsized":"2024-03-04T06:55:13.102522+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116017+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116017+0000","last_peered":"2024-03-04T06:55:13.116017+0000","last_clean":"2024-03-04T06:55:13.116017+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116017+0000","last_undegraded":"2024-03-04T06:55:13.116017+0000","last_fullsized":"2024-03-04T06:55:13.116017+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4377,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097266+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097266+0000","last_peered":"2024-03-04T06:55:13.097266+0000","last_clean":"2024-03-04T06:55:13.097266+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097266+0000","last_undegraded":"2024-03-04T06:55:13.097266+0000","last_fullsized":"2024-03-04T06:55:13.097266+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097599+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:13.097599+0000","last_peered":"2024-03-04T06:55:13.097599+0000","last_clean":"2024-03-04T06:55:13.097599+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:13.097599+0000","last_undegraded":"2024-03-04T06:55:13.097599+0000","last_fullsized":"2024-03-04T06:55:13.097599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117221+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.117221+0000","last_peered":"2024-03-04T06:55:13.117221+0000","last_clean":"2024-03-04T06:55:13.117221+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.117221+0000","last_undegraded":"2024-03-04T06:55:13.117221+0000","last_fullsized":"2024-03-04T06:55:13.117221+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097200+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097200+0000","last_peered":"2024-03-04T06:55:13.097200+0000","last_clean":"2024-03-04T06:55:13.097200+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097200+0000","last_undegraded":"2024-03-04T06:55:13.097200+0000","last_fullsized":"2024-03-04T06:55:13.097200+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4608,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.311904+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:13.311904+0000","last_peered":"2024-03-04T06:55:13.311904+0000","last_clean":"2024-03-04T06:55:13.311904+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:13.311904+0000","last_undegraded":"2024-03-04T06:55:13.311904+0000","last_fullsized":"2024-03-04T06:55:13.311904+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095643+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095643+0000","last_peered":"2024-03-04T06:55:13.095643+0000","last_clean":"2024-03-04T06:55:13.095643+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095643+0000","last_undegraded":"2024-03-04T06:55:13.095643+0000","last_fullsized":"2024-03-04T06:55:13.095643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1077,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115185+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115185+0000","last_peered":"2024-03-04T06:55:13.115185+0000","last_clean":"2024-03-04T06:55:13.115185+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115185+0000","last_undegraded":"2024-03-04T06:55:13.115185+0000","last_fullsized":"2024-03-04T06:55:13.115185+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115325+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115325+0000","last_peered":"2024-03-04T06:55:13.115325+0000","last_clean":"2024-03-04T06:55:13.115325+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115325+0000","last_undegraded":"2024-03-04T06:55:13.115325+0000","last_fullsized":"2024-03-04T06:55:13.115325+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4633,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107390+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:13.107390+0000","last_peered":"2024-03-04T06:55:13.107390+0000","last_clean":"2024-03-04T06:55:13.107390+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:13.107390+0000","last_undegraded":"2024-03-04T06:55:13.107390+0000","last_fullsized":"2024-03-04T06:55:13.107390+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1055,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101919+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101919+0000","last_peered":"2024-03-04T06:55:13.101919+0000","last_clean":"2024-03-04T06:55:13.101919+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101919+0000","last_undegraded":"2024-03-04T06:55:13.101919+0000","last_fullsized":"2024-03-04T06:55:13.101919+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1183,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095626+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095626+0000","last_peered":"2024-03-04T06:55:13.095626+0000","last_clean":"2024-03-04T06:55:13.095626+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095626+0000","last_undegraded":"2024-03-04T06:55:13.095626+0000","last_fullsized":"2024-03-04T06:55:13.095626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5156,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.111062+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.111062+0000","last_peered":"2024-03-04T06:55:13.111062+0000","last_clean":"2024-03-04T06:55:13.111062+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.111062+0000","last_undegraded":"2024-03-04T06:55:13.111062+0000","last_fullsized":"2024-03-04T06:55:13.111062+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116686+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.116686+0000","last_peered":"2024-03-04T06:55:13.116686+0000","last_clean":"2024-03-04T06:55:13.116686+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.116686+0000","last_undegraded":"2024-03-04T06:55:13.116686+0000","last_fullsized":"2024-03-04T06:55:13.116686+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097769+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097769+0000","last_peered":"2024-03-04T06:55:13.097769+0000","last_clean":"2024-03-04T06:55:13.097769+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097769+0000","last_undegraded":"2024-03-04T06:55:13.097769+0000","last_fullsized":"2024-03-04T06:55:13.097769+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4718,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.169321+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.169321+0000","last_peered":"2024-03-04T06:55:13.169321+0000","last_clean":"2024-03-04T06:55:13.169321+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.169321+0000","last_undegraded":"2024-03-04T06:55:13.169321+0000","last_fullsized":"2024-03-04T06:55:13.169321+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114842+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.114842+0000","last_peered":"2024-03-04T06:55:13.114842+0000","last_clean":"2024-03-04T06:55:13.114842+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.114842+0000","last_undegraded":"2024-03-04T06:55:13.114842+0000","last_fullsized":"2024-03-04T06:55:13.114842+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098787+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098787+0000","last_peered":"2024-03-04T06:55:13.098787+0000","last_clean":"2024-03-04T06:55:13.098787+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098787+0000","last_undegraded":"2024-03-04T06:55:13.098787+0000","last_fullsized":"2024-03-04T06:55:13.098787+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5553,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117009+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:13.117009+0000","last_peered":"2024-03-04T06:55:13.117009+0000","last_clean":"2024-03-04T06:55:13.117009+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:13.117009+0000","last_undegraded":"2024-03-04T06:55:13.117009+0000","last_fullsized":"2024-03-04T06:55:13.117009+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102342+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102342+0000","last_peered":"2024-03-04T06:55:13.102342+0000","last_clean":"2024-03-04T06:55:13.102342+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102342+0000","last_undegraded":"2024-03-04T06:55:13.102342+0000","last_fullsized":"2024-03-04T06:55:13.102342+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114691+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114691+0000","last_peered":"2024-03-04T06:55:13.114691+0000","last_clean":"2024-03-04T06:55:13.114691+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114691+0000","last_undegraded":"2024-03-04T06:55:13.114691+0000","last_fullsized":"2024-03-04T06:55:13.114691+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096824+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096824+0000","last_peered":"2024-03-04T06:55:13.096824+0000","last_clean":"2024-03-04T06:55:13.096824+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096824+0000","last_undegraded":"2024-03-04T06:55:13.096824+0000","last_fullsized":"2024-03-04T06:55:13.096824+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097239+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097239+0000","last_peered":"2024-03-04T06:55:13.097239+0000","last_clean":"2024-03-04T06:55:13.097239+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097239+0000","last_undegraded":"2024-03-04T06:55:13.097239+0000","last_fullsized":"2024-03-04T06:55:13.097239+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102416+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102416+0000","last_peered":"2024-03-04T06:55:13.102416+0000","last_clean":"2024-03-04T06:55:13.102416+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102416+0000","last_undegraded":"2024-03-04T06:55:13.102416+0000","last_fullsized":"2024-03-04T06:55:13.102416+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4365,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.315099+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:13.315099+0000","last_peered":"2024-03-04T06:55:13.315099+0000","last_clean":"2024-03-04T06:55:13.315099+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:13.315099+0000","last_undegraded":"2024-03-04T06:55:13.315099+0000","last_fullsized":"2024-03-04T06:55:13.315099+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115541+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:13.115541+0000","last_peered":"2024-03-04T06:55:13.115541+0000","last_clean":"2024-03-04T06:55:13.115541+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:13.115541+0000","last_undegraded":"2024-03-04T06:55:13.115541+0000","last_fullsized":"2024-03-04T06:55:13.115541+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105888+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:13.105888+0000","last_peered":"2024-03-04T06:55:13.105888+0000","last_clean":"2024-03-04T06:55:13.105888+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:13.105888+0000","last_undegraded":"2024-03-04T06:55:13.105888+0000","last_fullsized":"2024-03-04T06:55:13.105888+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4598,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.321650+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.321650+0000","last_peered":"2024-03-04T06:55:13.321650+0000","last_clean":"2024-03-04T06:55:13.321650+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.321650+0000","last_undegraded":"2024-03-04T06:55:13.321650+0000","last_fullsized":"2024-03-04T06:55:13.321650+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097504+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097504+0000","last_peered":"2024-03-04T06:55:13.097504+0000","last_clean":"2024-03-04T06:55:13.097504+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097504+0000","last_undegraded":"2024-03-04T06:55:13.097504+0000","last_fullsized":"2024-03-04T06:55:13.097504+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104831+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.104831+0000","last_peered":"2024-03-04T06:55:13.104831+0000","last_clean":"2024-03-04T06:55:13.104831+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.104831+0000","last_undegraded":"2024-03-04T06:55:13.104831+0000","last_fullsized":"2024-03-04T06:55:13.104831+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114524+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:13.114524+0000","last_peered":"2024-03-04T06:55:13.114524+0000","last_clean":"2024-03-04T06:55:13.114524+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:13.114524+0000","last_undegraded":"2024-03-04T06:55:13.114524+0000","last_fullsized":"2024-03-04T06:55:13.114524+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096648+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:13.096648+0000","last_peered":"2024-03-04T06:55:13.096648+0000","last_clean":"2024-03-04T06:55:13.096648+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:13.096648+0000","last_undegraded":"2024-03-04T06:55:13.096648+0000","last_fullsized":"2024-03-04T06:55:13.096648+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105999+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.105999+0000","last_peered":"2024-03-04T06:55:13.105999+0000","last_clean":"2024-03-04T06:55:13.105999+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.105999+0000","last_undegraded":"2024-03-04T06:55:13.105999+0000","last_fullsized":"2024-03-04T06:55:13.105999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117074+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117074+0000","last_peered":"2024-03-04T06:55:13.117074+0000","last_clean":"2024-03-04T06:55:13.117074+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117074+0000","last_undegraded":"2024-03-04T06:55:13.117074+0000","last_fullsized":"2024-03-04T06:55:13.117074+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096759+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096759+0000","last_peered":"2024-03-04T06:55:13.096759+0000","last_clean":"2024-03-04T06:55:13.096759+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096759+0000","last_undegraded":"2024-03-04T06:55:13.096759+0000","last_fullsized":"2024-03-04T06:55:13.096759+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115428+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.115428+0000","last_peered":"2024-03-04T06:55:13.115428+0000","last_clean":"2024-03-04T06:55:13.115428+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.115428+0000","last_undegraded":"2024-03-04T06:55:13.115428+0000","last_fullsized":"2024-03-04T06:55:13.115428+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115286+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115286+0000","last_peered":"2024-03-04T06:55:13.115286+0000","last_clean":"2024-03-04T06:55:13.115286+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115286+0000","last_undegraded":"2024-03-04T06:55:13.115286+0000","last_fullsized":"2024-03-04T06:55:13.115286+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1192,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097432+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097432+0000","last_peered":"2024-03-04T06:55:13.097432+0000","last_clean":"2024-03-04T06:55:13.097432+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097432+0000","last_undegraded":"2024-03-04T06:55:13.097432+0000","last_fullsized":"2024-03-04T06:55:13.097432+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105275+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:13.105275+0000","last_peered":"2024-03-04T06:55:13.105275+0000","last_clean":"2024-03-04T06:55:13.105275+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:13.105275+0000","last_undegraded":"2024-03-04T06:55:13.105275+0000","last_fullsized":"2024-03-04T06:55:13.105275+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096564+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096564+0000","last_peered":"2024-03-04T06:55:13.096564+0000","last_clean":"2024-03-04T06:55:13.096564+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096564+0000","last_undegraded":"2024-03-04T06:55:13.096564+0000","last_fullsized":"2024-03-04T06:55:13.096564+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105576+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:13.105576+0000","last_peered":"2024-03-04T06:55:13.105576+0000","last_clean":"2024-03-04T06:55:13.105576+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:13.105576+0000","last_undegraded":"2024-03-04T06:55:13.105576+0000","last_fullsized":"2024-03-04T06:55:13.105576+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116864+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116864+0000","last_peered":"2024-03-04T06:55:13.116864+0000","last_clean":"2024-03-04T06:55:13.116864+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116864+0000","last_undegraded":"2024-03-04T06:55:13.116864+0000","last_fullsized":"2024-03-04T06:55:13.116864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114786+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114786+0000","last_peered":"2024-03-04T06:55:13.114786+0000","last_clean":"2024-03-04T06:55:13.114786+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114786+0000","last_undegraded":"2024-03-04T06:55:13.114786+0000","last_fullsized":"2024-03-04T06:55:13.114786+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503433,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648081,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142388,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287035,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997741,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885797,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937375,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792728,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:56:10.345 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:10.345 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:10.345 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:10.346 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:10.346 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:10.346 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:10.346 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:10.346 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:10.346 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:10.346 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:10.346 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:56:10.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:10 smithi203 ceph-mon[85573]: pgmap v949: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:11.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:11 smithi137 ceph-mon[88869]: from='client.44462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:56:11.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:11 smithi137 ceph-mon[91314]: from='client.44462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:56:11.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:11 smithi203 ceph-mon[85573]: from='client.44462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:56:12.457 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:12 smithi137 ceph-mon[88869]: pgmap v950: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:12.457 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:12 smithi137 ceph-mon[91314]: pgmap v950: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:12.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:12 smithi203 ceph-mon[85573]: pgmap v950: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:14.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:14 smithi137 ceph-mon[88869]: pgmap v951: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:14.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:14 smithi137 ceph-mon[91314]: pgmap v951: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:14.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:14 smithi203 ceph-mon[85573]: pgmap v951: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:15.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:56:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:56:15] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:56:16.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:16 smithi137 ceph-mon[88869]: pgmap v952: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:16.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:16 smithi137 ceph-mon[91314]: pgmap v952: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:16.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:16 smithi203 ceph-mon[85573]: pgmap v952: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:18.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:18 smithi137 ceph-mon[88869]: pgmap v953: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:18.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:18 smithi137 ceph-mon[91314]: pgmap v953: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:18.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:18 smithi203 ceph-mon[85573]: pgmap v953: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:20.347 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:56:20.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:20 smithi137 ceph-mon[88869]: pgmap v954: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:20.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:20 smithi137 ceph-mon[91314]: pgmap v954: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:20.570 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:56:20.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:20 smithi203 ceph-mon[85573]: pgmap v954: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:22.367 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:56:22.369 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:56:22.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:22 smithi137 ceph-mon[88869]: pgmap v955: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:22.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:22 smithi137 ceph-mon[91314]: pgmap v955: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:22.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:22 smithi203 ceph-mon[85573]: pgmap v955: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:23.045 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":955,"stamp":"2024-03-04T06:56:20.478075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004212"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103340+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103340+0000","last_peered":"2024-03-04T06:55:13.103340+0000","last_clean":"2024-03-04T06:55:13.103340+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103340+0000","last_undegraded":"2024-03-04T06:55:13.103340+0000","last_fullsized":"2024-03-04T06:55:13.103340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116955+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.116955+0000","last_peered":"2024-03-04T06:55:13.116955+0000","last_clean":"2024-03-04T06:55:13.116955+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.116955+0000","last_undegraded":"2024-03-04T06:55:13.116955+0000","last_fullsized":"2024-03-04T06:55:13.116955+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115370+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115370+0000","last_peered":"2024-03-04T06:55:13.115370+0000","last_clean":"2024-03-04T06:55:13.115370+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115370+0000","last_undegraded":"2024-03-04T06:55:13.115370+0000","last_fullsized":"2024-03-04T06:55:13.115370+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106086+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106086+0000","last_peered":"2024-03-04T06:55:13.106086+0000","last_clean":"2024-03-04T06:55:13.106086+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106086+0000","last_undegraded":"2024-03-04T06:55:13.106086+0000","last_fullsized":"2024-03-04T06:55:13.106086+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101948+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.101948+0000","last_peered":"2024-03-04T06:55:13.101948+0000","last_clean":"2024-03-04T06:55:13.101948+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.101948+0000","last_undegraded":"2024-03-04T06:55:13.101948+0000","last_fullsized":"2024-03-04T06:55:13.101948+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106042+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106042+0000","last_peered":"2024-03-04T06:55:13.106042+0000","last_clean":"2024-03-04T06:55:13.106042+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106042+0000","last_undegraded":"2024-03-04T06:55:13.106042+0000","last_fullsized":"2024-03-04T06:55:13.106042+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101755+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101755+0000","last_peered":"2024-03-04T06:55:13.101755+0000","last_clean":"2024-03-04T06:55:13.101755+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101755+0000","last_undegraded":"2024-03-04T06:55:13.101755+0000","last_fullsized":"2024-03-04T06:55:13.101755+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097051+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:13.097051+0000","last_peered":"2024-03-04T06:55:13.097051+0000","last_clean":"2024-03-04T06:55:13.097051+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:13.097051+0000","last_undegraded":"2024-03-04T06:55:13.097051+0000","last_fullsized":"2024-03-04T06:55:13.097051+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1063,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102987+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.102987+0000","last_peered":"2024-03-04T06:55:13.102987+0000","last_clean":"2024-03-04T06:55:13.102987+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.102987+0000","last_undegraded":"2024-03-04T06:55:13.102987+0000","last_fullsized":"2024-03-04T06:55:13.102987+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114958+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.114958+0000","last_peered":"2024-03-04T06:55:13.114958+0000","last_clean":"2024-03-04T06:55:13.114958+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.114958+0000","last_undegraded":"2024-03-04T06:55:13.114958+0000","last_fullsized":"2024-03-04T06:55:13.114958+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114806+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114806+0000","last_peered":"2024-03-04T06:55:13.114806+0000","last_clean":"2024-03-04T06:55:13.114806+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114806+0000","last_undegraded":"2024-03-04T06:55:13.114806+0000","last_fullsized":"2024-03-04T06:55:13.114806+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1154,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095971+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:13.095971+0000","last_peered":"2024-03-04T06:55:13.095971+0000","last_clean":"2024-03-04T06:55:13.095971+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:13.095971+0000","last_undegraded":"2024-03-04T06:55:13.095971+0000","last_fullsized":"2024-03-04T06:55:13.095971+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1198,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098969+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.098969+0000","last_peered":"2024-03-04T06:55:13.098969+0000","last_clean":"2024-03-04T06:55:13.098969+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.098969+0000","last_undegraded":"2024-03-04T06:55:13.098969+0000","last_fullsized":"2024-03-04T06:55:13.098969+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115324+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:13.115324+0000","last_peered":"2024-03-04T06:55:13.115324+0000","last_clean":"2024-03-04T06:55:13.115324+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:13.115324+0000","last_undegraded":"2024-03-04T06:55:13.115324+0000","last_fullsized":"2024-03-04T06:55:13.115324+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115730+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115730+0000","last_peered":"2024-03-04T06:55:13.115730+0000","last_clean":"2024-03-04T06:55:13.115730+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115730+0000","last_undegraded":"2024-03-04T06:55:13.115730+0000","last_fullsized":"2024-03-04T06:55:13.115730+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104995+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104995+0000","last_peered":"2024-03-04T06:55:13.104995+0000","last_clean":"2024-03-04T06:55:13.104995+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104995+0000","last_undegraded":"2024-03-04T06:55:13.104995+0000","last_fullsized":"2024-03-04T06:55:13.104995+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.107002+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.107002+0000","last_peered":"2024-03-04T06:55:13.107002+0000","last_clean":"2024-03-04T06:55:13.107002+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.107002+0000","last_undegraded":"2024-03-04T06:55:13.107002+0000","last_fullsized":"2024-03-04T06:55:13.107002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096883+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096883+0000","last_peered":"2024-03-04T06:55:13.096883+0000","last_clean":"2024-03-04T06:55:13.096883+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096883+0000","last_undegraded":"2024-03-04T06:55:13.096883+0000","last_fullsized":"2024-03-04T06:55:13.096883+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102246+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102246+0000","last_peered":"2024-03-04T06:55:13.102246+0000","last_clean":"2024-03-04T06:55:13.102246+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102246+0000","last_undegraded":"2024-03-04T06:55:13.102246+0000","last_fullsized":"2024-03-04T06:55:13.102246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116560+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116560+0000","last_peered":"2024-03-04T06:55:13.116560+0000","last_clean":"2024-03-04T06:55:13.116560+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116560+0000","last_undegraded":"2024-03-04T06:55:13.116560+0000","last_fullsized":"2024-03-04T06:55:13.116560+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097609+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:13.097609+0000","last_peered":"2024-03-04T06:55:13.097609+0000","last_clean":"2024-03-04T06:55:13.097609+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:13.097609+0000","last_undegraded":"2024-03-04T06:55:13.097609+0000","last_fullsized":"2024-03-04T06:55:13.097609+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097848+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:13.097848+0000","last_peered":"2024-03-04T06:55:13.097848+0000","last_clean":"2024-03-04T06:55:13.097848+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:13.097848+0000","last_undegraded":"2024-03-04T06:55:13.097848+0000","last_fullsized":"2024-03-04T06:55:13.097848+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115577+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.115577+0000","last_peered":"2024-03-04T06:55:13.115577+0000","last_clean":"2024-03-04T06:55:13.115577+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.115577+0000","last_undegraded":"2024-03-04T06:55:13.115577+0000","last_fullsized":"2024-03-04T06:55:13.115577+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1233,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098515+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098515+0000","last_peered":"2024-03-04T06:55:13.098515+0000","last_clean":"2024-03-04T06:55:13.098515+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098515+0000","last_undegraded":"2024-03-04T06:55:13.098515+0000","last_fullsized":"2024-03-04T06:55:13.098515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1220,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097456+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097456+0000","last_peered":"2024-03-04T06:55:13.097456+0000","last_clean":"2024-03-04T06:55:13.097456+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097456+0000","last_undegraded":"2024-03-04T06:55:13.097456+0000","last_fullsized":"2024-03-04T06:55:13.097456+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1068,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102398+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102398+0000","last_peered":"2024-03-04T06:55:13.102398+0000","last_clean":"2024-03-04T06:55:13.102398+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102398+0000","last_undegraded":"2024-03-04T06:55:13.102398+0000","last_fullsized":"2024-03-04T06:55:13.102398+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1124,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106153+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106153+0000","last_peered":"2024-03-04T06:55:13.106153+0000","last_clean":"2024-03-04T06:55:13.106153+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106153+0000","last_undegraded":"2024-03-04T06:55:13.106153+0000","last_fullsized":"2024-03-04T06:55:13.106153+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098905+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:13.098905+0000","last_peered":"2024-03-04T06:55:13.098905+0000","last_clean":"2024-03-04T06:55:13.098905+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:13.098905+0000","last_undegraded":"2024-03-04T06:55:13.098905+0000","last_fullsized":"2024-03-04T06:55:13.098905+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1188,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096052+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.096052+0000","last_peered":"2024-03-04T06:55:13.096052+0000","last_clean":"2024-03-04T06:55:13.096052+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.096052+0000","last_undegraded":"2024-03-04T06:55:13.096052+0000","last_fullsized":"2024-03-04T06:55:13.096052+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114659+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114659+0000","last_peered":"2024-03-04T06:55:13.114659+0000","last_clean":"2024-03-04T06:55:13.114659+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114659+0000","last_undegraded":"2024-03-04T06:55:13.114659+0000","last_fullsized":"2024-03-04T06:55:13.114659+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.118051+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.118051+0000","last_peered":"2024-03-04T06:55:13.118051+0000","last_clean":"2024-03-04T06:55:13.118051+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.118051+0000","last_undegraded":"2024-03-04T06:55:13.118051+0000","last_fullsized":"2024-03-04T06:55:13.118051+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096686+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096686+0000","last_peered":"2024-03-04T06:55:13.096686+0000","last_clean":"2024-03-04T06:55:13.096686+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096686+0000","last_undegraded":"2024-03-04T06:55:13.096686+0000","last_fullsized":"2024-03-04T06:55:13.096686+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097180+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097180+0000","last_peered":"2024-03-04T06:55:13.097180+0000","last_clean":"2024-03-04T06:55:13.097180+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097180+0000","last_undegraded":"2024-03-04T06:55:13.097180+0000","last_fullsized":"2024-03-04T06:55:13.097180+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105593+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105593+0000","last_peered":"2024-03-04T06:55:13.105593+0000","last_clean":"2024-03-04T06:55:13.105593+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105593+0000","last_undegraded":"2024-03-04T06:55:13.105593+0000","last_fullsized":"2024-03-04T06:55:13.105593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115824+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115824+0000","last_peered":"2024-03-04T06:55:13.115824+0000","last_clean":"2024-03-04T06:55:13.115824+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115824+0000","last_undegraded":"2024-03-04T06:55:13.115824+0000","last_fullsized":"2024-03-04T06:55:13.115824+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115093+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115093+0000","last_peered":"2024-03-04T06:55:13.115093+0000","last_clean":"2024-03-04T06:55:13.115093+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115093+0000","last_undegraded":"2024-03-04T06:55:13.115093+0000","last_fullsized":"2024-03-04T06:55:13.115093+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1110,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105468+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105468+0000","last_peered":"2024-03-04T06:55:13.105468+0000","last_clean":"2024-03-04T06:55:13.105468+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105468+0000","last_undegraded":"2024-03-04T06:55:13.105468+0000","last_fullsized":"2024-03-04T06:55:13.105468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105915+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105915+0000","last_peered":"2024-03-04T06:55:13.105915+0000","last_clean":"2024-03-04T06:55:13.105915+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105915+0000","last_undegraded":"2024-03-04T06:55:13.105915+0000","last_fullsized":"2024-03-04T06:55:13.105915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116155+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116155+0000","last_peered":"2024-03-04T06:55:13.116155+0000","last_clean":"2024-03-04T06:55:13.116155+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116155+0000","last_undegraded":"2024-03-04T06:55:13.116155+0000","last_fullsized":"2024-03-04T06:55:13.116155+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116083+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116083+0000","last_peered":"2024-03-04T06:55:13.116083+0000","last_clean":"2024-03-04T06:55:13.116083+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116083+0000","last_undegraded":"2024-03-04T06:55:13.116083+0000","last_fullsized":"2024-03-04T06:55:13.116083+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096448+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:13.096448+0000","last_peered":"2024-03-04T06:55:13.096448+0000","last_clean":"2024-03-04T06:55:13.096448+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:13.096448+0000","last_undegraded":"2024-03-04T06:55:13.096448+0000","last_fullsized":"2024-03-04T06:55:13.096448+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114921+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114921+0000","last_peered":"2024-03-04T06:55:13.114921+0000","last_clean":"2024-03-04T06:55:13.114921+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114921+0000","last_undegraded":"2024-03-04T06:55:13.114921+0000","last_fullsized":"2024-03-04T06:55:13.114921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102608+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102608+0000","last_peered":"2024-03-04T06:55:13.102608+0000","last_clean":"2024-03-04T06:55:13.102608+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102608+0000","last_undegraded":"2024-03-04T06:55:13.102608+0000","last_fullsized":"2024-03-04T06:55:13.102608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117741+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:13.117741+0000","last_peered":"2024-03-04T06:55:13.117741+0000","last_clean":"2024-03-04T06:55:13.117741+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:13.117741+0000","last_undegraded":"2024-03-04T06:55:13.117741+0000","last_fullsized":"2024-03-04T06:55:13.117741+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098491+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098491+0000","last_peered":"2024-03-04T06:55:13.098491+0000","last_clean":"2024-03-04T06:55:13.098491+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098491+0000","last_undegraded":"2024-03-04T06:55:13.098491+0000","last_fullsized":"2024-03-04T06:55:13.098491+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105922+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105922+0000","last_peered":"2024-03-04T06:55:13.105922+0000","last_clean":"2024-03-04T06:55:13.105922+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105922+0000","last_undegraded":"2024-03-04T06:55:13.105922+0000","last_fullsized":"2024-03-04T06:55:13.105922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102507+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102507+0000","last_peered":"2024-03-04T06:55:13.102507+0000","last_clean":"2024-03-04T06:55:13.102507+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102507+0000","last_undegraded":"2024-03-04T06:55:13.102507+0000","last_fullsized":"2024-03-04T06:55:13.102507+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114409+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114409+0000","last_peered":"2024-03-04T06:55:13.114409+0000","last_clean":"2024-03-04T06:55:13.114409+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114409+0000","last_undegraded":"2024-03-04T06:55:13.114409+0000","last_fullsized":"2024-03-04T06:55:13.114409+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114411+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114411+0000","last_peered":"2024-03-04T06:55:13.114411+0000","last_clean":"2024-03-04T06:55:13.114411+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114411+0000","last_undegraded":"2024-03-04T06:55:13.114411+0000","last_fullsized":"2024-03-04T06:55:13.114411+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1251,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096553+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096553+0000","last_peered":"2024-03-04T06:55:13.096553+0000","last_clean":"2024-03-04T06:55:13.096553+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096553+0000","last_undegraded":"2024-03-04T06:55:13.096553+0000","last_fullsized":"2024-03-04T06:55:13.096553+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101772+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101772+0000","last_peered":"2024-03-04T06:55:13.101772+0000","last_clean":"2024-03-04T06:55:13.101772+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101772+0000","last_undegraded":"2024-03-04T06:55:13.101772+0000","last_fullsized":"2024-03-04T06:55:13.101772+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3576,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096470+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:13.096470+0000","last_peered":"2024-03-04T06:55:13.096470+0000","last_clean":"2024-03-04T06:55:13.096470+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:13.096470+0000","last_undegraded":"2024-03-04T06:55:13.096470+0000","last_fullsized":"2024-03-04T06:55:13.096470+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096934+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096934+0000","last_peered":"2024-03-04T06:55:13.096934+0000","last_clean":"2024-03-04T06:55:13.096934+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096934+0000","last_undegraded":"2024-03-04T06:55:13.096934+0000","last_fullsized":"2024-03-04T06:55:13.096934+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102885+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102885+0000","last_peered":"2024-03-04T06:55:13.102885+0000","last_clean":"2024-03-04T06:55:13.102885+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102885+0000","last_undegraded":"2024-03-04T06:55:13.102885+0000","last_fullsized":"2024-03-04T06:55:13.102885+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17114,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117468+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117468+0000","last_peered":"2024-03-04T06:55:13.117468+0000","last_clean":"2024-03-04T06:55:13.117468+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117468+0000","last_undegraded":"2024-03-04T06:55:13.117468+0000","last_fullsized":"2024-03-04T06:55:13.117468+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115048+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115048+0000","last_peered":"2024-03-04T06:55:13.115048+0000","last_clean":"2024-03-04T06:55:13.115048+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115048+0000","last_undegraded":"2024-03-04T06:55:13.115048+0000","last_fullsized":"2024-03-04T06:55:13.115048+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116658+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116658+0000","last_peered":"2024-03-04T06:55:13.116658+0000","last_clean":"2024-03-04T06:55:13.116658+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116658+0000","last_undegraded":"2024-03-04T06:55:13.116658+0000","last_fullsized":"2024-03-04T06:55:13.116658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105904+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.105904+0000","last_peered":"2024-03-04T06:55:13.105904+0000","last_clean":"2024-03-04T06:55:13.105904+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.105904+0000","last_undegraded":"2024-03-04T06:55:13.105904+0000","last_fullsized":"2024-03-04T06:55:13.105904+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4384,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.116730+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.116730+0000","last_peered":"2024-03-04T06:55:13.116730+0000","last_clean":"2024-03-04T06:55:13.116730+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.116730+0000","last_undegraded":"2024-03-04T06:55:13.116730+0000","last_fullsized":"2024-03-04T06:55:13.116730+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115924+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115924+0000","last_peered":"2024-03-04T06:55:13.115924+0000","last_clean":"2024-03-04T06:55:13.115924+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115924+0000","last_undegraded":"2024-03-04T06:55:13.115924+0000","last_fullsized":"2024-03-04T06:55:13.115924+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105684+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105684+0000","last_peered":"2024-03-04T06:55:13.105684+0000","last_clean":"2024-03-04T06:55:13.105684+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105684+0000","last_undegraded":"2024-03-04T06:55:13.105684+0000","last_fullsized":"2024-03-04T06:55:13.105684+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096227+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096227+0000","last_peered":"2024-03-04T06:55:13.096227+0000","last_clean":"2024-03-04T06:55:13.096227+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096227+0000","last_undegraded":"2024-03-04T06:55:13.096227+0000","last_fullsized":"2024-03-04T06:55:13.096227+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5638,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097306+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:13.097306+0000","last_peered":"2024-03-04T06:55:13.097306+0000","last_clean":"2024-03-04T06:55:13.097306+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:13.097306+0000","last_undegraded":"2024-03-04T06:55:13.097306+0000","last_fullsized":"2024-03-04T06:55:13.097306+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116182+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.116182+0000","last_peered":"2024-03-04T06:55:13.116182+0000","last_clean":"2024-03-04T06:55:13.116182+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.116182+0000","last_undegraded":"2024-03-04T06:55:13.116182+0000","last_fullsized":"2024-03-04T06:55:13.116182+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114108+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114108+0000","last_peered":"2024-03-04T06:55:13.114108+0000","last_clean":"2024-03-04T06:55:13.114108+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114108+0000","last_undegraded":"2024-03-04T06:55:13.114108+0000","last_fullsized":"2024-03-04T06:55:13.114108+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096536+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:13.096536+0000","last_peered":"2024-03-04T06:55:13.096536+0000","last_clean":"2024-03-04T06:55:13.096536+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:13.096536+0000","last_undegraded":"2024-03-04T06:55:13.096536+0000","last_fullsized":"2024-03-04T06:55:13.096536+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4014,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107389+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.107389+0000","last_peered":"2024-03-04T06:55:13.107389+0000","last_clean":"2024-03-04T06:55:13.107389+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.107389+0000","last_undegraded":"2024-03-04T06:55:13.107389+0000","last_fullsized":"2024-03-04T06:55:13.107389+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1090,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115070+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:13.115070+0000","last_peered":"2024-03-04T06:55:13.115070+0000","last_clean":"2024-03-04T06:55:13.115070+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:13.115070+0000","last_undegraded":"2024-03-04T06:55:13.115070+0000","last_fullsized":"2024-03-04T06:55:13.115070+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098424+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098424+0000","last_peered":"2024-03-04T06:55:13.098424+0000","last_clean":"2024-03-04T06:55:13.098424+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098424+0000","last_undegraded":"2024-03-04T06:55:13.098424+0000","last_fullsized":"2024-03-04T06:55:13.098424+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105176+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105176+0000","last_peered":"2024-03-04T06:55:13.105176+0000","last_clean":"2024-03-04T06:55:13.105176+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105176+0000","last_undegraded":"2024-03-04T06:55:13.105176+0000","last_fullsized":"2024-03-04T06:55:13.105176+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1549,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101736+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101736+0000","last_peered":"2024-03-04T06:55:13.101736+0000","last_clean":"2024-03-04T06:55:13.101736+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101736+0000","last_undegraded":"2024-03-04T06:55:13.101736+0000","last_fullsized":"2024-03-04T06:55:13.101736+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3949,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.128010+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:13.128010+0000","last_peered":"2024-03-04T06:55:13.128010+0000","last_clean":"2024-03-04T06:55:13.128010+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:13.128010+0000","last_undegraded":"2024-03-04T06:55:13.128010+0000","last_fullsized":"2024-03-04T06:55:13.128010+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117334+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117334+0000","last_peered":"2024-03-04T06:55:13.117334+0000","last_clean":"2024-03-04T06:55:13.117334+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117334+0000","last_undegraded":"2024-03-04T06:55:13.117334+0000","last_fullsized":"2024-03-04T06:55:13.117334+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096315+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:13.096315+0000","last_peered":"2024-03-04T06:55:13.096315+0000","last_clean":"2024-03-04T06:55:13.096315+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:13.096315+0000","last_undegraded":"2024-03-04T06:55:13.096315+0000","last_fullsized":"2024-03-04T06:55:13.096315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101691+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101691+0000","last_peered":"2024-03-04T06:55:13.101691+0000","last_clean":"2024-03-04T06:55:13.101691+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101691+0000","last_undegraded":"2024-03-04T06:55:13.101691+0000","last_fullsized":"2024-03-04T06:55:13.101691+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15290,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.174192+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:13.174192+0000","last_peered":"2024-03-04T06:55:13.174192+0000","last_clean":"2024-03-04T06:55:13.174192+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:13.174192+0000","last_undegraded":"2024-03-04T06:55:13.174192+0000","last_fullsized":"2024-03-04T06:55:13.174192+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117486+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117486+0000","last_peered":"2024-03-04T06:55:13.117486+0000","last_clean":"2024-03-04T06:55:13.117486+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117486+0000","last_undegraded":"2024-03-04T06:55:13.117486+0000","last_fullsized":"2024-03-04T06:55:13.117486+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102583+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102583+0000","last_peered":"2024-03-04T06:55:13.102583+0000","last_clean":"2024-03-04T06:55:13.102583+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102583+0000","last_undegraded":"2024-03-04T06:55:13.102583+0000","last_fullsized":"2024-03-04T06:55:13.102583+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116017+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116017+0000","last_peered":"2024-03-04T06:55:13.116017+0000","last_clean":"2024-03-04T06:55:13.116017+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116017+0000","last_undegraded":"2024-03-04T06:55:13.116017+0000","last_fullsized":"2024-03-04T06:55:13.116017+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4377,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097266+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097266+0000","last_peered":"2024-03-04T06:55:13.097266+0000","last_clean":"2024-03-04T06:55:13.097266+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097266+0000","last_undegraded":"2024-03-04T06:55:13.097266+0000","last_fullsized":"2024-03-04T06:55:13.097266+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097599+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:13.097599+0000","last_peered":"2024-03-04T06:55:13.097599+0000","last_clean":"2024-03-04T06:55:13.097599+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:13.097599+0000","last_undegraded":"2024-03-04T06:55:13.097599+0000","last_fullsized":"2024-03-04T06:55:13.097599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117221+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.117221+0000","last_peered":"2024-03-04T06:55:13.117221+0000","last_clean":"2024-03-04T06:55:13.117221+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.117221+0000","last_undegraded":"2024-03-04T06:55:13.117221+0000","last_fullsized":"2024-03-04T06:55:13.117221+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097200+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097200+0000","last_peered":"2024-03-04T06:55:13.097200+0000","last_clean":"2024-03-04T06:55:13.097200+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097200+0000","last_undegraded":"2024-03-04T06:55:13.097200+0000","last_fullsized":"2024-03-04T06:55:13.097200+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4608,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.311904+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:13.311904+0000","last_peered":"2024-03-04T06:55:13.311904+0000","last_clean":"2024-03-04T06:55:13.311904+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:13.311904+0000","last_undegraded":"2024-03-04T06:55:13.311904+0000","last_fullsized":"2024-03-04T06:55:13.311904+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095643+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095643+0000","last_peered":"2024-03-04T06:55:13.095643+0000","last_clean":"2024-03-04T06:55:13.095643+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095643+0000","last_undegraded":"2024-03-04T06:55:13.095643+0000","last_fullsized":"2024-03-04T06:55:13.095643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1077,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115185+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115185+0000","last_peered":"2024-03-04T06:55:13.115185+0000","last_clean":"2024-03-04T06:55:13.115185+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115185+0000","last_undegraded":"2024-03-04T06:55:13.115185+0000","last_fullsized":"2024-03-04T06:55:13.115185+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115325+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115325+0000","last_peered":"2024-03-04T06:55:13.115325+0000","last_clean":"2024-03-04T06:55:13.115325+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115325+0000","last_undegraded":"2024-03-04T06:55:13.115325+0000","last_fullsized":"2024-03-04T06:55:13.115325+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4633,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107390+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:13.107390+0000","last_peered":"2024-03-04T06:55:13.107390+0000","last_clean":"2024-03-04T06:55:13.107390+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:13.107390+0000","last_undegraded":"2024-03-04T06:55:13.107390+0000","last_fullsized":"2024-03-04T06:55:13.107390+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1055,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101919+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101919+0000","last_peered":"2024-03-04T06:55:13.101919+0000","last_clean":"2024-03-04T06:55:13.101919+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101919+0000","last_undegraded":"2024-03-04T06:55:13.101919+0000","last_fullsized":"2024-03-04T06:55:13.101919+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1183,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095626+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095626+0000","last_peered":"2024-03-04T06:55:13.095626+0000","last_clean":"2024-03-04T06:55:13.095626+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095626+0000","last_undegraded":"2024-03-04T06:55:13.095626+0000","last_fullsized":"2024-03-04T06:55:13.095626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5156,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.111062+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.111062+0000","last_peered":"2024-03-04T06:55:13.111062+0000","last_clean":"2024-03-04T06:55:13.111062+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.111062+0000","last_undegraded":"2024-03-04T06:55:13.111062+0000","last_fullsized":"2024-03-04T06:55:13.111062+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116686+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.116686+0000","last_peered":"2024-03-04T06:55:13.116686+0000","last_clean":"2024-03-04T06:55:13.116686+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.116686+0000","last_undegraded":"2024-03-04T06:55:13.116686+0000","last_fullsized":"2024-03-04T06:55:13.116686+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097769+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097769+0000","last_peered":"2024-03-04T06:55:13.097769+0000","last_clean":"2024-03-04T06:55:13.097769+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097769+0000","last_undegraded":"2024-03-04T06:55:13.097769+0000","last_fullsized":"2024-03-04T06:55:13.097769+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4718,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.169321+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.169321+0000","last_peered":"2024-03-04T06:55:13.169321+0000","last_clean":"2024-03-04T06:55:13.169321+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.169321+0000","last_undegraded":"2024-03-04T06:55:13.169321+0000","last_fullsized":"2024-03-04T06:55:13.169321+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114842+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.114842+0000","last_peered":"2024-03-04T06:55:13.114842+0000","last_clean":"2024-03-04T06:55:13.114842+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.114842+0000","last_undegraded":"2024-03-04T06:55:13.114842+0000","last_fullsized":"2024-03-04T06:55:13.114842+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098787+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098787+0000","last_peered":"2024-03-04T06:55:13.098787+0000","last_clean":"2024-03-04T06:55:13.098787+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098787+0000","last_undegraded":"2024-03-04T06:55:13.098787+0000","last_fullsized":"2024-03-04T06:55:13.098787+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5553,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117009+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:13.117009+0000","last_peered":"2024-03-04T06:55:13.117009+0000","last_clean":"2024-03-04T06:55:13.117009+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:13.117009+0000","last_undegraded":"2024-03-04T06:55:13.117009+0000","last_fullsized":"2024-03-04T06:55:13.117009+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102342+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102342+0000","last_peered":"2024-03-04T06:55:13.102342+0000","last_clean":"2024-03-04T06:55:13.102342+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102342+0000","last_undegraded":"2024-03-04T06:55:13.102342+0000","last_fullsized":"2024-03-04T06:55:13.102342+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114691+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114691+0000","last_peered":"2024-03-04T06:55:13.114691+0000","last_clean":"2024-03-04T06:55:13.114691+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114691+0000","last_undegraded":"2024-03-04T06:55:13.114691+0000","last_fullsized":"2024-03-04T06:55:13.114691+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096824+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096824+0000","last_peered":"2024-03-04T06:55:13.096824+0000","last_clean":"2024-03-04T06:55:13.096824+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096824+0000","last_undegraded":"2024-03-04T06:55:13.096824+0000","last_fullsized":"2024-03-04T06:55:13.096824+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097239+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097239+0000","last_peered":"2024-03-04T06:55:13.097239+0000","last_clean":"2024-03-04T06:55:13.097239+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097239+0000","last_undegraded":"2024-03-04T06:55:13.097239+0000","last_fullsized":"2024-03-04T06:55:13.097239+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102416+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102416+0000","last_peered":"2024-03-04T06:55:13.102416+0000","last_clean":"2024-03-04T06:55:13.102416+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102416+0000","last_undegraded":"2024-03-04T06:55:13.102416+0000","last_fullsized":"2024-03-04T06:55:13.102416+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4365,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.315099+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:13.315099+0000","last_peered":"2024-03-04T06:55:13.315099+0000","last_clean":"2024-03-04T06:55:13.315099+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:13.315099+0000","last_undegraded":"2024-03-04T06:55:13.315099+0000","last_fullsized":"2024-03-04T06:55:13.315099+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115541+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:13.115541+0000","last_peered":"2024-03-04T06:55:13.115541+0000","last_clean":"2024-03-04T06:55:13.115541+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:13.115541+0000","last_undegraded":"2024-03-04T06:55:13.115541+0000","last_fullsized":"2024-03-04T06:55:13.115541+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105888+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:13.105888+0000","last_peered":"2024-03-04T06:55:13.105888+0000","last_clean":"2024-03-04T06:55:13.105888+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:13.105888+0000","last_undegraded":"2024-03-04T06:55:13.105888+0000","last_fullsized":"2024-03-04T06:55:13.105888+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4598,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.321650+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.321650+0000","last_peered":"2024-03-04T06:55:13.321650+0000","last_clean":"2024-03-04T06:55:13.321650+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.321650+0000","last_undegraded":"2024-03-04T06:55:13.321650+0000","last_fullsized":"2024-03-04T06:55:13.321650+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097504+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097504+0000","last_peered":"2024-03-04T06:55:13.097504+0000","last_clean":"2024-03-04T06:55:13.097504+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097504+0000","last_undegraded":"2024-03-04T06:55:13.097504+0000","last_fullsized":"2024-03-04T06:55:13.097504+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104831+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.104831+0000","last_peered":"2024-03-04T06:55:13.104831+0000","last_clean":"2024-03-04T06:55:13.104831+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.104831+0000","last_undegraded":"2024-03-04T06:55:13.104831+0000","last_fullsized":"2024-03-04T06:55:13.104831+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114524+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:13.114524+0000","last_peered":"2024-03-04T06:55:13.114524+0000","last_clean":"2024-03-04T06:55:13.114524+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:13.114524+0000","last_undegraded":"2024-03-04T06:55:13.114524+0000","last_fullsized":"2024-03-04T06:55:13.114524+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096648+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:13.096648+0000","last_peered":"2024-03-04T06:55:13.096648+0000","last_clean":"2024-03-04T06:55:13.096648+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:13.096648+0000","last_undegraded":"2024-03-04T06:55:13.096648+0000","last_fullsized":"2024-03-04T06:55:13.096648+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105999+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.105999+0000","last_peered":"2024-03-04T06:55:13.105999+0000","last_clean":"2024-03-04T06:55:13.105999+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.105999+0000","last_undegraded":"2024-03-04T06:55:13.105999+0000","last_fullsized":"2024-03-04T06:55:13.105999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117074+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117074+0000","last_peered":"2024-03-04T06:55:13.117074+0000","last_clean":"2024-03-04T06:55:13.117074+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117074+0000","last_undegraded":"2024-03-04T06:55:13.117074+0000","last_fullsized":"2024-03-04T06:55:13.117074+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096759+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096759+0000","last_peered":"2024-03-04T06:55:13.096759+0000","last_clean":"2024-03-04T06:55:13.096759+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096759+0000","last_undegraded":"2024-03-04T06:55:13.096759+0000","last_fullsized":"2024-03-04T06:55:13.096759+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115428+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.115428+0000","last_peered":"2024-03-04T06:55:13.115428+0000","last_clean":"2024-03-04T06:55:13.115428+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.115428+0000","last_undegraded":"2024-03-04T06:55:13.115428+0000","last_fullsized":"2024-03-04T06:55:13.115428+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115286+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115286+0000","last_peered":"2024-03-04T06:55:13.115286+0000","last_clean":"2024-03-04T06:55:13.115286+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115286+0000","last_undegraded":"2024-03-04T06:55:13.115286+0000","last_fullsized":"2024-03-04T06:55:13.115286+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1192,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097432+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097432+0000","last_peered":"2024-03-04T06:55:13.097432+0000","last_clean":"2024-03-04T06:55:13.097432+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097432+0000","last_undegraded":"2024-03-04T06:55:13.097432+0000","last_fullsized":"2024-03-04T06:55:13.097432+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105275+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:13.105275+0000","last_peered":"2024-03-04T06:55:13.105275+0000","last_clean":"2024-03-04T06:55:13.105275+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:13.105275+0000","last_undegraded":"2024-03-04T06:55:13.105275+0000","last_fullsized":"2024-03-04T06:55:13.105275+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096564+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096564+0000","last_peered":"2024-03-04T06:55:13.096564+0000","last_clean":"2024-03-04T06:55:13.096564+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096564+0000","last_undegraded":"2024-03-04T06:55:13.096564+0000","last_fullsized":"2024-03-04T06:55:13.096564+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105576+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:13.105576+0000","last_peered":"2024-03-04T06:55:13.105576+0000","last_clean":"2024-03-04T06:55:13.105576+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:13.105576+0000","last_undegraded":"2024-03-04T06:55:13.105576+0000","last_fullsized":"2024-03-04T06:55:13.105576+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116864+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116864+0000","last_peered":"2024-03-04T06:55:13.116864+0000","last_clean":"2024-03-04T06:55:13.116864+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116864+0000","last_undegraded":"2024-03-04T06:55:13.116864+0000","last_fullsized":"2024-03-04T06:55:13.116864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114836+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114836+0000","last_peered":"2024-03-04T06:55:13.114836+0000","last_clean":"2024-03-04T06:55:13.114836+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114836+0000","last_undegraded":"2024-03-04T06:55:13.114836+0000","last_fullsized":"2024-03-04T06:55:13.114836+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503436,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648083,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142390,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287037,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997743,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885800,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937377,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792730,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:56:23.050 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:23.050 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:23.051 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:23.051 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:23.051 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:23.051 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:23.051 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:23.051 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:23.051 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:23.051 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:23.051 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:56:23.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:23 smithi137 ceph-mon[88869]: from='client.44468 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:56:23.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:23 smithi137 ceph-mon[91314]: from='client.44468 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:56:23.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:23 smithi203 ceph-mon[85573]: from='client.44468 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:56:24.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:24 smithi137 ceph-mon[88869]: pgmap v956: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:24.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:56:24.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:24 smithi137 ceph-mon[91314]: pgmap v956: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:24.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:56:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:24 smithi203 ceph-mon[85573]: pgmap v956: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:56:25.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:56:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:56:25] "GET /metrics HTTP/1.1" 200 36337 "" "Prometheus/2.43.0" 2024-03-04T06:56:26.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:26 smithi137 ceph-mon[88869]: pgmap v957: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:26.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:26 smithi137 ceph-mon[91314]: pgmap v957: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:26.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:26 smithi203 ceph-mon[85573]: pgmap v957: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:28.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:28 smithi137 ceph-mon[88869]: pgmap v958: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:28.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:28 smithi137 ceph-mon[91314]: pgmap v958: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:28.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:28 smithi203 ceph-mon[85573]: pgmap v958: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:30.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:30 smithi137 ceph-mon[88869]: pgmap v959: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:30.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:30 smithi137 ceph-mon[91314]: pgmap v959: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:30.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:30 smithi203 ceph-mon[85573]: pgmap v959: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:32.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:32 smithi137 ceph-mon[88869]: pgmap v960: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:32 smithi137 ceph-mon[91314]: pgmap v960: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:32.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:32 smithi203 ceph-mon[85573]: pgmap v960: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:33.052 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:56:33.270 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:56:34.423 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:34 smithi137 ceph-mon[88869]: pgmap v961: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:34.423 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:34 smithi137 ceph-mon[91314]: pgmap v961: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:34.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:34 smithi203 ceph-mon[85573]: pgmap v961: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:35.133 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:56:35.135 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:56:35.620 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:56:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:56:35] "GET /metrics HTTP/1.1" 200 36337 "" "Prometheus/2.43.0" 2024-03-04T06:56:35.859 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":962,"stamp":"2024-03-04T06:56:34.482242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003694"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103340+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103340+0000","last_peered":"2024-03-04T06:55:13.103340+0000","last_clean":"2024-03-04T06:55:13.103340+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103340+0000","last_undegraded":"2024-03-04T06:55:13.103340+0000","last_fullsized":"2024-03-04T06:55:13.103340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116955+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.116955+0000","last_peered":"2024-03-04T06:55:13.116955+0000","last_clean":"2024-03-04T06:55:13.116955+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.116955+0000","last_undegraded":"2024-03-04T06:55:13.116955+0000","last_fullsized":"2024-03-04T06:55:13.116955+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115416+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115416+0000","last_peered":"2024-03-04T06:55:13.115416+0000","last_clean":"2024-03-04T06:55:13.115416+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115416+0000","last_undegraded":"2024-03-04T06:55:13.115416+0000","last_fullsized":"2024-03-04T06:55:13.115416+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106086+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106086+0000","last_peered":"2024-03-04T06:55:13.106086+0000","last_clean":"2024-03-04T06:55:13.106086+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106086+0000","last_undegraded":"2024-03-04T06:55:13.106086+0000","last_fullsized":"2024-03-04T06:55:13.106086+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101948+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.101948+0000","last_peered":"2024-03-04T06:55:13.101948+0000","last_clean":"2024-03-04T06:55:13.101948+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.101948+0000","last_undegraded":"2024-03-04T06:55:13.101948+0000","last_fullsized":"2024-03-04T06:55:13.101948+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106089+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106089+0000","last_peered":"2024-03-04T06:55:13.106089+0000","last_clean":"2024-03-04T06:55:13.106089+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106089+0000","last_undegraded":"2024-03-04T06:55:13.106089+0000","last_fullsized":"2024-03-04T06:55:13.106089+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101755+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101755+0000","last_peered":"2024-03-04T06:55:13.101755+0000","last_clean":"2024-03-04T06:55:13.101755+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101755+0000","last_undegraded":"2024-03-04T06:55:13.101755+0000","last_fullsized":"2024-03-04T06:55:13.101755+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097051+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:13.097051+0000","last_peered":"2024-03-04T06:55:13.097051+0000","last_clean":"2024-03-04T06:55:13.097051+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:13.097051+0000","last_undegraded":"2024-03-04T06:55:13.097051+0000","last_fullsized":"2024-03-04T06:55:13.097051+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1063,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102987+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.102987+0000","last_peered":"2024-03-04T06:55:13.102987+0000","last_clean":"2024-03-04T06:55:13.102987+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.102987+0000","last_undegraded":"2024-03-04T06:55:13.102987+0000","last_fullsized":"2024-03-04T06:55:13.102987+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114958+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.114958+0000","last_peered":"2024-03-04T06:55:13.114958+0000","last_clean":"2024-03-04T06:55:13.114958+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.114958+0000","last_undegraded":"2024-03-04T06:55:13.114958+0000","last_fullsized":"2024-03-04T06:55:13.114958+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114806+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114806+0000","last_peered":"2024-03-04T06:55:13.114806+0000","last_clean":"2024-03-04T06:55:13.114806+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114806+0000","last_undegraded":"2024-03-04T06:55:13.114806+0000","last_fullsized":"2024-03-04T06:55:13.114806+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1154,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095971+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:13.095971+0000","last_peered":"2024-03-04T06:55:13.095971+0000","last_clean":"2024-03-04T06:55:13.095971+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:13.095971+0000","last_undegraded":"2024-03-04T06:55:13.095971+0000","last_fullsized":"2024-03-04T06:55:13.095971+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1198,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098969+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.098969+0000","last_peered":"2024-03-04T06:55:13.098969+0000","last_clean":"2024-03-04T06:55:13.098969+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.098969+0000","last_undegraded":"2024-03-04T06:55:13.098969+0000","last_fullsized":"2024-03-04T06:55:13.098969+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115324+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:13.115324+0000","last_peered":"2024-03-04T06:55:13.115324+0000","last_clean":"2024-03-04T06:55:13.115324+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:13.115324+0000","last_undegraded":"2024-03-04T06:55:13.115324+0000","last_fullsized":"2024-03-04T06:55:13.115324+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115730+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115730+0000","last_peered":"2024-03-04T06:55:13.115730+0000","last_clean":"2024-03-04T06:55:13.115730+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115730+0000","last_undegraded":"2024-03-04T06:55:13.115730+0000","last_fullsized":"2024-03-04T06:55:13.115730+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104995+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104995+0000","last_peered":"2024-03-04T06:55:13.104995+0000","last_clean":"2024-03-04T06:55:13.104995+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104995+0000","last_undegraded":"2024-03-04T06:55:13.104995+0000","last_fullsized":"2024-03-04T06:55:13.104995+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.107002+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.107002+0000","last_peered":"2024-03-04T06:55:13.107002+0000","last_clean":"2024-03-04T06:55:13.107002+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.107002+0000","last_undegraded":"2024-03-04T06:55:13.107002+0000","last_fullsized":"2024-03-04T06:55:13.107002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096941+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096941+0000","last_peered":"2024-03-04T06:55:13.096941+0000","last_clean":"2024-03-04T06:55:13.096941+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096941+0000","last_undegraded":"2024-03-04T06:55:13.096941+0000","last_fullsized":"2024-03-04T06:55:13.096941+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102246+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102246+0000","last_peered":"2024-03-04T06:55:13.102246+0000","last_clean":"2024-03-04T06:55:13.102246+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102246+0000","last_undegraded":"2024-03-04T06:55:13.102246+0000","last_fullsized":"2024-03-04T06:55:13.102246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116614+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116614+0000","last_peered":"2024-03-04T06:55:13.116614+0000","last_clean":"2024-03-04T06:55:13.116614+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116614+0000","last_undegraded":"2024-03-04T06:55:13.116614+0000","last_fullsized":"2024-03-04T06:55:13.116614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097609+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:13.097609+0000","last_peered":"2024-03-04T06:55:13.097609+0000","last_clean":"2024-03-04T06:55:13.097609+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:13.097609+0000","last_undegraded":"2024-03-04T06:55:13.097609+0000","last_fullsized":"2024-03-04T06:55:13.097609+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097848+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:13.097848+0000","last_peered":"2024-03-04T06:55:13.097848+0000","last_clean":"2024-03-04T06:55:13.097848+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:13.097848+0000","last_undegraded":"2024-03-04T06:55:13.097848+0000","last_fullsized":"2024-03-04T06:55:13.097848+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116801+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.116801+0000","last_peered":"2024-03-04T06:55:13.116801+0000","last_clean":"2024-03-04T06:55:13.116801+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.116801+0000","last_undegraded":"2024-03-04T06:55:13.116801+0000","last_fullsized":"2024-03-04T06:55:13.116801+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1233,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098515+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098515+0000","last_peered":"2024-03-04T06:55:13.098515+0000","last_clean":"2024-03-04T06:55:13.098515+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098515+0000","last_undegraded":"2024-03-04T06:55:13.098515+0000","last_fullsized":"2024-03-04T06:55:13.098515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1220,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097456+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097456+0000","last_peered":"2024-03-04T06:55:13.097456+0000","last_clean":"2024-03-04T06:55:13.097456+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097456+0000","last_undegraded":"2024-03-04T06:55:13.097456+0000","last_fullsized":"2024-03-04T06:55:13.097456+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1068,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102398+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102398+0000","last_peered":"2024-03-04T06:55:13.102398+0000","last_clean":"2024-03-04T06:55:13.102398+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102398+0000","last_undegraded":"2024-03-04T06:55:13.102398+0000","last_fullsized":"2024-03-04T06:55:13.102398+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106216+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106216+0000","last_peered":"2024-03-04T06:55:13.106216+0000","last_clean":"2024-03-04T06:55:13.106216+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106216+0000","last_undegraded":"2024-03-04T06:55:13.106216+0000","last_fullsized":"2024-03-04T06:55:13.106216+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098905+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:13.098905+0000","last_peered":"2024-03-04T06:55:13.098905+0000","last_clean":"2024-03-04T06:55:13.098905+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:13.098905+0000","last_undegraded":"2024-03-04T06:55:13.098905+0000","last_fullsized":"2024-03-04T06:55:13.098905+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1188,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096052+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.096052+0000","last_peered":"2024-03-04T06:55:13.096052+0000","last_clean":"2024-03-04T06:55:13.096052+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.096052+0000","last_undegraded":"2024-03-04T06:55:13.096052+0000","last_fullsized":"2024-03-04T06:55:13.096052+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114659+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114659+0000","last_peered":"2024-03-04T06:55:13.114659+0000","last_clean":"2024-03-04T06:55:13.114659+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114659+0000","last_undegraded":"2024-03-04T06:55:13.114659+0000","last_fullsized":"2024-03-04T06:55:13.114659+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.118051+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.118051+0000","last_peered":"2024-03-04T06:55:13.118051+0000","last_clean":"2024-03-04T06:55:13.118051+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.118051+0000","last_undegraded":"2024-03-04T06:55:13.118051+0000","last_fullsized":"2024-03-04T06:55:13.118051+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096686+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096686+0000","last_peered":"2024-03-04T06:55:13.096686+0000","last_clean":"2024-03-04T06:55:13.096686+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096686+0000","last_undegraded":"2024-03-04T06:55:13.096686+0000","last_fullsized":"2024-03-04T06:55:13.096686+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097180+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097180+0000","last_peered":"2024-03-04T06:55:13.097180+0000","last_clean":"2024-03-04T06:55:13.097180+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097180+0000","last_undegraded":"2024-03-04T06:55:13.097180+0000","last_fullsized":"2024-03-04T06:55:13.097180+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105593+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105593+0000","last_peered":"2024-03-04T06:55:13.105593+0000","last_clean":"2024-03-04T06:55:13.105593+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105593+0000","last_undegraded":"2024-03-04T06:55:13.105593+0000","last_fullsized":"2024-03-04T06:55:13.105593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115824+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115824+0000","last_peered":"2024-03-04T06:55:13.115824+0000","last_clean":"2024-03-04T06:55:13.115824+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115824+0000","last_undegraded":"2024-03-04T06:55:13.115824+0000","last_fullsized":"2024-03-04T06:55:13.115824+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115093+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115093+0000","last_peered":"2024-03-04T06:55:13.115093+0000","last_clean":"2024-03-04T06:55:13.115093+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115093+0000","last_undegraded":"2024-03-04T06:55:13.115093+0000","last_fullsized":"2024-03-04T06:55:13.115093+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1110,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105468+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105468+0000","last_peered":"2024-03-04T06:55:13.105468+0000","last_clean":"2024-03-04T06:55:13.105468+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105468+0000","last_undegraded":"2024-03-04T06:55:13.105468+0000","last_fullsized":"2024-03-04T06:55:13.105468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105915+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105915+0000","last_peered":"2024-03-04T06:55:13.105915+0000","last_clean":"2024-03-04T06:55:13.105915+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105915+0000","last_undegraded":"2024-03-04T06:55:13.105915+0000","last_fullsized":"2024-03-04T06:55:13.105915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116155+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116155+0000","last_peered":"2024-03-04T06:55:13.116155+0000","last_clean":"2024-03-04T06:55:13.116155+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116155+0000","last_undegraded":"2024-03-04T06:55:13.116155+0000","last_fullsized":"2024-03-04T06:55:13.116155+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116083+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116083+0000","last_peered":"2024-03-04T06:55:13.116083+0000","last_clean":"2024-03-04T06:55:13.116083+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116083+0000","last_undegraded":"2024-03-04T06:55:13.116083+0000","last_fullsized":"2024-03-04T06:55:13.116083+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096448+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:13.096448+0000","last_peered":"2024-03-04T06:55:13.096448+0000","last_clean":"2024-03-04T06:55:13.096448+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:13.096448+0000","last_undegraded":"2024-03-04T06:55:13.096448+0000","last_fullsized":"2024-03-04T06:55:13.096448+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114988+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114988+0000","last_peered":"2024-03-04T06:55:13.114988+0000","last_clean":"2024-03-04T06:55:13.114988+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114988+0000","last_undegraded":"2024-03-04T06:55:13.114988+0000","last_fullsized":"2024-03-04T06:55:13.114988+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102608+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102608+0000","last_peered":"2024-03-04T06:55:13.102608+0000","last_clean":"2024-03-04T06:55:13.102608+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102608+0000","last_undegraded":"2024-03-04T06:55:13.102608+0000","last_fullsized":"2024-03-04T06:55:13.102608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117741+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:13.117741+0000","last_peered":"2024-03-04T06:55:13.117741+0000","last_clean":"2024-03-04T06:55:13.117741+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:13.117741+0000","last_undegraded":"2024-03-04T06:55:13.117741+0000","last_fullsized":"2024-03-04T06:55:13.117741+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098537+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098537+0000","last_peered":"2024-03-04T06:55:13.098537+0000","last_clean":"2024-03-04T06:55:13.098537+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098537+0000","last_undegraded":"2024-03-04T06:55:13.098537+0000","last_fullsized":"2024-03-04T06:55:13.098537+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105922+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105922+0000","last_peered":"2024-03-04T06:55:13.105922+0000","last_clean":"2024-03-04T06:55:13.105922+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105922+0000","last_undegraded":"2024-03-04T06:55:13.105922+0000","last_fullsized":"2024-03-04T06:55:13.105922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102507+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102507+0000","last_peered":"2024-03-04T06:55:13.102507+0000","last_clean":"2024-03-04T06:55:13.102507+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102507+0000","last_undegraded":"2024-03-04T06:55:13.102507+0000","last_fullsized":"2024-03-04T06:55:13.102507+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114471+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114471+0000","last_peered":"2024-03-04T06:55:13.114471+0000","last_clean":"2024-03-04T06:55:13.114471+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114471+0000","last_undegraded":"2024-03-04T06:55:13.114471+0000","last_fullsized":"2024-03-04T06:55:13.114471+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114484+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114484+0000","last_peered":"2024-03-04T06:55:13.114484+0000","last_clean":"2024-03-04T06:55:13.114484+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114484+0000","last_undegraded":"2024-03-04T06:55:13.114484+0000","last_fullsized":"2024-03-04T06:55:13.114484+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1252,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101772+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101772+0000","last_peered":"2024-03-04T06:55:13.101772+0000","last_clean":"2024-03-04T06:55:13.101772+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101772+0000","last_undegraded":"2024-03-04T06:55:13.101772+0000","last_fullsized":"2024-03-04T06:55:13.101772+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3576,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096470+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:13.096470+0000","last_peered":"2024-03-04T06:55:13.096470+0000","last_clean":"2024-03-04T06:55:13.096470+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:13.096470+0000","last_undegraded":"2024-03-04T06:55:13.096470+0000","last_fullsized":"2024-03-04T06:55:13.096470+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096934+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096934+0000","last_peered":"2024-03-04T06:55:13.096934+0000","last_clean":"2024-03-04T06:55:13.096934+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096934+0000","last_undegraded":"2024-03-04T06:55:13.096934+0000","last_fullsized":"2024-03-04T06:55:13.096934+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102885+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102885+0000","last_peered":"2024-03-04T06:55:13.102885+0000","last_clean":"2024-03-04T06:55:13.102885+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102885+0000","last_undegraded":"2024-03-04T06:55:13.102885+0000","last_fullsized":"2024-03-04T06:55:13.102885+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17115,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117976+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117976+0000","last_peered":"2024-03-04T06:55:13.117976+0000","last_clean":"2024-03-04T06:55:13.117976+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117976+0000","last_undegraded":"2024-03-04T06:55:13.117976+0000","last_fullsized":"2024-03-04T06:55:13.117976+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115048+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115048+0000","last_peered":"2024-03-04T06:55:13.115048+0000","last_clean":"2024-03-04T06:55:13.115048+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115048+0000","last_undegraded":"2024-03-04T06:55:13.115048+0000","last_fullsized":"2024-03-04T06:55:13.115048+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116658+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116658+0000","last_peered":"2024-03-04T06:55:13.116658+0000","last_clean":"2024-03-04T06:55:13.116658+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116658+0000","last_undegraded":"2024-03-04T06:55:13.116658+0000","last_fullsized":"2024-03-04T06:55:13.116658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105904+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.105904+0000","last_peered":"2024-03-04T06:55:13.105904+0000","last_clean":"2024-03-04T06:55:13.105904+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.105904+0000","last_undegraded":"2024-03-04T06:55:13.105904+0000","last_fullsized":"2024-03-04T06:55:13.105904+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4385,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117010+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.117010+0000","last_peered":"2024-03-04T06:55:13.117010+0000","last_clean":"2024-03-04T06:55:13.117010+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.117010+0000","last_undegraded":"2024-03-04T06:55:13.117010+0000","last_fullsized":"2024-03-04T06:55:13.117010+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115924+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115924+0000","last_peered":"2024-03-04T06:55:13.115924+0000","last_clean":"2024-03-04T06:55:13.115924+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115924+0000","last_undegraded":"2024-03-04T06:55:13.115924+0000","last_fullsized":"2024-03-04T06:55:13.115924+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105684+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105684+0000","last_peered":"2024-03-04T06:55:13.105684+0000","last_clean":"2024-03-04T06:55:13.105684+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105684+0000","last_undegraded":"2024-03-04T06:55:13.105684+0000","last_fullsized":"2024-03-04T06:55:13.105684+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096227+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096227+0000","last_peered":"2024-03-04T06:55:13.096227+0000","last_clean":"2024-03-04T06:55:13.096227+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096227+0000","last_undegraded":"2024-03-04T06:55:13.096227+0000","last_fullsized":"2024-03-04T06:55:13.096227+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5638,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097306+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:13.097306+0000","last_peered":"2024-03-04T06:55:13.097306+0000","last_clean":"2024-03-04T06:55:13.097306+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:13.097306+0000","last_undegraded":"2024-03-04T06:55:13.097306+0000","last_fullsized":"2024-03-04T06:55:13.097306+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116182+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.116182+0000","last_peered":"2024-03-04T06:55:13.116182+0000","last_clean":"2024-03-04T06:55:13.116182+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.116182+0000","last_undegraded":"2024-03-04T06:55:13.116182+0000","last_fullsized":"2024-03-04T06:55:13.116182+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114171+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114171+0000","last_peered":"2024-03-04T06:55:13.114171+0000","last_clean":"2024-03-04T06:55:13.114171+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114171+0000","last_undegraded":"2024-03-04T06:55:13.114171+0000","last_fullsized":"2024-03-04T06:55:13.114171+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096536+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:13.096536+0000","last_peered":"2024-03-04T06:55:13.096536+0000","last_clean":"2024-03-04T06:55:13.096536+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:13.096536+0000","last_undegraded":"2024-03-04T06:55:13.096536+0000","last_fullsized":"2024-03-04T06:55:13.096536+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4014,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107389+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.107389+0000","last_peered":"2024-03-04T06:55:13.107389+0000","last_clean":"2024-03-04T06:55:13.107389+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.107389+0000","last_undegraded":"2024-03-04T06:55:13.107389+0000","last_fullsized":"2024-03-04T06:55:13.107389+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1090,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115070+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:13.115070+0000","last_peered":"2024-03-04T06:55:13.115070+0000","last_clean":"2024-03-04T06:55:13.115070+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:13.115070+0000","last_undegraded":"2024-03-04T06:55:13.115070+0000","last_fullsized":"2024-03-04T06:55:13.115070+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098424+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098424+0000","last_peered":"2024-03-04T06:55:13.098424+0000","last_clean":"2024-03-04T06:55:13.098424+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098424+0000","last_undegraded":"2024-03-04T06:55:13.098424+0000","last_fullsized":"2024-03-04T06:55:13.098424+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105176+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105176+0000","last_peered":"2024-03-04T06:55:13.105176+0000","last_clean":"2024-03-04T06:55:13.105176+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105176+0000","last_undegraded":"2024-03-04T06:55:13.105176+0000","last_fullsized":"2024-03-04T06:55:13.105176+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1549,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101736+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101736+0000","last_peered":"2024-03-04T06:55:13.101736+0000","last_clean":"2024-03-04T06:55:13.101736+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101736+0000","last_undegraded":"2024-03-04T06:55:13.101736+0000","last_fullsized":"2024-03-04T06:55:13.101736+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3949,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.128010+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:13.128010+0000","last_peered":"2024-03-04T06:55:13.128010+0000","last_clean":"2024-03-04T06:55:13.128010+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:13.128010+0000","last_undegraded":"2024-03-04T06:55:13.128010+0000","last_fullsized":"2024-03-04T06:55:13.128010+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117334+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117334+0000","last_peered":"2024-03-04T06:55:13.117334+0000","last_clean":"2024-03-04T06:55:13.117334+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117334+0000","last_undegraded":"2024-03-04T06:55:13.117334+0000","last_fullsized":"2024-03-04T06:55:13.117334+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096315+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:13.096315+0000","last_peered":"2024-03-04T06:55:13.096315+0000","last_clean":"2024-03-04T06:55:13.096315+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:13.096315+0000","last_undegraded":"2024-03-04T06:55:13.096315+0000","last_fullsized":"2024-03-04T06:55:13.096315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101691+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101691+0000","last_peered":"2024-03-04T06:55:13.101691+0000","last_clean":"2024-03-04T06:55:13.101691+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101691+0000","last_undegraded":"2024-03-04T06:55:13.101691+0000","last_fullsized":"2024-03-04T06:55:13.101691+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15290,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.174192+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:13.174192+0000","last_peered":"2024-03-04T06:55:13.174192+0000","last_clean":"2024-03-04T06:55:13.174192+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:13.174192+0000","last_undegraded":"2024-03-04T06:55:13.174192+0000","last_fullsized":"2024-03-04T06:55:13.174192+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117527+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117527+0000","last_peered":"2024-03-04T06:55:13.117527+0000","last_clean":"2024-03-04T06:55:13.117527+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117527+0000","last_undegraded":"2024-03-04T06:55:13.117527+0000","last_fullsized":"2024-03-04T06:55:13.117527+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102583+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102583+0000","last_peered":"2024-03-04T06:55:13.102583+0000","last_clean":"2024-03-04T06:55:13.102583+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102583+0000","last_undegraded":"2024-03-04T06:55:13.102583+0000","last_fullsized":"2024-03-04T06:55:13.102583+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116017+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116017+0000","last_peered":"2024-03-04T06:55:13.116017+0000","last_clean":"2024-03-04T06:55:13.116017+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116017+0000","last_undegraded":"2024-03-04T06:55:13.116017+0000","last_fullsized":"2024-03-04T06:55:13.116017+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4377,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097266+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097266+0000","last_peered":"2024-03-04T06:55:13.097266+0000","last_clean":"2024-03-04T06:55:13.097266+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097266+0000","last_undegraded":"2024-03-04T06:55:13.097266+0000","last_fullsized":"2024-03-04T06:55:13.097266+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097599+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:13.097599+0000","last_peered":"2024-03-04T06:55:13.097599+0000","last_clean":"2024-03-04T06:55:13.097599+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:13.097599+0000","last_undegraded":"2024-03-04T06:55:13.097599+0000","last_fullsized":"2024-03-04T06:55:13.097599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117221+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.117221+0000","last_peered":"2024-03-04T06:55:13.117221+0000","last_clean":"2024-03-04T06:55:13.117221+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.117221+0000","last_undegraded":"2024-03-04T06:55:13.117221+0000","last_fullsized":"2024-03-04T06:55:13.117221+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097249+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097249+0000","last_peered":"2024-03-04T06:55:13.097249+0000","last_clean":"2024-03-04T06:55:13.097249+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097249+0000","last_undegraded":"2024-03-04T06:55:13.097249+0000","last_fullsized":"2024-03-04T06:55:13.097249+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4608,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.311904+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:13.311904+0000","last_peered":"2024-03-04T06:55:13.311904+0000","last_clean":"2024-03-04T06:55:13.311904+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:13.311904+0000","last_undegraded":"2024-03-04T06:55:13.311904+0000","last_fullsized":"2024-03-04T06:55:13.311904+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095643+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095643+0000","last_peered":"2024-03-04T06:55:13.095643+0000","last_clean":"2024-03-04T06:55:13.095643+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095643+0000","last_undegraded":"2024-03-04T06:55:13.095643+0000","last_fullsized":"2024-03-04T06:55:13.095643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1077,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115185+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115185+0000","last_peered":"2024-03-04T06:55:13.115185+0000","last_clean":"2024-03-04T06:55:13.115185+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115185+0000","last_undegraded":"2024-03-04T06:55:13.115185+0000","last_fullsized":"2024-03-04T06:55:13.115185+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115325+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115325+0000","last_peered":"2024-03-04T06:55:13.115325+0000","last_clean":"2024-03-04T06:55:13.115325+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115325+0000","last_undegraded":"2024-03-04T06:55:13.115325+0000","last_fullsized":"2024-03-04T06:55:13.115325+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4633,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107390+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:13.107390+0000","last_peered":"2024-03-04T06:55:13.107390+0000","last_clean":"2024-03-04T06:55:13.107390+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:13.107390+0000","last_undegraded":"2024-03-04T06:55:13.107390+0000","last_fullsized":"2024-03-04T06:55:13.107390+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1055,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101919+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101919+0000","last_peered":"2024-03-04T06:55:13.101919+0000","last_clean":"2024-03-04T06:55:13.101919+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101919+0000","last_undegraded":"2024-03-04T06:55:13.101919+0000","last_fullsized":"2024-03-04T06:55:13.101919+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1183,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095626+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095626+0000","last_peered":"2024-03-04T06:55:13.095626+0000","last_clean":"2024-03-04T06:55:13.095626+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095626+0000","last_undegraded":"2024-03-04T06:55:13.095626+0000","last_fullsized":"2024-03-04T06:55:13.095626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5156,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.111062+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.111062+0000","last_peered":"2024-03-04T06:55:13.111062+0000","last_clean":"2024-03-04T06:55:13.111062+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.111062+0000","last_undegraded":"2024-03-04T06:55:13.111062+0000","last_fullsized":"2024-03-04T06:55:13.111062+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116686+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.116686+0000","last_peered":"2024-03-04T06:55:13.116686+0000","last_clean":"2024-03-04T06:55:13.116686+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.116686+0000","last_undegraded":"2024-03-04T06:55:13.116686+0000","last_fullsized":"2024-03-04T06:55:13.116686+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097821+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097821+0000","last_peered":"2024-03-04T06:55:13.097821+0000","last_clean":"2024-03-04T06:55:13.097821+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097821+0000","last_undegraded":"2024-03-04T06:55:13.097821+0000","last_fullsized":"2024-03-04T06:55:13.097821+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4718,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.169321+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.169321+0000","last_peered":"2024-03-04T06:55:13.169321+0000","last_clean":"2024-03-04T06:55:13.169321+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.169321+0000","last_undegraded":"2024-03-04T06:55:13.169321+0000","last_fullsized":"2024-03-04T06:55:13.169321+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114842+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.114842+0000","last_peered":"2024-03-04T06:55:13.114842+0000","last_clean":"2024-03-04T06:55:13.114842+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.114842+0000","last_undegraded":"2024-03-04T06:55:13.114842+0000","last_fullsized":"2024-03-04T06:55:13.114842+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098787+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098787+0000","last_peered":"2024-03-04T06:55:13.098787+0000","last_clean":"2024-03-04T06:55:13.098787+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098787+0000","last_undegraded":"2024-03-04T06:55:13.098787+0000","last_fullsized":"2024-03-04T06:55:13.098787+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5553,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117009+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:13.117009+0000","last_peered":"2024-03-04T06:55:13.117009+0000","last_clean":"2024-03-04T06:55:13.117009+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:13.117009+0000","last_undegraded":"2024-03-04T06:55:13.117009+0000","last_fullsized":"2024-03-04T06:55:13.117009+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102342+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102342+0000","last_peered":"2024-03-04T06:55:13.102342+0000","last_clean":"2024-03-04T06:55:13.102342+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102342+0000","last_undegraded":"2024-03-04T06:55:13.102342+0000","last_fullsized":"2024-03-04T06:55:13.102342+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114691+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114691+0000","last_peered":"2024-03-04T06:55:13.114691+0000","last_clean":"2024-03-04T06:55:13.114691+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114691+0000","last_undegraded":"2024-03-04T06:55:13.114691+0000","last_fullsized":"2024-03-04T06:55:13.114691+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096824+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096824+0000","last_peered":"2024-03-04T06:55:13.096824+0000","last_clean":"2024-03-04T06:55:13.096824+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096824+0000","last_undegraded":"2024-03-04T06:55:13.096824+0000","last_fullsized":"2024-03-04T06:55:13.096824+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097239+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097239+0000","last_peered":"2024-03-04T06:55:13.097239+0000","last_clean":"2024-03-04T06:55:13.097239+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097239+0000","last_undegraded":"2024-03-04T06:55:13.097239+0000","last_fullsized":"2024-03-04T06:55:13.097239+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102416+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102416+0000","last_peered":"2024-03-04T06:55:13.102416+0000","last_clean":"2024-03-04T06:55:13.102416+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102416+0000","last_undegraded":"2024-03-04T06:55:13.102416+0000","last_fullsized":"2024-03-04T06:55:13.102416+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4365,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.315099+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:13.315099+0000","last_peered":"2024-03-04T06:55:13.315099+0000","last_clean":"2024-03-04T06:55:13.315099+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:13.315099+0000","last_undegraded":"2024-03-04T06:55:13.315099+0000","last_fullsized":"2024-03-04T06:55:13.315099+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115541+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:13.115541+0000","last_peered":"2024-03-04T06:55:13.115541+0000","last_clean":"2024-03-04T06:55:13.115541+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:13.115541+0000","last_undegraded":"2024-03-04T06:55:13.115541+0000","last_fullsized":"2024-03-04T06:55:13.115541+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105888+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:13.105888+0000","last_peered":"2024-03-04T06:55:13.105888+0000","last_clean":"2024-03-04T06:55:13.105888+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:13.105888+0000","last_undegraded":"2024-03-04T06:55:13.105888+0000","last_fullsized":"2024-03-04T06:55:13.105888+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4598,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.321650+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.321650+0000","last_peered":"2024-03-04T06:55:13.321650+0000","last_clean":"2024-03-04T06:55:13.321650+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.321650+0000","last_undegraded":"2024-03-04T06:55:13.321650+0000","last_fullsized":"2024-03-04T06:55:13.321650+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097504+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097504+0000","last_peered":"2024-03-04T06:55:13.097504+0000","last_clean":"2024-03-04T06:55:13.097504+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097504+0000","last_undegraded":"2024-03-04T06:55:13.097504+0000","last_fullsized":"2024-03-04T06:55:13.097504+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104831+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.104831+0000","last_peered":"2024-03-04T06:55:13.104831+0000","last_clean":"2024-03-04T06:55:13.104831+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.104831+0000","last_undegraded":"2024-03-04T06:55:13.104831+0000","last_fullsized":"2024-03-04T06:55:13.104831+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114524+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:13.114524+0000","last_peered":"2024-03-04T06:55:13.114524+0000","last_clean":"2024-03-04T06:55:13.114524+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:13.114524+0000","last_undegraded":"2024-03-04T06:55:13.114524+0000","last_fullsized":"2024-03-04T06:55:13.114524+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096648+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:13.096648+0000","last_peered":"2024-03-04T06:55:13.096648+0000","last_clean":"2024-03-04T06:55:13.096648+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:13.096648+0000","last_undegraded":"2024-03-04T06:55:13.096648+0000","last_fullsized":"2024-03-04T06:55:13.096648+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105999+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.105999+0000","last_peered":"2024-03-04T06:55:13.105999+0000","last_clean":"2024-03-04T06:55:13.105999+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.105999+0000","last_undegraded":"2024-03-04T06:55:13.105999+0000","last_fullsized":"2024-03-04T06:55:13.105999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117390+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117390+0000","last_peered":"2024-03-04T06:55:13.117390+0000","last_clean":"2024-03-04T06:55:13.117390+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117390+0000","last_undegraded":"2024-03-04T06:55:13.117390+0000","last_fullsized":"2024-03-04T06:55:13.117390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096810+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096810+0000","last_peered":"2024-03-04T06:55:13.096810+0000","last_clean":"2024-03-04T06:55:13.096810+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096810+0000","last_undegraded":"2024-03-04T06:55:13.096810+0000","last_fullsized":"2024-03-04T06:55:13.096810+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115428+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.115428+0000","last_peered":"2024-03-04T06:55:13.115428+0000","last_clean":"2024-03-04T06:55:13.115428+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.115428+0000","last_undegraded":"2024-03-04T06:55:13.115428+0000","last_fullsized":"2024-03-04T06:55:13.115428+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115286+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115286+0000","last_peered":"2024-03-04T06:55:13.115286+0000","last_clean":"2024-03-04T06:55:13.115286+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115286+0000","last_undegraded":"2024-03-04T06:55:13.115286+0000","last_fullsized":"2024-03-04T06:55:13.115286+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097481+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097481+0000","last_peered":"2024-03-04T06:55:13.097481+0000","last_clean":"2024-03-04T06:55:13.097481+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097481+0000","last_undegraded":"2024-03-04T06:55:13.097481+0000","last_fullsized":"2024-03-04T06:55:13.097481+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105275+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:13.105275+0000","last_peered":"2024-03-04T06:55:13.105275+0000","last_clean":"2024-03-04T06:55:13.105275+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:13.105275+0000","last_undegraded":"2024-03-04T06:55:13.105275+0000","last_fullsized":"2024-03-04T06:55:13.105275+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096564+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096564+0000","last_peered":"2024-03-04T06:55:13.096564+0000","last_clean":"2024-03-04T06:55:13.096564+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096564+0000","last_undegraded":"2024-03-04T06:55:13.096564+0000","last_fullsized":"2024-03-04T06:55:13.096564+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105576+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:13.105576+0000","last_peered":"2024-03-04T06:55:13.105576+0000","last_clean":"2024-03-04T06:55:13.105576+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:13.105576+0000","last_undegraded":"2024-03-04T06:55:13.105576+0000","last_fullsized":"2024-03-04T06:55:13.105576+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116864+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116864+0000","last_peered":"2024-03-04T06:55:13.116864+0000","last_clean":"2024-03-04T06:55:13.116864+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116864+0000","last_undegraded":"2024-03-04T06:55:13.116864+0000","last_fullsized":"2024-03-04T06:55:13.116864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114836+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114836+0000","last_peered":"2024-03-04T06:55:13.114836+0000","last_clean":"2024-03-04T06:55:13.114836+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114836+0000","last_undegraded":"2024-03-04T06:55:13.114836+0000","last_fullsized":"2024-03-04T06:55:13.114836+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503438,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648086,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142393,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287040,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997746,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885802,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937380,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792733,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:56:35.863 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:35.864 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:35.864 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:35.864 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:35.864 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:35.864 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:35.864 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:35.864 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:35.864 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:35.864 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:35.864 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:56:36.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:36 smithi137 ceph-mon[91314]: pgmap v962: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:36.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:36 smithi137 ceph-mon[91314]: from='client.44474 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:56:36.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:36 smithi137 ceph-mon[88869]: pgmap v962: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:36.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:36 smithi137 ceph-mon[88869]: from='client.44474 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:56:36.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:36 smithi203 ceph-mon[85573]: pgmap v962: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:36.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:36 smithi203 ceph-mon[85573]: from='client.44474 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:56:38.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:38 smithi137 ceph-mon[88869]: pgmap v963: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:38 smithi137 ceph-mon[91314]: pgmap v963: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:38.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:38 smithi203 ceph-mon[85573]: pgmap v963: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:39.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:56:39.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:56:39.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:56:40.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:40 smithi137 ceph-mon[88869]: pgmap v964: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:40.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:40 smithi137 ceph-mon[91314]: pgmap v964: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:40.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:40 smithi203 ceph-mon[85573]: pgmap v964: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:42.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:42 smithi137 ceph-mon[88869]: pgmap v965: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:42.608 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:42 smithi137 ceph-mon[91314]: pgmap v965: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:42.609 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:42 smithi203 ceph-mon[85573]: pgmap v965: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:44.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:44 smithi137 ceph-mon[88869]: pgmap v966: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:44.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:44 smithi137 ceph-mon[91314]: pgmap v966: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:44.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:44 smithi203 ceph-mon[85573]: pgmap v966: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:45.750 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:56:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:56:45] "GET /metrics HTTP/1.1" 200 36338 "" "Prometheus/2.43.0" 2024-03-04T06:56:45.865 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:56:46.078 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:56:46.453 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:46 smithi137 ceph-mon[88869]: pgmap v967: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:46.453 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:46 smithi137 ceph-mon[91314]: pgmap v967: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:46.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:46 smithi203 ceph-mon[85573]: pgmap v967: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:47.969 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:56:47.976 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:56:48.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:48 smithi137 ceph-mon[91314]: pgmap v968: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:48 smithi137 ceph-mon[88869]: pgmap v968: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:48.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:48 smithi203 ceph-mon[85573]: pgmap v968: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:48.675 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":968,"stamp":"2024-03-04T06:56:46.486631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004389"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103340+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103340+0000","last_peered":"2024-03-04T06:55:13.103340+0000","last_clean":"2024-03-04T06:55:13.103340+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103340+0000","last_undegraded":"2024-03-04T06:55:13.103340+0000","last_fullsized":"2024-03-04T06:55:13.103340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116955+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.116955+0000","last_peered":"2024-03-04T06:55:13.116955+0000","last_clean":"2024-03-04T06:55:13.116955+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.116955+0000","last_undegraded":"2024-03-04T06:55:13.116955+0000","last_fullsized":"2024-03-04T06:55:13.116955+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115416+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115416+0000","last_peered":"2024-03-04T06:55:13.115416+0000","last_clean":"2024-03-04T06:55:13.115416+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115416+0000","last_undegraded":"2024-03-04T06:55:13.115416+0000","last_fullsized":"2024-03-04T06:55:13.115416+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106086+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106086+0000","last_peered":"2024-03-04T06:55:13.106086+0000","last_clean":"2024-03-04T06:55:13.106086+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106086+0000","last_undegraded":"2024-03-04T06:55:13.106086+0000","last_fullsized":"2024-03-04T06:55:13.106086+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101948+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.101948+0000","last_peered":"2024-03-04T06:55:13.101948+0000","last_clean":"2024-03-04T06:55:13.101948+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.101948+0000","last_undegraded":"2024-03-04T06:55:13.101948+0000","last_fullsized":"2024-03-04T06:55:13.101948+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106089+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106089+0000","last_peered":"2024-03-04T06:55:13.106089+0000","last_clean":"2024-03-04T06:55:13.106089+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106089+0000","last_undegraded":"2024-03-04T06:55:13.106089+0000","last_fullsized":"2024-03-04T06:55:13.106089+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101755+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101755+0000","last_peered":"2024-03-04T06:55:13.101755+0000","last_clean":"2024-03-04T06:55:13.101755+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101755+0000","last_undegraded":"2024-03-04T06:55:13.101755+0000","last_fullsized":"2024-03-04T06:55:13.101755+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097051+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:13.097051+0000","last_peered":"2024-03-04T06:55:13.097051+0000","last_clean":"2024-03-04T06:55:13.097051+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:13.097051+0000","last_undegraded":"2024-03-04T06:55:13.097051+0000","last_fullsized":"2024-03-04T06:55:13.097051+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1063,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102987+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.102987+0000","last_peered":"2024-03-04T06:55:13.102987+0000","last_clean":"2024-03-04T06:55:13.102987+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.102987+0000","last_undegraded":"2024-03-04T06:55:13.102987+0000","last_fullsized":"2024-03-04T06:55:13.102987+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115007+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.115007+0000","last_peered":"2024-03-04T06:55:13.115007+0000","last_clean":"2024-03-04T06:55:13.115007+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.115007+0000","last_undegraded":"2024-03-04T06:55:13.115007+0000","last_fullsized":"2024-03-04T06:55:13.115007+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114852+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114852+0000","last_peered":"2024-03-04T06:55:13.114852+0000","last_clean":"2024-03-04T06:55:13.114852+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114852+0000","last_undegraded":"2024-03-04T06:55:13.114852+0000","last_fullsized":"2024-03-04T06:55:13.114852+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1154,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095971+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:13.095971+0000","last_peered":"2024-03-04T06:55:13.095971+0000","last_clean":"2024-03-04T06:55:13.095971+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:13.095971+0000","last_undegraded":"2024-03-04T06:55:13.095971+0000","last_fullsized":"2024-03-04T06:55:13.095971+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1198,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098969+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.098969+0000","last_peered":"2024-03-04T06:55:13.098969+0000","last_clean":"2024-03-04T06:55:13.098969+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.098969+0000","last_undegraded":"2024-03-04T06:55:13.098969+0000","last_fullsized":"2024-03-04T06:55:13.098969+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115324+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:13.115324+0000","last_peered":"2024-03-04T06:55:13.115324+0000","last_clean":"2024-03-04T06:55:13.115324+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:13.115324+0000","last_undegraded":"2024-03-04T06:55:13.115324+0000","last_fullsized":"2024-03-04T06:55:13.115324+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115730+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115730+0000","last_peered":"2024-03-04T06:55:13.115730+0000","last_clean":"2024-03-04T06:55:13.115730+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115730+0000","last_undegraded":"2024-03-04T06:55:13.115730+0000","last_fullsized":"2024-03-04T06:55:13.115730+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104995+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104995+0000","last_peered":"2024-03-04T06:55:13.104995+0000","last_clean":"2024-03-04T06:55:13.104995+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104995+0000","last_undegraded":"2024-03-04T06:55:13.104995+0000","last_fullsized":"2024-03-04T06:55:13.104995+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.107002+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.107002+0000","last_peered":"2024-03-04T06:55:13.107002+0000","last_clean":"2024-03-04T06:55:13.107002+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.107002+0000","last_undegraded":"2024-03-04T06:55:13.107002+0000","last_fullsized":"2024-03-04T06:55:13.107002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096941+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096941+0000","last_peered":"2024-03-04T06:55:13.096941+0000","last_clean":"2024-03-04T06:55:13.096941+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096941+0000","last_undegraded":"2024-03-04T06:55:13.096941+0000","last_fullsized":"2024-03-04T06:55:13.096941+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102246+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102246+0000","last_peered":"2024-03-04T06:55:13.102246+0000","last_clean":"2024-03-04T06:55:13.102246+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102246+0000","last_undegraded":"2024-03-04T06:55:13.102246+0000","last_fullsized":"2024-03-04T06:55:13.102246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116614+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116614+0000","last_peered":"2024-03-04T06:55:13.116614+0000","last_clean":"2024-03-04T06:55:13.116614+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116614+0000","last_undegraded":"2024-03-04T06:55:13.116614+0000","last_fullsized":"2024-03-04T06:55:13.116614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097609+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:13.097609+0000","last_peered":"2024-03-04T06:55:13.097609+0000","last_clean":"2024-03-04T06:55:13.097609+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:13.097609+0000","last_undegraded":"2024-03-04T06:55:13.097609+0000","last_fullsized":"2024-03-04T06:55:13.097609+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097848+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:13.097848+0000","last_peered":"2024-03-04T06:55:13.097848+0000","last_clean":"2024-03-04T06:55:13.097848+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:13.097848+0000","last_undegraded":"2024-03-04T06:55:13.097848+0000","last_fullsized":"2024-03-04T06:55:13.097848+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116801+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.116801+0000","last_peered":"2024-03-04T06:55:13.116801+0000","last_clean":"2024-03-04T06:55:13.116801+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.116801+0000","last_undegraded":"2024-03-04T06:55:13.116801+0000","last_fullsized":"2024-03-04T06:55:13.116801+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1233,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098515+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098515+0000","last_peered":"2024-03-04T06:55:13.098515+0000","last_clean":"2024-03-04T06:55:13.098515+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098515+0000","last_undegraded":"2024-03-04T06:55:13.098515+0000","last_fullsized":"2024-03-04T06:55:13.098515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1220,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097456+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097456+0000","last_peered":"2024-03-04T06:55:13.097456+0000","last_clean":"2024-03-04T06:55:13.097456+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097456+0000","last_undegraded":"2024-03-04T06:55:13.097456+0000","last_fullsized":"2024-03-04T06:55:13.097456+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1068,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102398+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102398+0000","last_peered":"2024-03-04T06:55:13.102398+0000","last_clean":"2024-03-04T06:55:13.102398+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102398+0000","last_undegraded":"2024-03-04T06:55:13.102398+0000","last_fullsized":"2024-03-04T06:55:13.102398+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106216+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106216+0000","last_peered":"2024-03-04T06:55:13.106216+0000","last_clean":"2024-03-04T06:55:13.106216+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106216+0000","last_undegraded":"2024-03-04T06:55:13.106216+0000","last_fullsized":"2024-03-04T06:55:13.106216+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098905+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:13.098905+0000","last_peered":"2024-03-04T06:55:13.098905+0000","last_clean":"2024-03-04T06:55:13.098905+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:13.098905+0000","last_undegraded":"2024-03-04T06:55:13.098905+0000","last_fullsized":"2024-03-04T06:55:13.098905+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1188,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096052+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.096052+0000","last_peered":"2024-03-04T06:55:13.096052+0000","last_clean":"2024-03-04T06:55:13.096052+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.096052+0000","last_undegraded":"2024-03-04T06:55:13.096052+0000","last_fullsized":"2024-03-04T06:55:13.096052+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114659+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114659+0000","last_peered":"2024-03-04T06:55:13.114659+0000","last_clean":"2024-03-04T06:55:13.114659+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114659+0000","last_undegraded":"2024-03-04T06:55:13.114659+0000","last_fullsized":"2024-03-04T06:55:13.114659+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.118051+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.118051+0000","last_peered":"2024-03-04T06:55:13.118051+0000","last_clean":"2024-03-04T06:55:13.118051+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.118051+0000","last_undegraded":"2024-03-04T06:55:13.118051+0000","last_fullsized":"2024-03-04T06:55:13.118051+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096686+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096686+0000","last_peered":"2024-03-04T06:55:13.096686+0000","last_clean":"2024-03-04T06:55:13.096686+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096686+0000","last_undegraded":"2024-03-04T06:55:13.096686+0000","last_fullsized":"2024-03-04T06:55:13.096686+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097180+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097180+0000","last_peered":"2024-03-04T06:55:13.097180+0000","last_clean":"2024-03-04T06:55:13.097180+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097180+0000","last_undegraded":"2024-03-04T06:55:13.097180+0000","last_fullsized":"2024-03-04T06:55:13.097180+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105593+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105593+0000","last_peered":"2024-03-04T06:55:13.105593+0000","last_clean":"2024-03-04T06:55:13.105593+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105593+0000","last_undegraded":"2024-03-04T06:55:13.105593+0000","last_fullsized":"2024-03-04T06:55:13.105593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115824+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115824+0000","last_peered":"2024-03-04T06:55:13.115824+0000","last_clean":"2024-03-04T06:55:13.115824+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115824+0000","last_undegraded":"2024-03-04T06:55:13.115824+0000","last_fullsized":"2024-03-04T06:55:13.115824+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115145+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115145+0000","last_peered":"2024-03-04T06:55:13.115145+0000","last_clean":"2024-03-04T06:55:13.115145+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115145+0000","last_undegraded":"2024-03-04T06:55:13.115145+0000","last_fullsized":"2024-03-04T06:55:13.115145+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1110,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105468+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105468+0000","last_peered":"2024-03-04T06:55:13.105468+0000","last_clean":"2024-03-04T06:55:13.105468+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105468+0000","last_undegraded":"2024-03-04T06:55:13.105468+0000","last_fullsized":"2024-03-04T06:55:13.105468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105915+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105915+0000","last_peered":"2024-03-04T06:55:13.105915+0000","last_clean":"2024-03-04T06:55:13.105915+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105915+0000","last_undegraded":"2024-03-04T06:55:13.105915+0000","last_fullsized":"2024-03-04T06:55:13.105915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116155+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116155+0000","last_peered":"2024-03-04T06:55:13.116155+0000","last_clean":"2024-03-04T06:55:13.116155+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116155+0000","last_undegraded":"2024-03-04T06:55:13.116155+0000","last_fullsized":"2024-03-04T06:55:13.116155+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116083+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116083+0000","last_peered":"2024-03-04T06:55:13.116083+0000","last_clean":"2024-03-04T06:55:13.116083+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116083+0000","last_undegraded":"2024-03-04T06:55:13.116083+0000","last_fullsized":"2024-03-04T06:55:13.116083+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096448+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:13.096448+0000","last_peered":"2024-03-04T06:55:13.096448+0000","last_clean":"2024-03-04T06:55:13.096448+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:13.096448+0000","last_undegraded":"2024-03-04T06:55:13.096448+0000","last_fullsized":"2024-03-04T06:55:13.096448+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114988+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114988+0000","last_peered":"2024-03-04T06:55:13.114988+0000","last_clean":"2024-03-04T06:55:13.114988+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114988+0000","last_undegraded":"2024-03-04T06:55:13.114988+0000","last_fullsized":"2024-03-04T06:55:13.114988+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102608+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102608+0000","last_peered":"2024-03-04T06:55:13.102608+0000","last_clean":"2024-03-04T06:55:13.102608+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102608+0000","last_undegraded":"2024-03-04T06:55:13.102608+0000","last_fullsized":"2024-03-04T06:55:13.102608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117741+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:13.117741+0000","last_peered":"2024-03-04T06:55:13.117741+0000","last_clean":"2024-03-04T06:55:13.117741+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:13.117741+0000","last_undegraded":"2024-03-04T06:55:13.117741+0000","last_fullsized":"2024-03-04T06:55:13.117741+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098537+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098537+0000","last_peered":"2024-03-04T06:55:13.098537+0000","last_clean":"2024-03-04T06:55:13.098537+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098537+0000","last_undegraded":"2024-03-04T06:55:13.098537+0000","last_fullsized":"2024-03-04T06:55:13.098537+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105922+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105922+0000","last_peered":"2024-03-04T06:55:13.105922+0000","last_clean":"2024-03-04T06:55:13.105922+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105922+0000","last_undegraded":"2024-03-04T06:55:13.105922+0000","last_fullsized":"2024-03-04T06:55:13.105922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102507+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102507+0000","last_peered":"2024-03-04T06:55:13.102507+0000","last_clean":"2024-03-04T06:55:13.102507+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102507+0000","last_undegraded":"2024-03-04T06:55:13.102507+0000","last_fullsized":"2024-03-04T06:55:13.102507+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114471+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114471+0000","last_peered":"2024-03-04T06:55:13.114471+0000","last_clean":"2024-03-04T06:55:13.114471+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114471+0000","last_undegraded":"2024-03-04T06:55:13.114471+0000","last_fullsized":"2024-03-04T06:55:13.114471+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114484+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114484+0000","last_peered":"2024-03-04T06:55:13.114484+0000","last_clean":"2024-03-04T06:55:13.114484+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114484+0000","last_undegraded":"2024-03-04T06:55:13.114484+0000","last_fullsized":"2024-03-04T06:55:13.114484+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1252,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101772+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101772+0000","last_peered":"2024-03-04T06:55:13.101772+0000","last_clean":"2024-03-04T06:55:13.101772+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101772+0000","last_undegraded":"2024-03-04T06:55:13.101772+0000","last_fullsized":"2024-03-04T06:55:13.101772+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3576,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096470+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:13.096470+0000","last_peered":"2024-03-04T06:55:13.096470+0000","last_clean":"2024-03-04T06:55:13.096470+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:13.096470+0000","last_undegraded":"2024-03-04T06:55:13.096470+0000","last_fullsized":"2024-03-04T06:55:13.096470+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096934+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096934+0000","last_peered":"2024-03-04T06:55:13.096934+0000","last_clean":"2024-03-04T06:55:13.096934+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096934+0000","last_undegraded":"2024-03-04T06:55:13.096934+0000","last_fullsized":"2024-03-04T06:55:13.096934+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102885+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102885+0000","last_peered":"2024-03-04T06:55:13.102885+0000","last_clean":"2024-03-04T06:55:13.102885+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102885+0000","last_undegraded":"2024-03-04T06:55:13.102885+0000","last_fullsized":"2024-03-04T06:55:13.102885+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17115,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117976+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117976+0000","last_peered":"2024-03-04T06:55:13.117976+0000","last_clean":"2024-03-04T06:55:13.117976+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117976+0000","last_undegraded":"2024-03-04T06:55:13.117976+0000","last_fullsized":"2024-03-04T06:55:13.117976+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115048+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115048+0000","last_peered":"2024-03-04T06:55:13.115048+0000","last_clean":"2024-03-04T06:55:13.115048+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115048+0000","last_undegraded":"2024-03-04T06:55:13.115048+0000","last_fullsized":"2024-03-04T06:55:13.115048+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116658+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116658+0000","last_peered":"2024-03-04T06:55:13.116658+0000","last_clean":"2024-03-04T06:55:13.116658+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116658+0000","last_undegraded":"2024-03-04T06:55:13.116658+0000","last_fullsized":"2024-03-04T06:55:13.116658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105904+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.105904+0000","last_peered":"2024-03-04T06:55:13.105904+0000","last_clean":"2024-03-04T06:55:13.105904+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.105904+0000","last_undegraded":"2024-03-04T06:55:13.105904+0000","last_fullsized":"2024-03-04T06:55:13.105904+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4385,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117010+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.117010+0000","last_peered":"2024-03-04T06:55:13.117010+0000","last_clean":"2024-03-04T06:55:13.117010+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.117010+0000","last_undegraded":"2024-03-04T06:55:13.117010+0000","last_fullsized":"2024-03-04T06:55:13.117010+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115924+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115924+0000","last_peered":"2024-03-04T06:55:13.115924+0000","last_clean":"2024-03-04T06:55:13.115924+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115924+0000","last_undegraded":"2024-03-04T06:55:13.115924+0000","last_fullsized":"2024-03-04T06:55:13.115924+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105684+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105684+0000","last_peered":"2024-03-04T06:55:13.105684+0000","last_clean":"2024-03-04T06:55:13.105684+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105684+0000","last_undegraded":"2024-03-04T06:55:13.105684+0000","last_fullsized":"2024-03-04T06:55:13.105684+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096287+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096287+0000","last_peered":"2024-03-04T06:55:13.096287+0000","last_clean":"2024-03-04T06:55:13.096287+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096287+0000","last_undegraded":"2024-03-04T06:55:13.096287+0000","last_fullsized":"2024-03-04T06:55:13.096287+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5638,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097306+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:13.097306+0000","last_peered":"2024-03-04T06:55:13.097306+0000","last_clean":"2024-03-04T06:55:13.097306+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:13.097306+0000","last_undegraded":"2024-03-04T06:55:13.097306+0000","last_fullsized":"2024-03-04T06:55:13.097306+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116182+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.116182+0000","last_peered":"2024-03-04T06:55:13.116182+0000","last_clean":"2024-03-04T06:55:13.116182+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.116182+0000","last_undegraded":"2024-03-04T06:55:13.116182+0000","last_fullsized":"2024-03-04T06:55:13.116182+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114171+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114171+0000","last_peered":"2024-03-04T06:55:13.114171+0000","last_clean":"2024-03-04T06:55:13.114171+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114171+0000","last_undegraded":"2024-03-04T06:55:13.114171+0000","last_fullsized":"2024-03-04T06:55:13.114171+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096536+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:13.096536+0000","last_peered":"2024-03-04T06:55:13.096536+0000","last_clean":"2024-03-04T06:55:13.096536+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:13.096536+0000","last_undegraded":"2024-03-04T06:55:13.096536+0000","last_fullsized":"2024-03-04T06:55:13.096536+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4014,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107389+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.107389+0000","last_peered":"2024-03-04T06:55:13.107389+0000","last_clean":"2024-03-04T06:55:13.107389+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.107389+0000","last_undegraded":"2024-03-04T06:55:13.107389+0000","last_fullsized":"2024-03-04T06:55:13.107389+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1090,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115070+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:13.115070+0000","last_peered":"2024-03-04T06:55:13.115070+0000","last_clean":"2024-03-04T06:55:13.115070+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:13.115070+0000","last_undegraded":"2024-03-04T06:55:13.115070+0000","last_fullsized":"2024-03-04T06:55:13.115070+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098424+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098424+0000","last_peered":"2024-03-04T06:55:13.098424+0000","last_clean":"2024-03-04T06:55:13.098424+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098424+0000","last_undegraded":"2024-03-04T06:55:13.098424+0000","last_fullsized":"2024-03-04T06:55:13.098424+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105176+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105176+0000","last_peered":"2024-03-04T06:55:13.105176+0000","last_clean":"2024-03-04T06:55:13.105176+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105176+0000","last_undegraded":"2024-03-04T06:55:13.105176+0000","last_fullsized":"2024-03-04T06:55:13.105176+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1549,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101736+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101736+0000","last_peered":"2024-03-04T06:55:13.101736+0000","last_clean":"2024-03-04T06:55:13.101736+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101736+0000","last_undegraded":"2024-03-04T06:55:13.101736+0000","last_fullsized":"2024-03-04T06:55:13.101736+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3949,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.128010+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:13.128010+0000","last_peered":"2024-03-04T06:55:13.128010+0000","last_clean":"2024-03-04T06:55:13.128010+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:13.128010+0000","last_undegraded":"2024-03-04T06:55:13.128010+0000","last_fullsized":"2024-03-04T06:55:13.128010+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117334+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117334+0000","last_peered":"2024-03-04T06:55:13.117334+0000","last_clean":"2024-03-04T06:55:13.117334+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117334+0000","last_undegraded":"2024-03-04T06:55:13.117334+0000","last_fullsized":"2024-03-04T06:55:13.117334+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096315+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:13.096315+0000","last_peered":"2024-03-04T06:55:13.096315+0000","last_clean":"2024-03-04T06:55:13.096315+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:13.096315+0000","last_undegraded":"2024-03-04T06:55:13.096315+0000","last_fullsized":"2024-03-04T06:55:13.096315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101691+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101691+0000","last_peered":"2024-03-04T06:55:13.101691+0000","last_clean":"2024-03-04T06:55:13.101691+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101691+0000","last_undegraded":"2024-03-04T06:55:13.101691+0000","last_fullsized":"2024-03-04T06:55:13.101691+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15290,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.174192+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:13.174192+0000","last_peered":"2024-03-04T06:55:13.174192+0000","last_clean":"2024-03-04T06:55:13.174192+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:13.174192+0000","last_undegraded":"2024-03-04T06:55:13.174192+0000","last_fullsized":"2024-03-04T06:55:13.174192+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117527+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117527+0000","last_peered":"2024-03-04T06:55:13.117527+0000","last_clean":"2024-03-04T06:55:13.117527+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117527+0000","last_undegraded":"2024-03-04T06:55:13.117527+0000","last_fullsized":"2024-03-04T06:55:13.117527+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102583+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102583+0000","last_peered":"2024-03-04T06:55:13.102583+0000","last_clean":"2024-03-04T06:55:13.102583+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102583+0000","last_undegraded":"2024-03-04T06:55:13.102583+0000","last_fullsized":"2024-03-04T06:55:13.102583+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116017+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116017+0000","last_peered":"2024-03-04T06:55:13.116017+0000","last_clean":"2024-03-04T06:55:13.116017+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116017+0000","last_undegraded":"2024-03-04T06:55:13.116017+0000","last_fullsized":"2024-03-04T06:55:13.116017+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4378,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097496+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097496+0000","last_peered":"2024-03-04T06:55:13.097496+0000","last_clean":"2024-03-04T06:55:13.097496+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097496+0000","last_undegraded":"2024-03-04T06:55:13.097496+0000","last_fullsized":"2024-03-04T06:55:13.097496+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097599+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:13.097599+0000","last_peered":"2024-03-04T06:55:13.097599+0000","last_clean":"2024-03-04T06:55:13.097599+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:13.097599+0000","last_undegraded":"2024-03-04T06:55:13.097599+0000","last_fullsized":"2024-03-04T06:55:13.097599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117221+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.117221+0000","last_peered":"2024-03-04T06:55:13.117221+0000","last_clean":"2024-03-04T06:55:13.117221+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.117221+0000","last_undegraded":"2024-03-04T06:55:13.117221+0000","last_fullsized":"2024-03-04T06:55:13.117221+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097249+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097249+0000","last_peered":"2024-03-04T06:55:13.097249+0000","last_clean":"2024-03-04T06:55:13.097249+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097249+0000","last_undegraded":"2024-03-04T06:55:13.097249+0000","last_fullsized":"2024-03-04T06:55:13.097249+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4608,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.311904+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:13.311904+0000","last_peered":"2024-03-04T06:55:13.311904+0000","last_clean":"2024-03-04T06:55:13.311904+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:13.311904+0000","last_undegraded":"2024-03-04T06:55:13.311904+0000","last_fullsized":"2024-03-04T06:55:13.311904+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095704+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095704+0000","last_peered":"2024-03-04T06:55:13.095704+0000","last_clean":"2024-03-04T06:55:13.095704+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095704+0000","last_undegraded":"2024-03-04T06:55:13.095704+0000","last_fullsized":"2024-03-04T06:55:13.095704+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1077,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115185+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115185+0000","last_peered":"2024-03-04T06:55:13.115185+0000","last_clean":"2024-03-04T06:55:13.115185+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115185+0000","last_undegraded":"2024-03-04T06:55:13.115185+0000","last_fullsized":"2024-03-04T06:55:13.115185+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115325+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115325+0000","last_peered":"2024-03-04T06:55:13.115325+0000","last_clean":"2024-03-04T06:55:13.115325+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115325+0000","last_undegraded":"2024-03-04T06:55:13.115325+0000","last_fullsized":"2024-03-04T06:55:13.115325+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4633,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107390+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:13.107390+0000","last_peered":"2024-03-04T06:55:13.107390+0000","last_clean":"2024-03-04T06:55:13.107390+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:13.107390+0000","last_undegraded":"2024-03-04T06:55:13.107390+0000","last_fullsized":"2024-03-04T06:55:13.107390+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101972+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101972+0000","last_peered":"2024-03-04T06:55:13.101972+0000","last_clean":"2024-03-04T06:55:13.101972+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101972+0000","last_undegraded":"2024-03-04T06:55:13.101972+0000","last_fullsized":"2024-03-04T06:55:13.101972+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1183,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095626+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095626+0000","last_peered":"2024-03-04T06:55:13.095626+0000","last_clean":"2024-03-04T06:55:13.095626+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095626+0000","last_undegraded":"2024-03-04T06:55:13.095626+0000","last_fullsized":"2024-03-04T06:55:13.095626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5156,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.111062+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.111062+0000","last_peered":"2024-03-04T06:55:13.111062+0000","last_clean":"2024-03-04T06:55:13.111062+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.111062+0000","last_undegraded":"2024-03-04T06:55:13.111062+0000","last_fullsized":"2024-03-04T06:55:13.111062+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116686+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.116686+0000","last_peered":"2024-03-04T06:55:13.116686+0000","last_clean":"2024-03-04T06:55:13.116686+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.116686+0000","last_undegraded":"2024-03-04T06:55:13.116686+0000","last_fullsized":"2024-03-04T06:55:13.116686+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097821+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097821+0000","last_peered":"2024-03-04T06:55:13.097821+0000","last_clean":"2024-03-04T06:55:13.097821+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097821+0000","last_undegraded":"2024-03-04T06:55:13.097821+0000","last_fullsized":"2024-03-04T06:55:13.097821+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4718,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.169321+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.169321+0000","last_peered":"2024-03-04T06:55:13.169321+0000","last_clean":"2024-03-04T06:55:13.169321+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.169321+0000","last_undegraded":"2024-03-04T06:55:13.169321+0000","last_fullsized":"2024-03-04T06:55:13.169321+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114842+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.114842+0000","last_peered":"2024-03-04T06:55:13.114842+0000","last_clean":"2024-03-04T06:55:13.114842+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.114842+0000","last_undegraded":"2024-03-04T06:55:13.114842+0000","last_fullsized":"2024-03-04T06:55:13.114842+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098839+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098839+0000","last_peered":"2024-03-04T06:55:13.098839+0000","last_clean":"2024-03-04T06:55:13.098839+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098839+0000","last_undegraded":"2024-03-04T06:55:13.098839+0000","last_fullsized":"2024-03-04T06:55:13.098839+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5553,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117009+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:13.117009+0000","last_peered":"2024-03-04T06:55:13.117009+0000","last_clean":"2024-03-04T06:55:13.117009+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:13.117009+0000","last_undegraded":"2024-03-04T06:55:13.117009+0000","last_fullsized":"2024-03-04T06:55:13.117009+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102342+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102342+0000","last_peered":"2024-03-04T06:55:13.102342+0000","last_clean":"2024-03-04T06:55:13.102342+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102342+0000","last_undegraded":"2024-03-04T06:55:13.102342+0000","last_fullsized":"2024-03-04T06:55:13.102342+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114691+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114691+0000","last_peered":"2024-03-04T06:55:13.114691+0000","last_clean":"2024-03-04T06:55:13.114691+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114691+0000","last_undegraded":"2024-03-04T06:55:13.114691+0000","last_fullsized":"2024-03-04T06:55:13.114691+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096824+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096824+0000","last_peered":"2024-03-04T06:55:13.096824+0000","last_clean":"2024-03-04T06:55:13.096824+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096824+0000","last_undegraded":"2024-03-04T06:55:13.096824+0000","last_fullsized":"2024-03-04T06:55:13.096824+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097239+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097239+0000","last_peered":"2024-03-04T06:55:13.097239+0000","last_clean":"2024-03-04T06:55:13.097239+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097239+0000","last_undegraded":"2024-03-04T06:55:13.097239+0000","last_fullsized":"2024-03-04T06:55:13.097239+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102416+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102416+0000","last_peered":"2024-03-04T06:55:13.102416+0000","last_clean":"2024-03-04T06:55:13.102416+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102416+0000","last_undegraded":"2024-03-04T06:55:13.102416+0000","last_fullsized":"2024-03-04T06:55:13.102416+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4365,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.315099+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:13.315099+0000","last_peered":"2024-03-04T06:55:13.315099+0000","last_clean":"2024-03-04T06:55:13.315099+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:13.315099+0000","last_undegraded":"2024-03-04T06:55:13.315099+0000","last_fullsized":"2024-03-04T06:55:13.315099+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115541+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:13.115541+0000","last_peered":"2024-03-04T06:55:13.115541+0000","last_clean":"2024-03-04T06:55:13.115541+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:13.115541+0000","last_undegraded":"2024-03-04T06:55:13.115541+0000","last_fullsized":"2024-03-04T06:55:13.115541+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105888+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:13.105888+0000","last_peered":"2024-03-04T06:55:13.105888+0000","last_clean":"2024-03-04T06:55:13.105888+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:13.105888+0000","last_undegraded":"2024-03-04T06:55:13.105888+0000","last_fullsized":"2024-03-04T06:55:13.105888+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4599,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.322375+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.322375+0000","last_peered":"2024-03-04T06:55:13.322375+0000","last_clean":"2024-03-04T06:55:13.322375+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.322375+0000","last_undegraded":"2024-03-04T06:55:13.322375+0000","last_fullsized":"2024-03-04T06:55:13.322375+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097504+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097504+0000","last_peered":"2024-03-04T06:55:13.097504+0000","last_clean":"2024-03-04T06:55:13.097504+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097504+0000","last_undegraded":"2024-03-04T06:55:13.097504+0000","last_fullsized":"2024-03-04T06:55:13.097504+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104831+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.104831+0000","last_peered":"2024-03-04T06:55:13.104831+0000","last_clean":"2024-03-04T06:55:13.104831+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.104831+0000","last_undegraded":"2024-03-04T06:55:13.104831+0000","last_fullsized":"2024-03-04T06:55:13.104831+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114524+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:13.114524+0000","last_peered":"2024-03-04T06:55:13.114524+0000","last_clean":"2024-03-04T06:55:13.114524+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:13.114524+0000","last_undegraded":"2024-03-04T06:55:13.114524+0000","last_fullsized":"2024-03-04T06:55:13.114524+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096648+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:13.096648+0000","last_peered":"2024-03-04T06:55:13.096648+0000","last_clean":"2024-03-04T06:55:13.096648+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:13.096648+0000","last_undegraded":"2024-03-04T06:55:13.096648+0000","last_fullsized":"2024-03-04T06:55:13.096648+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105999+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.105999+0000","last_peered":"2024-03-04T06:55:13.105999+0000","last_clean":"2024-03-04T06:55:13.105999+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.105999+0000","last_undegraded":"2024-03-04T06:55:13.105999+0000","last_fullsized":"2024-03-04T06:55:13.105999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117390+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117390+0000","last_peered":"2024-03-04T06:55:13.117390+0000","last_clean":"2024-03-04T06:55:13.117390+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117390+0000","last_undegraded":"2024-03-04T06:55:13.117390+0000","last_fullsized":"2024-03-04T06:55:13.117390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096810+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096810+0000","last_peered":"2024-03-04T06:55:13.096810+0000","last_clean":"2024-03-04T06:55:13.096810+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096810+0000","last_undegraded":"2024-03-04T06:55:13.096810+0000","last_fullsized":"2024-03-04T06:55:13.096810+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115428+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.115428+0000","last_peered":"2024-03-04T06:55:13.115428+0000","last_clean":"2024-03-04T06:55:13.115428+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.115428+0000","last_undegraded":"2024-03-04T06:55:13.115428+0000","last_fullsized":"2024-03-04T06:55:13.115428+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115286+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115286+0000","last_peered":"2024-03-04T06:55:13.115286+0000","last_clean":"2024-03-04T06:55:13.115286+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115286+0000","last_undegraded":"2024-03-04T06:55:13.115286+0000","last_fullsized":"2024-03-04T06:55:13.115286+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097481+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097481+0000","last_peered":"2024-03-04T06:55:13.097481+0000","last_clean":"2024-03-04T06:55:13.097481+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097481+0000","last_undegraded":"2024-03-04T06:55:13.097481+0000","last_fullsized":"2024-03-04T06:55:13.097481+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105275+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:13.105275+0000","last_peered":"2024-03-04T06:55:13.105275+0000","last_clean":"2024-03-04T06:55:13.105275+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:13.105275+0000","last_undegraded":"2024-03-04T06:55:13.105275+0000","last_fullsized":"2024-03-04T06:55:13.105275+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105576+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:13.105576+0000","last_peered":"2024-03-04T06:55:13.105576+0000","last_clean":"2024-03-04T06:55:13.105576+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:13.105576+0000","last_undegraded":"2024-03-04T06:55:13.105576+0000","last_fullsized":"2024-03-04T06:55:13.105576+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116864+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116864+0000","last_peered":"2024-03-04T06:55:13.116864+0000","last_clean":"2024-03-04T06:55:13.116864+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116864+0000","last_undegraded":"2024-03-04T06:55:13.116864+0000","last_fullsized":"2024-03-04T06:55:13.116864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114836+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114836+0000","last_peered":"2024-03-04T06:55:13.114836+0000","last_clean":"2024-03-04T06:55:13.114836+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114836+0000","last_undegraded":"2024-03-04T06:55:13.114836+0000","last_fullsized":"2024-03-04T06:55:13.114836+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503441,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648088,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142395,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287042,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997748,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885805,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937382,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792735,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:56:48.680 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:48.680 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:48.680 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:48.680 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:48.680 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:48.681 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:48.681 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:48.681 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:48.681 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:48.681 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:56:48.681 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:56:49.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:49 smithi137 ceph-mon[88869]: from='client.34539 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:56:49.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:49 smithi137 ceph-mon[91314]: from='client.34539 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:56:49.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:49 smithi203 ceph-mon[85573]: from='client.34539 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:56:50.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:50 smithi137 ceph-mon[88869]: pgmap v969: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:50.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:50 smithi137 ceph-mon[91314]: pgmap v969: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:50.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:50 smithi203 ceph-mon[85573]: pgmap v969: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:52.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:52 smithi137 ceph-mon[88869]: pgmap v970: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:52.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:52 smithi137 ceph-mon[91314]: pgmap v970: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:52.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:52 smithi203 ceph-mon[85573]: pgmap v970: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:54.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:54 smithi137 ceph-mon[88869]: pgmap v971: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:54.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:56:54.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:54 smithi137 ceph-mon[91314]: pgmap v971: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:54.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:56:54.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:54 smithi203 ceph-mon[85573]: pgmap v971: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:54.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:56:55.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:56:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:56:55] "GET /metrics HTTP/1.1" 200 36336 "" "Prometheus/2.43.0" 2024-03-04T06:56:56.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:56 smithi137 ceph-mon[88869]: pgmap v972: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:56.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:56 smithi137 ceph-mon[91314]: pgmap v972: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:56.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:56 smithi203 ceph-mon[85573]: pgmap v972: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:58.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:56:58 smithi137 ceph-mon[88869]: pgmap v973: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:58.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:56:58 smithi137 ceph-mon[91314]: pgmap v973: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:58.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:56:58 smithi203 ceph-mon[85573]: pgmap v973: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:56:58.683 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:56:58.901 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:57:00.383 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:00 smithi137 ceph-mon[88869]: pgmap v974: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:00.383 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:00 smithi137 ceph-mon[91314]: pgmap v974: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:00.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:00 smithi203 ceph-mon[85573]: pgmap v974: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:00.818 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:57:00.820 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:57:01.503 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":975,"stamp":"2024-03-04T06:57:00.491166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004054"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103340+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103340+0000","last_peered":"2024-03-04T06:55:13.103340+0000","last_clean":"2024-03-04T06:55:13.103340+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103340+0000","last_undegraded":"2024-03-04T06:55:13.103340+0000","last_fullsized":"2024-03-04T06:55:13.103340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117002+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.117002+0000","last_peered":"2024-03-04T06:55:13.117002+0000","last_clean":"2024-03-04T06:55:13.117002+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.117002+0000","last_undegraded":"2024-03-04T06:55:13.117002+0000","last_fullsized":"2024-03-04T06:55:13.117002+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115416+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115416+0000","last_peered":"2024-03-04T06:55:13.115416+0000","last_clean":"2024-03-04T06:55:13.115416+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115416+0000","last_undegraded":"2024-03-04T06:55:13.115416+0000","last_fullsized":"2024-03-04T06:55:13.115416+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106163+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106163+0000","last_peered":"2024-03-04T06:55:13.106163+0000","last_clean":"2024-03-04T06:55:13.106163+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106163+0000","last_undegraded":"2024-03-04T06:55:13.106163+0000","last_fullsized":"2024-03-04T06:55:13.106163+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101948+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.101948+0000","last_peered":"2024-03-04T06:55:13.101948+0000","last_clean":"2024-03-04T06:55:13.101948+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.101948+0000","last_undegraded":"2024-03-04T06:55:13.101948+0000","last_fullsized":"2024-03-04T06:55:13.101948+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106089+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106089+0000","last_peered":"2024-03-04T06:55:13.106089+0000","last_clean":"2024-03-04T06:55:13.106089+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106089+0000","last_undegraded":"2024-03-04T06:55:13.106089+0000","last_fullsized":"2024-03-04T06:55:13.106089+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101755+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101755+0000","last_peered":"2024-03-04T06:55:13.101755+0000","last_clean":"2024-03-04T06:55:13.101755+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101755+0000","last_undegraded":"2024-03-04T06:55:13.101755+0000","last_fullsized":"2024-03-04T06:55:13.101755+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097051+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:13.097051+0000","last_peered":"2024-03-04T06:55:13.097051+0000","last_clean":"2024-03-04T06:55:13.097051+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:13.097051+0000","last_undegraded":"2024-03-04T06:55:13.097051+0000","last_fullsized":"2024-03-04T06:55:13.097051+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1063,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102987+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.102987+0000","last_peered":"2024-03-04T06:55:13.102987+0000","last_clean":"2024-03-04T06:55:13.102987+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.102987+0000","last_undegraded":"2024-03-04T06:55:13.102987+0000","last_fullsized":"2024-03-04T06:55:13.102987+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115007+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.115007+0000","last_peered":"2024-03-04T06:55:13.115007+0000","last_clean":"2024-03-04T06:55:13.115007+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.115007+0000","last_undegraded":"2024-03-04T06:55:13.115007+0000","last_fullsized":"2024-03-04T06:55:13.115007+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114852+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114852+0000","last_peered":"2024-03-04T06:55:13.114852+0000","last_clean":"2024-03-04T06:55:13.114852+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114852+0000","last_undegraded":"2024-03-04T06:55:13.114852+0000","last_fullsized":"2024-03-04T06:55:13.114852+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1154,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095971+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:13.095971+0000","last_peered":"2024-03-04T06:55:13.095971+0000","last_clean":"2024-03-04T06:55:13.095971+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:13.095971+0000","last_undegraded":"2024-03-04T06:55:13.095971+0000","last_fullsized":"2024-03-04T06:55:13.095971+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1198,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098969+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.098969+0000","last_peered":"2024-03-04T06:55:13.098969+0000","last_clean":"2024-03-04T06:55:13.098969+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.098969+0000","last_undegraded":"2024-03-04T06:55:13.098969+0000","last_fullsized":"2024-03-04T06:55:13.098969+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115324+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:13.115324+0000","last_peered":"2024-03-04T06:55:13.115324+0000","last_clean":"2024-03-04T06:55:13.115324+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:13.115324+0000","last_undegraded":"2024-03-04T06:55:13.115324+0000","last_fullsized":"2024-03-04T06:55:13.115324+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115730+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115730+0000","last_peered":"2024-03-04T06:55:13.115730+0000","last_clean":"2024-03-04T06:55:13.115730+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115730+0000","last_undegraded":"2024-03-04T06:55:13.115730+0000","last_fullsized":"2024-03-04T06:55:13.115730+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104995+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104995+0000","last_peered":"2024-03-04T06:55:13.104995+0000","last_clean":"2024-03-04T06:55:13.104995+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104995+0000","last_undegraded":"2024-03-04T06:55:13.104995+0000","last_fullsized":"2024-03-04T06:55:13.104995+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.107002+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.107002+0000","last_peered":"2024-03-04T06:55:13.107002+0000","last_clean":"2024-03-04T06:55:13.107002+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.107002+0000","last_undegraded":"2024-03-04T06:55:13.107002+0000","last_fullsized":"2024-03-04T06:55:13.107002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096941+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096941+0000","last_peered":"2024-03-04T06:55:13.096941+0000","last_clean":"2024-03-04T06:55:13.096941+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096941+0000","last_undegraded":"2024-03-04T06:55:13.096941+0000","last_fullsized":"2024-03-04T06:55:13.096941+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102303+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102303+0000","last_peered":"2024-03-04T06:55:13.102303+0000","last_clean":"2024-03-04T06:55:13.102303+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102303+0000","last_undegraded":"2024-03-04T06:55:13.102303+0000","last_fullsized":"2024-03-04T06:55:13.102303+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116614+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116614+0000","last_peered":"2024-03-04T06:55:13.116614+0000","last_clean":"2024-03-04T06:55:13.116614+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116614+0000","last_undegraded":"2024-03-04T06:55:13.116614+0000","last_fullsized":"2024-03-04T06:55:13.116614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097609+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:13.097609+0000","last_peered":"2024-03-04T06:55:13.097609+0000","last_clean":"2024-03-04T06:55:13.097609+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:13.097609+0000","last_undegraded":"2024-03-04T06:55:13.097609+0000","last_fullsized":"2024-03-04T06:55:13.097609+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097848+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:13.097848+0000","last_peered":"2024-03-04T06:55:13.097848+0000","last_clean":"2024-03-04T06:55:13.097848+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:13.097848+0000","last_undegraded":"2024-03-04T06:55:13.097848+0000","last_fullsized":"2024-03-04T06:55:13.097848+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116801+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.116801+0000","last_peered":"2024-03-04T06:55:13.116801+0000","last_clean":"2024-03-04T06:55:13.116801+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.116801+0000","last_undegraded":"2024-03-04T06:55:13.116801+0000","last_fullsized":"2024-03-04T06:55:13.116801+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1233,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098515+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098515+0000","last_peered":"2024-03-04T06:55:13.098515+0000","last_clean":"2024-03-04T06:55:13.098515+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098515+0000","last_undegraded":"2024-03-04T06:55:13.098515+0000","last_fullsized":"2024-03-04T06:55:13.098515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1220,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097456+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097456+0000","last_peered":"2024-03-04T06:55:13.097456+0000","last_clean":"2024-03-04T06:55:13.097456+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097456+0000","last_undegraded":"2024-03-04T06:55:13.097456+0000","last_fullsized":"2024-03-04T06:55:13.097456+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1068,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102398+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102398+0000","last_peered":"2024-03-04T06:55:13.102398+0000","last_clean":"2024-03-04T06:55:13.102398+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102398+0000","last_undegraded":"2024-03-04T06:55:13.102398+0000","last_fullsized":"2024-03-04T06:55:13.102398+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106216+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106216+0000","last_peered":"2024-03-04T06:55:13.106216+0000","last_clean":"2024-03-04T06:55:13.106216+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106216+0000","last_undegraded":"2024-03-04T06:55:13.106216+0000","last_fullsized":"2024-03-04T06:55:13.106216+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098905+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:13.098905+0000","last_peered":"2024-03-04T06:55:13.098905+0000","last_clean":"2024-03-04T06:55:13.098905+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:13.098905+0000","last_undegraded":"2024-03-04T06:55:13.098905+0000","last_fullsized":"2024-03-04T06:55:13.098905+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1188,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096052+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.096052+0000","last_peered":"2024-03-04T06:55:13.096052+0000","last_clean":"2024-03-04T06:55:13.096052+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.096052+0000","last_undegraded":"2024-03-04T06:55:13.096052+0000","last_fullsized":"2024-03-04T06:55:13.096052+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114709+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114709+0000","last_peered":"2024-03-04T06:55:13.114709+0000","last_clean":"2024-03-04T06:55:13.114709+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114709+0000","last_undegraded":"2024-03-04T06:55:13.114709+0000","last_fullsized":"2024-03-04T06:55:13.114709+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.118051+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.118051+0000","last_peered":"2024-03-04T06:55:13.118051+0000","last_clean":"2024-03-04T06:55:13.118051+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.118051+0000","last_undegraded":"2024-03-04T06:55:13.118051+0000","last_fullsized":"2024-03-04T06:55:13.118051+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096686+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096686+0000","last_peered":"2024-03-04T06:55:13.096686+0000","last_clean":"2024-03-04T06:55:13.096686+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096686+0000","last_undegraded":"2024-03-04T06:55:13.096686+0000","last_fullsized":"2024-03-04T06:55:13.096686+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097180+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097180+0000","last_peered":"2024-03-04T06:55:13.097180+0000","last_clean":"2024-03-04T06:55:13.097180+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097180+0000","last_undegraded":"2024-03-04T06:55:13.097180+0000","last_fullsized":"2024-03-04T06:55:13.097180+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105593+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105593+0000","last_peered":"2024-03-04T06:55:13.105593+0000","last_clean":"2024-03-04T06:55:13.105593+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105593+0000","last_undegraded":"2024-03-04T06:55:13.105593+0000","last_fullsized":"2024-03-04T06:55:13.105593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115824+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115824+0000","last_peered":"2024-03-04T06:55:13.115824+0000","last_clean":"2024-03-04T06:55:13.115824+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115824+0000","last_undegraded":"2024-03-04T06:55:13.115824+0000","last_fullsized":"2024-03-04T06:55:13.115824+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115145+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115145+0000","last_peered":"2024-03-04T06:55:13.115145+0000","last_clean":"2024-03-04T06:55:13.115145+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115145+0000","last_undegraded":"2024-03-04T06:55:13.115145+0000","last_fullsized":"2024-03-04T06:55:13.115145+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1110,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105468+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105468+0000","last_peered":"2024-03-04T06:55:13.105468+0000","last_clean":"2024-03-04T06:55:13.105468+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105468+0000","last_undegraded":"2024-03-04T06:55:13.105468+0000","last_fullsized":"2024-03-04T06:55:13.105468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105915+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105915+0000","last_peered":"2024-03-04T06:55:13.105915+0000","last_clean":"2024-03-04T06:55:13.105915+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105915+0000","last_undegraded":"2024-03-04T06:55:13.105915+0000","last_fullsized":"2024-03-04T06:55:13.105915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116155+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116155+0000","last_peered":"2024-03-04T06:55:13.116155+0000","last_clean":"2024-03-04T06:55:13.116155+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116155+0000","last_undegraded":"2024-03-04T06:55:13.116155+0000","last_fullsized":"2024-03-04T06:55:13.116155+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116083+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116083+0000","last_peered":"2024-03-04T06:55:13.116083+0000","last_clean":"2024-03-04T06:55:13.116083+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116083+0000","last_undegraded":"2024-03-04T06:55:13.116083+0000","last_fullsized":"2024-03-04T06:55:13.116083+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096448+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:13.096448+0000","last_peered":"2024-03-04T06:55:13.096448+0000","last_clean":"2024-03-04T06:55:13.096448+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:13.096448+0000","last_undegraded":"2024-03-04T06:55:13.096448+0000","last_fullsized":"2024-03-04T06:55:13.096448+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114988+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114988+0000","last_peered":"2024-03-04T06:55:13.114988+0000","last_clean":"2024-03-04T06:55:13.114988+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114988+0000","last_undegraded":"2024-03-04T06:55:13.114988+0000","last_fullsized":"2024-03-04T06:55:13.114988+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102608+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102608+0000","last_peered":"2024-03-04T06:55:13.102608+0000","last_clean":"2024-03-04T06:55:13.102608+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102608+0000","last_undegraded":"2024-03-04T06:55:13.102608+0000","last_fullsized":"2024-03-04T06:55:13.102608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117741+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:13.117741+0000","last_peered":"2024-03-04T06:55:13.117741+0000","last_clean":"2024-03-04T06:55:13.117741+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:13.117741+0000","last_undegraded":"2024-03-04T06:55:13.117741+0000","last_fullsized":"2024-03-04T06:55:13.117741+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098537+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098537+0000","last_peered":"2024-03-04T06:55:13.098537+0000","last_clean":"2024-03-04T06:55:13.098537+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098537+0000","last_undegraded":"2024-03-04T06:55:13.098537+0000","last_fullsized":"2024-03-04T06:55:13.098537+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105922+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105922+0000","last_peered":"2024-03-04T06:55:13.105922+0000","last_clean":"2024-03-04T06:55:13.105922+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105922+0000","last_undegraded":"2024-03-04T06:55:13.105922+0000","last_fullsized":"2024-03-04T06:55:13.105922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102507+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102507+0000","last_peered":"2024-03-04T06:55:13.102507+0000","last_clean":"2024-03-04T06:55:13.102507+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102507+0000","last_undegraded":"2024-03-04T06:55:13.102507+0000","last_fullsized":"2024-03-04T06:55:13.102507+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114471+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114471+0000","last_peered":"2024-03-04T06:55:13.114471+0000","last_clean":"2024-03-04T06:55:13.114471+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114471+0000","last_undegraded":"2024-03-04T06:55:13.114471+0000","last_fullsized":"2024-03-04T06:55:13.114471+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114484+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114484+0000","last_peered":"2024-03-04T06:55:13.114484+0000","last_clean":"2024-03-04T06:55:13.114484+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114484+0000","last_undegraded":"2024-03-04T06:55:13.114484+0000","last_fullsized":"2024-03-04T06:55:13.114484+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1252,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101772+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101772+0000","last_peered":"2024-03-04T06:55:13.101772+0000","last_clean":"2024-03-04T06:55:13.101772+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101772+0000","last_undegraded":"2024-03-04T06:55:13.101772+0000","last_fullsized":"2024-03-04T06:55:13.101772+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3576,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096470+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:13.096470+0000","last_peered":"2024-03-04T06:55:13.096470+0000","last_clean":"2024-03-04T06:55:13.096470+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:13.096470+0000","last_undegraded":"2024-03-04T06:55:13.096470+0000","last_fullsized":"2024-03-04T06:55:13.096470+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096934+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096934+0000","last_peered":"2024-03-04T06:55:13.096934+0000","last_clean":"2024-03-04T06:55:13.096934+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096934+0000","last_undegraded":"2024-03-04T06:55:13.096934+0000","last_fullsized":"2024-03-04T06:55:13.096934+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102943+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102943+0000","last_peered":"2024-03-04T06:55:13.102943+0000","last_clean":"2024-03-04T06:55:13.102943+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102943+0000","last_undegraded":"2024-03-04T06:55:13.102943+0000","last_fullsized":"2024-03-04T06:55:13.102943+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17115,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117976+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117976+0000","last_peered":"2024-03-04T06:55:13.117976+0000","last_clean":"2024-03-04T06:55:13.117976+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117976+0000","last_undegraded":"2024-03-04T06:55:13.117976+0000","last_fullsized":"2024-03-04T06:55:13.117976+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115088+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115088+0000","last_peered":"2024-03-04T06:55:13.115088+0000","last_clean":"2024-03-04T06:55:13.115088+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115088+0000","last_undegraded":"2024-03-04T06:55:13.115088+0000","last_fullsized":"2024-03-04T06:55:13.115088+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116699+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116699+0000","last_peered":"2024-03-04T06:55:13.116699+0000","last_clean":"2024-03-04T06:55:13.116699+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116699+0000","last_undegraded":"2024-03-04T06:55:13.116699+0000","last_fullsized":"2024-03-04T06:55:13.116699+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105904+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.105904+0000","last_peered":"2024-03-04T06:55:13.105904+0000","last_clean":"2024-03-04T06:55:13.105904+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.105904+0000","last_undegraded":"2024-03-04T06:55:13.105904+0000","last_fullsized":"2024-03-04T06:55:13.105904+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4385,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117010+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.117010+0000","last_peered":"2024-03-04T06:55:13.117010+0000","last_clean":"2024-03-04T06:55:13.117010+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.117010+0000","last_undegraded":"2024-03-04T06:55:13.117010+0000","last_fullsized":"2024-03-04T06:55:13.117010+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115964+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115964+0000","last_peered":"2024-03-04T06:55:13.115964+0000","last_clean":"2024-03-04T06:55:13.115964+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115964+0000","last_undegraded":"2024-03-04T06:55:13.115964+0000","last_fullsized":"2024-03-04T06:55:13.115964+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105684+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105684+0000","last_peered":"2024-03-04T06:55:13.105684+0000","last_clean":"2024-03-04T06:55:13.105684+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105684+0000","last_undegraded":"2024-03-04T06:55:13.105684+0000","last_fullsized":"2024-03-04T06:55:13.105684+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096287+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096287+0000","last_peered":"2024-03-04T06:55:13.096287+0000","last_clean":"2024-03-04T06:55:13.096287+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096287+0000","last_undegraded":"2024-03-04T06:55:13.096287+0000","last_fullsized":"2024-03-04T06:55:13.096287+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5638,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097306+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:13.097306+0000","last_peered":"2024-03-04T06:55:13.097306+0000","last_clean":"2024-03-04T06:55:13.097306+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:13.097306+0000","last_undegraded":"2024-03-04T06:55:13.097306+0000","last_fullsized":"2024-03-04T06:55:13.097306+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116182+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.116182+0000","last_peered":"2024-03-04T06:55:13.116182+0000","last_clean":"2024-03-04T06:55:13.116182+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.116182+0000","last_undegraded":"2024-03-04T06:55:13.116182+0000","last_fullsized":"2024-03-04T06:55:13.116182+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114171+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114171+0000","last_peered":"2024-03-04T06:55:13.114171+0000","last_clean":"2024-03-04T06:55:13.114171+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114171+0000","last_undegraded":"2024-03-04T06:55:13.114171+0000","last_fullsized":"2024-03-04T06:55:13.114171+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096536+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:13.096536+0000","last_peered":"2024-03-04T06:55:13.096536+0000","last_clean":"2024-03-04T06:55:13.096536+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:13.096536+0000","last_undegraded":"2024-03-04T06:55:13.096536+0000","last_fullsized":"2024-03-04T06:55:13.096536+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4014,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107389+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.107389+0000","last_peered":"2024-03-04T06:55:13.107389+0000","last_clean":"2024-03-04T06:55:13.107389+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.107389+0000","last_undegraded":"2024-03-04T06:55:13.107389+0000","last_fullsized":"2024-03-04T06:55:13.107389+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1090,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115070+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:13.115070+0000","last_peered":"2024-03-04T06:55:13.115070+0000","last_clean":"2024-03-04T06:55:13.115070+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:13.115070+0000","last_undegraded":"2024-03-04T06:55:13.115070+0000","last_fullsized":"2024-03-04T06:55:13.115070+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098424+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098424+0000","last_peered":"2024-03-04T06:55:13.098424+0000","last_clean":"2024-03-04T06:55:13.098424+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098424+0000","last_undegraded":"2024-03-04T06:55:13.098424+0000","last_fullsized":"2024-03-04T06:55:13.098424+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105176+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105176+0000","last_peered":"2024-03-04T06:55:13.105176+0000","last_clean":"2024-03-04T06:55:13.105176+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105176+0000","last_undegraded":"2024-03-04T06:55:13.105176+0000","last_fullsized":"2024-03-04T06:55:13.105176+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1549,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101736+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101736+0000","last_peered":"2024-03-04T06:55:13.101736+0000","last_clean":"2024-03-04T06:55:13.101736+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101736+0000","last_undegraded":"2024-03-04T06:55:13.101736+0000","last_fullsized":"2024-03-04T06:55:13.101736+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3949,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.128010+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:13.128010+0000","last_peered":"2024-03-04T06:55:13.128010+0000","last_clean":"2024-03-04T06:55:13.128010+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:13.128010+0000","last_undegraded":"2024-03-04T06:55:13.128010+0000","last_fullsized":"2024-03-04T06:55:13.128010+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117375+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117375+0000","last_peered":"2024-03-04T06:55:13.117375+0000","last_clean":"2024-03-04T06:55:13.117375+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117375+0000","last_undegraded":"2024-03-04T06:55:13.117375+0000","last_fullsized":"2024-03-04T06:55:13.117375+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096315+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:13.096315+0000","last_peered":"2024-03-04T06:55:13.096315+0000","last_clean":"2024-03-04T06:55:13.096315+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:13.096315+0000","last_undegraded":"2024-03-04T06:55:13.096315+0000","last_fullsized":"2024-03-04T06:55:13.096315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101691+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101691+0000","last_peered":"2024-03-04T06:55:13.101691+0000","last_clean":"2024-03-04T06:55:13.101691+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101691+0000","last_undegraded":"2024-03-04T06:55:13.101691+0000","last_fullsized":"2024-03-04T06:55:13.101691+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15290,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.174192+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:13.174192+0000","last_peered":"2024-03-04T06:55:13.174192+0000","last_clean":"2024-03-04T06:55:13.174192+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:13.174192+0000","last_undegraded":"2024-03-04T06:55:13.174192+0000","last_fullsized":"2024-03-04T06:55:13.174192+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117527+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117527+0000","last_peered":"2024-03-04T06:55:13.117527+0000","last_clean":"2024-03-04T06:55:13.117527+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117527+0000","last_undegraded":"2024-03-04T06:55:13.117527+0000","last_fullsized":"2024-03-04T06:55:13.117527+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102583+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102583+0000","last_peered":"2024-03-04T06:55:13.102583+0000","last_clean":"2024-03-04T06:55:13.102583+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102583+0000","last_undegraded":"2024-03-04T06:55:13.102583+0000","last_fullsized":"2024-03-04T06:55:13.102583+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116059+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116059+0000","last_peered":"2024-03-04T06:55:13.116059+0000","last_clean":"2024-03-04T06:55:13.116059+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116059+0000","last_undegraded":"2024-03-04T06:55:13.116059+0000","last_fullsized":"2024-03-04T06:55:13.116059+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4378,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097496+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097496+0000","last_peered":"2024-03-04T06:55:13.097496+0000","last_clean":"2024-03-04T06:55:13.097496+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097496+0000","last_undegraded":"2024-03-04T06:55:13.097496+0000","last_fullsized":"2024-03-04T06:55:13.097496+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097599+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:13.097599+0000","last_peered":"2024-03-04T06:55:13.097599+0000","last_clean":"2024-03-04T06:55:13.097599+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:13.097599+0000","last_undegraded":"2024-03-04T06:55:13.097599+0000","last_fullsized":"2024-03-04T06:55:13.097599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117221+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.117221+0000","last_peered":"2024-03-04T06:55:13.117221+0000","last_clean":"2024-03-04T06:55:13.117221+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.117221+0000","last_undegraded":"2024-03-04T06:55:13.117221+0000","last_fullsized":"2024-03-04T06:55:13.117221+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097249+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097249+0000","last_peered":"2024-03-04T06:55:13.097249+0000","last_clean":"2024-03-04T06:55:13.097249+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097249+0000","last_undegraded":"2024-03-04T06:55:13.097249+0000","last_fullsized":"2024-03-04T06:55:13.097249+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4608,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.311904+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:13.311904+0000","last_peered":"2024-03-04T06:55:13.311904+0000","last_clean":"2024-03-04T06:55:13.311904+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:13.311904+0000","last_undegraded":"2024-03-04T06:55:13.311904+0000","last_fullsized":"2024-03-04T06:55:13.311904+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095704+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095704+0000","last_peered":"2024-03-04T06:55:13.095704+0000","last_clean":"2024-03-04T06:55:13.095704+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095704+0000","last_undegraded":"2024-03-04T06:55:13.095704+0000","last_fullsized":"2024-03-04T06:55:13.095704+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1077,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115185+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115185+0000","last_peered":"2024-03-04T06:55:13.115185+0000","last_clean":"2024-03-04T06:55:13.115185+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115185+0000","last_undegraded":"2024-03-04T06:55:13.115185+0000","last_fullsized":"2024-03-04T06:55:13.115185+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115644+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115644+0000","last_peered":"2024-03-04T06:55:13.115644+0000","last_clean":"2024-03-04T06:55:13.115644+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115644+0000","last_undegraded":"2024-03-04T06:55:13.115644+0000","last_fullsized":"2024-03-04T06:55:13.115644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4633,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107390+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:13.107390+0000","last_peered":"2024-03-04T06:55:13.107390+0000","last_clean":"2024-03-04T06:55:13.107390+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:13.107390+0000","last_undegraded":"2024-03-04T06:55:13.107390+0000","last_fullsized":"2024-03-04T06:55:13.107390+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101972+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101972+0000","last_peered":"2024-03-04T06:55:13.101972+0000","last_clean":"2024-03-04T06:55:13.101972+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101972+0000","last_undegraded":"2024-03-04T06:55:13.101972+0000","last_fullsized":"2024-03-04T06:55:13.101972+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1184,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095689+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095689+0000","last_peered":"2024-03-04T06:55:13.095689+0000","last_clean":"2024-03-04T06:55:13.095689+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095689+0000","last_undegraded":"2024-03-04T06:55:13.095689+0000","last_fullsized":"2024-03-04T06:55:13.095689+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5156,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.111062+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.111062+0000","last_peered":"2024-03-04T06:55:13.111062+0000","last_clean":"2024-03-04T06:55:13.111062+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.111062+0000","last_undegraded":"2024-03-04T06:55:13.111062+0000","last_fullsized":"2024-03-04T06:55:13.111062+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116686+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.116686+0000","last_peered":"2024-03-04T06:55:13.116686+0000","last_clean":"2024-03-04T06:55:13.116686+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.116686+0000","last_undegraded":"2024-03-04T06:55:13.116686+0000","last_fullsized":"2024-03-04T06:55:13.116686+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097821+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097821+0000","last_peered":"2024-03-04T06:55:13.097821+0000","last_clean":"2024-03-04T06:55:13.097821+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097821+0000","last_undegraded":"2024-03-04T06:55:13.097821+0000","last_fullsized":"2024-03-04T06:55:13.097821+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4718,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.169321+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.169321+0000","last_peered":"2024-03-04T06:55:13.169321+0000","last_clean":"2024-03-04T06:55:13.169321+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.169321+0000","last_undegraded":"2024-03-04T06:55:13.169321+0000","last_fullsized":"2024-03-04T06:55:13.169321+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114842+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.114842+0000","last_peered":"2024-03-04T06:55:13.114842+0000","last_clean":"2024-03-04T06:55:13.114842+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.114842+0000","last_undegraded":"2024-03-04T06:55:13.114842+0000","last_fullsized":"2024-03-04T06:55:13.114842+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098839+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098839+0000","last_peered":"2024-03-04T06:55:13.098839+0000","last_clean":"2024-03-04T06:55:13.098839+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098839+0000","last_undegraded":"2024-03-04T06:55:13.098839+0000","last_fullsized":"2024-03-04T06:55:13.098839+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5553,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117009+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:13.117009+0000","last_peered":"2024-03-04T06:55:13.117009+0000","last_clean":"2024-03-04T06:55:13.117009+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:13.117009+0000","last_undegraded":"2024-03-04T06:55:13.117009+0000","last_fullsized":"2024-03-04T06:55:13.117009+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102401+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102401+0000","last_peered":"2024-03-04T06:55:13.102401+0000","last_clean":"2024-03-04T06:55:13.102401+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102401+0000","last_undegraded":"2024-03-04T06:55:13.102401+0000","last_fullsized":"2024-03-04T06:55:13.102401+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114691+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114691+0000","last_peered":"2024-03-04T06:55:13.114691+0000","last_clean":"2024-03-04T06:55:13.114691+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114691+0000","last_undegraded":"2024-03-04T06:55:13.114691+0000","last_fullsized":"2024-03-04T06:55:13.114691+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096824+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096824+0000","last_peered":"2024-03-04T06:55:13.096824+0000","last_clean":"2024-03-04T06:55:13.096824+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096824+0000","last_undegraded":"2024-03-04T06:55:13.096824+0000","last_fullsized":"2024-03-04T06:55:13.096824+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097239+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097239+0000","last_peered":"2024-03-04T06:55:13.097239+0000","last_clean":"2024-03-04T06:55:13.097239+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097239+0000","last_undegraded":"2024-03-04T06:55:13.097239+0000","last_fullsized":"2024-03-04T06:55:13.097239+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102489+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102489+0000","last_peered":"2024-03-04T06:55:13.102489+0000","last_clean":"2024-03-04T06:55:13.102489+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102489+0000","last_undegraded":"2024-03-04T06:55:13.102489+0000","last_fullsized":"2024-03-04T06:55:13.102489+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4365,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.315099+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:13.315099+0000","last_peered":"2024-03-04T06:55:13.315099+0000","last_clean":"2024-03-04T06:55:13.315099+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:13.315099+0000","last_undegraded":"2024-03-04T06:55:13.315099+0000","last_fullsized":"2024-03-04T06:55:13.315099+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115541+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:13.115541+0000","last_peered":"2024-03-04T06:55:13.115541+0000","last_clean":"2024-03-04T06:55:13.115541+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:13.115541+0000","last_undegraded":"2024-03-04T06:55:13.115541+0000","last_fullsized":"2024-03-04T06:55:13.115541+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105888+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:13.105888+0000","last_peered":"2024-03-04T06:55:13.105888+0000","last_clean":"2024-03-04T06:55:13.105888+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:13.105888+0000","last_undegraded":"2024-03-04T06:55:13.105888+0000","last_fullsized":"2024-03-04T06:55:13.105888+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4599,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.322375+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.322375+0000","last_peered":"2024-03-04T06:55:13.322375+0000","last_clean":"2024-03-04T06:55:13.322375+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.322375+0000","last_undegraded":"2024-03-04T06:55:13.322375+0000","last_fullsized":"2024-03-04T06:55:13.322375+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097504+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097504+0000","last_peered":"2024-03-04T06:55:13.097504+0000","last_clean":"2024-03-04T06:55:13.097504+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097504+0000","last_undegraded":"2024-03-04T06:55:13.097504+0000","last_fullsized":"2024-03-04T06:55:13.097504+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105586+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.105586+0000","last_peered":"2024-03-04T06:55:13.105586+0000","last_clean":"2024-03-04T06:55:13.105586+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.105586+0000","last_undegraded":"2024-03-04T06:55:13.105586+0000","last_fullsized":"2024-03-04T06:55:13.105586+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114524+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:13.114524+0000","last_peered":"2024-03-04T06:55:13.114524+0000","last_clean":"2024-03-04T06:55:13.114524+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:13.114524+0000","last_undegraded":"2024-03-04T06:55:13.114524+0000","last_fullsized":"2024-03-04T06:55:13.114524+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096648+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:13.096648+0000","last_peered":"2024-03-04T06:55:13.096648+0000","last_clean":"2024-03-04T06:55:13.096648+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:13.096648+0000","last_undegraded":"2024-03-04T06:55:13.096648+0000","last_fullsized":"2024-03-04T06:55:13.096648+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105999+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.105999+0000","last_peered":"2024-03-04T06:55:13.105999+0000","last_clean":"2024-03-04T06:55:13.105999+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.105999+0000","last_undegraded":"2024-03-04T06:55:13.105999+0000","last_fullsized":"2024-03-04T06:55:13.105999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117390+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117390+0000","last_peered":"2024-03-04T06:55:13.117390+0000","last_clean":"2024-03-04T06:55:13.117390+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117390+0000","last_undegraded":"2024-03-04T06:55:13.117390+0000","last_fullsized":"2024-03-04T06:55:13.117390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096810+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096810+0000","last_peered":"2024-03-04T06:55:13.096810+0000","last_clean":"2024-03-04T06:55:13.096810+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096810+0000","last_undegraded":"2024-03-04T06:55:13.096810+0000","last_fullsized":"2024-03-04T06:55:13.096810+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115428+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.115428+0000","last_peered":"2024-03-04T06:55:13.115428+0000","last_clean":"2024-03-04T06:55:13.115428+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.115428+0000","last_undegraded":"2024-03-04T06:55:13.115428+0000","last_fullsized":"2024-03-04T06:55:13.115428+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115286+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115286+0000","last_peered":"2024-03-04T06:55:13.115286+0000","last_clean":"2024-03-04T06:55:13.115286+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115286+0000","last_undegraded":"2024-03-04T06:55:13.115286+0000","last_fullsized":"2024-03-04T06:55:13.115286+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097481+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097481+0000","last_peered":"2024-03-04T06:55:13.097481+0000","last_clean":"2024-03-04T06:55:13.097481+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097481+0000","last_undegraded":"2024-03-04T06:55:13.097481+0000","last_fullsized":"2024-03-04T06:55:13.097481+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105275+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:13.105275+0000","last_peered":"2024-03-04T06:55:13.105275+0000","last_clean":"2024-03-04T06:55:13.105275+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:13.105275+0000","last_undegraded":"2024-03-04T06:55:13.105275+0000","last_fullsized":"2024-03-04T06:55:13.105275+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105576+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:13.105576+0000","last_peered":"2024-03-04T06:55:13.105576+0000","last_clean":"2024-03-04T06:55:13.105576+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:13.105576+0000","last_undegraded":"2024-03-04T06:55:13.105576+0000","last_fullsized":"2024-03-04T06:55:13.105576+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116864+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116864+0000","last_peered":"2024-03-04T06:55:13.116864+0000","last_clean":"2024-03-04T06:55:13.116864+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116864+0000","last_undegraded":"2024-03-04T06:55:13.116864+0000","last_fullsized":"2024-03-04T06:55:13.116864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114836+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114836+0000","last_peered":"2024-03-04T06:55:13.114836+0000","last_clean":"2024-03-04T06:55:13.114836+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114836+0000","last_undegraded":"2024-03-04T06:55:13.114836+0000","last_fullsized":"2024-03-04T06:55:13.114836+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503444,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648091,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142398,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287045,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997751,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885808,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937385,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792738,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:57:01.507 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:01.508 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:01.508 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:01.508 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:01.508 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:01.508 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:01.508 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:01.508 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:01.508 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:01.508 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:01.508 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:57:02.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:02 smithi137 ceph-mon[88869]: pgmap v975: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:02.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:02 smithi137 ceph-mon[88869]: from='client.44486 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:02.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:02 smithi137 ceph-mon[91314]: pgmap v975: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:02.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:02 smithi137 ceph-mon[91314]: from='client.44486 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:02.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:02 smithi203 ceph-mon[85573]: pgmap v975: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:02.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:02 smithi203 ceph-mon[85573]: from='client.44486 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:04.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:04 smithi137 ceph-mon[88869]: pgmap v976: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:04.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:04 smithi137 ceph-mon[91314]: pgmap v976: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:04.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:04 smithi203 ceph-mon[85573]: pgmap v976: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:05.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:57:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:57:05] "GET /metrics HTTP/1.1" 200 36336 "" "Prometheus/2.43.0" 2024-03-04T06:57:06.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:06 smithi203 ceph-mon[85573]: pgmap v977: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:06.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:06 smithi137 ceph-mon[88869]: pgmap v977: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:06.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:06 smithi137 ceph-mon[91314]: pgmap v977: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:08.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:08 smithi203 ceph-mon[85573]: pgmap v978: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:08.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:08 smithi137 ceph-mon[88869]: pgmap v978: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:08.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:08 smithi137 ceph-mon[91314]: pgmap v978: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:09.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:57:09.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:57:09.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:57:09.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:57:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:57:09.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:57:10.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:10 smithi203 ceph-mon[85573]: pgmap v979: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:10.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:57:10.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:57:10.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:57:10.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:10 smithi137 ceph-mon[88869]: pgmap v979: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:57:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:57:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:57:10.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:10 smithi137 ceph-mon[91314]: pgmap v979: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:10.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:57:10.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:57:10.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:57:11.509 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:57:11.726 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:57:12.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:12 smithi137 ceph-mon[91314]: pgmap v980: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:12.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:12 smithi137 ceph-mon[88869]: pgmap v980: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:12.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:12 smithi203 ceph-mon[85573]: pgmap v980: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:13.337 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:57:13.339 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:57:13.967 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":981,"stamp":"2024-03-04T06:57:12.494765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003598"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103340+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103340+0000","last_peered":"2024-03-04T06:55:13.103340+0000","last_clean":"2024-03-04T06:55:13.103340+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103340+0000","last_undegraded":"2024-03-04T06:55:13.103340+0000","last_fullsized":"2024-03-04T06:55:13.103340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117002+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.117002+0000","last_peered":"2024-03-04T06:55:13.117002+0000","last_clean":"2024-03-04T06:55:13.117002+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.117002+0000","last_undegraded":"2024-03-04T06:55:13.117002+0000","last_fullsized":"2024-03-04T06:55:13.117002+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115416+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115416+0000","last_peered":"2024-03-04T06:55:13.115416+0000","last_clean":"2024-03-04T06:55:13.115416+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115416+0000","last_undegraded":"2024-03-04T06:55:13.115416+0000","last_fullsized":"2024-03-04T06:55:13.115416+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106163+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106163+0000","last_peered":"2024-03-04T06:55:13.106163+0000","last_clean":"2024-03-04T06:55:13.106163+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106163+0000","last_undegraded":"2024-03-04T06:55:13.106163+0000","last_fullsized":"2024-03-04T06:55:13.106163+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101948+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.101948+0000","last_peered":"2024-03-04T06:55:13.101948+0000","last_clean":"2024-03-04T06:55:13.101948+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.101948+0000","last_undegraded":"2024-03-04T06:55:13.101948+0000","last_fullsized":"2024-03-04T06:55:13.101948+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106089+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106089+0000","last_peered":"2024-03-04T06:55:13.106089+0000","last_clean":"2024-03-04T06:55:13.106089+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106089+0000","last_undegraded":"2024-03-04T06:55:13.106089+0000","last_fullsized":"2024-03-04T06:55:13.106089+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101755+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101755+0000","last_peered":"2024-03-04T06:55:13.101755+0000","last_clean":"2024-03-04T06:55:13.101755+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101755+0000","last_undegraded":"2024-03-04T06:55:13.101755+0000","last_fullsized":"2024-03-04T06:55:13.101755+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097051+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:13.097051+0000","last_peered":"2024-03-04T06:55:13.097051+0000","last_clean":"2024-03-04T06:55:13.097051+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:13.097051+0000","last_undegraded":"2024-03-04T06:55:13.097051+0000","last_fullsized":"2024-03-04T06:55:13.097051+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1063,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102987+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.102987+0000","last_peered":"2024-03-04T06:55:13.102987+0000","last_clean":"2024-03-04T06:55:13.102987+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.102987+0000","last_undegraded":"2024-03-04T06:55:13.102987+0000","last_fullsized":"2024-03-04T06:55:13.102987+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115007+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.115007+0000","last_peered":"2024-03-04T06:55:13.115007+0000","last_clean":"2024-03-04T06:55:13.115007+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.115007+0000","last_undegraded":"2024-03-04T06:55:13.115007+0000","last_fullsized":"2024-03-04T06:55:13.115007+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114852+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114852+0000","last_peered":"2024-03-04T06:55:13.114852+0000","last_clean":"2024-03-04T06:55:13.114852+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114852+0000","last_undegraded":"2024-03-04T06:55:13.114852+0000","last_fullsized":"2024-03-04T06:55:13.114852+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1154,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095971+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:13.095971+0000","last_peered":"2024-03-04T06:55:13.095971+0000","last_clean":"2024-03-04T06:55:13.095971+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:13.095971+0000","last_undegraded":"2024-03-04T06:55:13.095971+0000","last_fullsized":"2024-03-04T06:55:13.095971+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1198,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098969+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.098969+0000","last_peered":"2024-03-04T06:55:13.098969+0000","last_clean":"2024-03-04T06:55:13.098969+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.098969+0000","last_undegraded":"2024-03-04T06:55:13.098969+0000","last_fullsized":"2024-03-04T06:55:13.098969+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115324+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:13.115324+0000","last_peered":"2024-03-04T06:55:13.115324+0000","last_clean":"2024-03-04T06:55:13.115324+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:13.115324+0000","last_undegraded":"2024-03-04T06:55:13.115324+0000","last_fullsized":"2024-03-04T06:55:13.115324+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115730+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115730+0000","last_peered":"2024-03-04T06:55:13.115730+0000","last_clean":"2024-03-04T06:55:13.115730+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115730+0000","last_undegraded":"2024-03-04T06:55:13.115730+0000","last_fullsized":"2024-03-04T06:55:13.115730+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104995+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104995+0000","last_peered":"2024-03-04T06:55:13.104995+0000","last_clean":"2024-03-04T06:55:13.104995+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104995+0000","last_undegraded":"2024-03-04T06:55:13.104995+0000","last_fullsized":"2024-03-04T06:55:13.104995+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.107002+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.107002+0000","last_peered":"2024-03-04T06:55:13.107002+0000","last_clean":"2024-03-04T06:55:13.107002+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.107002+0000","last_undegraded":"2024-03-04T06:55:13.107002+0000","last_fullsized":"2024-03-04T06:55:13.107002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096941+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096941+0000","last_peered":"2024-03-04T06:55:13.096941+0000","last_clean":"2024-03-04T06:55:13.096941+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096941+0000","last_undegraded":"2024-03-04T06:55:13.096941+0000","last_fullsized":"2024-03-04T06:55:13.096941+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102303+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102303+0000","last_peered":"2024-03-04T06:55:13.102303+0000","last_clean":"2024-03-04T06:55:13.102303+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102303+0000","last_undegraded":"2024-03-04T06:55:13.102303+0000","last_fullsized":"2024-03-04T06:55:13.102303+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116614+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116614+0000","last_peered":"2024-03-04T06:55:13.116614+0000","last_clean":"2024-03-04T06:55:13.116614+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116614+0000","last_undegraded":"2024-03-04T06:55:13.116614+0000","last_fullsized":"2024-03-04T06:55:13.116614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097609+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:13.097609+0000","last_peered":"2024-03-04T06:55:13.097609+0000","last_clean":"2024-03-04T06:55:13.097609+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:13.097609+0000","last_undegraded":"2024-03-04T06:55:13.097609+0000","last_fullsized":"2024-03-04T06:55:13.097609+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097848+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:13.097848+0000","last_peered":"2024-03-04T06:55:13.097848+0000","last_clean":"2024-03-04T06:55:13.097848+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:13.097848+0000","last_undegraded":"2024-03-04T06:55:13.097848+0000","last_fullsized":"2024-03-04T06:55:13.097848+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116801+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.116801+0000","last_peered":"2024-03-04T06:55:13.116801+0000","last_clean":"2024-03-04T06:55:13.116801+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.116801+0000","last_undegraded":"2024-03-04T06:55:13.116801+0000","last_fullsized":"2024-03-04T06:55:13.116801+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1234,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098569+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098569+0000","last_peered":"2024-03-04T06:55:13.098569+0000","last_clean":"2024-03-04T06:55:13.098569+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098569+0000","last_undegraded":"2024-03-04T06:55:13.098569+0000","last_fullsized":"2024-03-04T06:55:13.098569+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1221,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097506+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097506+0000","last_peered":"2024-03-04T06:55:13.097506+0000","last_clean":"2024-03-04T06:55:13.097506+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097506+0000","last_undegraded":"2024-03-04T06:55:13.097506+0000","last_fullsized":"2024-03-04T06:55:13.097506+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1068,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102398+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102398+0000","last_peered":"2024-03-04T06:55:13.102398+0000","last_clean":"2024-03-04T06:55:13.102398+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102398+0000","last_undegraded":"2024-03-04T06:55:13.102398+0000","last_fullsized":"2024-03-04T06:55:13.102398+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106216+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106216+0000","last_peered":"2024-03-04T06:55:13.106216+0000","last_clean":"2024-03-04T06:55:13.106216+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106216+0000","last_undegraded":"2024-03-04T06:55:13.106216+0000","last_fullsized":"2024-03-04T06:55:13.106216+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098905+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:13.098905+0000","last_peered":"2024-03-04T06:55:13.098905+0000","last_clean":"2024-03-04T06:55:13.098905+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:13.098905+0000","last_undegraded":"2024-03-04T06:55:13.098905+0000","last_fullsized":"2024-03-04T06:55:13.098905+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1188,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096052+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.096052+0000","last_peered":"2024-03-04T06:55:13.096052+0000","last_clean":"2024-03-04T06:55:13.096052+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.096052+0000","last_undegraded":"2024-03-04T06:55:13.096052+0000","last_fullsized":"2024-03-04T06:55:13.096052+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114709+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114709+0000","last_peered":"2024-03-04T06:55:13.114709+0000","last_clean":"2024-03-04T06:55:13.114709+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114709+0000","last_undegraded":"2024-03-04T06:55:13.114709+0000","last_fullsized":"2024-03-04T06:55:13.114709+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.118051+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.118051+0000","last_peered":"2024-03-04T06:55:13.118051+0000","last_clean":"2024-03-04T06:55:13.118051+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.118051+0000","last_undegraded":"2024-03-04T06:55:13.118051+0000","last_fullsized":"2024-03-04T06:55:13.118051+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096686+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096686+0000","last_peered":"2024-03-04T06:55:13.096686+0000","last_clean":"2024-03-04T06:55:13.096686+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096686+0000","last_undegraded":"2024-03-04T06:55:13.096686+0000","last_fullsized":"2024-03-04T06:55:13.096686+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097180+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097180+0000","last_peered":"2024-03-04T06:55:13.097180+0000","last_clean":"2024-03-04T06:55:13.097180+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097180+0000","last_undegraded":"2024-03-04T06:55:13.097180+0000","last_fullsized":"2024-03-04T06:55:13.097180+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105593+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105593+0000","last_peered":"2024-03-04T06:55:13.105593+0000","last_clean":"2024-03-04T06:55:13.105593+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105593+0000","last_undegraded":"2024-03-04T06:55:13.105593+0000","last_fullsized":"2024-03-04T06:55:13.105593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115824+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115824+0000","last_peered":"2024-03-04T06:55:13.115824+0000","last_clean":"2024-03-04T06:55:13.115824+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115824+0000","last_undegraded":"2024-03-04T06:55:13.115824+0000","last_fullsized":"2024-03-04T06:55:13.115824+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115145+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115145+0000","last_peered":"2024-03-04T06:55:13.115145+0000","last_clean":"2024-03-04T06:55:13.115145+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115145+0000","last_undegraded":"2024-03-04T06:55:13.115145+0000","last_fullsized":"2024-03-04T06:55:13.115145+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1110,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105468+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105468+0000","last_peered":"2024-03-04T06:55:13.105468+0000","last_clean":"2024-03-04T06:55:13.105468+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105468+0000","last_undegraded":"2024-03-04T06:55:13.105468+0000","last_fullsized":"2024-03-04T06:55:13.105468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105915+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105915+0000","last_peered":"2024-03-04T06:55:13.105915+0000","last_clean":"2024-03-04T06:55:13.105915+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105915+0000","last_undegraded":"2024-03-04T06:55:13.105915+0000","last_fullsized":"2024-03-04T06:55:13.105915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116155+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116155+0000","last_peered":"2024-03-04T06:55:13.116155+0000","last_clean":"2024-03-04T06:55:13.116155+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116155+0000","last_undegraded":"2024-03-04T06:55:13.116155+0000","last_fullsized":"2024-03-04T06:55:13.116155+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116083+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116083+0000","last_peered":"2024-03-04T06:55:13.116083+0000","last_clean":"2024-03-04T06:55:13.116083+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116083+0000","last_undegraded":"2024-03-04T06:55:13.116083+0000","last_fullsized":"2024-03-04T06:55:13.116083+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096448+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:13.096448+0000","last_peered":"2024-03-04T06:55:13.096448+0000","last_clean":"2024-03-04T06:55:13.096448+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:13.096448+0000","last_undegraded":"2024-03-04T06:55:13.096448+0000","last_fullsized":"2024-03-04T06:55:13.096448+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114988+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114988+0000","last_peered":"2024-03-04T06:55:13.114988+0000","last_clean":"2024-03-04T06:55:13.114988+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114988+0000","last_undegraded":"2024-03-04T06:55:13.114988+0000","last_fullsized":"2024-03-04T06:55:13.114988+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1049,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102608+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102608+0000","last_peered":"2024-03-04T06:55:13.102608+0000","last_clean":"2024-03-04T06:55:13.102608+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102608+0000","last_undegraded":"2024-03-04T06:55:13.102608+0000","last_fullsized":"2024-03-04T06:55:13.102608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117741+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:13.117741+0000","last_peered":"2024-03-04T06:55:13.117741+0000","last_clean":"2024-03-04T06:55:13.117741+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:13.117741+0000","last_undegraded":"2024-03-04T06:55:13.117741+0000","last_fullsized":"2024-03-04T06:55:13.117741+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098537+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098537+0000","last_peered":"2024-03-04T06:55:13.098537+0000","last_clean":"2024-03-04T06:55:13.098537+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098537+0000","last_undegraded":"2024-03-04T06:55:13.098537+0000","last_fullsized":"2024-03-04T06:55:13.098537+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105922+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105922+0000","last_peered":"2024-03-04T06:55:13.105922+0000","last_clean":"2024-03-04T06:55:13.105922+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105922+0000","last_undegraded":"2024-03-04T06:55:13.105922+0000","last_fullsized":"2024-03-04T06:55:13.105922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102561+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102561+0000","last_peered":"2024-03-04T06:55:13.102561+0000","last_clean":"2024-03-04T06:55:13.102561+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102561+0000","last_undegraded":"2024-03-04T06:55:13.102561+0000","last_fullsized":"2024-03-04T06:55:13.102561+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114471+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114471+0000","last_peered":"2024-03-04T06:55:13.114471+0000","last_clean":"2024-03-04T06:55:13.114471+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114471+0000","last_undegraded":"2024-03-04T06:55:13.114471+0000","last_fullsized":"2024-03-04T06:55:13.114471+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114484+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114484+0000","last_peered":"2024-03-04T06:55:13.114484+0000","last_clean":"2024-03-04T06:55:13.114484+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114484+0000","last_undegraded":"2024-03-04T06:55:13.114484+0000","last_fullsized":"2024-03-04T06:55:13.114484+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1252,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101837+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101837+0000","last_peered":"2024-03-04T06:55:13.101837+0000","last_clean":"2024-03-04T06:55:13.101837+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101837+0000","last_undegraded":"2024-03-04T06:55:13.101837+0000","last_fullsized":"2024-03-04T06:55:13.101837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3576,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096470+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:13.096470+0000","last_peered":"2024-03-04T06:55:13.096470+0000","last_clean":"2024-03-04T06:55:13.096470+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:13.096470+0000","last_undegraded":"2024-03-04T06:55:13.096470+0000","last_fullsized":"2024-03-04T06:55:13.096470+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096934+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096934+0000","last_peered":"2024-03-04T06:55:13.096934+0000","last_clean":"2024-03-04T06:55:13.096934+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096934+0000","last_undegraded":"2024-03-04T06:55:13.096934+0000","last_fullsized":"2024-03-04T06:55:13.096934+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102943+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102943+0000","last_peered":"2024-03-04T06:55:13.102943+0000","last_clean":"2024-03-04T06:55:13.102943+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102943+0000","last_undegraded":"2024-03-04T06:55:13.102943+0000","last_fullsized":"2024-03-04T06:55:13.102943+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17115,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117976+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117976+0000","last_peered":"2024-03-04T06:55:13.117976+0000","last_clean":"2024-03-04T06:55:13.117976+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117976+0000","last_undegraded":"2024-03-04T06:55:13.117976+0000","last_fullsized":"2024-03-04T06:55:13.117976+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115088+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115088+0000","last_peered":"2024-03-04T06:55:13.115088+0000","last_clean":"2024-03-04T06:55:13.115088+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115088+0000","last_undegraded":"2024-03-04T06:55:13.115088+0000","last_fullsized":"2024-03-04T06:55:13.115088+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116699+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116699+0000","last_peered":"2024-03-04T06:55:13.116699+0000","last_clean":"2024-03-04T06:55:13.116699+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116699+0000","last_undegraded":"2024-03-04T06:55:13.116699+0000","last_fullsized":"2024-03-04T06:55:13.116699+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105904+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.105904+0000","last_peered":"2024-03-04T06:55:13.105904+0000","last_clean":"2024-03-04T06:55:13.105904+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.105904+0000","last_undegraded":"2024-03-04T06:55:13.105904+0000","last_fullsized":"2024-03-04T06:55:13.105904+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4385,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117010+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.117010+0000","last_peered":"2024-03-04T06:55:13.117010+0000","last_clean":"2024-03-04T06:55:13.117010+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.117010+0000","last_undegraded":"2024-03-04T06:55:13.117010+0000","last_fullsized":"2024-03-04T06:55:13.117010+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115964+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115964+0000","last_peered":"2024-03-04T06:55:13.115964+0000","last_clean":"2024-03-04T06:55:13.115964+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115964+0000","last_undegraded":"2024-03-04T06:55:13.115964+0000","last_fullsized":"2024-03-04T06:55:13.115964+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105684+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105684+0000","last_peered":"2024-03-04T06:55:13.105684+0000","last_clean":"2024-03-04T06:55:13.105684+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105684+0000","last_undegraded":"2024-03-04T06:55:13.105684+0000","last_fullsized":"2024-03-04T06:55:13.105684+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096287+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096287+0000","last_peered":"2024-03-04T06:55:13.096287+0000","last_clean":"2024-03-04T06:55:13.096287+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096287+0000","last_undegraded":"2024-03-04T06:55:13.096287+0000","last_fullsized":"2024-03-04T06:55:13.096287+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5638,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097306+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:13.097306+0000","last_peered":"2024-03-04T06:55:13.097306+0000","last_clean":"2024-03-04T06:55:13.097306+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:13.097306+0000","last_undegraded":"2024-03-04T06:55:13.097306+0000","last_fullsized":"2024-03-04T06:55:13.097306+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116182+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.116182+0000","last_peered":"2024-03-04T06:55:13.116182+0000","last_clean":"2024-03-04T06:55:13.116182+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.116182+0000","last_undegraded":"2024-03-04T06:55:13.116182+0000","last_fullsized":"2024-03-04T06:55:13.116182+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114171+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114171+0000","last_peered":"2024-03-04T06:55:13.114171+0000","last_clean":"2024-03-04T06:55:13.114171+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114171+0000","last_undegraded":"2024-03-04T06:55:13.114171+0000","last_fullsized":"2024-03-04T06:55:13.114171+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096536+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:13.096536+0000","last_peered":"2024-03-04T06:55:13.096536+0000","last_clean":"2024-03-04T06:55:13.096536+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:13.096536+0000","last_undegraded":"2024-03-04T06:55:13.096536+0000","last_fullsized":"2024-03-04T06:55:13.096536+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4014,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107389+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.107389+0000","last_peered":"2024-03-04T06:55:13.107389+0000","last_clean":"2024-03-04T06:55:13.107389+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.107389+0000","last_undegraded":"2024-03-04T06:55:13.107389+0000","last_fullsized":"2024-03-04T06:55:13.107389+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1090,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115070+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:13.115070+0000","last_peered":"2024-03-04T06:55:13.115070+0000","last_clean":"2024-03-04T06:55:13.115070+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:13.115070+0000","last_undegraded":"2024-03-04T06:55:13.115070+0000","last_fullsized":"2024-03-04T06:55:13.115070+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098424+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098424+0000","last_peered":"2024-03-04T06:55:13.098424+0000","last_clean":"2024-03-04T06:55:13.098424+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098424+0000","last_undegraded":"2024-03-04T06:55:13.098424+0000","last_fullsized":"2024-03-04T06:55:13.098424+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105176+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105176+0000","last_peered":"2024-03-04T06:55:13.105176+0000","last_clean":"2024-03-04T06:55:13.105176+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105176+0000","last_undegraded":"2024-03-04T06:55:13.105176+0000","last_fullsized":"2024-03-04T06:55:13.105176+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1549,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101736+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101736+0000","last_peered":"2024-03-04T06:55:13.101736+0000","last_clean":"2024-03-04T06:55:13.101736+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101736+0000","last_undegraded":"2024-03-04T06:55:13.101736+0000","last_fullsized":"2024-03-04T06:55:13.101736+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3949,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.128010+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:13.128010+0000","last_peered":"2024-03-04T06:55:13.128010+0000","last_clean":"2024-03-04T06:55:13.128010+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:13.128010+0000","last_undegraded":"2024-03-04T06:55:13.128010+0000","last_fullsized":"2024-03-04T06:55:13.128010+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117375+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117375+0000","last_peered":"2024-03-04T06:55:13.117375+0000","last_clean":"2024-03-04T06:55:13.117375+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117375+0000","last_undegraded":"2024-03-04T06:55:13.117375+0000","last_fullsized":"2024-03-04T06:55:13.117375+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096315+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:13.096315+0000","last_peered":"2024-03-04T06:55:13.096315+0000","last_clean":"2024-03-04T06:55:13.096315+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:13.096315+0000","last_undegraded":"2024-03-04T06:55:13.096315+0000","last_fullsized":"2024-03-04T06:55:13.096315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101691+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101691+0000","last_peered":"2024-03-04T06:55:13.101691+0000","last_clean":"2024-03-04T06:55:13.101691+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101691+0000","last_undegraded":"2024-03-04T06:55:13.101691+0000","last_fullsized":"2024-03-04T06:55:13.101691+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15290,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.174192+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:13.174192+0000","last_peered":"2024-03-04T06:55:13.174192+0000","last_clean":"2024-03-04T06:55:13.174192+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:13.174192+0000","last_undegraded":"2024-03-04T06:55:13.174192+0000","last_fullsized":"2024-03-04T06:55:13.174192+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117527+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117527+0000","last_peered":"2024-03-04T06:55:13.117527+0000","last_clean":"2024-03-04T06:55:13.117527+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117527+0000","last_undegraded":"2024-03-04T06:55:13.117527+0000","last_fullsized":"2024-03-04T06:55:13.117527+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102583+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102583+0000","last_peered":"2024-03-04T06:55:13.102583+0000","last_clean":"2024-03-04T06:55:13.102583+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102583+0000","last_undegraded":"2024-03-04T06:55:13.102583+0000","last_fullsized":"2024-03-04T06:55:13.102583+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116059+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116059+0000","last_peered":"2024-03-04T06:55:13.116059+0000","last_clean":"2024-03-04T06:55:13.116059+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116059+0000","last_undegraded":"2024-03-04T06:55:13.116059+0000","last_fullsized":"2024-03-04T06:55:13.116059+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4378,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097496+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097496+0000","last_peered":"2024-03-04T06:55:13.097496+0000","last_clean":"2024-03-04T06:55:13.097496+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097496+0000","last_undegraded":"2024-03-04T06:55:13.097496+0000","last_fullsized":"2024-03-04T06:55:13.097496+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097599+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:13.097599+0000","last_peered":"2024-03-04T06:55:13.097599+0000","last_clean":"2024-03-04T06:55:13.097599+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:13.097599+0000","last_undegraded":"2024-03-04T06:55:13.097599+0000","last_fullsized":"2024-03-04T06:55:13.097599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117221+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.117221+0000","last_peered":"2024-03-04T06:55:13.117221+0000","last_clean":"2024-03-04T06:55:13.117221+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.117221+0000","last_undegraded":"2024-03-04T06:55:13.117221+0000","last_fullsized":"2024-03-04T06:55:13.117221+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097249+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097249+0000","last_peered":"2024-03-04T06:55:13.097249+0000","last_clean":"2024-03-04T06:55:13.097249+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097249+0000","last_undegraded":"2024-03-04T06:55:13.097249+0000","last_fullsized":"2024-03-04T06:55:13.097249+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4608,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.311904+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:13.311904+0000","last_peered":"2024-03-04T06:55:13.311904+0000","last_clean":"2024-03-04T06:55:13.311904+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:13.311904+0000","last_undegraded":"2024-03-04T06:55:13.311904+0000","last_fullsized":"2024-03-04T06:55:13.311904+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095704+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095704+0000","last_peered":"2024-03-04T06:55:13.095704+0000","last_clean":"2024-03-04T06:55:13.095704+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095704+0000","last_undegraded":"2024-03-04T06:55:13.095704+0000","last_fullsized":"2024-03-04T06:55:13.095704+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1077,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115185+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115185+0000","last_peered":"2024-03-04T06:55:13.115185+0000","last_clean":"2024-03-04T06:55:13.115185+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115185+0000","last_undegraded":"2024-03-04T06:55:13.115185+0000","last_fullsized":"2024-03-04T06:55:13.115185+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115644+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115644+0000","last_peered":"2024-03-04T06:55:13.115644+0000","last_clean":"2024-03-04T06:55:13.115644+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115644+0000","last_undegraded":"2024-03-04T06:55:13.115644+0000","last_fullsized":"2024-03-04T06:55:13.115644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4633,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107390+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:13.107390+0000","last_peered":"2024-03-04T06:55:13.107390+0000","last_clean":"2024-03-04T06:55:13.107390+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:13.107390+0000","last_undegraded":"2024-03-04T06:55:13.107390+0000","last_fullsized":"2024-03-04T06:55:13.107390+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101972+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101972+0000","last_peered":"2024-03-04T06:55:13.101972+0000","last_clean":"2024-03-04T06:55:13.101972+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101972+0000","last_undegraded":"2024-03-04T06:55:13.101972+0000","last_fullsized":"2024-03-04T06:55:13.101972+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1184,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095689+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095689+0000","last_peered":"2024-03-04T06:55:13.095689+0000","last_clean":"2024-03-04T06:55:13.095689+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095689+0000","last_undegraded":"2024-03-04T06:55:13.095689+0000","last_fullsized":"2024-03-04T06:55:13.095689+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5156,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.111062+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.111062+0000","last_peered":"2024-03-04T06:55:13.111062+0000","last_clean":"2024-03-04T06:55:13.111062+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.111062+0000","last_undegraded":"2024-03-04T06:55:13.111062+0000","last_fullsized":"2024-03-04T06:55:13.111062+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116686+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.116686+0000","last_peered":"2024-03-04T06:55:13.116686+0000","last_clean":"2024-03-04T06:55:13.116686+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.116686+0000","last_undegraded":"2024-03-04T06:55:13.116686+0000","last_fullsized":"2024-03-04T06:55:13.116686+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097821+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097821+0000","last_peered":"2024-03-04T06:55:13.097821+0000","last_clean":"2024-03-04T06:55:13.097821+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097821+0000","last_undegraded":"2024-03-04T06:55:13.097821+0000","last_fullsized":"2024-03-04T06:55:13.097821+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4718,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.169321+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.169321+0000","last_peered":"2024-03-04T06:55:13.169321+0000","last_clean":"2024-03-04T06:55:13.169321+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.169321+0000","last_undegraded":"2024-03-04T06:55:13.169321+0000","last_fullsized":"2024-03-04T06:55:13.169321+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114842+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.114842+0000","last_peered":"2024-03-04T06:55:13.114842+0000","last_clean":"2024-03-04T06:55:13.114842+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.114842+0000","last_undegraded":"2024-03-04T06:55:13.114842+0000","last_fullsized":"2024-03-04T06:55:13.114842+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098839+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098839+0000","last_peered":"2024-03-04T06:55:13.098839+0000","last_clean":"2024-03-04T06:55:13.098839+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098839+0000","last_undegraded":"2024-03-04T06:55:13.098839+0000","last_fullsized":"2024-03-04T06:55:13.098839+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5553,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117009+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:13.117009+0000","last_peered":"2024-03-04T06:55:13.117009+0000","last_clean":"2024-03-04T06:55:13.117009+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:13.117009+0000","last_undegraded":"2024-03-04T06:55:13.117009+0000","last_fullsized":"2024-03-04T06:55:13.117009+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102401+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102401+0000","last_peered":"2024-03-04T06:55:13.102401+0000","last_clean":"2024-03-04T06:55:13.102401+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102401+0000","last_undegraded":"2024-03-04T06:55:13.102401+0000","last_fullsized":"2024-03-04T06:55:13.102401+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114691+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114691+0000","last_peered":"2024-03-04T06:55:13.114691+0000","last_clean":"2024-03-04T06:55:13.114691+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114691+0000","last_undegraded":"2024-03-04T06:55:13.114691+0000","last_fullsized":"2024-03-04T06:55:13.114691+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096824+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096824+0000","last_peered":"2024-03-04T06:55:13.096824+0000","last_clean":"2024-03-04T06:55:13.096824+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096824+0000","last_undegraded":"2024-03-04T06:55:13.096824+0000","last_fullsized":"2024-03-04T06:55:13.096824+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097239+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097239+0000","last_peered":"2024-03-04T06:55:13.097239+0000","last_clean":"2024-03-04T06:55:13.097239+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097239+0000","last_undegraded":"2024-03-04T06:55:13.097239+0000","last_fullsized":"2024-03-04T06:55:13.097239+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102489+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102489+0000","last_peered":"2024-03-04T06:55:13.102489+0000","last_clean":"2024-03-04T06:55:13.102489+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102489+0000","last_undegraded":"2024-03-04T06:55:13.102489+0000","last_fullsized":"2024-03-04T06:55:13.102489+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4365,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.315099+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:13.315099+0000","last_peered":"2024-03-04T06:55:13.315099+0000","last_clean":"2024-03-04T06:55:13.315099+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:13.315099+0000","last_undegraded":"2024-03-04T06:55:13.315099+0000","last_fullsized":"2024-03-04T06:55:13.315099+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115541+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:13.115541+0000","last_peered":"2024-03-04T06:55:13.115541+0000","last_clean":"2024-03-04T06:55:13.115541+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:13.115541+0000","last_undegraded":"2024-03-04T06:55:13.115541+0000","last_fullsized":"2024-03-04T06:55:13.115541+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105888+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:13.105888+0000","last_peered":"2024-03-04T06:55:13.105888+0000","last_clean":"2024-03-04T06:55:13.105888+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:13.105888+0000","last_undegraded":"2024-03-04T06:55:13.105888+0000","last_fullsized":"2024-03-04T06:55:13.105888+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4599,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.322375+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.322375+0000","last_peered":"2024-03-04T06:55:13.322375+0000","last_clean":"2024-03-04T06:55:13.322375+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.322375+0000","last_undegraded":"2024-03-04T06:55:13.322375+0000","last_fullsized":"2024-03-04T06:55:13.322375+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097504+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097504+0000","last_peered":"2024-03-04T06:55:13.097504+0000","last_clean":"2024-03-04T06:55:13.097504+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097504+0000","last_undegraded":"2024-03-04T06:55:13.097504+0000","last_fullsized":"2024-03-04T06:55:13.097504+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105586+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.105586+0000","last_peered":"2024-03-04T06:55:13.105586+0000","last_clean":"2024-03-04T06:55:13.105586+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.105586+0000","last_undegraded":"2024-03-04T06:55:13.105586+0000","last_fullsized":"2024-03-04T06:55:13.105586+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114524+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:13.114524+0000","last_peered":"2024-03-04T06:55:13.114524+0000","last_clean":"2024-03-04T06:55:13.114524+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:13.114524+0000","last_undegraded":"2024-03-04T06:55:13.114524+0000","last_fullsized":"2024-03-04T06:55:13.114524+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096648+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:13.096648+0000","last_peered":"2024-03-04T06:55:13.096648+0000","last_clean":"2024-03-04T06:55:13.096648+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:13.096648+0000","last_undegraded":"2024-03-04T06:55:13.096648+0000","last_fullsized":"2024-03-04T06:55:13.096648+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105999+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.105999+0000","last_peered":"2024-03-04T06:55:13.105999+0000","last_clean":"2024-03-04T06:55:13.105999+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.105999+0000","last_undegraded":"2024-03-04T06:55:13.105999+0000","last_fullsized":"2024-03-04T06:55:13.105999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117390+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117390+0000","last_peered":"2024-03-04T06:55:13.117390+0000","last_clean":"2024-03-04T06:55:13.117390+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117390+0000","last_undegraded":"2024-03-04T06:55:13.117390+0000","last_fullsized":"2024-03-04T06:55:13.117390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096810+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096810+0000","last_peered":"2024-03-04T06:55:13.096810+0000","last_clean":"2024-03-04T06:55:13.096810+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096810+0000","last_undegraded":"2024-03-04T06:55:13.096810+0000","last_fullsized":"2024-03-04T06:55:13.096810+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115428+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.115428+0000","last_peered":"2024-03-04T06:55:13.115428+0000","last_clean":"2024-03-04T06:55:13.115428+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.115428+0000","last_undegraded":"2024-03-04T06:55:13.115428+0000","last_fullsized":"2024-03-04T06:55:13.115428+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115286+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115286+0000","last_peered":"2024-03-04T06:55:13.115286+0000","last_clean":"2024-03-04T06:55:13.115286+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115286+0000","last_undegraded":"2024-03-04T06:55:13.115286+0000","last_fullsized":"2024-03-04T06:55:13.115286+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097481+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097481+0000","last_peered":"2024-03-04T06:55:13.097481+0000","last_clean":"2024-03-04T06:55:13.097481+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097481+0000","last_undegraded":"2024-03-04T06:55:13.097481+0000","last_fullsized":"2024-03-04T06:55:13.097481+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105275+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:13.105275+0000","last_peered":"2024-03-04T06:55:13.105275+0000","last_clean":"2024-03-04T06:55:13.105275+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:13.105275+0000","last_undegraded":"2024-03-04T06:55:13.105275+0000","last_fullsized":"2024-03-04T06:55:13.105275+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105576+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:13.105576+0000","last_peered":"2024-03-04T06:55:13.105576+0000","last_clean":"2024-03-04T06:55:13.105576+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:13.105576+0000","last_undegraded":"2024-03-04T06:55:13.105576+0000","last_fullsized":"2024-03-04T06:55:13.105576+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116864+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116864+0000","last_peered":"2024-03-04T06:55:13.116864+0000","last_clean":"2024-03-04T06:55:13.116864+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116864+0000","last_undegraded":"2024-03-04T06:55:13.116864+0000","last_fullsized":"2024-03-04T06:55:13.116864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114836+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114836+0000","last_peered":"2024-03-04T06:55:13.114836+0000","last_clean":"2024-03-04T06:55:13.114836+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114836+0000","last_undegraded":"2024-03-04T06:55:13.114836+0000","last_fullsized":"2024-03-04T06:55:13.114836+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503446,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648093,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142400,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287047,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997753,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885810,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937387,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792740,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:57:13.972 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:13.972 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:13.972 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:13.972 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:13.972 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:13.972 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:13.972 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:13.973 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:13.973 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:13.973 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:13.973 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:57:14.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:14 smithi203 ceph-mon[85573]: pgmap v981: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:14.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:14 smithi203 ceph-mon[85573]: from='client.34551 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:14.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:14 smithi137 ceph-mon[91314]: pgmap v981: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:14.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:14 smithi137 ceph-mon[91314]: from='client.34551 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:14.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:14 smithi137 ceph-mon[88869]: pgmap v981: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:14.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:14 smithi137 ceph-mon[88869]: from='client.34551 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:15.542 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:57:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:57:15] "GET /metrics HTTP/1.1" 200 36336 "" "Prometheus/2.43.0" 2024-03-04T06:57:16.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:16 smithi137 ceph-mon[88869]: pgmap v982: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:16.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:16 smithi137 ceph-mon[91314]: pgmap v982: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:16.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:16 smithi203 ceph-mon[85573]: pgmap v982: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:18.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:18 smithi203 ceph-mon[85573]: pgmap v983: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:18.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:18 smithi137 ceph-mon[88869]: pgmap v983: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:18.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:18 smithi137 ceph-mon[91314]: pgmap v983: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:20.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:20 smithi203 ceph-mon[85573]: pgmap v984: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:20.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:20 smithi137 ceph-mon[88869]: pgmap v984: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:20.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:20 smithi137 ceph-mon[91314]: pgmap v984: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:22.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:22 smithi203 ceph-mon[85573]: pgmap v985: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:22.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:22 smithi137 ceph-mon[88869]: pgmap v985: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:22.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:22 smithi137 ceph-mon[91314]: pgmap v985: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:23.974 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:57:24.195 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:57:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:24 smithi203 ceph-mon[85573]: pgmap v986: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:57:24.623 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:24 smithi137 ceph-mon[88869]: pgmap v986: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:24.623 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:57:24.623 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:24 smithi137 ceph-mon[91314]: pgmap v986: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:24.623 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:57:25.542 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:57:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:57:25] "GET /metrics HTTP/1.1" 200 36331 "" "Prometheus/2.43.0" 2024-03-04T06:57:25.982 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:57:25.984 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:57:26.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:26 smithi137 ceph-mon[88869]: pgmap v987: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:26.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:26 smithi137 ceph-mon[91314]: pgmap v987: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:26.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:26 smithi203 ceph-mon[85573]: pgmap v987: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:26.637 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":987,"stamp":"2024-03-04T06:57:24.498367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003602"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103340+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103340+0000","last_peered":"2024-03-04T06:55:13.103340+0000","last_clean":"2024-03-04T06:55:13.103340+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103340+0000","last_undegraded":"2024-03-04T06:55:13.103340+0000","last_fullsized":"2024-03-04T06:55:13.103340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117002+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.117002+0000","last_peered":"2024-03-04T06:55:13.117002+0000","last_clean":"2024-03-04T06:55:13.117002+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.117002+0000","last_undegraded":"2024-03-04T06:55:13.117002+0000","last_fullsized":"2024-03-04T06:55:13.117002+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115416+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115416+0000","last_peered":"2024-03-04T06:55:13.115416+0000","last_clean":"2024-03-04T06:55:13.115416+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115416+0000","last_undegraded":"2024-03-04T06:55:13.115416+0000","last_fullsized":"2024-03-04T06:55:13.115416+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106163+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106163+0000","last_peered":"2024-03-04T06:55:13.106163+0000","last_clean":"2024-03-04T06:55:13.106163+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106163+0000","last_undegraded":"2024-03-04T06:55:13.106163+0000","last_fullsized":"2024-03-04T06:55:13.106163+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101948+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.101948+0000","last_peered":"2024-03-04T06:55:13.101948+0000","last_clean":"2024-03-04T06:55:13.101948+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.101948+0000","last_undegraded":"2024-03-04T06:55:13.101948+0000","last_fullsized":"2024-03-04T06:55:13.101948+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106089+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106089+0000","last_peered":"2024-03-04T06:55:13.106089+0000","last_clean":"2024-03-04T06:55:13.106089+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106089+0000","last_undegraded":"2024-03-04T06:55:13.106089+0000","last_fullsized":"2024-03-04T06:55:13.106089+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101755+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101755+0000","last_peered":"2024-03-04T06:55:13.101755+0000","last_clean":"2024-03-04T06:55:13.101755+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101755+0000","last_undegraded":"2024-03-04T06:55:13.101755+0000","last_fullsized":"2024-03-04T06:55:13.101755+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097051+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:13.097051+0000","last_peered":"2024-03-04T06:55:13.097051+0000","last_clean":"2024-03-04T06:55:13.097051+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:13.097051+0000","last_undegraded":"2024-03-04T06:55:13.097051+0000","last_fullsized":"2024-03-04T06:55:13.097051+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1064,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103046+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.103046+0000","last_peered":"2024-03-04T06:55:13.103046+0000","last_clean":"2024-03-04T06:55:13.103046+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.103046+0000","last_undegraded":"2024-03-04T06:55:13.103046+0000","last_fullsized":"2024-03-04T06:55:13.103046+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115007+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.115007+0000","last_peered":"2024-03-04T06:55:13.115007+0000","last_clean":"2024-03-04T06:55:13.115007+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.115007+0000","last_undegraded":"2024-03-04T06:55:13.115007+0000","last_fullsized":"2024-03-04T06:55:13.115007+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114852+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114852+0000","last_peered":"2024-03-04T06:55:13.114852+0000","last_clean":"2024-03-04T06:55:13.114852+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114852+0000","last_undegraded":"2024-03-04T06:55:13.114852+0000","last_fullsized":"2024-03-04T06:55:13.114852+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1154,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095971+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:13.095971+0000","last_peered":"2024-03-04T06:55:13.095971+0000","last_clean":"2024-03-04T06:55:13.095971+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:13.095971+0000","last_undegraded":"2024-03-04T06:55:13.095971+0000","last_fullsized":"2024-03-04T06:55:13.095971+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1198,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098969+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.098969+0000","last_peered":"2024-03-04T06:55:13.098969+0000","last_clean":"2024-03-04T06:55:13.098969+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.098969+0000","last_undegraded":"2024-03-04T06:55:13.098969+0000","last_fullsized":"2024-03-04T06:55:13.098969+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115324+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:13.115324+0000","last_peered":"2024-03-04T06:55:13.115324+0000","last_clean":"2024-03-04T06:55:13.115324+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:13.115324+0000","last_undegraded":"2024-03-04T06:55:13.115324+0000","last_fullsized":"2024-03-04T06:55:13.115324+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115730+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115730+0000","last_peered":"2024-03-04T06:55:13.115730+0000","last_clean":"2024-03-04T06:55:13.115730+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115730+0000","last_undegraded":"2024-03-04T06:55:13.115730+0000","last_fullsized":"2024-03-04T06:55:13.115730+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104995+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104995+0000","last_peered":"2024-03-04T06:55:13.104995+0000","last_clean":"2024-03-04T06:55:13.104995+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104995+0000","last_undegraded":"2024-03-04T06:55:13.104995+0000","last_fullsized":"2024-03-04T06:55:13.104995+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.107002+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.107002+0000","last_peered":"2024-03-04T06:55:13.107002+0000","last_clean":"2024-03-04T06:55:13.107002+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.107002+0000","last_undegraded":"2024-03-04T06:55:13.107002+0000","last_fullsized":"2024-03-04T06:55:13.107002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096941+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096941+0000","last_peered":"2024-03-04T06:55:13.096941+0000","last_clean":"2024-03-04T06:55:13.096941+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096941+0000","last_undegraded":"2024-03-04T06:55:13.096941+0000","last_fullsized":"2024-03-04T06:55:13.096941+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102303+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102303+0000","last_peered":"2024-03-04T06:55:13.102303+0000","last_clean":"2024-03-04T06:55:13.102303+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102303+0000","last_undegraded":"2024-03-04T06:55:13.102303+0000","last_fullsized":"2024-03-04T06:55:13.102303+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116614+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116614+0000","last_peered":"2024-03-04T06:55:13.116614+0000","last_clean":"2024-03-04T06:55:13.116614+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116614+0000","last_undegraded":"2024-03-04T06:55:13.116614+0000","last_fullsized":"2024-03-04T06:55:13.116614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097609+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:13.097609+0000","last_peered":"2024-03-04T06:55:13.097609+0000","last_clean":"2024-03-04T06:55:13.097609+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:13.097609+0000","last_undegraded":"2024-03-04T06:55:13.097609+0000","last_fullsized":"2024-03-04T06:55:13.097609+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097848+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:13.097848+0000","last_peered":"2024-03-04T06:55:13.097848+0000","last_clean":"2024-03-04T06:55:13.097848+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:13.097848+0000","last_undegraded":"2024-03-04T06:55:13.097848+0000","last_fullsized":"2024-03-04T06:55:13.097848+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116801+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.116801+0000","last_peered":"2024-03-04T06:55:13.116801+0000","last_clean":"2024-03-04T06:55:13.116801+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.116801+0000","last_undegraded":"2024-03-04T06:55:13.116801+0000","last_fullsized":"2024-03-04T06:55:13.116801+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1234,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098569+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098569+0000","last_peered":"2024-03-04T06:55:13.098569+0000","last_clean":"2024-03-04T06:55:13.098569+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098569+0000","last_undegraded":"2024-03-04T06:55:13.098569+0000","last_fullsized":"2024-03-04T06:55:13.098569+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1221,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097506+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097506+0000","last_peered":"2024-03-04T06:55:13.097506+0000","last_clean":"2024-03-04T06:55:13.097506+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097506+0000","last_undegraded":"2024-03-04T06:55:13.097506+0000","last_fullsized":"2024-03-04T06:55:13.097506+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1068,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102398+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102398+0000","last_peered":"2024-03-04T06:55:13.102398+0000","last_clean":"2024-03-04T06:55:13.102398+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102398+0000","last_undegraded":"2024-03-04T06:55:13.102398+0000","last_fullsized":"2024-03-04T06:55:13.102398+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106216+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106216+0000","last_peered":"2024-03-04T06:55:13.106216+0000","last_clean":"2024-03-04T06:55:13.106216+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106216+0000","last_undegraded":"2024-03-04T06:55:13.106216+0000","last_fullsized":"2024-03-04T06:55:13.106216+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098905+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:13.098905+0000","last_peered":"2024-03-04T06:55:13.098905+0000","last_clean":"2024-03-04T06:55:13.098905+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:13.098905+0000","last_undegraded":"2024-03-04T06:55:13.098905+0000","last_fullsized":"2024-03-04T06:55:13.098905+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1188,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096052+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.096052+0000","last_peered":"2024-03-04T06:55:13.096052+0000","last_clean":"2024-03-04T06:55:13.096052+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.096052+0000","last_undegraded":"2024-03-04T06:55:13.096052+0000","last_fullsized":"2024-03-04T06:55:13.096052+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114709+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114709+0000","last_peered":"2024-03-04T06:55:13.114709+0000","last_clean":"2024-03-04T06:55:13.114709+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114709+0000","last_undegraded":"2024-03-04T06:55:13.114709+0000","last_fullsized":"2024-03-04T06:55:13.114709+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.118051+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.118051+0000","last_peered":"2024-03-04T06:55:13.118051+0000","last_clean":"2024-03-04T06:55:13.118051+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.118051+0000","last_undegraded":"2024-03-04T06:55:13.118051+0000","last_fullsized":"2024-03-04T06:55:13.118051+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096686+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096686+0000","last_peered":"2024-03-04T06:55:13.096686+0000","last_clean":"2024-03-04T06:55:13.096686+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096686+0000","last_undegraded":"2024-03-04T06:55:13.096686+0000","last_fullsized":"2024-03-04T06:55:13.096686+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097180+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097180+0000","last_peered":"2024-03-04T06:55:13.097180+0000","last_clean":"2024-03-04T06:55:13.097180+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097180+0000","last_undegraded":"2024-03-04T06:55:13.097180+0000","last_fullsized":"2024-03-04T06:55:13.097180+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105593+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105593+0000","last_peered":"2024-03-04T06:55:13.105593+0000","last_clean":"2024-03-04T06:55:13.105593+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105593+0000","last_undegraded":"2024-03-04T06:55:13.105593+0000","last_fullsized":"2024-03-04T06:55:13.105593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115824+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115824+0000","last_peered":"2024-03-04T06:55:13.115824+0000","last_clean":"2024-03-04T06:55:13.115824+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115824+0000","last_undegraded":"2024-03-04T06:55:13.115824+0000","last_fullsized":"2024-03-04T06:55:13.115824+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115145+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115145+0000","last_peered":"2024-03-04T06:55:13.115145+0000","last_clean":"2024-03-04T06:55:13.115145+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115145+0000","last_undegraded":"2024-03-04T06:55:13.115145+0000","last_fullsized":"2024-03-04T06:55:13.115145+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1110,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105468+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105468+0000","last_peered":"2024-03-04T06:55:13.105468+0000","last_clean":"2024-03-04T06:55:13.105468+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105468+0000","last_undegraded":"2024-03-04T06:55:13.105468+0000","last_fullsized":"2024-03-04T06:55:13.105468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105915+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105915+0000","last_peered":"2024-03-04T06:55:13.105915+0000","last_clean":"2024-03-04T06:55:13.105915+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105915+0000","last_undegraded":"2024-03-04T06:55:13.105915+0000","last_fullsized":"2024-03-04T06:55:13.105915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116155+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116155+0000","last_peered":"2024-03-04T06:55:13.116155+0000","last_clean":"2024-03-04T06:55:13.116155+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116155+0000","last_undegraded":"2024-03-04T06:55:13.116155+0000","last_fullsized":"2024-03-04T06:55:13.116155+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116083+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116083+0000","last_peered":"2024-03-04T06:55:13.116083+0000","last_clean":"2024-03-04T06:55:13.116083+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116083+0000","last_undegraded":"2024-03-04T06:55:13.116083+0000","last_fullsized":"2024-03-04T06:55:13.116083+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096448+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:13.096448+0000","last_peered":"2024-03-04T06:55:13.096448+0000","last_clean":"2024-03-04T06:55:13.096448+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:13.096448+0000","last_undegraded":"2024-03-04T06:55:13.096448+0000","last_fullsized":"2024-03-04T06:55:13.096448+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114988+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114988+0000","last_peered":"2024-03-04T06:55:13.114988+0000","last_clean":"2024-03-04T06:55:13.114988+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114988+0000","last_undegraded":"2024-03-04T06:55:13.114988+0000","last_fullsized":"2024-03-04T06:55:13.114988+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102665+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102665+0000","last_peered":"2024-03-04T06:55:13.102665+0000","last_clean":"2024-03-04T06:55:13.102665+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102665+0000","last_undegraded":"2024-03-04T06:55:13.102665+0000","last_fullsized":"2024-03-04T06:55:13.102665+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117741+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:13.117741+0000","last_peered":"2024-03-04T06:55:13.117741+0000","last_clean":"2024-03-04T06:55:13.117741+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:13.117741+0000","last_undegraded":"2024-03-04T06:55:13.117741+0000","last_fullsized":"2024-03-04T06:55:13.117741+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098537+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098537+0000","last_peered":"2024-03-04T06:55:13.098537+0000","last_clean":"2024-03-04T06:55:13.098537+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098537+0000","last_undegraded":"2024-03-04T06:55:13.098537+0000","last_fullsized":"2024-03-04T06:55:13.098537+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105922+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105922+0000","last_peered":"2024-03-04T06:55:13.105922+0000","last_clean":"2024-03-04T06:55:13.105922+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105922+0000","last_undegraded":"2024-03-04T06:55:13.105922+0000","last_fullsized":"2024-03-04T06:55:13.105922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102561+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102561+0000","last_peered":"2024-03-04T06:55:13.102561+0000","last_clean":"2024-03-04T06:55:13.102561+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102561+0000","last_undegraded":"2024-03-04T06:55:13.102561+0000","last_fullsized":"2024-03-04T06:55:13.102561+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114471+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114471+0000","last_peered":"2024-03-04T06:55:13.114471+0000","last_clean":"2024-03-04T06:55:13.114471+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114471+0000","last_undegraded":"2024-03-04T06:55:13.114471+0000","last_fullsized":"2024-03-04T06:55:13.114471+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114484+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114484+0000","last_peered":"2024-03-04T06:55:13.114484+0000","last_clean":"2024-03-04T06:55:13.114484+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114484+0000","last_undegraded":"2024-03-04T06:55:13.114484+0000","last_fullsized":"2024-03-04T06:55:13.114484+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1252,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101837+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101837+0000","last_peered":"2024-03-04T06:55:13.101837+0000","last_clean":"2024-03-04T06:55:13.101837+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101837+0000","last_undegraded":"2024-03-04T06:55:13.101837+0000","last_fullsized":"2024-03-04T06:55:13.101837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3576,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096470+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:13.096470+0000","last_peered":"2024-03-04T06:55:13.096470+0000","last_clean":"2024-03-04T06:55:13.096470+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:13.096470+0000","last_undegraded":"2024-03-04T06:55:13.096470+0000","last_fullsized":"2024-03-04T06:55:13.096470+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096992+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096992+0000","last_peered":"2024-03-04T06:55:13.096992+0000","last_clean":"2024-03-04T06:55:13.096992+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096992+0000","last_undegraded":"2024-03-04T06:55:13.096992+0000","last_fullsized":"2024-03-04T06:55:13.096992+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102943+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102943+0000","last_peered":"2024-03-04T06:55:13.102943+0000","last_clean":"2024-03-04T06:55:13.102943+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102943+0000","last_undegraded":"2024-03-04T06:55:13.102943+0000","last_fullsized":"2024-03-04T06:55:13.102943+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17115,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117976+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117976+0000","last_peered":"2024-03-04T06:55:13.117976+0000","last_clean":"2024-03-04T06:55:13.117976+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117976+0000","last_undegraded":"2024-03-04T06:55:13.117976+0000","last_fullsized":"2024-03-04T06:55:13.117976+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115088+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115088+0000","last_peered":"2024-03-04T06:55:13.115088+0000","last_clean":"2024-03-04T06:55:13.115088+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115088+0000","last_undegraded":"2024-03-04T06:55:13.115088+0000","last_fullsized":"2024-03-04T06:55:13.115088+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116699+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116699+0000","last_peered":"2024-03-04T06:55:13.116699+0000","last_clean":"2024-03-04T06:55:13.116699+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116699+0000","last_undegraded":"2024-03-04T06:55:13.116699+0000","last_fullsized":"2024-03-04T06:55:13.116699+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106020+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.106020+0000","last_peered":"2024-03-04T06:55:13.106020+0000","last_clean":"2024-03-04T06:55:13.106020+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.106020+0000","last_undegraded":"2024-03-04T06:55:13.106020+0000","last_fullsized":"2024-03-04T06:55:13.106020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4385,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117010+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.117010+0000","last_peered":"2024-03-04T06:55:13.117010+0000","last_clean":"2024-03-04T06:55:13.117010+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.117010+0000","last_undegraded":"2024-03-04T06:55:13.117010+0000","last_fullsized":"2024-03-04T06:55:13.117010+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115964+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115964+0000","last_peered":"2024-03-04T06:55:13.115964+0000","last_clean":"2024-03-04T06:55:13.115964+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115964+0000","last_undegraded":"2024-03-04T06:55:13.115964+0000","last_fullsized":"2024-03-04T06:55:13.115964+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105737+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105737+0000","last_peered":"2024-03-04T06:55:13.105737+0000","last_clean":"2024-03-04T06:55:13.105737+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105737+0000","last_undegraded":"2024-03-04T06:55:13.105737+0000","last_fullsized":"2024-03-04T06:55:13.105737+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096287+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096287+0000","last_peered":"2024-03-04T06:55:13.096287+0000","last_clean":"2024-03-04T06:55:13.096287+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096287+0000","last_undegraded":"2024-03-04T06:55:13.096287+0000","last_fullsized":"2024-03-04T06:55:13.096287+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5638,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097306+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:13.097306+0000","last_peered":"2024-03-04T06:55:13.097306+0000","last_clean":"2024-03-04T06:55:13.097306+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:13.097306+0000","last_undegraded":"2024-03-04T06:55:13.097306+0000","last_fullsized":"2024-03-04T06:55:13.097306+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141294+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.141294+0000","last_peered":"2024-03-04T06:55:13.141294+0000","last_clean":"2024-03-04T06:55:13.141294+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.141294+0000","last_undegraded":"2024-03-04T06:55:13.141294+0000","last_fullsized":"2024-03-04T06:55:13.141294+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114171+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114171+0000","last_peered":"2024-03-04T06:55:13.114171+0000","last_clean":"2024-03-04T06:55:13.114171+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114171+0000","last_undegraded":"2024-03-04T06:55:13.114171+0000","last_fullsized":"2024-03-04T06:55:13.114171+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096536+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:13.096536+0000","last_peered":"2024-03-04T06:55:13.096536+0000","last_clean":"2024-03-04T06:55:13.096536+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:13.096536+0000","last_undegraded":"2024-03-04T06:55:13.096536+0000","last_fullsized":"2024-03-04T06:55:13.096536+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4014,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107389+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.107389+0000","last_peered":"2024-03-04T06:55:13.107389+0000","last_clean":"2024-03-04T06:55:13.107389+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.107389+0000","last_undegraded":"2024-03-04T06:55:13.107389+0000","last_fullsized":"2024-03-04T06:55:13.107389+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1090,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115070+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:13.115070+0000","last_peered":"2024-03-04T06:55:13.115070+0000","last_clean":"2024-03-04T06:55:13.115070+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:13.115070+0000","last_undegraded":"2024-03-04T06:55:13.115070+0000","last_fullsized":"2024-03-04T06:55:13.115070+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098424+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098424+0000","last_peered":"2024-03-04T06:55:13.098424+0000","last_clean":"2024-03-04T06:55:13.098424+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098424+0000","last_undegraded":"2024-03-04T06:55:13.098424+0000","last_fullsized":"2024-03-04T06:55:13.098424+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105228+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105228+0000","last_peered":"2024-03-04T06:55:13.105228+0000","last_clean":"2024-03-04T06:55:13.105228+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105228+0000","last_undegraded":"2024-03-04T06:55:13.105228+0000","last_fullsized":"2024-03-04T06:55:13.105228+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1549,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101736+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101736+0000","last_peered":"2024-03-04T06:55:13.101736+0000","last_clean":"2024-03-04T06:55:13.101736+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101736+0000","last_undegraded":"2024-03-04T06:55:13.101736+0000","last_fullsized":"2024-03-04T06:55:13.101736+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3949,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.128010+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:13.128010+0000","last_peered":"2024-03-04T06:55:13.128010+0000","last_clean":"2024-03-04T06:55:13.128010+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:13.128010+0000","last_undegraded":"2024-03-04T06:55:13.128010+0000","last_fullsized":"2024-03-04T06:55:13.128010+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117375+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117375+0000","last_peered":"2024-03-04T06:55:13.117375+0000","last_clean":"2024-03-04T06:55:13.117375+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117375+0000","last_undegraded":"2024-03-04T06:55:13.117375+0000","last_fullsized":"2024-03-04T06:55:13.117375+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096315+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:13.096315+0000","last_peered":"2024-03-04T06:55:13.096315+0000","last_clean":"2024-03-04T06:55:13.096315+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:13.096315+0000","last_undegraded":"2024-03-04T06:55:13.096315+0000","last_fullsized":"2024-03-04T06:55:13.096315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101691+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101691+0000","last_peered":"2024-03-04T06:55:13.101691+0000","last_clean":"2024-03-04T06:55:13.101691+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101691+0000","last_undegraded":"2024-03-04T06:55:13.101691+0000","last_fullsized":"2024-03-04T06:55:13.101691+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15290,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.174192+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:13.174192+0000","last_peered":"2024-03-04T06:55:13.174192+0000","last_clean":"2024-03-04T06:55:13.174192+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:13.174192+0000","last_undegraded":"2024-03-04T06:55:13.174192+0000","last_fullsized":"2024-03-04T06:55:13.174192+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117527+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117527+0000","last_peered":"2024-03-04T06:55:13.117527+0000","last_clean":"2024-03-04T06:55:13.117527+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117527+0000","last_undegraded":"2024-03-04T06:55:13.117527+0000","last_fullsized":"2024-03-04T06:55:13.117527+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102583+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102583+0000","last_peered":"2024-03-04T06:55:13.102583+0000","last_clean":"2024-03-04T06:55:13.102583+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102583+0000","last_undegraded":"2024-03-04T06:55:13.102583+0000","last_fullsized":"2024-03-04T06:55:13.102583+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116059+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116059+0000","last_peered":"2024-03-04T06:55:13.116059+0000","last_clean":"2024-03-04T06:55:13.116059+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116059+0000","last_undegraded":"2024-03-04T06:55:13.116059+0000","last_fullsized":"2024-03-04T06:55:13.116059+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4378,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097496+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097496+0000","last_peered":"2024-03-04T06:55:13.097496+0000","last_clean":"2024-03-04T06:55:13.097496+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097496+0000","last_undegraded":"2024-03-04T06:55:13.097496+0000","last_fullsized":"2024-03-04T06:55:13.097496+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097599+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:13.097599+0000","last_peered":"2024-03-04T06:55:13.097599+0000","last_clean":"2024-03-04T06:55:13.097599+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:13.097599+0000","last_undegraded":"2024-03-04T06:55:13.097599+0000","last_fullsized":"2024-03-04T06:55:13.097599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141284+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.141284+0000","last_peered":"2024-03-04T06:55:13.141284+0000","last_clean":"2024-03-04T06:55:13.141284+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.141284+0000","last_undegraded":"2024-03-04T06:55:13.141284+0000","last_fullsized":"2024-03-04T06:55:13.141284+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097249+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097249+0000","last_peered":"2024-03-04T06:55:13.097249+0000","last_clean":"2024-03-04T06:55:13.097249+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097249+0000","last_undegraded":"2024-03-04T06:55:13.097249+0000","last_fullsized":"2024-03-04T06:55:13.097249+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4608,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.311904+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:13.311904+0000","last_peered":"2024-03-04T06:55:13.311904+0000","last_clean":"2024-03-04T06:55:13.311904+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:13.311904+0000","last_undegraded":"2024-03-04T06:55:13.311904+0000","last_fullsized":"2024-03-04T06:55:13.311904+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095704+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095704+0000","last_peered":"2024-03-04T06:55:13.095704+0000","last_clean":"2024-03-04T06:55:13.095704+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095704+0000","last_undegraded":"2024-03-04T06:55:13.095704+0000","last_fullsized":"2024-03-04T06:55:13.095704+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1077,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115185+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115185+0000","last_peered":"2024-03-04T06:55:13.115185+0000","last_clean":"2024-03-04T06:55:13.115185+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115185+0000","last_undegraded":"2024-03-04T06:55:13.115185+0000","last_fullsized":"2024-03-04T06:55:13.115185+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115644+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115644+0000","last_peered":"2024-03-04T06:55:13.115644+0000","last_clean":"2024-03-04T06:55:13.115644+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115644+0000","last_undegraded":"2024-03-04T06:55:13.115644+0000","last_fullsized":"2024-03-04T06:55:13.115644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4633,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107390+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:13.107390+0000","last_peered":"2024-03-04T06:55:13.107390+0000","last_clean":"2024-03-04T06:55:13.107390+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:13.107390+0000","last_undegraded":"2024-03-04T06:55:13.107390+0000","last_fullsized":"2024-03-04T06:55:13.107390+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101972+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101972+0000","last_peered":"2024-03-04T06:55:13.101972+0000","last_clean":"2024-03-04T06:55:13.101972+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101972+0000","last_undegraded":"2024-03-04T06:55:13.101972+0000","last_fullsized":"2024-03-04T06:55:13.101972+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1184,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095689+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095689+0000","last_peered":"2024-03-04T06:55:13.095689+0000","last_clean":"2024-03-04T06:55:13.095689+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095689+0000","last_undegraded":"2024-03-04T06:55:13.095689+0000","last_fullsized":"2024-03-04T06:55:13.095689+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5157,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.113366+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.113366+0000","last_peered":"2024-03-04T06:55:13.113366+0000","last_clean":"2024-03-04T06:55:13.113366+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.113366+0000","last_undegraded":"2024-03-04T06:55:13.113366+0000","last_fullsized":"2024-03-04T06:55:13.113366+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141219+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.141219+0000","last_peered":"2024-03-04T06:55:13.141219+0000","last_clean":"2024-03-04T06:55:13.141219+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.141219+0000","last_undegraded":"2024-03-04T06:55:13.141219+0000","last_fullsized":"2024-03-04T06:55:13.141219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097821+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097821+0000","last_peered":"2024-03-04T06:55:13.097821+0000","last_clean":"2024-03-04T06:55:13.097821+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097821+0000","last_undegraded":"2024-03-04T06:55:13.097821+0000","last_fullsized":"2024-03-04T06:55:13.097821+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4718,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.169321+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.169321+0000","last_peered":"2024-03-04T06:55:13.169321+0000","last_clean":"2024-03-04T06:55:13.169321+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.169321+0000","last_undegraded":"2024-03-04T06:55:13.169321+0000","last_fullsized":"2024-03-04T06:55:13.169321+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141246+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.141246+0000","last_peered":"2024-03-04T06:55:13.141246+0000","last_clean":"2024-03-04T06:55:13.141246+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.141246+0000","last_undegraded":"2024-03-04T06:55:13.141246+0000","last_fullsized":"2024-03-04T06:55:13.141246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098839+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098839+0000","last_peered":"2024-03-04T06:55:13.098839+0000","last_clean":"2024-03-04T06:55:13.098839+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098839+0000","last_undegraded":"2024-03-04T06:55:13.098839+0000","last_fullsized":"2024-03-04T06:55:13.098839+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5553,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117009+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:13.117009+0000","last_peered":"2024-03-04T06:55:13.117009+0000","last_clean":"2024-03-04T06:55:13.117009+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:13.117009+0000","last_undegraded":"2024-03-04T06:55:13.117009+0000","last_fullsized":"2024-03-04T06:55:13.117009+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102401+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102401+0000","last_peered":"2024-03-04T06:55:13.102401+0000","last_clean":"2024-03-04T06:55:13.102401+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102401+0000","last_undegraded":"2024-03-04T06:55:13.102401+0000","last_fullsized":"2024-03-04T06:55:13.102401+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114691+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114691+0000","last_peered":"2024-03-04T06:55:13.114691+0000","last_clean":"2024-03-04T06:55:13.114691+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114691+0000","last_undegraded":"2024-03-04T06:55:13.114691+0000","last_fullsized":"2024-03-04T06:55:13.114691+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096824+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096824+0000","last_peered":"2024-03-04T06:55:13.096824+0000","last_clean":"2024-03-04T06:55:13.096824+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096824+0000","last_undegraded":"2024-03-04T06:55:13.096824+0000","last_fullsized":"2024-03-04T06:55:13.096824+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097239+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097239+0000","last_peered":"2024-03-04T06:55:13.097239+0000","last_clean":"2024-03-04T06:55:13.097239+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097239+0000","last_undegraded":"2024-03-04T06:55:13.097239+0000","last_fullsized":"2024-03-04T06:55:13.097239+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102489+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102489+0000","last_peered":"2024-03-04T06:55:13.102489+0000","last_clean":"2024-03-04T06:55:13.102489+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102489+0000","last_undegraded":"2024-03-04T06:55:13.102489+0000","last_fullsized":"2024-03-04T06:55:13.102489+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4365,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.315099+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:13.315099+0000","last_peered":"2024-03-04T06:55:13.315099+0000","last_clean":"2024-03-04T06:55:13.315099+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:13.315099+0000","last_undegraded":"2024-03-04T06:55:13.315099+0000","last_fullsized":"2024-03-04T06:55:13.315099+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115541+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:13.115541+0000","last_peered":"2024-03-04T06:55:13.115541+0000","last_clean":"2024-03-04T06:55:13.115541+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:13.115541+0000","last_undegraded":"2024-03-04T06:55:13.115541+0000","last_fullsized":"2024-03-04T06:55:13.115541+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105888+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:13.105888+0000","last_peered":"2024-03-04T06:55:13.105888+0000","last_clean":"2024-03-04T06:55:13.105888+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:13.105888+0000","last_undegraded":"2024-03-04T06:55:13.105888+0000","last_fullsized":"2024-03-04T06:55:13.105888+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4599,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.322375+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.322375+0000","last_peered":"2024-03-04T06:55:13.322375+0000","last_clean":"2024-03-04T06:55:13.322375+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.322375+0000","last_undegraded":"2024-03-04T06:55:13.322375+0000","last_fullsized":"2024-03-04T06:55:13.322375+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097504+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097504+0000","last_peered":"2024-03-04T06:55:13.097504+0000","last_clean":"2024-03-04T06:55:13.097504+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097504+0000","last_undegraded":"2024-03-04T06:55:13.097504+0000","last_fullsized":"2024-03-04T06:55:13.097504+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105586+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.105586+0000","last_peered":"2024-03-04T06:55:13.105586+0000","last_clean":"2024-03-04T06:55:13.105586+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.105586+0000","last_undegraded":"2024-03-04T06:55:13.105586+0000","last_fullsized":"2024-03-04T06:55:13.105586+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114524+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:13.114524+0000","last_peered":"2024-03-04T06:55:13.114524+0000","last_clean":"2024-03-04T06:55:13.114524+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:13.114524+0000","last_undegraded":"2024-03-04T06:55:13.114524+0000","last_fullsized":"2024-03-04T06:55:13.114524+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096648+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:13.096648+0000","last_peered":"2024-03-04T06:55:13.096648+0000","last_clean":"2024-03-04T06:55:13.096648+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:13.096648+0000","last_undegraded":"2024-03-04T06:55:13.096648+0000","last_fullsized":"2024-03-04T06:55:13.096648+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106053+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.106053+0000","last_peered":"2024-03-04T06:55:13.106053+0000","last_clean":"2024-03-04T06:55:13.106053+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.106053+0000","last_undegraded":"2024-03-04T06:55:13.106053+0000","last_fullsized":"2024-03-04T06:55:13.106053+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117390+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117390+0000","last_peered":"2024-03-04T06:55:13.117390+0000","last_clean":"2024-03-04T06:55:13.117390+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117390+0000","last_undegraded":"2024-03-04T06:55:13.117390+0000","last_fullsized":"2024-03-04T06:55:13.117390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096810+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096810+0000","last_peered":"2024-03-04T06:55:13.096810+0000","last_clean":"2024-03-04T06:55:13.096810+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096810+0000","last_undegraded":"2024-03-04T06:55:13.096810+0000","last_fullsized":"2024-03-04T06:55:13.096810+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141268+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.141268+0000","last_peered":"2024-03-04T06:55:13.141268+0000","last_clean":"2024-03-04T06:55:13.141268+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.141268+0000","last_undegraded":"2024-03-04T06:55:13.141268+0000","last_fullsized":"2024-03-04T06:55:13.141268+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115286+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115286+0000","last_peered":"2024-03-04T06:55:13.115286+0000","last_clean":"2024-03-04T06:55:13.115286+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115286+0000","last_undegraded":"2024-03-04T06:55:13.115286+0000","last_fullsized":"2024-03-04T06:55:13.115286+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097481+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097481+0000","last_peered":"2024-03-04T06:55:13.097481+0000","last_clean":"2024-03-04T06:55:13.097481+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097481+0000","last_undegraded":"2024-03-04T06:55:13.097481+0000","last_fullsized":"2024-03-04T06:55:13.097481+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105275+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:13.105275+0000","last_peered":"2024-03-04T06:55:13.105275+0000","last_clean":"2024-03-04T06:55:13.105275+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:13.105275+0000","last_undegraded":"2024-03-04T06:55:13.105275+0000","last_fullsized":"2024-03-04T06:55:13.105275+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105576+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:13.105576+0000","last_peered":"2024-03-04T06:55:13.105576+0000","last_clean":"2024-03-04T06:55:13.105576+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:13.105576+0000","last_undegraded":"2024-03-04T06:55:13.105576+0000","last_fullsized":"2024-03-04T06:55:13.105576+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116911+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116911+0000","last_peered":"2024-03-04T06:55:13.116911+0000","last_clean":"2024-03-04T06:55:13.116911+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116911+0000","last_undegraded":"2024-03-04T06:55:13.116911+0000","last_fullsized":"2024-03-04T06:55:13.116911+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114836+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114836+0000","last_peered":"2024-03-04T06:55:13.114836+0000","last_clean":"2024-03-04T06:55:13.114836+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114836+0000","last_undegraded":"2024-03-04T06:55:13.114836+0000","last_fullsized":"2024-03-04T06:55:13.114836+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503448,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648096,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142403,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287050,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997756,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885812,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937390,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792743,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:57:26.643 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:26.643 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:26.643 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:26.643 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:26.643 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:26.643 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:26.643 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:26.643 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:26.643 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:26.644 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:26.644 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:57:27.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:27 smithi203 ceph-mon[85573]: from='client.34557 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:27.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:27 smithi137 ceph-mon[91314]: from='client.34557 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:27.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:27 smithi137 ceph-mon[88869]: from='client.34557 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:28.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:28 smithi203 ceph-mon[85573]: pgmap v988: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:28.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:28 smithi137 ceph-mon[88869]: pgmap v988: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:28.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:28 smithi137 ceph-mon[91314]: pgmap v988: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:30.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:30 smithi203 ceph-mon[85573]: pgmap v989: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:30.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:30 smithi137 ceph-mon[88869]: pgmap v989: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:30.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:30 smithi137 ceph-mon[91314]: pgmap v989: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:32.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:32 smithi203 ceph-mon[85573]: pgmap v990: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:32.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:32 smithi137 ceph-mon[88869]: pgmap v990: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:32.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:32 smithi137 ceph-mon[91314]: pgmap v990: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:34.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:34 smithi203 ceph-mon[85573]: pgmap v991: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:34.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:34 smithi137 ceph-mon[88869]: pgmap v991: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:34.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:34 smithi137 ceph-mon[91314]: pgmap v991: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:35.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:57:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:57:35] "GET /metrics HTTP/1.1" 200 36331 "" "Prometheus/2.43.0" 2024-03-04T06:57:36.644 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:57:36.676 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:36 smithi137 ceph-mon[88869]: pgmap v992: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:36.676 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:36 smithi137 ceph-mon[91314]: pgmap v992: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:36.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:36 smithi203 ceph-mon[85573]: pgmap v992: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:36.862 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:57:38.493 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:38 smithi137 ceph-mon[88869]: pgmap v993: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:38.493 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:38 smithi137 ceph-mon[91314]: pgmap v993: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:38.727 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:57:38.730 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:57:38.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:38 smithi203 ceph-mon[85573]: pgmap v993: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:39.497 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":994,"stamp":"2024-03-04T06:57:38.502976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003945"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103340+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103340+0000","last_peered":"2024-03-04T06:55:13.103340+0000","last_clean":"2024-03-04T06:55:13.103340+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103340+0000","last_undegraded":"2024-03-04T06:55:13.103340+0000","last_fullsized":"2024-03-04T06:55:13.103340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117002+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.117002+0000","last_peered":"2024-03-04T06:55:13.117002+0000","last_clean":"2024-03-04T06:55:13.117002+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.117002+0000","last_undegraded":"2024-03-04T06:55:13.117002+0000","last_fullsized":"2024-03-04T06:55:13.117002+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115416+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115416+0000","last_peered":"2024-03-04T06:55:13.115416+0000","last_clean":"2024-03-04T06:55:13.115416+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115416+0000","last_undegraded":"2024-03-04T06:55:13.115416+0000","last_fullsized":"2024-03-04T06:55:13.115416+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106163+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106163+0000","last_peered":"2024-03-04T06:55:13.106163+0000","last_clean":"2024-03-04T06:55:13.106163+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106163+0000","last_undegraded":"2024-03-04T06:55:13.106163+0000","last_fullsized":"2024-03-04T06:55:13.106163+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102005+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.102005+0000","last_peered":"2024-03-04T06:55:13.102005+0000","last_clean":"2024-03-04T06:55:13.102005+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.102005+0000","last_undegraded":"2024-03-04T06:55:13.102005+0000","last_fullsized":"2024-03-04T06:55:13.102005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106089+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106089+0000","last_peered":"2024-03-04T06:55:13.106089+0000","last_clean":"2024-03-04T06:55:13.106089+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106089+0000","last_undegraded":"2024-03-04T06:55:13.106089+0000","last_fullsized":"2024-03-04T06:55:13.106089+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101809+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101809+0000","last_peered":"2024-03-04T06:55:13.101809+0000","last_clean":"2024-03-04T06:55:13.101809+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101809+0000","last_undegraded":"2024-03-04T06:55:13.101809+0000","last_fullsized":"2024-03-04T06:55:13.101809+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097051+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:13.097051+0000","last_peered":"2024-03-04T06:55:13.097051+0000","last_clean":"2024-03-04T06:55:13.097051+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:13.097051+0000","last_undegraded":"2024-03-04T06:55:13.097051+0000","last_fullsized":"2024-03-04T06:55:13.097051+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1064,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103046+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.103046+0000","last_peered":"2024-03-04T06:55:13.103046+0000","last_clean":"2024-03-04T06:55:13.103046+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.103046+0000","last_undegraded":"2024-03-04T06:55:13.103046+0000","last_fullsized":"2024-03-04T06:55:13.103046+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115007+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.115007+0000","last_peered":"2024-03-04T06:55:13.115007+0000","last_clean":"2024-03-04T06:55:13.115007+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.115007+0000","last_undegraded":"2024-03-04T06:55:13.115007+0000","last_fullsized":"2024-03-04T06:55:13.115007+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114852+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114852+0000","last_peered":"2024-03-04T06:55:13.114852+0000","last_clean":"2024-03-04T06:55:13.114852+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114852+0000","last_undegraded":"2024-03-04T06:55:13.114852+0000","last_fullsized":"2024-03-04T06:55:13.114852+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1154,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095971+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:13.095971+0000","last_peered":"2024-03-04T06:55:13.095971+0000","last_clean":"2024-03-04T06:55:13.095971+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:13.095971+0000","last_undegraded":"2024-03-04T06:55:13.095971+0000","last_fullsized":"2024-03-04T06:55:13.095971+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.099013+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.099013+0000","last_peered":"2024-03-04T06:55:13.099013+0000","last_clean":"2024-03-04T06:55:13.099013+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.099013+0000","last_undegraded":"2024-03-04T06:55:13.099013+0000","last_fullsized":"2024-03-04T06:55:13.099013+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985446+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:17.985446+0000","last_peered":"2024-03-04T06:55:17.985446+0000","last_clean":"2024-03-04T06:55:17.985446+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:17.985446+0000","last_undegraded":"2024-03-04T06:55:17.985446+0000","last_fullsized":"2024-03-04T06:55:17.985446+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115730+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115730+0000","last_peered":"2024-03-04T06:55:13.115730+0000","last_clean":"2024-03-04T06:55:13.115730+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115730+0000","last_undegraded":"2024-03-04T06:55:13.115730+0000","last_fullsized":"2024-03-04T06:55:13.115730+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104995+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104995+0000","last_peered":"2024-03-04T06:55:13.104995+0000","last_clean":"2024-03-04T06:55:13.104995+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104995+0000","last_undegraded":"2024-03-04T06:55:13.104995+0000","last_fullsized":"2024-03-04T06:55:13.104995+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.107002+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.107002+0000","last_peered":"2024-03-04T06:55:13.107002+0000","last_clean":"2024-03-04T06:55:13.107002+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.107002+0000","last_undegraded":"2024-03-04T06:55:13.107002+0000","last_fullsized":"2024-03-04T06:55:13.107002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096941+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096941+0000","last_peered":"2024-03-04T06:55:13.096941+0000","last_clean":"2024-03-04T06:55:13.096941+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096941+0000","last_undegraded":"2024-03-04T06:55:13.096941+0000","last_fullsized":"2024-03-04T06:55:13.096941+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102303+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102303+0000","last_peered":"2024-03-04T06:55:13.102303+0000","last_clean":"2024-03-04T06:55:13.102303+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102303+0000","last_undegraded":"2024-03-04T06:55:13.102303+0000","last_fullsized":"2024-03-04T06:55:13.102303+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116614+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116614+0000","last_peered":"2024-03-04T06:55:13.116614+0000","last_clean":"2024-03-04T06:55:13.116614+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116614+0000","last_undegraded":"2024-03-04T06:55:13.116614+0000","last_fullsized":"2024-03-04T06:55:13.116614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097609+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:13.097609+0000","last_peered":"2024-03-04T06:55:13.097609+0000","last_clean":"2024-03-04T06:55:13.097609+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:13.097609+0000","last_undegraded":"2024-03-04T06:55:13.097609+0000","last_fullsized":"2024-03-04T06:55:13.097609+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097848+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:13.097848+0000","last_peered":"2024-03-04T06:55:13.097848+0000","last_clean":"2024-03-04T06:55:13.097848+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:13.097848+0000","last_undegraded":"2024-03-04T06:55:13.097848+0000","last_fullsized":"2024-03-04T06:55:13.097848+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116801+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.116801+0000","last_peered":"2024-03-04T06:55:13.116801+0000","last_clean":"2024-03-04T06:55:13.116801+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.116801+0000","last_undegraded":"2024-03-04T06:55:13.116801+0000","last_fullsized":"2024-03-04T06:55:13.116801+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1234,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098569+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098569+0000","last_peered":"2024-03-04T06:55:13.098569+0000","last_clean":"2024-03-04T06:55:13.098569+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098569+0000","last_undegraded":"2024-03-04T06:55:13.098569+0000","last_fullsized":"2024-03-04T06:55:13.098569+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1221,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097506+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097506+0000","last_peered":"2024-03-04T06:55:13.097506+0000","last_clean":"2024-03-04T06:55:13.097506+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097506+0000","last_undegraded":"2024-03-04T06:55:13.097506+0000","last_fullsized":"2024-03-04T06:55:13.097506+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102499+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102499+0000","last_peered":"2024-03-04T06:55:13.102499+0000","last_clean":"2024-03-04T06:55:13.102499+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102499+0000","last_undegraded":"2024-03-04T06:55:13.102499+0000","last_fullsized":"2024-03-04T06:55:13.102499+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106216+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106216+0000","last_peered":"2024-03-04T06:55:13.106216+0000","last_clean":"2024-03-04T06:55:13.106216+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106216+0000","last_undegraded":"2024-03-04T06:55:13.106216+0000","last_fullsized":"2024-03-04T06:55:13.106216+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098905+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:13.098905+0000","last_peered":"2024-03-04T06:55:13.098905+0000","last_clean":"2024-03-04T06:55:13.098905+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:13.098905+0000","last_undegraded":"2024-03-04T06:55:13.098905+0000","last_fullsized":"2024-03-04T06:55:13.098905+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1188,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096052+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.096052+0000","last_peered":"2024-03-04T06:55:13.096052+0000","last_clean":"2024-03-04T06:55:13.096052+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.096052+0000","last_undegraded":"2024-03-04T06:55:13.096052+0000","last_fullsized":"2024-03-04T06:55:13.096052+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114709+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114709+0000","last_peered":"2024-03-04T06:55:13.114709+0000","last_clean":"2024-03-04T06:55:13.114709+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114709+0000","last_undegraded":"2024-03-04T06:55:13.114709+0000","last_fullsized":"2024-03-04T06:55:13.114709+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.118051+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.118051+0000","last_peered":"2024-03-04T06:55:13.118051+0000","last_clean":"2024-03-04T06:55:13.118051+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.118051+0000","last_undegraded":"2024-03-04T06:55:13.118051+0000","last_fullsized":"2024-03-04T06:55:13.118051+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096734+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096734+0000","last_peered":"2024-03-04T06:55:13.096734+0000","last_clean":"2024-03-04T06:55:13.096734+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096734+0000","last_undegraded":"2024-03-04T06:55:13.096734+0000","last_fullsized":"2024-03-04T06:55:13.096734+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097225+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097225+0000","last_peered":"2024-03-04T06:55:13.097225+0000","last_clean":"2024-03-04T06:55:13.097225+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097225+0000","last_undegraded":"2024-03-04T06:55:13.097225+0000","last_fullsized":"2024-03-04T06:55:13.097225+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105593+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105593+0000","last_peered":"2024-03-04T06:55:13.105593+0000","last_clean":"2024-03-04T06:55:13.105593+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105593+0000","last_undegraded":"2024-03-04T06:55:13.105593+0000","last_fullsized":"2024-03-04T06:55:13.105593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115824+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115824+0000","last_peered":"2024-03-04T06:55:13.115824+0000","last_clean":"2024-03-04T06:55:13.115824+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115824+0000","last_undegraded":"2024-03-04T06:55:13.115824+0000","last_fullsized":"2024-03-04T06:55:13.115824+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115145+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115145+0000","last_peered":"2024-03-04T06:55:13.115145+0000","last_clean":"2024-03-04T06:55:13.115145+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115145+0000","last_undegraded":"2024-03-04T06:55:13.115145+0000","last_fullsized":"2024-03-04T06:55:13.115145+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1110,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105468+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105468+0000","last_peered":"2024-03-04T06:55:13.105468+0000","last_clean":"2024-03-04T06:55:13.105468+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105468+0000","last_undegraded":"2024-03-04T06:55:13.105468+0000","last_fullsized":"2024-03-04T06:55:13.105468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105915+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105915+0000","last_peered":"2024-03-04T06:55:13.105915+0000","last_clean":"2024-03-04T06:55:13.105915+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105915+0000","last_undegraded":"2024-03-04T06:55:13.105915+0000","last_fullsized":"2024-03-04T06:55:13.105915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116155+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116155+0000","last_peered":"2024-03-04T06:55:13.116155+0000","last_clean":"2024-03-04T06:55:13.116155+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116155+0000","last_undegraded":"2024-03-04T06:55:13.116155+0000","last_fullsized":"2024-03-04T06:55:13.116155+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116083+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116083+0000","last_peered":"2024-03-04T06:55:13.116083+0000","last_clean":"2024-03-04T06:55:13.116083+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116083+0000","last_undegraded":"2024-03-04T06:55:13.116083+0000","last_fullsized":"2024-03-04T06:55:13.116083+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.602395+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:17.602395+0000","last_peered":"2024-03-04T06:55:17.602395+0000","last_clean":"2024-03-04T06:55:17.602395+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:17.602395+0000","last_undegraded":"2024-03-04T06:55:17.602395+0000","last_fullsized":"2024-03-04T06:55:17.602395+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114988+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114988+0000","last_peered":"2024-03-04T06:55:13.114988+0000","last_clean":"2024-03-04T06:55:13.114988+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114988+0000","last_undegraded":"2024-03-04T06:55:13.114988+0000","last_fullsized":"2024-03-04T06:55:13.114988+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102665+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102665+0000","last_peered":"2024-03-04T06:55:13.102665+0000","last_clean":"2024-03-04T06:55:13.102665+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102665+0000","last_undegraded":"2024-03-04T06:55:13.102665+0000","last_fullsized":"2024-03-04T06:55:13.102665+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1302,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985489+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:17.985489+0000","last_peered":"2024-03-04T06:55:17.985489+0000","last_clean":"2024-03-04T06:55:17.985489+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:17.985489+0000","last_undegraded":"2024-03-04T06:55:17.985489+0000","last_fullsized":"2024-03-04T06:55:17.985489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098537+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098537+0000","last_peered":"2024-03-04T06:55:13.098537+0000","last_clean":"2024-03-04T06:55:13.098537+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098537+0000","last_undegraded":"2024-03-04T06:55:13.098537+0000","last_fullsized":"2024-03-04T06:55:13.098537+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105922+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105922+0000","last_peered":"2024-03-04T06:55:13.105922+0000","last_clean":"2024-03-04T06:55:13.105922+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105922+0000","last_undegraded":"2024-03-04T06:55:13.105922+0000","last_fullsized":"2024-03-04T06:55:13.105922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102561+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102561+0000","last_peered":"2024-03-04T06:55:13.102561+0000","last_clean":"2024-03-04T06:55:13.102561+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102561+0000","last_undegraded":"2024-03-04T06:55:13.102561+0000","last_fullsized":"2024-03-04T06:55:13.102561+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114471+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114471+0000","last_peered":"2024-03-04T06:55:13.114471+0000","last_clean":"2024-03-04T06:55:13.114471+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114471+0000","last_undegraded":"2024-03-04T06:55:13.114471+0000","last_fullsized":"2024-03-04T06:55:13.114471+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114484+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114484+0000","last_peered":"2024-03-04T06:55:13.114484+0000","last_clean":"2024-03-04T06:55:13.114484+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114484+0000","last_undegraded":"2024-03-04T06:55:13.114484+0000","last_fullsized":"2024-03-04T06:55:13.114484+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1252,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101837+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101837+0000","last_peered":"2024-03-04T06:55:13.101837+0000","last_clean":"2024-03-04T06:55:13.101837+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101837+0000","last_undegraded":"2024-03-04T06:55:13.101837+0000","last_fullsized":"2024-03-04T06:55:13.101837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3576,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096470+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:13.096470+0000","last_peered":"2024-03-04T06:55:13.096470+0000","last_clean":"2024-03-04T06:55:13.096470+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:13.096470+0000","last_undegraded":"2024-03-04T06:55:13.096470+0000","last_fullsized":"2024-03-04T06:55:13.096470+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096992+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096992+0000","last_peered":"2024-03-04T06:55:13.096992+0000","last_clean":"2024-03-04T06:55:13.096992+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096992+0000","last_undegraded":"2024-03-04T06:55:13.096992+0000","last_fullsized":"2024-03-04T06:55:13.096992+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102943+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102943+0000","last_peered":"2024-03-04T06:55:13.102943+0000","last_clean":"2024-03-04T06:55:13.102943+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102943+0000","last_undegraded":"2024-03-04T06:55:13.102943+0000","last_fullsized":"2024-03-04T06:55:13.102943+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17115,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117976+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117976+0000","last_peered":"2024-03-04T06:55:13.117976+0000","last_clean":"2024-03-04T06:55:13.117976+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117976+0000","last_undegraded":"2024-03-04T06:55:13.117976+0000","last_fullsized":"2024-03-04T06:55:13.117976+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115088+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115088+0000","last_peered":"2024-03-04T06:55:13.115088+0000","last_clean":"2024-03-04T06:55:13.115088+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115088+0000","last_undegraded":"2024-03-04T06:55:13.115088+0000","last_fullsized":"2024-03-04T06:55:13.115088+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116699+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116699+0000","last_peered":"2024-03-04T06:55:13.116699+0000","last_clean":"2024-03-04T06:55:13.116699+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116699+0000","last_undegraded":"2024-03-04T06:55:13.116699+0000","last_fullsized":"2024-03-04T06:55:13.116699+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106020+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.106020+0000","last_peered":"2024-03-04T06:55:13.106020+0000","last_clean":"2024-03-04T06:55:13.106020+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.106020+0000","last_undegraded":"2024-03-04T06:55:13.106020+0000","last_fullsized":"2024-03-04T06:55:13.106020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4385,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117010+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.117010+0000","last_peered":"2024-03-04T06:55:13.117010+0000","last_clean":"2024-03-04T06:55:13.117010+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.117010+0000","last_undegraded":"2024-03-04T06:55:13.117010+0000","last_fullsized":"2024-03-04T06:55:13.117010+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115964+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115964+0000","last_peered":"2024-03-04T06:55:13.115964+0000","last_clean":"2024-03-04T06:55:13.115964+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115964+0000","last_undegraded":"2024-03-04T06:55:13.115964+0000","last_fullsized":"2024-03-04T06:55:13.115964+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105737+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105737+0000","last_peered":"2024-03-04T06:55:13.105737+0000","last_clean":"2024-03-04T06:55:13.105737+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105737+0000","last_undegraded":"2024-03-04T06:55:13.105737+0000","last_fullsized":"2024-03-04T06:55:13.105737+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096287+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096287+0000","last_peered":"2024-03-04T06:55:13.096287+0000","last_clean":"2024-03-04T06:55:13.096287+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096287+0000","last_undegraded":"2024-03-04T06:55:13.096287+0000","last_fullsized":"2024-03-04T06:55:13.096287+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5638,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097306+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:13.097306+0000","last_peered":"2024-03-04T06:55:13.097306+0000","last_clean":"2024-03-04T06:55:13.097306+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:13.097306+0000","last_undegraded":"2024-03-04T06:55:13.097306+0000","last_fullsized":"2024-03-04T06:55:13.097306+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141294+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.141294+0000","last_peered":"2024-03-04T06:55:13.141294+0000","last_clean":"2024-03-04T06:55:13.141294+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.141294+0000","last_undegraded":"2024-03-04T06:55:13.141294+0000","last_fullsized":"2024-03-04T06:55:13.141294+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114171+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114171+0000","last_peered":"2024-03-04T06:55:13.114171+0000","last_clean":"2024-03-04T06:55:13.114171+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114171+0000","last_undegraded":"2024-03-04T06:55:13.114171+0000","last_fullsized":"2024-03-04T06:55:13.114171+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375859+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:28.375859+0000","last_peered":"2024-03-04T06:55:28.375859+0000","last_clean":"2024-03-04T06:55:28.375859+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:28.375859+0000","last_undegraded":"2024-03-04T06:55:28.375859+0000","last_fullsized":"2024-03-04T06:55:28.375859+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4014,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107389+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.107389+0000","last_peered":"2024-03-04T06:55:13.107389+0000","last_clean":"2024-03-04T06:55:13.107389+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.107389+0000","last_undegraded":"2024-03-04T06:55:13.107389+0000","last_fullsized":"2024-03-04T06:55:13.107389+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1090,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115070+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:13.115070+0000","last_peered":"2024-03-04T06:55:13.115070+0000","last_clean":"2024-03-04T06:55:13.115070+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:13.115070+0000","last_undegraded":"2024-03-04T06:55:13.115070+0000","last_fullsized":"2024-03-04T06:55:13.115070+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098424+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098424+0000","last_peered":"2024-03-04T06:55:13.098424+0000","last_clean":"2024-03-04T06:55:13.098424+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098424+0000","last_undegraded":"2024-03-04T06:55:13.098424+0000","last_fullsized":"2024-03-04T06:55:13.098424+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105228+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105228+0000","last_peered":"2024-03-04T06:55:13.105228+0000","last_clean":"2024-03-04T06:55:13.105228+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105228+0000","last_undegraded":"2024-03-04T06:55:13.105228+0000","last_fullsized":"2024-03-04T06:55:13.105228+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1549,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101736+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101736+0000","last_peered":"2024-03-04T06:55:13.101736+0000","last_clean":"2024-03-04T06:55:13.101736+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101736+0000","last_undegraded":"2024-03-04T06:55:13.101736+0000","last_fullsized":"2024-03-04T06:55:13.101736+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3950,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933655+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:22.933655+0000","last_peered":"2024-03-04T06:55:22.933655+0000","last_clean":"2024-03-04T06:55:22.933655+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:22.933655+0000","last_undegraded":"2024-03-04T06:55:22.933655+0000","last_fullsized":"2024-03-04T06:55:22.933655+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117375+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117375+0000","last_peered":"2024-03-04T06:55:13.117375+0000","last_clean":"2024-03-04T06:55:13.117375+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117375+0000","last_undegraded":"2024-03-04T06:55:13.117375+0000","last_fullsized":"2024-03-04T06:55:13.117375+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375833+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:28.375833+0000","last_peered":"2024-03-04T06:55:28.375833+0000","last_clean":"2024-03-04T06:55:28.375833+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:28.375833+0000","last_undegraded":"2024-03-04T06:55:28.375833+0000","last_fullsized":"2024-03-04T06:55:28.375833+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101691+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101691+0000","last_peered":"2024-03-04T06:55:13.101691+0000","last_clean":"2024-03-04T06:55:13.101691+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101691+0000","last_undegraded":"2024-03-04T06:55:13.101691+0000","last_fullsized":"2024-03-04T06:55:13.101691+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15290,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.174192+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:13.174192+0000","last_peered":"2024-03-04T06:55:13.174192+0000","last_clean":"2024-03-04T06:55:13.174192+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:13.174192+0000","last_undegraded":"2024-03-04T06:55:13.174192+0000","last_fullsized":"2024-03-04T06:55:13.174192+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117527+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117527+0000","last_peered":"2024-03-04T06:55:13.117527+0000","last_clean":"2024-03-04T06:55:13.117527+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117527+0000","last_undegraded":"2024-03-04T06:55:13.117527+0000","last_fullsized":"2024-03-04T06:55:13.117527+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102583+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102583+0000","last_peered":"2024-03-04T06:55:13.102583+0000","last_clean":"2024-03-04T06:55:13.102583+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102583+0000","last_undegraded":"2024-03-04T06:55:13.102583+0000","last_fullsized":"2024-03-04T06:55:13.102583+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116059+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116059+0000","last_peered":"2024-03-04T06:55:13.116059+0000","last_clean":"2024-03-04T06:55:13.116059+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116059+0000","last_undegraded":"2024-03-04T06:55:13.116059+0000","last_fullsized":"2024-03-04T06:55:13.116059+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4378,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097496+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097496+0000","last_peered":"2024-03-04T06:55:13.097496+0000","last_clean":"2024-03-04T06:55:13.097496+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097496+0000","last_undegraded":"2024-03-04T06:55:13.097496+0000","last_fullsized":"2024-03-04T06:55:13.097496+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097599+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:13.097599+0000","last_peered":"2024-03-04T06:55:13.097599+0000","last_clean":"2024-03-04T06:55:13.097599+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:13.097599+0000","last_undegraded":"2024-03-04T06:55:13.097599+0000","last_fullsized":"2024-03-04T06:55:13.097599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141284+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.141284+0000","last_peered":"2024-03-04T06:55:13.141284+0000","last_clean":"2024-03-04T06:55:13.141284+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.141284+0000","last_undegraded":"2024-03-04T06:55:13.141284+0000","last_fullsized":"2024-03-04T06:55:13.141284+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097249+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097249+0000","last_peered":"2024-03-04T06:55:13.097249+0000","last_clean":"2024-03-04T06:55:13.097249+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097249+0000","last_undegraded":"2024-03-04T06:55:13.097249+0000","last_fullsized":"2024-03-04T06:55:13.097249+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4608,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.311904+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:13.311904+0000","last_peered":"2024-03-04T06:55:13.311904+0000","last_clean":"2024-03-04T06:55:13.311904+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:13.311904+0000","last_undegraded":"2024-03-04T06:55:13.311904+0000","last_fullsized":"2024-03-04T06:55:13.311904+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095704+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095704+0000","last_peered":"2024-03-04T06:55:13.095704+0000","last_clean":"2024-03-04T06:55:13.095704+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095704+0000","last_undegraded":"2024-03-04T06:55:13.095704+0000","last_fullsized":"2024-03-04T06:55:13.095704+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1077,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115185+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115185+0000","last_peered":"2024-03-04T06:55:13.115185+0000","last_clean":"2024-03-04T06:55:13.115185+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115185+0000","last_undegraded":"2024-03-04T06:55:13.115185+0000","last_fullsized":"2024-03-04T06:55:13.115185+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115644+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115644+0000","last_peered":"2024-03-04T06:55:13.115644+0000","last_clean":"2024-03-04T06:55:13.115644+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115644+0000","last_undegraded":"2024-03-04T06:55:13.115644+0000","last_fullsized":"2024-03-04T06:55:13.115644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4633,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107390+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:13.107390+0000","last_peered":"2024-03-04T06:55:13.107390+0000","last_clean":"2024-03-04T06:55:13.107390+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:13.107390+0000","last_undegraded":"2024-03-04T06:55:13.107390+0000","last_fullsized":"2024-03-04T06:55:13.107390+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101972+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101972+0000","last_peered":"2024-03-04T06:55:13.101972+0000","last_clean":"2024-03-04T06:55:13.101972+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101972+0000","last_undegraded":"2024-03-04T06:55:13.101972+0000","last_fullsized":"2024-03-04T06:55:13.101972+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1184,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095689+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095689+0000","last_peered":"2024-03-04T06:55:13.095689+0000","last_clean":"2024-03-04T06:55:13.095689+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095689+0000","last_undegraded":"2024-03-04T06:55:13.095689+0000","last_fullsized":"2024-03-04T06:55:13.095689+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5157,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.113366+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.113366+0000","last_peered":"2024-03-04T06:55:13.113366+0000","last_clean":"2024-03-04T06:55:13.113366+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.113366+0000","last_undegraded":"2024-03-04T06:55:13.113366+0000","last_fullsized":"2024-03-04T06:55:13.113366+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141219+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.141219+0000","last_peered":"2024-03-04T06:55:13.141219+0000","last_clean":"2024-03-04T06:55:13.141219+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.141219+0000","last_undegraded":"2024-03-04T06:55:13.141219+0000","last_fullsized":"2024-03-04T06:55:13.141219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097821+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097821+0000","last_peered":"2024-03-04T06:55:13.097821+0000","last_clean":"2024-03-04T06:55:13.097821+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097821+0000","last_undegraded":"2024-03-04T06:55:13.097821+0000","last_fullsized":"2024-03-04T06:55:13.097821+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4718,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.169321+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.169321+0000","last_peered":"2024-03-04T06:55:13.169321+0000","last_clean":"2024-03-04T06:55:13.169321+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.169321+0000","last_undegraded":"2024-03-04T06:55:13.169321+0000","last_fullsized":"2024-03-04T06:55:13.169321+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141246+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.141246+0000","last_peered":"2024-03-04T06:55:13.141246+0000","last_clean":"2024-03-04T06:55:13.141246+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.141246+0000","last_undegraded":"2024-03-04T06:55:13.141246+0000","last_fullsized":"2024-03-04T06:55:13.141246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098839+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098839+0000","last_peered":"2024-03-04T06:55:13.098839+0000","last_clean":"2024-03-04T06:55:13.098839+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098839+0000","last_undegraded":"2024-03-04T06:55:13.098839+0000","last_fullsized":"2024-03-04T06:55:13.098839+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5553,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117009+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:13.117009+0000","last_peered":"2024-03-04T06:55:13.117009+0000","last_clean":"2024-03-04T06:55:13.117009+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:13.117009+0000","last_undegraded":"2024-03-04T06:55:13.117009+0000","last_fullsized":"2024-03-04T06:55:13.117009+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102401+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102401+0000","last_peered":"2024-03-04T06:55:13.102401+0000","last_clean":"2024-03-04T06:55:13.102401+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102401+0000","last_undegraded":"2024-03-04T06:55:13.102401+0000","last_fullsized":"2024-03-04T06:55:13.102401+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114691+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114691+0000","last_peered":"2024-03-04T06:55:13.114691+0000","last_clean":"2024-03-04T06:55:13.114691+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114691+0000","last_undegraded":"2024-03-04T06:55:13.114691+0000","last_fullsized":"2024-03-04T06:55:13.114691+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096824+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096824+0000","last_peered":"2024-03-04T06:55:13.096824+0000","last_clean":"2024-03-04T06:55:13.096824+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096824+0000","last_undegraded":"2024-03-04T06:55:13.096824+0000","last_fullsized":"2024-03-04T06:55:13.096824+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097239+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097239+0000","last_peered":"2024-03-04T06:55:13.097239+0000","last_clean":"2024-03-04T06:55:13.097239+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097239+0000","last_undegraded":"2024-03-04T06:55:13.097239+0000","last_fullsized":"2024-03-04T06:55:13.097239+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102489+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102489+0000","last_peered":"2024-03-04T06:55:13.102489+0000","last_clean":"2024-03-04T06:55:13.102489+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102489+0000","last_undegraded":"2024-03-04T06:55:13.102489+0000","last_fullsized":"2024-03-04T06:55:13.102489+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4365,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.315099+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:13.315099+0000","last_peered":"2024-03-04T06:55:13.315099+0000","last_clean":"2024-03-04T06:55:13.315099+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:13.315099+0000","last_undegraded":"2024-03-04T06:55:13.315099+0000","last_fullsized":"2024-03-04T06:55:13.315099+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115541+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:13.115541+0000","last_peered":"2024-03-04T06:55:13.115541+0000","last_clean":"2024-03-04T06:55:13.115541+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:13.115541+0000","last_undegraded":"2024-03-04T06:55:13.115541+0000","last_fullsized":"2024-03-04T06:55:13.115541+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105888+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:13.105888+0000","last_peered":"2024-03-04T06:55:13.105888+0000","last_clean":"2024-03-04T06:55:13.105888+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:13.105888+0000","last_undegraded":"2024-03-04T06:55:13.105888+0000","last_fullsized":"2024-03-04T06:55:13.105888+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4599,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.322375+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.322375+0000","last_peered":"2024-03-04T06:55:13.322375+0000","last_clean":"2024-03-04T06:55:13.322375+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.322375+0000","last_undegraded":"2024-03-04T06:55:13.322375+0000","last_fullsized":"2024-03-04T06:55:13.322375+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097504+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097504+0000","last_peered":"2024-03-04T06:55:13.097504+0000","last_clean":"2024-03-04T06:55:13.097504+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097504+0000","last_undegraded":"2024-03-04T06:55:13.097504+0000","last_fullsized":"2024-03-04T06:55:13.097504+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105586+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.105586+0000","last_peered":"2024-03-04T06:55:13.105586+0000","last_clean":"2024-03-04T06:55:13.105586+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.105586+0000","last_undegraded":"2024-03-04T06:55:13.105586+0000","last_fullsized":"2024-03-04T06:55:13.105586+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114524+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:13.114524+0000","last_peered":"2024-03-04T06:55:13.114524+0000","last_clean":"2024-03-04T06:55:13.114524+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:13.114524+0000","last_undegraded":"2024-03-04T06:55:13.114524+0000","last_fullsized":"2024-03-04T06:55:13.114524+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375870+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:28.375870+0000","last_peered":"2024-03-04T06:55:28.375870+0000","last_clean":"2024-03-04T06:55:28.375870+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:28.375870+0000","last_undegraded":"2024-03-04T06:55:28.375870+0000","last_fullsized":"2024-03-04T06:55:28.375870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106053+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.106053+0000","last_peered":"2024-03-04T06:55:13.106053+0000","last_clean":"2024-03-04T06:55:13.106053+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.106053+0000","last_undegraded":"2024-03-04T06:55:13.106053+0000","last_fullsized":"2024-03-04T06:55:13.106053+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117390+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117390+0000","last_peered":"2024-03-04T06:55:13.117390+0000","last_clean":"2024-03-04T06:55:13.117390+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117390+0000","last_undegraded":"2024-03-04T06:55:13.117390+0000","last_fullsized":"2024-03-04T06:55:13.117390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096810+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096810+0000","last_peered":"2024-03-04T06:55:13.096810+0000","last_clean":"2024-03-04T06:55:13.096810+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096810+0000","last_undegraded":"2024-03-04T06:55:13.096810+0000","last_fullsized":"2024-03-04T06:55:13.096810+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141268+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.141268+0000","last_peered":"2024-03-04T06:55:13.141268+0000","last_clean":"2024-03-04T06:55:13.141268+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.141268+0000","last_undegraded":"2024-03-04T06:55:13.141268+0000","last_fullsized":"2024-03-04T06:55:13.141268+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115286+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115286+0000","last_peered":"2024-03-04T06:55:13.115286+0000","last_clean":"2024-03-04T06:55:13.115286+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115286+0000","last_undegraded":"2024-03-04T06:55:13.115286+0000","last_fullsized":"2024-03-04T06:55:13.115286+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097481+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097481+0000","last_peered":"2024-03-04T06:55:13.097481+0000","last_clean":"2024-03-04T06:55:13.097481+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097481+0000","last_undegraded":"2024-03-04T06:55:13.097481+0000","last_fullsized":"2024-03-04T06:55:13.097481+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933591+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:22.933591+0000","last_peered":"2024-03-04T06:55:22.933591+0000","last_clean":"2024-03-04T06:55:22.933591+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:22.933591+0000","last_undegraded":"2024-03-04T06:55:22.933591+0000","last_fullsized":"2024-03-04T06:55:22.933591+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105576+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:13.105576+0000","last_peered":"2024-03-04T06:55:13.105576+0000","last_clean":"2024-03-04T06:55:13.105576+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:13.105576+0000","last_undegraded":"2024-03-04T06:55:13.105576+0000","last_fullsized":"2024-03-04T06:55:13.105576+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116911+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116911+0000","last_peered":"2024-03-04T06:55:13.116911+0000","last_clean":"2024-03-04T06:55:13.116911+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116911+0000","last_undegraded":"2024-03-04T06:55:13.116911+0000","last_fullsized":"2024-03-04T06:55:13.116911+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114836+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114836+0000","last_peered":"2024-03-04T06:55:13.114836+0000","last_clean":"2024-03-04T06:55:13.114836+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114836+0000","last_undegraded":"2024-03-04T06:55:13.114836+0000","last_fullsized":"2024-03-04T06:55:13.114836+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503451,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648099,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142406,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287053,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997759,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885815,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937393,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792746,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:57:39.558 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:39.558 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:39.558 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:39.558 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:39.558 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:39.558 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:39.558 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:39.558 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:39.558 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:39.558 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:39.558 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:57:39.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:57:39.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:57:39.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:57:40.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:40 smithi137 ceph-mon[91314]: pgmap v994: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:40.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:40 smithi137 ceph-mon[91314]: from='client.44504 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:40 smithi137 ceph-mon[88869]: pgmap v994: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:40.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:40 smithi137 ceph-mon[88869]: from='client.44504 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:40.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:40 smithi203 ceph-mon[85573]: pgmap v994: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:40.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:40 smithi203 ceph-mon[85573]: from='client.44504 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:42.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:42 smithi137 ceph-mon[88869]: pgmap v995: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:42.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:42 smithi137 ceph-mon[91314]: pgmap v995: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:42.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:42 smithi203 ceph-mon[85573]: pgmap v995: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:44.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:44 smithi137 ceph-mon[88869]: pgmap v996: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:44.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:44 smithi137 ceph-mon[91314]: pgmap v996: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:44.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:44 smithi203 ceph-mon[85573]: pgmap v996: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:45.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:57:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:57:45] "GET /metrics HTTP/1.1" 200 36337 "" "Prometheus/2.43.0" 2024-03-04T06:57:46.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:46 smithi137 ceph-mon[88869]: pgmap v997: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:46.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:46 smithi137 ceph-mon[91314]: pgmap v997: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:46.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:46 smithi203 ceph-mon[85573]: pgmap v997: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:48.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:48 smithi137 ceph-mon[88869]: pgmap v998: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:48.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:48 smithi137 ceph-mon[91314]: pgmap v998: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:48.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:48 smithi203 ceph-mon[85573]: pgmap v998: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:49.560 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:57:49.781 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:57:50.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:50 smithi137 ceph-mon[88869]: pgmap v999: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:50.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:50 smithi137 ceph-mon[91314]: pgmap v999: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:50.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:50 smithi203 ceph-mon[85573]: pgmap v999: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:51.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:57:51.669 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:57:52.324 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1000,"stamp":"2024-03-04T06:57:50.506975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003999"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103340+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103340+0000","last_peered":"2024-03-04T06:55:13.103340+0000","last_clean":"2024-03-04T06:55:13.103340+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103340+0000","last_undegraded":"2024-03-04T06:55:13.103340+0000","last_fullsized":"2024-03-04T06:55:13.103340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117002+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.117002+0000","last_peered":"2024-03-04T06:55:13.117002+0000","last_clean":"2024-03-04T06:55:13.117002+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.117002+0000","last_undegraded":"2024-03-04T06:55:13.117002+0000","last_fullsized":"2024-03-04T06:55:13.117002+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115416+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115416+0000","last_peered":"2024-03-04T06:55:13.115416+0000","last_clean":"2024-03-04T06:55:13.115416+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115416+0000","last_undegraded":"2024-03-04T06:55:13.115416+0000","last_fullsized":"2024-03-04T06:55:13.115416+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106163+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106163+0000","last_peered":"2024-03-04T06:55:13.106163+0000","last_clean":"2024-03-04T06:55:13.106163+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106163+0000","last_undegraded":"2024-03-04T06:55:13.106163+0000","last_fullsized":"2024-03-04T06:55:13.106163+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102005+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.102005+0000","last_peered":"2024-03-04T06:55:13.102005+0000","last_clean":"2024-03-04T06:55:13.102005+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.102005+0000","last_undegraded":"2024-03-04T06:55:13.102005+0000","last_fullsized":"2024-03-04T06:55:13.102005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106089+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106089+0000","last_peered":"2024-03-04T06:55:13.106089+0000","last_clean":"2024-03-04T06:55:13.106089+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106089+0000","last_undegraded":"2024-03-04T06:55:13.106089+0000","last_fullsized":"2024-03-04T06:55:13.106089+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101809+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101809+0000","last_peered":"2024-03-04T06:55:13.101809+0000","last_clean":"2024-03-04T06:55:13.101809+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101809+0000","last_undegraded":"2024-03-04T06:55:13.101809+0000","last_fullsized":"2024-03-04T06:55:13.101809+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984614+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:14.984614+0000","last_peered":"2024-03-04T06:55:14.984614+0000","last_clean":"2024-03-04T06:55:14.984614+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:14.984614+0000","last_undegraded":"2024-03-04T06:55:14.984614+0000","last_fullsized":"2024-03-04T06:55:14.984614+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1064,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103046+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.103046+0000","last_peered":"2024-03-04T06:55:13.103046+0000","last_clean":"2024-03-04T06:55:13.103046+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.103046+0000","last_undegraded":"2024-03-04T06:55:13.103046+0000","last_fullsized":"2024-03-04T06:55:13.103046+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115007+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.115007+0000","last_peered":"2024-03-04T06:55:13.115007+0000","last_clean":"2024-03-04T06:55:13.115007+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.115007+0000","last_undegraded":"2024-03-04T06:55:13.115007+0000","last_fullsized":"2024-03-04T06:55:13.115007+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114852+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114852+0000","last_peered":"2024-03-04T06:55:13.114852+0000","last_clean":"2024-03-04T06:55:13.114852+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114852+0000","last_undegraded":"2024-03-04T06:55:13.114852+0000","last_fullsized":"2024-03-04T06:55:13.114852+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1154,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095971+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:13.095971+0000","last_peered":"2024-03-04T06:55:13.095971+0000","last_clean":"2024-03-04T06:55:13.095971+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:13.095971+0000","last_undegraded":"2024-03-04T06:55:13.095971+0000","last_fullsized":"2024-03-04T06:55:13.095971+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.099013+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.099013+0000","last_peered":"2024-03-04T06:55:13.099013+0000","last_clean":"2024-03-04T06:55:13.099013+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.099013+0000","last_undegraded":"2024-03-04T06:55:13.099013+0000","last_fullsized":"2024-03-04T06:55:13.099013+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985446+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:17.985446+0000","last_peered":"2024-03-04T06:55:17.985446+0000","last_clean":"2024-03-04T06:55:17.985446+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:17.985446+0000","last_undegraded":"2024-03-04T06:55:17.985446+0000","last_fullsized":"2024-03-04T06:55:17.985446+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115730+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115730+0000","last_peered":"2024-03-04T06:55:13.115730+0000","last_clean":"2024-03-04T06:55:13.115730+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115730+0000","last_undegraded":"2024-03-04T06:55:13.115730+0000","last_fullsized":"2024-03-04T06:55:13.115730+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104995+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104995+0000","last_peered":"2024-03-04T06:55:13.104995+0000","last_clean":"2024-03-04T06:55:13.104995+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104995+0000","last_undegraded":"2024-03-04T06:55:13.104995+0000","last_fullsized":"2024-03-04T06:55:13.104995+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.107002+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.107002+0000","last_peered":"2024-03-04T06:55:13.107002+0000","last_clean":"2024-03-04T06:55:13.107002+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.107002+0000","last_undegraded":"2024-03-04T06:55:13.107002+0000","last_fullsized":"2024-03-04T06:55:13.107002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096941+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096941+0000","last_peered":"2024-03-04T06:55:13.096941+0000","last_clean":"2024-03-04T06:55:13.096941+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096941+0000","last_undegraded":"2024-03-04T06:55:13.096941+0000","last_fullsized":"2024-03-04T06:55:13.096941+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102303+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102303+0000","last_peered":"2024-03-04T06:55:13.102303+0000","last_clean":"2024-03-04T06:55:13.102303+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102303+0000","last_undegraded":"2024-03-04T06:55:13.102303+0000","last_fullsized":"2024-03-04T06:55:13.102303+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116614+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116614+0000","last_peered":"2024-03-04T06:55:13.116614+0000","last_clean":"2024-03-04T06:55:13.116614+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116614+0000","last_undegraded":"2024-03-04T06:55:13.116614+0000","last_fullsized":"2024-03-04T06:55:13.116614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988343+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:44.988343+0000","last_peered":"2024-03-04T06:55:44.988343+0000","last_clean":"2024-03-04T06:55:44.988343+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:44.988343+0000","last_undegraded":"2024-03-04T06:55:44.988343+0000","last_fullsized":"2024-03-04T06:55:44.988343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988353+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:44.988353+0000","last_peered":"2024-03-04T06:55:44.988353+0000","last_clean":"2024-03-04T06:55:44.988353+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:44.988353+0000","last_undegraded":"2024-03-04T06:55:44.988353+0000","last_fullsized":"2024-03-04T06:55:44.988353+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116801+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.116801+0000","last_peered":"2024-03-04T06:55:13.116801+0000","last_clean":"2024-03-04T06:55:13.116801+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.116801+0000","last_undegraded":"2024-03-04T06:55:13.116801+0000","last_fullsized":"2024-03-04T06:55:13.116801+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1234,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098569+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098569+0000","last_peered":"2024-03-04T06:55:13.098569+0000","last_clean":"2024-03-04T06:55:13.098569+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098569+0000","last_undegraded":"2024-03-04T06:55:13.098569+0000","last_fullsized":"2024-03-04T06:55:13.098569+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1221,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097506+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097506+0000","last_peered":"2024-03-04T06:55:13.097506+0000","last_clean":"2024-03-04T06:55:13.097506+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097506+0000","last_undegraded":"2024-03-04T06:55:13.097506+0000","last_fullsized":"2024-03-04T06:55:13.097506+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102499+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102499+0000","last_peered":"2024-03-04T06:55:13.102499+0000","last_clean":"2024-03-04T06:55:13.102499+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102499+0000","last_undegraded":"2024-03-04T06:55:13.102499+0000","last_fullsized":"2024-03-04T06:55:13.102499+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106216+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106216+0000","last_peered":"2024-03-04T06:55:13.106216+0000","last_clean":"2024-03-04T06:55:13.106216+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106216+0000","last_undegraded":"2024-03-04T06:55:13.106216+0000","last_fullsized":"2024-03-04T06:55:13.106216+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984673+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:14.984673+0000","last_peered":"2024-03-04T06:55:14.984673+0000","last_clean":"2024-03-04T06:55:14.984673+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:14.984673+0000","last_undegraded":"2024-03-04T06:55:14.984673+0000","last_fullsized":"2024-03-04T06:55:14.984673+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1188,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096052+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.096052+0000","last_peered":"2024-03-04T06:55:13.096052+0000","last_clean":"2024-03-04T06:55:13.096052+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.096052+0000","last_undegraded":"2024-03-04T06:55:13.096052+0000","last_fullsized":"2024-03-04T06:55:13.096052+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114709+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114709+0000","last_peered":"2024-03-04T06:55:13.114709+0000","last_clean":"2024-03-04T06:55:13.114709+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114709+0000","last_undegraded":"2024-03-04T06:55:13.114709+0000","last_fullsized":"2024-03-04T06:55:13.114709+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.118051+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.118051+0000","last_peered":"2024-03-04T06:55:13.118051+0000","last_clean":"2024-03-04T06:55:13.118051+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.118051+0000","last_undegraded":"2024-03-04T06:55:13.118051+0000","last_fullsized":"2024-03-04T06:55:13.118051+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096734+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096734+0000","last_peered":"2024-03-04T06:55:13.096734+0000","last_clean":"2024-03-04T06:55:13.096734+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096734+0000","last_undegraded":"2024-03-04T06:55:13.096734+0000","last_fullsized":"2024-03-04T06:55:13.096734+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097225+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097225+0000","last_peered":"2024-03-04T06:55:13.097225+0000","last_clean":"2024-03-04T06:55:13.097225+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097225+0000","last_undegraded":"2024-03-04T06:55:13.097225+0000","last_fullsized":"2024-03-04T06:55:13.097225+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105593+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105593+0000","last_peered":"2024-03-04T06:55:13.105593+0000","last_clean":"2024-03-04T06:55:13.105593+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105593+0000","last_undegraded":"2024-03-04T06:55:13.105593+0000","last_fullsized":"2024-03-04T06:55:13.105593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115824+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115824+0000","last_peered":"2024-03-04T06:55:13.115824+0000","last_clean":"2024-03-04T06:55:13.115824+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115824+0000","last_undegraded":"2024-03-04T06:55:13.115824+0000","last_fullsized":"2024-03-04T06:55:13.115824+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115145+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115145+0000","last_peered":"2024-03-04T06:55:13.115145+0000","last_clean":"2024-03-04T06:55:13.115145+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115145+0000","last_undegraded":"2024-03-04T06:55:13.115145+0000","last_fullsized":"2024-03-04T06:55:13.115145+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1110,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105468+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105468+0000","last_peered":"2024-03-04T06:55:13.105468+0000","last_clean":"2024-03-04T06:55:13.105468+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105468+0000","last_undegraded":"2024-03-04T06:55:13.105468+0000","last_fullsized":"2024-03-04T06:55:13.105468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105915+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105915+0000","last_peered":"2024-03-04T06:55:13.105915+0000","last_clean":"2024-03-04T06:55:13.105915+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105915+0000","last_undegraded":"2024-03-04T06:55:13.105915+0000","last_fullsized":"2024-03-04T06:55:13.105915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116155+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116155+0000","last_peered":"2024-03-04T06:55:13.116155+0000","last_clean":"2024-03-04T06:55:13.116155+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116155+0000","last_undegraded":"2024-03-04T06:55:13.116155+0000","last_fullsized":"2024-03-04T06:55:13.116155+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116083+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116083+0000","last_peered":"2024-03-04T06:55:13.116083+0000","last_clean":"2024-03-04T06:55:13.116083+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116083+0000","last_undegraded":"2024-03-04T06:55:13.116083+0000","last_fullsized":"2024-03-04T06:55:13.116083+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.602395+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:17.602395+0000","last_peered":"2024-03-04T06:55:17.602395+0000","last_clean":"2024-03-04T06:55:17.602395+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:17.602395+0000","last_undegraded":"2024-03-04T06:55:17.602395+0000","last_fullsized":"2024-03-04T06:55:17.602395+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114988+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114988+0000","last_peered":"2024-03-04T06:55:13.114988+0000","last_clean":"2024-03-04T06:55:13.114988+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114988+0000","last_undegraded":"2024-03-04T06:55:13.114988+0000","last_fullsized":"2024-03-04T06:55:13.114988+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102665+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102665+0000","last_peered":"2024-03-04T06:55:13.102665+0000","last_clean":"2024-03-04T06:55:13.102665+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102665+0000","last_undegraded":"2024-03-04T06:55:13.102665+0000","last_fullsized":"2024-03-04T06:55:13.102665+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1302,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985489+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:17.985489+0000","last_peered":"2024-03-04T06:55:17.985489+0000","last_clean":"2024-03-04T06:55:17.985489+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:17.985489+0000","last_undegraded":"2024-03-04T06:55:17.985489+0000","last_fullsized":"2024-03-04T06:55:17.985489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098537+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098537+0000","last_peered":"2024-03-04T06:55:13.098537+0000","last_clean":"2024-03-04T06:55:13.098537+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098537+0000","last_undegraded":"2024-03-04T06:55:13.098537+0000","last_fullsized":"2024-03-04T06:55:13.098537+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105922+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105922+0000","last_peered":"2024-03-04T06:55:13.105922+0000","last_clean":"2024-03-04T06:55:13.105922+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105922+0000","last_undegraded":"2024-03-04T06:55:13.105922+0000","last_fullsized":"2024-03-04T06:55:13.105922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102561+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102561+0000","last_peered":"2024-03-04T06:55:13.102561+0000","last_clean":"2024-03-04T06:55:13.102561+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102561+0000","last_undegraded":"2024-03-04T06:55:13.102561+0000","last_fullsized":"2024-03-04T06:55:13.102561+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114471+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114471+0000","last_peered":"2024-03-04T06:55:13.114471+0000","last_clean":"2024-03-04T06:55:13.114471+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114471+0000","last_undegraded":"2024-03-04T06:55:13.114471+0000","last_fullsized":"2024-03-04T06:55:13.114471+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114484+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114484+0000","last_peered":"2024-03-04T06:55:13.114484+0000","last_clean":"2024-03-04T06:55:13.114484+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114484+0000","last_undegraded":"2024-03-04T06:55:13.114484+0000","last_fullsized":"2024-03-04T06:55:13.114484+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1252,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101837+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101837+0000","last_peered":"2024-03-04T06:55:13.101837+0000","last_clean":"2024-03-04T06:55:13.101837+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101837+0000","last_undegraded":"2024-03-04T06:55:13.101837+0000","last_fullsized":"2024-03-04T06:55:13.101837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3576,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096470+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:13.096470+0000","last_peered":"2024-03-04T06:55:13.096470+0000","last_clean":"2024-03-04T06:55:13.096470+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:13.096470+0000","last_undegraded":"2024-03-04T06:55:13.096470+0000","last_fullsized":"2024-03-04T06:55:13.096470+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096992+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096992+0000","last_peered":"2024-03-04T06:55:13.096992+0000","last_clean":"2024-03-04T06:55:13.096992+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096992+0000","last_undegraded":"2024-03-04T06:55:13.096992+0000","last_fullsized":"2024-03-04T06:55:13.096992+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102943+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102943+0000","last_peered":"2024-03-04T06:55:13.102943+0000","last_clean":"2024-03-04T06:55:13.102943+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102943+0000","last_undegraded":"2024-03-04T06:55:13.102943+0000","last_fullsized":"2024-03-04T06:55:13.102943+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17115,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117976+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117976+0000","last_peered":"2024-03-04T06:55:13.117976+0000","last_clean":"2024-03-04T06:55:13.117976+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117976+0000","last_undegraded":"2024-03-04T06:55:13.117976+0000","last_fullsized":"2024-03-04T06:55:13.117976+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115088+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115088+0000","last_peered":"2024-03-04T06:55:13.115088+0000","last_clean":"2024-03-04T06:55:13.115088+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115088+0000","last_undegraded":"2024-03-04T06:55:13.115088+0000","last_fullsized":"2024-03-04T06:55:13.115088+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116699+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116699+0000","last_peered":"2024-03-04T06:55:13.116699+0000","last_clean":"2024-03-04T06:55:13.116699+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116699+0000","last_undegraded":"2024-03-04T06:55:13.116699+0000","last_fullsized":"2024-03-04T06:55:13.116699+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106020+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.106020+0000","last_peered":"2024-03-04T06:55:13.106020+0000","last_clean":"2024-03-04T06:55:13.106020+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.106020+0000","last_undegraded":"2024-03-04T06:55:13.106020+0000","last_fullsized":"2024-03-04T06:55:13.106020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4385,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117010+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.117010+0000","last_peered":"2024-03-04T06:55:13.117010+0000","last_clean":"2024-03-04T06:55:13.117010+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.117010+0000","last_undegraded":"2024-03-04T06:55:13.117010+0000","last_fullsized":"2024-03-04T06:55:13.117010+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115964+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115964+0000","last_peered":"2024-03-04T06:55:13.115964+0000","last_clean":"2024-03-04T06:55:13.115964+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115964+0000","last_undegraded":"2024-03-04T06:55:13.115964+0000","last_fullsized":"2024-03-04T06:55:13.115964+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105737+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105737+0000","last_peered":"2024-03-04T06:55:13.105737+0000","last_clean":"2024-03-04T06:55:13.105737+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105737+0000","last_undegraded":"2024-03-04T06:55:13.105737+0000","last_fullsized":"2024-03-04T06:55:13.105737+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096287+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096287+0000","last_peered":"2024-03-04T06:55:13.096287+0000","last_clean":"2024-03-04T06:55:13.096287+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096287+0000","last_undegraded":"2024-03-04T06:55:13.096287+0000","last_fullsized":"2024-03-04T06:55:13.096287+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5638,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097306+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:13.097306+0000","last_peered":"2024-03-04T06:55:13.097306+0000","last_clean":"2024-03-04T06:55:13.097306+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:13.097306+0000","last_undegraded":"2024-03-04T06:55:13.097306+0000","last_fullsized":"2024-03-04T06:55:13.097306+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141294+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.141294+0000","last_peered":"2024-03-04T06:55:13.141294+0000","last_clean":"2024-03-04T06:55:13.141294+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.141294+0000","last_undegraded":"2024-03-04T06:55:13.141294+0000","last_fullsized":"2024-03-04T06:55:13.141294+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114171+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114171+0000","last_peered":"2024-03-04T06:55:13.114171+0000","last_clean":"2024-03-04T06:55:13.114171+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114171+0000","last_undegraded":"2024-03-04T06:55:13.114171+0000","last_fullsized":"2024-03-04T06:55:13.114171+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375859+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:28.375859+0000","last_peered":"2024-03-04T06:55:28.375859+0000","last_clean":"2024-03-04T06:55:28.375859+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:28.375859+0000","last_undegraded":"2024-03-04T06:55:28.375859+0000","last_fullsized":"2024-03-04T06:55:28.375859+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4014,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107389+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.107389+0000","last_peered":"2024-03-04T06:55:13.107389+0000","last_clean":"2024-03-04T06:55:13.107389+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.107389+0000","last_undegraded":"2024-03-04T06:55:13.107389+0000","last_fullsized":"2024-03-04T06:55:13.107389+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.217050+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:43.217050+0000","last_peered":"2024-03-04T06:55:43.217050+0000","last_clean":"2024-03-04T06:55:43.217050+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:43.217050+0000","last_undegraded":"2024-03-04T06:55:43.217050+0000","last_fullsized":"2024-03-04T06:55:43.217050+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098424+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098424+0000","last_peered":"2024-03-04T06:55:13.098424+0000","last_clean":"2024-03-04T06:55:13.098424+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098424+0000","last_undegraded":"2024-03-04T06:55:13.098424+0000","last_fullsized":"2024-03-04T06:55:13.098424+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105228+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105228+0000","last_peered":"2024-03-04T06:55:13.105228+0000","last_clean":"2024-03-04T06:55:13.105228+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105228+0000","last_undegraded":"2024-03-04T06:55:13.105228+0000","last_fullsized":"2024-03-04T06:55:13.105228+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1549,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101736+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101736+0000","last_peered":"2024-03-04T06:55:13.101736+0000","last_clean":"2024-03-04T06:55:13.101736+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101736+0000","last_undegraded":"2024-03-04T06:55:13.101736+0000","last_fullsized":"2024-03-04T06:55:13.101736+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3950,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933655+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:22.933655+0000","last_peered":"2024-03-04T06:55:22.933655+0000","last_clean":"2024-03-04T06:55:22.933655+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:22.933655+0000","last_undegraded":"2024-03-04T06:55:22.933655+0000","last_fullsized":"2024-03-04T06:55:22.933655+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117375+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117375+0000","last_peered":"2024-03-04T06:55:13.117375+0000","last_clean":"2024-03-04T06:55:13.117375+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117375+0000","last_undegraded":"2024-03-04T06:55:13.117375+0000","last_fullsized":"2024-03-04T06:55:13.117375+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375833+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:28.375833+0000","last_peered":"2024-03-04T06:55:28.375833+0000","last_clean":"2024-03-04T06:55:28.375833+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:28.375833+0000","last_undegraded":"2024-03-04T06:55:28.375833+0000","last_fullsized":"2024-03-04T06:55:28.375833+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101691+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101691+0000","last_peered":"2024-03-04T06:55:13.101691+0000","last_clean":"2024-03-04T06:55:13.101691+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101691+0000","last_undegraded":"2024-03-04T06:55:13.101691+0000","last_fullsized":"2024-03-04T06:55:13.101691+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15291,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:43.217015+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:43.217015+0000","last_peered":"2024-03-04T06:55:43.217015+0000","last_clean":"2024-03-04T06:55:43.217015+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:43.217015+0000","last_undegraded":"2024-03-04T06:55:43.217015+0000","last_fullsized":"2024-03-04T06:55:43.217015+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117527+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117527+0000","last_peered":"2024-03-04T06:55:13.117527+0000","last_clean":"2024-03-04T06:55:13.117527+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117527+0000","last_undegraded":"2024-03-04T06:55:13.117527+0000","last_fullsized":"2024-03-04T06:55:13.117527+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102583+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102583+0000","last_peered":"2024-03-04T06:55:13.102583+0000","last_clean":"2024-03-04T06:55:13.102583+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102583+0000","last_undegraded":"2024-03-04T06:55:13.102583+0000","last_fullsized":"2024-03-04T06:55:13.102583+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116059+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116059+0000","last_peered":"2024-03-04T06:55:13.116059+0000","last_clean":"2024-03-04T06:55:13.116059+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116059+0000","last_undegraded":"2024-03-04T06:55:13.116059+0000","last_fullsized":"2024-03-04T06:55:13.116059+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4378,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097496+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097496+0000","last_peered":"2024-03-04T06:55:13.097496+0000","last_clean":"2024-03-04T06:55:13.097496+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097496+0000","last_undegraded":"2024-03-04T06:55:13.097496+0000","last_fullsized":"2024-03-04T06:55:13.097496+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988300+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:44.988300+0000","last_peered":"2024-03-04T06:55:44.988300+0000","last_clean":"2024-03-04T06:55:44.988300+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:44.988300+0000","last_undegraded":"2024-03-04T06:55:44.988300+0000","last_fullsized":"2024-03-04T06:55:44.988300+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141284+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.141284+0000","last_peered":"2024-03-04T06:55:13.141284+0000","last_clean":"2024-03-04T06:55:13.141284+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.141284+0000","last_undegraded":"2024-03-04T06:55:13.141284+0000","last_fullsized":"2024-03-04T06:55:13.141284+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097249+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097249+0000","last_peered":"2024-03-04T06:55:13.097249+0000","last_clean":"2024-03-04T06:55:13.097249+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097249+0000","last_undegraded":"2024-03-04T06:55:13.097249+0000","last_fullsized":"2024-03-04T06:55:13.097249+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4609,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:44.988263+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:44.988263+0000","last_peered":"2024-03-04T06:55:44.988263+0000","last_clean":"2024-03-04T06:55:44.988263+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:44.988263+0000","last_undegraded":"2024-03-04T06:55:44.988263+0000","last_fullsized":"2024-03-04T06:55:44.988263+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095704+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095704+0000","last_peered":"2024-03-04T06:55:13.095704+0000","last_clean":"2024-03-04T06:55:13.095704+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095704+0000","last_undegraded":"2024-03-04T06:55:13.095704+0000","last_fullsized":"2024-03-04T06:55:13.095704+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1077,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115185+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115185+0000","last_peered":"2024-03-04T06:55:13.115185+0000","last_clean":"2024-03-04T06:55:13.115185+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115185+0000","last_undegraded":"2024-03-04T06:55:13.115185+0000","last_fullsized":"2024-03-04T06:55:13.115185+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115644+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115644+0000","last_peered":"2024-03-04T06:55:13.115644+0000","last_clean":"2024-03-04T06:55:13.115644+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115644+0000","last_undegraded":"2024-03-04T06:55:13.115644+0000","last_fullsized":"2024-03-04T06:55:13.115644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4633,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107390+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:13.107390+0000","last_peered":"2024-03-04T06:55:13.107390+0000","last_clean":"2024-03-04T06:55:13.107390+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:13.107390+0000","last_undegraded":"2024-03-04T06:55:13.107390+0000","last_fullsized":"2024-03-04T06:55:13.107390+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101972+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101972+0000","last_peered":"2024-03-04T06:55:13.101972+0000","last_clean":"2024-03-04T06:55:13.101972+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101972+0000","last_undegraded":"2024-03-04T06:55:13.101972+0000","last_fullsized":"2024-03-04T06:55:13.101972+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1184,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095689+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095689+0000","last_peered":"2024-03-04T06:55:13.095689+0000","last_clean":"2024-03-04T06:55:13.095689+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095689+0000","last_undegraded":"2024-03-04T06:55:13.095689+0000","last_fullsized":"2024-03-04T06:55:13.095689+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5157,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.113366+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.113366+0000","last_peered":"2024-03-04T06:55:13.113366+0000","last_clean":"2024-03-04T06:55:13.113366+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.113366+0000","last_undegraded":"2024-03-04T06:55:13.113366+0000","last_fullsized":"2024-03-04T06:55:13.113366+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141219+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.141219+0000","last_peered":"2024-03-04T06:55:13.141219+0000","last_clean":"2024-03-04T06:55:13.141219+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.141219+0000","last_undegraded":"2024-03-04T06:55:13.141219+0000","last_fullsized":"2024-03-04T06:55:13.141219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097821+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097821+0000","last_peered":"2024-03-04T06:55:13.097821+0000","last_clean":"2024-03-04T06:55:13.097821+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097821+0000","last_undegraded":"2024-03-04T06:55:13.097821+0000","last_fullsized":"2024-03-04T06:55:13.097821+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4718,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.169321+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.169321+0000","last_peered":"2024-03-04T06:55:13.169321+0000","last_clean":"2024-03-04T06:55:13.169321+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.169321+0000","last_undegraded":"2024-03-04T06:55:13.169321+0000","last_fullsized":"2024-03-04T06:55:13.169321+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141246+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.141246+0000","last_peered":"2024-03-04T06:55:13.141246+0000","last_clean":"2024-03-04T06:55:13.141246+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.141246+0000","last_undegraded":"2024-03-04T06:55:13.141246+0000","last_fullsized":"2024-03-04T06:55:13.141246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098839+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098839+0000","last_peered":"2024-03-04T06:55:13.098839+0000","last_clean":"2024-03-04T06:55:13.098839+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098839+0000","last_undegraded":"2024-03-04T06:55:13.098839+0000","last_fullsized":"2024-03-04T06:55:13.098839+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5554,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:33.143474+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:33.143474+0000","last_peered":"2024-03-04T06:55:33.143474+0000","last_clean":"2024-03-04T06:55:33.143474+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:33.143474+0000","last_undegraded":"2024-03-04T06:55:33.143474+0000","last_fullsized":"2024-03-04T06:55:33.143474+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102401+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102401+0000","last_peered":"2024-03-04T06:55:13.102401+0000","last_clean":"2024-03-04T06:55:13.102401+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102401+0000","last_undegraded":"2024-03-04T06:55:13.102401+0000","last_fullsized":"2024-03-04T06:55:13.102401+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114691+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114691+0000","last_peered":"2024-03-04T06:55:13.114691+0000","last_clean":"2024-03-04T06:55:13.114691+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114691+0000","last_undegraded":"2024-03-04T06:55:13.114691+0000","last_fullsized":"2024-03-04T06:55:13.114691+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096824+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096824+0000","last_peered":"2024-03-04T06:55:13.096824+0000","last_clean":"2024-03-04T06:55:13.096824+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096824+0000","last_undegraded":"2024-03-04T06:55:13.096824+0000","last_fullsized":"2024-03-04T06:55:13.096824+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097239+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097239+0000","last_peered":"2024-03-04T06:55:13.097239+0000","last_clean":"2024-03-04T06:55:13.097239+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097239+0000","last_undegraded":"2024-03-04T06:55:13.097239+0000","last_fullsized":"2024-03-04T06:55:13.097239+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102489+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102489+0000","last_peered":"2024-03-04T06:55:13.102489+0000","last_clean":"2024-03-04T06:55:13.102489+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102489+0000","last_undegraded":"2024-03-04T06:55:13.102489+0000","last_fullsized":"2024-03-04T06:55:13.102489+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4365,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.315099+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:13.315099+0000","last_peered":"2024-03-04T06:55:13.315099+0000","last_clean":"2024-03-04T06:55:13.315099+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:13.315099+0000","last_undegraded":"2024-03-04T06:55:13.315099+0000","last_fullsized":"2024-03-04T06:55:13.315099+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:33.143531+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:33.143531+0000","last_peered":"2024-03-04T06:55:33.143531+0000","last_clean":"2024-03-04T06:55:33.143531+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:33.143531+0000","last_undegraded":"2024-03-04T06:55:33.143531+0000","last_fullsized":"2024-03-04T06:55:33.143531+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1138,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105888+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:13.105888+0000","last_peered":"2024-03-04T06:55:13.105888+0000","last_clean":"2024-03-04T06:55:13.105888+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:13.105888+0000","last_undegraded":"2024-03-04T06:55:13.105888+0000","last_fullsized":"2024-03-04T06:55:13.105888+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4599,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.322375+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.322375+0000","last_peered":"2024-03-04T06:55:13.322375+0000","last_clean":"2024-03-04T06:55:13.322375+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.322375+0000","last_undegraded":"2024-03-04T06:55:13.322375+0000","last_fullsized":"2024-03-04T06:55:13.322375+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097504+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097504+0000","last_peered":"2024-03-04T06:55:13.097504+0000","last_clean":"2024-03-04T06:55:13.097504+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097504+0000","last_undegraded":"2024-03-04T06:55:13.097504+0000","last_fullsized":"2024-03-04T06:55:13.097504+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105586+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.105586+0000","last_peered":"2024-03-04T06:55:13.105586+0000","last_clean":"2024-03-04T06:55:13.105586+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.105586+0000","last_undegraded":"2024-03-04T06:55:13.105586+0000","last_fullsized":"2024-03-04T06:55:13.105586+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.216983+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:43.216983+0000","last_peered":"2024-03-04T06:55:43.216983+0000","last_clean":"2024-03-04T06:55:43.216983+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:43.216983+0000","last_undegraded":"2024-03-04T06:55:43.216983+0000","last_fullsized":"2024-03-04T06:55:43.216983+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375870+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:28.375870+0000","last_peered":"2024-03-04T06:55:28.375870+0000","last_clean":"2024-03-04T06:55:28.375870+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:28.375870+0000","last_undegraded":"2024-03-04T06:55:28.375870+0000","last_fullsized":"2024-03-04T06:55:28.375870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106053+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.106053+0000","last_peered":"2024-03-04T06:55:13.106053+0000","last_clean":"2024-03-04T06:55:13.106053+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.106053+0000","last_undegraded":"2024-03-04T06:55:13.106053+0000","last_fullsized":"2024-03-04T06:55:13.106053+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117390+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117390+0000","last_peered":"2024-03-04T06:55:13.117390+0000","last_clean":"2024-03-04T06:55:13.117390+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117390+0000","last_undegraded":"2024-03-04T06:55:13.117390+0000","last_fullsized":"2024-03-04T06:55:13.117390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096810+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096810+0000","last_peered":"2024-03-04T06:55:13.096810+0000","last_clean":"2024-03-04T06:55:13.096810+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096810+0000","last_undegraded":"2024-03-04T06:55:13.096810+0000","last_fullsized":"2024-03-04T06:55:13.096810+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141268+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.141268+0000","last_peered":"2024-03-04T06:55:13.141268+0000","last_clean":"2024-03-04T06:55:13.141268+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.141268+0000","last_undegraded":"2024-03-04T06:55:13.141268+0000","last_fullsized":"2024-03-04T06:55:13.141268+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115286+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115286+0000","last_peered":"2024-03-04T06:55:13.115286+0000","last_clean":"2024-03-04T06:55:13.115286+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115286+0000","last_undegraded":"2024-03-04T06:55:13.115286+0000","last_fullsized":"2024-03-04T06:55:13.115286+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097481+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097481+0000","last_peered":"2024-03-04T06:55:13.097481+0000","last_clean":"2024-03-04T06:55:13.097481+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097481+0000","last_undegraded":"2024-03-04T06:55:13.097481+0000","last_fullsized":"2024-03-04T06:55:13.097481+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933591+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:22.933591+0000","last_peered":"2024-03-04T06:55:22.933591+0000","last_clean":"2024-03-04T06:55:22.933591+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:22.933591+0000","last_undegraded":"2024-03-04T06:55:22.933591+0000","last_fullsized":"2024-03-04T06:55:22.933591+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105576+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:13.105576+0000","last_peered":"2024-03-04T06:55:13.105576+0000","last_clean":"2024-03-04T06:55:13.105576+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:13.105576+0000","last_undegraded":"2024-03-04T06:55:13.105576+0000","last_fullsized":"2024-03-04T06:55:13.105576+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116911+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116911+0000","last_peered":"2024-03-04T06:55:13.116911+0000","last_clean":"2024-03-04T06:55:13.116911+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116911+0000","last_undegraded":"2024-03-04T06:55:13.116911+0000","last_fullsized":"2024-03-04T06:55:13.116911+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114836+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114836+0000","last_peered":"2024-03-04T06:55:13.114836+0000","last_clean":"2024-03-04T06:55:13.114836+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114836+0000","last_undegraded":"2024-03-04T06:55:13.114836+0000","last_fullsized":"2024-03-04T06:55:13.114836+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503454,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648101,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142408,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287055,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997761,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885818,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937395,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792748,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:57:52.329 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:52.329 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:52.329 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:52.329 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:52.329 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:52.329 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:52.329 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:52.330 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:52.330 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:52.330 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:57:52.330 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:57:52.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:52 smithi137 ceph-mon[88869]: pgmap v1000: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:52.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:52 smithi137 ceph-mon[91314]: pgmap v1000: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:52.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:52 smithi203 ceph-mon[85573]: pgmap v1000: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:53.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:53 smithi137 ceph-mon[88869]: from='client.44510 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:53.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:53 smithi137 ceph-mon[91314]: from='client.44510 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:53.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:53 smithi203 ceph-mon[85573]: from='client.44510 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:57:54.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:54 smithi137 ceph-mon[88869]: pgmap v1001: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:54.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:57:54.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:54 smithi137 ceph-mon[91314]: pgmap v1001: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:54.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:57:54.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:54 smithi203 ceph-mon[85573]: pgmap v1001: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:54.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:57:55.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:57:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:57:55] "GET /metrics HTTP/1.1" 200 36337 "" "Prometheus/2.43.0" 2024-03-04T06:57:56.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:56 smithi137 ceph-mon[88869]: pgmap v1002: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:56.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:56 smithi137 ceph-mon[91314]: pgmap v1002: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:56.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:56 smithi203 ceph-mon[85573]: pgmap v1002: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:58.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:57:58 smithi137 ceph-mon[88869]: pgmap v1003: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:58.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:57:58 smithi137 ceph-mon[91314]: pgmap v1003: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:57:58.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:57:58 smithi203 ceph-mon[85573]: pgmap v1003: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:00.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:00 smithi137 ceph-mon[88869]: pgmap v1004: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:00.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:00 smithi137 ceph-mon[91314]: pgmap v1004: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:00.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:00 smithi203 ceph-mon[85573]: pgmap v1004: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:02.331 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:58:02.553 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:58:02.675 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:02 smithi137 ceph-mon[88869]: pgmap v1005: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:02.675 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:02 smithi137 ceph-mon[91314]: pgmap v1005: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:02.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:02 smithi203 ceph-mon[85573]: pgmap v1005: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:04.338 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:58:04.341 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:58:04.698 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:04 smithi137 ceph-mon[88869]: pgmap v1006: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:04.698 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:04 smithi137 ceph-mon[91314]: pgmap v1006: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:04.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:04 smithi203 ceph-mon[85573]: pgmap v1006: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:04.988 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1006,"stamp":"2024-03-04T06:58:02.511015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004039"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103340+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103340+0000","last_peered":"2024-03-04T06:55:13.103340+0000","last_clean":"2024-03-04T06:55:13.103340+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103340+0000","last_undegraded":"2024-03-04T06:55:13.103340+0000","last_fullsized":"2024-03-04T06:55:13.103340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117002+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.117002+0000","last_peered":"2024-03-04T06:55:13.117002+0000","last_clean":"2024-03-04T06:55:13.117002+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.117002+0000","last_undegraded":"2024-03-04T06:55:13.117002+0000","last_fullsized":"2024-03-04T06:55:13.117002+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115416+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115416+0000","last_peered":"2024-03-04T06:55:13.115416+0000","last_clean":"2024-03-04T06:55:13.115416+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115416+0000","last_undegraded":"2024-03-04T06:55:13.115416+0000","last_fullsized":"2024-03-04T06:55:13.115416+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106163+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106163+0000","last_peered":"2024-03-04T06:55:13.106163+0000","last_clean":"2024-03-04T06:55:13.106163+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106163+0000","last_undegraded":"2024-03-04T06:55:13.106163+0000","last_fullsized":"2024-03-04T06:55:13.106163+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102005+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.102005+0000","last_peered":"2024-03-04T06:55:13.102005+0000","last_clean":"2024-03-04T06:55:13.102005+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.102005+0000","last_undegraded":"2024-03-04T06:55:13.102005+0000","last_fullsized":"2024-03-04T06:55:13.102005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106089+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106089+0000","last_peered":"2024-03-04T06:55:13.106089+0000","last_clean":"2024-03-04T06:55:13.106089+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106089+0000","last_undegraded":"2024-03-04T06:55:13.106089+0000","last_fullsized":"2024-03-04T06:55:13.106089+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101809+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101809+0000","last_peered":"2024-03-04T06:55:13.101809+0000","last_clean":"2024-03-04T06:55:13.101809+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101809+0000","last_undegraded":"2024-03-04T06:55:13.101809+0000","last_fullsized":"2024-03-04T06:55:13.101809+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984614+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:14.984614+0000","last_peered":"2024-03-04T06:55:14.984614+0000","last_clean":"2024-03-04T06:55:14.984614+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:14.984614+0000","last_undegraded":"2024-03-04T06:55:14.984614+0000","last_fullsized":"2024-03-04T06:55:14.984614+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1064,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103046+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.103046+0000","last_peered":"2024-03-04T06:55:13.103046+0000","last_clean":"2024-03-04T06:55:13.103046+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.103046+0000","last_undegraded":"2024-03-04T06:55:13.103046+0000","last_fullsized":"2024-03-04T06:55:13.103046+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115007+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.115007+0000","last_peered":"2024-03-04T06:55:13.115007+0000","last_clean":"2024-03-04T06:55:13.115007+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.115007+0000","last_undegraded":"2024-03-04T06:55:13.115007+0000","last_fullsized":"2024-03-04T06:55:13.115007+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114852+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114852+0000","last_peered":"2024-03-04T06:55:13.114852+0000","last_clean":"2024-03-04T06:55:13.114852+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114852+0000","last_undegraded":"2024-03-04T06:55:13.114852+0000","last_fullsized":"2024-03-04T06:55:13.114852+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:32.604419+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:32.604419+0000","last_peered":"2024-03-04T06:55:32.604419+0000","last_clean":"2024-03-04T06:55:32.604419+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:32.604419+0000","last_undegraded":"2024-03-04T06:55:32.604419+0000","last_fullsized":"2024-03-04T06:55:32.604419+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.099013+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.099013+0000","last_peered":"2024-03-04T06:55:13.099013+0000","last_clean":"2024-03-04T06:55:13.099013+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.099013+0000","last_undegraded":"2024-03-04T06:55:13.099013+0000","last_fullsized":"2024-03-04T06:55:13.099013+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985446+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:17.985446+0000","last_peered":"2024-03-04T06:55:17.985446+0000","last_clean":"2024-03-04T06:55:17.985446+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:17.985446+0000","last_undegraded":"2024-03-04T06:55:17.985446+0000","last_fullsized":"2024-03-04T06:55:17.985446+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115730+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:13.115730+0000","last_peered":"2024-03-04T06:55:13.115730+0000","last_clean":"2024-03-04T06:55:13.115730+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:13.115730+0000","last_undegraded":"2024-03-04T06:55:13.115730+0000","last_fullsized":"2024-03-04T06:55:13.115730+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.104995+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:13.104995+0000","last_peered":"2024-03-04T06:55:13.104995+0000","last_clean":"2024-03-04T06:55:13.104995+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:13.104995+0000","last_undegraded":"2024-03-04T06:55:13.104995+0000","last_fullsized":"2024-03-04T06:55:13.104995+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.107002+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:13.107002+0000","last_peered":"2024-03-04T06:55:13.107002+0000","last_clean":"2024-03-04T06:55:13.107002+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:13.107002+0000","last_undegraded":"2024-03-04T06:55:13.107002+0000","last_fullsized":"2024-03-04T06:55:13.107002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096941+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096941+0000","last_peered":"2024-03-04T06:55:13.096941+0000","last_clean":"2024-03-04T06:55:13.096941+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096941+0000","last_undegraded":"2024-03-04T06:55:13.096941+0000","last_fullsized":"2024-03-04T06:55:13.096941+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102303+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102303+0000","last_peered":"2024-03-04T06:55:13.102303+0000","last_clean":"2024-03-04T06:55:13.102303+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102303+0000","last_undegraded":"2024-03-04T06:55:13.102303+0000","last_fullsized":"2024-03-04T06:55:13.102303+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116614+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116614+0000","last_peered":"2024-03-04T06:55:13.116614+0000","last_clean":"2024-03-04T06:55:13.116614+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116614+0000","last_undegraded":"2024-03-04T06:55:13.116614+0000","last_fullsized":"2024-03-04T06:55:13.116614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988343+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:44.988343+0000","last_peered":"2024-03-04T06:55:44.988343+0000","last_clean":"2024-03-04T06:55:44.988343+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:44.988343+0000","last_undegraded":"2024-03-04T06:55:44.988343+0000","last_fullsized":"2024-03-04T06:55:44.988343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988353+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:44.988353+0000","last_peered":"2024-03-04T06:55:44.988353+0000","last_clean":"2024-03-04T06:55:44.988353+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:44.988353+0000","last_undegraded":"2024-03-04T06:55:44.988353+0000","last_fullsized":"2024-03-04T06:55:44.988353+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116801+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.116801+0000","last_peered":"2024-03-04T06:55:13.116801+0000","last_clean":"2024-03-04T06:55:13.116801+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.116801+0000","last_undegraded":"2024-03-04T06:55:13.116801+0000","last_fullsized":"2024-03-04T06:55:13.116801+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1234,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098569+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098569+0000","last_peered":"2024-03-04T06:55:13.098569+0000","last_clean":"2024-03-04T06:55:13.098569+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098569+0000","last_undegraded":"2024-03-04T06:55:13.098569+0000","last_fullsized":"2024-03-04T06:55:13.098569+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1221,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097506+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097506+0000","last_peered":"2024-03-04T06:55:13.097506+0000","last_clean":"2024-03-04T06:55:13.097506+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097506+0000","last_undegraded":"2024-03-04T06:55:13.097506+0000","last_fullsized":"2024-03-04T06:55:13.097506+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102499+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102499+0000","last_peered":"2024-03-04T06:55:13.102499+0000","last_clean":"2024-03-04T06:55:13.102499+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102499+0000","last_undegraded":"2024-03-04T06:55:13.102499+0000","last_fullsized":"2024-03-04T06:55:13.102499+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106216+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106216+0000","last_peered":"2024-03-04T06:55:13.106216+0000","last_clean":"2024-03-04T06:55:13.106216+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106216+0000","last_undegraded":"2024-03-04T06:55:13.106216+0000","last_fullsized":"2024-03-04T06:55:13.106216+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984673+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:14.984673+0000","last_peered":"2024-03-04T06:55:14.984673+0000","last_clean":"2024-03-04T06:55:14.984673+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:14.984673+0000","last_undegraded":"2024-03-04T06:55:14.984673+0000","last_fullsized":"2024-03-04T06:55:14.984673+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1188,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096052+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.096052+0000","last_peered":"2024-03-04T06:55:13.096052+0000","last_clean":"2024-03-04T06:55:13.096052+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.096052+0000","last_undegraded":"2024-03-04T06:55:13.096052+0000","last_fullsized":"2024-03-04T06:55:13.096052+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114709+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114709+0000","last_peered":"2024-03-04T06:55:13.114709+0000","last_clean":"2024-03-04T06:55:13.114709+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114709+0000","last_undegraded":"2024-03-04T06:55:13.114709+0000","last_fullsized":"2024-03-04T06:55:13.114709+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.118051+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.118051+0000","last_peered":"2024-03-04T06:55:13.118051+0000","last_clean":"2024-03-04T06:55:13.118051+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.118051+0000","last_undegraded":"2024-03-04T06:55:13.118051+0000","last_fullsized":"2024-03-04T06:55:13.118051+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096734+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096734+0000","last_peered":"2024-03-04T06:55:13.096734+0000","last_clean":"2024-03-04T06:55:13.096734+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096734+0000","last_undegraded":"2024-03-04T06:55:13.096734+0000","last_fullsized":"2024-03-04T06:55:13.096734+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097225+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097225+0000","last_peered":"2024-03-04T06:55:13.097225+0000","last_clean":"2024-03-04T06:55:13.097225+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097225+0000","last_undegraded":"2024-03-04T06:55:13.097225+0000","last_fullsized":"2024-03-04T06:55:13.097225+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105593+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105593+0000","last_peered":"2024-03-04T06:55:13.105593+0000","last_clean":"2024-03-04T06:55:13.105593+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105593+0000","last_undegraded":"2024-03-04T06:55:13.105593+0000","last_fullsized":"2024-03-04T06:55:13.105593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115824+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115824+0000","last_peered":"2024-03-04T06:55:13.115824+0000","last_clean":"2024-03-04T06:55:13.115824+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115824+0000","last_undegraded":"2024-03-04T06:55:13.115824+0000","last_fullsized":"2024-03-04T06:55:13.115824+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115145+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115145+0000","last_peered":"2024-03-04T06:55:13.115145+0000","last_clean":"2024-03-04T06:55:13.115145+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115145+0000","last_undegraded":"2024-03-04T06:55:13.115145+0000","last_fullsized":"2024-03-04T06:55:13.115145+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1110,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105468+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105468+0000","last_peered":"2024-03-04T06:55:13.105468+0000","last_clean":"2024-03-04T06:55:13.105468+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105468+0000","last_undegraded":"2024-03-04T06:55:13.105468+0000","last_fullsized":"2024-03-04T06:55:13.105468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105915+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105915+0000","last_peered":"2024-03-04T06:55:13.105915+0000","last_clean":"2024-03-04T06:55:13.105915+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105915+0000","last_undegraded":"2024-03-04T06:55:13.105915+0000","last_fullsized":"2024-03-04T06:55:13.105915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116155+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:13.116155+0000","last_peered":"2024-03-04T06:55:13.116155+0000","last_clean":"2024-03-04T06:55:13.116155+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:13.116155+0000","last_undegraded":"2024-03-04T06:55:13.116155+0000","last_fullsized":"2024-03-04T06:55:13.116155+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116083+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116083+0000","last_peered":"2024-03-04T06:55:13.116083+0000","last_clean":"2024-03-04T06:55:13.116083+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116083+0000","last_undegraded":"2024-03-04T06:55:13.116083+0000","last_fullsized":"2024-03-04T06:55:13.116083+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.602395+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:17.602395+0000","last_peered":"2024-03-04T06:55:17.602395+0000","last_clean":"2024-03-04T06:55:17.602395+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:17.602395+0000","last_undegraded":"2024-03-04T06:55:17.602395+0000","last_fullsized":"2024-03-04T06:55:17.602395+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114988+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114988+0000","last_peered":"2024-03-04T06:55:13.114988+0000","last_clean":"2024-03-04T06:55:13.114988+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114988+0000","last_undegraded":"2024-03-04T06:55:13.114988+0000","last_fullsized":"2024-03-04T06:55:13.114988+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102665+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102665+0000","last_peered":"2024-03-04T06:55:13.102665+0000","last_clean":"2024-03-04T06:55:13.102665+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102665+0000","last_undegraded":"2024-03-04T06:55:13.102665+0000","last_fullsized":"2024-03-04T06:55:13.102665+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1302,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985489+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:17.985489+0000","last_peered":"2024-03-04T06:55:17.985489+0000","last_clean":"2024-03-04T06:55:17.985489+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:17.985489+0000","last_undegraded":"2024-03-04T06:55:17.985489+0000","last_fullsized":"2024-03-04T06:55:17.985489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098537+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098537+0000","last_peered":"2024-03-04T06:55:13.098537+0000","last_clean":"2024-03-04T06:55:13.098537+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098537+0000","last_undegraded":"2024-03-04T06:55:13.098537+0000","last_fullsized":"2024-03-04T06:55:13.098537+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105922+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:13.105922+0000","last_peered":"2024-03-04T06:55:13.105922+0000","last_clean":"2024-03-04T06:55:13.105922+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:13.105922+0000","last_undegraded":"2024-03-04T06:55:13.105922+0000","last_fullsized":"2024-03-04T06:55:13.105922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102561+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102561+0000","last_peered":"2024-03-04T06:55:13.102561+0000","last_clean":"2024-03-04T06:55:13.102561+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102561+0000","last_undegraded":"2024-03-04T06:55:13.102561+0000","last_fullsized":"2024-03-04T06:55:13.102561+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114471+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114471+0000","last_peered":"2024-03-04T06:55:13.114471+0000","last_clean":"2024-03-04T06:55:13.114471+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114471+0000","last_undegraded":"2024-03-04T06:55:13.114471+0000","last_fullsized":"2024-03-04T06:55:13.114471+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114484+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114484+0000","last_peered":"2024-03-04T06:55:13.114484+0000","last_clean":"2024-03-04T06:55:13.114484+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114484+0000","last_undegraded":"2024-03-04T06:55:13.114484+0000","last_fullsized":"2024-03-04T06:55:13.114484+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1252,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101837+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101837+0000","last_peered":"2024-03-04T06:55:13.101837+0000","last_clean":"2024-03-04T06:55:13.101837+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101837+0000","last_undegraded":"2024-03-04T06:55:13.101837+0000","last_fullsized":"2024-03-04T06:55:13.101837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3577,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377824+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:48.377824+0000","last_peered":"2024-03-04T06:55:48.377824+0000","last_clean":"2024-03-04T06:55:48.377824+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:48.377824+0000","last_undegraded":"2024-03-04T06:55:48.377824+0000","last_fullsized":"2024-03-04T06:55:48.377824+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096992+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096992+0000","last_peered":"2024-03-04T06:55:13.096992+0000","last_clean":"2024-03-04T06:55:13.096992+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096992+0000","last_undegraded":"2024-03-04T06:55:13.096992+0000","last_fullsized":"2024-03-04T06:55:13.096992+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102943+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102943+0000","last_peered":"2024-03-04T06:55:13.102943+0000","last_clean":"2024-03-04T06:55:13.102943+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102943+0000","last_undegraded":"2024-03-04T06:55:13.102943+0000","last_fullsized":"2024-03-04T06:55:13.102943+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17115,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117976+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117976+0000","last_peered":"2024-03-04T06:55:13.117976+0000","last_clean":"2024-03-04T06:55:13.117976+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117976+0000","last_undegraded":"2024-03-04T06:55:13.117976+0000","last_fullsized":"2024-03-04T06:55:13.117976+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115088+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115088+0000","last_peered":"2024-03-04T06:55:13.115088+0000","last_clean":"2024-03-04T06:55:13.115088+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115088+0000","last_undegraded":"2024-03-04T06:55:13.115088+0000","last_fullsized":"2024-03-04T06:55:13.115088+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116699+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116699+0000","last_peered":"2024-03-04T06:55:13.116699+0000","last_clean":"2024-03-04T06:55:13.116699+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116699+0000","last_undegraded":"2024-03-04T06:55:13.116699+0000","last_fullsized":"2024-03-04T06:55:13.116699+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106020+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.106020+0000","last_peered":"2024-03-04T06:55:13.106020+0000","last_clean":"2024-03-04T06:55:13.106020+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.106020+0000","last_undegraded":"2024-03-04T06:55:13.106020+0000","last_fullsized":"2024-03-04T06:55:13.106020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4385,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117010+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.117010+0000","last_peered":"2024-03-04T06:55:13.117010+0000","last_clean":"2024-03-04T06:55:13.117010+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.117010+0000","last_undegraded":"2024-03-04T06:55:13.117010+0000","last_fullsized":"2024-03-04T06:55:13.117010+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115964+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115964+0000","last_peered":"2024-03-04T06:55:13.115964+0000","last_clean":"2024-03-04T06:55:13.115964+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115964+0000","last_undegraded":"2024-03-04T06:55:13.115964+0000","last_fullsized":"2024-03-04T06:55:13.115964+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105737+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105737+0000","last_peered":"2024-03-04T06:55:13.105737+0000","last_clean":"2024-03-04T06:55:13.105737+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105737+0000","last_undegraded":"2024-03-04T06:55:13.105737+0000","last_fullsized":"2024-03-04T06:55:13.105737+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096287+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096287+0000","last_peered":"2024-03-04T06:55:13.096287+0000","last_clean":"2024-03-04T06:55:13.096287+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096287+0000","last_undegraded":"2024-03-04T06:55:13.096287+0000","last_fullsized":"2024-03-04T06:55:13.096287+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5639,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377937+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:48.377937+0000","last_peered":"2024-03-04T06:55:48.377937+0000","last_clean":"2024-03-04T06:55:48.377937+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:48.377937+0000","last_undegraded":"2024-03-04T06:55:48.377937+0000","last_fullsized":"2024-03-04T06:55:48.377937+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141294+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.141294+0000","last_peered":"2024-03-04T06:55:13.141294+0000","last_clean":"2024-03-04T06:55:13.141294+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.141294+0000","last_undegraded":"2024-03-04T06:55:13.141294+0000","last_fullsized":"2024-03-04T06:55:13.141294+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114171+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114171+0000","last_peered":"2024-03-04T06:55:13.114171+0000","last_clean":"2024-03-04T06:55:13.114171+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114171+0000","last_undegraded":"2024-03-04T06:55:13.114171+0000","last_fullsized":"2024-03-04T06:55:13.114171+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375859+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:28.375859+0000","last_peered":"2024-03-04T06:55:28.375859+0000","last_clean":"2024-03-04T06:55:28.375859+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:28.375859+0000","last_undegraded":"2024-03-04T06:55:28.375859+0000","last_fullsized":"2024-03-04T06:55:28.375859+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4014,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107389+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.107389+0000","last_peered":"2024-03-04T06:55:13.107389+0000","last_clean":"2024-03-04T06:55:13.107389+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.107389+0000","last_undegraded":"2024-03-04T06:55:13.107389+0000","last_fullsized":"2024-03-04T06:55:13.107389+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.217050+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:43.217050+0000","last_peered":"2024-03-04T06:55:43.217050+0000","last_clean":"2024-03-04T06:55:43.217050+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:43.217050+0000","last_undegraded":"2024-03-04T06:55:43.217050+0000","last_fullsized":"2024-03-04T06:55:43.217050+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098424+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:55:13.098424+0000","last_peered":"2024-03-04T06:55:13.098424+0000","last_clean":"2024-03-04T06:55:13.098424+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:55:13.098424+0000","last_undegraded":"2024-03-04T06:55:13.098424+0000","last_fullsized":"2024-03-04T06:55:13.098424+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105228+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105228+0000","last_peered":"2024-03-04T06:55:13.105228+0000","last_clean":"2024-03-04T06:55:13.105228+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105228+0000","last_undegraded":"2024-03-04T06:55:13.105228+0000","last_fullsized":"2024-03-04T06:55:13.105228+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1549,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101736+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:55:13.101736+0000","last_peered":"2024-03-04T06:55:13.101736+0000","last_clean":"2024-03-04T06:55:13.101736+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:55:13.101736+0000","last_undegraded":"2024-03-04T06:55:13.101736+0000","last_fullsized":"2024-03-04T06:55:13.101736+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3950,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933655+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:22.933655+0000","last_peered":"2024-03-04T06:55:22.933655+0000","last_clean":"2024-03-04T06:55:22.933655+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:22.933655+0000","last_undegraded":"2024-03-04T06:55:22.933655+0000","last_fullsized":"2024-03-04T06:55:22.933655+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117375+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117375+0000","last_peered":"2024-03-04T06:55:13.117375+0000","last_clean":"2024-03-04T06:55:13.117375+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117375+0000","last_undegraded":"2024-03-04T06:55:13.117375+0000","last_fullsized":"2024-03-04T06:55:13.117375+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375833+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:28.375833+0000","last_peered":"2024-03-04T06:55:28.375833+0000","last_clean":"2024-03-04T06:55:28.375833+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:28.375833+0000","last_undegraded":"2024-03-04T06:55:28.375833+0000","last_fullsized":"2024-03-04T06:55:28.375833+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101691+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:55:13.101691+0000","last_peered":"2024-03-04T06:55:13.101691+0000","last_clean":"2024-03-04T06:55:13.101691+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:55:13.101691+0000","last_undegraded":"2024-03-04T06:55:13.101691+0000","last_fullsized":"2024-03-04T06:55:13.101691+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15291,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:43.217015+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:43.217015+0000","last_peered":"2024-03-04T06:55:43.217015+0000","last_clean":"2024-03-04T06:55:43.217015+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:43.217015+0000","last_undegraded":"2024-03-04T06:55:43.217015+0000","last_fullsized":"2024-03-04T06:55:43.217015+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117527+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117527+0000","last_peered":"2024-03-04T06:55:13.117527+0000","last_clean":"2024-03-04T06:55:13.117527+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117527+0000","last_undegraded":"2024-03-04T06:55:13.117527+0000","last_fullsized":"2024-03-04T06:55:13.117527+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102583+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102583+0000","last_peered":"2024-03-04T06:55:13.102583+0000","last_clean":"2024-03-04T06:55:13.102583+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102583+0000","last_undegraded":"2024-03-04T06:55:13.102583+0000","last_fullsized":"2024-03-04T06:55:13.102583+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116059+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116059+0000","last_peered":"2024-03-04T06:55:13.116059+0000","last_clean":"2024-03-04T06:55:13.116059+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116059+0000","last_undegraded":"2024-03-04T06:55:13.116059+0000","last_fullsized":"2024-03-04T06:55:13.116059+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4378,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097496+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097496+0000","last_peered":"2024-03-04T06:55:13.097496+0000","last_clean":"2024-03-04T06:55:13.097496+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097496+0000","last_undegraded":"2024-03-04T06:55:13.097496+0000","last_fullsized":"2024-03-04T06:55:13.097496+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988300+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:44.988300+0000","last_peered":"2024-03-04T06:55:44.988300+0000","last_clean":"2024-03-04T06:55:44.988300+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:44.988300+0000","last_undegraded":"2024-03-04T06:55:44.988300+0000","last_fullsized":"2024-03-04T06:55:44.988300+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141284+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.141284+0000","last_peered":"2024-03-04T06:55:13.141284+0000","last_clean":"2024-03-04T06:55:13.141284+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.141284+0000","last_undegraded":"2024-03-04T06:55:13.141284+0000","last_fullsized":"2024-03-04T06:55:13.141284+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097249+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097249+0000","last_peered":"2024-03-04T06:55:13.097249+0000","last_clean":"2024-03-04T06:55:13.097249+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097249+0000","last_undegraded":"2024-03-04T06:55:13.097249+0000","last_fullsized":"2024-03-04T06:55:13.097249+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4609,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:44.988263+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:44.988263+0000","last_peered":"2024-03-04T06:55:44.988263+0000","last_clean":"2024-03-04T06:55:44.988263+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:44.988263+0000","last_undegraded":"2024-03-04T06:55:44.988263+0000","last_fullsized":"2024-03-04T06:55:44.988263+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095704+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095704+0000","last_peered":"2024-03-04T06:55:13.095704+0000","last_clean":"2024-03-04T06:55:13.095704+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095704+0000","last_undegraded":"2024-03-04T06:55:13.095704+0000","last_fullsized":"2024-03-04T06:55:13.095704+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1077,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115185+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:13.115185+0000","last_peered":"2024-03-04T06:55:13.115185+0000","last_clean":"2024-03-04T06:55:13.115185+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:13.115185+0000","last_undegraded":"2024-03-04T06:55:13.115185+0000","last_fullsized":"2024-03-04T06:55:13.115185+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115644+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115644+0000","last_peered":"2024-03-04T06:55:13.115644+0000","last_clean":"2024-03-04T06:55:13.115644+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115644+0000","last_undegraded":"2024-03-04T06:55:13.115644+0000","last_fullsized":"2024-03-04T06:55:13.115644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4634,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:37.935758+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:37.935758+0000","last_peered":"2024-03-04T06:55:37.935758+0000","last_clean":"2024-03-04T06:55:37.935758+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:37.935758+0000","last_undegraded":"2024-03-04T06:55:37.935758+0000","last_fullsized":"2024-03-04T06:55:37.935758+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101972+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101972+0000","last_peered":"2024-03-04T06:55:13.101972+0000","last_clean":"2024-03-04T06:55:13.101972+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101972+0000","last_undegraded":"2024-03-04T06:55:13.101972+0000","last_fullsized":"2024-03-04T06:55:13.101972+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1184,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095689+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095689+0000","last_peered":"2024-03-04T06:55:13.095689+0000","last_clean":"2024-03-04T06:55:13.095689+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095689+0000","last_undegraded":"2024-03-04T06:55:13.095689+0000","last_fullsized":"2024-03-04T06:55:13.095689+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5157,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.113366+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.113366+0000","last_peered":"2024-03-04T06:55:13.113366+0000","last_clean":"2024-03-04T06:55:13.113366+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.113366+0000","last_undegraded":"2024-03-04T06:55:13.113366+0000","last_fullsized":"2024-03-04T06:55:13.113366+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141219+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.141219+0000","last_peered":"2024-03-04T06:55:13.141219+0000","last_clean":"2024-03-04T06:55:13.141219+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.141219+0000","last_undegraded":"2024-03-04T06:55:13.141219+0000","last_fullsized":"2024-03-04T06:55:13.141219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097821+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097821+0000","last_peered":"2024-03-04T06:55:13.097821+0000","last_clean":"2024-03-04T06:55:13.097821+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097821+0000","last_undegraded":"2024-03-04T06:55:13.097821+0000","last_fullsized":"2024-03-04T06:55:13.097821+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4718,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.169321+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.169321+0000","last_peered":"2024-03-04T06:55:13.169321+0000","last_clean":"2024-03-04T06:55:13.169321+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.169321+0000","last_undegraded":"2024-03-04T06:55:13.169321+0000","last_fullsized":"2024-03-04T06:55:13.169321+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141246+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.141246+0000","last_peered":"2024-03-04T06:55:13.141246+0000","last_clean":"2024-03-04T06:55:13.141246+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.141246+0000","last_undegraded":"2024-03-04T06:55:13.141246+0000","last_fullsized":"2024-03-04T06:55:13.141246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098839+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098839+0000","last_peered":"2024-03-04T06:55:13.098839+0000","last_clean":"2024-03-04T06:55:13.098839+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098839+0000","last_undegraded":"2024-03-04T06:55:13.098839+0000","last_fullsized":"2024-03-04T06:55:13.098839+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5554,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:33.143474+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:33.143474+0000","last_peered":"2024-03-04T06:55:33.143474+0000","last_clean":"2024-03-04T06:55:33.143474+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:33.143474+0000","last_undegraded":"2024-03-04T06:55:33.143474+0000","last_fullsized":"2024-03-04T06:55:33.143474+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102401+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102401+0000","last_peered":"2024-03-04T06:55:13.102401+0000","last_clean":"2024-03-04T06:55:13.102401+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102401+0000","last_undegraded":"2024-03-04T06:55:13.102401+0000","last_fullsized":"2024-03-04T06:55:13.102401+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114691+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:13.114691+0000","last_peered":"2024-03-04T06:55:13.114691+0000","last_clean":"2024-03-04T06:55:13.114691+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:13.114691+0000","last_undegraded":"2024-03-04T06:55:13.114691+0000","last_fullsized":"2024-03-04T06:55:13.114691+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096824+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096824+0000","last_peered":"2024-03-04T06:55:13.096824+0000","last_clean":"2024-03-04T06:55:13.096824+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096824+0000","last_undegraded":"2024-03-04T06:55:13.096824+0000","last_fullsized":"2024-03-04T06:55:13.096824+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097239+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097239+0000","last_peered":"2024-03-04T06:55:13.097239+0000","last_clean":"2024-03-04T06:55:13.097239+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097239+0000","last_undegraded":"2024-03-04T06:55:13.097239+0000","last_fullsized":"2024-03-04T06:55:13.097239+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102489+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102489+0000","last_peered":"2024-03-04T06:55:13.102489+0000","last_clean":"2024-03-04T06:55:13.102489+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102489+0000","last_undegraded":"2024-03-04T06:55:13.102489+0000","last_fullsized":"2024-03-04T06:55:13.102489+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4366,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377880+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:48.377880+0000","last_peered":"2024-03-04T06:55:48.377880+0000","last_clean":"2024-03-04T06:55:48.377880+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:48.377880+0000","last_undegraded":"2024-03-04T06:55:48.377880+0000","last_fullsized":"2024-03-04T06:55:48.377880+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:33.143531+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:33.143531+0000","last_peered":"2024-03-04T06:55:33.143531+0000","last_clean":"2024-03-04T06:55:33.143531+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:33.143531+0000","last_undegraded":"2024-03-04T06:55:33.143531+0000","last_fullsized":"2024-03-04T06:55:33.143531+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935733+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:37.935733+0000","last_peered":"2024-03-04T06:55:37.935733+0000","last_clean":"2024-03-04T06:55:37.935733+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:37.935733+0000","last_undegraded":"2024-03-04T06:55:37.935733+0000","last_fullsized":"2024-03-04T06:55:37.935733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4599,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.322375+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.322375+0000","last_peered":"2024-03-04T06:55:13.322375+0000","last_clean":"2024-03-04T06:55:13.322375+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.322375+0000","last_undegraded":"2024-03-04T06:55:13.322375+0000","last_fullsized":"2024-03-04T06:55:13.322375+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097504+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097504+0000","last_peered":"2024-03-04T06:55:13.097504+0000","last_clean":"2024-03-04T06:55:13.097504+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097504+0000","last_undegraded":"2024-03-04T06:55:13.097504+0000","last_fullsized":"2024-03-04T06:55:13.097504+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105586+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.105586+0000","last_peered":"2024-03-04T06:55:13.105586+0000","last_clean":"2024-03-04T06:55:13.105586+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.105586+0000","last_undegraded":"2024-03-04T06:55:13.105586+0000","last_fullsized":"2024-03-04T06:55:13.105586+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.216983+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:43.216983+0000","last_peered":"2024-03-04T06:55:43.216983+0000","last_clean":"2024-03-04T06:55:43.216983+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:43.216983+0000","last_undegraded":"2024-03-04T06:55:43.216983+0000","last_fullsized":"2024-03-04T06:55:43.216983+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375870+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:28.375870+0000","last_peered":"2024-03-04T06:55:28.375870+0000","last_clean":"2024-03-04T06:55:28.375870+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:28.375870+0000","last_undegraded":"2024-03-04T06:55:28.375870+0000","last_fullsized":"2024-03-04T06:55:28.375870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106053+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.106053+0000","last_peered":"2024-03-04T06:55:13.106053+0000","last_clean":"2024-03-04T06:55:13.106053+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.106053+0000","last_undegraded":"2024-03-04T06:55:13.106053+0000","last_fullsized":"2024-03-04T06:55:13.106053+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117390+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117390+0000","last_peered":"2024-03-04T06:55:13.117390+0000","last_clean":"2024-03-04T06:55:13.117390+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117390+0000","last_undegraded":"2024-03-04T06:55:13.117390+0000","last_fullsized":"2024-03-04T06:55:13.117390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096810+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096810+0000","last_peered":"2024-03-04T06:55:13.096810+0000","last_clean":"2024-03-04T06:55:13.096810+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096810+0000","last_undegraded":"2024-03-04T06:55:13.096810+0000","last_fullsized":"2024-03-04T06:55:13.096810+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141268+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.141268+0000","last_peered":"2024-03-04T06:55:13.141268+0000","last_clean":"2024-03-04T06:55:13.141268+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.141268+0000","last_undegraded":"2024-03-04T06:55:13.141268+0000","last_fullsized":"2024-03-04T06:55:13.141268+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115286+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:13.115286+0000","last_peered":"2024-03-04T06:55:13.115286+0000","last_clean":"2024-03-04T06:55:13.115286+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:13.115286+0000","last_undegraded":"2024-03-04T06:55:13.115286+0000","last_fullsized":"2024-03-04T06:55:13.115286+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097481+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097481+0000","last_peered":"2024-03-04T06:55:13.097481+0000","last_clean":"2024-03-04T06:55:13.097481+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097481+0000","last_undegraded":"2024-03-04T06:55:13.097481+0000","last_fullsized":"2024-03-04T06:55:13.097481+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933591+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:22.933591+0000","last_peered":"2024-03-04T06:55:22.933591+0000","last_clean":"2024-03-04T06:55:22.933591+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:22.933591+0000","last_undegraded":"2024-03-04T06:55:22.933591+0000","last_fullsized":"2024-03-04T06:55:22.933591+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1120,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935684+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:37.935684+0000","last_peered":"2024-03-04T06:55:37.935684+0000","last_clean":"2024-03-04T06:55:37.935684+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:37.935684+0000","last_undegraded":"2024-03-04T06:55:37.935684+0000","last_fullsized":"2024-03-04T06:55:37.935684+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116911+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116911+0000","last_peered":"2024-03-04T06:55:13.116911+0000","last_clean":"2024-03-04T06:55:13.116911+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116911+0000","last_undegraded":"2024-03-04T06:55:13.116911+0000","last_fullsized":"2024-03-04T06:55:13.116911+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114836+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114836+0000","last_peered":"2024-03-04T06:55:13.114836+0000","last_clean":"2024-03-04T06:55:13.114836+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114836+0000","last_undegraded":"2024-03-04T06:55:13.114836+0000","last_fullsized":"2024-03-04T06:55:13.114836+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503456,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648103,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142410,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287057,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997763,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885820,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937397,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792750,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:58:04.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:04.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:04.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:04.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:04.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:04.994 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:04.994 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:04.994 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:04.994 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:04.994 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:04.994 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:58:05.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:05 smithi137 ceph-mon[88869]: from='client.44516 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:05.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:05 smithi137 ceph-mon[91314]: from='client.44516 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:05.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:58:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:58:05] "GET /metrics HTTP/1.1" 200 36337 "" "Prometheus/2.43.0" 2024-03-04T06:58:05.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:05 smithi203 ceph-mon[85573]: from='client.44516 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:06.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:06 smithi137 ceph-mon[91314]: pgmap v1007: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:06.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:06 smithi137 ceph-mon[88869]: pgmap v1007: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:06.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:06 smithi203 ceph-mon[85573]: pgmap v1007: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:08.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:08 smithi137 ceph-mon[91314]: pgmap v1008: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:08.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:58:08.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:08 smithi137 ceph-mon[88869]: pgmap v1008: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:08.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:58:08.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:08 smithi203 ceph-mon[85573]: pgmap v1008: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:08.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:58:10.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:10 smithi137 ceph-mon[88869]: pgmap v1009: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:58:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:58:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:58:10.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:58:10.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:10 smithi137 ceph-mon[91314]: pgmap v1009: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:10.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:58:10.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:58:10.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:58:10.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:58:10.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:10 smithi203 ceph-mon[85573]: pgmap v1009: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:10.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:58:10.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:58:10.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:58:10.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:58:12.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:12 smithi137 ceph-mon[88869]: pgmap v1010: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:12.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:12 smithi137 ceph-mon[91314]: pgmap v1010: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:12.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:12 smithi203 ceph-mon[85573]: pgmap v1010: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:14.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:14 smithi137 ceph-mon[88869]: pgmap v1011: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:14.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:14 smithi137 ceph-mon[91314]: pgmap v1011: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:14.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:14 smithi203 ceph-mon[85573]: pgmap v1011: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:14.996 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:58:15.216 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:58:15.652 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:58:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:58:15] "GET /metrics HTTP/1.1" 200 36337 "" "Prometheus/2.43.0" 2024-03-04T06:58:16.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:16 smithi137 ceph-mon[88869]: pgmap v1012: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:16.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:16 smithi137 ceph-mon[91314]: pgmap v1012: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:16.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:16 smithi203 ceph-mon[85573]: pgmap v1012: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:16.976 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:58:16.979 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:58:17.584 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1013,"stamp":"2024-03-04T06:58:16.515351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003928"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103340+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:55:13.103340+0000","last_peered":"2024-03-04T06:55:13.103340+0000","last_clean":"2024-03-04T06:55:13.103340+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:55:13.103340+0000","last_undegraded":"2024-03-04T06:55:13.103340+0000","last_fullsized":"2024-03-04T06:55:13.103340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117002+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.117002+0000","last_peered":"2024-03-04T06:55:13.117002+0000","last_clean":"2024-03-04T06:55:13.117002+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.117002+0000","last_undegraded":"2024-03-04T06:55:13.117002+0000","last_fullsized":"2024-03-04T06:55:13.117002+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115416+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:55:13.115416+0000","last_peered":"2024-03-04T06:55:13.115416+0000","last_clean":"2024-03-04T06:55:13.115416+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:55:13.115416+0000","last_undegraded":"2024-03-04T06:55:13.115416+0000","last_fullsized":"2024-03-04T06:55:13.115416+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106163+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106163+0000","last_peered":"2024-03-04T06:55:13.106163+0000","last_clean":"2024-03-04T06:55:13.106163+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106163+0000","last_undegraded":"2024-03-04T06:55:13.106163+0000","last_fullsized":"2024-03-04T06:55:13.106163+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102005+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.102005+0000","last_peered":"2024-03-04T06:55:13.102005+0000","last_clean":"2024-03-04T06:55:13.102005+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.102005+0000","last_undegraded":"2024-03-04T06:55:13.102005+0000","last_fullsized":"2024-03-04T06:55:13.102005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106089+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106089+0000","last_peered":"2024-03-04T06:55:13.106089+0000","last_clean":"2024-03-04T06:55:13.106089+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106089+0000","last_undegraded":"2024-03-04T06:55:13.106089+0000","last_fullsized":"2024-03-04T06:55:13.106089+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101809+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101809+0000","last_peered":"2024-03-04T06:55:13.101809+0000","last_clean":"2024-03-04T06:55:13.101809+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101809+0000","last_undegraded":"2024-03-04T06:55:13.101809+0000","last_fullsized":"2024-03-04T06:55:13.101809+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984614+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:14.984614+0000","last_peered":"2024-03-04T06:55:14.984614+0000","last_clean":"2024-03-04T06:55:14.984614+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:14.984614+0000","last_undegraded":"2024-03-04T06:55:14.984614+0000","last_fullsized":"2024-03-04T06:55:14.984614+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1064,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103046+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.103046+0000","last_peered":"2024-03-04T06:55:13.103046+0000","last_clean":"2024-03-04T06:55:13.103046+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.103046+0000","last_undegraded":"2024-03-04T06:55:13.103046+0000","last_fullsized":"2024-03-04T06:55:13.103046+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115007+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.115007+0000","last_peered":"2024-03-04T06:55:13.115007+0000","last_clean":"2024-03-04T06:55:13.115007+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.115007+0000","last_undegraded":"2024-03-04T06:55:13.115007+0000","last_fullsized":"2024-03-04T06:55:13.115007+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114852+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114852+0000","last_peered":"2024-03-04T06:55:13.114852+0000","last_clean":"2024-03-04T06:55:13.114852+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114852+0000","last_undegraded":"2024-03-04T06:55:13.114852+0000","last_fullsized":"2024-03-04T06:55:13.114852+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:32.604419+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:32.604419+0000","last_peered":"2024-03-04T06:55:32.604419+0000","last_clean":"2024-03-04T06:55:32.604419+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:32.604419+0000","last_undegraded":"2024-03-04T06:55:32.604419+0000","last_fullsized":"2024-03-04T06:55:32.604419+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.099013+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.099013+0000","last_peered":"2024-03-04T06:55:13.099013+0000","last_clean":"2024-03-04T06:55:13.099013+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.099013+0000","last_undegraded":"2024-03-04T06:55:13.099013+0000","last_fullsized":"2024-03-04T06:55:13.099013+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985446+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:17.985446+0000","last_peered":"2024-03-04T06:55:17.985446+0000","last_clean":"2024-03-04T06:55:17.985446+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:17.985446+0000","last_undegraded":"2024-03-04T06:55:17.985446+0000","last_fullsized":"2024-03-04T06:55:17.985446+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:53.145282+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:53.145282+0000","last_peered":"2024-03-04T06:55:53.145282+0000","last_clean":"2024-03-04T06:55:53.145282+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:53.145282+0000","last_undegraded":"2024-03-04T06:55:53.145282+0000","last_fullsized":"2024-03-04T06:55:53.145282+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937387+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:52.937387+0000","last_peered":"2024-03-04T06:55:52.937387+0000","last_clean":"2024-03-04T06:55:52.937387+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:52.937387+0000","last_undegraded":"2024-03-04T06:55:52.937387+0000","last_fullsized":"2024-03-04T06:55:52.937387+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937465+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:52.937465+0000","last_peered":"2024-03-04T06:55:52.937465+0000","last_clean":"2024-03-04T06:55:52.937465+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:52.937465+0000","last_undegraded":"2024-03-04T06:55:52.937465+0000","last_fullsized":"2024-03-04T06:55:52.937465+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096941+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096941+0000","last_peered":"2024-03-04T06:55:13.096941+0000","last_clean":"2024-03-04T06:55:13.096941+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096941+0000","last_undegraded":"2024-03-04T06:55:13.096941+0000","last_fullsized":"2024-03-04T06:55:13.096941+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102303+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102303+0000","last_peered":"2024-03-04T06:55:13.102303+0000","last_clean":"2024-03-04T06:55:13.102303+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102303+0000","last_undegraded":"2024-03-04T06:55:13.102303+0000","last_fullsized":"2024-03-04T06:55:13.102303+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116614+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:55:13.116614+0000","last_peered":"2024-03-04T06:55:13.116614+0000","last_clean":"2024-03-04T06:55:13.116614+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:55:13.116614+0000","last_undegraded":"2024-03-04T06:55:13.116614+0000","last_fullsized":"2024-03-04T06:55:13.116614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988343+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:44.988343+0000","last_peered":"2024-03-04T06:55:44.988343+0000","last_clean":"2024-03-04T06:55:44.988343+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:44.988343+0000","last_undegraded":"2024-03-04T06:55:44.988343+0000","last_fullsized":"2024-03-04T06:55:44.988343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988353+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:44.988353+0000","last_peered":"2024-03-04T06:55:44.988353+0000","last_clean":"2024-03-04T06:55:44.988353+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:44.988353+0000","last_undegraded":"2024-03-04T06:55:44.988353+0000","last_fullsized":"2024-03-04T06:55:44.988353+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116801+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:55:13.116801+0000","last_peered":"2024-03-04T06:55:13.116801+0000","last_clean":"2024-03-04T06:55:13.116801+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:55:13.116801+0000","last_undegraded":"2024-03-04T06:55:13.116801+0000","last_fullsized":"2024-03-04T06:55:13.116801+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1234,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098569+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098569+0000","last_peered":"2024-03-04T06:55:13.098569+0000","last_clean":"2024-03-04T06:55:13.098569+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098569+0000","last_undegraded":"2024-03-04T06:55:13.098569+0000","last_fullsized":"2024-03-04T06:55:13.098569+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1221,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097506+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097506+0000","last_peered":"2024-03-04T06:55:13.097506+0000","last_clean":"2024-03-04T06:55:13.097506+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097506+0000","last_undegraded":"2024-03-04T06:55:13.097506+0000","last_fullsized":"2024-03-04T06:55:13.097506+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102499+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102499+0000","last_peered":"2024-03-04T06:55:13.102499+0000","last_clean":"2024-03-04T06:55:13.102499+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102499+0000","last_undegraded":"2024-03-04T06:55:13.102499+0000","last_fullsized":"2024-03-04T06:55:13.102499+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106216+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106216+0000","last_peered":"2024-03-04T06:55:13.106216+0000","last_clean":"2024-03-04T06:55:13.106216+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106216+0000","last_undegraded":"2024-03-04T06:55:13.106216+0000","last_fullsized":"2024-03-04T06:55:13.106216+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984673+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:14.984673+0000","last_peered":"2024-03-04T06:55:14.984673+0000","last_clean":"2024-03-04T06:55:14.984673+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:14.984673+0000","last_undegraded":"2024-03-04T06:55:14.984673+0000","last_fullsized":"2024-03-04T06:55:14.984673+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1188,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096052+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:13.096052+0000","last_peered":"2024-03-04T06:55:13.096052+0000","last_clean":"2024-03-04T06:55:13.096052+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:13.096052+0000","last_undegraded":"2024-03-04T06:55:13.096052+0000","last_fullsized":"2024-03-04T06:55:13.096052+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114709+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114709+0000","last_peered":"2024-03-04T06:55:13.114709+0000","last_clean":"2024-03-04T06:55:13.114709+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114709+0000","last_undegraded":"2024-03-04T06:55:13.114709+0000","last_fullsized":"2024-03-04T06:55:13.114709+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1295,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.118051+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:13.118051+0000","last_peered":"2024-03-04T06:55:13.118051+0000","last_clean":"2024-03-04T06:55:13.118051+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:13.118051+0000","last_undegraded":"2024-03-04T06:55:13.118051+0000","last_fullsized":"2024-03-04T06:55:13.118051+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096734+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096734+0000","last_peered":"2024-03-04T06:55:13.096734+0000","last_clean":"2024-03-04T06:55:13.096734+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096734+0000","last_undegraded":"2024-03-04T06:55:13.096734+0000","last_fullsized":"2024-03-04T06:55:13.096734+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097225+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097225+0000","last_peered":"2024-03-04T06:55:13.097225+0000","last_clean":"2024-03-04T06:55:13.097225+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097225+0000","last_undegraded":"2024-03-04T06:55:13.097225+0000","last_fullsized":"2024-03-04T06:55:13.097225+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105593+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105593+0000","last_peered":"2024-03-04T06:55:13.105593+0000","last_clean":"2024-03-04T06:55:13.105593+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105593+0000","last_undegraded":"2024-03-04T06:55:13.105593+0000","last_fullsized":"2024-03-04T06:55:13.105593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115824+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115824+0000","last_peered":"2024-03-04T06:55:13.115824+0000","last_clean":"2024-03-04T06:55:13.115824+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115824+0000","last_undegraded":"2024-03-04T06:55:13.115824+0000","last_fullsized":"2024-03-04T06:55:13.115824+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115145+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115145+0000","last_peered":"2024-03-04T06:55:13.115145+0000","last_clean":"2024-03-04T06:55:13.115145+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115145+0000","last_undegraded":"2024-03-04T06:55:13.115145+0000","last_fullsized":"2024-03-04T06:55:13.115145+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1110,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105468+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105468+0000","last_peered":"2024-03-04T06:55:13.105468+0000","last_clean":"2024-03-04T06:55:13.105468+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105468+0000","last_undegraded":"2024-03-04T06:55:13.105468+0000","last_fullsized":"2024-03-04T06:55:13.105468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105915+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105915+0000","last_peered":"2024-03-04T06:55:13.105915+0000","last_clean":"2024-03-04T06:55:13.105915+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105915+0000","last_undegraded":"2024-03-04T06:55:13.105915+0000","last_fullsized":"2024-03-04T06:55:13.105915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.988031+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:37.988031+0000","last_peered":"2024-03-04T06:55:37.988031+0000","last_clean":"2024-03-04T06:55:37.988031+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:37.988031+0000","last_undegraded":"2024-03-04T06:55:37.988031+0000","last_fullsized":"2024-03-04T06:55:37.988031+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116083+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116083+0000","last_peered":"2024-03-04T06:55:13.116083+0000","last_clean":"2024-03-04T06:55:13.116083+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116083+0000","last_undegraded":"2024-03-04T06:55:13.116083+0000","last_fullsized":"2024-03-04T06:55:13.116083+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.602395+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:17.602395+0000","last_peered":"2024-03-04T06:55:17.602395+0000","last_clean":"2024-03-04T06:55:17.602395+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:17.602395+0000","last_undegraded":"2024-03-04T06:55:17.602395+0000","last_fullsized":"2024-03-04T06:55:17.602395+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114988+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114988+0000","last_peered":"2024-03-04T06:55:13.114988+0000","last_clean":"2024-03-04T06:55:13.114988+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114988+0000","last_undegraded":"2024-03-04T06:55:13.114988+0000","last_fullsized":"2024-03-04T06:55:13.114988+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102665+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102665+0000","last_peered":"2024-03-04T06:55:13.102665+0000","last_clean":"2024-03-04T06:55:13.102665+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102665+0000","last_undegraded":"2024-03-04T06:55:13.102665+0000","last_fullsized":"2024-03-04T06:55:13.102665+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1302,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985489+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:17.985489+0000","last_peered":"2024-03-04T06:55:17.985489+0000","last_clean":"2024-03-04T06:55:17.985489+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:17.985489+0000","last_undegraded":"2024-03-04T06:55:17.985489+0000","last_fullsized":"2024-03-04T06:55:17.985489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098537+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098537+0000","last_peered":"2024-03-04T06:55:13.098537+0000","last_clean":"2024-03-04T06:55:13.098537+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098537+0000","last_undegraded":"2024-03-04T06:55:13.098537+0000","last_fullsized":"2024-03-04T06:55:13.098537+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937420+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:52.937420+0000","last_peered":"2024-03-04T06:55:52.937420+0000","last_clean":"2024-03-04T06:55:52.937420+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:52.937420+0000","last_undegraded":"2024-03-04T06:55:52.937420+0000","last_fullsized":"2024-03-04T06:55:52.937420+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102561+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102561+0000","last_peered":"2024-03-04T06:55:13.102561+0000","last_clean":"2024-03-04T06:55:13.102561+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102561+0000","last_undegraded":"2024-03-04T06:55:13.102561+0000","last_fullsized":"2024-03-04T06:55:13.102561+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114471+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114471+0000","last_peered":"2024-03-04T06:55:13.114471+0000","last_clean":"2024-03-04T06:55:13.114471+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114471+0000","last_undegraded":"2024-03-04T06:55:13.114471+0000","last_fullsized":"2024-03-04T06:55:13.114471+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114484+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114484+0000","last_peered":"2024-03-04T06:55:13.114484+0000","last_clean":"2024-03-04T06:55:13.114484+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114484+0000","last_undegraded":"2024-03-04T06:55:13.114484+0000","last_fullsized":"2024-03-04T06:55:13.114484+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1252,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101837+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101837+0000","last_peered":"2024-03-04T06:55:13.101837+0000","last_clean":"2024-03-04T06:55:13.101837+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101837+0000","last_undegraded":"2024-03-04T06:55:13.101837+0000","last_fullsized":"2024-03-04T06:55:13.101837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3577,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377824+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:48.377824+0000","last_peered":"2024-03-04T06:55:48.377824+0000","last_clean":"2024-03-04T06:55:48.377824+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:48.377824+0000","last_undegraded":"2024-03-04T06:55:48.377824+0000","last_fullsized":"2024-03-04T06:55:48.377824+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096992+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096992+0000","last_peered":"2024-03-04T06:55:13.096992+0000","last_clean":"2024-03-04T06:55:13.096992+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096992+0000","last_undegraded":"2024-03-04T06:55:13.096992+0000","last_fullsized":"2024-03-04T06:55:13.096992+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102943+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102943+0000","last_peered":"2024-03-04T06:55:13.102943+0000","last_clean":"2024-03-04T06:55:13.102943+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102943+0000","last_undegraded":"2024-03-04T06:55:13.102943+0000","last_fullsized":"2024-03-04T06:55:13.102943+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17115,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117976+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:55:13.117976+0000","last_peered":"2024-03-04T06:55:13.117976+0000","last_clean":"2024-03-04T06:55:13.117976+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:55:13.117976+0000","last_undegraded":"2024-03-04T06:55:13.117976+0000","last_fullsized":"2024-03-04T06:55:13.117976+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115088+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115088+0000","last_peered":"2024-03-04T06:55:13.115088+0000","last_clean":"2024-03-04T06:55:13.115088+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115088+0000","last_undegraded":"2024-03-04T06:55:13.115088+0000","last_fullsized":"2024-03-04T06:55:13.115088+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116699+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116699+0000","last_peered":"2024-03-04T06:55:13.116699+0000","last_clean":"2024-03-04T06:55:13.116699+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116699+0000","last_undegraded":"2024-03-04T06:55:13.116699+0000","last_fullsized":"2024-03-04T06:55:13.116699+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106020+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.106020+0000","last_peered":"2024-03-04T06:55:13.106020+0000","last_clean":"2024-03-04T06:55:13.106020+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.106020+0000","last_undegraded":"2024-03-04T06:55:13.106020+0000","last_fullsized":"2024-03-04T06:55:13.106020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4385,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.117010+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:55:13.117010+0000","last_peered":"2024-03-04T06:55:13.117010+0000","last_clean":"2024-03-04T06:55:13.117010+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:55:13.117010+0000","last_undegraded":"2024-03-04T06:55:13.117010+0000","last_fullsized":"2024-03-04T06:55:13.117010+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115964+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115964+0000","last_peered":"2024-03-04T06:55:13.115964+0000","last_clean":"2024-03-04T06:55:13.115964+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115964+0000","last_undegraded":"2024-03-04T06:55:13.115964+0000","last_fullsized":"2024-03-04T06:55:13.115964+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105737+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105737+0000","last_peered":"2024-03-04T06:55:13.105737+0000","last_clean":"2024-03-04T06:55:13.105737+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105737+0000","last_undegraded":"2024-03-04T06:55:13.105737+0000","last_fullsized":"2024-03-04T06:55:13.105737+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096287+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096287+0000","last_peered":"2024-03-04T06:55:13.096287+0000","last_clean":"2024-03-04T06:55:13.096287+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096287+0000","last_undegraded":"2024-03-04T06:55:13.096287+0000","last_fullsized":"2024-03-04T06:55:13.096287+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5639,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377937+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:48.377937+0000","last_peered":"2024-03-04T06:55:48.377937+0000","last_clean":"2024-03-04T06:55:48.377937+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:48.377937+0000","last_undegraded":"2024-03-04T06:55:48.377937+0000","last_fullsized":"2024-03-04T06:55:48.377937+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141294+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.141294+0000","last_peered":"2024-03-04T06:55:13.141294+0000","last_clean":"2024-03-04T06:55:13.141294+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.141294+0000","last_undegraded":"2024-03-04T06:55:13.141294+0000","last_fullsized":"2024-03-04T06:55:13.141294+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114171+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114171+0000","last_peered":"2024-03-04T06:55:13.114171+0000","last_clean":"2024-03-04T06:55:13.114171+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114171+0000","last_undegraded":"2024-03-04T06:55:13.114171+0000","last_fullsized":"2024-03-04T06:55:13.114171+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375859+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:28.375859+0000","last_peered":"2024-03-04T06:55:28.375859+0000","last_clean":"2024-03-04T06:55:28.375859+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:28.375859+0000","last_undegraded":"2024-03-04T06:55:28.375859+0000","last_fullsized":"2024-03-04T06:55:28.375859+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4014,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.107389+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:55:13.107389+0000","last_peered":"2024-03-04T06:55:13.107389+0000","last_clean":"2024-03-04T06:55:13.107389+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:55:13.107389+0000","last_undegraded":"2024-03-04T06:55:13.107389+0000","last_fullsized":"2024-03-04T06:55:13.107389+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.217050+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:43.217050+0000","last_peered":"2024-03-04T06:55:43.217050+0000","last_clean":"2024-03-04T06:55:43.217050+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:43.217050+0000","last_undegraded":"2024-03-04T06:55:43.217050+0000","last_fullsized":"2024-03-04T06:55:43.217050+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.990790+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:56:04.990790+0000","last_peered":"2024-03-04T06:56:04.990790+0000","last_clean":"2024-03-04T06:56:04.990790+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:56:04.990790+0000","last_undegraded":"2024-03-04T06:56:04.990790+0000","last_fullsized":"2024-03-04T06:56:04.990790+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105228+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105228+0000","last_peered":"2024-03-04T06:55:13.105228+0000","last_clean":"2024-03-04T06:55:13.105228+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105228+0000","last_undegraded":"2024-03-04T06:55:13.105228+0000","last_fullsized":"2024-03-04T06:55:13.105228+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1550,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532802+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:56:04.532802+0000","last_peered":"2024-03-04T06:56:04.532802+0000","last_clean":"2024-03-04T06:56:04.532802+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:56:04.532802+0000","last_undegraded":"2024-03-04T06:56:04.532802+0000","last_fullsized":"2024-03-04T06:56:04.532802+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3950,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933655+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:22.933655+0000","last_peered":"2024-03-04T06:55:22.933655+0000","last_clean":"2024-03-04T06:55:22.933655+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:22.933655+0000","last_undegraded":"2024-03-04T06:55:22.933655+0000","last_fullsized":"2024-03-04T06:55:22.933655+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117375+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117375+0000","last_peered":"2024-03-04T06:55:13.117375+0000","last_clean":"2024-03-04T06:55:13.117375+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117375+0000","last_undegraded":"2024-03-04T06:55:13.117375+0000","last_fullsized":"2024-03-04T06:55:13.117375+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375833+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:28.375833+0000","last_peered":"2024-03-04T06:55:28.375833+0000","last_clean":"2024-03-04T06:55:28.375833+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:28.375833+0000","last_undegraded":"2024-03-04T06:55:28.375833+0000","last_fullsized":"2024-03-04T06:55:28.375833+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532768+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:56:04.532768+0000","last_peered":"2024-03-04T06:56:04.532768+0000","last_clean":"2024-03-04T06:56:04.532768+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:56:04.532768+0000","last_undegraded":"2024-03-04T06:56:04.532768+0000","last_fullsized":"2024-03-04T06:56:04.532768+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15291,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:43.217015+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:43.217015+0000","last_peered":"2024-03-04T06:55:43.217015+0000","last_clean":"2024-03-04T06:55:43.217015+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:43.217015+0000","last_undegraded":"2024-03-04T06:55:43.217015+0000","last_fullsized":"2024-03-04T06:55:43.217015+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117527+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:55:13.117527+0000","last_peered":"2024-03-04T06:55:13.117527+0000","last_clean":"2024-03-04T06:55:13.117527+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:55:13.117527+0000","last_undegraded":"2024-03-04T06:55:13.117527+0000","last_fullsized":"2024-03-04T06:55:13.117527+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102583+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:55:13.102583+0000","last_peered":"2024-03-04T06:55:13.102583+0000","last_clean":"2024-03-04T06:55:13.102583+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:55:13.102583+0000","last_undegraded":"2024-03-04T06:55:13.102583+0000","last_fullsized":"2024-03-04T06:55:13.102583+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116059+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116059+0000","last_peered":"2024-03-04T06:55:13.116059+0000","last_clean":"2024-03-04T06:55:13.116059+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116059+0000","last_undegraded":"2024-03-04T06:55:13.116059+0000","last_fullsized":"2024-03-04T06:55:13.116059+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4378,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097496+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097496+0000","last_peered":"2024-03-04T06:55:13.097496+0000","last_clean":"2024-03-04T06:55:13.097496+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097496+0000","last_undegraded":"2024-03-04T06:55:13.097496+0000","last_fullsized":"2024-03-04T06:55:13.097496+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988300+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:44.988300+0000","last_peered":"2024-03-04T06:55:44.988300+0000","last_clean":"2024-03-04T06:55:44.988300+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:44.988300+0000","last_undegraded":"2024-03-04T06:55:44.988300+0000","last_fullsized":"2024-03-04T06:55:44.988300+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141284+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.141284+0000","last_peered":"2024-03-04T06:55:13.141284+0000","last_clean":"2024-03-04T06:55:13.141284+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.141284+0000","last_undegraded":"2024-03-04T06:55:13.141284+0000","last_fullsized":"2024-03-04T06:55:13.141284+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097249+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097249+0000","last_peered":"2024-03-04T06:55:13.097249+0000","last_clean":"2024-03-04T06:55:13.097249+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097249+0000","last_undegraded":"2024-03-04T06:55:13.097249+0000","last_fullsized":"2024-03-04T06:55:13.097249+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4609,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:44.988263+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:44.988263+0000","last_peered":"2024-03-04T06:55:44.988263+0000","last_clean":"2024-03-04T06:55:44.988263+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:44.988263+0000","last_undegraded":"2024-03-04T06:55:44.988263+0000","last_fullsized":"2024-03-04T06:55:44.988263+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095704+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095704+0000","last_peered":"2024-03-04T06:55:13.095704+0000","last_clean":"2024-03-04T06:55:13.095704+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095704+0000","last_undegraded":"2024-03-04T06:55:13.095704+0000","last_fullsized":"2024-03-04T06:55:13.095704+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1078,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218837+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:58.218837+0000","last_peered":"2024-03-04T06:55:58.218837+0000","last_clean":"2024-03-04T06:55:58.218837+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:58.218837+0000","last_undegraded":"2024-03-04T06:55:58.218837+0000","last_fullsized":"2024-03-04T06:55:58.218837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115644+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115644+0000","last_peered":"2024-03-04T06:55:13.115644+0000","last_clean":"2024-03-04T06:55:13.115644+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115644+0000","last_undegraded":"2024-03-04T06:55:13.115644+0000","last_fullsized":"2024-03-04T06:55:13.115644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4634,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:37.935758+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:37.935758+0000","last_peered":"2024-03-04T06:55:37.935758+0000","last_clean":"2024-03-04T06:55:37.935758+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:37.935758+0000","last_undegraded":"2024-03-04T06:55:37.935758+0000","last_fullsized":"2024-03-04T06:55:37.935758+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101972+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101972+0000","last_peered":"2024-03-04T06:55:13.101972+0000","last_clean":"2024-03-04T06:55:13.101972+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101972+0000","last_undegraded":"2024-03-04T06:55:13.101972+0000","last_fullsized":"2024-03-04T06:55:13.101972+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1184,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095689+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095689+0000","last_peered":"2024-03-04T06:55:13.095689+0000","last_clean":"2024-03-04T06:55:13.095689+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095689+0000","last_undegraded":"2024-03-04T06:55:13.095689+0000","last_fullsized":"2024-03-04T06:55:13.095689+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5157,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.113366+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.113366+0000","last_peered":"2024-03-04T06:55:13.113366+0000","last_clean":"2024-03-04T06:55:13.113366+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.113366+0000","last_undegraded":"2024-03-04T06:55:13.113366+0000","last_fullsized":"2024-03-04T06:55:13.113366+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141219+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.141219+0000","last_peered":"2024-03-04T06:55:13.141219+0000","last_clean":"2024-03-04T06:55:13.141219+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.141219+0000","last_undegraded":"2024-03-04T06:55:13.141219+0000","last_fullsized":"2024-03-04T06:55:13.141219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097821+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097821+0000","last_peered":"2024-03-04T06:55:13.097821+0000","last_clean":"2024-03-04T06:55:13.097821+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097821+0000","last_undegraded":"2024-03-04T06:55:13.097821+0000","last_fullsized":"2024-03-04T06:55:13.097821+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4718,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.169321+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:55:13.169321+0000","last_peered":"2024-03-04T06:55:13.169321+0000","last_clean":"2024-03-04T06:55:13.169321+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:55:13.169321+0000","last_undegraded":"2024-03-04T06:55:13.169321+0000","last_fullsized":"2024-03-04T06:55:13.169321+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141246+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.141246+0000","last_peered":"2024-03-04T06:55:13.141246+0000","last_clean":"2024-03-04T06:55:13.141246+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.141246+0000","last_undegraded":"2024-03-04T06:55:13.141246+0000","last_fullsized":"2024-03-04T06:55:13.141246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098839+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098839+0000","last_peered":"2024-03-04T06:55:13.098839+0000","last_clean":"2024-03-04T06:55:13.098839+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098839+0000","last_undegraded":"2024-03-04T06:55:13.098839+0000","last_fullsized":"2024-03-04T06:55:13.098839+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5554,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:33.143474+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:33.143474+0000","last_peered":"2024-03-04T06:55:33.143474+0000","last_clean":"2024-03-04T06:55:33.143474+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:33.143474+0000","last_undegraded":"2024-03-04T06:55:33.143474+0000","last_fullsized":"2024-03-04T06:55:33.143474+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102401+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102401+0000","last_peered":"2024-03-04T06:55:13.102401+0000","last_clean":"2024-03-04T06:55:13.102401+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102401+0000","last_undegraded":"2024-03-04T06:55:13.102401+0000","last_fullsized":"2024-03-04T06:55:13.102401+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218784+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:58.218784+0000","last_peered":"2024-03-04T06:55:58.218784+0000","last_clean":"2024-03-04T06:55:58.218784+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:58.218784+0000","last_undegraded":"2024-03-04T06:55:58.218784+0000","last_fullsized":"2024-03-04T06:55:58.218784+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096824+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:55:13.096824+0000","last_peered":"2024-03-04T06:55:13.096824+0000","last_clean":"2024-03-04T06:55:13.096824+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:55:13.096824+0000","last_undegraded":"2024-03-04T06:55:13.096824+0000","last_fullsized":"2024-03-04T06:55:13.096824+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097239+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:55:13.097239+0000","last_peered":"2024-03-04T06:55:13.097239+0000","last_clean":"2024-03-04T06:55:13.097239+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:55:13.097239+0000","last_undegraded":"2024-03-04T06:55:13.097239+0000","last_fullsized":"2024-03-04T06:55:13.097239+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102489+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102489+0000","last_peered":"2024-03-04T06:55:13.102489+0000","last_clean":"2024-03-04T06:55:13.102489+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102489+0000","last_undegraded":"2024-03-04T06:55:13.102489+0000","last_fullsized":"2024-03-04T06:55:13.102489+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4366,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377880+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:48.377880+0000","last_peered":"2024-03-04T06:55:48.377880+0000","last_clean":"2024-03-04T06:55:48.377880+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:48.377880+0000","last_undegraded":"2024-03-04T06:55:48.377880+0000","last_fullsized":"2024-03-04T06:55:48.377880+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:33.143531+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:33.143531+0000","last_peered":"2024-03-04T06:55:33.143531+0000","last_clean":"2024-03-04T06:55:33.143531+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:33.143531+0000","last_undegraded":"2024-03-04T06:55:33.143531+0000","last_fullsized":"2024-03-04T06:55:33.143531+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935733+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:37.935733+0000","last_peered":"2024-03-04T06:55:37.935733+0000","last_clean":"2024-03-04T06:55:37.935733+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:37.935733+0000","last_undegraded":"2024-03-04T06:55:37.935733+0000","last_fullsized":"2024-03-04T06:55:37.935733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4599,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.322375+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.322375+0000","last_peered":"2024-03-04T06:55:13.322375+0000","last_clean":"2024-03-04T06:55:13.322375+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.322375+0000","last_undegraded":"2024-03-04T06:55:13.322375+0000","last_fullsized":"2024-03-04T06:55:13.322375+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097504+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:55:13.097504+0000","last_peered":"2024-03-04T06:55:13.097504+0000","last_clean":"2024-03-04T06:55:13.097504+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:55:13.097504+0000","last_undegraded":"2024-03-04T06:55:13.097504+0000","last_fullsized":"2024-03-04T06:55:13.097504+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105586+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.105586+0000","last_peered":"2024-03-04T06:55:13.105586+0000","last_clean":"2024-03-04T06:55:13.105586+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.105586+0000","last_undegraded":"2024-03-04T06:55:13.105586+0000","last_fullsized":"2024-03-04T06:55:13.105586+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.216983+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:43.216983+0000","last_peered":"2024-03-04T06:55:43.216983+0000","last_clean":"2024-03-04T06:55:43.216983+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:43.216983+0000","last_undegraded":"2024-03-04T06:55:43.216983+0000","last_fullsized":"2024-03-04T06:55:43.216983+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375870+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:28.375870+0000","last_peered":"2024-03-04T06:55:28.375870+0000","last_clean":"2024-03-04T06:55:28.375870+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:28.375870+0000","last_undegraded":"2024-03-04T06:55:28.375870+0000","last_fullsized":"2024-03-04T06:55:28.375870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106053+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.106053+0000","last_peered":"2024-03-04T06:55:13.106053+0000","last_clean":"2024-03-04T06:55:13.106053+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.106053+0000","last_undegraded":"2024-03-04T06:55:13.106053+0000","last_fullsized":"2024-03-04T06:55:13.106053+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117390+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:55:13.117390+0000","last_peered":"2024-03-04T06:55:13.117390+0000","last_clean":"2024-03-04T06:55:13.117390+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:55:13.117390+0000","last_undegraded":"2024-03-04T06:55:13.117390+0000","last_fullsized":"2024-03-04T06:55:13.117390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096810+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096810+0000","last_peered":"2024-03-04T06:55:13.096810+0000","last_clean":"2024-03-04T06:55:13.096810+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096810+0000","last_undegraded":"2024-03-04T06:55:13.096810+0000","last_fullsized":"2024-03-04T06:55:13.096810+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141268+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.141268+0000","last_peered":"2024-03-04T06:55:13.141268+0000","last_clean":"2024-03-04T06:55:13.141268+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.141268+0000","last_undegraded":"2024-03-04T06:55:13.141268+0000","last_fullsized":"2024-03-04T06:55:13.141268+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218825+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:58.218825+0000","last_peered":"2024-03-04T06:55:58.218825+0000","last_clean":"2024-03-04T06:55:58.218825+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:58.218825+0000","last_undegraded":"2024-03-04T06:55:58.218825+0000","last_fullsized":"2024-03-04T06:55:58.218825+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097481+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097481+0000","last_peered":"2024-03-04T06:55:13.097481+0000","last_clean":"2024-03-04T06:55:13.097481+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097481+0000","last_undegraded":"2024-03-04T06:55:13.097481+0000","last_fullsized":"2024-03-04T06:55:13.097481+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933591+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:22.933591+0000","last_peered":"2024-03-04T06:55:22.933591+0000","last_clean":"2024-03-04T06:55:22.933591+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:22.933591+0000","last_undegraded":"2024-03-04T06:55:22.933591+0000","last_fullsized":"2024-03-04T06:55:22.933591+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1120,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935684+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:37.935684+0000","last_peered":"2024-03-04T06:55:37.935684+0000","last_clean":"2024-03-04T06:55:37.935684+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:37.935684+0000","last_undegraded":"2024-03-04T06:55:37.935684+0000","last_fullsized":"2024-03-04T06:55:37.935684+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116911+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116911+0000","last_peered":"2024-03-04T06:55:13.116911+0000","last_clean":"2024-03-04T06:55:13.116911+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116911+0000","last_undegraded":"2024-03-04T06:55:13.116911+0000","last_fullsized":"2024-03-04T06:55:13.116911+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114836+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:55:13.114836+0000","last_peered":"2024-03-04T06:55:13.114836+0000","last_clean":"2024-03-04T06:55:13.114836+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:55:13.114836+0000","last_undegraded":"2024-03-04T06:55:13.114836+0000","last_fullsized":"2024-03-04T06:55:13.114836+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503459,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648106,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142413,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287060,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997766,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885823,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937400,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792753,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:58:17.589 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:17.589 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:17.589 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:17.589 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:17.589 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:17.589 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:17.590 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:17.590 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:17.590 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:17.590 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:17.590 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:58:18.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:18 smithi137 ceph-mon[91314]: pgmap v1013: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:18.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:18 smithi137 ceph-mon[91314]: from='client.44522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:18.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:18 smithi137 ceph-mon[88869]: pgmap v1013: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:18.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:18 smithi137 ceph-mon[88869]: from='client.44522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:18.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:18 smithi203 ceph-mon[85573]: pgmap v1013: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:18.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:18 smithi203 ceph-mon[85573]: from='client.44522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:20.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:20 smithi137 ceph-mon[88869]: pgmap v1014: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:20.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:20 smithi137 ceph-mon[91314]: pgmap v1014: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:20.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:20 smithi203 ceph-mon[85573]: pgmap v1014: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:22.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:22 smithi137 ceph-mon[88869]: pgmap v1015: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:22.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:22 smithi137 ceph-mon[91314]: pgmap v1015: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:22.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:22 smithi203 ceph-mon[85573]: pgmap v1015: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:23.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:58:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:58:23.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:58:24.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:24 smithi137 ceph-mon[88869]: pgmap v1016: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:24 smithi137 ceph-mon[91314]: pgmap v1016: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:24.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:24 smithi203 ceph-mon[85573]: pgmap v1016: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:25.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:58:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:58:25] "GET /metrics HTTP/1.1" 200 36334 "" "Prometheus/2.43.0" 2024-03-04T06:58:26.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:26 smithi137 ceph-mon[88869]: pgmap v1017: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:26 smithi137 ceph-mon[91314]: pgmap v1017: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:26.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:26 smithi203 ceph-mon[85573]: pgmap v1017: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:27.591 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:58:27.810 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:58:28.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:28 smithi137 ceph-mon[88869]: pgmap v1018: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:28.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:28 smithi137 ceph-mon[91314]: pgmap v1018: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:28.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:28 smithi203 ceph-mon[85573]: pgmap v1018: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:29.559 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:58:29.561 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:58:30.239 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1019,"stamp":"2024-03-04T06:58:28.519446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004094"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534568+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:56:19.534568+0000","last_peered":"2024-03-04T06:56:19.534568+0000","last_clean":"2024-03-04T06:56:19.534568+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:56:19.534568+0000","last_undegraded":"2024-03-04T06:56:19.534568+0000","last_fullsized":"2024-03-04T06:56:19.534568+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117002+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.117002+0000","last_peered":"2024-03-04T06:55:13.117002+0000","last_clean":"2024-03-04T06:55:13.117002+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.117002+0000","last_undegraded":"2024-03-04T06:55:13.117002+0000","last_fullsized":"2024-03-04T06:55:13.117002+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992691+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:56:22.992691+0000","last_peered":"2024-03-04T06:56:22.992691+0000","last_clean":"2024-03-04T06:56:22.992691+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:56:22.992691+0000","last_undegraded":"2024-03-04T06:56:22.992691+0000","last_fullsized":"2024-03-04T06:56:22.992691+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106163+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106163+0000","last_peered":"2024-03-04T06:55:13.106163+0000","last_clean":"2024-03-04T06:55:13.106163+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106163+0000","last_undegraded":"2024-03-04T06:55:13.106163+0000","last_fullsized":"2024-03-04T06:55:13.106163+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102005+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.102005+0000","last_peered":"2024-03-04T06:55:13.102005+0000","last_clean":"2024-03-04T06:55:13.102005+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.102005+0000","last_undegraded":"2024-03-04T06:55:13.102005+0000","last_fullsized":"2024-03-04T06:55:13.102005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106089+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106089+0000","last_peered":"2024-03-04T06:55:13.106089+0000","last_clean":"2024-03-04T06:55:13.106089+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106089+0000","last_undegraded":"2024-03-04T06:55:13.106089+0000","last_fullsized":"2024-03-04T06:55:13.106089+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101809+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101809+0000","last_peered":"2024-03-04T06:55:13.101809+0000","last_clean":"2024-03-04T06:55:13.101809+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101809+0000","last_undegraded":"2024-03-04T06:55:13.101809+0000","last_fullsized":"2024-03-04T06:55:13.101809+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984614+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:14.984614+0000","last_peered":"2024-03-04T06:55:14.984614+0000","last_clean":"2024-03-04T06:55:14.984614+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:14.984614+0000","last_undegraded":"2024-03-04T06:55:14.984614+0000","last_fullsized":"2024-03-04T06:55:14.984614+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1064,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103046+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.103046+0000","last_peered":"2024-03-04T06:55:13.103046+0000","last_clean":"2024-03-04T06:55:13.103046+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.103046+0000","last_undegraded":"2024-03-04T06:55:13.103046+0000","last_fullsized":"2024-03-04T06:55:13.103046+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115007+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.115007+0000","last_peered":"2024-03-04T06:55:13.115007+0000","last_clean":"2024-03-04T06:55:13.115007+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.115007+0000","last_undegraded":"2024-03-04T06:55:13.115007+0000","last_fullsized":"2024-03-04T06:55:13.115007+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114852+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114852+0000","last_peered":"2024-03-04T06:55:13.114852+0000","last_clean":"2024-03-04T06:55:13.114852+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114852+0000","last_undegraded":"2024-03-04T06:55:13.114852+0000","last_fullsized":"2024-03-04T06:55:13.114852+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:32.604419+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:32.604419+0000","last_peered":"2024-03-04T06:55:32.604419+0000","last_clean":"2024-03-04T06:55:32.604419+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:32.604419+0000","last_undegraded":"2024-03-04T06:55:32.604419+0000","last_fullsized":"2024-03-04T06:55:32.604419+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.099013+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.099013+0000","last_peered":"2024-03-04T06:55:13.099013+0000","last_clean":"2024-03-04T06:55:13.099013+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.099013+0000","last_undegraded":"2024-03-04T06:55:13.099013+0000","last_fullsized":"2024-03-04T06:55:13.099013+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985446+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:17.985446+0000","last_peered":"2024-03-04T06:55:17.985446+0000","last_clean":"2024-03-04T06:55:17.985446+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:17.985446+0000","last_undegraded":"2024-03-04T06:55:17.985446+0000","last_fullsized":"2024-03-04T06:55:17.985446+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:53.145282+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:53.145282+0000","last_peered":"2024-03-04T06:55:53.145282+0000","last_clean":"2024-03-04T06:55:53.145282+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:53.145282+0000","last_undegraded":"2024-03-04T06:55:53.145282+0000","last_fullsized":"2024-03-04T06:55:53.145282+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937387+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:52.937387+0000","last_peered":"2024-03-04T06:55:52.937387+0000","last_clean":"2024-03-04T06:55:52.937387+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:52.937387+0000","last_undegraded":"2024-03-04T06:55:52.937387+0000","last_fullsized":"2024-03-04T06:55:52.937387+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937465+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:52.937465+0000","last_peered":"2024-03-04T06:55:52.937465+0000","last_clean":"2024-03-04T06:55:52.937465+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:52.937465+0000","last_undegraded":"2024-03-04T06:55:52.937465+0000","last_fullsized":"2024-03-04T06:55:52.937465+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096941+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096941+0000","last_peered":"2024-03-04T06:55:13.096941+0000","last_clean":"2024-03-04T06:55:13.096941+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096941+0000","last_undegraded":"2024-03-04T06:55:13.096941+0000","last_fullsized":"2024-03-04T06:55:13.096941+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102303+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102303+0000","last_peered":"2024-03-04T06:55:13.102303+0000","last_clean":"2024-03-04T06:55:13.102303+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102303+0000","last_undegraded":"2024-03-04T06:55:13.102303+0000","last_fullsized":"2024-03-04T06:55:13.102303+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1305,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992748+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:56:22.992748+0000","last_peered":"2024-03-04T06:56:22.992748+0000","last_clean":"2024-03-04T06:56:22.992748+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:56:22.992748+0000","last_undegraded":"2024-03-04T06:56:22.992748+0000","last_fullsized":"2024-03-04T06:56:22.992748+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988343+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:44.988343+0000","last_peered":"2024-03-04T06:55:44.988343+0000","last_clean":"2024-03-04T06:55:44.988343+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:44.988343+0000","last_undegraded":"2024-03-04T06:55:44.988343+0000","last_fullsized":"2024-03-04T06:55:44.988343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988353+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:44.988353+0000","last_peered":"2024-03-04T06:55:44.988353+0000","last_clean":"2024-03-04T06:55:44.988353+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:44.988353+0000","last_undegraded":"2024-03-04T06:55:44.988353+0000","last_fullsized":"2024-03-04T06:55:44.988353+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992731+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:56:22.992731+0000","last_peered":"2024-03-04T06:56:22.992731+0000","last_clean":"2024-03-04T06:56:22.992731+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:56:22.992731+0000","last_undegraded":"2024-03-04T06:56:22.992731+0000","last_fullsized":"2024-03-04T06:56:22.992731+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1234,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098569+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098569+0000","last_peered":"2024-03-04T06:55:13.098569+0000","last_clean":"2024-03-04T06:55:13.098569+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098569+0000","last_undegraded":"2024-03-04T06:55:13.098569+0000","last_fullsized":"2024-03-04T06:55:13.098569+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1221,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097506+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097506+0000","last_peered":"2024-03-04T06:55:13.097506+0000","last_clean":"2024-03-04T06:55:13.097506+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097506+0000","last_undegraded":"2024-03-04T06:55:13.097506+0000","last_fullsized":"2024-03-04T06:55:13.097506+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102499+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102499+0000","last_peered":"2024-03-04T06:55:13.102499+0000","last_clean":"2024-03-04T06:55:13.102499+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102499+0000","last_undegraded":"2024-03-04T06:55:13.102499+0000","last_fullsized":"2024-03-04T06:55:13.102499+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106216+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106216+0000","last_peered":"2024-03-04T06:55:13.106216+0000","last_clean":"2024-03-04T06:55:13.106216+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106216+0000","last_undegraded":"2024-03-04T06:55:13.106216+0000","last_fullsized":"2024-03-04T06:55:13.106216+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984673+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:14.984673+0000","last_peered":"2024-03-04T06:55:14.984673+0000","last_clean":"2024-03-04T06:55:14.984673+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:14.984673+0000","last_undegraded":"2024-03-04T06:55:14.984673+0000","last_fullsized":"2024-03-04T06:55:14.984673+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1189,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:47.606038+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:47.606038+0000","last_peered":"2024-03-04T06:55:47.606038+0000","last_clean":"2024-03-04T06:55:47.606038+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:47.606038+0000","last_undegraded":"2024-03-04T06:55:47.606038+0000","last_fullsized":"2024-03-04T06:55:47.606038+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114709+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114709+0000","last_peered":"2024-03-04T06:55:13.114709+0000","last_clean":"2024-03-04T06:55:13.114709+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114709+0000","last_undegraded":"2024-03-04T06:55:13.114709+0000","last_fullsized":"2024-03-04T06:55:13.114709+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:57.989954+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:57.989954+0000","last_peered":"2024-03-04T06:55:57.989954+0000","last_clean":"2024-03-04T06:55:57.989954+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:57.989954+0000","last_undegraded":"2024-03-04T06:55:57.989954+0000","last_fullsized":"2024-03-04T06:55:57.989954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096734+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096734+0000","last_peered":"2024-03-04T06:55:13.096734+0000","last_clean":"2024-03-04T06:55:13.096734+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096734+0000","last_undegraded":"2024-03-04T06:55:13.096734+0000","last_fullsized":"2024-03-04T06:55:13.096734+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097225+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097225+0000","last_peered":"2024-03-04T06:55:13.097225+0000","last_clean":"2024-03-04T06:55:13.097225+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097225+0000","last_undegraded":"2024-03-04T06:55:13.097225+0000","last_fullsized":"2024-03-04T06:55:13.097225+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105593+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:55:13.105593+0000","last_peered":"2024-03-04T06:55:13.105593+0000","last_clean":"2024-03-04T06:55:13.105593+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:55:13.105593+0000","last_undegraded":"2024-03-04T06:55:13.105593+0000","last_fullsized":"2024-03-04T06:55:13.105593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115824+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:55:13.115824+0000","last_peered":"2024-03-04T06:55:13.115824+0000","last_clean":"2024-03-04T06:55:13.115824+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:55:13.115824+0000","last_undegraded":"2024-03-04T06:55:13.115824+0000","last_fullsized":"2024-03-04T06:55:13.115824+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115145+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115145+0000","last_peered":"2024-03-04T06:55:13.115145+0000","last_clean":"2024-03-04T06:55:13.115145+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115145+0000","last_undegraded":"2024-03-04T06:55:13.115145+0000","last_fullsized":"2024-03-04T06:55:13.115145+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1110,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105468+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:55:13.105468+0000","last_peered":"2024-03-04T06:55:13.105468+0000","last_clean":"2024-03-04T06:55:13.105468+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:55:13.105468+0000","last_undegraded":"2024-03-04T06:55:13.105468+0000","last_fullsized":"2024-03-04T06:55:13.105468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105915+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:55:13.105915+0000","last_peered":"2024-03-04T06:55:13.105915+0000","last_clean":"2024-03-04T06:55:13.105915+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:55:13.105915+0000","last_undegraded":"2024-03-04T06:55:13.105915+0000","last_fullsized":"2024-03-04T06:55:13.105915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.988031+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:37.988031+0000","last_peered":"2024-03-04T06:55:37.988031+0000","last_clean":"2024-03-04T06:55:37.988031+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:37.988031+0000","last_undegraded":"2024-03-04T06:55:37.988031+0000","last_fullsized":"2024-03-04T06:55:37.988031+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116083+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:55:13.116083+0000","last_peered":"2024-03-04T06:55:13.116083+0000","last_clean":"2024-03-04T06:55:13.116083+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:55:13.116083+0000","last_undegraded":"2024-03-04T06:55:13.116083+0000","last_fullsized":"2024-03-04T06:55:13.116083+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.602395+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:17.602395+0000","last_peered":"2024-03-04T06:55:17.602395+0000","last_clean":"2024-03-04T06:55:17.602395+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:17.602395+0000","last_undegraded":"2024-03-04T06:55:17.602395+0000","last_fullsized":"2024-03-04T06:55:17.602395+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114988+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114988+0000","last_peered":"2024-03-04T06:55:13.114988+0000","last_clean":"2024-03-04T06:55:13.114988+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114988+0000","last_undegraded":"2024-03-04T06:55:13.114988+0000","last_fullsized":"2024-03-04T06:55:13.114988+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102665+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102665+0000","last_peered":"2024-03-04T06:55:13.102665+0000","last_clean":"2024-03-04T06:55:13.102665+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102665+0000","last_undegraded":"2024-03-04T06:55:13.102665+0000","last_fullsized":"2024-03-04T06:55:13.102665+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1302,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985489+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:17.985489+0000","last_peered":"2024-03-04T06:55:17.985489+0000","last_clean":"2024-03-04T06:55:17.985489+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:17.985489+0000","last_undegraded":"2024-03-04T06:55:17.985489+0000","last_fullsized":"2024-03-04T06:55:17.985489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098537+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098537+0000","last_peered":"2024-03-04T06:55:13.098537+0000","last_clean":"2024-03-04T06:55:13.098537+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098537+0000","last_undegraded":"2024-03-04T06:55:13.098537+0000","last_fullsized":"2024-03-04T06:55:13.098537+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937420+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:52.937420+0000","last_peered":"2024-03-04T06:55:52.937420+0000","last_clean":"2024-03-04T06:55:52.937420+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:52.937420+0000","last_undegraded":"2024-03-04T06:55:52.937420+0000","last_fullsized":"2024-03-04T06:55:52.937420+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102561+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102561+0000","last_peered":"2024-03-04T06:55:13.102561+0000","last_clean":"2024-03-04T06:55:13.102561+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102561+0000","last_undegraded":"2024-03-04T06:55:13.102561+0000","last_fullsized":"2024-03-04T06:55:13.102561+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114471+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114471+0000","last_peered":"2024-03-04T06:55:13.114471+0000","last_clean":"2024-03-04T06:55:13.114471+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114471+0000","last_undegraded":"2024-03-04T06:55:13.114471+0000","last_fullsized":"2024-03-04T06:55:13.114471+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114484+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114484+0000","last_peered":"2024-03-04T06:55:13.114484+0000","last_clean":"2024-03-04T06:55:13.114484+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114484+0000","last_undegraded":"2024-03-04T06:55:13.114484+0000","last_fullsized":"2024-03-04T06:55:13.114484+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1252,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101837+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101837+0000","last_peered":"2024-03-04T06:55:13.101837+0000","last_clean":"2024-03-04T06:55:13.101837+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101837+0000","last_undegraded":"2024-03-04T06:55:13.101837+0000","last_fullsized":"2024-03-04T06:55:13.101837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3577,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377824+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:48.377824+0000","last_peered":"2024-03-04T06:55:48.377824+0000","last_clean":"2024-03-04T06:55:48.377824+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:48.377824+0000","last_undegraded":"2024-03-04T06:55:48.377824+0000","last_fullsized":"2024-03-04T06:55:48.377824+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096992+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096992+0000","last_peered":"2024-03-04T06:55:13.096992+0000","last_clean":"2024-03-04T06:55:13.096992+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096992+0000","last_undegraded":"2024-03-04T06:55:13.096992+0000","last_fullsized":"2024-03-04T06:55:13.096992+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102943+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102943+0000","last_peered":"2024-03-04T06:55:13.102943+0000","last_clean":"2024-03-04T06:55:13.102943+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102943+0000","last_undegraded":"2024-03-04T06:55:13.102943+0000","last_fullsized":"2024-03-04T06:55:13.102943+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17116,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992661+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:56:22.992661+0000","last_peered":"2024-03-04T06:56:22.992661+0000","last_clean":"2024-03-04T06:56:22.992661+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:56:22.992661+0000","last_undegraded":"2024-03-04T06:56:22.992661+0000","last_fullsized":"2024-03-04T06:56:22.992661+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115088+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115088+0000","last_peered":"2024-03-04T06:55:13.115088+0000","last_clean":"2024-03-04T06:55:13.115088+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115088+0000","last_undegraded":"2024-03-04T06:55:13.115088+0000","last_fullsized":"2024-03-04T06:55:13.115088+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116699+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116699+0000","last_peered":"2024-03-04T06:55:13.116699+0000","last_clean":"2024-03-04T06:55:13.116699+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116699+0000","last_undegraded":"2024-03-04T06:55:13.116699+0000","last_fullsized":"2024-03-04T06:55:13.116699+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106020+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.106020+0000","last_peered":"2024-03-04T06:55:13.106020+0000","last_clean":"2024-03-04T06:55:13.106020+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.106020+0000","last_undegraded":"2024-03-04T06:55:13.106020+0000","last_fullsized":"2024-03-04T06:55:13.106020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4386,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992700+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:56:22.992700+0000","last_peered":"2024-03-04T06:56:22.992700+0000","last_clean":"2024-03-04T06:56:22.992700+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:56:22.992700+0000","last_undegraded":"2024-03-04T06:56:22.992700+0000","last_fullsized":"2024-03-04T06:56:22.992700+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115964+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115964+0000","last_peered":"2024-03-04T06:55:13.115964+0000","last_clean":"2024-03-04T06:55:13.115964+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115964+0000","last_undegraded":"2024-03-04T06:55:13.115964+0000","last_fullsized":"2024-03-04T06:55:13.115964+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105737+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105737+0000","last_peered":"2024-03-04T06:55:13.105737+0000","last_clean":"2024-03-04T06:55:13.105737+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105737+0000","last_undegraded":"2024-03-04T06:55:13.105737+0000","last_fullsized":"2024-03-04T06:55:13.105737+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096287+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096287+0000","last_peered":"2024-03-04T06:55:13.096287+0000","last_clean":"2024-03-04T06:55:13.096287+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096287+0000","last_undegraded":"2024-03-04T06:55:13.096287+0000","last_fullsized":"2024-03-04T06:55:13.096287+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5639,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377937+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:48.377937+0000","last_peered":"2024-03-04T06:55:48.377937+0000","last_clean":"2024-03-04T06:55:48.377937+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:48.377937+0000","last_undegraded":"2024-03-04T06:55:48.377937+0000","last_fullsized":"2024-03-04T06:55:48.377937+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141294+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.141294+0000","last_peered":"2024-03-04T06:55:13.141294+0000","last_clean":"2024-03-04T06:55:13.141294+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.141294+0000","last_undegraded":"2024-03-04T06:55:13.141294+0000","last_fullsized":"2024-03-04T06:55:13.141294+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114171+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:55:13.114171+0000","last_peered":"2024-03-04T06:55:13.114171+0000","last_clean":"2024-03-04T06:55:13.114171+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:55:13.114171+0000","last_undegraded":"2024-03-04T06:55:13.114171+0000","last_fullsized":"2024-03-04T06:55:13.114171+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375859+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:28.375859+0000","last_peered":"2024-03-04T06:55:28.375859+0000","last_clean":"2024-03-04T06:55:28.375859+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:28.375859+0000","last_undegraded":"2024-03-04T06:55:28.375859+0000","last_fullsized":"2024-03-04T06:55:28.375859+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4015,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:19.534498+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:56:19.534498+0000","last_peered":"2024-03-04T06:56:19.534498+0000","last_clean":"2024-03-04T06:56:19.534498+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:56:19.534498+0000","last_undegraded":"2024-03-04T06:56:19.534498+0000","last_fullsized":"2024-03-04T06:56:19.534498+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.217050+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:43.217050+0000","last_peered":"2024-03-04T06:55:43.217050+0000","last_clean":"2024-03-04T06:55:43.217050+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:43.217050+0000","last_undegraded":"2024-03-04T06:55:43.217050+0000","last_fullsized":"2024-03-04T06:55:43.217050+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.990790+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:56:04.990790+0000","last_peered":"2024-03-04T06:56:04.990790+0000","last_clean":"2024-03-04T06:56:04.990790+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:56:04.990790+0000","last_undegraded":"2024-03-04T06:56:04.990790+0000","last_fullsized":"2024-03-04T06:56:04.990790+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105228+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105228+0000","last_peered":"2024-03-04T06:55:13.105228+0000","last_clean":"2024-03-04T06:55:13.105228+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105228+0000","last_undegraded":"2024-03-04T06:55:13.105228+0000","last_fullsized":"2024-03-04T06:55:13.105228+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1550,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532802+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:56:04.532802+0000","last_peered":"2024-03-04T06:56:04.532802+0000","last_clean":"2024-03-04T06:56:04.532802+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:56:04.532802+0000","last_undegraded":"2024-03-04T06:56:04.532802+0000","last_fullsized":"2024-03-04T06:56:04.532802+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3950,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933655+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:22.933655+0000","last_peered":"2024-03-04T06:55:22.933655+0000","last_clean":"2024-03-04T06:55:22.933655+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:22.933655+0000","last_undegraded":"2024-03-04T06:55:22.933655+0000","last_fullsized":"2024-03-04T06:55:22.933655+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117375+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117375+0000","last_peered":"2024-03-04T06:55:13.117375+0000","last_clean":"2024-03-04T06:55:13.117375+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117375+0000","last_undegraded":"2024-03-04T06:55:13.117375+0000","last_fullsized":"2024-03-04T06:55:13.117375+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375833+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:28.375833+0000","last_peered":"2024-03-04T06:55:28.375833+0000","last_clean":"2024-03-04T06:55:28.375833+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:28.375833+0000","last_undegraded":"2024-03-04T06:55:28.375833+0000","last_fullsized":"2024-03-04T06:55:28.375833+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532768+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:56:04.532768+0000","last_peered":"2024-03-04T06:56:04.532768+0000","last_clean":"2024-03-04T06:56:04.532768+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:56:04.532768+0000","last_undegraded":"2024-03-04T06:56:04.532768+0000","last_fullsized":"2024-03-04T06:56:04.532768+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15291,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:43.217015+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:43.217015+0000","last_peered":"2024-03-04T06:55:43.217015+0000","last_clean":"2024-03-04T06:55:43.217015+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:43.217015+0000","last_undegraded":"2024-03-04T06:55:43.217015+0000","last_fullsized":"2024-03-04T06:55:43.217015+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992678+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:56:22.992678+0000","last_peered":"2024-03-04T06:56:22.992678+0000","last_clean":"2024-03-04T06:56:22.992678+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:56:22.992678+0000","last_undegraded":"2024-03-04T06:56:22.992678+0000","last_fullsized":"2024-03-04T06:56:22.992678+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534547+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:56:19.534547+0000","last_peered":"2024-03-04T06:56:19.534547+0000","last_clean":"2024-03-04T06:56:19.534547+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:56:19.534547+0000","last_undegraded":"2024-03-04T06:56:19.534547+0000","last_fullsized":"2024-03-04T06:56:19.534547+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116059+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116059+0000","last_peered":"2024-03-04T06:55:13.116059+0000","last_clean":"2024-03-04T06:55:13.116059+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116059+0000","last_undegraded":"2024-03-04T06:55:13.116059+0000","last_fullsized":"2024-03-04T06:55:13.116059+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4378,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097496+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097496+0000","last_peered":"2024-03-04T06:55:13.097496+0000","last_clean":"2024-03-04T06:55:13.097496+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097496+0000","last_undegraded":"2024-03-04T06:55:13.097496+0000","last_fullsized":"2024-03-04T06:55:13.097496+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988300+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:44.988300+0000","last_peered":"2024-03-04T06:55:44.988300+0000","last_clean":"2024-03-04T06:55:44.988300+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:44.988300+0000","last_undegraded":"2024-03-04T06:55:44.988300+0000","last_fullsized":"2024-03-04T06:55:44.988300+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141284+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.141284+0000","last_peered":"2024-03-04T06:55:13.141284+0000","last_clean":"2024-03-04T06:55:13.141284+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.141284+0000","last_undegraded":"2024-03-04T06:55:13.141284+0000","last_fullsized":"2024-03-04T06:55:13.141284+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097249+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:55:13.097249+0000","last_peered":"2024-03-04T06:55:13.097249+0000","last_clean":"2024-03-04T06:55:13.097249+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:55:13.097249+0000","last_undegraded":"2024-03-04T06:55:13.097249+0000","last_fullsized":"2024-03-04T06:55:13.097249+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4609,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:44.988263+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:44.988263+0000","last_peered":"2024-03-04T06:55:44.988263+0000","last_clean":"2024-03-04T06:55:44.988263+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:44.988263+0000","last_undegraded":"2024-03-04T06:55:44.988263+0000","last_fullsized":"2024-03-04T06:55:44.988263+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095704+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095704+0000","last_peered":"2024-03-04T06:55:13.095704+0000","last_clean":"2024-03-04T06:55:13.095704+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095704+0000","last_undegraded":"2024-03-04T06:55:13.095704+0000","last_fullsized":"2024-03-04T06:55:13.095704+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1078,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218837+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:58.218837+0000","last_peered":"2024-03-04T06:55:58.218837+0000","last_clean":"2024-03-04T06:55:58.218837+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:58.218837+0000","last_undegraded":"2024-03-04T06:55:58.218837+0000","last_fullsized":"2024-03-04T06:55:58.218837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115644+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115644+0000","last_peered":"2024-03-04T06:55:13.115644+0000","last_clean":"2024-03-04T06:55:13.115644+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115644+0000","last_undegraded":"2024-03-04T06:55:13.115644+0000","last_fullsized":"2024-03-04T06:55:13.115644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4634,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:37.935758+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:37.935758+0000","last_peered":"2024-03-04T06:55:37.935758+0000","last_clean":"2024-03-04T06:55:37.935758+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:37.935758+0000","last_undegraded":"2024-03-04T06:55:37.935758+0000","last_fullsized":"2024-03-04T06:55:37.935758+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101972+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101972+0000","last_peered":"2024-03-04T06:55:13.101972+0000","last_clean":"2024-03-04T06:55:13.101972+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101972+0000","last_undegraded":"2024-03-04T06:55:13.101972+0000","last_fullsized":"2024-03-04T06:55:13.101972+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1184,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095689+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095689+0000","last_peered":"2024-03-04T06:55:13.095689+0000","last_clean":"2024-03-04T06:55:13.095689+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095689+0000","last_undegraded":"2024-03-04T06:55:13.095689+0000","last_fullsized":"2024-03-04T06:55:13.095689+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5157,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.113366+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.113366+0000","last_peered":"2024-03-04T06:55:13.113366+0000","last_clean":"2024-03-04T06:55:13.113366+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.113366+0000","last_undegraded":"2024-03-04T06:55:13.113366+0000","last_fullsized":"2024-03-04T06:55:13.113366+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141219+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.141219+0000","last_peered":"2024-03-04T06:55:13.141219+0000","last_clean":"2024-03-04T06:55:13.141219+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.141219+0000","last_undegraded":"2024-03-04T06:55:13.141219+0000","last_fullsized":"2024-03-04T06:55:13.141219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097821+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:55:13.097821+0000","last_peered":"2024-03-04T06:55:13.097821+0000","last_clean":"2024-03-04T06:55:13.097821+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:55:13.097821+0000","last_undegraded":"2024-03-04T06:55:13.097821+0000","last_fullsized":"2024-03-04T06:55:13.097821+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4719,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380021+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:56:08.380021+0000","last_peered":"2024-03-04T06:56:08.380021+0000","last_clean":"2024-03-04T06:56:08.380021+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:56:08.380021+0000","last_undegraded":"2024-03-04T06:56:08.380021+0000","last_fullsized":"2024-03-04T06:56:08.380021+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141246+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.141246+0000","last_peered":"2024-03-04T06:55:13.141246+0000","last_clean":"2024-03-04T06:55:13.141246+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.141246+0000","last_undegraded":"2024-03-04T06:55:13.141246+0000","last_fullsized":"2024-03-04T06:55:13.141246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098839+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098839+0000","last_peered":"2024-03-04T06:55:13.098839+0000","last_clean":"2024-03-04T06:55:13.098839+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098839+0000","last_undegraded":"2024-03-04T06:55:13.098839+0000","last_fullsized":"2024-03-04T06:55:13.098839+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5554,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:33.143474+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:33.143474+0000","last_peered":"2024-03-04T06:55:33.143474+0000","last_clean":"2024-03-04T06:55:33.143474+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:33.143474+0000","last_undegraded":"2024-03-04T06:55:33.143474+0000","last_fullsized":"2024-03-04T06:55:33.143474+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102401+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102401+0000","last_peered":"2024-03-04T06:55:13.102401+0000","last_clean":"2024-03-04T06:55:13.102401+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102401+0000","last_undegraded":"2024-03-04T06:55:13.102401+0000","last_fullsized":"2024-03-04T06:55:13.102401+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218784+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:58.218784+0000","last_peered":"2024-03-04T06:55:58.218784+0000","last_clean":"2024-03-04T06:55:58.218784+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:58.218784+0000","last_undegraded":"2024-03-04T06:55:58.218784+0000","last_fullsized":"2024-03-04T06:55:58.218784+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.379963+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:56:08.379963+0000","last_peered":"2024-03-04T06:56:08.379963+0000","last_clean":"2024-03-04T06:56:08.379963+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:56:08.379963+0000","last_undegraded":"2024-03-04T06:56:08.379963+0000","last_fullsized":"2024-03-04T06:56:08.379963+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380005+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:56:08.380005+0000","last_peered":"2024-03-04T06:56:08.380005+0000","last_clean":"2024-03-04T06:56:08.380005+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:56:08.380005+0000","last_undegraded":"2024-03-04T06:56:08.380005+0000","last_fullsized":"2024-03-04T06:56:08.380005+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102489+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102489+0000","last_peered":"2024-03-04T06:55:13.102489+0000","last_clean":"2024-03-04T06:55:13.102489+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102489+0000","last_undegraded":"2024-03-04T06:55:13.102489+0000","last_fullsized":"2024-03-04T06:55:13.102489+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4366,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377880+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:48.377880+0000","last_peered":"2024-03-04T06:55:48.377880+0000","last_clean":"2024-03-04T06:55:48.377880+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:48.377880+0000","last_undegraded":"2024-03-04T06:55:48.377880+0000","last_fullsized":"2024-03-04T06:55:48.377880+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:33.143531+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:33.143531+0000","last_peered":"2024-03-04T06:55:33.143531+0000","last_clean":"2024-03-04T06:55:33.143531+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:33.143531+0000","last_undegraded":"2024-03-04T06:55:33.143531+0000","last_fullsized":"2024-03-04T06:55:33.143531+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935733+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:37.935733+0000","last_peered":"2024-03-04T06:55:37.935733+0000","last_clean":"2024-03-04T06:55:37.935733+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:37.935733+0000","last_undegraded":"2024-03-04T06:55:37.935733+0000","last_fullsized":"2024-03-04T06:55:37.935733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4599,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.322375+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.322375+0000","last_peered":"2024-03-04T06:55:13.322375+0000","last_clean":"2024-03-04T06:55:13.322375+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.322375+0000","last_undegraded":"2024-03-04T06:55:13.322375+0000","last_fullsized":"2024-03-04T06:55:13.322375+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1245,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380055+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:56:08.380055+0000","last_peered":"2024-03-04T06:56:08.380055+0000","last_clean":"2024-03-04T06:56:08.380055+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:56:08.380055+0000","last_undegraded":"2024-03-04T06:56:08.380055+0000","last_fullsized":"2024-03-04T06:56:08.380055+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105586+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.105586+0000","last_peered":"2024-03-04T06:55:13.105586+0000","last_clean":"2024-03-04T06:55:13.105586+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.105586+0000","last_undegraded":"2024-03-04T06:55:13.105586+0000","last_fullsized":"2024-03-04T06:55:13.105586+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.216983+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:43.216983+0000","last_peered":"2024-03-04T06:55:43.216983+0000","last_clean":"2024-03-04T06:55:43.216983+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:43.216983+0000","last_undegraded":"2024-03-04T06:55:43.216983+0000","last_fullsized":"2024-03-04T06:55:43.216983+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375870+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:28.375870+0000","last_peered":"2024-03-04T06:55:28.375870+0000","last_clean":"2024-03-04T06:55:28.375870+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:28.375870+0000","last_undegraded":"2024-03-04T06:55:28.375870+0000","last_fullsized":"2024-03-04T06:55:28.375870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106053+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.106053+0000","last_peered":"2024-03-04T06:55:13.106053+0000","last_clean":"2024-03-04T06:55:13.106053+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.106053+0000","last_undegraded":"2024-03-04T06:55:13.106053+0000","last_fullsized":"2024-03-04T06:55:13.106053+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992636+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:56:22.992636+0000","last_peered":"2024-03-04T06:56:22.992636+0000","last_clean":"2024-03-04T06:56:22.992636+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:56:22.992636+0000","last_undegraded":"2024-03-04T06:56:22.992636+0000","last_fullsized":"2024-03-04T06:56:22.992636+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096810+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:55:13.096810+0000","last_peered":"2024-03-04T06:55:13.096810+0000","last_clean":"2024-03-04T06:55:13.096810+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:55:13.096810+0000","last_undegraded":"2024-03-04T06:55:13.096810+0000","last_fullsized":"2024-03-04T06:55:13.096810+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141268+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.141268+0000","last_peered":"2024-03-04T06:55:13.141268+0000","last_clean":"2024-03-04T06:55:13.141268+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.141268+0000","last_undegraded":"2024-03-04T06:55:13.141268+0000","last_fullsized":"2024-03-04T06:55:13.141268+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218825+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:58.218825+0000","last_peered":"2024-03-04T06:55:58.218825+0000","last_clean":"2024-03-04T06:55:58.218825+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:58.218825+0000","last_undegraded":"2024-03-04T06:55:58.218825+0000","last_fullsized":"2024-03-04T06:55:58.218825+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1193,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097481+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:55:13.097481+0000","last_peered":"2024-03-04T06:55:13.097481+0000","last_clean":"2024-03-04T06:55:13.097481+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:55:13.097481+0000","last_undegraded":"2024-03-04T06:55:13.097481+0000","last_fullsized":"2024-03-04T06:55:13.097481+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933591+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:22.933591+0000","last_peered":"2024-03-04T06:55:22.933591+0000","last_clean":"2024-03-04T06:55:22.933591+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:22.933591+0000","last_undegraded":"2024-03-04T06:55:22.933591+0000","last_fullsized":"2024-03-04T06:55:22.933591+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1120,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935684+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:37.935684+0000","last_peered":"2024-03-04T06:55:37.935684+0000","last_clean":"2024-03-04T06:55:37.935684+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:37.935684+0000","last_undegraded":"2024-03-04T06:55:37.935684+0000","last_fullsized":"2024-03-04T06:55:37.935684+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116911+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116911+0000","last_peered":"2024-03-04T06:55:13.116911+0000","last_clean":"2024-03-04T06:55:13.116911+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116911+0000","last_undegraded":"2024-03-04T06:55:13.116911+0000","last_fullsized":"2024-03-04T06:55:13.116911+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.220345+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:56:13.220345+0000","last_peered":"2024-03-04T06:56:13.220345+0000","last_clean":"2024-03-04T06:56:13.220345+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:56:13.220345+0000","last_undegraded":"2024-03-04T06:56:13.220345+0000","last_fullsized":"2024-03-04T06:56:13.220345+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503461,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648109,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142416,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287063,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997769,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885825,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937403,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792756,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:58:30.245 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:30.245 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:30.245 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:30.245 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:30.245 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:30.245 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:30.245 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:30.245 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:30.246 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:30.246 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:30.246 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:58:30.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:30 smithi137 ceph-mon[91314]: pgmap v1019: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:30.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:30 smithi137 ceph-mon[88869]: pgmap v1019: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:30.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:30 smithi203 ceph-mon[85573]: pgmap v1019: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:31.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:31 smithi137 ceph-mon[88869]: from='client.44528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:31.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:31 smithi137 ceph-mon[91314]: from='client.44528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:31.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:31 smithi203 ceph-mon[85573]: from='client.44528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:32.746 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:32 smithi203 ceph-mon[85573]: pgmap v1020: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:32.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:32 smithi137 ceph-mon[88869]: pgmap v1020: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:32.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:32 smithi137 ceph-mon[91314]: pgmap v1020: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:33.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:33 smithi137 ceph-mon[88869]: pgmap v1021: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:33.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:33 smithi137 ceph-mon[91314]: pgmap v1021: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:33.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:33 smithi203 ceph-mon[85573]: pgmap v1021: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:35.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:35 smithi137 ceph-mon[88869]: pgmap v1022: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:35.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:35 smithi137 ceph-mon[91314]: pgmap v1022: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:35.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:58:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:58:35] "GET /metrics HTTP/1.1" 200 36334 "" "Prometheus/2.43.0" 2024-03-04T06:58:35.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:35 smithi203 ceph-mon[85573]: pgmap v1022: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:37.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:37 smithi137 ceph-mon[88869]: pgmap v1023: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:37.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:37 smithi137 ceph-mon[91314]: pgmap v1023: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:37.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:37 smithi203 ceph-mon[85573]: pgmap v1023: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:38.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:58:38.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:58:38.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:58:39.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:39 smithi137 ceph-mon[88869]: pgmap v1024: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:39.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:39 smithi137 ceph-mon[91314]: pgmap v1024: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:39.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:39 smithi203 ceph-mon[85573]: pgmap v1024: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:40.247 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:58:40.465 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:58:41.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:41 smithi137 ceph-mon[88869]: pgmap v1025: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:41.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:41 smithi137 ceph-mon[91314]: pgmap v1025: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:41.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:41 smithi203 ceph-mon[85573]: pgmap v1025: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:42.235 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:58:42.237 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:58:42.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:42 smithi137 ceph-mon[88869]: from='client.34593 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:42.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:42 smithi137 ceph-mon[91314]: from='client.34593 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:42.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:42 smithi203 ceph-mon[85573]: from='client.34593 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:42.870 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1025,"stamp":"2024-03-04T06:58:40.523181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003735"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534568+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:56:19.534568+0000","last_peered":"2024-03-04T06:56:19.534568+0000","last_clean":"2024-03-04T06:56:19.534568+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:56:19.534568+0000","last_undegraded":"2024-03-04T06:56:19.534568+0000","last_fullsized":"2024-03-04T06:56:19.534568+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117002+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.117002+0000","last_peered":"2024-03-04T06:55:13.117002+0000","last_clean":"2024-03-04T06:55:13.117002+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.117002+0000","last_undegraded":"2024-03-04T06:55:13.117002+0000","last_fullsized":"2024-03-04T06:55:13.117002+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992691+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:56:22.992691+0000","last_peered":"2024-03-04T06:56:22.992691+0000","last_clean":"2024-03-04T06:56:22.992691+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:56:22.992691+0000","last_undegraded":"2024-03-04T06:56:22.992691+0000","last_fullsized":"2024-03-04T06:56:22.992691+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106163+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:55:13.106163+0000","last_peered":"2024-03-04T06:55:13.106163+0000","last_clean":"2024-03-04T06:55:13.106163+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:55:13.106163+0000","last_undegraded":"2024-03-04T06:55:13.106163+0000","last_fullsized":"2024-03-04T06:55:13.106163+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102005+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.102005+0000","last_peered":"2024-03-04T06:55:13.102005+0000","last_clean":"2024-03-04T06:55:13.102005+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.102005+0000","last_undegraded":"2024-03-04T06:55:13.102005+0000","last_fullsized":"2024-03-04T06:55:13.102005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106089+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:55:13.106089+0000","last_peered":"2024-03-04T06:55:13.106089+0000","last_clean":"2024-03-04T06:55:13.106089+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:55:13.106089+0000","last_undegraded":"2024-03-04T06:55:13.106089+0000","last_fullsized":"2024-03-04T06:55:13.106089+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101809+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101809+0000","last_peered":"2024-03-04T06:55:13.101809+0000","last_clean":"2024-03-04T06:55:13.101809+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101809+0000","last_undegraded":"2024-03-04T06:55:13.101809+0000","last_fullsized":"2024-03-04T06:55:13.101809+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984614+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:14.984614+0000","last_peered":"2024-03-04T06:55:14.984614+0000","last_clean":"2024-03-04T06:55:14.984614+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:14.984614+0000","last_undegraded":"2024-03-04T06:55:14.984614+0000","last_fullsized":"2024-03-04T06:55:14.984614+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1064,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103046+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.103046+0000","last_peered":"2024-03-04T06:55:13.103046+0000","last_clean":"2024-03-04T06:55:13.103046+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.103046+0000","last_undegraded":"2024-03-04T06:55:13.103046+0000","last_fullsized":"2024-03-04T06:55:13.103046+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115007+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.115007+0000","last_peered":"2024-03-04T06:55:13.115007+0000","last_clean":"2024-03-04T06:55:13.115007+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.115007+0000","last_undegraded":"2024-03-04T06:55:13.115007+0000","last_fullsized":"2024-03-04T06:55:13.115007+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114852+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114852+0000","last_peered":"2024-03-04T06:55:13.114852+0000","last_clean":"2024-03-04T06:55:13.114852+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114852+0000","last_undegraded":"2024-03-04T06:55:13.114852+0000","last_fullsized":"2024-03-04T06:55:13.114852+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:32.604419+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:32.604419+0000","last_peered":"2024-03-04T06:55:32.604419+0000","last_clean":"2024-03-04T06:55:32.604419+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:32.604419+0000","last_undegraded":"2024-03-04T06:55:32.604419+0000","last_fullsized":"2024-03-04T06:55:32.604419+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.099013+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.099013+0000","last_peered":"2024-03-04T06:55:13.099013+0000","last_clean":"2024-03-04T06:55:13.099013+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.099013+0000","last_undegraded":"2024-03-04T06:55:13.099013+0000","last_fullsized":"2024-03-04T06:55:13.099013+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985446+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:17.985446+0000","last_peered":"2024-03-04T06:55:17.985446+0000","last_clean":"2024-03-04T06:55:17.985446+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:17.985446+0000","last_undegraded":"2024-03-04T06:55:17.985446+0000","last_fullsized":"2024-03-04T06:55:17.985446+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:53.145282+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:53.145282+0000","last_peered":"2024-03-04T06:55:53.145282+0000","last_clean":"2024-03-04T06:55:53.145282+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:53.145282+0000","last_undegraded":"2024-03-04T06:55:53.145282+0000","last_fullsized":"2024-03-04T06:55:53.145282+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937387+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:52.937387+0000","last_peered":"2024-03-04T06:55:52.937387+0000","last_clean":"2024-03-04T06:55:52.937387+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:52.937387+0000","last_undegraded":"2024-03-04T06:55:52.937387+0000","last_fullsized":"2024-03-04T06:55:52.937387+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937465+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:52.937465+0000","last_peered":"2024-03-04T06:55:52.937465+0000","last_clean":"2024-03-04T06:55:52.937465+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:52.937465+0000","last_undegraded":"2024-03-04T06:55:52.937465+0000","last_fullsized":"2024-03-04T06:55:52.937465+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096941+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:55:13.096941+0000","last_peered":"2024-03-04T06:55:13.096941+0000","last_clean":"2024-03-04T06:55:13.096941+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:55:13.096941+0000","last_undegraded":"2024-03-04T06:55:13.096941+0000","last_fullsized":"2024-03-04T06:55:13.096941+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102303+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102303+0000","last_peered":"2024-03-04T06:55:13.102303+0000","last_clean":"2024-03-04T06:55:13.102303+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102303+0000","last_undegraded":"2024-03-04T06:55:13.102303+0000","last_fullsized":"2024-03-04T06:55:13.102303+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1305,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992748+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:56:22.992748+0000","last_peered":"2024-03-04T06:56:22.992748+0000","last_clean":"2024-03-04T06:56:22.992748+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:56:22.992748+0000","last_undegraded":"2024-03-04T06:56:22.992748+0000","last_fullsized":"2024-03-04T06:56:22.992748+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988343+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:44.988343+0000","last_peered":"2024-03-04T06:55:44.988343+0000","last_clean":"2024-03-04T06:55:44.988343+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:44.988343+0000","last_undegraded":"2024-03-04T06:55:44.988343+0000","last_fullsized":"2024-03-04T06:55:44.988343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988353+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:44.988353+0000","last_peered":"2024-03-04T06:55:44.988353+0000","last_clean":"2024-03-04T06:55:44.988353+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:44.988353+0000","last_undegraded":"2024-03-04T06:55:44.988353+0000","last_fullsized":"2024-03-04T06:55:44.988353+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992731+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:56:22.992731+0000","last_peered":"2024-03-04T06:56:22.992731+0000","last_clean":"2024-03-04T06:56:22.992731+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:56:22.992731+0000","last_undegraded":"2024-03-04T06:56:22.992731+0000","last_fullsized":"2024-03-04T06:56:22.992731+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1234,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098569+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098569+0000","last_peered":"2024-03-04T06:55:13.098569+0000","last_clean":"2024-03-04T06:55:13.098569+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098569+0000","last_undegraded":"2024-03-04T06:55:13.098569+0000","last_fullsized":"2024-03-04T06:55:13.098569+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1221,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097506+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097506+0000","last_peered":"2024-03-04T06:55:13.097506+0000","last_clean":"2024-03-04T06:55:13.097506+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097506+0000","last_undegraded":"2024-03-04T06:55:13.097506+0000","last_fullsized":"2024-03-04T06:55:13.097506+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102499+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102499+0000","last_peered":"2024-03-04T06:55:13.102499+0000","last_clean":"2024-03-04T06:55:13.102499+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102499+0000","last_undegraded":"2024-03-04T06:55:13.102499+0000","last_fullsized":"2024-03-04T06:55:13.102499+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1125,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106216+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:55:13.106216+0000","last_peered":"2024-03-04T06:55:13.106216+0000","last_clean":"2024-03-04T06:55:13.106216+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:55:13.106216+0000","last_undegraded":"2024-03-04T06:55:13.106216+0000","last_fullsized":"2024-03-04T06:55:13.106216+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984673+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:14.984673+0000","last_peered":"2024-03-04T06:55:14.984673+0000","last_clean":"2024-03-04T06:55:14.984673+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:14.984673+0000","last_undegraded":"2024-03-04T06:55:14.984673+0000","last_fullsized":"2024-03-04T06:55:14.984673+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1189,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:47.606038+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:47.606038+0000","last_peered":"2024-03-04T06:55:47.606038+0000","last_clean":"2024-03-04T06:55:47.606038+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:47.606038+0000","last_undegraded":"2024-03-04T06:55:47.606038+0000","last_fullsized":"2024-03-04T06:55:47.606038+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114709+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114709+0000","last_peered":"2024-03-04T06:55:13.114709+0000","last_clean":"2024-03-04T06:55:13.114709+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114709+0000","last_undegraded":"2024-03-04T06:55:13.114709+0000","last_fullsized":"2024-03-04T06:55:13.114709+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:57.989954+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:57.989954+0000","last_peered":"2024-03-04T06:55:57.989954+0000","last_clean":"2024-03-04T06:55:57.989954+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:57.989954+0000","last_undegraded":"2024-03-04T06:55:57.989954+0000","last_fullsized":"2024-03-04T06:55:57.989954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096734+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096734+0000","last_peered":"2024-03-04T06:55:13.096734+0000","last_clean":"2024-03-04T06:55:13.096734+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096734+0000","last_undegraded":"2024-03-04T06:55:13.096734+0000","last_fullsized":"2024-03-04T06:55:13.096734+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097225+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097225+0000","last_peered":"2024-03-04T06:55:13.097225+0000","last_clean":"2024-03-04T06:55:13.097225+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097225+0000","last_undegraded":"2024-03-04T06:55:13.097225+0000","last_fullsized":"2024-03-04T06:55:13.097225+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939306+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:56:07.939306+0000","last_peered":"2024-03-04T06:56:07.939306+0000","last_clean":"2024-03-04T06:56:07.939306+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:56:07.939306+0000","last_undegraded":"2024-03-04T06:56:07.939306+0000","last_fullsized":"2024-03-04T06:56:07.939306+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147156+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:56:13.147156+0000","last_peered":"2024-03-04T06:56:13.147156+0000","last_clean":"2024-03-04T06:56:13.147156+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:56:13.147156+0000","last_undegraded":"2024-03-04T06:56:13.147156+0000","last_fullsized":"2024-03-04T06:56:13.147156+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115145+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115145+0000","last_peered":"2024-03-04T06:55:13.115145+0000","last_clean":"2024-03-04T06:55:13.115145+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115145+0000","last_undegraded":"2024-03-04T06:55:13.115145+0000","last_fullsized":"2024-03-04T06:55:13.115145+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939379+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:56:07.939379+0000","last_peered":"2024-03-04T06:56:07.939379+0000","last_clean":"2024-03-04T06:56:07.939379+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:56:07.939379+0000","last_undegraded":"2024-03-04T06:56:07.939379+0000","last_fullsized":"2024-03-04T06:56:07.939379+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939364+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:56:07.939364+0000","last_peered":"2024-03-04T06:56:07.939364+0000","last_clean":"2024-03-04T06:56:07.939364+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:56:07.939364+0000","last_undegraded":"2024-03-04T06:56:07.939364+0000","last_fullsized":"2024-03-04T06:56:07.939364+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.988031+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:37.988031+0000","last_peered":"2024-03-04T06:55:37.988031+0000","last_clean":"2024-03-04T06:55:37.988031+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:37.988031+0000","last_undegraded":"2024-03-04T06:55:37.988031+0000","last_fullsized":"2024-03-04T06:55:37.988031+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147207+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:56:13.147207+0000","last_peered":"2024-03-04T06:56:13.147207+0000","last_clean":"2024-03-04T06:56:13.147207+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:56:13.147207+0000","last_undegraded":"2024-03-04T06:56:13.147207+0000","last_fullsized":"2024-03-04T06:56:13.147207+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.602395+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:17.602395+0000","last_peered":"2024-03-04T06:55:17.602395+0000","last_clean":"2024-03-04T06:55:17.602395+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:17.602395+0000","last_undegraded":"2024-03-04T06:55:17.602395+0000","last_fullsized":"2024-03-04T06:55:17.602395+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114988+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:55:13.114988+0000","last_peered":"2024-03-04T06:55:13.114988+0000","last_clean":"2024-03-04T06:55:13.114988+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:55:13.114988+0000","last_undegraded":"2024-03-04T06:55:13.114988+0000","last_fullsized":"2024-03-04T06:55:13.114988+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102665+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102665+0000","last_peered":"2024-03-04T06:55:13.102665+0000","last_clean":"2024-03-04T06:55:13.102665+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102665+0000","last_undegraded":"2024-03-04T06:55:13.102665+0000","last_fullsized":"2024-03-04T06:55:13.102665+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1302,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985489+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:17.985489+0000","last_peered":"2024-03-04T06:55:17.985489+0000","last_clean":"2024-03-04T06:55:17.985489+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:17.985489+0000","last_undegraded":"2024-03-04T06:55:17.985489+0000","last_fullsized":"2024-03-04T06:55:17.985489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098537+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:55:13.098537+0000","last_peered":"2024-03-04T06:55:13.098537+0000","last_clean":"2024-03-04T06:55:13.098537+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:55:13.098537+0000","last_undegraded":"2024-03-04T06:55:13.098537+0000","last_fullsized":"2024-03-04T06:55:13.098537+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937420+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:52.937420+0000","last_peered":"2024-03-04T06:55:52.937420+0000","last_clean":"2024-03-04T06:55:52.937420+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:52.937420+0000","last_undegraded":"2024-03-04T06:55:52.937420+0000","last_fullsized":"2024-03-04T06:55:52.937420+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102561+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102561+0000","last_peered":"2024-03-04T06:55:13.102561+0000","last_clean":"2024-03-04T06:55:13.102561+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102561+0000","last_undegraded":"2024-03-04T06:55:13.102561+0000","last_fullsized":"2024-03-04T06:55:13.102561+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114471+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:55:13.114471+0000","last_peered":"2024-03-04T06:55:13.114471+0000","last_clean":"2024-03-04T06:55:13.114471+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:55:13.114471+0000","last_undegraded":"2024-03-04T06:55:13.114471+0000","last_fullsized":"2024-03-04T06:55:13.114471+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114484+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:55:13.114484+0000","last_peered":"2024-03-04T06:55:13.114484+0000","last_clean":"2024-03-04T06:55:13.114484+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:55:13.114484+0000","last_undegraded":"2024-03-04T06:55:13.114484+0000","last_fullsized":"2024-03-04T06:55:13.114484+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1252,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101837+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101837+0000","last_peered":"2024-03-04T06:55:13.101837+0000","last_clean":"2024-03-04T06:55:13.101837+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101837+0000","last_undegraded":"2024-03-04T06:55:13.101837+0000","last_fullsized":"2024-03-04T06:55:13.101837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3577,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377824+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:48.377824+0000","last_peered":"2024-03-04T06:55:48.377824+0000","last_clean":"2024-03-04T06:55:48.377824+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:48.377824+0000","last_undegraded":"2024-03-04T06:55:48.377824+0000","last_fullsized":"2024-03-04T06:55:48.377824+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096992+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096992+0000","last_peered":"2024-03-04T06:55:13.096992+0000","last_clean":"2024-03-04T06:55:13.096992+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096992+0000","last_undegraded":"2024-03-04T06:55:13.096992+0000","last_fullsized":"2024-03-04T06:55:13.096992+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102943+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102943+0000","last_peered":"2024-03-04T06:55:13.102943+0000","last_clean":"2024-03-04T06:55:13.102943+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102943+0000","last_undegraded":"2024-03-04T06:55:13.102943+0000","last_fullsized":"2024-03-04T06:55:13.102943+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17116,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992661+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:56:22.992661+0000","last_peered":"2024-03-04T06:56:22.992661+0000","last_clean":"2024-03-04T06:56:22.992661+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:56:22.992661+0000","last_undegraded":"2024-03-04T06:56:22.992661+0000","last_fullsized":"2024-03-04T06:56:22.992661+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115088+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115088+0000","last_peered":"2024-03-04T06:55:13.115088+0000","last_clean":"2024-03-04T06:55:13.115088+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115088+0000","last_undegraded":"2024-03-04T06:55:13.115088+0000","last_fullsized":"2024-03-04T06:55:13.115088+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116699+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116699+0000","last_peered":"2024-03-04T06:55:13.116699+0000","last_clean":"2024-03-04T06:55:13.116699+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116699+0000","last_undegraded":"2024-03-04T06:55:13.116699+0000","last_fullsized":"2024-03-04T06:55:13.116699+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106020+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.106020+0000","last_peered":"2024-03-04T06:55:13.106020+0000","last_clean":"2024-03-04T06:55:13.106020+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.106020+0000","last_undegraded":"2024-03-04T06:55:13.106020+0000","last_fullsized":"2024-03-04T06:55:13.106020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4386,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992700+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:56:22.992700+0000","last_peered":"2024-03-04T06:56:22.992700+0000","last_clean":"2024-03-04T06:56:22.992700+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:56:22.992700+0000","last_undegraded":"2024-03-04T06:56:22.992700+0000","last_fullsized":"2024-03-04T06:56:22.992700+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115964+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115964+0000","last_peered":"2024-03-04T06:55:13.115964+0000","last_clean":"2024-03-04T06:55:13.115964+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115964+0000","last_undegraded":"2024-03-04T06:55:13.115964+0000","last_fullsized":"2024-03-04T06:55:13.115964+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105737+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105737+0000","last_peered":"2024-03-04T06:55:13.105737+0000","last_clean":"2024-03-04T06:55:13.105737+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105737+0000","last_undegraded":"2024-03-04T06:55:13.105737+0000","last_fullsized":"2024-03-04T06:55:13.105737+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096287+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:55:13.096287+0000","last_peered":"2024-03-04T06:55:13.096287+0000","last_clean":"2024-03-04T06:55:13.096287+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:55:13.096287+0000","last_undegraded":"2024-03-04T06:55:13.096287+0000","last_fullsized":"2024-03-04T06:55:13.096287+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5639,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377937+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:48.377937+0000","last_peered":"2024-03-04T06:55:48.377937+0000","last_clean":"2024-03-04T06:55:48.377937+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:48.377937+0000","last_undegraded":"2024-03-04T06:55:48.377937+0000","last_fullsized":"2024-03-04T06:55:48.377937+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141294+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.141294+0000","last_peered":"2024-03-04T06:55:13.141294+0000","last_clean":"2024-03-04T06:55:13.141294+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.141294+0000","last_undegraded":"2024-03-04T06:55:13.141294+0000","last_fullsized":"2024-03-04T06:55:13.141294+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:33.149241+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:56:33.149241+0000","last_peered":"2024-03-04T06:56:33.149241+0000","last_clean":"2024-03-04T06:56:33.149241+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:56:33.149241+0000","last_undegraded":"2024-03-04T06:56:33.149241+0000","last_fullsized":"2024-03-04T06:56:33.149241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375859+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:28.375859+0000","last_peered":"2024-03-04T06:55:28.375859+0000","last_clean":"2024-03-04T06:55:28.375859+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:28.375859+0000","last_undegraded":"2024-03-04T06:55:28.375859+0000","last_fullsized":"2024-03-04T06:55:28.375859+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4015,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:19.534498+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:56:19.534498+0000","last_peered":"2024-03-04T06:56:19.534498+0000","last_clean":"2024-03-04T06:56:19.534498+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:56:19.534498+0000","last_undegraded":"2024-03-04T06:56:19.534498+0000","last_fullsized":"2024-03-04T06:56:19.534498+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.217050+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:43.217050+0000","last_peered":"2024-03-04T06:55:43.217050+0000","last_clean":"2024-03-04T06:55:43.217050+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:43.217050+0000","last_undegraded":"2024-03-04T06:55:43.217050+0000","last_fullsized":"2024-03-04T06:55:43.217050+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.990790+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:56:04.990790+0000","last_peered":"2024-03-04T06:56:04.990790+0000","last_clean":"2024-03-04T06:56:04.990790+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:56:04.990790+0000","last_undegraded":"2024-03-04T06:56:04.990790+0000","last_fullsized":"2024-03-04T06:56:04.990790+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105228+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105228+0000","last_peered":"2024-03-04T06:55:13.105228+0000","last_clean":"2024-03-04T06:55:13.105228+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105228+0000","last_undegraded":"2024-03-04T06:55:13.105228+0000","last_fullsized":"2024-03-04T06:55:13.105228+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1550,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532802+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:56:04.532802+0000","last_peered":"2024-03-04T06:56:04.532802+0000","last_clean":"2024-03-04T06:56:04.532802+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:56:04.532802+0000","last_undegraded":"2024-03-04T06:56:04.532802+0000","last_fullsized":"2024-03-04T06:56:04.532802+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3950,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933655+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:22.933655+0000","last_peered":"2024-03-04T06:55:22.933655+0000","last_clean":"2024-03-04T06:55:22.933655+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:22.933655+0000","last_undegraded":"2024-03-04T06:55:22.933655+0000","last_fullsized":"2024-03-04T06:55:22.933655+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117375+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117375+0000","last_peered":"2024-03-04T06:55:13.117375+0000","last_clean":"2024-03-04T06:55:13.117375+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117375+0000","last_undegraded":"2024-03-04T06:55:13.117375+0000","last_fullsized":"2024-03-04T06:55:13.117375+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375833+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:28.375833+0000","last_peered":"2024-03-04T06:55:28.375833+0000","last_clean":"2024-03-04T06:55:28.375833+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:28.375833+0000","last_undegraded":"2024-03-04T06:55:28.375833+0000","last_fullsized":"2024-03-04T06:55:28.375833+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532768+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:56:04.532768+0000","last_peered":"2024-03-04T06:56:04.532768+0000","last_clean":"2024-03-04T06:56:04.532768+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:56:04.532768+0000","last_undegraded":"2024-03-04T06:56:04.532768+0000","last_fullsized":"2024-03-04T06:56:04.532768+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15291,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:43.217015+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:43.217015+0000","last_peered":"2024-03-04T06:55:43.217015+0000","last_clean":"2024-03-04T06:55:43.217015+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:43.217015+0000","last_undegraded":"2024-03-04T06:55:43.217015+0000","last_fullsized":"2024-03-04T06:55:43.217015+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992678+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:56:22.992678+0000","last_peered":"2024-03-04T06:56:22.992678+0000","last_clean":"2024-03-04T06:56:22.992678+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:56:22.992678+0000","last_undegraded":"2024-03-04T06:56:22.992678+0000","last_fullsized":"2024-03-04T06:56:22.992678+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534547+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:56:19.534547+0000","last_peered":"2024-03-04T06:56:19.534547+0000","last_clean":"2024-03-04T06:56:19.534547+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:56:19.534547+0000","last_undegraded":"2024-03-04T06:56:19.534547+0000","last_fullsized":"2024-03-04T06:56:19.534547+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116059+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116059+0000","last_peered":"2024-03-04T06:55:13.116059+0000","last_clean":"2024-03-04T06:55:13.116059+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116059+0000","last_undegraded":"2024-03-04T06:55:13.116059+0000","last_fullsized":"2024-03-04T06:55:13.116059+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4378,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.097496+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:55:13.097496+0000","last_peered":"2024-03-04T06:55:13.097496+0000","last_clean":"2024-03-04T06:55:13.097496+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:55:13.097496+0000","last_undegraded":"2024-03-04T06:55:13.097496+0000","last_fullsized":"2024-03-04T06:55:13.097496+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988300+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:44.988300+0000","last_peered":"2024-03-04T06:55:44.988300+0000","last_clean":"2024-03-04T06:55:44.988300+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:44.988300+0000","last_undegraded":"2024-03-04T06:55:44.988300+0000","last_fullsized":"2024-03-04T06:55:44.988300+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141284+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.141284+0000","last_peered":"2024-03-04T06:55:13.141284+0000","last_clean":"2024-03-04T06:55:13.141284+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.141284+0000","last_undegraded":"2024-03-04T06:55:13.141284+0000","last_fullsized":"2024-03-04T06:55:13.141284+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992884+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:56:24.992884+0000","last_peered":"2024-03-04T06:56:24.992884+0000","last_clean":"2024-03-04T06:56:24.992884+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:56:24.992884+0000","last_undegraded":"2024-03-04T06:56:24.992884+0000","last_fullsized":"2024-03-04T06:56:24.992884+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4609,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:44.988263+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:44.988263+0000","last_peered":"2024-03-04T06:55:44.988263+0000","last_clean":"2024-03-04T06:55:44.988263+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:44.988263+0000","last_undegraded":"2024-03-04T06:55:44.988263+0000","last_fullsized":"2024-03-04T06:55:44.988263+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095704+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:55:13.095704+0000","last_peered":"2024-03-04T06:55:13.095704+0000","last_clean":"2024-03-04T06:55:13.095704+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:55:13.095704+0000","last_undegraded":"2024-03-04T06:55:13.095704+0000","last_fullsized":"2024-03-04T06:55:13.095704+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1078,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218837+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:58.218837+0000","last_peered":"2024-03-04T06:55:58.218837+0000","last_clean":"2024-03-04T06:55:58.218837+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:58.218837+0000","last_undegraded":"2024-03-04T06:55:58.218837+0000","last_fullsized":"2024-03-04T06:55:58.218837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115644+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115644+0000","last_peered":"2024-03-04T06:55:13.115644+0000","last_clean":"2024-03-04T06:55:13.115644+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115644+0000","last_undegraded":"2024-03-04T06:55:13.115644+0000","last_fullsized":"2024-03-04T06:55:13.115644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4634,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:37.935758+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:37.935758+0000","last_peered":"2024-03-04T06:55:37.935758+0000","last_clean":"2024-03-04T06:55:37.935758+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:37.935758+0000","last_undegraded":"2024-03-04T06:55:37.935758+0000","last_fullsized":"2024-03-04T06:55:37.935758+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1056,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101972+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:55:13.101972+0000","last_peered":"2024-03-04T06:55:13.101972+0000","last_clean":"2024-03-04T06:55:13.101972+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:55:13.101972+0000","last_undegraded":"2024-03-04T06:55:13.101972+0000","last_fullsized":"2024-03-04T06:55:13.101972+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1184,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095689+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095689+0000","last_peered":"2024-03-04T06:55:13.095689+0000","last_clean":"2024-03-04T06:55:13.095689+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095689+0000","last_undegraded":"2024-03-04T06:55:13.095689+0000","last_fullsized":"2024-03-04T06:55:13.095689+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5157,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.113366+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.113366+0000","last_peered":"2024-03-04T06:55:13.113366+0000","last_clean":"2024-03-04T06:55:13.113366+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.113366+0000","last_undegraded":"2024-03-04T06:55:13.113366+0000","last_fullsized":"2024-03-04T06:55:13.113366+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141219+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.141219+0000","last_peered":"2024-03-04T06:55:13.141219+0000","last_clean":"2024-03-04T06:55:13.141219+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.141219+0000","last_undegraded":"2024-03-04T06:55:13.141219+0000","last_fullsized":"2024-03-04T06:55:13.141219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992810+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:56:24.992810+0000","last_peered":"2024-03-04T06:56:24.992810+0000","last_clean":"2024-03-04T06:56:24.992810+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:56:24.992810+0000","last_undegraded":"2024-03-04T06:56:24.992810+0000","last_fullsized":"2024-03-04T06:56:24.992810+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4719,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380021+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:56:08.380021+0000","last_peered":"2024-03-04T06:56:08.380021+0000","last_clean":"2024-03-04T06:56:08.380021+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:56:08.380021+0000","last_undegraded":"2024-03-04T06:56:08.380021+0000","last_fullsized":"2024-03-04T06:56:08.380021+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141246+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.141246+0000","last_peered":"2024-03-04T06:55:13.141246+0000","last_clean":"2024-03-04T06:55:13.141246+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.141246+0000","last_undegraded":"2024-03-04T06:55:13.141246+0000","last_fullsized":"2024-03-04T06:55:13.141246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098839+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098839+0000","last_peered":"2024-03-04T06:55:13.098839+0000","last_clean":"2024-03-04T06:55:13.098839+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098839+0000","last_undegraded":"2024-03-04T06:55:13.098839+0000","last_fullsized":"2024-03-04T06:55:13.098839+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5554,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:33.143474+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:33.143474+0000","last_peered":"2024-03-04T06:55:33.143474+0000","last_clean":"2024-03-04T06:55:33.143474+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:33.143474+0000","last_undegraded":"2024-03-04T06:55:33.143474+0000","last_fullsized":"2024-03-04T06:55:33.143474+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102401+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102401+0000","last_peered":"2024-03-04T06:55:13.102401+0000","last_clean":"2024-03-04T06:55:13.102401+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102401+0000","last_undegraded":"2024-03-04T06:55:13.102401+0000","last_fullsized":"2024-03-04T06:55:13.102401+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218784+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:58.218784+0000","last_peered":"2024-03-04T06:55:58.218784+0000","last_clean":"2024-03-04T06:55:58.218784+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:58.218784+0000","last_undegraded":"2024-03-04T06:55:58.218784+0000","last_fullsized":"2024-03-04T06:55:58.218784+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.379963+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:56:08.379963+0000","last_peered":"2024-03-04T06:56:08.379963+0000","last_clean":"2024-03-04T06:56:08.379963+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:56:08.379963+0000","last_undegraded":"2024-03-04T06:56:08.379963+0000","last_fullsized":"2024-03-04T06:56:08.379963+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380005+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:56:08.380005+0000","last_peered":"2024-03-04T06:56:08.380005+0000","last_clean":"2024-03-04T06:56:08.380005+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:56:08.380005+0000","last_undegraded":"2024-03-04T06:56:08.380005+0000","last_fullsized":"2024-03-04T06:56:08.380005+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102489+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102489+0000","last_peered":"2024-03-04T06:55:13.102489+0000","last_clean":"2024-03-04T06:55:13.102489+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102489+0000","last_undegraded":"2024-03-04T06:55:13.102489+0000","last_fullsized":"2024-03-04T06:55:13.102489+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4366,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377880+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:48.377880+0000","last_peered":"2024-03-04T06:55:48.377880+0000","last_clean":"2024-03-04T06:55:48.377880+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:48.377880+0000","last_undegraded":"2024-03-04T06:55:48.377880+0000","last_fullsized":"2024-03-04T06:55:48.377880+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:33.143531+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:33.143531+0000","last_peered":"2024-03-04T06:55:33.143531+0000","last_clean":"2024-03-04T06:55:33.143531+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:33.143531+0000","last_undegraded":"2024-03-04T06:55:33.143531+0000","last_fullsized":"2024-03-04T06:55:33.143531+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935733+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:37.935733+0000","last_peered":"2024-03-04T06:55:37.935733+0000","last_clean":"2024-03-04T06:55:37.935733+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:37.935733+0000","last_undegraded":"2024-03-04T06:55:37.935733+0000","last_fullsized":"2024-03-04T06:55:37.935733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4599,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.322375+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:55:13.322375+0000","last_peered":"2024-03-04T06:55:13.322375+0000","last_clean":"2024-03-04T06:55:13.322375+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:55:13.322375+0000","last_undegraded":"2024-03-04T06:55:13.322375+0000","last_fullsized":"2024-03-04T06:55:13.322375+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1245,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380055+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:56:08.380055+0000","last_peered":"2024-03-04T06:56:08.380055+0000","last_clean":"2024-03-04T06:56:08.380055+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:56:08.380055+0000","last_undegraded":"2024-03-04T06:56:08.380055+0000","last_fullsized":"2024-03-04T06:56:08.380055+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105586+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.105586+0000","last_peered":"2024-03-04T06:55:13.105586+0000","last_clean":"2024-03-04T06:55:13.105586+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.105586+0000","last_undegraded":"2024-03-04T06:55:13.105586+0000","last_fullsized":"2024-03-04T06:55:13.105586+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.216983+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:43.216983+0000","last_peered":"2024-03-04T06:55:43.216983+0000","last_clean":"2024-03-04T06:55:43.216983+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:43.216983+0000","last_undegraded":"2024-03-04T06:55:43.216983+0000","last_fullsized":"2024-03-04T06:55:43.216983+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375870+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:28.375870+0000","last_peered":"2024-03-04T06:55:28.375870+0000","last_clean":"2024-03-04T06:55:28.375870+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:28.375870+0000","last_undegraded":"2024-03-04T06:55:28.375870+0000","last_fullsized":"2024-03-04T06:55:28.375870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106053+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.106053+0000","last_peered":"2024-03-04T06:55:13.106053+0000","last_clean":"2024-03-04T06:55:13.106053+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.106053+0000","last_undegraded":"2024-03-04T06:55:13.106053+0000","last_fullsized":"2024-03-04T06:55:13.106053+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992636+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:56:22.992636+0000","last_peered":"2024-03-04T06:56:22.992636+0000","last_clean":"2024-03-04T06:56:22.992636+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:56:22.992636+0000","last_undegraded":"2024-03-04T06:56:22.992636+0000","last_fullsized":"2024-03-04T06:56:22.992636+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992858+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:56:24.992858+0000","last_peered":"2024-03-04T06:56:24.992858+0000","last_clean":"2024-03-04T06:56:24.992858+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:56:24.992858+0000","last_undegraded":"2024-03-04T06:56:24.992858+0000","last_fullsized":"2024-03-04T06:56:24.992858+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141268+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.141268+0000","last_peered":"2024-03-04T06:55:13.141268+0000","last_clean":"2024-03-04T06:55:13.141268+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.141268+0000","last_undegraded":"2024-03-04T06:55:13.141268+0000","last_fullsized":"2024-03-04T06:55:13.141268+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218825+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:58.218825+0000","last_peered":"2024-03-04T06:55:58.218825+0000","last_clean":"2024-03-04T06:55:58.218825+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:58.218825+0000","last_undegraded":"2024-03-04T06:55:58.218825+0000","last_fullsized":"2024-03-04T06:55:58.218825+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992900+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:56:24.992900+0000","last_peered":"2024-03-04T06:56:24.992900+0000","last_clean":"2024-03-04T06:56:24.992900+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:56:24.992900+0000","last_undegraded":"2024-03-04T06:56:24.992900+0000","last_fullsized":"2024-03-04T06:56:24.992900+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933591+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:22.933591+0000","last_peered":"2024-03-04T06:55:22.933591+0000","last_clean":"2024-03-04T06:55:22.933591+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:22.933591+0000","last_undegraded":"2024-03-04T06:55:22.933591+0000","last_fullsized":"2024-03-04T06:55:22.933591+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1120,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935684+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:37.935684+0000","last_peered":"2024-03-04T06:55:37.935684+0000","last_clean":"2024-03-04T06:55:37.935684+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:37.935684+0000","last_undegraded":"2024-03-04T06:55:37.935684+0000","last_fullsized":"2024-03-04T06:55:37.935684+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116911+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116911+0000","last_peered":"2024-03-04T06:55:13.116911+0000","last_clean":"2024-03-04T06:55:13.116911+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116911+0000","last_undegraded":"2024-03-04T06:55:13.116911+0000","last_fullsized":"2024-03-04T06:55:13.116911+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.220345+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:56:13.220345+0000","last_peered":"2024-03-04T06:56:13.220345+0000","last_clean":"2024-03-04T06:56:13.220345+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:56:13.220345+0000","last_undegraded":"2024-03-04T06:56:13.220345+0000","last_fullsized":"2024-03-04T06:56:13.220345+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503464,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648111,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142418,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287065,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997771,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885828,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937405,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792758,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:58:42.875 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:42.875 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:42.875 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:42.875 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:42.875 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:42.875 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:42.875 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:42.876 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:42.876 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:42.876 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:42.876 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:58:43.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:43 smithi137 ceph-mon[88869]: pgmap v1026: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:43.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:43 smithi137 ceph-mon[91314]: pgmap v1026: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:43.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:43 smithi203 ceph-mon[85573]: pgmap v1026: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:45.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:45 smithi137 ceph-mon[88869]: pgmap v1027: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:45.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:58:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:58:45] "GET /metrics HTTP/1.1" 200 36334 "" "Prometheus/2.43.0" 2024-03-04T06:58:45.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:45 smithi137 ceph-mon[91314]: pgmap v1027: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:45.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:45 smithi203 ceph-mon[85573]: pgmap v1027: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:47.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:47 smithi203 ceph-mon[85573]: pgmap v1028: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:48.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:47 smithi137 ceph-mon[88869]: pgmap v1028: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:48.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:47 smithi137 ceph-mon[91314]: pgmap v1028: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:49.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:49 smithi203 ceph-mon[85573]: pgmap v1029: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:50.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:49 smithi137 ceph-mon[88869]: pgmap v1029: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:50.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:49 smithi137 ceph-mon[91314]: pgmap v1029: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:51.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:51 smithi203 ceph-mon[85573]: pgmap v1030: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:52.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:51 smithi137 ceph-mon[88869]: pgmap v1030: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:52.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:51 smithi137 ceph-mon[91314]: pgmap v1030: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:52.877 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:58:53.102 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:58:53.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:53 smithi137 ceph-mon[88869]: pgmap v1031: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:53.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:53 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:58:53.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:53 smithi137 ceph-mon[91314]: pgmap v1031: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:53.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:53 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:58:53.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:53 smithi203 ceph-mon[85573]: pgmap v1031: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:53.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:53 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:58:54.853 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:58:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:58:55.513 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1032,"stamp":"2024-03-04T06:58:54.527488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003803"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534568+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:56:19.534568+0000","last_peered":"2024-03-04T06:56:19.534568+0000","last_clean":"2024-03-04T06:56:19.534568+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:56:19.534568+0000","last_undegraded":"2024-03-04T06:56:19.534568+0000","last_fullsized":"2024-03-04T06:56:19.534568+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1259,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117002+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:55:13.117002+0000","last_peered":"2024-03-04T06:55:13.117002+0000","last_clean":"2024-03-04T06:55:13.117002+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:55:13.117002+0000","last_undegraded":"2024-03-04T06:55:13.117002+0000","last_fullsized":"2024-03-04T06:55:13.117002+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992691+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:56:22.992691+0000","last_peered":"2024-03-04T06:56:22.992691+0000","last_clean":"2024-03-04T06:56:22.992691+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:56:22.992691+0000","last_undegraded":"2024-03-04T06:56:22.992691+0000","last_fullsized":"2024-03-04T06:56:22.992691+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:52.944862+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:56:52.944862+0000","last_peered":"2024-03-04T06:56:52.944862+0000","last_clean":"2024-03-04T06:56:52.944862+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:56:52.944862+0000","last_undegraded":"2024-03-04T06:56:52.944862+0000","last_fullsized":"2024-03-04T06:56:52.944862+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102005+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.102005+0000","last_peered":"2024-03-04T06:55:13.102005+0000","last_clean":"2024-03-04T06:55:13.102005+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.102005+0000","last_undegraded":"2024-03-04T06:55:13.102005+0000","last_fullsized":"2024-03-04T06:55:13.102005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941144+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:56:22.941144+0000","last_peered":"2024-03-04T06:56:22.941144+0000","last_clean":"2024-03-04T06:56:22.941144+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:56:22.941144+0000","last_undegraded":"2024-03-04T06:56:22.941144+0000","last_fullsized":"2024-03-04T06:56:22.941144+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101809+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101809+0000","last_peered":"2024-03-04T06:55:13.101809+0000","last_clean":"2024-03-04T06:55:13.101809+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101809+0000","last_undegraded":"2024-03-04T06:55:13.101809+0000","last_fullsized":"2024-03-04T06:55:13.101809+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984614+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:14.984614+0000","last_peered":"2024-03-04T06:55:14.984614+0000","last_clean":"2024-03-04T06:55:14.984614+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:14.984614+0000","last_undegraded":"2024-03-04T06:55:14.984614+0000","last_fullsized":"2024-03-04T06:55:14.984614+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1064,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103046+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.103046+0000","last_peered":"2024-03-04T06:55:13.103046+0000","last_clean":"2024-03-04T06:55:13.103046+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.103046+0000","last_undegraded":"2024-03-04T06:55:13.103046+0000","last_fullsized":"2024-03-04T06:55:13.103046+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115007+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.115007+0000","last_peered":"2024-03-04T06:55:13.115007+0000","last_clean":"2024-03-04T06:55:13.115007+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.115007+0000","last_undegraded":"2024-03-04T06:55:13.115007+0000","last_fullsized":"2024-03-04T06:55:13.115007+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114852+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114852+0000","last_peered":"2024-03-04T06:55:13.114852+0000","last_clean":"2024-03-04T06:55:13.114852+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114852+0000","last_undegraded":"2024-03-04T06:55:13.114852+0000","last_fullsized":"2024-03-04T06:55:13.114852+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:32.604419+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:32.604419+0000","last_peered":"2024-03-04T06:55:32.604419+0000","last_clean":"2024-03-04T06:55:32.604419+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:32.604419+0000","last_undegraded":"2024-03-04T06:55:32.604419+0000","last_fullsized":"2024-03-04T06:55:32.604419+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.099013+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.099013+0000","last_peered":"2024-03-04T06:55:13.099013+0000","last_clean":"2024-03-04T06:55:13.099013+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.099013+0000","last_undegraded":"2024-03-04T06:55:13.099013+0000","last_fullsized":"2024-03-04T06:55:13.099013+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985446+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:17.985446+0000","last_peered":"2024-03-04T06:55:17.985446+0000","last_clean":"2024-03-04T06:55:17.985446+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:17.985446+0000","last_undegraded":"2024-03-04T06:55:17.985446+0000","last_fullsized":"2024-03-04T06:55:17.985446+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:53.145282+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:53.145282+0000","last_peered":"2024-03-04T06:55:53.145282+0000","last_clean":"2024-03-04T06:55:53.145282+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:53.145282+0000","last_undegraded":"2024-03-04T06:55:53.145282+0000","last_fullsized":"2024-03-04T06:55:53.145282+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937387+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:52.937387+0000","last_peered":"2024-03-04T06:55:52.937387+0000","last_clean":"2024-03-04T06:55:52.937387+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:52.937387+0000","last_undegraded":"2024-03-04T06:55:52.937387+0000","last_fullsized":"2024-03-04T06:55:52.937387+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937465+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:52.937465+0000","last_peered":"2024-03-04T06:55:52.937465+0000","last_clean":"2024-03-04T06:55:52.937465+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:52.937465+0000","last_undegraded":"2024-03-04T06:55:52.937465+0000","last_fullsized":"2024-03-04T06:55:52.937465+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382095+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:56:28.382095+0000","last_peered":"2024-03-04T06:56:28.382095+0000","last_clean":"2024-03-04T06:56:28.382095+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:56:28.382095+0000","last_undegraded":"2024-03-04T06:56:28.382095+0000","last_fullsized":"2024-03-04T06:56:28.382095+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102303+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:55:13.102303+0000","last_peered":"2024-03-04T06:55:13.102303+0000","last_clean":"2024-03-04T06:55:13.102303+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:55:13.102303+0000","last_undegraded":"2024-03-04T06:55:13.102303+0000","last_fullsized":"2024-03-04T06:55:13.102303+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1305,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992748+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:56:22.992748+0000","last_peered":"2024-03-04T06:56:22.992748+0000","last_clean":"2024-03-04T06:56:22.992748+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:56:22.992748+0000","last_undegraded":"2024-03-04T06:56:22.992748+0000","last_fullsized":"2024-03-04T06:56:22.992748+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988343+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:44.988343+0000","last_peered":"2024-03-04T06:55:44.988343+0000","last_clean":"2024-03-04T06:55:44.988343+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:44.988343+0000","last_undegraded":"2024-03-04T06:55:44.988343+0000","last_fullsized":"2024-03-04T06:55:44.988343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988353+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:44.988353+0000","last_peered":"2024-03-04T06:55:44.988353+0000","last_clean":"2024-03-04T06:55:44.988353+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:44.988353+0000","last_undegraded":"2024-03-04T06:55:44.988353+0000","last_fullsized":"2024-03-04T06:55:44.988353+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992731+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:56:22.992731+0000","last_peered":"2024-03-04T06:56:22.992731+0000","last_clean":"2024-03-04T06:56:22.992731+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:56:22.992731+0000","last_undegraded":"2024-03-04T06:56:22.992731+0000","last_fullsized":"2024-03-04T06:56:22.992731+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1234,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098569+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098569+0000","last_peered":"2024-03-04T06:55:13.098569+0000","last_clean":"2024-03-04T06:55:13.098569+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098569+0000","last_undegraded":"2024-03-04T06:55:13.098569+0000","last_fullsized":"2024-03-04T06:55:13.098569+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1221,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097506+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097506+0000","last_peered":"2024-03-04T06:55:13.097506+0000","last_clean":"2024-03-04T06:55:13.097506+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097506+0000","last_undegraded":"2024-03-04T06:55:13.097506+0000","last_fullsized":"2024-03-04T06:55:13.097506+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102499+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102499+0000","last_peered":"2024-03-04T06:55:13.102499+0000","last_clean":"2024-03-04T06:55:13.102499+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102499+0000","last_undegraded":"2024-03-04T06:55:13.102499+0000","last_fullsized":"2024-03-04T06:55:13.102499+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941175+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:56:22.941175+0000","last_peered":"2024-03-04T06:56:22.941175+0000","last_clean":"2024-03-04T06:56:22.941175+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:56:22.941175+0000","last_undegraded":"2024-03-04T06:56:22.941175+0000","last_fullsized":"2024-03-04T06:56:22.941175+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984673+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:14.984673+0000","last_peered":"2024-03-04T06:55:14.984673+0000","last_clean":"2024-03-04T06:55:14.984673+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:14.984673+0000","last_undegraded":"2024-03-04T06:55:14.984673+0000","last_fullsized":"2024-03-04T06:55:14.984673+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1189,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:47.606038+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:47.606038+0000","last_peered":"2024-03-04T06:55:47.606038+0000","last_clean":"2024-03-04T06:55:47.606038+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:47.606038+0000","last_undegraded":"2024-03-04T06:55:47.606038+0000","last_fullsized":"2024-03-04T06:55:47.606038+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114709+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114709+0000","last_peered":"2024-03-04T06:55:13.114709+0000","last_clean":"2024-03-04T06:55:13.114709+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114709+0000","last_undegraded":"2024-03-04T06:55:13.114709+0000","last_fullsized":"2024-03-04T06:55:13.114709+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:57.989954+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:57.989954+0000","last_peered":"2024-03-04T06:55:57.989954+0000","last_clean":"2024-03-04T06:55:57.989954+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:57.989954+0000","last_undegraded":"2024-03-04T06:55:57.989954+0000","last_fullsized":"2024-03-04T06:55:57.989954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096734+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096734+0000","last_peered":"2024-03-04T06:55:13.096734+0000","last_clean":"2024-03-04T06:55:13.096734+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096734+0000","last_undegraded":"2024-03-04T06:55:13.096734+0000","last_fullsized":"2024-03-04T06:55:13.096734+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097225+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097225+0000","last_peered":"2024-03-04T06:55:13.097225+0000","last_clean":"2024-03-04T06:55:13.097225+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097225+0000","last_undegraded":"2024-03-04T06:55:13.097225+0000","last_fullsized":"2024-03-04T06:55:13.097225+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939306+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:56:07.939306+0000","last_peered":"2024-03-04T06:56:07.939306+0000","last_clean":"2024-03-04T06:56:07.939306+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:56:07.939306+0000","last_undegraded":"2024-03-04T06:56:07.939306+0000","last_fullsized":"2024-03-04T06:56:07.939306+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147156+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:56:13.147156+0000","last_peered":"2024-03-04T06:56:13.147156+0000","last_clean":"2024-03-04T06:56:13.147156+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:56:13.147156+0000","last_undegraded":"2024-03-04T06:56:13.147156+0000","last_fullsized":"2024-03-04T06:56:13.147156+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115145+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115145+0000","last_peered":"2024-03-04T06:55:13.115145+0000","last_clean":"2024-03-04T06:55:13.115145+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115145+0000","last_undegraded":"2024-03-04T06:55:13.115145+0000","last_fullsized":"2024-03-04T06:55:13.115145+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939379+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:56:07.939379+0000","last_peered":"2024-03-04T06:56:07.939379+0000","last_clean":"2024-03-04T06:56:07.939379+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:56:07.939379+0000","last_undegraded":"2024-03-04T06:56:07.939379+0000","last_fullsized":"2024-03-04T06:56:07.939379+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939364+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:56:07.939364+0000","last_peered":"2024-03-04T06:56:07.939364+0000","last_clean":"2024-03-04T06:56:07.939364+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:56:07.939364+0000","last_undegraded":"2024-03-04T06:56:07.939364+0000","last_fullsized":"2024-03-04T06:56:07.939364+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.988031+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:37.988031+0000","last_peered":"2024-03-04T06:55:37.988031+0000","last_clean":"2024-03-04T06:55:37.988031+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:37.988031+0000","last_undegraded":"2024-03-04T06:55:37.988031+0000","last_fullsized":"2024-03-04T06:55:37.988031+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147207+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:56:13.147207+0000","last_peered":"2024-03-04T06:56:13.147207+0000","last_clean":"2024-03-04T06:56:13.147207+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:56:13.147207+0000","last_undegraded":"2024-03-04T06:56:13.147207+0000","last_fullsized":"2024-03-04T06:56:13.147207+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.602395+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:17.602395+0000","last_peered":"2024-03-04T06:55:17.602395+0000","last_clean":"2024-03-04T06:55:17.602395+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:17.602395+0000","last_undegraded":"2024-03-04T06:55:17.602395+0000","last_fullsized":"2024-03-04T06:55:17.602395+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1130,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221797+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:56:28.221797+0000","last_peered":"2024-03-04T06:56:28.221797+0000","last_clean":"2024-03-04T06:56:28.221797+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:56:28.221797+0000","last_undegraded":"2024-03-04T06:56:28.221797+0000","last_fullsized":"2024-03-04T06:56:28.221797+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102665+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102665+0000","last_peered":"2024-03-04T06:55:13.102665+0000","last_clean":"2024-03-04T06:55:13.102665+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102665+0000","last_undegraded":"2024-03-04T06:55:13.102665+0000","last_fullsized":"2024-03-04T06:55:13.102665+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1302,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985489+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:17.985489+0000","last_peered":"2024-03-04T06:55:17.985489+0000","last_clean":"2024-03-04T06:55:17.985489+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:17.985489+0000","last_undegraded":"2024-03-04T06:55:17.985489+0000","last_fullsized":"2024-03-04T06:55:17.985489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382052+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:56:28.382052+0000","last_peered":"2024-03-04T06:56:28.382052+0000","last_clean":"2024-03-04T06:56:28.382052+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:56:28.382052+0000","last_undegraded":"2024-03-04T06:56:28.382052+0000","last_fullsized":"2024-03-04T06:56:28.382052+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937420+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:52.937420+0000","last_peered":"2024-03-04T06:55:52.937420+0000","last_clean":"2024-03-04T06:55:52.937420+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:52.937420+0000","last_undegraded":"2024-03-04T06:55:52.937420+0000","last_fullsized":"2024-03-04T06:55:52.937420+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102561+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102561+0000","last_peered":"2024-03-04T06:55:13.102561+0000","last_clean":"2024-03-04T06:55:13.102561+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102561+0000","last_undegraded":"2024-03-04T06:55:13.102561+0000","last_fullsized":"2024-03-04T06:55:13.102561+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221752+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:56:28.221752+0000","last_peered":"2024-03-04T06:56:28.221752+0000","last_clean":"2024-03-04T06:56:28.221752+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:56:28.221752+0000","last_undegraded":"2024-03-04T06:56:28.221752+0000","last_fullsized":"2024-03-04T06:56:28.221752+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221703+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:56:28.221703+0000","last_peered":"2024-03-04T06:56:28.221703+0000","last_clean":"2024-03-04T06:56:28.221703+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:56:28.221703+0000","last_undegraded":"2024-03-04T06:56:28.221703+0000","last_fullsized":"2024-03-04T06:56:28.221703+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1253,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382011+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:56:28.382011+0000","last_peered":"2024-03-04T06:56:28.382011+0000","last_clean":"2024-03-04T06:56:28.382011+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:56:28.382011+0000","last_undegraded":"2024-03-04T06:56:28.382011+0000","last_fullsized":"2024-03-04T06:56:28.382011+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101837+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101837+0000","last_peered":"2024-03-04T06:55:13.101837+0000","last_clean":"2024-03-04T06:55:13.101837+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101837+0000","last_undegraded":"2024-03-04T06:55:13.101837+0000","last_fullsized":"2024-03-04T06:55:13.101837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3577,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377824+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:48.377824+0000","last_peered":"2024-03-04T06:55:48.377824+0000","last_clean":"2024-03-04T06:55:48.377824+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:48.377824+0000","last_undegraded":"2024-03-04T06:55:48.377824+0000","last_fullsized":"2024-03-04T06:55:48.377824+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096992+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096992+0000","last_peered":"2024-03-04T06:55:13.096992+0000","last_clean":"2024-03-04T06:55:13.096992+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096992+0000","last_undegraded":"2024-03-04T06:55:13.096992+0000","last_fullsized":"2024-03-04T06:55:13.096992+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102943+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:55:13.102943+0000","last_peered":"2024-03-04T06:55:13.102943+0000","last_clean":"2024-03-04T06:55:13.102943+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:55:13.102943+0000","last_undegraded":"2024-03-04T06:55:13.102943+0000","last_fullsized":"2024-03-04T06:55:13.102943+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17116,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992661+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:56:22.992661+0000","last_peered":"2024-03-04T06:56:22.992661+0000","last_clean":"2024-03-04T06:56:22.992661+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:56:22.992661+0000","last_undegraded":"2024-03-04T06:56:22.992661+0000","last_fullsized":"2024-03-04T06:56:22.992661+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115088+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:55:13.115088+0000","last_peered":"2024-03-04T06:55:13.115088+0000","last_clean":"2024-03-04T06:55:13.115088+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:55:13.115088+0000","last_undegraded":"2024-03-04T06:55:13.115088+0000","last_fullsized":"2024-03-04T06:55:13.115088+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116699+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:55:13.116699+0000","last_peered":"2024-03-04T06:55:13.116699+0000","last_clean":"2024-03-04T06:55:13.116699+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:55:13.116699+0000","last_undegraded":"2024-03-04T06:55:13.116699+0000","last_fullsized":"2024-03-04T06:55:13.116699+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106020+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.106020+0000","last_peered":"2024-03-04T06:55:13.106020+0000","last_clean":"2024-03-04T06:55:13.106020+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.106020+0000","last_undegraded":"2024-03-04T06:55:13.106020+0000","last_fullsized":"2024-03-04T06:55:13.106020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4386,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992700+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:56:22.992700+0000","last_peered":"2024-03-04T06:56:22.992700+0000","last_clean":"2024-03-04T06:56:22.992700+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:56:22.992700+0000","last_undegraded":"2024-03-04T06:56:22.992700+0000","last_fullsized":"2024-03-04T06:56:22.992700+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115964+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:55:13.115964+0000","last_peered":"2024-03-04T06:55:13.115964+0000","last_clean":"2024-03-04T06:55:13.115964+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:55:13.115964+0000","last_undegraded":"2024-03-04T06:55:13.115964+0000","last_fullsized":"2024-03-04T06:55:13.115964+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105737+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105737+0000","last_peered":"2024-03-04T06:55:13.105737+0000","last_clean":"2024-03-04T06:55:13.105737+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105737+0000","last_undegraded":"2024-03-04T06:55:13.105737+0000","last_fullsized":"2024-03-04T06:55:13.105737+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611663+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:56:37.611663+0000","last_peered":"2024-03-04T06:56:37.611663+0000","last_clean":"2024-03-04T06:56:37.611663+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:56:37.611663+0000","last_undegraded":"2024-03-04T06:56:37.611663+0000","last_fullsized":"2024-03-04T06:56:37.611663+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5639,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377937+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:48.377937+0000","last_peered":"2024-03-04T06:55:48.377937+0000","last_clean":"2024-03-04T06:55:48.377937+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:48.377937+0000","last_undegraded":"2024-03-04T06:55:48.377937+0000","last_fullsized":"2024-03-04T06:55:48.377937+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141294+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.141294+0000","last_peered":"2024-03-04T06:55:13.141294+0000","last_clean":"2024-03-04T06:55:13.141294+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.141294+0000","last_undegraded":"2024-03-04T06:55:13.141294+0000","last_fullsized":"2024-03-04T06:55:13.141294+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:33.149241+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:56:33.149241+0000","last_peered":"2024-03-04T06:56:33.149241+0000","last_clean":"2024-03-04T06:56:33.149241+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:56:33.149241+0000","last_undegraded":"2024-03-04T06:56:33.149241+0000","last_fullsized":"2024-03-04T06:56:33.149241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375859+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:28.375859+0000","last_peered":"2024-03-04T06:55:28.375859+0000","last_clean":"2024-03-04T06:55:28.375859+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:28.375859+0000","last_undegraded":"2024-03-04T06:55:28.375859+0000","last_fullsized":"2024-03-04T06:55:28.375859+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4015,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:19.534498+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:56:19.534498+0000","last_peered":"2024-03-04T06:56:19.534498+0000","last_clean":"2024-03-04T06:56:19.534498+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:56:19.534498+0000","last_undegraded":"2024-03-04T06:56:19.534498+0000","last_fullsized":"2024-03-04T06:56:19.534498+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.217050+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:43.217050+0000","last_peered":"2024-03-04T06:55:43.217050+0000","last_clean":"2024-03-04T06:55:43.217050+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:43.217050+0000","last_undegraded":"2024-03-04T06:55:43.217050+0000","last_fullsized":"2024-03-04T06:55:43.217050+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.990790+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:56:04.990790+0000","last_peered":"2024-03-04T06:56:04.990790+0000","last_clean":"2024-03-04T06:56:04.990790+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:56:04.990790+0000","last_undegraded":"2024-03-04T06:56:04.990790+0000","last_fullsized":"2024-03-04T06:56:04.990790+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105228+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105228+0000","last_peered":"2024-03-04T06:55:13.105228+0000","last_clean":"2024-03-04T06:55:13.105228+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105228+0000","last_undegraded":"2024-03-04T06:55:13.105228+0000","last_fullsized":"2024-03-04T06:55:13.105228+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1550,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532802+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:56:04.532802+0000","last_peered":"2024-03-04T06:56:04.532802+0000","last_clean":"2024-03-04T06:56:04.532802+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:56:04.532802+0000","last_undegraded":"2024-03-04T06:56:04.532802+0000","last_fullsized":"2024-03-04T06:56:04.532802+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3950,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933655+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:22.933655+0000","last_peered":"2024-03-04T06:55:22.933655+0000","last_clean":"2024-03-04T06:55:22.933655+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:22.933655+0000","last_undegraded":"2024-03-04T06:55:22.933655+0000","last_fullsized":"2024-03-04T06:55:22.933655+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.117375+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:55:13.117375+0000","last_peered":"2024-03-04T06:55:13.117375+0000","last_clean":"2024-03-04T06:55:13.117375+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:55:13.117375+0000","last_undegraded":"2024-03-04T06:55:13.117375+0000","last_fullsized":"2024-03-04T06:55:13.117375+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375833+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:28.375833+0000","last_peered":"2024-03-04T06:55:28.375833+0000","last_clean":"2024-03-04T06:55:28.375833+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:28.375833+0000","last_undegraded":"2024-03-04T06:55:28.375833+0000","last_fullsized":"2024-03-04T06:55:28.375833+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532768+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:56:04.532768+0000","last_peered":"2024-03-04T06:56:04.532768+0000","last_clean":"2024-03-04T06:56:04.532768+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:56:04.532768+0000","last_undegraded":"2024-03-04T06:56:04.532768+0000","last_fullsized":"2024-03-04T06:56:04.532768+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15291,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:43.217015+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:43.217015+0000","last_peered":"2024-03-04T06:55:43.217015+0000","last_clean":"2024-03-04T06:55:43.217015+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:43.217015+0000","last_undegraded":"2024-03-04T06:55:43.217015+0000","last_fullsized":"2024-03-04T06:55:43.217015+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992678+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:56:22.992678+0000","last_peered":"2024-03-04T06:56:22.992678+0000","last_clean":"2024-03-04T06:56:22.992678+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:56:22.992678+0000","last_undegraded":"2024-03-04T06:56:22.992678+0000","last_fullsized":"2024-03-04T06:56:22.992678+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534547+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:56:19.534547+0000","last_peered":"2024-03-04T06:56:19.534547+0000","last_clean":"2024-03-04T06:56:19.534547+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:56:19.534547+0000","last_undegraded":"2024-03-04T06:56:19.534547+0000","last_fullsized":"2024-03-04T06:56:19.534547+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116059+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:55:13.116059+0000","last_peered":"2024-03-04T06:55:13.116059+0000","last_clean":"2024-03-04T06:55:13.116059+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:55:13.116059+0000","last_undegraded":"2024-03-04T06:55:13.116059+0000","last_fullsized":"2024-03-04T06:55:13.116059+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4379,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:37.611623+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:56:37.611623+0000","last_peered":"2024-03-04T06:56:37.611623+0000","last_clean":"2024-03-04T06:56:37.611623+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:56:37.611623+0000","last_undegraded":"2024-03-04T06:56:37.611623+0000","last_fullsized":"2024-03-04T06:56:37.611623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988300+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:44.988300+0000","last_peered":"2024-03-04T06:55:44.988300+0000","last_clean":"2024-03-04T06:55:44.988300+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:44.988300+0000","last_undegraded":"2024-03-04T06:55:44.988300+0000","last_fullsized":"2024-03-04T06:55:44.988300+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141284+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.141284+0000","last_peered":"2024-03-04T06:55:13.141284+0000","last_clean":"2024-03-04T06:55:13.141284+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.141284+0000","last_undegraded":"2024-03-04T06:55:13.141284+0000","last_fullsized":"2024-03-04T06:55:13.141284+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992884+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:56:24.992884+0000","last_peered":"2024-03-04T06:56:24.992884+0000","last_clean":"2024-03-04T06:56:24.992884+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:56:24.992884+0000","last_undegraded":"2024-03-04T06:56:24.992884+0000","last_fullsized":"2024-03-04T06:56:24.992884+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4609,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:44.988263+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:44.988263+0000","last_peered":"2024-03-04T06:55:44.988263+0000","last_clean":"2024-03-04T06:55:44.988263+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:44.988263+0000","last_undegraded":"2024-03-04T06:55:44.988263+0000","last_fullsized":"2024-03-04T06:55:44.988263+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611593+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:56:37.611593+0000","last_peered":"2024-03-04T06:56:37.611593+0000","last_clean":"2024-03-04T06:56:37.611593+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:56:37.611593+0000","last_undegraded":"2024-03-04T06:56:37.611593+0000","last_fullsized":"2024-03-04T06:56:37.611593+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1078,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218837+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:58.218837+0000","last_peered":"2024-03-04T06:55:58.218837+0000","last_clean":"2024-03-04T06:55:58.218837+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:58.218837+0000","last_undegraded":"2024-03-04T06:55:58.218837+0000","last_fullsized":"2024-03-04T06:55:58.218837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115644+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:55:13.115644+0000","last_peered":"2024-03-04T06:55:13.115644+0000","last_clean":"2024-03-04T06:55:13.115644+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:55:13.115644+0000","last_undegraded":"2024-03-04T06:55:13.115644+0000","last_fullsized":"2024-03-04T06:55:13.115644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4634,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:37.935758+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:37.935758+0000","last_peered":"2024-03-04T06:55:37.935758+0000","last_clean":"2024-03-04T06:55:37.935758+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:37.935758+0000","last_undegraded":"2024-03-04T06:55:37.935758+0000","last_fullsized":"2024-03-04T06:55:37.935758+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:34.536591+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:56:34.536591+0000","last_peered":"2024-03-04T06:56:34.536591+0000","last_clean":"2024-03-04T06:56:34.536591+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:56:34.536591+0000","last_undegraded":"2024-03-04T06:56:34.536591+0000","last_fullsized":"2024-03-04T06:56:34.536591+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1184,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095689+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095689+0000","last_peered":"2024-03-04T06:55:13.095689+0000","last_clean":"2024-03-04T06:55:13.095689+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095689+0000","last_undegraded":"2024-03-04T06:55:13.095689+0000","last_fullsized":"2024-03-04T06:55:13.095689+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5157,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.113366+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.113366+0000","last_peered":"2024-03-04T06:55:13.113366+0000","last_clean":"2024-03-04T06:55:13.113366+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.113366+0000","last_undegraded":"2024-03-04T06:55:13.113366+0000","last_fullsized":"2024-03-04T06:55:13.113366+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141219+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.141219+0000","last_peered":"2024-03-04T06:55:13.141219+0000","last_clean":"2024-03-04T06:55:13.141219+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.141219+0000","last_undegraded":"2024-03-04T06:55:13.141219+0000","last_fullsized":"2024-03-04T06:55:13.141219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992810+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:56:24.992810+0000","last_peered":"2024-03-04T06:56:24.992810+0000","last_clean":"2024-03-04T06:56:24.992810+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:56:24.992810+0000","last_undegraded":"2024-03-04T06:56:24.992810+0000","last_fullsized":"2024-03-04T06:56:24.992810+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4719,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380021+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:56:08.380021+0000","last_peered":"2024-03-04T06:56:08.380021+0000","last_clean":"2024-03-04T06:56:08.380021+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:56:08.380021+0000","last_undegraded":"2024-03-04T06:56:08.380021+0000","last_fullsized":"2024-03-04T06:56:08.380021+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141246+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.141246+0000","last_peered":"2024-03-04T06:55:13.141246+0000","last_clean":"2024-03-04T06:55:13.141246+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.141246+0000","last_undegraded":"2024-03-04T06:55:13.141246+0000","last_fullsized":"2024-03-04T06:55:13.141246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098839+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:55:13.098839+0000","last_peered":"2024-03-04T06:55:13.098839+0000","last_clean":"2024-03-04T06:55:13.098839+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:55:13.098839+0000","last_undegraded":"2024-03-04T06:55:13.098839+0000","last_fullsized":"2024-03-04T06:55:13.098839+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5554,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:33.143474+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:33.143474+0000","last_peered":"2024-03-04T06:55:33.143474+0000","last_clean":"2024-03-04T06:55:33.143474+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:33.143474+0000","last_undegraded":"2024-03-04T06:55:33.143474+0000","last_fullsized":"2024-03-04T06:55:33.143474+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102401+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:55:13.102401+0000","last_peered":"2024-03-04T06:55:13.102401+0000","last_clean":"2024-03-04T06:55:13.102401+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:55:13.102401+0000","last_undegraded":"2024-03-04T06:55:13.102401+0000","last_fullsized":"2024-03-04T06:55:13.102401+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218784+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:58.218784+0000","last_peered":"2024-03-04T06:55:58.218784+0000","last_clean":"2024-03-04T06:55:58.218784+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:58.218784+0000","last_undegraded":"2024-03-04T06:55:58.218784+0000","last_fullsized":"2024-03-04T06:55:58.218784+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.379963+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:56:08.379963+0000","last_peered":"2024-03-04T06:56:08.379963+0000","last_clean":"2024-03-04T06:56:08.379963+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:56:08.379963+0000","last_undegraded":"2024-03-04T06:56:08.379963+0000","last_fullsized":"2024-03-04T06:56:08.379963+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380005+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:56:08.380005+0000","last_peered":"2024-03-04T06:56:08.380005+0000","last_clean":"2024-03-04T06:56:08.380005+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:56:08.380005+0000","last_undegraded":"2024-03-04T06:56:08.380005+0000","last_fullsized":"2024-03-04T06:56:08.380005+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102489+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:55:13.102489+0000","last_peered":"2024-03-04T06:55:13.102489+0000","last_clean":"2024-03-04T06:55:13.102489+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:55:13.102489+0000","last_undegraded":"2024-03-04T06:55:13.102489+0000","last_fullsized":"2024-03-04T06:55:13.102489+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4366,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377880+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:48.377880+0000","last_peered":"2024-03-04T06:55:48.377880+0000","last_clean":"2024-03-04T06:55:48.377880+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:48.377880+0000","last_undegraded":"2024-03-04T06:55:48.377880+0000","last_fullsized":"2024-03-04T06:55:48.377880+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:33.143531+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:33.143531+0000","last_peered":"2024-03-04T06:55:33.143531+0000","last_clean":"2024-03-04T06:55:33.143531+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:33.143531+0000","last_undegraded":"2024-03-04T06:55:33.143531+0000","last_fullsized":"2024-03-04T06:55:33.143531+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935733+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:37.935733+0000","last_peered":"2024-03-04T06:55:37.935733+0000","last_clean":"2024-03-04T06:55:37.935733+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:37.935733+0000","last_undegraded":"2024-03-04T06:55:37.935733+0000","last_fullsized":"2024-03-04T06:55:37.935733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4600,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:34.536621+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:56:34.536621+0000","last_peered":"2024-03-04T06:56:34.536621+0000","last_clean":"2024-03-04T06:56:34.536621+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:56:34.536621+0000","last_undegraded":"2024-03-04T06:56:34.536621+0000","last_fullsized":"2024-03-04T06:56:34.536621+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1245,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380055+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:56:08.380055+0000","last_peered":"2024-03-04T06:56:08.380055+0000","last_clean":"2024-03-04T06:56:08.380055+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:56:08.380055+0000","last_undegraded":"2024-03-04T06:56:08.380055+0000","last_fullsized":"2024-03-04T06:56:08.380055+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105586+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:55:13.105586+0000","last_peered":"2024-03-04T06:55:13.105586+0000","last_clean":"2024-03-04T06:55:13.105586+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:55:13.105586+0000","last_undegraded":"2024-03-04T06:55:13.105586+0000","last_fullsized":"2024-03-04T06:55:13.105586+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.216983+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:43.216983+0000","last_peered":"2024-03-04T06:55:43.216983+0000","last_clean":"2024-03-04T06:55:43.216983+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:43.216983+0000","last_undegraded":"2024-03-04T06:55:43.216983+0000","last_fullsized":"2024-03-04T06:55:43.216983+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375870+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:28.375870+0000","last_peered":"2024-03-04T06:55:28.375870+0000","last_clean":"2024-03-04T06:55:28.375870+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:28.375870+0000","last_undegraded":"2024-03-04T06:55:28.375870+0000","last_fullsized":"2024-03-04T06:55:28.375870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106053+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.106053+0000","last_peered":"2024-03-04T06:55:13.106053+0000","last_clean":"2024-03-04T06:55:13.106053+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.106053+0000","last_undegraded":"2024-03-04T06:55:13.106053+0000","last_fullsized":"2024-03-04T06:55:13.106053+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992636+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:56:22.992636+0000","last_peered":"2024-03-04T06:56:22.992636+0000","last_clean":"2024-03-04T06:56:22.992636+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:56:22.992636+0000","last_undegraded":"2024-03-04T06:56:22.992636+0000","last_fullsized":"2024-03-04T06:56:22.992636+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992858+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:56:24.992858+0000","last_peered":"2024-03-04T06:56:24.992858+0000","last_clean":"2024-03-04T06:56:24.992858+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:56:24.992858+0000","last_undegraded":"2024-03-04T06:56:24.992858+0000","last_fullsized":"2024-03-04T06:56:24.992858+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141268+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.141268+0000","last_peered":"2024-03-04T06:55:13.141268+0000","last_clean":"2024-03-04T06:55:13.141268+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.141268+0000","last_undegraded":"2024-03-04T06:55:13.141268+0000","last_fullsized":"2024-03-04T06:55:13.141268+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218825+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:58.218825+0000","last_peered":"2024-03-04T06:55:58.218825+0000","last_clean":"2024-03-04T06:55:58.218825+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:58.218825+0000","last_undegraded":"2024-03-04T06:55:58.218825+0000","last_fullsized":"2024-03-04T06:55:58.218825+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992900+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:56:24.992900+0000","last_peered":"2024-03-04T06:56:24.992900+0000","last_clean":"2024-03-04T06:56:24.992900+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:56:24.992900+0000","last_undegraded":"2024-03-04T06:56:24.992900+0000","last_fullsized":"2024-03-04T06:56:24.992900+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933591+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:22.933591+0000","last_peered":"2024-03-04T06:55:22.933591+0000","last_clean":"2024-03-04T06:55:22.933591+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:22.933591+0000","last_undegraded":"2024-03-04T06:55:22.933591+0000","last_fullsized":"2024-03-04T06:55:22.933591+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096613+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:55:13.096613+0000","last_peered":"2024-03-04T06:55:13.096613+0000","last_clean":"2024-03-04T06:55:13.096613+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:55:13.096613+0000","last_undegraded":"2024-03-04T06:55:13.096613+0000","last_fullsized":"2024-03-04T06:55:13.096613+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1120,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935684+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:37.935684+0000","last_peered":"2024-03-04T06:55:37.935684+0000","last_clean":"2024-03-04T06:55:37.935684+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:37.935684+0000","last_undegraded":"2024-03-04T06:55:37.935684+0000","last_fullsized":"2024-03-04T06:55:37.935684+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116911+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116911+0000","last_peered":"2024-03-04T06:55:13.116911+0000","last_clean":"2024-03-04T06:55:13.116911+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116911+0000","last_undegraded":"2024-03-04T06:55:13.116911+0000","last_fullsized":"2024-03-04T06:55:13.116911+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.220345+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:56:13.220345+0000","last_peered":"2024-03-04T06:56:13.220345+0000","last_clean":"2024-03-04T06:56:13.220345+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:56:13.220345+0000","last_undegraded":"2024-03-04T06:56:13.220345+0000","last_fullsized":"2024-03-04T06:56:13.220345+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503466,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648114,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142421,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287068,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997774,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885830,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937408,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792761,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:58:55.517 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:55.517 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:55.517 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:55.518 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:55.518 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:55.518 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:55.518 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:55.518 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:55.518 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:55.518 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:58:55.518 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:58:55.569 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:58:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:58:55] "GET /metrics HTTP/1.1" 200 36338 "" "Prometheus/2.43.0" 2024-03-04T06:58:55.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:55 smithi203 ceph-mon[85573]: pgmap v1032: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:55.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:55 smithi203 ceph-mon[85573]: from='client.34599 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:56.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:55 smithi137 ceph-mon[88869]: pgmap v1032: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:56.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:55 smithi137 ceph-mon[88869]: from='client.34599 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:56.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:55 smithi137 ceph-mon[91314]: pgmap v1032: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:56.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:55 smithi137 ceph-mon[91314]: from='client.34599 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:58:57.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:57 smithi203 ceph-mon[85573]: pgmap v1033: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:58.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:57 smithi137 ceph-mon[88869]: pgmap v1033: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:58.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:57 smithi137 ceph-mon[91314]: pgmap v1033: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:58:59.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:58:59 smithi203 ceph-mon[85573]: pgmap v1034: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:00.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:58:59 smithi137 ceph-mon[88869]: pgmap v1034: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:00.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:58:59 smithi137 ceph-mon[91314]: pgmap v1034: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:01.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:01 smithi203 ceph-mon[85573]: pgmap v1035: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:02.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:01 smithi137 ceph-mon[88869]: pgmap v1035: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:02.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:01 smithi137 ceph-mon[91314]: pgmap v1035: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:03.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:03 smithi203 ceph-mon[85573]: pgmap v1036: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:04.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:03 smithi137 ceph-mon[88869]: pgmap v1036: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:04.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:03 smithi137 ceph-mon[91314]: pgmap v1036: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:05.519 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:59:05.584 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:59:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:59:05] "GET /metrics HTTP/1.1" 200 36338 "" "Prometheus/2.43.0" 2024-03-04T06:59:05.738 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:59:05.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:05 smithi203 ceph-mon[85573]: pgmap v1037: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:05.859 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:05 smithi137 ceph-mon[88869]: pgmap v1037: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:05.860 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:05 smithi137 ceph-mon[91314]: pgmap v1037: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:07.548 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:59:07.550 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:59:07.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:07 smithi203 ceph-mon[85573]: pgmap v1038: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:07.908 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:07 smithi137 ceph-mon[88869]: pgmap v1038: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:07.909 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:07 smithi137 ceph-mon[91314]: pgmap v1038: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:08.238 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1038,"stamp":"2024-03-04T06:59:06.531414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003926"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534568+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:56:19.534568+0000","last_peered":"2024-03-04T06:56:19.534568+0000","last_clean":"2024-03-04T06:56:19.534568+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:56:19.534568+0000","last_undegraded":"2024-03-04T06:56:19.534568+0000","last_fullsized":"2024-03-04T06:56:19.534568+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151921+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:56:58.151921+0000","last_peered":"2024-03-04T06:56:58.151921+0000","last_clean":"2024-03-04T06:56:58.151921+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:56:58.151921+0000","last_undegraded":"2024-03-04T06:56:58.151921+0000","last_fullsized":"2024-03-04T06:56:58.151921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992691+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:56:22.992691+0000","last_peered":"2024-03-04T06:56:22.992691+0000","last_clean":"2024-03-04T06:56:22.992691+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:56:22.992691+0000","last_undegraded":"2024-03-04T06:56:22.992691+0000","last_fullsized":"2024-03-04T06:56:22.992691+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:52.944862+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:56:52.944862+0000","last_peered":"2024-03-04T06:56:52.944862+0000","last_clean":"2024-03-04T06:56:52.944862+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:56:52.944862+0000","last_undegraded":"2024-03-04T06:56:52.944862+0000","last_fullsized":"2024-03-04T06:56:52.944862+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102005+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.102005+0000","last_peered":"2024-03-04T06:55:13.102005+0000","last_clean":"2024-03-04T06:55:13.102005+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.102005+0000","last_undegraded":"2024-03-04T06:55:13.102005+0000","last_fullsized":"2024-03-04T06:55:13.102005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941144+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:56:22.941144+0000","last_peered":"2024-03-04T06:56:22.941144+0000","last_clean":"2024-03-04T06:56:22.941144+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:56:22.941144+0000","last_undegraded":"2024-03-04T06:56:22.941144+0000","last_fullsized":"2024-03-04T06:56:22.941144+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101809+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101809+0000","last_peered":"2024-03-04T06:55:13.101809+0000","last_clean":"2024-03-04T06:55:13.101809+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101809+0000","last_undegraded":"2024-03-04T06:55:13.101809+0000","last_fullsized":"2024-03-04T06:55:13.101809+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984614+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:14.984614+0000","last_peered":"2024-03-04T06:55:14.984614+0000","last_clean":"2024-03-04T06:55:14.984614+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:14.984614+0000","last_undegraded":"2024-03-04T06:55:14.984614+0000","last_fullsized":"2024-03-04T06:55:14.984614+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1064,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103046+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.103046+0000","last_peered":"2024-03-04T06:55:13.103046+0000","last_clean":"2024-03-04T06:55:13.103046+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.103046+0000","last_undegraded":"2024-03-04T06:55:13.103046+0000","last_fullsized":"2024-03-04T06:55:13.103046+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115007+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:55:13.115007+0000","last_peered":"2024-03-04T06:55:13.115007+0000","last_clean":"2024-03-04T06:55:13.115007+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:55:13.115007+0000","last_undegraded":"2024-03-04T06:55:13.115007+0000","last_fullsized":"2024-03-04T06:55:13.115007+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114852+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:55:13.114852+0000","last_peered":"2024-03-04T06:55:13.114852+0000","last_clean":"2024-03-04T06:55:13.114852+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:55:13.114852+0000","last_undegraded":"2024-03-04T06:55:13.114852+0000","last_fullsized":"2024-03-04T06:55:13.114852+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:32.604419+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:32.604419+0000","last_peered":"2024-03-04T06:55:32.604419+0000","last_clean":"2024-03-04T06:55:32.604419+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:32.604419+0000","last_undegraded":"2024-03-04T06:55:32.604419+0000","last_fullsized":"2024-03-04T06:55:32.604419+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.099013+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.099013+0000","last_peered":"2024-03-04T06:55:13.099013+0000","last_clean":"2024-03-04T06:55:13.099013+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.099013+0000","last_undegraded":"2024-03-04T06:55:13.099013+0000","last_fullsized":"2024-03-04T06:55:13.099013+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985446+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:17.985446+0000","last_peered":"2024-03-04T06:55:17.985446+0000","last_clean":"2024-03-04T06:55:17.985446+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:17.985446+0000","last_undegraded":"2024-03-04T06:55:17.985446+0000","last_fullsized":"2024-03-04T06:55:17.985446+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:53.145282+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:53.145282+0000","last_peered":"2024-03-04T06:55:53.145282+0000","last_clean":"2024-03-04T06:55:53.145282+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:53.145282+0000","last_undegraded":"2024-03-04T06:55:53.145282+0000","last_fullsized":"2024-03-04T06:55:53.145282+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937387+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:52.937387+0000","last_peered":"2024-03-04T06:55:52.937387+0000","last_clean":"2024-03-04T06:55:52.937387+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:52.937387+0000","last_undegraded":"2024-03-04T06:55:52.937387+0000","last_fullsized":"2024-03-04T06:55:52.937387+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937465+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:52.937465+0000","last_peered":"2024-03-04T06:55:52.937465+0000","last_clean":"2024-03-04T06:55:52.937465+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:52.937465+0000","last_undegraded":"2024-03-04T06:55:52.937465+0000","last_fullsized":"2024-03-04T06:55:52.937465+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382095+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:56:28.382095+0000","last_peered":"2024-03-04T06:56:28.382095+0000","last_clean":"2024-03-04T06:56:28.382095+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:56:28.382095+0000","last_undegraded":"2024-03-04T06:56:28.382095+0000","last_fullsized":"2024-03-04T06:56:28.382095+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538587+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:56:49.538587+0000","last_peered":"2024-03-04T06:56:49.538587+0000","last_clean":"2024-03-04T06:56:49.538587+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:56:49.538587+0000","last_undegraded":"2024-03-04T06:56:49.538587+0000","last_fullsized":"2024-03-04T06:56:49.538587+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1305,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992748+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:56:22.992748+0000","last_peered":"2024-03-04T06:56:22.992748+0000","last_clean":"2024-03-04T06:56:22.992748+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:56:22.992748+0000","last_undegraded":"2024-03-04T06:56:22.992748+0000","last_fullsized":"2024-03-04T06:56:22.992748+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988343+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:44.988343+0000","last_peered":"2024-03-04T06:55:44.988343+0000","last_clean":"2024-03-04T06:55:44.988343+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:44.988343+0000","last_undegraded":"2024-03-04T06:55:44.988343+0000","last_fullsized":"2024-03-04T06:55:44.988343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988353+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:44.988353+0000","last_peered":"2024-03-04T06:55:44.988353+0000","last_clean":"2024-03-04T06:55:44.988353+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:44.988353+0000","last_undegraded":"2024-03-04T06:55:44.988353+0000","last_fullsized":"2024-03-04T06:55:44.988353+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992731+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:56:22.992731+0000","last_peered":"2024-03-04T06:56:22.992731+0000","last_clean":"2024-03-04T06:56:22.992731+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:56:22.992731+0000","last_undegraded":"2024-03-04T06:56:22.992731+0000","last_fullsized":"2024-03-04T06:56:22.992731+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1234,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098569+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098569+0000","last_peered":"2024-03-04T06:55:13.098569+0000","last_clean":"2024-03-04T06:55:13.098569+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098569+0000","last_undegraded":"2024-03-04T06:55:13.098569+0000","last_fullsized":"2024-03-04T06:55:13.098569+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1221,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097506+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097506+0000","last_peered":"2024-03-04T06:55:13.097506+0000","last_clean":"2024-03-04T06:55:13.097506+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097506+0000","last_undegraded":"2024-03-04T06:55:13.097506+0000","last_fullsized":"2024-03-04T06:55:13.097506+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102499+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102499+0000","last_peered":"2024-03-04T06:55:13.102499+0000","last_clean":"2024-03-04T06:55:13.102499+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102499+0000","last_undegraded":"2024-03-04T06:55:13.102499+0000","last_fullsized":"2024-03-04T06:55:13.102499+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941175+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:56:22.941175+0000","last_peered":"2024-03-04T06:56:22.941175+0000","last_clean":"2024-03-04T06:56:22.941175+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:56:22.941175+0000","last_undegraded":"2024-03-04T06:56:22.941175+0000","last_fullsized":"2024-03-04T06:56:22.941175+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984673+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:14.984673+0000","last_peered":"2024-03-04T06:55:14.984673+0000","last_clean":"2024-03-04T06:55:14.984673+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:14.984673+0000","last_undegraded":"2024-03-04T06:55:14.984673+0000","last_fullsized":"2024-03-04T06:55:14.984673+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1189,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:47.606038+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:47.606038+0000","last_peered":"2024-03-04T06:55:47.606038+0000","last_clean":"2024-03-04T06:55:47.606038+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:47.606038+0000","last_undegraded":"2024-03-04T06:55:47.606038+0000","last_fullsized":"2024-03-04T06:55:47.606038+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114709+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114709+0000","last_peered":"2024-03-04T06:55:13.114709+0000","last_clean":"2024-03-04T06:55:13.114709+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114709+0000","last_undegraded":"2024-03-04T06:55:13.114709+0000","last_fullsized":"2024-03-04T06:55:13.114709+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:57.989954+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:57.989954+0000","last_peered":"2024-03-04T06:55:57.989954+0000","last_clean":"2024-03-04T06:55:57.989954+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:57.989954+0000","last_undegraded":"2024-03-04T06:55:57.989954+0000","last_fullsized":"2024-03-04T06:55:57.989954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096734+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096734+0000","last_peered":"2024-03-04T06:55:13.096734+0000","last_clean":"2024-03-04T06:55:13.096734+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096734+0000","last_undegraded":"2024-03-04T06:55:13.096734+0000","last_fullsized":"2024-03-04T06:55:13.096734+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097225+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097225+0000","last_peered":"2024-03-04T06:55:13.097225+0000","last_clean":"2024-03-04T06:55:13.097225+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097225+0000","last_undegraded":"2024-03-04T06:55:13.097225+0000","last_fullsized":"2024-03-04T06:55:13.097225+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939306+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:56:07.939306+0000","last_peered":"2024-03-04T06:56:07.939306+0000","last_clean":"2024-03-04T06:56:07.939306+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:56:07.939306+0000","last_undegraded":"2024-03-04T06:56:07.939306+0000","last_fullsized":"2024-03-04T06:56:07.939306+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147156+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:56:13.147156+0000","last_peered":"2024-03-04T06:56:13.147156+0000","last_clean":"2024-03-04T06:56:13.147156+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:56:13.147156+0000","last_undegraded":"2024-03-04T06:56:13.147156+0000","last_fullsized":"2024-03-04T06:56:13.147156+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.115145+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:55:13.115145+0000","last_peered":"2024-03-04T06:55:13.115145+0000","last_clean":"2024-03-04T06:55:13.115145+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:55:13.115145+0000","last_undegraded":"2024-03-04T06:55:13.115145+0000","last_fullsized":"2024-03-04T06:55:13.115145+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939379+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:56:07.939379+0000","last_peered":"2024-03-04T06:56:07.939379+0000","last_clean":"2024-03-04T06:56:07.939379+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:56:07.939379+0000","last_undegraded":"2024-03-04T06:56:07.939379+0000","last_fullsized":"2024-03-04T06:56:07.939379+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939364+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:56:07.939364+0000","last_peered":"2024-03-04T06:56:07.939364+0000","last_clean":"2024-03-04T06:56:07.939364+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:56:07.939364+0000","last_undegraded":"2024-03-04T06:56:07.939364+0000","last_fullsized":"2024-03-04T06:56:07.939364+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.988031+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:37.988031+0000","last_peered":"2024-03-04T06:55:37.988031+0000","last_clean":"2024-03-04T06:55:37.988031+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:37.988031+0000","last_undegraded":"2024-03-04T06:55:37.988031+0000","last_fullsized":"2024-03-04T06:55:37.988031+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147207+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:56:13.147207+0000","last_peered":"2024-03-04T06:56:13.147207+0000","last_clean":"2024-03-04T06:56:13.147207+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:56:13.147207+0000","last_undegraded":"2024-03-04T06:56:13.147207+0000","last_fullsized":"2024-03-04T06:56:13.147207+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.602395+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:17.602395+0000","last_peered":"2024-03-04T06:55:17.602395+0000","last_clean":"2024-03-04T06:55:17.602395+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:17.602395+0000","last_undegraded":"2024-03-04T06:55:17.602395+0000","last_fullsized":"2024-03-04T06:55:17.602395+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1130,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221797+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:56:28.221797+0000","last_peered":"2024-03-04T06:56:28.221797+0000","last_clean":"2024-03-04T06:56:28.221797+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:56:28.221797+0000","last_undegraded":"2024-03-04T06:56:28.221797+0000","last_fullsized":"2024-03-04T06:56:28.221797+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102665+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102665+0000","last_peered":"2024-03-04T06:55:13.102665+0000","last_clean":"2024-03-04T06:55:13.102665+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102665+0000","last_undegraded":"2024-03-04T06:55:13.102665+0000","last_fullsized":"2024-03-04T06:55:13.102665+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1302,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985489+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:17.985489+0000","last_peered":"2024-03-04T06:55:17.985489+0000","last_clean":"2024-03-04T06:55:17.985489+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:17.985489+0000","last_undegraded":"2024-03-04T06:55:17.985489+0000","last_fullsized":"2024-03-04T06:55:17.985489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382052+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:56:28.382052+0000","last_peered":"2024-03-04T06:56:28.382052+0000","last_clean":"2024-03-04T06:56:28.382052+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:56:28.382052+0000","last_undegraded":"2024-03-04T06:56:28.382052+0000","last_fullsized":"2024-03-04T06:56:28.382052+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937420+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:52.937420+0000","last_peered":"2024-03-04T06:55:52.937420+0000","last_clean":"2024-03-04T06:55:52.937420+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:52.937420+0000","last_undegraded":"2024-03-04T06:55:52.937420+0000","last_fullsized":"2024-03-04T06:55:52.937420+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102561+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102561+0000","last_peered":"2024-03-04T06:55:13.102561+0000","last_clean":"2024-03-04T06:55:13.102561+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102561+0000","last_undegraded":"2024-03-04T06:55:13.102561+0000","last_fullsized":"2024-03-04T06:55:13.102561+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221752+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:56:28.221752+0000","last_peered":"2024-03-04T06:56:28.221752+0000","last_clean":"2024-03-04T06:56:28.221752+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:56:28.221752+0000","last_undegraded":"2024-03-04T06:56:28.221752+0000","last_fullsized":"2024-03-04T06:56:28.221752+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221703+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:56:28.221703+0000","last_peered":"2024-03-04T06:56:28.221703+0000","last_clean":"2024-03-04T06:56:28.221703+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:56:28.221703+0000","last_undegraded":"2024-03-04T06:56:28.221703+0000","last_fullsized":"2024-03-04T06:56:28.221703+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1253,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382011+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:56:28.382011+0000","last_peered":"2024-03-04T06:56:28.382011+0000","last_clean":"2024-03-04T06:56:28.382011+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:56:28.382011+0000","last_undegraded":"2024-03-04T06:56:28.382011+0000","last_fullsized":"2024-03-04T06:56:28.382011+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101837+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101837+0000","last_peered":"2024-03-04T06:55:13.101837+0000","last_clean":"2024-03-04T06:55:13.101837+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101837+0000","last_undegraded":"2024-03-04T06:55:13.101837+0000","last_fullsized":"2024-03-04T06:55:13.101837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3577,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377824+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:48.377824+0000","last_peered":"2024-03-04T06:55:48.377824+0000","last_clean":"2024-03-04T06:55:48.377824+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:48.377824+0000","last_undegraded":"2024-03-04T06:55:48.377824+0000","last_fullsized":"2024-03-04T06:55:48.377824+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096992+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096992+0000","last_peered":"2024-03-04T06:55:13.096992+0000","last_clean":"2024-03-04T06:55:13.096992+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096992+0000","last_undegraded":"2024-03-04T06:55:13.096992+0000","last_fullsized":"2024-03-04T06:55:13.096992+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:56:49.538613+0000","last_peered":"2024-03-04T06:56:49.538613+0000","last_clean":"2024-03-04T06:56:49.538613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:56:49.538613+0000","last_undegraded":"2024-03-04T06:56:49.538613+0000","last_fullsized":"2024-03-04T06:56:49.538613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17116,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992661+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:56:22.992661+0000","last_peered":"2024-03-04T06:56:22.992661+0000","last_clean":"2024-03-04T06:56:22.992661+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:56:22.992661+0000","last_undegraded":"2024-03-04T06:56:22.992661+0000","last_fullsized":"2024-03-04T06:56:22.992661+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151860+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:56:58.151860+0000","last_peered":"2024-03-04T06:56:58.151860+0000","last_clean":"2024-03-04T06:56:58.151860+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:56:58.151860+0000","last_undegraded":"2024-03-04T06:56:58.151860+0000","last_fullsized":"2024-03-04T06:56:58.151860+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151904+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:56:58.151904+0000","last_peered":"2024-03-04T06:56:58.151904+0000","last_clean":"2024-03-04T06:56:58.151904+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:56:58.151904+0000","last_undegraded":"2024-03-04T06:56:58.151904+0000","last_fullsized":"2024-03-04T06:56:58.151904+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106020+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:55:13.106020+0000","last_peered":"2024-03-04T06:55:13.106020+0000","last_clean":"2024-03-04T06:55:13.106020+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:55:13.106020+0000","last_undegraded":"2024-03-04T06:55:13.106020+0000","last_fullsized":"2024-03-04T06:55:13.106020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4386,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992700+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:56:22.992700+0000","last_peered":"2024-03-04T06:56:22.992700+0000","last_clean":"2024-03-04T06:56:22.992700+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:56:22.992700+0000","last_undegraded":"2024-03-04T06:56:22.992700+0000","last_fullsized":"2024-03-04T06:56:22.992700+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151882+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:56:58.151882+0000","last_peered":"2024-03-04T06:56:58.151882+0000","last_clean":"2024-03-04T06:56:58.151882+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:56:58.151882+0000","last_undegraded":"2024-03-04T06:56:58.151882+0000","last_fullsized":"2024-03-04T06:56:58.151882+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105737+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:55:13.105737+0000","last_peered":"2024-03-04T06:55:13.105737+0000","last_clean":"2024-03-04T06:55:13.105737+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:55:13.105737+0000","last_undegraded":"2024-03-04T06:55:13.105737+0000","last_fullsized":"2024-03-04T06:55:13.105737+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611663+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:56:37.611663+0000","last_peered":"2024-03-04T06:56:37.611663+0000","last_clean":"2024-03-04T06:56:37.611663+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:56:37.611663+0000","last_undegraded":"2024-03-04T06:56:37.611663+0000","last_fullsized":"2024-03-04T06:56:37.611663+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5639,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377937+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:48.377937+0000","last_peered":"2024-03-04T06:55:48.377937+0000","last_clean":"2024-03-04T06:55:48.377937+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:48.377937+0000","last_undegraded":"2024-03-04T06:55:48.377937+0000","last_fullsized":"2024-03-04T06:55:48.377937+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141294+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.141294+0000","last_peered":"2024-03-04T06:55:13.141294+0000","last_clean":"2024-03-04T06:55:13.141294+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.141294+0000","last_undegraded":"2024-03-04T06:55:13.141294+0000","last_fullsized":"2024-03-04T06:55:13.141294+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:33.149241+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:56:33.149241+0000","last_peered":"2024-03-04T06:56:33.149241+0000","last_clean":"2024-03-04T06:56:33.149241+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:56:33.149241+0000","last_undegraded":"2024-03-04T06:56:33.149241+0000","last_fullsized":"2024-03-04T06:56:33.149241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375859+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:28.375859+0000","last_peered":"2024-03-04T06:55:28.375859+0000","last_clean":"2024-03-04T06:55:28.375859+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:28.375859+0000","last_undegraded":"2024-03-04T06:55:28.375859+0000","last_fullsized":"2024-03-04T06:55:28.375859+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4015,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:19.534498+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:56:19.534498+0000","last_peered":"2024-03-04T06:56:19.534498+0000","last_clean":"2024-03-04T06:56:19.534498+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:56:19.534498+0000","last_undegraded":"2024-03-04T06:56:19.534498+0000","last_fullsized":"2024-03-04T06:56:19.534498+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.217050+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:43.217050+0000","last_peered":"2024-03-04T06:55:43.217050+0000","last_clean":"2024-03-04T06:55:43.217050+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:43.217050+0000","last_undegraded":"2024-03-04T06:55:43.217050+0000","last_fullsized":"2024-03-04T06:55:43.217050+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.990790+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:56:04.990790+0000","last_peered":"2024-03-04T06:56:04.990790+0000","last_clean":"2024-03-04T06:56:04.990790+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:56:04.990790+0000","last_undegraded":"2024-03-04T06:56:04.990790+0000","last_fullsized":"2024-03-04T06:56:04.990790+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.105228+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:55:13.105228+0000","last_peered":"2024-03-04T06:55:13.105228+0000","last_clean":"2024-03-04T06:55:13.105228+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:55:13.105228+0000","last_undegraded":"2024-03-04T06:55:13.105228+0000","last_fullsized":"2024-03-04T06:55:13.105228+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1550,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532802+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:56:04.532802+0000","last_peered":"2024-03-04T06:56:04.532802+0000","last_clean":"2024-03-04T06:56:04.532802+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:56:04.532802+0000","last_undegraded":"2024-03-04T06:56:04.532802+0000","last_fullsized":"2024-03-04T06:56:04.532802+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3950,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933655+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:22.933655+0000","last_peered":"2024-03-04T06:55:22.933655+0000","last_clean":"2024-03-04T06:55:22.933655+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:22.933655+0000","last_undegraded":"2024-03-04T06:55:22.933655+0000","last_fullsized":"2024-03-04T06:55:22.933655+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995396+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:56:47.995396+0000","last_peered":"2024-03-04T06:56:47.995396+0000","last_clean":"2024-03-04T06:56:47.995396+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:56:47.995396+0000","last_undegraded":"2024-03-04T06:56:47.995396+0000","last_fullsized":"2024-03-04T06:56:47.995396+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375833+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:28.375833+0000","last_peered":"2024-03-04T06:55:28.375833+0000","last_clean":"2024-03-04T06:55:28.375833+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:28.375833+0000","last_undegraded":"2024-03-04T06:55:28.375833+0000","last_fullsized":"2024-03-04T06:55:28.375833+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532768+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:56:04.532768+0000","last_peered":"2024-03-04T06:56:04.532768+0000","last_clean":"2024-03-04T06:56:04.532768+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:56:04.532768+0000","last_undegraded":"2024-03-04T06:56:04.532768+0000","last_fullsized":"2024-03-04T06:56:04.532768+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15291,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:43.217015+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:43.217015+0000","last_peered":"2024-03-04T06:55:43.217015+0000","last_clean":"2024-03-04T06:55:43.217015+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:43.217015+0000","last_undegraded":"2024-03-04T06:55:43.217015+0000","last_fullsized":"2024-03-04T06:55:43.217015+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992678+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:56:22.992678+0000","last_peered":"2024-03-04T06:56:22.992678+0000","last_clean":"2024-03-04T06:56:22.992678+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:56:22.992678+0000","last_undegraded":"2024-03-04T06:56:22.992678+0000","last_fullsized":"2024-03-04T06:56:22.992678+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534547+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:56:19.534547+0000","last_peered":"2024-03-04T06:56:19.534547+0000","last_clean":"2024-03-04T06:56:19.534547+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:56:19.534547+0000","last_undegraded":"2024-03-04T06:56:19.534547+0000","last_fullsized":"2024-03-04T06:56:19.534547+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151891+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:56:58.151891+0000","last_peered":"2024-03-04T06:56:58.151891+0000","last_clean":"2024-03-04T06:56:58.151891+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:56:58.151891+0000","last_undegraded":"2024-03-04T06:56:58.151891+0000","last_fullsized":"2024-03-04T06:56:58.151891+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4379,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:37.611623+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:56:37.611623+0000","last_peered":"2024-03-04T06:56:37.611623+0000","last_clean":"2024-03-04T06:56:37.611623+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:56:37.611623+0000","last_undegraded":"2024-03-04T06:56:37.611623+0000","last_fullsized":"2024-03-04T06:56:37.611623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988300+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:44.988300+0000","last_peered":"2024-03-04T06:55:44.988300+0000","last_clean":"2024-03-04T06:55:44.988300+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:44.988300+0000","last_undegraded":"2024-03-04T06:55:44.988300+0000","last_fullsized":"2024-03-04T06:55:44.988300+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141284+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.141284+0000","last_peered":"2024-03-04T06:55:13.141284+0000","last_clean":"2024-03-04T06:55:13.141284+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.141284+0000","last_undegraded":"2024-03-04T06:55:13.141284+0000","last_fullsized":"2024-03-04T06:55:13.141284+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992884+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:56:24.992884+0000","last_peered":"2024-03-04T06:56:24.992884+0000","last_clean":"2024-03-04T06:56:24.992884+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:56:24.992884+0000","last_undegraded":"2024-03-04T06:56:24.992884+0000","last_fullsized":"2024-03-04T06:56:24.992884+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4609,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:44.988263+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:44.988263+0000","last_peered":"2024-03-04T06:55:44.988263+0000","last_clean":"2024-03-04T06:55:44.988263+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:44.988263+0000","last_undegraded":"2024-03-04T06:55:44.988263+0000","last_fullsized":"2024-03-04T06:55:44.988263+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611593+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:56:37.611593+0000","last_peered":"2024-03-04T06:56:37.611593+0000","last_clean":"2024-03-04T06:56:37.611593+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:56:37.611593+0000","last_undegraded":"2024-03-04T06:56:37.611593+0000","last_fullsized":"2024-03-04T06:56:37.611593+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1078,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218837+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:58.218837+0000","last_peered":"2024-03-04T06:55:58.218837+0000","last_clean":"2024-03-04T06:55:58.218837+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:58.218837+0000","last_undegraded":"2024-03-04T06:55:58.218837+0000","last_fullsized":"2024-03-04T06:55:58.218837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995375+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:56:47.995375+0000","last_peered":"2024-03-04T06:56:47.995375+0000","last_clean":"2024-03-04T06:56:47.995375+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:56:47.995375+0000","last_undegraded":"2024-03-04T06:56:47.995375+0000","last_fullsized":"2024-03-04T06:56:47.995375+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4634,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:37.935758+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:37.935758+0000","last_peered":"2024-03-04T06:55:37.935758+0000","last_clean":"2024-03-04T06:55:37.935758+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:37.935758+0000","last_undegraded":"2024-03-04T06:55:37.935758+0000","last_fullsized":"2024-03-04T06:55:37.935758+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:34.536591+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:56:34.536591+0000","last_peered":"2024-03-04T06:56:34.536591+0000","last_clean":"2024-03-04T06:56:34.536591+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:56:34.536591+0000","last_undegraded":"2024-03-04T06:56:34.536591+0000","last_fullsized":"2024-03-04T06:56:34.536591+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1184,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.095689+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:55:13.095689+0000","last_peered":"2024-03-04T06:55:13.095689+0000","last_clean":"2024-03-04T06:55:13.095689+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:55:13.095689+0000","last_undegraded":"2024-03-04T06:55:13.095689+0000","last_fullsized":"2024-03-04T06:55:13.095689+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5157,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.113366+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.113366+0000","last_peered":"2024-03-04T06:55:13.113366+0000","last_clean":"2024-03-04T06:55:13.113366+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.113366+0000","last_undegraded":"2024-03-04T06:55:13.113366+0000","last_fullsized":"2024-03-04T06:55:13.113366+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141219+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.141219+0000","last_peered":"2024-03-04T06:55:13.141219+0000","last_clean":"2024-03-04T06:55:13.141219+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.141219+0000","last_undegraded":"2024-03-04T06:55:13.141219+0000","last_fullsized":"2024-03-04T06:55:13.141219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992810+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:56:24.992810+0000","last_peered":"2024-03-04T06:56:24.992810+0000","last_clean":"2024-03-04T06:56:24.992810+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:56:24.992810+0000","last_undegraded":"2024-03-04T06:56:24.992810+0000","last_fullsized":"2024-03-04T06:56:24.992810+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4719,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380021+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:56:08.380021+0000","last_peered":"2024-03-04T06:56:08.380021+0000","last_clean":"2024-03-04T06:56:08.380021+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:56:08.380021+0000","last_undegraded":"2024-03-04T06:56:08.380021+0000","last_fullsized":"2024-03-04T06:56:08.380021+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141246+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.141246+0000","last_peered":"2024-03-04T06:55:13.141246+0000","last_clean":"2024-03-04T06:55:13.141246+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.141246+0000","last_undegraded":"2024-03-04T06:55:13.141246+0000","last_fullsized":"2024-03-04T06:55:13.141246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994937+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:56:44.994937+0000","last_peered":"2024-03-04T06:56:44.994937+0000","last_clean":"2024-03-04T06:56:44.994937+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:56:44.994937+0000","last_undegraded":"2024-03-04T06:56:44.994937+0000","last_fullsized":"2024-03-04T06:56:44.994937+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5554,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:33.143474+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:33.143474+0000","last_peered":"2024-03-04T06:55:33.143474+0000","last_clean":"2024-03-04T06:55:33.143474+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:33.143474+0000","last_undegraded":"2024-03-04T06:55:33.143474+0000","last_fullsized":"2024-03-04T06:55:33.143474+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:56:49.538554+0000","last_peered":"2024-03-04T06:56:49.538554+0000","last_clean":"2024-03-04T06:56:49.538554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:56:49.538554+0000","last_undegraded":"2024-03-04T06:56:49.538554+0000","last_fullsized":"2024-03-04T06:56:49.538554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218784+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:58.218784+0000","last_peered":"2024-03-04T06:55:58.218784+0000","last_clean":"2024-03-04T06:55:58.218784+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:58.218784+0000","last_undegraded":"2024-03-04T06:55:58.218784+0000","last_fullsized":"2024-03-04T06:55:58.218784+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.379963+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:56:08.379963+0000","last_peered":"2024-03-04T06:56:08.379963+0000","last_clean":"2024-03-04T06:56:08.379963+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:56:08.379963+0000","last_undegraded":"2024-03-04T06:56:08.379963+0000","last_fullsized":"2024-03-04T06:56:08.379963+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380005+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:56:08.380005+0000","last_peered":"2024-03-04T06:56:08.380005+0000","last_clean":"2024-03-04T06:56:08.380005+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:56:08.380005+0000","last_undegraded":"2024-03-04T06:56:08.380005+0000","last_fullsized":"2024-03-04T06:56:08.380005+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:56:49.538599+0000","last_peered":"2024-03-04T06:56:49.538599+0000","last_clean":"2024-03-04T06:56:49.538599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:56:49.538599+0000","last_undegraded":"2024-03-04T06:56:49.538599+0000","last_fullsized":"2024-03-04T06:56:49.538599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4366,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377880+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:48.377880+0000","last_peered":"2024-03-04T06:55:48.377880+0000","last_clean":"2024-03-04T06:55:48.377880+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:48.377880+0000","last_undegraded":"2024-03-04T06:55:48.377880+0000","last_fullsized":"2024-03-04T06:55:48.377880+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:33.143531+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:33.143531+0000","last_peered":"2024-03-04T06:55:33.143531+0000","last_clean":"2024-03-04T06:55:33.143531+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:33.143531+0000","last_undegraded":"2024-03-04T06:55:33.143531+0000","last_fullsized":"2024-03-04T06:55:33.143531+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935733+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:37.935733+0000","last_peered":"2024-03-04T06:55:37.935733+0000","last_clean":"2024-03-04T06:55:37.935733+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:37.935733+0000","last_undegraded":"2024-03-04T06:55:37.935733+0000","last_fullsized":"2024-03-04T06:55:37.935733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4600,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:34.536621+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:56:34.536621+0000","last_peered":"2024-03-04T06:56:34.536621+0000","last_clean":"2024-03-04T06:56:34.536621+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:56:34.536621+0000","last_undegraded":"2024-03-04T06:56:34.536621+0000","last_fullsized":"2024-03-04T06:56:34.536621+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1245,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380055+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:56:08.380055+0000","last_peered":"2024-03-04T06:56:08.380055+0000","last_clean":"2024-03-04T06:56:08.380055+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:56:08.380055+0000","last_undegraded":"2024-03-04T06:56:08.380055+0000","last_fullsized":"2024-03-04T06:56:08.380055+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538627+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:56:49.538627+0000","last_peered":"2024-03-04T06:56:49.538627+0000","last_clean":"2024-03-04T06:56:49.538627+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:56:49.538627+0000","last_undegraded":"2024-03-04T06:56:49.538627+0000","last_fullsized":"2024-03-04T06:56:49.538627+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.216983+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:43.216983+0000","last_peered":"2024-03-04T06:55:43.216983+0000","last_clean":"2024-03-04T06:55:43.216983+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:43.216983+0000","last_undegraded":"2024-03-04T06:55:43.216983+0000","last_fullsized":"2024-03-04T06:55:43.216983+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375870+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:28.375870+0000","last_peered":"2024-03-04T06:55:28.375870+0000","last_clean":"2024-03-04T06:55:28.375870+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:28.375870+0000","last_undegraded":"2024-03-04T06:55:28.375870+0000","last_fullsized":"2024-03-04T06:55:28.375870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.106053+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:55:13.106053+0000","last_peered":"2024-03-04T06:55:13.106053+0000","last_clean":"2024-03-04T06:55:13.106053+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:55:13.106053+0000","last_undegraded":"2024-03-04T06:55:13.106053+0000","last_fullsized":"2024-03-04T06:55:13.106053+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992636+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:56:22.992636+0000","last_peered":"2024-03-04T06:56:22.992636+0000","last_clean":"2024-03-04T06:56:22.992636+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:56:22.992636+0000","last_undegraded":"2024-03-04T06:56:22.992636+0000","last_fullsized":"2024-03-04T06:56:22.992636+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992858+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:56:24.992858+0000","last_peered":"2024-03-04T06:56:24.992858+0000","last_clean":"2024-03-04T06:56:24.992858+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:56:24.992858+0000","last_undegraded":"2024-03-04T06:56:24.992858+0000","last_fullsized":"2024-03-04T06:56:24.992858+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141268+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.141268+0000","last_peered":"2024-03-04T06:55:13.141268+0000","last_clean":"2024-03-04T06:55:13.141268+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.141268+0000","last_undegraded":"2024-03-04T06:55:13.141268+0000","last_fullsized":"2024-03-04T06:55:13.141268+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218825+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:58.218825+0000","last_peered":"2024-03-04T06:55:58.218825+0000","last_clean":"2024-03-04T06:55:58.218825+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:58.218825+0000","last_undegraded":"2024-03-04T06:55:58.218825+0000","last_fullsized":"2024-03-04T06:55:58.218825+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992900+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:56:24.992900+0000","last_peered":"2024-03-04T06:56:24.992900+0000","last_clean":"2024-03-04T06:56:24.992900+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:56:24.992900+0000","last_undegraded":"2024-03-04T06:56:24.992900+0000","last_fullsized":"2024-03-04T06:56:24.992900+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933591+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:22.933591+0000","last_peered":"2024-03-04T06:55:22.933591+0000","last_clean":"2024-03-04T06:55:22.933591+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:22.933591+0000","last_undegraded":"2024-03-04T06:55:22.933591+0000","last_fullsized":"2024-03-04T06:55:22.933591+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994907+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:56:44.994907+0000","last_peered":"2024-03-04T06:56:44.994907+0000","last_clean":"2024-03-04T06:56:44.994907+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:56:44.994907+0000","last_undegraded":"2024-03-04T06:56:44.994907+0000","last_fullsized":"2024-03-04T06:56:44.994907+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1120,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935684+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:37.935684+0000","last_peered":"2024-03-04T06:55:37.935684+0000","last_clean":"2024-03-04T06:55:37.935684+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:37.935684+0000","last_undegraded":"2024-03-04T06:55:37.935684+0000","last_fullsized":"2024-03-04T06:55:37.935684+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116911+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116911+0000","last_peered":"2024-03-04T06:55:13.116911+0000","last_clean":"2024-03-04T06:55:13.116911+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116911+0000","last_undegraded":"2024-03-04T06:55:13.116911+0000","last_fullsized":"2024-03-04T06:55:13.116911+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.220345+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:56:13.220345+0000","last_peered":"2024-03-04T06:56:13.220345+0000","last_clean":"2024-03-04T06:56:13.220345+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:56:13.220345+0000","last_undegraded":"2024-03-04T06:56:13.220345+0000","last_fullsized":"2024-03-04T06:56:13.220345+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503469,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648116,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142423,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287070,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997776,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885833,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937410,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792763,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:59:08.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:08.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:08.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:08.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:08.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:08.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:08.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:08.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:08.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:08.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:08.244 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:59:08.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:08 smithi137 ceph-mon[91314]: from='client.44546 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:59:08.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:59:08.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:08 smithi137 ceph-mon[88869]: from='client.44546 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:59:08.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:59:08.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:08 smithi203 ceph-mon[85573]: from='client.44546 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:59:08.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:59:09.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:09 smithi137 ceph-mon[88869]: pgmap v1039: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:09 smithi137 ceph-mon[91314]: pgmap v1039: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:09.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:09 smithi203 ceph-mon[85573]: pgmap v1039: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:11.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:10 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:59:11.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:10 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:59:11.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:10 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T06:59:12.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:11 smithi137 ceph-mon[88869]: pgmap v1040: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:12.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:11 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:59:12.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:11 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:59:12.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:11 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:59:12.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:11 smithi137 ceph-mon[91314]: pgmap v1040: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:12.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:11 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:59:12.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:11 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:59:12.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:11 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:59:12.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:11 smithi203 ceph-mon[85573]: pgmap v1040: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:12.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:11 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T06:59:12.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:11 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T06:59:12.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:11 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T06:59:13.866 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:13 smithi137 ceph-mon[88869]: pgmap v1041: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:13.866 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:13 smithi137 ceph-mon[91314]: pgmap v1041: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:14.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:13 smithi203 ceph-mon[85573]: pgmap v1041: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:15.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:59:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:59:15] "GET /metrics HTTP/1.1" 200 36338 "" "Prometheus/2.43.0" 2024-03-04T06:59:16.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:15 smithi137 ceph-mon[88869]: pgmap v1042: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:16.292 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:15 smithi137 ceph-mon[91314]: pgmap v1042: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:16.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:15 smithi203 ceph-mon[85573]: pgmap v1042: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:18.245 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:59:18.275 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:18 smithi137 ceph-mon[88869]: pgmap v1043: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:18.275 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:18 smithi137 ceph-mon[91314]: pgmap v1043: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:18.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:18 smithi203 ceph-mon[85573]: pgmap v1043: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:18.460 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:59:20.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:20 smithi137 ceph-mon[88869]: pgmap v1044: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:20.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:20 smithi137 ceph-mon[91314]: pgmap v1044: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:20.318 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:59:20.320 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:59:20.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:20 smithi203 ceph-mon[85573]: pgmap v1044: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:21.011 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1044,"stamp":"2024-03-04T06:59:18.535144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003730"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534568+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:56:19.534568+0000","last_peered":"2024-03-04T06:56:19.534568+0000","last_clean":"2024-03-04T06:56:19.534568+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:56:19.534568+0000","last_undegraded":"2024-03-04T06:56:19.534568+0000","last_fullsized":"2024-03-04T06:56:19.534568+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151921+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:56:58.151921+0000","last_peered":"2024-03-04T06:56:58.151921+0000","last_clean":"2024-03-04T06:56:58.151921+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:56:58.151921+0000","last_undegraded":"2024-03-04T06:56:58.151921+0000","last_fullsized":"2024-03-04T06:56:58.151921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992691+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:56:22.992691+0000","last_peered":"2024-03-04T06:56:22.992691+0000","last_clean":"2024-03-04T06:56:22.992691+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:56:22.992691+0000","last_undegraded":"2024-03-04T06:56:22.992691+0000","last_fullsized":"2024-03-04T06:56:22.992691+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:52.944862+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:56:52.944862+0000","last_peered":"2024-03-04T06:56:52.944862+0000","last_clean":"2024-03-04T06:56:52.944862+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:56:52.944862+0000","last_undegraded":"2024-03-04T06:56:52.944862+0000","last_fullsized":"2024-03-04T06:56:52.944862+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102005+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.102005+0000","last_peered":"2024-03-04T06:55:13.102005+0000","last_clean":"2024-03-04T06:55:13.102005+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.102005+0000","last_undegraded":"2024-03-04T06:55:13.102005+0000","last_fullsized":"2024-03-04T06:55:13.102005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941144+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:56:22.941144+0000","last_peered":"2024-03-04T06:56:22.941144+0000","last_clean":"2024-03-04T06:56:22.941144+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:56:22.941144+0000","last_undegraded":"2024-03-04T06:56:22.941144+0000","last_fullsized":"2024-03-04T06:56:22.941144+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101809+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101809+0000","last_peered":"2024-03-04T06:55:13.101809+0000","last_clean":"2024-03-04T06:55:13.101809+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101809+0000","last_undegraded":"2024-03-04T06:55:13.101809+0000","last_fullsized":"2024-03-04T06:55:13.101809+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984614+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:14.984614+0000","last_peered":"2024-03-04T06:55:14.984614+0000","last_clean":"2024-03-04T06:55:14.984614+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:14.984614+0000","last_undegraded":"2024-03-04T06:55:14.984614+0000","last_fullsized":"2024-03-04T06:55:14.984614+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1064,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103046+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.103046+0000","last_peered":"2024-03-04T06:55:13.103046+0000","last_clean":"2024-03-04T06:55:13.103046+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.103046+0000","last_undegraded":"2024-03-04T06:55:13.103046+0000","last_fullsized":"2024-03-04T06:55:13.103046+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223356+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:56:43.223356+0000","last_peered":"2024-03-04T06:56:43.223356+0000","last_clean":"2024-03-04T06:56:43.223356+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:56:43.223356+0000","last_undegraded":"2024-03-04T06:56:43.223356+0000","last_fullsized":"2024-03-04T06:56:43.223356+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223323+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:56:43.223323+0000","last_peered":"2024-03-04T06:56:43.223323+0000","last_clean":"2024-03-04T06:56:43.223323+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:56:43.223323+0000","last_undegraded":"2024-03-04T06:56:43.223323+0000","last_fullsized":"2024-03-04T06:56:43.223323+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:32.604419+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:32.604419+0000","last_peered":"2024-03-04T06:55:32.604419+0000","last_clean":"2024-03-04T06:55:32.604419+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:32.604419+0000","last_undegraded":"2024-03-04T06:55:32.604419+0000","last_fullsized":"2024-03-04T06:55:32.604419+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.099013+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.099013+0000","last_peered":"2024-03-04T06:55:13.099013+0000","last_clean":"2024-03-04T06:55:13.099013+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.099013+0000","last_undegraded":"2024-03-04T06:55:13.099013+0000","last_fullsized":"2024-03-04T06:55:13.099013+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985446+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:17.985446+0000","last_peered":"2024-03-04T06:55:17.985446+0000","last_clean":"2024-03-04T06:55:17.985446+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:17.985446+0000","last_undegraded":"2024-03-04T06:55:17.985446+0000","last_fullsized":"2024-03-04T06:55:17.985446+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:53.145282+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:53.145282+0000","last_peered":"2024-03-04T06:55:53.145282+0000","last_clean":"2024-03-04T06:55:53.145282+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:53.145282+0000","last_undegraded":"2024-03-04T06:55:53.145282+0000","last_fullsized":"2024-03-04T06:55:53.145282+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937387+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:52.937387+0000","last_peered":"2024-03-04T06:55:52.937387+0000","last_clean":"2024-03-04T06:55:52.937387+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:52.937387+0000","last_undegraded":"2024-03-04T06:55:52.937387+0000","last_fullsized":"2024-03-04T06:55:52.937387+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937465+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:52.937465+0000","last_peered":"2024-03-04T06:55:52.937465+0000","last_clean":"2024-03-04T06:55:52.937465+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:52.937465+0000","last_undegraded":"2024-03-04T06:55:52.937465+0000","last_fullsized":"2024-03-04T06:55:52.937465+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382095+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:56:28.382095+0000","last_peered":"2024-03-04T06:56:28.382095+0000","last_clean":"2024-03-04T06:56:28.382095+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:56:28.382095+0000","last_undegraded":"2024-03-04T06:56:28.382095+0000","last_fullsized":"2024-03-04T06:56:28.382095+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538587+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:56:49.538587+0000","last_peered":"2024-03-04T06:56:49.538587+0000","last_clean":"2024-03-04T06:56:49.538587+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:56:49.538587+0000","last_undegraded":"2024-03-04T06:56:49.538587+0000","last_fullsized":"2024-03-04T06:56:49.538587+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1305,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992748+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:56:22.992748+0000","last_peered":"2024-03-04T06:56:22.992748+0000","last_clean":"2024-03-04T06:56:22.992748+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:56:22.992748+0000","last_undegraded":"2024-03-04T06:56:22.992748+0000","last_fullsized":"2024-03-04T06:56:22.992748+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988343+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:44.988343+0000","last_peered":"2024-03-04T06:55:44.988343+0000","last_clean":"2024-03-04T06:55:44.988343+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:44.988343+0000","last_undegraded":"2024-03-04T06:55:44.988343+0000","last_fullsized":"2024-03-04T06:55:44.988343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988353+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:44.988353+0000","last_peered":"2024-03-04T06:55:44.988353+0000","last_clean":"2024-03-04T06:55:44.988353+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:44.988353+0000","last_undegraded":"2024-03-04T06:55:44.988353+0000","last_fullsized":"2024-03-04T06:55:44.988353+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992731+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:56:22.992731+0000","last_peered":"2024-03-04T06:56:22.992731+0000","last_clean":"2024-03-04T06:56:22.992731+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:56:22.992731+0000","last_undegraded":"2024-03-04T06:56:22.992731+0000","last_fullsized":"2024-03-04T06:56:22.992731+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1234,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098569+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098569+0000","last_peered":"2024-03-04T06:55:13.098569+0000","last_clean":"2024-03-04T06:55:13.098569+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098569+0000","last_undegraded":"2024-03-04T06:55:13.098569+0000","last_fullsized":"2024-03-04T06:55:13.098569+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1221,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097506+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097506+0000","last_peered":"2024-03-04T06:55:13.097506+0000","last_clean":"2024-03-04T06:55:13.097506+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097506+0000","last_undegraded":"2024-03-04T06:55:13.097506+0000","last_fullsized":"2024-03-04T06:55:13.097506+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102499+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102499+0000","last_peered":"2024-03-04T06:55:13.102499+0000","last_clean":"2024-03-04T06:55:13.102499+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102499+0000","last_undegraded":"2024-03-04T06:55:13.102499+0000","last_fullsized":"2024-03-04T06:55:13.102499+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941175+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:56:22.941175+0000","last_peered":"2024-03-04T06:56:22.941175+0000","last_clean":"2024-03-04T06:56:22.941175+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:56:22.941175+0000","last_undegraded":"2024-03-04T06:56:22.941175+0000","last_fullsized":"2024-03-04T06:56:22.941175+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984673+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:14.984673+0000","last_peered":"2024-03-04T06:55:14.984673+0000","last_clean":"2024-03-04T06:55:14.984673+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:14.984673+0000","last_undegraded":"2024-03-04T06:55:14.984673+0000","last_fullsized":"2024-03-04T06:55:14.984673+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1189,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:47.606038+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:47.606038+0000","last_peered":"2024-03-04T06:55:47.606038+0000","last_clean":"2024-03-04T06:55:47.606038+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:47.606038+0000","last_undegraded":"2024-03-04T06:55:47.606038+0000","last_fullsized":"2024-03-04T06:55:47.606038+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.114709+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:55:13.114709+0000","last_peered":"2024-03-04T06:55:13.114709+0000","last_clean":"2024-03-04T06:55:13.114709+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:55:13.114709+0000","last_undegraded":"2024-03-04T06:55:13.114709+0000","last_fullsized":"2024-03-04T06:55:13.114709+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:57.989954+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:57.989954+0000","last_peered":"2024-03-04T06:55:57.989954+0000","last_clean":"2024-03-04T06:55:57.989954+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:57.989954+0000","last_undegraded":"2024-03-04T06:55:57.989954+0000","last_fullsized":"2024-03-04T06:55:57.989954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096734+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096734+0000","last_peered":"2024-03-04T06:55:13.096734+0000","last_clean":"2024-03-04T06:55:13.096734+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096734+0000","last_undegraded":"2024-03-04T06:55:13.096734+0000","last_fullsized":"2024-03-04T06:55:13.096734+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097225+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097225+0000","last_peered":"2024-03-04T06:55:13.097225+0000","last_clean":"2024-03-04T06:55:13.097225+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097225+0000","last_undegraded":"2024-03-04T06:55:13.097225+0000","last_fullsized":"2024-03-04T06:55:13.097225+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939306+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:56:07.939306+0000","last_peered":"2024-03-04T06:56:07.939306+0000","last_clean":"2024-03-04T06:56:07.939306+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:56:07.939306+0000","last_undegraded":"2024-03-04T06:56:07.939306+0000","last_fullsized":"2024-03-04T06:56:07.939306+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147156+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:56:13.147156+0000","last_peered":"2024-03-04T06:56:13.147156+0000","last_clean":"2024-03-04T06:56:13.147156+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:56:13.147156+0000","last_undegraded":"2024-03-04T06:56:13.147156+0000","last_fullsized":"2024-03-04T06:56:13.147156+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223376+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:56:43.223376+0000","last_peered":"2024-03-04T06:56:43.223376+0000","last_clean":"2024-03-04T06:56:43.223376+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:56:43.223376+0000","last_undegraded":"2024-03-04T06:56:43.223376+0000","last_fullsized":"2024-03-04T06:56:43.223376+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939379+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:56:07.939379+0000","last_peered":"2024-03-04T06:56:07.939379+0000","last_clean":"2024-03-04T06:56:07.939379+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:56:07.939379+0000","last_undegraded":"2024-03-04T06:56:07.939379+0000","last_fullsized":"2024-03-04T06:56:07.939379+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939364+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:56:07.939364+0000","last_peered":"2024-03-04T06:56:07.939364+0000","last_clean":"2024-03-04T06:56:07.939364+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:56:07.939364+0000","last_undegraded":"2024-03-04T06:56:07.939364+0000","last_fullsized":"2024-03-04T06:56:07.939364+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.988031+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:37.988031+0000","last_peered":"2024-03-04T06:55:37.988031+0000","last_clean":"2024-03-04T06:55:37.988031+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:37.988031+0000","last_undegraded":"2024-03-04T06:55:37.988031+0000","last_fullsized":"2024-03-04T06:55:37.988031+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147207+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:56:13.147207+0000","last_peered":"2024-03-04T06:56:13.147207+0000","last_clean":"2024-03-04T06:56:13.147207+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:56:13.147207+0000","last_undegraded":"2024-03-04T06:56:13.147207+0000","last_fullsized":"2024-03-04T06:56:13.147207+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.602395+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:17.602395+0000","last_peered":"2024-03-04T06:55:17.602395+0000","last_clean":"2024-03-04T06:55:17.602395+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:17.602395+0000","last_undegraded":"2024-03-04T06:55:17.602395+0000","last_fullsized":"2024-03-04T06:55:17.602395+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1130,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221797+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:56:28.221797+0000","last_peered":"2024-03-04T06:56:28.221797+0000","last_clean":"2024-03-04T06:56:28.221797+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:56:28.221797+0000","last_undegraded":"2024-03-04T06:56:28.221797+0000","last_fullsized":"2024-03-04T06:56:28.221797+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102665+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102665+0000","last_peered":"2024-03-04T06:55:13.102665+0000","last_clean":"2024-03-04T06:55:13.102665+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102665+0000","last_undegraded":"2024-03-04T06:55:13.102665+0000","last_fullsized":"2024-03-04T06:55:13.102665+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1302,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985489+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:17.985489+0000","last_peered":"2024-03-04T06:55:17.985489+0000","last_clean":"2024-03-04T06:55:17.985489+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:17.985489+0000","last_undegraded":"2024-03-04T06:55:17.985489+0000","last_fullsized":"2024-03-04T06:55:17.985489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382052+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:56:28.382052+0000","last_peered":"2024-03-04T06:56:28.382052+0000","last_clean":"2024-03-04T06:56:28.382052+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:56:28.382052+0000","last_undegraded":"2024-03-04T06:56:28.382052+0000","last_fullsized":"2024-03-04T06:56:28.382052+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937420+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:52.937420+0000","last_peered":"2024-03-04T06:55:52.937420+0000","last_clean":"2024-03-04T06:55:52.937420+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:52.937420+0000","last_undegraded":"2024-03-04T06:55:52.937420+0000","last_fullsized":"2024-03-04T06:55:52.937420+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102561+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:55:13.102561+0000","last_peered":"2024-03-04T06:55:13.102561+0000","last_clean":"2024-03-04T06:55:13.102561+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:55:13.102561+0000","last_undegraded":"2024-03-04T06:55:13.102561+0000","last_fullsized":"2024-03-04T06:55:13.102561+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221752+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:56:28.221752+0000","last_peered":"2024-03-04T06:56:28.221752+0000","last_clean":"2024-03-04T06:56:28.221752+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:56:28.221752+0000","last_undegraded":"2024-03-04T06:56:28.221752+0000","last_fullsized":"2024-03-04T06:56:28.221752+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221703+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:56:28.221703+0000","last_peered":"2024-03-04T06:56:28.221703+0000","last_clean":"2024-03-04T06:56:28.221703+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:56:28.221703+0000","last_undegraded":"2024-03-04T06:56:28.221703+0000","last_fullsized":"2024-03-04T06:56:28.221703+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1253,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382011+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:56:28.382011+0000","last_peered":"2024-03-04T06:56:28.382011+0000","last_clean":"2024-03-04T06:56:28.382011+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:56:28.382011+0000","last_undegraded":"2024-03-04T06:56:28.382011+0000","last_fullsized":"2024-03-04T06:56:28.382011+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101837+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:55:13.101837+0000","last_peered":"2024-03-04T06:55:13.101837+0000","last_clean":"2024-03-04T06:55:13.101837+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:55:13.101837+0000","last_undegraded":"2024-03-04T06:55:13.101837+0000","last_fullsized":"2024-03-04T06:55:13.101837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3577,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377824+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:48.377824+0000","last_peered":"2024-03-04T06:55:48.377824+0000","last_clean":"2024-03-04T06:55:48.377824+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:48.377824+0000","last_undegraded":"2024-03-04T06:55:48.377824+0000","last_fullsized":"2024-03-04T06:55:48.377824+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096992+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096992+0000","last_peered":"2024-03-04T06:55:13.096992+0000","last_clean":"2024-03-04T06:55:13.096992+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096992+0000","last_undegraded":"2024-03-04T06:55:13.096992+0000","last_fullsized":"2024-03-04T06:55:13.096992+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:56:49.538613+0000","last_peered":"2024-03-04T06:56:49.538613+0000","last_clean":"2024-03-04T06:56:49.538613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:56:49.538613+0000","last_undegraded":"2024-03-04T06:56:49.538613+0000","last_fullsized":"2024-03-04T06:56:49.538613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17116,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992661+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:56:22.992661+0000","last_peered":"2024-03-04T06:56:22.992661+0000","last_clean":"2024-03-04T06:56:22.992661+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:56:22.992661+0000","last_undegraded":"2024-03-04T06:56:22.992661+0000","last_fullsized":"2024-03-04T06:56:22.992661+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151860+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:56:58.151860+0000","last_peered":"2024-03-04T06:56:58.151860+0000","last_clean":"2024-03-04T06:56:58.151860+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:56:58.151860+0000","last_undegraded":"2024-03-04T06:56:58.151860+0000","last_fullsized":"2024-03-04T06:56:58.151860+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151904+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:56:58.151904+0000","last_peered":"2024-03-04T06:56:58.151904+0000","last_clean":"2024-03-04T06:56:58.151904+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:56:58.151904+0000","last_undegraded":"2024-03-04T06:56:58.151904+0000","last_fullsized":"2024-03-04T06:56:58.151904+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947110+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:57:12.947110+0000","last_peered":"2024-03-04T06:57:12.947110+0000","last_clean":"2024-03-04T06:57:12.947110+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:57:12.947110+0000","last_undegraded":"2024-03-04T06:57:12.947110+0000","last_fullsized":"2024-03-04T06:57:12.947110+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4386,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992700+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:56:22.992700+0000","last_peered":"2024-03-04T06:56:22.992700+0000","last_clean":"2024-03-04T06:56:22.992700+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:56:22.992700+0000","last_undegraded":"2024-03-04T06:56:22.992700+0000","last_fullsized":"2024-03-04T06:56:22.992700+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151882+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:56:58.151882+0000","last_peered":"2024-03-04T06:56:58.151882+0000","last_clean":"2024-03-04T06:56:58.151882+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:56:58.151882+0000","last_undegraded":"2024-03-04T06:56:58.151882+0000","last_fullsized":"2024-03-04T06:56:58.151882+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947055+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:57:12.947055+0000","last_peered":"2024-03-04T06:57:12.947055+0000","last_clean":"2024-03-04T06:57:12.947055+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:57:12.947055+0000","last_undegraded":"2024-03-04T06:57:12.947055+0000","last_fullsized":"2024-03-04T06:57:12.947055+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611663+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:56:37.611663+0000","last_peered":"2024-03-04T06:56:37.611663+0000","last_clean":"2024-03-04T06:56:37.611663+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:56:37.611663+0000","last_undegraded":"2024-03-04T06:56:37.611663+0000","last_fullsized":"2024-03-04T06:56:37.611663+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5639,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377937+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:48.377937+0000","last_peered":"2024-03-04T06:55:48.377937+0000","last_clean":"2024-03-04T06:55:48.377937+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:48.377937+0000","last_undegraded":"2024-03-04T06:55:48.377937+0000","last_fullsized":"2024-03-04T06:55:48.377937+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141294+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.141294+0000","last_peered":"2024-03-04T06:55:13.141294+0000","last_clean":"2024-03-04T06:55:13.141294+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.141294+0000","last_undegraded":"2024-03-04T06:55:13.141294+0000","last_fullsized":"2024-03-04T06:55:13.141294+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:33.149241+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:56:33.149241+0000","last_peered":"2024-03-04T06:56:33.149241+0000","last_clean":"2024-03-04T06:56:33.149241+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:56:33.149241+0000","last_undegraded":"2024-03-04T06:56:33.149241+0000","last_fullsized":"2024-03-04T06:56:33.149241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375859+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:28.375859+0000","last_peered":"2024-03-04T06:55:28.375859+0000","last_clean":"2024-03-04T06:55:28.375859+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:28.375859+0000","last_undegraded":"2024-03-04T06:55:28.375859+0000","last_fullsized":"2024-03-04T06:55:28.375859+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4015,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:19.534498+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:56:19.534498+0000","last_peered":"2024-03-04T06:56:19.534498+0000","last_clean":"2024-03-04T06:56:19.534498+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:56:19.534498+0000","last_undegraded":"2024-03-04T06:56:19.534498+0000","last_fullsized":"2024-03-04T06:56:19.534498+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.217050+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:43.217050+0000","last_peered":"2024-03-04T06:55:43.217050+0000","last_clean":"2024-03-04T06:55:43.217050+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:43.217050+0000","last_undegraded":"2024-03-04T06:55:43.217050+0000","last_fullsized":"2024-03-04T06:55:43.217050+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.990790+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:56:04.990790+0000","last_peered":"2024-03-04T06:56:04.990790+0000","last_clean":"2024-03-04T06:56:04.990790+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:56:04.990790+0000","last_undegraded":"2024-03-04T06:56:04.990790+0000","last_fullsized":"2024-03-04T06:56:04.990790+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947097+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:57:12.947097+0000","last_peered":"2024-03-04T06:57:12.947097+0000","last_clean":"2024-03-04T06:57:12.947097+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:57:12.947097+0000","last_undegraded":"2024-03-04T06:57:12.947097+0000","last_fullsized":"2024-03-04T06:57:12.947097+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1550,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532802+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:56:04.532802+0000","last_peered":"2024-03-04T06:56:04.532802+0000","last_clean":"2024-03-04T06:56:04.532802+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:56:04.532802+0000","last_undegraded":"2024-03-04T06:56:04.532802+0000","last_fullsized":"2024-03-04T06:56:04.532802+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3950,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933655+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:22.933655+0000","last_peered":"2024-03-04T06:55:22.933655+0000","last_clean":"2024-03-04T06:55:22.933655+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:22.933655+0000","last_undegraded":"2024-03-04T06:55:22.933655+0000","last_fullsized":"2024-03-04T06:55:22.933655+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995396+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:56:47.995396+0000","last_peered":"2024-03-04T06:56:47.995396+0000","last_clean":"2024-03-04T06:56:47.995396+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:56:47.995396+0000","last_undegraded":"2024-03-04T06:56:47.995396+0000","last_fullsized":"2024-03-04T06:56:47.995396+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375833+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:28.375833+0000","last_peered":"2024-03-04T06:55:28.375833+0000","last_clean":"2024-03-04T06:55:28.375833+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:28.375833+0000","last_undegraded":"2024-03-04T06:55:28.375833+0000","last_fullsized":"2024-03-04T06:55:28.375833+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532768+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:56:04.532768+0000","last_peered":"2024-03-04T06:56:04.532768+0000","last_clean":"2024-03-04T06:56:04.532768+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:56:04.532768+0000","last_undegraded":"2024-03-04T06:56:04.532768+0000","last_fullsized":"2024-03-04T06:56:04.532768+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15291,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:43.217015+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:43.217015+0000","last_peered":"2024-03-04T06:55:43.217015+0000","last_clean":"2024-03-04T06:55:43.217015+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:43.217015+0000","last_undegraded":"2024-03-04T06:55:43.217015+0000","last_fullsized":"2024-03-04T06:55:43.217015+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992678+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:56:22.992678+0000","last_peered":"2024-03-04T06:56:22.992678+0000","last_clean":"2024-03-04T06:56:22.992678+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:56:22.992678+0000","last_undegraded":"2024-03-04T06:56:22.992678+0000","last_fullsized":"2024-03-04T06:56:22.992678+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534547+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:56:19.534547+0000","last_peered":"2024-03-04T06:56:19.534547+0000","last_clean":"2024-03-04T06:56:19.534547+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:56:19.534547+0000","last_undegraded":"2024-03-04T06:56:19.534547+0000","last_fullsized":"2024-03-04T06:56:19.534547+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151891+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:56:58.151891+0000","last_peered":"2024-03-04T06:56:58.151891+0000","last_clean":"2024-03-04T06:56:58.151891+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:56:58.151891+0000","last_undegraded":"2024-03-04T06:56:58.151891+0000","last_fullsized":"2024-03-04T06:56:58.151891+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4379,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:37.611623+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:56:37.611623+0000","last_peered":"2024-03-04T06:56:37.611623+0000","last_clean":"2024-03-04T06:56:37.611623+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:56:37.611623+0000","last_undegraded":"2024-03-04T06:56:37.611623+0000","last_fullsized":"2024-03-04T06:56:37.611623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988300+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:44.988300+0000","last_peered":"2024-03-04T06:55:44.988300+0000","last_clean":"2024-03-04T06:55:44.988300+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:44.988300+0000","last_undegraded":"2024-03-04T06:55:44.988300+0000","last_fullsized":"2024-03-04T06:55:44.988300+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141284+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.141284+0000","last_peered":"2024-03-04T06:55:13.141284+0000","last_clean":"2024-03-04T06:55:13.141284+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.141284+0000","last_undegraded":"2024-03-04T06:55:13.141284+0000","last_fullsized":"2024-03-04T06:55:13.141284+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992884+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:56:24.992884+0000","last_peered":"2024-03-04T06:56:24.992884+0000","last_clean":"2024-03-04T06:56:24.992884+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:56:24.992884+0000","last_undegraded":"2024-03-04T06:56:24.992884+0000","last_fullsized":"2024-03-04T06:56:24.992884+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4609,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:44.988263+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:44.988263+0000","last_peered":"2024-03-04T06:55:44.988263+0000","last_clean":"2024-03-04T06:55:44.988263+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:44.988263+0000","last_undegraded":"2024-03-04T06:55:44.988263+0000","last_fullsized":"2024-03-04T06:55:44.988263+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611593+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:56:37.611593+0000","last_peered":"2024-03-04T06:56:37.611593+0000","last_clean":"2024-03-04T06:56:37.611593+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:56:37.611593+0000","last_undegraded":"2024-03-04T06:56:37.611593+0000","last_fullsized":"2024-03-04T06:56:37.611593+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1078,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218837+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:58.218837+0000","last_peered":"2024-03-04T06:55:58.218837+0000","last_clean":"2024-03-04T06:55:58.218837+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:58.218837+0000","last_undegraded":"2024-03-04T06:55:58.218837+0000","last_fullsized":"2024-03-04T06:55:58.218837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995375+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:56:47.995375+0000","last_peered":"2024-03-04T06:56:47.995375+0000","last_clean":"2024-03-04T06:56:47.995375+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:56:47.995375+0000","last_undegraded":"2024-03-04T06:56:47.995375+0000","last_fullsized":"2024-03-04T06:56:47.995375+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4634,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:37.935758+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:37.935758+0000","last_peered":"2024-03-04T06:55:37.935758+0000","last_clean":"2024-03-04T06:55:37.935758+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:37.935758+0000","last_undegraded":"2024-03-04T06:55:37.935758+0000","last_fullsized":"2024-03-04T06:55:37.935758+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:34.536591+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:56:34.536591+0000","last_peered":"2024-03-04T06:56:34.536591+0000","last_clean":"2024-03-04T06:56:34.536591+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:56:34.536591+0000","last_undegraded":"2024-03-04T06:56:34.536591+0000","last_fullsized":"2024-03-04T06:56:34.536591+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1185,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:57.614016+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:56:57.614016+0000","last_peered":"2024-03-04T06:56:57.614016+0000","last_clean":"2024-03-04T06:56:57.614016+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:56:57.614016+0000","last_undegraded":"2024-03-04T06:56:57.614016+0000","last_fullsized":"2024-03-04T06:56:57.614016+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5157,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.113366+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.113366+0000","last_peered":"2024-03-04T06:55:13.113366+0000","last_clean":"2024-03-04T06:55:13.113366+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.113366+0000","last_undegraded":"2024-03-04T06:55:13.113366+0000","last_fullsized":"2024-03-04T06:55:13.113366+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141219+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.141219+0000","last_peered":"2024-03-04T06:55:13.141219+0000","last_clean":"2024-03-04T06:55:13.141219+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.141219+0000","last_undegraded":"2024-03-04T06:55:13.141219+0000","last_fullsized":"2024-03-04T06:55:13.141219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992810+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:56:24.992810+0000","last_peered":"2024-03-04T06:56:24.992810+0000","last_clean":"2024-03-04T06:56:24.992810+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:56:24.992810+0000","last_undegraded":"2024-03-04T06:56:24.992810+0000","last_fullsized":"2024-03-04T06:56:24.992810+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4719,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380021+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:56:08.380021+0000","last_peered":"2024-03-04T06:56:08.380021+0000","last_clean":"2024-03-04T06:56:08.380021+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:56:08.380021+0000","last_undegraded":"2024-03-04T06:56:08.380021+0000","last_fullsized":"2024-03-04T06:56:08.380021+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141246+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.141246+0000","last_peered":"2024-03-04T06:55:13.141246+0000","last_clean":"2024-03-04T06:55:13.141246+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.141246+0000","last_undegraded":"2024-03-04T06:55:13.141246+0000","last_fullsized":"2024-03-04T06:55:13.141246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994937+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:56:44.994937+0000","last_peered":"2024-03-04T06:56:44.994937+0000","last_clean":"2024-03-04T06:56:44.994937+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:56:44.994937+0000","last_undegraded":"2024-03-04T06:56:44.994937+0000","last_fullsized":"2024-03-04T06:56:44.994937+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5554,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:33.143474+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:33.143474+0000","last_peered":"2024-03-04T06:55:33.143474+0000","last_clean":"2024-03-04T06:55:33.143474+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:33.143474+0000","last_undegraded":"2024-03-04T06:55:33.143474+0000","last_fullsized":"2024-03-04T06:55:33.143474+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:56:49.538554+0000","last_peered":"2024-03-04T06:56:49.538554+0000","last_clean":"2024-03-04T06:56:49.538554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:56:49.538554+0000","last_undegraded":"2024-03-04T06:56:49.538554+0000","last_fullsized":"2024-03-04T06:56:49.538554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218784+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:58.218784+0000","last_peered":"2024-03-04T06:55:58.218784+0000","last_clean":"2024-03-04T06:55:58.218784+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:58.218784+0000","last_undegraded":"2024-03-04T06:55:58.218784+0000","last_fullsized":"2024-03-04T06:55:58.218784+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.379963+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:56:08.379963+0000","last_peered":"2024-03-04T06:56:08.379963+0000","last_clean":"2024-03-04T06:56:08.379963+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:56:08.379963+0000","last_undegraded":"2024-03-04T06:56:08.379963+0000","last_fullsized":"2024-03-04T06:56:08.379963+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380005+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:56:08.380005+0000","last_peered":"2024-03-04T06:56:08.380005+0000","last_clean":"2024-03-04T06:56:08.380005+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:56:08.380005+0000","last_undegraded":"2024-03-04T06:56:08.380005+0000","last_fullsized":"2024-03-04T06:56:08.380005+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:56:49.538599+0000","last_peered":"2024-03-04T06:56:49.538599+0000","last_clean":"2024-03-04T06:56:49.538599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:56:49.538599+0000","last_undegraded":"2024-03-04T06:56:49.538599+0000","last_fullsized":"2024-03-04T06:56:49.538599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4366,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377880+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:48.377880+0000","last_peered":"2024-03-04T06:55:48.377880+0000","last_clean":"2024-03-04T06:55:48.377880+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:48.377880+0000","last_undegraded":"2024-03-04T06:55:48.377880+0000","last_fullsized":"2024-03-04T06:55:48.377880+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:33.143531+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:33.143531+0000","last_peered":"2024-03-04T06:55:33.143531+0000","last_clean":"2024-03-04T06:55:33.143531+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:33.143531+0000","last_undegraded":"2024-03-04T06:55:33.143531+0000","last_fullsized":"2024-03-04T06:55:33.143531+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935733+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:37.935733+0000","last_peered":"2024-03-04T06:55:37.935733+0000","last_clean":"2024-03-04T06:55:37.935733+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:37.935733+0000","last_undegraded":"2024-03-04T06:55:37.935733+0000","last_fullsized":"2024-03-04T06:55:37.935733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4600,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:34.536621+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:56:34.536621+0000","last_peered":"2024-03-04T06:56:34.536621+0000","last_clean":"2024-03-04T06:56:34.536621+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:56:34.536621+0000","last_undegraded":"2024-03-04T06:56:34.536621+0000","last_fullsized":"2024-03-04T06:56:34.536621+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1245,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380055+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:56:08.380055+0000","last_peered":"2024-03-04T06:56:08.380055+0000","last_clean":"2024-03-04T06:56:08.380055+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:56:08.380055+0000","last_undegraded":"2024-03-04T06:56:08.380055+0000","last_fullsized":"2024-03-04T06:56:08.380055+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538627+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:56:49.538627+0000","last_peered":"2024-03-04T06:56:49.538627+0000","last_clean":"2024-03-04T06:56:49.538627+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:56:49.538627+0000","last_undegraded":"2024-03-04T06:56:49.538627+0000","last_fullsized":"2024-03-04T06:56:49.538627+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.216983+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:43.216983+0000","last_peered":"2024-03-04T06:55:43.216983+0000","last_clean":"2024-03-04T06:55:43.216983+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:43.216983+0000","last_undegraded":"2024-03-04T06:55:43.216983+0000","last_fullsized":"2024-03-04T06:55:43.216983+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375870+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:28.375870+0000","last_peered":"2024-03-04T06:55:28.375870+0000","last_clean":"2024-03-04T06:55:28.375870+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:28.375870+0000","last_undegraded":"2024-03-04T06:55:28.375870+0000","last_fullsized":"2024-03-04T06:55:28.375870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947082+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:57:12.947082+0000","last_peered":"2024-03-04T06:57:12.947082+0000","last_clean":"2024-03-04T06:57:12.947082+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:57:12.947082+0000","last_undegraded":"2024-03-04T06:57:12.947082+0000","last_fullsized":"2024-03-04T06:57:12.947082+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992636+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:56:22.992636+0000","last_peered":"2024-03-04T06:56:22.992636+0000","last_clean":"2024-03-04T06:56:22.992636+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:56:22.992636+0000","last_undegraded":"2024-03-04T06:56:22.992636+0000","last_fullsized":"2024-03-04T06:56:22.992636+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992858+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:56:24.992858+0000","last_peered":"2024-03-04T06:56:24.992858+0000","last_clean":"2024-03-04T06:56:24.992858+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:56:24.992858+0000","last_undegraded":"2024-03-04T06:56:24.992858+0000","last_fullsized":"2024-03-04T06:56:24.992858+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141268+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.141268+0000","last_peered":"2024-03-04T06:55:13.141268+0000","last_clean":"2024-03-04T06:55:13.141268+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.141268+0000","last_undegraded":"2024-03-04T06:55:13.141268+0000","last_fullsized":"2024-03-04T06:55:13.141268+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218825+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:58.218825+0000","last_peered":"2024-03-04T06:55:58.218825+0000","last_clean":"2024-03-04T06:55:58.218825+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:58.218825+0000","last_undegraded":"2024-03-04T06:55:58.218825+0000","last_fullsized":"2024-03-04T06:55:58.218825+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992900+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:56:24.992900+0000","last_peered":"2024-03-04T06:56:24.992900+0000","last_clean":"2024-03-04T06:56:24.992900+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:56:24.992900+0000","last_undegraded":"2024-03-04T06:56:24.992900+0000","last_fullsized":"2024-03-04T06:56:24.992900+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933591+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:22.933591+0000","last_peered":"2024-03-04T06:55:22.933591+0000","last_clean":"2024-03-04T06:55:22.933591+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:22.933591+0000","last_undegraded":"2024-03-04T06:55:22.933591+0000","last_fullsized":"2024-03-04T06:55:22.933591+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994907+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:56:44.994907+0000","last_peered":"2024-03-04T06:56:44.994907+0000","last_clean":"2024-03-04T06:56:44.994907+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:56:44.994907+0000","last_undegraded":"2024-03-04T06:56:44.994907+0000","last_fullsized":"2024-03-04T06:56:44.994907+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1120,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935684+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:37.935684+0000","last_peered":"2024-03-04T06:55:37.935684+0000","last_clean":"2024-03-04T06:55:37.935684+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:37.935684+0000","last_undegraded":"2024-03-04T06:55:37.935684+0000","last_fullsized":"2024-03-04T06:55:37.935684+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.116911+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:55:13.116911+0000","last_peered":"2024-03-04T06:55:13.116911+0000","last_clean":"2024-03-04T06:55:13.116911+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:55:13.116911+0000","last_undegraded":"2024-03-04T06:55:13.116911+0000","last_fullsized":"2024-03-04T06:55:13.116911+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.220345+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:56:13.220345+0000","last_peered":"2024-03-04T06:56:13.220345+0000","last_clean":"2024-03-04T06:56:13.220345+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:56:13.220345+0000","last_undegraded":"2024-03-04T06:56:13.220345+0000","last_fullsized":"2024-03-04T06:56:13.220345+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503471,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648119,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142426,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287073,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997779,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885835,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937413,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792766,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:59:21.016 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:21.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:21.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:21.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:21.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:21.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:21.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:21.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:21.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:21.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:21.017 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:59:21.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:21 smithi137 ceph-mon[88869]: from='client.44552 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:59:21.292 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:21 smithi137 ceph-mon[91314]: from='client.44552 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:59:21.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:21 smithi203 ceph-mon[85573]: from='client.44552 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:59:22.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:22 smithi137 ceph-mon[88869]: pgmap v1045: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:22.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:22 smithi137 ceph-mon[91314]: pgmap v1045: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:22.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:22 smithi203 ceph-mon[85573]: pgmap v1045: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:24 smithi137 ceph-mon[88869]: pgmap v1046: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:24.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:59:24.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:24 smithi137 ceph-mon[91314]: pgmap v1046: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:24.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:59:24.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:24 smithi203 ceph-mon[85573]: pgmap v1046: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:24.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:59:25.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:59:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:59:25] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:59:26.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:26 smithi137 ceph-mon[88869]: pgmap v1047: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:26.292 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:26 smithi137 ceph-mon[91314]: pgmap v1047: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:26.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:26 smithi203 ceph-mon[85573]: pgmap v1047: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:28.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:28 smithi137 ceph-mon[88869]: pgmap v1048: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:28.292 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:28 smithi137 ceph-mon[91314]: pgmap v1048: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:28.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:28 smithi203 ceph-mon[85573]: pgmap v1048: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:30.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:30 smithi137 ceph-mon[88869]: pgmap v1049: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:30.292 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:30 smithi137 ceph-mon[91314]: pgmap v1049: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:30.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:30 smithi203 ceph-mon[85573]: pgmap v1049: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:31.018 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:59:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:59:32.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:32 smithi137 ceph-mon[88869]: pgmap v1050: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:32.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:32 smithi137 ceph-mon[91314]: pgmap v1050: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:32.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:32 smithi203 ceph-mon[85573]: pgmap v1050: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:33.104 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:59:33.106 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:59:33.781 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1051,"stamp":"2024-03-04T06:59:32.539509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003797"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534568+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:56:19.534568+0000","last_peered":"2024-03-04T06:56:19.534568+0000","last_clean":"2024-03-04T06:56:19.534568+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:56:19.534568+0000","last_undegraded":"2024-03-04T06:56:19.534568+0000","last_fullsized":"2024-03-04T06:56:19.534568+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151921+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:56:58.151921+0000","last_peered":"2024-03-04T06:56:58.151921+0000","last_clean":"2024-03-04T06:56:58.151921+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:56:58.151921+0000","last_undegraded":"2024-03-04T06:56:58.151921+0000","last_fullsized":"2024-03-04T06:56:58.151921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992691+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:56:22.992691+0000","last_peered":"2024-03-04T06:56:22.992691+0000","last_clean":"2024-03-04T06:56:22.992691+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:56:22.992691+0000","last_undegraded":"2024-03-04T06:56:22.992691+0000","last_fullsized":"2024-03-04T06:56:22.992691+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:52.944862+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:56:52.944862+0000","last_peered":"2024-03-04T06:56:52.944862+0000","last_clean":"2024-03-04T06:56:52.944862+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:56:52.944862+0000","last_undegraded":"2024-03-04T06:56:52.944862+0000","last_fullsized":"2024-03-04T06:56:52.944862+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102005+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.102005+0000","last_peered":"2024-03-04T06:55:13.102005+0000","last_clean":"2024-03-04T06:55:13.102005+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.102005+0000","last_undegraded":"2024-03-04T06:55:13.102005+0000","last_fullsized":"2024-03-04T06:55:13.102005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941144+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:56:22.941144+0000","last_peered":"2024-03-04T06:56:22.941144+0000","last_clean":"2024-03-04T06:56:22.941144+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:56:22.941144+0000","last_undegraded":"2024-03-04T06:56:22.941144+0000","last_fullsized":"2024-03-04T06:56:22.941144+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101809+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101809+0000","last_peered":"2024-03-04T06:55:13.101809+0000","last_clean":"2024-03-04T06:55:13.101809+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101809+0000","last_undegraded":"2024-03-04T06:55:13.101809+0000","last_fullsized":"2024-03-04T06:55:13.101809+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984614+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:14.984614+0000","last_peered":"2024-03-04T06:55:14.984614+0000","last_clean":"2024-03-04T06:55:14.984614+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:14.984614+0000","last_undegraded":"2024-03-04T06:55:14.984614+0000","last_fullsized":"2024-03-04T06:55:14.984614+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1064,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103046+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.103046+0000","last_peered":"2024-03-04T06:55:13.103046+0000","last_clean":"2024-03-04T06:55:13.103046+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.103046+0000","last_undegraded":"2024-03-04T06:55:13.103046+0000","last_fullsized":"2024-03-04T06:55:13.103046+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223356+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:56:43.223356+0000","last_peered":"2024-03-04T06:56:43.223356+0000","last_clean":"2024-03-04T06:56:43.223356+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:56:43.223356+0000","last_undegraded":"2024-03-04T06:56:43.223356+0000","last_fullsized":"2024-03-04T06:56:43.223356+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223323+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:56:43.223323+0000","last_peered":"2024-03-04T06:56:43.223323+0000","last_clean":"2024-03-04T06:56:43.223323+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:56:43.223323+0000","last_undegraded":"2024-03-04T06:56:43.223323+0000","last_fullsized":"2024-03-04T06:56:43.223323+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:32.604419+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:32.604419+0000","last_peered":"2024-03-04T06:55:32.604419+0000","last_clean":"2024-03-04T06:55:32.604419+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:32.604419+0000","last_undegraded":"2024-03-04T06:55:32.604419+0000","last_fullsized":"2024-03-04T06:55:32.604419+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.099013+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.099013+0000","last_peered":"2024-03-04T06:55:13.099013+0000","last_clean":"2024-03-04T06:55:13.099013+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.099013+0000","last_undegraded":"2024-03-04T06:55:13.099013+0000","last_fullsized":"2024-03-04T06:55:13.099013+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985446+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:17.985446+0000","last_peered":"2024-03-04T06:55:17.985446+0000","last_clean":"2024-03-04T06:55:17.985446+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:17.985446+0000","last_undegraded":"2024-03-04T06:55:17.985446+0000","last_fullsized":"2024-03-04T06:55:17.985446+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:53.145282+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:53.145282+0000","last_peered":"2024-03-04T06:55:53.145282+0000","last_clean":"2024-03-04T06:55:53.145282+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:53.145282+0000","last_undegraded":"2024-03-04T06:55:53.145282+0000","last_fullsized":"2024-03-04T06:55:53.145282+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937387+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:52.937387+0000","last_peered":"2024-03-04T06:55:52.937387+0000","last_clean":"2024-03-04T06:55:52.937387+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:52.937387+0000","last_undegraded":"2024-03-04T06:55:52.937387+0000","last_fullsized":"2024-03-04T06:55:52.937387+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937465+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:52.937465+0000","last_peered":"2024-03-04T06:55:52.937465+0000","last_clean":"2024-03-04T06:55:52.937465+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:52.937465+0000","last_undegraded":"2024-03-04T06:55:52.937465+0000","last_fullsized":"2024-03-04T06:55:52.937465+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382095+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:56:28.382095+0000","last_peered":"2024-03-04T06:56:28.382095+0000","last_clean":"2024-03-04T06:56:28.382095+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:56:28.382095+0000","last_undegraded":"2024-03-04T06:56:28.382095+0000","last_fullsized":"2024-03-04T06:56:28.382095+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538587+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:56:49.538587+0000","last_peered":"2024-03-04T06:56:49.538587+0000","last_clean":"2024-03-04T06:56:49.538587+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:56:49.538587+0000","last_undegraded":"2024-03-04T06:56:49.538587+0000","last_fullsized":"2024-03-04T06:56:49.538587+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1305,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992748+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:56:22.992748+0000","last_peered":"2024-03-04T06:56:22.992748+0000","last_clean":"2024-03-04T06:56:22.992748+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:56:22.992748+0000","last_undegraded":"2024-03-04T06:56:22.992748+0000","last_fullsized":"2024-03-04T06:56:22.992748+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988343+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:44.988343+0000","last_peered":"2024-03-04T06:55:44.988343+0000","last_clean":"2024-03-04T06:55:44.988343+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:44.988343+0000","last_undegraded":"2024-03-04T06:55:44.988343+0000","last_fullsized":"2024-03-04T06:55:44.988343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988353+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:44.988353+0000","last_peered":"2024-03-04T06:55:44.988353+0000","last_clean":"2024-03-04T06:55:44.988353+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:44.988353+0000","last_undegraded":"2024-03-04T06:55:44.988353+0000","last_fullsized":"2024-03-04T06:55:44.988353+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992731+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:56:22.992731+0000","last_peered":"2024-03-04T06:56:22.992731+0000","last_clean":"2024-03-04T06:56:22.992731+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:56:22.992731+0000","last_undegraded":"2024-03-04T06:56:22.992731+0000","last_fullsized":"2024-03-04T06:56:22.992731+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1234,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.098569+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:55:13.098569+0000","last_peered":"2024-03-04T06:55:13.098569+0000","last_clean":"2024-03-04T06:55:13.098569+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:55:13.098569+0000","last_undegraded":"2024-03-04T06:55:13.098569+0000","last_fullsized":"2024-03-04T06:55:13.098569+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1221,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097506+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:55:13.097506+0000","last_peered":"2024-03-04T06:55:13.097506+0000","last_clean":"2024-03-04T06:55:13.097506+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:55:13.097506+0000","last_undegraded":"2024-03-04T06:55:13.097506+0000","last_fullsized":"2024-03-04T06:55:13.097506+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102499+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102499+0000","last_peered":"2024-03-04T06:55:13.102499+0000","last_clean":"2024-03-04T06:55:13.102499+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102499+0000","last_undegraded":"2024-03-04T06:55:13.102499+0000","last_fullsized":"2024-03-04T06:55:13.102499+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941175+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:56:22.941175+0000","last_peered":"2024-03-04T06:56:22.941175+0000","last_clean":"2024-03-04T06:56:22.941175+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:56:22.941175+0000","last_undegraded":"2024-03-04T06:56:22.941175+0000","last_fullsized":"2024-03-04T06:56:22.941175+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984673+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:14.984673+0000","last_peered":"2024-03-04T06:55:14.984673+0000","last_clean":"2024-03-04T06:55:14.984673+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:14.984673+0000","last_undegraded":"2024-03-04T06:55:14.984673+0000","last_fullsized":"2024-03-04T06:55:14.984673+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1189,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:47.606038+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:47.606038+0000","last_peered":"2024-03-04T06:55:47.606038+0000","last_clean":"2024-03-04T06:55:47.606038+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:47.606038+0000","last_undegraded":"2024-03-04T06:55:47.606038+0000","last_fullsized":"2024-03-04T06:55:47.606038+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.224901+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:56:58.224901+0000","last_peered":"2024-03-04T06:56:58.224901+0000","last_clean":"2024-03-04T06:56:58.224901+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:56:58.224901+0000","last_undegraded":"2024-03-04T06:56:58.224901+0000","last_fullsized":"2024-03-04T06:56:58.224901+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:57.989954+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:57.989954+0000","last_peered":"2024-03-04T06:55:57.989954+0000","last_clean":"2024-03-04T06:55:57.989954+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:57.989954+0000","last_undegraded":"2024-03-04T06:55:57.989954+0000","last_fullsized":"2024-03-04T06:55:57.989954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096734+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096734+0000","last_peered":"2024-03-04T06:55:13.096734+0000","last_clean":"2024-03-04T06:55:13.096734+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096734+0000","last_undegraded":"2024-03-04T06:55:13.096734+0000","last_fullsized":"2024-03-04T06:55:13.096734+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097225+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097225+0000","last_peered":"2024-03-04T06:55:13.097225+0000","last_clean":"2024-03-04T06:55:13.097225+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097225+0000","last_undegraded":"2024-03-04T06:55:13.097225+0000","last_fullsized":"2024-03-04T06:55:13.097225+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939306+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:56:07.939306+0000","last_peered":"2024-03-04T06:56:07.939306+0000","last_clean":"2024-03-04T06:56:07.939306+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:56:07.939306+0000","last_undegraded":"2024-03-04T06:56:07.939306+0000","last_fullsized":"2024-03-04T06:56:07.939306+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147156+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:56:13.147156+0000","last_peered":"2024-03-04T06:56:13.147156+0000","last_clean":"2024-03-04T06:56:13.147156+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:56:13.147156+0000","last_undegraded":"2024-03-04T06:56:13.147156+0000","last_fullsized":"2024-03-04T06:56:13.147156+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223376+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:56:43.223376+0000","last_peered":"2024-03-04T06:56:43.223376+0000","last_clean":"2024-03-04T06:56:43.223376+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:56:43.223376+0000","last_undegraded":"2024-03-04T06:56:43.223376+0000","last_fullsized":"2024-03-04T06:56:43.223376+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939379+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:56:07.939379+0000","last_peered":"2024-03-04T06:56:07.939379+0000","last_clean":"2024-03-04T06:56:07.939379+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:56:07.939379+0000","last_undegraded":"2024-03-04T06:56:07.939379+0000","last_fullsized":"2024-03-04T06:56:07.939379+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939364+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:56:07.939364+0000","last_peered":"2024-03-04T06:56:07.939364+0000","last_clean":"2024-03-04T06:56:07.939364+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:56:07.939364+0000","last_undegraded":"2024-03-04T06:56:07.939364+0000","last_fullsized":"2024-03-04T06:56:07.939364+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.988031+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:37.988031+0000","last_peered":"2024-03-04T06:55:37.988031+0000","last_clean":"2024-03-04T06:55:37.988031+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:37.988031+0000","last_undegraded":"2024-03-04T06:55:37.988031+0000","last_fullsized":"2024-03-04T06:55:37.988031+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147207+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:56:13.147207+0000","last_peered":"2024-03-04T06:56:13.147207+0000","last_clean":"2024-03-04T06:56:13.147207+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:56:13.147207+0000","last_undegraded":"2024-03-04T06:56:13.147207+0000","last_fullsized":"2024-03-04T06:56:13.147207+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.602395+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:17.602395+0000","last_peered":"2024-03-04T06:55:17.602395+0000","last_clean":"2024-03-04T06:55:17.602395+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:17.602395+0000","last_undegraded":"2024-03-04T06:55:17.602395+0000","last_fullsized":"2024-03-04T06:55:17.602395+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1130,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221797+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:56:28.221797+0000","last_peered":"2024-03-04T06:56:28.221797+0000","last_clean":"2024-03-04T06:56:28.221797+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:56:28.221797+0000","last_undegraded":"2024-03-04T06:56:28.221797+0000","last_fullsized":"2024-03-04T06:56:28.221797+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102665+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102665+0000","last_peered":"2024-03-04T06:55:13.102665+0000","last_clean":"2024-03-04T06:55:13.102665+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102665+0000","last_undegraded":"2024-03-04T06:55:13.102665+0000","last_fullsized":"2024-03-04T06:55:13.102665+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1302,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985489+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:17.985489+0000","last_peered":"2024-03-04T06:55:17.985489+0000","last_clean":"2024-03-04T06:55:17.985489+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:17.985489+0000","last_undegraded":"2024-03-04T06:55:17.985489+0000","last_fullsized":"2024-03-04T06:55:17.985489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382052+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:56:28.382052+0000","last_peered":"2024-03-04T06:56:28.382052+0000","last_clean":"2024-03-04T06:56:28.382052+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:56:28.382052+0000","last_undegraded":"2024-03-04T06:56:28.382052+0000","last_fullsized":"2024-03-04T06:56:28.382052+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937420+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:52.937420+0000","last_peered":"2024-03-04T06:55:52.937420+0000","last_clean":"2024-03-04T06:55:52.937420+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:52.937420+0000","last_undegraded":"2024-03-04T06:55:52.937420+0000","last_fullsized":"2024-03-04T06:55:52.937420+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540167+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:57:04.540167+0000","last_peered":"2024-03-04T06:57:04.540167+0000","last_clean":"2024-03-04T06:57:04.540167+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:57:04.540167+0000","last_undegraded":"2024-03-04T06:57:04.540167+0000","last_fullsized":"2024-03-04T06:57:04.540167+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221752+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:56:28.221752+0000","last_peered":"2024-03-04T06:56:28.221752+0000","last_clean":"2024-03-04T06:56:28.221752+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:56:28.221752+0000","last_undegraded":"2024-03-04T06:56:28.221752+0000","last_fullsized":"2024-03-04T06:56:28.221752+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221703+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:56:28.221703+0000","last_peered":"2024-03-04T06:56:28.221703+0000","last_clean":"2024-03-04T06:56:28.221703+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:56:28.221703+0000","last_undegraded":"2024-03-04T06:56:28.221703+0000","last_fullsized":"2024-03-04T06:56:28.221703+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1253,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382011+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:56:28.382011+0000","last_peered":"2024-03-04T06:56:28.382011+0000","last_clean":"2024-03-04T06:56:28.382011+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:56:28.382011+0000","last_undegraded":"2024-03-04T06:56:28.382011+0000","last_fullsized":"2024-03-04T06:56:28.382011+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540129+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:57:04.540129+0000","last_peered":"2024-03-04T06:57:04.540129+0000","last_clean":"2024-03-04T06:57:04.540129+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:57:04.540129+0000","last_undegraded":"2024-03-04T06:57:04.540129+0000","last_fullsized":"2024-03-04T06:57:04.540129+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3577,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377824+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:48.377824+0000","last_peered":"2024-03-04T06:55:48.377824+0000","last_clean":"2024-03-04T06:55:48.377824+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:48.377824+0000","last_undegraded":"2024-03-04T06:55:48.377824+0000","last_fullsized":"2024-03-04T06:55:48.377824+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096992+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:55:13.096992+0000","last_peered":"2024-03-04T06:55:13.096992+0000","last_clean":"2024-03-04T06:55:13.096992+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:55:13.096992+0000","last_undegraded":"2024-03-04T06:55:13.096992+0000","last_fullsized":"2024-03-04T06:55:13.096992+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:56:49.538613+0000","last_peered":"2024-03-04T06:56:49.538613+0000","last_clean":"2024-03-04T06:56:49.538613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:56:49.538613+0000","last_undegraded":"2024-03-04T06:56:49.538613+0000","last_fullsized":"2024-03-04T06:56:49.538613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17116,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992661+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:56:22.992661+0000","last_peered":"2024-03-04T06:56:22.992661+0000","last_clean":"2024-03-04T06:56:22.992661+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:56:22.992661+0000","last_undegraded":"2024-03-04T06:56:22.992661+0000","last_fullsized":"2024-03-04T06:56:22.992661+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151860+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:56:58.151860+0000","last_peered":"2024-03-04T06:56:58.151860+0000","last_clean":"2024-03-04T06:56:58.151860+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:56:58.151860+0000","last_undegraded":"2024-03-04T06:56:58.151860+0000","last_fullsized":"2024-03-04T06:56:58.151860+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151904+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:56:58.151904+0000","last_peered":"2024-03-04T06:56:58.151904+0000","last_clean":"2024-03-04T06:56:58.151904+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:56:58.151904+0000","last_undegraded":"2024-03-04T06:56:58.151904+0000","last_fullsized":"2024-03-04T06:56:58.151904+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947110+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:57:12.947110+0000","last_peered":"2024-03-04T06:57:12.947110+0000","last_clean":"2024-03-04T06:57:12.947110+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:57:12.947110+0000","last_undegraded":"2024-03-04T06:57:12.947110+0000","last_fullsized":"2024-03-04T06:57:12.947110+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4386,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992700+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:56:22.992700+0000","last_peered":"2024-03-04T06:56:22.992700+0000","last_clean":"2024-03-04T06:56:22.992700+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:56:22.992700+0000","last_undegraded":"2024-03-04T06:56:22.992700+0000","last_fullsized":"2024-03-04T06:56:22.992700+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151882+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:56:58.151882+0000","last_peered":"2024-03-04T06:56:58.151882+0000","last_clean":"2024-03-04T06:56:58.151882+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:56:58.151882+0000","last_undegraded":"2024-03-04T06:56:58.151882+0000","last_fullsized":"2024-03-04T06:56:58.151882+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947055+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:57:12.947055+0000","last_peered":"2024-03-04T06:57:12.947055+0000","last_clean":"2024-03-04T06:57:12.947055+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:57:12.947055+0000","last_undegraded":"2024-03-04T06:57:12.947055+0000","last_fullsized":"2024-03-04T06:57:12.947055+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611663+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:56:37.611663+0000","last_peered":"2024-03-04T06:56:37.611663+0000","last_clean":"2024-03-04T06:56:37.611663+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:56:37.611663+0000","last_undegraded":"2024-03-04T06:56:37.611663+0000","last_fullsized":"2024-03-04T06:56:37.611663+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5639,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377937+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:48.377937+0000","last_peered":"2024-03-04T06:55:48.377937+0000","last_clean":"2024-03-04T06:55:48.377937+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:48.377937+0000","last_undegraded":"2024-03-04T06:55:48.377937+0000","last_fullsized":"2024-03-04T06:55:48.377937+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141294+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:55:13.141294+0000","last_peered":"2024-03-04T06:55:13.141294+0000","last_clean":"2024-03-04T06:55:13.141294+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:55:13.141294+0000","last_undegraded":"2024-03-04T06:55:13.141294+0000","last_fullsized":"2024-03-04T06:55:13.141294+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:33.149241+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:56:33.149241+0000","last_peered":"2024-03-04T06:56:33.149241+0000","last_clean":"2024-03-04T06:56:33.149241+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:56:33.149241+0000","last_undegraded":"2024-03-04T06:56:33.149241+0000","last_fullsized":"2024-03-04T06:56:33.149241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375859+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:55:28.375859+0000","last_peered":"2024-03-04T06:55:28.375859+0000","last_clean":"2024-03-04T06:55:28.375859+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:55:28.375859+0000","last_undegraded":"2024-03-04T06:55:28.375859+0000","last_fullsized":"2024-03-04T06:55:28.375859+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4015,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:19.534498+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:56:19.534498+0000","last_peered":"2024-03-04T06:56:19.534498+0000","last_clean":"2024-03-04T06:56:19.534498+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:56:19.534498+0000","last_undegraded":"2024-03-04T06:56:19.534498+0000","last_fullsized":"2024-03-04T06:56:19.534498+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.217050+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:43.217050+0000","last_peered":"2024-03-04T06:55:43.217050+0000","last_clean":"2024-03-04T06:55:43.217050+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:43.217050+0000","last_undegraded":"2024-03-04T06:55:43.217050+0000","last_fullsized":"2024-03-04T06:55:43.217050+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.990790+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:56:04.990790+0000","last_peered":"2024-03-04T06:56:04.990790+0000","last_clean":"2024-03-04T06:56:04.990790+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:56:04.990790+0000","last_undegraded":"2024-03-04T06:56:04.990790+0000","last_fullsized":"2024-03-04T06:56:04.990790+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947097+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:57:12.947097+0000","last_peered":"2024-03-04T06:57:12.947097+0000","last_clean":"2024-03-04T06:57:12.947097+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:57:12.947097+0000","last_undegraded":"2024-03-04T06:57:12.947097+0000","last_fullsized":"2024-03-04T06:57:12.947097+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1550,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532802+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:56:04.532802+0000","last_peered":"2024-03-04T06:56:04.532802+0000","last_clean":"2024-03-04T06:56:04.532802+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:56:04.532802+0000","last_undegraded":"2024-03-04T06:56:04.532802+0000","last_fullsized":"2024-03-04T06:56:04.532802+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3950,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933655+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:55:22.933655+0000","last_peered":"2024-03-04T06:55:22.933655+0000","last_clean":"2024-03-04T06:55:22.933655+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:55:22.933655+0000","last_undegraded":"2024-03-04T06:55:22.933655+0000","last_fullsized":"2024-03-04T06:55:22.933655+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995396+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:56:47.995396+0000","last_peered":"2024-03-04T06:56:47.995396+0000","last_clean":"2024-03-04T06:56:47.995396+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:56:47.995396+0000","last_undegraded":"2024-03-04T06:56:47.995396+0000","last_fullsized":"2024-03-04T06:56:47.995396+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375833+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:55:28.375833+0000","last_peered":"2024-03-04T06:55:28.375833+0000","last_clean":"2024-03-04T06:55:28.375833+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:55:28.375833+0000","last_undegraded":"2024-03-04T06:55:28.375833+0000","last_fullsized":"2024-03-04T06:55:28.375833+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532768+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:56:04.532768+0000","last_peered":"2024-03-04T06:56:04.532768+0000","last_clean":"2024-03-04T06:56:04.532768+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:56:04.532768+0000","last_undegraded":"2024-03-04T06:56:04.532768+0000","last_fullsized":"2024-03-04T06:56:04.532768+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15291,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:43.217015+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:43.217015+0000","last_peered":"2024-03-04T06:55:43.217015+0000","last_clean":"2024-03-04T06:55:43.217015+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:43.217015+0000","last_undegraded":"2024-03-04T06:55:43.217015+0000","last_fullsized":"2024-03-04T06:55:43.217015+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992678+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:56:22.992678+0000","last_peered":"2024-03-04T06:56:22.992678+0000","last_clean":"2024-03-04T06:56:22.992678+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:56:22.992678+0000","last_undegraded":"2024-03-04T06:56:22.992678+0000","last_fullsized":"2024-03-04T06:56:22.992678+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534547+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:56:19.534547+0000","last_peered":"2024-03-04T06:56:19.534547+0000","last_clean":"2024-03-04T06:56:19.534547+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:56:19.534547+0000","last_undegraded":"2024-03-04T06:56:19.534547+0000","last_fullsized":"2024-03-04T06:56:19.534547+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151891+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:56:58.151891+0000","last_peered":"2024-03-04T06:56:58.151891+0000","last_clean":"2024-03-04T06:56:58.151891+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:56:58.151891+0000","last_undegraded":"2024-03-04T06:56:58.151891+0000","last_fullsized":"2024-03-04T06:56:58.151891+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4379,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:37.611623+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:56:37.611623+0000","last_peered":"2024-03-04T06:56:37.611623+0000","last_clean":"2024-03-04T06:56:37.611623+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:56:37.611623+0000","last_undegraded":"2024-03-04T06:56:37.611623+0000","last_fullsized":"2024-03-04T06:56:37.611623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988300+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:44.988300+0000","last_peered":"2024-03-04T06:55:44.988300+0000","last_clean":"2024-03-04T06:55:44.988300+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:44.988300+0000","last_undegraded":"2024-03-04T06:55:44.988300+0000","last_fullsized":"2024-03-04T06:55:44.988300+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141284+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:55:13.141284+0000","last_peered":"2024-03-04T06:55:13.141284+0000","last_clean":"2024-03-04T06:55:13.141284+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:55:13.141284+0000","last_undegraded":"2024-03-04T06:55:13.141284+0000","last_fullsized":"2024-03-04T06:55:13.141284+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992884+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:56:24.992884+0000","last_peered":"2024-03-04T06:56:24.992884+0000","last_clean":"2024-03-04T06:56:24.992884+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:56:24.992884+0000","last_undegraded":"2024-03-04T06:56:24.992884+0000","last_fullsized":"2024-03-04T06:56:24.992884+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4609,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:44.988263+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:44.988263+0000","last_peered":"2024-03-04T06:55:44.988263+0000","last_clean":"2024-03-04T06:55:44.988263+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:44.988263+0000","last_undegraded":"2024-03-04T06:55:44.988263+0000","last_fullsized":"2024-03-04T06:55:44.988263+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611593+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:56:37.611593+0000","last_peered":"2024-03-04T06:56:37.611593+0000","last_clean":"2024-03-04T06:56:37.611593+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:56:37.611593+0000","last_undegraded":"2024-03-04T06:56:37.611593+0000","last_fullsized":"2024-03-04T06:56:37.611593+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1078,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218837+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:58.218837+0000","last_peered":"2024-03-04T06:55:58.218837+0000","last_clean":"2024-03-04T06:55:58.218837+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:58.218837+0000","last_undegraded":"2024-03-04T06:55:58.218837+0000","last_fullsized":"2024-03-04T06:55:58.218837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995375+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:56:47.995375+0000","last_peered":"2024-03-04T06:56:47.995375+0000","last_clean":"2024-03-04T06:56:47.995375+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:56:47.995375+0000","last_undegraded":"2024-03-04T06:56:47.995375+0000","last_fullsized":"2024-03-04T06:56:47.995375+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4634,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:37.935758+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:37.935758+0000","last_peered":"2024-03-04T06:55:37.935758+0000","last_clean":"2024-03-04T06:55:37.935758+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:37.935758+0000","last_undegraded":"2024-03-04T06:55:37.935758+0000","last_fullsized":"2024-03-04T06:55:37.935758+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:34.536591+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:56:34.536591+0000","last_peered":"2024-03-04T06:56:34.536591+0000","last_clean":"2024-03-04T06:56:34.536591+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:56:34.536591+0000","last_undegraded":"2024-03-04T06:56:34.536591+0000","last_fullsized":"2024-03-04T06:56:34.536591+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1185,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:57.614016+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:56:57.614016+0000","last_peered":"2024-03-04T06:56:57.614016+0000","last_clean":"2024-03-04T06:56:57.614016+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:56:57.614016+0000","last_undegraded":"2024-03-04T06:56:57.614016+0000","last_fullsized":"2024-03-04T06:56:57.614016+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5157,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:13.113366+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:55:13.113366+0000","last_peered":"2024-03-04T06:55:13.113366+0000","last_clean":"2024-03-04T06:55:13.113366+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:55:13.113366+0000","last_undegraded":"2024-03-04T06:55:13.113366+0000","last_fullsized":"2024-03-04T06:55:13.113366+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141219+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:55:13.141219+0000","last_peered":"2024-03-04T06:55:13.141219+0000","last_clean":"2024-03-04T06:55:13.141219+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:55:13.141219+0000","last_undegraded":"2024-03-04T06:55:13.141219+0000","last_fullsized":"2024-03-04T06:55:13.141219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992810+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:56:24.992810+0000","last_peered":"2024-03-04T06:56:24.992810+0000","last_clean":"2024-03-04T06:56:24.992810+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:56:24.992810+0000","last_undegraded":"2024-03-04T06:56:24.992810+0000","last_fullsized":"2024-03-04T06:56:24.992810+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4719,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380021+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:56:08.380021+0000","last_peered":"2024-03-04T06:56:08.380021+0000","last_clean":"2024-03-04T06:56:08.380021+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:56:08.380021+0000","last_undegraded":"2024-03-04T06:56:08.380021+0000","last_fullsized":"2024-03-04T06:56:08.380021+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141246+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:55:13.141246+0000","last_peered":"2024-03-04T06:55:13.141246+0000","last_clean":"2024-03-04T06:55:13.141246+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:55:13.141246+0000","last_undegraded":"2024-03-04T06:55:13.141246+0000","last_fullsized":"2024-03-04T06:55:13.141246+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994937+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:56:44.994937+0000","last_peered":"2024-03-04T06:56:44.994937+0000","last_clean":"2024-03-04T06:56:44.994937+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:56:44.994937+0000","last_undegraded":"2024-03-04T06:56:44.994937+0000","last_fullsized":"2024-03-04T06:56:44.994937+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5554,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:33.143474+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:33.143474+0000","last_peered":"2024-03-04T06:55:33.143474+0000","last_clean":"2024-03-04T06:55:33.143474+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:33.143474+0000","last_undegraded":"2024-03-04T06:55:33.143474+0000","last_fullsized":"2024-03-04T06:55:33.143474+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:56:49.538554+0000","last_peered":"2024-03-04T06:56:49.538554+0000","last_clean":"2024-03-04T06:56:49.538554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:56:49.538554+0000","last_undegraded":"2024-03-04T06:56:49.538554+0000","last_fullsized":"2024-03-04T06:56:49.538554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218784+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:58.218784+0000","last_peered":"2024-03-04T06:55:58.218784+0000","last_clean":"2024-03-04T06:55:58.218784+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:58.218784+0000","last_undegraded":"2024-03-04T06:55:58.218784+0000","last_fullsized":"2024-03-04T06:55:58.218784+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.379963+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:56:08.379963+0000","last_peered":"2024-03-04T06:56:08.379963+0000","last_clean":"2024-03-04T06:56:08.379963+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:56:08.379963+0000","last_undegraded":"2024-03-04T06:56:08.379963+0000","last_fullsized":"2024-03-04T06:56:08.379963+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380005+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:56:08.380005+0000","last_peered":"2024-03-04T06:56:08.380005+0000","last_clean":"2024-03-04T06:56:08.380005+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:56:08.380005+0000","last_undegraded":"2024-03-04T06:56:08.380005+0000","last_fullsized":"2024-03-04T06:56:08.380005+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:56:49.538599+0000","last_peered":"2024-03-04T06:56:49.538599+0000","last_clean":"2024-03-04T06:56:49.538599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:56:49.538599+0000","last_undegraded":"2024-03-04T06:56:49.538599+0000","last_fullsized":"2024-03-04T06:56:49.538599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4366,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377880+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:48.377880+0000","last_peered":"2024-03-04T06:55:48.377880+0000","last_clean":"2024-03-04T06:55:48.377880+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:48.377880+0000","last_undegraded":"2024-03-04T06:55:48.377880+0000","last_fullsized":"2024-03-04T06:55:48.377880+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:33.143531+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:33.143531+0000","last_peered":"2024-03-04T06:55:33.143531+0000","last_clean":"2024-03-04T06:55:33.143531+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:33.143531+0000","last_undegraded":"2024-03-04T06:55:33.143531+0000","last_fullsized":"2024-03-04T06:55:33.143531+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935733+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:37.935733+0000","last_peered":"2024-03-04T06:55:37.935733+0000","last_clean":"2024-03-04T06:55:37.935733+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:37.935733+0000","last_undegraded":"2024-03-04T06:55:37.935733+0000","last_fullsized":"2024-03-04T06:55:37.935733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4600,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:34.536621+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:56:34.536621+0000","last_peered":"2024-03-04T06:56:34.536621+0000","last_clean":"2024-03-04T06:56:34.536621+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:56:34.536621+0000","last_undegraded":"2024-03-04T06:56:34.536621+0000","last_fullsized":"2024-03-04T06:56:34.536621+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1245,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380055+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:56:08.380055+0000","last_peered":"2024-03-04T06:56:08.380055+0000","last_clean":"2024-03-04T06:56:08.380055+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:56:08.380055+0000","last_undegraded":"2024-03-04T06:56:08.380055+0000","last_fullsized":"2024-03-04T06:56:08.380055+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538627+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:56:49.538627+0000","last_peered":"2024-03-04T06:56:49.538627+0000","last_clean":"2024-03-04T06:56:49.538627+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:56:49.538627+0000","last_undegraded":"2024-03-04T06:56:49.538627+0000","last_fullsized":"2024-03-04T06:56:49.538627+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.216983+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:43.216983+0000","last_peered":"2024-03-04T06:55:43.216983+0000","last_clean":"2024-03-04T06:55:43.216983+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:43.216983+0000","last_undegraded":"2024-03-04T06:55:43.216983+0000","last_fullsized":"2024-03-04T06:55:43.216983+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:28.375870+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:55:28.375870+0000","last_peered":"2024-03-04T06:55:28.375870+0000","last_clean":"2024-03-04T06:55:28.375870+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:55:28.375870+0000","last_undegraded":"2024-03-04T06:55:28.375870+0000","last_fullsized":"2024-03-04T06:55:28.375870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947082+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:57:12.947082+0000","last_peered":"2024-03-04T06:57:12.947082+0000","last_clean":"2024-03-04T06:57:12.947082+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:57:12.947082+0000","last_undegraded":"2024-03-04T06:57:12.947082+0000","last_fullsized":"2024-03-04T06:57:12.947082+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992636+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:56:22.992636+0000","last_peered":"2024-03-04T06:56:22.992636+0000","last_clean":"2024-03-04T06:56:22.992636+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:56:22.992636+0000","last_undegraded":"2024-03-04T06:56:22.992636+0000","last_fullsized":"2024-03-04T06:56:22.992636+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992858+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:56:24.992858+0000","last_peered":"2024-03-04T06:56:24.992858+0000","last_clean":"2024-03-04T06:56:24.992858+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:56:24.992858+0000","last_undegraded":"2024-03-04T06:56:24.992858+0000","last_fullsized":"2024-03-04T06:56:24.992858+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.141268+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:55:13.141268+0000","last_peered":"2024-03-04T06:55:13.141268+0000","last_clean":"2024-03-04T06:55:13.141268+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:55:13.141268+0000","last_undegraded":"2024-03-04T06:55:13.141268+0000","last_fullsized":"2024-03-04T06:55:13.141268+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218825+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:58.218825+0000","last_peered":"2024-03-04T06:55:58.218825+0000","last_clean":"2024-03-04T06:55:58.218825+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:58.218825+0000","last_undegraded":"2024-03-04T06:55:58.218825+0000","last_fullsized":"2024-03-04T06:55:58.218825+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992900+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:56:24.992900+0000","last_peered":"2024-03-04T06:56:24.992900+0000","last_clean":"2024-03-04T06:56:24.992900+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:56:24.992900+0000","last_undegraded":"2024-03-04T06:56:24.992900+0000","last_fullsized":"2024-03-04T06:56:24.992900+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1145,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:22.933591+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:55:22.933591+0000","last_peered":"2024-03-04T06:55:22.933591+0000","last_clean":"2024-03-04T06:55:22.933591+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:55:22.933591+0000","last_undegraded":"2024-03-04T06:55:22.933591+0000","last_fullsized":"2024-03-04T06:55:22.933591+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994907+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:56:44.994907+0000","last_peered":"2024-03-04T06:56:44.994907+0000","last_clean":"2024-03-04T06:56:44.994907+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:56:44.994907+0000","last_undegraded":"2024-03-04T06:56:44.994907+0000","last_fullsized":"2024-03-04T06:56:44.994907+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1120,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935684+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:37.935684+0000","last_peered":"2024-03-04T06:55:37.935684+0000","last_clean":"2024-03-04T06:55:37.935684+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:37.935684+0000","last_undegraded":"2024-03-04T06:55:37.935684+0000","last_fullsized":"2024-03-04T06:55:37.935684+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.998327+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:57:12.998327+0000","last_peered":"2024-03-04T06:57:12.998327+0000","last_clean":"2024-03-04T06:57:12.998327+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:57:12.998327+0000","last_undegraded":"2024-03-04T06:57:12.998327+0000","last_fullsized":"2024-03-04T06:57:12.998327+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.220345+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:56:13.220345+0000","last_peered":"2024-03-04T06:56:13.220345+0000","last_clean":"2024-03-04T06:56:13.220345+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:56:13.220345+0000","last_undegraded":"2024-03-04T06:56:13.220345+0000","last_fullsized":"2024-03-04T06:56:13.220345+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503474,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648121,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142428,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287075,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997781,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885838,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937415,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792768,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:59:33.786 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:33.786 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:33.786 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:33.786 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:33.786 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:33.786 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:33.786 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:33.786 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:33.786 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:33.786 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:33.786 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:59:34.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:34 smithi137 ceph-mon[88869]: pgmap v1051: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:34.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:34 smithi137 ceph-mon[88869]: from='client.34617 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:59:34.292 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:34 smithi137 ceph-mon[91314]: pgmap v1051: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:34.292 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:34 smithi137 ceph-mon[91314]: from='client.34617 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:59:34.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:34 smithi203 ceph-mon[85573]: pgmap v1051: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:34.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:34 smithi203 ceph-mon[85573]: from='client.34617 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:59:35.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:59:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:59:35] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T06:59:36.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:36 smithi137 ceph-mon[88869]: pgmap v1052: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:36.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:36 smithi137 ceph-mon[91314]: pgmap v1052: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:36.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:36 smithi203 ceph-mon[85573]: pgmap v1052: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:38.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:38 smithi137 ceph-mon[88869]: pgmap v1053: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:38.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:38 smithi137 ceph-mon[91314]: pgmap v1053: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:38.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:38 smithi203 ceph-mon[85573]: pgmap v1053: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:39.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:59:39.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:59:39.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:59:40.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:40 smithi137 ceph-mon[88869]: pgmap v1054: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:40.295 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:40 smithi137 ceph-mon[91314]: pgmap v1054: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:40.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:40 smithi203 ceph-mon[85573]: pgmap v1054: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:42.348 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:42 smithi203 ceph-mon[85573]: pgmap v1055: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:42.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:42 smithi137 ceph-mon[88869]: pgmap v1055: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:42.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:42 smithi137 ceph-mon[91314]: pgmap v1055: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:43.787 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:59:44.006 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:59:44.128 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:44 smithi137 ceph-mon[88869]: pgmap v1056: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:44.128 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:44 smithi137 ceph-mon[91314]: pgmap v1056: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:44.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:44 smithi203 ceph-mon[85573]: pgmap v1056: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:45.421 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:59:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:59:45] "GET /metrics HTTP/1.1" 200 36335 "" "Prometheus/2.43.0" 2024-03-04T06:59:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:59:45.875 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:59:46.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:46 smithi203 ceph-mon[85573]: pgmap v1057: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:46.523 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:46 smithi137 ceph-mon[88869]: pgmap v1057: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:46.523 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:46 smithi137 ceph-mon[91314]: pgmap v1057: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:46.548 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1057,"stamp":"2024-03-04T06:59:44.543326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003817"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534568+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:56:19.534568+0000","last_peered":"2024-03-04T06:56:19.534568+0000","last_clean":"2024-03-04T06:56:19.534568+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:56:19.534568+0000","last_undegraded":"2024-03-04T06:56:19.534568+0000","last_fullsized":"2024-03-04T06:56:19.534568+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151921+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:56:58.151921+0000","last_peered":"2024-03-04T06:56:58.151921+0000","last_clean":"2024-03-04T06:56:58.151921+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:56:58.151921+0000","last_undegraded":"2024-03-04T06:56:58.151921+0000","last_fullsized":"2024-03-04T06:56:58.151921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992691+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:56:22.992691+0000","last_peered":"2024-03-04T06:56:22.992691+0000","last_clean":"2024-03-04T06:56:22.992691+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:56:22.992691+0000","last_undegraded":"2024-03-04T06:56:22.992691+0000","last_fullsized":"2024-03-04T06:56:22.992691+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:52.944862+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:56:52.944862+0000","last_peered":"2024-03-04T06:56:52.944862+0000","last_clean":"2024-03-04T06:56:52.944862+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:56:52.944862+0000","last_undegraded":"2024-03-04T06:56:52.944862+0000","last_fullsized":"2024-03-04T06:56:52.944862+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102005+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.102005+0000","last_peered":"2024-03-04T06:55:13.102005+0000","last_clean":"2024-03-04T06:55:13.102005+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.102005+0000","last_undegraded":"2024-03-04T06:55:13.102005+0000","last_fullsized":"2024-03-04T06:55:13.102005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941144+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:56:22.941144+0000","last_peered":"2024-03-04T06:56:22.941144+0000","last_clean":"2024-03-04T06:56:22.941144+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:56:22.941144+0000","last_undegraded":"2024-03-04T06:56:22.941144+0000","last_fullsized":"2024-03-04T06:56:22.941144+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101809+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101809+0000","last_peered":"2024-03-04T06:55:13.101809+0000","last_clean":"2024-03-04T06:55:13.101809+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101809+0000","last_undegraded":"2024-03-04T06:55:13.101809+0000","last_fullsized":"2024-03-04T06:55:13.101809+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984614+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:14.984614+0000","last_peered":"2024-03-04T06:55:14.984614+0000","last_clean":"2024-03-04T06:55:14.984614+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:14.984614+0000","last_undegraded":"2024-03-04T06:55:14.984614+0000","last_fullsized":"2024-03-04T06:55:14.984614+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1064,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.103046+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:55:13.103046+0000","last_peered":"2024-03-04T06:55:13.103046+0000","last_clean":"2024-03-04T06:55:13.103046+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:55:13.103046+0000","last_undegraded":"2024-03-04T06:55:13.103046+0000","last_fullsized":"2024-03-04T06:55:13.103046+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223356+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:56:43.223356+0000","last_peered":"2024-03-04T06:56:43.223356+0000","last_clean":"2024-03-04T06:56:43.223356+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:56:43.223356+0000","last_undegraded":"2024-03-04T06:56:43.223356+0000","last_fullsized":"2024-03-04T06:56:43.223356+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223323+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:56:43.223323+0000","last_peered":"2024-03-04T06:56:43.223323+0000","last_clean":"2024-03-04T06:56:43.223323+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:56:43.223323+0000","last_undegraded":"2024-03-04T06:56:43.223323+0000","last_fullsized":"2024-03-04T06:56:43.223323+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:32.604419+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:32.604419+0000","last_peered":"2024-03-04T06:55:32.604419+0000","last_clean":"2024-03-04T06:55:32.604419+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:32.604419+0000","last_undegraded":"2024-03-04T06:55:32.604419+0000","last_fullsized":"2024-03-04T06:55:32.604419+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1199,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.099013+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:55:13.099013+0000","last_peered":"2024-03-04T06:55:13.099013+0000","last_clean":"2024-03-04T06:55:13.099013+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:55:13.099013+0000","last_undegraded":"2024-03-04T06:55:13.099013+0000","last_fullsized":"2024-03-04T06:55:13.099013+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985446+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:55:17.985446+0000","last_peered":"2024-03-04T06:55:17.985446+0000","last_clean":"2024-03-04T06:55:17.985446+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:55:17.985446+0000","last_undegraded":"2024-03-04T06:55:17.985446+0000","last_fullsized":"2024-03-04T06:55:17.985446+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:53.145282+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:53.145282+0000","last_peered":"2024-03-04T06:55:53.145282+0000","last_clean":"2024-03-04T06:55:53.145282+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:53.145282+0000","last_undegraded":"2024-03-04T06:55:53.145282+0000","last_fullsized":"2024-03-04T06:55:53.145282+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937387+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:52.937387+0000","last_peered":"2024-03-04T06:55:52.937387+0000","last_clean":"2024-03-04T06:55:52.937387+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:52.937387+0000","last_undegraded":"2024-03-04T06:55:52.937387+0000","last_fullsized":"2024-03-04T06:55:52.937387+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937465+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:52.937465+0000","last_peered":"2024-03-04T06:55:52.937465+0000","last_clean":"2024-03-04T06:55:52.937465+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:52.937465+0000","last_undegraded":"2024-03-04T06:55:52.937465+0000","last_fullsized":"2024-03-04T06:55:52.937465+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382095+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:56:28.382095+0000","last_peered":"2024-03-04T06:56:28.382095+0000","last_clean":"2024-03-04T06:56:28.382095+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:56:28.382095+0000","last_undegraded":"2024-03-04T06:56:28.382095+0000","last_fullsized":"2024-03-04T06:56:28.382095+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538587+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:56:49.538587+0000","last_peered":"2024-03-04T06:56:49.538587+0000","last_clean":"2024-03-04T06:56:49.538587+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:56:49.538587+0000","last_undegraded":"2024-03-04T06:56:49.538587+0000","last_fullsized":"2024-03-04T06:56:49.538587+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1305,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992748+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:56:22.992748+0000","last_peered":"2024-03-04T06:56:22.992748+0000","last_clean":"2024-03-04T06:56:22.992748+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:56:22.992748+0000","last_undegraded":"2024-03-04T06:56:22.992748+0000","last_fullsized":"2024-03-04T06:56:22.992748+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988343+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:55:44.988343+0000","last_peered":"2024-03-04T06:55:44.988343+0000","last_clean":"2024-03-04T06:55:44.988343+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:55:44.988343+0000","last_undegraded":"2024-03-04T06:55:44.988343+0000","last_fullsized":"2024-03-04T06:55:44.988343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988353+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:55:44.988353+0000","last_peered":"2024-03-04T06:55:44.988353+0000","last_clean":"2024-03-04T06:55:44.988353+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:55:44.988353+0000","last_undegraded":"2024-03-04T06:55:44.988353+0000","last_fullsized":"2024-03-04T06:55:44.988353+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992731+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:56:22.992731+0000","last_peered":"2024-03-04T06:56:22.992731+0000","last_clean":"2024-03-04T06:56:22.992731+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:56:22.992731+0000","last_undegraded":"2024-03-04T06:56:22.992731+0000","last_fullsized":"2024-03-04T06:56:22.992731+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1235,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386420+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:57:08.386420+0000","last_peered":"2024-03-04T06:57:08.386420+0000","last_clean":"2024-03-04T06:57:08.386420+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:57:08.386420+0000","last_undegraded":"2024-03-04T06:57:08.386420+0000","last_fullsized":"2024-03-04T06:57:08.386420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1222,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386390+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:57:08.386390+0000","last_peered":"2024-03-04T06:57:08.386390+0000","last_clean":"2024-03-04T06:57:08.386390+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:57:08.386390+0000","last_undegraded":"2024-03-04T06:57:08.386390+0000","last_fullsized":"2024-03-04T06:57:08.386390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102499+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102499+0000","last_peered":"2024-03-04T06:55:13.102499+0000","last_clean":"2024-03-04T06:55:13.102499+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102499+0000","last_undegraded":"2024-03-04T06:55:13.102499+0000","last_fullsized":"2024-03-04T06:55:13.102499+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941175+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:56:22.941175+0000","last_peered":"2024-03-04T06:56:22.941175+0000","last_clean":"2024-03-04T06:56:22.941175+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:56:22.941175+0000","last_undegraded":"2024-03-04T06:56:22.941175+0000","last_fullsized":"2024-03-04T06:56:22.941175+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984673+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:14.984673+0000","last_peered":"2024-03-04T06:55:14.984673+0000","last_clean":"2024-03-04T06:55:14.984673+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:14.984673+0000","last_undegraded":"2024-03-04T06:55:14.984673+0000","last_fullsized":"2024-03-04T06:55:14.984673+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1189,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:47.606038+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:47.606038+0000","last_peered":"2024-03-04T06:55:47.606038+0000","last_clean":"2024-03-04T06:55:47.606038+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:47.606038+0000","last_undegraded":"2024-03-04T06:55:47.606038+0000","last_fullsized":"2024-03-04T06:55:47.606038+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.224901+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:56:58.224901+0000","last_peered":"2024-03-04T06:56:58.224901+0000","last_clean":"2024-03-04T06:56:58.224901+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:56:58.224901+0000","last_undegraded":"2024-03-04T06:56:58.224901+0000","last_fullsized":"2024-03-04T06:56:58.224901+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:57.989954+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:57.989954+0000","last_peered":"2024-03-04T06:55:57.989954+0000","last_clean":"2024-03-04T06:55:57.989954+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:57.989954+0000","last_undegraded":"2024-03-04T06:55:57.989954+0000","last_fullsized":"2024-03-04T06:55:57.989954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.096734+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:55:13.096734+0000","last_peered":"2024-03-04T06:55:13.096734+0000","last_clean":"2024-03-04T06:55:13.096734+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:55:13.096734+0000","last_undegraded":"2024-03-04T06:55:13.096734+0000","last_fullsized":"2024-03-04T06:55:13.096734+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.097225+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:55:13.097225+0000","last_peered":"2024-03-04T06:55:13.097225+0000","last_clean":"2024-03-04T06:55:13.097225+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:55:13.097225+0000","last_undegraded":"2024-03-04T06:55:13.097225+0000","last_fullsized":"2024-03-04T06:55:13.097225+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939306+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:56:07.939306+0000","last_peered":"2024-03-04T06:56:07.939306+0000","last_clean":"2024-03-04T06:56:07.939306+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:56:07.939306+0000","last_undegraded":"2024-03-04T06:56:07.939306+0000","last_fullsized":"2024-03-04T06:56:07.939306+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147156+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:56:13.147156+0000","last_peered":"2024-03-04T06:56:13.147156+0000","last_clean":"2024-03-04T06:56:13.147156+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:56:13.147156+0000","last_undegraded":"2024-03-04T06:56:13.147156+0000","last_fullsized":"2024-03-04T06:56:13.147156+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223376+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:56:43.223376+0000","last_peered":"2024-03-04T06:56:43.223376+0000","last_clean":"2024-03-04T06:56:43.223376+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:56:43.223376+0000","last_undegraded":"2024-03-04T06:56:43.223376+0000","last_fullsized":"2024-03-04T06:56:43.223376+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939379+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:56:07.939379+0000","last_peered":"2024-03-04T06:56:07.939379+0000","last_clean":"2024-03-04T06:56:07.939379+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:56:07.939379+0000","last_undegraded":"2024-03-04T06:56:07.939379+0000","last_fullsized":"2024-03-04T06:56:07.939379+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939364+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:56:07.939364+0000","last_peered":"2024-03-04T06:56:07.939364+0000","last_clean":"2024-03-04T06:56:07.939364+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:56:07.939364+0000","last_undegraded":"2024-03-04T06:56:07.939364+0000","last_fullsized":"2024-03-04T06:56:07.939364+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.988031+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:37.988031+0000","last_peered":"2024-03-04T06:55:37.988031+0000","last_clean":"2024-03-04T06:55:37.988031+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:37.988031+0000","last_undegraded":"2024-03-04T06:55:37.988031+0000","last_fullsized":"2024-03-04T06:55:37.988031+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147207+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:56:13.147207+0000","last_peered":"2024-03-04T06:56:13.147207+0000","last_clean":"2024-03-04T06:56:13.147207+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:56:13.147207+0000","last_undegraded":"2024-03-04T06:56:13.147207+0000","last_fullsized":"2024-03-04T06:56:13.147207+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.602395+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:55:17.602395+0000","last_peered":"2024-03-04T06:55:17.602395+0000","last_clean":"2024-03-04T06:55:17.602395+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:55:17.602395+0000","last_undegraded":"2024-03-04T06:55:17.602395+0000","last_fullsized":"2024-03-04T06:55:17.602395+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1130,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221797+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:56:28.221797+0000","last_peered":"2024-03-04T06:56:28.221797+0000","last_clean":"2024-03-04T06:56:28.221797+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:56:28.221797+0000","last_undegraded":"2024-03-04T06:56:28.221797+0000","last_fullsized":"2024-03-04T06:56:28.221797+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1050,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102665+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:55:13.102665+0000","last_peered":"2024-03-04T06:55:13.102665+0000","last_clean":"2024-03-04T06:55:13.102665+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:55:13.102665+0000","last_undegraded":"2024-03-04T06:55:13.102665+0000","last_fullsized":"2024-03-04T06:55:13.102665+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1302,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:17.985489+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:55:17.985489+0000","last_peered":"2024-03-04T06:55:17.985489+0000","last_clean":"2024-03-04T06:55:17.985489+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:55:17.985489+0000","last_undegraded":"2024-03-04T06:55:17.985489+0000","last_fullsized":"2024-03-04T06:55:17.985489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382052+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:56:28.382052+0000","last_peered":"2024-03-04T06:56:28.382052+0000","last_clean":"2024-03-04T06:56:28.382052+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:56:28.382052+0000","last_undegraded":"2024-03-04T06:56:28.382052+0000","last_fullsized":"2024-03-04T06:56:28.382052+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937420+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:52.937420+0000","last_peered":"2024-03-04T06:55:52.937420+0000","last_clean":"2024-03-04T06:55:52.937420+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:52.937420+0000","last_undegraded":"2024-03-04T06:55:52.937420+0000","last_fullsized":"2024-03-04T06:55:52.937420+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540167+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:57:04.540167+0000","last_peered":"2024-03-04T06:57:04.540167+0000","last_clean":"2024-03-04T06:57:04.540167+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:57:04.540167+0000","last_undegraded":"2024-03-04T06:57:04.540167+0000","last_fullsized":"2024-03-04T06:57:04.540167+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221752+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:56:28.221752+0000","last_peered":"2024-03-04T06:56:28.221752+0000","last_clean":"2024-03-04T06:56:28.221752+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:56:28.221752+0000","last_undegraded":"2024-03-04T06:56:28.221752+0000","last_fullsized":"2024-03-04T06:56:28.221752+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221703+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:56:28.221703+0000","last_peered":"2024-03-04T06:56:28.221703+0000","last_clean":"2024-03-04T06:56:28.221703+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:56:28.221703+0000","last_undegraded":"2024-03-04T06:56:28.221703+0000","last_fullsized":"2024-03-04T06:56:28.221703+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1253,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382011+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:56:28.382011+0000","last_peered":"2024-03-04T06:56:28.382011+0000","last_clean":"2024-03-04T06:56:28.382011+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:56:28.382011+0000","last_undegraded":"2024-03-04T06:56:28.382011+0000","last_fullsized":"2024-03-04T06:56:28.382011+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540129+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:57:04.540129+0000","last_peered":"2024-03-04T06:57:04.540129+0000","last_clean":"2024-03-04T06:57:04.540129+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:57:04.540129+0000","last_undegraded":"2024-03-04T06:57:04.540129+0000","last_fullsized":"2024-03-04T06:57:04.540129+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3577,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377824+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:48.377824+0000","last_peered":"2024-03-04T06:55:48.377824+0000","last_clean":"2024-03-04T06:55:48.377824+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:48.377824+0000","last_undegraded":"2024-03-04T06:55:48.377824+0000","last_fullsized":"2024-03-04T06:55:48.377824+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:17.616250+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:57:17.616250+0000","last_peered":"2024-03-04T06:57:17.616250+0000","last_clean":"2024-03-04T06:57:17.616250+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:57:17.616250+0000","last_undegraded":"2024-03-04T06:57:17.616250+0000","last_fullsized":"2024-03-04T06:57:17.616250+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:56:49.538613+0000","last_peered":"2024-03-04T06:56:49.538613+0000","last_clean":"2024-03-04T06:56:49.538613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:56:49.538613+0000","last_undegraded":"2024-03-04T06:56:49.538613+0000","last_fullsized":"2024-03-04T06:56:49.538613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17116,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992661+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:56:22.992661+0000","last_peered":"2024-03-04T06:56:22.992661+0000","last_clean":"2024-03-04T06:56:22.992661+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:56:22.992661+0000","last_undegraded":"2024-03-04T06:56:22.992661+0000","last_fullsized":"2024-03-04T06:56:22.992661+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151860+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:56:58.151860+0000","last_peered":"2024-03-04T06:56:58.151860+0000","last_clean":"2024-03-04T06:56:58.151860+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:56:58.151860+0000","last_undegraded":"2024-03-04T06:56:58.151860+0000","last_fullsized":"2024-03-04T06:56:58.151860+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151904+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:56:58.151904+0000","last_peered":"2024-03-04T06:56:58.151904+0000","last_clean":"2024-03-04T06:56:58.151904+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:56:58.151904+0000","last_undegraded":"2024-03-04T06:56:58.151904+0000","last_fullsized":"2024-03-04T06:56:58.151904+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947110+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:57:12.947110+0000","last_peered":"2024-03-04T06:57:12.947110+0000","last_clean":"2024-03-04T06:57:12.947110+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:57:12.947110+0000","last_undegraded":"2024-03-04T06:57:12.947110+0000","last_fullsized":"2024-03-04T06:57:12.947110+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4386,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992700+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:56:22.992700+0000","last_peered":"2024-03-04T06:56:22.992700+0000","last_clean":"2024-03-04T06:56:22.992700+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:56:22.992700+0000","last_undegraded":"2024-03-04T06:56:22.992700+0000","last_fullsized":"2024-03-04T06:56:22.992700+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151882+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:56:58.151882+0000","last_peered":"2024-03-04T06:56:58.151882+0000","last_clean":"2024-03-04T06:56:58.151882+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:56:58.151882+0000","last_undegraded":"2024-03-04T06:56:58.151882+0000","last_fullsized":"2024-03-04T06:56:58.151882+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947055+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:57:12.947055+0000","last_peered":"2024-03-04T06:57:12.947055+0000","last_clean":"2024-03-04T06:57:12.947055+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:57:12.947055+0000","last_undegraded":"2024-03-04T06:57:12.947055+0000","last_fullsized":"2024-03-04T06:57:12.947055+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611663+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:56:37.611663+0000","last_peered":"2024-03-04T06:56:37.611663+0000","last_clean":"2024-03-04T06:56:37.611663+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:56:37.611663+0000","last_undegraded":"2024-03-04T06:56:37.611663+0000","last_fullsized":"2024-03-04T06:56:37.611663+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5639,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377937+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:48.377937+0000","last_peered":"2024-03-04T06:55:48.377937+0000","last_clean":"2024-03-04T06:55:48.377937+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:48.377937+0000","last_undegraded":"2024-03-04T06:55:48.377937+0000","last_fullsized":"2024-03-04T06:55:48.377937+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1256,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154711+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:57:23.154711+0000","last_peered":"2024-03-04T06:57:23.154711+0000","last_clean":"2024-03-04T06:57:23.154711+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:57:23.154711+0000","last_undegraded":"2024-03-04T06:57:23.154711+0000","last_fullsized":"2024-03-04T06:57:23.154711+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:33.149241+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:56:33.149241+0000","last_peered":"2024-03-04T06:56:33.149241+0000","last_clean":"2024-03-04T06:56:33.149241+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:56:33.149241+0000","last_undegraded":"2024-03-04T06:56:33.149241+0000","last_fullsized":"2024-03-04T06:56:33.149241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389235+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:57:33.389235+0000","last_peered":"2024-03-04T06:57:33.389235+0000","last_clean":"2024-03-04T06:57:33.389235+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:57:33.389235+0000","last_undegraded":"2024-03-04T06:57:33.389235+0000","last_fullsized":"2024-03-04T06:57:33.389235+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4015,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:19.534498+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:56:19.534498+0000","last_peered":"2024-03-04T06:56:19.534498+0000","last_clean":"2024-03-04T06:56:19.534498+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:56:19.534498+0000","last_undegraded":"2024-03-04T06:56:19.534498+0000","last_fullsized":"2024-03-04T06:56:19.534498+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1091,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.217050+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:55:43.217050+0000","last_peered":"2024-03-04T06:55:43.217050+0000","last_clean":"2024-03-04T06:55:43.217050+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:55:43.217050+0000","last_undegraded":"2024-03-04T06:55:43.217050+0000","last_fullsized":"2024-03-04T06:55:43.217050+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.990790+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:56:04.990790+0000","last_peered":"2024-03-04T06:56:04.990790+0000","last_clean":"2024-03-04T06:56:04.990790+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:56:04.990790+0000","last_undegraded":"2024-03-04T06:56:04.990790+0000","last_fullsized":"2024-03-04T06:56:04.990790+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947097+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:57:12.947097+0000","last_peered":"2024-03-04T06:57:12.947097+0000","last_clean":"2024-03-04T06:57:12.947097+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:57:12.947097+0000","last_undegraded":"2024-03-04T06:57:12.947097+0000","last_fullsized":"2024-03-04T06:57:12.947097+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1550,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532802+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:56:04.532802+0000","last_peered":"2024-03-04T06:56:04.532802+0000","last_clean":"2024-03-04T06:56:04.532802+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:56:04.532802+0000","last_undegraded":"2024-03-04T06:56:04.532802+0000","last_fullsized":"2024-03-04T06:56:04.532802+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3951,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949380+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:57:32.949380+0000","last_peered":"2024-03-04T06:57:32.949380+0000","last_clean":"2024-03-04T06:57:32.949380+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:57:32.949380+0000","last_undegraded":"2024-03-04T06:57:32.949380+0000","last_fullsized":"2024-03-04T06:57:32.949380+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995396+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:56:47.995396+0000","last_peered":"2024-03-04T06:56:47.995396+0000","last_clean":"2024-03-04T06:56:47.995396+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:56:47.995396+0000","last_undegraded":"2024-03-04T06:56:47.995396+0000","last_fullsized":"2024-03-04T06:56:47.995396+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389207+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:57:33.389207+0000","last_peered":"2024-03-04T06:57:33.389207+0000","last_clean":"2024-03-04T06:57:33.389207+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:57:33.389207+0000","last_undegraded":"2024-03-04T06:57:33.389207+0000","last_fullsized":"2024-03-04T06:57:33.389207+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532768+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:56:04.532768+0000","last_peered":"2024-03-04T06:56:04.532768+0000","last_clean":"2024-03-04T06:56:04.532768+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:56:04.532768+0000","last_undegraded":"2024-03-04T06:56:04.532768+0000","last_fullsized":"2024-03-04T06:56:04.532768+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15291,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:43.217015+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:55:43.217015+0000","last_peered":"2024-03-04T06:55:43.217015+0000","last_clean":"2024-03-04T06:55:43.217015+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:55:43.217015+0000","last_undegraded":"2024-03-04T06:55:43.217015+0000","last_fullsized":"2024-03-04T06:55:43.217015+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992678+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:56:22.992678+0000","last_peered":"2024-03-04T06:56:22.992678+0000","last_clean":"2024-03-04T06:56:22.992678+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:56:22.992678+0000","last_undegraded":"2024-03-04T06:56:22.992678+0000","last_fullsized":"2024-03-04T06:56:22.992678+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534547+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:56:19.534547+0000","last_peered":"2024-03-04T06:56:19.534547+0000","last_clean":"2024-03-04T06:56:19.534547+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:56:19.534547+0000","last_undegraded":"2024-03-04T06:56:19.534547+0000","last_fullsized":"2024-03-04T06:56:19.534547+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151891+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:56:58.151891+0000","last_peered":"2024-03-04T06:56:58.151891+0000","last_clean":"2024-03-04T06:56:58.151891+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:56:58.151891+0000","last_undegraded":"2024-03-04T06:56:58.151891+0000","last_fullsized":"2024-03-04T06:56:58.151891+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4379,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:37.611623+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:56:37.611623+0000","last_peered":"2024-03-04T06:56:37.611623+0000","last_clean":"2024-03-04T06:56:37.611623+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:56:37.611623+0000","last_undegraded":"2024-03-04T06:56:37.611623+0000","last_fullsized":"2024-03-04T06:56:37.611623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:44.988300+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:55:44.988300+0000","last_peered":"2024-03-04T06:55:44.988300+0000","last_clean":"2024-03-04T06:55:44.988300+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:55:44.988300+0000","last_undegraded":"2024-03-04T06:55:44.988300+0000","last_fullsized":"2024-03-04T06:55:44.988300+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1269,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154698+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:57:23.154698+0000","last_peered":"2024-03-04T06:57:23.154698+0000","last_clean":"2024-03-04T06:57:23.154698+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:57:23.154698+0000","last_undegraded":"2024-03-04T06:57:23.154698+0000","last_fullsized":"2024-03-04T06:57:23.154698+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992884+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:56:24.992884+0000","last_peered":"2024-03-04T06:56:24.992884+0000","last_clean":"2024-03-04T06:56:24.992884+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:56:24.992884+0000","last_undegraded":"2024-03-04T06:56:24.992884+0000","last_fullsized":"2024-03-04T06:56:24.992884+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4609,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:44.988263+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:55:44.988263+0000","last_peered":"2024-03-04T06:55:44.988263+0000","last_clean":"2024-03-04T06:55:44.988263+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:55:44.988263+0000","last_undegraded":"2024-03-04T06:55:44.988263+0000","last_fullsized":"2024-03-04T06:55:44.988263+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611593+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:56:37.611593+0000","last_peered":"2024-03-04T06:56:37.611593+0000","last_clean":"2024-03-04T06:56:37.611593+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:56:37.611593+0000","last_undegraded":"2024-03-04T06:56:37.611593+0000","last_fullsized":"2024-03-04T06:56:37.611593+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1078,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218837+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:58.218837+0000","last_peered":"2024-03-04T06:55:58.218837+0000","last_clean":"2024-03-04T06:55:58.218837+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:58.218837+0000","last_undegraded":"2024-03-04T06:55:58.218837+0000","last_fullsized":"2024-03-04T06:55:58.218837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995375+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:56:47.995375+0000","last_peered":"2024-03-04T06:56:47.995375+0000","last_clean":"2024-03-04T06:56:47.995375+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:56:47.995375+0000","last_undegraded":"2024-03-04T06:56:47.995375+0000","last_fullsized":"2024-03-04T06:56:47.995375+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4634,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:37.935758+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:37.935758+0000","last_peered":"2024-03-04T06:55:37.935758+0000","last_clean":"2024-03-04T06:55:37.935758+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:37.935758+0000","last_undegraded":"2024-03-04T06:55:37.935758+0000","last_fullsized":"2024-03-04T06:55:37.935758+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:34.536591+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:56:34.536591+0000","last_peered":"2024-03-04T06:56:34.536591+0000","last_clean":"2024-03-04T06:56:34.536591+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:56:34.536591+0000","last_undegraded":"2024-03-04T06:56:34.536591+0000","last_fullsized":"2024-03-04T06:56:34.536591+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1185,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:57.614016+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:56:57.614016+0000","last_peered":"2024-03-04T06:56:57.614016+0000","last_clean":"2024-03-04T06:56:57.614016+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:56:57.614016+0000","last_undegraded":"2024-03-04T06:56:57.614016+0000","last_fullsized":"2024-03-04T06:56:57.614016+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5158,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:17.616210+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:57:17.616210+0000","last_peered":"2024-03-04T06:57:17.616210+0000","last_clean":"2024-03-04T06:57:17.616210+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:57:17.616210+0000","last_undegraded":"2024-03-04T06:57:17.616210+0000","last_fullsized":"2024-03-04T06:57:17.616210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154620+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:57:23.154620+0000","last_peered":"2024-03-04T06:57:23.154620+0000","last_clean":"2024-03-04T06:57:23.154620+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:57:23.154620+0000","last_undegraded":"2024-03-04T06:57:23.154620+0000","last_fullsized":"2024-03-04T06:57:23.154620+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992810+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:56:24.992810+0000","last_peered":"2024-03-04T06:56:24.992810+0000","last_clean":"2024-03-04T06:56:24.992810+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:56:24.992810+0000","last_undegraded":"2024-03-04T06:56:24.992810+0000","last_fullsized":"2024-03-04T06:56:24.992810+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4719,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380021+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:56:08.380021+0000","last_peered":"2024-03-04T06:56:08.380021+0000","last_clean":"2024-03-04T06:56:08.380021+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:56:08.380021+0000","last_undegraded":"2024-03-04T06:56:08.380021+0000","last_fullsized":"2024-03-04T06:56:08.380021+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154658+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:57:23.154658+0000","last_peered":"2024-03-04T06:57:23.154658+0000","last_clean":"2024-03-04T06:57:23.154658+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:57:23.154658+0000","last_undegraded":"2024-03-04T06:57:23.154658+0000","last_fullsized":"2024-03-04T06:57:23.154658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994937+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:56:44.994937+0000","last_peered":"2024-03-04T06:56:44.994937+0000","last_clean":"2024-03-04T06:56:44.994937+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:56:44.994937+0000","last_undegraded":"2024-03-04T06:56:44.994937+0000","last_fullsized":"2024-03-04T06:56:44.994937+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5554,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:33.143474+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:33.143474+0000","last_peered":"2024-03-04T06:55:33.143474+0000","last_clean":"2024-03-04T06:55:33.143474+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:33.143474+0000","last_undegraded":"2024-03-04T06:55:33.143474+0000","last_fullsized":"2024-03-04T06:55:33.143474+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:56:49.538554+0000","last_peered":"2024-03-04T06:56:49.538554+0000","last_clean":"2024-03-04T06:56:49.538554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:56:49.538554+0000","last_undegraded":"2024-03-04T06:56:49.538554+0000","last_fullsized":"2024-03-04T06:56:49.538554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218784+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:58.218784+0000","last_peered":"2024-03-04T06:55:58.218784+0000","last_clean":"2024-03-04T06:55:58.218784+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:58.218784+0000","last_undegraded":"2024-03-04T06:55:58.218784+0000","last_fullsized":"2024-03-04T06:55:58.218784+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.379963+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:56:08.379963+0000","last_peered":"2024-03-04T06:56:08.379963+0000","last_clean":"2024-03-04T06:56:08.379963+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:56:08.379963+0000","last_undegraded":"2024-03-04T06:56:08.379963+0000","last_fullsized":"2024-03-04T06:56:08.379963+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380005+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:56:08.380005+0000","last_peered":"2024-03-04T06:56:08.380005+0000","last_clean":"2024-03-04T06:56:08.380005+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:56:08.380005+0000","last_undegraded":"2024-03-04T06:56:08.380005+0000","last_fullsized":"2024-03-04T06:56:08.380005+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:56:49.538599+0000","last_peered":"2024-03-04T06:56:49.538599+0000","last_clean":"2024-03-04T06:56:49.538599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:56:49.538599+0000","last_undegraded":"2024-03-04T06:56:49.538599+0000","last_fullsized":"2024-03-04T06:56:49.538599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4366,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377880+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:48.377880+0000","last_peered":"2024-03-04T06:55:48.377880+0000","last_clean":"2024-03-04T06:55:48.377880+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:48.377880+0000","last_undegraded":"2024-03-04T06:55:48.377880+0000","last_fullsized":"2024-03-04T06:55:48.377880+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:33.143531+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:33.143531+0000","last_peered":"2024-03-04T06:55:33.143531+0000","last_clean":"2024-03-04T06:55:33.143531+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:33.143531+0000","last_undegraded":"2024-03-04T06:55:33.143531+0000","last_fullsized":"2024-03-04T06:55:33.143531+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935733+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:37.935733+0000","last_peered":"2024-03-04T06:55:37.935733+0000","last_clean":"2024-03-04T06:55:37.935733+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:37.935733+0000","last_undegraded":"2024-03-04T06:55:37.935733+0000","last_fullsized":"2024-03-04T06:55:37.935733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4600,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:34.536621+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:56:34.536621+0000","last_peered":"2024-03-04T06:56:34.536621+0000","last_clean":"2024-03-04T06:56:34.536621+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:56:34.536621+0000","last_undegraded":"2024-03-04T06:56:34.536621+0000","last_fullsized":"2024-03-04T06:56:34.536621+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1245,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380055+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:56:08.380055+0000","last_peered":"2024-03-04T06:56:08.380055+0000","last_clean":"2024-03-04T06:56:08.380055+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:56:08.380055+0000","last_undegraded":"2024-03-04T06:56:08.380055+0000","last_fullsized":"2024-03-04T06:56:08.380055+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538627+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:56:49.538627+0000","last_peered":"2024-03-04T06:56:49.538627+0000","last_clean":"2024-03-04T06:56:49.538627+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:56:49.538627+0000","last_undegraded":"2024-03-04T06:56:49.538627+0000","last_fullsized":"2024-03-04T06:56:49.538627+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:43.216983+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:55:43.216983+0000","last_peered":"2024-03-04T06:55:43.216983+0000","last_clean":"2024-03-04T06:55:43.216983+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:55:43.216983+0000","last_undegraded":"2024-03-04T06:55:43.216983+0000","last_fullsized":"2024-03-04T06:55:43.216983+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389246+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:57:33.389246+0000","last_peered":"2024-03-04T06:57:33.389246+0000","last_clean":"2024-03-04T06:57:33.389246+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:57:33.389246+0000","last_undegraded":"2024-03-04T06:57:33.389246+0000","last_fullsized":"2024-03-04T06:57:33.389246+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947082+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:57:12.947082+0000","last_peered":"2024-03-04T06:57:12.947082+0000","last_clean":"2024-03-04T06:57:12.947082+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:57:12.947082+0000","last_undegraded":"2024-03-04T06:57:12.947082+0000","last_fullsized":"2024-03-04T06:57:12.947082+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992636+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:56:22.992636+0000","last_peered":"2024-03-04T06:56:22.992636+0000","last_clean":"2024-03-04T06:56:22.992636+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:56:22.992636+0000","last_undegraded":"2024-03-04T06:56:22.992636+0000","last_fullsized":"2024-03-04T06:56:22.992636+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992858+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:56:24.992858+0000","last_peered":"2024-03-04T06:56:24.992858+0000","last_clean":"2024-03-04T06:56:24.992858+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:56:24.992858+0000","last_undegraded":"2024-03-04T06:56:24.992858+0000","last_fullsized":"2024-03-04T06:56:24.992858+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154682+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:57:23.154682+0000","last_peered":"2024-03-04T06:57:23.154682+0000","last_clean":"2024-03-04T06:57:23.154682+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:57:23.154682+0000","last_undegraded":"2024-03-04T06:57:23.154682+0000","last_fullsized":"2024-03-04T06:57:23.154682+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218825+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:58.218825+0000","last_peered":"2024-03-04T06:55:58.218825+0000","last_clean":"2024-03-04T06:55:58.218825+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:58.218825+0000","last_undegraded":"2024-03-04T06:55:58.218825+0000","last_fullsized":"2024-03-04T06:55:58.218825+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992900+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:56:24.992900+0000","last_peered":"2024-03-04T06:56:24.992900+0000","last_clean":"2024-03-04T06:56:24.992900+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:56:24.992900+0000","last_undegraded":"2024-03-04T06:56:24.992900+0000","last_fullsized":"2024-03-04T06:56:24.992900+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949325+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:57:32.949325+0000","last_peered":"2024-03-04T06:57:32.949325+0000","last_clean":"2024-03-04T06:57:32.949325+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:57:32.949325+0000","last_undegraded":"2024-03-04T06:57:32.949325+0000","last_fullsized":"2024-03-04T06:57:32.949325+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994907+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:56:44.994907+0000","last_peered":"2024-03-04T06:56:44.994907+0000","last_clean":"2024-03-04T06:56:44.994907+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:56:44.994907+0000","last_undegraded":"2024-03-04T06:56:44.994907+0000","last_fullsized":"2024-03-04T06:56:44.994907+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1120,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935684+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:37.935684+0000","last_peered":"2024-03-04T06:55:37.935684+0000","last_clean":"2024-03-04T06:55:37.935684+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:37.935684+0000","last_undegraded":"2024-03-04T06:55:37.935684+0000","last_fullsized":"2024-03-04T06:55:37.935684+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.998327+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:57:12.998327+0000","last_peered":"2024-03-04T06:57:12.998327+0000","last_clean":"2024-03-04T06:57:12.998327+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:57:12.998327+0000","last_undegraded":"2024-03-04T06:57:12.998327+0000","last_fullsized":"2024-03-04T06:57:12.998327+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.220345+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:56:13.220345+0000","last_peered":"2024-03-04T06:56:13.220345+0000","last_clean":"2024-03-04T06:56:13.220345+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:56:13.220345+0000","last_undegraded":"2024-03-04T06:56:13.220345+0000","last_fullsized":"2024-03-04T06:56:13.220345+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503476,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648124,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142431,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287078,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997784,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885840,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937418,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792771,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:59:46.553 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:46.553 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:46.554 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:46.554 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:46.554 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:46.554 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:46.554 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:46.554 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:46.554 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:46.554 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:46.554 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T06:59:47.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:47 smithi203 ceph-mon[85573]: from='client.34623 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:59:47.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:47 smithi137 ceph-mon[88869]: from='client.34623 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:59:47.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:47 smithi137 ceph-mon[91314]: from='client.34623 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T06:59:48.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:48 smithi203 ceph-mon[85573]: pgmap v1058: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:48.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:48 smithi137 ceph-mon[88869]: pgmap v1058: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:48.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:48 smithi137 ceph-mon[91314]: pgmap v1058: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:50.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:50 smithi203 ceph-mon[85573]: pgmap v1059: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:50.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:50 smithi137 ceph-mon[88869]: pgmap v1059: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:50.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:50 smithi137 ceph-mon[91314]: pgmap v1059: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:52.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:52 smithi203 ceph-mon[85573]: pgmap v1060: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:52.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:52 smithi137 ceph-mon[88869]: pgmap v1060: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:52.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:52 smithi137 ceph-mon[91314]: pgmap v1060: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:54.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:54 smithi203 ceph-mon[85573]: pgmap v1061: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:54.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:59:54.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:54 smithi137 ceph-mon[88869]: pgmap v1061: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:54.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:59:54.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:54 smithi137 ceph-mon[91314]: pgmap v1061: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:54.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T06:59:55.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 06:59:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:06:59:55] "GET /metrics HTTP/1.1" 200 36335 "" "Prometheus/2.43.0" 2024-03-04T06:59:56.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:56 smithi203 ceph-mon[85573]: pgmap v1062: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:56.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:56 smithi137 ceph-mon[88869]: pgmap v1062: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:56.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:56 smithi137 ceph-mon[91314]: pgmap v1062: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:56.555 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T06:59:56.774 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T06:59:58.231 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 06:59:58 smithi137 ceph-mon[88869]: pgmap v1063: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:58.231 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 06:59:58 smithi137 ceph-mon[91314]: pgmap v1063: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:58.345 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 06:59:58 smithi203 ceph-mon[85573]: pgmap v1063: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T06:59:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T06:59:58.799 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T06:59:59.492 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1064,"stamp":"2024-03-04T06:59:58.547494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003549"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534568+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:56:19.534568+0000","last_peered":"2024-03-04T06:56:19.534568+0000","last_clean":"2024-03-04T06:56:19.534568+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:56:19.534568+0000","last_undegraded":"2024-03-04T06:56:19.534568+0000","last_fullsized":"2024-03-04T06:56:19.534568+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151921+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:56:58.151921+0000","last_peered":"2024-03-04T06:56:58.151921+0000","last_clean":"2024-03-04T06:56:58.151921+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:56:58.151921+0000","last_undegraded":"2024-03-04T06:56:58.151921+0000","last_fullsized":"2024-03-04T06:56:58.151921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992691+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:56:22.992691+0000","last_peered":"2024-03-04T06:56:22.992691+0000","last_clean":"2024-03-04T06:56:22.992691+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:56:22.992691+0000","last_undegraded":"2024-03-04T06:56:22.992691+0000","last_fullsized":"2024-03-04T06:56:22.992691+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:52.944862+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:56:52.944862+0000","last_peered":"2024-03-04T06:56:52.944862+0000","last_clean":"2024-03-04T06:56:52.944862+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:56:52.944862+0000","last_undegraded":"2024-03-04T06:56:52.944862+0000","last_fullsized":"2024-03-04T06:56:52.944862+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102005+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:55:13.102005+0000","last_peered":"2024-03-04T06:55:13.102005+0000","last_clean":"2024-03-04T06:55:13.102005+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:55:13.102005+0000","last_undegraded":"2024-03-04T06:55:13.102005+0000","last_fullsized":"2024-03-04T06:55:13.102005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941144+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:56:22.941144+0000","last_peered":"2024-03-04T06:56:22.941144+0000","last_clean":"2024-03-04T06:56:22.941144+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:56:22.941144+0000","last_undegraded":"2024-03-04T06:56:22.941144+0000","last_fullsized":"2024-03-04T06:56:22.941144+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.101809+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:55:13.101809+0000","last_peered":"2024-03-04T06:55:13.101809+0000","last_clean":"2024-03-04T06:55:13.101809+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:55:13.101809+0000","last_undegraded":"2024-03-04T06:55:13.101809+0000","last_fullsized":"2024-03-04T06:55:13.101809+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984614+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:14.984614+0000","last_peered":"2024-03-04T06:55:14.984614+0000","last_clean":"2024-03-04T06:55:14.984614+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:14.984614+0000","last_undegraded":"2024-03-04T06:55:14.984614+0000","last_fullsized":"2024-03-04T06:55:14.984614+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1065,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541782+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:57:19.541782+0000","last_peered":"2024-03-04T06:57:19.541782+0000","last_clean":"2024-03-04T06:57:19.541782+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:57:19.541782+0000","last_undegraded":"2024-03-04T06:57:19.541782+0000","last_fullsized":"2024-03-04T06:57:19.541782+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223356+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:56:43.223356+0000","last_peered":"2024-03-04T06:56:43.223356+0000","last_clean":"2024-03-04T06:56:43.223356+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:56:43.223356+0000","last_undegraded":"2024-03-04T06:56:43.223356+0000","last_fullsized":"2024-03-04T06:56:43.223356+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223323+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:56:43.223323+0000","last_peered":"2024-03-04T06:56:43.223323+0000","last_clean":"2024-03-04T06:56:43.223323+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:56:43.223323+0000","last_undegraded":"2024-03-04T06:56:43.223323+0000","last_fullsized":"2024-03-04T06:56:43.223323+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:32.604419+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:32.604419+0000","last_peered":"2024-03-04T06:55:32.604419+0000","last_clean":"2024-03-04T06:55:32.604419+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:32.604419+0000","last_undegraded":"2024-03-04T06:55:32.604419+0000","last_fullsized":"2024-03-04T06:55:32.604419+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999343+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:57:24.999343+0000","last_peered":"2024-03-04T06:57:24.999343+0000","last_clean":"2024-03-04T06:57:24.999343+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:57:24.999343+0000","last_undegraded":"2024-03-04T06:57:24.999343+0000","last_fullsized":"2024-03-04T06:57:24.999343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001313+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:57:38.001313+0000","last_peered":"2024-03-04T06:57:38.001313+0000","last_clean":"2024-03-04T06:57:38.001313+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:57:38.001313+0000","last_undegraded":"2024-03-04T06:57:38.001313+0000","last_fullsized":"2024-03-04T06:57:38.001313+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:53.145282+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:53.145282+0000","last_peered":"2024-03-04T06:55:53.145282+0000","last_clean":"2024-03-04T06:55:53.145282+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:53.145282+0000","last_undegraded":"2024-03-04T06:55:53.145282+0000","last_fullsized":"2024-03-04T06:55:53.145282+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937387+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:52.937387+0000","last_peered":"2024-03-04T06:55:52.937387+0000","last_clean":"2024-03-04T06:55:52.937387+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:52.937387+0000","last_undegraded":"2024-03-04T06:55:52.937387+0000","last_fullsized":"2024-03-04T06:55:52.937387+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937465+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:52.937465+0000","last_peered":"2024-03-04T06:55:52.937465+0000","last_clean":"2024-03-04T06:55:52.937465+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:52.937465+0000","last_undegraded":"2024-03-04T06:55:52.937465+0000","last_fullsized":"2024-03-04T06:55:52.937465+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382095+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:56:28.382095+0000","last_peered":"2024-03-04T06:56:28.382095+0000","last_clean":"2024-03-04T06:56:28.382095+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:56:28.382095+0000","last_undegraded":"2024-03-04T06:56:28.382095+0000","last_fullsized":"2024-03-04T06:56:28.382095+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538587+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:56:49.538587+0000","last_peered":"2024-03-04T06:56:49.538587+0000","last_clean":"2024-03-04T06:56:49.538587+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:56:49.538587+0000","last_undegraded":"2024-03-04T06:56:49.538587+0000","last_fullsized":"2024-03-04T06:56:49.538587+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1305,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992748+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:56:22.992748+0000","last_peered":"2024-03-04T06:56:22.992748+0000","last_clean":"2024-03-04T06:56:22.992748+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:56:22.992748+0000","last_undegraded":"2024-03-04T06:56:22.992748+0000","last_fullsized":"2024-03-04T06:56:22.992748+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001710+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:57:45.001710+0000","last_peered":"2024-03-04T06:57:45.001710+0000","last_clean":"2024-03-04T06:57:45.001710+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:57:45.001710+0000","last_undegraded":"2024-03-04T06:57:45.001710+0000","last_fullsized":"2024-03-04T06:57:45.001710+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001722+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:57:45.001722+0000","last_peered":"2024-03-04T06:57:45.001722+0000","last_clean":"2024-03-04T06:57:45.001722+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:57:45.001722+0000","last_undegraded":"2024-03-04T06:57:45.001722+0000","last_fullsized":"2024-03-04T06:57:45.001722+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992731+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:56:22.992731+0000","last_peered":"2024-03-04T06:56:22.992731+0000","last_clean":"2024-03-04T06:56:22.992731+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:56:22.992731+0000","last_undegraded":"2024-03-04T06:56:22.992731+0000","last_fullsized":"2024-03-04T06:56:22.992731+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1235,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386420+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:57:08.386420+0000","last_peered":"2024-03-04T06:57:08.386420+0000","last_clean":"2024-03-04T06:57:08.386420+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:57:08.386420+0000","last_undegraded":"2024-03-04T06:57:08.386420+0000","last_fullsized":"2024-03-04T06:57:08.386420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1222,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386390+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:57:08.386390+0000","last_peered":"2024-03-04T06:57:08.386390+0000","last_clean":"2024-03-04T06:57:08.386390+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:57:08.386390+0000","last_undegraded":"2024-03-04T06:57:08.386390+0000","last_fullsized":"2024-03-04T06:57:08.386390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1069,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:13.102499+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:55:13.102499+0000","last_peered":"2024-03-04T06:55:13.102499+0000","last_clean":"2024-03-04T06:55:13.102499+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:55:13.102499+0000","last_undegraded":"2024-03-04T06:55:13.102499+0000","last_fullsized":"2024-03-04T06:55:13.102499+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941175+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:56:22.941175+0000","last_peered":"2024-03-04T06:56:22.941175+0000","last_clean":"2024-03-04T06:56:22.941175+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:56:22.941175+0000","last_undegraded":"2024-03-04T06:56:22.941175+0000","last_fullsized":"2024-03-04T06:56:22.941175+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984673+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:14.984673+0000","last_peered":"2024-03-04T06:55:14.984673+0000","last_clean":"2024-03-04T06:55:14.984673+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:14.984673+0000","last_undegraded":"2024-03-04T06:55:14.984673+0000","last_fullsized":"2024-03-04T06:55:14.984673+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1189,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:47.606038+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:47.606038+0000","last_peered":"2024-03-04T06:55:47.606038+0000","last_clean":"2024-03-04T06:55:47.606038+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:47.606038+0000","last_undegraded":"2024-03-04T06:55:47.606038+0000","last_fullsized":"2024-03-04T06:55:47.606038+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.224901+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:56:58.224901+0000","last_peered":"2024-03-04T06:56:58.224901+0000","last_clean":"2024-03-04T06:56:58.224901+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:56:58.224901+0000","last_undegraded":"2024-03-04T06:56:58.224901+0000","last_fullsized":"2024-03-04T06:56:58.224901+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:57.989954+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:57.989954+0000","last_peered":"2024-03-04T06:55:57.989954+0000","last_clean":"2024-03-04T06:55:57.989954+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:57.989954+0000","last_undegraded":"2024-03-04T06:55:57.989954+0000","last_fullsized":"2024-03-04T06:55:57.989954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999328+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:57:24.999328+0000","last_peered":"2024-03-04T06:57:24.999328+0000","last_clean":"2024-03-04T06:57:24.999328+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:57:24.999328+0000","last_undegraded":"2024-03-04T06:57:24.999328+0000","last_fullsized":"2024-03-04T06:57:24.999328+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999296+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:57:24.999296+0000","last_peered":"2024-03-04T06:57:24.999296+0000","last_clean":"2024-03-04T06:57:24.999296+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:57:24.999296+0000","last_undegraded":"2024-03-04T06:57:24.999296+0000","last_fullsized":"2024-03-04T06:57:24.999296+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939306+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:56:07.939306+0000","last_peered":"2024-03-04T06:56:07.939306+0000","last_clean":"2024-03-04T06:56:07.939306+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:56:07.939306+0000","last_undegraded":"2024-03-04T06:56:07.939306+0000","last_fullsized":"2024-03-04T06:56:07.939306+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147156+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:56:13.147156+0000","last_peered":"2024-03-04T06:56:13.147156+0000","last_clean":"2024-03-04T06:56:13.147156+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:56:13.147156+0000","last_undegraded":"2024-03-04T06:56:13.147156+0000","last_fullsized":"2024-03-04T06:56:13.147156+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223376+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:56:43.223376+0000","last_peered":"2024-03-04T06:56:43.223376+0000","last_clean":"2024-03-04T06:56:43.223376+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:56:43.223376+0000","last_undegraded":"2024-03-04T06:56:43.223376+0000","last_fullsized":"2024-03-04T06:56:43.223376+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939379+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:56:07.939379+0000","last_peered":"2024-03-04T06:56:07.939379+0000","last_clean":"2024-03-04T06:56:07.939379+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:56:07.939379+0000","last_undegraded":"2024-03-04T06:56:07.939379+0000","last_fullsized":"2024-03-04T06:56:07.939379+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939364+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:56:07.939364+0000","last_peered":"2024-03-04T06:56:07.939364+0000","last_clean":"2024-03-04T06:56:07.939364+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:56:07.939364+0000","last_undegraded":"2024-03-04T06:56:07.939364+0000","last_fullsized":"2024-03-04T06:56:07.939364+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.988031+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:37.988031+0000","last_peered":"2024-03-04T06:55:37.988031+0000","last_clean":"2024-03-04T06:55:37.988031+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:37.988031+0000","last_undegraded":"2024-03-04T06:55:37.988031+0000","last_fullsized":"2024-03-04T06:55:37.988031+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147207+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:56:13.147207+0000","last_peered":"2024-03-04T06:56:13.147207+0000","last_clean":"2024-03-04T06:56:13.147207+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:56:13.147207+0000","last_undegraded":"2024-03-04T06:56:13.147207+0000","last_fullsized":"2024-03-04T06:56:13.147207+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:37.618704+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:57:37.618704+0000","last_peered":"2024-03-04T06:57:37.618704+0000","last_clean":"2024-03-04T06:57:37.618704+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:57:37.618704+0000","last_undegraded":"2024-03-04T06:57:37.618704+0000","last_fullsized":"2024-03-04T06:57:37.618704+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1130,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221797+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:56:28.221797+0000","last_peered":"2024-03-04T06:56:28.221797+0000","last_clean":"2024-03-04T06:56:28.221797+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:56:28.221797+0000","last_undegraded":"2024-03-04T06:56:28.221797+0000","last_fullsized":"2024-03-04T06:56:28.221797+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541754+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:57:19.541754+0000","last_peered":"2024-03-04T06:57:19.541754+0000","last_clean":"2024-03-04T06:57:19.541754+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:57:19.541754+0000","last_undegraded":"2024-03-04T06:57:19.541754+0000","last_fullsized":"2024-03-04T06:57:19.541754+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001343+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:57:38.001343+0000","last_peered":"2024-03-04T06:57:38.001343+0000","last_clean":"2024-03-04T06:57:38.001343+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:57:38.001343+0000","last_undegraded":"2024-03-04T06:57:38.001343+0000","last_fullsized":"2024-03-04T06:57:38.001343+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382052+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:56:28.382052+0000","last_peered":"2024-03-04T06:56:28.382052+0000","last_clean":"2024-03-04T06:56:28.382052+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:56:28.382052+0000","last_undegraded":"2024-03-04T06:56:28.382052+0000","last_fullsized":"2024-03-04T06:56:28.382052+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937420+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:52.937420+0000","last_peered":"2024-03-04T06:55:52.937420+0000","last_clean":"2024-03-04T06:55:52.937420+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:52.937420+0000","last_undegraded":"2024-03-04T06:55:52.937420+0000","last_fullsized":"2024-03-04T06:55:52.937420+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540167+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:57:04.540167+0000","last_peered":"2024-03-04T06:57:04.540167+0000","last_clean":"2024-03-04T06:57:04.540167+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:57:04.540167+0000","last_undegraded":"2024-03-04T06:57:04.540167+0000","last_fullsized":"2024-03-04T06:57:04.540167+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221752+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:56:28.221752+0000","last_peered":"2024-03-04T06:56:28.221752+0000","last_clean":"2024-03-04T06:56:28.221752+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:56:28.221752+0000","last_undegraded":"2024-03-04T06:56:28.221752+0000","last_fullsized":"2024-03-04T06:56:28.221752+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221703+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:56:28.221703+0000","last_peered":"2024-03-04T06:56:28.221703+0000","last_clean":"2024-03-04T06:56:28.221703+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:56:28.221703+0000","last_undegraded":"2024-03-04T06:56:28.221703+0000","last_fullsized":"2024-03-04T06:56:28.221703+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1253,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382011+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:56:28.382011+0000","last_peered":"2024-03-04T06:56:28.382011+0000","last_clean":"2024-03-04T06:56:28.382011+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:56:28.382011+0000","last_undegraded":"2024-03-04T06:56:28.382011+0000","last_fullsized":"2024-03-04T06:56:28.382011+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540129+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:57:04.540129+0000","last_peered":"2024-03-04T06:57:04.540129+0000","last_clean":"2024-03-04T06:57:04.540129+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:57:04.540129+0000","last_undegraded":"2024-03-04T06:57:04.540129+0000","last_fullsized":"2024-03-04T06:57:04.540129+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3577,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377824+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:55:48.377824+0000","last_peered":"2024-03-04T06:55:48.377824+0000","last_clean":"2024-03-04T06:55:48.377824+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:55:48.377824+0000","last_undegraded":"2024-03-04T06:55:48.377824+0000","last_fullsized":"2024-03-04T06:55:48.377824+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:17.616250+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:57:17.616250+0000","last_peered":"2024-03-04T06:57:17.616250+0000","last_clean":"2024-03-04T06:57:17.616250+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:57:17.616250+0000","last_undegraded":"2024-03-04T06:57:17.616250+0000","last_fullsized":"2024-03-04T06:57:17.616250+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:56:49.538613+0000","last_peered":"2024-03-04T06:56:49.538613+0000","last_clean":"2024-03-04T06:56:49.538613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:56:49.538613+0000","last_undegraded":"2024-03-04T06:56:49.538613+0000","last_fullsized":"2024-03-04T06:56:49.538613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17116,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992661+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:56:22.992661+0000","last_peered":"2024-03-04T06:56:22.992661+0000","last_clean":"2024-03-04T06:56:22.992661+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:56:22.992661+0000","last_undegraded":"2024-03-04T06:56:22.992661+0000","last_fullsized":"2024-03-04T06:56:22.992661+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151860+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:56:58.151860+0000","last_peered":"2024-03-04T06:56:58.151860+0000","last_clean":"2024-03-04T06:56:58.151860+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:56:58.151860+0000","last_undegraded":"2024-03-04T06:56:58.151860+0000","last_fullsized":"2024-03-04T06:56:58.151860+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151904+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:56:58.151904+0000","last_peered":"2024-03-04T06:56:58.151904+0000","last_clean":"2024-03-04T06:56:58.151904+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:56:58.151904+0000","last_undegraded":"2024-03-04T06:56:58.151904+0000","last_fullsized":"2024-03-04T06:56:58.151904+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947110+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:57:12.947110+0000","last_peered":"2024-03-04T06:57:12.947110+0000","last_clean":"2024-03-04T06:57:12.947110+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:57:12.947110+0000","last_undegraded":"2024-03-04T06:57:12.947110+0000","last_fullsized":"2024-03-04T06:57:12.947110+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4386,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992700+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:56:22.992700+0000","last_peered":"2024-03-04T06:56:22.992700+0000","last_clean":"2024-03-04T06:56:22.992700+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:56:22.992700+0000","last_undegraded":"2024-03-04T06:56:22.992700+0000","last_fullsized":"2024-03-04T06:56:22.992700+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151882+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:56:58.151882+0000","last_peered":"2024-03-04T06:56:58.151882+0000","last_clean":"2024-03-04T06:56:58.151882+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:56:58.151882+0000","last_undegraded":"2024-03-04T06:56:58.151882+0000","last_fullsized":"2024-03-04T06:56:58.151882+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947055+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:57:12.947055+0000","last_peered":"2024-03-04T06:57:12.947055+0000","last_clean":"2024-03-04T06:57:12.947055+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:57:12.947055+0000","last_undegraded":"2024-03-04T06:57:12.947055+0000","last_fullsized":"2024-03-04T06:57:12.947055+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611663+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:56:37.611663+0000","last_peered":"2024-03-04T06:56:37.611663+0000","last_clean":"2024-03-04T06:56:37.611663+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:56:37.611663+0000","last_undegraded":"2024-03-04T06:56:37.611663+0000","last_fullsized":"2024-03-04T06:56:37.611663+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5639,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377937+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:55:48.377937+0000","last_peered":"2024-03-04T06:55:48.377937+0000","last_clean":"2024-03-04T06:55:48.377937+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:55:48.377937+0000","last_undegraded":"2024-03-04T06:55:48.377937+0000","last_fullsized":"2024-03-04T06:55:48.377937+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1256,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154711+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:57:23.154711+0000","last_peered":"2024-03-04T06:57:23.154711+0000","last_clean":"2024-03-04T06:57:23.154711+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:57:23.154711+0000","last_undegraded":"2024-03-04T06:57:23.154711+0000","last_fullsized":"2024-03-04T06:57:23.154711+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:33.149241+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:56:33.149241+0000","last_peered":"2024-03-04T06:56:33.149241+0000","last_clean":"2024-03-04T06:56:33.149241+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:56:33.149241+0000","last_undegraded":"2024-03-04T06:56:33.149241+0000","last_fullsized":"2024-03-04T06:56:33.149241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389235+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:57:33.389235+0000","last_peered":"2024-03-04T06:57:33.389235+0000","last_clean":"2024-03-04T06:57:33.389235+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:57:33.389235+0000","last_undegraded":"2024-03-04T06:57:33.389235+0000","last_fullsized":"2024-03-04T06:57:33.389235+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4015,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:19.534498+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:56:19.534498+0000","last_peered":"2024-03-04T06:56:19.534498+0000","last_clean":"2024-03-04T06:56:19.534498+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:56:19.534498+0000","last_undegraded":"2024-03-04T06:56:19.534498+0000","last_fullsized":"2024-03-04T06:56:19.534498+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230253+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:57:48.230253+0000","last_peered":"2024-03-04T06:57:48.230253+0000","last_clean":"2024-03-04T06:57:48.230253+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:57:48.230253+0000","last_undegraded":"2024-03-04T06:57:48.230253+0000","last_fullsized":"2024-03-04T06:57:48.230253+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.990790+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:56:04.990790+0000","last_peered":"2024-03-04T06:56:04.990790+0000","last_clean":"2024-03-04T06:56:04.990790+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:56:04.990790+0000","last_undegraded":"2024-03-04T06:56:04.990790+0000","last_fullsized":"2024-03-04T06:56:04.990790+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947097+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:57:12.947097+0000","last_peered":"2024-03-04T06:57:12.947097+0000","last_clean":"2024-03-04T06:57:12.947097+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:57:12.947097+0000","last_undegraded":"2024-03-04T06:57:12.947097+0000","last_fullsized":"2024-03-04T06:57:12.947097+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1550,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532802+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:56:04.532802+0000","last_peered":"2024-03-04T06:56:04.532802+0000","last_clean":"2024-03-04T06:56:04.532802+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:56:04.532802+0000","last_undegraded":"2024-03-04T06:56:04.532802+0000","last_fullsized":"2024-03-04T06:56:04.532802+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3951,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949380+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:57:32.949380+0000","last_peered":"2024-03-04T06:57:32.949380+0000","last_clean":"2024-03-04T06:57:32.949380+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:57:32.949380+0000","last_undegraded":"2024-03-04T06:57:32.949380+0000","last_fullsized":"2024-03-04T06:57:32.949380+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995396+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:56:47.995396+0000","last_peered":"2024-03-04T06:56:47.995396+0000","last_clean":"2024-03-04T06:56:47.995396+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:56:47.995396+0000","last_undegraded":"2024-03-04T06:56:47.995396+0000","last_fullsized":"2024-03-04T06:56:47.995396+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389207+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:57:33.389207+0000","last_peered":"2024-03-04T06:57:33.389207+0000","last_clean":"2024-03-04T06:57:33.389207+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:57:33.389207+0000","last_undegraded":"2024-03-04T06:57:33.389207+0000","last_fullsized":"2024-03-04T06:57:33.389207+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.532768+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:56:04.532768+0000","last_peered":"2024-03-04T06:56:04.532768+0000","last_clean":"2024-03-04T06:56:04.532768+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:56:04.532768+0000","last_undegraded":"2024-03-04T06:56:04.532768+0000","last_fullsized":"2024-03-04T06:56:04.532768+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15292,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.230222+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:57:48.230222+0000","last_peered":"2024-03-04T06:57:48.230222+0000","last_clean":"2024-03-04T06:57:48.230222+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:57:48.230222+0000","last_undegraded":"2024-03-04T06:57:48.230222+0000","last_fullsized":"2024-03-04T06:57:48.230222+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992678+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:56:22.992678+0000","last_peered":"2024-03-04T06:56:22.992678+0000","last_clean":"2024-03-04T06:56:22.992678+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:56:22.992678+0000","last_undegraded":"2024-03-04T06:56:22.992678+0000","last_fullsized":"2024-03-04T06:56:22.992678+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534547+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:56:19.534547+0000","last_peered":"2024-03-04T06:56:19.534547+0000","last_clean":"2024-03-04T06:56:19.534547+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:56:19.534547+0000","last_undegraded":"2024-03-04T06:56:19.534547+0000","last_fullsized":"2024-03-04T06:56:19.534547+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151891+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:56:58.151891+0000","last_peered":"2024-03-04T06:56:58.151891+0000","last_clean":"2024-03-04T06:56:58.151891+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:56:58.151891+0000","last_undegraded":"2024-03-04T06:56:58.151891+0000","last_fullsized":"2024-03-04T06:56:58.151891+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4379,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:37.611623+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:56:37.611623+0000","last_peered":"2024-03-04T06:56:37.611623+0000","last_clean":"2024-03-04T06:56:37.611623+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:56:37.611623+0000","last_undegraded":"2024-03-04T06:56:37.611623+0000","last_fullsized":"2024-03-04T06:56:37.611623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001670+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:57:45.001670+0000","last_peered":"2024-03-04T06:57:45.001670+0000","last_clean":"2024-03-04T06:57:45.001670+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:57:45.001670+0000","last_undegraded":"2024-03-04T06:57:45.001670+0000","last_fullsized":"2024-03-04T06:57:45.001670+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1269,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154698+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:57:23.154698+0000","last_peered":"2024-03-04T06:57:23.154698+0000","last_clean":"2024-03-04T06:57:23.154698+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:57:23.154698+0000","last_undegraded":"2024-03-04T06:57:23.154698+0000","last_fullsized":"2024-03-04T06:57:23.154698+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992884+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:56:24.992884+0000","last_peered":"2024-03-04T06:56:24.992884+0000","last_clean":"2024-03-04T06:56:24.992884+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:56:24.992884+0000","last_undegraded":"2024-03-04T06:56:24.992884+0000","last_fullsized":"2024-03-04T06:56:24.992884+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4610,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:45.001644+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:57:45.001644+0000","last_peered":"2024-03-04T06:57:45.001644+0000","last_clean":"2024-03-04T06:57:45.001644+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:57:45.001644+0000","last_undegraded":"2024-03-04T06:57:45.001644+0000","last_fullsized":"2024-03-04T06:57:45.001644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611593+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:56:37.611593+0000","last_peered":"2024-03-04T06:56:37.611593+0000","last_clean":"2024-03-04T06:56:37.611593+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:56:37.611593+0000","last_undegraded":"2024-03-04T06:56:37.611593+0000","last_fullsized":"2024-03-04T06:56:37.611593+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1078,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218837+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:58.218837+0000","last_peered":"2024-03-04T06:55:58.218837+0000","last_clean":"2024-03-04T06:55:58.218837+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:58.218837+0000","last_undegraded":"2024-03-04T06:55:58.218837+0000","last_fullsized":"2024-03-04T06:55:58.218837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995375+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:56:47.995375+0000","last_peered":"2024-03-04T06:56:47.995375+0000","last_clean":"2024-03-04T06:56:47.995375+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:56:47.995375+0000","last_undegraded":"2024-03-04T06:56:47.995375+0000","last_fullsized":"2024-03-04T06:56:47.995375+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4634,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:37.935758+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:55:37.935758+0000","last_peered":"2024-03-04T06:55:37.935758+0000","last_clean":"2024-03-04T06:55:37.935758+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:55:37.935758+0000","last_undegraded":"2024-03-04T06:55:37.935758+0000","last_fullsized":"2024-03-04T06:55:37.935758+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:34.536591+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:56:34.536591+0000","last_peered":"2024-03-04T06:56:34.536591+0000","last_clean":"2024-03-04T06:56:34.536591+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:56:34.536591+0000","last_undegraded":"2024-03-04T06:56:34.536591+0000","last_fullsized":"2024-03-04T06:56:34.536591+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1185,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:57.614016+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:56:57.614016+0000","last_peered":"2024-03-04T06:56:57.614016+0000","last_clean":"2024-03-04T06:56:57.614016+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:56:57.614016+0000","last_undegraded":"2024-03-04T06:56:57.614016+0000","last_fullsized":"2024-03-04T06:56:57.614016+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5158,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:17.616210+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:57:17.616210+0000","last_peered":"2024-03-04T06:57:17.616210+0000","last_clean":"2024-03-04T06:57:17.616210+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:57:17.616210+0000","last_undegraded":"2024-03-04T06:57:17.616210+0000","last_fullsized":"2024-03-04T06:57:17.616210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154620+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:57:23.154620+0000","last_peered":"2024-03-04T06:57:23.154620+0000","last_clean":"2024-03-04T06:57:23.154620+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:57:23.154620+0000","last_undegraded":"2024-03-04T06:57:23.154620+0000","last_fullsized":"2024-03-04T06:57:23.154620+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992810+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:56:24.992810+0000","last_peered":"2024-03-04T06:56:24.992810+0000","last_clean":"2024-03-04T06:56:24.992810+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:56:24.992810+0000","last_undegraded":"2024-03-04T06:56:24.992810+0000","last_fullsized":"2024-03-04T06:56:24.992810+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4719,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380021+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:56:08.380021+0000","last_peered":"2024-03-04T06:56:08.380021+0000","last_clean":"2024-03-04T06:56:08.380021+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:56:08.380021+0000","last_undegraded":"2024-03-04T06:56:08.380021+0000","last_fullsized":"2024-03-04T06:56:08.380021+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154658+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:57:23.154658+0000","last_peered":"2024-03-04T06:57:23.154658+0000","last_clean":"2024-03-04T06:57:23.154658+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:57:23.154658+0000","last_undegraded":"2024-03-04T06:57:23.154658+0000","last_fullsized":"2024-03-04T06:57:23.154658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994937+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:56:44.994937+0000","last_peered":"2024-03-04T06:56:44.994937+0000","last_clean":"2024-03-04T06:56:44.994937+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:56:44.994937+0000","last_undegraded":"2024-03-04T06:56:44.994937+0000","last_fullsized":"2024-03-04T06:56:44.994937+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5554,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:55:33.143474+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:55:33.143474+0000","last_peered":"2024-03-04T06:55:33.143474+0000","last_clean":"2024-03-04T06:55:33.143474+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:55:33.143474+0000","last_undegraded":"2024-03-04T06:55:33.143474+0000","last_fullsized":"2024-03-04T06:55:33.143474+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:56:49.538554+0000","last_peered":"2024-03-04T06:56:49.538554+0000","last_clean":"2024-03-04T06:56:49.538554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:56:49.538554+0000","last_undegraded":"2024-03-04T06:56:49.538554+0000","last_fullsized":"2024-03-04T06:56:49.538554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218784+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:58.218784+0000","last_peered":"2024-03-04T06:55:58.218784+0000","last_clean":"2024-03-04T06:55:58.218784+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:58.218784+0000","last_undegraded":"2024-03-04T06:55:58.218784+0000","last_fullsized":"2024-03-04T06:55:58.218784+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.379963+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:56:08.379963+0000","last_peered":"2024-03-04T06:56:08.379963+0000","last_clean":"2024-03-04T06:56:08.379963+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:56:08.379963+0000","last_undegraded":"2024-03-04T06:56:08.379963+0000","last_fullsized":"2024-03-04T06:56:08.379963+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380005+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:56:08.380005+0000","last_peered":"2024-03-04T06:56:08.380005+0000","last_clean":"2024-03-04T06:56:08.380005+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:56:08.380005+0000","last_undegraded":"2024-03-04T06:56:08.380005+0000","last_fullsized":"2024-03-04T06:56:08.380005+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:56:49.538599+0000","last_peered":"2024-03-04T06:56:49.538599+0000","last_clean":"2024-03-04T06:56:49.538599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:56:49.538599+0000","last_undegraded":"2024-03-04T06:56:49.538599+0000","last_fullsized":"2024-03-04T06:56:49.538599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4366,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:48.377880+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:55:48.377880+0000","last_peered":"2024-03-04T06:55:48.377880+0000","last_clean":"2024-03-04T06:55:48.377880+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:55:48.377880+0000","last_undegraded":"2024-03-04T06:55:48.377880+0000","last_fullsized":"2024-03-04T06:55:48.377880+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:33.143531+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:55:33.143531+0000","last_peered":"2024-03-04T06:55:33.143531+0000","last_clean":"2024-03-04T06:55:33.143531+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:55:33.143531+0000","last_undegraded":"2024-03-04T06:55:33.143531+0000","last_fullsized":"2024-03-04T06:55:33.143531+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1139,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935733+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:55:37.935733+0000","last_peered":"2024-03-04T06:55:37.935733+0000","last_clean":"2024-03-04T06:55:37.935733+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:55:37.935733+0000","last_undegraded":"2024-03-04T06:55:37.935733+0000","last_fullsized":"2024-03-04T06:55:37.935733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4600,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:34.536621+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:56:34.536621+0000","last_peered":"2024-03-04T06:56:34.536621+0000","last_clean":"2024-03-04T06:56:34.536621+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:56:34.536621+0000","last_undegraded":"2024-03-04T06:56:34.536621+0000","last_fullsized":"2024-03-04T06:56:34.536621+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1245,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380055+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:56:08.380055+0000","last_peered":"2024-03-04T06:56:08.380055+0000","last_clean":"2024-03-04T06:56:08.380055+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:56:08.380055+0000","last_undegraded":"2024-03-04T06:56:08.380055+0000","last_fullsized":"2024-03-04T06:56:08.380055+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538627+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:56:49.538627+0000","last_peered":"2024-03-04T06:56:49.538627+0000","last_clean":"2024-03-04T06:56:49.538627+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:56:49.538627+0000","last_undegraded":"2024-03-04T06:56:49.538627+0000","last_fullsized":"2024-03-04T06:56:49.538627+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230189+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:57:48.230189+0000","last_peered":"2024-03-04T06:57:48.230189+0000","last_clean":"2024-03-04T06:57:48.230189+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:57:48.230189+0000","last_undegraded":"2024-03-04T06:57:48.230189+0000","last_fullsized":"2024-03-04T06:57:48.230189+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389246+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:57:33.389246+0000","last_peered":"2024-03-04T06:57:33.389246+0000","last_clean":"2024-03-04T06:57:33.389246+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:57:33.389246+0000","last_undegraded":"2024-03-04T06:57:33.389246+0000","last_fullsized":"2024-03-04T06:57:33.389246+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947082+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:57:12.947082+0000","last_peered":"2024-03-04T06:57:12.947082+0000","last_clean":"2024-03-04T06:57:12.947082+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:57:12.947082+0000","last_undegraded":"2024-03-04T06:57:12.947082+0000","last_fullsized":"2024-03-04T06:57:12.947082+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992636+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:56:22.992636+0000","last_peered":"2024-03-04T06:56:22.992636+0000","last_clean":"2024-03-04T06:56:22.992636+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:56:22.992636+0000","last_undegraded":"2024-03-04T06:56:22.992636+0000","last_fullsized":"2024-03-04T06:56:22.992636+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992858+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:56:24.992858+0000","last_peered":"2024-03-04T06:56:24.992858+0000","last_clean":"2024-03-04T06:56:24.992858+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:56:24.992858+0000","last_undegraded":"2024-03-04T06:56:24.992858+0000","last_fullsized":"2024-03-04T06:56:24.992858+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154682+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:57:23.154682+0000","last_peered":"2024-03-04T06:57:23.154682+0000","last_clean":"2024-03-04T06:57:23.154682+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:57:23.154682+0000","last_undegraded":"2024-03-04T06:57:23.154682+0000","last_fullsized":"2024-03-04T06:57:23.154682+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218825+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:58.218825+0000","last_peered":"2024-03-04T06:55:58.218825+0000","last_clean":"2024-03-04T06:55:58.218825+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:58.218825+0000","last_undegraded":"2024-03-04T06:55:58.218825+0000","last_fullsized":"2024-03-04T06:55:58.218825+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992900+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:56:24.992900+0000","last_peered":"2024-03-04T06:56:24.992900+0000","last_clean":"2024-03-04T06:56:24.992900+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:56:24.992900+0000","last_undegraded":"2024-03-04T06:56:24.992900+0000","last_fullsized":"2024-03-04T06:56:24.992900+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949325+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:57:32.949325+0000","last_peered":"2024-03-04T06:57:32.949325+0000","last_clean":"2024-03-04T06:57:32.949325+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:57:32.949325+0000","last_undegraded":"2024-03-04T06:57:32.949325+0000","last_fullsized":"2024-03-04T06:57:32.949325+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994907+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:56:44.994907+0000","last_peered":"2024-03-04T06:56:44.994907+0000","last_clean":"2024-03-04T06:56:44.994907+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:56:44.994907+0000","last_undegraded":"2024-03-04T06:56:44.994907+0000","last_fullsized":"2024-03-04T06:56:44.994907+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1120,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.935684+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:55:37.935684+0000","last_peered":"2024-03-04T06:55:37.935684+0000","last_clean":"2024-03-04T06:55:37.935684+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:55:37.935684+0000","last_undegraded":"2024-03-04T06:55:37.935684+0000","last_fullsized":"2024-03-04T06:55:37.935684+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.998327+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:57:12.998327+0000","last_peered":"2024-03-04T06:57:12.998327+0000","last_clean":"2024-03-04T06:57:12.998327+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:57:12.998327+0000","last_undegraded":"2024-03-04T06:57:12.998327+0000","last_fullsized":"2024-03-04T06:57:12.998327+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.220345+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:56:13.220345+0000","last_peered":"2024-03-04T06:56:13.220345+0000","last_clean":"2024-03-04T06:56:13.220345+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:56:13.220345+0000","last_undegraded":"2024-03-04T06:56:13.220345+0000","last_fullsized":"2024-03-04T06:56:13.220345+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503479,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648127,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142434,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287081,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997787,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885843,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937421,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792774,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T06:59:59.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:59.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:59.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:59.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:59.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:59.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:59.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:59.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:59.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:59.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T06:59:59.497 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:00:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: pgmap v1064: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: from='client.34629 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: Health detail: HEALTH_ERR Possible data damage: 10 pgs snaptrim_error 2024-03-04T07:00:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: [ERR] PG_DAMAGED: Possible data damage: 10 pgs snaptrim_error 2024-03-04T07:00:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: pg 5.0 is active+clean+snaptrim_error, acting [3,1,4] 2024-03-04T07:00:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: pg 5.1 is active+clean+snaptrim_error, acting [4,3,7] 2024-03-04T07:00:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: pg 5.2 is active+clean+snaptrim_error, acting [6,0,5] 2024-03-04T07:00:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-04T07:00:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: pg 5.4 is active+clean+snaptrim_error, acting [7,2,5] 2024-03-04T07:00:00.293 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-04T07:00:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: pg 5.9 is active+clean+snaptrim_error, acting [7,6,1] 2024-03-04T07:00:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: pg 5.c is active+clean+snaptrim_error, acting [1,4,0] 2024-03-04T07:00:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: pg 5.e is active+clean+snaptrim_error, acting [4,5,0] 2024-03-04T07:00:00.294 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[91314]: pg 5.f is active+clean+snaptrim_error, acting [5,4,6] 2024-03-04T07:00:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:59:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR Possible data damage: 10 pgs snaptrim_error 2024-03-04T07:00:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:59:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : [ERR] PG_DAMAGED: Possible data damage: 10 pgs snaptrim_error 2024-03-04T07:00:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:59:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.0 is active+clean+snaptrim_error, acting [3,1,4] 2024-03-04T07:00:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:59:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.1 is active+clean+snaptrim_error, acting [4,3,7] 2024-03-04T07:00:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:59:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.2 is active+clean+snaptrim_error, acting [6,0,5] 2024-03-04T07:00:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:59:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-04T07:00:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:59:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.4 is active+clean+snaptrim_error, acting [7,2,5] 2024-03-04T07:00:00.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:59:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:59:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.9 is active+clean+snaptrim_error, acting [7,6,1] 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:59:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.c is active+clean+snaptrim_error, acting [1,4,0] 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:59:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.e is active+clean+snaptrim_error, acting [4,5,0] 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T06:59:59.999+0000 7f439a4e6700 -1 log_channel(cluster) log [ERR] : pg 5.f is active+clean+snaptrim_error, acting [5,4,6] 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: pgmap v1064: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: from='client.34629 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: Health detail: HEALTH_ERR Possible data damage: 10 pgs snaptrim_error 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: [ERR] PG_DAMAGED: Possible data damage: 10 pgs snaptrim_error 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: pg 5.0 is active+clean+snaptrim_error, acting [3,1,4] 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: pg 5.1 is active+clean+snaptrim_error, acting [4,3,7] 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: pg 5.2 is active+clean+snaptrim_error, acting [6,0,5] 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: pg 5.4 is active+clean+snaptrim_error, acting [7,2,5] 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-04T07:00:00.295 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: pg 5.9 is active+clean+snaptrim_error, acting [7,6,1] 2024-03-04T07:00:00.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: pg 5.c is active+clean+snaptrim_error, acting [1,4,0] 2024-03-04T07:00:00.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: pg 5.e is active+clean+snaptrim_error, acting [4,5,0] 2024-03-04T07:00:00.296 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:00 smithi137 ceph-mon[88869]: pg 5.f is active+clean+snaptrim_error, acting [5,4,6] 2024-03-04T07:00:00.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: pgmap v1064: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:00.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: from='client.34629 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:00.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: Health detail: HEALTH_ERR Possible data damage: 10 pgs snaptrim_error 2024-03-04T07:00:00.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: [ERR] PG_DAMAGED: Possible data damage: 10 pgs snaptrim_error 2024-03-04T07:00:00.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: pg 5.0 is active+clean+snaptrim_error, acting [3,1,4] 2024-03-04T07:00:00.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: pg 5.1 is active+clean+snaptrim_error, acting [4,3,7] 2024-03-04T07:00:00.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: pg 5.2 is active+clean+snaptrim_error, acting [6,0,5] 2024-03-04T07:00:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-04T07:00:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: pg 5.4 is active+clean+snaptrim_error, acting [7,2,5] 2024-03-04T07:00:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-04T07:00:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: pg 5.9 is active+clean+snaptrim_error, acting [7,6,1] 2024-03-04T07:00:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: pg 5.c is active+clean+snaptrim_error, acting [1,4,0] 2024-03-04T07:00:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: pg 5.e is active+clean+snaptrim_error, acting [4,5,0] 2024-03-04T07:00:00.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:00 smithi203 ceph-mon[85573]: pg 5.f is active+clean+snaptrim_error, acting [5,4,6] 2024-03-04T07:00:02.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:02 smithi137 ceph-mon[88869]: pgmap v1065: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:02.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:02 smithi137 ceph-mon[91314]: pgmap v1065: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:02.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:02 smithi203 ceph-mon[85573]: pgmap v1065: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:04.397 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:04 smithi203 ceph-mon[85573]: pgmap v1066: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:04.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:04 smithi137 ceph-mon[88869]: pgmap v1066: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:04.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:04 smithi137 ceph-mon[91314]: pgmap v1066: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:05.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:00:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:00:05] "GET /metrics HTTP/1.1" 200 36335 "" "Prometheus/2.43.0" 2024-03-04T07:00:06.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:06 smithi137 ceph-mon[88869]: pgmap v1067: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:06.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:06 smithi137 ceph-mon[91314]: pgmap v1067: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:06.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:06 smithi203 ceph-mon[85573]: pgmap v1067: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:08.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:08 smithi137 ceph-mon[88869]: pgmap v1068: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:08.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:08 smithi137 ceph-mon[91314]: pgmap v1068: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:08.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:08 smithi203 ceph-mon[85573]: pgmap v1068: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:09.498 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:00:09.529 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:00:09.529 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:00:09.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:00:09.718 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:00:10.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:10 smithi137 ceph-mon[88869]: pgmap v1069: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:10.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:10 smithi137 ceph-mon[91314]: pgmap v1069: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:10.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:10 smithi203 ceph-mon[85573]: pgmap v1069: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:11.168 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:11 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:00:11.169 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:11 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:00:11.594 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:11 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:00:11.634 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:00:11.636 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:00:12.233 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:12 smithi137 ceph-mon[88869]: pgmap v1070: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:12.233 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:12 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:00:12.233 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:12 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:00:12.233 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:12 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:00:12.233 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:12 smithi137 ceph-mon[91314]: pgmap v1070: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:12.233 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:12 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:00:12.233 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:12 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:00:12.234 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:12 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:00:12.255 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1070,"stamp":"2024-03-04T07:00:10.551131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003636"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534568+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:56:19.534568+0000","last_peered":"2024-03-04T06:56:19.534568+0000","last_clean":"2024-03-04T06:56:19.534568+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:56:19.534568+0000","last_undegraded":"2024-03-04T06:56:19.534568+0000","last_fullsized":"2024-03-04T06:56:19.534568+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151921+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:56:58.151921+0000","last_peered":"2024-03-04T06:56:58.151921+0000","last_clean":"2024-03-04T06:56:58.151921+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:56:58.151921+0000","last_undegraded":"2024-03-04T06:56:58.151921+0000","last_fullsized":"2024-03-04T06:56:58.151921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992691+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:56:22.992691+0000","last_peered":"2024-03-04T06:56:22.992691+0000","last_clean":"2024-03-04T06:56:22.992691+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:56:22.992691+0000","last_undegraded":"2024-03-04T06:56:22.992691+0000","last_fullsized":"2024-03-04T06:56:22.992691+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:52.944862+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:56:52.944862+0000","last_peered":"2024-03-04T06:56:52.944862+0000","last_clean":"2024-03-04T06:56:52.944862+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:56:52.944862+0000","last_undegraded":"2024-03-04T06:56:52.944862+0000","last_fullsized":"2024-03-04T06:56:52.944862+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543619+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:57:34.543619+0000","last_peered":"2024-03-04T06:57:34.543619+0000","last_clean":"2024-03-04T06:57:34.543619+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:57:34.543619+0000","last_undegraded":"2024-03-04T06:57:34.543619+0000","last_fullsized":"2024-03-04T06:57:34.543619+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941144+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:56:22.941144+0000","last_peered":"2024-03-04T06:56:22.941144+0000","last_clean":"2024-03-04T06:56:22.941144+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:56:22.941144+0000","last_undegraded":"2024-03-04T06:56:22.941144+0000","last_fullsized":"2024-03-04T06:56:22.941144+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543594+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:57:34.543594+0000","last_peered":"2024-03-04T06:57:34.543594+0000","last_clean":"2024-03-04T06:57:34.543594+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:57:34.543594+0000","last_undegraded":"2024-03-04T06:57:34.543594+0000","last_fullsized":"2024-03-04T06:57:34.543594+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984614+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:55:14.984614+0000","last_peered":"2024-03-04T06:55:14.984614+0000","last_clean":"2024-03-04T06:55:14.984614+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:55:14.984614+0000","last_undegraded":"2024-03-04T06:55:14.984614+0000","last_fullsized":"2024-03-04T06:55:14.984614+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1065,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541782+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:57:19.541782+0000","last_peered":"2024-03-04T06:57:19.541782+0000","last_clean":"2024-03-04T06:57:19.541782+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:57:19.541782+0000","last_undegraded":"2024-03-04T06:57:19.541782+0000","last_fullsized":"2024-03-04T06:57:19.541782+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223356+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:56:43.223356+0000","last_peered":"2024-03-04T06:56:43.223356+0000","last_clean":"2024-03-04T06:56:43.223356+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:56:43.223356+0000","last_undegraded":"2024-03-04T06:56:43.223356+0000","last_fullsized":"2024-03-04T06:56:43.223356+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223323+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:56:43.223323+0000","last_peered":"2024-03-04T06:56:43.223323+0000","last_clean":"2024-03-04T06:56:43.223323+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:56:43.223323+0000","last_undegraded":"2024-03-04T06:56:43.223323+0000","last_fullsized":"2024-03-04T06:56:43.223323+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:32.604419+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:32.604419+0000","last_peered":"2024-03-04T06:55:32.604419+0000","last_clean":"2024-03-04T06:55:32.604419+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:32.604419+0000","last_undegraded":"2024-03-04T06:55:32.604419+0000","last_fullsized":"2024-03-04T06:55:32.604419+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999343+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:57:24.999343+0000","last_peered":"2024-03-04T06:57:24.999343+0000","last_clean":"2024-03-04T06:57:24.999343+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:57:24.999343+0000","last_undegraded":"2024-03-04T06:57:24.999343+0000","last_fullsized":"2024-03-04T06:57:24.999343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001313+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:57:38.001313+0000","last_peered":"2024-03-04T06:57:38.001313+0000","last_clean":"2024-03-04T06:57:38.001313+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:57:38.001313+0000","last_undegraded":"2024-03-04T06:57:38.001313+0000","last_fullsized":"2024-03-04T06:57:38.001313+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:53.145282+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:53.145282+0000","last_peered":"2024-03-04T06:55:53.145282+0000","last_clean":"2024-03-04T06:55:53.145282+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:53.145282+0000","last_undegraded":"2024-03-04T06:55:53.145282+0000","last_fullsized":"2024-03-04T06:55:53.145282+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937387+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:52.937387+0000","last_peered":"2024-03-04T06:55:52.937387+0000","last_clean":"2024-03-04T06:55:52.937387+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:52.937387+0000","last_undegraded":"2024-03-04T06:55:52.937387+0000","last_fullsized":"2024-03-04T06:55:52.937387+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937465+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:52.937465+0000","last_peered":"2024-03-04T06:55:52.937465+0000","last_clean":"2024-03-04T06:55:52.937465+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:52.937465+0000","last_undegraded":"2024-03-04T06:55:52.937465+0000","last_fullsized":"2024-03-04T06:55:52.937465+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382095+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:56:28.382095+0000","last_peered":"2024-03-04T06:56:28.382095+0000","last_clean":"2024-03-04T06:56:28.382095+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:56:28.382095+0000","last_undegraded":"2024-03-04T06:56:28.382095+0000","last_fullsized":"2024-03-04T06:56:28.382095+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538587+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:56:49.538587+0000","last_peered":"2024-03-04T06:56:49.538587+0000","last_clean":"2024-03-04T06:56:49.538587+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:56:49.538587+0000","last_undegraded":"2024-03-04T06:56:49.538587+0000","last_fullsized":"2024-03-04T06:56:49.538587+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1305,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992748+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:56:22.992748+0000","last_peered":"2024-03-04T06:56:22.992748+0000","last_clean":"2024-03-04T06:56:22.992748+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:56:22.992748+0000","last_undegraded":"2024-03-04T06:56:22.992748+0000","last_fullsized":"2024-03-04T06:56:22.992748+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001710+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:57:45.001710+0000","last_peered":"2024-03-04T06:57:45.001710+0000","last_clean":"2024-03-04T06:57:45.001710+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:57:45.001710+0000","last_undegraded":"2024-03-04T06:57:45.001710+0000","last_fullsized":"2024-03-04T06:57:45.001710+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001722+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:57:45.001722+0000","last_peered":"2024-03-04T06:57:45.001722+0000","last_clean":"2024-03-04T06:57:45.001722+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:57:45.001722+0000","last_undegraded":"2024-03-04T06:57:45.001722+0000","last_fullsized":"2024-03-04T06:57:45.001722+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992731+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:56:22.992731+0000","last_peered":"2024-03-04T06:56:22.992731+0000","last_clean":"2024-03-04T06:56:22.992731+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:56:22.992731+0000","last_undegraded":"2024-03-04T06:56:22.992731+0000","last_fullsized":"2024-03-04T06:56:22.992731+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1235,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386420+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:57:08.386420+0000","last_peered":"2024-03-04T06:57:08.386420+0000","last_clean":"2024-03-04T06:57:08.386420+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:57:08.386420+0000","last_undegraded":"2024-03-04T06:57:08.386420+0000","last_fullsized":"2024-03-04T06:57:08.386420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1222,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386390+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:57:08.386390+0000","last_peered":"2024-03-04T06:57:08.386390+0000","last_clean":"2024-03-04T06:57:08.386390+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:57:08.386390+0000","last_undegraded":"2024-03-04T06:57:08.386390+0000","last_fullsized":"2024-03-04T06:57:08.386390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543632+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:57:34.543632+0000","last_peered":"2024-03-04T06:57:34.543632+0000","last_clean":"2024-03-04T06:57:34.543632+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:57:34.543632+0000","last_undegraded":"2024-03-04T06:57:34.543632+0000","last_fullsized":"2024-03-04T06:57:34.543632+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941175+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:56:22.941175+0000","last_peered":"2024-03-04T06:56:22.941175+0000","last_clean":"2024-03-04T06:56:22.941175+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:56:22.941175+0000","last_undegraded":"2024-03-04T06:56:22.941175+0000","last_fullsized":"2024-03-04T06:56:22.941175+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:14.984673+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:55:14.984673+0000","last_peered":"2024-03-04T06:55:14.984673+0000","last_clean":"2024-03-04T06:55:14.984673+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:55:14.984673+0000","last_undegraded":"2024-03-04T06:55:14.984673+0000","last_fullsized":"2024-03-04T06:55:14.984673+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1189,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:47.606038+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:47.606038+0000","last_peered":"2024-03-04T06:55:47.606038+0000","last_clean":"2024-03-04T06:55:47.606038+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:47.606038+0000","last_undegraded":"2024-03-04T06:55:47.606038+0000","last_fullsized":"2024-03-04T06:55:47.606038+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.224901+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:56:58.224901+0000","last_peered":"2024-03-04T06:56:58.224901+0000","last_clean":"2024-03-04T06:56:58.224901+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:56:58.224901+0000","last_undegraded":"2024-03-04T06:56:58.224901+0000","last_fullsized":"2024-03-04T06:56:58.224901+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:57.989954+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:57.989954+0000","last_peered":"2024-03-04T06:55:57.989954+0000","last_clean":"2024-03-04T06:55:57.989954+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:57.989954+0000","last_undegraded":"2024-03-04T06:55:57.989954+0000","last_fullsized":"2024-03-04T06:55:57.989954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999328+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:57:24.999328+0000","last_peered":"2024-03-04T06:57:24.999328+0000","last_clean":"2024-03-04T06:57:24.999328+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:57:24.999328+0000","last_undegraded":"2024-03-04T06:57:24.999328+0000","last_fullsized":"2024-03-04T06:57:24.999328+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999296+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:57:24.999296+0000","last_peered":"2024-03-04T06:57:24.999296+0000","last_clean":"2024-03-04T06:57:24.999296+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:57:24.999296+0000","last_undegraded":"2024-03-04T06:57:24.999296+0000","last_fullsized":"2024-03-04T06:57:24.999296+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939306+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:56:07.939306+0000","last_peered":"2024-03-04T06:56:07.939306+0000","last_clean":"2024-03-04T06:56:07.939306+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:56:07.939306+0000","last_undegraded":"2024-03-04T06:56:07.939306+0000","last_fullsized":"2024-03-04T06:56:07.939306+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147156+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:56:13.147156+0000","last_peered":"2024-03-04T06:56:13.147156+0000","last_clean":"2024-03-04T06:56:13.147156+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:56:13.147156+0000","last_undegraded":"2024-03-04T06:56:13.147156+0000","last_fullsized":"2024-03-04T06:56:13.147156+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223376+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:56:43.223376+0000","last_peered":"2024-03-04T06:56:43.223376+0000","last_clean":"2024-03-04T06:56:43.223376+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:56:43.223376+0000","last_undegraded":"2024-03-04T06:56:43.223376+0000","last_fullsized":"2024-03-04T06:56:43.223376+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939379+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:56:07.939379+0000","last_peered":"2024-03-04T06:56:07.939379+0000","last_clean":"2024-03-04T06:56:07.939379+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:56:07.939379+0000","last_undegraded":"2024-03-04T06:56:07.939379+0000","last_fullsized":"2024-03-04T06:56:07.939379+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939364+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:56:07.939364+0000","last_peered":"2024-03-04T06:56:07.939364+0000","last_clean":"2024-03-04T06:56:07.939364+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:56:07.939364+0000","last_undegraded":"2024-03-04T06:56:07.939364+0000","last_fullsized":"2024-03-04T06:56:07.939364+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.988031+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:37.988031+0000","last_peered":"2024-03-04T06:55:37.988031+0000","last_clean":"2024-03-04T06:55:37.988031+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:37.988031+0000","last_undegraded":"2024-03-04T06:55:37.988031+0000","last_fullsized":"2024-03-04T06:55:37.988031+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147207+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:56:13.147207+0000","last_peered":"2024-03-04T06:56:13.147207+0000","last_clean":"2024-03-04T06:56:13.147207+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:56:13.147207+0000","last_undegraded":"2024-03-04T06:56:13.147207+0000","last_fullsized":"2024-03-04T06:56:13.147207+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:37.618704+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:57:37.618704+0000","last_peered":"2024-03-04T06:57:37.618704+0000","last_clean":"2024-03-04T06:57:37.618704+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:57:37.618704+0000","last_undegraded":"2024-03-04T06:57:37.618704+0000","last_fullsized":"2024-03-04T06:57:37.618704+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1130,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221797+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:56:28.221797+0000","last_peered":"2024-03-04T06:56:28.221797+0000","last_clean":"2024-03-04T06:56:28.221797+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:56:28.221797+0000","last_undegraded":"2024-03-04T06:56:28.221797+0000","last_fullsized":"2024-03-04T06:56:28.221797+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541754+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:57:19.541754+0000","last_peered":"2024-03-04T06:57:19.541754+0000","last_clean":"2024-03-04T06:57:19.541754+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:57:19.541754+0000","last_undegraded":"2024-03-04T06:57:19.541754+0000","last_fullsized":"2024-03-04T06:57:19.541754+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001343+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:57:38.001343+0000","last_peered":"2024-03-04T06:57:38.001343+0000","last_clean":"2024-03-04T06:57:38.001343+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:57:38.001343+0000","last_undegraded":"2024-03-04T06:57:38.001343+0000","last_fullsized":"2024-03-04T06:57:38.001343+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382052+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:56:28.382052+0000","last_peered":"2024-03-04T06:56:28.382052+0000","last_clean":"2024-03-04T06:56:28.382052+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:56:28.382052+0000","last_undegraded":"2024-03-04T06:56:28.382052+0000","last_fullsized":"2024-03-04T06:56:28.382052+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937420+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:52.937420+0000","last_peered":"2024-03-04T06:55:52.937420+0000","last_clean":"2024-03-04T06:55:52.937420+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:52.937420+0000","last_undegraded":"2024-03-04T06:55:52.937420+0000","last_fullsized":"2024-03-04T06:55:52.937420+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540167+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:57:04.540167+0000","last_peered":"2024-03-04T06:57:04.540167+0000","last_clean":"2024-03-04T06:57:04.540167+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:57:04.540167+0000","last_undegraded":"2024-03-04T06:57:04.540167+0000","last_fullsized":"2024-03-04T06:57:04.540167+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221752+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:56:28.221752+0000","last_peered":"2024-03-04T06:56:28.221752+0000","last_clean":"2024-03-04T06:56:28.221752+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:56:28.221752+0000","last_undegraded":"2024-03-04T06:56:28.221752+0000","last_fullsized":"2024-03-04T06:56:28.221752+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221703+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:56:28.221703+0000","last_peered":"2024-03-04T06:56:28.221703+0000","last_clean":"2024-03-04T06:56:28.221703+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:56:28.221703+0000","last_undegraded":"2024-03-04T06:56:28.221703+0000","last_fullsized":"2024-03-04T06:56:28.221703+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1253,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382011+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:56:28.382011+0000","last_peered":"2024-03-04T06:56:28.382011+0000","last_clean":"2024-03-04T06:56:28.382011+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:56:28.382011+0000","last_undegraded":"2024-03-04T06:56:28.382011+0000","last_fullsized":"2024-03-04T06:56:28.382011+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540129+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:57:04.540129+0000","last_peered":"2024-03-04T06:57:04.540129+0000","last_clean":"2024-03-04T06:57:04.540129+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:57:04.540129+0000","last_undegraded":"2024-03-04T06:57:04.540129+0000","last_fullsized":"2024-03-04T06:57:04.540129+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3578,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.391939+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:57:58.391939+0000","last_peered":"2024-03-04T06:57:58.391939+0000","last_clean":"2024-03-04T06:57:58.391939+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:57:58.391939+0000","last_undegraded":"2024-03-04T06:57:58.391939+0000","last_fullsized":"2024-03-04T06:57:58.391939+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:17.616250+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:57:17.616250+0000","last_peered":"2024-03-04T06:57:17.616250+0000","last_clean":"2024-03-04T06:57:17.616250+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:57:17.616250+0000","last_undegraded":"2024-03-04T06:57:17.616250+0000","last_fullsized":"2024-03-04T06:57:17.616250+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:56:49.538613+0000","last_peered":"2024-03-04T06:56:49.538613+0000","last_clean":"2024-03-04T06:56:49.538613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:56:49.538613+0000","last_undegraded":"2024-03-04T06:56:49.538613+0000","last_fullsized":"2024-03-04T06:56:49.538613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17116,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992661+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:56:22.992661+0000","last_peered":"2024-03-04T06:56:22.992661+0000","last_clean":"2024-03-04T06:56:22.992661+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:56:22.992661+0000","last_undegraded":"2024-03-04T06:56:22.992661+0000","last_fullsized":"2024-03-04T06:56:22.992661+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151860+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:56:58.151860+0000","last_peered":"2024-03-04T06:56:58.151860+0000","last_clean":"2024-03-04T06:56:58.151860+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:56:58.151860+0000","last_undegraded":"2024-03-04T06:56:58.151860+0000","last_fullsized":"2024-03-04T06:56:58.151860+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151904+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:56:58.151904+0000","last_peered":"2024-03-04T06:56:58.151904+0000","last_clean":"2024-03-04T06:56:58.151904+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:56:58.151904+0000","last_undegraded":"2024-03-04T06:56:58.151904+0000","last_fullsized":"2024-03-04T06:56:58.151904+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947110+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:57:12.947110+0000","last_peered":"2024-03-04T06:57:12.947110+0000","last_clean":"2024-03-04T06:57:12.947110+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:57:12.947110+0000","last_undegraded":"2024-03-04T06:57:12.947110+0000","last_fullsized":"2024-03-04T06:57:12.947110+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4386,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992700+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:56:22.992700+0000","last_peered":"2024-03-04T06:56:22.992700+0000","last_clean":"2024-03-04T06:56:22.992700+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:56:22.992700+0000","last_undegraded":"2024-03-04T06:56:22.992700+0000","last_fullsized":"2024-03-04T06:56:22.992700+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151882+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:56:58.151882+0000","last_peered":"2024-03-04T06:56:58.151882+0000","last_clean":"2024-03-04T06:56:58.151882+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:56:58.151882+0000","last_undegraded":"2024-03-04T06:56:58.151882+0000","last_fullsized":"2024-03-04T06:56:58.151882+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947055+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:57:12.947055+0000","last_peered":"2024-03-04T06:57:12.947055+0000","last_clean":"2024-03-04T06:57:12.947055+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:57:12.947055+0000","last_undegraded":"2024-03-04T06:57:12.947055+0000","last_fullsized":"2024-03-04T06:57:12.947055+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611663+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:56:37.611663+0000","last_peered":"2024-03-04T06:56:37.611663+0000","last_clean":"2024-03-04T06:56:37.611663+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:56:37.611663+0000","last_undegraded":"2024-03-04T06:56:37.611663+0000","last_fullsized":"2024-03-04T06:56:37.611663+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5640,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392060+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:57:58.392060+0000","last_peered":"2024-03-04T06:57:58.392060+0000","last_clean":"2024-03-04T06:57:58.392060+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:57:58.392060+0000","last_undegraded":"2024-03-04T06:57:58.392060+0000","last_fullsized":"2024-03-04T06:57:58.392060+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1256,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154711+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:57:23.154711+0000","last_peered":"2024-03-04T06:57:23.154711+0000","last_clean":"2024-03-04T06:57:23.154711+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:57:23.154711+0000","last_undegraded":"2024-03-04T06:57:23.154711+0000","last_fullsized":"2024-03-04T06:57:23.154711+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:33.149241+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:56:33.149241+0000","last_peered":"2024-03-04T06:56:33.149241+0000","last_clean":"2024-03-04T06:56:33.149241+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:56:33.149241+0000","last_undegraded":"2024-03-04T06:56:33.149241+0000","last_fullsized":"2024-03-04T06:56:33.149241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389235+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:57:33.389235+0000","last_peered":"2024-03-04T06:57:33.389235+0000","last_clean":"2024-03-04T06:57:33.389235+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:57:33.389235+0000","last_undegraded":"2024-03-04T06:57:33.389235+0000","last_fullsized":"2024-03-04T06:57:33.389235+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4015,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:19.534498+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:56:19.534498+0000","last_peered":"2024-03-04T06:56:19.534498+0000","last_clean":"2024-03-04T06:56:19.534498+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:56:19.534498+0000","last_undegraded":"2024-03-04T06:56:19.534498+0000","last_fullsized":"2024-03-04T06:56:19.534498+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230253+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:57:48.230253+0000","last_peered":"2024-03-04T06:57:48.230253+0000","last_clean":"2024-03-04T06:57:48.230253+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:57:48.230253+0000","last_undegraded":"2024-03-04T06:57:48.230253+0000","last_fullsized":"2024-03-04T06:57:48.230253+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:04.990790+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:56:04.990790+0000","last_peered":"2024-03-04T06:56:04.990790+0000","last_clean":"2024-03-04T06:56:04.990790+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:56:04.990790+0000","last_undegraded":"2024-03-04T06:56:04.990790+0000","last_fullsized":"2024-03-04T06:56:04.990790+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947097+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:57:12.947097+0000","last_peered":"2024-03-04T06:57:12.947097+0000","last_clean":"2024-03-04T06:57:12.947097+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:57:12.947097+0000","last_undegraded":"2024-03-04T06:57:12.947097+0000","last_fullsized":"2024-03-04T06:57:12.947097+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1551,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547030+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:58:04.547030+0000","last_peered":"2024-03-04T06:58:04.547030+0000","last_clean":"2024-03-04T06:58:04.547030+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:58:04.547030+0000","last_undegraded":"2024-03-04T06:58:04.547030+0000","last_fullsized":"2024-03-04T06:58:04.547030+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3951,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949380+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:57:32.949380+0000","last_peered":"2024-03-04T06:57:32.949380+0000","last_clean":"2024-03-04T06:57:32.949380+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:57:32.949380+0000","last_undegraded":"2024-03-04T06:57:32.949380+0000","last_fullsized":"2024-03-04T06:57:32.949380+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995396+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:56:47.995396+0000","last_peered":"2024-03-04T06:56:47.995396+0000","last_clean":"2024-03-04T06:56:47.995396+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:56:47.995396+0000","last_undegraded":"2024-03-04T06:56:47.995396+0000","last_fullsized":"2024-03-04T06:56:47.995396+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389207+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:57:33.389207+0000","last_peered":"2024-03-04T06:57:33.389207+0000","last_clean":"2024-03-04T06:57:33.389207+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:57:33.389207+0000","last_undegraded":"2024-03-04T06:57:33.389207+0000","last_fullsized":"2024-03-04T06:57:33.389207+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547005+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:58:04.547005+0000","last_peered":"2024-03-04T06:58:04.547005+0000","last_clean":"2024-03-04T06:58:04.547005+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:58:04.547005+0000","last_undegraded":"2024-03-04T06:58:04.547005+0000","last_fullsized":"2024-03-04T06:58:04.547005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15292,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.230222+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:57:48.230222+0000","last_peered":"2024-03-04T06:57:48.230222+0000","last_clean":"2024-03-04T06:57:48.230222+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:57:48.230222+0000","last_undegraded":"2024-03-04T06:57:48.230222+0000","last_fullsized":"2024-03-04T06:57:48.230222+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992678+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:56:22.992678+0000","last_peered":"2024-03-04T06:56:22.992678+0000","last_clean":"2024-03-04T06:56:22.992678+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:56:22.992678+0000","last_undegraded":"2024-03-04T06:56:22.992678+0000","last_fullsized":"2024-03-04T06:56:22.992678+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534547+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:56:19.534547+0000","last_peered":"2024-03-04T06:56:19.534547+0000","last_clean":"2024-03-04T06:56:19.534547+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:56:19.534547+0000","last_undegraded":"2024-03-04T06:56:19.534547+0000","last_fullsized":"2024-03-04T06:56:19.534547+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151891+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:56:58.151891+0000","last_peered":"2024-03-04T06:56:58.151891+0000","last_clean":"2024-03-04T06:56:58.151891+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:56:58.151891+0000","last_undegraded":"2024-03-04T06:56:58.151891+0000","last_fullsized":"2024-03-04T06:56:58.151891+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4379,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:37.611623+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:56:37.611623+0000","last_peered":"2024-03-04T06:56:37.611623+0000","last_clean":"2024-03-04T06:56:37.611623+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:56:37.611623+0000","last_undegraded":"2024-03-04T06:56:37.611623+0000","last_fullsized":"2024-03-04T06:56:37.611623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001670+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:57:45.001670+0000","last_peered":"2024-03-04T06:57:45.001670+0000","last_clean":"2024-03-04T06:57:45.001670+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:57:45.001670+0000","last_undegraded":"2024-03-04T06:57:45.001670+0000","last_fullsized":"2024-03-04T06:57:45.001670+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1269,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154698+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:57:23.154698+0000","last_peered":"2024-03-04T06:57:23.154698+0000","last_clean":"2024-03-04T06:57:23.154698+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:57:23.154698+0000","last_undegraded":"2024-03-04T06:57:23.154698+0000","last_fullsized":"2024-03-04T06:57:23.154698+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992884+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:56:24.992884+0000","last_peered":"2024-03-04T06:56:24.992884+0000","last_clean":"2024-03-04T06:56:24.992884+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:56:24.992884+0000","last_undegraded":"2024-03-04T06:56:24.992884+0000","last_fullsized":"2024-03-04T06:56:24.992884+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4610,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:45.001644+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:57:45.001644+0000","last_peered":"2024-03-04T06:57:45.001644+0000","last_clean":"2024-03-04T06:57:45.001644+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:57:45.001644+0000","last_undegraded":"2024-03-04T06:57:45.001644+0000","last_fullsized":"2024-03-04T06:57:45.001644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611593+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:56:37.611593+0000","last_peered":"2024-03-04T06:56:37.611593+0000","last_clean":"2024-03-04T06:56:37.611593+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:56:37.611593+0000","last_undegraded":"2024-03-04T06:56:37.611593+0000","last_fullsized":"2024-03-04T06:56:37.611593+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1078,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218837+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:55:58.218837+0000","last_peered":"2024-03-04T06:55:58.218837+0000","last_clean":"2024-03-04T06:55:58.218837+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:55:58.218837+0000","last_undegraded":"2024-03-04T06:55:58.218837+0000","last_fullsized":"2024-03-04T06:55:58.218837+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995375+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:56:47.995375+0000","last_peered":"2024-03-04T06:56:47.995375+0000","last_clean":"2024-03-04T06:56:47.995375+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:56:47.995375+0000","last_undegraded":"2024-03-04T06:56:47.995375+0000","last_fullsized":"2024-03-04T06:56:47.995375+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4635,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:52.951690+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:57:52.951690+0000","last_peered":"2024-03-04T06:57:52.951690+0000","last_clean":"2024-03-04T06:57:52.951690+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:57:52.951690+0000","last_undegraded":"2024-03-04T06:57:52.951690+0000","last_fullsized":"2024-03-04T06:57:52.951690+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:34.536591+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:56:34.536591+0000","last_peered":"2024-03-04T06:56:34.536591+0000","last_clean":"2024-03-04T06:56:34.536591+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:56:34.536591+0000","last_undegraded":"2024-03-04T06:56:34.536591+0000","last_fullsized":"2024-03-04T06:56:34.536591+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1185,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:57.614016+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:56:57.614016+0000","last_peered":"2024-03-04T06:56:57.614016+0000","last_clean":"2024-03-04T06:56:57.614016+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:56:57.614016+0000","last_undegraded":"2024-03-04T06:56:57.614016+0000","last_fullsized":"2024-03-04T06:56:57.614016+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5158,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:17.616210+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:57:17.616210+0000","last_peered":"2024-03-04T06:57:17.616210+0000","last_clean":"2024-03-04T06:57:17.616210+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:57:17.616210+0000","last_undegraded":"2024-03-04T06:57:17.616210+0000","last_fullsized":"2024-03-04T06:57:17.616210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154620+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:57:23.154620+0000","last_peered":"2024-03-04T06:57:23.154620+0000","last_clean":"2024-03-04T06:57:23.154620+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:57:23.154620+0000","last_undegraded":"2024-03-04T06:57:23.154620+0000","last_fullsized":"2024-03-04T06:57:23.154620+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992810+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:56:24.992810+0000","last_peered":"2024-03-04T06:56:24.992810+0000","last_clean":"2024-03-04T06:56:24.992810+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:56:24.992810+0000","last_undegraded":"2024-03-04T06:56:24.992810+0000","last_fullsized":"2024-03-04T06:56:24.992810+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4719,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380021+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:56:08.380021+0000","last_peered":"2024-03-04T06:56:08.380021+0000","last_clean":"2024-03-04T06:56:08.380021+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:56:08.380021+0000","last_undegraded":"2024-03-04T06:56:08.380021+0000","last_fullsized":"2024-03-04T06:56:08.380021+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154658+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:57:23.154658+0000","last_peered":"2024-03-04T06:57:23.154658+0000","last_clean":"2024-03-04T06:57:23.154658+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:57:23.154658+0000","last_undegraded":"2024-03-04T06:57:23.154658+0000","last_fullsized":"2024-03-04T06:57:23.154658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994937+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:56:44.994937+0000","last_peered":"2024-03-04T06:56:44.994937+0000","last_clean":"2024-03-04T06:56:44.994937+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:56:44.994937+0000","last_undegraded":"2024-03-04T06:56:44.994937+0000","last_fullsized":"2024-03-04T06:56:44.994937+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5555,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.157094+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:57:48.157094+0000","last_peered":"2024-03-04T06:57:48.157094+0000","last_clean":"2024-03-04T06:57:48.157094+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:57:48.157094+0000","last_undegraded":"2024-03-04T06:57:48.157094+0000","last_fullsized":"2024-03-04T06:57:48.157094+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:56:49.538554+0000","last_peered":"2024-03-04T06:56:49.538554+0000","last_clean":"2024-03-04T06:56:49.538554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:56:49.538554+0000","last_undegraded":"2024-03-04T06:56:49.538554+0000","last_fullsized":"2024-03-04T06:56:49.538554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1100,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218784+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:55:58.218784+0000","last_peered":"2024-03-04T06:55:58.218784+0000","last_clean":"2024-03-04T06:55:58.218784+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:55:58.218784+0000","last_undegraded":"2024-03-04T06:55:58.218784+0000","last_fullsized":"2024-03-04T06:55:58.218784+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.379963+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:56:08.379963+0000","last_peered":"2024-03-04T06:56:08.379963+0000","last_clean":"2024-03-04T06:56:08.379963+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:56:08.379963+0000","last_undegraded":"2024-03-04T06:56:08.379963+0000","last_fullsized":"2024-03-04T06:56:08.379963+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380005+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:56:08.380005+0000","last_peered":"2024-03-04T06:56:08.380005+0000","last_clean":"2024-03-04T06:56:08.380005+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:56:08.380005+0000","last_undegraded":"2024-03-04T06:56:08.380005+0000","last_fullsized":"2024-03-04T06:56:08.380005+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:56:49.538599+0000","last_peered":"2024-03-04T06:56:49.538599+0000","last_clean":"2024-03-04T06:56:49.538599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:56:49.538599+0000","last_undegraded":"2024-03-04T06:56:49.538599+0000","last_fullsized":"2024-03-04T06:56:49.538599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4367,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392018+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:57:58.392018+0000","last_peered":"2024-03-04T06:57:58.392018+0000","last_clean":"2024-03-04T06:57:58.392018+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:57:58.392018+0000","last_undegraded":"2024-03-04T06:57:58.392018+0000","last_fullsized":"2024-03-04T06:57:58.392018+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.157162+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:57:48.157162+0000","last_peered":"2024-03-04T06:57:48.157162+0000","last_clean":"2024-03-04T06:57:48.157162+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:57:48.157162+0000","last_undegraded":"2024-03-04T06:57:48.157162+0000","last_fullsized":"2024-03-04T06:57:48.157162+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951665+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:57:52.951665+0000","last_peered":"2024-03-04T06:57:52.951665+0000","last_clean":"2024-03-04T06:57:52.951665+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:57:52.951665+0000","last_undegraded":"2024-03-04T06:57:52.951665+0000","last_fullsized":"2024-03-04T06:57:52.951665+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4600,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:34.536621+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:56:34.536621+0000","last_peered":"2024-03-04T06:56:34.536621+0000","last_clean":"2024-03-04T06:56:34.536621+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:56:34.536621+0000","last_undegraded":"2024-03-04T06:56:34.536621+0000","last_fullsized":"2024-03-04T06:56:34.536621+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1245,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380055+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:56:08.380055+0000","last_peered":"2024-03-04T06:56:08.380055+0000","last_clean":"2024-03-04T06:56:08.380055+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:56:08.380055+0000","last_undegraded":"2024-03-04T06:56:08.380055+0000","last_fullsized":"2024-03-04T06:56:08.380055+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538627+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:56:49.538627+0000","last_peered":"2024-03-04T06:56:49.538627+0000","last_clean":"2024-03-04T06:56:49.538627+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:56:49.538627+0000","last_undegraded":"2024-03-04T06:56:49.538627+0000","last_fullsized":"2024-03-04T06:56:49.538627+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230189+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:57:48.230189+0000","last_peered":"2024-03-04T06:57:48.230189+0000","last_clean":"2024-03-04T06:57:48.230189+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:57:48.230189+0000","last_undegraded":"2024-03-04T06:57:48.230189+0000","last_fullsized":"2024-03-04T06:57:48.230189+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389246+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:57:33.389246+0000","last_peered":"2024-03-04T06:57:33.389246+0000","last_clean":"2024-03-04T06:57:33.389246+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:57:33.389246+0000","last_undegraded":"2024-03-04T06:57:33.389246+0000","last_fullsized":"2024-03-04T06:57:33.389246+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947082+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:57:12.947082+0000","last_peered":"2024-03-04T06:57:12.947082+0000","last_clean":"2024-03-04T06:57:12.947082+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:57:12.947082+0000","last_undegraded":"2024-03-04T06:57:12.947082+0000","last_fullsized":"2024-03-04T06:57:12.947082+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992636+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:56:22.992636+0000","last_peered":"2024-03-04T06:56:22.992636+0000","last_clean":"2024-03-04T06:56:22.992636+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:56:22.992636+0000","last_undegraded":"2024-03-04T06:56:22.992636+0000","last_fullsized":"2024-03-04T06:56:22.992636+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992858+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:56:24.992858+0000","last_peered":"2024-03-04T06:56:24.992858+0000","last_clean":"2024-03-04T06:56:24.992858+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:56:24.992858+0000","last_undegraded":"2024-03-04T06:56:24.992858+0000","last_fullsized":"2024-03-04T06:56:24.992858+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154682+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:57:23.154682+0000","last_peered":"2024-03-04T06:57:23.154682+0000","last_clean":"2024-03-04T06:57:23.154682+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:57:23.154682+0000","last_undegraded":"2024-03-04T06:57:23.154682+0000","last_fullsized":"2024-03-04T06:57:23.154682+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:58.218825+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:55:58.218825+0000","last_peered":"2024-03-04T06:55:58.218825+0000","last_clean":"2024-03-04T06:55:58.218825+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:55:58.218825+0000","last_undegraded":"2024-03-04T06:55:58.218825+0000","last_fullsized":"2024-03-04T06:55:58.218825+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992900+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:56:24.992900+0000","last_peered":"2024-03-04T06:56:24.992900+0000","last_clean":"2024-03-04T06:56:24.992900+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:56:24.992900+0000","last_undegraded":"2024-03-04T06:56:24.992900+0000","last_fullsized":"2024-03-04T06:56:24.992900+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949325+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:57:32.949325+0000","last_peered":"2024-03-04T06:57:32.949325+0000","last_clean":"2024-03-04T06:57:32.949325+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:57:32.949325+0000","last_undegraded":"2024-03-04T06:57:32.949325+0000","last_fullsized":"2024-03-04T06:57:32.949325+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994907+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:56:44.994907+0000","last_peered":"2024-03-04T06:56:44.994907+0000","last_clean":"2024-03-04T06:56:44.994907+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:56:44.994907+0000","last_undegraded":"2024-03-04T06:56:44.994907+0000","last_fullsized":"2024-03-04T06:56:44.994907+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1121,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951615+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:57:52.951615+0000","last_peered":"2024-03-04T06:57:52.951615+0000","last_clean":"2024-03-04T06:57:52.951615+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:57:52.951615+0000","last_undegraded":"2024-03-04T06:57:52.951615+0000","last_fullsized":"2024-03-04T06:57:52.951615+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.998327+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:57:12.998327+0000","last_peered":"2024-03-04T06:57:12.998327+0000","last_clean":"2024-03-04T06:57:12.998327+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:57:12.998327+0000","last_undegraded":"2024-03-04T06:57:12.998327+0000","last_fullsized":"2024-03-04T06:57:12.998327+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.220345+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:56:13.220345+0000","last_peered":"2024-03-04T06:56:13.220345+0000","last_clean":"2024-03-04T06:56:13.220345+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:56:13.220345+0000","last_undegraded":"2024-03-04T06:56:13.220345+0000","last_fullsized":"2024-03-04T06:56:13.220345+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503482,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648129,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142436,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287083,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997789,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885846,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937423,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792776,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:00:12.259 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:12.260 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:12.260 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:12.260 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:12.260 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:12.260 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:12.260 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:12.260 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:12.260 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:12.260 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:12.260 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:00:12.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:12 smithi203 ceph-mon[85573]: pgmap v1070: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:12.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:12 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:00:12.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:12 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:00:12.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:12 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:00:13.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:13 smithi137 ceph-mon[88869]: from='client.44576 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:13.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:13 smithi137 ceph-mon[91314]: from='client.44576 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:13.594 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:13 smithi203 ceph-mon[85573]: from='client.44576 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:14.444 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:14 smithi137 ceph-mon[88869]: pgmap v1071: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:14.444 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:14 smithi137 ceph-mon[91314]: pgmap v1071: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:14.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:14 smithi203 ceph-mon[85573]: pgmap v1071: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:15.717 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:00:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:00:15] "GET /metrics HTTP/1.1" 200 36335 "" "Prometheus/2.43.0" 2024-03-04T07:00:16.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:16 smithi137 ceph-mon[91314]: pgmap v1072: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:16.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:16 smithi137 ceph-mon[88869]: pgmap v1072: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:16.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:16 smithi203 ceph-mon[85573]: pgmap v1072: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:18.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:18 smithi137 ceph-mon[88869]: pgmap v1073: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:18.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:18 smithi137 ceph-mon[91314]: pgmap v1073: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:18.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:18 smithi203 ceph-mon[85573]: pgmap v1073: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:20.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:20 smithi137 ceph-mon[88869]: pgmap v1074: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:20.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:20 smithi137 ceph-mon[91314]: pgmap v1074: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:20.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:20 smithi203 ceph-mon[85573]: pgmap v1074: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:22.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:00:22.484 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:00:22.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:22 smithi137 ceph-mon[88869]: pgmap v1075: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:22.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:22 smithi137 ceph-mon[91314]: pgmap v1075: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:22.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:22 smithi203 ceph-mon[85573]: pgmap v1075: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:24.429 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:00:24.430 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:24 smithi137 ceph-mon[88869]: pgmap v1076: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:24.430 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:00:24.430 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:24 smithi137 ceph-mon[91314]: pgmap v1076: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:24.430 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:00:24.437 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:00:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:24 smithi203 ceph-mon[85573]: pgmap v1076: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:00:25.128 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1076,"stamp":"2024-03-04T07:00:22.554653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003522"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534568+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:56:19.534568+0000","last_peered":"2024-03-04T06:56:19.534568+0000","last_clean":"2024-03-04T06:56:19.534568+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:56:19.534568+0000","last_undegraded":"2024-03-04T06:56:19.534568+0000","last_fullsized":"2024-03-04T06:56:19.534568+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151921+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:56:58.151921+0000","last_peered":"2024-03-04T06:56:58.151921+0000","last_clean":"2024-03-04T06:56:58.151921+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:56:58.151921+0000","last_undegraded":"2024-03-04T06:56:58.151921+0000","last_fullsized":"2024-03-04T06:56:58.151921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992691+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:56:22.992691+0000","last_peered":"2024-03-04T06:56:22.992691+0000","last_clean":"2024-03-04T06:56:22.992691+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:56:22.992691+0000","last_undegraded":"2024-03-04T06:56:22.992691+0000","last_fullsized":"2024-03-04T06:56:22.992691+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:52.944862+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:56:52.944862+0000","last_peered":"2024-03-04T06:56:52.944862+0000","last_clean":"2024-03-04T06:56:52.944862+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:56:52.944862+0000","last_undegraded":"2024-03-04T06:56:52.944862+0000","last_fullsized":"2024-03-04T06:56:52.944862+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543619+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:57:34.543619+0000","last_peered":"2024-03-04T06:57:34.543619+0000","last_clean":"2024-03-04T06:57:34.543619+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:57:34.543619+0000","last_undegraded":"2024-03-04T06:57:34.543619+0000","last_fullsized":"2024-03-04T06:57:34.543619+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941144+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:56:22.941144+0000","last_peered":"2024-03-04T06:56:22.941144+0000","last_clean":"2024-03-04T06:56:22.941144+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:56:22.941144+0000","last_undegraded":"2024-03-04T06:56:22.941144+0000","last_fullsized":"2024-03-04T06:56:22.941144+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543594+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:57:34.543594+0000","last_peered":"2024-03-04T06:57:34.543594+0000","last_clean":"2024-03-04T06:57:34.543594+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:57:34.543594+0000","last_undegraded":"2024-03-04T06:57:34.543594+0000","last_fullsized":"2024-03-04T06:57:34.543594+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001597+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:57:45.001597+0000","last_peered":"2024-03-04T06:57:45.001597+0000","last_clean":"2024-03-04T06:57:45.001597+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:57:45.001597+0000","last_undegraded":"2024-03-04T06:57:45.001597+0000","last_fullsized":"2024-03-04T06:57:45.001597+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1065,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541782+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:57:19.541782+0000","last_peered":"2024-03-04T06:57:19.541782+0000","last_clean":"2024-03-04T06:57:19.541782+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:57:19.541782+0000","last_undegraded":"2024-03-04T06:57:19.541782+0000","last_fullsized":"2024-03-04T06:57:19.541782+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223356+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:56:43.223356+0000","last_peered":"2024-03-04T06:56:43.223356+0000","last_clean":"2024-03-04T06:56:43.223356+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:56:43.223356+0000","last_undegraded":"2024-03-04T06:56:43.223356+0000","last_fullsized":"2024-03-04T06:56:43.223356+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223323+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:56:43.223323+0000","last_peered":"2024-03-04T06:56:43.223323+0000","last_clean":"2024-03-04T06:56:43.223323+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:56:43.223323+0000","last_undegraded":"2024-03-04T06:56:43.223323+0000","last_fullsized":"2024-03-04T06:56:43.223323+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1155,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:32.604419+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:55:32.604419+0000","last_peered":"2024-03-04T06:55:32.604419+0000","last_clean":"2024-03-04T06:55:32.604419+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:55:32.604419+0000","last_undegraded":"2024-03-04T06:55:32.604419+0000","last_fullsized":"2024-03-04T06:55:32.604419+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999343+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:57:24.999343+0000","last_peered":"2024-03-04T06:57:24.999343+0000","last_clean":"2024-03-04T06:57:24.999343+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:57:24.999343+0000","last_undegraded":"2024-03-04T06:57:24.999343+0000","last_fullsized":"2024-03-04T06:57:24.999343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001313+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:57:38.001313+0000","last_peered":"2024-03-04T06:57:38.001313+0000","last_clean":"2024-03-04T06:57:38.001313+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:57:38.001313+0000","last_undegraded":"2024-03-04T06:57:38.001313+0000","last_fullsized":"2024-03-04T06:57:38.001313+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:53.145282+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:55:53.145282+0000","last_peered":"2024-03-04T06:55:53.145282+0000","last_clean":"2024-03-04T06:55:53.145282+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:55:53.145282+0000","last_undegraded":"2024-03-04T06:55:53.145282+0000","last_fullsized":"2024-03-04T06:55:53.145282+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937387+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:55:52.937387+0000","last_peered":"2024-03-04T06:55:52.937387+0000","last_clean":"2024-03-04T06:55:52.937387+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:55:52.937387+0000","last_undegraded":"2024-03-04T06:55:52.937387+0000","last_fullsized":"2024-03-04T06:55:52.937387+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937465+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:55:52.937465+0000","last_peered":"2024-03-04T06:55:52.937465+0000","last_clean":"2024-03-04T06:55:52.937465+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:55:52.937465+0000","last_undegraded":"2024-03-04T06:55:52.937465+0000","last_fullsized":"2024-03-04T06:55:52.937465+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382095+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:56:28.382095+0000","last_peered":"2024-03-04T06:56:28.382095+0000","last_clean":"2024-03-04T06:56:28.382095+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:56:28.382095+0000","last_undegraded":"2024-03-04T06:56:28.382095+0000","last_fullsized":"2024-03-04T06:56:28.382095+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538587+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:56:49.538587+0000","last_peered":"2024-03-04T06:56:49.538587+0000","last_clean":"2024-03-04T06:56:49.538587+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:56:49.538587+0000","last_undegraded":"2024-03-04T06:56:49.538587+0000","last_fullsized":"2024-03-04T06:56:49.538587+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1305,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992748+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:56:22.992748+0000","last_peered":"2024-03-04T06:56:22.992748+0000","last_clean":"2024-03-04T06:56:22.992748+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:56:22.992748+0000","last_undegraded":"2024-03-04T06:56:22.992748+0000","last_fullsized":"2024-03-04T06:56:22.992748+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001710+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:57:45.001710+0000","last_peered":"2024-03-04T06:57:45.001710+0000","last_clean":"2024-03-04T06:57:45.001710+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:57:45.001710+0000","last_undegraded":"2024-03-04T06:57:45.001710+0000","last_fullsized":"2024-03-04T06:57:45.001710+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001722+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:57:45.001722+0000","last_peered":"2024-03-04T06:57:45.001722+0000","last_clean":"2024-03-04T06:57:45.001722+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:57:45.001722+0000","last_undegraded":"2024-03-04T06:57:45.001722+0000","last_fullsized":"2024-03-04T06:57:45.001722+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992731+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:56:22.992731+0000","last_peered":"2024-03-04T06:56:22.992731+0000","last_clean":"2024-03-04T06:56:22.992731+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:56:22.992731+0000","last_undegraded":"2024-03-04T06:56:22.992731+0000","last_fullsized":"2024-03-04T06:56:22.992731+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1235,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386420+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:57:08.386420+0000","last_peered":"2024-03-04T06:57:08.386420+0000","last_clean":"2024-03-04T06:57:08.386420+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:57:08.386420+0000","last_undegraded":"2024-03-04T06:57:08.386420+0000","last_fullsized":"2024-03-04T06:57:08.386420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1222,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386390+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:57:08.386390+0000","last_peered":"2024-03-04T06:57:08.386390+0000","last_clean":"2024-03-04T06:57:08.386390+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:57:08.386390+0000","last_undegraded":"2024-03-04T06:57:08.386390+0000","last_fullsized":"2024-03-04T06:57:08.386390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543632+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:57:34.543632+0000","last_peered":"2024-03-04T06:57:34.543632+0000","last_clean":"2024-03-04T06:57:34.543632+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:57:34.543632+0000","last_undegraded":"2024-03-04T06:57:34.543632+0000","last_fullsized":"2024-03-04T06:57:34.543632+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941175+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:56:22.941175+0000","last_peered":"2024-03-04T06:56:22.941175+0000","last_clean":"2024-03-04T06:56:22.941175+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:56:22.941175+0000","last_undegraded":"2024-03-04T06:56:22.941175+0000","last_fullsized":"2024-03-04T06:56:22.941175+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001694+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:57:45.001694+0000","last_peered":"2024-03-04T06:57:45.001694+0000","last_clean":"2024-03-04T06:57:45.001694+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:57:45.001694+0000","last_undegraded":"2024-03-04T06:57:45.001694+0000","last_fullsized":"2024-03-04T06:57:45.001694+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1189,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:47.606038+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:47.606038+0000","last_peered":"2024-03-04T06:55:47.606038+0000","last_clean":"2024-03-04T06:55:47.606038+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:47.606038+0000","last_undegraded":"2024-03-04T06:55:47.606038+0000","last_fullsized":"2024-03-04T06:55:47.606038+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.224901+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:56:58.224901+0000","last_peered":"2024-03-04T06:56:58.224901+0000","last_clean":"2024-03-04T06:56:58.224901+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:56:58.224901+0000","last_undegraded":"2024-03-04T06:56:58.224901+0000","last_fullsized":"2024-03-04T06:56:58.224901+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:57.989954+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:57.989954+0000","last_peered":"2024-03-04T06:55:57.989954+0000","last_clean":"2024-03-04T06:55:57.989954+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:57.989954+0000","last_undegraded":"2024-03-04T06:55:57.989954+0000","last_fullsized":"2024-03-04T06:55:57.989954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999328+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:57:24.999328+0000","last_peered":"2024-03-04T06:57:24.999328+0000","last_clean":"2024-03-04T06:57:24.999328+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:57:24.999328+0000","last_undegraded":"2024-03-04T06:57:24.999328+0000","last_fullsized":"2024-03-04T06:57:24.999328+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999296+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:57:24.999296+0000","last_peered":"2024-03-04T06:57:24.999296+0000","last_clean":"2024-03-04T06:57:24.999296+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:57:24.999296+0000","last_undegraded":"2024-03-04T06:57:24.999296+0000","last_fullsized":"2024-03-04T06:57:24.999296+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939306+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:56:07.939306+0000","last_peered":"2024-03-04T06:56:07.939306+0000","last_clean":"2024-03-04T06:56:07.939306+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:56:07.939306+0000","last_undegraded":"2024-03-04T06:56:07.939306+0000","last_fullsized":"2024-03-04T06:56:07.939306+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147156+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:56:13.147156+0000","last_peered":"2024-03-04T06:56:13.147156+0000","last_clean":"2024-03-04T06:56:13.147156+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:56:13.147156+0000","last_undegraded":"2024-03-04T06:56:13.147156+0000","last_fullsized":"2024-03-04T06:56:13.147156+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223376+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:56:43.223376+0000","last_peered":"2024-03-04T06:56:43.223376+0000","last_clean":"2024-03-04T06:56:43.223376+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:56:43.223376+0000","last_undegraded":"2024-03-04T06:56:43.223376+0000","last_fullsized":"2024-03-04T06:56:43.223376+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939379+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:56:07.939379+0000","last_peered":"2024-03-04T06:56:07.939379+0000","last_clean":"2024-03-04T06:56:07.939379+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:56:07.939379+0000","last_undegraded":"2024-03-04T06:56:07.939379+0000","last_fullsized":"2024-03-04T06:56:07.939379+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939364+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:56:07.939364+0000","last_peered":"2024-03-04T06:56:07.939364+0000","last_clean":"2024-03-04T06:56:07.939364+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:56:07.939364+0000","last_undegraded":"2024-03-04T06:56:07.939364+0000","last_fullsized":"2024-03-04T06:56:07.939364+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:37.988031+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:55:37.988031+0000","last_peered":"2024-03-04T06:55:37.988031+0000","last_clean":"2024-03-04T06:55:37.988031+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:55:37.988031+0000","last_undegraded":"2024-03-04T06:55:37.988031+0000","last_fullsized":"2024-03-04T06:55:37.988031+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147207+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:56:13.147207+0000","last_peered":"2024-03-04T06:56:13.147207+0000","last_clean":"2024-03-04T06:56:13.147207+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:56:13.147207+0000","last_undegraded":"2024-03-04T06:56:13.147207+0000","last_fullsized":"2024-03-04T06:56:13.147207+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:37.618704+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:57:37.618704+0000","last_peered":"2024-03-04T06:57:37.618704+0000","last_clean":"2024-03-04T06:57:37.618704+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:57:37.618704+0000","last_undegraded":"2024-03-04T06:57:37.618704+0000","last_fullsized":"2024-03-04T06:57:37.618704+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1130,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221797+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:56:28.221797+0000","last_peered":"2024-03-04T06:56:28.221797+0000","last_clean":"2024-03-04T06:56:28.221797+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:56:28.221797+0000","last_undegraded":"2024-03-04T06:56:28.221797+0000","last_fullsized":"2024-03-04T06:56:28.221797+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541754+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:57:19.541754+0000","last_peered":"2024-03-04T06:57:19.541754+0000","last_clean":"2024-03-04T06:57:19.541754+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:57:19.541754+0000","last_undegraded":"2024-03-04T06:57:19.541754+0000","last_fullsized":"2024-03-04T06:57:19.541754+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001343+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:57:38.001343+0000","last_peered":"2024-03-04T06:57:38.001343+0000","last_clean":"2024-03-04T06:57:38.001343+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:57:38.001343+0000","last_undegraded":"2024-03-04T06:57:38.001343+0000","last_fullsized":"2024-03-04T06:57:38.001343+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382052+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:56:28.382052+0000","last_peered":"2024-03-04T06:56:28.382052+0000","last_clean":"2024-03-04T06:56:28.382052+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:56:28.382052+0000","last_undegraded":"2024-03-04T06:56:28.382052+0000","last_fullsized":"2024-03-04T06:56:28.382052+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:52.937420+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:55:52.937420+0000","last_peered":"2024-03-04T06:55:52.937420+0000","last_clean":"2024-03-04T06:55:52.937420+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:55:52.937420+0000","last_undegraded":"2024-03-04T06:55:52.937420+0000","last_fullsized":"2024-03-04T06:55:52.937420+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540167+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:57:04.540167+0000","last_peered":"2024-03-04T06:57:04.540167+0000","last_clean":"2024-03-04T06:57:04.540167+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:57:04.540167+0000","last_undegraded":"2024-03-04T06:57:04.540167+0000","last_fullsized":"2024-03-04T06:57:04.540167+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221752+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:56:28.221752+0000","last_peered":"2024-03-04T06:56:28.221752+0000","last_clean":"2024-03-04T06:56:28.221752+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:56:28.221752+0000","last_undegraded":"2024-03-04T06:56:28.221752+0000","last_fullsized":"2024-03-04T06:56:28.221752+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221703+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:56:28.221703+0000","last_peered":"2024-03-04T06:56:28.221703+0000","last_clean":"2024-03-04T06:56:28.221703+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:56:28.221703+0000","last_undegraded":"2024-03-04T06:56:28.221703+0000","last_fullsized":"2024-03-04T06:56:28.221703+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1253,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382011+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:56:28.382011+0000","last_peered":"2024-03-04T06:56:28.382011+0000","last_clean":"2024-03-04T06:56:28.382011+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:56:28.382011+0000","last_undegraded":"2024-03-04T06:56:28.382011+0000","last_fullsized":"2024-03-04T06:56:28.382011+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540129+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:57:04.540129+0000","last_peered":"2024-03-04T06:57:04.540129+0000","last_clean":"2024-03-04T06:57:04.540129+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:57:04.540129+0000","last_undegraded":"2024-03-04T06:57:04.540129+0000","last_fullsized":"2024-03-04T06:57:04.540129+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3578,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.391939+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:57:58.391939+0000","last_peered":"2024-03-04T06:57:58.391939+0000","last_clean":"2024-03-04T06:57:58.391939+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:57:58.391939+0000","last_undegraded":"2024-03-04T06:57:58.391939+0000","last_fullsized":"2024-03-04T06:57:58.391939+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:17.616250+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:57:17.616250+0000","last_peered":"2024-03-04T06:57:17.616250+0000","last_clean":"2024-03-04T06:57:17.616250+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:57:17.616250+0000","last_undegraded":"2024-03-04T06:57:17.616250+0000","last_fullsized":"2024-03-04T06:57:17.616250+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:56:49.538613+0000","last_peered":"2024-03-04T06:56:49.538613+0000","last_clean":"2024-03-04T06:56:49.538613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:56:49.538613+0000","last_undegraded":"2024-03-04T06:56:49.538613+0000","last_fullsized":"2024-03-04T06:56:49.538613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17116,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992661+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:56:22.992661+0000","last_peered":"2024-03-04T06:56:22.992661+0000","last_clean":"2024-03-04T06:56:22.992661+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:56:22.992661+0000","last_undegraded":"2024-03-04T06:56:22.992661+0000","last_fullsized":"2024-03-04T06:56:22.992661+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151860+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:56:58.151860+0000","last_peered":"2024-03-04T06:56:58.151860+0000","last_clean":"2024-03-04T06:56:58.151860+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:56:58.151860+0000","last_undegraded":"2024-03-04T06:56:58.151860+0000","last_fullsized":"2024-03-04T06:56:58.151860+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151904+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:56:58.151904+0000","last_peered":"2024-03-04T06:56:58.151904+0000","last_clean":"2024-03-04T06:56:58.151904+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:56:58.151904+0000","last_undegraded":"2024-03-04T06:56:58.151904+0000","last_fullsized":"2024-03-04T06:56:58.151904+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947110+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:57:12.947110+0000","last_peered":"2024-03-04T06:57:12.947110+0000","last_clean":"2024-03-04T06:57:12.947110+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:57:12.947110+0000","last_undegraded":"2024-03-04T06:57:12.947110+0000","last_fullsized":"2024-03-04T06:57:12.947110+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4386,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:22.992700+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:56:22.992700+0000","last_peered":"2024-03-04T06:56:22.992700+0000","last_clean":"2024-03-04T06:56:22.992700+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:56:22.992700+0000","last_undegraded":"2024-03-04T06:56:22.992700+0000","last_fullsized":"2024-03-04T06:56:22.992700+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151882+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:56:58.151882+0000","last_peered":"2024-03-04T06:56:58.151882+0000","last_clean":"2024-03-04T06:56:58.151882+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:56:58.151882+0000","last_undegraded":"2024-03-04T06:56:58.151882+0000","last_fullsized":"2024-03-04T06:56:58.151882+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947055+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:57:12.947055+0000","last_peered":"2024-03-04T06:57:12.947055+0000","last_clean":"2024-03-04T06:57:12.947055+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:57:12.947055+0000","last_undegraded":"2024-03-04T06:57:12.947055+0000","last_fullsized":"2024-03-04T06:57:12.947055+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611663+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:56:37.611663+0000","last_peered":"2024-03-04T06:56:37.611663+0000","last_clean":"2024-03-04T06:56:37.611663+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:56:37.611663+0000","last_undegraded":"2024-03-04T06:56:37.611663+0000","last_fullsized":"2024-03-04T06:56:37.611663+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5640,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392060+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:57:58.392060+0000","last_peered":"2024-03-04T06:57:58.392060+0000","last_clean":"2024-03-04T06:57:58.392060+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:57:58.392060+0000","last_undegraded":"2024-03-04T06:57:58.392060+0000","last_fullsized":"2024-03-04T06:57:58.392060+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1256,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154711+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:57:23.154711+0000","last_peered":"2024-03-04T06:57:23.154711+0000","last_clean":"2024-03-04T06:57:23.154711+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:57:23.154711+0000","last_undegraded":"2024-03-04T06:57:23.154711+0000","last_fullsized":"2024-03-04T06:57:23.154711+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:33.149241+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:56:33.149241+0000","last_peered":"2024-03-04T06:56:33.149241+0000","last_clean":"2024-03-04T06:56:33.149241+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:56:33.149241+0000","last_undegraded":"2024-03-04T06:56:33.149241+0000","last_fullsized":"2024-03-04T06:56:33.149241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389235+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:57:33.389235+0000","last_peered":"2024-03-04T06:57:33.389235+0000","last_clean":"2024-03-04T06:57:33.389235+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:57:33.389235+0000","last_undegraded":"2024-03-04T06:57:33.389235+0000","last_fullsized":"2024-03-04T06:57:33.389235+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4015,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:19.534498+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:56:19.534498+0000","last_peered":"2024-03-04T06:56:19.534498+0000","last_clean":"2024-03-04T06:56:19.534498+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:56:19.534498+0000","last_undegraded":"2024-03-04T06:56:19.534498+0000","last_fullsized":"2024-03-04T06:56:19.534498+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230253+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:57:48.230253+0000","last_peered":"2024-03-04T06:57:48.230253+0000","last_clean":"2024-03-04T06:57:48.230253+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:57:48.230253+0000","last_undegraded":"2024-03-04T06:57:48.230253+0000","last_fullsized":"2024-03-04T06:57:48.230253+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:10.004451+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:58:10.004451+0000","last_peered":"2024-03-04T06:58:10.004451+0000","last_clean":"2024-03-04T06:58:10.004451+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:58:10.004451+0000","last_undegraded":"2024-03-04T06:58:10.004451+0000","last_fullsized":"2024-03-04T06:58:10.004451+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947097+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:57:12.947097+0000","last_peered":"2024-03-04T06:57:12.947097+0000","last_clean":"2024-03-04T06:57:12.947097+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:57:12.947097+0000","last_undegraded":"2024-03-04T06:57:12.947097+0000","last_fullsized":"2024-03-04T06:57:12.947097+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1551,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547030+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:58:04.547030+0000","last_peered":"2024-03-04T06:58:04.547030+0000","last_clean":"2024-03-04T06:58:04.547030+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:58:04.547030+0000","last_undegraded":"2024-03-04T06:58:04.547030+0000","last_fullsized":"2024-03-04T06:58:04.547030+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3951,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949380+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:57:32.949380+0000","last_peered":"2024-03-04T06:57:32.949380+0000","last_clean":"2024-03-04T06:57:32.949380+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:57:32.949380+0000","last_undegraded":"2024-03-04T06:57:32.949380+0000","last_fullsized":"2024-03-04T06:57:32.949380+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995396+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:56:47.995396+0000","last_peered":"2024-03-04T06:56:47.995396+0000","last_clean":"2024-03-04T06:56:47.995396+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:56:47.995396+0000","last_undegraded":"2024-03-04T06:56:47.995396+0000","last_fullsized":"2024-03-04T06:56:47.995396+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389207+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:57:33.389207+0000","last_peered":"2024-03-04T06:57:33.389207+0000","last_clean":"2024-03-04T06:57:33.389207+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:57:33.389207+0000","last_undegraded":"2024-03-04T06:57:33.389207+0000","last_fullsized":"2024-03-04T06:57:33.389207+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547005+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:58:04.547005+0000","last_peered":"2024-03-04T06:58:04.547005+0000","last_clean":"2024-03-04T06:58:04.547005+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:58:04.547005+0000","last_undegraded":"2024-03-04T06:58:04.547005+0000","last_fullsized":"2024-03-04T06:58:04.547005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15292,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.230222+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:57:48.230222+0000","last_peered":"2024-03-04T06:57:48.230222+0000","last_clean":"2024-03-04T06:57:48.230222+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:57:48.230222+0000","last_undegraded":"2024-03-04T06:57:48.230222+0000","last_fullsized":"2024-03-04T06:57:48.230222+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992678+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:56:22.992678+0000","last_peered":"2024-03-04T06:56:22.992678+0000","last_clean":"2024-03-04T06:56:22.992678+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:56:22.992678+0000","last_undegraded":"2024-03-04T06:56:22.992678+0000","last_fullsized":"2024-03-04T06:56:22.992678+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:19.534547+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:56:19.534547+0000","last_peered":"2024-03-04T06:56:19.534547+0000","last_clean":"2024-03-04T06:56:19.534547+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:56:19.534547+0000","last_undegraded":"2024-03-04T06:56:19.534547+0000","last_fullsized":"2024-03-04T06:56:19.534547+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151891+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:56:58.151891+0000","last_peered":"2024-03-04T06:56:58.151891+0000","last_clean":"2024-03-04T06:56:58.151891+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:56:58.151891+0000","last_undegraded":"2024-03-04T06:56:58.151891+0000","last_fullsized":"2024-03-04T06:56:58.151891+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4379,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:37.611623+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:56:37.611623+0000","last_peered":"2024-03-04T06:56:37.611623+0000","last_clean":"2024-03-04T06:56:37.611623+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:56:37.611623+0000","last_undegraded":"2024-03-04T06:56:37.611623+0000","last_fullsized":"2024-03-04T06:56:37.611623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001670+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:57:45.001670+0000","last_peered":"2024-03-04T06:57:45.001670+0000","last_clean":"2024-03-04T06:57:45.001670+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:57:45.001670+0000","last_undegraded":"2024-03-04T06:57:45.001670+0000","last_fullsized":"2024-03-04T06:57:45.001670+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1269,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154698+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:57:23.154698+0000","last_peered":"2024-03-04T06:57:23.154698+0000","last_clean":"2024-03-04T06:57:23.154698+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:57:23.154698+0000","last_undegraded":"2024-03-04T06:57:23.154698+0000","last_fullsized":"2024-03-04T06:57:23.154698+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992884+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:56:24.992884+0000","last_peered":"2024-03-04T06:56:24.992884+0000","last_clean":"2024-03-04T06:56:24.992884+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:56:24.992884+0000","last_undegraded":"2024-03-04T06:56:24.992884+0000","last_fullsized":"2024-03-04T06:56:24.992884+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4610,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:45.001644+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:57:45.001644+0000","last_peered":"2024-03-04T06:57:45.001644+0000","last_clean":"2024-03-04T06:57:45.001644+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:57:45.001644+0000","last_undegraded":"2024-03-04T06:57:45.001644+0000","last_fullsized":"2024-03-04T06:57:45.001644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611593+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:56:37.611593+0000","last_peered":"2024-03-04T06:56:37.611593+0000","last_clean":"2024-03-04T06:56:37.611593+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:56:37.611593+0000","last_undegraded":"2024-03-04T06:56:37.611593+0000","last_fullsized":"2024-03-04T06:56:37.611593+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1079,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232447+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:58:08.232447+0000","last_peered":"2024-03-04T06:58:08.232447+0000","last_clean":"2024-03-04T06:58:08.232447+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:58:08.232447+0000","last_undegraded":"2024-03-04T06:58:08.232447+0000","last_fullsized":"2024-03-04T06:58:08.232447+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995375+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:56:47.995375+0000","last_peered":"2024-03-04T06:56:47.995375+0000","last_clean":"2024-03-04T06:56:47.995375+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:56:47.995375+0000","last_undegraded":"2024-03-04T06:56:47.995375+0000","last_fullsized":"2024-03-04T06:56:47.995375+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4635,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:52.951690+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:57:52.951690+0000","last_peered":"2024-03-04T06:57:52.951690+0000","last_clean":"2024-03-04T06:57:52.951690+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:57:52.951690+0000","last_undegraded":"2024-03-04T06:57:52.951690+0000","last_fullsized":"2024-03-04T06:57:52.951690+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:34.536591+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:56:34.536591+0000","last_peered":"2024-03-04T06:56:34.536591+0000","last_clean":"2024-03-04T06:56:34.536591+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:56:34.536591+0000","last_undegraded":"2024-03-04T06:56:34.536591+0000","last_fullsized":"2024-03-04T06:56:34.536591+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1185,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:57.614016+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:56:57.614016+0000","last_peered":"2024-03-04T06:56:57.614016+0000","last_clean":"2024-03-04T06:56:57.614016+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:56:57.614016+0000","last_undegraded":"2024-03-04T06:56:57.614016+0000","last_fullsized":"2024-03-04T06:56:57.614016+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5158,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:17.616210+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:57:17.616210+0000","last_peered":"2024-03-04T06:57:17.616210+0000","last_clean":"2024-03-04T06:57:17.616210+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:57:17.616210+0000","last_undegraded":"2024-03-04T06:57:17.616210+0000","last_fullsized":"2024-03-04T06:57:17.616210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154620+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:57:23.154620+0000","last_peered":"2024-03-04T06:57:23.154620+0000","last_clean":"2024-03-04T06:57:23.154620+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:57:23.154620+0000","last_undegraded":"2024-03-04T06:57:23.154620+0000","last_fullsized":"2024-03-04T06:57:23.154620+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992810+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:56:24.992810+0000","last_peered":"2024-03-04T06:56:24.992810+0000","last_clean":"2024-03-04T06:56:24.992810+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:56:24.992810+0000","last_undegraded":"2024-03-04T06:56:24.992810+0000","last_fullsized":"2024-03-04T06:56:24.992810+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4719,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380021+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:56:08.380021+0000","last_peered":"2024-03-04T06:56:08.380021+0000","last_clean":"2024-03-04T06:56:08.380021+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:56:08.380021+0000","last_undegraded":"2024-03-04T06:56:08.380021+0000","last_fullsized":"2024-03-04T06:56:08.380021+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154658+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:57:23.154658+0000","last_peered":"2024-03-04T06:57:23.154658+0000","last_clean":"2024-03-04T06:57:23.154658+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:57:23.154658+0000","last_undegraded":"2024-03-04T06:57:23.154658+0000","last_fullsized":"2024-03-04T06:57:23.154658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994937+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:56:44.994937+0000","last_peered":"2024-03-04T06:56:44.994937+0000","last_clean":"2024-03-04T06:56:44.994937+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:56:44.994937+0000","last_undegraded":"2024-03-04T06:56:44.994937+0000","last_fullsized":"2024-03-04T06:56:44.994937+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5555,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.157094+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:57:48.157094+0000","last_peered":"2024-03-04T06:57:48.157094+0000","last_clean":"2024-03-04T06:57:48.157094+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:57:48.157094+0000","last_undegraded":"2024-03-04T06:57:48.157094+0000","last_fullsized":"2024-03-04T06:57:48.157094+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:56:49.538554+0000","last_peered":"2024-03-04T06:56:49.538554+0000","last_clean":"2024-03-04T06:56:49.538554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:56:49.538554+0000","last_undegraded":"2024-03-04T06:56:49.538554+0000","last_fullsized":"2024-03-04T06:56:49.538554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232398+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:58:08.232398+0000","last_peered":"2024-03-04T06:58:08.232398+0000","last_clean":"2024-03-04T06:58:08.232398+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:58:08.232398+0000","last_undegraded":"2024-03-04T06:58:08.232398+0000","last_fullsized":"2024-03-04T06:58:08.232398+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.379963+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:56:08.379963+0000","last_peered":"2024-03-04T06:56:08.379963+0000","last_clean":"2024-03-04T06:56:08.379963+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:56:08.379963+0000","last_undegraded":"2024-03-04T06:56:08.379963+0000","last_fullsized":"2024-03-04T06:56:08.379963+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380005+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:56:08.380005+0000","last_peered":"2024-03-04T06:56:08.380005+0000","last_clean":"2024-03-04T06:56:08.380005+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:56:08.380005+0000","last_undegraded":"2024-03-04T06:56:08.380005+0000","last_fullsized":"2024-03-04T06:56:08.380005+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:56:49.538599+0000","last_peered":"2024-03-04T06:56:49.538599+0000","last_clean":"2024-03-04T06:56:49.538599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:56:49.538599+0000","last_undegraded":"2024-03-04T06:56:49.538599+0000","last_fullsized":"2024-03-04T06:56:49.538599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4367,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392018+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:57:58.392018+0000","last_peered":"2024-03-04T06:57:58.392018+0000","last_clean":"2024-03-04T06:57:58.392018+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:57:58.392018+0000","last_undegraded":"2024-03-04T06:57:58.392018+0000","last_fullsized":"2024-03-04T06:57:58.392018+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.157162+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:57:48.157162+0000","last_peered":"2024-03-04T06:57:48.157162+0000","last_clean":"2024-03-04T06:57:48.157162+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:57:48.157162+0000","last_undegraded":"2024-03-04T06:57:48.157162+0000","last_fullsized":"2024-03-04T06:57:48.157162+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951665+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:57:52.951665+0000","last_peered":"2024-03-04T06:57:52.951665+0000","last_clean":"2024-03-04T06:57:52.951665+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:57:52.951665+0000","last_undegraded":"2024-03-04T06:57:52.951665+0000","last_fullsized":"2024-03-04T06:57:52.951665+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4600,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:34.536621+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:56:34.536621+0000","last_peered":"2024-03-04T06:56:34.536621+0000","last_clean":"2024-03-04T06:56:34.536621+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:56:34.536621+0000","last_undegraded":"2024-03-04T06:56:34.536621+0000","last_fullsized":"2024-03-04T06:56:34.536621+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1245,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380055+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:56:08.380055+0000","last_peered":"2024-03-04T06:56:08.380055+0000","last_clean":"2024-03-04T06:56:08.380055+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:56:08.380055+0000","last_undegraded":"2024-03-04T06:56:08.380055+0000","last_fullsized":"2024-03-04T06:56:08.380055+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538627+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:56:49.538627+0000","last_peered":"2024-03-04T06:56:49.538627+0000","last_clean":"2024-03-04T06:56:49.538627+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:56:49.538627+0000","last_undegraded":"2024-03-04T06:56:49.538627+0000","last_fullsized":"2024-03-04T06:56:49.538627+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230189+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:57:48.230189+0000","last_peered":"2024-03-04T06:57:48.230189+0000","last_clean":"2024-03-04T06:57:48.230189+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:57:48.230189+0000","last_undegraded":"2024-03-04T06:57:48.230189+0000","last_fullsized":"2024-03-04T06:57:48.230189+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389246+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:57:33.389246+0000","last_peered":"2024-03-04T06:57:33.389246+0000","last_clean":"2024-03-04T06:57:33.389246+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:57:33.389246+0000","last_undegraded":"2024-03-04T06:57:33.389246+0000","last_fullsized":"2024-03-04T06:57:33.389246+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947082+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:57:12.947082+0000","last_peered":"2024-03-04T06:57:12.947082+0000","last_clean":"2024-03-04T06:57:12.947082+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:57:12.947082+0000","last_undegraded":"2024-03-04T06:57:12.947082+0000","last_fullsized":"2024-03-04T06:57:12.947082+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.992636+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:56:22.992636+0000","last_peered":"2024-03-04T06:56:22.992636+0000","last_clean":"2024-03-04T06:56:22.992636+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:56:22.992636+0000","last_undegraded":"2024-03-04T06:56:22.992636+0000","last_fullsized":"2024-03-04T06:56:22.992636+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992858+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:56:24.992858+0000","last_peered":"2024-03-04T06:56:24.992858+0000","last_clean":"2024-03-04T06:56:24.992858+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:56:24.992858+0000","last_undegraded":"2024-03-04T06:56:24.992858+0000","last_fullsized":"2024-03-04T06:56:24.992858+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154682+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:57:23.154682+0000","last_peered":"2024-03-04T06:57:23.154682+0000","last_clean":"2024-03-04T06:57:23.154682+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:57:23.154682+0000","last_undegraded":"2024-03-04T06:57:23.154682+0000","last_fullsized":"2024-03-04T06:57:23.154682+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232435+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:58:08.232435+0000","last_peered":"2024-03-04T06:58:08.232435+0000","last_clean":"2024-03-04T06:58:08.232435+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:58:08.232435+0000","last_undegraded":"2024-03-04T06:58:08.232435+0000","last_fullsized":"2024-03-04T06:58:08.232435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992900+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:56:24.992900+0000","last_peered":"2024-03-04T06:56:24.992900+0000","last_clean":"2024-03-04T06:56:24.992900+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:56:24.992900+0000","last_undegraded":"2024-03-04T06:56:24.992900+0000","last_fullsized":"2024-03-04T06:56:24.992900+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949325+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:57:32.949325+0000","last_peered":"2024-03-04T06:57:32.949325+0000","last_clean":"2024-03-04T06:57:32.949325+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:57:32.949325+0000","last_undegraded":"2024-03-04T06:57:32.949325+0000","last_fullsized":"2024-03-04T06:57:32.949325+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994907+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:56:44.994907+0000","last_peered":"2024-03-04T06:56:44.994907+0000","last_clean":"2024-03-04T06:56:44.994907+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:56:44.994907+0000","last_undegraded":"2024-03-04T06:56:44.994907+0000","last_fullsized":"2024-03-04T06:56:44.994907+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1121,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951615+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:57:52.951615+0000","last_peered":"2024-03-04T06:57:52.951615+0000","last_clean":"2024-03-04T06:57:52.951615+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:57:52.951615+0000","last_undegraded":"2024-03-04T06:57:52.951615+0000","last_fullsized":"2024-03-04T06:57:52.951615+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.998327+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:57:12.998327+0000","last_peered":"2024-03-04T06:57:12.998327+0000","last_clean":"2024-03-04T06:57:12.998327+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:57:12.998327+0000","last_undegraded":"2024-03-04T06:57:12.998327+0000","last_fullsized":"2024-03-04T06:57:12.998327+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.220345+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:56:13.220345+0000","last_peered":"2024-03-04T06:56:13.220345+0000","last_clean":"2024-03-04T06:56:13.220345+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:56:13.220345+0000","last_undegraded":"2024-03-04T06:56:13.220345+0000","last_fullsized":"2024-03-04T06:56:13.220345+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503484,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648131,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142438,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287085,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997791,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885848,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937425,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792778,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:00:25.133 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:25.134 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:25.134 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:25.134 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:25.134 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:25.134 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:25.134 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:25.134 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:25.134 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:25.134 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:25.134 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:00:25.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:25 smithi137 ceph-mon[88869]: from='client.44582 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:25.543 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:00:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:00:25] "GET /metrics HTTP/1.1" 200 36338 "" "Prometheus/2.43.0" 2024-03-04T07:00:25.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:25 smithi137 ceph-mon[91314]: from='client.44582 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:25.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:25 smithi203 ceph-mon[85573]: from='client.44582 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:26.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:26 smithi137 ceph-mon[88869]: pgmap v1077: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:26.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:26 smithi137 ceph-mon[91314]: pgmap v1077: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:26.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:26 smithi203 ceph-mon[85573]: pgmap v1077: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:28.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:28 smithi137 ceph-mon[88869]: pgmap v1078: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:28.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:28 smithi137 ceph-mon[91314]: pgmap v1078: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:28.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:28 smithi203 ceph-mon[85573]: pgmap v1078: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:30.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:30 smithi137 ceph-mon[88869]: pgmap v1079: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:30.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:30 smithi137 ceph-mon[91314]: pgmap v1079: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:30.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:30 smithi203 ceph-mon[85573]: pgmap v1079: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:32.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:32 smithi137 ceph-mon[88869]: pgmap v1080: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:32.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:32 smithi137 ceph-mon[91314]: pgmap v1080: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:32.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:32 smithi203 ceph-mon[85573]: pgmap v1080: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:34.502 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:34 smithi137 ceph-mon[88869]: pgmap v1081: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:34.502 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:34 smithi137 ceph-mon[91314]: pgmap v1081: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:34.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:34 smithi203 ceph-mon[85573]: pgmap v1081: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:35.136 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:00:35.355 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:00:35.471 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:00:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:00:35] "GET /metrics HTTP/1.1" 200 36338 "" "Prometheus/2.43.0" 2024-03-04T07:00:36.475 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:36 smithi137 ceph-mon[88869]: pgmap v1082: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:36.475 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:36 smithi137 ceph-mon[91314]: pgmap v1082: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:36.591 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:36 smithi203 ceph-mon[85573]: pgmap v1082: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:00:37.259 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:00:37.897 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1083,"stamp":"2024-03-04T07:00:36.559247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004234"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549208+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:58:24.549208+0000","last_peered":"2024-03-04T06:58:24.549208+0000","last_clean":"2024-03-04T06:58:24.549208+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:58:24.549208+0000","last_undegraded":"2024-03-04T06:58:24.549208+0000","last_fullsized":"2024-03-04T06:58:24.549208+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151921+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:56:58.151921+0000","last_peered":"2024-03-04T06:56:58.151921+0000","last_clean":"2024-03-04T06:56:58.151921+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:56:58.151921+0000","last_undegraded":"2024-03-04T06:56:58.151921+0000","last_fullsized":"2024-03-04T06:56:58.151921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006644+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:58:28.006644+0000","last_peered":"2024-03-04T06:58:28.006644+0000","last_clean":"2024-03-04T06:58:28.006644+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:58:28.006644+0000","last_undegraded":"2024-03-04T06:58:28.006644+0000","last_fullsized":"2024-03-04T06:58:28.006644+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:52.944862+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:56:52.944862+0000","last_peered":"2024-03-04T06:56:52.944862+0000","last_clean":"2024-03-04T06:56:52.944862+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:56:52.944862+0000","last_undegraded":"2024-03-04T06:56:52.944862+0000","last_fullsized":"2024-03-04T06:56:52.944862+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543619+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:57:34.543619+0000","last_peered":"2024-03-04T06:57:34.543619+0000","last_clean":"2024-03-04T06:57:34.543619+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:57:34.543619+0000","last_undegraded":"2024-03-04T06:57:34.543619+0000","last_fullsized":"2024-03-04T06:57:34.543619+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941144+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:56:22.941144+0000","last_peered":"2024-03-04T06:56:22.941144+0000","last_clean":"2024-03-04T06:56:22.941144+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:56:22.941144+0000","last_undegraded":"2024-03-04T06:56:22.941144+0000","last_fullsized":"2024-03-04T06:56:22.941144+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543594+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:57:34.543594+0000","last_peered":"2024-03-04T06:57:34.543594+0000","last_clean":"2024-03-04T06:57:34.543594+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:57:34.543594+0000","last_undegraded":"2024-03-04T06:57:34.543594+0000","last_fullsized":"2024-03-04T06:57:34.543594+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001597+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:57:45.001597+0000","last_peered":"2024-03-04T06:57:45.001597+0000","last_clean":"2024-03-04T06:57:45.001597+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:57:45.001597+0000","last_undegraded":"2024-03-04T06:57:45.001597+0000","last_fullsized":"2024-03-04T06:57:45.001597+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1065,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541782+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:57:19.541782+0000","last_peered":"2024-03-04T06:57:19.541782+0000","last_clean":"2024-03-04T06:57:19.541782+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:57:19.541782+0000","last_undegraded":"2024-03-04T06:57:19.541782+0000","last_fullsized":"2024-03-04T06:57:19.541782+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223356+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:56:43.223356+0000","last_peered":"2024-03-04T06:56:43.223356+0000","last_clean":"2024-03-04T06:56:43.223356+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:56:43.223356+0000","last_undegraded":"2024-03-04T06:56:43.223356+0000","last_fullsized":"2024-03-04T06:56:43.223356+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223323+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:56:43.223323+0000","last_peered":"2024-03-04T06:56:43.223323+0000","last_clean":"2024-03-04T06:56:43.223323+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:56:43.223323+0000","last_undegraded":"2024-03-04T06:56:43.223323+0000","last_fullsized":"2024-03-04T06:56:43.223323+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:57.620940+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:57:57.620940+0000","last_peered":"2024-03-04T06:57:57.620940+0000","last_clean":"2024-03-04T06:57:57.620940+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:57:57.620940+0000","last_undegraded":"2024-03-04T06:57:57.620940+0000","last_fullsized":"2024-03-04T06:57:57.620940+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999343+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:57:24.999343+0000","last_peered":"2024-03-04T06:57:24.999343+0000","last_clean":"2024-03-04T06:57:24.999343+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:57:24.999343+0000","last_undegraded":"2024-03-04T06:57:24.999343+0000","last_fullsized":"2024-03-04T06:57:24.999343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001313+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:57:38.001313+0000","last_peered":"2024-03-04T06:57:38.001313+0000","last_clean":"2024-03-04T06:57:38.001313+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:57:38.001313+0000","last_undegraded":"2024-03-04T06:57:38.001313+0000","last_fullsized":"2024-03-04T06:57:38.001313+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:13.159769+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:58:13.159769+0000","last_peered":"2024-03-04T06:58:13.159769+0000","last_clean":"2024-03-04T06:58:13.159769+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:58:13.159769+0000","last_undegraded":"2024-03-04T06:58:13.159769+0000","last_fullsized":"2024-03-04T06:58:13.159769+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953787+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:58:12.953787+0000","last_peered":"2024-03-04T06:58:12.953787+0000","last_clean":"2024-03-04T06:58:12.953787+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:58:12.953787+0000","last_undegraded":"2024-03-04T06:58:12.953787+0000","last_fullsized":"2024-03-04T06:58:12.953787+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953915+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:58:12.953915+0000","last_peered":"2024-03-04T06:58:12.953915+0000","last_clean":"2024-03-04T06:58:12.953915+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:58:12.953915+0000","last_undegraded":"2024-03-04T06:58:12.953915+0000","last_fullsized":"2024-03-04T06:58:12.953915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382095+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:56:28.382095+0000","last_peered":"2024-03-04T06:56:28.382095+0000","last_clean":"2024-03-04T06:56:28.382095+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:56:28.382095+0000","last_undegraded":"2024-03-04T06:56:28.382095+0000","last_fullsized":"2024-03-04T06:56:28.382095+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538587+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:56:49.538587+0000","last_peered":"2024-03-04T06:56:49.538587+0000","last_clean":"2024-03-04T06:56:49.538587+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:56:49.538587+0000","last_undegraded":"2024-03-04T06:56:49.538587+0000","last_fullsized":"2024-03-04T06:56:49.538587+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1306,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006697+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:58:28.006697+0000","last_peered":"2024-03-04T06:58:28.006697+0000","last_clean":"2024-03-04T06:58:28.006697+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:58:28.006697+0000","last_undegraded":"2024-03-04T06:58:28.006697+0000","last_fullsized":"2024-03-04T06:58:28.006697+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001710+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:57:45.001710+0000","last_peered":"2024-03-04T06:57:45.001710+0000","last_clean":"2024-03-04T06:57:45.001710+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:57:45.001710+0000","last_undegraded":"2024-03-04T06:57:45.001710+0000","last_fullsized":"2024-03-04T06:57:45.001710+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001722+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:57:45.001722+0000","last_peered":"2024-03-04T06:57:45.001722+0000","last_clean":"2024-03-04T06:57:45.001722+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:57:45.001722+0000","last_undegraded":"2024-03-04T06:57:45.001722+0000","last_fullsized":"2024-03-04T06:57:45.001722+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006681+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:58:28.006681+0000","last_peered":"2024-03-04T06:58:28.006681+0000","last_clean":"2024-03-04T06:58:28.006681+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:58:28.006681+0000","last_undegraded":"2024-03-04T06:58:28.006681+0000","last_fullsized":"2024-03-04T06:58:28.006681+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1235,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386420+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:57:08.386420+0000","last_peered":"2024-03-04T06:57:08.386420+0000","last_clean":"2024-03-04T06:57:08.386420+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:57:08.386420+0000","last_undegraded":"2024-03-04T06:57:08.386420+0000","last_fullsized":"2024-03-04T06:57:08.386420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1222,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386390+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:57:08.386390+0000","last_peered":"2024-03-04T06:57:08.386390+0000","last_clean":"2024-03-04T06:57:08.386390+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:57:08.386390+0000","last_undegraded":"2024-03-04T06:57:08.386390+0000","last_fullsized":"2024-03-04T06:57:08.386390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543632+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:57:34.543632+0000","last_peered":"2024-03-04T06:57:34.543632+0000","last_clean":"2024-03-04T06:57:34.543632+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:57:34.543632+0000","last_undegraded":"2024-03-04T06:57:34.543632+0000","last_fullsized":"2024-03-04T06:57:34.543632+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941175+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:56:22.941175+0000","last_peered":"2024-03-04T06:56:22.941175+0000","last_clean":"2024-03-04T06:56:22.941175+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:56:22.941175+0000","last_undegraded":"2024-03-04T06:56:22.941175+0000","last_fullsized":"2024-03-04T06:56:22.941175+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001694+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:57:45.001694+0000","last_peered":"2024-03-04T06:57:45.001694+0000","last_clean":"2024-03-04T06:57:45.001694+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:57:45.001694+0000","last_undegraded":"2024-03-04T06:57:45.001694+0000","last_fullsized":"2024-03-04T06:57:45.001694+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1189,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:47.606038+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:55:47.606038+0000","last_peered":"2024-03-04T06:55:47.606038+0000","last_clean":"2024-03-04T06:55:47.606038+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:55:47.606038+0000","last_undegraded":"2024-03-04T06:55:47.606038+0000","last_fullsized":"2024-03-04T06:55:47.606038+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.224901+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:56:58.224901+0000","last_peered":"2024-03-04T06:56:58.224901+0000","last_clean":"2024-03-04T06:56:58.224901+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:56:58.224901+0000","last_undegraded":"2024-03-04T06:56:58.224901+0000","last_fullsized":"2024-03-04T06:56:58.224901+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:57.989954+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:57.989954+0000","last_peered":"2024-03-04T06:55:57.989954+0000","last_clean":"2024-03-04T06:55:57.989954+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:57.989954+0000","last_undegraded":"2024-03-04T06:55:57.989954+0000","last_fullsized":"2024-03-04T06:55:57.989954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999328+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:57:24.999328+0000","last_peered":"2024-03-04T06:57:24.999328+0000","last_clean":"2024-03-04T06:57:24.999328+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:57:24.999328+0000","last_undegraded":"2024-03-04T06:57:24.999328+0000","last_fullsized":"2024-03-04T06:57:24.999328+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999296+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:57:24.999296+0000","last_peered":"2024-03-04T06:57:24.999296+0000","last_clean":"2024-03-04T06:57:24.999296+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:57:24.999296+0000","last_undegraded":"2024-03-04T06:57:24.999296+0000","last_fullsized":"2024-03-04T06:57:24.999296+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939306+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:56:07.939306+0000","last_peered":"2024-03-04T06:56:07.939306+0000","last_clean":"2024-03-04T06:56:07.939306+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:56:07.939306+0000","last_undegraded":"2024-03-04T06:56:07.939306+0000","last_fullsized":"2024-03-04T06:56:07.939306+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147156+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:56:13.147156+0000","last_peered":"2024-03-04T06:56:13.147156+0000","last_clean":"2024-03-04T06:56:13.147156+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:56:13.147156+0000","last_undegraded":"2024-03-04T06:56:13.147156+0000","last_fullsized":"2024-03-04T06:56:13.147156+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223376+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:56:43.223376+0000","last_peered":"2024-03-04T06:56:43.223376+0000","last_clean":"2024-03-04T06:56:43.223376+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:56:43.223376+0000","last_undegraded":"2024-03-04T06:56:43.223376+0000","last_fullsized":"2024-03-04T06:56:43.223376+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939379+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:56:07.939379+0000","last_peered":"2024-03-04T06:56:07.939379+0000","last_clean":"2024-03-04T06:56:07.939379+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:56:07.939379+0000","last_undegraded":"2024-03-04T06:56:07.939379+0000","last_fullsized":"2024-03-04T06:56:07.939379+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939364+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:56:07.939364+0000","last_peered":"2024-03-04T06:56:07.939364+0000","last_clean":"2024-03-04T06:56:07.939364+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:56:07.939364+0000","last_undegraded":"2024-03-04T06:56:07.939364+0000","last_fullsized":"2024-03-04T06:56:07.939364+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:03.003999+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:58:03.003999+0000","last_peered":"2024-03-04T06:58:03.003999+0000","last_clean":"2024-03-04T06:58:03.003999+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:58:03.003999+0000","last_undegraded":"2024-03-04T06:58:03.003999+0000","last_fullsized":"2024-03-04T06:58:03.003999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147207+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:56:13.147207+0000","last_peered":"2024-03-04T06:56:13.147207+0000","last_clean":"2024-03-04T06:56:13.147207+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:56:13.147207+0000","last_undegraded":"2024-03-04T06:56:13.147207+0000","last_fullsized":"2024-03-04T06:56:13.147207+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:37.618704+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:57:37.618704+0000","last_peered":"2024-03-04T06:57:37.618704+0000","last_clean":"2024-03-04T06:57:37.618704+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:57:37.618704+0000","last_undegraded":"2024-03-04T06:57:37.618704+0000","last_fullsized":"2024-03-04T06:57:37.618704+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1130,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221797+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:56:28.221797+0000","last_peered":"2024-03-04T06:56:28.221797+0000","last_clean":"2024-03-04T06:56:28.221797+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:56:28.221797+0000","last_undegraded":"2024-03-04T06:56:28.221797+0000","last_fullsized":"2024-03-04T06:56:28.221797+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541754+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:57:19.541754+0000","last_peered":"2024-03-04T06:57:19.541754+0000","last_clean":"2024-03-04T06:57:19.541754+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:57:19.541754+0000","last_undegraded":"2024-03-04T06:57:19.541754+0000","last_fullsized":"2024-03-04T06:57:19.541754+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001343+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:57:38.001343+0000","last_peered":"2024-03-04T06:57:38.001343+0000","last_clean":"2024-03-04T06:57:38.001343+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:57:38.001343+0000","last_undegraded":"2024-03-04T06:57:38.001343+0000","last_fullsized":"2024-03-04T06:57:38.001343+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382052+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:56:28.382052+0000","last_peered":"2024-03-04T06:56:28.382052+0000","last_clean":"2024-03-04T06:56:28.382052+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:56:28.382052+0000","last_undegraded":"2024-03-04T06:56:28.382052+0000","last_fullsized":"2024-03-04T06:56:28.382052+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953851+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:58:12.953851+0000","last_peered":"2024-03-04T06:58:12.953851+0000","last_clean":"2024-03-04T06:58:12.953851+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:58:12.953851+0000","last_undegraded":"2024-03-04T06:58:12.953851+0000","last_fullsized":"2024-03-04T06:58:12.953851+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540167+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:57:04.540167+0000","last_peered":"2024-03-04T06:57:04.540167+0000","last_clean":"2024-03-04T06:57:04.540167+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:57:04.540167+0000","last_undegraded":"2024-03-04T06:57:04.540167+0000","last_fullsized":"2024-03-04T06:57:04.540167+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221752+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:56:28.221752+0000","last_peered":"2024-03-04T06:56:28.221752+0000","last_clean":"2024-03-04T06:56:28.221752+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:56:28.221752+0000","last_undegraded":"2024-03-04T06:56:28.221752+0000","last_fullsized":"2024-03-04T06:56:28.221752+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221703+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:56:28.221703+0000","last_peered":"2024-03-04T06:56:28.221703+0000","last_clean":"2024-03-04T06:56:28.221703+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:56:28.221703+0000","last_undegraded":"2024-03-04T06:56:28.221703+0000","last_fullsized":"2024-03-04T06:56:28.221703+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1253,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382011+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:56:28.382011+0000","last_peered":"2024-03-04T06:56:28.382011+0000","last_clean":"2024-03-04T06:56:28.382011+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:56:28.382011+0000","last_undegraded":"2024-03-04T06:56:28.382011+0000","last_fullsized":"2024-03-04T06:56:28.382011+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540129+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:57:04.540129+0000","last_peered":"2024-03-04T06:57:04.540129+0000","last_clean":"2024-03-04T06:57:04.540129+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:57:04.540129+0000","last_undegraded":"2024-03-04T06:57:04.540129+0000","last_fullsized":"2024-03-04T06:57:04.540129+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3578,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.391939+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:57:58.391939+0000","last_peered":"2024-03-04T06:57:58.391939+0000","last_clean":"2024-03-04T06:57:58.391939+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:57:58.391939+0000","last_undegraded":"2024-03-04T06:57:58.391939+0000","last_fullsized":"2024-03-04T06:57:58.391939+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:17.616250+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:57:17.616250+0000","last_peered":"2024-03-04T06:57:17.616250+0000","last_clean":"2024-03-04T06:57:17.616250+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:57:17.616250+0000","last_undegraded":"2024-03-04T06:57:17.616250+0000","last_fullsized":"2024-03-04T06:57:17.616250+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:56:49.538613+0000","last_peered":"2024-03-04T06:56:49.538613+0000","last_clean":"2024-03-04T06:56:49.538613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:56:49.538613+0000","last_undegraded":"2024-03-04T06:56:49.538613+0000","last_fullsized":"2024-03-04T06:56:49.538613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17117,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006566+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:58:28.006566+0000","last_peered":"2024-03-04T06:58:28.006566+0000","last_clean":"2024-03-04T06:58:28.006566+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:58:28.006566+0000","last_undegraded":"2024-03-04T06:58:28.006566+0000","last_fullsized":"2024-03-04T06:58:28.006566+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151860+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:56:58.151860+0000","last_peered":"2024-03-04T06:56:58.151860+0000","last_clean":"2024-03-04T06:56:58.151860+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:56:58.151860+0000","last_undegraded":"2024-03-04T06:56:58.151860+0000","last_fullsized":"2024-03-04T06:56:58.151860+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151904+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:56:58.151904+0000","last_peered":"2024-03-04T06:56:58.151904+0000","last_clean":"2024-03-04T06:56:58.151904+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:56:58.151904+0000","last_undegraded":"2024-03-04T06:56:58.151904+0000","last_fullsized":"2024-03-04T06:56:58.151904+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947110+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:57:12.947110+0000","last_peered":"2024-03-04T06:57:12.947110+0000","last_clean":"2024-03-04T06:57:12.947110+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:57:12.947110+0000","last_undegraded":"2024-03-04T06:57:12.947110+0000","last_fullsized":"2024-03-04T06:57:12.947110+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4387,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006651+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:58:28.006651+0000","last_peered":"2024-03-04T06:58:28.006651+0000","last_clean":"2024-03-04T06:58:28.006651+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:58:28.006651+0000","last_undegraded":"2024-03-04T06:58:28.006651+0000","last_fullsized":"2024-03-04T06:58:28.006651+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151882+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:56:58.151882+0000","last_peered":"2024-03-04T06:56:58.151882+0000","last_clean":"2024-03-04T06:56:58.151882+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:56:58.151882+0000","last_undegraded":"2024-03-04T06:56:58.151882+0000","last_fullsized":"2024-03-04T06:56:58.151882+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947055+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:57:12.947055+0000","last_peered":"2024-03-04T06:57:12.947055+0000","last_clean":"2024-03-04T06:57:12.947055+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:57:12.947055+0000","last_undegraded":"2024-03-04T06:57:12.947055+0000","last_fullsized":"2024-03-04T06:57:12.947055+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611663+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:56:37.611663+0000","last_peered":"2024-03-04T06:56:37.611663+0000","last_clean":"2024-03-04T06:56:37.611663+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:56:37.611663+0000","last_undegraded":"2024-03-04T06:56:37.611663+0000","last_fullsized":"2024-03-04T06:56:37.611663+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5640,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392060+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:57:58.392060+0000","last_peered":"2024-03-04T06:57:58.392060+0000","last_clean":"2024-03-04T06:57:58.392060+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:57:58.392060+0000","last_undegraded":"2024-03-04T06:57:58.392060+0000","last_fullsized":"2024-03-04T06:57:58.392060+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1256,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154711+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:57:23.154711+0000","last_peered":"2024-03-04T06:57:23.154711+0000","last_clean":"2024-03-04T06:57:23.154711+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:57:23.154711+0000","last_undegraded":"2024-03-04T06:57:23.154711+0000","last_fullsized":"2024-03-04T06:57:23.154711+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:33.162083+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:58:33.162083+0000","last_peered":"2024-03-04T06:58:33.162083+0000","last_clean":"2024-03-04T06:58:33.162083+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:58:33.162083+0000","last_undegraded":"2024-03-04T06:58:33.162083+0000","last_fullsized":"2024-03-04T06:58:33.162083+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389235+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:57:33.389235+0000","last_peered":"2024-03-04T06:57:33.389235+0000","last_clean":"2024-03-04T06:57:33.389235+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:57:33.389235+0000","last_undegraded":"2024-03-04T06:57:33.389235+0000","last_fullsized":"2024-03-04T06:57:33.389235+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4016,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:24.549121+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:58:24.549121+0000","last_peered":"2024-03-04T06:58:24.549121+0000","last_clean":"2024-03-04T06:58:24.549121+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:58:24.549121+0000","last_undegraded":"2024-03-04T06:58:24.549121+0000","last_fullsized":"2024-03-04T06:58:24.549121+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230253+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:57:48.230253+0000","last_peered":"2024-03-04T06:57:48.230253+0000","last_clean":"2024-03-04T06:57:48.230253+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:57:48.230253+0000","last_undegraded":"2024-03-04T06:57:48.230253+0000","last_fullsized":"2024-03-04T06:57:48.230253+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:10.004451+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:58:10.004451+0000","last_peered":"2024-03-04T06:58:10.004451+0000","last_clean":"2024-03-04T06:58:10.004451+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:58:10.004451+0000","last_undegraded":"2024-03-04T06:58:10.004451+0000","last_fullsized":"2024-03-04T06:58:10.004451+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947097+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:57:12.947097+0000","last_peered":"2024-03-04T06:57:12.947097+0000","last_clean":"2024-03-04T06:57:12.947097+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:57:12.947097+0000","last_undegraded":"2024-03-04T06:57:12.947097+0000","last_fullsized":"2024-03-04T06:57:12.947097+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1551,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547030+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:58:04.547030+0000","last_peered":"2024-03-04T06:58:04.547030+0000","last_clean":"2024-03-04T06:58:04.547030+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:58:04.547030+0000","last_undegraded":"2024-03-04T06:58:04.547030+0000","last_fullsized":"2024-03-04T06:58:04.547030+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3951,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949380+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:57:32.949380+0000","last_peered":"2024-03-04T06:57:32.949380+0000","last_clean":"2024-03-04T06:57:32.949380+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:57:32.949380+0000","last_undegraded":"2024-03-04T06:57:32.949380+0000","last_fullsized":"2024-03-04T06:57:32.949380+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995396+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:56:47.995396+0000","last_peered":"2024-03-04T06:56:47.995396+0000","last_clean":"2024-03-04T06:56:47.995396+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:56:47.995396+0000","last_undegraded":"2024-03-04T06:56:47.995396+0000","last_fullsized":"2024-03-04T06:56:47.995396+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389207+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:57:33.389207+0000","last_peered":"2024-03-04T06:57:33.389207+0000","last_clean":"2024-03-04T06:57:33.389207+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:57:33.389207+0000","last_undegraded":"2024-03-04T06:57:33.389207+0000","last_fullsized":"2024-03-04T06:57:33.389207+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547005+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:58:04.547005+0000","last_peered":"2024-03-04T06:58:04.547005+0000","last_clean":"2024-03-04T06:58:04.547005+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:58:04.547005+0000","last_undegraded":"2024-03-04T06:58:04.547005+0000","last_fullsized":"2024-03-04T06:58:04.547005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15292,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.230222+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:57:48.230222+0000","last_peered":"2024-03-04T06:57:48.230222+0000","last_clean":"2024-03-04T06:57:48.230222+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:57:48.230222+0000","last_undegraded":"2024-03-04T06:57:48.230222+0000","last_fullsized":"2024-03-04T06:57:48.230222+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006608+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:58:28.006608+0000","last_peered":"2024-03-04T06:58:28.006608+0000","last_clean":"2024-03-04T06:58:28.006608+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:58:28.006608+0000","last_undegraded":"2024-03-04T06:58:28.006608+0000","last_fullsized":"2024-03-04T06:58:28.006608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549190+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:58:24.549190+0000","last_peered":"2024-03-04T06:58:24.549190+0000","last_clean":"2024-03-04T06:58:24.549190+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:58:24.549190+0000","last_undegraded":"2024-03-04T06:58:24.549190+0000","last_fullsized":"2024-03-04T06:58:24.549190+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151891+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:56:58.151891+0000","last_peered":"2024-03-04T06:56:58.151891+0000","last_clean":"2024-03-04T06:56:58.151891+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:56:58.151891+0000","last_undegraded":"2024-03-04T06:56:58.151891+0000","last_fullsized":"2024-03-04T06:56:58.151891+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4379,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:37.611623+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:56:37.611623+0000","last_peered":"2024-03-04T06:56:37.611623+0000","last_clean":"2024-03-04T06:56:37.611623+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:56:37.611623+0000","last_undegraded":"2024-03-04T06:56:37.611623+0000","last_fullsized":"2024-03-04T06:56:37.611623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001670+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:57:45.001670+0000","last_peered":"2024-03-04T06:57:45.001670+0000","last_clean":"2024-03-04T06:57:45.001670+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:57:45.001670+0000","last_undegraded":"2024-03-04T06:57:45.001670+0000","last_fullsized":"2024-03-04T06:57:45.001670+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1269,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154698+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:57:23.154698+0000","last_peered":"2024-03-04T06:57:23.154698+0000","last_clean":"2024-03-04T06:57:23.154698+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:57:23.154698+0000","last_undegraded":"2024-03-04T06:57:23.154698+0000","last_fullsized":"2024-03-04T06:57:23.154698+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992884+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:56:24.992884+0000","last_peered":"2024-03-04T06:56:24.992884+0000","last_clean":"2024-03-04T06:56:24.992884+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:56:24.992884+0000","last_undegraded":"2024-03-04T06:56:24.992884+0000","last_fullsized":"2024-03-04T06:56:24.992884+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4610,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:45.001644+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:57:45.001644+0000","last_peered":"2024-03-04T06:57:45.001644+0000","last_clean":"2024-03-04T06:57:45.001644+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:57:45.001644+0000","last_undegraded":"2024-03-04T06:57:45.001644+0000","last_fullsized":"2024-03-04T06:57:45.001644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:37.611593+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:56:37.611593+0000","last_peered":"2024-03-04T06:56:37.611593+0000","last_clean":"2024-03-04T06:56:37.611593+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:56:37.611593+0000","last_undegraded":"2024-03-04T06:56:37.611593+0000","last_fullsized":"2024-03-04T06:56:37.611593+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1079,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232447+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:58:08.232447+0000","last_peered":"2024-03-04T06:58:08.232447+0000","last_clean":"2024-03-04T06:58:08.232447+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:58:08.232447+0000","last_undegraded":"2024-03-04T06:58:08.232447+0000","last_fullsized":"2024-03-04T06:58:08.232447+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995375+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:56:47.995375+0000","last_peered":"2024-03-04T06:56:47.995375+0000","last_clean":"2024-03-04T06:56:47.995375+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:56:47.995375+0000","last_undegraded":"2024-03-04T06:56:47.995375+0000","last_fullsized":"2024-03-04T06:56:47.995375+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4635,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:52.951690+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:57:52.951690+0000","last_peered":"2024-03-04T06:57:52.951690+0000","last_clean":"2024-03-04T06:57:52.951690+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:57:52.951690+0000","last_undegraded":"2024-03-04T06:57:52.951690+0000","last_fullsized":"2024-03-04T06:57:52.951690+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:34.536591+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:56:34.536591+0000","last_peered":"2024-03-04T06:56:34.536591+0000","last_clean":"2024-03-04T06:56:34.536591+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:56:34.536591+0000","last_undegraded":"2024-03-04T06:56:34.536591+0000","last_fullsized":"2024-03-04T06:56:34.536591+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1185,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:57.614016+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:56:57.614016+0000","last_peered":"2024-03-04T06:56:57.614016+0000","last_clean":"2024-03-04T06:56:57.614016+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:56:57.614016+0000","last_undegraded":"2024-03-04T06:56:57.614016+0000","last_fullsized":"2024-03-04T06:56:57.614016+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5158,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:17.616210+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:57:17.616210+0000","last_peered":"2024-03-04T06:57:17.616210+0000","last_clean":"2024-03-04T06:57:17.616210+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:57:17.616210+0000","last_undegraded":"2024-03-04T06:57:17.616210+0000","last_fullsized":"2024-03-04T06:57:17.616210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154620+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:57:23.154620+0000","last_peered":"2024-03-04T06:57:23.154620+0000","last_clean":"2024-03-04T06:57:23.154620+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:57:23.154620+0000","last_undegraded":"2024-03-04T06:57:23.154620+0000","last_fullsized":"2024-03-04T06:57:23.154620+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992810+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:56:24.992810+0000","last_peered":"2024-03-04T06:56:24.992810+0000","last_clean":"2024-03-04T06:56:24.992810+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:56:24.992810+0000","last_undegraded":"2024-03-04T06:56:24.992810+0000","last_fullsized":"2024-03-04T06:56:24.992810+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4719,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380021+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:56:08.380021+0000","last_peered":"2024-03-04T06:56:08.380021+0000","last_clean":"2024-03-04T06:56:08.380021+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:56:08.380021+0000","last_undegraded":"2024-03-04T06:56:08.380021+0000","last_fullsized":"2024-03-04T06:56:08.380021+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154658+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:57:23.154658+0000","last_peered":"2024-03-04T06:57:23.154658+0000","last_clean":"2024-03-04T06:57:23.154658+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:57:23.154658+0000","last_undegraded":"2024-03-04T06:57:23.154658+0000","last_fullsized":"2024-03-04T06:57:23.154658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994937+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:56:44.994937+0000","last_peered":"2024-03-04T06:56:44.994937+0000","last_clean":"2024-03-04T06:56:44.994937+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:56:44.994937+0000","last_undegraded":"2024-03-04T06:56:44.994937+0000","last_fullsized":"2024-03-04T06:56:44.994937+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5555,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.157094+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:57:48.157094+0000","last_peered":"2024-03-04T06:57:48.157094+0000","last_clean":"2024-03-04T06:57:48.157094+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:57:48.157094+0000","last_undegraded":"2024-03-04T06:57:48.157094+0000","last_fullsized":"2024-03-04T06:57:48.157094+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:56:49.538554+0000","last_peered":"2024-03-04T06:56:49.538554+0000","last_clean":"2024-03-04T06:56:49.538554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:56:49.538554+0000","last_undegraded":"2024-03-04T06:56:49.538554+0000","last_fullsized":"2024-03-04T06:56:49.538554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232398+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:58:08.232398+0000","last_peered":"2024-03-04T06:58:08.232398+0000","last_clean":"2024-03-04T06:58:08.232398+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:58:08.232398+0000","last_undegraded":"2024-03-04T06:58:08.232398+0000","last_fullsized":"2024-03-04T06:58:08.232398+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.379963+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:56:08.379963+0000","last_peered":"2024-03-04T06:56:08.379963+0000","last_clean":"2024-03-04T06:56:08.379963+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:56:08.379963+0000","last_undegraded":"2024-03-04T06:56:08.379963+0000","last_fullsized":"2024-03-04T06:56:08.379963+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1238,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380005+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:56:08.380005+0000","last_peered":"2024-03-04T06:56:08.380005+0000","last_clean":"2024-03-04T06:56:08.380005+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:56:08.380005+0000","last_undegraded":"2024-03-04T06:56:08.380005+0000","last_fullsized":"2024-03-04T06:56:08.380005+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:56:49.538599+0000","last_peered":"2024-03-04T06:56:49.538599+0000","last_clean":"2024-03-04T06:56:49.538599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:56:49.538599+0000","last_undegraded":"2024-03-04T06:56:49.538599+0000","last_fullsized":"2024-03-04T06:56:49.538599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4367,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392018+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:57:58.392018+0000","last_peered":"2024-03-04T06:57:58.392018+0000","last_clean":"2024-03-04T06:57:58.392018+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:57:58.392018+0000","last_undegraded":"2024-03-04T06:57:58.392018+0000","last_fullsized":"2024-03-04T06:57:58.392018+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.157162+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:57:48.157162+0000","last_peered":"2024-03-04T06:57:48.157162+0000","last_clean":"2024-03-04T06:57:48.157162+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:57:48.157162+0000","last_undegraded":"2024-03-04T06:57:48.157162+0000","last_fullsized":"2024-03-04T06:57:48.157162+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951665+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:57:52.951665+0000","last_peered":"2024-03-04T06:57:52.951665+0000","last_clean":"2024-03-04T06:57:52.951665+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:57:52.951665+0000","last_undegraded":"2024-03-04T06:57:52.951665+0000","last_fullsized":"2024-03-04T06:57:52.951665+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4600,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:34.536621+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:56:34.536621+0000","last_peered":"2024-03-04T06:56:34.536621+0000","last_clean":"2024-03-04T06:56:34.536621+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:56:34.536621+0000","last_undegraded":"2024-03-04T06:56:34.536621+0000","last_fullsized":"2024-03-04T06:56:34.536621+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1245,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:08.380055+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:56:08.380055+0000","last_peered":"2024-03-04T06:56:08.380055+0000","last_clean":"2024-03-04T06:56:08.380055+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:56:08.380055+0000","last_undegraded":"2024-03-04T06:56:08.380055+0000","last_fullsized":"2024-03-04T06:56:08.380055+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538627+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:56:49.538627+0000","last_peered":"2024-03-04T06:56:49.538627+0000","last_clean":"2024-03-04T06:56:49.538627+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:56:49.538627+0000","last_undegraded":"2024-03-04T06:56:49.538627+0000","last_fullsized":"2024-03-04T06:56:49.538627+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230189+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:57:48.230189+0000","last_peered":"2024-03-04T06:57:48.230189+0000","last_clean":"2024-03-04T06:57:48.230189+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:57:48.230189+0000","last_undegraded":"2024-03-04T06:57:48.230189+0000","last_fullsized":"2024-03-04T06:57:48.230189+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389246+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:57:33.389246+0000","last_peered":"2024-03-04T06:57:33.389246+0000","last_clean":"2024-03-04T06:57:33.389246+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:57:33.389246+0000","last_undegraded":"2024-03-04T06:57:33.389246+0000","last_fullsized":"2024-03-04T06:57:33.389246+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947082+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:57:12.947082+0000","last_peered":"2024-03-04T06:57:12.947082+0000","last_clean":"2024-03-04T06:57:12.947082+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:57:12.947082+0000","last_undegraded":"2024-03-04T06:57:12.947082+0000","last_fullsized":"2024-03-04T06:57:12.947082+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006538+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:58:28.006538+0000","last_peered":"2024-03-04T06:58:28.006538+0000","last_clean":"2024-03-04T06:58:28.006538+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:58:28.006538+0000","last_undegraded":"2024-03-04T06:58:28.006538+0000","last_fullsized":"2024-03-04T06:58:28.006538+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992858+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:56:24.992858+0000","last_peered":"2024-03-04T06:56:24.992858+0000","last_clean":"2024-03-04T06:56:24.992858+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:56:24.992858+0000","last_undegraded":"2024-03-04T06:56:24.992858+0000","last_fullsized":"2024-03-04T06:56:24.992858+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154682+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:57:23.154682+0000","last_peered":"2024-03-04T06:57:23.154682+0000","last_clean":"2024-03-04T06:57:23.154682+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:57:23.154682+0000","last_undegraded":"2024-03-04T06:57:23.154682+0000","last_fullsized":"2024-03-04T06:57:23.154682+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232435+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:58:08.232435+0000","last_peered":"2024-03-04T06:58:08.232435+0000","last_clean":"2024-03-04T06:58:08.232435+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:58:08.232435+0000","last_undegraded":"2024-03-04T06:58:08.232435+0000","last_fullsized":"2024-03-04T06:58:08.232435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1194,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:24.992900+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:56:24.992900+0000","last_peered":"2024-03-04T06:56:24.992900+0000","last_clean":"2024-03-04T06:56:24.992900+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:56:24.992900+0000","last_undegraded":"2024-03-04T06:56:24.992900+0000","last_fullsized":"2024-03-04T06:56:24.992900+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949325+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:57:32.949325+0000","last_peered":"2024-03-04T06:57:32.949325+0000","last_clean":"2024-03-04T06:57:32.949325+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:57:32.949325+0000","last_undegraded":"2024-03-04T06:57:32.949325+0000","last_fullsized":"2024-03-04T06:57:32.949325+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994907+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:56:44.994907+0000","last_peered":"2024-03-04T06:56:44.994907+0000","last_clean":"2024-03-04T06:56:44.994907+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:56:44.994907+0000","last_undegraded":"2024-03-04T06:56:44.994907+0000","last_fullsized":"2024-03-04T06:56:44.994907+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1121,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951615+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:57:52.951615+0000","last_peered":"2024-03-04T06:57:52.951615+0000","last_clean":"2024-03-04T06:57:52.951615+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:57:52.951615+0000","last_undegraded":"2024-03-04T06:57:52.951615+0000","last_fullsized":"2024-03-04T06:57:52.951615+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.998327+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:57:12.998327+0000","last_peered":"2024-03-04T06:57:12.998327+0000","last_clean":"2024-03-04T06:57:12.998327+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:57:12.998327+0000","last_undegraded":"2024-03-04T06:57:12.998327+0000","last_fullsized":"2024-03-04T06:57:12.998327+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.220345+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:56:13.220345+0000","last_peered":"2024-03-04T06:56:13.220345+0000","last_clean":"2024-03-04T06:56:13.220345+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:56:13.220345+0000","last_undegraded":"2024-03-04T06:56:13.220345+0000","last_fullsized":"2024-03-04T06:56:13.220345+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503487,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648134,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142441,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287088,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997794,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885851,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937428,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792781,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:00:37.902 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:37.902 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:37.903 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:37.903 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:37.903 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:37.903 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:37.903 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:37.903 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:37.903 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:37.903 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:37.903 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:00:38.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:38 smithi137 ceph-mon[88869]: pgmap v1083: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:38.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:38 smithi137 ceph-mon[88869]: from='client.34647 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:38 smithi137 ceph-mon[91314]: pgmap v1083: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:38.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:38 smithi137 ceph-mon[91314]: from='client.34647 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:38.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:38 smithi203 ceph-mon[85573]: pgmap v1083: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:38.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:38 smithi203 ceph-mon[85573]: from='client.34647 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:39.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:00:39.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:00:39.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:00:40.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:40 smithi137 ceph-mon[88869]: pgmap v1084: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:40.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:40 smithi137 ceph-mon[91314]: pgmap v1084: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:40.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:40 smithi203 ceph-mon[85573]: pgmap v1084: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:42.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:42 smithi137 ceph-mon[88869]: pgmap v1085: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:42.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:42 smithi137 ceph-mon[91314]: pgmap v1085: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:42.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:42 smithi203 ceph-mon[85573]: pgmap v1085: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:44.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:44 smithi137 ceph-mon[88869]: pgmap v1086: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:44.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:44 smithi137 ceph-mon[91314]: pgmap v1086: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:44.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:44 smithi203 ceph-mon[85573]: pgmap v1086: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:45.615 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:00:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:00:45] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-03-04T07:00:46.346 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:46 smithi203 ceph-mon[85573]: pgmap v1087: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:46.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:46 smithi137 ceph-mon[88869]: pgmap v1087: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:46.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:46 smithi137 ceph-mon[91314]: pgmap v1087: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:47.906 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:00:48.128 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:00:48.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:48 smithi137 ceph-mon[88869]: pgmap v1088: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:48.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:48 smithi137 ceph-mon[91314]: pgmap v1088: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:48.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:48 smithi203 ceph-mon[85573]: pgmap v1088: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:00:50.010 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:00:50.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:50 smithi137 ceph-mon[88869]: pgmap v1089: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:50.292 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:50 smithi137 ceph-mon[91314]: pgmap v1089: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:50.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:50 smithi203 ceph-mon[85573]: pgmap v1089: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:50.703 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1089,"stamp":"2024-03-04T07:00:48.562821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003574"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549208+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:58:24.549208+0000","last_peered":"2024-03-04T06:58:24.549208+0000","last_clean":"2024-03-04T06:58:24.549208+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:58:24.549208+0000","last_undegraded":"2024-03-04T06:58:24.549208+0000","last_fullsized":"2024-03-04T06:58:24.549208+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151921+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:56:58.151921+0000","last_peered":"2024-03-04T06:56:58.151921+0000","last_clean":"2024-03-04T06:56:58.151921+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:56:58.151921+0000","last_undegraded":"2024-03-04T06:56:58.151921+0000","last_fullsized":"2024-03-04T06:56:58.151921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006644+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:58:28.006644+0000","last_peered":"2024-03-04T06:58:28.006644+0000","last_clean":"2024-03-04T06:58:28.006644+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:58:28.006644+0000","last_undegraded":"2024-03-04T06:58:28.006644+0000","last_fullsized":"2024-03-04T06:58:28.006644+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:52.944862+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:56:52.944862+0000","last_peered":"2024-03-04T06:56:52.944862+0000","last_clean":"2024-03-04T06:56:52.944862+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:56:52.944862+0000","last_undegraded":"2024-03-04T06:56:52.944862+0000","last_fullsized":"2024-03-04T06:56:52.944862+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543619+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:57:34.543619+0000","last_peered":"2024-03-04T06:57:34.543619+0000","last_clean":"2024-03-04T06:57:34.543619+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:57:34.543619+0000","last_undegraded":"2024-03-04T06:57:34.543619+0000","last_fullsized":"2024-03-04T06:57:34.543619+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941144+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:56:22.941144+0000","last_peered":"2024-03-04T06:56:22.941144+0000","last_clean":"2024-03-04T06:56:22.941144+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:56:22.941144+0000","last_undegraded":"2024-03-04T06:56:22.941144+0000","last_fullsized":"2024-03-04T06:56:22.941144+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543594+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:57:34.543594+0000","last_peered":"2024-03-04T06:57:34.543594+0000","last_clean":"2024-03-04T06:57:34.543594+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:57:34.543594+0000","last_undegraded":"2024-03-04T06:57:34.543594+0000","last_fullsized":"2024-03-04T06:57:34.543594+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001597+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:57:45.001597+0000","last_peered":"2024-03-04T06:57:45.001597+0000","last_clean":"2024-03-04T06:57:45.001597+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:57:45.001597+0000","last_undegraded":"2024-03-04T06:57:45.001597+0000","last_fullsized":"2024-03-04T06:57:45.001597+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1065,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541782+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:57:19.541782+0000","last_peered":"2024-03-04T06:57:19.541782+0000","last_clean":"2024-03-04T06:57:19.541782+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:57:19.541782+0000","last_undegraded":"2024-03-04T06:57:19.541782+0000","last_fullsized":"2024-03-04T06:57:19.541782+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223356+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:56:43.223356+0000","last_peered":"2024-03-04T06:56:43.223356+0000","last_clean":"2024-03-04T06:56:43.223356+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:56:43.223356+0000","last_undegraded":"2024-03-04T06:56:43.223356+0000","last_fullsized":"2024-03-04T06:56:43.223356+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223323+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:56:43.223323+0000","last_peered":"2024-03-04T06:56:43.223323+0000","last_clean":"2024-03-04T06:56:43.223323+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:56:43.223323+0000","last_undegraded":"2024-03-04T06:56:43.223323+0000","last_fullsized":"2024-03-04T06:56:43.223323+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:57.620940+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:57:57.620940+0000","last_peered":"2024-03-04T06:57:57.620940+0000","last_clean":"2024-03-04T06:57:57.620940+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:57:57.620940+0000","last_undegraded":"2024-03-04T06:57:57.620940+0000","last_fullsized":"2024-03-04T06:57:57.620940+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999343+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:57:24.999343+0000","last_peered":"2024-03-04T06:57:24.999343+0000","last_clean":"2024-03-04T06:57:24.999343+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:57:24.999343+0000","last_undegraded":"2024-03-04T06:57:24.999343+0000","last_fullsized":"2024-03-04T06:57:24.999343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001313+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:57:38.001313+0000","last_peered":"2024-03-04T06:57:38.001313+0000","last_clean":"2024-03-04T06:57:38.001313+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:57:38.001313+0000","last_undegraded":"2024-03-04T06:57:38.001313+0000","last_fullsized":"2024-03-04T06:57:38.001313+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:13.159769+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:58:13.159769+0000","last_peered":"2024-03-04T06:58:13.159769+0000","last_clean":"2024-03-04T06:58:13.159769+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:58:13.159769+0000","last_undegraded":"2024-03-04T06:58:13.159769+0000","last_fullsized":"2024-03-04T06:58:13.159769+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953787+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:58:12.953787+0000","last_peered":"2024-03-04T06:58:12.953787+0000","last_clean":"2024-03-04T06:58:12.953787+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:58:12.953787+0000","last_undegraded":"2024-03-04T06:58:12.953787+0000","last_fullsized":"2024-03-04T06:58:12.953787+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953915+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:58:12.953915+0000","last_peered":"2024-03-04T06:58:12.953915+0000","last_clean":"2024-03-04T06:58:12.953915+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:58:12.953915+0000","last_undegraded":"2024-03-04T06:58:12.953915+0000","last_fullsized":"2024-03-04T06:58:12.953915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382095+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:56:28.382095+0000","last_peered":"2024-03-04T06:56:28.382095+0000","last_clean":"2024-03-04T06:56:28.382095+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:56:28.382095+0000","last_undegraded":"2024-03-04T06:56:28.382095+0000","last_fullsized":"2024-03-04T06:56:28.382095+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538587+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:56:49.538587+0000","last_peered":"2024-03-04T06:56:49.538587+0000","last_clean":"2024-03-04T06:56:49.538587+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:56:49.538587+0000","last_undegraded":"2024-03-04T06:56:49.538587+0000","last_fullsized":"2024-03-04T06:56:49.538587+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1306,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006697+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:58:28.006697+0000","last_peered":"2024-03-04T06:58:28.006697+0000","last_clean":"2024-03-04T06:58:28.006697+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:58:28.006697+0000","last_undegraded":"2024-03-04T06:58:28.006697+0000","last_fullsized":"2024-03-04T06:58:28.006697+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001710+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:57:45.001710+0000","last_peered":"2024-03-04T06:57:45.001710+0000","last_clean":"2024-03-04T06:57:45.001710+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:57:45.001710+0000","last_undegraded":"2024-03-04T06:57:45.001710+0000","last_fullsized":"2024-03-04T06:57:45.001710+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001722+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:57:45.001722+0000","last_peered":"2024-03-04T06:57:45.001722+0000","last_clean":"2024-03-04T06:57:45.001722+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:57:45.001722+0000","last_undegraded":"2024-03-04T06:57:45.001722+0000","last_fullsized":"2024-03-04T06:57:45.001722+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006681+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:58:28.006681+0000","last_peered":"2024-03-04T06:58:28.006681+0000","last_clean":"2024-03-04T06:58:28.006681+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:58:28.006681+0000","last_undegraded":"2024-03-04T06:58:28.006681+0000","last_fullsized":"2024-03-04T06:58:28.006681+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1235,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386420+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:57:08.386420+0000","last_peered":"2024-03-04T06:57:08.386420+0000","last_clean":"2024-03-04T06:57:08.386420+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:57:08.386420+0000","last_undegraded":"2024-03-04T06:57:08.386420+0000","last_fullsized":"2024-03-04T06:57:08.386420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1222,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386390+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:57:08.386390+0000","last_peered":"2024-03-04T06:57:08.386390+0000","last_clean":"2024-03-04T06:57:08.386390+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:57:08.386390+0000","last_undegraded":"2024-03-04T06:57:08.386390+0000","last_fullsized":"2024-03-04T06:57:08.386390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543632+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:57:34.543632+0000","last_peered":"2024-03-04T06:57:34.543632+0000","last_clean":"2024-03-04T06:57:34.543632+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:57:34.543632+0000","last_undegraded":"2024-03-04T06:57:34.543632+0000","last_fullsized":"2024-03-04T06:57:34.543632+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941175+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:56:22.941175+0000","last_peered":"2024-03-04T06:56:22.941175+0000","last_clean":"2024-03-04T06:56:22.941175+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:56:22.941175+0000","last_undegraded":"2024-03-04T06:56:22.941175+0000","last_fullsized":"2024-03-04T06:56:22.941175+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001694+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:57:45.001694+0000","last_peered":"2024-03-04T06:57:45.001694+0000","last_clean":"2024-03-04T06:57:45.001694+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:57:45.001694+0000","last_undegraded":"2024-03-04T06:57:45.001694+0000","last_fullsized":"2024-03-04T06:57:45.001694+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1190,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:17.623076+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:58:17.623076+0000","last_peered":"2024-03-04T06:58:17.623076+0000","last_clean":"2024-03-04T06:58:17.623076+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:58:17.623076+0000","last_undegraded":"2024-03-04T06:58:17.623076+0000","last_fullsized":"2024-03-04T06:58:17.623076+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.224901+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:56:58.224901+0000","last_peered":"2024-03-04T06:56:58.224901+0000","last_clean":"2024-03-04T06:56:58.224901+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:56:58.224901+0000","last_undegraded":"2024-03-04T06:56:58.224901+0000","last_fullsized":"2024-03-04T06:56:58.224901+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1296,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:55:57.989954+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:55:57.989954+0000","last_peered":"2024-03-04T06:55:57.989954+0000","last_clean":"2024-03-04T06:55:57.989954+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:55:57.989954+0000","last_undegraded":"2024-03-04T06:55:57.989954+0000","last_fullsized":"2024-03-04T06:55:57.989954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999328+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:57:24.999328+0000","last_peered":"2024-03-04T06:57:24.999328+0000","last_clean":"2024-03-04T06:57:24.999328+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:57:24.999328+0000","last_undegraded":"2024-03-04T06:57:24.999328+0000","last_fullsized":"2024-03-04T06:57:24.999328+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999296+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:57:24.999296+0000","last_peered":"2024-03-04T06:57:24.999296+0000","last_clean":"2024-03-04T06:57:24.999296+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:57:24.999296+0000","last_undegraded":"2024-03-04T06:57:24.999296+0000","last_fullsized":"2024-03-04T06:57:24.999296+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939306+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:56:07.939306+0000","last_peered":"2024-03-04T06:56:07.939306+0000","last_clean":"2024-03-04T06:56:07.939306+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:56:07.939306+0000","last_undegraded":"2024-03-04T06:56:07.939306+0000","last_fullsized":"2024-03-04T06:56:07.939306+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147156+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:56:13.147156+0000","last_peered":"2024-03-04T06:56:13.147156+0000","last_clean":"2024-03-04T06:56:13.147156+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:56:13.147156+0000","last_undegraded":"2024-03-04T06:56:13.147156+0000","last_fullsized":"2024-03-04T06:56:13.147156+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223376+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:56:43.223376+0000","last_peered":"2024-03-04T06:56:43.223376+0000","last_clean":"2024-03-04T06:56:43.223376+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:56:43.223376+0000","last_undegraded":"2024-03-04T06:56:43.223376+0000","last_fullsized":"2024-03-04T06:56:43.223376+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1111,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939379+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:56:07.939379+0000","last_peered":"2024-03-04T06:56:07.939379+0000","last_clean":"2024-03-04T06:56:07.939379+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:56:07.939379+0000","last_undegraded":"2024-03-04T06:56:07.939379+0000","last_fullsized":"2024-03-04T06:56:07.939379+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:07.939364+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:56:07.939364+0000","last_peered":"2024-03-04T06:56:07.939364+0000","last_clean":"2024-03-04T06:56:07.939364+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:56:07.939364+0000","last_undegraded":"2024-03-04T06:56:07.939364+0000","last_fullsized":"2024-03-04T06:56:07.939364+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:03.003999+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:58:03.003999+0000","last_peered":"2024-03-04T06:58:03.003999+0000","last_clean":"2024-03-04T06:58:03.003999+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:58:03.003999+0000","last_undegraded":"2024-03-04T06:58:03.003999+0000","last_fullsized":"2024-03-04T06:58:03.003999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147207+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:56:13.147207+0000","last_peered":"2024-03-04T06:56:13.147207+0000","last_clean":"2024-03-04T06:56:13.147207+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:56:13.147207+0000","last_undegraded":"2024-03-04T06:56:13.147207+0000","last_fullsized":"2024-03-04T06:56:13.147207+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:37.618704+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:57:37.618704+0000","last_peered":"2024-03-04T06:57:37.618704+0000","last_clean":"2024-03-04T06:57:37.618704+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:57:37.618704+0000","last_undegraded":"2024-03-04T06:57:37.618704+0000","last_fullsized":"2024-03-04T06:57:37.618704+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1130,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221797+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:56:28.221797+0000","last_peered":"2024-03-04T06:56:28.221797+0000","last_clean":"2024-03-04T06:56:28.221797+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:56:28.221797+0000","last_undegraded":"2024-03-04T06:56:28.221797+0000","last_fullsized":"2024-03-04T06:56:28.221797+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541754+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:57:19.541754+0000","last_peered":"2024-03-04T06:57:19.541754+0000","last_clean":"2024-03-04T06:57:19.541754+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:57:19.541754+0000","last_undegraded":"2024-03-04T06:57:19.541754+0000","last_fullsized":"2024-03-04T06:57:19.541754+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001343+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:57:38.001343+0000","last_peered":"2024-03-04T06:57:38.001343+0000","last_clean":"2024-03-04T06:57:38.001343+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:57:38.001343+0000","last_undegraded":"2024-03-04T06:57:38.001343+0000","last_fullsized":"2024-03-04T06:57:38.001343+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382052+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:56:28.382052+0000","last_peered":"2024-03-04T06:56:28.382052+0000","last_clean":"2024-03-04T06:56:28.382052+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:56:28.382052+0000","last_undegraded":"2024-03-04T06:56:28.382052+0000","last_fullsized":"2024-03-04T06:56:28.382052+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953851+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:58:12.953851+0000","last_peered":"2024-03-04T06:58:12.953851+0000","last_clean":"2024-03-04T06:58:12.953851+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:58:12.953851+0000","last_undegraded":"2024-03-04T06:58:12.953851+0000","last_fullsized":"2024-03-04T06:58:12.953851+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540167+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:57:04.540167+0000","last_peered":"2024-03-04T06:57:04.540167+0000","last_clean":"2024-03-04T06:57:04.540167+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:57:04.540167+0000","last_undegraded":"2024-03-04T06:57:04.540167+0000","last_fullsized":"2024-03-04T06:57:04.540167+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221752+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:56:28.221752+0000","last_peered":"2024-03-04T06:56:28.221752+0000","last_clean":"2024-03-04T06:56:28.221752+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:56:28.221752+0000","last_undegraded":"2024-03-04T06:56:28.221752+0000","last_fullsized":"2024-03-04T06:56:28.221752+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221703+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:56:28.221703+0000","last_peered":"2024-03-04T06:56:28.221703+0000","last_clean":"2024-03-04T06:56:28.221703+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:56:28.221703+0000","last_undegraded":"2024-03-04T06:56:28.221703+0000","last_fullsized":"2024-03-04T06:56:28.221703+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1253,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382011+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:56:28.382011+0000","last_peered":"2024-03-04T06:56:28.382011+0000","last_clean":"2024-03-04T06:56:28.382011+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:56:28.382011+0000","last_undegraded":"2024-03-04T06:56:28.382011+0000","last_fullsized":"2024-03-04T06:56:28.382011+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540129+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:57:04.540129+0000","last_peered":"2024-03-04T06:57:04.540129+0000","last_clean":"2024-03-04T06:57:04.540129+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:57:04.540129+0000","last_undegraded":"2024-03-04T06:57:04.540129+0000","last_fullsized":"2024-03-04T06:57:04.540129+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3578,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.391939+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:57:58.391939+0000","last_peered":"2024-03-04T06:57:58.391939+0000","last_clean":"2024-03-04T06:57:58.391939+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:57:58.391939+0000","last_undegraded":"2024-03-04T06:57:58.391939+0000","last_fullsized":"2024-03-04T06:57:58.391939+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:17.616250+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:57:17.616250+0000","last_peered":"2024-03-04T06:57:17.616250+0000","last_clean":"2024-03-04T06:57:17.616250+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:57:17.616250+0000","last_undegraded":"2024-03-04T06:57:17.616250+0000","last_fullsized":"2024-03-04T06:57:17.616250+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:56:49.538613+0000","last_peered":"2024-03-04T06:56:49.538613+0000","last_clean":"2024-03-04T06:56:49.538613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:56:49.538613+0000","last_undegraded":"2024-03-04T06:56:49.538613+0000","last_fullsized":"2024-03-04T06:56:49.538613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17117,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006566+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:58:28.006566+0000","last_peered":"2024-03-04T06:58:28.006566+0000","last_clean":"2024-03-04T06:58:28.006566+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:58:28.006566+0000","last_undegraded":"2024-03-04T06:58:28.006566+0000","last_fullsized":"2024-03-04T06:58:28.006566+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151860+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:56:58.151860+0000","last_peered":"2024-03-04T06:56:58.151860+0000","last_clean":"2024-03-04T06:56:58.151860+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:56:58.151860+0000","last_undegraded":"2024-03-04T06:56:58.151860+0000","last_fullsized":"2024-03-04T06:56:58.151860+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151904+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:56:58.151904+0000","last_peered":"2024-03-04T06:56:58.151904+0000","last_clean":"2024-03-04T06:56:58.151904+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:56:58.151904+0000","last_undegraded":"2024-03-04T06:56:58.151904+0000","last_fullsized":"2024-03-04T06:56:58.151904+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947110+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:57:12.947110+0000","last_peered":"2024-03-04T06:57:12.947110+0000","last_clean":"2024-03-04T06:57:12.947110+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:57:12.947110+0000","last_undegraded":"2024-03-04T06:57:12.947110+0000","last_fullsized":"2024-03-04T06:57:12.947110+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4387,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006651+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:58:28.006651+0000","last_peered":"2024-03-04T06:58:28.006651+0000","last_clean":"2024-03-04T06:58:28.006651+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:58:28.006651+0000","last_undegraded":"2024-03-04T06:58:28.006651+0000","last_fullsized":"2024-03-04T06:58:28.006651+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151882+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:56:58.151882+0000","last_peered":"2024-03-04T06:56:58.151882+0000","last_clean":"2024-03-04T06:56:58.151882+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:56:58.151882+0000","last_undegraded":"2024-03-04T06:56:58.151882+0000","last_fullsized":"2024-03-04T06:56:58.151882+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947055+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:57:12.947055+0000","last_peered":"2024-03-04T06:57:12.947055+0000","last_clean":"2024-03-04T06:57:12.947055+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:57:12.947055+0000","last_undegraded":"2024-03-04T06:57:12.947055+0000","last_fullsized":"2024-03-04T06:57:12.947055+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625641+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:58:42.625641+0000","last_peered":"2024-03-04T06:58:42.625641+0000","last_clean":"2024-03-04T06:58:42.625641+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:58:42.625641+0000","last_undegraded":"2024-03-04T06:58:42.625641+0000","last_fullsized":"2024-03-04T06:58:42.625641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5640,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392060+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:57:58.392060+0000","last_peered":"2024-03-04T06:57:58.392060+0000","last_clean":"2024-03-04T06:57:58.392060+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:57:58.392060+0000","last_undegraded":"2024-03-04T06:57:58.392060+0000","last_fullsized":"2024-03-04T06:57:58.392060+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1256,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154711+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:57:23.154711+0000","last_peered":"2024-03-04T06:57:23.154711+0000","last_clean":"2024-03-04T06:57:23.154711+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:57:23.154711+0000","last_undegraded":"2024-03-04T06:57:23.154711+0000","last_fullsized":"2024-03-04T06:57:23.154711+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:33.162083+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:58:33.162083+0000","last_peered":"2024-03-04T06:58:33.162083+0000","last_clean":"2024-03-04T06:58:33.162083+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:58:33.162083+0000","last_undegraded":"2024-03-04T06:58:33.162083+0000","last_fullsized":"2024-03-04T06:58:33.162083+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389235+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:57:33.389235+0000","last_peered":"2024-03-04T06:57:33.389235+0000","last_clean":"2024-03-04T06:57:33.389235+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:57:33.389235+0000","last_undegraded":"2024-03-04T06:57:33.389235+0000","last_fullsized":"2024-03-04T06:57:33.389235+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4016,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:24.549121+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:58:24.549121+0000","last_peered":"2024-03-04T06:58:24.549121+0000","last_clean":"2024-03-04T06:58:24.549121+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:58:24.549121+0000","last_undegraded":"2024-03-04T06:58:24.549121+0000","last_fullsized":"2024-03-04T06:58:24.549121+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230253+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:57:48.230253+0000","last_peered":"2024-03-04T06:57:48.230253+0000","last_clean":"2024-03-04T06:57:48.230253+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:57:48.230253+0000","last_undegraded":"2024-03-04T06:57:48.230253+0000","last_fullsized":"2024-03-04T06:57:48.230253+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:10.004451+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:58:10.004451+0000","last_peered":"2024-03-04T06:58:10.004451+0000","last_clean":"2024-03-04T06:58:10.004451+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:58:10.004451+0000","last_undegraded":"2024-03-04T06:58:10.004451+0000","last_fullsized":"2024-03-04T06:58:10.004451+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947097+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:57:12.947097+0000","last_peered":"2024-03-04T06:57:12.947097+0000","last_clean":"2024-03-04T06:57:12.947097+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:57:12.947097+0000","last_undegraded":"2024-03-04T06:57:12.947097+0000","last_fullsized":"2024-03-04T06:57:12.947097+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1551,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547030+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:58:04.547030+0000","last_peered":"2024-03-04T06:58:04.547030+0000","last_clean":"2024-03-04T06:58:04.547030+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:58:04.547030+0000","last_undegraded":"2024-03-04T06:58:04.547030+0000","last_fullsized":"2024-03-04T06:58:04.547030+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3951,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949380+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:57:32.949380+0000","last_peered":"2024-03-04T06:57:32.949380+0000","last_clean":"2024-03-04T06:57:32.949380+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:57:32.949380+0000","last_undegraded":"2024-03-04T06:57:32.949380+0000","last_fullsized":"2024-03-04T06:57:32.949380+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995396+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:56:47.995396+0000","last_peered":"2024-03-04T06:56:47.995396+0000","last_clean":"2024-03-04T06:56:47.995396+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:56:47.995396+0000","last_undegraded":"2024-03-04T06:56:47.995396+0000","last_fullsized":"2024-03-04T06:56:47.995396+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389207+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:57:33.389207+0000","last_peered":"2024-03-04T06:57:33.389207+0000","last_clean":"2024-03-04T06:57:33.389207+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:57:33.389207+0000","last_undegraded":"2024-03-04T06:57:33.389207+0000","last_fullsized":"2024-03-04T06:57:33.389207+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547005+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:58:04.547005+0000","last_peered":"2024-03-04T06:58:04.547005+0000","last_clean":"2024-03-04T06:58:04.547005+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:58:04.547005+0000","last_undegraded":"2024-03-04T06:58:04.547005+0000","last_fullsized":"2024-03-04T06:58:04.547005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15292,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.230222+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:57:48.230222+0000","last_peered":"2024-03-04T06:57:48.230222+0000","last_clean":"2024-03-04T06:57:48.230222+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:57:48.230222+0000","last_undegraded":"2024-03-04T06:57:48.230222+0000","last_fullsized":"2024-03-04T06:57:48.230222+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006608+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:58:28.006608+0000","last_peered":"2024-03-04T06:58:28.006608+0000","last_clean":"2024-03-04T06:58:28.006608+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:58:28.006608+0000","last_undegraded":"2024-03-04T06:58:28.006608+0000","last_fullsized":"2024-03-04T06:58:28.006608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549190+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:58:24.549190+0000","last_peered":"2024-03-04T06:58:24.549190+0000","last_clean":"2024-03-04T06:58:24.549190+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:58:24.549190+0000","last_undegraded":"2024-03-04T06:58:24.549190+0000","last_fullsized":"2024-03-04T06:58:24.549190+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151891+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:56:58.151891+0000","last_peered":"2024-03-04T06:56:58.151891+0000","last_clean":"2024-03-04T06:56:58.151891+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:56:58.151891+0000","last_undegraded":"2024-03-04T06:56:58.151891+0000","last_fullsized":"2024-03-04T06:56:58.151891+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4380,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:42.625602+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:58:42.625602+0000","last_peered":"2024-03-04T06:58:42.625602+0000","last_clean":"2024-03-04T06:58:42.625602+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:58:42.625602+0000","last_undegraded":"2024-03-04T06:58:42.625602+0000","last_fullsized":"2024-03-04T06:58:42.625602+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001670+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:57:45.001670+0000","last_peered":"2024-03-04T06:57:45.001670+0000","last_clean":"2024-03-04T06:57:45.001670+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:57:45.001670+0000","last_undegraded":"2024-03-04T06:57:45.001670+0000","last_fullsized":"2024-03-04T06:57:45.001670+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1269,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154698+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:57:23.154698+0000","last_peered":"2024-03-04T06:57:23.154698+0000","last_clean":"2024-03-04T06:57:23.154698+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:57:23.154698+0000","last_undegraded":"2024-03-04T06:57:23.154698+0000","last_fullsized":"2024-03-04T06:57:23.154698+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007125+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:58:35.007125+0000","last_peered":"2024-03-04T06:58:35.007125+0000","last_clean":"2024-03-04T06:58:35.007125+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:58:35.007125+0000","last_undegraded":"2024-03-04T06:58:35.007125+0000","last_fullsized":"2024-03-04T06:58:35.007125+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4610,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:45.001644+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:57:45.001644+0000","last_peered":"2024-03-04T06:57:45.001644+0000","last_clean":"2024-03-04T06:57:45.001644+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:57:45.001644+0000","last_undegraded":"2024-03-04T06:57:45.001644+0000","last_fullsized":"2024-03-04T06:57:45.001644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625572+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:58:42.625572+0000","last_peered":"2024-03-04T06:58:42.625572+0000","last_clean":"2024-03-04T06:58:42.625572+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:58:42.625572+0000","last_undegraded":"2024-03-04T06:58:42.625572+0000","last_fullsized":"2024-03-04T06:58:42.625572+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1079,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232447+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:58:08.232447+0000","last_peered":"2024-03-04T06:58:08.232447+0000","last_clean":"2024-03-04T06:58:08.232447+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:58:08.232447+0000","last_undegraded":"2024-03-04T06:58:08.232447+0000","last_fullsized":"2024-03-04T06:58:08.232447+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995375+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:56:47.995375+0000","last_peered":"2024-03-04T06:56:47.995375+0000","last_clean":"2024-03-04T06:56:47.995375+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:56:47.995375+0000","last_undegraded":"2024-03-04T06:56:47.995375+0000","last_fullsized":"2024-03-04T06:56:47.995375+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4635,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:52.951690+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:57:52.951690+0000","last_peered":"2024-03-04T06:57:52.951690+0000","last_clean":"2024-03-04T06:57:52.951690+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:57:52.951690+0000","last_undegraded":"2024-03-04T06:57:52.951690+0000","last_fullsized":"2024-03-04T06:57:52.951690+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1057,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:34.536591+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:56:34.536591+0000","last_peered":"2024-03-04T06:56:34.536591+0000","last_clean":"2024-03-04T06:56:34.536591+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:56:34.536591+0000","last_undegraded":"2024-03-04T06:56:34.536591+0000","last_fullsized":"2024-03-04T06:56:34.536591+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1185,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:57.614016+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:56:57.614016+0000","last_peered":"2024-03-04T06:56:57.614016+0000","last_clean":"2024-03-04T06:56:57.614016+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:56:57.614016+0000","last_undegraded":"2024-03-04T06:56:57.614016+0000","last_fullsized":"2024-03-04T06:56:57.614016+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5158,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:17.616210+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:57:17.616210+0000","last_peered":"2024-03-04T06:57:17.616210+0000","last_clean":"2024-03-04T06:57:17.616210+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:57:17.616210+0000","last_undegraded":"2024-03-04T06:57:17.616210+0000","last_fullsized":"2024-03-04T06:57:17.616210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154620+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:57:23.154620+0000","last_peered":"2024-03-04T06:57:23.154620+0000","last_clean":"2024-03-04T06:57:23.154620+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:57:23.154620+0000","last_undegraded":"2024-03-04T06:57:23.154620+0000","last_fullsized":"2024-03-04T06:57:23.154620+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007066+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:58:35.007066+0000","last_peered":"2024-03-04T06:58:35.007066+0000","last_clean":"2024-03-04T06:58:35.007066+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:58:35.007066+0000","last_undegraded":"2024-03-04T06:58:35.007066+0000","last_fullsized":"2024-03-04T06:58:35.007066+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4720,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394889+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:58:23.394889+0000","last_peered":"2024-03-04T06:58:23.394889+0000","last_clean":"2024-03-04T06:58:23.394889+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:58:23.394889+0000","last_undegraded":"2024-03-04T06:58:23.394889+0000","last_fullsized":"2024-03-04T06:58:23.394889+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154658+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:57:23.154658+0000","last_peered":"2024-03-04T06:57:23.154658+0000","last_clean":"2024-03-04T06:57:23.154658+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:57:23.154658+0000","last_undegraded":"2024-03-04T06:57:23.154658+0000","last_fullsized":"2024-03-04T06:57:23.154658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994937+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:56:44.994937+0000","last_peered":"2024-03-04T06:56:44.994937+0000","last_clean":"2024-03-04T06:56:44.994937+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:56:44.994937+0000","last_undegraded":"2024-03-04T06:56:44.994937+0000","last_fullsized":"2024-03-04T06:56:44.994937+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5555,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.157094+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:57:48.157094+0000","last_peered":"2024-03-04T06:57:48.157094+0000","last_clean":"2024-03-04T06:57:48.157094+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:57:48.157094+0000","last_undegraded":"2024-03-04T06:57:48.157094+0000","last_fullsized":"2024-03-04T06:57:48.157094+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:56:49.538554+0000","last_peered":"2024-03-04T06:56:49.538554+0000","last_clean":"2024-03-04T06:56:49.538554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:56:49.538554+0000","last_undegraded":"2024-03-04T06:56:49.538554+0000","last_fullsized":"2024-03-04T06:56:49.538554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232398+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:58:08.232398+0000","last_peered":"2024-03-04T06:58:08.232398+0000","last_clean":"2024-03-04T06:58:08.232398+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:58:08.232398+0000","last_undegraded":"2024-03-04T06:58:08.232398+0000","last_fullsized":"2024-03-04T06:58:08.232398+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394833+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:58:23.394833+0000","last_peered":"2024-03-04T06:58:23.394833+0000","last_clean":"2024-03-04T06:58:23.394833+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:58:23.394833+0000","last_undegraded":"2024-03-04T06:58:23.394833+0000","last_fullsized":"2024-03-04T06:58:23.394833+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394877+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:58:23.394877+0000","last_peered":"2024-03-04T06:58:23.394877+0000","last_clean":"2024-03-04T06:58:23.394877+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:58:23.394877+0000","last_undegraded":"2024-03-04T06:58:23.394877+0000","last_fullsized":"2024-03-04T06:58:23.394877+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:56:49.538599+0000","last_peered":"2024-03-04T06:56:49.538599+0000","last_clean":"2024-03-04T06:56:49.538599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:56:49.538599+0000","last_undegraded":"2024-03-04T06:56:49.538599+0000","last_fullsized":"2024-03-04T06:56:49.538599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4367,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392018+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:57:58.392018+0000","last_peered":"2024-03-04T06:57:58.392018+0000","last_clean":"2024-03-04T06:57:58.392018+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:57:58.392018+0000","last_undegraded":"2024-03-04T06:57:58.392018+0000","last_fullsized":"2024-03-04T06:57:58.392018+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.157162+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:57:48.157162+0000","last_peered":"2024-03-04T06:57:48.157162+0000","last_clean":"2024-03-04T06:57:48.157162+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:57:48.157162+0000","last_undegraded":"2024-03-04T06:57:48.157162+0000","last_fullsized":"2024-03-04T06:57:48.157162+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951665+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:57:52.951665+0000","last_peered":"2024-03-04T06:57:52.951665+0000","last_clean":"2024-03-04T06:57:52.951665+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:57:52.951665+0000","last_undegraded":"2024-03-04T06:57:52.951665+0000","last_fullsized":"2024-03-04T06:57:52.951665+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4600,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:56:34.536621+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:56:34.536621+0000","last_peered":"2024-03-04T06:56:34.536621+0000","last_clean":"2024-03-04T06:56:34.536621+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:56:34.536621+0000","last_undegraded":"2024-03-04T06:56:34.536621+0000","last_fullsized":"2024-03-04T06:56:34.536621+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1246,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394915+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:58:23.394915+0000","last_peered":"2024-03-04T06:58:23.394915+0000","last_clean":"2024-03-04T06:58:23.394915+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:58:23.394915+0000","last_undegraded":"2024-03-04T06:58:23.394915+0000","last_fullsized":"2024-03-04T06:58:23.394915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538627+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:56:49.538627+0000","last_peered":"2024-03-04T06:56:49.538627+0000","last_clean":"2024-03-04T06:56:49.538627+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:56:49.538627+0000","last_undegraded":"2024-03-04T06:56:49.538627+0000","last_fullsized":"2024-03-04T06:56:49.538627+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230189+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:57:48.230189+0000","last_peered":"2024-03-04T06:57:48.230189+0000","last_clean":"2024-03-04T06:57:48.230189+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:57:48.230189+0000","last_undegraded":"2024-03-04T06:57:48.230189+0000","last_fullsized":"2024-03-04T06:57:48.230189+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389246+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:57:33.389246+0000","last_peered":"2024-03-04T06:57:33.389246+0000","last_clean":"2024-03-04T06:57:33.389246+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:57:33.389246+0000","last_undegraded":"2024-03-04T06:57:33.389246+0000","last_fullsized":"2024-03-04T06:57:33.389246+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947082+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:57:12.947082+0000","last_peered":"2024-03-04T06:57:12.947082+0000","last_clean":"2024-03-04T06:57:12.947082+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:57:12.947082+0000","last_undegraded":"2024-03-04T06:57:12.947082+0000","last_fullsized":"2024-03-04T06:57:12.947082+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006538+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:58:28.006538+0000","last_peered":"2024-03-04T06:58:28.006538+0000","last_clean":"2024-03-04T06:58:28.006538+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:58:28.006538+0000","last_undegraded":"2024-03-04T06:58:28.006538+0000","last_fullsized":"2024-03-04T06:58:28.006538+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007105+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:58:35.007105+0000","last_peered":"2024-03-04T06:58:35.007105+0000","last_clean":"2024-03-04T06:58:35.007105+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:58:35.007105+0000","last_undegraded":"2024-03-04T06:58:35.007105+0000","last_fullsized":"2024-03-04T06:58:35.007105+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154682+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:57:23.154682+0000","last_peered":"2024-03-04T06:57:23.154682+0000","last_clean":"2024-03-04T06:57:23.154682+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:57:23.154682+0000","last_undegraded":"2024-03-04T06:57:23.154682+0000","last_fullsized":"2024-03-04T06:57:23.154682+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232435+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:58:08.232435+0000","last_peered":"2024-03-04T06:58:08.232435+0000","last_clean":"2024-03-04T06:58:08.232435+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:58:08.232435+0000","last_undegraded":"2024-03-04T06:58:08.232435+0000","last_fullsized":"2024-03-04T06:58:08.232435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007138+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:58:35.007138+0000","last_peered":"2024-03-04T06:58:35.007138+0000","last_clean":"2024-03-04T06:58:35.007138+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:58:35.007138+0000","last_undegraded":"2024-03-04T06:58:35.007138+0000","last_fullsized":"2024-03-04T06:58:35.007138+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949325+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:57:32.949325+0000","last_peered":"2024-03-04T06:57:32.949325+0000","last_clean":"2024-03-04T06:57:32.949325+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:57:32.949325+0000","last_undegraded":"2024-03-04T06:57:32.949325+0000","last_fullsized":"2024-03-04T06:57:32.949325+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994907+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:56:44.994907+0000","last_peered":"2024-03-04T06:56:44.994907+0000","last_clean":"2024-03-04T06:56:44.994907+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:56:44.994907+0000","last_undegraded":"2024-03-04T06:56:44.994907+0000","last_fullsized":"2024-03-04T06:56:44.994907+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1121,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951615+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:57:52.951615+0000","last_peered":"2024-03-04T06:57:52.951615+0000","last_clean":"2024-03-04T06:57:52.951615+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:57:52.951615+0000","last_undegraded":"2024-03-04T06:57:52.951615+0000","last_fullsized":"2024-03-04T06:57:52.951615+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.998327+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:57:12.998327+0000","last_peered":"2024-03-04T06:57:12.998327+0000","last_clean":"2024-03-04T06:57:12.998327+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:57:12.998327+0000","last_undegraded":"2024-03-04T06:57:12.998327+0000","last_fullsized":"2024-03-04T06:57:12.998327+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.234922+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:58:28.234922+0000","last_peered":"2024-03-04T06:58:28.234922+0000","last_clean":"2024-03-04T06:58:28.234922+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:58:28.234922+0000","last_undegraded":"2024-03-04T06:58:28.234922+0000","last_fullsized":"2024-03-04T06:58:28.234922+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503489,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648137,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142444,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287091,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997797,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885853,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937431,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792784,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:00:50.710 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:50.710 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:50.710 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:50.710 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:50.710 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:50.710 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:50.710 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:50.710 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:50.710 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:50.710 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:00:50.711 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:00:51.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:51 smithi137 ceph-mon[88869]: from='client.34653 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:51.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:51 smithi137 ceph-mon[91314]: from='client.34653 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:51.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:51 smithi203 ceph-mon[85573]: from='client.34653 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:00:52.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:52 smithi137 ceph-mon[88869]: pgmap v1090: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:52.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:52 smithi137 ceph-mon[91314]: pgmap v1090: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:52.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:52 smithi203 ceph-mon[85573]: pgmap v1090: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:54.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:54 smithi137 ceph-mon[88869]: pgmap v1091: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:54.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:00:54.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:54 smithi137 ceph-mon[91314]: pgmap v1091: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:54.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:00:54.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:54 smithi203 ceph-mon[85573]: pgmap v1091: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:54.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:00:55.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:00:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:00:55] "GET /metrics HTTP/1.1" 200 36337 "" "Prometheus/2.43.0" 2024-03-04T07:00:56.292 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:56 smithi137 ceph-mon[91314]: pgmap v1092: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:56.292 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:56 smithi137 ceph-mon[88869]: pgmap v1092: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:56.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:56 smithi203 ceph-mon[85573]: pgmap v1092: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:58.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:00:58 smithi137 ceph-mon[88869]: pgmap v1093: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:58.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:00:58 smithi137 ceph-mon[91314]: pgmap v1093: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:00:58.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:00:58 smithi203 ceph-mon[85573]: pgmap v1093: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:00.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:00 smithi137 ceph-mon[88869]: pgmap v1094: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:00.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:00 smithi137 ceph-mon[91314]: pgmap v1094: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:00.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:00 smithi203 ceph-mon[85573]: pgmap v1094: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:00.711 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:01:00.932 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:01:02.320 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:02 smithi137 ceph-mon[91314]: pgmap v1095: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:02.320 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:02 smithi137 ceph-mon[88869]: pgmap v1095: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:02.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:02 smithi203 ceph-mon[85573]: pgmap v1095: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:02.851 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:01:02.853 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:01:03.458 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1096,"stamp":"2024-03-04T07:01:02.567574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004019"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549208+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:58:24.549208+0000","last_peered":"2024-03-04T06:58:24.549208+0000","last_clean":"2024-03-04T06:58:24.549208+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:58:24.549208+0000","last_undegraded":"2024-03-04T06:58:24.549208+0000","last_fullsized":"2024-03-04T06:58:24.549208+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1260,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151921+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:56:58.151921+0000","last_peered":"2024-03-04T06:56:58.151921+0000","last_clean":"2024-03-04T06:56:58.151921+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:56:58.151921+0000","last_undegraded":"2024-03-04T06:56:58.151921+0000","last_fullsized":"2024-03-04T06:56:58.151921+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006644+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:58:28.006644+0000","last_peered":"2024-03-04T06:58:28.006644+0000","last_clean":"2024-03-04T06:58:28.006644+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:58:28.006644+0000","last_undegraded":"2024-03-04T06:58:28.006644+0000","last_fullsized":"2024-03-04T06:58:28.006644+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958856+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:58:52.958856+0000","last_peered":"2024-03-04T06:58:52.958856+0000","last_clean":"2024-03-04T06:58:52.958856+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:58:52.958856+0000","last_undegraded":"2024-03-04T06:58:52.958856+0000","last_fullsized":"2024-03-04T06:58:52.958856+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543619+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:57:34.543619+0000","last_peered":"2024-03-04T06:57:34.543619+0000","last_clean":"2024-03-04T06:57:34.543619+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:57:34.543619+0000","last_undegraded":"2024-03-04T06:57:34.543619+0000","last_fullsized":"2024-03-04T06:57:34.543619+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941144+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:56:22.941144+0000","last_peered":"2024-03-04T06:56:22.941144+0000","last_clean":"2024-03-04T06:56:22.941144+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:56:22.941144+0000","last_undegraded":"2024-03-04T06:56:22.941144+0000","last_fullsized":"2024-03-04T06:56:22.941144+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543594+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:57:34.543594+0000","last_peered":"2024-03-04T06:57:34.543594+0000","last_clean":"2024-03-04T06:57:34.543594+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:57:34.543594+0000","last_undegraded":"2024-03-04T06:57:34.543594+0000","last_fullsized":"2024-03-04T06:57:34.543594+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001597+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:57:45.001597+0000","last_peered":"2024-03-04T06:57:45.001597+0000","last_clean":"2024-03-04T06:57:45.001597+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:57:45.001597+0000","last_undegraded":"2024-03-04T06:57:45.001597+0000","last_fullsized":"2024-03-04T06:57:45.001597+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1065,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541782+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:57:19.541782+0000","last_peered":"2024-03-04T06:57:19.541782+0000","last_clean":"2024-03-04T06:57:19.541782+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:57:19.541782+0000","last_undegraded":"2024-03-04T06:57:19.541782+0000","last_fullsized":"2024-03-04T06:57:19.541782+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223356+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:56:43.223356+0000","last_peered":"2024-03-04T06:56:43.223356+0000","last_clean":"2024-03-04T06:56:43.223356+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:56:43.223356+0000","last_undegraded":"2024-03-04T06:56:43.223356+0000","last_fullsized":"2024-03-04T06:56:43.223356+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223323+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:56:43.223323+0000","last_peered":"2024-03-04T06:56:43.223323+0000","last_clean":"2024-03-04T06:56:43.223323+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:56:43.223323+0000","last_undegraded":"2024-03-04T06:56:43.223323+0000","last_fullsized":"2024-03-04T06:56:43.223323+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:57.620940+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:57:57.620940+0000","last_peered":"2024-03-04T06:57:57.620940+0000","last_clean":"2024-03-04T06:57:57.620940+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:57:57.620940+0000","last_undegraded":"2024-03-04T06:57:57.620940+0000","last_fullsized":"2024-03-04T06:57:57.620940+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999343+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:57:24.999343+0000","last_peered":"2024-03-04T06:57:24.999343+0000","last_clean":"2024-03-04T06:57:24.999343+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:57:24.999343+0000","last_undegraded":"2024-03-04T06:57:24.999343+0000","last_fullsized":"2024-03-04T06:57:24.999343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001313+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:57:38.001313+0000","last_peered":"2024-03-04T06:57:38.001313+0000","last_clean":"2024-03-04T06:57:38.001313+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:57:38.001313+0000","last_undegraded":"2024-03-04T06:57:38.001313+0000","last_fullsized":"2024-03-04T06:57:38.001313+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:13.159769+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:58:13.159769+0000","last_peered":"2024-03-04T06:58:13.159769+0000","last_clean":"2024-03-04T06:58:13.159769+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:58:13.159769+0000","last_undegraded":"2024-03-04T06:58:13.159769+0000","last_fullsized":"2024-03-04T06:58:13.159769+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953787+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:58:12.953787+0000","last_peered":"2024-03-04T06:58:12.953787+0000","last_clean":"2024-03-04T06:58:12.953787+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:58:12.953787+0000","last_undegraded":"2024-03-04T06:58:12.953787+0000","last_fullsized":"2024-03-04T06:58:12.953787+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953915+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:58:12.953915+0000","last_peered":"2024-03-04T06:58:12.953915+0000","last_clean":"2024-03-04T06:58:12.953915+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:58:12.953915+0000","last_undegraded":"2024-03-04T06:58:12.953915+0000","last_fullsized":"2024-03-04T06:58:12.953915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382095+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:56:28.382095+0000","last_peered":"2024-03-04T06:56:28.382095+0000","last_clean":"2024-03-04T06:56:28.382095+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:56:28.382095+0000","last_undegraded":"2024-03-04T06:56:28.382095+0000","last_fullsized":"2024-03-04T06:56:28.382095+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538587+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:56:49.538587+0000","last_peered":"2024-03-04T06:56:49.538587+0000","last_clean":"2024-03-04T06:56:49.538587+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:56:49.538587+0000","last_undegraded":"2024-03-04T06:56:49.538587+0000","last_fullsized":"2024-03-04T06:56:49.538587+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1306,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006697+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:58:28.006697+0000","last_peered":"2024-03-04T06:58:28.006697+0000","last_clean":"2024-03-04T06:58:28.006697+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:58:28.006697+0000","last_undegraded":"2024-03-04T06:58:28.006697+0000","last_fullsized":"2024-03-04T06:58:28.006697+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001710+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:57:45.001710+0000","last_peered":"2024-03-04T06:57:45.001710+0000","last_clean":"2024-03-04T06:57:45.001710+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:57:45.001710+0000","last_undegraded":"2024-03-04T06:57:45.001710+0000","last_fullsized":"2024-03-04T06:57:45.001710+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001722+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:57:45.001722+0000","last_peered":"2024-03-04T06:57:45.001722+0000","last_clean":"2024-03-04T06:57:45.001722+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:57:45.001722+0000","last_undegraded":"2024-03-04T06:57:45.001722+0000","last_fullsized":"2024-03-04T06:57:45.001722+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006681+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:58:28.006681+0000","last_peered":"2024-03-04T06:58:28.006681+0000","last_clean":"2024-03-04T06:58:28.006681+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:58:28.006681+0000","last_undegraded":"2024-03-04T06:58:28.006681+0000","last_fullsized":"2024-03-04T06:58:28.006681+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1235,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386420+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:57:08.386420+0000","last_peered":"2024-03-04T06:57:08.386420+0000","last_clean":"2024-03-04T06:57:08.386420+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:57:08.386420+0000","last_undegraded":"2024-03-04T06:57:08.386420+0000","last_fullsized":"2024-03-04T06:57:08.386420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1222,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386390+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:57:08.386390+0000","last_peered":"2024-03-04T06:57:08.386390+0000","last_clean":"2024-03-04T06:57:08.386390+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:57:08.386390+0000","last_undegraded":"2024-03-04T06:57:08.386390+0000","last_fullsized":"2024-03-04T06:57:08.386390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543632+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:57:34.543632+0000","last_peered":"2024-03-04T06:57:34.543632+0000","last_clean":"2024-03-04T06:57:34.543632+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:57:34.543632+0000","last_undegraded":"2024-03-04T06:57:34.543632+0000","last_fullsized":"2024-03-04T06:57:34.543632+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941175+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:56:22.941175+0000","last_peered":"2024-03-04T06:56:22.941175+0000","last_clean":"2024-03-04T06:56:22.941175+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:56:22.941175+0000","last_undegraded":"2024-03-04T06:56:22.941175+0000","last_fullsized":"2024-03-04T06:56:22.941175+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001694+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:57:45.001694+0000","last_peered":"2024-03-04T06:57:45.001694+0000","last_clean":"2024-03-04T06:57:45.001694+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:57:45.001694+0000","last_undegraded":"2024-03-04T06:57:45.001694+0000","last_fullsized":"2024-03-04T06:57:45.001694+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1190,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:17.623076+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:58:17.623076+0000","last_peered":"2024-03-04T06:58:17.623076+0000","last_clean":"2024-03-04T06:58:17.623076+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:58:17.623076+0000","last_undegraded":"2024-03-04T06:58:17.623076+0000","last_fullsized":"2024-03-04T06:58:17.623076+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.224901+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:56:58.224901+0000","last_peered":"2024-03-04T06:56:58.224901+0000","last_clean":"2024-03-04T06:56:58.224901+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:56:58.224901+0000","last_undegraded":"2024-03-04T06:56:58.224901+0000","last_fullsized":"2024-03-04T06:56:58.224901+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006622+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:58:28.006622+0000","last_peered":"2024-03-04T06:58:28.006622+0000","last_clean":"2024-03-04T06:58:28.006622+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:58:28.006622+0000","last_undegraded":"2024-03-04T06:58:28.006622+0000","last_fullsized":"2024-03-04T06:58:28.006622+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999328+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:57:24.999328+0000","last_peered":"2024-03-04T06:57:24.999328+0000","last_clean":"2024-03-04T06:57:24.999328+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:57:24.999328+0000","last_undegraded":"2024-03-04T06:57:24.999328+0000","last_fullsized":"2024-03-04T06:57:24.999328+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999296+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:57:24.999296+0000","last_peered":"2024-03-04T06:57:24.999296+0000","last_clean":"2024-03-04T06:57:24.999296+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:57:24.999296+0000","last_undegraded":"2024-03-04T06:57:24.999296+0000","last_fullsized":"2024-03-04T06:57:24.999296+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956356+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:58:32.956356+0000","last_peered":"2024-03-04T06:58:32.956356+0000","last_clean":"2024-03-04T06:58:32.956356+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:58:32.956356+0000","last_undegraded":"2024-03-04T06:58:32.956356+0000","last_fullsized":"2024-03-04T06:58:32.956356+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147156+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:56:13.147156+0000","last_peered":"2024-03-04T06:56:13.147156+0000","last_clean":"2024-03-04T06:56:13.147156+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:56:13.147156+0000","last_undegraded":"2024-03-04T06:56:13.147156+0000","last_fullsized":"2024-03-04T06:56:13.147156+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223376+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:56:43.223376+0000","last_peered":"2024-03-04T06:56:43.223376+0000","last_clean":"2024-03-04T06:56:43.223376+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:56:43.223376+0000","last_undegraded":"2024-03-04T06:56:43.223376+0000","last_fullsized":"2024-03-04T06:56:43.223376+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956414+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:58:32.956414+0000","last_peered":"2024-03-04T06:58:32.956414+0000","last_clean":"2024-03-04T06:58:32.956414+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:58:32.956414+0000","last_undegraded":"2024-03-04T06:58:32.956414+0000","last_fullsized":"2024-03-04T06:58:32.956414+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956402+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:58:32.956402+0000","last_peered":"2024-03-04T06:58:32.956402+0000","last_clean":"2024-03-04T06:58:32.956402+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:58:32.956402+0000","last_undegraded":"2024-03-04T06:58:32.956402+0000","last_fullsized":"2024-03-04T06:58:32.956402+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:03.003999+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:58:03.003999+0000","last_peered":"2024-03-04T06:58:03.003999+0000","last_clean":"2024-03-04T06:58:03.003999+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:58:03.003999+0000","last_undegraded":"2024-03-04T06:58:03.003999+0000","last_fullsized":"2024-03-04T06:58:03.003999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:13.147207+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:56:13.147207+0000","last_peered":"2024-03-04T06:56:13.147207+0000","last_clean":"2024-03-04T06:56:13.147207+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:56:13.147207+0000","last_undegraded":"2024-03-04T06:56:13.147207+0000","last_fullsized":"2024-03-04T06:56:13.147207+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:37.618704+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:57:37.618704+0000","last_peered":"2024-03-04T06:57:37.618704+0000","last_clean":"2024-03-04T06:57:37.618704+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:57:37.618704+0000","last_undegraded":"2024-03-04T06:57:37.618704+0000","last_fullsized":"2024-03-04T06:57:37.618704+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1130,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221797+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:56:28.221797+0000","last_peered":"2024-03-04T06:56:28.221797+0000","last_clean":"2024-03-04T06:56:28.221797+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:56:28.221797+0000","last_undegraded":"2024-03-04T06:56:28.221797+0000","last_fullsized":"2024-03-04T06:56:28.221797+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541754+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:57:19.541754+0000","last_peered":"2024-03-04T06:57:19.541754+0000","last_clean":"2024-03-04T06:57:19.541754+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:57:19.541754+0000","last_undegraded":"2024-03-04T06:57:19.541754+0000","last_fullsized":"2024-03-04T06:57:19.541754+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001343+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:57:38.001343+0000","last_peered":"2024-03-04T06:57:38.001343+0000","last_clean":"2024-03-04T06:57:38.001343+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:57:38.001343+0000","last_undegraded":"2024-03-04T06:57:38.001343+0000","last_fullsized":"2024-03-04T06:57:38.001343+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382052+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:56:28.382052+0000","last_peered":"2024-03-04T06:56:28.382052+0000","last_clean":"2024-03-04T06:56:28.382052+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:56:28.382052+0000","last_undegraded":"2024-03-04T06:56:28.382052+0000","last_fullsized":"2024-03-04T06:56:28.382052+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953851+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:58:12.953851+0000","last_peered":"2024-03-04T06:58:12.953851+0000","last_clean":"2024-03-04T06:58:12.953851+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:58:12.953851+0000","last_undegraded":"2024-03-04T06:58:12.953851+0000","last_fullsized":"2024-03-04T06:58:12.953851+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540167+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:57:04.540167+0000","last_peered":"2024-03-04T06:57:04.540167+0000","last_clean":"2024-03-04T06:57:04.540167+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:57:04.540167+0000","last_undegraded":"2024-03-04T06:57:04.540167+0000","last_fullsized":"2024-03-04T06:57:04.540167+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221752+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:56:28.221752+0000","last_peered":"2024-03-04T06:56:28.221752+0000","last_clean":"2024-03-04T06:56:28.221752+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:56:28.221752+0000","last_undegraded":"2024-03-04T06:56:28.221752+0000","last_fullsized":"2024-03-04T06:56:28.221752+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.221703+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:56:28.221703+0000","last_peered":"2024-03-04T06:56:28.221703+0000","last_clean":"2024-03-04T06:56:28.221703+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:56:28.221703+0000","last_undegraded":"2024-03-04T06:56:28.221703+0000","last_fullsized":"2024-03-04T06:56:28.221703+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1253,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:28.382011+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:56:28.382011+0000","last_peered":"2024-03-04T06:56:28.382011+0000","last_clean":"2024-03-04T06:56:28.382011+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:56:28.382011+0000","last_undegraded":"2024-03-04T06:56:28.382011+0000","last_fullsized":"2024-03-04T06:56:28.382011+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540129+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:57:04.540129+0000","last_peered":"2024-03-04T06:57:04.540129+0000","last_clean":"2024-03-04T06:57:04.540129+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:57:04.540129+0000","last_undegraded":"2024-03-04T06:57:04.540129+0000","last_fullsized":"2024-03-04T06:57:04.540129+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3578,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.391939+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:57:58.391939+0000","last_peered":"2024-03-04T06:57:58.391939+0000","last_clean":"2024-03-04T06:57:58.391939+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:57:58.391939+0000","last_undegraded":"2024-03-04T06:57:58.391939+0000","last_fullsized":"2024-03-04T06:57:58.391939+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:17.616250+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:57:17.616250+0000","last_peered":"2024-03-04T06:57:17.616250+0000","last_clean":"2024-03-04T06:57:17.616250+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:57:17.616250+0000","last_undegraded":"2024-03-04T06:57:17.616250+0000","last_fullsized":"2024-03-04T06:57:17.616250+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:56:49.538613+0000","last_peered":"2024-03-04T06:56:49.538613+0000","last_clean":"2024-03-04T06:56:49.538613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:56:49.538613+0000","last_undegraded":"2024-03-04T06:56:49.538613+0000","last_fullsized":"2024-03-04T06:56:49.538613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17117,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006566+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:58:28.006566+0000","last_peered":"2024-03-04T06:58:28.006566+0000","last_clean":"2024-03-04T06:58:28.006566+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:58:28.006566+0000","last_undegraded":"2024-03-04T06:58:28.006566+0000","last_fullsized":"2024-03-04T06:58:28.006566+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151860+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:56:58.151860+0000","last_peered":"2024-03-04T06:56:58.151860+0000","last_clean":"2024-03-04T06:56:58.151860+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:56:58.151860+0000","last_undegraded":"2024-03-04T06:56:58.151860+0000","last_fullsized":"2024-03-04T06:56:58.151860+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151904+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:56:58.151904+0000","last_peered":"2024-03-04T06:56:58.151904+0000","last_clean":"2024-03-04T06:56:58.151904+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:56:58.151904+0000","last_undegraded":"2024-03-04T06:56:58.151904+0000","last_fullsized":"2024-03-04T06:56:58.151904+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947110+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:57:12.947110+0000","last_peered":"2024-03-04T06:57:12.947110+0000","last_clean":"2024-03-04T06:57:12.947110+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:57:12.947110+0000","last_undegraded":"2024-03-04T06:57:12.947110+0000","last_fullsized":"2024-03-04T06:57:12.947110+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4387,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006651+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:58:28.006651+0000","last_peered":"2024-03-04T06:58:28.006651+0000","last_clean":"2024-03-04T06:58:28.006651+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:58:28.006651+0000","last_undegraded":"2024-03-04T06:58:28.006651+0000","last_fullsized":"2024-03-04T06:58:28.006651+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151882+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:56:58.151882+0000","last_peered":"2024-03-04T06:56:58.151882+0000","last_clean":"2024-03-04T06:56:58.151882+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:56:58.151882+0000","last_undegraded":"2024-03-04T06:56:58.151882+0000","last_fullsized":"2024-03-04T06:56:58.151882+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947055+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:57:12.947055+0000","last_peered":"2024-03-04T06:57:12.947055+0000","last_clean":"2024-03-04T06:57:12.947055+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:57:12.947055+0000","last_undegraded":"2024-03-04T06:57:12.947055+0000","last_fullsized":"2024-03-04T06:57:12.947055+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625641+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:58:42.625641+0000","last_peered":"2024-03-04T06:58:42.625641+0000","last_clean":"2024-03-04T06:58:42.625641+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:58:42.625641+0000","last_undegraded":"2024-03-04T06:58:42.625641+0000","last_fullsized":"2024-03-04T06:58:42.625641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5640,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392060+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:57:58.392060+0000","last_peered":"2024-03-04T06:57:58.392060+0000","last_clean":"2024-03-04T06:57:58.392060+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:57:58.392060+0000","last_undegraded":"2024-03-04T06:57:58.392060+0000","last_fullsized":"2024-03-04T06:57:58.392060+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1256,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154711+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:57:23.154711+0000","last_peered":"2024-03-04T06:57:23.154711+0000","last_clean":"2024-03-04T06:57:23.154711+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:57:23.154711+0000","last_undegraded":"2024-03-04T06:57:23.154711+0000","last_fullsized":"2024-03-04T06:57:23.154711+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:33.162083+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:58:33.162083+0000","last_peered":"2024-03-04T06:58:33.162083+0000","last_clean":"2024-03-04T06:58:33.162083+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:58:33.162083+0000","last_undegraded":"2024-03-04T06:58:33.162083+0000","last_fullsized":"2024-03-04T06:58:33.162083+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389235+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:57:33.389235+0000","last_peered":"2024-03-04T06:57:33.389235+0000","last_clean":"2024-03-04T06:57:33.389235+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:57:33.389235+0000","last_undegraded":"2024-03-04T06:57:33.389235+0000","last_fullsized":"2024-03-04T06:57:33.389235+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4016,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:24.549121+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:58:24.549121+0000","last_peered":"2024-03-04T06:58:24.549121+0000","last_clean":"2024-03-04T06:58:24.549121+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:58:24.549121+0000","last_undegraded":"2024-03-04T06:58:24.549121+0000","last_fullsized":"2024-03-04T06:58:24.549121+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230253+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:57:48.230253+0000","last_peered":"2024-03-04T06:57:48.230253+0000","last_clean":"2024-03-04T06:57:48.230253+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:57:48.230253+0000","last_undegraded":"2024-03-04T06:57:48.230253+0000","last_fullsized":"2024-03-04T06:57:48.230253+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:10.004451+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:58:10.004451+0000","last_peered":"2024-03-04T06:58:10.004451+0000","last_clean":"2024-03-04T06:58:10.004451+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:58:10.004451+0000","last_undegraded":"2024-03-04T06:58:10.004451+0000","last_fullsized":"2024-03-04T06:58:10.004451+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947097+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:57:12.947097+0000","last_peered":"2024-03-04T06:57:12.947097+0000","last_clean":"2024-03-04T06:57:12.947097+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:57:12.947097+0000","last_undegraded":"2024-03-04T06:57:12.947097+0000","last_fullsized":"2024-03-04T06:57:12.947097+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1551,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547030+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:58:04.547030+0000","last_peered":"2024-03-04T06:58:04.547030+0000","last_clean":"2024-03-04T06:58:04.547030+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:58:04.547030+0000","last_undegraded":"2024-03-04T06:58:04.547030+0000","last_fullsized":"2024-03-04T06:58:04.547030+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3951,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949380+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:57:32.949380+0000","last_peered":"2024-03-04T06:57:32.949380+0000","last_clean":"2024-03-04T06:57:32.949380+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:57:32.949380+0000","last_undegraded":"2024-03-04T06:57:32.949380+0000","last_fullsized":"2024-03-04T06:57:32.949380+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995396+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:56:47.995396+0000","last_peered":"2024-03-04T06:56:47.995396+0000","last_clean":"2024-03-04T06:56:47.995396+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:56:47.995396+0000","last_undegraded":"2024-03-04T06:56:47.995396+0000","last_fullsized":"2024-03-04T06:56:47.995396+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389207+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:57:33.389207+0000","last_peered":"2024-03-04T06:57:33.389207+0000","last_clean":"2024-03-04T06:57:33.389207+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:57:33.389207+0000","last_undegraded":"2024-03-04T06:57:33.389207+0000","last_fullsized":"2024-03-04T06:57:33.389207+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547005+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:58:04.547005+0000","last_peered":"2024-03-04T06:58:04.547005+0000","last_clean":"2024-03-04T06:58:04.547005+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:58:04.547005+0000","last_undegraded":"2024-03-04T06:58:04.547005+0000","last_fullsized":"2024-03-04T06:58:04.547005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15292,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.230222+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:57:48.230222+0000","last_peered":"2024-03-04T06:57:48.230222+0000","last_clean":"2024-03-04T06:57:48.230222+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:57:48.230222+0000","last_undegraded":"2024-03-04T06:57:48.230222+0000","last_fullsized":"2024-03-04T06:57:48.230222+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006608+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:58:28.006608+0000","last_peered":"2024-03-04T06:58:28.006608+0000","last_clean":"2024-03-04T06:58:28.006608+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:58:28.006608+0000","last_undegraded":"2024-03-04T06:58:28.006608+0000","last_fullsized":"2024-03-04T06:58:28.006608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549190+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:58:24.549190+0000","last_peered":"2024-03-04T06:58:24.549190+0000","last_clean":"2024-03-04T06:58:24.549190+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:58:24.549190+0000","last_undegraded":"2024-03-04T06:58:24.549190+0000","last_fullsized":"2024-03-04T06:58:24.549190+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.151891+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:56:58.151891+0000","last_peered":"2024-03-04T06:56:58.151891+0000","last_clean":"2024-03-04T06:56:58.151891+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:56:58.151891+0000","last_undegraded":"2024-03-04T06:56:58.151891+0000","last_fullsized":"2024-03-04T06:56:58.151891+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4380,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:42.625602+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:58:42.625602+0000","last_peered":"2024-03-04T06:58:42.625602+0000","last_clean":"2024-03-04T06:58:42.625602+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:58:42.625602+0000","last_undegraded":"2024-03-04T06:58:42.625602+0000","last_fullsized":"2024-03-04T06:58:42.625602+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001670+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:57:45.001670+0000","last_peered":"2024-03-04T06:57:45.001670+0000","last_clean":"2024-03-04T06:57:45.001670+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:57:45.001670+0000","last_undegraded":"2024-03-04T06:57:45.001670+0000","last_fullsized":"2024-03-04T06:57:45.001670+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1269,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154698+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:57:23.154698+0000","last_peered":"2024-03-04T06:57:23.154698+0000","last_clean":"2024-03-04T06:57:23.154698+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:57:23.154698+0000","last_undegraded":"2024-03-04T06:57:23.154698+0000","last_fullsized":"2024-03-04T06:57:23.154698+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007125+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:58:35.007125+0000","last_peered":"2024-03-04T06:58:35.007125+0000","last_clean":"2024-03-04T06:58:35.007125+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:58:35.007125+0000","last_undegraded":"2024-03-04T06:58:35.007125+0000","last_fullsized":"2024-03-04T06:58:35.007125+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4610,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:45.001644+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:57:45.001644+0000","last_peered":"2024-03-04T06:57:45.001644+0000","last_clean":"2024-03-04T06:57:45.001644+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:57:45.001644+0000","last_undegraded":"2024-03-04T06:57:45.001644+0000","last_fullsized":"2024-03-04T06:57:45.001644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625572+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:58:42.625572+0000","last_peered":"2024-03-04T06:58:42.625572+0000","last_clean":"2024-03-04T06:58:42.625572+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:58:42.625572+0000","last_undegraded":"2024-03-04T06:58:42.625572+0000","last_fullsized":"2024-03-04T06:58:42.625572+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1079,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232447+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:58:08.232447+0000","last_peered":"2024-03-04T06:58:08.232447+0000","last_clean":"2024-03-04T06:58:08.232447+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:58:08.232447+0000","last_undegraded":"2024-03-04T06:58:08.232447+0000","last_fullsized":"2024-03-04T06:58:08.232447+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:47.995375+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:56:47.995375+0000","last_peered":"2024-03-04T06:56:47.995375+0000","last_clean":"2024-03-04T06:56:47.995375+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:56:47.995375+0000","last_undegraded":"2024-03-04T06:56:47.995375+0000","last_fullsized":"2024-03-04T06:56:47.995375+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4635,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:52.951690+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:57:52.951690+0000","last_peered":"2024-03-04T06:57:52.951690+0000","last_clean":"2024-03-04T06:57:52.951690+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:57:52.951690+0000","last_undegraded":"2024-03-04T06:57:52.951690+0000","last_fullsized":"2024-03-04T06:57:52.951690+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:44.551296+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:58:44.551296+0000","last_peered":"2024-03-04T06:58:44.551296+0000","last_clean":"2024-03-04T06:58:44.551296+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:58:44.551296+0000","last_undegraded":"2024-03-04T06:58:44.551296+0000","last_fullsized":"2024-03-04T06:58:44.551296+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1185,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:57.614016+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:56:57.614016+0000","last_peered":"2024-03-04T06:56:57.614016+0000","last_clean":"2024-03-04T06:56:57.614016+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:56:57.614016+0000","last_undegraded":"2024-03-04T06:56:57.614016+0000","last_fullsized":"2024-03-04T06:56:57.614016+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5158,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:17.616210+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:57:17.616210+0000","last_peered":"2024-03-04T06:57:17.616210+0000","last_clean":"2024-03-04T06:57:17.616210+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:57:17.616210+0000","last_undegraded":"2024-03-04T06:57:17.616210+0000","last_fullsized":"2024-03-04T06:57:17.616210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154620+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:57:23.154620+0000","last_peered":"2024-03-04T06:57:23.154620+0000","last_clean":"2024-03-04T06:57:23.154620+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:57:23.154620+0000","last_undegraded":"2024-03-04T06:57:23.154620+0000","last_fullsized":"2024-03-04T06:57:23.154620+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007066+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:58:35.007066+0000","last_peered":"2024-03-04T06:58:35.007066+0000","last_clean":"2024-03-04T06:58:35.007066+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:58:35.007066+0000","last_undegraded":"2024-03-04T06:58:35.007066+0000","last_fullsized":"2024-03-04T06:58:35.007066+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4720,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394889+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:58:23.394889+0000","last_peered":"2024-03-04T06:58:23.394889+0000","last_clean":"2024-03-04T06:58:23.394889+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:58:23.394889+0000","last_undegraded":"2024-03-04T06:58:23.394889+0000","last_fullsized":"2024-03-04T06:58:23.394889+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154658+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:57:23.154658+0000","last_peered":"2024-03-04T06:57:23.154658+0000","last_clean":"2024-03-04T06:57:23.154658+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:57:23.154658+0000","last_undegraded":"2024-03-04T06:57:23.154658+0000","last_fullsized":"2024-03-04T06:57:23.154658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994937+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:56:44.994937+0000","last_peered":"2024-03-04T06:56:44.994937+0000","last_clean":"2024-03-04T06:56:44.994937+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:56:44.994937+0000","last_undegraded":"2024-03-04T06:56:44.994937+0000","last_fullsized":"2024-03-04T06:56:44.994937+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5555,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.157094+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:57:48.157094+0000","last_peered":"2024-03-04T06:57:48.157094+0000","last_clean":"2024-03-04T06:57:48.157094+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:57:48.157094+0000","last_undegraded":"2024-03-04T06:57:48.157094+0000","last_fullsized":"2024-03-04T06:57:48.157094+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:56:49.538554+0000","last_peered":"2024-03-04T06:56:49.538554+0000","last_clean":"2024-03-04T06:56:49.538554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:56:49.538554+0000","last_undegraded":"2024-03-04T06:56:49.538554+0000","last_fullsized":"2024-03-04T06:56:49.538554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232398+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:58:08.232398+0000","last_peered":"2024-03-04T06:58:08.232398+0000","last_clean":"2024-03-04T06:58:08.232398+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:58:08.232398+0000","last_undegraded":"2024-03-04T06:58:08.232398+0000","last_fullsized":"2024-03-04T06:58:08.232398+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394833+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:58:23.394833+0000","last_peered":"2024-03-04T06:58:23.394833+0000","last_clean":"2024-03-04T06:58:23.394833+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:58:23.394833+0000","last_undegraded":"2024-03-04T06:58:23.394833+0000","last_fullsized":"2024-03-04T06:58:23.394833+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394877+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:58:23.394877+0000","last_peered":"2024-03-04T06:58:23.394877+0000","last_clean":"2024-03-04T06:58:23.394877+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:58:23.394877+0000","last_undegraded":"2024-03-04T06:58:23.394877+0000","last_fullsized":"2024-03-04T06:58:23.394877+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:56:49.538599+0000","last_peered":"2024-03-04T06:56:49.538599+0000","last_clean":"2024-03-04T06:56:49.538599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:56:49.538599+0000","last_undegraded":"2024-03-04T06:56:49.538599+0000","last_fullsized":"2024-03-04T06:56:49.538599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4367,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392018+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:57:58.392018+0000","last_peered":"2024-03-04T06:57:58.392018+0000","last_clean":"2024-03-04T06:57:58.392018+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:57:58.392018+0000","last_undegraded":"2024-03-04T06:57:58.392018+0000","last_fullsized":"2024-03-04T06:57:58.392018+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.157162+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:57:48.157162+0000","last_peered":"2024-03-04T06:57:48.157162+0000","last_clean":"2024-03-04T06:57:48.157162+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:57:48.157162+0000","last_undegraded":"2024-03-04T06:57:48.157162+0000","last_fullsized":"2024-03-04T06:57:48.157162+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951665+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:57:52.951665+0000","last_peered":"2024-03-04T06:57:52.951665+0000","last_clean":"2024-03-04T06:57:52.951665+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:57:52.951665+0000","last_undegraded":"2024-03-04T06:57:52.951665+0000","last_fullsized":"2024-03-04T06:57:52.951665+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4601,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:44.551323+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:58:44.551323+0000","last_peered":"2024-03-04T06:58:44.551323+0000","last_clean":"2024-03-04T06:58:44.551323+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:58:44.551323+0000","last_undegraded":"2024-03-04T06:58:44.551323+0000","last_fullsized":"2024-03-04T06:58:44.551323+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1246,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394915+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:58:23.394915+0000","last_peered":"2024-03-04T06:58:23.394915+0000","last_clean":"2024-03-04T06:58:23.394915+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:58:23.394915+0000","last_undegraded":"2024-03-04T06:58:23.394915+0000","last_fullsized":"2024-03-04T06:58:23.394915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538627+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:56:49.538627+0000","last_peered":"2024-03-04T06:56:49.538627+0000","last_clean":"2024-03-04T06:56:49.538627+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:56:49.538627+0000","last_undegraded":"2024-03-04T06:56:49.538627+0000","last_fullsized":"2024-03-04T06:56:49.538627+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230189+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:57:48.230189+0000","last_peered":"2024-03-04T06:57:48.230189+0000","last_clean":"2024-03-04T06:57:48.230189+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:57:48.230189+0000","last_undegraded":"2024-03-04T06:57:48.230189+0000","last_fullsized":"2024-03-04T06:57:48.230189+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389246+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:57:33.389246+0000","last_peered":"2024-03-04T06:57:33.389246+0000","last_clean":"2024-03-04T06:57:33.389246+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:57:33.389246+0000","last_undegraded":"2024-03-04T06:57:33.389246+0000","last_fullsized":"2024-03-04T06:57:33.389246+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947082+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:57:12.947082+0000","last_peered":"2024-03-04T06:57:12.947082+0000","last_clean":"2024-03-04T06:57:12.947082+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:57:12.947082+0000","last_undegraded":"2024-03-04T06:57:12.947082+0000","last_fullsized":"2024-03-04T06:57:12.947082+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006538+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:58:28.006538+0000","last_peered":"2024-03-04T06:58:28.006538+0000","last_clean":"2024-03-04T06:58:28.006538+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:58:28.006538+0000","last_undegraded":"2024-03-04T06:58:28.006538+0000","last_fullsized":"2024-03-04T06:58:28.006538+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007105+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:58:35.007105+0000","last_peered":"2024-03-04T06:58:35.007105+0000","last_clean":"2024-03-04T06:58:35.007105+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:58:35.007105+0000","last_undegraded":"2024-03-04T06:58:35.007105+0000","last_fullsized":"2024-03-04T06:58:35.007105+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154682+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:57:23.154682+0000","last_peered":"2024-03-04T06:57:23.154682+0000","last_clean":"2024-03-04T06:57:23.154682+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:57:23.154682+0000","last_undegraded":"2024-03-04T06:57:23.154682+0000","last_fullsized":"2024-03-04T06:57:23.154682+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232435+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:58:08.232435+0000","last_peered":"2024-03-04T06:58:08.232435+0000","last_clean":"2024-03-04T06:58:08.232435+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:58:08.232435+0000","last_undegraded":"2024-03-04T06:58:08.232435+0000","last_fullsized":"2024-03-04T06:58:08.232435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007138+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:58:35.007138+0000","last_peered":"2024-03-04T06:58:35.007138+0000","last_clean":"2024-03-04T06:58:35.007138+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:58:35.007138+0000","last_undegraded":"2024-03-04T06:58:35.007138+0000","last_fullsized":"2024-03-04T06:58:35.007138+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949325+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:57:32.949325+0000","last_peered":"2024-03-04T06:57:32.949325+0000","last_clean":"2024-03-04T06:57:32.949325+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:57:32.949325+0000","last_undegraded":"2024-03-04T06:57:32.949325+0000","last_fullsized":"2024-03-04T06:57:32.949325+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994907+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:56:44.994907+0000","last_peered":"2024-03-04T06:56:44.994907+0000","last_clean":"2024-03-04T06:56:44.994907+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:56:44.994907+0000","last_undegraded":"2024-03-04T06:56:44.994907+0000","last_fullsized":"2024-03-04T06:56:44.994907+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1121,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951615+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:57:52.951615+0000","last_peered":"2024-03-04T06:57:52.951615+0000","last_clean":"2024-03-04T06:57:52.951615+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:57:52.951615+0000","last_undegraded":"2024-03-04T06:57:52.951615+0000","last_fullsized":"2024-03-04T06:57:52.951615+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.998327+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:57:12.998327+0000","last_peered":"2024-03-04T06:57:12.998327+0000","last_clean":"2024-03-04T06:57:12.998327+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:57:12.998327+0000","last_undegraded":"2024-03-04T06:57:12.998327+0000","last_fullsized":"2024-03-04T06:57:12.998327+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.234922+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:58:28.234922+0000","last_peered":"2024-03-04T06:58:28.234922+0000","last_clean":"2024-03-04T06:58:28.234922+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:58:28.234922+0000","last_undegraded":"2024-03-04T06:58:28.234922+0000","last_fullsized":"2024-03-04T06:58:28.234922+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503492,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648139,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142446,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287093,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997799,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937433,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792786,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:01:03.463 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:03.464 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:03.464 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:03.464 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:03.464 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:03.464 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:03.464 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:03.464 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:03.464 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:03.464 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:03.464 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:01:04.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:04 smithi137 ceph-mon[88869]: pgmap v1096: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:04.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:04 smithi137 ceph-mon[88869]: from='client.34659 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:04.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:04 smithi137 ceph-mon[91314]: pgmap v1096: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:04.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:04 smithi137 ceph-mon[91314]: from='client.34659 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:04.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:04 smithi203 ceph-mon[85573]: pgmap v1096: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:04.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:04 smithi203 ceph-mon[85573]: from='client.34659 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:05.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:01:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:01:05] "GET /metrics HTTP/1.1" 200 36337 "" "Prometheus/2.43.0" 2024-03-04T07:01:06.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:06 smithi137 ceph-mon[88869]: pgmap v1097: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:06.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:06 smithi137 ceph-mon[91314]: pgmap v1097: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:06.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:06 smithi203 ceph-mon[85573]: pgmap v1097: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:08.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:08 smithi137 ceph-mon[88869]: pgmap v1098: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:08.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:08 smithi137 ceph-mon[91314]: pgmap v1098: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:08.594 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:08 smithi203 ceph-mon[85573]: pgmap v1098: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:09.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:01:09.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:01:09.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:01:10.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:10 smithi137 ceph-mon[88869]: pgmap v1099: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:10.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:10 smithi137 ceph-mon[91314]: pgmap v1099: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:10.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:10 smithi203 ceph-mon[85573]: pgmap v1099: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:12.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:12 smithi137 ceph-mon[88869]: pgmap v1100: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:12.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:12 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:01:12.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:12 smithi137 ceph-mon[91314]: pgmap v1100: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:12.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:12 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:01:12.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:12 smithi203 ceph-mon[85573]: pgmap v1100: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:12.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:12 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:01:13.465 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:01:13.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:01:13.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:01:13.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:13 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:01:13.496 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:01:13.496 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:01:13.496 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:13 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:01:13.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:01:13.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:01:13.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:13 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:01:13.683 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:01:14.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:14 smithi137 ceph-mon[88869]: pgmap v1101: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:14.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:14 smithi137 ceph-mon[91314]: pgmap v1101: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:14.594 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:14 smithi203 ceph-mon[85573]: pgmap v1101: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:15.507 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:01:15.509 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:01:15.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:01:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:01:15] "GET /metrics HTTP/1.1" 200 36334 "" "Prometheus/2.43.0" 2024-03-04T07:01:16.012 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1102,"stamp":"2024-03-04T07:01:14.571348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003773"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549208+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:58:24.549208+0000","last_peered":"2024-03-04T06:58:24.549208+0000","last_clean":"2024-03-04T06:58:24.549208+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:58:24.549208+0000","last_undegraded":"2024-03-04T06:58:24.549208+0000","last_fullsized":"2024-03-04T06:58:24.549208+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.165005+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:59:03.165005+0000","last_peered":"2024-03-04T06:59:03.165005+0000","last_clean":"2024-03-04T06:59:03.165005+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:59:03.165005+0000","last_undegraded":"2024-03-04T06:59:03.165005+0000","last_fullsized":"2024-03-04T06:59:03.165005+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006644+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:58:28.006644+0000","last_peered":"2024-03-04T06:58:28.006644+0000","last_clean":"2024-03-04T06:58:28.006644+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:58:28.006644+0000","last_undegraded":"2024-03-04T06:58:28.006644+0000","last_fullsized":"2024-03-04T06:58:28.006644+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958856+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:58:52.958856+0000","last_peered":"2024-03-04T06:58:52.958856+0000","last_clean":"2024-03-04T06:58:52.958856+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:58:52.958856+0000","last_undegraded":"2024-03-04T06:58:52.958856+0000","last_fullsized":"2024-03-04T06:58:52.958856+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543619+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:57:34.543619+0000","last_peered":"2024-03-04T06:57:34.543619+0000","last_clean":"2024-03-04T06:57:34.543619+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:57:34.543619+0000","last_undegraded":"2024-03-04T06:57:34.543619+0000","last_fullsized":"2024-03-04T06:57:34.543619+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1116,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941144+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:56:22.941144+0000","last_peered":"2024-03-04T06:56:22.941144+0000","last_clean":"2024-03-04T06:56:22.941144+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:56:22.941144+0000","last_undegraded":"2024-03-04T06:56:22.941144+0000","last_fullsized":"2024-03-04T06:56:22.941144+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543594+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:57:34.543594+0000","last_peered":"2024-03-04T06:57:34.543594+0000","last_clean":"2024-03-04T06:57:34.543594+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:57:34.543594+0000","last_undegraded":"2024-03-04T06:57:34.543594+0000","last_fullsized":"2024-03-04T06:57:34.543594+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001597+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:57:45.001597+0000","last_peered":"2024-03-04T06:57:45.001597+0000","last_clean":"2024-03-04T06:57:45.001597+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:57:45.001597+0000","last_undegraded":"2024-03-04T06:57:45.001597+0000","last_fullsized":"2024-03-04T06:57:45.001597+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1065,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541782+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:57:19.541782+0000","last_peered":"2024-03-04T06:57:19.541782+0000","last_clean":"2024-03-04T06:57:19.541782+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:57:19.541782+0000","last_undegraded":"2024-03-04T06:57:19.541782+0000","last_fullsized":"2024-03-04T06:57:19.541782+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223356+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:56:43.223356+0000","last_peered":"2024-03-04T06:56:43.223356+0000","last_clean":"2024-03-04T06:56:43.223356+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:56:43.223356+0000","last_undegraded":"2024-03-04T06:56:43.223356+0000","last_fullsized":"2024-03-04T06:56:43.223356+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223323+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:56:43.223323+0000","last_peered":"2024-03-04T06:56:43.223323+0000","last_clean":"2024-03-04T06:56:43.223323+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:56:43.223323+0000","last_undegraded":"2024-03-04T06:56:43.223323+0000","last_fullsized":"2024-03-04T06:56:43.223323+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:57.620940+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:57:57.620940+0000","last_peered":"2024-03-04T06:57:57.620940+0000","last_clean":"2024-03-04T06:57:57.620940+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:57:57.620940+0000","last_undegraded":"2024-03-04T06:57:57.620940+0000","last_fullsized":"2024-03-04T06:57:57.620940+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999343+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:57:24.999343+0000","last_peered":"2024-03-04T06:57:24.999343+0000","last_clean":"2024-03-04T06:57:24.999343+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:57:24.999343+0000","last_undegraded":"2024-03-04T06:57:24.999343+0000","last_fullsized":"2024-03-04T06:57:24.999343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001313+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:57:38.001313+0000","last_peered":"2024-03-04T06:57:38.001313+0000","last_clean":"2024-03-04T06:57:38.001313+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:57:38.001313+0000","last_undegraded":"2024-03-04T06:57:38.001313+0000","last_fullsized":"2024-03-04T06:57:38.001313+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:13.159769+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:58:13.159769+0000","last_peered":"2024-03-04T06:58:13.159769+0000","last_clean":"2024-03-04T06:58:13.159769+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:58:13.159769+0000","last_undegraded":"2024-03-04T06:58:13.159769+0000","last_fullsized":"2024-03-04T06:58:13.159769+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953787+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:58:12.953787+0000","last_peered":"2024-03-04T06:58:12.953787+0000","last_clean":"2024-03-04T06:58:12.953787+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:58:12.953787+0000","last_undegraded":"2024-03-04T06:58:12.953787+0000","last_fullsized":"2024-03-04T06:58:12.953787+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953915+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:58:12.953915+0000","last_peered":"2024-03-04T06:58:12.953915+0000","last_clean":"2024-03-04T06:58:12.953915+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:58:12.953915+0000","last_undegraded":"2024-03-04T06:58:12.953915+0000","last_fullsized":"2024-03-04T06:58:12.953915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397463+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:58:48.397463+0000","last_peered":"2024-03-04T06:58:48.397463+0000","last_clean":"2024-03-04T06:58:48.397463+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:58:48.397463+0000","last_undegraded":"2024-03-04T06:58:48.397463+0000","last_fullsized":"2024-03-04T06:58:48.397463+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538587+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:56:49.538587+0000","last_peered":"2024-03-04T06:56:49.538587+0000","last_clean":"2024-03-04T06:56:49.538587+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:56:49.538587+0000","last_undegraded":"2024-03-04T06:56:49.538587+0000","last_fullsized":"2024-03-04T06:56:49.538587+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1306,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006697+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:58:28.006697+0000","last_peered":"2024-03-04T06:58:28.006697+0000","last_clean":"2024-03-04T06:58:28.006697+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:58:28.006697+0000","last_undegraded":"2024-03-04T06:58:28.006697+0000","last_fullsized":"2024-03-04T06:58:28.006697+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001710+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:57:45.001710+0000","last_peered":"2024-03-04T06:57:45.001710+0000","last_clean":"2024-03-04T06:57:45.001710+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:57:45.001710+0000","last_undegraded":"2024-03-04T06:57:45.001710+0000","last_fullsized":"2024-03-04T06:57:45.001710+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001722+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:57:45.001722+0000","last_peered":"2024-03-04T06:57:45.001722+0000","last_clean":"2024-03-04T06:57:45.001722+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:57:45.001722+0000","last_undegraded":"2024-03-04T06:57:45.001722+0000","last_fullsized":"2024-03-04T06:57:45.001722+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006681+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:58:28.006681+0000","last_peered":"2024-03-04T06:58:28.006681+0000","last_clean":"2024-03-04T06:58:28.006681+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:58:28.006681+0000","last_undegraded":"2024-03-04T06:58:28.006681+0000","last_fullsized":"2024-03-04T06:58:28.006681+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1235,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386420+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:57:08.386420+0000","last_peered":"2024-03-04T06:57:08.386420+0000","last_clean":"2024-03-04T06:57:08.386420+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:57:08.386420+0000","last_undegraded":"2024-03-04T06:57:08.386420+0000","last_fullsized":"2024-03-04T06:57:08.386420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1222,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386390+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:57:08.386390+0000","last_peered":"2024-03-04T06:57:08.386390+0000","last_clean":"2024-03-04T06:57:08.386390+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:57:08.386390+0000","last_undegraded":"2024-03-04T06:57:08.386390+0000","last_fullsized":"2024-03-04T06:57:08.386390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543632+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:57:34.543632+0000","last_peered":"2024-03-04T06:57:34.543632+0000","last_clean":"2024-03-04T06:57:34.543632+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:57:34.543632+0000","last_undegraded":"2024-03-04T06:57:34.543632+0000","last_fullsized":"2024-03-04T06:57:34.543632+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1126,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:22.941175+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:56:22.941175+0000","last_peered":"2024-03-04T06:56:22.941175+0000","last_clean":"2024-03-04T06:56:22.941175+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:56:22.941175+0000","last_undegraded":"2024-03-04T06:56:22.941175+0000","last_fullsized":"2024-03-04T06:56:22.941175+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001694+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:57:45.001694+0000","last_peered":"2024-03-04T06:57:45.001694+0000","last_clean":"2024-03-04T06:57:45.001694+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:57:45.001694+0000","last_undegraded":"2024-03-04T06:57:45.001694+0000","last_fullsized":"2024-03-04T06:57:45.001694+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1190,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:17.623076+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:58:17.623076+0000","last_peered":"2024-03-04T06:58:17.623076+0000","last_clean":"2024-03-04T06:58:17.623076+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:58:17.623076+0000","last_undegraded":"2024-03-04T06:58:17.623076+0000","last_fullsized":"2024-03-04T06:58:17.623076+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.224901+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:56:58.224901+0000","last_peered":"2024-03-04T06:56:58.224901+0000","last_clean":"2024-03-04T06:56:58.224901+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:56:58.224901+0000","last_undegraded":"2024-03-04T06:56:58.224901+0000","last_fullsized":"2024-03-04T06:56:58.224901+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006622+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:58:28.006622+0000","last_peered":"2024-03-04T06:58:28.006622+0000","last_clean":"2024-03-04T06:58:28.006622+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:58:28.006622+0000","last_undegraded":"2024-03-04T06:58:28.006622+0000","last_fullsized":"2024-03-04T06:58:28.006622+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999328+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:57:24.999328+0000","last_peered":"2024-03-04T06:57:24.999328+0000","last_clean":"2024-03-04T06:57:24.999328+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:57:24.999328+0000","last_undegraded":"2024-03-04T06:57:24.999328+0000","last_fullsized":"2024-03-04T06:57:24.999328+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999296+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:57:24.999296+0000","last_peered":"2024-03-04T06:57:24.999296+0000","last_clean":"2024-03-04T06:57:24.999296+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:57:24.999296+0000","last_undegraded":"2024-03-04T06:57:24.999296+0000","last_fullsized":"2024-03-04T06:57:24.999296+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956356+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:58:32.956356+0000","last_peered":"2024-03-04T06:58:32.956356+0000","last_clean":"2024-03-04T06:58:32.956356+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:58:32.956356+0000","last_undegraded":"2024-03-04T06:58:32.956356+0000","last_fullsized":"2024-03-04T06:58:32.956356+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162696+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:58:38.162696+0000","last_peered":"2024-03-04T06:58:38.162696+0000","last_clean":"2024-03-04T06:58:38.162696+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:58:38.162696+0000","last_undegraded":"2024-03-04T06:58:38.162696+0000","last_fullsized":"2024-03-04T06:58:38.162696+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223376+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:56:43.223376+0000","last_peered":"2024-03-04T06:56:43.223376+0000","last_clean":"2024-03-04T06:56:43.223376+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:56:43.223376+0000","last_undegraded":"2024-03-04T06:56:43.223376+0000","last_fullsized":"2024-03-04T06:56:43.223376+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956414+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:58:32.956414+0000","last_peered":"2024-03-04T06:58:32.956414+0000","last_clean":"2024-03-04T06:58:32.956414+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:58:32.956414+0000","last_undegraded":"2024-03-04T06:58:32.956414+0000","last_fullsized":"2024-03-04T06:58:32.956414+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956402+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:58:32.956402+0000","last_peered":"2024-03-04T06:58:32.956402+0000","last_clean":"2024-03-04T06:58:32.956402+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:58:32.956402+0000","last_undegraded":"2024-03-04T06:58:32.956402+0000","last_fullsized":"2024-03-04T06:58:32.956402+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:03.003999+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:58:03.003999+0000","last_peered":"2024-03-04T06:58:03.003999+0000","last_clean":"2024-03-04T06:58:03.003999+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:58:03.003999+0000","last_undegraded":"2024-03-04T06:58:03.003999+0000","last_fullsized":"2024-03-04T06:58:03.003999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162740+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:58:38.162740+0000","last_peered":"2024-03-04T06:58:38.162740+0000","last_clean":"2024-03-04T06:58:38.162740+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:58:38.162740+0000","last_undegraded":"2024-03-04T06:58:38.162740+0000","last_fullsized":"2024-03-04T06:58:38.162740+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:37.618704+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:57:37.618704+0000","last_peered":"2024-03-04T06:57:37.618704+0000","last_clean":"2024-03-04T06:57:37.618704+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:57:37.618704+0000","last_undegraded":"2024-03-04T06:57:37.618704+0000","last_fullsized":"2024-03-04T06:57:37.618704+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1131,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237167+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:58:48.237167+0000","last_peered":"2024-03-04T06:58:48.237167+0000","last_clean":"2024-03-04T06:58:48.237167+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:58:48.237167+0000","last_undegraded":"2024-03-04T06:58:48.237167+0000","last_fullsized":"2024-03-04T06:58:48.237167+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541754+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:57:19.541754+0000","last_peered":"2024-03-04T06:57:19.541754+0000","last_clean":"2024-03-04T06:57:19.541754+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:57:19.541754+0000","last_undegraded":"2024-03-04T06:57:19.541754+0000","last_fullsized":"2024-03-04T06:57:19.541754+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001343+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:57:38.001343+0000","last_peered":"2024-03-04T06:57:38.001343+0000","last_clean":"2024-03-04T06:57:38.001343+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:57:38.001343+0000","last_undegraded":"2024-03-04T06:57:38.001343+0000","last_fullsized":"2024-03-04T06:57:38.001343+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397438+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:58:48.397438+0000","last_peered":"2024-03-04T06:58:48.397438+0000","last_clean":"2024-03-04T06:58:48.397438+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:58:48.397438+0000","last_undegraded":"2024-03-04T06:58:48.397438+0000","last_fullsized":"2024-03-04T06:58:48.397438+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953851+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:58:12.953851+0000","last_peered":"2024-03-04T06:58:12.953851+0000","last_clean":"2024-03-04T06:58:12.953851+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:58:12.953851+0000","last_undegraded":"2024-03-04T06:58:12.953851+0000","last_fullsized":"2024-03-04T06:58:12.953851+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540167+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:57:04.540167+0000","last_peered":"2024-03-04T06:57:04.540167+0000","last_clean":"2024-03-04T06:57:04.540167+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:57:04.540167+0000","last_undegraded":"2024-03-04T06:57:04.540167+0000","last_fullsized":"2024-03-04T06:57:04.540167+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237147+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:58:48.237147+0000","last_peered":"2024-03-04T06:58:48.237147+0000","last_clean":"2024-03-04T06:58:48.237147+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:58:48.237147+0000","last_undegraded":"2024-03-04T06:58:48.237147+0000","last_fullsized":"2024-03-04T06:58:48.237147+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237122+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:58:48.237122+0000","last_peered":"2024-03-04T06:58:48.237122+0000","last_clean":"2024-03-04T06:58:48.237122+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:58:48.237122+0000","last_undegraded":"2024-03-04T06:58:48.237122+0000","last_fullsized":"2024-03-04T06:58:48.237122+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397404+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:58:48.397404+0000","last_peered":"2024-03-04T06:58:48.397404+0000","last_clean":"2024-03-04T06:58:48.397404+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:58:48.397404+0000","last_undegraded":"2024-03-04T06:58:48.397404+0000","last_fullsized":"2024-03-04T06:58:48.397404+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540129+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:57:04.540129+0000","last_peered":"2024-03-04T06:57:04.540129+0000","last_clean":"2024-03-04T06:57:04.540129+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:57:04.540129+0000","last_undegraded":"2024-03-04T06:57:04.540129+0000","last_fullsized":"2024-03-04T06:57:04.540129+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3578,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.391939+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:57:58.391939+0000","last_peered":"2024-03-04T06:57:58.391939+0000","last_clean":"2024-03-04T06:57:58.391939+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:57:58.391939+0000","last_undegraded":"2024-03-04T06:57:58.391939+0000","last_fullsized":"2024-03-04T06:57:58.391939+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:17.616250+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:57:17.616250+0000","last_peered":"2024-03-04T06:57:17.616250+0000","last_clean":"2024-03-04T06:57:17.616250+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:57:17.616250+0000","last_undegraded":"2024-03-04T06:57:17.616250+0000","last_fullsized":"2024-03-04T06:57:17.616250+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:56:49.538613+0000","last_peered":"2024-03-04T06:56:49.538613+0000","last_clean":"2024-03-04T06:56:49.538613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:56:49.538613+0000","last_undegraded":"2024-03-04T06:56:49.538613+0000","last_fullsized":"2024-03-04T06:56:49.538613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17117,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006566+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:58:28.006566+0000","last_peered":"2024-03-04T06:58:28.006566+0000","last_clean":"2024-03-04T06:58:28.006566+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:58:28.006566+0000","last_undegraded":"2024-03-04T06:58:28.006566+0000","last_fullsized":"2024-03-04T06:58:28.006566+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164900+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:59:03.164900+0000","last_peered":"2024-03-04T06:59:03.164900+0000","last_clean":"2024-03-04T06:59:03.164900+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:59:03.164900+0000","last_undegraded":"2024-03-04T06:59:03.164900+0000","last_fullsized":"2024-03-04T06:59:03.164900+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164981+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:59:03.164981+0000","last_peered":"2024-03-04T06:59:03.164981+0000","last_clean":"2024-03-04T06:59:03.164981+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:59:03.164981+0000","last_undegraded":"2024-03-04T06:59:03.164981+0000","last_fullsized":"2024-03-04T06:59:03.164981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947110+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:57:12.947110+0000","last_peered":"2024-03-04T06:57:12.947110+0000","last_clean":"2024-03-04T06:57:12.947110+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:57:12.947110+0000","last_undegraded":"2024-03-04T06:57:12.947110+0000","last_fullsized":"2024-03-04T06:57:12.947110+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4387,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006651+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:58:28.006651+0000","last_peered":"2024-03-04T06:58:28.006651+0000","last_clean":"2024-03-04T06:58:28.006651+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:58:28.006651+0000","last_undegraded":"2024-03-04T06:58:28.006651+0000","last_fullsized":"2024-03-04T06:58:28.006651+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164925+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:59:03.164925+0000","last_peered":"2024-03-04T06:59:03.164925+0000","last_clean":"2024-03-04T06:59:03.164925+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:59:03.164925+0000","last_undegraded":"2024-03-04T06:59:03.164925+0000","last_fullsized":"2024-03-04T06:59:03.164925+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947055+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:57:12.947055+0000","last_peered":"2024-03-04T06:57:12.947055+0000","last_clean":"2024-03-04T06:57:12.947055+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:57:12.947055+0000","last_undegraded":"2024-03-04T06:57:12.947055+0000","last_fullsized":"2024-03-04T06:57:12.947055+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625641+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:58:42.625641+0000","last_peered":"2024-03-04T06:58:42.625641+0000","last_clean":"2024-03-04T06:58:42.625641+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:58:42.625641+0000","last_undegraded":"2024-03-04T06:58:42.625641+0000","last_fullsized":"2024-03-04T06:58:42.625641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5640,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392060+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:57:58.392060+0000","last_peered":"2024-03-04T06:57:58.392060+0000","last_clean":"2024-03-04T06:57:58.392060+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:57:58.392060+0000","last_undegraded":"2024-03-04T06:57:58.392060+0000","last_fullsized":"2024-03-04T06:57:58.392060+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1256,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154711+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:57:23.154711+0000","last_peered":"2024-03-04T06:57:23.154711+0000","last_clean":"2024-03-04T06:57:23.154711+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:57:23.154711+0000","last_undegraded":"2024-03-04T06:57:23.154711+0000","last_fullsized":"2024-03-04T06:57:23.154711+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:33.162083+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:58:33.162083+0000","last_peered":"2024-03-04T06:58:33.162083+0000","last_clean":"2024-03-04T06:58:33.162083+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:58:33.162083+0000","last_undegraded":"2024-03-04T06:58:33.162083+0000","last_fullsized":"2024-03-04T06:58:33.162083+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389235+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:57:33.389235+0000","last_peered":"2024-03-04T06:57:33.389235+0000","last_clean":"2024-03-04T06:57:33.389235+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:57:33.389235+0000","last_undegraded":"2024-03-04T06:57:33.389235+0000","last_fullsized":"2024-03-04T06:57:33.389235+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4016,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:24.549121+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:58:24.549121+0000","last_peered":"2024-03-04T06:58:24.549121+0000","last_clean":"2024-03-04T06:58:24.549121+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:58:24.549121+0000","last_undegraded":"2024-03-04T06:58:24.549121+0000","last_fullsized":"2024-03-04T06:58:24.549121+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230253+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:57:48.230253+0000","last_peered":"2024-03-04T06:57:48.230253+0000","last_clean":"2024-03-04T06:57:48.230253+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:57:48.230253+0000","last_undegraded":"2024-03-04T06:57:48.230253+0000","last_fullsized":"2024-03-04T06:57:48.230253+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:10.004451+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:58:10.004451+0000","last_peered":"2024-03-04T06:58:10.004451+0000","last_clean":"2024-03-04T06:58:10.004451+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:58:10.004451+0000","last_undegraded":"2024-03-04T06:58:10.004451+0000","last_fullsized":"2024-03-04T06:58:10.004451+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947097+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:57:12.947097+0000","last_peered":"2024-03-04T06:57:12.947097+0000","last_clean":"2024-03-04T06:57:12.947097+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:57:12.947097+0000","last_undegraded":"2024-03-04T06:57:12.947097+0000","last_fullsized":"2024-03-04T06:57:12.947097+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1551,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547030+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:58:04.547030+0000","last_peered":"2024-03-04T06:58:04.547030+0000","last_clean":"2024-03-04T06:58:04.547030+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:58:04.547030+0000","last_undegraded":"2024-03-04T06:58:04.547030+0000","last_fullsized":"2024-03-04T06:58:04.547030+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3951,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949380+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:57:32.949380+0000","last_peered":"2024-03-04T06:57:32.949380+0000","last_clean":"2024-03-04T06:57:32.949380+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:57:32.949380+0000","last_undegraded":"2024-03-04T06:57:32.949380+0000","last_fullsized":"2024-03-04T06:57:32.949380+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009504+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:58:58.009504+0000","last_peered":"2024-03-04T06:58:58.009504+0000","last_clean":"2024-03-04T06:58:58.009504+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:58:58.009504+0000","last_undegraded":"2024-03-04T06:58:58.009504+0000","last_fullsized":"2024-03-04T06:58:58.009504+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389207+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:57:33.389207+0000","last_peered":"2024-03-04T06:57:33.389207+0000","last_clean":"2024-03-04T06:57:33.389207+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:57:33.389207+0000","last_undegraded":"2024-03-04T06:57:33.389207+0000","last_fullsized":"2024-03-04T06:57:33.389207+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547005+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:58:04.547005+0000","last_peered":"2024-03-04T06:58:04.547005+0000","last_clean":"2024-03-04T06:58:04.547005+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:58:04.547005+0000","last_undegraded":"2024-03-04T06:58:04.547005+0000","last_fullsized":"2024-03-04T06:58:04.547005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15292,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.230222+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:57:48.230222+0000","last_peered":"2024-03-04T06:57:48.230222+0000","last_clean":"2024-03-04T06:57:48.230222+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:57:48.230222+0000","last_undegraded":"2024-03-04T06:57:48.230222+0000","last_fullsized":"2024-03-04T06:57:48.230222+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006608+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:58:28.006608+0000","last_peered":"2024-03-04T06:58:28.006608+0000","last_clean":"2024-03-04T06:58:28.006608+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:58:28.006608+0000","last_undegraded":"2024-03-04T06:58:28.006608+0000","last_fullsized":"2024-03-04T06:58:28.006608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549190+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:58:24.549190+0000","last_peered":"2024-03-04T06:58:24.549190+0000","last_clean":"2024-03-04T06:58:24.549190+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:58:24.549190+0000","last_undegraded":"2024-03-04T06:58:24.549190+0000","last_fullsized":"2024-03-04T06:58:24.549190+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164943+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:59:03.164943+0000","last_peered":"2024-03-04T06:59:03.164943+0000","last_clean":"2024-03-04T06:59:03.164943+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:59:03.164943+0000","last_undegraded":"2024-03-04T06:59:03.164943+0000","last_fullsized":"2024-03-04T06:59:03.164943+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4380,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:42.625602+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:58:42.625602+0000","last_peered":"2024-03-04T06:58:42.625602+0000","last_clean":"2024-03-04T06:58:42.625602+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:58:42.625602+0000","last_undegraded":"2024-03-04T06:58:42.625602+0000","last_fullsized":"2024-03-04T06:58:42.625602+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001670+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:57:45.001670+0000","last_peered":"2024-03-04T06:57:45.001670+0000","last_clean":"2024-03-04T06:57:45.001670+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:57:45.001670+0000","last_undegraded":"2024-03-04T06:57:45.001670+0000","last_fullsized":"2024-03-04T06:57:45.001670+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1269,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154698+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:57:23.154698+0000","last_peered":"2024-03-04T06:57:23.154698+0000","last_clean":"2024-03-04T06:57:23.154698+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:57:23.154698+0000","last_undegraded":"2024-03-04T06:57:23.154698+0000","last_fullsized":"2024-03-04T06:57:23.154698+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007125+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:58:35.007125+0000","last_peered":"2024-03-04T06:58:35.007125+0000","last_clean":"2024-03-04T06:58:35.007125+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:58:35.007125+0000","last_undegraded":"2024-03-04T06:58:35.007125+0000","last_fullsized":"2024-03-04T06:58:35.007125+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4610,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:45.001644+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:57:45.001644+0000","last_peered":"2024-03-04T06:57:45.001644+0000","last_clean":"2024-03-04T06:57:45.001644+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:57:45.001644+0000","last_undegraded":"2024-03-04T06:57:45.001644+0000","last_fullsized":"2024-03-04T06:57:45.001644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625572+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:58:42.625572+0000","last_peered":"2024-03-04T06:58:42.625572+0000","last_clean":"2024-03-04T06:58:42.625572+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:58:42.625572+0000","last_undegraded":"2024-03-04T06:58:42.625572+0000","last_fullsized":"2024-03-04T06:58:42.625572+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1079,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232447+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:58:08.232447+0000","last_peered":"2024-03-04T06:58:08.232447+0000","last_clean":"2024-03-04T06:58:08.232447+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:58:08.232447+0000","last_undegraded":"2024-03-04T06:58:08.232447+0000","last_fullsized":"2024-03-04T06:58:08.232447+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009478+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:58:58.009478+0000","last_peered":"2024-03-04T06:58:58.009478+0000","last_clean":"2024-03-04T06:58:58.009478+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:58:58.009478+0000","last_undegraded":"2024-03-04T06:58:58.009478+0000","last_fullsized":"2024-03-04T06:58:58.009478+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4635,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:52.951690+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:57:52.951690+0000","last_peered":"2024-03-04T06:57:52.951690+0000","last_clean":"2024-03-04T06:57:52.951690+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:57:52.951690+0000","last_undegraded":"2024-03-04T06:57:52.951690+0000","last_fullsized":"2024-03-04T06:57:52.951690+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:44.551296+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:58:44.551296+0000","last_peered":"2024-03-04T06:58:44.551296+0000","last_clean":"2024-03-04T06:58:44.551296+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:58:44.551296+0000","last_undegraded":"2024-03-04T06:58:44.551296+0000","last_fullsized":"2024-03-04T06:58:44.551296+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1185,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:57.614016+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:56:57.614016+0000","last_peered":"2024-03-04T06:56:57.614016+0000","last_clean":"2024-03-04T06:56:57.614016+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:56:57.614016+0000","last_undegraded":"2024-03-04T06:56:57.614016+0000","last_fullsized":"2024-03-04T06:56:57.614016+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5158,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:17.616210+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:57:17.616210+0000","last_peered":"2024-03-04T06:57:17.616210+0000","last_clean":"2024-03-04T06:57:17.616210+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:57:17.616210+0000","last_undegraded":"2024-03-04T06:57:17.616210+0000","last_fullsized":"2024-03-04T06:57:17.616210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154620+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:57:23.154620+0000","last_peered":"2024-03-04T06:57:23.154620+0000","last_clean":"2024-03-04T06:57:23.154620+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:57:23.154620+0000","last_undegraded":"2024-03-04T06:57:23.154620+0000","last_fullsized":"2024-03-04T06:57:23.154620+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007066+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:58:35.007066+0000","last_peered":"2024-03-04T06:58:35.007066+0000","last_clean":"2024-03-04T06:58:35.007066+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:58:35.007066+0000","last_undegraded":"2024-03-04T06:58:35.007066+0000","last_fullsized":"2024-03-04T06:58:35.007066+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4720,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394889+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:58:23.394889+0000","last_peered":"2024-03-04T06:58:23.394889+0000","last_clean":"2024-03-04T06:58:23.394889+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:58:23.394889+0000","last_undegraded":"2024-03-04T06:58:23.394889+0000","last_fullsized":"2024-03-04T06:58:23.394889+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154658+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:57:23.154658+0000","last_peered":"2024-03-04T06:57:23.154658+0000","last_clean":"2024-03-04T06:57:23.154658+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:57:23.154658+0000","last_undegraded":"2024-03-04T06:57:23.154658+0000","last_fullsized":"2024-03-04T06:57:23.154658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994937+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:56:44.994937+0000","last_peered":"2024-03-04T06:56:44.994937+0000","last_clean":"2024-03-04T06:56:44.994937+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:56:44.994937+0000","last_undegraded":"2024-03-04T06:56:44.994937+0000","last_fullsized":"2024-03-04T06:56:44.994937+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5555,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.157094+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:57:48.157094+0000","last_peered":"2024-03-04T06:57:48.157094+0000","last_clean":"2024-03-04T06:57:48.157094+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:57:48.157094+0000","last_undegraded":"2024-03-04T06:57:48.157094+0000","last_fullsized":"2024-03-04T06:57:48.157094+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:56:49.538554+0000","last_peered":"2024-03-04T06:56:49.538554+0000","last_clean":"2024-03-04T06:56:49.538554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:56:49.538554+0000","last_undegraded":"2024-03-04T06:56:49.538554+0000","last_fullsized":"2024-03-04T06:56:49.538554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232398+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:58:08.232398+0000","last_peered":"2024-03-04T06:58:08.232398+0000","last_clean":"2024-03-04T06:58:08.232398+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:58:08.232398+0000","last_undegraded":"2024-03-04T06:58:08.232398+0000","last_fullsized":"2024-03-04T06:58:08.232398+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394833+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:58:23.394833+0000","last_peered":"2024-03-04T06:58:23.394833+0000","last_clean":"2024-03-04T06:58:23.394833+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:58:23.394833+0000","last_undegraded":"2024-03-04T06:58:23.394833+0000","last_fullsized":"2024-03-04T06:58:23.394833+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394877+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:58:23.394877+0000","last_peered":"2024-03-04T06:58:23.394877+0000","last_clean":"2024-03-04T06:58:23.394877+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:58:23.394877+0000","last_undegraded":"2024-03-04T06:58:23.394877+0000","last_fullsized":"2024-03-04T06:58:23.394877+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:56:49.538599+0000","last_peered":"2024-03-04T06:56:49.538599+0000","last_clean":"2024-03-04T06:56:49.538599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:56:49.538599+0000","last_undegraded":"2024-03-04T06:56:49.538599+0000","last_fullsized":"2024-03-04T06:56:49.538599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4367,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392018+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:57:58.392018+0000","last_peered":"2024-03-04T06:57:58.392018+0000","last_clean":"2024-03-04T06:57:58.392018+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:57:58.392018+0000","last_undegraded":"2024-03-04T06:57:58.392018+0000","last_fullsized":"2024-03-04T06:57:58.392018+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.157162+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:57:48.157162+0000","last_peered":"2024-03-04T06:57:48.157162+0000","last_clean":"2024-03-04T06:57:48.157162+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:57:48.157162+0000","last_undegraded":"2024-03-04T06:57:48.157162+0000","last_fullsized":"2024-03-04T06:57:48.157162+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951665+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:57:52.951665+0000","last_peered":"2024-03-04T06:57:52.951665+0000","last_clean":"2024-03-04T06:57:52.951665+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:57:52.951665+0000","last_undegraded":"2024-03-04T06:57:52.951665+0000","last_fullsized":"2024-03-04T06:57:52.951665+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4601,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:44.551323+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:58:44.551323+0000","last_peered":"2024-03-04T06:58:44.551323+0000","last_clean":"2024-03-04T06:58:44.551323+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:58:44.551323+0000","last_undegraded":"2024-03-04T06:58:44.551323+0000","last_fullsized":"2024-03-04T06:58:44.551323+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1246,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394915+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:58:23.394915+0000","last_peered":"2024-03-04T06:58:23.394915+0000","last_clean":"2024-03-04T06:58:23.394915+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:58:23.394915+0000","last_undegraded":"2024-03-04T06:58:23.394915+0000","last_fullsized":"2024-03-04T06:58:23.394915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:49.538627+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:56:49.538627+0000","last_peered":"2024-03-04T06:56:49.538627+0000","last_clean":"2024-03-04T06:56:49.538627+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:56:49.538627+0000","last_undegraded":"2024-03-04T06:56:49.538627+0000","last_fullsized":"2024-03-04T06:56:49.538627+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230189+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:57:48.230189+0000","last_peered":"2024-03-04T06:57:48.230189+0000","last_clean":"2024-03-04T06:57:48.230189+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:57:48.230189+0000","last_undegraded":"2024-03-04T06:57:48.230189+0000","last_fullsized":"2024-03-04T06:57:48.230189+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389246+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:57:33.389246+0000","last_peered":"2024-03-04T06:57:33.389246+0000","last_clean":"2024-03-04T06:57:33.389246+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:57:33.389246+0000","last_undegraded":"2024-03-04T06:57:33.389246+0000","last_fullsized":"2024-03-04T06:57:33.389246+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.947082+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:57:12.947082+0000","last_peered":"2024-03-04T06:57:12.947082+0000","last_clean":"2024-03-04T06:57:12.947082+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:57:12.947082+0000","last_undegraded":"2024-03-04T06:57:12.947082+0000","last_fullsized":"2024-03-04T06:57:12.947082+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006538+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:58:28.006538+0000","last_peered":"2024-03-04T06:58:28.006538+0000","last_clean":"2024-03-04T06:58:28.006538+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:58:28.006538+0000","last_undegraded":"2024-03-04T06:58:28.006538+0000","last_fullsized":"2024-03-04T06:58:28.006538+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007105+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:58:35.007105+0000","last_peered":"2024-03-04T06:58:35.007105+0000","last_clean":"2024-03-04T06:58:35.007105+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:58:35.007105+0000","last_undegraded":"2024-03-04T06:58:35.007105+0000","last_fullsized":"2024-03-04T06:58:35.007105+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154682+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:57:23.154682+0000","last_peered":"2024-03-04T06:57:23.154682+0000","last_clean":"2024-03-04T06:57:23.154682+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:57:23.154682+0000","last_undegraded":"2024-03-04T06:57:23.154682+0000","last_fullsized":"2024-03-04T06:57:23.154682+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232435+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:58:08.232435+0000","last_peered":"2024-03-04T06:58:08.232435+0000","last_clean":"2024-03-04T06:58:08.232435+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:58:08.232435+0000","last_undegraded":"2024-03-04T06:58:08.232435+0000","last_fullsized":"2024-03-04T06:58:08.232435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007138+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:58:35.007138+0000","last_peered":"2024-03-04T06:58:35.007138+0000","last_clean":"2024-03-04T06:58:35.007138+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:58:35.007138+0000","last_undegraded":"2024-03-04T06:58:35.007138+0000","last_fullsized":"2024-03-04T06:58:35.007138+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949325+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:57:32.949325+0000","last_peered":"2024-03-04T06:57:32.949325+0000","last_clean":"2024-03-04T06:57:32.949325+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:57:32.949325+0000","last_undegraded":"2024-03-04T06:57:32.949325+0000","last_fullsized":"2024-03-04T06:57:32.949325+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:44.994907+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:56:44.994907+0000","last_peered":"2024-03-04T06:56:44.994907+0000","last_clean":"2024-03-04T06:56:44.994907+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:56:44.994907+0000","last_undegraded":"2024-03-04T06:56:44.994907+0000","last_fullsized":"2024-03-04T06:56:44.994907+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1121,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951615+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:57:52.951615+0000","last_peered":"2024-03-04T06:57:52.951615+0000","last_clean":"2024-03-04T06:57:52.951615+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:57:52.951615+0000","last_undegraded":"2024-03-04T06:57:52.951615+0000","last_fullsized":"2024-03-04T06:57:52.951615+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.998327+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:57:12.998327+0000","last_peered":"2024-03-04T06:57:12.998327+0000","last_clean":"2024-03-04T06:57:12.998327+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:57:12.998327+0000","last_undegraded":"2024-03-04T06:57:12.998327+0000","last_fullsized":"2024-03-04T06:57:12.998327+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.234922+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:58:28.234922+0000","last_peered":"2024-03-04T06:58:28.234922+0000","last_clean":"2024-03-04T06:58:28.234922+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:58:28.234922+0000","last_undegraded":"2024-03-04T06:58:28.234922+0000","last_fullsized":"2024-03-04T06:58:28.234922+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503495,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648142,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287096,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997802,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937436,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792789,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:01:16.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:16.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:16.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:16.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:16.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:16.017 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:16.018 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:16.018 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:16.018 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:16.018 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:16.018 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:01:16.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:16 smithi137 ceph-mon[88869]: pgmap v1102: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:16.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:16 smithi137 ceph-mon[88869]: from='client.44606 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:16.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:16 smithi137 ceph-mon[91314]: pgmap v1102: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:16.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:16 smithi137 ceph-mon[91314]: from='client.44606 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:16.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:16 smithi203 ceph-mon[85573]: pgmap v1102: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:16.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:16 smithi203 ceph-mon[85573]: from='client.44606 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:18.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:18 smithi137 ceph-mon[88869]: pgmap v1103: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:18.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:18 smithi137 ceph-mon[91314]: pgmap v1103: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:18.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:18 smithi203 ceph-mon[85573]: pgmap v1103: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:20.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:20 smithi137 ceph-mon[88869]: pgmap v1104: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:20.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:20 smithi137 ceph-mon[91314]: pgmap v1104: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:20.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:20 smithi203 ceph-mon[85573]: pgmap v1104: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:22.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:22 smithi137 ceph-mon[88869]: pgmap v1105: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:22.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:22 smithi137 ceph-mon[91314]: pgmap v1105: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:22.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:22 smithi203 ceph-mon[85573]: pgmap v1105: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:24.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:24 smithi137 ceph-mon[88869]: pgmap v1106: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:24.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:01:24.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:24 smithi137 ceph-mon[91314]: pgmap v1106: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:24.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:01:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:24 smithi203 ceph-mon[85573]: pgmap v1106: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:01:25.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:01:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:01:25] "GET /metrics HTTP/1.1" 200 36338 "" "Prometheus/2.43.0" 2024-03-04T07:01:26.019 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:01:26.240 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:01:26.363 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:26 smithi137 ceph-mon[88869]: pgmap v1107: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:26.363 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:26 smithi137 ceph-mon[91314]: pgmap v1107: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:26.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:26 smithi203 ceph-mon[85573]: pgmap v1107: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:28.087 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:01:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:01:28.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:28 smithi137 ceph-mon[88869]: pgmap v1108: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:28.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:28 smithi137 ceph-mon[91314]: pgmap v1108: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:28.594 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:28 smithi203 ceph-mon[85573]: pgmap v1108: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:28.701 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1108,"stamp":"2024-03-04T07:01:26.575131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003782"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549208+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:58:24.549208+0000","last_peered":"2024-03-04T06:58:24.549208+0000","last_clean":"2024-03-04T06:58:24.549208+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:58:24.549208+0000","last_undegraded":"2024-03-04T06:58:24.549208+0000","last_fullsized":"2024-03-04T06:58:24.549208+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.165005+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:59:03.165005+0000","last_peered":"2024-03-04T06:59:03.165005+0000","last_clean":"2024-03-04T06:59:03.165005+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:59:03.165005+0000","last_undegraded":"2024-03-04T06:59:03.165005+0000","last_fullsized":"2024-03-04T06:59:03.165005+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006644+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:58:28.006644+0000","last_peered":"2024-03-04T06:58:28.006644+0000","last_clean":"2024-03-04T06:58:28.006644+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:58:28.006644+0000","last_undegraded":"2024-03-04T06:58:28.006644+0000","last_fullsized":"2024-03-04T06:58:28.006644+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958856+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:58:52.958856+0000","last_peered":"2024-03-04T06:58:52.958856+0000","last_clean":"2024-03-04T06:58:52.958856+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:58:52.958856+0000","last_undegraded":"2024-03-04T06:58:52.958856+0000","last_fullsized":"2024-03-04T06:58:52.958856+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543619+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:57:34.543619+0000","last_peered":"2024-03-04T06:57:34.543619+0000","last_clean":"2024-03-04T06:57:34.543619+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:57:34.543619+0000","last_undegraded":"2024-03-04T06:57:34.543619+0000","last_fullsized":"2024-03-04T06:57:34.543619+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958813+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:58:52.958813+0000","last_peered":"2024-03-04T06:58:52.958813+0000","last_clean":"2024-03-04T06:58:52.958813+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:58:52.958813+0000","last_undegraded":"2024-03-04T06:58:52.958813+0000","last_fullsized":"2024-03-04T06:58:52.958813+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543594+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:57:34.543594+0000","last_peered":"2024-03-04T06:57:34.543594+0000","last_clean":"2024-03-04T06:57:34.543594+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:57:34.543594+0000","last_undegraded":"2024-03-04T06:57:34.543594+0000","last_fullsized":"2024-03-04T06:57:34.543594+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001597+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:57:45.001597+0000","last_peered":"2024-03-04T06:57:45.001597+0000","last_clean":"2024-03-04T06:57:45.001597+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:57:45.001597+0000","last_undegraded":"2024-03-04T06:57:45.001597+0000","last_fullsized":"2024-03-04T06:57:45.001597+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1065,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541782+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:57:19.541782+0000","last_peered":"2024-03-04T06:57:19.541782+0000","last_clean":"2024-03-04T06:57:19.541782+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:57:19.541782+0000","last_undegraded":"2024-03-04T06:57:19.541782+0000","last_fullsized":"2024-03-04T06:57:19.541782+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223356+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:56:43.223356+0000","last_peered":"2024-03-04T06:56:43.223356+0000","last_clean":"2024-03-04T06:56:43.223356+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:56:43.223356+0000","last_undegraded":"2024-03-04T06:56:43.223356+0000","last_fullsized":"2024-03-04T06:56:43.223356+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223323+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:56:43.223323+0000","last_peered":"2024-03-04T06:56:43.223323+0000","last_clean":"2024-03-04T06:56:43.223323+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:56:43.223323+0000","last_undegraded":"2024-03-04T06:56:43.223323+0000","last_fullsized":"2024-03-04T06:56:43.223323+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:57.620940+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:57:57.620940+0000","last_peered":"2024-03-04T06:57:57.620940+0000","last_clean":"2024-03-04T06:57:57.620940+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:57:57.620940+0000","last_undegraded":"2024-03-04T06:57:57.620940+0000","last_fullsized":"2024-03-04T06:57:57.620940+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999343+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:57:24.999343+0000","last_peered":"2024-03-04T06:57:24.999343+0000","last_clean":"2024-03-04T06:57:24.999343+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:57:24.999343+0000","last_undegraded":"2024-03-04T06:57:24.999343+0000","last_fullsized":"2024-03-04T06:57:24.999343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001313+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:57:38.001313+0000","last_peered":"2024-03-04T06:57:38.001313+0000","last_clean":"2024-03-04T06:57:38.001313+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:57:38.001313+0000","last_undegraded":"2024-03-04T06:57:38.001313+0000","last_fullsized":"2024-03-04T06:57:38.001313+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:13.159769+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:58:13.159769+0000","last_peered":"2024-03-04T06:58:13.159769+0000","last_clean":"2024-03-04T06:58:13.159769+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:58:13.159769+0000","last_undegraded":"2024-03-04T06:58:13.159769+0000","last_fullsized":"2024-03-04T06:58:13.159769+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953787+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:58:12.953787+0000","last_peered":"2024-03-04T06:58:12.953787+0000","last_clean":"2024-03-04T06:58:12.953787+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:58:12.953787+0000","last_undegraded":"2024-03-04T06:58:12.953787+0000","last_fullsized":"2024-03-04T06:58:12.953787+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953915+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:58:12.953915+0000","last_peered":"2024-03-04T06:58:12.953915+0000","last_clean":"2024-03-04T06:58:12.953915+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:58:12.953915+0000","last_undegraded":"2024-03-04T06:58:12.953915+0000","last_fullsized":"2024-03-04T06:58:12.953915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397463+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:58:48.397463+0000","last_peered":"2024-03-04T06:58:48.397463+0000","last_clean":"2024-03-04T06:58:48.397463+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:58:48.397463+0000","last_undegraded":"2024-03-04T06:58:48.397463+0000","last_fullsized":"2024-03-04T06:58:48.397463+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:59:04.553588+0000","last_peered":"2024-03-04T06:59:04.553588+0000","last_clean":"2024-03-04T06:59:04.553588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:59:04.553588+0000","last_undegraded":"2024-03-04T06:59:04.553588+0000","last_fullsized":"2024-03-04T06:59:04.553588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1306,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006697+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:58:28.006697+0000","last_peered":"2024-03-04T06:58:28.006697+0000","last_clean":"2024-03-04T06:58:28.006697+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:58:28.006697+0000","last_undegraded":"2024-03-04T06:58:28.006697+0000","last_fullsized":"2024-03-04T06:58:28.006697+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001710+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:57:45.001710+0000","last_peered":"2024-03-04T06:57:45.001710+0000","last_clean":"2024-03-04T06:57:45.001710+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:57:45.001710+0000","last_undegraded":"2024-03-04T06:57:45.001710+0000","last_fullsized":"2024-03-04T06:57:45.001710+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001722+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:57:45.001722+0000","last_peered":"2024-03-04T06:57:45.001722+0000","last_clean":"2024-03-04T06:57:45.001722+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:57:45.001722+0000","last_undegraded":"2024-03-04T06:57:45.001722+0000","last_fullsized":"2024-03-04T06:57:45.001722+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006681+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:58:28.006681+0000","last_peered":"2024-03-04T06:58:28.006681+0000","last_clean":"2024-03-04T06:58:28.006681+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:58:28.006681+0000","last_undegraded":"2024-03-04T06:58:28.006681+0000","last_fullsized":"2024-03-04T06:58:28.006681+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1235,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386420+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:57:08.386420+0000","last_peered":"2024-03-04T06:57:08.386420+0000","last_clean":"2024-03-04T06:57:08.386420+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:57:08.386420+0000","last_undegraded":"2024-03-04T06:57:08.386420+0000","last_fullsized":"2024-03-04T06:57:08.386420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1222,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386390+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:57:08.386390+0000","last_peered":"2024-03-04T06:57:08.386390+0000","last_clean":"2024-03-04T06:57:08.386390+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:57:08.386390+0000","last_undegraded":"2024-03-04T06:57:08.386390+0000","last_fullsized":"2024-03-04T06:57:08.386390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543632+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:57:34.543632+0000","last_peered":"2024-03-04T06:57:34.543632+0000","last_clean":"2024-03-04T06:57:34.543632+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:57:34.543632+0000","last_undegraded":"2024-03-04T06:57:34.543632+0000","last_fullsized":"2024-03-04T06:57:34.543632+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958870+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:58:52.958870+0000","last_peered":"2024-03-04T06:58:52.958870+0000","last_clean":"2024-03-04T06:58:52.958870+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:58:52.958870+0000","last_undegraded":"2024-03-04T06:58:52.958870+0000","last_fullsized":"2024-03-04T06:58:52.958870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001694+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:57:45.001694+0000","last_peered":"2024-03-04T06:57:45.001694+0000","last_clean":"2024-03-04T06:57:45.001694+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:57:45.001694+0000","last_undegraded":"2024-03-04T06:57:45.001694+0000","last_fullsized":"2024-03-04T06:57:45.001694+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1190,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:17.623076+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:58:17.623076+0000","last_peered":"2024-03-04T06:58:17.623076+0000","last_clean":"2024-03-04T06:58:17.623076+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:58:17.623076+0000","last_undegraded":"2024-03-04T06:58:17.623076+0000","last_fullsized":"2024-03-04T06:58:17.623076+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.224901+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:56:58.224901+0000","last_peered":"2024-03-04T06:56:58.224901+0000","last_clean":"2024-03-04T06:56:58.224901+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:56:58.224901+0000","last_undegraded":"2024-03-04T06:56:58.224901+0000","last_fullsized":"2024-03-04T06:56:58.224901+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006622+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:58:28.006622+0000","last_peered":"2024-03-04T06:58:28.006622+0000","last_clean":"2024-03-04T06:58:28.006622+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:58:28.006622+0000","last_undegraded":"2024-03-04T06:58:28.006622+0000","last_fullsized":"2024-03-04T06:58:28.006622+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999328+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:57:24.999328+0000","last_peered":"2024-03-04T06:57:24.999328+0000","last_clean":"2024-03-04T06:57:24.999328+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:57:24.999328+0000","last_undegraded":"2024-03-04T06:57:24.999328+0000","last_fullsized":"2024-03-04T06:57:24.999328+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999296+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:57:24.999296+0000","last_peered":"2024-03-04T06:57:24.999296+0000","last_clean":"2024-03-04T06:57:24.999296+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:57:24.999296+0000","last_undegraded":"2024-03-04T06:57:24.999296+0000","last_fullsized":"2024-03-04T06:57:24.999296+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956356+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:58:32.956356+0000","last_peered":"2024-03-04T06:58:32.956356+0000","last_clean":"2024-03-04T06:58:32.956356+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:58:32.956356+0000","last_undegraded":"2024-03-04T06:58:32.956356+0000","last_fullsized":"2024-03-04T06:58:32.956356+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162696+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:58:38.162696+0000","last_peered":"2024-03-04T06:58:38.162696+0000","last_clean":"2024-03-04T06:58:38.162696+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:58:38.162696+0000","last_undegraded":"2024-03-04T06:58:38.162696+0000","last_fullsized":"2024-03-04T06:58:38.162696+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:43.223376+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:56:43.223376+0000","last_peered":"2024-03-04T06:56:43.223376+0000","last_clean":"2024-03-04T06:56:43.223376+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:56:43.223376+0000","last_undegraded":"2024-03-04T06:56:43.223376+0000","last_fullsized":"2024-03-04T06:56:43.223376+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956414+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:58:32.956414+0000","last_peered":"2024-03-04T06:58:32.956414+0000","last_clean":"2024-03-04T06:58:32.956414+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:58:32.956414+0000","last_undegraded":"2024-03-04T06:58:32.956414+0000","last_fullsized":"2024-03-04T06:58:32.956414+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956402+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:58:32.956402+0000","last_peered":"2024-03-04T06:58:32.956402+0000","last_clean":"2024-03-04T06:58:32.956402+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:58:32.956402+0000","last_undegraded":"2024-03-04T06:58:32.956402+0000","last_fullsized":"2024-03-04T06:58:32.956402+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:03.003999+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:58:03.003999+0000","last_peered":"2024-03-04T06:58:03.003999+0000","last_clean":"2024-03-04T06:58:03.003999+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:58:03.003999+0000","last_undegraded":"2024-03-04T06:58:03.003999+0000","last_fullsized":"2024-03-04T06:58:03.003999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162740+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:58:38.162740+0000","last_peered":"2024-03-04T06:58:38.162740+0000","last_clean":"2024-03-04T06:58:38.162740+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:58:38.162740+0000","last_undegraded":"2024-03-04T06:58:38.162740+0000","last_fullsized":"2024-03-04T06:58:38.162740+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:37.618704+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:57:37.618704+0000","last_peered":"2024-03-04T06:57:37.618704+0000","last_clean":"2024-03-04T06:57:37.618704+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:57:37.618704+0000","last_undegraded":"2024-03-04T06:57:37.618704+0000","last_fullsized":"2024-03-04T06:57:37.618704+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1131,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237167+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:58:48.237167+0000","last_peered":"2024-03-04T06:58:48.237167+0000","last_clean":"2024-03-04T06:58:48.237167+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:58:48.237167+0000","last_undegraded":"2024-03-04T06:58:48.237167+0000","last_fullsized":"2024-03-04T06:58:48.237167+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541754+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:57:19.541754+0000","last_peered":"2024-03-04T06:57:19.541754+0000","last_clean":"2024-03-04T06:57:19.541754+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:57:19.541754+0000","last_undegraded":"2024-03-04T06:57:19.541754+0000","last_fullsized":"2024-03-04T06:57:19.541754+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001343+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:57:38.001343+0000","last_peered":"2024-03-04T06:57:38.001343+0000","last_clean":"2024-03-04T06:57:38.001343+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:57:38.001343+0000","last_undegraded":"2024-03-04T06:57:38.001343+0000","last_fullsized":"2024-03-04T06:57:38.001343+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397438+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:58:48.397438+0000","last_peered":"2024-03-04T06:58:48.397438+0000","last_clean":"2024-03-04T06:58:48.397438+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:58:48.397438+0000","last_undegraded":"2024-03-04T06:58:48.397438+0000","last_fullsized":"2024-03-04T06:58:48.397438+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953851+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:58:12.953851+0000","last_peered":"2024-03-04T06:58:12.953851+0000","last_clean":"2024-03-04T06:58:12.953851+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:58:12.953851+0000","last_undegraded":"2024-03-04T06:58:12.953851+0000","last_fullsized":"2024-03-04T06:58:12.953851+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540167+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:57:04.540167+0000","last_peered":"2024-03-04T06:57:04.540167+0000","last_clean":"2024-03-04T06:57:04.540167+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:57:04.540167+0000","last_undegraded":"2024-03-04T06:57:04.540167+0000","last_fullsized":"2024-03-04T06:57:04.540167+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237147+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:58:48.237147+0000","last_peered":"2024-03-04T06:58:48.237147+0000","last_clean":"2024-03-04T06:58:48.237147+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:58:48.237147+0000","last_undegraded":"2024-03-04T06:58:48.237147+0000","last_fullsized":"2024-03-04T06:58:48.237147+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237122+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:58:48.237122+0000","last_peered":"2024-03-04T06:58:48.237122+0000","last_clean":"2024-03-04T06:58:48.237122+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:58:48.237122+0000","last_undegraded":"2024-03-04T06:58:48.237122+0000","last_fullsized":"2024-03-04T06:58:48.237122+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397404+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:58:48.397404+0000","last_peered":"2024-03-04T06:58:48.397404+0000","last_clean":"2024-03-04T06:58:48.397404+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:58:48.397404+0000","last_undegraded":"2024-03-04T06:58:48.397404+0000","last_fullsized":"2024-03-04T06:58:48.397404+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540129+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:57:04.540129+0000","last_peered":"2024-03-04T06:57:04.540129+0000","last_clean":"2024-03-04T06:57:04.540129+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:57:04.540129+0000","last_undegraded":"2024-03-04T06:57:04.540129+0000","last_fullsized":"2024-03-04T06:57:04.540129+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3578,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.391939+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:57:58.391939+0000","last_peered":"2024-03-04T06:57:58.391939+0000","last_clean":"2024-03-04T06:57:58.391939+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:57:58.391939+0000","last_undegraded":"2024-03-04T06:57:58.391939+0000","last_fullsized":"2024-03-04T06:57:58.391939+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:17.616250+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:57:17.616250+0000","last_peered":"2024-03-04T06:57:17.616250+0000","last_clean":"2024-03-04T06:57:17.616250+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:57:17.616250+0000","last_undegraded":"2024-03-04T06:57:17.616250+0000","last_fullsized":"2024-03-04T06:57:17.616250+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553616+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:59:04.553616+0000","last_peered":"2024-03-04T06:59:04.553616+0000","last_clean":"2024-03-04T06:59:04.553616+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:59:04.553616+0000","last_undegraded":"2024-03-04T06:59:04.553616+0000","last_fullsized":"2024-03-04T06:59:04.553616+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17117,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006566+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:58:28.006566+0000","last_peered":"2024-03-04T06:58:28.006566+0000","last_clean":"2024-03-04T06:58:28.006566+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:58:28.006566+0000","last_undegraded":"2024-03-04T06:58:28.006566+0000","last_fullsized":"2024-03-04T06:58:28.006566+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164900+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:59:03.164900+0000","last_peered":"2024-03-04T06:59:03.164900+0000","last_clean":"2024-03-04T06:59:03.164900+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:59:03.164900+0000","last_undegraded":"2024-03-04T06:59:03.164900+0000","last_fullsized":"2024-03-04T06:59:03.164900+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164981+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:59:03.164981+0000","last_peered":"2024-03-04T06:59:03.164981+0000","last_clean":"2024-03-04T06:59:03.164981+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:59:03.164981+0000","last_undegraded":"2024-03-04T06:59:03.164981+0000","last_fullsized":"2024-03-04T06:59:03.164981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962033+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:59:17.962033+0000","last_peered":"2024-03-04T06:59:17.962033+0000","last_clean":"2024-03-04T06:59:17.962033+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:59:17.962033+0000","last_undegraded":"2024-03-04T06:59:17.962033+0000","last_fullsized":"2024-03-04T06:59:17.962033+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4387,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006651+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:58:28.006651+0000","last_peered":"2024-03-04T06:58:28.006651+0000","last_clean":"2024-03-04T06:58:28.006651+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:58:28.006651+0000","last_undegraded":"2024-03-04T06:58:28.006651+0000","last_fullsized":"2024-03-04T06:58:28.006651+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164925+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:59:03.164925+0000","last_peered":"2024-03-04T06:59:03.164925+0000","last_clean":"2024-03-04T06:59:03.164925+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:59:03.164925+0000","last_undegraded":"2024-03-04T06:59:03.164925+0000","last_fullsized":"2024-03-04T06:59:03.164925+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.961943+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:59:17.961943+0000","last_peered":"2024-03-04T06:59:17.961943+0000","last_clean":"2024-03-04T06:59:17.961943+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:59:17.961943+0000","last_undegraded":"2024-03-04T06:59:17.961943+0000","last_fullsized":"2024-03-04T06:59:17.961943+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625641+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:58:42.625641+0000","last_peered":"2024-03-04T06:58:42.625641+0000","last_clean":"2024-03-04T06:58:42.625641+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:58:42.625641+0000","last_undegraded":"2024-03-04T06:58:42.625641+0000","last_fullsized":"2024-03-04T06:58:42.625641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5640,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392060+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:57:58.392060+0000","last_peered":"2024-03-04T06:57:58.392060+0000","last_clean":"2024-03-04T06:57:58.392060+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:57:58.392060+0000","last_undegraded":"2024-03-04T06:57:58.392060+0000","last_fullsized":"2024-03-04T06:57:58.392060+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1256,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154711+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:57:23.154711+0000","last_peered":"2024-03-04T06:57:23.154711+0000","last_clean":"2024-03-04T06:57:23.154711+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:57:23.154711+0000","last_undegraded":"2024-03-04T06:57:23.154711+0000","last_fullsized":"2024-03-04T06:57:23.154711+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:33.162083+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:58:33.162083+0000","last_peered":"2024-03-04T06:58:33.162083+0000","last_clean":"2024-03-04T06:58:33.162083+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:58:33.162083+0000","last_undegraded":"2024-03-04T06:58:33.162083+0000","last_fullsized":"2024-03-04T06:58:33.162083+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389235+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:57:33.389235+0000","last_peered":"2024-03-04T06:57:33.389235+0000","last_clean":"2024-03-04T06:57:33.389235+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:57:33.389235+0000","last_undegraded":"2024-03-04T06:57:33.389235+0000","last_fullsized":"2024-03-04T06:57:33.389235+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4016,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:24.549121+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:58:24.549121+0000","last_peered":"2024-03-04T06:58:24.549121+0000","last_clean":"2024-03-04T06:58:24.549121+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:58:24.549121+0000","last_undegraded":"2024-03-04T06:58:24.549121+0000","last_fullsized":"2024-03-04T06:58:24.549121+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230253+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:57:48.230253+0000","last_peered":"2024-03-04T06:57:48.230253+0000","last_clean":"2024-03-04T06:57:48.230253+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:57:48.230253+0000","last_undegraded":"2024-03-04T06:57:48.230253+0000","last_fullsized":"2024-03-04T06:57:48.230253+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:10.004451+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:58:10.004451+0000","last_peered":"2024-03-04T06:58:10.004451+0000","last_clean":"2024-03-04T06:58:10.004451+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:58:10.004451+0000","last_undegraded":"2024-03-04T06:58:10.004451+0000","last_fullsized":"2024-03-04T06:58:10.004451+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962020+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:59:17.962020+0000","last_peered":"2024-03-04T06:59:17.962020+0000","last_clean":"2024-03-04T06:59:17.962020+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:59:17.962020+0000","last_undegraded":"2024-03-04T06:59:17.962020+0000","last_fullsized":"2024-03-04T06:59:17.962020+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1551,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547030+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:58:04.547030+0000","last_peered":"2024-03-04T06:58:04.547030+0000","last_clean":"2024-03-04T06:58:04.547030+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:58:04.547030+0000","last_undegraded":"2024-03-04T06:58:04.547030+0000","last_fullsized":"2024-03-04T06:58:04.547030+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3951,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949380+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:57:32.949380+0000","last_peered":"2024-03-04T06:57:32.949380+0000","last_clean":"2024-03-04T06:57:32.949380+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:57:32.949380+0000","last_undegraded":"2024-03-04T06:57:32.949380+0000","last_fullsized":"2024-03-04T06:57:32.949380+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009504+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:58:58.009504+0000","last_peered":"2024-03-04T06:58:58.009504+0000","last_clean":"2024-03-04T06:58:58.009504+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:58:58.009504+0000","last_undegraded":"2024-03-04T06:58:58.009504+0000","last_fullsized":"2024-03-04T06:58:58.009504+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389207+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:57:33.389207+0000","last_peered":"2024-03-04T06:57:33.389207+0000","last_clean":"2024-03-04T06:57:33.389207+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:57:33.389207+0000","last_undegraded":"2024-03-04T06:57:33.389207+0000","last_fullsized":"2024-03-04T06:57:33.389207+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547005+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:58:04.547005+0000","last_peered":"2024-03-04T06:58:04.547005+0000","last_clean":"2024-03-04T06:58:04.547005+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:58:04.547005+0000","last_undegraded":"2024-03-04T06:58:04.547005+0000","last_fullsized":"2024-03-04T06:58:04.547005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15292,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.230222+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:57:48.230222+0000","last_peered":"2024-03-04T06:57:48.230222+0000","last_clean":"2024-03-04T06:57:48.230222+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:57:48.230222+0000","last_undegraded":"2024-03-04T06:57:48.230222+0000","last_fullsized":"2024-03-04T06:57:48.230222+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006608+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:58:28.006608+0000","last_peered":"2024-03-04T06:58:28.006608+0000","last_clean":"2024-03-04T06:58:28.006608+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:58:28.006608+0000","last_undegraded":"2024-03-04T06:58:28.006608+0000","last_fullsized":"2024-03-04T06:58:28.006608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549190+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:58:24.549190+0000","last_peered":"2024-03-04T06:58:24.549190+0000","last_clean":"2024-03-04T06:58:24.549190+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:58:24.549190+0000","last_undegraded":"2024-03-04T06:58:24.549190+0000","last_fullsized":"2024-03-04T06:58:24.549190+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164943+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:59:03.164943+0000","last_peered":"2024-03-04T06:59:03.164943+0000","last_clean":"2024-03-04T06:59:03.164943+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:59:03.164943+0000","last_undegraded":"2024-03-04T06:59:03.164943+0000","last_fullsized":"2024-03-04T06:59:03.164943+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4380,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:42.625602+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:58:42.625602+0000","last_peered":"2024-03-04T06:58:42.625602+0000","last_clean":"2024-03-04T06:58:42.625602+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:58:42.625602+0000","last_undegraded":"2024-03-04T06:58:42.625602+0000","last_fullsized":"2024-03-04T06:58:42.625602+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001670+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:57:45.001670+0000","last_peered":"2024-03-04T06:57:45.001670+0000","last_clean":"2024-03-04T06:57:45.001670+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:57:45.001670+0000","last_undegraded":"2024-03-04T06:57:45.001670+0000","last_fullsized":"2024-03-04T06:57:45.001670+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1269,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154698+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:57:23.154698+0000","last_peered":"2024-03-04T06:57:23.154698+0000","last_clean":"2024-03-04T06:57:23.154698+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:57:23.154698+0000","last_undegraded":"2024-03-04T06:57:23.154698+0000","last_fullsized":"2024-03-04T06:57:23.154698+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007125+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:58:35.007125+0000","last_peered":"2024-03-04T06:58:35.007125+0000","last_clean":"2024-03-04T06:58:35.007125+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:58:35.007125+0000","last_undegraded":"2024-03-04T06:58:35.007125+0000","last_fullsized":"2024-03-04T06:58:35.007125+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4610,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:45.001644+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:57:45.001644+0000","last_peered":"2024-03-04T06:57:45.001644+0000","last_clean":"2024-03-04T06:57:45.001644+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:57:45.001644+0000","last_undegraded":"2024-03-04T06:57:45.001644+0000","last_fullsized":"2024-03-04T06:57:45.001644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625572+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:58:42.625572+0000","last_peered":"2024-03-04T06:58:42.625572+0000","last_clean":"2024-03-04T06:58:42.625572+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:58:42.625572+0000","last_undegraded":"2024-03-04T06:58:42.625572+0000","last_fullsized":"2024-03-04T06:58:42.625572+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1079,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232447+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:58:08.232447+0000","last_peered":"2024-03-04T06:58:08.232447+0000","last_clean":"2024-03-04T06:58:08.232447+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:58:08.232447+0000","last_undegraded":"2024-03-04T06:58:08.232447+0000","last_fullsized":"2024-03-04T06:58:08.232447+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009478+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:58:58.009478+0000","last_peered":"2024-03-04T06:58:58.009478+0000","last_clean":"2024-03-04T06:58:58.009478+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:58:58.009478+0000","last_undegraded":"2024-03-04T06:58:58.009478+0000","last_fullsized":"2024-03-04T06:58:58.009478+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4635,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:52.951690+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:57:52.951690+0000","last_peered":"2024-03-04T06:57:52.951690+0000","last_clean":"2024-03-04T06:57:52.951690+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:57:52.951690+0000","last_undegraded":"2024-03-04T06:57:52.951690+0000","last_fullsized":"2024-03-04T06:57:52.951690+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:44.551296+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:58:44.551296+0000","last_peered":"2024-03-04T06:58:44.551296+0000","last_clean":"2024-03-04T06:58:44.551296+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:58:44.551296+0000","last_undegraded":"2024-03-04T06:58:44.551296+0000","last_fullsized":"2024-03-04T06:58:44.551296+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1186,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:07.628352+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:59:07.628352+0000","last_peered":"2024-03-04T06:59:07.628352+0000","last_clean":"2024-03-04T06:59:07.628352+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:59:07.628352+0000","last_undegraded":"2024-03-04T06:59:07.628352+0000","last_fullsized":"2024-03-04T06:59:07.628352+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5158,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:17.616210+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:57:17.616210+0000","last_peered":"2024-03-04T06:57:17.616210+0000","last_clean":"2024-03-04T06:57:17.616210+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:57:17.616210+0000","last_undegraded":"2024-03-04T06:57:17.616210+0000","last_fullsized":"2024-03-04T06:57:17.616210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154620+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:57:23.154620+0000","last_peered":"2024-03-04T06:57:23.154620+0000","last_clean":"2024-03-04T06:57:23.154620+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:57:23.154620+0000","last_undegraded":"2024-03-04T06:57:23.154620+0000","last_fullsized":"2024-03-04T06:57:23.154620+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007066+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:58:35.007066+0000","last_peered":"2024-03-04T06:58:35.007066+0000","last_clean":"2024-03-04T06:58:35.007066+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:58:35.007066+0000","last_undegraded":"2024-03-04T06:58:35.007066+0000","last_fullsized":"2024-03-04T06:58:35.007066+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4720,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394889+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:58:23.394889+0000","last_peered":"2024-03-04T06:58:23.394889+0000","last_clean":"2024-03-04T06:58:23.394889+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:58:23.394889+0000","last_undegraded":"2024-03-04T06:58:23.394889+0000","last_fullsized":"2024-03-04T06:58:23.394889+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154658+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:57:23.154658+0000","last_peered":"2024-03-04T06:57:23.154658+0000","last_clean":"2024-03-04T06:57:23.154658+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:57:23.154658+0000","last_undegraded":"2024-03-04T06:57:23.154658+0000","last_fullsized":"2024-03-04T06:57:23.154658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009678+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:59:00.009678+0000","last_peered":"2024-03-04T06:59:00.009678+0000","last_clean":"2024-03-04T06:59:00.009678+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:59:00.009678+0000","last_undegraded":"2024-03-04T06:59:00.009678+0000","last_fullsized":"2024-03-04T06:59:00.009678+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5555,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.157094+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:57:48.157094+0000","last_peered":"2024-03-04T06:57:48.157094+0000","last_clean":"2024-03-04T06:57:48.157094+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:57:48.157094+0000","last_undegraded":"2024-03-04T06:57:48.157094+0000","last_fullsized":"2024-03-04T06:57:48.157094+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553540+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:59:04.553540+0000","last_peered":"2024-03-04T06:59:04.553540+0000","last_clean":"2024-03-04T06:59:04.553540+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:59:04.553540+0000","last_undegraded":"2024-03-04T06:59:04.553540+0000","last_fullsized":"2024-03-04T06:59:04.553540+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232398+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:58:08.232398+0000","last_peered":"2024-03-04T06:58:08.232398+0000","last_clean":"2024-03-04T06:58:08.232398+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:58:08.232398+0000","last_undegraded":"2024-03-04T06:58:08.232398+0000","last_fullsized":"2024-03-04T06:58:08.232398+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394833+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:58:23.394833+0000","last_peered":"2024-03-04T06:58:23.394833+0000","last_clean":"2024-03-04T06:58:23.394833+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:58:23.394833+0000","last_undegraded":"2024-03-04T06:58:23.394833+0000","last_fullsized":"2024-03-04T06:58:23.394833+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394877+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:58:23.394877+0000","last_peered":"2024-03-04T06:58:23.394877+0000","last_clean":"2024-03-04T06:58:23.394877+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:58:23.394877+0000","last_undegraded":"2024-03-04T06:58:23.394877+0000","last_fullsized":"2024-03-04T06:58:23.394877+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553601+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:59:04.553601+0000","last_peered":"2024-03-04T06:59:04.553601+0000","last_clean":"2024-03-04T06:59:04.553601+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:59:04.553601+0000","last_undegraded":"2024-03-04T06:59:04.553601+0000","last_fullsized":"2024-03-04T06:59:04.553601+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4367,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392018+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:57:58.392018+0000","last_peered":"2024-03-04T06:57:58.392018+0000","last_clean":"2024-03-04T06:57:58.392018+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:57:58.392018+0000","last_undegraded":"2024-03-04T06:57:58.392018+0000","last_fullsized":"2024-03-04T06:57:58.392018+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.157162+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:57:48.157162+0000","last_peered":"2024-03-04T06:57:48.157162+0000","last_clean":"2024-03-04T06:57:48.157162+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:57:48.157162+0000","last_undegraded":"2024-03-04T06:57:48.157162+0000","last_fullsized":"2024-03-04T06:57:48.157162+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951665+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:57:52.951665+0000","last_peered":"2024-03-04T06:57:52.951665+0000","last_clean":"2024-03-04T06:57:52.951665+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:57:52.951665+0000","last_undegraded":"2024-03-04T06:57:52.951665+0000","last_fullsized":"2024-03-04T06:57:52.951665+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4601,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:44.551323+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:58:44.551323+0000","last_peered":"2024-03-04T06:58:44.551323+0000","last_clean":"2024-03-04T06:58:44.551323+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:58:44.551323+0000","last_undegraded":"2024-03-04T06:58:44.551323+0000","last_fullsized":"2024-03-04T06:58:44.551323+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1246,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394915+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:58:23.394915+0000","last_peered":"2024-03-04T06:58:23.394915+0000","last_clean":"2024-03-04T06:58:23.394915+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:58:23.394915+0000","last_undegraded":"2024-03-04T06:58:23.394915+0000","last_fullsized":"2024-03-04T06:58:23.394915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553631+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:59:04.553631+0000","last_peered":"2024-03-04T06:59:04.553631+0000","last_clean":"2024-03-04T06:59:04.553631+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:59:04.553631+0000","last_undegraded":"2024-03-04T06:59:04.553631+0000","last_fullsized":"2024-03-04T06:59:04.553631+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230189+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:57:48.230189+0000","last_peered":"2024-03-04T06:57:48.230189+0000","last_clean":"2024-03-04T06:57:48.230189+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:57:48.230189+0000","last_undegraded":"2024-03-04T06:57:48.230189+0000","last_fullsized":"2024-03-04T06:57:48.230189+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389246+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:57:33.389246+0000","last_peered":"2024-03-04T06:57:33.389246+0000","last_clean":"2024-03-04T06:57:33.389246+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:57:33.389246+0000","last_undegraded":"2024-03-04T06:57:33.389246+0000","last_fullsized":"2024-03-04T06:57:33.389246+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962003+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:59:17.962003+0000","last_peered":"2024-03-04T06:59:17.962003+0000","last_clean":"2024-03-04T06:59:17.962003+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:59:17.962003+0000","last_undegraded":"2024-03-04T06:59:17.962003+0000","last_fullsized":"2024-03-04T06:59:17.962003+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006538+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:58:28.006538+0000","last_peered":"2024-03-04T06:58:28.006538+0000","last_clean":"2024-03-04T06:58:28.006538+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:58:28.006538+0000","last_undegraded":"2024-03-04T06:58:28.006538+0000","last_fullsized":"2024-03-04T06:58:28.006538+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007105+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:58:35.007105+0000","last_peered":"2024-03-04T06:58:35.007105+0000","last_clean":"2024-03-04T06:58:35.007105+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:58:35.007105+0000","last_undegraded":"2024-03-04T06:58:35.007105+0000","last_fullsized":"2024-03-04T06:58:35.007105+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154682+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:57:23.154682+0000","last_peered":"2024-03-04T06:57:23.154682+0000","last_clean":"2024-03-04T06:57:23.154682+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:57:23.154682+0000","last_undegraded":"2024-03-04T06:57:23.154682+0000","last_fullsized":"2024-03-04T06:57:23.154682+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232435+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:58:08.232435+0000","last_peered":"2024-03-04T06:58:08.232435+0000","last_clean":"2024-03-04T06:58:08.232435+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:58:08.232435+0000","last_undegraded":"2024-03-04T06:58:08.232435+0000","last_fullsized":"2024-03-04T06:58:08.232435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007138+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:58:35.007138+0000","last_peered":"2024-03-04T06:58:35.007138+0000","last_clean":"2024-03-04T06:58:35.007138+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:58:35.007138+0000","last_undegraded":"2024-03-04T06:58:35.007138+0000","last_fullsized":"2024-03-04T06:58:35.007138+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949325+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:57:32.949325+0000","last_peered":"2024-03-04T06:57:32.949325+0000","last_clean":"2024-03-04T06:57:32.949325+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:57:32.949325+0000","last_undegraded":"2024-03-04T06:57:32.949325+0000","last_fullsized":"2024-03-04T06:57:32.949325+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009646+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:59:00.009646+0000","last_peered":"2024-03-04T06:59:00.009646+0000","last_clean":"2024-03-04T06:59:00.009646+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:59:00.009646+0000","last_undegraded":"2024-03-04T06:59:00.009646+0000","last_fullsized":"2024-03-04T06:59:00.009646+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1121,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951615+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:57:52.951615+0000","last_peered":"2024-03-04T06:57:52.951615+0000","last_clean":"2024-03-04T06:57:52.951615+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:57:52.951615+0000","last_undegraded":"2024-03-04T06:57:52.951615+0000","last_fullsized":"2024-03-04T06:57:52.951615+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.998327+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:57:12.998327+0000","last_peered":"2024-03-04T06:57:12.998327+0000","last_clean":"2024-03-04T06:57:12.998327+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:57:12.998327+0000","last_undegraded":"2024-03-04T06:57:12.998327+0000","last_fullsized":"2024-03-04T06:57:12.998327+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.234922+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:58:28.234922+0000","last_peered":"2024-03-04T06:58:28.234922+0000","last_clean":"2024-03-04T06:58:28.234922+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:58:28.234922+0000","last_undegraded":"2024-03-04T06:58:28.234922+0000","last_fullsized":"2024-03-04T06:58:28.234922+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503497,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648144,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287098,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997804,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937438,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792791,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:01:28.706 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:28.706 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:28.706 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:28.706 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:28.706 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:28.706 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:28.706 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:28.706 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:28.706 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:28.706 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:28.706 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:01:29.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:29 smithi137 ceph-mon[88869]: from='client.44612 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:29.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:29 smithi137 ceph-mon[91314]: from='client.44612 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:29.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:29 smithi203 ceph-mon[85573]: from='client.44612 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:30.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:30 smithi137 ceph-mon[88869]: pgmap v1109: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:30.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:30 smithi137 ceph-mon[91314]: pgmap v1109: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:30.594 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:30 smithi203 ceph-mon[85573]: pgmap v1109: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:32.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:32 smithi137 ceph-mon[88869]: pgmap v1110: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:32.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:32 smithi137 ceph-mon[91314]: pgmap v1110: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:32.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:32 smithi203 ceph-mon[85573]: pgmap v1110: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:34.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:34 smithi137 ceph-mon[88869]: pgmap v1111: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:34.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:34 smithi137 ceph-mon[91314]: pgmap v1111: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:34.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:34 smithi203 ceph-mon[85573]: pgmap v1111: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:35.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:01:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:01:35] "GET /metrics HTTP/1.1" 200 36338 "" "Prometheus/2.43.0" 2024-03-04T07:01:36.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:36 smithi203 ceph-mon[85573]: pgmap v1112: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:36.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:36 smithi137 ceph-mon[88869]: pgmap v1112: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:36.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:36 smithi137 ceph-mon[91314]: pgmap v1112: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:38.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:38 smithi203 ceph-mon[85573]: pgmap v1113: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:38.708 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:01:38.739 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:38 smithi137 ceph-mon[88869]: pgmap v1113: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:38.739 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:38 smithi137 ceph-mon[91314]: pgmap v1113: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:38.925 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:01:39.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:01:39.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:01:39.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:01:40.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:40 smithi137 ceph-mon[88869]: pgmap v1114: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:40.544 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:40 smithi137 ceph-mon[91314]: pgmap v1114: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:40.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:40 smithi203 ceph-mon[85573]: pgmap v1114: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:40.885 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:01:40.888 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:01:41.491 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1115,"stamp":"2024-03-04T07:01:40.579393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003804"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549208+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:58:24.549208+0000","last_peered":"2024-03-04T06:58:24.549208+0000","last_clean":"2024-03-04T06:58:24.549208+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:58:24.549208+0000","last_undegraded":"2024-03-04T06:58:24.549208+0000","last_fullsized":"2024-03-04T06:58:24.549208+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.165005+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:59:03.165005+0000","last_peered":"2024-03-04T06:59:03.165005+0000","last_clean":"2024-03-04T06:59:03.165005+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:59:03.165005+0000","last_undegraded":"2024-03-04T06:59:03.165005+0000","last_fullsized":"2024-03-04T06:59:03.165005+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006644+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:58:28.006644+0000","last_peered":"2024-03-04T06:58:28.006644+0000","last_clean":"2024-03-04T06:58:28.006644+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:58:28.006644+0000","last_undegraded":"2024-03-04T06:58:28.006644+0000","last_fullsized":"2024-03-04T06:58:28.006644+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958856+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:58:52.958856+0000","last_peered":"2024-03-04T06:58:52.958856+0000","last_clean":"2024-03-04T06:58:52.958856+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:58:52.958856+0000","last_undegraded":"2024-03-04T06:58:52.958856+0000","last_fullsized":"2024-03-04T06:58:52.958856+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543619+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:57:34.543619+0000","last_peered":"2024-03-04T06:57:34.543619+0000","last_clean":"2024-03-04T06:57:34.543619+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:57:34.543619+0000","last_undegraded":"2024-03-04T06:57:34.543619+0000","last_fullsized":"2024-03-04T06:57:34.543619+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958813+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:58:52.958813+0000","last_peered":"2024-03-04T06:58:52.958813+0000","last_clean":"2024-03-04T06:58:52.958813+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:58:52.958813+0000","last_undegraded":"2024-03-04T06:58:52.958813+0000","last_fullsized":"2024-03-04T06:58:52.958813+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543594+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:57:34.543594+0000","last_peered":"2024-03-04T06:57:34.543594+0000","last_clean":"2024-03-04T06:57:34.543594+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:57:34.543594+0000","last_undegraded":"2024-03-04T06:57:34.543594+0000","last_fullsized":"2024-03-04T06:57:34.543594+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001597+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:57:45.001597+0000","last_peered":"2024-03-04T06:57:45.001597+0000","last_clean":"2024-03-04T06:57:45.001597+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:57:45.001597+0000","last_undegraded":"2024-03-04T06:57:45.001597+0000","last_fullsized":"2024-03-04T06:57:45.001597+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1065,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541782+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:57:19.541782+0000","last_peered":"2024-03-04T06:57:19.541782+0000","last_clean":"2024-03-04T06:57:19.541782+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:57:19.541782+0000","last_undegraded":"2024-03-04T06:57:19.541782+0000","last_fullsized":"2024-03-04T06:57:19.541782+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239534+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:59:08.239534+0000","last_peered":"2024-03-04T06:59:08.239534+0000","last_clean":"2024-03-04T06:59:08.239534+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:59:08.239534+0000","last_undegraded":"2024-03-04T06:59:08.239534+0000","last_fullsized":"2024-03-04T06:59:08.239534+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239472+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:59:08.239472+0000","last_peered":"2024-03-04T06:59:08.239472+0000","last_clean":"2024-03-04T06:59:08.239472+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:59:08.239472+0000","last_undegraded":"2024-03-04T06:59:08.239472+0000","last_fullsized":"2024-03-04T06:59:08.239472+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:57.620940+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:57:57.620940+0000","last_peered":"2024-03-04T06:57:57.620940+0000","last_clean":"2024-03-04T06:57:57.620940+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:57:57.620940+0000","last_undegraded":"2024-03-04T06:57:57.620940+0000","last_fullsized":"2024-03-04T06:57:57.620940+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999343+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:57:24.999343+0000","last_peered":"2024-03-04T06:57:24.999343+0000","last_clean":"2024-03-04T06:57:24.999343+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:57:24.999343+0000","last_undegraded":"2024-03-04T06:57:24.999343+0000","last_fullsized":"2024-03-04T06:57:24.999343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001313+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:57:38.001313+0000","last_peered":"2024-03-04T06:57:38.001313+0000","last_clean":"2024-03-04T06:57:38.001313+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:57:38.001313+0000","last_undegraded":"2024-03-04T06:57:38.001313+0000","last_fullsized":"2024-03-04T06:57:38.001313+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:13.159769+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:58:13.159769+0000","last_peered":"2024-03-04T06:58:13.159769+0000","last_clean":"2024-03-04T06:58:13.159769+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:58:13.159769+0000","last_undegraded":"2024-03-04T06:58:13.159769+0000","last_fullsized":"2024-03-04T06:58:13.159769+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953787+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:58:12.953787+0000","last_peered":"2024-03-04T06:58:12.953787+0000","last_clean":"2024-03-04T06:58:12.953787+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:58:12.953787+0000","last_undegraded":"2024-03-04T06:58:12.953787+0000","last_fullsized":"2024-03-04T06:58:12.953787+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953915+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:58:12.953915+0000","last_peered":"2024-03-04T06:58:12.953915+0000","last_clean":"2024-03-04T06:58:12.953915+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:58:12.953915+0000","last_undegraded":"2024-03-04T06:58:12.953915+0000","last_fullsized":"2024-03-04T06:58:12.953915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397463+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:58:48.397463+0000","last_peered":"2024-03-04T06:58:48.397463+0000","last_clean":"2024-03-04T06:58:48.397463+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:58:48.397463+0000","last_undegraded":"2024-03-04T06:58:48.397463+0000","last_fullsized":"2024-03-04T06:58:48.397463+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:59:04.553588+0000","last_peered":"2024-03-04T06:59:04.553588+0000","last_clean":"2024-03-04T06:59:04.553588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:59:04.553588+0000","last_undegraded":"2024-03-04T06:59:04.553588+0000","last_fullsized":"2024-03-04T06:59:04.553588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1306,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006697+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:58:28.006697+0000","last_peered":"2024-03-04T06:58:28.006697+0000","last_clean":"2024-03-04T06:58:28.006697+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:58:28.006697+0000","last_undegraded":"2024-03-04T06:58:28.006697+0000","last_fullsized":"2024-03-04T06:58:28.006697+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001710+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:57:45.001710+0000","last_peered":"2024-03-04T06:57:45.001710+0000","last_clean":"2024-03-04T06:57:45.001710+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:57:45.001710+0000","last_undegraded":"2024-03-04T06:57:45.001710+0000","last_fullsized":"2024-03-04T06:57:45.001710+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001722+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:57:45.001722+0000","last_peered":"2024-03-04T06:57:45.001722+0000","last_clean":"2024-03-04T06:57:45.001722+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:57:45.001722+0000","last_undegraded":"2024-03-04T06:57:45.001722+0000","last_fullsized":"2024-03-04T06:57:45.001722+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006681+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:58:28.006681+0000","last_peered":"2024-03-04T06:58:28.006681+0000","last_clean":"2024-03-04T06:58:28.006681+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:58:28.006681+0000","last_undegraded":"2024-03-04T06:58:28.006681+0000","last_fullsized":"2024-03-04T06:58:28.006681+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1235,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386420+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:57:08.386420+0000","last_peered":"2024-03-04T06:57:08.386420+0000","last_clean":"2024-03-04T06:57:08.386420+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:57:08.386420+0000","last_undegraded":"2024-03-04T06:57:08.386420+0000","last_fullsized":"2024-03-04T06:57:08.386420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1222,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386390+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:57:08.386390+0000","last_peered":"2024-03-04T06:57:08.386390+0000","last_clean":"2024-03-04T06:57:08.386390+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:57:08.386390+0000","last_undegraded":"2024-03-04T06:57:08.386390+0000","last_fullsized":"2024-03-04T06:57:08.386390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543632+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:57:34.543632+0000","last_peered":"2024-03-04T06:57:34.543632+0000","last_clean":"2024-03-04T06:57:34.543632+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:57:34.543632+0000","last_undegraded":"2024-03-04T06:57:34.543632+0000","last_fullsized":"2024-03-04T06:57:34.543632+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958870+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:58:52.958870+0000","last_peered":"2024-03-04T06:58:52.958870+0000","last_clean":"2024-03-04T06:58:52.958870+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:58:52.958870+0000","last_undegraded":"2024-03-04T06:58:52.958870+0000","last_fullsized":"2024-03-04T06:58:52.958870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001694+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:57:45.001694+0000","last_peered":"2024-03-04T06:57:45.001694+0000","last_clean":"2024-03-04T06:57:45.001694+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:57:45.001694+0000","last_undegraded":"2024-03-04T06:57:45.001694+0000","last_fullsized":"2024-03-04T06:57:45.001694+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1190,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:17.623076+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:58:17.623076+0000","last_peered":"2024-03-04T06:58:17.623076+0000","last_clean":"2024-03-04T06:58:17.623076+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:58:17.623076+0000","last_undegraded":"2024-03-04T06:58:17.623076+0000","last_fullsized":"2024-03-04T06:58:17.623076+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.224901+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:56:58.224901+0000","last_peered":"2024-03-04T06:56:58.224901+0000","last_clean":"2024-03-04T06:56:58.224901+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:56:58.224901+0000","last_undegraded":"2024-03-04T06:56:58.224901+0000","last_fullsized":"2024-03-04T06:56:58.224901+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006622+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:58:28.006622+0000","last_peered":"2024-03-04T06:58:28.006622+0000","last_clean":"2024-03-04T06:58:28.006622+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:58:28.006622+0000","last_undegraded":"2024-03-04T06:58:28.006622+0000","last_fullsized":"2024-03-04T06:58:28.006622+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999328+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:57:24.999328+0000","last_peered":"2024-03-04T06:57:24.999328+0000","last_clean":"2024-03-04T06:57:24.999328+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:57:24.999328+0000","last_undegraded":"2024-03-04T06:57:24.999328+0000","last_fullsized":"2024-03-04T06:57:24.999328+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999296+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:57:24.999296+0000","last_peered":"2024-03-04T06:57:24.999296+0000","last_clean":"2024-03-04T06:57:24.999296+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:57:24.999296+0000","last_undegraded":"2024-03-04T06:57:24.999296+0000","last_fullsized":"2024-03-04T06:57:24.999296+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956356+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:58:32.956356+0000","last_peered":"2024-03-04T06:58:32.956356+0000","last_clean":"2024-03-04T06:58:32.956356+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:58:32.956356+0000","last_undegraded":"2024-03-04T06:58:32.956356+0000","last_fullsized":"2024-03-04T06:58:32.956356+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162696+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:58:38.162696+0000","last_peered":"2024-03-04T06:58:38.162696+0000","last_clean":"2024-03-04T06:58:38.162696+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:58:38.162696+0000","last_undegraded":"2024-03-04T06:58:38.162696+0000","last_fullsized":"2024-03-04T06:58:38.162696+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239549+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:59:08.239549+0000","last_peered":"2024-03-04T06:59:08.239549+0000","last_clean":"2024-03-04T06:59:08.239549+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:59:08.239549+0000","last_undegraded":"2024-03-04T06:59:08.239549+0000","last_fullsized":"2024-03-04T06:59:08.239549+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956414+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:58:32.956414+0000","last_peered":"2024-03-04T06:58:32.956414+0000","last_clean":"2024-03-04T06:58:32.956414+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:58:32.956414+0000","last_undegraded":"2024-03-04T06:58:32.956414+0000","last_fullsized":"2024-03-04T06:58:32.956414+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956402+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:58:32.956402+0000","last_peered":"2024-03-04T06:58:32.956402+0000","last_clean":"2024-03-04T06:58:32.956402+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:58:32.956402+0000","last_undegraded":"2024-03-04T06:58:32.956402+0000","last_fullsized":"2024-03-04T06:58:32.956402+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:03.003999+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:58:03.003999+0000","last_peered":"2024-03-04T06:58:03.003999+0000","last_clean":"2024-03-04T06:58:03.003999+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:58:03.003999+0000","last_undegraded":"2024-03-04T06:58:03.003999+0000","last_fullsized":"2024-03-04T06:58:03.003999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162740+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:58:38.162740+0000","last_peered":"2024-03-04T06:58:38.162740+0000","last_clean":"2024-03-04T06:58:38.162740+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:58:38.162740+0000","last_undegraded":"2024-03-04T06:58:38.162740+0000","last_fullsized":"2024-03-04T06:58:38.162740+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:37.618704+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:57:37.618704+0000","last_peered":"2024-03-04T06:57:37.618704+0000","last_clean":"2024-03-04T06:57:37.618704+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:57:37.618704+0000","last_undegraded":"2024-03-04T06:57:37.618704+0000","last_fullsized":"2024-03-04T06:57:37.618704+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1131,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237167+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:58:48.237167+0000","last_peered":"2024-03-04T06:58:48.237167+0000","last_clean":"2024-03-04T06:58:48.237167+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:58:48.237167+0000","last_undegraded":"2024-03-04T06:58:48.237167+0000","last_fullsized":"2024-03-04T06:58:48.237167+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541754+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:57:19.541754+0000","last_peered":"2024-03-04T06:57:19.541754+0000","last_clean":"2024-03-04T06:57:19.541754+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:57:19.541754+0000","last_undegraded":"2024-03-04T06:57:19.541754+0000","last_fullsized":"2024-03-04T06:57:19.541754+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001343+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:57:38.001343+0000","last_peered":"2024-03-04T06:57:38.001343+0000","last_clean":"2024-03-04T06:57:38.001343+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:57:38.001343+0000","last_undegraded":"2024-03-04T06:57:38.001343+0000","last_fullsized":"2024-03-04T06:57:38.001343+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397438+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:58:48.397438+0000","last_peered":"2024-03-04T06:58:48.397438+0000","last_clean":"2024-03-04T06:58:48.397438+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:58:48.397438+0000","last_undegraded":"2024-03-04T06:58:48.397438+0000","last_fullsized":"2024-03-04T06:58:48.397438+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953851+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:58:12.953851+0000","last_peered":"2024-03-04T06:58:12.953851+0000","last_clean":"2024-03-04T06:58:12.953851+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:58:12.953851+0000","last_undegraded":"2024-03-04T06:58:12.953851+0000","last_fullsized":"2024-03-04T06:58:12.953851+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540167+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:57:04.540167+0000","last_peered":"2024-03-04T06:57:04.540167+0000","last_clean":"2024-03-04T06:57:04.540167+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:57:04.540167+0000","last_undegraded":"2024-03-04T06:57:04.540167+0000","last_fullsized":"2024-03-04T06:57:04.540167+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237147+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:58:48.237147+0000","last_peered":"2024-03-04T06:58:48.237147+0000","last_clean":"2024-03-04T06:58:48.237147+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:58:48.237147+0000","last_undegraded":"2024-03-04T06:58:48.237147+0000","last_fullsized":"2024-03-04T06:58:48.237147+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237122+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:58:48.237122+0000","last_peered":"2024-03-04T06:58:48.237122+0000","last_clean":"2024-03-04T06:58:48.237122+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:58:48.237122+0000","last_undegraded":"2024-03-04T06:58:48.237122+0000","last_fullsized":"2024-03-04T06:58:48.237122+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397404+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:58:48.397404+0000","last_peered":"2024-03-04T06:58:48.397404+0000","last_clean":"2024-03-04T06:58:48.397404+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:58:48.397404+0000","last_undegraded":"2024-03-04T06:58:48.397404+0000","last_fullsized":"2024-03-04T06:58:48.397404+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:04.540129+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:57:04.540129+0000","last_peered":"2024-03-04T06:57:04.540129+0000","last_clean":"2024-03-04T06:57:04.540129+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:57:04.540129+0000","last_undegraded":"2024-03-04T06:57:04.540129+0000","last_fullsized":"2024-03-04T06:57:04.540129+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3578,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.391939+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:57:58.391939+0000","last_peered":"2024-03-04T06:57:58.391939+0000","last_clean":"2024-03-04T06:57:58.391939+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:57:58.391939+0000","last_undegraded":"2024-03-04T06:57:58.391939+0000","last_fullsized":"2024-03-04T06:57:58.391939+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:17.616250+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:57:17.616250+0000","last_peered":"2024-03-04T06:57:17.616250+0000","last_clean":"2024-03-04T06:57:17.616250+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:57:17.616250+0000","last_undegraded":"2024-03-04T06:57:17.616250+0000","last_fullsized":"2024-03-04T06:57:17.616250+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553616+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:59:04.553616+0000","last_peered":"2024-03-04T06:59:04.553616+0000","last_clean":"2024-03-04T06:59:04.553616+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:59:04.553616+0000","last_undegraded":"2024-03-04T06:59:04.553616+0000","last_fullsized":"2024-03-04T06:59:04.553616+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17117,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006566+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:58:28.006566+0000","last_peered":"2024-03-04T06:58:28.006566+0000","last_clean":"2024-03-04T06:58:28.006566+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:58:28.006566+0000","last_undegraded":"2024-03-04T06:58:28.006566+0000","last_fullsized":"2024-03-04T06:58:28.006566+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164900+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:59:03.164900+0000","last_peered":"2024-03-04T06:59:03.164900+0000","last_clean":"2024-03-04T06:59:03.164900+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:59:03.164900+0000","last_undegraded":"2024-03-04T06:59:03.164900+0000","last_fullsized":"2024-03-04T06:59:03.164900+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164981+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:59:03.164981+0000","last_peered":"2024-03-04T06:59:03.164981+0000","last_clean":"2024-03-04T06:59:03.164981+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:59:03.164981+0000","last_undegraded":"2024-03-04T06:59:03.164981+0000","last_fullsized":"2024-03-04T06:59:03.164981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962033+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:59:17.962033+0000","last_peered":"2024-03-04T06:59:17.962033+0000","last_clean":"2024-03-04T06:59:17.962033+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:59:17.962033+0000","last_undegraded":"2024-03-04T06:59:17.962033+0000","last_fullsized":"2024-03-04T06:59:17.962033+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4387,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006651+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:58:28.006651+0000","last_peered":"2024-03-04T06:58:28.006651+0000","last_clean":"2024-03-04T06:58:28.006651+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:58:28.006651+0000","last_undegraded":"2024-03-04T06:58:28.006651+0000","last_fullsized":"2024-03-04T06:58:28.006651+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164925+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:59:03.164925+0000","last_peered":"2024-03-04T06:59:03.164925+0000","last_clean":"2024-03-04T06:59:03.164925+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:59:03.164925+0000","last_undegraded":"2024-03-04T06:59:03.164925+0000","last_fullsized":"2024-03-04T06:59:03.164925+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.961943+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:59:17.961943+0000","last_peered":"2024-03-04T06:59:17.961943+0000","last_clean":"2024-03-04T06:59:17.961943+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:59:17.961943+0000","last_undegraded":"2024-03-04T06:59:17.961943+0000","last_fullsized":"2024-03-04T06:59:17.961943+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625641+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:58:42.625641+0000","last_peered":"2024-03-04T06:58:42.625641+0000","last_clean":"2024-03-04T06:58:42.625641+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:58:42.625641+0000","last_undegraded":"2024-03-04T06:58:42.625641+0000","last_fullsized":"2024-03-04T06:58:42.625641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5640,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392060+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:57:58.392060+0000","last_peered":"2024-03-04T06:57:58.392060+0000","last_clean":"2024-03-04T06:57:58.392060+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:57:58.392060+0000","last_undegraded":"2024-03-04T06:57:58.392060+0000","last_fullsized":"2024-03-04T06:57:58.392060+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1256,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154711+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:57:23.154711+0000","last_peered":"2024-03-04T06:57:23.154711+0000","last_clean":"2024-03-04T06:57:23.154711+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:57:23.154711+0000","last_undegraded":"2024-03-04T06:57:23.154711+0000","last_fullsized":"2024-03-04T06:57:23.154711+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:33.162083+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:58:33.162083+0000","last_peered":"2024-03-04T06:58:33.162083+0000","last_clean":"2024-03-04T06:58:33.162083+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:58:33.162083+0000","last_undegraded":"2024-03-04T06:58:33.162083+0000","last_fullsized":"2024-03-04T06:58:33.162083+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389235+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:57:33.389235+0000","last_peered":"2024-03-04T06:57:33.389235+0000","last_clean":"2024-03-04T06:57:33.389235+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:57:33.389235+0000","last_undegraded":"2024-03-04T06:57:33.389235+0000","last_fullsized":"2024-03-04T06:57:33.389235+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4016,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:24.549121+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:58:24.549121+0000","last_peered":"2024-03-04T06:58:24.549121+0000","last_clean":"2024-03-04T06:58:24.549121+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:58:24.549121+0000","last_undegraded":"2024-03-04T06:58:24.549121+0000","last_fullsized":"2024-03-04T06:58:24.549121+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230253+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:57:48.230253+0000","last_peered":"2024-03-04T06:57:48.230253+0000","last_clean":"2024-03-04T06:57:48.230253+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:57:48.230253+0000","last_undegraded":"2024-03-04T06:57:48.230253+0000","last_fullsized":"2024-03-04T06:57:48.230253+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:10.004451+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:58:10.004451+0000","last_peered":"2024-03-04T06:58:10.004451+0000","last_clean":"2024-03-04T06:58:10.004451+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:58:10.004451+0000","last_undegraded":"2024-03-04T06:58:10.004451+0000","last_fullsized":"2024-03-04T06:58:10.004451+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962020+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:59:17.962020+0000","last_peered":"2024-03-04T06:59:17.962020+0000","last_clean":"2024-03-04T06:59:17.962020+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:59:17.962020+0000","last_undegraded":"2024-03-04T06:59:17.962020+0000","last_fullsized":"2024-03-04T06:59:17.962020+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1551,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547030+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:58:04.547030+0000","last_peered":"2024-03-04T06:58:04.547030+0000","last_clean":"2024-03-04T06:58:04.547030+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:58:04.547030+0000","last_undegraded":"2024-03-04T06:58:04.547030+0000","last_fullsized":"2024-03-04T06:58:04.547030+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3951,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949380+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:57:32.949380+0000","last_peered":"2024-03-04T06:57:32.949380+0000","last_clean":"2024-03-04T06:57:32.949380+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:57:32.949380+0000","last_undegraded":"2024-03-04T06:57:32.949380+0000","last_fullsized":"2024-03-04T06:57:32.949380+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009504+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:58:58.009504+0000","last_peered":"2024-03-04T06:58:58.009504+0000","last_clean":"2024-03-04T06:58:58.009504+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:58:58.009504+0000","last_undegraded":"2024-03-04T06:58:58.009504+0000","last_fullsized":"2024-03-04T06:58:58.009504+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389207+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:57:33.389207+0000","last_peered":"2024-03-04T06:57:33.389207+0000","last_clean":"2024-03-04T06:57:33.389207+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:57:33.389207+0000","last_undegraded":"2024-03-04T06:57:33.389207+0000","last_fullsized":"2024-03-04T06:57:33.389207+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547005+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:58:04.547005+0000","last_peered":"2024-03-04T06:58:04.547005+0000","last_clean":"2024-03-04T06:58:04.547005+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:58:04.547005+0000","last_undegraded":"2024-03-04T06:58:04.547005+0000","last_fullsized":"2024-03-04T06:58:04.547005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15292,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.230222+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:57:48.230222+0000","last_peered":"2024-03-04T06:57:48.230222+0000","last_clean":"2024-03-04T06:57:48.230222+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:57:48.230222+0000","last_undegraded":"2024-03-04T06:57:48.230222+0000","last_fullsized":"2024-03-04T06:57:48.230222+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006608+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:58:28.006608+0000","last_peered":"2024-03-04T06:58:28.006608+0000","last_clean":"2024-03-04T06:58:28.006608+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:58:28.006608+0000","last_undegraded":"2024-03-04T06:58:28.006608+0000","last_fullsized":"2024-03-04T06:58:28.006608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549190+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:58:24.549190+0000","last_peered":"2024-03-04T06:58:24.549190+0000","last_clean":"2024-03-04T06:58:24.549190+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:58:24.549190+0000","last_undegraded":"2024-03-04T06:58:24.549190+0000","last_fullsized":"2024-03-04T06:58:24.549190+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164943+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:59:03.164943+0000","last_peered":"2024-03-04T06:59:03.164943+0000","last_clean":"2024-03-04T06:59:03.164943+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:59:03.164943+0000","last_undegraded":"2024-03-04T06:59:03.164943+0000","last_fullsized":"2024-03-04T06:59:03.164943+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4380,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:42.625602+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:58:42.625602+0000","last_peered":"2024-03-04T06:58:42.625602+0000","last_clean":"2024-03-04T06:58:42.625602+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:58:42.625602+0000","last_undegraded":"2024-03-04T06:58:42.625602+0000","last_fullsized":"2024-03-04T06:58:42.625602+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1204,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001670+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:57:45.001670+0000","last_peered":"2024-03-04T06:57:45.001670+0000","last_clean":"2024-03-04T06:57:45.001670+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:57:45.001670+0000","last_undegraded":"2024-03-04T06:57:45.001670+0000","last_fullsized":"2024-03-04T06:57:45.001670+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1269,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154698+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:57:23.154698+0000","last_peered":"2024-03-04T06:57:23.154698+0000","last_clean":"2024-03-04T06:57:23.154698+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:57:23.154698+0000","last_undegraded":"2024-03-04T06:57:23.154698+0000","last_fullsized":"2024-03-04T06:57:23.154698+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007125+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:58:35.007125+0000","last_peered":"2024-03-04T06:58:35.007125+0000","last_clean":"2024-03-04T06:58:35.007125+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:58:35.007125+0000","last_undegraded":"2024-03-04T06:58:35.007125+0000","last_fullsized":"2024-03-04T06:58:35.007125+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4610,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:45.001644+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:57:45.001644+0000","last_peered":"2024-03-04T06:57:45.001644+0000","last_clean":"2024-03-04T06:57:45.001644+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:57:45.001644+0000","last_undegraded":"2024-03-04T06:57:45.001644+0000","last_fullsized":"2024-03-04T06:57:45.001644+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625572+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:58:42.625572+0000","last_peered":"2024-03-04T06:58:42.625572+0000","last_clean":"2024-03-04T06:58:42.625572+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:58:42.625572+0000","last_undegraded":"2024-03-04T06:58:42.625572+0000","last_fullsized":"2024-03-04T06:58:42.625572+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1079,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232447+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:58:08.232447+0000","last_peered":"2024-03-04T06:58:08.232447+0000","last_clean":"2024-03-04T06:58:08.232447+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:58:08.232447+0000","last_undegraded":"2024-03-04T06:58:08.232447+0000","last_fullsized":"2024-03-04T06:58:08.232447+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009478+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:58:58.009478+0000","last_peered":"2024-03-04T06:58:58.009478+0000","last_clean":"2024-03-04T06:58:58.009478+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:58:58.009478+0000","last_undegraded":"2024-03-04T06:58:58.009478+0000","last_fullsized":"2024-03-04T06:58:58.009478+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4635,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:52.951690+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:57:52.951690+0000","last_peered":"2024-03-04T06:57:52.951690+0000","last_clean":"2024-03-04T06:57:52.951690+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:57:52.951690+0000","last_undegraded":"2024-03-04T06:57:52.951690+0000","last_fullsized":"2024-03-04T06:57:52.951690+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:44.551296+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:58:44.551296+0000","last_peered":"2024-03-04T06:58:44.551296+0000","last_clean":"2024-03-04T06:58:44.551296+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:58:44.551296+0000","last_undegraded":"2024-03-04T06:58:44.551296+0000","last_fullsized":"2024-03-04T06:58:44.551296+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1186,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:07.628352+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:59:07.628352+0000","last_peered":"2024-03-04T06:59:07.628352+0000","last_clean":"2024-03-04T06:59:07.628352+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:59:07.628352+0000","last_undegraded":"2024-03-04T06:59:07.628352+0000","last_fullsized":"2024-03-04T06:59:07.628352+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5158,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:17.616210+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:57:17.616210+0000","last_peered":"2024-03-04T06:57:17.616210+0000","last_clean":"2024-03-04T06:57:17.616210+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:57:17.616210+0000","last_undegraded":"2024-03-04T06:57:17.616210+0000","last_fullsized":"2024-03-04T06:57:17.616210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154620+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:57:23.154620+0000","last_peered":"2024-03-04T06:57:23.154620+0000","last_clean":"2024-03-04T06:57:23.154620+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:57:23.154620+0000","last_undegraded":"2024-03-04T06:57:23.154620+0000","last_fullsized":"2024-03-04T06:57:23.154620+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007066+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:58:35.007066+0000","last_peered":"2024-03-04T06:58:35.007066+0000","last_clean":"2024-03-04T06:58:35.007066+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:58:35.007066+0000","last_undegraded":"2024-03-04T06:58:35.007066+0000","last_fullsized":"2024-03-04T06:58:35.007066+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4720,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394889+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:58:23.394889+0000","last_peered":"2024-03-04T06:58:23.394889+0000","last_clean":"2024-03-04T06:58:23.394889+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:58:23.394889+0000","last_undegraded":"2024-03-04T06:58:23.394889+0000","last_fullsized":"2024-03-04T06:58:23.394889+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154658+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:57:23.154658+0000","last_peered":"2024-03-04T06:57:23.154658+0000","last_clean":"2024-03-04T06:57:23.154658+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:57:23.154658+0000","last_undegraded":"2024-03-04T06:57:23.154658+0000","last_fullsized":"2024-03-04T06:57:23.154658+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009678+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:59:00.009678+0000","last_peered":"2024-03-04T06:59:00.009678+0000","last_clean":"2024-03-04T06:59:00.009678+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:59:00.009678+0000","last_undegraded":"2024-03-04T06:59:00.009678+0000","last_fullsized":"2024-03-04T06:59:00.009678+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5555,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.157094+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:57:48.157094+0000","last_peered":"2024-03-04T06:57:48.157094+0000","last_clean":"2024-03-04T06:57:48.157094+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:57:48.157094+0000","last_undegraded":"2024-03-04T06:57:48.157094+0000","last_fullsized":"2024-03-04T06:57:48.157094+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553540+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:59:04.553540+0000","last_peered":"2024-03-04T06:59:04.553540+0000","last_clean":"2024-03-04T06:59:04.553540+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:59:04.553540+0000","last_undegraded":"2024-03-04T06:59:04.553540+0000","last_fullsized":"2024-03-04T06:59:04.553540+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232398+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:58:08.232398+0000","last_peered":"2024-03-04T06:58:08.232398+0000","last_clean":"2024-03-04T06:58:08.232398+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:58:08.232398+0000","last_undegraded":"2024-03-04T06:58:08.232398+0000","last_fullsized":"2024-03-04T06:58:08.232398+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394833+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:58:23.394833+0000","last_peered":"2024-03-04T06:58:23.394833+0000","last_clean":"2024-03-04T06:58:23.394833+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:58:23.394833+0000","last_undegraded":"2024-03-04T06:58:23.394833+0000","last_fullsized":"2024-03-04T06:58:23.394833+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394877+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:58:23.394877+0000","last_peered":"2024-03-04T06:58:23.394877+0000","last_clean":"2024-03-04T06:58:23.394877+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:58:23.394877+0000","last_undegraded":"2024-03-04T06:58:23.394877+0000","last_fullsized":"2024-03-04T06:58:23.394877+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553601+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:59:04.553601+0000","last_peered":"2024-03-04T06:59:04.553601+0000","last_clean":"2024-03-04T06:59:04.553601+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:59:04.553601+0000","last_undegraded":"2024-03-04T06:59:04.553601+0000","last_fullsized":"2024-03-04T06:59:04.553601+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4367,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392018+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:57:58.392018+0000","last_peered":"2024-03-04T06:57:58.392018+0000","last_clean":"2024-03-04T06:57:58.392018+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:57:58.392018+0000","last_undegraded":"2024-03-04T06:57:58.392018+0000","last_fullsized":"2024-03-04T06:57:58.392018+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.157162+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:57:48.157162+0000","last_peered":"2024-03-04T06:57:48.157162+0000","last_clean":"2024-03-04T06:57:48.157162+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:57:48.157162+0000","last_undegraded":"2024-03-04T06:57:48.157162+0000","last_fullsized":"2024-03-04T06:57:48.157162+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951665+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:57:52.951665+0000","last_peered":"2024-03-04T06:57:52.951665+0000","last_clean":"2024-03-04T06:57:52.951665+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:57:52.951665+0000","last_undegraded":"2024-03-04T06:57:52.951665+0000","last_fullsized":"2024-03-04T06:57:52.951665+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4601,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:44.551323+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:58:44.551323+0000","last_peered":"2024-03-04T06:58:44.551323+0000","last_clean":"2024-03-04T06:58:44.551323+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:58:44.551323+0000","last_undegraded":"2024-03-04T06:58:44.551323+0000","last_fullsized":"2024-03-04T06:58:44.551323+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1246,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394915+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:58:23.394915+0000","last_peered":"2024-03-04T06:58:23.394915+0000","last_clean":"2024-03-04T06:58:23.394915+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:58:23.394915+0000","last_undegraded":"2024-03-04T06:58:23.394915+0000","last_fullsized":"2024-03-04T06:58:23.394915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553631+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:59:04.553631+0000","last_peered":"2024-03-04T06:59:04.553631+0000","last_clean":"2024-03-04T06:59:04.553631+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:59:04.553631+0000","last_undegraded":"2024-03-04T06:59:04.553631+0000","last_fullsized":"2024-03-04T06:59:04.553631+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230189+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:57:48.230189+0000","last_peered":"2024-03-04T06:57:48.230189+0000","last_clean":"2024-03-04T06:57:48.230189+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:57:48.230189+0000","last_undegraded":"2024-03-04T06:57:48.230189+0000","last_fullsized":"2024-03-04T06:57:48.230189+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:33.389246+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:57:33.389246+0000","last_peered":"2024-03-04T06:57:33.389246+0000","last_clean":"2024-03-04T06:57:33.389246+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:57:33.389246+0000","last_undegraded":"2024-03-04T06:57:33.389246+0000","last_fullsized":"2024-03-04T06:57:33.389246+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962003+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:59:17.962003+0000","last_peered":"2024-03-04T06:59:17.962003+0000","last_clean":"2024-03-04T06:59:17.962003+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:59:17.962003+0000","last_undegraded":"2024-03-04T06:59:17.962003+0000","last_fullsized":"2024-03-04T06:59:17.962003+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006538+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:58:28.006538+0000","last_peered":"2024-03-04T06:58:28.006538+0000","last_clean":"2024-03-04T06:58:28.006538+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:58:28.006538+0000","last_undegraded":"2024-03-04T06:58:28.006538+0000","last_fullsized":"2024-03-04T06:58:28.006538+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007105+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:58:35.007105+0000","last_peered":"2024-03-04T06:58:35.007105+0000","last_clean":"2024-03-04T06:58:35.007105+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:58:35.007105+0000","last_undegraded":"2024-03-04T06:58:35.007105+0000","last_fullsized":"2024-03-04T06:58:35.007105+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:23.154682+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:57:23.154682+0000","last_peered":"2024-03-04T06:57:23.154682+0000","last_clean":"2024-03-04T06:57:23.154682+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:57:23.154682+0000","last_undegraded":"2024-03-04T06:57:23.154682+0000","last_fullsized":"2024-03-04T06:57:23.154682+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232435+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:58:08.232435+0000","last_peered":"2024-03-04T06:58:08.232435+0000","last_clean":"2024-03-04T06:58:08.232435+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:58:08.232435+0000","last_undegraded":"2024-03-04T06:58:08.232435+0000","last_fullsized":"2024-03-04T06:58:08.232435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007138+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:58:35.007138+0000","last_peered":"2024-03-04T06:58:35.007138+0000","last_clean":"2024-03-04T06:58:35.007138+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:58:35.007138+0000","last_undegraded":"2024-03-04T06:58:35.007138+0000","last_fullsized":"2024-03-04T06:58:35.007138+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949325+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:57:32.949325+0000","last_peered":"2024-03-04T06:57:32.949325+0000","last_clean":"2024-03-04T06:57:32.949325+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:57:32.949325+0000","last_undegraded":"2024-03-04T06:57:32.949325+0000","last_fullsized":"2024-03-04T06:57:32.949325+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009646+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:59:00.009646+0000","last_peered":"2024-03-04T06:59:00.009646+0000","last_clean":"2024-03-04T06:59:00.009646+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:59:00.009646+0000","last_undegraded":"2024-03-04T06:59:00.009646+0000","last_fullsized":"2024-03-04T06:59:00.009646+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1121,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951615+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:57:52.951615+0000","last_peered":"2024-03-04T06:57:52.951615+0000","last_clean":"2024-03-04T06:57:52.951615+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:57:52.951615+0000","last_undegraded":"2024-03-04T06:57:52.951615+0000","last_fullsized":"2024-03-04T06:57:52.951615+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:12.998327+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:57:12.998327+0000","last_peered":"2024-03-04T06:57:12.998327+0000","last_clean":"2024-03-04T06:57:12.998327+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:57:12.998327+0000","last_undegraded":"2024-03-04T06:57:12.998327+0000","last_fullsized":"2024-03-04T06:57:12.998327+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.234922+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:58:28.234922+0000","last_peered":"2024-03-04T06:58:28.234922+0000","last_clean":"2024-03-04T06:58:28.234922+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:58:28.234922+0000","last_undegraded":"2024-03-04T06:58:28.234922+0000","last_fullsized":"2024-03-04T06:58:28.234922+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503500,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648147,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142454,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287101,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997807,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885864,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937441,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792794,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:01:41.496 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:41.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:41.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:41.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:41.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:41.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:41.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:41.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:41.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:41.497 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:41.497 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:01:42.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:42 smithi203 ceph-mon[85573]: pgmap v1115: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:42.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:42 smithi203 ceph-mon[85573]: from='client.34677 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:42.686 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:42 smithi137 ceph-mon[88869]: pgmap v1115: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:42.686 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:42 smithi137 ceph-mon[88869]: from='client.34677 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:42.686 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:42 smithi137 ceph-mon[91314]: pgmap v1115: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:42.686 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:42 smithi137 ceph-mon[91314]: from='client.34677 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:44.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:44 smithi203 ceph-mon[85573]: pgmap v1116: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:44.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:44 smithi137 ceph-mon[88869]: pgmap v1116: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:44.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:44 smithi137 ceph-mon[91314]: pgmap v1116: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:45.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:01:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:01:45] "GET /metrics HTTP/1.1" 200 36336 "" "Prometheus/2.43.0" 2024-03-04T07:01:46.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:46 smithi203 ceph-mon[85573]: pgmap v1117: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:46.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:46 smithi137 ceph-mon[88869]: pgmap v1117: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:46.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:46 smithi137 ceph-mon[91314]: pgmap v1117: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:48.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:48 smithi203 ceph-mon[85573]: pgmap v1118: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:48.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:48 smithi137 ceph-mon[88869]: pgmap v1118: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:48.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:48 smithi137 ceph-mon[91314]: pgmap v1118: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:50.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:50 smithi203 ceph-mon[85573]: pgmap v1119: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:50.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:50 smithi137 ceph-mon[88869]: pgmap v1119: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:50.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:50 smithi137 ceph-mon[91314]: pgmap v1119: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:51.499 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:01:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:01:52.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:52 smithi137 ceph-mon[91314]: pgmap v1120: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:52.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:52 smithi137 ceph-mon[88869]: pgmap v1120: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:52.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:52 smithi203 ceph-mon[85573]: pgmap v1120: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:01:53.630 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:01:54.286 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1121,"stamp":"2024-03-04T07:01:52.583303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003910"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549208+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:58:24.549208+0000","last_peered":"2024-03-04T06:58:24.549208+0000","last_clean":"2024-03-04T06:58:24.549208+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:58:24.549208+0000","last_undegraded":"2024-03-04T06:58:24.549208+0000","last_fullsized":"2024-03-04T06:58:24.549208+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.165005+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:59:03.165005+0000","last_peered":"2024-03-04T06:59:03.165005+0000","last_clean":"2024-03-04T06:59:03.165005+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:59:03.165005+0000","last_undegraded":"2024-03-04T06:59:03.165005+0000","last_fullsized":"2024-03-04T06:59:03.165005+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006644+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:58:28.006644+0000","last_peered":"2024-03-04T06:58:28.006644+0000","last_clean":"2024-03-04T06:58:28.006644+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:58:28.006644+0000","last_undegraded":"2024-03-04T06:58:28.006644+0000","last_fullsized":"2024-03-04T06:58:28.006644+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958856+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:58:52.958856+0000","last_peered":"2024-03-04T06:58:52.958856+0000","last_clean":"2024-03-04T06:58:52.958856+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:58:52.958856+0000","last_undegraded":"2024-03-04T06:58:52.958856+0000","last_fullsized":"2024-03-04T06:58:52.958856+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543619+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:57:34.543619+0000","last_peered":"2024-03-04T06:57:34.543619+0000","last_clean":"2024-03-04T06:57:34.543619+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:57:34.543619+0000","last_undegraded":"2024-03-04T06:57:34.543619+0000","last_fullsized":"2024-03-04T06:57:34.543619+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958813+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:58:52.958813+0000","last_peered":"2024-03-04T06:58:52.958813+0000","last_clean":"2024-03-04T06:58:52.958813+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:58:52.958813+0000","last_undegraded":"2024-03-04T06:58:52.958813+0000","last_fullsized":"2024-03-04T06:58:52.958813+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543594+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:57:34.543594+0000","last_peered":"2024-03-04T06:57:34.543594+0000","last_clean":"2024-03-04T06:57:34.543594+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:57:34.543594+0000","last_undegraded":"2024-03-04T06:57:34.543594+0000","last_fullsized":"2024-03-04T06:57:34.543594+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001597+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:57:45.001597+0000","last_peered":"2024-03-04T06:57:45.001597+0000","last_clean":"2024-03-04T06:57:45.001597+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:57:45.001597+0000","last_undegraded":"2024-03-04T06:57:45.001597+0000","last_fullsized":"2024-03-04T06:57:45.001597+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1065,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541782+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:57:19.541782+0000","last_peered":"2024-03-04T06:57:19.541782+0000","last_clean":"2024-03-04T06:57:19.541782+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:57:19.541782+0000","last_undegraded":"2024-03-04T06:57:19.541782+0000","last_fullsized":"2024-03-04T06:57:19.541782+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239534+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:59:08.239534+0000","last_peered":"2024-03-04T06:59:08.239534+0000","last_clean":"2024-03-04T06:59:08.239534+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:59:08.239534+0000","last_undegraded":"2024-03-04T06:59:08.239534+0000","last_fullsized":"2024-03-04T06:59:08.239534+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239472+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:59:08.239472+0000","last_peered":"2024-03-04T06:59:08.239472+0000","last_clean":"2024-03-04T06:59:08.239472+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:59:08.239472+0000","last_undegraded":"2024-03-04T06:59:08.239472+0000","last_fullsized":"2024-03-04T06:59:08.239472+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:57.620940+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:57:57.620940+0000","last_peered":"2024-03-04T06:57:57.620940+0000","last_clean":"2024-03-04T06:57:57.620940+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:57:57.620940+0000","last_undegraded":"2024-03-04T06:57:57.620940+0000","last_fullsized":"2024-03-04T06:57:57.620940+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999343+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:57:24.999343+0000","last_peered":"2024-03-04T06:57:24.999343+0000","last_clean":"2024-03-04T06:57:24.999343+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:57:24.999343+0000","last_undegraded":"2024-03-04T06:57:24.999343+0000","last_fullsized":"2024-03-04T06:57:24.999343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001313+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:57:38.001313+0000","last_peered":"2024-03-04T06:57:38.001313+0000","last_clean":"2024-03-04T06:57:38.001313+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:57:38.001313+0000","last_undegraded":"2024-03-04T06:57:38.001313+0000","last_fullsized":"2024-03-04T06:57:38.001313+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:13.159769+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:58:13.159769+0000","last_peered":"2024-03-04T06:58:13.159769+0000","last_clean":"2024-03-04T06:58:13.159769+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:58:13.159769+0000","last_undegraded":"2024-03-04T06:58:13.159769+0000","last_fullsized":"2024-03-04T06:58:13.159769+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953787+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:58:12.953787+0000","last_peered":"2024-03-04T06:58:12.953787+0000","last_clean":"2024-03-04T06:58:12.953787+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:58:12.953787+0000","last_undegraded":"2024-03-04T06:58:12.953787+0000","last_fullsized":"2024-03-04T06:58:12.953787+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953915+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:58:12.953915+0000","last_peered":"2024-03-04T06:58:12.953915+0000","last_clean":"2024-03-04T06:58:12.953915+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:58:12.953915+0000","last_undegraded":"2024-03-04T06:58:12.953915+0000","last_fullsized":"2024-03-04T06:58:12.953915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397463+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:58:48.397463+0000","last_peered":"2024-03-04T06:58:48.397463+0000","last_clean":"2024-03-04T06:58:48.397463+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:58:48.397463+0000","last_undegraded":"2024-03-04T06:58:48.397463+0000","last_fullsized":"2024-03-04T06:58:48.397463+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:59:04.553588+0000","last_peered":"2024-03-04T06:59:04.553588+0000","last_clean":"2024-03-04T06:59:04.553588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:59:04.553588+0000","last_undegraded":"2024-03-04T06:59:04.553588+0000","last_fullsized":"2024-03-04T06:59:04.553588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1306,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006697+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:58:28.006697+0000","last_peered":"2024-03-04T06:58:28.006697+0000","last_clean":"2024-03-04T06:58:28.006697+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:58:28.006697+0000","last_undegraded":"2024-03-04T06:58:28.006697+0000","last_fullsized":"2024-03-04T06:58:28.006697+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014206+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:59:45.014206+0000","last_peered":"2024-03-04T06:59:45.014206+0000","last_clean":"2024-03-04T06:59:45.014206+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:59:45.014206+0000","last_undegraded":"2024-03-04T06:59:45.014206+0000","last_fullsized":"2024-03-04T06:59:45.014206+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014216+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:59:45.014216+0000","last_peered":"2024-03-04T06:59:45.014216+0000","last_clean":"2024-03-04T06:59:45.014216+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:59:45.014216+0000","last_undegraded":"2024-03-04T06:59:45.014216+0000","last_fullsized":"2024-03-04T06:59:45.014216+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006681+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:58:28.006681+0000","last_peered":"2024-03-04T06:58:28.006681+0000","last_clean":"2024-03-04T06:58:28.006681+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:58:28.006681+0000","last_undegraded":"2024-03-04T06:58:28.006681+0000","last_fullsized":"2024-03-04T06:58:28.006681+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1235,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386420+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:57:08.386420+0000","last_peered":"2024-03-04T06:57:08.386420+0000","last_clean":"2024-03-04T06:57:08.386420+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:57:08.386420+0000","last_undegraded":"2024-03-04T06:57:08.386420+0000","last_fullsized":"2024-03-04T06:57:08.386420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1222,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386390+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:57:08.386390+0000","last_peered":"2024-03-04T06:57:08.386390+0000","last_clean":"2024-03-04T06:57:08.386390+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:57:08.386390+0000","last_undegraded":"2024-03-04T06:57:08.386390+0000","last_fullsized":"2024-03-04T06:57:08.386390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543632+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:57:34.543632+0000","last_peered":"2024-03-04T06:57:34.543632+0000","last_clean":"2024-03-04T06:57:34.543632+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:57:34.543632+0000","last_undegraded":"2024-03-04T06:57:34.543632+0000","last_fullsized":"2024-03-04T06:57:34.543632+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958870+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:58:52.958870+0000","last_peered":"2024-03-04T06:58:52.958870+0000","last_clean":"2024-03-04T06:58:52.958870+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:58:52.958870+0000","last_undegraded":"2024-03-04T06:58:52.958870+0000","last_fullsized":"2024-03-04T06:58:52.958870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001694+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:57:45.001694+0000","last_peered":"2024-03-04T06:57:45.001694+0000","last_clean":"2024-03-04T06:57:45.001694+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:57:45.001694+0000","last_undegraded":"2024-03-04T06:57:45.001694+0000","last_fullsized":"2024-03-04T06:57:45.001694+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1190,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:17.623076+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:58:17.623076+0000","last_peered":"2024-03-04T06:58:17.623076+0000","last_clean":"2024-03-04T06:58:17.623076+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:58:17.623076+0000","last_undegraded":"2024-03-04T06:58:17.623076+0000","last_fullsized":"2024-03-04T06:58:17.623076+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:56:58.224901+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:56:58.224901+0000","last_peered":"2024-03-04T06:56:58.224901+0000","last_clean":"2024-03-04T06:56:58.224901+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:56:58.224901+0000","last_undegraded":"2024-03-04T06:56:58.224901+0000","last_fullsized":"2024-03-04T06:56:58.224901+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006622+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:58:28.006622+0000","last_peered":"2024-03-04T06:58:28.006622+0000","last_clean":"2024-03-04T06:58:28.006622+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:58:28.006622+0000","last_undegraded":"2024-03-04T06:58:28.006622+0000","last_fullsized":"2024-03-04T06:58:28.006622+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999328+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:57:24.999328+0000","last_peered":"2024-03-04T06:57:24.999328+0000","last_clean":"2024-03-04T06:57:24.999328+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:57:24.999328+0000","last_undegraded":"2024-03-04T06:57:24.999328+0000","last_fullsized":"2024-03-04T06:57:24.999328+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999296+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:57:24.999296+0000","last_peered":"2024-03-04T06:57:24.999296+0000","last_clean":"2024-03-04T06:57:24.999296+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:57:24.999296+0000","last_undegraded":"2024-03-04T06:57:24.999296+0000","last_fullsized":"2024-03-04T06:57:24.999296+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956356+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:58:32.956356+0000","last_peered":"2024-03-04T06:58:32.956356+0000","last_clean":"2024-03-04T06:58:32.956356+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:58:32.956356+0000","last_undegraded":"2024-03-04T06:58:32.956356+0000","last_fullsized":"2024-03-04T06:58:32.956356+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162696+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:58:38.162696+0000","last_peered":"2024-03-04T06:58:38.162696+0000","last_clean":"2024-03-04T06:58:38.162696+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:58:38.162696+0000","last_undegraded":"2024-03-04T06:58:38.162696+0000","last_fullsized":"2024-03-04T06:58:38.162696+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239549+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:59:08.239549+0000","last_peered":"2024-03-04T06:59:08.239549+0000","last_clean":"2024-03-04T06:59:08.239549+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:59:08.239549+0000","last_undegraded":"2024-03-04T06:59:08.239549+0000","last_fullsized":"2024-03-04T06:59:08.239549+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956414+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:58:32.956414+0000","last_peered":"2024-03-04T06:58:32.956414+0000","last_clean":"2024-03-04T06:58:32.956414+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:58:32.956414+0000","last_undegraded":"2024-03-04T06:58:32.956414+0000","last_fullsized":"2024-03-04T06:58:32.956414+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956402+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:58:32.956402+0000","last_peered":"2024-03-04T06:58:32.956402+0000","last_clean":"2024-03-04T06:58:32.956402+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:58:32.956402+0000","last_undegraded":"2024-03-04T06:58:32.956402+0000","last_fullsized":"2024-03-04T06:58:32.956402+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:03.003999+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:58:03.003999+0000","last_peered":"2024-03-04T06:58:03.003999+0000","last_clean":"2024-03-04T06:58:03.003999+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:58:03.003999+0000","last_undegraded":"2024-03-04T06:58:03.003999+0000","last_fullsized":"2024-03-04T06:58:03.003999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162740+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:58:38.162740+0000","last_peered":"2024-03-04T06:58:38.162740+0000","last_clean":"2024-03-04T06:58:38.162740+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:58:38.162740+0000","last_undegraded":"2024-03-04T06:58:38.162740+0000","last_fullsized":"2024-03-04T06:58:38.162740+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:37.618704+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:57:37.618704+0000","last_peered":"2024-03-04T06:57:37.618704+0000","last_clean":"2024-03-04T06:57:37.618704+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:57:37.618704+0000","last_undegraded":"2024-03-04T06:57:37.618704+0000","last_fullsized":"2024-03-04T06:57:37.618704+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1131,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237167+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:58:48.237167+0000","last_peered":"2024-03-04T06:58:48.237167+0000","last_clean":"2024-03-04T06:58:48.237167+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:58:48.237167+0000","last_undegraded":"2024-03-04T06:58:48.237167+0000","last_fullsized":"2024-03-04T06:58:48.237167+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541754+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:57:19.541754+0000","last_peered":"2024-03-04T06:57:19.541754+0000","last_clean":"2024-03-04T06:57:19.541754+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:57:19.541754+0000","last_undegraded":"2024-03-04T06:57:19.541754+0000","last_fullsized":"2024-03-04T06:57:19.541754+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001343+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:57:38.001343+0000","last_peered":"2024-03-04T06:57:38.001343+0000","last_clean":"2024-03-04T06:57:38.001343+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:57:38.001343+0000","last_undegraded":"2024-03-04T06:57:38.001343+0000","last_fullsized":"2024-03-04T06:57:38.001343+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397438+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:58:48.397438+0000","last_peered":"2024-03-04T06:58:48.397438+0000","last_clean":"2024-03-04T06:58:48.397438+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:58:48.397438+0000","last_undegraded":"2024-03-04T06:58:48.397438+0000","last_fullsized":"2024-03-04T06:58:48.397438+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953851+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:58:12.953851+0000","last_peered":"2024-03-04T06:58:12.953851+0000","last_clean":"2024-03-04T06:58:12.953851+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:58:12.953851+0000","last_undegraded":"2024-03-04T06:58:12.953851+0000","last_fullsized":"2024-03-04T06:58:12.953851+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555834+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:59:24.555834+0000","last_peered":"2024-03-04T06:59:24.555834+0000","last_clean":"2024-03-04T06:59:24.555834+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:59:24.555834+0000","last_undegraded":"2024-03-04T06:59:24.555834+0000","last_fullsized":"2024-03-04T06:59:24.555834+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237147+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:58:48.237147+0000","last_peered":"2024-03-04T06:58:48.237147+0000","last_clean":"2024-03-04T06:58:48.237147+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:58:48.237147+0000","last_undegraded":"2024-03-04T06:58:48.237147+0000","last_fullsized":"2024-03-04T06:58:48.237147+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237122+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:58:48.237122+0000","last_peered":"2024-03-04T06:58:48.237122+0000","last_clean":"2024-03-04T06:58:48.237122+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:58:48.237122+0000","last_undegraded":"2024-03-04T06:58:48.237122+0000","last_fullsized":"2024-03-04T06:58:48.237122+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397404+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:58:48.397404+0000","last_peered":"2024-03-04T06:58:48.397404+0000","last_clean":"2024-03-04T06:58:48.397404+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:58:48.397404+0000","last_undegraded":"2024-03-04T06:58:48.397404+0000","last_fullsized":"2024-03-04T06:58:48.397404+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555799+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:59:24.555799+0000","last_peered":"2024-03-04T06:59:24.555799+0000","last_clean":"2024-03-04T06:59:24.555799+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:59:24.555799+0000","last_undegraded":"2024-03-04T06:59:24.555799+0000","last_fullsized":"2024-03-04T06:59:24.555799+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3578,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.391939+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:57:58.391939+0000","last_peered":"2024-03-04T06:57:58.391939+0000","last_clean":"2024-03-04T06:57:58.391939+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:57:58.391939+0000","last_undegraded":"2024-03-04T06:57:58.391939+0000","last_fullsized":"2024-03-04T06:57:58.391939+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:32.631361+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:59:32.631361+0000","last_peered":"2024-03-04T06:59:32.631361+0000","last_clean":"2024-03-04T06:59:32.631361+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:59:32.631361+0000","last_undegraded":"2024-03-04T06:59:32.631361+0000","last_fullsized":"2024-03-04T06:59:32.631361+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553616+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:59:04.553616+0000","last_peered":"2024-03-04T06:59:04.553616+0000","last_clean":"2024-03-04T06:59:04.553616+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:59:04.553616+0000","last_undegraded":"2024-03-04T06:59:04.553616+0000","last_fullsized":"2024-03-04T06:59:04.553616+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17117,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006566+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:58:28.006566+0000","last_peered":"2024-03-04T06:58:28.006566+0000","last_clean":"2024-03-04T06:58:28.006566+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:58:28.006566+0000","last_undegraded":"2024-03-04T06:58:28.006566+0000","last_fullsized":"2024-03-04T06:58:28.006566+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164900+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:59:03.164900+0000","last_peered":"2024-03-04T06:59:03.164900+0000","last_clean":"2024-03-04T06:59:03.164900+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:59:03.164900+0000","last_undegraded":"2024-03-04T06:59:03.164900+0000","last_fullsized":"2024-03-04T06:59:03.164900+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164981+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:59:03.164981+0000","last_peered":"2024-03-04T06:59:03.164981+0000","last_clean":"2024-03-04T06:59:03.164981+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:59:03.164981+0000","last_undegraded":"2024-03-04T06:59:03.164981+0000","last_fullsized":"2024-03-04T06:59:03.164981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962033+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:59:17.962033+0000","last_peered":"2024-03-04T06:59:17.962033+0000","last_clean":"2024-03-04T06:59:17.962033+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:59:17.962033+0000","last_undegraded":"2024-03-04T06:59:17.962033+0000","last_fullsized":"2024-03-04T06:59:17.962033+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4387,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006651+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:58:28.006651+0000","last_peered":"2024-03-04T06:58:28.006651+0000","last_clean":"2024-03-04T06:58:28.006651+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:58:28.006651+0000","last_undegraded":"2024-03-04T06:58:28.006651+0000","last_fullsized":"2024-03-04T06:58:28.006651+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164925+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:59:03.164925+0000","last_peered":"2024-03-04T06:59:03.164925+0000","last_clean":"2024-03-04T06:59:03.164925+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:59:03.164925+0000","last_undegraded":"2024-03-04T06:59:03.164925+0000","last_fullsized":"2024-03-04T06:59:03.164925+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.961943+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:59:17.961943+0000","last_peered":"2024-03-04T06:59:17.961943+0000","last_clean":"2024-03-04T06:59:17.961943+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:59:17.961943+0000","last_undegraded":"2024-03-04T06:59:17.961943+0000","last_fullsized":"2024-03-04T06:59:17.961943+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625641+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:58:42.625641+0000","last_peered":"2024-03-04T06:58:42.625641+0000","last_clean":"2024-03-04T06:58:42.625641+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:58:42.625641+0000","last_undegraded":"2024-03-04T06:58:42.625641+0000","last_fullsized":"2024-03-04T06:58:42.625641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5640,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392060+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:57:58.392060+0000","last_peered":"2024-03-04T06:57:58.392060+0000","last_clean":"2024-03-04T06:57:58.392060+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:57:58.392060+0000","last_undegraded":"2024-03-04T06:57:58.392060+0000","last_fullsized":"2024-03-04T06:57:58.392060+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1257,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168065+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:59:33.168065+0000","last_peered":"2024-03-04T06:59:33.168065+0000","last_clean":"2024-03-04T06:59:33.168065+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:59:33.168065+0000","last_undegraded":"2024-03-04T06:59:33.168065+0000","last_fullsized":"2024-03-04T06:59:33.168065+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:33.162083+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:58:33.162083+0000","last_peered":"2024-03-04T06:58:33.162083+0000","last_clean":"2024-03-04T06:58:33.162083+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:58:33.162083+0000","last_undegraded":"2024-03-04T06:58:33.162083+0000","last_fullsized":"2024-03-04T06:58:33.162083+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403066+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:59:38.403066+0000","last_peered":"2024-03-04T06:59:38.403066+0000","last_clean":"2024-03-04T06:59:38.403066+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:59:38.403066+0000","last_undegraded":"2024-03-04T06:59:38.403066+0000","last_fullsized":"2024-03-04T06:59:38.403066+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4016,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:24.549121+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:58:24.549121+0000","last_peered":"2024-03-04T06:58:24.549121+0000","last_clean":"2024-03-04T06:58:24.549121+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:58:24.549121+0000","last_undegraded":"2024-03-04T06:58:24.549121+0000","last_fullsized":"2024-03-04T06:58:24.549121+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1092,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230253+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:57:48.230253+0000","last_peered":"2024-03-04T06:57:48.230253+0000","last_clean":"2024-03-04T06:57:48.230253+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:57:48.230253+0000","last_undegraded":"2024-03-04T06:57:48.230253+0000","last_fullsized":"2024-03-04T06:57:48.230253+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:10.004451+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:58:10.004451+0000","last_peered":"2024-03-04T06:58:10.004451+0000","last_clean":"2024-03-04T06:58:10.004451+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:58:10.004451+0000","last_undegraded":"2024-03-04T06:58:10.004451+0000","last_fullsized":"2024-03-04T06:58:10.004451+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962020+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:59:17.962020+0000","last_peered":"2024-03-04T06:59:17.962020+0000","last_clean":"2024-03-04T06:59:17.962020+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:59:17.962020+0000","last_undegraded":"2024-03-04T06:59:17.962020+0000","last_fullsized":"2024-03-04T06:59:17.962020+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1551,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547030+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T06:58:04.547030+0000","last_peered":"2024-03-04T06:58:04.547030+0000","last_clean":"2024-03-04T06:58:04.547030+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T06:58:04.547030+0000","last_undegraded":"2024-03-04T06:58:04.547030+0000","last_fullsized":"2024-03-04T06:58:04.547030+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3951,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949380+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:57:32.949380+0000","last_peered":"2024-03-04T06:57:32.949380+0000","last_clean":"2024-03-04T06:57:32.949380+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:57:32.949380+0000","last_undegraded":"2024-03-04T06:57:32.949380+0000","last_fullsized":"2024-03-04T06:57:32.949380+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009504+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:58:58.009504+0000","last_peered":"2024-03-04T06:58:58.009504+0000","last_clean":"2024-03-04T06:58:58.009504+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:58:58.009504+0000","last_undegraded":"2024-03-04T06:58:58.009504+0000","last_fullsized":"2024-03-04T06:58:58.009504+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403043+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:59:38.403043+0000","last_peered":"2024-03-04T06:59:38.403043+0000","last_clean":"2024-03-04T06:59:38.403043+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:59:38.403043+0000","last_undegraded":"2024-03-04T06:59:38.403043+0000","last_fullsized":"2024-03-04T06:59:38.403043+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:04.547005+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T06:58:04.547005+0000","last_peered":"2024-03-04T06:58:04.547005+0000","last_clean":"2024-03-04T06:58:04.547005+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T06:58:04.547005+0000","last_undegraded":"2024-03-04T06:58:04.547005+0000","last_fullsized":"2024-03-04T06:58:04.547005+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15292,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.230222+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:57:48.230222+0000","last_peered":"2024-03-04T06:57:48.230222+0000","last_clean":"2024-03-04T06:57:48.230222+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:57:48.230222+0000","last_undegraded":"2024-03-04T06:57:48.230222+0000","last_fullsized":"2024-03-04T06:57:48.230222+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006608+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:58:28.006608+0000","last_peered":"2024-03-04T06:58:28.006608+0000","last_clean":"2024-03-04T06:58:28.006608+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:58:28.006608+0000","last_undegraded":"2024-03-04T06:58:28.006608+0000","last_fullsized":"2024-03-04T06:58:28.006608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549190+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:58:24.549190+0000","last_peered":"2024-03-04T06:58:24.549190+0000","last_clean":"2024-03-04T06:58:24.549190+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:58:24.549190+0000","last_undegraded":"2024-03-04T06:58:24.549190+0000","last_fullsized":"2024-03-04T06:58:24.549190+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164943+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:59:03.164943+0000","last_peered":"2024-03-04T06:59:03.164943+0000","last_clean":"2024-03-04T06:59:03.164943+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:59:03.164943+0000","last_undegraded":"2024-03-04T06:59:03.164943+0000","last_fullsized":"2024-03-04T06:59:03.164943+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4380,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:42.625602+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:58:42.625602+0000","last_peered":"2024-03-04T06:58:42.625602+0000","last_clean":"2024-03-04T06:58:42.625602+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:58:42.625602+0000","last_undegraded":"2024-03-04T06:58:42.625602+0000","last_fullsized":"2024-03-04T06:58:42.625602+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014181+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:59:45.014181+0000","last_peered":"2024-03-04T06:59:45.014181+0000","last_clean":"2024-03-04T06:59:45.014181+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:59:45.014181+0000","last_undegraded":"2024-03-04T06:59:45.014181+0000","last_fullsized":"2024-03-04T06:59:45.014181+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1270,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168056+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:59:33.168056+0000","last_peered":"2024-03-04T06:59:33.168056+0000","last_clean":"2024-03-04T06:59:33.168056+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:59:33.168056+0000","last_undegraded":"2024-03-04T06:59:33.168056+0000","last_fullsized":"2024-03-04T06:59:33.168056+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007125+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:58:35.007125+0000","last_peered":"2024-03-04T06:58:35.007125+0000","last_clean":"2024-03-04T06:58:35.007125+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:58:35.007125+0000","last_undegraded":"2024-03-04T06:58:35.007125+0000","last_fullsized":"2024-03-04T06:58:35.007125+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4611,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:45.014149+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:59:45.014149+0000","last_peered":"2024-03-04T06:59:45.014149+0000","last_clean":"2024-03-04T06:59:45.014149+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:59:45.014149+0000","last_undegraded":"2024-03-04T06:59:45.014149+0000","last_fullsized":"2024-03-04T06:59:45.014149+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625572+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:58:42.625572+0000","last_peered":"2024-03-04T06:58:42.625572+0000","last_clean":"2024-03-04T06:58:42.625572+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:58:42.625572+0000","last_undegraded":"2024-03-04T06:58:42.625572+0000","last_fullsized":"2024-03-04T06:58:42.625572+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1079,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232447+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:58:08.232447+0000","last_peered":"2024-03-04T06:58:08.232447+0000","last_clean":"2024-03-04T06:58:08.232447+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:58:08.232447+0000","last_undegraded":"2024-03-04T06:58:08.232447+0000","last_fullsized":"2024-03-04T06:58:08.232447+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009478+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:58:58.009478+0000","last_peered":"2024-03-04T06:58:58.009478+0000","last_clean":"2024-03-04T06:58:58.009478+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:58:58.009478+0000","last_undegraded":"2024-03-04T06:58:58.009478+0000","last_fullsized":"2024-03-04T06:58:58.009478+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4635,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:52.951690+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:57:52.951690+0000","last_peered":"2024-03-04T06:57:52.951690+0000","last_clean":"2024-03-04T06:57:52.951690+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:57:52.951690+0000","last_undegraded":"2024-03-04T06:57:52.951690+0000","last_fullsized":"2024-03-04T06:57:52.951690+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:44.551296+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:58:44.551296+0000","last_peered":"2024-03-04T06:58:44.551296+0000","last_clean":"2024-03-04T06:58:44.551296+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:58:44.551296+0000","last_undegraded":"2024-03-04T06:58:44.551296+0000","last_fullsized":"2024-03-04T06:58:44.551296+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1186,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:07.628352+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:59:07.628352+0000","last_peered":"2024-03-04T06:59:07.628352+0000","last_clean":"2024-03-04T06:59:07.628352+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:59:07.628352+0000","last_undegraded":"2024-03-04T06:59:07.628352+0000","last_fullsized":"2024-03-04T06:59:07.628352+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5159,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:32.631317+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:59:32.631317+0000","last_peered":"2024-03-04T06:59:32.631317+0000","last_clean":"2024-03-04T06:59:32.631317+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:59:32.631317+0000","last_undegraded":"2024-03-04T06:59:32.631317+0000","last_fullsized":"2024-03-04T06:59:32.631317+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.167981+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:59:33.167981+0000","last_peered":"2024-03-04T06:59:33.167981+0000","last_clean":"2024-03-04T06:59:33.167981+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:59:33.167981+0000","last_undegraded":"2024-03-04T06:59:33.167981+0000","last_fullsized":"2024-03-04T06:59:33.167981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007066+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:58:35.007066+0000","last_peered":"2024-03-04T06:58:35.007066+0000","last_clean":"2024-03-04T06:58:35.007066+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:58:35.007066+0000","last_undegraded":"2024-03-04T06:58:35.007066+0000","last_fullsized":"2024-03-04T06:58:35.007066+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4720,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394889+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:58:23.394889+0000","last_peered":"2024-03-04T06:58:23.394889+0000","last_clean":"2024-03-04T06:58:23.394889+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:58:23.394889+0000","last_undegraded":"2024-03-04T06:58:23.394889+0000","last_fullsized":"2024-03-04T06:58:23.394889+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168002+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:59:33.168002+0000","last_peered":"2024-03-04T06:59:33.168002+0000","last_clean":"2024-03-04T06:59:33.168002+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:59:33.168002+0000","last_undegraded":"2024-03-04T06:59:33.168002+0000","last_fullsized":"2024-03-04T06:59:33.168002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009678+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:59:00.009678+0000","last_peered":"2024-03-04T06:59:00.009678+0000","last_clean":"2024-03-04T06:59:00.009678+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:59:00.009678+0000","last_undegraded":"2024-03-04T06:59:00.009678+0000","last_fullsized":"2024-03-04T06:59:00.009678+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5555,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.157094+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:57:48.157094+0000","last_peered":"2024-03-04T06:57:48.157094+0000","last_clean":"2024-03-04T06:57:48.157094+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:57:48.157094+0000","last_undegraded":"2024-03-04T06:57:48.157094+0000","last_fullsized":"2024-03-04T06:57:48.157094+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553540+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:59:04.553540+0000","last_peered":"2024-03-04T06:59:04.553540+0000","last_clean":"2024-03-04T06:59:04.553540+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:59:04.553540+0000","last_undegraded":"2024-03-04T06:59:04.553540+0000","last_fullsized":"2024-03-04T06:59:04.553540+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232398+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:58:08.232398+0000","last_peered":"2024-03-04T06:58:08.232398+0000","last_clean":"2024-03-04T06:58:08.232398+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:58:08.232398+0000","last_undegraded":"2024-03-04T06:58:08.232398+0000","last_fullsized":"2024-03-04T06:58:08.232398+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394833+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:58:23.394833+0000","last_peered":"2024-03-04T06:58:23.394833+0000","last_clean":"2024-03-04T06:58:23.394833+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:58:23.394833+0000","last_undegraded":"2024-03-04T06:58:23.394833+0000","last_fullsized":"2024-03-04T06:58:23.394833+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394877+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:58:23.394877+0000","last_peered":"2024-03-04T06:58:23.394877+0000","last_clean":"2024-03-04T06:58:23.394877+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:58:23.394877+0000","last_undegraded":"2024-03-04T06:58:23.394877+0000","last_fullsized":"2024-03-04T06:58:23.394877+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553601+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:59:04.553601+0000","last_peered":"2024-03-04T06:59:04.553601+0000","last_clean":"2024-03-04T06:59:04.553601+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:59:04.553601+0000","last_undegraded":"2024-03-04T06:59:04.553601+0000","last_fullsized":"2024-03-04T06:59:04.553601+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4367,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392018+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:57:58.392018+0000","last_peered":"2024-03-04T06:57:58.392018+0000","last_clean":"2024-03-04T06:57:58.392018+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:57:58.392018+0000","last_undegraded":"2024-03-04T06:57:58.392018+0000","last_fullsized":"2024-03-04T06:57:58.392018+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.157162+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:57:48.157162+0000","last_peered":"2024-03-04T06:57:48.157162+0000","last_clean":"2024-03-04T06:57:48.157162+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:57:48.157162+0000","last_undegraded":"2024-03-04T06:57:48.157162+0000","last_fullsized":"2024-03-04T06:57:48.157162+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951665+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:57:52.951665+0000","last_peered":"2024-03-04T06:57:52.951665+0000","last_clean":"2024-03-04T06:57:52.951665+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:57:52.951665+0000","last_undegraded":"2024-03-04T06:57:52.951665+0000","last_fullsized":"2024-03-04T06:57:52.951665+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4601,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:44.551323+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:58:44.551323+0000","last_peered":"2024-03-04T06:58:44.551323+0000","last_clean":"2024-03-04T06:58:44.551323+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:58:44.551323+0000","last_undegraded":"2024-03-04T06:58:44.551323+0000","last_fullsized":"2024-03-04T06:58:44.551323+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1246,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394915+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:58:23.394915+0000","last_peered":"2024-03-04T06:58:23.394915+0000","last_clean":"2024-03-04T06:58:23.394915+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:58:23.394915+0000","last_undegraded":"2024-03-04T06:58:23.394915+0000","last_fullsized":"2024-03-04T06:58:23.394915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553631+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:59:04.553631+0000","last_peered":"2024-03-04T06:59:04.553631+0000","last_clean":"2024-03-04T06:59:04.553631+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:59:04.553631+0000","last_undegraded":"2024-03-04T06:59:04.553631+0000","last_fullsized":"2024-03-04T06:59:04.553631+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.230189+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:57:48.230189+0000","last_peered":"2024-03-04T06:57:48.230189+0000","last_clean":"2024-03-04T06:57:48.230189+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:57:48.230189+0000","last_undegraded":"2024-03-04T06:57:48.230189+0000","last_fullsized":"2024-03-04T06:57:48.230189+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403075+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:59:38.403075+0000","last_peered":"2024-03-04T06:59:38.403075+0000","last_clean":"2024-03-04T06:59:38.403075+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:59:38.403075+0000","last_undegraded":"2024-03-04T06:59:38.403075+0000","last_fullsized":"2024-03-04T06:59:38.403075+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962003+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:59:17.962003+0000","last_peered":"2024-03-04T06:59:17.962003+0000","last_clean":"2024-03-04T06:59:17.962003+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:59:17.962003+0000","last_undegraded":"2024-03-04T06:59:17.962003+0000","last_fullsized":"2024-03-04T06:59:17.962003+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006538+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:58:28.006538+0000","last_peered":"2024-03-04T06:58:28.006538+0000","last_clean":"2024-03-04T06:58:28.006538+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:58:28.006538+0000","last_undegraded":"2024-03-04T06:58:28.006538+0000","last_fullsized":"2024-03-04T06:58:28.006538+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007105+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:58:35.007105+0000","last_peered":"2024-03-04T06:58:35.007105+0000","last_clean":"2024-03-04T06:58:35.007105+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:58:35.007105+0000","last_undegraded":"2024-03-04T06:58:35.007105+0000","last_fullsized":"2024-03-04T06:58:35.007105+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168023+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:59:33.168023+0000","last_peered":"2024-03-04T06:59:33.168023+0000","last_clean":"2024-03-04T06:59:33.168023+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:59:33.168023+0000","last_undegraded":"2024-03-04T06:59:33.168023+0000","last_fullsized":"2024-03-04T06:59:33.168023+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232435+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:58:08.232435+0000","last_peered":"2024-03-04T06:58:08.232435+0000","last_clean":"2024-03-04T06:58:08.232435+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:58:08.232435+0000","last_undegraded":"2024-03-04T06:58:08.232435+0000","last_fullsized":"2024-03-04T06:58:08.232435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007138+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:58:35.007138+0000","last_peered":"2024-03-04T06:58:35.007138+0000","last_clean":"2024-03-04T06:58:35.007138+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:58:35.007138+0000","last_undegraded":"2024-03-04T06:58:35.007138+0000","last_fullsized":"2024-03-04T06:58:35.007138+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1146,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:32.949325+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:57:32.949325+0000","last_peered":"2024-03-04T06:57:32.949325+0000","last_clean":"2024-03-04T06:57:32.949325+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:57:32.949325+0000","last_undegraded":"2024-03-04T06:57:32.949325+0000","last_fullsized":"2024-03-04T06:57:32.949325+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009646+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:59:00.009646+0000","last_peered":"2024-03-04T06:59:00.009646+0000","last_clean":"2024-03-04T06:59:00.009646+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:59:00.009646+0000","last_undegraded":"2024-03-04T06:59:00.009646+0000","last_fullsized":"2024-03-04T06:59:00.009646+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1121,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951615+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:57:52.951615+0000","last_peered":"2024-03-04T06:57:52.951615+0000","last_clean":"2024-03-04T06:57:52.951615+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:57:52.951615+0000","last_undegraded":"2024-03-04T06:57:52.951615+0000","last_fullsized":"2024-03-04T06:57:52.951615+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.012471+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:59:28.012471+0000","last_peered":"2024-03-04T06:59:28.012471+0000","last_clean":"2024-03-04T06:59:28.012471+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:59:28.012471+0000","last_undegraded":"2024-03-04T06:59:28.012471+0000","last_fullsized":"2024-03-04T06:59:28.012471+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.234922+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:58:28.234922+0000","last_peered":"2024-03-04T06:58:28.234922+0000","last_clean":"2024-03-04T06:58:28.234922+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:58:28.234922+0000","last_undegraded":"2024-03-04T06:58:28.234922+0000","last_fullsized":"2024-03-04T06:58:28.234922+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503502,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648149,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142456,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287103,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997809,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885866,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937443,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792796,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:01:54.291 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:54.291 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:54.291 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:54.291 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:54.291 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:54.292 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:54.292 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:54.292 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:54.292 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:54.292 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:01:54.292 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:01:54.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:54 smithi137 ceph-mon[88869]: pgmap v1121: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:54.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:01:54.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:54 smithi137 ceph-mon[91314]: pgmap v1121: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:54.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:01:54.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:54 smithi203 ceph-mon[85573]: pgmap v1121: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:54.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:01:55.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:55 smithi203 ceph-mon[85573]: from='client.44624 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:55.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:55 smithi137 ceph-mon[88869]: from='client.44624 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:55.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:55 smithi137 ceph-mon[91314]: from='client.44624 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:01:55.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:01:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:01:55] "GET /metrics HTTP/1.1" 200 36335 "" "Prometheus/2.43.0" 2024-03-04T07:01:56.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:56 smithi203 ceph-mon[85573]: pgmap v1122: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:56.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:56 smithi137 ceph-mon[88869]: pgmap v1122: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:56.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:56 smithi137 ceph-mon[91314]: pgmap v1122: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:57.345 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 07:01:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a[121142]: logger=cleanup t=2024-03-04T07:01:56.870437897Z level=info msg="Completed cleanup jobs" duration=3.687064ms 2024-03-04T07:01:58.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:01:58 smithi203 ceph-mon[85573]: pgmap v1123: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:58.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:01:58 smithi137 ceph-mon[88869]: pgmap v1123: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:01:58.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:01:58 smithi137 ceph-mon[91314]: pgmap v1123: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:00.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:00 smithi203 ceph-mon[85573]: pgmap v1124: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:00.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:00 smithi137 ceph-mon[88869]: pgmap v1124: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:00.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:00 smithi137 ceph-mon[91314]: pgmap v1124: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:02.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:02 smithi203 ceph-mon[85573]: pgmap v1125: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:02.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:02 smithi137 ceph-mon[88869]: pgmap v1125: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:02.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:02 smithi137 ceph-mon[91314]: pgmap v1125: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:04.293 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:02:04.517 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:02:04.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:04 smithi203 ceph-mon[85573]: pgmap v1126: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:04.639 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:04 smithi137 ceph-mon[88869]: pgmap v1126: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:04.639 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:04 smithi137 ceph-mon[91314]: pgmap v1126: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:05.676 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:02:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:02:05] "GET /metrics HTTP/1.1" 200 36335 "" "Prometheus/2.43.0" 2024-03-04T07:02:06.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:06 smithi137 ceph-mon[88869]: pgmap v1127: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:06.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:06 smithi137 ceph-mon[91314]: pgmap v1127: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:06.561 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:02:06.562 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:02:06.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:06 smithi203 ceph-mon[85573]: pgmap v1127: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:07.254 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1127,"stamp":"2024-03-04T07:02:04.587023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003720"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549208+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:58:24.549208+0000","last_peered":"2024-03-04T06:58:24.549208+0000","last_clean":"2024-03-04T06:58:24.549208+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:58:24.549208+0000","last_undegraded":"2024-03-04T06:58:24.549208+0000","last_fullsized":"2024-03-04T06:58:24.549208+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.165005+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:59:03.165005+0000","last_peered":"2024-03-04T06:59:03.165005+0000","last_clean":"2024-03-04T06:59:03.165005+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:59:03.165005+0000","last_undegraded":"2024-03-04T06:59:03.165005+0000","last_fullsized":"2024-03-04T06:59:03.165005+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006644+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:58:28.006644+0000","last_peered":"2024-03-04T06:58:28.006644+0000","last_clean":"2024-03-04T06:58:28.006644+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:58:28.006644+0000","last_undegraded":"2024-03-04T06:58:28.006644+0000","last_fullsized":"2024-03-04T06:58:28.006644+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958856+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:58:52.958856+0000","last_peered":"2024-03-04T06:58:52.958856+0000","last_clean":"2024-03-04T06:58:52.958856+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:58:52.958856+0000","last_undegraded":"2024-03-04T06:58:52.958856+0000","last_fullsized":"2024-03-04T06:58:52.958856+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543619+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:57:34.543619+0000","last_peered":"2024-03-04T06:57:34.543619+0000","last_clean":"2024-03-04T06:57:34.543619+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:57:34.543619+0000","last_undegraded":"2024-03-04T06:57:34.543619+0000","last_fullsized":"2024-03-04T06:57:34.543619+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958813+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:58:52.958813+0000","last_peered":"2024-03-04T06:58:52.958813+0000","last_clean":"2024-03-04T06:58:52.958813+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:58:52.958813+0000","last_undegraded":"2024-03-04T06:58:52.958813+0000","last_fullsized":"2024-03-04T06:58:52.958813+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543594+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:57:34.543594+0000","last_peered":"2024-03-04T06:57:34.543594+0000","last_clean":"2024-03-04T06:57:34.543594+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:57:34.543594+0000","last_undegraded":"2024-03-04T06:57:34.543594+0000","last_fullsized":"2024-03-04T06:57:34.543594+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001597+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:57:45.001597+0000","last_peered":"2024-03-04T06:57:45.001597+0000","last_clean":"2024-03-04T06:57:45.001597+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:57:45.001597+0000","last_undegraded":"2024-03-04T06:57:45.001597+0000","last_fullsized":"2024-03-04T06:57:45.001597+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1065,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541782+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:57:19.541782+0000","last_peered":"2024-03-04T06:57:19.541782+0000","last_clean":"2024-03-04T06:57:19.541782+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:57:19.541782+0000","last_undegraded":"2024-03-04T06:57:19.541782+0000","last_fullsized":"2024-03-04T06:57:19.541782+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239534+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:59:08.239534+0000","last_peered":"2024-03-04T06:59:08.239534+0000","last_clean":"2024-03-04T06:59:08.239534+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:59:08.239534+0000","last_undegraded":"2024-03-04T06:59:08.239534+0000","last_fullsized":"2024-03-04T06:59:08.239534+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239472+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:59:08.239472+0000","last_peered":"2024-03-04T06:59:08.239472+0000","last_clean":"2024-03-04T06:59:08.239472+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:59:08.239472+0000","last_undegraded":"2024-03-04T06:59:08.239472+0000","last_fullsized":"2024-03-04T06:59:08.239472+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:57.620940+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:57:57.620940+0000","last_peered":"2024-03-04T06:57:57.620940+0000","last_clean":"2024-03-04T06:57:57.620940+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:57:57.620940+0000","last_undegraded":"2024-03-04T06:57:57.620940+0000","last_fullsized":"2024-03-04T06:57:57.620940+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1200,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999343+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:57:24.999343+0000","last_peered":"2024-03-04T06:57:24.999343+0000","last_clean":"2024-03-04T06:57:24.999343+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:57:24.999343+0000","last_undegraded":"2024-03-04T06:57:24.999343+0000","last_fullsized":"2024-03-04T06:57:24.999343+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001313+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:57:38.001313+0000","last_peered":"2024-03-04T06:57:38.001313+0000","last_clean":"2024-03-04T06:57:38.001313+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:57:38.001313+0000","last_undegraded":"2024-03-04T06:57:38.001313+0000","last_fullsized":"2024-03-04T06:57:38.001313+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:13.159769+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:58:13.159769+0000","last_peered":"2024-03-04T06:58:13.159769+0000","last_clean":"2024-03-04T06:58:13.159769+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:58:13.159769+0000","last_undegraded":"2024-03-04T06:58:13.159769+0000","last_fullsized":"2024-03-04T06:58:13.159769+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953787+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:58:12.953787+0000","last_peered":"2024-03-04T06:58:12.953787+0000","last_clean":"2024-03-04T06:58:12.953787+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:58:12.953787+0000","last_undegraded":"2024-03-04T06:58:12.953787+0000","last_fullsized":"2024-03-04T06:58:12.953787+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953915+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:58:12.953915+0000","last_peered":"2024-03-04T06:58:12.953915+0000","last_clean":"2024-03-04T06:58:12.953915+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:58:12.953915+0000","last_undegraded":"2024-03-04T06:58:12.953915+0000","last_fullsized":"2024-03-04T06:58:12.953915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397463+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:58:48.397463+0000","last_peered":"2024-03-04T06:58:48.397463+0000","last_clean":"2024-03-04T06:58:48.397463+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:58:48.397463+0000","last_undegraded":"2024-03-04T06:58:48.397463+0000","last_fullsized":"2024-03-04T06:58:48.397463+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:59:04.553588+0000","last_peered":"2024-03-04T06:59:04.553588+0000","last_clean":"2024-03-04T06:59:04.553588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:59:04.553588+0000","last_undegraded":"2024-03-04T06:59:04.553588+0000","last_fullsized":"2024-03-04T06:59:04.553588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1306,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006697+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:58:28.006697+0000","last_peered":"2024-03-04T06:58:28.006697+0000","last_clean":"2024-03-04T06:58:28.006697+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:58:28.006697+0000","last_undegraded":"2024-03-04T06:58:28.006697+0000","last_fullsized":"2024-03-04T06:58:28.006697+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014206+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:59:45.014206+0000","last_peered":"2024-03-04T06:59:45.014206+0000","last_clean":"2024-03-04T06:59:45.014206+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:59:45.014206+0000","last_undegraded":"2024-03-04T06:59:45.014206+0000","last_fullsized":"2024-03-04T06:59:45.014206+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014216+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:59:45.014216+0000","last_peered":"2024-03-04T06:59:45.014216+0000","last_clean":"2024-03-04T06:59:45.014216+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:59:45.014216+0000","last_undegraded":"2024-03-04T06:59:45.014216+0000","last_fullsized":"2024-03-04T06:59:45.014216+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006681+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:58:28.006681+0000","last_peered":"2024-03-04T06:58:28.006681+0000","last_clean":"2024-03-04T06:58:28.006681+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:58:28.006681+0000","last_undegraded":"2024-03-04T06:58:28.006681+0000","last_fullsized":"2024-03-04T06:58:28.006681+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1235,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386420+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:57:08.386420+0000","last_peered":"2024-03-04T06:57:08.386420+0000","last_clean":"2024-03-04T06:57:08.386420+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:57:08.386420+0000","last_undegraded":"2024-03-04T06:57:08.386420+0000","last_fullsized":"2024-03-04T06:57:08.386420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1222,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:08.386390+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:57:08.386390+0000","last_peered":"2024-03-04T06:57:08.386390+0000","last_clean":"2024-03-04T06:57:08.386390+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:57:08.386390+0000","last_undegraded":"2024-03-04T06:57:08.386390+0000","last_fullsized":"2024-03-04T06:57:08.386390+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543632+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:57:34.543632+0000","last_peered":"2024-03-04T06:57:34.543632+0000","last_clean":"2024-03-04T06:57:34.543632+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:57:34.543632+0000","last_undegraded":"2024-03-04T06:57:34.543632+0000","last_fullsized":"2024-03-04T06:57:34.543632+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958870+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:58:52.958870+0000","last_peered":"2024-03-04T06:58:52.958870+0000","last_clean":"2024-03-04T06:58:52.958870+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:58:52.958870+0000","last_undegraded":"2024-03-04T06:58:52.958870+0000","last_fullsized":"2024-03-04T06:58:52.958870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001694+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:57:45.001694+0000","last_peered":"2024-03-04T06:57:45.001694+0000","last_clean":"2024-03-04T06:57:45.001694+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:57:45.001694+0000","last_undegraded":"2024-03-04T06:57:45.001694+0000","last_fullsized":"2024-03-04T06:57:45.001694+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1190,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:17.623076+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:58:17.623076+0000","last_peered":"2024-03-04T06:58:17.623076+0000","last_clean":"2024-03-04T06:58:17.623076+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:58:17.623076+0000","last_undegraded":"2024-03-04T06:58:17.623076+0000","last_fullsized":"2024-03-04T06:58:17.623076+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.241598+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:59:28.241598+0000","last_peered":"2024-03-04T06:59:28.241598+0000","last_clean":"2024-03-04T06:59:28.241598+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:59:28.241598+0000","last_undegraded":"2024-03-04T06:59:28.241598+0000","last_fullsized":"2024-03-04T06:59:28.241598+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006622+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:58:28.006622+0000","last_peered":"2024-03-04T06:58:28.006622+0000","last_clean":"2024-03-04T06:58:28.006622+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:58:28.006622+0000","last_undegraded":"2024-03-04T06:58:28.006622+0000","last_fullsized":"2024-03-04T06:58:28.006622+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999328+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:57:24.999328+0000","last_peered":"2024-03-04T06:57:24.999328+0000","last_clean":"2024-03-04T06:57:24.999328+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:57:24.999328+0000","last_undegraded":"2024-03-04T06:57:24.999328+0000","last_fullsized":"2024-03-04T06:57:24.999328+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:24.999296+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:57:24.999296+0000","last_peered":"2024-03-04T06:57:24.999296+0000","last_clean":"2024-03-04T06:57:24.999296+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:57:24.999296+0000","last_undegraded":"2024-03-04T06:57:24.999296+0000","last_fullsized":"2024-03-04T06:57:24.999296+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956356+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:58:32.956356+0000","last_peered":"2024-03-04T06:58:32.956356+0000","last_clean":"2024-03-04T06:58:32.956356+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:58:32.956356+0000","last_undegraded":"2024-03-04T06:58:32.956356+0000","last_fullsized":"2024-03-04T06:58:32.956356+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162696+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:58:38.162696+0000","last_peered":"2024-03-04T06:58:38.162696+0000","last_clean":"2024-03-04T06:58:38.162696+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:58:38.162696+0000","last_undegraded":"2024-03-04T06:58:38.162696+0000","last_fullsized":"2024-03-04T06:58:38.162696+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239549+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:59:08.239549+0000","last_peered":"2024-03-04T06:59:08.239549+0000","last_clean":"2024-03-04T06:59:08.239549+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:59:08.239549+0000","last_undegraded":"2024-03-04T06:59:08.239549+0000","last_fullsized":"2024-03-04T06:59:08.239549+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956414+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:58:32.956414+0000","last_peered":"2024-03-04T06:58:32.956414+0000","last_clean":"2024-03-04T06:58:32.956414+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:58:32.956414+0000","last_undegraded":"2024-03-04T06:58:32.956414+0000","last_fullsized":"2024-03-04T06:58:32.956414+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956402+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:58:32.956402+0000","last_peered":"2024-03-04T06:58:32.956402+0000","last_clean":"2024-03-04T06:58:32.956402+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:58:32.956402+0000","last_undegraded":"2024-03-04T06:58:32.956402+0000","last_fullsized":"2024-03-04T06:58:32.956402+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:03.003999+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:58:03.003999+0000","last_peered":"2024-03-04T06:58:03.003999+0000","last_clean":"2024-03-04T06:58:03.003999+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:58:03.003999+0000","last_undegraded":"2024-03-04T06:58:03.003999+0000","last_fullsized":"2024-03-04T06:58:03.003999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162740+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:58:38.162740+0000","last_peered":"2024-03-04T06:58:38.162740+0000","last_clean":"2024-03-04T06:58:38.162740+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:58:38.162740+0000","last_undegraded":"2024-03-04T06:58:38.162740+0000","last_fullsized":"2024-03-04T06:58:38.162740+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:37.618704+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:57:37.618704+0000","last_peered":"2024-03-04T06:57:37.618704+0000","last_clean":"2024-03-04T06:57:37.618704+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:57:37.618704+0000","last_undegraded":"2024-03-04T06:57:37.618704+0000","last_fullsized":"2024-03-04T06:57:37.618704+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1131,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237167+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:58:48.237167+0000","last_peered":"2024-03-04T06:58:48.237167+0000","last_clean":"2024-03-04T06:58:48.237167+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:58:48.237167+0000","last_undegraded":"2024-03-04T06:58:48.237167+0000","last_fullsized":"2024-03-04T06:58:48.237167+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1051,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:19.541754+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:57:19.541754+0000","last_peered":"2024-03-04T06:57:19.541754+0000","last_clean":"2024-03-04T06:57:19.541754+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:57:19.541754+0000","last_undegraded":"2024-03-04T06:57:19.541754+0000","last_fullsized":"2024-03-04T06:57:19.541754+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1303,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:38.001343+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:57:38.001343+0000","last_peered":"2024-03-04T06:57:38.001343+0000","last_clean":"2024-03-04T06:57:38.001343+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:57:38.001343+0000","last_undegraded":"2024-03-04T06:57:38.001343+0000","last_fullsized":"2024-03-04T06:57:38.001343+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397438+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:58:48.397438+0000","last_peered":"2024-03-04T06:58:48.397438+0000","last_clean":"2024-03-04T06:58:48.397438+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:58:48.397438+0000","last_undegraded":"2024-03-04T06:58:48.397438+0000","last_fullsized":"2024-03-04T06:58:48.397438+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953851+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:58:12.953851+0000","last_peered":"2024-03-04T06:58:12.953851+0000","last_clean":"2024-03-04T06:58:12.953851+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:58:12.953851+0000","last_undegraded":"2024-03-04T06:58:12.953851+0000","last_fullsized":"2024-03-04T06:58:12.953851+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555834+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:59:24.555834+0000","last_peered":"2024-03-04T06:59:24.555834+0000","last_clean":"2024-03-04T06:59:24.555834+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:59:24.555834+0000","last_undegraded":"2024-03-04T06:59:24.555834+0000","last_fullsized":"2024-03-04T06:59:24.555834+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237147+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:58:48.237147+0000","last_peered":"2024-03-04T06:58:48.237147+0000","last_clean":"2024-03-04T06:58:48.237147+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:58:48.237147+0000","last_undegraded":"2024-03-04T06:58:48.237147+0000","last_fullsized":"2024-03-04T06:58:48.237147+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237122+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:58:48.237122+0000","last_peered":"2024-03-04T06:58:48.237122+0000","last_clean":"2024-03-04T06:58:48.237122+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:58:48.237122+0000","last_undegraded":"2024-03-04T06:58:48.237122+0000","last_fullsized":"2024-03-04T06:58:48.237122+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397404+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:58:48.397404+0000","last_peered":"2024-03-04T06:58:48.397404+0000","last_clean":"2024-03-04T06:58:48.397404+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:58:48.397404+0000","last_undegraded":"2024-03-04T06:58:48.397404+0000","last_fullsized":"2024-03-04T06:58:48.397404+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555799+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:59:24.555799+0000","last_peered":"2024-03-04T06:59:24.555799+0000","last_clean":"2024-03-04T06:59:24.555799+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:59:24.555799+0000","last_undegraded":"2024-03-04T06:59:24.555799+0000","last_fullsized":"2024-03-04T06:59:24.555799+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3578,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.391939+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T06:57:58.391939+0000","last_peered":"2024-03-04T06:57:58.391939+0000","last_clean":"2024-03-04T06:57:58.391939+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T06:57:58.391939+0000","last_undegraded":"2024-03-04T06:57:58.391939+0000","last_fullsized":"2024-03-04T06:57:58.391939+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:32.631361+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:59:32.631361+0000","last_peered":"2024-03-04T06:59:32.631361+0000","last_clean":"2024-03-04T06:59:32.631361+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:59:32.631361+0000","last_undegraded":"2024-03-04T06:59:32.631361+0000","last_fullsized":"2024-03-04T06:59:32.631361+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553616+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:59:04.553616+0000","last_peered":"2024-03-04T06:59:04.553616+0000","last_clean":"2024-03-04T06:59:04.553616+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:59:04.553616+0000","last_undegraded":"2024-03-04T06:59:04.553616+0000","last_fullsized":"2024-03-04T06:59:04.553616+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17117,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006566+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:58:28.006566+0000","last_peered":"2024-03-04T06:58:28.006566+0000","last_clean":"2024-03-04T06:58:28.006566+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:58:28.006566+0000","last_undegraded":"2024-03-04T06:58:28.006566+0000","last_fullsized":"2024-03-04T06:58:28.006566+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164900+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:59:03.164900+0000","last_peered":"2024-03-04T06:59:03.164900+0000","last_clean":"2024-03-04T06:59:03.164900+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:59:03.164900+0000","last_undegraded":"2024-03-04T06:59:03.164900+0000","last_fullsized":"2024-03-04T06:59:03.164900+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164981+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:59:03.164981+0000","last_peered":"2024-03-04T06:59:03.164981+0000","last_clean":"2024-03-04T06:59:03.164981+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:59:03.164981+0000","last_undegraded":"2024-03-04T06:59:03.164981+0000","last_fullsized":"2024-03-04T06:59:03.164981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962033+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:59:17.962033+0000","last_peered":"2024-03-04T06:59:17.962033+0000","last_clean":"2024-03-04T06:59:17.962033+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:59:17.962033+0000","last_undegraded":"2024-03-04T06:59:17.962033+0000","last_fullsized":"2024-03-04T06:59:17.962033+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4387,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006651+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:58:28.006651+0000","last_peered":"2024-03-04T06:58:28.006651+0000","last_clean":"2024-03-04T06:58:28.006651+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:58:28.006651+0000","last_undegraded":"2024-03-04T06:58:28.006651+0000","last_fullsized":"2024-03-04T06:58:28.006651+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164925+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:59:03.164925+0000","last_peered":"2024-03-04T06:59:03.164925+0000","last_clean":"2024-03-04T06:59:03.164925+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:59:03.164925+0000","last_undegraded":"2024-03-04T06:59:03.164925+0000","last_fullsized":"2024-03-04T06:59:03.164925+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.961943+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:59:17.961943+0000","last_peered":"2024-03-04T06:59:17.961943+0000","last_clean":"2024-03-04T06:59:17.961943+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:59:17.961943+0000","last_undegraded":"2024-03-04T06:59:17.961943+0000","last_fullsized":"2024-03-04T06:59:17.961943+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625641+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:58:42.625641+0000","last_peered":"2024-03-04T06:58:42.625641+0000","last_clean":"2024-03-04T06:58:42.625641+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:58:42.625641+0000","last_undegraded":"2024-03-04T06:58:42.625641+0000","last_fullsized":"2024-03-04T06:58:42.625641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5640,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392060+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T06:57:58.392060+0000","last_peered":"2024-03-04T06:57:58.392060+0000","last_clean":"2024-03-04T06:57:58.392060+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T06:57:58.392060+0000","last_undegraded":"2024-03-04T06:57:58.392060+0000","last_fullsized":"2024-03-04T06:57:58.392060+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1257,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168065+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:59:33.168065+0000","last_peered":"2024-03-04T06:59:33.168065+0000","last_clean":"2024-03-04T06:59:33.168065+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:59:33.168065+0000","last_undegraded":"2024-03-04T06:59:33.168065+0000","last_fullsized":"2024-03-04T06:59:33.168065+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:33.162083+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:58:33.162083+0000","last_peered":"2024-03-04T06:58:33.162083+0000","last_clean":"2024-03-04T06:58:33.162083+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:58:33.162083+0000","last_undegraded":"2024-03-04T06:58:33.162083+0000","last_fullsized":"2024-03-04T06:58:33.162083+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403066+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:59:38.403066+0000","last_peered":"2024-03-04T06:59:38.403066+0000","last_clean":"2024-03-04T06:59:38.403066+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:59:38.403066+0000","last_undegraded":"2024-03-04T06:59:38.403066+0000","last_fullsized":"2024-03-04T06:59:38.403066+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4016,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:24.549121+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:58:24.549121+0000","last_peered":"2024-03-04T06:58:24.549121+0000","last_clean":"2024-03-04T06:58:24.549121+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:58:24.549121+0000","last_undegraded":"2024-03-04T06:58:24.549121+0000","last_fullsized":"2024-03-04T06:58:24.549121+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244731+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:59:53.244731+0000","last_peered":"2024-03-04T06:59:53.244731+0000","last_clean":"2024-03-04T06:59:53.244731+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:59:53.244731+0000","last_undegraded":"2024-03-04T06:59:53.244731+0000","last_fullsized":"2024-03-04T06:59:53.244731+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:10.004451+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:58:10.004451+0000","last_peered":"2024-03-04T06:58:10.004451+0000","last_clean":"2024-03-04T06:58:10.004451+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:58:10.004451+0000","last_undegraded":"2024-03-04T06:58:10.004451+0000","last_fullsized":"2024-03-04T06:58:10.004451+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962020+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:59:17.962020+0000","last_peered":"2024-03-04T06:59:17.962020+0000","last_clean":"2024-03-04T06:59:17.962020+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:59:17.962020+0000","last_undegraded":"2024-03-04T06:59:17.962020+0000","last_fullsized":"2024-03-04T06:59:17.962020+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1552,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560890+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:00:04.560890+0000","last_peered":"2024-03-04T07:00:04.560890+0000","last_clean":"2024-03-04T07:00:04.560890+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:00:04.560890+0000","last_undegraded":"2024-03-04T07:00:04.560890+0000","last_fullsized":"2024-03-04T07:00:04.560890+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3952,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.965034+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:59:42.965034+0000","last_peered":"2024-03-04T06:59:42.965034+0000","last_clean":"2024-03-04T06:59:42.965034+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:59:42.965034+0000","last_undegraded":"2024-03-04T06:59:42.965034+0000","last_fullsized":"2024-03-04T06:59:42.965034+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009504+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:58:58.009504+0000","last_peered":"2024-03-04T06:58:58.009504+0000","last_clean":"2024-03-04T06:58:58.009504+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:58:58.009504+0000","last_undegraded":"2024-03-04T06:58:58.009504+0000","last_fullsized":"2024-03-04T06:58:58.009504+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403043+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:59:38.403043+0000","last_peered":"2024-03-04T06:59:38.403043+0000","last_clean":"2024-03-04T06:59:38.403043+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:59:38.403043+0000","last_undegraded":"2024-03-04T06:59:38.403043+0000","last_fullsized":"2024-03-04T06:59:38.403043+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560852+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:00:04.560852+0000","last_peered":"2024-03-04T07:00:04.560852+0000","last_clean":"2024-03-04T07:00:04.560852+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:00:04.560852+0000","last_undegraded":"2024-03-04T07:00:04.560852+0000","last_fullsized":"2024-03-04T07:00:04.560852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15293,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:53.244696+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:59:53.244696+0000","last_peered":"2024-03-04T06:59:53.244696+0000","last_clean":"2024-03-04T06:59:53.244696+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:59:53.244696+0000","last_undegraded":"2024-03-04T06:59:53.244696+0000","last_fullsized":"2024-03-04T06:59:53.244696+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006608+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:58:28.006608+0000","last_peered":"2024-03-04T06:58:28.006608+0000","last_clean":"2024-03-04T06:58:28.006608+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:58:28.006608+0000","last_undegraded":"2024-03-04T06:58:28.006608+0000","last_fullsized":"2024-03-04T06:58:28.006608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549190+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:58:24.549190+0000","last_peered":"2024-03-04T06:58:24.549190+0000","last_clean":"2024-03-04T06:58:24.549190+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:58:24.549190+0000","last_undegraded":"2024-03-04T06:58:24.549190+0000","last_fullsized":"2024-03-04T06:58:24.549190+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164943+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:59:03.164943+0000","last_peered":"2024-03-04T06:59:03.164943+0000","last_clean":"2024-03-04T06:59:03.164943+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:59:03.164943+0000","last_undegraded":"2024-03-04T06:59:03.164943+0000","last_fullsized":"2024-03-04T06:59:03.164943+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4380,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:42.625602+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:58:42.625602+0000","last_peered":"2024-03-04T06:58:42.625602+0000","last_clean":"2024-03-04T06:58:42.625602+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:58:42.625602+0000","last_undegraded":"2024-03-04T06:58:42.625602+0000","last_fullsized":"2024-03-04T06:58:42.625602+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014181+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:59:45.014181+0000","last_peered":"2024-03-04T06:59:45.014181+0000","last_clean":"2024-03-04T06:59:45.014181+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:59:45.014181+0000","last_undegraded":"2024-03-04T06:59:45.014181+0000","last_fullsized":"2024-03-04T06:59:45.014181+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1270,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168056+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:59:33.168056+0000","last_peered":"2024-03-04T06:59:33.168056+0000","last_clean":"2024-03-04T06:59:33.168056+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:59:33.168056+0000","last_undegraded":"2024-03-04T06:59:33.168056+0000","last_fullsized":"2024-03-04T06:59:33.168056+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007125+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:58:35.007125+0000","last_peered":"2024-03-04T06:58:35.007125+0000","last_clean":"2024-03-04T06:58:35.007125+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:58:35.007125+0000","last_undegraded":"2024-03-04T06:58:35.007125+0000","last_fullsized":"2024-03-04T06:58:35.007125+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4611,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:45.014149+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:59:45.014149+0000","last_peered":"2024-03-04T06:59:45.014149+0000","last_clean":"2024-03-04T06:59:45.014149+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:59:45.014149+0000","last_undegraded":"2024-03-04T06:59:45.014149+0000","last_fullsized":"2024-03-04T06:59:45.014149+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625572+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:58:42.625572+0000","last_peered":"2024-03-04T06:58:42.625572+0000","last_clean":"2024-03-04T06:58:42.625572+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:58:42.625572+0000","last_undegraded":"2024-03-04T06:58:42.625572+0000","last_fullsized":"2024-03-04T06:58:42.625572+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1079,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232447+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:58:08.232447+0000","last_peered":"2024-03-04T06:58:08.232447+0000","last_clean":"2024-03-04T06:58:08.232447+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:58:08.232447+0000","last_undegraded":"2024-03-04T06:58:08.232447+0000","last_fullsized":"2024-03-04T06:58:08.232447+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009478+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:58:58.009478+0000","last_peered":"2024-03-04T06:58:58.009478+0000","last_clean":"2024-03-04T06:58:58.009478+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:58:58.009478+0000","last_undegraded":"2024-03-04T06:58:58.009478+0000","last_fullsized":"2024-03-04T06:58:58.009478+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4635,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:52.951690+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:57:52.951690+0000","last_peered":"2024-03-04T06:57:52.951690+0000","last_clean":"2024-03-04T06:57:52.951690+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:57:52.951690+0000","last_undegraded":"2024-03-04T06:57:52.951690+0000","last_fullsized":"2024-03-04T06:57:52.951690+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:44.551296+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:58:44.551296+0000","last_peered":"2024-03-04T06:58:44.551296+0000","last_clean":"2024-03-04T06:58:44.551296+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:58:44.551296+0000","last_undegraded":"2024-03-04T06:58:44.551296+0000","last_fullsized":"2024-03-04T06:58:44.551296+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1186,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:07.628352+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:59:07.628352+0000","last_peered":"2024-03-04T06:59:07.628352+0000","last_clean":"2024-03-04T06:59:07.628352+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:59:07.628352+0000","last_undegraded":"2024-03-04T06:59:07.628352+0000","last_fullsized":"2024-03-04T06:59:07.628352+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5159,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:32.631317+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:59:32.631317+0000","last_peered":"2024-03-04T06:59:32.631317+0000","last_clean":"2024-03-04T06:59:32.631317+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:59:32.631317+0000","last_undegraded":"2024-03-04T06:59:32.631317+0000","last_fullsized":"2024-03-04T06:59:32.631317+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.167981+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:59:33.167981+0000","last_peered":"2024-03-04T06:59:33.167981+0000","last_clean":"2024-03-04T06:59:33.167981+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:59:33.167981+0000","last_undegraded":"2024-03-04T06:59:33.167981+0000","last_fullsized":"2024-03-04T06:59:33.167981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007066+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:58:35.007066+0000","last_peered":"2024-03-04T06:58:35.007066+0000","last_clean":"2024-03-04T06:58:35.007066+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:58:35.007066+0000","last_undegraded":"2024-03-04T06:58:35.007066+0000","last_fullsized":"2024-03-04T06:58:35.007066+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4720,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394889+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:58:23.394889+0000","last_peered":"2024-03-04T06:58:23.394889+0000","last_clean":"2024-03-04T06:58:23.394889+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:58:23.394889+0000","last_undegraded":"2024-03-04T06:58:23.394889+0000","last_fullsized":"2024-03-04T06:58:23.394889+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168002+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:59:33.168002+0000","last_peered":"2024-03-04T06:59:33.168002+0000","last_clean":"2024-03-04T06:59:33.168002+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:59:33.168002+0000","last_undegraded":"2024-03-04T06:59:33.168002+0000","last_fullsized":"2024-03-04T06:59:33.168002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009678+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:59:00.009678+0000","last_peered":"2024-03-04T06:59:00.009678+0000","last_clean":"2024-03-04T06:59:00.009678+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:59:00.009678+0000","last_undegraded":"2024-03-04T06:59:00.009678+0000","last_fullsized":"2024-03-04T06:59:00.009678+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5555,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:48.157094+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T06:57:48.157094+0000","last_peered":"2024-03-04T06:57:48.157094+0000","last_clean":"2024-03-04T06:57:48.157094+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T06:57:48.157094+0000","last_undegraded":"2024-03-04T06:57:48.157094+0000","last_fullsized":"2024-03-04T06:57:48.157094+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553540+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:59:04.553540+0000","last_peered":"2024-03-04T06:59:04.553540+0000","last_clean":"2024-03-04T06:59:04.553540+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:59:04.553540+0000","last_undegraded":"2024-03-04T06:59:04.553540+0000","last_fullsized":"2024-03-04T06:59:04.553540+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232398+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:58:08.232398+0000","last_peered":"2024-03-04T06:58:08.232398+0000","last_clean":"2024-03-04T06:58:08.232398+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:58:08.232398+0000","last_undegraded":"2024-03-04T06:58:08.232398+0000","last_fullsized":"2024-03-04T06:58:08.232398+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394833+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:58:23.394833+0000","last_peered":"2024-03-04T06:58:23.394833+0000","last_clean":"2024-03-04T06:58:23.394833+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:58:23.394833+0000","last_undegraded":"2024-03-04T06:58:23.394833+0000","last_fullsized":"2024-03-04T06:58:23.394833+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394877+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:58:23.394877+0000","last_peered":"2024-03-04T06:58:23.394877+0000","last_clean":"2024-03-04T06:58:23.394877+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:58:23.394877+0000","last_undegraded":"2024-03-04T06:58:23.394877+0000","last_fullsized":"2024-03-04T06:58:23.394877+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553601+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:59:04.553601+0000","last_peered":"2024-03-04T06:59:04.553601+0000","last_clean":"2024-03-04T06:59:04.553601+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:59:04.553601+0000","last_undegraded":"2024-03-04T06:59:04.553601+0000","last_fullsized":"2024-03-04T06:59:04.553601+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4367,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:58.392018+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T06:57:58.392018+0000","last_peered":"2024-03-04T06:57:58.392018+0000","last_clean":"2024-03-04T06:57:58.392018+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T06:57:58.392018+0000","last_undegraded":"2024-03-04T06:57:58.392018+0000","last_fullsized":"2024-03-04T06:57:58.392018+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:48.157162+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T06:57:48.157162+0000","last_peered":"2024-03-04T06:57:48.157162+0000","last_clean":"2024-03-04T06:57:48.157162+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T06:57:48.157162+0000","last_undegraded":"2024-03-04T06:57:48.157162+0000","last_fullsized":"2024-03-04T06:57:48.157162+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951665+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:57:52.951665+0000","last_peered":"2024-03-04T06:57:52.951665+0000","last_clean":"2024-03-04T06:57:52.951665+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:57:52.951665+0000","last_undegraded":"2024-03-04T06:57:52.951665+0000","last_fullsized":"2024-03-04T06:57:52.951665+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4601,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:44.551323+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:58:44.551323+0000","last_peered":"2024-03-04T06:58:44.551323+0000","last_clean":"2024-03-04T06:58:44.551323+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:58:44.551323+0000","last_undegraded":"2024-03-04T06:58:44.551323+0000","last_fullsized":"2024-03-04T06:58:44.551323+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1246,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394915+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:58:23.394915+0000","last_peered":"2024-03-04T06:58:23.394915+0000","last_clean":"2024-03-04T06:58:23.394915+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:58:23.394915+0000","last_undegraded":"2024-03-04T06:58:23.394915+0000","last_fullsized":"2024-03-04T06:58:23.394915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553631+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:59:04.553631+0000","last_peered":"2024-03-04T06:59:04.553631+0000","last_clean":"2024-03-04T06:59:04.553631+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:59:04.553631+0000","last_undegraded":"2024-03-04T06:59:04.553631+0000","last_fullsized":"2024-03-04T06:59:04.553631+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244661+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:59:53.244661+0000","last_peered":"2024-03-04T06:59:53.244661+0000","last_clean":"2024-03-04T06:59:53.244661+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:59:53.244661+0000","last_undegraded":"2024-03-04T06:59:53.244661+0000","last_fullsized":"2024-03-04T06:59:53.244661+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403075+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:59:38.403075+0000","last_peered":"2024-03-04T06:59:38.403075+0000","last_clean":"2024-03-04T06:59:38.403075+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:59:38.403075+0000","last_undegraded":"2024-03-04T06:59:38.403075+0000","last_fullsized":"2024-03-04T06:59:38.403075+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962003+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:59:17.962003+0000","last_peered":"2024-03-04T06:59:17.962003+0000","last_clean":"2024-03-04T06:59:17.962003+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:59:17.962003+0000","last_undegraded":"2024-03-04T06:59:17.962003+0000","last_fullsized":"2024-03-04T06:59:17.962003+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006538+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:58:28.006538+0000","last_peered":"2024-03-04T06:58:28.006538+0000","last_clean":"2024-03-04T06:58:28.006538+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:58:28.006538+0000","last_undegraded":"2024-03-04T06:58:28.006538+0000","last_fullsized":"2024-03-04T06:58:28.006538+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007105+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:58:35.007105+0000","last_peered":"2024-03-04T06:58:35.007105+0000","last_clean":"2024-03-04T06:58:35.007105+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:58:35.007105+0000","last_undegraded":"2024-03-04T06:58:35.007105+0000","last_fullsized":"2024-03-04T06:58:35.007105+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168023+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:59:33.168023+0000","last_peered":"2024-03-04T06:59:33.168023+0000","last_clean":"2024-03-04T06:59:33.168023+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:59:33.168023+0000","last_undegraded":"2024-03-04T06:59:33.168023+0000","last_fullsized":"2024-03-04T06:59:33.168023+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232435+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:58:08.232435+0000","last_peered":"2024-03-04T06:58:08.232435+0000","last_clean":"2024-03-04T06:58:08.232435+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:58:08.232435+0000","last_undegraded":"2024-03-04T06:58:08.232435+0000","last_fullsized":"2024-03-04T06:58:08.232435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007138+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:58:35.007138+0000","last_peered":"2024-03-04T06:58:35.007138+0000","last_clean":"2024-03-04T06:58:35.007138+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:58:35.007138+0000","last_undegraded":"2024-03-04T06:58:35.007138+0000","last_fullsized":"2024-03-04T06:58:35.007138+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.964990+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:59:42.964990+0000","last_peered":"2024-03-04T06:59:42.964990+0000","last_clean":"2024-03-04T06:59:42.964990+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:59:42.964990+0000","last_undegraded":"2024-03-04T06:59:42.964990+0000","last_fullsized":"2024-03-04T06:59:42.964990+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009646+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:59:00.009646+0000","last_peered":"2024-03-04T06:59:00.009646+0000","last_clean":"2024-03-04T06:59:00.009646+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:59:00.009646+0000","last_undegraded":"2024-03-04T06:59:00.009646+0000","last_fullsized":"2024-03-04T06:59:00.009646+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1121,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951615+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:57:52.951615+0000","last_peered":"2024-03-04T06:57:52.951615+0000","last_clean":"2024-03-04T06:57:52.951615+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:57:52.951615+0000","last_undegraded":"2024-03-04T06:57:52.951615+0000","last_fullsized":"2024-03-04T06:57:52.951615+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.012471+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:59:28.012471+0000","last_peered":"2024-03-04T06:59:28.012471+0000","last_clean":"2024-03-04T06:59:28.012471+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:59:28.012471+0000","last_undegraded":"2024-03-04T06:59:28.012471+0000","last_fullsized":"2024-03-04T06:59:28.012471+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.234922+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:58:28.234922+0000","last_peered":"2024-03-04T06:58:28.234922+0000","last_clean":"2024-03-04T06:58:28.234922+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:58:28.234922+0000","last_undegraded":"2024-03-04T06:58:28.234922+0000","last_fullsized":"2024-03-04T06:58:28.234922+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503505,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142459,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287106,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997812,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885868,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937446,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792799,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:02:07.259 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:07.259 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:07.259 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:07.259 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:07.259 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:07.259 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:07.260 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:07.260 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:07.260 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:07.260 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:07.260 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:02:08.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:08 smithi137 ceph-mon[88869]: from='client.44630 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:08.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:08 smithi137 ceph-mon[88869]: pgmap v1128: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:08.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:08 smithi137 ceph-mon[91314]: from='client.44630 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:08.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:08 smithi137 ceph-mon[91314]: pgmap v1128: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:08.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:08 smithi203 ceph-mon[85573]: from='client.44630 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:08.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:08 smithi203 ceph-mon[85573]: pgmap v1128: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:09.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:02:09.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:02:09.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:02:10.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:10 smithi137 ceph-mon[88869]: pgmap v1129: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:10.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:10 smithi137 ceph-mon[91314]: pgmap v1129: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:10.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:10 smithi203 ceph-mon[85573]: pgmap v1129: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:12.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:12 smithi137 ceph-mon[91314]: pgmap v1130: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:12.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:12 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:02:12.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:12 smithi137 ceph-mon[88869]: pgmap v1130: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:12.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:12 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:02:12.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:12 smithi203 ceph-mon[85573]: pgmap v1130: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:12.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:12 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:02:14.651 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:14 smithi203 ceph-mon[85573]: pgmap v1131: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:14.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:14 smithi137 ceph-mon[88869]: pgmap v1131: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:14.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:14 smithi137 ceph-mon[91314]: pgmap v1131: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:15.556 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:02:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:02:15] "GET /metrics HTTP/1.1" 200 36336 "" "Prometheus/2.43.0" 2024-03-04T07:02:16.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:16 smithi203 ceph-mon[85573]: pgmap v1132: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:16.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:16 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:16.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:16 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:16.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:16 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:16.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:16 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:16.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:16 smithi137 ceph-mon[91314]: pgmap v1132: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:16.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:16 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:16.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:16 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:16.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:16 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:16.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:16 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:16.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:16 smithi137 ceph-mon[88869]: pgmap v1132: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:16.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:16 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:16.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:16 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:16.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:16 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:16.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:16 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:17.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:02:17.481 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:02:17.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:17 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:02:17.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:17 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:02:17.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:17 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:17.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:17 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:02:17.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:17 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:02:17.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:17 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:17.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:17 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:02:17.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:17 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:02:17.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:17 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:02:18.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:18 smithi203 ceph-mon[85573]: pgmap v1133: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:18.605 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:18 smithi137 ceph-mon[88869]: pgmap v1133: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:18.606 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:18 smithi137 ceph-mon[91314]: pgmap v1133: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:19.405 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:02:19.407 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:02:20.085 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1134,"stamp":"2024-03-04T07:02:18.590857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003101"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549208+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:58:24.549208+0000","last_peered":"2024-03-04T06:58:24.549208+0000","last_clean":"2024-03-04T06:58:24.549208+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:58:24.549208+0000","last_undegraded":"2024-03-04T06:58:24.549208+0000","last_fullsized":"2024-03-04T06:58:24.549208+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.165005+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:59:03.165005+0000","last_peered":"2024-03-04T06:59:03.165005+0000","last_clean":"2024-03-04T06:59:03.165005+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:59:03.165005+0000","last_undegraded":"2024-03-04T06:59:03.165005+0000","last_fullsized":"2024-03-04T06:59:03.165005+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006644+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:58:28.006644+0000","last_peered":"2024-03-04T06:58:28.006644+0000","last_clean":"2024-03-04T06:58:28.006644+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:58:28.006644+0000","last_undegraded":"2024-03-04T06:58:28.006644+0000","last_fullsized":"2024-03-04T06:58:28.006644+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958856+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:58:52.958856+0000","last_peered":"2024-03-04T06:58:52.958856+0000","last_clean":"2024-03-04T06:58:52.958856+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:58:52.958856+0000","last_undegraded":"2024-03-04T06:58:52.958856+0000","last_fullsized":"2024-03-04T06:58:52.958856+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543619+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:57:34.543619+0000","last_peered":"2024-03-04T06:57:34.543619+0000","last_clean":"2024-03-04T06:57:34.543619+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:57:34.543619+0000","last_undegraded":"2024-03-04T06:57:34.543619+0000","last_fullsized":"2024-03-04T06:57:34.543619+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958813+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:58:52.958813+0000","last_peered":"2024-03-04T06:58:52.958813+0000","last_clean":"2024-03-04T06:58:52.958813+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:58:52.958813+0000","last_undegraded":"2024-03-04T06:58:52.958813+0000","last_fullsized":"2024-03-04T06:58:52.958813+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543594+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:57:34.543594+0000","last_peered":"2024-03-04T06:57:34.543594+0000","last_clean":"2024-03-04T06:57:34.543594+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:57:34.543594+0000","last_undegraded":"2024-03-04T06:57:34.543594+0000","last_fullsized":"2024-03-04T06:57:34.543594+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001597+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:57:45.001597+0000","last_peered":"2024-03-04T06:57:45.001597+0000","last_clean":"2024-03-04T06:57:45.001597+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:57:45.001597+0000","last_undegraded":"2024-03-04T06:57:45.001597+0000","last_fullsized":"2024-03-04T06:57:45.001597+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1066,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558470+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:59:44.558470+0000","last_peered":"2024-03-04T06:59:44.558470+0000","last_clean":"2024-03-04T06:59:44.558470+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:59:44.558470+0000","last_undegraded":"2024-03-04T06:59:44.558470+0000","last_fullsized":"2024-03-04T06:59:44.558470+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239534+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:59:08.239534+0000","last_peered":"2024-03-04T06:59:08.239534+0000","last_clean":"2024-03-04T06:59:08.239534+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:59:08.239534+0000","last_undegraded":"2024-03-04T06:59:08.239534+0000","last_fullsized":"2024-03-04T06:59:08.239534+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239472+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:59:08.239472+0000","last_peered":"2024-03-04T06:59:08.239472+0000","last_clean":"2024-03-04T06:59:08.239472+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:59:08.239472+0000","last_undegraded":"2024-03-04T06:59:08.239472+0000","last_fullsized":"2024-03-04T06:59:08.239472+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:57.620940+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:57:57.620940+0000","last_peered":"2024-03-04T06:57:57.620940+0000","last_clean":"2024-03-04T06:57:57.620940+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:57:57.620940+0000","last_undegraded":"2024-03-04T06:57:57.620940+0000","last_fullsized":"2024-03-04T06:57:57.620940+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014730+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:59:50.014730+0000","last_peered":"2024-03-04T06:59:50.014730+0000","last_clean":"2024-03-04T06:59:50.014730+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:59:50.014730+0000","last_undegraded":"2024-03-04T06:59:50.014730+0000","last_fullsized":"2024-03-04T06:59:50.014730+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015553+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:59:58.015553+0000","last_peered":"2024-03-04T06:59:58.015553+0000","last_clean":"2024-03-04T06:59:58.015553+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:59:58.015553+0000","last_undegraded":"2024-03-04T06:59:58.015553+0000","last_fullsized":"2024-03-04T06:59:58.015553+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:13.159769+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:58:13.159769+0000","last_peered":"2024-03-04T06:58:13.159769+0000","last_clean":"2024-03-04T06:58:13.159769+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:58:13.159769+0000","last_undegraded":"2024-03-04T06:58:13.159769+0000","last_fullsized":"2024-03-04T06:58:13.159769+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953787+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:58:12.953787+0000","last_peered":"2024-03-04T06:58:12.953787+0000","last_clean":"2024-03-04T06:58:12.953787+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:58:12.953787+0000","last_undegraded":"2024-03-04T06:58:12.953787+0000","last_fullsized":"2024-03-04T06:58:12.953787+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953915+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:58:12.953915+0000","last_peered":"2024-03-04T06:58:12.953915+0000","last_clean":"2024-03-04T06:58:12.953915+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:58:12.953915+0000","last_undegraded":"2024-03-04T06:58:12.953915+0000","last_fullsized":"2024-03-04T06:58:12.953915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397463+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:58:48.397463+0000","last_peered":"2024-03-04T06:58:48.397463+0000","last_clean":"2024-03-04T06:58:48.397463+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:58:48.397463+0000","last_undegraded":"2024-03-04T06:58:48.397463+0000","last_fullsized":"2024-03-04T06:58:48.397463+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:59:04.553588+0000","last_peered":"2024-03-04T06:59:04.553588+0000","last_clean":"2024-03-04T06:59:04.553588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:59:04.553588+0000","last_undegraded":"2024-03-04T06:59:04.553588+0000","last_fullsized":"2024-03-04T06:59:04.553588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1306,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006697+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:58:28.006697+0000","last_peered":"2024-03-04T06:58:28.006697+0000","last_clean":"2024-03-04T06:58:28.006697+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:58:28.006697+0000","last_undegraded":"2024-03-04T06:58:28.006697+0000","last_fullsized":"2024-03-04T06:58:28.006697+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014206+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:59:45.014206+0000","last_peered":"2024-03-04T06:59:45.014206+0000","last_clean":"2024-03-04T06:59:45.014206+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:59:45.014206+0000","last_undegraded":"2024-03-04T06:59:45.014206+0000","last_fullsized":"2024-03-04T06:59:45.014206+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014216+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:59:45.014216+0000","last_peered":"2024-03-04T06:59:45.014216+0000","last_clean":"2024-03-04T06:59:45.014216+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:59:45.014216+0000","last_undegraded":"2024-03-04T06:59:45.014216+0000","last_fullsized":"2024-03-04T06:59:45.014216+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006681+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:58:28.006681+0000","last_peered":"2024-03-04T06:58:28.006681+0000","last_clean":"2024-03-04T06:58:28.006681+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:58:28.006681+0000","last_undegraded":"2024-03-04T06:58:28.006681+0000","last_fullsized":"2024-03-04T06:58:28.006681+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403128+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:59:38.403128+0000","last_peered":"2024-03-04T06:59:38.403128+0000","last_clean":"2024-03-04T06:59:38.403128+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:59:38.403128+0000","last_undegraded":"2024-03-04T06:59:38.403128+0000","last_fullsized":"2024-03-04T06:59:38.403128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1223,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403103+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:59:38.403103+0000","last_peered":"2024-03-04T06:59:38.403103+0000","last_clean":"2024-03-04T06:59:38.403103+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:59:38.403103+0000","last_undegraded":"2024-03-04T06:59:38.403103+0000","last_fullsized":"2024-03-04T06:59:38.403103+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543632+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:57:34.543632+0000","last_peered":"2024-03-04T06:57:34.543632+0000","last_clean":"2024-03-04T06:57:34.543632+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:57:34.543632+0000","last_undegraded":"2024-03-04T06:57:34.543632+0000","last_fullsized":"2024-03-04T06:57:34.543632+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958870+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:58:52.958870+0000","last_peered":"2024-03-04T06:58:52.958870+0000","last_clean":"2024-03-04T06:58:52.958870+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:58:52.958870+0000","last_undegraded":"2024-03-04T06:58:52.958870+0000","last_fullsized":"2024-03-04T06:58:52.958870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001694+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:57:45.001694+0000","last_peered":"2024-03-04T06:57:45.001694+0000","last_clean":"2024-03-04T06:57:45.001694+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:57:45.001694+0000","last_undegraded":"2024-03-04T06:57:45.001694+0000","last_fullsized":"2024-03-04T06:57:45.001694+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1190,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:17.623076+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:58:17.623076+0000","last_peered":"2024-03-04T06:58:17.623076+0000","last_clean":"2024-03-04T06:58:17.623076+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:58:17.623076+0000","last_undegraded":"2024-03-04T06:58:17.623076+0000","last_fullsized":"2024-03-04T06:58:17.623076+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.241598+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:59:28.241598+0000","last_peered":"2024-03-04T06:59:28.241598+0000","last_clean":"2024-03-04T06:59:28.241598+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:59:28.241598+0000","last_undegraded":"2024-03-04T06:59:28.241598+0000","last_fullsized":"2024-03-04T06:59:28.241598+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006622+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:58:28.006622+0000","last_peered":"2024-03-04T06:58:28.006622+0000","last_clean":"2024-03-04T06:58:28.006622+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:58:28.006622+0000","last_undegraded":"2024-03-04T06:58:28.006622+0000","last_fullsized":"2024-03-04T06:58:28.006622+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014712+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:59:50.014712+0000","last_peered":"2024-03-04T06:59:50.014712+0000","last_clean":"2024-03-04T06:59:50.014712+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:59:50.014712+0000","last_undegraded":"2024-03-04T06:59:50.014712+0000","last_fullsized":"2024-03-04T06:59:50.014712+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014675+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:59:50.014675+0000","last_peered":"2024-03-04T06:59:50.014675+0000","last_clean":"2024-03-04T06:59:50.014675+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:59:50.014675+0000","last_undegraded":"2024-03-04T06:59:50.014675+0000","last_fullsized":"2024-03-04T06:59:50.014675+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956356+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:58:32.956356+0000","last_peered":"2024-03-04T06:58:32.956356+0000","last_clean":"2024-03-04T06:58:32.956356+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:58:32.956356+0000","last_undegraded":"2024-03-04T06:58:32.956356+0000","last_fullsized":"2024-03-04T06:58:32.956356+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162696+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:58:38.162696+0000","last_peered":"2024-03-04T06:58:38.162696+0000","last_clean":"2024-03-04T06:58:38.162696+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:58:38.162696+0000","last_undegraded":"2024-03-04T06:58:38.162696+0000","last_fullsized":"2024-03-04T06:58:38.162696+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239549+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:59:08.239549+0000","last_peered":"2024-03-04T06:59:08.239549+0000","last_clean":"2024-03-04T06:59:08.239549+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:59:08.239549+0000","last_undegraded":"2024-03-04T06:59:08.239549+0000","last_fullsized":"2024-03-04T06:59:08.239549+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956414+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:58:32.956414+0000","last_peered":"2024-03-04T06:58:32.956414+0000","last_clean":"2024-03-04T06:58:32.956414+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:58:32.956414+0000","last_undegraded":"2024-03-04T06:58:32.956414+0000","last_fullsized":"2024-03-04T06:58:32.956414+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956402+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:58:32.956402+0000","last_peered":"2024-03-04T06:58:32.956402+0000","last_clean":"2024-03-04T06:58:32.956402+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:58:32.956402+0000","last_undegraded":"2024-03-04T06:58:32.956402+0000","last_fullsized":"2024-03-04T06:58:32.956402+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:03.003999+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:58:03.003999+0000","last_peered":"2024-03-04T06:58:03.003999+0000","last_clean":"2024-03-04T06:58:03.003999+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:58:03.003999+0000","last_undegraded":"2024-03-04T06:58:03.003999+0000","last_fullsized":"2024-03-04T06:58:03.003999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162740+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:58:38.162740+0000","last_peered":"2024-03-04T06:58:38.162740+0000","last_clean":"2024-03-04T06:58:38.162740+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:58:38.162740+0000","last_undegraded":"2024-03-04T06:58:38.162740+0000","last_fullsized":"2024-03-04T06:58:38.162740+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:57.633964+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:59:57.633964+0000","last_peered":"2024-03-04T06:59:57.633964+0000","last_clean":"2024-03-04T06:59:57.633964+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:59:57.633964+0000","last_undegraded":"2024-03-04T06:59:57.633964+0000","last_fullsized":"2024-03-04T06:59:57.633964+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1131,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237167+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:58:48.237167+0000","last_peered":"2024-03-04T06:58:48.237167+0000","last_clean":"2024-03-04T06:58:48.237167+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:58:48.237167+0000","last_undegraded":"2024-03-04T06:58:48.237167+0000","last_fullsized":"2024-03-04T06:58:48.237167+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558443+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:59:44.558443+0000","last_peered":"2024-03-04T06:59:44.558443+0000","last_clean":"2024-03-04T06:59:44.558443+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:59:44.558443+0000","last_undegraded":"2024-03-04T06:59:44.558443+0000","last_fullsized":"2024-03-04T06:59:44.558443+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015596+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:59:58.015596+0000","last_peered":"2024-03-04T06:59:58.015596+0000","last_clean":"2024-03-04T06:59:58.015596+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:59:58.015596+0000","last_undegraded":"2024-03-04T06:59:58.015596+0000","last_fullsized":"2024-03-04T06:59:58.015596+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397438+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:58:48.397438+0000","last_peered":"2024-03-04T06:58:48.397438+0000","last_clean":"2024-03-04T06:58:48.397438+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:58:48.397438+0000","last_undegraded":"2024-03-04T06:58:48.397438+0000","last_fullsized":"2024-03-04T06:58:48.397438+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953851+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:58:12.953851+0000","last_peered":"2024-03-04T06:58:12.953851+0000","last_clean":"2024-03-04T06:58:12.953851+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:58:12.953851+0000","last_undegraded":"2024-03-04T06:58:12.953851+0000","last_fullsized":"2024-03-04T06:58:12.953851+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555834+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:59:24.555834+0000","last_peered":"2024-03-04T06:59:24.555834+0000","last_clean":"2024-03-04T06:59:24.555834+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:59:24.555834+0000","last_undegraded":"2024-03-04T06:59:24.555834+0000","last_fullsized":"2024-03-04T06:59:24.555834+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237147+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:58:48.237147+0000","last_peered":"2024-03-04T06:58:48.237147+0000","last_clean":"2024-03-04T06:58:48.237147+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:58:48.237147+0000","last_undegraded":"2024-03-04T06:58:48.237147+0000","last_fullsized":"2024-03-04T06:58:48.237147+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237122+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:58:48.237122+0000","last_peered":"2024-03-04T06:58:48.237122+0000","last_clean":"2024-03-04T06:58:48.237122+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:58:48.237122+0000","last_undegraded":"2024-03-04T06:58:48.237122+0000","last_fullsized":"2024-03-04T06:58:48.237122+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397404+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:58:48.397404+0000","last_peered":"2024-03-04T06:58:48.397404+0000","last_clean":"2024-03-04T06:58:48.397404+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:58:48.397404+0000","last_undegraded":"2024-03-04T06:58:48.397404+0000","last_fullsized":"2024-03-04T06:58:48.397404+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555799+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:59:24.555799+0000","last_peered":"2024-03-04T06:59:24.555799+0000","last_clean":"2024-03-04T06:59:24.555799+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:59:24.555799+0000","last_undegraded":"2024-03-04T06:59:24.555799+0000","last_fullsized":"2024-03-04T06:59:24.555799+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3579,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405911+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:00:08.405911+0000","last_peered":"2024-03-04T07:00:08.405911+0000","last_clean":"2024-03-04T07:00:08.405911+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:00:08.405911+0000","last_undegraded":"2024-03-04T07:00:08.405911+0000","last_fullsized":"2024-03-04T07:00:08.405911+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:32.631361+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:59:32.631361+0000","last_peered":"2024-03-04T06:59:32.631361+0000","last_clean":"2024-03-04T06:59:32.631361+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:59:32.631361+0000","last_undegraded":"2024-03-04T06:59:32.631361+0000","last_fullsized":"2024-03-04T06:59:32.631361+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553616+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:59:04.553616+0000","last_peered":"2024-03-04T06:59:04.553616+0000","last_clean":"2024-03-04T06:59:04.553616+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:59:04.553616+0000","last_undegraded":"2024-03-04T06:59:04.553616+0000","last_fullsized":"2024-03-04T06:59:04.553616+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17117,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006566+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:58:28.006566+0000","last_peered":"2024-03-04T06:58:28.006566+0000","last_clean":"2024-03-04T06:58:28.006566+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:58:28.006566+0000","last_undegraded":"2024-03-04T06:58:28.006566+0000","last_fullsized":"2024-03-04T06:58:28.006566+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164900+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:59:03.164900+0000","last_peered":"2024-03-04T06:59:03.164900+0000","last_clean":"2024-03-04T06:59:03.164900+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:59:03.164900+0000","last_undegraded":"2024-03-04T06:59:03.164900+0000","last_fullsized":"2024-03-04T06:59:03.164900+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164981+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:59:03.164981+0000","last_peered":"2024-03-04T06:59:03.164981+0000","last_clean":"2024-03-04T06:59:03.164981+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:59:03.164981+0000","last_undegraded":"2024-03-04T06:59:03.164981+0000","last_fullsized":"2024-03-04T06:59:03.164981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962033+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:59:17.962033+0000","last_peered":"2024-03-04T06:59:17.962033+0000","last_clean":"2024-03-04T06:59:17.962033+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:59:17.962033+0000","last_undegraded":"2024-03-04T06:59:17.962033+0000","last_fullsized":"2024-03-04T06:59:17.962033+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4387,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006651+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:58:28.006651+0000","last_peered":"2024-03-04T06:58:28.006651+0000","last_clean":"2024-03-04T06:58:28.006651+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:58:28.006651+0000","last_undegraded":"2024-03-04T06:58:28.006651+0000","last_fullsized":"2024-03-04T06:58:28.006651+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164925+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:59:03.164925+0000","last_peered":"2024-03-04T06:59:03.164925+0000","last_clean":"2024-03-04T06:59:03.164925+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:59:03.164925+0000","last_undegraded":"2024-03-04T06:59:03.164925+0000","last_fullsized":"2024-03-04T06:59:03.164925+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.961943+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:59:17.961943+0000","last_peered":"2024-03-04T06:59:17.961943+0000","last_clean":"2024-03-04T06:59:17.961943+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:59:17.961943+0000","last_undegraded":"2024-03-04T06:59:17.961943+0000","last_fullsized":"2024-03-04T06:59:17.961943+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625641+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:58:42.625641+0000","last_peered":"2024-03-04T06:58:42.625641+0000","last_clean":"2024-03-04T06:58:42.625641+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:58:42.625641+0000","last_undegraded":"2024-03-04T06:58:42.625641+0000","last_fullsized":"2024-03-04T06:58:42.625641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5641,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.406020+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:00:08.406020+0000","last_peered":"2024-03-04T07:00:08.406020+0000","last_clean":"2024-03-04T07:00:08.406020+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:00:08.406020+0000","last_undegraded":"2024-03-04T07:00:08.406020+0000","last_fullsized":"2024-03-04T07:00:08.406020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1257,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168065+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:59:33.168065+0000","last_peered":"2024-03-04T06:59:33.168065+0000","last_clean":"2024-03-04T06:59:33.168065+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:59:33.168065+0000","last_undegraded":"2024-03-04T06:59:33.168065+0000","last_fullsized":"2024-03-04T06:59:33.168065+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:33.162083+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:58:33.162083+0000","last_peered":"2024-03-04T06:58:33.162083+0000","last_clean":"2024-03-04T06:58:33.162083+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:58:33.162083+0000","last_undegraded":"2024-03-04T06:58:33.162083+0000","last_fullsized":"2024-03-04T06:58:33.162083+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403066+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:59:38.403066+0000","last_peered":"2024-03-04T06:59:38.403066+0000","last_clean":"2024-03-04T06:59:38.403066+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:59:38.403066+0000","last_undegraded":"2024-03-04T06:59:38.403066+0000","last_fullsized":"2024-03-04T06:59:38.403066+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4016,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:24.549121+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:58:24.549121+0000","last_peered":"2024-03-04T06:58:24.549121+0000","last_clean":"2024-03-04T06:58:24.549121+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:58:24.549121+0000","last_undegraded":"2024-03-04T06:58:24.549121+0000","last_fullsized":"2024-03-04T06:58:24.549121+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244731+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:59:53.244731+0000","last_peered":"2024-03-04T06:59:53.244731+0000","last_clean":"2024-03-04T06:59:53.244731+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:59:53.244731+0000","last_undegraded":"2024-03-04T06:59:53.244731+0000","last_fullsized":"2024-03-04T06:59:53.244731+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1211,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:10.004451+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T06:58:10.004451+0000","last_peered":"2024-03-04T06:58:10.004451+0000","last_clean":"2024-03-04T06:58:10.004451+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T06:58:10.004451+0000","last_undegraded":"2024-03-04T06:58:10.004451+0000","last_fullsized":"2024-03-04T06:58:10.004451+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962020+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:59:17.962020+0000","last_peered":"2024-03-04T06:59:17.962020+0000","last_clean":"2024-03-04T06:59:17.962020+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:59:17.962020+0000","last_undegraded":"2024-03-04T06:59:17.962020+0000","last_fullsized":"2024-03-04T06:59:17.962020+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1552,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560890+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:00:04.560890+0000","last_peered":"2024-03-04T07:00:04.560890+0000","last_clean":"2024-03-04T07:00:04.560890+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:00:04.560890+0000","last_undegraded":"2024-03-04T07:00:04.560890+0000","last_fullsized":"2024-03-04T07:00:04.560890+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3952,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.965034+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:59:42.965034+0000","last_peered":"2024-03-04T06:59:42.965034+0000","last_clean":"2024-03-04T06:59:42.965034+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:59:42.965034+0000","last_undegraded":"2024-03-04T06:59:42.965034+0000","last_fullsized":"2024-03-04T06:59:42.965034+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009504+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:58:58.009504+0000","last_peered":"2024-03-04T06:58:58.009504+0000","last_clean":"2024-03-04T06:58:58.009504+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:58:58.009504+0000","last_undegraded":"2024-03-04T06:58:58.009504+0000","last_fullsized":"2024-03-04T06:58:58.009504+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403043+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:59:38.403043+0000","last_peered":"2024-03-04T06:59:38.403043+0000","last_clean":"2024-03-04T06:59:38.403043+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:59:38.403043+0000","last_undegraded":"2024-03-04T06:59:38.403043+0000","last_fullsized":"2024-03-04T06:59:38.403043+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560852+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:00:04.560852+0000","last_peered":"2024-03-04T07:00:04.560852+0000","last_clean":"2024-03-04T07:00:04.560852+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:00:04.560852+0000","last_undegraded":"2024-03-04T07:00:04.560852+0000","last_fullsized":"2024-03-04T07:00:04.560852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15293,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:53.244696+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:59:53.244696+0000","last_peered":"2024-03-04T06:59:53.244696+0000","last_clean":"2024-03-04T06:59:53.244696+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:59:53.244696+0000","last_undegraded":"2024-03-04T06:59:53.244696+0000","last_fullsized":"2024-03-04T06:59:53.244696+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006608+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:58:28.006608+0000","last_peered":"2024-03-04T06:58:28.006608+0000","last_clean":"2024-03-04T06:58:28.006608+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:58:28.006608+0000","last_undegraded":"2024-03-04T06:58:28.006608+0000","last_fullsized":"2024-03-04T06:58:28.006608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549190+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:58:24.549190+0000","last_peered":"2024-03-04T06:58:24.549190+0000","last_clean":"2024-03-04T06:58:24.549190+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:58:24.549190+0000","last_undegraded":"2024-03-04T06:58:24.549190+0000","last_fullsized":"2024-03-04T06:58:24.549190+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164943+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:59:03.164943+0000","last_peered":"2024-03-04T06:59:03.164943+0000","last_clean":"2024-03-04T06:59:03.164943+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:59:03.164943+0000","last_undegraded":"2024-03-04T06:59:03.164943+0000","last_fullsized":"2024-03-04T06:59:03.164943+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4380,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:42.625602+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:58:42.625602+0000","last_peered":"2024-03-04T06:58:42.625602+0000","last_clean":"2024-03-04T06:58:42.625602+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:58:42.625602+0000","last_undegraded":"2024-03-04T06:58:42.625602+0000","last_fullsized":"2024-03-04T06:58:42.625602+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014181+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:59:45.014181+0000","last_peered":"2024-03-04T06:59:45.014181+0000","last_clean":"2024-03-04T06:59:45.014181+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:59:45.014181+0000","last_undegraded":"2024-03-04T06:59:45.014181+0000","last_fullsized":"2024-03-04T06:59:45.014181+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1270,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168056+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:59:33.168056+0000","last_peered":"2024-03-04T06:59:33.168056+0000","last_clean":"2024-03-04T06:59:33.168056+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:59:33.168056+0000","last_undegraded":"2024-03-04T06:59:33.168056+0000","last_fullsized":"2024-03-04T06:59:33.168056+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007125+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:58:35.007125+0000","last_peered":"2024-03-04T06:58:35.007125+0000","last_clean":"2024-03-04T06:58:35.007125+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:58:35.007125+0000","last_undegraded":"2024-03-04T06:58:35.007125+0000","last_fullsized":"2024-03-04T06:58:35.007125+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4611,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:45.014149+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:59:45.014149+0000","last_peered":"2024-03-04T06:59:45.014149+0000","last_clean":"2024-03-04T06:59:45.014149+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:59:45.014149+0000","last_undegraded":"2024-03-04T06:59:45.014149+0000","last_fullsized":"2024-03-04T06:59:45.014149+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625572+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:58:42.625572+0000","last_peered":"2024-03-04T06:58:42.625572+0000","last_clean":"2024-03-04T06:58:42.625572+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:58:42.625572+0000","last_undegraded":"2024-03-04T06:58:42.625572+0000","last_fullsized":"2024-03-04T06:58:42.625572+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1079,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232447+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T06:58:08.232447+0000","last_peered":"2024-03-04T06:58:08.232447+0000","last_clean":"2024-03-04T06:58:08.232447+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T06:58:08.232447+0000","last_undegraded":"2024-03-04T06:58:08.232447+0000","last_fullsized":"2024-03-04T06:58:08.232447+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009478+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:58:58.009478+0000","last_peered":"2024-03-04T06:58:58.009478+0000","last_clean":"2024-03-04T06:58:58.009478+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:58:58.009478+0000","last_undegraded":"2024-03-04T06:58:58.009478+0000","last_fullsized":"2024-03-04T06:58:58.009478+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4635,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:57:52.951690+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T06:57:52.951690+0000","last_peered":"2024-03-04T06:57:52.951690+0000","last_clean":"2024-03-04T06:57:52.951690+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T06:57:52.951690+0000","last_undegraded":"2024-03-04T06:57:52.951690+0000","last_fullsized":"2024-03-04T06:57:52.951690+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:44.551296+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:58:44.551296+0000","last_peered":"2024-03-04T06:58:44.551296+0000","last_clean":"2024-03-04T06:58:44.551296+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:58:44.551296+0000","last_undegraded":"2024-03-04T06:58:44.551296+0000","last_fullsized":"2024-03-04T06:58:44.551296+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1186,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:07.628352+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:59:07.628352+0000","last_peered":"2024-03-04T06:59:07.628352+0000","last_clean":"2024-03-04T06:59:07.628352+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:59:07.628352+0000","last_undegraded":"2024-03-04T06:59:07.628352+0000","last_fullsized":"2024-03-04T06:59:07.628352+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5159,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:32.631317+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:59:32.631317+0000","last_peered":"2024-03-04T06:59:32.631317+0000","last_clean":"2024-03-04T06:59:32.631317+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:59:32.631317+0000","last_undegraded":"2024-03-04T06:59:32.631317+0000","last_fullsized":"2024-03-04T06:59:32.631317+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.167981+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:59:33.167981+0000","last_peered":"2024-03-04T06:59:33.167981+0000","last_clean":"2024-03-04T06:59:33.167981+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:59:33.167981+0000","last_undegraded":"2024-03-04T06:59:33.167981+0000","last_fullsized":"2024-03-04T06:59:33.167981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007066+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:58:35.007066+0000","last_peered":"2024-03-04T06:58:35.007066+0000","last_clean":"2024-03-04T06:58:35.007066+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:58:35.007066+0000","last_undegraded":"2024-03-04T06:58:35.007066+0000","last_fullsized":"2024-03-04T06:58:35.007066+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4720,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394889+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:58:23.394889+0000","last_peered":"2024-03-04T06:58:23.394889+0000","last_clean":"2024-03-04T06:58:23.394889+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:58:23.394889+0000","last_undegraded":"2024-03-04T06:58:23.394889+0000","last_fullsized":"2024-03-04T06:58:23.394889+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168002+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:59:33.168002+0000","last_peered":"2024-03-04T06:59:33.168002+0000","last_clean":"2024-03-04T06:59:33.168002+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:59:33.168002+0000","last_undegraded":"2024-03-04T06:59:33.168002+0000","last_fullsized":"2024-03-04T06:59:33.168002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009678+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:59:00.009678+0000","last_peered":"2024-03-04T06:59:00.009678+0000","last_clean":"2024-03-04T06:59:00.009678+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:59:00.009678+0000","last_undegraded":"2024-03-04T06:59:00.009678+0000","last_fullsized":"2024-03-04T06:59:00.009678+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5556,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:03.171266+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:00:03.171266+0000","last_peered":"2024-03-04T07:00:03.171266+0000","last_clean":"2024-03-04T07:00:03.171266+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:00:03.171266+0000","last_undegraded":"2024-03-04T07:00:03.171266+0000","last_fullsized":"2024-03-04T07:00:03.171266+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553540+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:59:04.553540+0000","last_peered":"2024-03-04T06:59:04.553540+0000","last_clean":"2024-03-04T06:59:04.553540+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:59:04.553540+0000","last_undegraded":"2024-03-04T06:59:04.553540+0000","last_fullsized":"2024-03-04T06:59:04.553540+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1101,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232398+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T06:58:08.232398+0000","last_peered":"2024-03-04T06:58:08.232398+0000","last_clean":"2024-03-04T06:58:08.232398+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T06:58:08.232398+0000","last_undegraded":"2024-03-04T06:58:08.232398+0000","last_fullsized":"2024-03-04T06:58:08.232398+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394833+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:58:23.394833+0000","last_peered":"2024-03-04T06:58:23.394833+0000","last_clean":"2024-03-04T06:58:23.394833+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:58:23.394833+0000","last_undegraded":"2024-03-04T06:58:23.394833+0000","last_fullsized":"2024-03-04T06:58:23.394833+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394877+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:58:23.394877+0000","last_peered":"2024-03-04T06:58:23.394877+0000","last_clean":"2024-03-04T06:58:23.394877+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:58:23.394877+0000","last_undegraded":"2024-03-04T06:58:23.394877+0000","last_fullsized":"2024-03-04T06:58:23.394877+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553601+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:59:04.553601+0000","last_peered":"2024-03-04T06:59:04.553601+0000","last_clean":"2024-03-04T06:59:04.553601+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:59:04.553601+0000","last_undegraded":"2024-03-04T06:59:04.553601+0000","last_fullsized":"2024-03-04T06:59:04.553601+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4368,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405967+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:00:08.405967+0000","last_peered":"2024-03-04T07:00:08.405967+0000","last_clean":"2024-03-04T07:00:08.405967+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:00:08.405967+0000","last_undegraded":"2024-03-04T07:00:08.405967+0000","last_fullsized":"2024-03-04T07:00:08.405967+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:03.171315+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:00:03.171315+0000","last_peered":"2024-03-04T07:00:03.171315+0000","last_clean":"2024-03-04T07:00:03.171315+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:00:03.171315+0000","last_undegraded":"2024-03-04T07:00:03.171315+0000","last_fullsized":"2024-03-04T07:00:03.171315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1140,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951665+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T06:57:52.951665+0000","last_peered":"2024-03-04T06:57:52.951665+0000","last_clean":"2024-03-04T06:57:52.951665+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T06:57:52.951665+0000","last_undegraded":"2024-03-04T06:57:52.951665+0000","last_fullsized":"2024-03-04T06:57:52.951665+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4601,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:44.551323+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:58:44.551323+0000","last_peered":"2024-03-04T06:58:44.551323+0000","last_clean":"2024-03-04T06:58:44.551323+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:58:44.551323+0000","last_undegraded":"2024-03-04T06:58:44.551323+0000","last_fullsized":"2024-03-04T06:58:44.551323+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1246,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394915+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:58:23.394915+0000","last_peered":"2024-03-04T06:58:23.394915+0000","last_clean":"2024-03-04T06:58:23.394915+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:58:23.394915+0000","last_undegraded":"2024-03-04T06:58:23.394915+0000","last_fullsized":"2024-03-04T06:58:23.394915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553631+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:59:04.553631+0000","last_peered":"2024-03-04T06:59:04.553631+0000","last_clean":"2024-03-04T06:59:04.553631+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:59:04.553631+0000","last_undegraded":"2024-03-04T06:59:04.553631+0000","last_fullsized":"2024-03-04T06:59:04.553631+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244661+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:59:53.244661+0000","last_peered":"2024-03-04T06:59:53.244661+0000","last_clean":"2024-03-04T06:59:53.244661+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:59:53.244661+0000","last_undegraded":"2024-03-04T06:59:53.244661+0000","last_fullsized":"2024-03-04T06:59:53.244661+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403075+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:59:38.403075+0000","last_peered":"2024-03-04T06:59:38.403075+0000","last_clean":"2024-03-04T06:59:38.403075+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:59:38.403075+0000","last_undegraded":"2024-03-04T06:59:38.403075+0000","last_fullsized":"2024-03-04T06:59:38.403075+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962003+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:59:17.962003+0000","last_peered":"2024-03-04T06:59:17.962003+0000","last_clean":"2024-03-04T06:59:17.962003+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:59:17.962003+0000","last_undegraded":"2024-03-04T06:59:17.962003+0000","last_fullsized":"2024-03-04T06:59:17.962003+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006538+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:58:28.006538+0000","last_peered":"2024-03-04T06:58:28.006538+0000","last_clean":"2024-03-04T06:58:28.006538+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:58:28.006538+0000","last_undegraded":"2024-03-04T06:58:28.006538+0000","last_fullsized":"2024-03-04T06:58:28.006538+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007105+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:58:35.007105+0000","last_peered":"2024-03-04T06:58:35.007105+0000","last_clean":"2024-03-04T06:58:35.007105+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:58:35.007105+0000","last_undegraded":"2024-03-04T06:58:35.007105+0000","last_fullsized":"2024-03-04T06:58:35.007105+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168023+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:59:33.168023+0000","last_peered":"2024-03-04T06:59:33.168023+0000","last_clean":"2024-03-04T06:59:33.168023+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:59:33.168023+0000","last_undegraded":"2024-03-04T06:59:33.168023+0000","last_fullsized":"2024-03-04T06:59:33.168023+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:08.232435+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T06:58:08.232435+0000","last_peered":"2024-03-04T06:58:08.232435+0000","last_clean":"2024-03-04T06:58:08.232435+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T06:58:08.232435+0000","last_undegraded":"2024-03-04T06:58:08.232435+0000","last_fullsized":"2024-03-04T06:58:08.232435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007138+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:58:35.007138+0000","last_peered":"2024-03-04T06:58:35.007138+0000","last_clean":"2024-03-04T06:58:35.007138+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:58:35.007138+0000","last_undegraded":"2024-03-04T06:58:35.007138+0000","last_fullsized":"2024-03-04T06:58:35.007138+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.964990+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:59:42.964990+0000","last_peered":"2024-03-04T06:59:42.964990+0000","last_clean":"2024-03-04T06:59:42.964990+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:59:42.964990+0000","last_undegraded":"2024-03-04T06:59:42.964990+0000","last_fullsized":"2024-03-04T06:59:42.964990+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009646+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:59:00.009646+0000","last_peered":"2024-03-04T06:59:00.009646+0000","last_clean":"2024-03-04T06:59:00.009646+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:59:00.009646+0000","last_undegraded":"2024-03-04T06:59:00.009646+0000","last_fullsized":"2024-03-04T06:59:00.009646+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1121,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:52.951615+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T06:57:52.951615+0000","last_peered":"2024-03-04T06:57:52.951615+0000","last_clean":"2024-03-04T06:57:52.951615+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T06:57:52.951615+0000","last_undegraded":"2024-03-04T06:57:52.951615+0000","last_fullsized":"2024-03-04T06:57:52.951615+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.012471+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:59:28.012471+0000","last_peered":"2024-03-04T06:59:28.012471+0000","last_clean":"2024-03-04T06:59:28.012471+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:59:28.012471+0000","last_undegraded":"2024-03-04T06:59:28.012471+0000","last_fullsized":"2024-03-04T06:59:28.012471+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.234922+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:58:28.234922+0000","last_peered":"2024-03-04T06:58:28.234922+0000","last_clean":"2024-03-04T06:58:28.234922+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:58:28.234922+0000","last_undegraded":"2024-03-04T06:58:28.234922+0000","last_fullsized":"2024-03-04T06:58:28.234922+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503507,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142462,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287109,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997815,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885871,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937449,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792802,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:02:20.090 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:20.090 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:20.090 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:20.090 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:20.090 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:20.090 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:20.090 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:20.091 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:20.091 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:20.091 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:20.091 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:02:20.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:20 smithi203 ceph-mon[85573]: pgmap v1134: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:20.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:20 smithi203 ceph-mon[85573]: from='client.44636 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:20.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:20 smithi137 ceph-mon[91314]: pgmap v1134: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:20.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:20 smithi137 ceph-mon[91314]: from='client.44636 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:20.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:20 smithi137 ceph-mon[88869]: pgmap v1134: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:20.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:20 smithi137 ceph-mon[88869]: from='client.44636 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:22.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:22 smithi203 ceph-mon[85573]: pgmap v1135: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:22.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:22 smithi137 ceph-mon[88869]: pgmap v1135: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:22.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:22 smithi137 ceph-mon[91314]: pgmap v1135: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:24.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:24 smithi137 ceph-mon[88869]: pgmap v1136: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:24.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:02:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:24 smithi137 ceph-mon[91314]: pgmap v1136: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:24.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:02:24.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:24 smithi203 ceph-mon[85573]: pgmap v1136: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:24.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:02:25.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:02:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:02:25] "GET /metrics HTTP/1.1" 200 36333 "" "Prometheus/2.43.0" 2024-03-04T07:02:26.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:26 smithi137 ceph-mon[88869]: pgmap v1137: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:26.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:26 smithi137 ceph-mon[91314]: pgmap v1137: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:26.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:26 smithi203 ceph-mon[85573]: pgmap v1137: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:28.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:28 smithi137 ceph-mon[88869]: pgmap v1138: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:28.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:28 smithi137 ceph-mon[91314]: pgmap v1138: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:28.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:28 smithi203 ceph-mon[85573]: pgmap v1138: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:30.091 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:02:30.312 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:02:30.435 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:30 smithi137 ceph-mon[88869]: pgmap v1139: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:30.436 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:30 smithi137 ceph-mon[91314]: pgmap v1139: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:30.849 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:30 smithi203 ceph-mon[85573]: pgmap v1139: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:32.205 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:02:32.207 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:02:32.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:32 smithi137 ceph-mon[88869]: pgmap v1140: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:32.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:32 smithi137 ceph-mon[91314]: pgmap v1140: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:32.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:32 smithi203 ceph-mon[85573]: pgmap v1140: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:32.872 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1140,"stamp":"2024-03-04T07:02:30.594855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003997"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549208+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T06:58:24.549208+0000","last_peered":"2024-03-04T06:58:24.549208+0000","last_clean":"2024-03-04T06:58:24.549208+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T06:58:24.549208+0000","last_undegraded":"2024-03-04T06:58:24.549208+0000","last_fullsized":"2024-03-04T06:58:24.549208+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.165005+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:59:03.165005+0000","last_peered":"2024-03-04T06:59:03.165005+0000","last_clean":"2024-03-04T06:59:03.165005+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:59:03.165005+0000","last_undegraded":"2024-03-04T06:59:03.165005+0000","last_fullsized":"2024-03-04T06:59:03.165005+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006644+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T06:58:28.006644+0000","last_peered":"2024-03-04T06:58:28.006644+0000","last_clean":"2024-03-04T06:58:28.006644+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T06:58:28.006644+0000","last_undegraded":"2024-03-04T06:58:28.006644+0000","last_fullsized":"2024-03-04T06:58:28.006644+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958856+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:58:52.958856+0000","last_peered":"2024-03-04T06:58:52.958856+0000","last_clean":"2024-03-04T06:58:52.958856+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:58:52.958856+0000","last_undegraded":"2024-03-04T06:58:52.958856+0000","last_fullsized":"2024-03-04T06:58:52.958856+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543619+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T06:57:34.543619+0000","last_peered":"2024-03-04T06:57:34.543619+0000","last_clean":"2024-03-04T06:57:34.543619+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T06:57:34.543619+0000","last_undegraded":"2024-03-04T06:57:34.543619+0000","last_fullsized":"2024-03-04T06:57:34.543619+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958813+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:58:52.958813+0000","last_peered":"2024-03-04T06:58:52.958813+0000","last_clean":"2024-03-04T06:58:52.958813+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:58:52.958813+0000","last_undegraded":"2024-03-04T06:58:52.958813+0000","last_fullsized":"2024-03-04T06:58:52.958813+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543594+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T06:57:34.543594+0000","last_peered":"2024-03-04T06:57:34.543594+0000","last_clean":"2024-03-04T06:57:34.543594+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T06:57:34.543594+0000","last_undegraded":"2024-03-04T06:57:34.543594+0000","last_fullsized":"2024-03-04T06:57:34.543594+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001597+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:57:45.001597+0000","last_peered":"2024-03-04T06:57:45.001597+0000","last_clean":"2024-03-04T06:57:45.001597+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:57:45.001597+0000","last_undegraded":"2024-03-04T06:57:45.001597+0000","last_fullsized":"2024-03-04T06:57:45.001597+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1066,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558470+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:59:44.558470+0000","last_peered":"2024-03-04T06:59:44.558470+0000","last_clean":"2024-03-04T06:59:44.558470+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:59:44.558470+0000","last_undegraded":"2024-03-04T06:59:44.558470+0000","last_fullsized":"2024-03-04T06:59:44.558470+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239534+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:59:08.239534+0000","last_peered":"2024-03-04T06:59:08.239534+0000","last_clean":"2024-03-04T06:59:08.239534+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:59:08.239534+0000","last_undegraded":"2024-03-04T06:59:08.239534+0000","last_fullsized":"2024-03-04T06:59:08.239534+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239472+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:59:08.239472+0000","last_peered":"2024-03-04T06:59:08.239472+0000","last_clean":"2024-03-04T06:59:08.239472+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:59:08.239472+0000","last_undegraded":"2024-03-04T06:59:08.239472+0000","last_fullsized":"2024-03-04T06:59:08.239472+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:57.620940+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:57:57.620940+0000","last_peered":"2024-03-04T06:57:57.620940+0000","last_clean":"2024-03-04T06:57:57.620940+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:57:57.620940+0000","last_undegraded":"2024-03-04T06:57:57.620940+0000","last_fullsized":"2024-03-04T06:57:57.620940+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014730+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:59:50.014730+0000","last_peered":"2024-03-04T06:59:50.014730+0000","last_clean":"2024-03-04T06:59:50.014730+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:59:50.014730+0000","last_undegraded":"2024-03-04T06:59:50.014730+0000","last_fullsized":"2024-03-04T06:59:50.014730+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015553+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:59:58.015553+0000","last_peered":"2024-03-04T06:59:58.015553+0000","last_clean":"2024-03-04T06:59:58.015553+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:59:58.015553+0000","last_undegraded":"2024-03-04T06:59:58.015553+0000","last_fullsized":"2024-03-04T06:59:58.015553+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:13.159769+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:58:13.159769+0000","last_peered":"2024-03-04T06:58:13.159769+0000","last_clean":"2024-03-04T06:58:13.159769+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:58:13.159769+0000","last_undegraded":"2024-03-04T06:58:13.159769+0000","last_fullsized":"2024-03-04T06:58:13.159769+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953787+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:58:12.953787+0000","last_peered":"2024-03-04T06:58:12.953787+0000","last_clean":"2024-03-04T06:58:12.953787+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:58:12.953787+0000","last_undegraded":"2024-03-04T06:58:12.953787+0000","last_fullsized":"2024-03-04T06:58:12.953787+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953915+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:58:12.953915+0000","last_peered":"2024-03-04T06:58:12.953915+0000","last_clean":"2024-03-04T06:58:12.953915+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:58:12.953915+0000","last_undegraded":"2024-03-04T06:58:12.953915+0000","last_fullsized":"2024-03-04T06:58:12.953915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397463+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:58:48.397463+0000","last_peered":"2024-03-04T06:58:48.397463+0000","last_clean":"2024-03-04T06:58:48.397463+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:58:48.397463+0000","last_undegraded":"2024-03-04T06:58:48.397463+0000","last_fullsized":"2024-03-04T06:58:48.397463+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:59:04.553588+0000","last_peered":"2024-03-04T06:59:04.553588+0000","last_clean":"2024-03-04T06:59:04.553588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:59:04.553588+0000","last_undegraded":"2024-03-04T06:59:04.553588+0000","last_fullsized":"2024-03-04T06:59:04.553588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1306,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006697+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T06:58:28.006697+0000","last_peered":"2024-03-04T06:58:28.006697+0000","last_clean":"2024-03-04T06:58:28.006697+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T06:58:28.006697+0000","last_undegraded":"2024-03-04T06:58:28.006697+0000","last_fullsized":"2024-03-04T06:58:28.006697+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014206+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:59:45.014206+0000","last_peered":"2024-03-04T06:59:45.014206+0000","last_clean":"2024-03-04T06:59:45.014206+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:59:45.014206+0000","last_undegraded":"2024-03-04T06:59:45.014206+0000","last_fullsized":"2024-03-04T06:59:45.014206+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014216+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:59:45.014216+0000","last_peered":"2024-03-04T06:59:45.014216+0000","last_clean":"2024-03-04T06:59:45.014216+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:59:45.014216+0000","last_undegraded":"2024-03-04T06:59:45.014216+0000","last_fullsized":"2024-03-04T06:59:45.014216+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006681+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T06:58:28.006681+0000","last_peered":"2024-03-04T06:58:28.006681+0000","last_clean":"2024-03-04T06:58:28.006681+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T06:58:28.006681+0000","last_undegraded":"2024-03-04T06:58:28.006681+0000","last_fullsized":"2024-03-04T06:58:28.006681+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403128+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:59:38.403128+0000","last_peered":"2024-03-04T06:59:38.403128+0000","last_clean":"2024-03-04T06:59:38.403128+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:59:38.403128+0000","last_undegraded":"2024-03-04T06:59:38.403128+0000","last_fullsized":"2024-03-04T06:59:38.403128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1223,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403103+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:59:38.403103+0000","last_peered":"2024-03-04T06:59:38.403103+0000","last_clean":"2024-03-04T06:59:38.403103+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:59:38.403103+0000","last_undegraded":"2024-03-04T06:59:38.403103+0000","last_fullsized":"2024-03-04T06:59:38.403103+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1070,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:34.543632+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T06:57:34.543632+0000","last_peered":"2024-03-04T06:57:34.543632+0000","last_clean":"2024-03-04T06:57:34.543632+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T06:57:34.543632+0000","last_undegraded":"2024-03-04T06:57:34.543632+0000","last_fullsized":"2024-03-04T06:57:34.543632+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958870+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:58:52.958870+0000","last_peered":"2024-03-04T06:58:52.958870+0000","last_clean":"2024-03-04T06:58:52.958870+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:58:52.958870+0000","last_undegraded":"2024-03-04T06:58:52.958870+0000","last_fullsized":"2024-03-04T06:58:52.958870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001694+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:57:45.001694+0000","last_peered":"2024-03-04T06:57:45.001694+0000","last_clean":"2024-03-04T06:57:45.001694+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:57:45.001694+0000","last_undegraded":"2024-03-04T06:57:45.001694+0000","last_fullsized":"2024-03-04T06:57:45.001694+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1190,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:17.623076+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:58:17.623076+0000","last_peered":"2024-03-04T06:58:17.623076+0000","last_clean":"2024-03-04T06:58:17.623076+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:58:17.623076+0000","last_undegraded":"2024-03-04T06:58:17.623076+0000","last_fullsized":"2024-03-04T06:58:17.623076+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.241598+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:59:28.241598+0000","last_peered":"2024-03-04T06:59:28.241598+0000","last_clean":"2024-03-04T06:59:28.241598+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:59:28.241598+0000","last_undegraded":"2024-03-04T06:59:28.241598+0000","last_fullsized":"2024-03-04T06:59:28.241598+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006622+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:58:28.006622+0000","last_peered":"2024-03-04T06:58:28.006622+0000","last_clean":"2024-03-04T06:58:28.006622+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:58:28.006622+0000","last_undegraded":"2024-03-04T06:58:28.006622+0000","last_fullsized":"2024-03-04T06:58:28.006622+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014712+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:59:50.014712+0000","last_peered":"2024-03-04T06:59:50.014712+0000","last_clean":"2024-03-04T06:59:50.014712+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:59:50.014712+0000","last_undegraded":"2024-03-04T06:59:50.014712+0000","last_fullsized":"2024-03-04T06:59:50.014712+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014675+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:59:50.014675+0000","last_peered":"2024-03-04T06:59:50.014675+0000","last_clean":"2024-03-04T06:59:50.014675+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:59:50.014675+0000","last_undegraded":"2024-03-04T06:59:50.014675+0000","last_fullsized":"2024-03-04T06:59:50.014675+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956356+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:58:32.956356+0000","last_peered":"2024-03-04T06:58:32.956356+0000","last_clean":"2024-03-04T06:58:32.956356+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:58:32.956356+0000","last_undegraded":"2024-03-04T06:58:32.956356+0000","last_fullsized":"2024-03-04T06:58:32.956356+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162696+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:58:38.162696+0000","last_peered":"2024-03-04T06:58:38.162696+0000","last_clean":"2024-03-04T06:58:38.162696+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:58:38.162696+0000","last_undegraded":"2024-03-04T06:58:38.162696+0000","last_fullsized":"2024-03-04T06:58:38.162696+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239549+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:59:08.239549+0000","last_peered":"2024-03-04T06:59:08.239549+0000","last_clean":"2024-03-04T06:59:08.239549+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:59:08.239549+0000","last_undegraded":"2024-03-04T06:59:08.239549+0000","last_fullsized":"2024-03-04T06:59:08.239549+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956414+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:58:32.956414+0000","last_peered":"2024-03-04T06:58:32.956414+0000","last_clean":"2024-03-04T06:58:32.956414+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:58:32.956414+0000","last_undegraded":"2024-03-04T06:58:32.956414+0000","last_fullsized":"2024-03-04T06:58:32.956414+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956402+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:58:32.956402+0000","last_peered":"2024-03-04T06:58:32.956402+0000","last_clean":"2024-03-04T06:58:32.956402+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:58:32.956402+0000","last_undegraded":"2024-03-04T06:58:32.956402+0000","last_fullsized":"2024-03-04T06:58:32.956402+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:03.003999+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:58:03.003999+0000","last_peered":"2024-03-04T06:58:03.003999+0000","last_clean":"2024-03-04T06:58:03.003999+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:58:03.003999+0000","last_undegraded":"2024-03-04T06:58:03.003999+0000","last_fullsized":"2024-03-04T06:58:03.003999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162740+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:58:38.162740+0000","last_peered":"2024-03-04T06:58:38.162740+0000","last_clean":"2024-03-04T06:58:38.162740+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:58:38.162740+0000","last_undegraded":"2024-03-04T06:58:38.162740+0000","last_fullsized":"2024-03-04T06:58:38.162740+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:57.633964+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:59:57.633964+0000","last_peered":"2024-03-04T06:59:57.633964+0000","last_clean":"2024-03-04T06:59:57.633964+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:59:57.633964+0000","last_undegraded":"2024-03-04T06:59:57.633964+0000","last_fullsized":"2024-03-04T06:59:57.633964+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1131,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237167+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:58:48.237167+0000","last_peered":"2024-03-04T06:58:48.237167+0000","last_clean":"2024-03-04T06:58:48.237167+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:58:48.237167+0000","last_undegraded":"2024-03-04T06:58:48.237167+0000","last_fullsized":"2024-03-04T06:58:48.237167+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558443+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:59:44.558443+0000","last_peered":"2024-03-04T06:59:44.558443+0000","last_clean":"2024-03-04T06:59:44.558443+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:59:44.558443+0000","last_undegraded":"2024-03-04T06:59:44.558443+0000","last_fullsized":"2024-03-04T06:59:44.558443+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015596+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:59:58.015596+0000","last_peered":"2024-03-04T06:59:58.015596+0000","last_clean":"2024-03-04T06:59:58.015596+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:59:58.015596+0000","last_undegraded":"2024-03-04T06:59:58.015596+0000","last_fullsized":"2024-03-04T06:59:58.015596+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397438+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:58:48.397438+0000","last_peered":"2024-03-04T06:58:48.397438+0000","last_clean":"2024-03-04T06:58:48.397438+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:58:48.397438+0000","last_undegraded":"2024-03-04T06:58:48.397438+0000","last_fullsized":"2024-03-04T06:58:48.397438+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953851+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:58:12.953851+0000","last_peered":"2024-03-04T06:58:12.953851+0000","last_clean":"2024-03-04T06:58:12.953851+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:58:12.953851+0000","last_undegraded":"2024-03-04T06:58:12.953851+0000","last_fullsized":"2024-03-04T06:58:12.953851+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555834+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:59:24.555834+0000","last_peered":"2024-03-04T06:59:24.555834+0000","last_clean":"2024-03-04T06:59:24.555834+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:59:24.555834+0000","last_undegraded":"2024-03-04T06:59:24.555834+0000","last_fullsized":"2024-03-04T06:59:24.555834+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237147+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:58:48.237147+0000","last_peered":"2024-03-04T06:58:48.237147+0000","last_clean":"2024-03-04T06:58:48.237147+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:58:48.237147+0000","last_undegraded":"2024-03-04T06:58:48.237147+0000","last_fullsized":"2024-03-04T06:58:48.237147+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237122+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:58:48.237122+0000","last_peered":"2024-03-04T06:58:48.237122+0000","last_clean":"2024-03-04T06:58:48.237122+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:58:48.237122+0000","last_undegraded":"2024-03-04T06:58:48.237122+0000","last_fullsized":"2024-03-04T06:58:48.237122+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397404+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:58:48.397404+0000","last_peered":"2024-03-04T06:58:48.397404+0000","last_clean":"2024-03-04T06:58:48.397404+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:58:48.397404+0000","last_undegraded":"2024-03-04T06:58:48.397404+0000","last_fullsized":"2024-03-04T06:58:48.397404+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555799+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:59:24.555799+0000","last_peered":"2024-03-04T06:59:24.555799+0000","last_clean":"2024-03-04T06:59:24.555799+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:59:24.555799+0000","last_undegraded":"2024-03-04T06:59:24.555799+0000","last_fullsized":"2024-03-04T06:59:24.555799+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3579,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405911+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:00:08.405911+0000","last_peered":"2024-03-04T07:00:08.405911+0000","last_clean":"2024-03-04T07:00:08.405911+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:00:08.405911+0000","last_undegraded":"2024-03-04T07:00:08.405911+0000","last_fullsized":"2024-03-04T07:00:08.405911+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:32.631361+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:59:32.631361+0000","last_peered":"2024-03-04T06:59:32.631361+0000","last_clean":"2024-03-04T06:59:32.631361+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:59:32.631361+0000","last_undegraded":"2024-03-04T06:59:32.631361+0000","last_fullsized":"2024-03-04T06:59:32.631361+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553616+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:59:04.553616+0000","last_peered":"2024-03-04T06:59:04.553616+0000","last_clean":"2024-03-04T06:59:04.553616+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:59:04.553616+0000","last_undegraded":"2024-03-04T06:59:04.553616+0000","last_fullsized":"2024-03-04T06:59:04.553616+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17117,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006566+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T06:58:28.006566+0000","last_peered":"2024-03-04T06:58:28.006566+0000","last_clean":"2024-03-04T06:58:28.006566+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T06:58:28.006566+0000","last_undegraded":"2024-03-04T06:58:28.006566+0000","last_fullsized":"2024-03-04T06:58:28.006566+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164900+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:59:03.164900+0000","last_peered":"2024-03-04T06:59:03.164900+0000","last_clean":"2024-03-04T06:59:03.164900+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:59:03.164900+0000","last_undegraded":"2024-03-04T06:59:03.164900+0000","last_fullsized":"2024-03-04T06:59:03.164900+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164981+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:59:03.164981+0000","last_peered":"2024-03-04T06:59:03.164981+0000","last_clean":"2024-03-04T06:59:03.164981+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:59:03.164981+0000","last_undegraded":"2024-03-04T06:59:03.164981+0000","last_fullsized":"2024-03-04T06:59:03.164981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962033+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:59:17.962033+0000","last_peered":"2024-03-04T06:59:17.962033+0000","last_clean":"2024-03-04T06:59:17.962033+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:59:17.962033+0000","last_undegraded":"2024-03-04T06:59:17.962033+0000","last_fullsized":"2024-03-04T06:59:17.962033+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4387,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:28.006651+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T06:58:28.006651+0000","last_peered":"2024-03-04T06:58:28.006651+0000","last_clean":"2024-03-04T06:58:28.006651+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T06:58:28.006651+0000","last_undegraded":"2024-03-04T06:58:28.006651+0000","last_fullsized":"2024-03-04T06:58:28.006651+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164925+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:59:03.164925+0000","last_peered":"2024-03-04T06:59:03.164925+0000","last_clean":"2024-03-04T06:59:03.164925+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:59:03.164925+0000","last_undegraded":"2024-03-04T06:59:03.164925+0000","last_fullsized":"2024-03-04T06:59:03.164925+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.961943+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:59:17.961943+0000","last_peered":"2024-03-04T06:59:17.961943+0000","last_clean":"2024-03-04T06:59:17.961943+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:59:17.961943+0000","last_undegraded":"2024-03-04T06:59:17.961943+0000","last_fullsized":"2024-03-04T06:59:17.961943+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625641+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:58:42.625641+0000","last_peered":"2024-03-04T06:58:42.625641+0000","last_clean":"2024-03-04T06:58:42.625641+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:58:42.625641+0000","last_undegraded":"2024-03-04T06:58:42.625641+0000","last_fullsized":"2024-03-04T06:58:42.625641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5641,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.406020+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:00:08.406020+0000","last_peered":"2024-03-04T07:00:08.406020+0000","last_clean":"2024-03-04T07:00:08.406020+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:00:08.406020+0000","last_undegraded":"2024-03-04T07:00:08.406020+0000","last_fullsized":"2024-03-04T07:00:08.406020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1257,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168065+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:59:33.168065+0000","last_peered":"2024-03-04T06:59:33.168065+0000","last_clean":"2024-03-04T06:59:33.168065+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:59:33.168065+0000","last_undegraded":"2024-03-04T06:59:33.168065+0000","last_fullsized":"2024-03-04T06:59:33.168065+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:33.162083+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T06:58:33.162083+0000","last_peered":"2024-03-04T06:58:33.162083+0000","last_clean":"2024-03-04T06:58:33.162083+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T06:58:33.162083+0000","last_undegraded":"2024-03-04T06:58:33.162083+0000","last_fullsized":"2024-03-04T06:58:33.162083+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403066+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:59:38.403066+0000","last_peered":"2024-03-04T06:59:38.403066+0000","last_clean":"2024-03-04T06:59:38.403066+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:59:38.403066+0000","last_undegraded":"2024-03-04T06:59:38.403066+0000","last_fullsized":"2024-03-04T06:59:38.403066+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4016,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:24.549121+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T06:58:24.549121+0000","last_peered":"2024-03-04T06:58:24.549121+0000","last_clean":"2024-03-04T06:58:24.549121+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T06:58:24.549121+0000","last_undegraded":"2024-03-04T06:58:24.549121+0000","last_fullsized":"2024-03-04T06:58:24.549121+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244731+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:59:53.244731+0000","last_peered":"2024-03-04T06:59:53.244731+0000","last_clean":"2024-03-04T06:59:53.244731+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:59:53.244731+0000","last_undegraded":"2024-03-04T06:59:53.244731+0000","last_fullsized":"2024-03-04T06:59:53.244731+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017258+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T07:00:15.017258+0000","last_peered":"2024-03-04T07:00:15.017258+0000","last_clean":"2024-03-04T07:00:15.017258+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T07:00:15.017258+0000","last_undegraded":"2024-03-04T07:00:15.017258+0000","last_fullsized":"2024-03-04T07:00:15.017258+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962020+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:59:17.962020+0000","last_peered":"2024-03-04T06:59:17.962020+0000","last_clean":"2024-03-04T06:59:17.962020+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:59:17.962020+0000","last_undegraded":"2024-03-04T06:59:17.962020+0000","last_fullsized":"2024-03-04T06:59:17.962020+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1552,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560890+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:00:04.560890+0000","last_peered":"2024-03-04T07:00:04.560890+0000","last_clean":"2024-03-04T07:00:04.560890+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:00:04.560890+0000","last_undegraded":"2024-03-04T07:00:04.560890+0000","last_fullsized":"2024-03-04T07:00:04.560890+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3952,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.965034+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:59:42.965034+0000","last_peered":"2024-03-04T06:59:42.965034+0000","last_clean":"2024-03-04T06:59:42.965034+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:59:42.965034+0000","last_undegraded":"2024-03-04T06:59:42.965034+0000","last_fullsized":"2024-03-04T06:59:42.965034+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009504+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:58:58.009504+0000","last_peered":"2024-03-04T06:58:58.009504+0000","last_clean":"2024-03-04T06:58:58.009504+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:58:58.009504+0000","last_undegraded":"2024-03-04T06:58:58.009504+0000","last_fullsized":"2024-03-04T06:58:58.009504+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403043+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:59:38.403043+0000","last_peered":"2024-03-04T06:59:38.403043+0000","last_clean":"2024-03-04T06:59:38.403043+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:59:38.403043+0000","last_undegraded":"2024-03-04T06:59:38.403043+0000","last_fullsized":"2024-03-04T06:59:38.403043+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560852+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:00:04.560852+0000","last_peered":"2024-03-04T07:00:04.560852+0000","last_clean":"2024-03-04T07:00:04.560852+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:00:04.560852+0000","last_undegraded":"2024-03-04T07:00:04.560852+0000","last_fullsized":"2024-03-04T07:00:04.560852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15293,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:53.244696+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:59:53.244696+0000","last_peered":"2024-03-04T06:59:53.244696+0000","last_clean":"2024-03-04T06:59:53.244696+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:59:53.244696+0000","last_undegraded":"2024-03-04T06:59:53.244696+0000","last_fullsized":"2024-03-04T06:59:53.244696+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006608+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T06:58:28.006608+0000","last_peered":"2024-03-04T06:58:28.006608+0000","last_clean":"2024-03-04T06:58:28.006608+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T06:58:28.006608+0000","last_undegraded":"2024-03-04T06:58:28.006608+0000","last_fullsized":"2024-03-04T06:58:28.006608+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:24.549190+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T06:58:24.549190+0000","last_peered":"2024-03-04T06:58:24.549190+0000","last_clean":"2024-03-04T06:58:24.549190+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T06:58:24.549190+0000","last_undegraded":"2024-03-04T06:58:24.549190+0000","last_fullsized":"2024-03-04T06:58:24.549190+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164943+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:59:03.164943+0000","last_peered":"2024-03-04T06:59:03.164943+0000","last_clean":"2024-03-04T06:59:03.164943+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:59:03.164943+0000","last_undegraded":"2024-03-04T06:59:03.164943+0000","last_fullsized":"2024-03-04T06:59:03.164943+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4380,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:42.625602+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:58:42.625602+0000","last_peered":"2024-03-04T06:58:42.625602+0000","last_clean":"2024-03-04T06:58:42.625602+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:58:42.625602+0000","last_undegraded":"2024-03-04T06:58:42.625602+0000","last_fullsized":"2024-03-04T06:58:42.625602+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014181+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:59:45.014181+0000","last_peered":"2024-03-04T06:59:45.014181+0000","last_clean":"2024-03-04T06:59:45.014181+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:59:45.014181+0000","last_undegraded":"2024-03-04T06:59:45.014181+0000","last_fullsized":"2024-03-04T06:59:45.014181+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1270,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168056+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:59:33.168056+0000","last_peered":"2024-03-04T06:59:33.168056+0000","last_clean":"2024-03-04T06:59:33.168056+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:59:33.168056+0000","last_undegraded":"2024-03-04T06:59:33.168056+0000","last_fullsized":"2024-03-04T06:59:33.168056+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007125+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:58:35.007125+0000","last_peered":"2024-03-04T06:58:35.007125+0000","last_clean":"2024-03-04T06:58:35.007125+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:58:35.007125+0000","last_undegraded":"2024-03-04T06:58:35.007125+0000","last_fullsized":"2024-03-04T06:58:35.007125+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4611,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:45.014149+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:59:45.014149+0000","last_peered":"2024-03-04T06:59:45.014149+0000","last_clean":"2024-03-04T06:59:45.014149+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:59:45.014149+0000","last_undegraded":"2024-03-04T06:59:45.014149+0000","last_fullsized":"2024-03-04T06:59:45.014149+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625572+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:58:42.625572+0000","last_peered":"2024-03-04T06:58:42.625572+0000","last_clean":"2024-03-04T06:58:42.625572+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:58:42.625572+0000","last_undegraded":"2024-03-04T06:58:42.625572+0000","last_fullsized":"2024-03-04T06:58:42.625572+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1080,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247864+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T07:00:18.247864+0000","last_peered":"2024-03-04T07:00:18.247864+0000","last_clean":"2024-03-04T07:00:18.247864+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T07:00:18.247864+0000","last_undegraded":"2024-03-04T07:00:18.247864+0000","last_fullsized":"2024-03-04T07:00:18.247864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009478+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:58:58.009478+0000","last_peered":"2024-03-04T06:58:58.009478+0000","last_clean":"2024-03-04T06:58:58.009478+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:58:58.009478+0000","last_undegraded":"2024-03-04T06:58:58.009478+0000","last_fullsized":"2024-03-04T06:58:58.009478+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4636,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:07.967606+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T07:00:07.967606+0000","last_peered":"2024-03-04T07:00:07.967606+0000","last_clean":"2024-03-04T07:00:07.967606+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T07:00:07.967606+0000","last_undegraded":"2024-03-04T07:00:07.967606+0000","last_fullsized":"2024-03-04T07:00:07.967606+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:44.551296+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:58:44.551296+0000","last_peered":"2024-03-04T06:58:44.551296+0000","last_clean":"2024-03-04T06:58:44.551296+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:58:44.551296+0000","last_undegraded":"2024-03-04T06:58:44.551296+0000","last_fullsized":"2024-03-04T06:58:44.551296+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1186,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:07.628352+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:59:07.628352+0000","last_peered":"2024-03-04T06:59:07.628352+0000","last_clean":"2024-03-04T06:59:07.628352+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:59:07.628352+0000","last_undegraded":"2024-03-04T06:59:07.628352+0000","last_fullsized":"2024-03-04T06:59:07.628352+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5159,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:32.631317+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:59:32.631317+0000","last_peered":"2024-03-04T06:59:32.631317+0000","last_clean":"2024-03-04T06:59:32.631317+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:59:32.631317+0000","last_undegraded":"2024-03-04T06:59:32.631317+0000","last_fullsized":"2024-03-04T06:59:32.631317+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.167981+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:59:33.167981+0000","last_peered":"2024-03-04T06:59:33.167981+0000","last_clean":"2024-03-04T06:59:33.167981+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:59:33.167981+0000","last_undegraded":"2024-03-04T06:59:33.167981+0000","last_fullsized":"2024-03-04T06:59:33.167981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007066+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:58:35.007066+0000","last_peered":"2024-03-04T06:58:35.007066+0000","last_clean":"2024-03-04T06:58:35.007066+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:58:35.007066+0000","last_undegraded":"2024-03-04T06:58:35.007066+0000","last_fullsized":"2024-03-04T06:58:35.007066+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4720,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394889+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:58:23.394889+0000","last_peered":"2024-03-04T06:58:23.394889+0000","last_clean":"2024-03-04T06:58:23.394889+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:58:23.394889+0000","last_undegraded":"2024-03-04T06:58:23.394889+0000","last_fullsized":"2024-03-04T06:58:23.394889+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168002+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:59:33.168002+0000","last_peered":"2024-03-04T06:59:33.168002+0000","last_clean":"2024-03-04T06:59:33.168002+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:59:33.168002+0000","last_undegraded":"2024-03-04T06:59:33.168002+0000","last_fullsized":"2024-03-04T06:59:33.168002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009678+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:59:00.009678+0000","last_peered":"2024-03-04T06:59:00.009678+0000","last_clean":"2024-03-04T06:59:00.009678+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:59:00.009678+0000","last_undegraded":"2024-03-04T06:59:00.009678+0000","last_fullsized":"2024-03-04T06:59:00.009678+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5556,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:03.171266+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:00:03.171266+0000","last_peered":"2024-03-04T07:00:03.171266+0000","last_clean":"2024-03-04T07:00:03.171266+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:00:03.171266+0000","last_undegraded":"2024-03-04T07:00:03.171266+0000","last_fullsized":"2024-03-04T07:00:03.171266+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553540+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:59:04.553540+0000","last_peered":"2024-03-04T06:59:04.553540+0000","last_clean":"2024-03-04T06:59:04.553540+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:59:04.553540+0000","last_undegraded":"2024-03-04T06:59:04.553540+0000","last_fullsized":"2024-03-04T06:59:04.553540+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247800+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T07:00:18.247800+0000","last_peered":"2024-03-04T07:00:18.247800+0000","last_clean":"2024-03-04T07:00:18.247800+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T07:00:18.247800+0000","last_undegraded":"2024-03-04T07:00:18.247800+0000","last_fullsized":"2024-03-04T07:00:18.247800+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394833+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:58:23.394833+0000","last_peered":"2024-03-04T06:58:23.394833+0000","last_clean":"2024-03-04T06:58:23.394833+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:58:23.394833+0000","last_undegraded":"2024-03-04T06:58:23.394833+0000","last_fullsized":"2024-03-04T06:58:23.394833+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394877+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:58:23.394877+0000","last_peered":"2024-03-04T06:58:23.394877+0000","last_clean":"2024-03-04T06:58:23.394877+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:58:23.394877+0000","last_undegraded":"2024-03-04T06:58:23.394877+0000","last_fullsized":"2024-03-04T06:58:23.394877+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553601+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:59:04.553601+0000","last_peered":"2024-03-04T06:59:04.553601+0000","last_clean":"2024-03-04T06:59:04.553601+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:59:04.553601+0000","last_undegraded":"2024-03-04T06:59:04.553601+0000","last_fullsized":"2024-03-04T06:59:04.553601+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4368,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405967+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:00:08.405967+0000","last_peered":"2024-03-04T07:00:08.405967+0000","last_clean":"2024-03-04T07:00:08.405967+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:00:08.405967+0000","last_undegraded":"2024-03-04T07:00:08.405967+0000","last_fullsized":"2024-03-04T07:00:08.405967+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:03.171315+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:00:03.171315+0000","last_peered":"2024-03-04T07:00:03.171315+0000","last_clean":"2024-03-04T07:00:03.171315+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:00:03.171315+0000","last_undegraded":"2024-03-04T07:00:03.171315+0000","last_fullsized":"2024-03-04T07:00:03.171315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967580+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T07:00:07.967580+0000","last_peered":"2024-03-04T07:00:07.967580+0000","last_clean":"2024-03-04T07:00:07.967580+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T07:00:07.967580+0000","last_undegraded":"2024-03-04T07:00:07.967580+0000","last_fullsized":"2024-03-04T07:00:07.967580+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4601,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:44.551323+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:58:44.551323+0000","last_peered":"2024-03-04T06:58:44.551323+0000","last_clean":"2024-03-04T06:58:44.551323+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:58:44.551323+0000","last_undegraded":"2024-03-04T06:58:44.551323+0000","last_fullsized":"2024-03-04T06:58:44.551323+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1246,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394915+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:58:23.394915+0000","last_peered":"2024-03-04T06:58:23.394915+0000","last_clean":"2024-03-04T06:58:23.394915+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:58:23.394915+0000","last_undegraded":"2024-03-04T06:58:23.394915+0000","last_fullsized":"2024-03-04T06:58:23.394915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553631+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:59:04.553631+0000","last_peered":"2024-03-04T06:59:04.553631+0000","last_clean":"2024-03-04T06:59:04.553631+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:59:04.553631+0000","last_undegraded":"2024-03-04T06:59:04.553631+0000","last_fullsized":"2024-03-04T06:59:04.553631+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244661+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:59:53.244661+0000","last_peered":"2024-03-04T06:59:53.244661+0000","last_clean":"2024-03-04T06:59:53.244661+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:59:53.244661+0000","last_undegraded":"2024-03-04T06:59:53.244661+0000","last_fullsized":"2024-03-04T06:59:53.244661+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403075+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:59:38.403075+0000","last_peered":"2024-03-04T06:59:38.403075+0000","last_clean":"2024-03-04T06:59:38.403075+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:59:38.403075+0000","last_undegraded":"2024-03-04T06:59:38.403075+0000","last_fullsized":"2024-03-04T06:59:38.403075+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962003+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:59:17.962003+0000","last_peered":"2024-03-04T06:59:17.962003+0000","last_clean":"2024-03-04T06:59:17.962003+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:59:17.962003+0000","last_undegraded":"2024-03-04T06:59:17.962003+0000","last_fullsized":"2024-03-04T06:59:17.962003+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006538+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T06:58:28.006538+0000","last_peered":"2024-03-04T06:58:28.006538+0000","last_clean":"2024-03-04T06:58:28.006538+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T06:58:28.006538+0000","last_undegraded":"2024-03-04T06:58:28.006538+0000","last_fullsized":"2024-03-04T06:58:28.006538+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007105+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:58:35.007105+0000","last_peered":"2024-03-04T06:58:35.007105+0000","last_clean":"2024-03-04T06:58:35.007105+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:58:35.007105+0000","last_undegraded":"2024-03-04T06:58:35.007105+0000","last_fullsized":"2024-03-04T06:58:35.007105+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168023+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:59:33.168023+0000","last_peered":"2024-03-04T06:59:33.168023+0000","last_clean":"2024-03-04T06:59:33.168023+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:59:33.168023+0000","last_undegraded":"2024-03-04T06:59:33.168023+0000","last_fullsized":"2024-03-04T06:59:33.168023+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247852+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T07:00:18.247852+0000","last_peered":"2024-03-04T07:00:18.247852+0000","last_clean":"2024-03-04T07:00:18.247852+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T07:00:18.247852+0000","last_undegraded":"2024-03-04T07:00:18.247852+0000","last_fullsized":"2024-03-04T07:00:18.247852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007138+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:58:35.007138+0000","last_peered":"2024-03-04T06:58:35.007138+0000","last_clean":"2024-03-04T06:58:35.007138+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:58:35.007138+0000","last_undegraded":"2024-03-04T06:58:35.007138+0000","last_fullsized":"2024-03-04T06:58:35.007138+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.964990+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:59:42.964990+0000","last_peered":"2024-03-04T06:59:42.964990+0000","last_clean":"2024-03-04T06:59:42.964990+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:59:42.964990+0000","last_undegraded":"2024-03-04T06:59:42.964990+0000","last_fullsized":"2024-03-04T06:59:42.964990+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009646+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:59:00.009646+0000","last_peered":"2024-03-04T06:59:00.009646+0000","last_clean":"2024-03-04T06:59:00.009646+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:59:00.009646+0000","last_undegraded":"2024-03-04T06:59:00.009646+0000","last_fullsized":"2024-03-04T06:59:00.009646+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1122,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967529+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T07:00:07.967529+0000","last_peered":"2024-03-04T07:00:07.967529+0000","last_clean":"2024-03-04T07:00:07.967529+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T07:00:07.967529+0000","last_undegraded":"2024-03-04T07:00:07.967529+0000","last_fullsized":"2024-03-04T07:00:07.967529+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.012471+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:59:28.012471+0000","last_peered":"2024-03-04T06:59:28.012471+0000","last_clean":"2024-03-04T06:59:28.012471+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:59:28.012471+0000","last_undegraded":"2024-03-04T06:59:28.012471+0000","last_fullsized":"2024-03-04T06:59:28.012471+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.234922+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:58:28.234922+0000","last_peered":"2024-03-04T06:58:28.234922+0000","last_clean":"2024-03-04T06:58:28.234922+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:58:28.234922+0000","last_undegraded":"2024-03-04T06:58:28.234922+0000","last_fullsized":"2024-03-04T06:58:28.234922+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503510,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648157,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142464,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287111,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997817,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885874,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937451,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792804,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:02:32.877 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:32.877 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:32.877 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:32.878 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:32.878 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:32.878 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:32.878 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:32.878 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:32.878 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:32.878 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:32.878 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:02:33.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:33 smithi137 ceph-mon[88869]: from='client.44642 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:33.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:33 smithi137 ceph-mon[91314]: from='client.44642 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:33.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:33 smithi203 ceph-mon[85573]: from='client.44642 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:34.747 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:34 smithi203 ceph-mon[85573]: pgmap v1141: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:34.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:34 smithi137 ceph-mon[88869]: pgmap v1141: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:34.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:34 smithi137 ceph-mon[91314]: pgmap v1141: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:35.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:02:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:02:35] "GET /metrics HTTP/1.1" 200 36333 "" "Prometheus/2.43.0" 2024-03-04T07:02:36.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:36 smithi137 ceph-mon[88869]: pgmap v1142: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:36.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:36 smithi137 ceph-mon[91314]: pgmap v1142: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:36.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:36 smithi203 ceph-mon[85573]: pgmap v1142: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:38.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:38 smithi137 ceph-mon[88869]: pgmap v1143: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:38.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:38 smithi137 ceph-mon[91314]: pgmap v1143: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:38.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:38 smithi203 ceph-mon[85573]: pgmap v1143: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:39.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:02:39.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:02:39.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:02:40.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:40 smithi137 ceph-mon[88869]: pgmap v1144: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:40.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:40 smithi137 ceph-mon[91314]: pgmap v1144: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:40.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:40 smithi203 ceph-mon[85573]: pgmap v1144: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:42.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:42 smithi137 ceph-mon[88869]: pgmap v1145: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:42.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:42 smithi137 ceph-mon[91314]: pgmap v1145: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:42.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:42 smithi203 ceph-mon[85573]: pgmap v1145: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:42.879 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:02:43.099 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:02:44.737 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:44 smithi137 ceph-mon[88869]: pgmap v1146: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:44.738 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:44 smithi137 ceph-mon[91314]: pgmap v1146: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:44.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:44 smithi203 ceph-mon[85573]: pgmap v1146: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:02:45.176 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:02:45.456 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:02:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:02:45] "GET /metrics HTTP/1.1" 200 36337 "" "Prometheus/2.43.0" 2024-03-04T07:02:45.871 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1147,"stamp":"2024-03-04T07:02:44.598883+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003315"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.564000+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T07:00:29.564000+0000","last_peered":"2024-03-04T07:00:29.564000+0000","last_clean":"2024-03-04T07:00:29.564000+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T07:00:29.564000+0000","last_undegraded":"2024-03-04T07:00:29.564000+0000","last_fullsized":"2024-03-04T07:00:29.564000+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.165005+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:59:03.165005+0000","last_peered":"2024-03-04T06:59:03.165005+0000","last_clean":"2024-03-04T06:59:03.165005+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:59:03.165005+0000","last_undegraded":"2024-03-04T06:59:03.165005+0000","last_fullsized":"2024-03-04T06:59:03.165005+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019562+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T07:00:33.019562+0000","last_peered":"2024-03-04T07:00:33.019562+0000","last_clean":"2024-03-04T07:00:33.019562+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T07:00:33.019562+0000","last_undegraded":"2024-03-04T07:00:33.019562+0000","last_fullsized":"2024-03-04T07:00:33.019562+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958856+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T06:58:52.958856+0000","last_peered":"2024-03-04T06:58:52.958856+0000","last_clean":"2024-03-04T06:58:52.958856+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T06:58:52.958856+0000","last_undegraded":"2024-03-04T06:58:52.958856+0000","last_fullsized":"2024-03-04T06:58:52.958856+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560949+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T07:00:04.560949+0000","last_peered":"2024-03-04T07:00:04.560949+0000","last_clean":"2024-03-04T07:00:04.560949+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T07:00:04.560949+0000","last_undegraded":"2024-03-04T07:00:04.560949+0000","last_fullsized":"2024-03-04T07:00:04.560949+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958813+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:58:52.958813+0000","last_peered":"2024-03-04T06:58:52.958813+0000","last_clean":"2024-03-04T06:58:52.958813+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:58:52.958813+0000","last_undegraded":"2024-03-04T06:58:52.958813+0000","last_fullsized":"2024-03-04T06:58:52.958813+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560930+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T07:00:04.560930+0000","last_peered":"2024-03-04T07:00:04.560930+0000","last_clean":"2024-03-04T07:00:04.560930+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T07:00:04.560930+0000","last_undegraded":"2024-03-04T07:00:04.560930+0000","last_fullsized":"2024-03-04T07:00:04.560930+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001597+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T06:57:45.001597+0000","last_peered":"2024-03-04T06:57:45.001597+0000","last_clean":"2024-03-04T06:57:45.001597+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T06:57:45.001597+0000","last_undegraded":"2024-03-04T06:57:45.001597+0000","last_fullsized":"2024-03-04T06:57:45.001597+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1066,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558470+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:59:44.558470+0000","last_peered":"2024-03-04T06:59:44.558470+0000","last_clean":"2024-03-04T06:59:44.558470+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:59:44.558470+0000","last_undegraded":"2024-03-04T06:59:44.558470+0000","last_fullsized":"2024-03-04T06:59:44.558470+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239534+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:59:08.239534+0000","last_peered":"2024-03-04T06:59:08.239534+0000","last_clean":"2024-03-04T06:59:08.239534+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:59:08.239534+0000","last_undegraded":"2024-03-04T06:59:08.239534+0000","last_fullsized":"2024-03-04T06:59:08.239534+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239472+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:59:08.239472+0000","last_peered":"2024-03-04T06:59:08.239472+0000","last_clean":"2024-03-04T06:59:08.239472+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:59:08.239472+0000","last_undegraded":"2024-03-04T06:59:08.239472+0000","last_fullsized":"2024-03-04T06:59:08.239472+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1156,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:57.620940+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T06:57:57.620940+0000","last_peered":"2024-03-04T06:57:57.620940+0000","last_clean":"2024-03-04T06:57:57.620940+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T06:57:57.620940+0000","last_undegraded":"2024-03-04T06:57:57.620940+0000","last_fullsized":"2024-03-04T06:57:57.620940+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014730+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:59:50.014730+0000","last_peered":"2024-03-04T06:59:50.014730+0000","last_clean":"2024-03-04T06:59:50.014730+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:59:50.014730+0000","last_undegraded":"2024-03-04T06:59:50.014730+0000","last_fullsized":"2024-03-04T06:59:50.014730+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015553+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:59:58.015553+0000","last_peered":"2024-03-04T06:59:58.015553+0000","last_clean":"2024-03-04T06:59:58.015553+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:59:58.015553+0000","last_undegraded":"2024-03-04T06:59:58.015553+0000","last_fullsized":"2024-03-04T06:59:58.015553+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:13.159769+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T06:58:13.159769+0000","last_peered":"2024-03-04T06:58:13.159769+0000","last_clean":"2024-03-04T06:58:13.159769+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T06:58:13.159769+0000","last_undegraded":"2024-03-04T06:58:13.159769+0000","last_fullsized":"2024-03-04T06:58:13.159769+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953787+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T06:58:12.953787+0000","last_peered":"2024-03-04T06:58:12.953787+0000","last_clean":"2024-03-04T06:58:12.953787+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T06:58:12.953787+0000","last_undegraded":"2024-03-04T06:58:12.953787+0000","last_fullsized":"2024-03-04T06:58:12.953787+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953915+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T06:58:12.953915+0000","last_peered":"2024-03-04T06:58:12.953915+0000","last_clean":"2024-03-04T06:58:12.953915+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T06:58:12.953915+0000","last_undegraded":"2024-03-04T06:58:12.953915+0000","last_fullsized":"2024-03-04T06:58:12.953915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397463+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:58:48.397463+0000","last_peered":"2024-03-04T06:58:48.397463+0000","last_clean":"2024-03-04T06:58:48.397463+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:58:48.397463+0000","last_undegraded":"2024-03-04T06:58:48.397463+0000","last_fullsized":"2024-03-04T06:58:48.397463+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:59:04.553588+0000","last_peered":"2024-03-04T06:59:04.553588+0000","last_clean":"2024-03-04T06:59:04.553588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:59:04.553588+0000","last_undegraded":"2024-03-04T06:59:04.553588+0000","last_fullsized":"2024-03-04T06:59:04.553588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1307,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019623+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T07:00:33.019623+0000","last_peered":"2024-03-04T07:00:33.019623+0000","last_clean":"2024-03-04T07:00:33.019623+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T07:00:33.019623+0000","last_undegraded":"2024-03-04T07:00:33.019623+0000","last_fullsized":"2024-03-04T07:00:33.019623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014206+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:59:45.014206+0000","last_peered":"2024-03-04T06:59:45.014206+0000","last_clean":"2024-03-04T06:59:45.014206+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:59:45.014206+0000","last_undegraded":"2024-03-04T06:59:45.014206+0000","last_fullsized":"2024-03-04T06:59:45.014206+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014216+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:59:45.014216+0000","last_peered":"2024-03-04T06:59:45.014216+0000","last_clean":"2024-03-04T06:59:45.014216+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:59:45.014216+0000","last_undegraded":"2024-03-04T06:59:45.014216+0000","last_fullsized":"2024-03-04T06:59:45.014216+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019611+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T07:00:33.019611+0000","last_peered":"2024-03-04T07:00:33.019611+0000","last_clean":"2024-03-04T07:00:33.019611+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T07:00:33.019611+0000","last_undegraded":"2024-03-04T07:00:33.019611+0000","last_fullsized":"2024-03-04T07:00:33.019611+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403128+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:59:38.403128+0000","last_peered":"2024-03-04T06:59:38.403128+0000","last_clean":"2024-03-04T06:59:38.403128+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:59:38.403128+0000","last_undegraded":"2024-03-04T06:59:38.403128+0000","last_fullsized":"2024-03-04T06:59:38.403128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1223,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403103+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:59:38.403103+0000","last_peered":"2024-03-04T06:59:38.403103+0000","last_clean":"2024-03-04T06:59:38.403103+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:59:38.403103+0000","last_undegraded":"2024-03-04T06:59:38.403103+0000","last_fullsized":"2024-03-04T06:59:38.403103+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560965+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T07:00:04.560965+0000","last_peered":"2024-03-04T07:00:04.560965+0000","last_clean":"2024-03-04T07:00:04.560965+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T07:00:04.560965+0000","last_undegraded":"2024-03-04T07:00:04.560965+0000","last_fullsized":"2024-03-04T07:00:04.560965+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958870+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:58:52.958870+0000","last_peered":"2024-03-04T06:58:52.958870+0000","last_clean":"2024-03-04T06:58:52.958870+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:58:52.958870+0000","last_undegraded":"2024-03-04T06:58:52.958870+0000","last_fullsized":"2024-03-04T06:58:52.958870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:57:45.001694+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T06:57:45.001694+0000","last_peered":"2024-03-04T06:57:45.001694+0000","last_clean":"2024-03-04T06:57:45.001694+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T06:57:45.001694+0000","last_undegraded":"2024-03-04T06:57:45.001694+0000","last_fullsized":"2024-03-04T06:57:45.001694+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1190,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:17.623076+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:58:17.623076+0000","last_peered":"2024-03-04T06:58:17.623076+0000","last_clean":"2024-03-04T06:58:17.623076+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:58:17.623076+0000","last_undegraded":"2024-03-04T06:58:17.623076+0000","last_fullsized":"2024-03-04T06:58:17.623076+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.241598+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:59:28.241598+0000","last_peered":"2024-03-04T06:59:28.241598+0000","last_clean":"2024-03-04T06:59:28.241598+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:59:28.241598+0000","last_undegraded":"2024-03-04T06:59:28.241598+0000","last_fullsized":"2024-03-04T06:59:28.241598+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006622+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:58:28.006622+0000","last_peered":"2024-03-04T06:58:28.006622+0000","last_clean":"2024-03-04T06:58:28.006622+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:58:28.006622+0000","last_undegraded":"2024-03-04T06:58:28.006622+0000","last_fullsized":"2024-03-04T06:58:28.006622+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014712+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:59:50.014712+0000","last_peered":"2024-03-04T06:59:50.014712+0000","last_clean":"2024-03-04T06:59:50.014712+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:59:50.014712+0000","last_undegraded":"2024-03-04T06:59:50.014712+0000","last_fullsized":"2024-03-04T06:59:50.014712+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014675+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:59:50.014675+0000","last_peered":"2024-03-04T06:59:50.014675+0000","last_clean":"2024-03-04T06:59:50.014675+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:59:50.014675+0000","last_undegraded":"2024-03-04T06:59:50.014675+0000","last_fullsized":"2024-03-04T06:59:50.014675+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956356+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:58:32.956356+0000","last_peered":"2024-03-04T06:58:32.956356+0000","last_clean":"2024-03-04T06:58:32.956356+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:58:32.956356+0000","last_undegraded":"2024-03-04T06:58:32.956356+0000","last_fullsized":"2024-03-04T06:58:32.956356+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162696+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:58:38.162696+0000","last_peered":"2024-03-04T06:58:38.162696+0000","last_clean":"2024-03-04T06:58:38.162696+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:58:38.162696+0000","last_undegraded":"2024-03-04T06:58:38.162696+0000","last_fullsized":"2024-03-04T06:58:38.162696+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239549+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:59:08.239549+0000","last_peered":"2024-03-04T06:59:08.239549+0000","last_clean":"2024-03-04T06:59:08.239549+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:59:08.239549+0000","last_undegraded":"2024-03-04T06:59:08.239549+0000","last_fullsized":"2024-03-04T06:59:08.239549+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956414+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:58:32.956414+0000","last_peered":"2024-03-04T06:58:32.956414+0000","last_clean":"2024-03-04T06:58:32.956414+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:58:32.956414+0000","last_undegraded":"2024-03-04T06:58:32.956414+0000","last_fullsized":"2024-03-04T06:58:32.956414+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956402+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:58:32.956402+0000","last_peered":"2024-03-04T06:58:32.956402+0000","last_clean":"2024-03-04T06:58:32.956402+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:58:32.956402+0000","last_undegraded":"2024-03-04T06:58:32.956402+0000","last_fullsized":"2024-03-04T06:58:32.956402+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:03.003999+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T06:58:03.003999+0000","last_peered":"2024-03-04T06:58:03.003999+0000","last_clean":"2024-03-04T06:58:03.003999+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T06:58:03.003999+0000","last_undegraded":"2024-03-04T06:58:03.003999+0000","last_fullsized":"2024-03-04T06:58:03.003999+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162740+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:58:38.162740+0000","last_peered":"2024-03-04T06:58:38.162740+0000","last_clean":"2024-03-04T06:58:38.162740+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:58:38.162740+0000","last_undegraded":"2024-03-04T06:58:38.162740+0000","last_fullsized":"2024-03-04T06:58:38.162740+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:57.633964+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:59:57.633964+0000","last_peered":"2024-03-04T06:59:57.633964+0000","last_clean":"2024-03-04T06:59:57.633964+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:59:57.633964+0000","last_undegraded":"2024-03-04T06:59:57.633964+0000","last_fullsized":"2024-03-04T06:59:57.633964+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1131,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237167+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:58:48.237167+0000","last_peered":"2024-03-04T06:58:48.237167+0000","last_clean":"2024-03-04T06:58:48.237167+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:58:48.237167+0000","last_undegraded":"2024-03-04T06:58:48.237167+0000","last_fullsized":"2024-03-04T06:58:48.237167+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558443+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:59:44.558443+0000","last_peered":"2024-03-04T06:59:44.558443+0000","last_clean":"2024-03-04T06:59:44.558443+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:59:44.558443+0000","last_undegraded":"2024-03-04T06:59:44.558443+0000","last_fullsized":"2024-03-04T06:59:44.558443+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015596+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:59:58.015596+0000","last_peered":"2024-03-04T06:59:58.015596+0000","last_clean":"2024-03-04T06:59:58.015596+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:59:58.015596+0000","last_undegraded":"2024-03-04T06:59:58.015596+0000","last_fullsized":"2024-03-04T06:59:58.015596+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397438+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:58:48.397438+0000","last_peered":"2024-03-04T06:58:48.397438+0000","last_clean":"2024-03-04T06:58:48.397438+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:58:48.397438+0000","last_undegraded":"2024-03-04T06:58:48.397438+0000","last_fullsized":"2024-03-04T06:58:48.397438+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:12.953851+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T06:58:12.953851+0000","last_peered":"2024-03-04T06:58:12.953851+0000","last_clean":"2024-03-04T06:58:12.953851+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T06:58:12.953851+0000","last_undegraded":"2024-03-04T06:58:12.953851+0000","last_fullsized":"2024-03-04T06:58:12.953851+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555834+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:59:24.555834+0000","last_peered":"2024-03-04T06:59:24.555834+0000","last_clean":"2024-03-04T06:59:24.555834+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:59:24.555834+0000","last_undegraded":"2024-03-04T06:59:24.555834+0000","last_fullsized":"2024-03-04T06:59:24.555834+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237147+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:58:48.237147+0000","last_peered":"2024-03-04T06:58:48.237147+0000","last_clean":"2024-03-04T06:58:48.237147+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:58:48.237147+0000","last_undegraded":"2024-03-04T06:58:48.237147+0000","last_fullsized":"2024-03-04T06:58:48.237147+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237122+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:58:48.237122+0000","last_peered":"2024-03-04T06:58:48.237122+0000","last_clean":"2024-03-04T06:58:48.237122+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:58:48.237122+0000","last_undegraded":"2024-03-04T06:58:48.237122+0000","last_fullsized":"2024-03-04T06:58:48.237122+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397404+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:58:48.397404+0000","last_peered":"2024-03-04T06:58:48.397404+0000","last_clean":"2024-03-04T06:58:48.397404+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:58:48.397404+0000","last_undegraded":"2024-03-04T06:58:48.397404+0000","last_fullsized":"2024-03-04T06:58:48.397404+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555799+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:59:24.555799+0000","last_peered":"2024-03-04T06:59:24.555799+0000","last_clean":"2024-03-04T06:59:24.555799+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:59:24.555799+0000","last_undegraded":"2024-03-04T06:59:24.555799+0000","last_fullsized":"2024-03-04T06:59:24.555799+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3579,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405911+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:00:08.405911+0000","last_peered":"2024-03-04T07:00:08.405911+0000","last_clean":"2024-03-04T07:00:08.405911+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:00:08.405911+0000","last_undegraded":"2024-03-04T07:00:08.405911+0000","last_fullsized":"2024-03-04T07:00:08.405911+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:32.631361+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:59:32.631361+0000","last_peered":"2024-03-04T06:59:32.631361+0000","last_clean":"2024-03-04T06:59:32.631361+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:59:32.631361+0000","last_undegraded":"2024-03-04T06:59:32.631361+0000","last_fullsized":"2024-03-04T06:59:32.631361+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553616+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:59:04.553616+0000","last_peered":"2024-03-04T06:59:04.553616+0000","last_clean":"2024-03-04T06:59:04.553616+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:59:04.553616+0000","last_undegraded":"2024-03-04T06:59:04.553616+0000","last_fullsized":"2024-03-04T06:59:04.553616+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17118,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019514+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T07:00:33.019514+0000","last_peered":"2024-03-04T07:00:33.019514+0000","last_clean":"2024-03-04T07:00:33.019514+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T07:00:33.019514+0000","last_undegraded":"2024-03-04T07:00:33.019514+0000","last_fullsized":"2024-03-04T07:00:33.019514+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164900+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:59:03.164900+0000","last_peered":"2024-03-04T06:59:03.164900+0000","last_clean":"2024-03-04T06:59:03.164900+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:59:03.164900+0000","last_undegraded":"2024-03-04T06:59:03.164900+0000","last_fullsized":"2024-03-04T06:59:03.164900+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164981+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:59:03.164981+0000","last_peered":"2024-03-04T06:59:03.164981+0000","last_clean":"2024-03-04T06:59:03.164981+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:59:03.164981+0000","last_undegraded":"2024-03-04T06:59:03.164981+0000","last_fullsized":"2024-03-04T06:59:03.164981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962033+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:59:17.962033+0000","last_peered":"2024-03-04T06:59:17.962033+0000","last_clean":"2024-03-04T06:59:17.962033+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:59:17.962033+0000","last_undegraded":"2024-03-04T06:59:17.962033+0000","last_fullsized":"2024-03-04T06:59:17.962033+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4388,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019581+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T07:00:33.019581+0000","last_peered":"2024-03-04T07:00:33.019581+0000","last_clean":"2024-03-04T07:00:33.019581+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T07:00:33.019581+0000","last_undegraded":"2024-03-04T07:00:33.019581+0000","last_fullsized":"2024-03-04T07:00:33.019581+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164925+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:59:03.164925+0000","last_peered":"2024-03-04T06:59:03.164925+0000","last_clean":"2024-03-04T06:59:03.164925+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:59:03.164925+0000","last_undegraded":"2024-03-04T06:59:03.164925+0000","last_fullsized":"2024-03-04T06:59:03.164925+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.961943+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:59:17.961943+0000","last_peered":"2024-03-04T06:59:17.961943+0000","last_clean":"2024-03-04T06:59:17.961943+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:59:17.961943+0000","last_undegraded":"2024-03-04T06:59:17.961943+0000","last_fullsized":"2024-03-04T06:59:17.961943+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1158,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625641+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T06:58:42.625641+0000","last_peered":"2024-03-04T06:58:42.625641+0000","last_clean":"2024-03-04T06:58:42.625641+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T06:58:42.625641+0000","last_undegraded":"2024-03-04T06:58:42.625641+0000","last_fullsized":"2024-03-04T06:58:42.625641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5641,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.406020+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:00:08.406020+0000","last_peered":"2024-03-04T07:00:08.406020+0000","last_clean":"2024-03-04T07:00:08.406020+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:00:08.406020+0000","last_undegraded":"2024-03-04T07:00:08.406020+0000","last_fullsized":"2024-03-04T07:00:08.406020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1257,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168065+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:59:33.168065+0000","last_peered":"2024-03-04T06:59:33.168065+0000","last_clean":"2024-03-04T06:59:33.168065+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:59:33.168065+0000","last_undegraded":"2024-03-04T06:59:33.168065+0000","last_fullsized":"2024-03-04T06:59:33.168065+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174867+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T07:00:33.174867+0000","last_peered":"2024-03-04T07:00:33.174867+0000","last_clean":"2024-03-04T07:00:33.174867+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T07:00:33.174867+0000","last_undegraded":"2024-03-04T07:00:33.174867+0000","last_fullsized":"2024-03-04T07:00:33.174867+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403066+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:59:38.403066+0000","last_peered":"2024-03-04T06:59:38.403066+0000","last_clean":"2024-03-04T06:59:38.403066+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:59:38.403066+0000","last_undegraded":"2024-03-04T06:59:38.403066+0000","last_fullsized":"2024-03-04T06:59:38.403066+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4017,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:29.563935+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T07:00:29.563935+0000","last_peered":"2024-03-04T07:00:29.563935+0000","last_clean":"2024-03-04T07:00:29.563935+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T07:00:29.563935+0000","last_undegraded":"2024-03-04T07:00:29.563935+0000","last_fullsized":"2024-03-04T07:00:29.563935+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244731+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:59:53.244731+0000","last_peered":"2024-03-04T06:59:53.244731+0000","last_clean":"2024-03-04T06:59:53.244731+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:59:53.244731+0000","last_undegraded":"2024-03-04T06:59:53.244731+0000","last_fullsized":"2024-03-04T06:59:53.244731+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017258+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T07:00:15.017258+0000","last_peered":"2024-03-04T07:00:15.017258+0000","last_clean":"2024-03-04T07:00:15.017258+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T07:00:15.017258+0000","last_undegraded":"2024-03-04T07:00:15.017258+0000","last_fullsized":"2024-03-04T07:00:15.017258+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962020+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:59:17.962020+0000","last_peered":"2024-03-04T06:59:17.962020+0000","last_clean":"2024-03-04T06:59:17.962020+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:59:17.962020+0000","last_undegraded":"2024-03-04T06:59:17.962020+0000","last_fullsized":"2024-03-04T06:59:17.962020+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1552,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560890+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:00:04.560890+0000","last_peered":"2024-03-04T07:00:04.560890+0000","last_clean":"2024-03-04T07:00:04.560890+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:00:04.560890+0000","last_undegraded":"2024-03-04T07:00:04.560890+0000","last_fullsized":"2024-03-04T07:00:04.560890+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3952,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.965034+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:59:42.965034+0000","last_peered":"2024-03-04T06:59:42.965034+0000","last_clean":"2024-03-04T06:59:42.965034+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:59:42.965034+0000","last_undegraded":"2024-03-04T06:59:42.965034+0000","last_fullsized":"2024-03-04T06:59:42.965034+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009504+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:58:58.009504+0000","last_peered":"2024-03-04T06:58:58.009504+0000","last_clean":"2024-03-04T06:58:58.009504+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:58:58.009504+0000","last_undegraded":"2024-03-04T06:58:58.009504+0000","last_fullsized":"2024-03-04T06:58:58.009504+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403043+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:59:38.403043+0000","last_peered":"2024-03-04T06:59:38.403043+0000","last_clean":"2024-03-04T06:59:38.403043+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:59:38.403043+0000","last_undegraded":"2024-03-04T06:59:38.403043+0000","last_fullsized":"2024-03-04T06:59:38.403043+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560852+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:00:04.560852+0000","last_peered":"2024-03-04T07:00:04.560852+0000","last_clean":"2024-03-04T07:00:04.560852+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:00:04.560852+0000","last_undegraded":"2024-03-04T07:00:04.560852+0000","last_fullsized":"2024-03-04T07:00:04.560852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15293,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:53.244696+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:59:53.244696+0000","last_peered":"2024-03-04T06:59:53.244696+0000","last_clean":"2024-03-04T06:59:53.244696+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:59:53.244696+0000","last_undegraded":"2024-03-04T06:59:53.244696+0000","last_fullsized":"2024-03-04T06:59:53.244696+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019541+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T07:00:33.019541+0000","last_peered":"2024-03-04T07:00:33.019541+0000","last_clean":"2024-03-04T07:00:33.019541+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T07:00:33.019541+0000","last_undegraded":"2024-03-04T07:00:33.019541+0000","last_fullsized":"2024-03-04T07:00:33.019541+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1075,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.563983+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T07:00:29.563983+0000","last_peered":"2024-03-04T07:00:29.563983+0000","last_clean":"2024-03-04T07:00:29.563983+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T07:00:29.563983+0000","last_undegraded":"2024-03-04T07:00:29.563983+0000","last_fullsized":"2024-03-04T07:00:29.563983+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164943+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:59:03.164943+0000","last_peered":"2024-03-04T06:59:03.164943+0000","last_clean":"2024-03-04T06:59:03.164943+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:59:03.164943+0000","last_undegraded":"2024-03-04T06:59:03.164943+0000","last_fullsized":"2024-03-04T06:59:03.164943+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4380,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:42.625602+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T06:58:42.625602+0000","last_peered":"2024-03-04T06:58:42.625602+0000","last_clean":"2024-03-04T06:58:42.625602+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T06:58:42.625602+0000","last_undegraded":"2024-03-04T06:58:42.625602+0000","last_fullsized":"2024-03-04T06:58:42.625602+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014181+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:59:45.014181+0000","last_peered":"2024-03-04T06:59:45.014181+0000","last_clean":"2024-03-04T06:59:45.014181+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:59:45.014181+0000","last_undegraded":"2024-03-04T06:59:45.014181+0000","last_fullsized":"2024-03-04T06:59:45.014181+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1270,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168056+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:59:33.168056+0000","last_peered":"2024-03-04T06:59:33.168056+0000","last_clean":"2024-03-04T06:59:33.168056+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:59:33.168056+0000","last_undegraded":"2024-03-04T06:59:33.168056+0000","last_fullsized":"2024-03-04T06:59:33.168056+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007125+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T06:58:35.007125+0000","last_peered":"2024-03-04T06:58:35.007125+0000","last_clean":"2024-03-04T06:58:35.007125+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T06:58:35.007125+0000","last_undegraded":"2024-03-04T06:58:35.007125+0000","last_fullsized":"2024-03-04T06:58:35.007125+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4611,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:45.014149+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:59:45.014149+0000","last_peered":"2024-03-04T06:59:45.014149+0000","last_clean":"2024-03-04T06:59:45.014149+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:59:45.014149+0000","last_undegraded":"2024-03-04T06:59:45.014149+0000","last_fullsized":"2024-03-04T06:59:45.014149+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:42.625572+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T06:58:42.625572+0000","last_peered":"2024-03-04T06:58:42.625572+0000","last_clean":"2024-03-04T06:58:42.625572+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T06:58:42.625572+0000","last_undegraded":"2024-03-04T06:58:42.625572+0000","last_fullsized":"2024-03-04T06:58:42.625572+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1080,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247864+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T07:00:18.247864+0000","last_peered":"2024-03-04T07:00:18.247864+0000","last_clean":"2024-03-04T07:00:18.247864+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T07:00:18.247864+0000","last_undegraded":"2024-03-04T07:00:18.247864+0000","last_fullsized":"2024-03-04T07:00:18.247864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009478+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:58:58.009478+0000","last_peered":"2024-03-04T06:58:58.009478+0000","last_clean":"2024-03-04T06:58:58.009478+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:58:58.009478+0000","last_undegraded":"2024-03-04T06:58:58.009478+0000","last_fullsized":"2024-03-04T06:58:58.009478+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4636,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:07.967606+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T07:00:07.967606+0000","last_peered":"2024-03-04T07:00:07.967606+0000","last_clean":"2024-03-04T07:00:07.967606+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T07:00:07.967606+0000","last_undegraded":"2024-03-04T07:00:07.967606+0000","last_fullsized":"2024-03-04T07:00:07.967606+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:44.551296+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:58:44.551296+0000","last_peered":"2024-03-04T06:58:44.551296+0000","last_clean":"2024-03-04T06:58:44.551296+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:58:44.551296+0000","last_undegraded":"2024-03-04T06:58:44.551296+0000","last_fullsized":"2024-03-04T06:58:44.551296+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1186,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:07.628352+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:59:07.628352+0000","last_peered":"2024-03-04T06:59:07.628352+0000","last_clean":"2024-03-04T06:59:07.628352+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:59:07.628352+0000","last_undegraded":"2024-03-04T06:59:07.628352+0000","last_fullsized":"2024-03-04T06:59:07.628352+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5159,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:32.631317+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:59:32.631317+0000","last_peered":"2024-03-04T06:59:32.631317+0000","last_clean":"2024-03-04T06:59:32.631317+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:59:32.631317+0000","last_undegraded":"2024-03-04T06:59:32.631317+0000","last_fullsized":"2024-03-04T06:59:32.631317+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.167981+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:59:33.167981+0000","last_peered":"2024-03-04T06:59:33.167981+0000","last_clean":"2024-03-04T06:59:33.167981+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:59:33.167981+0000","last_undegraded":"2024-03-04T06:59:33.167981+0000","last_fullsized":"2024-03-04T06:59:33.167981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007066+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T06:58:35.007066+0000","last_peered":"2024-03-04T06:58:35.007066+0000","last_clean":"2024-03-04T06:58:35.007066+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T06:58:35.007066+0000","last_undegraded":"2024-03-04T06:58:35.007066+0000","last_fullsized":"2024-03-04T06:58:35.007066+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4720,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394889+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T06:58:23.394889+0000","last_peered":"2024-03-04T06:58:23.394889+0000","last_clean":"2024-03-04T06:58:23.394889+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T06:58:23.394889+0000","last_undegraded":"2024-03-04T06:58:23.394889+0000","last_fullsized":"2024-03-04T06:58:23.394889+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168002+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:59:33.168002+0000","last_peered":"2024-03-04T06:59:33.168002+0000","last_clean":"2024-03-04T06:59:33.168002+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:59:33.168002+0000","last_undegraded":"2024-03-04T06:59:33.168002+0000","last_fullsized":"2024-03-04T06:59:33.168002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009678+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:59:00.009678+0000","last_peered":"2024-03-04T06:59:00.009678+0000","last_clean":"2024-03-04T06:59:00.009678+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:59:00.009678+0000","last_undegraded":"2024-03-04T06:59:00.009678+0000","last_fullsized":"2024-03-04T06:59:00.009678+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5556,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:03.171266+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:00:03.171266+0000","last_peered":"2024-03-04T07:00:03.171266+0000","last_clean":"2024-03-04T07:00:03.171266+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:00:03.171266+0000","last_undegraded":"2024-03-04T07:00:03.171266+0000","last_fullsized":"2024-03-04T07:00:03.171266+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553540+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:59:04.553540+0000","last_peered":"2024-03-04T06:59:04.553540+0000","last_clean":"2024-03-04T06:59:04.553540+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:59:04.553540+0000","last_undegraded":"2024-03-04T06:59:04.553540+0000","last_fullsized":"2024-03-04T06:59:04.553540+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247800+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T07:00:18.247800+0000","last_peered":"2024-03-04T07:00:18.247800+0000","last_clean":"2024-03-04T07:00:18.247800+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T07:00:18.247800+0000","last_undegraded":"2024-03-04T07:00:18.247800+0000","last_fullsized":"2024-03-04T07:00:18.247800+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394833+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T06:58:23.394833+0000","last_peered":"2024-03-04T06:58:23.394833+0000","last_clean":"2024-03-04T06:58:23.394833+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T06:58:23.394833+0000","last_undegraded":"2024-03-04T06:58:23.394833+0000","last_fullsized":"2024-03-04T06:58:23.394833+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1239,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394877+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T06:58:23.394877+0000","last_peered":"2024-03-04T06:58:23.394877+0000","last_clean":"2024-03-04T06:58:23.394877+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T06:58:23.394877+0000","last_undegraded":"2024-03-04T06:58:23.394877+0000","last_fullsized":"2024-03-04T06:58:23.394877+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553601+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:59:04.553601+0000","last_peered":"2024-03-04T06:59:04.553601+0000","last_clean":"2024-03-04T06:59:04.553601+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:59:04.553601+0000","last_undegraded":"2024-03-04T06:59:04.553601+0000","last_fullsized":"2024-03-04T06:59:04.553601+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4368,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405967+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:00:08.405967+0000","last_peered":"2024-03-04T07:00:08.405967+0000","last_clean":"2024-03-04T07:00:08.405967+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:00:08.405967+0000","last_undegraded":"2024-03-04T07:00:08.405967+0000","last_fullsized":"2024-03-04T07:00:08.405967+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:03.171315+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:00:03.171315+0000","last_peered":"2024-03-04T07:00:03.171315+0000","last_clean":"2024-03-04T07:00:03.171315+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:00:03.171315+0000","last_undegraded":"2024-03-04T07:00:03.171315+0000","last_fullsized":"2024-03-04T07:00:03.171315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967580+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T07:00:07.967580+0000","last_peered":"2024-03-04T07:00:07.967580+0000","last_clean":"2024-03-04T07:00:07.967580+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T07:00:07.967580+0000","last_undegraded":"2024-03-04T07:00:07.967580+0000","last_fullsized":"2024-03-04T07:00:07.967580+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4601,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:44.551323+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:58:44.551323+0000","last_peered":"2024-03-04T06:58:44.551323+0000","last_clean":"2024-03-04T06:58:44.551323+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:58:44.551323+0000","last_undegraded":"2024-03-04T06:58:44.551323+0000","last_fullsized":"2024-03-04T06:58:44.551323+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1246,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:23.394915+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T06:58:23.394915+0000","last_peered":"2024-03-04T06:58:23.394915+0000","last_clean":"2024-03-04T06:58:23.394915+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T06:58:23.394915+0000","last_undegraded":"2024-03-04T06:58:23.394915+0000","last_fullsized":"2024-03-04T06:58:23.394915+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553631+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:59:04.553631+0000","last_peered":"2024-03-04T06:59:04.553631+0000","last_clean":"2024-03-04T06:59:04.553631+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:59:04.553631+0000","last_undegraded":"2024-03-04T06:59:04.553631+0000","last_fullsized":"2024-03-04T06:59:04.553631+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244661+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:59:53.244661+0000","last_peered":"2024-03-04T06:59:53.244661+0000","last_clean":"2024-03-04T06:59:53.244661+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:59:53.244661+0000","last_undegraded":"2024-03-04T06:59:53.244661+0000","last_fullsized":"2024-03-04T06:59:53.244661+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403075+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:59:38.403075+0000","last_peered":"2024-03-04T06:59:38.403075+0000","last_clean":"2024-03-04T06:59:38.403075+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:59:38.403075+0000","last_undegraded":"2024-03-04T06:59:38.403075+0000","last_fullsized":"2024-03-04T06:59:38.403075+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962003+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:59:17.962003+0000","last_peered":"2024-03-04T06:59:17.962003+0000","last_clean":"2024-03-04T06:59:17.962003+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:59:17.962003+0000","last_undegraded":"2024-03-04T06:59:17.962003+0000","last_fullsized":"2024-03-04T06:59:17.962003+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019487+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T07:00:33.019487+0000","last_peered":"2024-03-04T07:00:33.019487+0000","last_clean":"2024-03-04T07:00:33.019487+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T07:00:33.019487+0000","last_undegraded":"2024-03-04T07:00:33.019487+0000","last_fullsized":"2024-03-04T07:00:33.019487+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007105+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T06:58:35.007105+0000","last_peered":"2024-03-04T06:58:35.007105+0000","last_clean":"2024-03-04T06:58:35.007105+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T06:58:35.007105+0000","last_undegraded":"2024-03-04T06:58:35.007105+0000","last_fullsized":"2024-03-04T06:58:35.007105+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168023+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:59:33.168023+0000","last_peered":"2024-03-04T06:59:33.168023+0000","last_clean":"2024-03-04T06:59:33.168023+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:59:33.168023+0000","last_undegraded":"2024-03-04T06:59:33.168023+0000","last_fullsized":"2024-03-04T06:59:33.168023+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247852+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T07:00:18.247852+0000","last_peered":"2024-03-04T07:00:18.247852+0000","last_clean":"2024-03-04T07:00:18.247852+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T07:00:18.247852+0000","last_undegraded":"2024-03-04T07:00:18.247852+0000","last_fullsized":"2024-03-04T07:00:18.247852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1195,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:35.007138+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T06:58:35.007138+0000","last_peered":"2024-03-04T06:58:35.007138+0000","last_clean":"2024-03-04T06:58:35.007138+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T06:58:35.007138+0000","last_undegraded":"2024-03-04T06:58:35.007138+0000","last_fullsized":"2024-03-04T06:58:35.007138+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.964990+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:59:42.964990+0000","last_peered":"2024-03-04T06:59:42.964990+0000","last_clean":"2024-03-04T06:59:42.964990+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:59:42.964990+0000","last_undegraded":"2024-03-04T06:59:42.964990+0000","last_fullsized":"2024-03-04T06:59:42.964990+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009646+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:59:00.009646+0000","last_peered":"2024-03-04T06:59:00.009646+0000","last_clean":"2024-03-04T06:59:00.009646+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:59:00.009646+0000","last_undegraded":"2024-03-04T06:59:00.009646+0000","last_fullsized":"2024-03-04T06:59:00.009646+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1122,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967529+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T07:00:07.967529+0000","last_peered":"2024-03-04T07:00:07.967529+0000","last_clean":"2024-03-04T07:00:07.967529+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T07:00:07.967529+0000","last_undegraded":"2024-03-04T07:00:07.967529+0000","last_fullsized":"2024-03-04T07:00:07.967529+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.012471+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:59:28.012471+0000","last_peered":"2024-03-04T06:59:28.012471+0000","last_clean":"2024-03-04T06:59:28.012471+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:59:28.012471+0000","last_undegraded":"2024-03-04T06:59:28.012471+0000","last_fullsized":"2024-03-04T06:59:28.012471+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.234922+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:58:28.234922+0000","last_peered":"2024-03-04T06:58:28.234922+0000","last_clean":"2024-03-04T06:58:28.234922+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:58:28.234922+0000","last_undegraded":"2024-03-04T06:58:28.234922+0000","last_fullsized":"2024-03-04T06:58:28.234922+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503513,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648160,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142467,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287114,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997820,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885876,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937454,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792807,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:02:45.877 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:45.877 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:45.877 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:45.877 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:45.877 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:45.877 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:45.877 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:45.877 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:45.877 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:45.877 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:45.877 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:02:46.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:46 smithi137 ceph-mon[88869]: pgmap v1147: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:46.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:46 smithi137 ceph-mon[88869]: from='client.44648 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:46.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:46 smithi137 ceph-mon[91314]: pgmap v1147: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:46.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:46 smithi137 ceph-mon[91314]: from='client.44648 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:46.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:46 smithi203 ceph-mon[85573]: pgmap v1147: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:46.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:46 smithi203 ceph-mon[85573]: from='client.44648 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:48.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:48 smithi137 ceph-mon[88869]: pgmap v1148: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:48.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:48 smithi137 ceph-mon[91314]: pgmap v1148: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:48.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:48 smithi203 ceph-mon[85573]: pgmap v1148: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:50.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:50 smithi137 ceph-mon[88869]: pgmap v1149: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:50.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:50 smithi137 ceph-mon[91314]: pgmap v1149: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:50.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:50 smithi203 ceph-mon[85573]: pgmap v1149: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:52.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:52 smithi137 ceph-mon[88869]: pgmap v1150: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:52.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:52 smithi137 ceph-mon[91314]: pgmap v1150: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:52.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:52 smithi203 ceph-mon[85573]: pgmap v1150: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:54.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:54 smithi137 ceph-mon[91314]: pgmap v1151: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:54.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:02:54.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:54 smithi137 ceph-mon[88869]: pgmap v1151: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:54.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:02:54.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:54 smithi203 ceph-mon[85573]: pgmap v1151: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:54.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:02:55.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:02:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:02:55] "GET /metrics HTTP/1.1" 200 36334 "" "Prometheus/2.43.0" 2024-03-04T07:02:55.878 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:02:56.096 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:02:56.517 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:56 smithi137 ceph-mon[88869]: pgmap v1152: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:56.518 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:56 smithi137 ceph-mon[91314]: pgmap v1152: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:56.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:56 smithi203 ceph-mon[85573]: pgmap v1152: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:58.132 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:02:58.135 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:02:58.503 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:58 smithi137 ceph-mon[88869]: pgmap v1153: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:58.504 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:58 smithi137 ceph-mon[91314]: pgmap v1153: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:58.810 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1153,"stamp":"2024-03-04T07:02:56.602944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004060"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.564000+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T07:00:29.564000+0000","last_peered":"2024-03-04T07:00:29.564000+0000","last_clean":"2024-03-04T07:00:29.564000+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T07:00:29.564000+0000","last_undegraded":"2024-03-04T07:00:29.564000+0000","last_fullsized":"2024-03-04T07:00:29.564000+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.165005+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:59:03.165005+0000","last_peered":"2024-03-04T06:59:03.165005+0000","last_clean":"2024-03-04T06:59:03.165005+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:59:03.165005+0000","last_undegraded":"2024-03-04T06:59:03.165005+0000","last_fullsized":"2024-03-04T06:59:03.165005+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019562+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T07:00:33.019562+0000","last_peered":"2024-03-04T07:00:33.019562+0000","last_clean":"2024-03-04T07:00:33.019562+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T07:00:33.019562+0000","last_undegraded":"2024-03-04T07:00:33.019562+0000","last_fullsized":"2024-03-04T07:00:33.019562+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1143,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:52.972434+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T07:00:52.972434+0000","last_peered":"2024-03-04T07:00:52.972434+0000","last_clean":"2024-03-04T07:00:52.972434+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T07:00:52.972434+0000","last_undegraded":"2024-03-04T07:00:52.972434+0000","last_fullsized":"2024-03-04T07:00:52.972434+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560949+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T07:00:04.560949+0000","last_peered":"2024-03-04T07:00:04.560949+0000","last_clean":"2024-03-04T07:00:04.560949+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T07:00:04.560949+0000","last_undegraded":"2024-03-04T07:00:04.560949+0000","last_fullsized":"2024-03-04T07:00:04.560949+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958813+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:58:52.958813+0000","last_peered":"2024-03-04T06:58:52.958813+0000","last_clean":"2024-03-04T06:58:52.958813+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:58:52.958813+0000","last_undegraded":"2024-03-04T06:58:52.958813+0000","last_fullsized":"2024-03-04T06:58:52.958813+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560930+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T07:00:04.560930+0000","last_peered":"2024-03-04T07:00:04.560930+0000","last_clean":"2024-03-04T07:00:04.560930+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T07:00:04.560930+0000","last_undegraded":"2024-03-04T07:00:04.560930+0000","last_fullsized":"2024-03-04T07:00:04.560930+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017220+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T07:00:15.017220+0000","last_peered":"2024-03-04T07:00:15.017220+0000","last_clean":"2024-03-04T07:00:15.017220+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T07:00:15.017220+0000","last_undegraded":"2024-03-04T07:00:15.017220+0000","last_fullsized":"2024-03-04T07:00:15.017220+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1066,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558470+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:59:44.558470+0000","last_peered":"2024-03-04T06:59:44.558470+0000","last_clean":"2024-03-04T06:59:44.558470+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:59:44.558470+0000","last_undegraded":"2024-03-04T06:59:44.558470+0000","last_fullsized":"2024-03-04T06:59:44.558470+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239534+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:59:08.239534+0000","last_peered":"2024-03-04T06:59:08.239534+0000","last_clean":"2024-03-04T06:59:08.239534+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:59:08.239534+0000","last_undegraded":"2024-03-04T06:59:08.239534+0000","last_fullsized":"2024-03-04T06:59:08.239534+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239472+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:59:08.239472+0000","last_peered":"2024-03-04T06:59:08.239472+0000","last_clean":"2024-03-04T06:59:08.239472+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:59:08.239472+0000","last_undegraded":"2024-03-04T06:59:08.239472+0000","last_fullsized":"2024-03-04T06:59:08.239472+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:22.636361+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T07:00:22.636361+0000","last_peered":"2024-03-04T07:00:22.636361+0000","last_clean":"2024-03-04T07:00:22.636361+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T07:00:22.636361+0000","last_undegraded":"2024-03-04T07:00:22.636361+0000","last_fullsized":"2024-03-04T07:00:22.636361+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014730+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:59:50.014730+0000","last_peered":"2024-03-04T06:59:50.014730+0000","last_clean":"2024-03-04T06:59:50.014730+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:59:50.014730+0000","last_undegraded":"2024-03-04T06:59:50.014730+0000","last_fullsized":"2024-03-04T06:59:50.014730+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015553+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:59:58.015553+0000","last_peered":"2024-03-04T06:59:58.015553+0000","last_clean":"2024-03-04T06:59:58.015553+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:59:58.015553+0000","last_undegraded":"2024-03-04T06:59:58.015553+0000","last_fullsized":"2024-03-04T06:59:58.015553+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174897+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T07:00:33.174897+0000","last_peered":"2024-03-04T07:00:33.174897+0000","last_clean":"2024-03-04T07:00:33.174897+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T07:00:33.174897+0000","last_undegraded":"2024-03-04T07:00:33.174897+0000","last_fullsized":"2024-03-04T07:00:33.174897+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970309+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T07:00:32.970309+0000","last_peered":"2024-03-04T07:00:32.970309+0000","last_clean":"2024-03-04T07:00:32.970309+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T07:00:32.970309+0000","last_undegraded":"2024-03-04T07:00:32.970309+0000","last_fullsized":"2024-03-04T07:00:32.970309+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970400+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T07:00:32.970400+0000","last_peered":"2024-03-04T07:00:32.970400+0000","last_clean":"2024-03-04T07:00:32.970400+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T07:00:32.970400+0000","last_undegraded":"2024-03-04T07:00:32.970400+0000","last_fullsized":"2024-03-04T07:00:32.970400+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397463+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:58:48.397463+0000","last_peered":"2024-03-04T06:58:48.397463+0000","last_clean":"2024-03-04T06:58:48.397463+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:58:48.397463+0000","last_undegraded":"2024-03-04T06:58:48.397463+0000","last_fullsized":"2024-03-04T06:58:48.397463+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:59:04.553588+0000","last_peered":"2024-03-04T06:59:04.553588+0000","last_clean":"2024-03-04T06:59:04.553588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:59:04.553588+0000","last_undegraded":"2024-03-04T06:59:04.553588+0000","last_fullsized":"2024-03-04T06:59:04.553588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1307,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019623+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T07:00:33.019623+0000","last_peered":"2024-03-04T07:00:33.019623+0000","last_clean":"2024-03-04T07:00:33.019623+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T07:00:33.019623+0000","last_undegraded":"2024-03-04T07:00:33.019623+0000","last_fullsized":"2024-03-04T07:00:33.019623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014206+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:59:45.014206+0000","last_peered":"2024-03-04T06:59:45.014206+0000","last_clean":"2024-03-04T06:59:45.014206+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:59:45.014206+0000","last_undegraded":"2024-03-04T06:59:45.014206+0000","last_fullsized":"2024-03-04T06:59:45.014206+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014216+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:59:45.014216+0000","last_peered":"2024-03-04T06:59:45.014216+0000","last_clean":"2024-03-04T06:59:45.014216+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:59:45.014216+0000","last_undegraded":"2024-03-04T06:59:45.014216+0000","last_fullsized":"2024-03-04T06:59:45.014216+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019611+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T07:00:33.019611+0000","last_peered":"2024-03-04T07:00:33.019611+0000","last_clean":"2024-03-04T07:00:33.019611+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T07:00:33.019611+0000","last_undegraded":"2024-03-04T07:00:33.019611+0000","last_fullsized":"2024-03-04T07:00:33.019611+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403128+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:59:38.403128+0000","last_peered":"2024-03-04T06:59:38.403128+0000","last_clean":"2024-03-04T06:59:38.403128+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:59:38.403128+0000","last_undegraded":"2024-03-04T06:59:38.403128+0000","last_fullsized":"2024-03-04T06:59:38.403128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1223,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403103+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:59:38.403103+0000","last_peered":"2024-03-04T06:59:38.403103+0000","last_clean":"2024-03-04T06:59:38.403103+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:59:38.403103+0000","last_undegraded":"2024-03-04T06:59:38.403103+0000","last_fullsized":"2024-03-04T06:59:38.403103+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560965+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T07:00:04.560965+0000","last_peered":"2024-03-04T07:00:04.560965+0000","last_clean":"2024-03-04T07:00:04.560965+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T07:00:04.560965+0000","last_undegraded":"2024-03-04T07:00:04.560965+0000","last_fullsized":"2024-03-04T07:00:04.560965+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958870+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:58:52.958870+0000","last_peered":"2024-03-04T06:58:52.958870+0000","last_clean":"2024-03-04T06:58:52.958870+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:58:52.958870+0000","last_undegraded":"2024-03-04T06:58:52.958870+0000","last_fullsized":"2024-03-04T06:58:52.958870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017274+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T07:00:15.017274+0000","last_peered":"2024-03-04T07:00:15.017274+0000","last_clean":"2024-03-04T07:00:15.017274+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T07:00:15.017274+0000","last_undegraded":"2024-03-04T07:00:15.017274+0000","last_fullsized":"2024-03-04T07:00:15.017274+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1190,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:17.623076+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:58:17.623076+0000","last_peered":"2024-03-04T06:58:17.623076+0000","last_clean":"2024-03-04T06:58:17.623076+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:58:17.623076+0000","last_undegraded":"2024-03-04T06:58:17.623076+0000","last_fullsized":"2024-03-04T06:58:17.623076+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.241598+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:59:28.241598+0000","last_peered":"2024-03-04T06:59:28.241598+0000","last_clean":"2024-03-04T06:59:28.241598+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:59:28.241598+0000","last_undegraded":"2024-03-04T06:59:28.241598+0000","last_fullsized":"2024-03-04T06:59:28.241598+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006622+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:58:28.006622+0000","last_peered":"2024-03-04T06:58:28.006622+0000","last_clean":"2024-03-04T06:58:28.006622+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:58:28.006622+0000","last_undegraded":"2024-03-04T06:58:28.006622+0000","last_fullsized":"2024-03-04T06:58:28.006622+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014712+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:59:50.014712+0000","last_peered":"2024-03-04T06:59:50.014712+0000","last_clean":"2024-03-04T06:59:50.014712+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:59:50.014712+0000","last_undegraded":"2024-03-04T06:59:50.014712+0000","last_fullsized":"2024-03-04T06:59:50.014712+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014675+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:59:50.014675+0000","last_peered":"2024-03-04T06:59:50.014675+0000","last_clean":"2024-03-04T06:59:50.014675+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:59:50.014675+0000","last_undegraded":"2024-03-04T06:59:50.014675+0000","last_fullsized":"2024-03-04T06:59:50.014675+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956356+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:58:32.956356+0000","last_peered":"2024-03-04T06:58:32.956356+0000","last_clean":"2024-03-04T06:58:32.956356+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:58:32.956356+0000","last_undegraded":"2024-03-04T06:58:32.956356+0000","last_fullsized":"2024-03-04T06:58:32.956356+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162696+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:58:38.162696+0000","last_peered":"2024-03-04T06:58:38.162696+0000","last_clean":"2024-03-04T06:58:38.162696+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:58:38.162696+0000","last_undegraded":"2024-03-04T06:58:38.162696+0000","last_fullsized":"2024-03-04T06:58:38.162696+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239549+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:59:08.239549+0000","last_peered":"2024-03-04T06:59:08.239549+0000","last_clean":"2024-03-04T06:59:08.239549+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:59:08.239549+0000","last_undegraded":"2024-03-04T06:59:08.239549+0000","last_fullsized":"2024-03-04T06:59:08.239549+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956414+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:58:32.956414+0000","last_peered":"2024-03-04T06:58:32.956414+0000","last_clean":"2024-03-04T06:58:32.956414+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:58:32.956414+0000","last_undegraded":"2024-03-04T06:58:32.956414+0000","last_fullsized":"2024-03-04T06:58:32.956414+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956402+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:58:32.956402+0000","last_peered":"2024-03-04T06:58:32.956402+0000","last_clean":"2024-03-04T06:58:32.956402+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:58:32.956402+0000","last_undegraded":"2024-03-04T06:58:32.956402+0000","last_fullsized":"2024-03-04T06:58:32.956402+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:28.018729+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T07:00:28.018729+0000","last_peered":"2024-03-04T07:00:28.018729+0000","last_clean":"2024-03-04T07:00:28.018729+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T07:00:28.018729+0000","last_undegraded":"2024-03-04T07:00:28.018729+0000","last_fullsized":"2024-03-04T07:00:28.018729+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162740+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:58:38.162740+0000","last_peered":"2024-03-04T06:58:38.162740+0000","last_clean":"2024-03-04T06:58:38.162740+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:58:38.162740+0000","last_undegraded":"2024-03-04T06:58:38.162740+0000","last_fullsized":"2024-03-04T06:58:38.162740+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:57.633964+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:59:57.633964+0000","last_peered":"2024-03-04T06:59:57.633964+0000","last_clean":"2024-03-04T06:59:57.633964+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:59:57.633964+0000","last_undegraded":"2024-03-04T06:59:57.633964+0000","last_fullsized":"2024-03-04T06:59:57.633964+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1131,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237167+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:58:48.237167+0000","last_peered":"2024-03-04T06:58:48.237167+0000","last_clean":"2024-03-04T06:58:48.237167+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:58:48.237167+0000","last_undegraded":"2024-03-04T06:58:48.237167+0000","last_fullsized":"2024-03-04T06:58:48.237167+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558443+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:59:44.558443+0000","last_peered":"2024-03-04T06:59:44.558443+0000","last_clean":"2024-03-04T06:59:44.558443+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:59:44.558443+0000","last_undegraded":"2024-03-04T06:59:44.558443+0000","last_fullsized":"2024-03-04T06:59:44.558443+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015596+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:59:58.015596+0000","last_peered":"2024-03-04T06:59:58.015596+0000","last_clean":"2024-03-04T06:59:58.015596+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:59:58.015596+0000","last_undegraded":"2024-03-04T06:59:58.015596+0000","last_fullsized":"2024-03-04T06:59:58.015596+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397438+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:58:48.397438+0000","last_peered":"2024-03-04T06:58:48.397438+0000","last_clean":"2024-03-04T06:58:48.397438+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:58:48.397438+0000","last_undegraded":"2024-03-04T06:58:48.397438+0000","last_fullsized":"2024-03-04T06:58:48.397438+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970340+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T07:00:32.970340+0000","last_peered":"2024-03-04T07:00:32.970340+0000","last_clean":"2024-03-04T07:00:32.970340+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T07:00:32.970340+0000","last_undegraded":"2024-03-04T07:00:32.970340+0000","last_fullsized":"2024-03-04T07:00:32.970340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555834+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:59:24.555834+0000","last_peered":"2024-03-04T06:59:24.555834+0000","last_clean":"2024-03-04T06:59:24.555834+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:59:24.555834+0000","last_undegraded":"2024-03-04T06:59:24.555834+0000","last_fullsized":"2024-03-04T06:59:24.555834+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237147+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:58:48.237147+0000","last_peered":"2024-03-04T06:58:48.237147+0000","last_clean":"2024-03-04T06:58:48.237147+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:58:48.237147+0000","last_undegraded":"2024-03-04T06:58:48.237147+0000","last_fullsized":"2024-03-04T06:58:48.237147+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237122+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:58:48.237122+0000","last_peered":"2024-03-04T06:58:48.237122+0000","last_clean":"2024-03-04T06:58:48.237122+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:58:48.237122+0000","last_undegraded":"2024-03-04T06:58:48.237122+0000","last_fullsized":"2024-03-04T06:58:48.237122+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397404+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:58:48.397404+0000","last_peered":"2024-03-04T06:58:48.397404+0000","last_clean":"2024-03-04T06:58:48.397404+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:58:48.397404+0000","last_undegraded":"2024-03-04T06:58:48.397404+0000","last_fullsized":"2024-03-04T06:58:48.397404+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555799+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:59:24.555799+0000","last_peered":"2024-03-04T06:59:24.555799+0000","last_clean":"2024-03-04T06:59:24.555799+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:59:24.555799+0000","last_undegraded":"2024-03-04T06:59:24.555799+0000","last_fullsized":"2024-03-04T06:59:24.555799+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3579,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405911+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:00:08.405911+0000","last_peered":"2024-03-04T07:00:08.405911+0000","last_clean":"2024-03-04T07:00:08.405911+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:00:08.405911+0000","last_undegraded":"2024-03-04T07:00:08.405911+0000","last_fullsized":"2024-03-04T07:00:08.405911+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:32.631361+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:59:32.631361+0000","last_peered":"2024-03-04T06:59:32.631361+0000","last_clean":"2024-03-04T06:59:32.631361+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:59:32.631361+0000","last_undegraded":"2024-03-04T06:59:32.631361+0000","last_fullsized":"2024-03-04T06:59:32.631361+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553616+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:59:04.553616+0000","last_peered":"2024-03-04T06:59:04.553616+0000","last_clean":"2024-03-04T06:59:04.553616+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:59:04.553616+0000","last_undegraded":"2024-03-04T06:59:04.553616+0000","last_fullsized":"2024-03-04T06:59:04.553616+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17118,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019514+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T07:00:33.019514+0000","last_peered":"2024-03-04T07:00:33.019514+0000","last_clean":"2024-03-04T07:00:33.019514+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T07:00:33.019514+0000","last_undegraded":"2024-03-04T07:00:33.019514+0000","last_fullsized":"2024-03-04T07:00:33.019514+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164900+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:59:03.164900+0000","last_peered":"2024-03-04T06:59:03.164900+0000","last_clean":"2024-03-04T06:59:03.164900+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:59:03.164900+0000","last_undegraded":"2024-03-04T06:59:03.164900+0000","last_fullsized":"2024-03-04T06:59:03.164900+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164981+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:59:03.164981+0000","last_peered":"2024-03-04T06:59:03.164981+0000","last_clean":"2024-03-04T06:59:03.164981+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:59:03.164981+0000","last_undegraded":"2024-03-04T06:59:03.164981+0000","last_fullsized":"2024-03-04T06:59:03.164981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962033+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:59:17.962033+0000","last_peered":"2024-03-04T06:59:17.962033+0000","last_clean":"2024-03-04T06:59:17.962033+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:59:17.962033+0000","last_undegraded":"2024-03-04T06:59:17.962033+0000","last_fullsized":"2024-03-04T06:59:17.962033+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4388,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019581+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T07:00:33.019581+0000","last_peered":"2024-03-04T07:00:33.019581+0000","last_clean":"2024-03-04T07:00:33.019581+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T07:00:33.019581+0000","last_undegraded":"2024-03-04T07:00:33.019581+0000","last_fullsized":"2024-03-04T07:00:33.019581+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164925+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:59:03.164925+0000","last_peered":"2024-03-04T06:59:03.164925+0000","last_clean":"2024-03-04T06:59:03.164925+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:59:03.164925+0000","last_undegraded":"2024-03-04T06:59:03.164925+0000","last_fullsized":"2024-03-04T06:59:03.164925+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.961943+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:59:17.961943+0000","last_peered":"2024-03-04T06:59:17.961943+0000","last_clean":"2024-03-04T06:59:17.961943+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:59:17.961943+0000","last_undegraded":"2024-03-04T06:59:17.961943+0000","last_fullsized":"2024-03-04T06:59:17.961943+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639139+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T07:00:47.639139+0000","last_peered":"2024-03-04T07:00:47.639139+0000","last_clean":"2024-03-04T07:00:47.639139+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T07:00:47.639139+0000","last_undegraded":"2024-03-04T07:00:47.639139+0000","last_fullsized":"2024-03-04T07:00:47.639139+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5641,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.406020+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:00:08.406020+0000","last_peered":"2024-03-04T07:00:08.406020+0000","last_clean":"2024-03-04T07:00:08.406020+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:00:08.406020+0000","last_undegraded":"2024-03-04T07:00:08.406020+0000","last_fullsized":"2024-03-04T07:00:08.406020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1257,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168065+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:59:33.168065+0000","last_peered":"2024-03-04T06:59:33.168065+0000","last_clean":"2024-03-04T06:59:33.168065+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:59:33.168065+0000","last_undegraded":"2024-03-04T06:59:33.168065+0000","last_fullsized":"2024-03-04T06:59:33.168065+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174867+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T07:00:33.174867+0000","last_peered":"2024-03-04T07:00:33.174867+0000","last_clean":"2024-03-04T07:00:33.174867+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T07:00:33.174867+0000","last_undegraded":"2024-03-04T07:00:33.174867+0000","last_fullsized":"2024-03-04T07:00:33.174867+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403066+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:59:38.403066+0000","last_peered":"2024-03-04T06:59:38.403066+0000","last_clean":"2024-03-04T06:59:38.403066+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:59:38.403066+0000","last_undegraded":"2024-03-04T06:59:38.403066+0000","last_fullsized":"2024-03-04T06:59:38.403066+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4017,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:29.563935+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T07:00:29.563935+0000","last_peered":"2024-03-04T07:00:29.563935+0000","last_clean":"2024-03-04T07:00:29.563935+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T07:00:29.563935+0000","last_undegraded":"2024-03-04T07:00:29.563935+0000","last_fullsized":"2024-03-04T07:00:29.563935+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244731+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:59:53.244731+0000","last_peered":"2024-03-04T06:59:53.244731+0000","last_clean":"2024-03-04T06:59:53.244731+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:59:53.244731+0000","last_undegraded":"2024-03-04T06:59:53.244731+0000","last_fullsized":"2024-03-04T06:59:53.244731+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017258+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T07:00:15.017258+0000","last_peered":"2024-03-04T07:00:15.017258+0000","last_clean":"2024-03-04T07:00:15.017258+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T07:00:15.017258+0000","last_undegraded":"2024-03-04T07:00:15.017258+0000","last_fullsized":"2024-03-04T07:00:15.017258+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962020+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:59:17.962020+0000","last_peered":"2024-03-04T06:59:17.962020+0000","last_clean":"2024-03-04T06:59:17.962020+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:59:17.962020+0000","last_undegraded":"2024-03-04T06:59:17.962020+0000","last_fullsized":"2024-03-04T06:59:17.962020+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1552,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560890+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:00:04.560890+0000","last_peered":"2024-03-04T07:00:04.560890+0000","last_clean":"2024-03-04T07:00:04.560890+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:00:04.560890+0000","last_undegraded":"2024-03-04T07:00:04.560890+0000","last_fullsized":"2024-03-04T07:00:04.560890+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3952,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.965034+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:59:42.965034+0000","last_peered":"2024-03-04T06:59:42.965034+0000","last_clean":"2024-03-04T06:59:42.965034+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:59:42.965034+0000","last_undegraded":"2024-03-04T06:59:42.965034+0000","last_fullsized":"2024-03-04T06:59:42.965034+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009504+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:58:58.009504+0000","last_peered":"2024-03-04T06:58:58.009504+0000","last_clean":"2024-03-04T06:58:58.009504+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:58:58.009504+0000","last_undegraded":"2024-03-04T06:58:58.009504+0000","last_fullsized":"2024-03-04T06:58:58.009504+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403043+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:59:38.403043+0000","last_peered":"2024-03-04T06:59:38.403043+0000","last_clean":"2024-03-04T06:59:38.403043+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:59:38.403043+0000","last_undegraded":"2024-03-04T06:59:38.403043+0000","last_fullsized":"2024-03-04T06:59:38.403043+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560852+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:00:04.560852+0000","last_peered":"2024-03-04T07:00:04.560852+0000","last_clean":"2024-03-04T07:00:04.560852+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:00:04.560852+0000","last_undegraded":"2024-03-04T07:00:04.560852+0000","last_fullsized":"2024-03-04T07:00:04.560852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15293,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:53.244696+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:59:53.244696+0000","last_peered":"2024-03-04T06:59:53.244696+0000","last_clean":"2024-03-04T06:59:53.244696+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:59:53.244696+0000","last_undegraded":"2024-03-04T06:59:53.244696+0000","last_fullsized":"2024-03-04T06:59:53.244696+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019541+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T07:00:33.019541+0000","last_peered":"2024-03-04T07:00:33.019541+0000","last_clean":"2024-03-04T07:00:33.019541+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T07:00:33.019541+0000","last_undegraded":"2024-03-04T07:00:33.019541+0000","last_fullsized":"2024-03-04T07:00:33.019541+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1075,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.563983+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T07:00:29.563983+0000","last_peered":"2024-03-04T07:00:29.563983+0000","last_clean":"2024-03-04T07:00:29.563983+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T07:00:29.563983+0000","last_undegraded":"2024-03-04T07:00:29.563983+0000","last_fullsized":"2024-03-04T07:00:29.563983+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164943+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:59:03.164943+0000","last_peered":"2024-03-04T06:59:03.164943+0000","last_clean":"2024-03-04T06:59:03.164943+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:59:03.164943+0000","last_undegraded":"2024-03-04T06:59:03.164943+0000","last_fullsized":"2024-03-04T06:59:03.164943+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4381,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:47.639101+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T07:00:47.639101+0000","last_peered":"2024-03-04T07:00:47.639101+0000","last_clean":"2024-03-04T07:00:47.639101+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T07:00:47.639101+0000","last_undegraded":"2024-03-04T07:00:47.639101+0000","last_fullsized":"2024-03-04T07:00:47.639101+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014181+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:59:45.014181+0000","last_peered":"2024-03-04T06:59:45.014181+0000","last_clean":"2024-03-04T06:59:45.014181+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:59:45.014181+0000","last_undegraded":"2024-03-04T06:59:45.014181+0000","last_fullsized":"2024-03-04T06:59:45.014181+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1270,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168056+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:59:33.168056+0000","last_peered":"2024-03-04T06:59:33.168056+0000","last_clean":"2024-03-04T06:59:33.168056+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:59:33.168056+0000","last_undegraded":"2024-03-04T06:59:33.168056+0000","last_fullsized":"2024-03-04T06:59:33.168056+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020800+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T07:00:45.020800+0000","last_peered":"2024-03-04T07:00:45.020800+0000","last_clean":"2024-03-04T07:00:45.020800+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T07:00:45.020800+0000","last_undegraded":"2024-03-04T07:00:45.020800+0000","last_fullsized":"2024-03-04T07:00:45.020800+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4611,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:45.014149+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:59:45.014149+0000","last_peered":"2024-03-04T06:59:45.014149+0000","last_clean":"2024-03-04T06:59:45.014149+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:59:45.014149+0000","last_undegraded":"2024-03-04T06:59:45.014149+0000","last_fullsized":"2024-03-04T06:59:45.014149+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639077+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T07:00:47.639077+0000","last_peered":"2024-03-04T07:00:47.639077+0000","last_clean":"2024-03-04T07:00:47.639077+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T07:00:47.639077+0000","last_undegraded":"2024-03-04T07:00:47.639077+0000","last_fullsized":"2024-03-04T07:00:47.639077+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1080,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247864+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T07:00:18.247864+0000","last_peered":"2024-03-04T07:00:18.247864+0000","last_clean":"2024-03-04T07:00:18.247864+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T07:00:18.247864+0000","last_undegraded":"2024-03-04T07:00:18.247864+0000","last_fullsized":"2024-03-04T07:00:18.247864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009478+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:58:58.009478+0000","last_peered":"2024-03-04T06:58:58.009478+0000","last_clean":"2024-03-04T06:58:58.009478+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:58:58.009478+0000","last_undegraded":"2024-03-04T06:58:58.009478+0000","last_fullsized":"2024-03-04T06:58:58.009478+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4636,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:07.967606+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T07:00:07.967606+0000","last_peered":"2024-03-04T07:00:07.967606+0000","last_clean":"2024-03-04T07:00:07.967606+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T07:00:07.967606+0000","last_undegraded":"2024-03-04T07:00:07.967606+0000","last_fullsized":"2024-03-04T07:00:07.967606+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1058,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:44.551296+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T06:58:44.551296+0000","last_peered":"2024-03-04T06:58:44.551296+0000","last_clean":"2024-03-04T06:58:44.551296+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T06:58:44.551296+0000","last_undegraded":"2024-03-04T06:58:44.551296+0000","last_fullsized":"2024-03-04T06:58:44.551296+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1186,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:07.628352+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:59:07.628352+0000","last_peered":"2024-03-04T06:59:07.628352+0000","last_clean":"2024-03-04T06:59:07.628352+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:59:07.628352+0000","last_undegraded":"2024-03-04T06:59:07.628352+0000","last_fullsized":"2024-03-04T06:59:07.628352+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5159,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:32.631317+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:59:32.631317+0000","last_peered":"2024-03-04T06:59:32.631317+0000","last_clean":"2024-03-04T06:59:32.631317+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:59:32.631317+0000","last_undegraded":"2024-03-04T06:59:32.631317+0000","last_fullsized":"2024-03-04T06:59:32.631317+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.167981+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:59:33.167981+0000","last_peered":"2024-03-04T06:59:33.167981+0000","last_clean":"2024-03-04T06:59:33.167981+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:59:33.167981+0000","last_undegraded":"2024-03-04T06:59:33.167981+0000","last_fullsized":"2024-03-04T06:59:33.167981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020733+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T07:00:45.020733+0000","last_peered":"2024-03-04T07:00:45.020733+0000","last_clean":"2024-03-04T07:00:45.020733+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T07:00:45.020733+0000","last_undegraded":"2024-03-04T07:00:45.020733+0000","last_fullsized":"2024-03-04T07:00:45.020733+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4721,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409468+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T07:00:38.409468+0000","last_peered":"2024-03-04T07:00:38.409468+0000","last_clean":"2024-03-04T07:00:38.409468+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T07:00:38.409468+0000","last_undegraded":"2024-03-04T07:00:38.409468+0000","last_fullsized":"2024-03-04T07:00:38.409468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168002+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:59:33.168002+0000","last_peered":"2024-03-04T06:59:33.168002+0000","last_clean":"2024-03-04T06:59:33.168002+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:59:33.168002+0000","last_undegraded":"2024-03-04T06:59:33.168002+0000","last_fullsized":"2024-03-04T06:59:33.168002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009678+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:59:00.009678+0000","last_peered":"2024-03-04T06:59:00.009678+0000","last_clean":"2024-03-04T06:59:00.009678+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:59:00.009678+0000","last_undegraded":"2024-03-04T06:59:00.009678+0000","last_fullsized":"2024-03-04T06:59:00.009678+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5556,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:03.171266+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:00:03.171266+0000","last_peered":"2024-03-04T07:00:03.171266+0000","last_clean":"2024-03-04T07:00:03.171266+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:00:03.171266+0000","last_undegraded":"2024-03-04T07:00:03.171266+0000","last_fullsized":"2024-03-04T07:00:03.171266+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553540+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:59:04.553540+0000","last_peered":"2024-03-04T06:59:04.553540+0000","last_clean":"2024-03-04T06:59:04.553540+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:59:04.553540+0000","last_undegraded":"2024-03-04T06:59:04.553540+0000","last_fullsized":"2024-03-04T06:59:04.553540+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247800+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T07:00:18.247800+0000","last_peered":"2024-03-04T07:00:18.247800+0000","last_clean":"2024-03-04T07:00:18.247800+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T07:00:18.247800+0000","last_undegraded":"2024-03-04T07:00:18.247800+0000","last_fullsized":"2024-03-04T07:00:18.247800+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409421+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T07:00:38.409421+0000","last_peered":"2024-03-04T07:00:38.409421+0000","last_clean":"2024-03-04T07:00:38.409421+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T07:00:38.409421+0000","last_undegraded":"2024-03-04T07:00:38.409421+0000","last_fullsized":"2024-03-04T07:00:38.409421+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409457+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T07:00:38.409457+0000","last_peered":"2024-03-04T07:00:38.409457+0000","last_clean":"2024-03-04T07:00:38.409457+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T07:00:38.409457+0000","last_undegraded":"2024-03-04T07:00:38.409457+0000","last_fullsized":"2024-03-04T07:00:38.409457+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553601+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:59:04.553601+0000","last_peered":"2024-03-04T06:59:04.553601+0000","last_clean":"2024-03-04T06:59:04.553601+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:59:04.553601+0000","last_undegraded":"2024-03-04T06:59:04.553601+0000","last_fullsized":"2024-03-04T06:59:04.553601+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4368,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405967+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:00:08.405967+0000","last_peered":"2024-03-04T07:00:08.405967+0000","last_clean":"2024-03-04T07:00:08.405967+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:00:08.405967+0000","last_undegraded":"2024-03-04T07:00:08.405967+0000","last_fullsized":"2024-03-04T07:00:08.405967+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:03.171315+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:00:03.171315+0000","last_peered":"2024-03-04T07:00:03.171315+0000","last_clean":"2024-03-04T07:00:03.171315+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:00:03.171315+0000","last_undegraded":"2024-03-04T07:00:03.171315+0000","last_fullsized":"2024-03-04T07:00:03.171315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967580+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T07:00:07.967580+0000","last_peered":"2024-03-04T07:00:07.967580+0000","last_clean":"2024-03-04T07:00:07.967580+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T07:00:07.967580+0000","last_undegraded":"2024-03-04T07:00:07.967580+0000","last_fullsized":"2024-03-04T07:00:07.967580+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4601,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:58:44.551323+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T06:58:44.551323+0000","last_peered":"2024-03-04T06:58:44.551323+0000","last_clean":"2024-03-04T06:58:44.551323+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T06:58:44.551323+0000","last_undegraded":"2024-03-04T06:58:44.551323+0000","last_fullsized":"2024-03-04T06:58:44.551323+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1247,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409492+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T07:00:38.409492+0000","last_peered":"2024-03-04T07:00:38.409492+0000","last_clean":"2024-03-04T07:00:38.409492+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T07:00:38.409492+0000","last_undegraded":"2024-03-04T07:00:38.409492+0000","last_fullsized":"2024-03-04T07:00:38.409492+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553631+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:59:04.553631+0000","last_peered":"2024-03-04T06:59:04.553631+0000","last_clean":"2024-03-04T06:59:04.553631+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:59:04.553631+0000","last_undegraded":"2024-03-04T06:59:04.553631+0000","last_fullsized":"2024-03-04T06:59:04.553631+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244661+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:59:53.244661+0000","last_peered":"2024-03-04T06:59:53.244661+0000","last_clean":"2024-03-04T06:59:53.244661+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:59:53.244661+0000","last_undegraded":"2024-03-04T06:59:53.244661+0000","last_fullsized":"2024-03-04T06:59:53.244661+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403075+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:59:38.403075+0000","last_peered":"2024-03-04T06:59:38.403075+0000","last_clean":"2024-03-04T06:59:38.403075+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:59:38.403075+0000","last_undegraded":"2024-03-04T06:59:38.403075+0000","last_fullsized":"2024-03-04T06:59:38.403075+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962003+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:59:17.962003+0000","last_peered":"2024-03-04T06:59:17.962003+0000","last_clean":"2024-03-04T06:59:17.962003+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:59:17.962003+0000","last_undegraded":"2024-03-04T06:59:17.962003+0000","last_fullsized":"2024-03-04T06:59:17.962003+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019487+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T07:00:33.019487+0000","last_peered":"2024-03-04T07:00:33.019487+0000","last_clean":"2024-03-04T07:00:33.019487+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T07:00:33.019487+0000","last_undegraded":"2024-03-04T07:00:33.019487+0000","last_fullsized":"2024-03-04T07:00:33.019487+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020779+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T07:00:45.020779+0000","last_peered":"2024-03-04T07:00:45.020779+0000","last_clean":"2024-03-04T07:00:45.020779+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T07:00:45.020779+0000","last_undegraded":"2024-03-04T07:00:45.020779+0000","last_fullsized":"2024-03-04T07:00:45.020779+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168023+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:59:33.168023+0000","last_peered":"2024-03-04T06:59:33.168023+0000","last_clean":"2024-03-04T06:59:33.168023+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:59:33.168023+0000","last_undegraded":"2024-03-04T06:59:33.168023+0000","last_fullsized":"2024-03-04T06:59:33.168023+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247852+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T07:00:18.247852+0000","last_peered":"2024-03-04T07:00:18.247852+0000","last_clean":"2024-03-04T07:00:18.247852+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T07:00:18.247852+0000","last_undegraded":"2024-03-04T07:00:18.247852+0000","last_fullsized":"2024-03-04T07:00:18.247852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020816+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T07:00:45.020816+0000","last_peered":"2024-03-04T07:00:45.020816+0000","last_clean":"2024-03-04T07:00:45.020816+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T07:00:45.020816+0000","last_undegraded":"2024-03-04T07:00:45.020816+0000","last_fullsized":"2024-03-04T07:00:45.020816+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.964990+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:59:42.964990+0000","last_peered":"2024-03-04T06:59:42.964990+0000","last_clean":"2024-03-04T06:59:42.964990+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:59:42.964990+0000","last_undegraded":"2024-03-04T06:59:42.964990+0000","last_fullsized":"2024-03-04T06:59:42.964990+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009646+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:59:00.009646+0000","last_peered":"2024-03-04T06:59:00.009646+0000","last_clean":"2024-03-04T06:59:00.009646+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:59:00.009646+0000","last_undegraded":"2024-03-04T06:59:00.009646+0000","last_fullsized":"2024-03-04T06:59:00.009646+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1122,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967529+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T07:00:07.967529+0000","last_peered":"2024-03-04T07:00:07.967529+0000","last_clean":"2024-03-04T07:00:07.967529+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T07:00:07.967529+0000","last_undegraded":"2024-03-04T07:00:07.967529+0000","last_fullsized":"2024-03-04T07:00:07.967529+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.012471+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:59:28.012471+0000","last_peered":"2024-03-04T06:59:28.012471+0000","last_clean":"2024-03-04T06:59:28.012471+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:59:28.012471+0000","last_undegraded":"2024-03-04T06:59:28.012471+0000","last_fullsized":"2024-03-04T06:59:28.012471+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.234922+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T06:58:28.234922+0000","last_peered":"2024-03-04T06:58:28.234922+0000","last_clean":"2024-03-04T06:58:28.234922+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T06:58:28.234922+0000","last_undegraded":"2024-03-04T06:58:28.234922+0000","last_fullsized":"2024-03-04T06:58:28.234922+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503515,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648162,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142469,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287116,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997822,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885879,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937456,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792809,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:02:58.815 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:58.815 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:58.815 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:58.815 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:58.815 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:58.815 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:58.815 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:58.815 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:58.816 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:58.816 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:02:58.816 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:02:58.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:58 smithi203 ceph-mon[85573]: pgmap v1153: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:02:59.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:02:59 smithi137 ceph-mon[88869]: from='client.44654 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:59.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:02:59 smithi137 ceph-mon[91314]: from='client.44654 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:02:59.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:02:59 smithi203 ceph-mon[85573]: from='client.44654 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:03:00.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:00 smithi137 ceph-mon[88869]: pgmap v1154: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:00.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:00 smithi137 ceph-mon[91314]: pgmap v1154: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:00.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:00 smithi203 ceph-mon[85573]: pgmap v1154: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:02.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:02 smithi137 ceph-mon[88869]: pgmap v1155: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:02.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:02 smithi137 ceph-mon[91314]: pgmap v1155: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:02.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:02 smithi203 ceph-mon[85573]: pgmap v1155: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:04.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:04 smithi137 ceph-mon[88869]: pgmap v1156: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:04.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:04 smithi137 ceph-mon[91314]: pgmap v1156: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:04.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:04 smithi203 ceph-mon[85573]: pgmap v1156: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:05.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:03:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:03:05] "GET /metrics HTTP/1.1" 200 36334 "" "Prometheus/2.43.0" 2024-03-04T07:03:06.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:06 smithi137 ceph-mon[88869]: pgmap v1157: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:06.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:06 smithi137 ceph-mon[91314]: pgmap v1157: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:06.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:06 smithi203 ceph-mon[85573]: pgmap v1157: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:08.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:08 smithi137 ceph-mon[88869]: pgmap v1158: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:08.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:08 smithi137 ceph-mon[91314]: pgmap v1158: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:03:08.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:03:08.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:08 smithi203 ceph-mon[85573]: pgmap v1158: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:08.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:03:09.035 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:03:10.697 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:10 smithi137 ceph-mon[88869]: pgmap v1159: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:10.697 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:10 smithi137 ceph-mon[91314]: pgmap v1159: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:10.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:10 smithi203 ceph-mon[85573]: pgmap v1159: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:10.899 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:03:10.901 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:03:11.447 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1160,"stamp":"2024-03-04T07:03:10.607155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003799"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.564000+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T07:00:29.564000+0000","last_peered":"2024-03-04T07:00:29.564000+0000","last_clean":"2024-03-04T07:00:29.564000+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T07:00:29.564000+0000","last_undegraded":"2024-03-04T07:00:29.564000+0000","last_fullsized":"2024-03-04T07:00:29.564000+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1261,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.165005+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T06:59:03.165005+0000","last_peered":"2024-03-04T06:59:03.165005+0000","last_clean":"2024-03-04T06:59:03.165005+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T06:59:03.165005+0000","last_undegraded":"2024-03-04T06:59:03.165005+0000","last_fullsized":"2024-03-04T06:59:03.165005+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019562+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T07:00:33.019562+0000","last_peered":"2024-03-04T07:00:33.019562+0000","last_clean":"2024-03-04T07:00:33.019562+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T07:00:33.019562+0000","last_undegraded":"2024-03-04T07:00:33.019562+0000","last_fullsized":"2024-03-04T07:00:33.019562+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1143,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:52.972434+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T07:00:52.972434+0000","last_peered":"2024-03-04T07:00:52.972434+0000","last_clean":"2024-03-04T07:00:52.972434+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T07:00:52.972434+0000","last_undegraded":"2024-03-04T07:00:52.972434+0000","last_fullsized":"2024-03-04T07:00:52.972434+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560949+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T07:00:04.560949+0000","last_peered":"2024-03-04T07:00:04.560949+0000","last_clean":"2024-03-04T07:00:04.560949+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T07:00:04.560949+0000","last_undegraded":"2024-03-04T07:00:04.560949+0000","last_fullsized":"2024-03-04T07:00:04.560949+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958813+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:58:52.958813+0000","last_peered":"2024-03-04T06:58:52.958813+0000","last_clean":"2024-03-04T06:58:52.958813+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:58:52.958813+0000","last_undegraded":"2024-03-04T06:58:52.958813+0000","last_fullsized":"2024-03-04T06:58:52.958813+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560930+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T07:00:04.560930+0000","last_peered":"2024-03-04T07:00:04.560930+0000","last_clean":"2024-03-04T07:00:04.560930+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T07:00:04.560930+0000","last_undegraded":"2024-03-04T07:00:04.560930+0000","last_fullsized":"2024-03-04T07:00:04.560930+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017220+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T07:00:15.017220+0000","last_peered":"2024-03-04T07:00:15.017220+0000","last_clean":"2024-03-04T07:00:15.017220+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T07:00:15.017220+0000","last_undegraded":"2024-03-04T07:00:15.017220+0000","last_fullsized":"2024-03-04T07:00:15.017220+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1066,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558470+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:59:44.558470+0000","last_peered":"2024-03-04T06:59:44.558470+0000","last_clean":"2024-03-04T06:59:44.558470+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:59:44.558470+0000","last_undegraded":"2024-03-04T06:59:44.558470+0000","last_fullsized":"2024-03-04T06:59:44.558470+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239534+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:59:08.239534+0000","last_peered":"2024-03-04T06:59:08.239534+0000","last_clean":"2024-03-04T06:59:08.239534+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:59:08.239534+0000","last_undegraded":"2024-03-04T06:59:08.239534+0000","last_fullsized":"2024-03-04T06:59:08.239534+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239472+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:59:08.239472+0000","last_peered":"2024-03-04T06:59:08.239472+0000","last_clean":"2024-03-04T06:59:08.239472+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:59:08.239472+0000","last_undegraded":"2024-03-04T06:59:08.239472+0000","last_fullsized":"2024-03-04T06:59:08.239472+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:22.636361+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T07:00:22.636361+0000","last_peered":"2024-03-04T07:00:22.636361+0000","last_clean":"2024-03-04T07:00:22.636361+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T07:00:22.636361+0000","last_undegraded":"2024-03-04T07:00:22.636361+0000","last_fullsized":"2024-03-04T07:00:22.636361+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014730+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:59:50.014730+0000","last_peered":"2024-03-04T06:59:50.014730+0000","last_clean":"2024-03-04T06:59:50.014730+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:59:50.014730+0000","last_undegraded":"2024-03-04T06:59:50.014730+0000","last_fullsized":"2024-03-04T06:59:50.014730+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015553+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:59:58.015553+0000","last_peered":"2024-03-04T06:59:58.015553+0000","last_clean":"2024-03-04T06:59:58.015553+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:59:58.015553+0000","last_undegraded":"2024-03-04T06:59:58.015553+0000","last_fullsized":"2024-03-04T06:59:58.015553+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174897+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T07:00:33.174897+0000","last_peered":"2024-03-04T07:00:33.174897+0000","last_clean":"2024-03-04T07:00:33.174897+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T07:00:33.174897+0000","last_undegraded":"2024-03-04T07:00:33.174897+0000","last_fullsized":"2024-03-04T07:00:33.174897+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970309+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T07:00:32.970309+0000","last_peered":"2024-03-04T07:00:32.970309+0000","last_clean":"2024-03-04T07:00:32.970309+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T07:00:32.970309+0000","last_undegraded":"2024-03-04T07:00:32.970309+0000","last_fullsized":"2024-03-04T07:00:32.970309+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970400+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T07:00:32.970400+0000","last_peered":"2024-03-04T07:00:32.970400+0000","last_clean":"2024-03-04T07:00:32.970400+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T07:00:32.970400+0000","last_undegraded":"2024-03-04T07:00:32.970400+0000","last_fullsized":"2024-03-04T07:00:32.970400+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397463+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:58:48.397463+0000","last_peered":"2024-03-04T06:58:48.397463+0000","last_clean":"2024-03-04T06:58:48.397463+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:58:48.397463+0000","last_undegraded":"2024-03-04T06:58:48.397463+0000","last_fullsized":"2024-03-04T06:58:48.397463+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:59:04.553588+0000","last_peered":"2024-03-04T06:59:04.553588+0000","last_clean":"2024-03-04T06:59:04.553588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:59:04.553588+0000","last_undegraded":"2024-03-04T06:59:04.553588+0000","last_fullsized":"2024-03-04T06:59:04.553588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1307,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019623+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T07:00:33.019623+0000","last_peered":"2024-03-04T07:00:33.019623+0000","last_clean":"2024-03-04T07:00:33.019623+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T07:00:33.019623+0000","last_undegraded":"2024-03-04T07:00:33.019623+0000","last_fullsized":"2024-03-04T07:00:33.019623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014206+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:59:45.014206+0000","last_peered":"2024-03-04T06:59:45.014206+0000","last_clean":"2024-03-04T06:59:45.014206+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:59:45.014206+0000","last_undegraded":"2024-03-04T06:59:45.014206+0000","last_fullsized":"2024-03-04T06:59:45.014206+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014216+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:59:45.014216+0000","last_peered":"2024-03-04T06:59:45.014216+0000","last_clean":"2024-03-04T06:59:45.014216+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:59:45.014216+0000","last_undegraded":"2024-03-04T06:59:45.014216+0000","last_fullsized":"2024-03-04T06:59:45.014216+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019611+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T07:00:33.019611+0000","last_peered":"2024-03-04T07:00:33.019611+0000","last_clean":"2024-03-04T07:00:33.019611+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T07:00:33.019611+0000","last_undegraded":"2024-03-04T07:00:33.019611+0000","last_fullsized":"2024-03-04T07:00:33.019611+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403128+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:59:38.403128+0000","last_peered":"2024-03-04T06:59:38.403128+0000","last_clean":"2024-03-04T06:59:38.403128+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:59:38.403128+0000","last_undegraded":"2024-03-04T06:59:38.403128+0000","last_fullsized":"2024-03-04T06:59:38.403128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1223,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403103+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:59:38.403103+0000","last_peered":"2024-03-04T06:59:38.403103+0000","last_clean":"2024-03-04T06:59:38.403103+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:59:38.403103+0000","last_undegraded":"2024-03-04T06:59:38.403103+0000","last_fullsized":"2024-03-04T06:59:38.403103+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560965+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T07:00:04.560965+0000","last_peered":"2024-03-04T07:00:04.560965+0000","last_clean":"2024-03-04T07:00:04.560965+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T07:00:04.560965+0000","last_undegraded":"2024-03-04T07:00:04.560965+0000","last_fullsized":"2024-03-04T07:00:04.560965+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958870+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:58:52.958870+0000","last_peered":"2024-03-04T06:58:52.958870+0000","last_clean":"2024-03-04T06:58:52.958870+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:58:52.958870+0000","last_undegraded":"2024-03-04T06:58:52.958870+0000","last_fullsized":"2024-03-04T06:58:52.958870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017274+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T07:00:15.017274+0000","last_peered":"2024-03-04T07:00:15.017274+0000","last_clean":"2024-03-04T07:00:15.017274+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T07:00:15.017274+0000","last_undegraded":"2024-03-04T07:00:15.017274+0000","last_fullsized":"2024-03-04T07:00:15.017274+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1190,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:17.623076+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T06:58:17.623076+0000","last_peered":"2024-03-04T06:58:17.623076+0000","last_clean":"2024-03-04T06:58:17.623076+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T06:58:17.623076+0000","last_undegraded":"2024-03-04T06:58:17.623076+0000","last_fullsized":"2024-03-04T06:58:17.623076+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.241598+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:59:28.241598+0000","last_peered":"2024-03-04T06:59:28.241598+0000","last_clean":"2024-03-04T06:59:28.241598+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:59:28.241598+0000","last_undegraded":"2024-03-04T06:59:28.241598+0000","last_fullsized":"2024-03-04T06:59:28.241598+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006622+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:58:28.006622+0000","last_peered":"2024-03-04T06:58:28.006622+0000","last_clean":"2024-03-04T06:58:28.006622+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:58:28.006622+0000","last_undegraded":"2024-03-04T06:58:28.006622+0000","last_fullsized":"2024-03-04T06:58:28.006622+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014712+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:59:50.014712+0000","last_peered":"2024-03-04T06:59:50.014712+0000","last_clean":"2024-03-04T06:59:50.014712+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:59:50.014712+0000","last_undegraded":"2024-03-04T06:59:50.014712+0000","last_fullsized":"2024-03-04T06:59:50.014712+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014675+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:59:50.014675+0000","last_peered":"2024-03-04T06:59:50.014675+0000","last_clean":"2024-03-04T06:59:50.014675+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:59:50.014675+0000","last_undegraded":"2024-03-04T06:59:50.014675+0000","last_fullsized":"2024-03-04T06:59:50.014675+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956356+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:58:32.956356+0000","last_peered":"2024-03-04T06:58:32.956356+0000","last_clean":"2024-03-04T06:58:32.956356+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:58:32.956356+0000","last_undegraded":"2024-03-04T06:58:32.956356+0000","last_fullsized":"2024-03-04T06:58:32.956356+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162696+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:58:38.162696+0000","last_peered":"2024-03-04T06:58:38.162696+0000","last_clean":"2024-03-04T06:58:38.162696+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:58:38.162696+0000","last_undegraded":"2024-03-04T06:58:38.162696+0000","last_fullsized":"2024-03-04T06:58:38.162696+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239549+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:59:08.239549+0000","last_peered":"2024-03-04T06:59:08.239549+0000","last_clean":"2024-03-04T06:59:08.239549+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:59:08.239549+0000","last_undegraded":"2024-03-04T06:59:08.239549+0000","last_fullsized":"2024-03-04T06:59:08.239549+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956414+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:58:32.956414+0000","last_peered":"2024-03-04T06:58:32.956414+0000","last_clean":"2024-03-04T06:58:32.956414+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:58:32.956414+0000","last_undegraded":"2024-03-04T06:58:32.956414+0000","last_fullsized":"2024-03-04T06:58:32.956414+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956402+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:58:32.956402+0000","last_peered":"2024-03-04T06:58:32.956402+0000","last_clean":"2024-03-04T06:58:32.956402+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:58:32.956402+0000","last_undegraded":"2024-03-04T06:58:32.956402+0000","last_fullsized":"2024-03-04T06:58:32.956402+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:28.018729+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T07:00:28.018729+0000","last_peered":"2024-03-04T07:00:28.018729+0000","last_clean":"2024-03-04T07:00:28.018729+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T07:00:28.018729+0000","last_undegraded":"2024-03-04T07:00:28.018729+0000","last_fullsized":"2024-03-04T07:00:28.018729+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162740+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:58:38.162740+0000","last_peered":"2024-03-04T06:58:38.162740+0000","last_clean":"2024-03-04T06:58:38.162740+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:58:38.162740+0000","last_undegraded":"2024-03-04T06:58:38.162740+0000","last_fullsized":"2024-03-04T06:58:38.162740+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:57.633964+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:59:57.633964+0000","last_peered":"2024-03-04T06:59:57.633964+0000","last_clean":"2024-03-04T06:59:57.633964+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:59:57.633964+0000","last_undegraded":"2024-03-04T06:59:57.633964+0000","last_fullsized":"2024-03-04T06:59:57.633964+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1131,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237167+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:58:48.237167+0000","last_peered":"2024-03-04T06:58:48.237167+0000","last_clean":"2024-03-04T06:58:48.237167+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:58:48.237167+0000","last_undegraded":"2024-03-04T06:58:48.237167+0000","last_fullsized":"2024-03-04T06:58:48.237167+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558443+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:59:44.558443+0000","last_peered":"2024-03-04T06:59:44.558443+0000","last_clean":"2024-03-04T06:59:44.558443+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:59:44.558443+0000","last_undegraded":"2024-03-04T06:59:44.558443+0000","last_fullsized":"2024-03-04T06:59:44.558443+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015596+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:59:58.015596+0000","last_peered":"2024-03-04T06:59:58.015596+0000","last_clean":"2024-03-04T06:59:58.015596+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:59:58.015596+0000","last_undegraded":"2024-03-04T06:59:58.015596+0000","last_fullsized":"2024-03-04T06:59:58.015596+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397438+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:58:48.397438+0000","last_peered":"2024-03-04T06:58:48.397438+0000","last_clean":"2024-03-04T06:58:48.397438+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:58:48.397438+0000","last_undegraded":"2024-03-04T06:58:48.397438+0000","last_fullsized":"2024-03-04T06:58:48.397438+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970340+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T07:00:32.970340+0000","last_peered":"2024-03-04T07:00:32.970340+0000","last_clean":"2024-03-04T07:00:32.970340+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T07:00:32.970340+0000","last_undegraded":"2024-03-04T07:00:32.970340+0000","last_fullsized":"2024-03-04T07:00:32.970340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555834+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:59:24.555834+0000","last_peered":"2024-03-04T06:59:24.555834+0000","last_clean":"2024-03-04T06:59:24.555834+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:59:24.555834+0000","last_undegraded":"2024-03-04T06:59:24.555834+0000","last_fullsized":"2024-03-04T06:59:24.555834+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237147+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:58:48.237147+0000","last_peered":"2024-03-04T06:58:48.237147+0000","last_clean":"2024-03-04T06:58:48.237147+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:58:48.237147+0000","last_undegraded":"2024-03-04T06:58:48.237147+0000","last_fullsized":"2024-03-04T06:58:48.237147+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237122+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:58:48.237122+0000","last_peered":"2024-03-04T06:58:48.237122+0000","last_clean":"2024-03-04T06:58:48.237122+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:58:48.237122+0000","last_undegraded":"2024-03-04T06:58:48.237122+0000","last_fullsized":"2024-03-04T06:58:48.237122+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397404+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:58:48.397404+0000","last_peered":"2024-03-04T06:58:48.397404+0000","last_clean":"2024-03-04T06:58:48.397404+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:58:48.397404+0000","last_undegraded":"2024-03-04T06:58:48.397404+0000","last_fullsized":"2024-03-04T06:58:48.397404+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555799+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:59:24.555799+0000","last_peered":"2024-03-04T06:59:24.555799+0000","last_clean":"2024-03-04T06:59:24.555799+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:59:24.555799+0000","last_undegraded":"2024-03-04T06:59:24.555799+0000","last_fullsized":"2024-03-04T06:59:24.555799+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3579,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405911+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:00:08.405911+0000","last_peered":"2024-03-04T07:00:08.405911+0000","last_clean":"2024-03-04T07:00:08.405911+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:00:08.405911+0000","last_undegraded":"2024-03-04T07:00:08.405911+0000","last_fullsized":"2024-03-04T07:00:08.405911+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:32.631361+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:59:32.631361+0000","last_peered":"2024-03-04T06:59:32.631361+0000","last_clean":"2024-03-04T06:59:32.631361+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:59:32.631361+0000","last_undegraded":"2024-03-04T06:59:32.631361+0000","last_fullsized":"2024-03-04T06:59:32.631361+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553616+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:59:04.553616+0000","last_peered":"2024-03-04T06:59:04.553616+0000","last_clean":"2024-03-04T06:59:04.553616+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:59:04.553616+0000","last_undegraded":"2024-03-04T06:59:04.553616+0000","last_fullsized":"2024-03-04T06:59:04.553616+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17118,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019514+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T07:00:33.019514+0000","last_peered":"2024-03-04T07:00:33.019514+0000","last_clean":"2024-03-04T07:00:33.019514+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T07:00:33.019514+0000","last_undegraded":"2024-03-04T07:00:33.019514+0000","last_fullsized":"2024-03-04T07:00:33.019514+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164900+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T06:59:03.164900+0000","last_peered":"2024-03-04T06:59:03.164900+0000","last_clean":"2024-03-04T06:59:03.164900+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T06:59:03.164900+0000","last_undegraded":"2024-03-04T06:59:03.164900+0000","last_fullsized":"2024-03-04T06:59:03.164900+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164981+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T06:59:03.164981+0000","last_peered":"2024-03-04T06:59:03.164981+0000","last_clean":"2024-03-04T06:59:03.164981+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T06:59:03.164981+0000","last_undegraded":"2024-03-04T06:59:03.164981+0000","last_fullsized":"2024-03-04T06:59:03.164981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962033+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:59:17.962033+0000","last_peered":"2024-03-04T06:59:17.962033+0000","last_clean":"2024-03-04T06:59:17.962033+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:59:17.962033+0000","last_undegraded":"2024-03-04T06:59:17.962033+0000","last_fullsized":"2024-03-04T06:59:17.962033+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4388,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019581+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T07:00:33.019581+0000","last_peered":"2024-03-04T07:00:33.019581+0000","last_clean":"2024-03-04T07:00:33.019581+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T07:00:33.019581+0000","last_undegraded":"2024-03-04T07:00:33.019581+0000","last_fullsized":"2024-03-04T07:00:33.019581+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164925+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T06:59:03.164925+0000","last_peered":"2024-03-04T06:59:03.164925+0000","last_clean":"2024-03-04T06:59:03.164925+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T06:59:03.164925+0000","last_undegraded":"2024-03-04T06:59:03.164925+0000","last_fullsized":"2024-03-04T06:59:03.164925+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.961943+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:59:17.961943+0000","last_peered":"2024-03-04T06:59:17.961943+0000","last_clean":"2024-03-04T06:59:17.961943+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:59:17.961943+0000","last_undegraded":"2024-03-04T06:59:17.961943+0000","last_fullsized":"2024-03-04T06:59:17.961943+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639139+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T07:00:47.639139+0000","last_peered":"2024-03-04T07:00:47.639139+0000","last_clean":"2024-03-04T07:00:47.639139+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T07:00:47.639139+0000","last_undegraded":"2024-03-04T07:00:47.639139+0000","last_fullsized":"2024-03-04T07:00:47.639139+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5641,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.406020+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:00:08.406020+0000","last_peered":"2024-03-04T07:00:08.406020+0000","last_clean":"2024-03-04T07:00:08.406020+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:00:08.406020+0000","last_undegraded":"2024-03-04T07:00:08.406020+0000","last_fullsized":"2024-03-04T07:00:08.406020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1257,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168065+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:59:33.168065+0000","last_peered":"2024-03-04T06:59:33.168065+0000","last_clean":"2024-03-04T06:59:33.168065+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:59:33.168065+0000","last_undegraded":"2024-03-04T06:59:33.168065+0000","last_fullsized":"2024-03-04T06:59:33.168065+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174867+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T07:00:33.174867+0000","last_peered":"2024-03-04T07:00:33.174867+0000","last_clean":"2024-03-04T07:00:33.174867+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T07:00:33.174867+0000","last_undegraded":"2024-03-04T07:00:33.174867+0000","last_fullsized":"2024-03-04T07:00:33.174867+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403066+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:59:38.403066+0000","last_peered":"2024-03-04T06:59:38.403066+0000","last_clean":"2024-03-04T06:59:38.403066+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:59:38.403066+0000","last_undegraded":"2024-03-04T06:59:38.403066+0000","last_fullsized":"2024-03-04T06:59:38.403066+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4017,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:29.563935+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T07:00:29.563935+0000","last_peered":"2024-03-04T07:00:29.563935+0000","last_clean":"2024-03-04T07:00:29.563935+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T07:00:29.563935+0000","last_undegraded":"2024-03-04T07:00:29.563935+0000","last_fullsized":"2024-03-04T07:00:29.563935+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244731+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:59:53.244731+0000","last_peered":"2024-03-04T06:59:53.244731+0000","last_clean":"2024-03-04T06:59:53.244731+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:59:53.244731+0000","last_undegraded":"2024-03-04T06:59:53.244731+0000","last_fullsized":"2024-03-04T06:59:53.244731+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017258+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T07:00:15.017258+0000","last_peered":"2024-03-04T07:00:15.017258+0000","last_clean":"2024-03-04T07:00:15.017258+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T07:00:15.017258+0000","last_undegraded":"2024-03-04T07:00:15.017258+0000","last_fullsized":"2024-03-04T07:00:15.017258+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962020+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:59:17.962020+0000","last_peered":"2024-03-04T06:59:17.962020+0000","last_clean":"2024-03-04T06:59:17.962020+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:59:17.962020+0000","last_undegraded":"2024-03-04T06:59:17.962020+0000","last_fullsized":"2024-03-04T06:59:17.962020+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1552,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560890+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:00:04.560890+0000","last_peered":"2024-03-04T07:00:04.560890+0000","last_clean":"2024-03-04T07:00:04.560890+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:00:04.560890+0000","last_undegraded":"2024-03-04T07:00:04.560890+0000","last_fullsized":"2024-03-04T07:00:04.560890+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3952,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.965034+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:59:42.965034+0000","last_peered":"2024-03-04T06:59:42.965034+0000","last_clean":"2024-03-04T06:59:42.965034+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:59:42.965034+0000","last_undegraded":"2024-03-04T06:59:42.965034+0000","last_fullsized":"2024-03-04T06:59:42.965034+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009504+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T06:58:58.009504+0000","last_peered":"2024-03-04T06:58:58.009504+0000","last_clean":"2024-03-04T06:58:58.009504+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T06:58:58.009504+0000","last_undegraded":"2024-03-04T06:58:58.009504+0000","last_fullsized":"2024-03-04T06:58:58.009504+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403043+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:59:38.403043+0000","last_peered":"2024-03-04T06:59:38.403043+0000","last_clean":"2024-03-04T06:59:38.403043+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:59:38.403043+0000","last_undegraded":"2024-03-04T06:59:38.403043+0000","last_fullsized":"2024-03-04T06:59:38.403043+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560852+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:00:04.560852+0000","last_peered":"2024-03-04T07:00:04.560852+0000","last_clean":"2024-03-04T07:00:04.560852+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:00:04.560852+0000","last_undegraded":"2024-03-04T07:00:04.560852+0000","last_fullsized":"2024-03-04T07:00:04.560852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15293,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:53.244696+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:59:53.244696+0000","last_peered":"2024-03-04T06:59:53.244696+0000","last_clean":"2024-03-04T06:59:53.244696+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:59:53.244696+0000","last_undegraded":"2024-03-04T06:59:53.244696+0000","last_fullsized":"2024-03-04T06:59:53.244696+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019541+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T07:00:33.019541+0000","last_peered":"2024-03-04T07:00:33.019541+0000","last_clean":"2024-03-04T07:00:33.019541+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T07:00:33.019541+0000","last_undegraded":"2024-03-04T07:00:33.019541+0000","last_fullsized":"2024-03-04T07:00:33.019541+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1075,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.563983+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T07:00:29.563983+0000","last_peered":"2024-03-04T07:00:29.563983+0000","last_clean":"2024-03-04T07:00:29.563983+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T07:00:29.563983+0000","last_undegraded":"2024-03-04T07:00:29.563983+0000","last_fullsized":"2024-03-04T07:00:29.563983+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:03.164943+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T06:59:03.164943+0000","last_peered":"2024-03-04T06:59:03.164943+0000","last_clean":"2024-03-04T06:59:03.164943+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T06:59:03.164943+0000","last_undegraded":"2024-03-04T06:59:03.164943+0000","last_fullsized":"2024-03-04T06:59:03.164943+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4381,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:47.639101+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T07:00:47.639101+0000","last_peered":"2024-03-04T07:00:47.639101+0000","last_clean":"2024-03-04T07:00:47.639101+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T07:00:47.639101+0000","last_undegraded":"2024-03-04T07:00:47.639101+0000","last_fullsized":"2024-03-04T07:00:47.639101+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014181+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:59:45.014181+0000","last_peered":"2024-03-04T06:59:45.014181+0000","last_clean":"2024-03-04T06:59:45.014181+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:59:45.014181+0000","last_undegraded":"2024-03-04T06:59:45.014181+0000","last_fullsized":"2024-03-04T06:59:45.014181+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1270,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168056+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:59:33.168056+0000","last_peered":"2024-03-04T06:59:33.168056+0000","last_clean":"2024-03-04T06:59:33.168056+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:59:33.168056+0000","last_undegraded":"2024-03-04T06:59:33.168056+0000","last_fullsized":"2024-03-04T06:59:33.168056+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020800+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T07:00:45.020800+0000","last_peered":"2024-03-04T07:00:45.020800+0000","last_clean":"2024-03-04T07:00:45.020800+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T07:00:45.020800+0000","last_undegraded":"2024-03-04T07:00:45.020800+0000","last_fullsized":"2024-03-04T07:00:45.020800+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4611,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:45.014149+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:59:45.014149+0000","last_peered":"2024-03-04T06:59:45.014149+0000","last_clean":"2024-03-04T06:59:45.014149+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:59:45.014149+0000","last_undegraded":"2024-03-04T06:59:45.014149+0000","last_fullsized":"2024-03-04T06:59:45.014149+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639077+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T07:00:47.639077+0000","last_peered":"2024-03-04T07:00:47.639077+0000","last_clean":"2024-03-04T07:00:47.639077+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T07:00:47.639077+0000","last_undegraded":"2024-03-04T07:00:47.639077+0000","last_fullsized":"2024-03-04T07:00:47.639077+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1080,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247864+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T07:00:18.247864+0000","last_peered":"2024-03-04T07:00:18.247864+0000","last_clean":"2024-03-04T07:00:18.247864+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T07:00:18.247864+0000","last_undegraded":"2024-03-04T07:00:18.247864+0000","last_fullsized":"2024-03-04T07:00:18.247864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:58.009478+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T06:58:58.009478+0000","last_peered":"2024-03-04T06:58:58.009478+0000","last_clean":"2024-03-04T06:58:58.009478+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T06:58:58.009478+0000","last_undegraded":"2024-03-04T06:58:58.009478+0000","last_fullsized":"2024-03-04T06:58:58.009478+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4636,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:07.967606+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T07:00:07.967606+0000","last_peered":"2024-03-04T07:00:07.967606+0000","last_clean":"2024-03-04T07:00:07.967606+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T07:00:07.967606+0000","last_undegraded":"2024-03-04T07:00:07.967606+0000","last_fullsized":"2024-03-04T07:00:07.967606+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:54.566566+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T07:00:54.566566+0000","last_peered":"2024-03-04T07:00:54.566566+0000","last_clean":"2024-03-04T07:00:54.566566+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T07:00:54.566566+0000","last_undegraded":"2024-03-04T07:00:54.566566+0000","last_fullsized":"2024-03-04T07:00:54.566566+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1186,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:07.628352+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:59:07.628352+0000","last_peered":"2024-03-04T06:59:07.628352+0000","last_clean":"2024-03-04T06:59:07.628352+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:59:07.628352+0000","last_undegraded":"2024-03-04T06:59:07.628352+0000","last_fullsized":"2024-03-04T06:59:07.628352+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5159,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:32.631317+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:59:32.631317+0000","last_peered":"2024-03-04T06:59:32.631317+0000","last_clean":"2024-03-04T06:59:32.631317+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:59:32.631317+0000","last_undegraded":"2024-03-04T06:59:32.631317+0000","last_fullsized":"2024-03-04T06:59:32.631317+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.167981+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:59:33.167981+0000","last_peered":"2024-03-04T06:59:33.167981+0000","last_clean":"2024-03-04T06:59:33.167981+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:59:33.167981+0000","last_undegraded":"2024-03-04T06:59:33.167981+0000","last_fullsized":"2024-03-04T06:59:33.167981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020733+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T07:00:45.020733+0000","last_peered":"2024-03-04T07:00:45.020733+0000","last_clean":"2024-03-04T07:00:45.020733+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T07:00:45.020733+0000","last_undegraded":"2024-03-04T07:00:45.020733+0000","last_fullsized":"2024-03-04T07:00:45.020733+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4721,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409468+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T07:00:38.409468+0000","last_peered":"2024-03-04T07:00:38.409468+0000","last_clean":"2024-03-04T07:00:38.409468+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T07:00:38.409468+0000","last_undegraded":"2024-03-04T07:00:38.409468+0000","last_fullsized":"2024-03-04T07:00:38.409468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168002+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:59:33.168002+0000","last_peered":"2024-03-04T06:59:33.168002+0000","last_clean":"2024-03-04T06:59:33.168002+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:59:33.168002+0000","last_undegraded":"2024-03-04T06:59:33.168002+0000","last_fullsized":"2024-03-04T06:59:33.168002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009678+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:59:00.009678+0000","last_peered":"2024-03-04T06:59:00.009678+0000","last_clean":"2024-03-04T06:59:00.009678+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:59:00.009678+0000","last_undegraded":"2024-03-04T06:59:00.009678+0000","last_fullsized":"2024-03-04T06:59:00.009678+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5556,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:03.171266+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:00:03.171266+0000","last_peered":"2024-03-04T07:00:03.171266+0000","last_clean":"2024-03-04T07:00:03.171266+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:00:03.171266+0000","last_undegraded":"2024-03-04T07:00:03.171266+0000","last_fullsized":"2024-03-04T07:00:03.171266+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553540+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:59:04.553540+0000","last_peered":"2024-03-04T06:59:04.553540+0000","last_clean":"2024-03-04T06:59:04.553540+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:59:04.553540+0000","last_undegraded":"2024-03-04T06:59:04.553540+0000","last_fullsized":"2024-03-04T06:59:04.553540+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247800+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T07:00:18.247800+0000","last_peered":"2024-03-04T07:00:18.247800+0000","last_clean":"2024-03-04T07:00:18.247800+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T07:00:18.247800+0000","last_undegraded":"2024-03-04T07:00:18.247800+0000","last_fullsized":"2024-03-04T07:00:18.247800+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409421+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T07:00:38.409421+0000","last_peered":"2024-03-04T07:00:38.409421+0000","last_clean":"2024-03-04T07:00:38.409421+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T07:00:38.409421+0000","last_undegraded":"2024-03-04T07:00:38.409421+0000","last_fullsized":"2024-03-04T07:00:38.409421+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409457+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T07:00:38.409457+0000","last_peered":"2024-03-04T07:00:38.409457+0000","last_clean":"2024-03-04T07:00:38.409457+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T07:00:38.409457+0000","last_undegraded":"2024-03-04T07:00:38.409457+0000","last_fullsized":"2024-03-04T07:00:38.409457+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553601+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:59:04.553601+0000","last_peered":"2024-03-04T06:59:04.553601+0000","last_clean":"2024-03-04T06:59:04.553601+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:59:04.553601+0000","last_undegraded":"2024-03-04T06:59:04.553601+0000","last_fullsized":"2024-03-04T06:59:04.553601+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4368,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405967+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:00:08.405967+0000","last_peered":"2024-03-04T07:00:08.405967+0000","last_clean":"2024-03-04T07:00:08.405967+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:00:08.405967+0000","last_undegraded":"2024-03-04T07:00:08.405967+0000","last_fullsized":"2024-03-04T07:00:08.405967+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:03.171315+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:00:03.171315+0000","last_peered":"2024-03-04T07:00:03.171315+0000","last_clean":"2024-03-04T07:00:03.171315+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:00:03.171315+0000","last_undegraded":"2024-03-04T07:00:03.171315+0000","last_fullsized":"2024-03-04T07:00:03.171315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967580+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T07:00:07.967580+0000","last_peered":"2024-03-04T07:00:07.967580+0000","last_clean":"2024-03-04T07:00:07.967580+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T07:00:07.967580+0000","last_undegraded":"2024-03-04T07:00:07.967580+0000","last_fullsized":"2024-03-04T07:00:07.967580+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4602,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:54.566603+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T07:00:54.566603+0000","last_peered":"2024-03-04T07:00:54.566603+0000","last_clean":"2024-03-04T07:00:54.566603+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T07:00:54.566603+0000","last_undegraded":"2024-03-04T07:00:54.566603+0000","last_fullsized":"2024-03-04T07:00:54.566603+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1247,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409492+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T07:00:38.409492+0000","last_peered":"2024-03-04T07:00:38.409492+0000","last_clean":"2024-03-04T07:00:38.409492+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T07:00:38.409492+0000","last_undegraded":"2024-03-04T07:00:38.409492+0000","last_fullsized":"2024-03-04T07:00:38.409492+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553631+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:59:04.553631+0000","last_peered":"2024-03-04T06:59:04.553631+0000","last_clean":"2024-03-04T06:59:04.553631+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:59:04.553631+0000","last_undegraded":"2024-03-04T06:59:04.553631+0000","last_fullsized":"2024-03-04T06:59:04.553631+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244661+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:59:53.244661+0000","last_peered":"2024-03-04T06:59:53.244661+0000","last_clean":"2024-03-04T06:59:53.244661+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:59:53.244661+0000","last_undegraded":"2024-03-04T06:59:53.244661+0000","last_fullsized":"2024-03-04T06:59:53.244661+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403075+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:59:38.403075+0000","last_peered":"2024-03-04T06:59:38.403075+0000","last_clean":"2024-03-04T06:59:38.403075+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:59:38.403075+0000","last_undegraded":"2024-03-04T06:59:38.403075+0000","last_fullsized":"2024-03-04T06:59:38.403075+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962003+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:59:17.962003+0000","last_peered":"2024-03-04T06:59:17.962003+0000","last_clean":"2024-03-04T06:59:17.962003+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:59:17.962003+0000","last_undegraded":"2024-03-04T06:59:17.962003+0000","last_fullsized":"2024-03-04T06:59:17.962003+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019487+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T07:00:33.019487+0000","last_peered":"2024-03-04T07:00:33.019487+0000","last_clean":"2024-03-04T07:00:33.019487+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T07:00:33.019487+0000","last_undegraded":"2024-03-04T07:00:33.019487+0000","last_fullsized":"2024-03-04T07:00:33.019487+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020779+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T07:00:45.020779+0000","last_peered":"2024-03-04T07:00:45.020779+0000","last_clean":"2024-03-04T07:00:45.020779+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T07:00:45.020779+0000","last_undegraded":"2024-03-04T07:00:45.020779+0000","last_fullsized":"2024-03-04T07:00:45.020779+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168023+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:59:33.168023+0000","last_peered":"2024-03-04T06:59:33.168023+0000","last_clean":"2024-03-04T06:59:33.168023+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:59:33.168023+0000","last_undegraded":"2024-03-04T06:59:33.168023+0000","last_fullsized":"2024-03-04T06:59:33.168023+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247852+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T07:00:18.247852+0000","last_peered":"2024-03-04T07:00:18.247852+0000","last_clean":"2024-03-04T07:00:18.247852+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T07:00:18.247852+0000","last_undegraded":"2024-03-04T07:00:18.247852+0000","last_fullsized":"2024-03-04T07:00:18.247852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020816+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T07:00:45.020816+0000","last_peered":"2024-03-04T07:00:45.020816+0000","last_clean":"2024-03-04T07:00:45.020816+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T07:00:45.020816+0000","last_undegraded":"2024-03-04T07:00:45.020816+0000","last_fullsized":"2024-03-04T07:00:45.020816+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.964990+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:59:42.964990+0000","last_peered":"2024-03-04T06:59:42.964990+0000","last_clean":"2024-03-04T06:59:42.964990+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:59:42.964990+0000","last_undegraded":"2024-03-04T06:59:42.964990+0000","last_fullsized":"2024-03-04T06:59:42.964990+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009646+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:59:00.009646+0000","last_peered":"2024-03-04T06:59:00.009646+0000","last_clean":"2024-03-04T06:59:00.009646+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:59:00.009646+0000","last_undegraded":"2024-03-04T06:59:00.009646+0000","last_fullsized":"2024-03-04T06:59:00.009646+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1122,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967529+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T07:00:07.967529+0000","last_peered":"2024-03-04T07:00:07.967529+0000","last_clean":"2024-03-04T07:00:07.967529+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T07:00:07.967529+0000","last_undegraded":"2024-03-04T07:00:07.967529+0000","last_fullsized":"2024-03-04T07:00:07.967529+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.012471+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:59:28.012471+0000","last_peered":"2024-03-04T06:59:28.012471+0000","last_clean":"2024-03-04T06:59:28.012471+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:59:28.012471+0000","last_undegraded":"2024-03-04T06:59:28.012471+0000","last_fullsized":"2024-03-04T06:59:28.012471+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:43.250705+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T07:00:43.250705+0000","last_peered":"2024-03-04T07:00:43.250705+0000","last_clean":"2024-03-04T07:00:43.250705+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T07:00:43.250705+0000","last_undegraded":"2024-03-04T07:00:43.250705+0000","last_fullsized":"2024-03-04T07:00:43.250705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503518,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648165,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142472,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287119,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997825,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885882,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937459,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792812,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:03:11.515 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:11.516 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:11.516 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:11.516 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:11.516 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:11.516 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:11.516 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:11.516 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:11.516 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:11.516 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:11.516 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:03:12.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:12 smithi137 ceph-mon[88869]: pgmap v1160: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:12.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:12 smithi137 ceph-mon[88869]: from='client.34719 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:03:12.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:12 smithi137 ceph-mon[91314]: pgmap v1160: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:12.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:12 smithi137 ceph-mon[91314]: from='client.34719 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:03:12.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:12 smithi203 ceph-mon[85573]: pgmap v1160: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:12.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:12 smithi203 ceph-mon[85573]: from='client.34719 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:03:14.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:14 smithi137 ceph-mon[88869]: pgmap v1161: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:14.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:14 smithi137 ceph-mon[91314]: pgmap v1161: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:14.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:14 smithi203 ceph-mon[85573]: pgmap v1161: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:15.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:03:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:03:15] "GET /metrics HTTP/1.1" 200 36334 "" "Prometheus/2.43.0" 2024-03-04T07:03:16.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:16 smithi137 ceph-mon[88869]: pgmap v1162: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:16.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:16 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:03:16.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:16 smithi137 ceph-mon[91314]: pgmap v1162: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:16.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:16 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:03:16.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:16 smithi203 ceph-mon[85573]: pgmap v1162: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:16.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:16 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:03:17.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:17 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:03:17.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:17 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:03:17.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:17 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:03:17.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:17 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:03:17.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:17 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:03:17.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:17 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:03:17.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:17 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:03:17.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:17 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:03:17.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:17 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:03:18.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:18 smithi137 ceph-mon[88869]: pgmap v1163: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:18.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:18 smithi137 ceph-mon[91314]: pgmap v1163: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:18.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:18 smithi203 ceph-mon[85573]: pgmap v1163: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:20.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:20 smithi137 ceph-mon[88869]: pgmap v1164: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:20.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:20 smithi137 ceph-mon[91314]: pgmap v1164: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:20.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:20 smithi203 ceph-mon[85573]: pgmap v1164: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:21.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:03:21.733 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:03:22.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:22 smithi137 ceph-mon[88869]: pgmap v1165: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:22.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:22 smithi137 ceph-mon[91314]: pgmap v1165: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:22.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:22 smithi203 ceph-mon[85573]: pgmap v1165: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:23.601 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:03:23.604 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:03:23.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:23 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:03:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:23 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:03:23.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:23 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:03:24.151 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1166,"stamp":"2024-03-04T07:03:22.611010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003854"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.564000+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T07:00:29.564000+0000","last_peered":"2024-03-04T07:00:29.564000+0000","last_clean":"2024-03-04T07:00:29.564000+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T07:00:29.564000+0000","last_undegraded":"2024-03-04T07:00:29.564000+0000","last_fullsized":"2024-03-04T07:00:29.564000+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178667+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T07:01:08.178667+0000","last_peered":"2024-03-04T07:01:08.178667+0000","last_clean":"2024-03-04T07:01:08.178667+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T07:01:08.178667+0000","last_undegraded":"2024-03-04T07:01:08.178667+0000","last_fullsized":"2024-03-04T07:01:08.178667+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019562+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T07:00:33.019562+0000","last_peered":"2024-03-04T07:00:33.019562+0000","last_clean":"2024-03-04T07:00:33.019562+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T07:00:33.019562+0000","last_undegraded":"2024-03-04T07:00:33.019562+0000","last_fullsized":"2024-03-04T07:00:33.019562+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1143,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:52.972434+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T07:00:52.972434+0000","last_peered":"2024-03-04T07:00:52.972434+0000","last_clean":"2024-03-04T07:00:52.972434+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T07:00:52.972434+0000","last_undegraded":"2024-03-04T07:00:52.972434+0000","last_fullsized":"2024-03-04T07:00:52.972434+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560949+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T07:00:04.560949+0000","last_peered":"2024-03-04T07:00:04.560949+0000","last_clean":"2024-03-04T07:00:04.560949+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T07:00:04.560949+0000","last_undegraded":"2024-03-04T07:00:04.560949+0000","last_fullsized":"2024-03-04T07:00:04.560949+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958813+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:58:52.958813+0000","last_peered":"2024-03-04T06:58:52.958813+0000","last_clean":"2024-03-04T06:58:52.958813+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:58:52.958813+0000","last_undegraded":"2024-03-04T06:58:52.958813+0000","last_fullsized":"2024-03-04T06:58:52.958813+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560930+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T07:00:04.560930+0000","last_peered":"2024-03-04T07:00:04.560930+0000","last_clean":"2024-03-04T07:00:04.560930+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T07:00:04.560930+0000","last_undegraded":"2024-03-04T07:00:04.560930+0000","last_fullsized":"2024-03-04T07:00:04.560930+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017220+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T07:00:15.017220+0000","last_peered":"2024-03-04T07:00:15.017220+0000","last_clean":"2024-03-04T07:00:15.017220+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T07:00:15.017220+0000","last_undegraded":"2024-03-04T07:00:15.017220+0000","last_fullsized":"2024-03-04T07:00:15.017220+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1066,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558470+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:59:44.558470+0000","last_peered":"2024-03-04T06:59:44.558470+0000","last_clean":"2024-03-04T06:59:44.558470+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:59:44.558470+0000","last_undegraded":"2024-03-04T06:59:44.558470+0000","last_fullsized":"2024-03-04T06:59:44.558470+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239534+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:59:08.239534+0000","last_peered":"2024-03-04T06:59:08.239534+0000","last_clean":"2024-03-04T06:59:08.239534+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:59:08.239534+0000","last_undegraded":"2024-03-04T06:59:08.239534+0000","last_fullsized":"2024-03-04T06:59:08.239534+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239472+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:59:08.239472+0000","last_peered":"2024-03-04T06:59:08.239472+0000","last_clean":"2024-03-04T06:59:08.239472+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:59:08.239472+0000","last_undegraded":"2024-03-04T06:59:08.239472+0000","last_fullsized":"2024-03-04T06:59:08.239472+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:22.636361+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T07:00:22.636361+0000","last_peered":"2024-03-04T07:00:22.636361+0000","last_clean":"2024-03-04T07:00:22.636361+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T07:00:22.636361+0000","last_undegraded":"2024-03-04T07:00:22.636361+0000","last_fullsized":"2024-03-04T07:00:22.636361+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014730+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:59:50.014730+0000","last_peered":"2024-03-04T06:59:50.014730+0000","last_clean":"2024-03-04T06:59:50.014730+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:59:50.014730+0000","last_undegraded":"2024-03-04T06:59:50.014730+0000","last_fullsized":"2024-03-04T06:59:50.014730+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015553+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:59:58.015553+0000","last_peered":"2024-03-04T06:59:58.015553+0000","last_clean":"2024-03-04T06:59:58.015553+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:59:58.015553+0000","last_undegraded":"2024-03-04T06:59:58.015553+0000","last_fullsized":"2024-03-04T06:59:58.015553+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174897+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T07:00:33.174897+0000","last_peered":"2024-03-04T07:00:33.174897+0000","last_clean":"2024-03-04T07:00:33.174897+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T07:00:33.174897+0000","last_undegraded":"2024-03-04T07:00:33.174897+0000","last_fullsized":"2024-03-04T07:00:33.174897+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970309+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T07:00:32.970309+0000","last_peered":"2024-03-04T07:00:32.970309+0000","last_clean":"2024-03-04T07:00:32.970309+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T07:00:32.970309+0000","last_undegraded":"2024-03-04T07:00:32.970309+0000","last_fullsized":"2024-03-04T07:00:32.970309+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970400+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T07:00:32.970400+0000","last_peered":"2024-03-04T07:00:32.970400+0000","last_clean":"2024-03-04T07:00:32.970400+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T07:00:32.970400+0000","last_undegraded":"2024-03-04T07:00:32.970400+0000","last_fullsized":"2024-03-04T07:00:32.970400+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397463+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T06:58:48.397463+0000","last_peered":"2024-03-04T06:58:48.397463+0000","last_clean":"2024-03-04T06:58:48.397463+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T06:58:48.397463+0000","last_undegraded":"2024-03-04T06:58:48.397463+0000","last_fullsized":"2024-03-04T06:58:48.397463+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T06:59:04.553588+0000","last_peered":"2024-03-04T06:59:04.553588+0000","last_clean":"2024-03-04T06:59:04.553588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T06:59:04.553588+0000","last_undegraded":"2024-03-04T06:59:04.553588+0000","last_fullsized":"2024-03-04T06:59:04.553588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1307,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019623+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T07:00:33.019623+0000","last_peered":"2024-03-04T07:00:33.019623+0000","last_clean":"2024-03-04T07:00:33.019623+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T07:00:33.019623+0000","last_undegraded":"2024-03-04T07:00:33.019623+0000","last_fullsized":"2024-03-04T07:00:33.019623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014206+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:59:45.014206+0000","last_peered":"2024-03-04T06:59:45.014206+0000","last_clean":"2024-03-04T06:59:45.014206+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:59:45.014206+0000","last_undegraded":"2024-03-04T06:59:45.014206+0000","last_fullsized":"2024-03-04T06:59:45.014206+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014216+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:59:45.014216+0000","last_peered":"2024-03-04T06:59:45.014216+0000","last_clean":"2024-03-04T06:59:45.014216+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:59:45.014216+0000","last_undegraded":"2024-03-04T06:59:45.014216+0000","last_fullsized":"2024-03-04T06:59:45.014216+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019611+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T07:00:33.019611+0000","last_peered":"2024-03-04T07:00:33.019611+0000","last_clean":"2024-03-04T07:00:33.019611+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T07:00:33.019611+0000","last_undegraded":"2024-03-04T07:00:33.019611+0000","last_fullsized":"2024-03-04T07:00:33.019611+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403128+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:59:38.403128+0000","last_peered":"2024-03-04T06:59:38.403128+0000","last_clean":"2024-03-04T06:59:38.403128+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:59:38.403128+0000","last_undegraded":"2024-03-04T06:59:38.403128+0000","last_fullsized":"2024-03-04T06:59:38.403128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1223,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403103+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:59:38.403103+0000","last_peered":"2024-03-04T06:59:38.403103+0000","last_clean":"2024-03-04T06:59:38.403103+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:59:38.403103+0000","last_undegraded":"2024-03-04T06:59:38.403103+0000","last_fullsized":"2024-03-04T06:59:38.403103+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560965+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T07:00:04.560965+0000","last_peered":"2024-03-04T07:00:04.560965+0000","last_clean":"2024-03-04T07:00:04.560965+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T07:00:04.560965+0000","last_undegraded":"2024-03-04T07:00:04.560965+0000","last_fullsized":"2024-03-04T07:00:04.560965+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958870+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:58:52.958870+0000","last_peered":"2024-03-04T06:58:52.958870+0000","last_clean":"2024-03-04T06:58:52.958870+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:58:52.958870+0000","last_undegraded":"2024-03-04T06:58:52.958870+0000","last_fullsized":"2024-03-04T06:58:52.958870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017274+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T07:00:15.017274+0000","last_peered":"2024-03-04T07:00:15.017274+0000","last_clean":"2024-03-04T07:00:15.017274+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T07:00:15.017274+0000","last_undegraded":"2024-03-04T07:00:15.017274+0000","last_fullsized":"2024-03-04T07:00:15.017274+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1191,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639127+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T07:00:47.639127+0000","last_peered":"2024-03-04T07:00:47.639127+0000","last_clean":"2024-03-04T07:00:47.639127+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T07:00:47.639127+0000","last_undegraded":"2024-03-04T07:00:47.639127+0000","last_fullsized":"2024-03-04T07:00:47.639127+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.241598+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:59:28.241598+0000","last_peered":"2024-03-04T06:59:28.241598+0000","last_clean":"2024-03-04T06:59:28.241598+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:59:28.241598+0000","last_undegraded":"2024-03-04T06:59:28.241598+0000","last_fullsized":"2024-03-04T06:59:28.241598+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1297,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:28.006622+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T06:58:28.006622+0000","last_peered":"2024-03-04T06:58:28.006622+0000","last_clean":"2024-03-04T06:58:28.006622+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T06:58:28.006622+0000","last_undegraded":"2024-03-04T06:58:28.006622+0000","last_fullsized":"2024-03-04T06:58:28.006622+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014712+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:59:50.014712+0000","last_peered":"2024-03-04T06:59:50.014712+0000","last_clean":"2024-03-04T06:59:50.014712+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:59:50.014712+0000","last_undegraded":"2024-03-04T06:59:50.014712+0000","last_fullsized":"2024-03-04T06:59:50.014712+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014675+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:59:50.014675+0000","last_peered":"2024-03-04T06:59:50.014675+0000","last_clean":"2024-03-04T06:59:50.014675+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:59:50.014675+0000","last_undegraded":"2024-03-04T06:59:50.014675+0000","last_fullsized":"2024-03-04T06:59:50.014675+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956356+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T06:58:32.956356+0000","last_peered":"2024-03-04T06:58:32.956356+0000","last_clean":"2024-03-04T06:58:32.956356+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T06:58:32.956356+0000","last_undegraded":"2024-03-04T06:58:32.956356+0000","last_fullsized":"2024-03-04T06:58:32.956356+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1264,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162696+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T06:58:38.162696+0000","last_peered":"2024-03-04T06:58:38.162696+0000","last_clean":"2024-03-04T06:58:38.162696+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T06:58:38.162696+0000","last_undegraded":"2024-03-04T06:58:38.162696+0000","last_fullsized":"2024-03-04T06:58:38.162696+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239549+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:59:08.239549+0000","last_peered":"2024-03-04T06:59:08.239549+0000","last_clean":"2024-03-04T06:59:08.239549+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:59:08.239549+0000","last_undegraded":"2024-03-04T06:59:08.239549+0000","last_fullsized":"2024-03-04T06:59:08.239549+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1112,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956414+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T06:58:32.956414+0000","last_peered":"2024-03-04T06:58:32.956414+0000","last_clean":"2024-03-04T06:58:32.956414+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T06:58:32.956414+0000","last_undegraded":"2024-03-04T06:58:32.956414+0000","last_fullsized":"2024-03-04T06:58:32.956414+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:32.956402+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T06:58:32.956402+0000","last_peered":"2024-03-04T06:58:32.956402+0000","last_clean":"2024-03-04T06:58:32.956402+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T06:58:32.956402+0000","last_undegraded":"2024-03-04T06:58:32.956402+0000","last_fullsized":"2024-03-04T06:58:32.956402+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:28.018729+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T07:00:28.018729+0000","last_peered":"2024-03-04T07:00:28.018729+0000","last_clean":"2024-03-04T07:00:28.018729+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T07:00:28.018729+0000","last_undegraded":"2024-03-04T07:00:28.018729+0000","last_fullsized":"2024-03-04T07:00:28.018729+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:38.162740+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T06:58:38.162740+0000","last_peered":"2024-03-04T06:58:38.162740+0000","last_clean":"2024-03-04T06:58:38.162740+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T06:58:38.162740+0000","last_undegraded":"2024-03-04T06:58:38.162740+0000","last_fullsized":"2024-03-04T06:58:38.162740+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:57.633964+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:59:57.633964+0000","last_peered":"2024-03-04T06:59:57.633964+0000","last_clean":"2024-03-04T06:59:57.633964+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:59:57.633964+0000","last_undegraded":"2024-03-04T06:59:57.633964+0000","last_fullsized":"2024-03-04T06:59:57.633964+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1131,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237167+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T06:58:48.237167+0000","last_peered":"2024-03-04T06:58:48.237167+0000","last_clean":"2024-03-04T06:58:48.237167+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T06:58:48.237167+0000","last_undegraded":"2024-03-04T06:58:48.237167+0000","last_fullsized":"2024-03-04T06:58:48.237167+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558443+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:59:44.558443+0000","last_peered":"2024-03-04T06:59:44.558443+0000","last_clean":"2024-03-04T06:59:44.558443+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:59:44.558443+0000","last_undegraded":"2024-03-04T06:59:44.558443+0000","last_fullsized":"2024-03-04T06:59:44.558443+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015596+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:59:58.015596+0000","last_peered":"2024-03-04T06:59:58.015596+0000","last_clean":"2024-03-04T06:59:58.015596+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:59:58.015596+0000","last_undegraded":"2024-03-04T06:59:58.015596+0000","last_fullsized":"2024-03-04T06:59:58.015596+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397438+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T06:58:48.397438+0000","last_peered":"2024-03-04T06:58:48.397438+0000","last_clean":"2024-03-04T06:58:48.397438+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T06:58:48.397438+0000","last_undegraded":"2024-03-04T06:58:48.397438+0000","last_fullsized":"2024-03-04T06:58:48.397438+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970340+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T07:00:32.970340+0000","last_peered":"2024-03-04T07:00:32.970340+0000","last_clean":"2024-03-04T07:00:32.970340+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T07:00:32.970340+0000","last_undegraded":"2024-03-04T07:00:32.970340+0000","last_fullsized":"2024-03-04T07:00:32.970340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555834+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:59:24.555834+0000","last_peered":"2024-03-04T06:59:24.555834+0000","last_clean":"2024-03-04T06:59:24.555834+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:59:24.555834+0000","last_undegraded":"2024-03-04T06:59:24.555834+0000","last_fullsized":"2024-03-04T06:59:24.555834+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237147+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T06:58:48.237147+0000","last_peered":"2024-03-04T06:58:48.237147+0000","last_clean":"2024-03-04T06:58:48.237147+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T06:58:48.237147+0000","last_undegraded":"2024-03-04T06:58:48.237147+0000","last_fullsized":"2024-03-04T06:58:48.237147+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.237122+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T06:58:48.237122+0000","last_peered":"2024-03-04T06:58:48.237122+0000","last_clean":"2024-03-04T06:58:48.237122+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T06:58:48.237122+0000","last_undegraded":"2024-03-04T06:58:48.237122+0000","last_fullsized":"2024-03-04T06:58:48.237122+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1254,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:48.397404+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T06:58:48.397404+0000","last_peered":"2024-03-04T06:58:48.397404+0000","last_clean":"2024-03-04T06:58:48.397404+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T06:58:48.397404+0000","last_undegraded":"2024-03-04T06:58:48.397404+0000","last_fullsized":"2024-03-04T06:58:48.397404+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555799+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:59:24.555799+0000","last_peered":"2024-03-04T06:59:24.555799+0000","last_clean":"2024-03-04T06:59:24.555799+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:59:24.555799+0000","last_undegraded":"2024-03-04T06:59:24.555799+0000","last_fullsized":"2024-03-04T06:59:24.555799+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3579,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405911+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:00:08.405911+0000","last_peered":"2024-03-04T07:00:08.405911+0000","last_clean":"2024-03-04T07:00:08.405911+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:00:08.405911+0000","last_undegraded":"2024-03-04T07:00:08.405911+0000","last_fullsized":"2024-03-04T07:00:08.405911+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:32.631361+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:59:32.631361+0000","last_peered":"2024-03-04T06:59:32.631361+0000","last_clean":"2024-03-04T06:59:32.631361+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:59:32.631361+0000","last_undegraded":"2024-03-04T06:59:32.631361+0000","last_fullsized":"2024-03-04T06:59:32.631361+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553616+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T06:59:04.553616+0000","last_peered":"2024-03-04T06:59:04.553616+0000","last_clean":"2024-03-04T06:59:04.553616+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T06:59:04.553616+0000","last_undegraded":"2024-03-04T06:59:04.553616+0000","last_fullsized":"2024-03-04T06:59:04.553616+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17118,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019514+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T07:00:33.019514+0000","last_peered":"2024-03-04T07:00:33.019514+0000","last_clean":"2024-03-04T07:00:33.019514+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T07:00:33.019514+0000","last_undegraded":"2024-03-04T07:00:33.019514+0000","last_fullsized":"2024-03-04T07:00:33.019514+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178538+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T07:01:08.178538+0000","last_peered":"2024-03-04T07:01:08.178538+0000","last_clean":"2024-03-04T07:01:08.178538+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T07:01:08.178538+0000","last_undegraded":"2024-03-04T07:01:08.178538+0000","last_fullsized":"2024-03-04T07:01:08.178538+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178614+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T07:01:08.178614+0000","last_peered":"2024-03-04T07:01:08.178614+0000","last_clean":"2024-03-04T07:01:08.178614+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T07:01:08.178614+0000","last_undegraded":"2024-03-04T07:01:08.178614+0000","last_fullsized":"2024-03-04T07:01:08.178614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962033+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T06:59:17.962033+0000","last_peered":"2024-03-04T06:59:17.962033+0000","last_clean":"2024-03-04T06:59:17.962033+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T06:59:17.962033+0000","last_undegraded":"2024-03-04T06:59:17.962033+0000","last_fullsized":"2024-03-04T06:59:17.962033+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4388,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019581+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T07:00:33.019581+0000","last_peered":"2024-03-04T07:00:33.019581+0000","last_clean":"2024-03-04T07:00:33.019581+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T07:00:33.019581+0000","last_undegraded":"2024-03-04T07:00:33.019581+0000","last_fullsized":"2024-03-04T07:00:33.019581+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178564+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T07:01:08.178564+0000","last_peered":"2024-03-04T07:01:08.178564+0000","last_clean":"2024-03-04T07:01:08.178564+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T07:01:08.178564+0000","last_undegraded":"2024-03-04T07:01:08.178564+0000","last_fullsized":"2024-03-04T07:01:08.178564+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1114,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.961943+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T06:59:17.961943+0000","last_peered":"2024-03-04T06:59:17.961943+0000","last_clean":"2024-03-04T06:59:17.961943+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T06:59:17.961943+0000","last_undegraded":"2024-03-04T06:59:17.961943+0000","last_fullsized":"2024-03-04T06:59:17.961943+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639139+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T07:00:47.639139+0000","last_peered":"2024-03-04T07:00:47.639139+0000","last_clean":"2024-03-04T07:00:47.639139+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T07:00:47.639139+0000","last_undegraded":"2024-03-04T07:00:47.639139+0000","last_fullsized":"2024-03-04T07:00:47.639139+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5641,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.406020+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:00:08.406020+0000","last_peered":"2024-03-04T07:00:08.406020+0000","last_clean":"2024-03-04T07:00:08.406020+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:00:08.406020+0000","last_undegraded":"2024-03-04T07:00:08.406020+0000","last_fullsized":"2024-03-04T07:00:08.406020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1257,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168065+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:59:33.168065+0000","last_peered":"2024-03-04T06:59:33.168065+0000","last_clean":"2024-03-04T06:59:33.168065+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:59:33.168065+0000","last_undegraded":"2024-03-04T06:59:33.168065+0000","last_fullsized":"2024-03-04T06:59:33.168065+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174867+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T07:00:33.174867+0000","last_peered":"2024-03-04T07:00:33.174867+0000","last_clean":"2024-03-04T07:00:33.174867+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T07:00:33.174867+0000","last_undegraded":"2024-03-04T07:00:33.174867+0000","last_fullsized":"2024-03-04T07:00:33.174867+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403066+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:59:38.403066+0000","last_peered":"2024-03-04T06:59:38.403066+0000","last_clean":"2024-03-04T06:59:38.403066+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:59:38.403066+0000","last_undegraded":"2024-03-04T06:59:38.403066+0000","last_fullsized":"2024-03-04T06:59:38.403066+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4017,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:29.563935+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T07:00:29.563935+0000","last_peered":"2024-03-04T07:00:29.563935+0000","last_clean":"2024-03-04T07:00:29.563935+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T07:00:29.563935+0000","last_undegraded":"2024-03-04T07:00:29.563935+0000","last_fullsized":"2024-03-04T07:00:29.563935+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244731+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:59:53.244731+0000","last_peered":"2024-03-04T06:59:53.244731+0000","last_clean":"2024-03-04T06:59:53.244731+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:59:53.244731+0000","last_undegraded":"2024-03-04T06:59:53.244731+0000","last_fullsized":"2024-03-04T06:59:53.244731+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017258+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T07:00:15.017258+0000","last_peered":"2024-03-04T07:00:15.017258+0000","last_clean":"2024-03-04T07:00:15.017258+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T07:00:15.017258+0000","last_undegraded":"2024-03-04T07:00:15.017258+0000","last_fullsized":"2024-03-04T07:00:15.017258+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962020+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T06:59:17.962020+0000","last_peered":"2024-03-04T06:59:17.962020+0000","last_clean":"2024-03-04T06:59:17.962020+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T06:59:17.962020+0000","last_undegraded":"2024-03-04T06:59:17.962020+0000","last_fullsized":"2024-03-04T06:59:17.962020+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1552,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560890+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:00:04.560890+0000","last_peered":"2024-03-04T07:00:04.560890+0000","last_clean":"2024-03-04T07:00:04.560890+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:00:04.560890+0000","last_undegraded":"2024-03-04T07:00:04.560890+0000","last_fullsized":"2024-03-04T07:00:04.560890+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3952,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.965034+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:59:42.965034+0000","last_peered":"2024-03-04T06:59:42.965034+0000","last_clean":"2024-03-04T06:59:42.965034+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:59:42.965034+0000","last_undegraded":"2024-03-04T06:59:42.965034+0000","last_fullsized":"2024-03-04T06:59:42.965034+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023391+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T07:01:08.023391+0000","last_peered":"2024-03-04T07:01:08.023391+0000","last_clean":"2024-03-04T07:01:08.023391+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T07:01:08.023391+0000","last_undegraded":"2024-03-04T07:01:08.023391+0000","last_fullsized":"2024-03-04T07:01:08.023391+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403043+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:59:38.403043+0000","last_peered":"2024-03-04T06:59:38.403043+0000","last_clean":"2024-03-04T06:59:38.403043+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:59:38.403043+0000","last_undegraded":"2024-03-04T06:59:38.403043+0000","last_fullsized":"2024-03-04T06:59:38.403043+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560852+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:00:04.560852+0000","last_peered":"2024-03-04T07:00:04.560852+0000","last_clean":"2024-03-04T07:00:04.560852+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:00:04.560852+0000","last_undegraded":"2024-03-04T07:00:04.560852+0000","last_fullsized":"2024-03-04T07:00:04.560852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15293,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:53.244696+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:59:53.244696+0000","last_peered":"2024-03-04T06:59:53.244696+0000","last_clean":"2024-03-04T06:59:53.244696+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:59:53.244696+0000","last_undegraded":"2024-03-04T06:59:53.244696+0000","last_fullsized":"2024-03-04T06:59:53.244696+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019541+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T07:00:33.019541+0000","last_peered":"2024-03-04T07:00:33.019541+0000","last_clean":"2024-03-04T07:00:33.019541+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T07:00:33.019541+0000","last_undegraded":"2024-03-04T07:00:33.019541+0000","last_fullsized":"2024-03-04T07:00:33.019541+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1075,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.563983+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T07:00:29.563983+0000","last_peered":"2024-03-04T07:00:29.563983+0000","last_clean":"2024-03-04T07:00:29.563983+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T07:00:29.563983+0000","last_undegraded":"2024-03-04T07:00:29.563983+0000","last_fullsized":"2024-03-04T07:00:29.563983+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178580+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T07:01:08.178580+0000","last_peered":"2024-03-04T07:01:08.178580+0000","last_clean":"2024-03-04T07:01:08.178580+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T07:01:08.178580+0000","last_undegraded":"2024-03-04T07:01:08.178580+0000","last_fullsized":"2024-03-04T07:01:08.178580+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4381,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:47.639101+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T07:00:47.639101+0000","last_peered":"2024-03-04T07:00:47.639101+0000","last_clean":"2024-03-04T07:00:47.639101+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T07:00:47.639101+0000","last_undegraded":"2024-03-04T07:00:47.639101+0000","last_fullsized":"2024-03-04T07:00:47.639101+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014181+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:59:45.014181+0000","last_peered":"2024-03-04T06:59:45.014181+0000","last_clean":"2024-03-04T06:59:45.014181+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:59:45.014181+0000","last_undegraded":"2024-03-04T06:59:45.014181+0000","last_fullsized":"2024-03-04T06:59:45.014181+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1270,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168056+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:59:33.168056+0000","last_peered":"2024-03-04T06:59:33.168056+0000","last_clean":"2024-03-04T06:59:33.168056+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:59:33.168056+0000","last_undegraded":"2024-03-04T06:59:33.168056+0000","last_fullsized":"2024-03-04T06:59:33.168056+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020800+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T07:00:45.020800+0000","last_peered":"2024-03-04T07:00:45.020800+0000","last_clean":"2024-03-04T07:00:45.020800+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T07:00:45.020800+0000","last_undegraded":"2024-03-04T07:00:45.020800+0000","last_fullsized":"2024-03-04T07:00:45.020800+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4611,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:45.014149+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:59:45.014149+0000","last_peered":"2024-03-04T06:59:45.014149+0000","last_clean":"2024-03-04T06:59:45.014149+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:59:45.014149+0000","last_undegraded":"2024-03-04T06:59:45.014149+0000","last_fullsized":"2024-03-04T06:59:45.014149+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639077+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T07:00:47.639077+0000","last_peered":"2024-03-04T07:00:47.639077+0000","last_clean":"2024-03-04T07:00:47.639077+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T07:00:47.639077+0000","last_undegraded":"2024-03-04T07:00:47.639077+0000","last_fullsized":"2024-03-04T07:00:47.639077+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1080,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247864+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T07:00:18.247864+0000","last_peered":"2024-03-04T07:00:18.247864+0000","last_clean":"2024-03-04T07:00:18.247864+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T07:00:18.247864+0000","last_undegraded":"2024-03-04T07:00:18.247864+0000","last_fullsized":"2024-03-04T07:00:18.247864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023341+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T07:01:08.023341+0000","last_peered":"2024-03-04T07:01:08.023341+0000","last_clean":"2024-03-04T07:01:08.023341+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T07:01:08.023341+0000","last_undegraded":"2024-03-04T07:01:08.023341+0000","last_fullsized":"2024-03-04T07:01:08.023341+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4636,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:07.967606+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T07:00:07.967606+0000","last_peered":"2024-03-04T07:00:07.967606+0000","last_clean":"2024-03-04T07:00:07.967606+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T07:00:07.967606+0000","last_undegraded":"2024-03-04T07:00:07.967606+0000","last_fullsized":"2024-03-04T07:00:07.967606+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:54.566566+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T07:00:54.566566+0000","last_peered":"2024-03-04T07:00:54.566566+0000","last_clean":"2024-03-04T07:00:54.566566+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T07:00:54.566566+0000","last_undegraded":"2024-03-04T07:00:54.566566+0000","last_fullsized":"2024-03-04T07:00:54.566566+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1186,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:07.628352+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T06:59:07.628352+0000","last_peered":"2024-03-04T06:59:07.628352+0000","last_clean":"2024-03-04T06:59:07.628352+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T06:59:07.628352+0000","last_undegraded":"2024-03-04T06:59:07.628352+0000","last_fullsized":"2024-03-04T06:59:07.628352+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5159,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:32.631317+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:59:32.631317+0000","last_peered":"2024-03-04T06:59:32.631317+0000","last_clean":"2024-03-04T06:59:32.631317+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:59:32.631317+0000","last_undegraded":"2024-03-04T06:59:32.631317+0000","last_fullsized":"2024-03-04T06:59:32.631317+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.167981+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:59:33.167981+0000","last_peered":"2024-03-04T06:59:33.167981+0000","last_clean":"2024-03-04T06:59:33.167981+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:59:33.167981+0000","last_undegraded":"2024-03-04T06:59:33.167981+0000","last_fullsized":"2024-03-04T06:59:33.167981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020733+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T07:00:45.020733+0000","last_peered":"2024-03-04T07:00:45.020733+0000","last_clean":"2024-03-04T07:00:45.020733+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T07:00:45.020733+0000","last_undegraded":"2024-03-04T07:00:45.020733+0000","last_fullsized":"2024-03-04T07:00:45.020733+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4721,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409468+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T07:00:38.409468+0000","last_peered":"2024-03-04T07:00:38.409468+0000","last_clean":"2024-03-04T07:00:38.409468+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T07:00:38.409468+0000","last_undegraded":"2024-03-04T07:00:38.409468+0000","last_fullsized":"2024-03-04T07:00:38.409468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168002+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:59:33.168002+0000","last_peered":"2024-03-04T06:59:33.168002+0000","last_clean":"2024-03-04T06:59:33.168002+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:59:33.168002+0000","last_undegraded":"2024-03-04T06:59:33.168002+0000","last_fullsized":"2024-03-04T06:59:33.168002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009678+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T06:59:00.009678+0000","last_peered":"2024-03-04T06:59:00.009678+0000","last_clean":"2024-03-04T06:59:00.009678+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T06:59:00.009678+0000","last_undegraded":"2024-03-04T06:59:00.009678+0000","last_fullsized":"2024-03-04T06:59:00.009678+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5556,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:03.171266+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:00:03.171266+0000","last_peered":"2024-03-04T07:00:03.171266+0000","last_clean":"2024-03-04T07:00:03.171266+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:00:03.171266+0000","last_undegraded":"2024-03-04T07:00:03.171266+0000","last_fullsized":"2024-03-04T07:00:03.171266+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553540+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T06:59:04.553540+0000","last_peered":"2024-03-04T06:59:04.553540+0000","last_clean":"2024-03-04T06:59:04.553540+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T06:59:04.553540+0000","last_undegraded":"2024-03-04T06:59:04.553540+0000","last_fullsized":"2024-03-04T06:59:04.553540+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247800+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T07:00:18.247800+0000","last_peered":"2024-03-04T07:00:18.247800+0000","last_clean":"2024-03-04T07:00:18.247800+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T07:00:18.247800+0000","last_undegraded":"2024-03-04T07:00:18.247800+0000","last_fullsized":"2024-03-04T07:00:18.247800+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409421+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T07:00:38.409421+0000","last_peered":"2024-03-04T07:00:38.409421+0000","last_clean":"2024-03-04T07:00:38.409421+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T07:00:38.409421+0000","last_undegraded":"2024-03-04T07:00:38.409421+0000","last_fullsized":"2024-03-04T07:00:38.409421+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409457+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T07:00:38.409457+0000","last_peered":"2024-03-04T07:00:38.409457+0000","last_clean":"2024-03-04T07:00:38.409457+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T07:00:38.409457+0000","last_undegraded":"2024-03-04T07:00:38.409457+0000","last_fullsized":"2024-03-04T07:00:38.409457+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553601+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T06:59:04.553601+0000","last_peered":"2024-03-04T06:59:04.553601+0000","last_clean":"2024-03-04T06:59:04.553601+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T06:59:04.553601+0000","last_undegraded":"2024-03-04T06:59:04.553601+0000","last_fullsized":"2024-03-04T06:59:04.553601+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4368,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405967+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:00:08.405967+0000","last_peered":"2024-03-04T07:00:08.405967+0000","last_clean":"2024-03-04T07:00:08.405967+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:00:08.405967+0000","last_undegraded":"2024-03-04T07:00:08.405967+0000","last_fullsized":"2024-03-04T07:00:08.405967+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:03.171315+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:00:03.171315+0000","last_peered":"2024-03-04T07:00:03.171315+0000","last_clean":"2024-03-04T07:00:03.171315+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:00:03.171315+0000","last_undegraded":"2024-03-04T07:00:03.171315+0000","last_fullsized":"2024-03-04T07:00:03.171315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967580+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T07:00:07.967580+0000","last_peered":"2024-03-04T07:00:07.967580+0000","last_clean":"2024-03-04T07:00:07.967580+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T07:00:07.967580+0000","last_undegraded":"2024-03-04T07:00:07.967580+0000","last_fullsized":"2024-03-04T07:00:07.967580+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4602,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:54.566603+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T07:00:54.566603+0000","last_peered":"2024-03-04T07:00:54.566603+0000","last_clean":"2024-03-04T07:00:54.566603+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T07:00:54.566603+0000","last_undegraded":"2024-03-04T07:00:54.566603+0000","last_fullsized":"2024-03-04T07:00:54.566603+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1247,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409492+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T07:00:38.409492+0000","last_peered":"2024-03-04T07:00:38.409492+0000","last_clean":"2024-03-04T07:00:38.409492+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T07:00:38.409492+0000","last_undegraded":"2024-03-04T07:00:38.409492+0000","last_fullsized":"2024-03-04T07:00:38.409492+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:04.553631+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T06:59:04.553631+0000","last_peered":"2024-03-04T06:59:04.553631+0000","last_clean":"2024-03-04T06:59:04.553631+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T06:59:04.553631+0000","last_undegraded":"2024-03-04T06:59:04.553631+0000","last_fullsized":"2024-03-04T06:59:04.553631+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244661+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:59:53.244661+0000","last_peered":"2024-03-04T06:59:53.244661+0000","last_clean":"2024-03-04T06:59:53.244661+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:59:53.244661+0000","last_undegraded":"2024-03-04T06:59:53.244661+0000","last_fullsized":"2024-03-04T06:59:53.244661+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403075+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:59:38.403075+0000","last_peered":"2024-03-04T06:59:38.403075+0000","last_clean":"2024-03-04T06:59:38.403075+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:59:38.403075+0000","last_undegraded":"2024-03-04T06:59:38.403075+0000","last_fullsized":"2024-03-04T06:59:38.403075+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:17.962003+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T06:59:17.962003+0000","last_peered":"2024-03-04T06:59:17.962003+0000","last_clean":"2024-03-04T06:59:17.962003+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T06:59:17.962003+0000","last_undegraded":"2024-03-04T06:59:17.962003+0000","last_fullsized":"2024-03-04T06:59:17.962003+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019487+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T07:00:33.019487+0000","last_peered":"2024-03-04T07:00:33.019487+0000","last_clean":"2024-03-04T07:00:33.019487+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T07:00:33.019487+0000","last_undegraded":"2024-03-04T07:00:33.019487+0000","last_fullsized":"2024-03-04T07:00:33.019487+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020779+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T07:00:45.020779+0000","last_peered":"2024-03-04T07:00:45.020779+0000","last_clean":"2024-03-04T07:00:45.020779+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T07:00:45.020779+0000","last_undegraded":"2024-03-04T07:00:45.020779+0000","last_fullsized":"2024-03-04T07:00:45.020779+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168023+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:59:33.168023+0000","last_peered":"2024-03-04T06:59:33.168023+0000","last_clean":"2024-03-04T06:59:33.168023+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:59:33.168023+0000","last_undegraded":"2024-03-04T06:59:33.168023+0000","last_fullsized":"2024-03-04T06:59:33.168023+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247852+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T07:00:18.247852+0000","last_peered":"2024-03-04T07:00:18.247852+0000","last_clean":"2024-03-04T07:00:18.247852+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T07:00:18.247852+0000","last_undegraded":"2024-03-04T07:00:18.247852+0000","last_fullsized":"2024-03-04T07:00:18.247852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020816+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T07:00:45.020816+0000","last_peered":"2024-03-04T07:00:45.020816+0000","last_clean":"2024-03-04T07:00:45.020816+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T07:00:45.020816+0000","last_undegraded":"2024-03-04T07:00:45.020816+0000","last_fullsized":"2024-03-04T07:00:45.020816+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.964990+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:59:42.964990+0000","last_peered":"2024-03-04T06:59:42.964990+0000","last_clean":"2024-03-04T06:59:42.964990+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:59:42.964990+0000","last_undegraded":"2024-03-04T06:59:42.964990+0000","last_fullsized":"2024-03-04T06:59:42.964990+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:00.009646+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T06:59:00.009646+0000","last_peered":"2024-03-04T06:59:00.009646+0000","last_clean":"2024-03-04T06:59:00.009646+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T06:59:00.009646+0000","last_undegraded":"2024-03-04T06:59:00.009646+0000","last_fullsized":"2024-03-04T06:59:00.009646+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1122,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967529+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T07:00:07.967529+0000","last_peered":"2024-03-04T07:00:07.967529+0000","last_clean":"2024-03-04T07:00:07.967529+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T07:00:07.967529+0000","last_undegraded":"2024-03-04T07:00:07.967529+0000","last_fullsized":"2024-03-04T07:00:07.967529+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.012471+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:59:28.012471+0000","last_peered":"2024-03-04T06:59:28.012471+0000","last_clean":"2024-03-04T06:59:28.012471+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:59:28.012471+0000","last_undegraded":"2024-03-04T06:59:28.012471+0000","last_fullsized":"2024-03-04T06:59:28.012471+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:43.250705+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T07:00:43.250705+0000","last_peered":"2024-03-04T07:00:43.250705+0000","last_clean":"2024-03-04T07:00:43.250705+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T07:00:43.250705+0000","last_undegraded":"2024-03-04T07:00:43.250705+0000","last_fullsized":"2024-03-04T07:00:43.250705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503520,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648167,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142474,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287121,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997827,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885884,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937462,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792814,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:03:24.156 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:24.157 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:24.157 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:24.157 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:24.157 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:24.157 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:24.157 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:24.157 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:24.157 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:24.157 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:24.157 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:03:24.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:24 smithi137 ceph-mon[88869]: pgmap v1166: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:24.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:24 smithi137 ceph-mon[91314]: pgmap v1166: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:24.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:24 smithi203 ceph-mon[85573]: pgmap v1166: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:25.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:25 smithi137 ceph-mon[88869]: from='client.34725 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:03:25.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:25 smithi137 ceph-mon[91314]: from='client.34725 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:03:25.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:03:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:03:25] "GET /metrics HTTP/1.1" 200 36337 "" "Prometheus/2.43.0" 2024-03-04T07:03:25.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:25 smithi203 ceph-mon[85573]: from='client.34725 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:03:26.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:26 smithi137 ceph-mon[88869]: pgmap v1167: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:26.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:26 smithi137 ceph-mon[91314]: pgmap v1167: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:26.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:26 smithi203 ceph-mon[85573]: pgmap v1167: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:28.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:28 smithi137 ceph-mon[88869]: pgmap v1168: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:28.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:28 smithi137 ceph-mon[91314]: pgmap v1168: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:28.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:28 smithi203 ceph-mon[85573]: pgmap v1168: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:30.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:30 smithi137 ceph-mon[88869]: pgmap v1169: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:30.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:30 smithi137 ceph-mon[91314]: pgmap v1169: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:30.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:30 smithi203 ceph-mon[85573]: pgmap v1169: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:32.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:32 smithi137 ceph-mon[91314]: pgmap v1170: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:32.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:32 smithi137 ceph-mon[88869]: pgmap v1170: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:32.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:32 smithi203 ceph-mon[85573]: pgmap v1170: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:34.158 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:03:34.379 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:03:34.764 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:34 smithi137 ceph-mon[88869]: pgmap v1171: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:34.764 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:34 smithi137 ceph-mon[91314]: pgmap v1171: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:34.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:34 smithi203 ceph-mon[85573]: pgmap v1171: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:35.682 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:03:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:03:35] "GET /metrics HTTP/1.1" 200 36337 "" "Prometheus/2.43.0" 2024-03-04T07:03:36.201 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:03:36.203 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:03:36.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:36 smithi137 ceph-mon[88869]: pgmap v1172: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:36.495 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:36 smithi137 ceph-mon[91314]: pgmap v1172: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:36.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:36 smithi203 ceph-mon[85573]: pgmap v1172: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:36.891 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1172,"stamp":"2024-03-04T07:03:34.614663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003653"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.564000+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T07:00:29.564000+0000","last_peered":"2024-03-04T07:00:29.564000+0000","last_clean":"2024-03-04T07:00:29.564000+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T07:00:29.564000+0000","last_undegraded":"2024-03-04T07:00:29.564000+0000","last_fullsized":"2024-03-04T07:00:29.564000+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178667+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T07:01:08.178667+0000","last_peered":"2024-03-04T07:01:08.178667+0000","last_clean":"2024-03-04T07:01:08.178667+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T07:01:08.178667+0000","last_undegraded":"2024-03-04T07:01:08.178667+0000","last_fullsized":"2024-03-04T07:01:08.178667+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019562+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T07:00:33.019562+0000","last_peered":"2024-03-04T07:00:33.019562+0000","last_clean":"2024-03-04T07:00:33.019562+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T07:00:33.019562+0000","last_undegraded":"2024-03-04T07:00:33.019562+0000","last_fullsized":"2024-03-04T07:00:33.019562+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1143,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:52.972434+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T07:00:52.972434+0000","last_peered":"2024-03-04T07:00:52.972434+0000","last_clean":"2024-03-04T07:00:52.972434+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T07:00:52.972434+0000","last_undegraded":"2024-03-04T07:00:52.972434+0000","last_fullsized":"2024-03-04T07:00:52.972434+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560949+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T07:00:04.560949+0000","last_peered":"2024-03-04T07:00:04.560949+0000","last_clean":"2024-03-04T07:00:04.560949+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T07:00:04.560949+0000","last_undegraded":"2024-03-04T07:00:04.560949+0000","last_fullsized":"2024-03-04T07:00:04.560949+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958813+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:58:52.958813+0000","last_peered":"2024-03-04T06:58:52.958813+0000","last_clean":"2024-03-04T06:58:52.958813+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:58:52.958813+0000","last_undegraded":"2024-03-04T06:58:52.958813+0000","last_fullsized":"2024-03-04T06:58:52.958813+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560930+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T07:00:04.560930+0000","last_peered":"2024-03-04T07:00:04.560930+0000","last_clean":"2024-03-04T07:00:04.560930+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T07:00:04.560930+0000","last_undegraded":"2024-03-04T07:00:04.560930+0000","last_fullsized":"2024-03-04T07:00:04.560930+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017220+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T07:00:15.017220+0000","last_peered":"2024-03-04T07:00:15.017220+0000","last_clean":"2024-03-04T07:00:15.017220+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T07:00:15.017220+0000","last_undegraded":"2024-03-04T07:00:15.017220+0000","last_fullsized":"2024-03-04T07:00:15.017220+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1066,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558470+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:59:44.558470+0000","last_peered":"2024-03-04T06:59:44.558470+0000","last_clean":"2024-03-04T06:59:44.558470+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:59:44.558470+0000","last_undegraded":"2024-03-04T06:59:44.558470+0000","last_fullsized":"2024-03-04T06:59:44.558470+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239534+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:59:08.239534+0000","last_peered":"2024-03-04T06:59:08.239534+0000","last_clean":"2024-03-04T06:59:08.239534+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:59:08.239534+0000","last_undegraded":"2024-03-04T06:59:08.239534+0000","last_fullsized":"2024-03-04T06:59:08.239534+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239472+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:59:08.239472+0000","last_peered":"2024-03-04T06:59:08.239472+0000","last_clean":"2024-03-04T06:59:08.239472+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:59:08.239472+0000","last_undegraded":"2024-03-04T06:59:08.239472+0000","last_fullsized":"2024-03-04T06:59:08.239472+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:22.636361+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T07:00:22.636361+0000","last_peered":"2024-03-04T07:00:22.636361+0000","last_clean":"2024-03-04T07:00:22.636361+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T07:00:22.636361+0000","last_undegraded":"2024-03-04T07:00:22.636361+0000","last_fullsized":"2024-03-04T07:00:22.636361+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014730+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:59:50.014730+0000","last_peered":"2024-03-04T06:59:50.014730+0000","last_clean":"2024-03-04T06:59:50.014730+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:59:50.014730+0000","last_undegraded":"2024-03-04T06:59:50.014730+0000","last_fullsized":"2024-03-04T06:59:50.014730+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015553+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:59:58.015553+0000","last_peered":"2024-03-04T06:59:58.015553+0000","last_clean":"2024-03-04T06:59:58.015553+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:59:58.015553+0000","last_undegraded":"2024-03-04T06:59:58.015553+0000","last_fullsized":"2024-03-04T06:59:58.015553+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174897+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T07:00:33.174897+0000","last_peered":"2024-03-04T07:00:33.174897+0000","last_clean":"2024-03-04T07:00:33.174897+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T07:00:33.174897+0000","last_undegraded":"2024-03-04T07:00:33.174897+0000","last_fullsized":"2024-03-04T07:00:33.174897+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970309+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T07:00:32.970309+0000","last_peered":"2024-03-04T07:00:32.970309+0000","last_clean":"2024-03-04T07:00:32.970309+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T07:00:32.970309+0000","last_undegraded":"2024-03-04T07:00:32.970309+0000","last_fullsized":"2024-03-04T07:00:32.970309+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970400+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T07:00:32.970400+0000","last_peered":"2024-03-04T07:00:32.970400+0000","last_clean":"2024-03-04T07:00:32.970400+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T07:00:32.970400+0000","last_undegraded":"2024-03-04T07:00:32.970400+0000","last_fullsized":"2024-03-04T07:00:32.970400+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412366+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T07:01:08.412366+0000","last_peered":"2024-03-04T07:01:08.412366+0000","last_clean":"2024-03-04T07:01:08.412366+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T07:01:08.412366+0000","last_undegraded":"2024-03-04T07:01:08.412366+0000","last_fullsized":"2024-03-04T07:01:08.412366+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T07:01:19.569588+0000","last_peered":"2024-03-04T07:01:19.569588+0000","last_clean":"2024-03-04T07:01:19.569588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T07:01:19.569588+0000","last_undegraded":"2024-03-04T07:01:19.569588+0000","last_fullsized":"2024-03-04T07:01:19.569588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1307,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019623+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T07:00:33.019623+0000","last_peered":"2024-03-04T07:00:33.019623+0000","last_clean":"2024-03-04T07:00:33.019623+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T07:00:33.019623+0000","last_undegraded":"2024-03-04T07:00:33.019623+0000","last_fullsized":"2024-03-04T07:00:33.019623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014206+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T06:59:45.014206+0000","last_peered":"2024-03-04T06:59:45.014206+0000","last_clean":"2024-03-04T06:59:45.014206+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T06:59:45.014206+0000","last_undegraded":"2024-03-04T06:59:45.014206+0000","last_fullsized":"2024-03-04T06:59:45.014206+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014216+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T06:59:45.014216+0000","last_peered":"2024-03-04T06:59:45.014216+0000","last_clean":"2024-03-04T06:59:45.014216+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T06:59:45.014216+0000","last_undegraded":"2024-03-04T06:59:45.014216+0000","last_fullsized":"2024-03-04T06:59:45.014216+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019611+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T07:00:33.019611+0000","last_peered":"2024-03-04T07:00:33.019611+0000","last_clean":"2024-03-04T07:00:33.019611+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T07:00:33.019611+0000","last_undegraded":"2024-03-04T07:00:33.019611+0000","last_fullsized":"2024-03-04T07:00:33.019611+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403128+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:59:38.403128+0000","last_peered":"2024-03-04T06:59:38.403128+0000","last_clean":"2024-03-04T06:59:38.403128+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:59:38.403128+0000","last_undegraded":"2024-03-04T06:59:38.403128+0000","last_fullsized":"2024-03-04T06:59:38.403128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1223,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403103+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:59:38.403103+0000","last_peered":"2024-03-04T06:59:38.403103+0000","last_clean":"2024-03-04T06:59:38.403103+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:59:38.403103+0000","last_undegraded":"2024-03-04T06:59:38.403103+0000","last_fullsized":"2024-03-04T06:59:38.403103+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560965+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T07:00:04.560965+0000","last_peered":"2024-03-04T07:00:04.560965+0000","last_clean":"2024-03-04T07:00:04.560965+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T07:00:04.560965+0000","last_undegraded":"2024-03-04T07:00:04.560965+0000","last_fullsized":"2024-03-04T07:00:04.560965+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958870+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:58:52.958870+0000","last_peered":"2024-03-04T06:58:52.958870+0000","last_clean":"2024-03-04T06:58:52.958870+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:58:52.958870+0000","last_undegraded":"2024-03-04T06:58:52.958870+0000","last_fullsized":"2024-03-04T06:58:52.958870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017274+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T07:00:15.017274+0000","last_peered":"2024-03-04T07:00:15.017274+0000","last_clean":"2024-03-04T07:00:15.017274+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T07:00:15.017274+0000","last_undegraded":"2024-03-04T07:00:15.017274+0000","last_fullsized":"2024-03-04T07:00:15.017274+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1191,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639127+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T07:00:47.639127+0000","last_peered":"2024-03-04T07:00:47.639127+0000","last_clean":"2024-03-04T07:00:47.639127+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T07:00:47.639127+0000","last_undegraded":"2024-03-04T07:00:47.639127+0000","last_fullsized":"2024-03-04T07:00:47.639127+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.241598+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:59:28.241598+0000","last_peered":"2024-03-04T06:59:28.241598+0000","last_clean":"2024-03-04T06:59:28.241598+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:59:28.241598+0000","last_undegraded":"2024-03-04T06:59:28.241598+0000","last_fullsized":"2024-03-04T06:59:28.241598+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:58.022394+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T07:00:58.022394+0000","last_peered":"2024-03-04T07:00:58.022394+0000","last_clean":"2024-03-04T07:00:58.022394+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T07:00:58.022394+0000","last_undegraded":"2024-03-04T07:00:58.022394+0000","last_fullsized":"2024-03-04T07:00:58.022394+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014712+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:59:50.014712+0000","last_peered":"2024-03-04T06:59:50.014712+0000","last_clean":"2024-03-04T06:59:50.014712+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:59:50.014712+0000","last_undegraded":"2024-03-04T06:59:50.014712+0000","last_fullsized":"2024-03-04T06:59:50.014712+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014675+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:59:50.014675+0000","last_peered":"2024-03-04T06:59:50.014675+0000","last_clean":"2024-03-04T06:59:50.014675+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:59:50.014675+0000","last_undegraded":"2024-03-04T06:59:50.014675+0000","last_fullsized":"2024-03-04T06:59:50.014675+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973153+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T07:00:57.973153+0000","last_peered":"2024-03-04T07:00:57.973153+0000","last_clean":"2024-03-04T07:00:57.973153+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T07:00:57.973153+0000","last_undegraded":"2024-03-04T07:00:57.973153+0000","last_fullsized":"2024-03-04T07:00:57.973153+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178000+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T07:01:03.178000+0000","last_peered":"2024-03-04T07:01:03.178000+0000","last_clean":"2024-03-04T07:01:03.178000+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T07:01:03.178000+0000","last_undegraded":"2024-03-04T07:01:03.178000+0000","last_fullsized":"2024-03-04T07:01:03.178000+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239549+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:59:08.239549+0000","last_peered":"2024-03-04T06:59:08.239549+0000","last_clean":"2024-03-04T06:59:08.239549+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:59:08.239549+0000","last_undegraded":"2024-03-04T06:59:08.239549+0000","last_fullsized":"2024-03-04T06:59:08.239549+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973230+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T07:00:57.973230+0000","last_peered":"2024-03-04T07:00:57.973230+0000","last_clean":"2024-03-04T07:00:57.973230+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T07:00:57.973230+0000","last_undegraded":"2024-03-04T07:00:57.973230+0000","last_fullsized":"2024-03-04T07:00:57.973230+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973215+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T07:00:57.973215+0000","last_peered":"2024-03-04T07:00:57.973215+0000","last_clean":"2024-03-04T07:00:57.973215+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T07:00:57.973215+0000","last_undegraded":"2024-03-04T07:00:57.973215+0000","last_fullsized":"2024-03-04T07:00:57.973215+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:28.018729+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T07:00:28.018729+0000","last_peered":"2024-03-04T07:00:28.018729+0000","last_clean":"2024-03-04T07:00:28.018729+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T07:00:28.018729+0000","last_undegraded":"2024-03-04T07:00:28.018729+0000","last_fullsized":"2024-03-04T07:00:28.018729+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178037+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T07:01:03.178037+0000","last_peered":"2024-03-04T07:01:03.178037+0000","last_clean":"2024-03-04T07:01:03.178037+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T07:01:03.178037+0000","last_undegraded":"2024-03-04T07:01:03.178037+0000","last_fullsized":"2024-03-04T07:01:03.178037+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:57.633964+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:59:57.633964+0000","last_peered":"2024-03-04T06:59:57.633964+0000","last_clean":"2024-03-04T06:59:57.633964+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:59:57.633964+0000","last_undegraded":"2024-03-04T06:59:57.633964+0000","last_fullsized":"2024-03-04T06:59:57.633964+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1132,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253574+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T07:01:08.253574+0000","last_peered":"2024-03-04T07:01:08.253574+0000","last_clean":"2024-03-04T07:01:08.253574+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T07:01:08.253574+0000","last_undegraded":"2024-03-04T07:01:08.253574+0000","last_fullsized":"2024-03-04T07:01:08.253574+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558443+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:59:44.558443+0000","last_peered":"2024-03-04T06:59:44.558443+0000","last_clean":"2024-03-04T06:59:44.558443+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:59:44.558443+0000","last_undegraded":"2024-03-04T06:59:44.558443+0000","last_fullsized":"2024-03-04T06:59:44.558443+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015596+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:59:58.015596+0000","last_peered":"2024-03-04T06:59:58.015596+0000","last_clean":"2024-03-04T06:59:58.015596+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:59:58.015596+0000","last_undegraded":"2024-03-04T06:59:58.015596+0000","last_fullsized":"2024-03-04T06:59:58.015596+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412330+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T07:01:08.412330+0000","last_peered":"2024-03-04T07:01:08.412330+0000","last_clean":"2024-03-04T07:01:08.412330+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T07:01:08.412330+0000","last_undegraded":"2024-03-04T07:01:08.412330+0000","last_fullsized":"2024-03-04T07:01:08.412330+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970340+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T07:00:32.970340+0000","last_peered":"2024-03-04T07:00:32.970340+0000","last_clean":"2024-03-04T07:00:32.970340+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T07:00:32.970340+0000","last_undegraded":"2024-03-04T07:00:32.970340+0000","last_fullsized":"2024-03-04T07:00:32.970340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555834+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:59:24.555834+0000","last_peered":"2024-03-04T06:59:24.555834+0000","last_clean":"2024-03-04T06:59:24.555834+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:59:24.555834+0000","last_undegraded":"2024-03-04T06:59:24.555834+0000","last_fullsized":"2024-03-04T06:59:24.555834+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1104,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253553+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T07:01:08.253553+0000","last_peered":"2024-03-04T07:01:08.253553+0000","last_clean":"2024-03-04T07:01:08.253553+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T07:01:08.253553+0000","last_undegraded":"2024-03-04T07:01:08.253553+0000","last_fullsized":"2024-03-04T07:01:08.253553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253528+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T07:01:08.253528+0000","last_peered":"2024-03-04T07:01:08.253528+0000","last_clean":"2024-03-04T07:01:08.253528+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T07:01:08.253528+0000","last_undegraded":"2024-03-04T07:01:08.253528+0000","last_fullsized":"2024-03-04T07:01:08.253528+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412282+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T07:01:08.412282+0000","last_peered":"2024-03-04T07:01:08.412282+0000","last_clean":"2024-03-04T07:01:08.412282+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T07:01:08.412282+0000","last_undegraded":"2024-03-04T07:01:08.412282+0000","last_fullsized":"2024-03-04T07:01:08.412282+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555799+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:59:24.555799+0000","last_peered":"2024-03-04T06:59:24.555799+0000","last_clean":"2024-03-04T06:59:24.555799+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:59:24.555799+0000","last_undegraded":"2024-03-04T06:59:24.555799+0000","last_fullsized":"2024-03-04T06:59:24.555799+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3579,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405911+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:00:08.405911+0000","last_peered":"2024-03-04T07:00:08.405911+0000","last_clean":"2024-03-04T07:00:08.405911+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:00:08.405911+0000","last_undegraded":"2024-03-04T07:00:08.405911+0000","last_fullsized":"2024-03-04T07:00:08.405911+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:32.631361+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:59:32.631361+0000","last_peered":"2024-03-04T06:59:32.631361+0000","last_clean":"2024-03-04T06:59:32.631361+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:59:32.631361+0000","last_undegraded":"2024-03-04T06:59:32.631361+0000","last_fullsized":"2024-03-04T06:59:32.631361+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T07:01:19.569613+0000","last_peered":"2024-03-04T07:01:19.569613+0000","last_clean":"2024-03-04T07:01:19.569613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T07:01:19.569613+0000","last_undegraded":"2024-03-04T07:01:19.569613+0000","last_fullsized":"2024-03-04T07:01:19.569613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17118,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019514+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T07:00:33.019514+0000","last_peered":"2024-03-04T07:00:33.019514+0000","last_clean":"2024-03-04T07:00:33.019514+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T07:00:33.019514+0000","last_undegraded":"2024-03-04T07:00:33.019514+0000","last_fullsized":"2024-03-04T07:00:33.019514+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178538+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T07:01:08.178538+0000","last_peered":"2024-03-04T07:01:08.178538+0000","last_clean":"2024-03-04T07:01:08.178538+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T07:01:08.178538+0000","last_undegraded":"2024-03-04T07:01:08.178538+0000","last_fullsized":"2024-03-04T07:01:08.178538+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178614+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T07:01:08.178614+0000","last_peered":"2024-03-04T07:01:08.178614+0000","last_clean":"2024-03-04T07:01:08.178614+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T07:01:08.178614+0000","last_undegraded":"2024-03-04T07:01:08.178614+0000","last_fullsized":"2024-03-04T07:01:08.178614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976230+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T07:01:22.976230+0000","last_peered":"2024-03-04T07:01:22.976230+0000","last_clean":"2024-03-04T07:01:22.976230+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T07:01:22.976230+0000","last_undegraded":"2024-03-04T07:01:22.976230+0000","last_fullsized":"2024-03-04T07:01:22.976230+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4388,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019581+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T07:00:33.019581+0000","last_peered":"2024-03-04T07:00:33.019581+0000","last_clean":"2024-03-04T07:00:33.019581+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T07:00:33.019581+0000","last_undegraded":"2024-03-04T07:00:33.019581+0000","last_fullsized":"2024-03-04T07:00:33.019581+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178564+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T07:01:08.178564+0000","last_peered":"2024-03-04T07:01:08.178564+0000","last_clean":"2024-03-04T07:01:08.178564+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T07:01:08.178564+0000","last_undegraded":"2024-03-04T07:01:08.178564+0000","last_fullsized":"2024-03-04T07:01:08.178564+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976151+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T07:01:22.976151+0000","last_peered":"2024-03-04T07:01:22.976151+0000","last_clean":"2024-03-04T07:01:22.976151+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T07:01:22.976151+0000","last_undegraded":"2024-03-04T07:01:22.976151+0000","last_fullsized":"2024-03-04T07:01:22.976151+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639139+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T07:00:47.639139+0000","last_peered":"2024-03-04T07:00:47.639139+0000","last_clean":"2024-03-04T07:00:47.639139+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T07:00:47.639139+0000","last_undegraded":"2024-03-04T07:00:47.639139+0000","last_fullsized":"2024-03-04T07:00:47.639139+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5641,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.406020+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:00:08.406020+0000","last_peered":"2024-03-04T07:00:08.406020+0000","last_clean":"2024-03-04T07:00:08.406020+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:00:08.406020+0000","last_undegraded":"2024-03-04T07:00:08.406020+0000","last_fullsized":"2024-03-04T07:00:08.406020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1257,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168065+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:59:33.168065+0000","last_peered":"2024-03-04T06:59:33.168065+0000","last_clean":"2024-03-04T06:59:33.168065+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:59:33.168065+0000","last_undegraded":"2024-03-04T06:59:33.168065+0000","last_fullsized":"2024-03-04T06:59:33.168065+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174867+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T07:00:33.174867+0000","last_peered":"2024-03-04T07:00:33.174867+0000","last_clean":"2024-03-04T07:00:33.174867+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T07:00:33.174867+0000","last_undegraded":"2024-03-04T07:00:33.174867+0000","last_fullsized":"2024-03-04T07:00:33.174867+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1241,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403066+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T06:59:38.403066+0000","last_peered":"2024-03-04T06:59:38.403066+0000","last_clean":"2024-03-04T06:59:38.403066+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T06:59:38.403066+0000","last_undegraded":"2024-03-04T06:59:38.403066+0000","last_fullsized":"2024-03-04T06:59:38.403066+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4017,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:29.563935+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T07:00:29.563935+0000","last_peered":"2024-03-04T07:00:29.563935+0000","last_clean":"2024-03-04T07:00:29.563935+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T07:00:29.563935+0000","last_undegraded":"2024-03-04T07:00:29.563935+0000","last_fullsized":"2024-03-04T07:00:29.563935+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244731+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:59:53.244731+0000","last_peered":"2024-03-04T06:59:53.244731+0000","last_clean":"2024-03-04T06:59:53.244731+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:59:53.244731+0000","last_undegraded":"2024-03-04T06:59:53.244731+0000","last_fullsized":"2024-03-04T06:59:53.244731+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017258+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T07:00:15.017258+0000","last_peered":"2024-03-04T07:00:15.017258+0000","last_clean":"2024-03-04T07:00:15.017258+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T07:00:15.017258+0000","last_undegraded":"2024-03-04T07:00:15.017258+0000","last_fullsized":"2024-03-04T07:00:15.017258+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1150,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976219+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T07:01:22.976219+0000","last_peered":"2024-03-04T07:01:22.976219+0000","last_clean":"2024-03-04T07:01:22.976219+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T07:01:22.976219+0000","last_undegraded":"2024-03-04T07:01:22.976219+0000","last_fullsized":"2024-03-04T07:01:22.976219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1552,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560890+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:00:04.560890+0000","last_peered":"2024-03-04T07:00:04.560890+0000","last_clean":"2024-03-04T07:00:04.560890+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:00:04.560890+0000","last_undegraded":"2024-03-04T07:00:04.560890+0000","last_fullsized":"2024-03-04T07:00:04.560890+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3952,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.965034+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:59:42.965034+0000","last_peered":"2024-03-04T06:59:42.965034+0000","last_clean":"2024-03-04T06:59:42.965034+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:59:42.965034+0000","last_undegraded":"2024-03-04T06:59:42.965034+0000","last_fullsized":"2024-03-04T06:59:42.965034+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023391+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T07:01:08.023391+0000","last_peered":"2024-03-04T07:01:08.023391+0000","last_clean":"2024-03-04T07:01:08.023391+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T07:01:08.023391+0000","last_undegraded":"2024-03-04T07:01:08.023391+0000","last_fullsized":"2024-03-04T07:01:08.023391+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403043+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T06:59:38.403043+0000","last_peered":"2024-03-04T06:59:38.403043+0000","last_clean":"2024-03-04T06:59:38.403043+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T06:59:38.403043+0000","last_undegraded":"2024-03-04T06:59:38.403043+0000","last_fullsized":"2024-03-04T06:59:38.403043+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560852+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:00:04.560852+0000","last_peered":"2024-03-04T07:00:04.560852+0000","last_clean":"2024-03-04T07:00:04.560852+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:00:04.560852+0000","last_undegraded":"2024-03-04T07:00:04.560852+0000","last_fullsized":"2024-03-04T07:00:04.560852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15293,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:53.244696+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:59:53.244696+0000","last_peered":"2024-03-04T06:59:53.244696+0000","last_clean":"2024-03-04T06:59:53.244696+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:59:53.244696+0000","last_undegraded":"2024-03-04T06:59:53.244696+0000","last_fullsized":"2024-03-04T06:59:53.244696+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019541+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T07:00:33.019541+0000","last_peered":"2024-03-04T07:00:33.019541+0000","last_clean":"2024-03-04T07:00:33.019541+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T07:00:33.019541+0000","last_undegraded":"2024-03-04T07:00:33.019541+0000","last_fullsized":"2024-03-04T07:00:33.019541+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1075,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.563983+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T07:00:29.563983+0000","last_peered":"2024-03-04T07:00:29.563983+0000","last_clean":"2024-03-04T07:00:29.563983+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T07:00:29.563983+0000","last_undegraded":"2024-03-04T07:00:29.563983+0000","last_fullsized":"2024-03-04T07:00:29.563983+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178580+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T07:01:08.178580+0000","last_peered":"2024-03-04T07:01:08.178580+0000","last_clean":"2024-03-04T07:01:08.178580+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T07:01:08.178580+0000","last_undegraded":"2024-03-04T07:01:08.178580+0000","last_fullsized":"2024-03-04T07:01:08.178580+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4381,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:47.639101+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T07:00:47.639101+0000","last_peered":"2024-03-04T07:00:47.639101+0000","last_clean":"2024-03-04T07:00:47.639101+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T07:00:47.639101+0000","last_undegraded":"2024-03-04T07:00:47.639101+0000","last_fullsized":"2024-03-04T07:00:47.639101+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1205,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:45.014181+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T06:59:45.014181+0000","last_peered":"2024-03-04T06:59:45.014181+0000","last_clean":"2024-03-04T06:59:45.014181+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T06:59:45.014181+0000","last_undegraded":"2024-03-04T06:59:45.014181+0000","last_fullsized":"2024-03-04T06:59:45.014181+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1270,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168056+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:59:33.168056+0000","last_peered":"2024-03-04T06:59:33.168056+0000","last_clean":"2024-03-04T06:59:33.168056+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:59:33.168056+0000","last_undegraded":"2024-03-04T06:59:33.168056+0000","last_fullsized":"2024-03-04T06:59:33.168056+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020800+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T07:00:45.020800+0000","last_peered":"2024-03-04T07:00:45.020800+0000","last_clean":"2024-03-04T07:00:45.020800+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T07:00:45.020800+0000","last_undegraded":"2024-03-04T07:00:45.020800+0000","last_fullsized":"2024-03-04T07:00:45.020800+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4611,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:45.014149+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T06:59:45.014149+0000","last_peered":"2024-03-04T06:59:45.014149+0000","last_clean":"2024-03-04T06:59:45.014149+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T06:59:45.014149+0000","last_undegraded":"2024-03-04T06:59:45.014149+0000","last_fullsized":"2024-03-04T06:59:45.014149+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639077+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T07:00:47.639077+0000","last_peered":"2024-03-04T07:00:47.639077+0000","last_clean":"2024-03-04T07:00:47.639077+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T07:00:47.639077+0000","last_undegraded":"2024-03-04T07:00:47.639077+0000","last_fullsized":"2024-03-04T07:00:47.639077+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1080,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247864+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T07:00:18.247864+0000","last_peered":"2024-03-04T07:00:18.247864+0000","last_clean":"2024-03-04T07:00:18.247864+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T07:00:18.247864+0000","last_undegraded":"2024-03-04T07:00:18.247864+0000","last_fullsized":"2024-03-04T07:00:18.247864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023341+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T07:01:08.023341+0000","last_peered":"2024-03-04T07:01:08.023341+0000","last_clean":"2024-03-04T07:01:08.023341+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T07:01:08.023341+0000","last_undegraded":"2024-03-04T07:01:08.023341+0000","last_fullsized":"2024-03-04T07:01:08.023341+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4636,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:07.967606+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T07:00:07.967606+0000","last_peered":"2024-03-04T07:00:07.967606+0000","last_clean":"2024-03-04T07:00:07.967606+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T07:00:07.967606+0000","last_undegraded":"2024-03-04T07:00:07.967606+0000","last_fullsized":"2024-03-04T07:00:07.967606+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:54.566566+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T07:00:54.566566+0000","last_peered":"2024-03-04T07:00:54.566566+0000","last_clean":"2024-03-04T07:00:54.566566+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T07:00:54.566566+0000","last_undegraded":"2024-03-04T07:00:54.566566+0000","last_fullsized":"2024-03-04T07:00:54.566566+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1187,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:17.642331+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T07:01:17.642331+0000","last_peered":"2024-03-04T07:01:17.642331+0000","last_clean":"2024-03-04T07:01:17.642331+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T07:01:17.642331+0000","last_undegraded":"2024-03-04T07:01:17.642331+0000","last_fullsized":"2024-03-04T07:01:17.642331+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5159,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:32.631317+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:59:32.631317+0000","last_peered":"2024-03-04T06:59:32.631317+0000","last_clean":"2024-03-04T06:59:32.631317+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:59:32.631317+0000","last_undegraded":"2024-03-04T06:59:32.631317+0000","last_fullsized":"2024-03-04T06:59:32.631317+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.167981+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:59:33.167981+0000","last_peered":"2024-03-04T06:59:33.167981+0000","last_clean":"2024-03-04T06:59:33.167981+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:59:33.167981+0000","last_undegraded":"2024-03-04T06:59:33.167981+0000","last_fullsized":"2024-03-04T06:59:33.167981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020733+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T07:00:45.020733+0000","last_peered":"2024-03-04T07:00:45.020733+0000","last_clean":"2024-03-04T07:00:45.020733+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T07:00:45.020733+0000","last_undegraded":"2024-03-04T07:00:45.020733+0000","last_fullsized":"2024-03-04T07:00:45.020733+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4721,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409468+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T07:00:38.409468+0000","last_peered":"2024-03-04T07:00:38.409468+0000","last_clean":"2024-03-04T07:00:38.409468+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T07:00:38.409468+0000","last_undegraded":"2024-03-04T07:00:38.409468+0000","last_fullsized":"2024-03-04T07:00:38.409468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168002+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:59:33.168002+0000","last_peered":"2024-03-04T06:59:33.168002+0000","last_clean":"2024-03-04T06:59:33.168002+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:59:33.168002+0000","last_undegraded":"2024-03-04T06:59:33.168002+0000","last_fullsized":"2024-03-04T06:59:33.168002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023738+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T07:01:15.023738+0000","last_peered":"2024-03-04T07:01:15.023738+0000","last_clean":"2024-03-04T07:01:15.023738+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T07:01:15.023738+0000","last_undegraded":"2024-03-04T07:01:15.023738+0000","last_fullsized":"2024-03-04T07:01:15.023738+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5556,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:03.171266+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:00:03.171266+0000","last_peered":"2024-03-04T07:00:03.171266+0000","last_clean":"2024-03-04T07:00:03.171266+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:00:03.171266+0000","last_undegraded":"2024-03-04T07:00:03.171266+0000","last_fullsized":"2024-03-04T07:00:03.171266+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T07:01:19.569554+0000","last_peered":"2024-03-04T07:01:19.569554+0000","last_clean":"2024-03-04T07:01:19.569554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T07:01:19.569554+0000","last_undegraded":"2024-03-04T07:01:19.569554+0000","last_fullsized":"2024-03-04T07:01:19.569554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247800+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T07:00:18.247800+0000","last_peered":"2024-03-04T07:00:18.247800+0000","last_clean":"2024-03-04T07:00:18.247800+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T07:00:18.247800+0000","last_undegraded":"2024-03-04T07:00:18.247800+0000","last_fullsized":"2024-03-04T07:00:18.247800+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409421+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T07:00:38.409421+0000","last_peered":"2024-03-04T07:00:38.409421+0000","last_clean":"2024-03-04T07:00:38.409421+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T07:00:38.409421+0000","last_undegraded":"2024-03-04T07:00:38.409421+0000","last_fullsized":"2024-03-04T07:00:38.409421+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409457+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T07:00:38.409457+0000","last_peered":"2024-03-04T07:00:38.409457+0000","last_clean":"2024-03-04T07:00:38.409457+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T07:00:38.409457+0000","last_undegraded":"2024-03-04T07:00:38.409457+0000","last_fullsized":"2024-03-04T07:00:38.409457+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T07:01:19.569599+0000","last_peered":"2024-03-04T07:01:19.569599+0000","last_clean":"2024-03-04T07:01:19.569599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T07:01:19.569599+0000","last_undegraded":"2024-03-04T07:01:19.569599+0000","last_fullsized":"2024-03-04T07:01:19.569599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4368,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405967+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:00:08.405967+0000","last_peered":"2024-03-04T07:00:08.405967+0000","last_clean":"2024-03-04T07:00:08.405967+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:00:08.405967+0000","last_undegraded":"2024-03-04T07:00:08.405967+0000","last_fullsized":"2024-03-04T07:00:08.405967+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:03.171315+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:00:03.171315+0000","last_peered":"2024-03-04T07:00:03.171315+0000","last_clean":"2024-03-04T07:00:03.171315+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:00:03.171315+0000","last_undegraded":"2024-03-04T07:00:03.171315+0000","last_fullsized":"2024-03-04T07:00:03.171315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967580+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T07:00:07.967580+0000","last_peered":"2024-03-04T07:00:07.967580+0000","last_clean":"2024-03-04T07:00:07.967580+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T07:00:07.967580+0000","last_undegraded":"2024-03-04T07:00:07.967580+0000","last_fullsized":"2024-03-04T07:00:07.967580+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4602,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:54.566603+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T07:00:54.566603+0000","last_peered":"2024-03-04T07:00:54.566603+0000","last_clean":"2024-03-04T07:00:54.566603+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T07:00:54.566603+0000","last_undegraded":"2024-03-04T07:00:54.566603+0000","last_fullsized":"2024-03-04T07:00:54.566603+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1247,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409492+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T07:00:38.409492+0000","last_peered":"2024-03-04T07:00:38.409492+0000","last_clean":"2024-03-04T07:00:38.409492+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T07:00:38.409492+0000","last_undegraded":"2024-03-04T07:00:38.409492+0000","last_fullsized":"2024-03-04T07:00:38.409492+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569626+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T07:01:19.569626+0000","last_peered":"2024-03-04T07:01:19.569626+0000","last_clean":"2024-03-04T07:01:19.569626+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T07:01:19.569626+0000","last_undegraded":"2024-03-04T07:01:19.569626+0000","last_fullsized":"2024-03-04T07:01:19.569626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244661+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:59:53.244661+0000","last_peered":"2024-03-04T06:59:53.244661+0000","last_clean":"2024-03-04T06:59:53.244661+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:59:53.244661+0000","last_undegraded":"2024-03-04T06:59:53.244661+0000","last_fullsized":"2024-03-04T06:59:53.244661+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403075+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T06:59:38.403075+0000","last_peered":"2024-03-04T06:59:38.403075+0000","last_clean":"2024-03-04T06:59:38.403075+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T06:59:38.403075+0000","last_undegraded":"2024-03-04T06:59:38.403075+0000","last_fullsized":"2024-03-04T06:59:38.403075+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976197+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T07:01:22.976197+0000","last_peered":"2024-03-04T07:01:22.976197+0000","last_clean":"2024-03-04T07:01:22.976197+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T07:01:22.976197+0000","last_undegraded":"2024-03-04T07:01:22.976197+0000","last_fullsized":"2024-03-04T07:01:22.976197+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019487+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T07:00:33.019487+0000","last_peered":"2024-03-04T07:00:33.019487+0000","last_clean":"2024-03-04T07:00:33.019487+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T07:00:33.019487+0000","last_undegraded":"2024-03-04T07:00:33.019487+0000","last_fullsized":"2024-03-04T07:00:33.019487+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020779+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T07:00:45.020779+0000","last_peered":"2024-03-04T07:00:45.020779+0000","last_clean":"2024-03-04T07:00:45.020779+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T07:00:45.020779+0000","last_undegraded":"2024-03-04T07:00:45.020779+0000","last_fullsized":"2024-03-04T07:00:45.020779+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168023+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:59:33.168023+0000","last_peered":"2024-03-04T06:59:33.168023+0000","last_clean":"2024-03-04T06:59:33.168023+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:59:33.168023+0000","last_undegraded":"2024-03-04T06:59:33.168023+0000","last_fullsized":"2024-03-04T06:59:33.168023+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247852+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T07:00:18.247852+0000","last_peered":"2024-03-04T07:00:18.247852+0000","last_clean":"2024-03-04T07:00:18.247852+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T07:00:18.247852+0000","last_undegraded":"2024-03-04T07:00:18.247852+0000","last_fullsized":"2024-03-04T07:00:18.247852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020816+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T07:00:45.020816+0000","last_peered":"2024-03-04T07:00:45.020816+0000","last_clean":"2024-03-04T07:00:45.020816+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T07:00:45.020816+0000","last_undegraded":"2024-03-04T07:00:45.020816+0000","last_fullsized":"2024-03-04T07:00:45.020816+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.964990+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:59:42.964990+0000","last_peered":"2024-03-04T06:59:42.964990+0000","last_clean":"2024-03-04T06:59:42.964990+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:59:42.964990+0000","last_undegraded":"2024-03-04T06:59:42.964990+0000","last_fullsized":"2024-03-04T06:59:42.964990+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023709+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T07:01:15.023709+0000","last_peered":"2024-03-04T07:01:15.023709+0000","last_clean":"2024-03-04T07:01:15.023709+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T07:01:15.023709+0000","last_undegraded":"2024-03-04T07:01:15.023709+0000","last_fullsized":"2024-03-04T07:01:15.023709+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1122,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967529+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T07:00:07.967529+0000","last_peered":"2024-03-04T07:00:07.967529+0000","last_clean":"2024-03-04T07:00:07.967529+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T07:00:07.967529+0000","last_undegraded":"2024-03-04T07:00:07.967529+0000","last_fullsized":"2024-03-04T07:00:07.967529+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.012471+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:59:28.012471+0000","last_peered":"2024-03-04T06:59:28.012471+0000","last_clean":"2024-03-04T06:59:28.012471+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:59:28.012471+0000","last_undegraded":"2024-03-04T06:59:28.012471+0000","last_fullsized":"2024-03-04T06:59:28.012471+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:43.250705+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T07:00:43.250705+0000","last_peered":"2024-03-04T07:00:43.250705+0000","last_clean":"2024-03-04T07:00:43.250705+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T07:00:43.250705+0000","last_undegraded":"2024-03-04T07:00:43.250705+0000","last_fullsized":"2024-03-04T07:00:43.250705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503523,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648170,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142477,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287124,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997830,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885886,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937464,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792817,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:03:36.896 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:36.896 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:36.897 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:36.897 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:36.897 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:36.897 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:36.897 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:36.897 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:36.897 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:36.897 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:36.897 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:03:37.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:37 smithi137 ceph-mon[88869]: from='client.34731 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:03:37.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:37 smithi137 ceph-mon[91314]: from='client.34731 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:03:37.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:37 smithi203 ceph-mon[85573]: from='client.34731 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:03:38.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:38 smithi137 ceph-mon[91314]: pgmap v1173: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:38.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:38 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:03:38.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:38 smithi137 ceph-mon[88869]: pgmap v1173: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:38.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:38 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:03:38.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:38 smithi203 ceph-mon[85573]: pgmap v1173: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:38.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:38 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:03:40.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:40 smithi137 ceph-mon[88869]: pgmap v1174: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:40.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:40 smithi137 ceph-mon[91314]: pgmap v1174: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:40.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:40 smithi203 ceph-mon[85573]: pgmap v1174: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:42.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:42 smithi137 ceph-mon[88869]: pgmap v1175: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:42.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:42 smithi137 ceph-mon[91314]: pgmap v1175: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:42.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:42 smithi203 ceph-mon[85573]: pgmap v1175: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:44.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:44 smithi137 ceph-mon[88869]: pgmap v1176: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:44.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:44 smithi137 ceph-mon[91314]: pgmap v1176: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:44.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:44 smithi203 ceph-mon[85573]: pgmap v1176: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:45.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:03:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:03:45] "GET /metrics HTTP/1.1" 200 36337 "" "Prometheus/2.43.0" 2024-03-04T07:03:46.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:46 smithi137 ceph-mon[91314]: pgmap v1177: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:46.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:46 smithi137 ceph-mon[88869]: pgmap v1177: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:46.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:46 smithi203 ceph-mon[85573]: pgmap v1177: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:46.898 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:03:47.118 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:03:48.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:48 smithi137 ceph-mon[88869]: pgmap v1178: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:48.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:48 smithi137 ceph-mon[91314]: pgmap v1178: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:48.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:48 smithi203 ceph-mon[85573]: pgmap v1178: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:03:49.165 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:03:49.854 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1179,"stamp":"2024-03-04T07:03:48.619243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003988"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.564000+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T07:00:29.564000+0000","last_peered":"2024-03-04T07:00:29.564000+0000","last_clean":"2024-03-04T07:00:29.564000+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T07:00:29.564000+0000","last_undegraded":"2024-03-04T07:00:29.564000+0000","last_fullsized":"2024-03-04T07:00:29.564000+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178667+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T07:01:08.178667+0000","last_peered":"2024-03-04T07:01:08.178667+0000","last_clean":"2024-03-04T07:01:08.178667+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T07:01:08.178667+0000","last_undegraded":"2024-03-04T07:01:08.178667+0000","last_fullsized":"2024-03-04T07:01:08.178667+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019562+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T07:00:33.019562+0000","last_peered":"2024-03-04T07:00:33.019562+0000","last_clean":"2024-03-04T07:00:33.019562+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T07:00:33.019562+0000","last_undegraded":"2024-03-04T07:00:33.019562+0000","last_fullsized":"2024-03-04T07:00:33.019562+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1143,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:52.972434+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T07:00:52.972434+0000","last_peered":"2024-03-04T07:00:52.972434+0000","last_clean":"2024-03-04T07:00:52.972434+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T07:00:52.972434+0000","last_undegraded":"2024-03-04T07:00:52.972434+0000","last_fullsized":"2024-03-04T07:00:52.972434+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560949+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T07:00:04.560949+0000","last_peered":"2024-03-04T07:00:04.560949+0000","last_clean":"2024-03-04T07:00:04.560949+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T07:00:04.560949+0000","last_undegraded":"2024-03-04T07:00:04.560949+0000","last_fullsized":"2024-03-04T07:00:04.560949+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1117,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958813+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T06:58:52.958813+0000","last_peered":"2024-03-04T06:58:52.958813+0000","last_clean":"2024-03-04T06:58:52.958813+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T06:58:52.958813+0000","last_undegraded":"2024-03-04T06:58:52.958813+0000","last_fullsized":"2024-03-04T06:58:52.958813+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560930+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T07:00:04.560930+0000","last_peered":"2024-03-04T07:00:04.560930+0000","last_clean":"2024-03-04T07:00:04.560930+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T07:00:04.560930+0000","last_undegraded":"2024-03-04T07:00:04.560930+0000","last_fullsized":"2024-03-04T07:00:04.560930+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017220+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T07:00:15.017220+0000","last_peered":"2024-03-04T07:00:15.017220+0000","last_clean":"2024-03-04T07:00:15.017220+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T07:00:15.017220+0000","last_undegraded":"2024-03-04T07:00:15.017220+0000","last_fullsized":"2024-03-04T07:00:15.017220+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1066,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558470+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:59:44.558470+0000","last_peered":"2024-03-04T06:59:44.558470+0000","last_clean":"2024-03-04T06:59:44.558470+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:59:44.558470+0000","last_undegraded":"2024-03-04T06:59:44.558470+0000","last_fullsized":"2024-03-04T06:59:44.558470+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239534+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T06:59:08.239534+0000","last_peered":"2024-03-04T06:59:08.239534+0000","last_clean":"2024-03-04T06:59:08.239534+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T06:59:08.239534+0000","last_undegraded":"2024-03-04T06:59:08.239534+0000","last_fullsized":"2024-03-04T06:59:08.239534+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239472+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T06:59:08.239472+0000","last_peered":"2024-03-04T06:59:08.239472+0000","last_clean":"2024-03-04T06:59:08.239472+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T06:59:08.239472+0000","last_undegraded":"2024-03-04T06:59:08.239472+0000","last_fullsized":"2024-03-04T06:59:08.239472+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:22.636361+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T07:00:22.636361+0000","last_peered":"2024-03-04T07:00:22.636361+0000","last_clean":"2024-03-04T07:00:22.636361+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T07:00:22.636361+0000","last_undegraded":"2024-03-04T07:00:22.636361+0000","last_fullsized":"2024-03-04T07:00:22.636361+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014730+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:59:50.014730+0000","last_peered":"2024-03-04T06:59:50.014730+0000","last_clean":"2024-03-04T06:59:50.014730+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:59:50.014730+0000","last_undegraded":"2024-03-04T06:59:50.014730+0000","last_fullsized":"2024-03-04T06:59:50.014730+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015553+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:59:58.015553+0000","last_peered":"2024-03-04T06:59:58.015553+0000","last_clean":"2024-03-04T06:59:58.015553+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:59:58.015553+0000","last_undegraded":"2024-03-04T06:59:58.015553+0000","last_fullsized":"2024-03-04T06:59:58.015553+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174897+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T07:00:33.174897+0000","last_peered":"2024-03-04T07:00:33.174897+0000","last_clean":"2024-03-04T07:00:33.174897+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T07:00:33.174897+0000","last_undegraded":"2024-03-04T07:00:33.174897+0000","last_fullsized":"2024-03-04T07:00:33.174897+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970309+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T07:00:32.970309+0000","last_peered":"2024-03-04T07:00:32.970309+0000","last_clean":"2024-03-04T07:00:32.970309+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T07:00:32.970309+0000","last_undegraded":"2024-03-04T07:00:32.970309+0000","last_fullsized":"2024-03-04T07:00:32.970309+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970400+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T07:00:32.970400+0000","last_peered":"2024-03-04T07:00:32.970400+0000","last_clean":"2024-03-04T07:00:32.970400+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T07:00:32.970400+0000","last_undegraded":"2024-03-04T07:00:32.970400+0000","last_fullsized":"2024-03-04T07:00:32.970400+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412366+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T07:01:08.412366+0000","last_peered":"2024-03-04T07:01:08.412366+0000","last_clean":"2024-03-04T07:01:08.412366+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T07:01:08.412366+0000","last_undegraded":"2024-03-04T07:01:08.412366+0000","last_fullsized":"2024-03-04T07:01:08.412366+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T07:01:19.569588+0000","last_peered":"2024-03-04T07:01:19.569588+0000","last_clean":"2024-03-04T07:01:19.569588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T07:01:19.569588+0000","last_undegraded":"2024-03-04T07:01:19.569588+0000","last_fullsized":"2024-03-04T07:01:19.569588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1307,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019623+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T07:00:33.019623+0000","last_peered":"2024-03-04T07:00:33.019623+0000","last_clean":"2024-03-04T07:00:33.019623+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T07:00:33.019623+0000","last_undegraded":"2024-03-04T07:00:33.019623+0000","last_fullsized":"2024-03-04T07:00:33.019623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1197,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026705+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T07:01:45.026705+0000","last_peered":"2024-03-04T07:01:45.026705+0000","last_clean":"2024-03-04T07:01:45.026705+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T07:01:45.026705+0000","last_undegraded":"2024-03-04T07:01:45.026705+0000","last_fullsized":"2024-03-04T07:01:45.026705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026715+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T07:01:45.026715+0000","last_peered":"2024-03-04T07:01:45.026715+0000","last_clean":"2024-03-04T07:01:45.026715+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T07:01:45.026715+0000","last_undegraded":"2024-03-04T07:01:45.026715+0000","last_fullsized":"2024-03-04T07:01:45.026715+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019611+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T07:00:33.019611+0000","last_peered":"2024-03-04T07:00:33.019611+0000","last_clean":"2024-03-04T07:00:33.019611+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T07:00:33.019611+0000","last_undegraded":"2024-03-04T07:00:33.019611+0000","last_fullsized":"2024-03-04T07:00:33.019611+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403128+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:59:38.403128+0000","last_peered":"2024-03-04T06:59:38.403128+0000","last_clean":"2024-03-04T06:59:38.403128+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:59:38.403128+0000","last_undegraded":"2024-03-04T06:59:38.403128+0000","last_fullsized":"2024-03-04T06:59:38.403128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1223,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403103+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:59:38.403103+0000","last_peered":"2024-03-04T06:59:38.403103+0000","last_clean":"2024-03-04T06:59:38.403103+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:59:38.403103+0000","last_undegraded":"2024-03-04T06:59:38.403103+0000","last_fullsized":"2024-03-04T06:59:38.403103+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560965+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T07:00:04.560965+0000","last_peered":"2024-03-04T07:00:04.560965+0000","last_clean":"2024-03-04T07:00:04.560965+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T07:00:04.560965+0000","last_undegraded":"2024-03-04T07:00:04.560965+0000","last_fullsized":"2024-03-04T07:00:04.560965+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1127,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:58:52.958870+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T06:58:52.958870+0000","last_peered":"2024-03-04T06:58:52.958870+0000","last_clean":"2024-03-04T06:58:52.958870+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T06:58:52.958870+0000","last_undegraded":"2024-03-04T06:58:52.958870+0000","last_fullsized":"2024-03-04T06:58:52.958870+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017274+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T07:00:15.017274+0000","last_peered":"2024-03-04T07:00:15.017274+0000","last_clean":"2024-03-04T07:00:15.017274+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T07:00:15.017274+0000","last_undegraded":"2024-03-04T07:00:15.017274+0000","last_fullsized":"2024-03-04T07:00:15.017274+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1191,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639127+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T07:00:47.639127+0000","last_peered":"2024-03-04T07:00:47.639127+0000","last_clean":"2024-03-04T07:00:47.639127+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T07:00:47.639127+0000","last_undegraded":"2024-03-04T07:00:47.639127+0000","last_fullsized":"2024-03-04T07:00:47.639127+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.241598+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:59:28.241598+0000","last_peered":"2024-03-04T06:59:28.241598+0000","last_clean":"2024-03-04T06:59:28.241598+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:59:28.241598+0000","last_undegraded":"2024-03-04T06:59:28.241598+0000","last_fullsized":"2024-03-04T06:59:28.241598+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:58.022394+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T07:00:58.022394+0000","last_peered":"2024-03-04T07:00:58.022394+0000","last_clean":"2024-03-04T07:00:58.022394+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T07:00:58.022394+0000","last_undegraded":"2024-03-04T07:00:58.022394+0000","last_fullsized":"2024-03-04T07:00:58.022394+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014712+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:59:50.014712+0000","last_peered":"2024-03-04T06:59:50.014712+0000","last_clean":"2024-03-04T06:59:50.014712+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:59:50.014712+0000","last_undegraded":"2024-03-04T06:59:50.014712+0000","last_fullsized":"2024-03-04T06:59:50.014712+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014675+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:59:50.014675+0000","last_peered":"2024-03-04T06:59:50.014675+0000","last_clean":"2024-03-04T06:59:50.014675+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:59:50.014675+0000","last_undegraded":"2024-03-04T06:59:50.014675+0000","last_fullsized":"2024-03-04T06:59:50.014675+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973153+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T07:00:57.973153+0000","last_peered":"2024-03-04T07:00:57.973153+0000","last_clean":"2024-03-04T07:00:57.973153+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T07:00:57.973153+0000","last_undegraded":"2024-03-04T07:00:57.973153+0000","last_fullsized":"2024-03-04T07:00:57.973153+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178000+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T07:01:03.178000+0000","last_peered":"2024-03-04T07:01:03.178000+0000","last_clean":"2024-03-04T07:01:03.178000+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T07:01:03.178000+0000","last_undegraded":"2024-03-04T07:01:03.178000+0000","last_fullsized":"2024-03-04T07:01:03.178000+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:08.239549+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T06:59:08.239549+0000","last_peered":"2024-03-04T06:59:08.239549+0000","last_clean":"2024-03-04T06:59:08.239549+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T06:59:08.239549+0000","last_undegraded":"2024-03-04T06:59:08.239549+0000","last_fullsized":"2024-03-04T06:59:08.239549+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973230+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T07:00:57.973230+0000","last_peered":"2024-03-04T07:00:57.973230+0000","last_clean":"2024-03-04T07:00:57.973230+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T07:00:57.973230+0000","last_undegraded":"2024-03-04T07:00:57.973230+0000","last_fullsized":"2024-03-04T07:00:57.973230+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973215+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T07:00:57.973215+0000","last_peered":"2024-03-04T07:00:57.973215+0000","last_clean":"2024-03-04T07:00:57.973215+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T07:00:57.973215+0000","last_undegraded":"2024-03-04T07:00:57.973215+0000","last_fullsized":"2024-03-04T07:00:57.973215+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:28.018729+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T07:00:28.018729+0000","last_peered":"2024-03-04T07:00:28.018729+0000","last_clean":"2024-03-04T07:00:28.018729+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T07:00:28.018729+0000","last_undegraded":"2024-03-04T07:00:28.018729+0000","last_fullsized":"2024-03-04T07:00:28.018729+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178037+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T07:01:03.178037+0000","last_peered":"2024-03-04T07:01:03.178037+0000","last_clean":"2024-03-04T07:01:03.178037+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T07:01:03.178037+0000","last_undegraded":"2024-03-04T07:01:03.178037+0000","last_fullsized":"2024-03-04T07:01:03.178037+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:57.633964+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:59:57.633964+0000","last_peered":"2024-03-04T06:59:57.633964+0000","last_clean":"2024-03-04T06:59:57.633964+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:59:57.633964+0000","last_undegraded":"2024-03-04T06:59:57.633964+0000","last_fullsized":"2024-03-04T06:59:57.633964+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1132,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253574+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T07:01:08.253574+0000","last_peered":"2024-03-04T07:01:08.253574+0000","last_clean":"2024-03-04T07:01:08.253574+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T07:01:08.253574+0000","last_undegraded":"2024-03-04T07:01:08.253574+0000","last_fullsized":"2024-03-04T07:01:08.253574+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558443+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:59:44.558443+0000","last_peered":"2024-03-04T06:59:44.558443+0000","last_clean":"2024-03-04T06:59:44.558443+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:59:44.558443+0000","last_undegraded":"2024-03-04T06:59:44.558443+0000","last_fullsized":"2024-03-04T06:59:44.558443+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015596+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:59:58.015596+0000","last_peered":"2024-03-04T06:59:58.015596+0000","last_clean":"2024-03-04T06:59:58.015596+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:59:58.015596+0000","last_undegraded":"2024-03-04T06:59:58.015596+0000","last_fullsized":"2024-03-04T06:59:58.015596+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412330+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T07:01:08.412330+0000","last_peered":"2024-03-04T07:01:08.412330+0000","last_clean":"2024-03-04T07:01:08.412330+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T07:01:08.412330+0000","last_undegraded":"2024-03-04T07:01:08.412330+0000","last_fullsized":"2024-03-04T07:01:08.412330+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970340+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T07:00:32.970340+0000","last_peered":"2024-03-04T07:00:32.970340+0000","last_clean":"2024-03-04T07:00:32.970340+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T07:00:32.970340+0000","last_undegraded":"2024-03-04T07:00:32.970340+0000","last_fullsized":"2024-03-04T07:00:32.970340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555834+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:59:24.555834+0000","last_peered":"2024-03-04T06:59:24.555834+0000","last_clean":"2024-03-04T06:59:24.555834+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:59:24.555834+0000","last_undegraded":"2024-03-04T06:59:24.555834+0000","last_fullsized":"2024-03-04T06:59:24.555834+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1104,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253553+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T07:01:08.253553+0000","last_peered":"2024-03-04T07:01:08.253553+0000","last_clean":"2024-03-04T07:01:08.253553+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T07:01:08.253553+0000","last_undegraded":"2024-03-04T07:01:08.253553+0000","last_fullsized":"2024-03-04T07:01:08.253553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253528+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T07:01:08.253528+0000","last_peered":"2024-03-04T07:01:08.253528+0000","last_clean":"2024-03-04T07:01:08.253528+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T07:01:08.253528+0000","last_undegraded":"2024-03-04T07:01:08.253528+0000","last_fullsized":"2024-03-04T07:01:08.253528+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412282+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T07:01:08.412282+0000","last_peered":"2024-03-04T07:01:08.412282+0000","last_clean":"2024-03-04T07:01:08.412282+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T07:01:08.412282+0000","last_undegraded":"2024-03-04T07:01:08.412282+0000","last_fullsized":"2024-03-04T07:01:08.412282+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555799+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:59:24.555799+0000","last_peered":"2024-03-04T06:59:24.555799+0000","last_clean":"2024-03-04T06:59:24.555799+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:59:24.555799+0000","last_undegraded":"2024-03-04T06:59:24.555799+0000","last_fullsized":"2024-03-04T06:59:24.555799+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3579,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405911+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:00:08.405911+0000","last_peered":"2024-03-04T07:00:08.405911+0000","last_clean":"2024-03-04T07:00:08.405911+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:00:08.405911+0000","last_undegraded":"2024-03-04T07:00:08.405911+0000","last_fullsized":"2024-03-04T07:00:08.405911+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:32.631361+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:59:32.631361+0000","last_peered":"2024-03-04T06:59:32.631361+0000","last_clean":"2024-03-04T06:59:32.631361+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:59:32.631361+0000","last_undegraded":"2024-03-04T06:59:32.631361+0000","last_fullsized":"2024-03-04T06:59:32.631361+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T07:01:19.569613+0000","last_peered":"2024-03-04T07:01:19.569613+0000","last_clean":"2024-03-04T07:01:19.569613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T07:01:19.569613+0000","last_undegraded":"2024-03-04T07:01:19.569613+0000","last_fullsized":"2024-03-04T07:01:19.569613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17118,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019514+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T07:00:33.019514+0000","last_peered":"2024-03-04T07:00:33.019514+0000","last_clean":"2024-03-04T07:00:33.019514+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T07:00:33.019514+0000","last_undegraded":"2024-03-04T07:00:33.019514+0000","last_fullsized":"2024-03-04T07:00:33.019514+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178538+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T07:01:08.178538+0000","last_peered":"2024-03-04T07:01:08.178538+0000","last_clean":"2024-03-04T07:01:08.178538+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T07:01:08.178538+0000","last_undegraded":"2024-03-04T07:01:08.178538+0000","last_fullsized":"2024-03-04T07:01:08.178538+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178614+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T07:01:08.178614+0000","last_peered":"2024-03-04T07:01:08.178614+0000","last_clean":"2024-03-04T07:01:08.178614+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T07:01:08.178614+0000","last_undegraded":"2024-03-04T07:01:08.178614+0000","last_fullsized":"2024-03-04T07:01:08.178614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976230+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T07:01:22.976230+0000","last_peered":"2024-03-04T07:01:22.976230+0000","last_clean":"2024-03-04T07:01:22.976230+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T07:01:22.976230+0000","last_undegraded":"2024-03-04T07:01:22.976230+0000","last_fullsized":"2024-03-04T07:01:22.976230+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4388,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019581+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T07:00:33.019581+0000","last_peered":"2024-03-04T07:00:33.019581+0000","last_clean":"2024-03-04T07:00:33.019581+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T07:00:33.019581+0000","last_undegraded":"2024-03-04T07:00:33.019581+0000","last_fullsized":"2024-03-04T07:00:33.019581+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178564+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T07:01:08.178564+0000","last_peered":"2024-03-04T07:01:08.178564+0000","last_clean":"2024-03-04T07:01:08.178564+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T07:01:08.178564+0000","last_undegraded":"2024-03-04T07:01:08.178564+0000","last_fullsized":"2024-03-04T07:01:08.178564+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976151+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T07:01:22.976151+0000","last_peered":"2024-03-04T07:01:22.976151+0000","last_clean":"2024-03-04T07:01:22.976151+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T07:01:22.976151+0000","last_undegraded":"2024-03-04T07:01:22.976151+0000","last_fullsized":"2024-03-04T07:01:22.976151+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639139+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T07:00:47.639139+0000","last_peered":"2024-03-04T07:00:47.639139+0000","last_clean":"2024-03-04T07:00:47.639139+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T07:00:47.639139+0000","last_undegraded":"2024-03-04T07:00:47.639139+0000","last_fullsized":"2024-03-04T07:00:47.639139+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5641,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.406020+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:00:08.406020+0000","last_peered":"2024-03-04T07:00:08.406020+0000","last_clean":"2024-03-04T07:00:08.406020+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:00:08.406020+0000","last_undegraded":"2024-03-04T07:00:08.406020+0000","last_fullsized":"2024-03-04T07:00:08.406020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1257,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168065+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T06:59:33.168065+0000","last_peered":"2024-03-04T06:59:33.168065+0000","last_clean":"2024-03-04T06:59:33.168065+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T06:59:33.168065+0000","last_undegraded":"2024-03-04T06:59:33.168065+0000","last_fullsized":"2024-03-04T06:59:33.168065+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174867+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T07:00:33.174867+0000","last_peered":"2024-03-04T07:00:33.174867+0000","last_clean":"2024-03-04T07:00:33.174867+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T07:00:33.174867+0000","last_undegraded":"2024-03-04T07:00:33.174867+0000","last_fullsized":"2024-03-04T07:00:33.174867+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416777+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T07:01:43.416777+0000","last_peered":"2024-03-04T07:01:43.416777+0000","last_clean":"2024-03-04T07:01:43.416777+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T07:01:43.416777+0000","last_undegraded":"2024-03-04T07:01:43.416777+0000","last_fullsized":"2024-03-04T07:01:43.416777+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4017,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:29.563935+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T07:00:29.563935+0000","last_peered":"2024-03-04T07:00:29.563935+0000","last_clean":"2024-03-04T07:00:29.563935+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T07:00:29.563935+0000","last_undegraded":"2024-03-04T07:00:29.563935+0000","last_fullsized":"2024-03-04T07:00:29.563935+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244731+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:59:53.244731+0000","last_peered":"2024-03-04T06:59:53.244731+0000","last_clean":"2024-03-04T06:59:53.244731+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:59:53.244731+0000","last_undegraded":"2024-03-04T06:59:53.244731+0000","last_fullsized":"2024-03-04T06:59:53.244731+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017258+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T07:00:15.017258+0000","last_peered":"2024-03-04T07:00:15.017258+0000","last_clean":"2024-03-04T07:00:15.017258+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T07:00:15.017258+0000","last_undegraded":"2024-03-04T07:00:15.017258+0000","last_fullsized":"2024-03-04T07:00:15.017258+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1150,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976219+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T07:01:22.976219+0000","last_peered":"2024-03-04T07:01:22.976219+0000","last_clean":"2024-03-04T07:01:22.976219+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T07:01:22.976219+0000","last_undegraded":"2024-03-04T07:01:22.976219+0000","last_fullsized":"2024-03-04T07:01:22.976219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1552,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560890+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:00:04.560890+0000","last_peered":"2024-03-04T07:00:04.560890+0000","last_clean":"2024-03-04T07:00:04.560890+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:00:04.560890+0000","last_undegraded":"2024-03-04T07:00:04.560890+0000","last_fullsized":"2024-03-04T07:00:04.560890+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3952,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.965034+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:59:42.965034+0000","last_peered":"2024-03-04T06:59:42.965034+0000","last_clean":"2024-03-04T06:59:42.965034+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:59:42.965034+0000","last_undegraded":"2024-03-04T06:59:42.965034+0000","last_fullsized":"2024-03-04T06:59:42.965034+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023391+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T07:01:08.023391+0000","last_peered":"2024-03-04T07:01:08.023391+0000","last_clean":"2024-03-04T07:01:08.023391+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T07:01:08.023391+0000","last_undegraded":"2024-03-04T07:01:08.023391+0000","last_fullsized":"2024-03-04T07:01:08.023391+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416752+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T07:01:43.416752+0000","last_peered":"2024-03-04T07:01:43.416752+0000","last_clean":"2024-03-04T07:01:43.416752+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T07:01:43.416752+0000","last_undegraded":"2024-03-04T07:01:43.416752+0000","last_fullsized":"2024-03-04T07:01:43.416752+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560852+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:00:04.560852+0000","last_peered":"2024-03-04T07:00:04.560852+0000","last_clean":"2024-03-04T07:00:04.560852+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:00:04.560852+0000","last_undegraded":"2024-03-04T07:00:04.560852+0000","last_fullsized":"2024-03-04T07:00:04.560852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15293,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:53.244696+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:59:53.244696+0000","last_peered":"2024-03-04T06:59:53.244696+0000","last_clean":"2024-03-04T06:59:53.244696+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:59:53.244696+0000","last_undegraded":"2024-03-04T06:59:53.244696+0000","last_fullsized":"2024-03-04T06:59:53.244696+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019541+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T07:00:33.019541+0000","last_peered":"2024-03-04T07:00:33.019541+0000","last_clean":"2024-03-04T07:00:33.019541+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T07:00:33.019541+0000","last_undegraded":"2024-03-04T07:00:33.019541+0000","last_fullsized":"2024-03-04T07:00:33.019541+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1075,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.563983+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T07:00:29.563983+0000","last_peered":"2024-03-04T07:00:29.563983+0000","last_clean":"2024-03-04T07:00:29.563983+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T07:00:29.563983+0000","last_undegraded":"2024-03-04T07:00:29.563983+0000","last_fullsized":"2024-03-04T07:00:29.563983+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178580+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T07:01:08.178580+0000","last_peered":"2024-03-04T07:01:08.178580+0000","last_clean":"2024-03-04T07:01:08.178580+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T07:01:08.178580+0000","last_undegraded":"2024-03-04T07:01:08.178580+0000","last_fullsized":"2024-03-04T07:01:08.178580+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4381,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:47.639101+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T07:00:47.639101+0000","last_peered":"2024-03-04T07:00:47.639101+0000","last_clean":"2024-03-04T07:00:47.639101+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T07:00:47.639101+0000","last_undegraded":"2024-03-04T07:00:47.639101+0000","last_fullsized":"2024-03-04T07:00:47.639101+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026676+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T07:01:45.026676+0000","last_peered":"2024-03-04T07:01:45.026676+0000","last_clean":"2024-03-04T07:01:45.026676+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T07:01:45.026676+0000","last_undegraded":"2024-03-04T07:01:45.026676+0000","last_fullsized":"2024-03-04T07:01:45.026676+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1270,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168056+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T06:59:33.168056+0000","last_peered":"2024-03-04T06:59:33.168056+0000","last_clean":"2024-03-04T06:59:33.168056+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T06:59:33.168056+0000","last_undegraded":"2024-03-04T06:59:33.168056+0000","last_fullsized":"2024-03-04T06:59:33.168056+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020800+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T07:00:45.020800+0000","last_peered":"2024-03-04T07:00:45.020800+0000","last_clean":"2024-03-04T07:00:45.020800+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T07:00:45.020800+0000","last_undegraded":"2024-03-04T07:00:45.020800+0000","last_fullsized":"2024-03-04T07:00:45.020800+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4612,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:45.026591+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T07:01:45.026591+0000","last_peered":"2024-03-04T07:01:45.026591+0000","last_clean":"2024-03-04T07:01:45.026591+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T07:01:45.026591+0000","last_undegraded":"2024-03-04T07:01:45.026591+0000","last_fullsized":"2024-03-04T07:01:45.026591+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639077+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T07:00:47.639077+0000","last_peered":"2024-03-04T07:00:47.639077+0000","last_clean":"2024-03-04T07:00:47.639077+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T07:00:47.639077+0000","last_undegraded":"2024-03-04T07:00:47.639077+0000","last_fullsized":"2024-03-04T07:00:47.639077+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1080,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247864+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T07:00:18.247864+0000","last_peered":"2024-03-04T07:00:18.247864+0000","last_clean":"2024-03-04T07:00:18.247864+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T07:00:18.247864+0000","last_undegraded":"2024-03-04T07:00:18.247864+0000","last_fullsized":"2024-03-04T07:00:18.247864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023341+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T07:01:08.023341+0000","last_peered":"2024-03-04T07:01:08.023341+0000","last_clean":"2024-03-04T07:01:08.023341+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T07:01:08.023341+0000","last_undegraded":"2024-03-04T07:01:08.023341+0000","last_fullsized":"2024-03-04T07:01:08.023341+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4636,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:07.967606+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T07:00:07.967606+0000","last_peered":"2024-03-04T07:00:07.967606+0000","last_clean":"2024-03-04T07:00:07.967606+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T07:00:07.967606+0000","last_undegraded":"2024-03-04T07:00:07.967606+0000","last_fullsized":"2024-03-04T07:00:07.967606+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:54.566566+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T07:00:54.566566+0000","last_peered":"2024-03-04T07:00:54.566566+0000","last_clean":"2024-03-04T07:00:54.566566+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T07:00:54.566566+0000","last_undegraded":"2024-03-04T07:00:54.566566+0000","last_fullsized":"2024-03-04T07:00:54.566566+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1187,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:17.642331+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T07:01:17.642331+0000","last_peered":"2024-03-04T07:01:17.642331+0000","last_clean":"2024-03-04T07:01:17.642331+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T07:01:17.642331+0000","last_undegraded":"2024-03-04T07:01:17.642331+0000","last_fullsized":"2024-03-04T07:01:17.642331+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5159,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:32.631317+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:59:32.631317+0000","last_peered":"2024-03-04T06:59:32.631317+0000","last_clean":"2024-03-04T06:59:32.631317+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:59:32.631317+0000","last_undegraded":"2024-03-04T06:59:32.631317+0000","last_fullsized":"2024-03-04T06:59:32.631317+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.167981+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T06:59:33.167981+0000","last_peered":"2024-03-04T06:59:33.167981+0000","last_clean":"2024-03-04T06:59:33.167981+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T06:59:33.167981+0000","last_undegraded":"2024-03-04T06:59:33.167981+0000","last_fullsized":"2024-03-04T06:59:33.167981+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020733+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T07:00:45.020733+0000","last_peered":"2024-03-04T07:00:45.020733+0000","last_clean":"2024-03-04T07:00:45.020733+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T07:00:45.020733+0000","last_undegraded":"2024-03-04T07:00:45.020733+0000","last_fullsized":"2024-03-04T07:00:45.020733+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4721,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409468+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T07:00:38.409468+0000","last_peered":"2024-03-04T07:00:38.409468+0000","last_clean":"2024-03-04T07:00:38.409468+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T07:00:38.409468+0000","last_undegraded":"2024-03-04T07:00:38.409468+0000","last_fullsized":"2024-03-04T07:00:38.409468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168002+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T06:59:33.168002+0000","last_peered":"2024-03-04T06:59:33.168002+0000","last_clean":"2024-03-04T06:59:33.168002+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T06:59:33.168002+0000","last_undegraded":"2024-03-04T06:59:33.168002+0000","last_fullsized":"2024-03-04T06:59:33.168002+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023738+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T07:01:15.023738+0000","last_peered":"2024-03-04T07:01:15.023738+0000","last_clean":"2024-03-04T07:01:15.023738+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T07:01:15.023738+0000","last_undegraded":"2024-03-04T07:01:15.023738+0000","last_fullsized":"2024-03-04T07:01:15.023738+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5556,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:03.171266+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:00:03.171266+0000","last_peered":"2024-03-04T07:00:03.171266+0000","last_clean":"2024-03-04T07:00:03.171266+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:00:03.171266+0000","last_undegraded":"2024-03-04T07:00:03.171266+0000","last_fullsized":"2024-03-04T07:00:03.171266+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T07:01:19.569554+0000","last_peered":"2024-03-04T07:01:19.569554+0000","last_clean":"2024-03-04T07:01:19.569554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T07:01:19.569554+0000","last_undegraded":"2024-03-04T07:01:19.569554+0000","last_fullsized":"2024-03-04T07:01:19.569554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247800+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T07:00:18.247800+0000","last_peered":"2024-03-04T07:00:18.247800+0000","last_clean":"2024-03-04T07:00:18.247800+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T07:00:18.247800+0000","last_undegraded":"2024-03-04T07:00:18.247800+0000","last_fullsized":"2024-03-04T07:00:18.247800+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409421+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T07:00:38.409421+0000","last_peered":"2024-03-04T07:00:38.409421+0000","last_clean":"2024-03-04T07:00:38.409421+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T07:00:38.409421+0000","last_undegraded":"2024-03-04T07:00:38.409421+0000","last_fullsized":"2024-03-04T07:00:38.409421+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409457+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T07:00:38.409457+0000","last_peered":"2024-03-04T07:00:38.409457+0000","last_clean":"2024-03-04T07:00:38.409457+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T07:00:38.409457+0000","last_undegraded":"2024-03-04T07:00:38.409457+0000","last_fullsized":"2024-03-04T07:00:38.409457+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T07:01:19.569599+0000","last_peered":"2024-03-04T07:01:19.569599+0000","last_clean":"2024-03-04T07:01:19.569599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T07:01:19.569599+0000","last_undegraded":"2024-03-04T07:01:19.569599+0000","last_fullsized":"2024-03-04T07:01:19.569599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4368,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405967+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:00:08.405967+0000","last_peered":"2024-03-04T07:00:08.405967+0000","last_clean":"2024-03-04T07:00:08.405967+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:00:08.405967+0000","last_undegraded":"2024-03-04T07:00:08.405967+0000","last_fullsized":"2024-03-04T07:00:08.405967+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:03.171315+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:00:03.171315+0000","last_peered":"2024-03-04T07:00:03.171315+0000","last_clean":"2024-03-04T07:00:03.171315+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:00:03.171315+0000","last_undegraded":"2024-03-04T07:00:03.171315+0000","last_fullsized":"2024-03-04T07:00:03.171315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967580+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T07:00:07.967580+0000","last_peered":"2024-03-04T07:00:07.967580+0000","last_clean":"2024-03-04T07:00:07.967580+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T07:00:07.967580+0000","last_undegraded":"2024-03-04T07:00:07.967580+0000","last_fullsized":"2024-03-04T07:00:07.967580+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4602,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:54.566603+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T07:00:54.566603+0000","last_peered":"2024-03-04T07:00:54.566603+0000","last_clean":"2024-03-04T07:00:54.566603+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T07:00:54.566603+0000","last_undegraded":"2024-03-04T07:00:54.566603+0000","last_fullsized":"2024-03-04T07:00:54.566603+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1247,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409492+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T07:00:38.409492+0000","last_peered":"2024-03-04T07:00:38.409492+0000","last_clean":"2024-03-04T07:00:38.409492+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T07:00:38.409492+0000","last_undegraded":"2024-03-04T07:00:38.409492+0000","last_fullsized":"2024-03-04T07:00:38.409492+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569626+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T07:01:19.569626+0000","last_peered":"2024-03-04T07:01:19.569626+0000","last_clean":"2024-03-04T07:01:19.569626+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T07:01:19.569626+0000","last_undegraded":"2024-03-04T07:01:19.569626+0000","last_fullsized":"2024-03-04T07:01:19.569626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244661+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:59:53.244661+0000","last_peered":"2024-03-04T06:59:53.244661+0000","last_clean":"2024-03-04T06:59:53.244661+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:59:53.244661+0000","last_undegraded":"2024-03-04T06:59:53.244661+0000","last_fullsized":"2024-03-04T06:59:53.244661+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416787+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T07:01:43.416787+0000","last_peered":"2024-03-04T07:01:43.416787+0000","last_clean":"2024-03-04T07:01:43.416787+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T07:01:43.416787+0000","last_undegraded":"2024-03-04T07:01:43.416787+0000","last_fullsized":"2024-03-04T07:01:43.416787+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976197+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T07:01:22.976197+0000","last_peered":"2024-03-04T07:01:22.976197+0000","last_clean":"2024-03-04T07:01:22.976197+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T07:01:22.976197+0000","last_undegraded":"2024-03-04T07:01:22.976197+0000","last_fullsized":"2024-03-04T07:01:22.976197+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019487+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T07:00:33.019487+0000","last_peered":"2024-03-04T07:00:33.019487+0000","last_clean":"2024-03-04T07:00:33.019487+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T07:00:33.019487+0000","last_undegraded":"2024-03-04T07:00:33.019487+0000","last_fullsized":"2024-03-04T07:00:33.019487+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020779+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T07:00:45.020779+0000","last_peered":"2024-03-04T07:00:45.020779+0000","last_clean":"2024-03-04T07:00:45.020779+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T07:00:45.020779+0000","last_undegraded":"2024-03-04T07:00:45.020779+0000","last_fullsized":"2024-03-04T07:00:45.020779+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:33.168023+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T06:59:33.168023+0000","last_peered":"2024-03-04T06:59:33.168023+0000","last_clean":"2024-03-04T06:59:33.168023+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T06:59:33.168023+0000","last_undegraded":"2024-03-04T06:59:33.168023+0000","last_fullsized":"2024-03-04T06:59:33.168023+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247852+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T07:00:18.247852+0000","last_peered":"2024-03-04T07:00:18.247852+0000","last_clean":"2024-03-04T07:00:18.247852+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T07:00:18.247852+0000","last_undegraded":"2024-03-04T07:00:18.247852+0000","last_fullsized":"2024-03-04T07:00:18.247852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020816+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T07:00:45.020816+0000","last_peered":"2024-03-04T07:00:45.020816+0000","last_clean":"2024-03-04T07:00:45.020816+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T07:00:45.020816+0000","last_undegraded":"2024-03-04T07:00:45.020816+0000","last_fullsized":"2024-03-04T07:00:45.020816+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.964990+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:59:42.964990+0000","last_peered":"2024-03-04T06:59:42.964990+0000","last_clean":"2024-03-04T06:59:42.964990+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:59:42.964990+0000","last_undegraded":"2024-03-04T06:59:42.964990+0000","last_fullsized":"2024-03-04T06:59:42.964990+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023709+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T07:01:15.023709+0000","last_peered":"2024-03-04T07:01:15.023709+0000","last_clean":"2024-03-04T07:01:15.023709+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T07:01:15.023709+0000","last_undegraded":"2024-03-04T07:01:15.023709+0000","last_fullsized":"2024-03-04T07:01:15.023709+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1122,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967529+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T07:00:07.967529+0000","last_peered":"2024-03-04T07:00:07.967529+0000","last_clean":"2024-03-04T07:00:07.967529+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T07:00:07.967529+0000","last_undegraded":"2024-03-04T07:00:07.967529+0000","last_fullsized":"2024-03-04T07:00:07.967529+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.012471+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T06:59:28.012471+0000","last_peered":"2024-03-04T06:59:28.012471+0000","last_clean":"2024-03-04T06:59:28.012471+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T06:59:28.012471+0000","last_undegraded":"2024-03-04T06:59:28.012471+0000","last_fullsized":"2024-03-04T06:59:28.012471+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:43.250705+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T07:00:43.250705+0000","last_peered":"2024-03-04T07:00:43.250705+0000","last_clean":"2024-03-04T07:00:43.250705+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T07:00:43.250705+0000","last_undegraded":"2024-03-04T07:00:43.250705+0000","last_fullsized":"2024-03-04T07:00:43.250705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503525,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648173,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142480,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287127,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997833,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885889,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937467,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792820,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:03:49.858 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:49.858 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:49.859 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:49.859 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:49.859 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:49.859 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:49.859 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:49.859 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:49.859 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:49.859 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:03:49.859 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:03:50.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:50 smithi137 ceph-mon[88869]: pgmap v1179: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:50.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:50 smithi137 ceph-mon[88869]: from='client.34737 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:03:50.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:50 smithi137 ceph-mon[91314]: pgmap v1179: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:50.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:50 smithi137 ceph-mon[91314]: from='client.34737 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:03:50.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:50 smithi203 ceph-mon[85573]: pgmap v1179: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:50.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:50 smithi203 ceph-mon[85573]: from='client.34737 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:03:52.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:52 smithi137 ceph-mon[88869]: pgmap v1180: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:52.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:52 smithi137 ceph-mon[91314]: pgmap v1180: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:52.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:52 smithi203 ceph-mon[85573]: pgmap v1180: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:53.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:53 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:03:53.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:53 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:03:53.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:53 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:03:54.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:54 smithi137 ceph-mon[88869]: pgmap v1181: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:54.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:54 smithi137 ceph-mon[91314]: pgmap v1181: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:54.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:54 smithi203 ceph-mon[85573]: pgmap v1181: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:55.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:03:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:03:55] "GET /metrics HTTP/1.1" 200 36336 "" "Prometheus/2.43.0" 2024-03-04T07:03:56.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:56 smithi137 ceph-mon[88869]: pgmap v1182: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:56.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:56 smithi137 ceph-mon[91314]: pgmap v1182: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:56.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:56 smithi203 ceph-mon[85573]: pgmap v1182: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:58.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:58 smithi137 ceph-mon[88869]: pgmap v1183: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:58.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:58 smithi137 ceph-mon[91314]: pgmap v1183: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:58.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:58 smithi203 ceph-mon[85573]: pgmap v1183: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:59.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:03:59 smithi137 ceph-mon[88869]: pgmap v1184: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:59.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:03:59 smithi137 ceph-mon[91314]: pgmap v1184: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:59.844 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:03:59 smithi203 ceph-mon[85573]: pgmap v1184: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:03:59.860 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:04:00.080 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:04:02.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:01 smithi137 ceph-mon[88869]: pgmap v1185: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:02.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:01 smithi137 ceph-mon[91314]: pgmap v1185: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:04:02.075 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:04:02.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:01 smithi203 ceph-mon[85573]: pgmap v1185: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:02.734 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1185,"stamp":"2024-03-04T07:04:00.623660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004417"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.564000+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T07:00:29.564000+0000","last_peered":"2024-03-04T07:00:29.564000+0000","last_clean":"2024-03-04T07:00:29.564000+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T07:00:29.564000+0000","last_undegraded":"2024-03-04T07:00:29.564000+0000","last_fullsized":"2024-03-04T07:00:29.564000+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178667+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T07:01:08.178667+0000","last_peered":"2024-03-04T07:01:08.178667+0000","last_clean":"2024-03-04T07:01:08.178667+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T07:01:08.178667+0000","last_undegraded":"2024-03-04T07:01:08.178667+0000","last_fullsized":"2024-03-04T07:01:08.178667+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019562+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T07:00:33.019562+0000","last_peered":"2024-03-04T07:00:33.019562+0000","last_clean":"2024-03-04T07:00:33.019562+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T07:00:33.019562+0000","last_undegraded":"2024-03-04T07:00:33.019562+0000","last_fullsized":"2024-03-04T07:00:33.019562+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1143,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:52.972434+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T07:00:52.972434+0000","last_peered":"2024-03-04T07:00:52.972434+0000","last_clean":"2024-03-04T07:00:52.972434+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T07:00:52.972434+0000","last_undegraded":"2024-03-04T07:00:52.972434+0000","last_fullsized":"2024-03-04T07:00:52.972434+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560949+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T07:00:04.560949+0000","last_peered":"2024-03-04T07:00:04.560949+0000","last_clean":"2024-03-04T07:00:04.560949+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T07:00:04.560949+0000","last_undegraded":"2024-03-04T07:00:04.560949+0000","last_fullsized":"2024-03-04T07:00:04.560949+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976210+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T07:01:22.976210+0000","last_peered":"2024-03-04T07:01:22.976210+0000","last_clean":"2024-03-04T07:01:22.976210+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T07:01:22.976210+0000","last_undegraded":"2024-03-04T07:01:22.976210+0000","last_fullsized":"2024-03-04T07:01:22.976210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560930+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T07:00:04.560930+0000","last_peered":"2024-03-04T07:00:04.560930+0000","last_clean":"2024-03-04T07:00:04.560930+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T07:00:04.560930+0000","last_undegraded":"2024-03-04T07:00:04.560930+0000","last_fullsized":"2024-03-04T07:00:04.560930+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017220+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T07:00:15.017220+0000","last_peered":"2024-03-04T07:00:15.017220+0000","last_clean":"2024-03-04T07:00:15.017220+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T07:00:15.017220+0000","last_undegraded":"2024-03-04T07:00:15.017220+0000","last_fullsized":"2024-03-04T07:00:15.017220+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1066,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558470+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:59:44.558470+0000","last_peered":"2024-03-04T06:59:44.558470+0000","last_clean":"2024-03-04T06:59:44.558470+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:59:44.558470+0000","last_undegraded":"2024-03-04T06:59:44.558470+0000","last_fullsized":"2024-03-04T06:59:44.558470+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256498+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T07:01:33.256498+0000","last_peered":"2024-03-04T07:01:33.256498+0000","last_clean":"2024-03-04T07:01:33.256498+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T07:01:33.256498+0000","last_undegraded":"2024-03-04T07:01:33.256498+0000","last_fullsized":"2024-03-04T07:01:33.256498+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256456+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T07:01:33.256456+0000","last_peered":"2024-03-04T07:01:33.256456+0000","last_clean":"2024-03-04T07:01:33.256456+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T07:01:33.256456+0000","last_undegraded":"2024-03-04T07:01:33.256456+0000","last_fullsized":"2024-03-04T07:01:33.256456+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:22.636361+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T07:00:22.636361+0000","last_peered":"2024-03-04T07:00:22.636361+0000","last_clean":"2024-03-04T07:00:22.636361+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T07:00:22.636361+0000","last_undegraded":"2024-03-04T07:00:22.636361+0000","last_fullsized":"2024-03-04T07:00:22.636361+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014730+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:59:50.014730+0000","last_peered":"2024-03-04T06:59:50.014730+0000","last_clean":"2024-03-04T06:59:50.014730+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:59:50.014730+0000","last_undegraded":"2024-03-04T06:59:50.014730+0000","last_fullsized":"2024-03-04T06:59:50.014730+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015553+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:59:58.015553+0000","last_peered":"2024-03-04T06:59:58.015553+0000","last_clean":"2024-03-04T06:59:58.015553+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:59:58.015553+0000","last_undegraded":"2024-03-04T06:59:58.015553+0000","last_fullsized":"2024-03-04T06:59:58.015553+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174897+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T07:00:33.174897+0000","last_peered":"2024-03-04T07:00:33.174897+0000","last_clean":"2024-03-04T07:00:33.174897+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T07:00:33.174897+0000","last_undegraded":"2024-03-04T07:00:33.174897+0000","last_fullsized":"2024-03-04T07:00:33.174897+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970309+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T07:00:32.970309+0000","last_peered":"2024-03-04T07:00:32.970309+0000","last_clean":"2024-03-04T07:00:32.970309+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T07:00:32.970309+0000","last_undegraded":"2024-03-04T07:00:32.970309+0000","last_fullsized":"2024-03-04T07:00:32.970309+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970400+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T07:00:32.970400+0000","last_peered":"2024-03-04T07:00:32.970400+0000","last_clean":"2024-03-04T07:00:32.970400+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T07:00:32.970400+0000","last_undegraded":"2024-03-04T07:00:32.970400+0000","last_fullsized":"2024-03-04T07:00:32.970400+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412366+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T07:01:08.412366+0000","last_peered":"2024-03-04T07:01:08.412366+0000","last_clean":"2024-03-04T07:01:08.412366+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T07:01:08.412366+0000","last_undegraded":"2024-03-04T07:01:08.412366+0000","last_fullsized":"2024-03-04T07:01:08.412366+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T07:01:19.569588+0000","last_peered":"2024-03-04T07:01:19.569588+0000","last_clean":"2024-03-04T07:01:19.569588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T07:01:19.569588+0000","last_undegraded":"2024-03-04T07:01:19.569588+0000","last_fullsized":"2024-03-04T07:01:19.569588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1307,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019623+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T07:00:33.019623+0000","last_peered":"2024-03-04T07:00:33.019623+0000","last_clean":"2024-03-04T07:00:33.019623+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T07:00:33.019623+0000","last_undegraded":"2024-03-04T07:00:33.019623+0000","last_fullsized":"2024-03-04T07:00:33.019623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1197,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026705+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T07:01:45.026705+0000","last_peered":"2024-03-04T07:01:45.026705+0000","last_clean":"2024-03-04T07:01:45.026705+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T07:01:45.026705+0000","last_undegraded":"2024-03-04T07:01:45.026705+0000","last_fullsized":"2024-03-04T07:01:45.026705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026715+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T07:01:45.026715+0000","last_peered":"2024-03-04T07:01:45.026715+0000","last_clean":"2024-03-04T07:01:45.026715+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T07:01:45.026715+0000","last_undegraded":"2024-03-04T07:01:45.026715+0000","last_fullsized":"2024-03-04T07:01:45.026715+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019611+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T07:00:33.019611+0000","last_peered":"2024-03-04T07:00:33.019611+0000","last_clean":"2024-03-04T07:00:33.019611+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T07:00:33.019611+0000","last_undegraded":"2024-03-04T07:00:33.019611+0000","last_fullsized":"2024-03-04T07:00:33.019611+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403128+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:59:38.403128+0000","last_peered":"2024-03-04T06:59:38.403128+0000","last_clean":"2024-03-04T06:59:38.403128+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:59:38.403128+0000","last_undegraded":"2024-03-04T06:59:38.403128+0000","last_fullsized":"2024-03-04T06:59:38.403128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1223,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403103+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:59:38.403103+0000","last_peered":"2024-03-04T06:59:38.403103+0000","last_clean":"2024-03-04T06:59:38.403103+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:59:38.403103+0000","last_undegraded":"2024-03-04T06:59:38.403103+0000","last_fullsized":"2024-03-04T06:59:38.403103+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560965+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T07:00:04.560965+0000","last_peered":"2024-03-04T07:00:04.560965+0000","last_clean":"2024-03-04T07:00:04.560965+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T07:00:04.560965+0000","last_undegraded":"2024-03-04T07:00:04.560965+0000","last_fullsized":"2024-03-04T07:00:04.560965+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976241+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T07:01:22.976241+0000","last_peered":"2024-03-04T07:01:22.976241+0000","last_clean":"2024-03-04T07:01:22.976241+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T07:01:22.976241+0000","last_undegraded":"2024-03-04T07:01:22.976241+0000","last_fullsized":"2024-03-04T07:01:22.976241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017274+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T07:00:15.017274+0000","last_peered":"2024-03-04T07:00:15.017274+0000","last_clean":"2024-03-04T07:00:15.017274+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T07:00:15.017274+0000","last_undegraded":"2024-03-04T07:00:15.017274+0000","last_fullsized":"2024-03-04T07:00:15.017274+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1191,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639127+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T07:00:47.639127+0000","last_peered":"2024-03-04T07:00:47.639127+0000","last_clean":"2024-03-04T07:00:47.639127+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T07:00:47.639127+0000","last_undegraded":"2024-03-04T07:00:47.639127+0000","last_fullsized":"2024-03-04T07:00:47.639127+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.241598+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:59:28.241598+0000","last_peered":"2024-03-04T06:59:28.241598+0000","last_clean":"2024-03-04T06:59:28.241598+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:59:28.241598+0000","last_undegraded":"2024-03-04T06:59:28.241598+0000","last_fullsized":"2024-03-04T06:59:28.241598+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:58.022394+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T07:00:58.022394+0000","last_peered":"2024-03-04T07:00:58.022394+0000","last_clean":"2024-03-04T07:00:58.022394+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T07:00:58.022394+0000","last_undegraded":"2024-03-04T07:00:58.022394+0000","last_fullsized":"2024-03-04T07:00:58.022394+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014712+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:59:50.014712+0000","last_peered":"2024-03-04T06:59:50.014712+0000","last_clean":"2024-03-04T06:59:50.014712+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:59:50.014712+0000","last_undegraded":"2024-03-04T06:59:50.014712+0000","last_fullsized":"2024-03-04T06:59:50.014712+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014675+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:59:50.014675+0000","last_peered":"2024-03-04T06:59:50.014675+0000","last_clean":"2024-03-04T06:59:50.014675+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:59:50.014675+0000","last_undegraded":"2024-03-04T06:59:50.014675+0000","last_fullsized":"2024-03-04T06:59:50.014675+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973153+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T07:00:57.973153+0000","last_peered":"2024-03-04T07:00:57.973153+0000","last_clean":"2024-03-04T07:00:57.973153+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T07:00:57.973153+0000","last_undegraded":"2024-03-04T07:00:57.973153+0000","last_fullsized":"2024-03-04T07:00:57.973153+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178000+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T07:01:03.178000+0000","last_peered":"2024-03-04T07:01:03.178000+0000","last_clean":"2024-03-04T07:01:03.178000+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T07:01:03.178000+0000","last_undegraded":"2024-03-04T07:01:03.178000+0000","last_fullsized":"2024-03-04T07:01:03.178000+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256513+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T07:01:33.256513+0000","last_peered":"2024-03-04T07:01:33.256513+0000","last_clean":"2024-03-04T07:01:33.256513+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T07:01:33.256513+0000","last_undegraded":"2024-03-04T07:01:33.256513+0000","last_fullsized":"2024-03-04T07:01:33.256513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973230+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T07:00:57.973230+0000","last_peered":"2024-03-04T07:00:57.973230+0000","last_clean":"2024-03-04T07:00:57.973230+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T07:00:57.973230+0000","last_undegraded":"2024-03-04T07:00:57.973230+0000","last_fullsized":"2024-03-04T07:00:57.973230+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973215+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T07:00:57.973215+0000","last_peered":"2024-03-04T07:00:57.973215+0000","last_clean":"2024-03-04T07:00:57.973215+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T07:00:57.973215+0000","last_undegraded":"2024-03-04T07:00:57.973215+0000","last_fullsized":"2024-03-04T07:00:57.973215+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:28.018729+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T07:00:28.018729+0000","last_peered":"2024-03-04T07:00:28.018729+0000","last_clean":"2024-03-04T07:00:28.018729+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T07:00:28.018729+0000","last_undegraded":"2024-03-04T07:00:28.018729+0000","last_fullsized":"2024-03-04T07:00:28.018729+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178037+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T07:01:03.178037+0000","last_peered":"2024-03-04T07:01:03.178037+0000","last_clean":"2024-03-04T07:01:03.178037+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T07:01:03.178037+0000","last_undegraded":"2024-03-04T07:01:03.178037+0000","last_fullsized":"2024-03-04T07:01:03.178037+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:57.633964+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:59:57.633964+0000","last_peered":"2024-03-04T06:59:57.633964+0000","last_clean":"2024-03-04T06:59:57.633964+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:59:57.633964+0000","last_undegraded":"2024-03-04T06:59:57.633964+0000","last_fullsized":"2024-03-04T06:59:57.633964+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1132,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253574+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T07:01:08.253574+0000","last_peered":"2024-03-04T07:01:08.253574+0000","last_clean":"2024-03-04T07:01:08.253574+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T07:01:08.253574+0000","last_undegraded":"2024-03-04T07:01:08.253574+0000","last_fullsized":"2024-03-04T07:01:08.253574+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558443+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:59:44.558443+0000","last_peered":"2024-03-04T06:59:44.558443+0000","last_clean":"2024-03-04T06:59:44.558443+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:59:44.558443+0000","last_undegraded":"2024-03-04T06:59:44.558443+0000","last_fullsized":"2024-03-04T06:59:44.558443+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015596+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:59:58.015596+0000","last_peered":"2024-03-04T06:59:58.015596+0000","last_clean":"2024-03-04T06:59:58.015596+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:59:58.015596+0000","last_undegraded":"2024-03-04T06:59:58.015596+0000","last_fullsized":"2024-03-04T06:59:58.015596+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412330+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T07:01:08.412330+0000","last_peered":"2024-03-04T07:01:08.412330+0000","last_clean":"2024-03-04T07:01:08.412330+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T07:01:08.412330+0000","last_undegraded":"2024-03-04T07:01:08.412330+0000","last_fullsized":"2024-03-04T07:01:08.412330+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970340+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T07:00:32.970340+0000","last_peered":"2024-03-04T07:00:32.970340+0000","last_clean":"2024-03-04T07:00:32.970340+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T07:00:32.970340+0000","last_undegraded":"2024-03-04T07:00:32.970340+0000","last_fullsized":"2024-03-04T07:00:32.970340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555834+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T06:59:24.555834+0000","last_peered":"2024-03-04T06:59:24.555834+0000","last_clean":"2024-03-04T06:59:24.555834+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T06:59:24.555834+0000","last_undegraded":"2024-03-04T06:59:24.555834+0000","last_fullsized":"2024-03-04T06:59:24.555834+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1104,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253553+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T07:01:08.253553+0000","last_peered":"2024-03-04T07:01:08.253553+0000","last_clean":"2024-03-04T07:01:08.253553+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T07:01:08.253553+0000","last_undegraded":"2024-03-04T07:01:08.253553+0000","last_fullsized":"2024-03-04T07:01:08.253553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253528+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T07:01:08.253528+0000","last_peered":"2024-03-04T07:01:08.253528+0000","last_clean":"2024-03-04T07:01:08.253528+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T07:01:08.253528+0000","last_undegraded":"2024-03-04T07:01:08.253528+0000","last_fullsized":"2024-03-04T07:01:08.253528+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412282+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T07:01:08.412282+0000","last_peered":"2024-03-04T07:01:08.412282+0000","last_clean":"2024-03-04T07:01:08.412282+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T07:01:08.412282+0000","last_undegraded":"2024-03-04T07:01:08.412282+0000","last_fullsized":"2024-03-04T07:01:08.412282+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:24.555799+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T06:59:24.555799+0000","last_peered":"2024-03-04T06:59:24.555799+0000","last_clean":"2024-03-04T06:59:24.555799+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T06:59:24.555799+0000","last_undegraded":"2024-03-04T06:59:24.555799+0000","last_fullsized":"2024-03-04T06:59:24.555799+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3579,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405911+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:00:08.405911+0000","last_peered":"2024-03-04T07:00:08.405911+0000","last_clean":"2024-03-04T07:00:08.405911+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:00:08.405911+0000","last_undegraded":"2024-03-04T07:00:08.405911+0000","last_fullsized":"2024-03-04T07:00:08.405911+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:32.631361+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T06:59:32.631361+0000","last_peered":"2024-03-04T06:59:32.631361+0000","last_clean":"2024-03-04T06:59:32.631361+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T06:59:32.631361+0000","last_undegraded":"2024-03-04T06:59:32.631361+0000","last_fullsized":"2024-03-04T06:59:32.631361+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T07:01:19.569613+0000","last_peered":"2024-03-04T07:01:19.569613+0000","last_clean":"2024-03-04T07:01:19.569613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T07:01:19.569613+0000","last_undegraded":"2024-03-04T07:01:19.569613+0000","last_fullsized":"2024-03-04T07:01:19.569613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17118,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019514+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T07:00:33.019514+0000","last_peered":"2024-03-04T07:00:33.019514+0000","last_clean":"2024-03-04T07:00:33.019514+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T07:00:33.019514+0000","last_undegraded":"2024-03-04T07:00:33.019514+0000","last_fullsized":"2024-03-04T07:00:33.019514+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178538+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T07:01:08.178538+0000","last_peered":"2024-03-04T07:01:08.178538+0000","last_clean":"2024-03-04T07:01:08.178538+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T07:01:08.178538+0000","last_undegraded":"2024-03-04T07:01:08.178538+0000","last_fullsized":"2024-03-04T07:01:08.178538+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178614+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T07:01:08.178614+0000","last_peered":"2024-03-04T07:01:08.178614+0000","last_clean":"2024-03-04T07:01:08.178614+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T07:01:08.178614+0000","last_undegraded":"2024-03-04T07:01:08.178614+0000","last_fullsized":"2024-03-04T07:01:08.178614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976230+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T07:01:22.976230+0000","last_peered":"2024-03-04T07:01:22.976230+0000","last_clean":"2024-03-04T07:01:22.976230+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T07:01:22.976230+0000","last_undegraded":"2024-03-04T07:01:22.976230+0000","last_fullsized":"2024-03-04T07:01:22.976230+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4388,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019581+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T07:00:33.019581+0000","last_peered":"2024-03-04T07:00:33.019581+0000","last_clean":"2024-03-04T07:00:33.019581+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T07:00:33.019581+0000","last_undegraded":"2024-03-04T07:00:33.019581+0000","last_fullsized":"2024-03-04T07:00:33.019581+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178564+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T07:01:08.178564+0000","last_peered":"2024-03-04T07:01:08.178564+0000","last_clean":"2024-03-04T07:01:08.178564+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T07:01:08.178564+0000","last_undegraded":"2024-03-04T07:01:08.178564+0000","last_fullsized":"2024-03-04T07:01:08.178564+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976151+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T07:01:22.976151+0000","last_peered":"2024-03-04T07:01:22.976151+0000","last_clean":"2024-03-04T07:01:22.976151+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T07:01:22.976151+0000","last_undegraded":"2024-03-04T07:01:22.976151+0000","last_fullsized":"2024-03-04T07:01:22.976151+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639139+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T07:00:47.639139+0000","last_peered":"2024-03-04T07:00:47.639139+0000","last_clean":"2024-03-04T07:00:47.639139+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T07:00:47.639139+0000","last_undegraded":"2024-03-04T07:00:47.639139+0000","last_fullsized":"2024-03-04T07:00:47.639139+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5641,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.406020+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:00:08.406020+0000","last_peered":"2024-03-04T07:00:08.406020+0000","last_clean":"2024-03-04T07:00:08.406020+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:00:08.406020+0000","last_undegraded":"2024-03-04T07:00:08.406020+0000","last_fullsized":"2024-03-04T07:00:08.406020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182480+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T07:01:43.182480+0000","last_peered":"2024-03-04T07:01:43.182480+0000","last_clean":"2024-03-04T07:01:43.182480+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T07:01:43.182480+0000","last_undegraded":"2024-03-04T07:01:43.182480+0000","last_fullsized":"2024-03-04T07:01:43.182480+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174867+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T07:00:33.174867+0000","last_peered":"2024-03-04T07:00:33.174867+0000","last_clean":"2024-03-04T07:00:33.174867+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T07:00:33.174867+0000","last_undegraded":"2024-03-04T07:00:33.174867+0000","last_fullsized":"2024-03-04T07:00:33.174867+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416777+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T07:01:43.416777+0000","last_peered":"2024-03-04T07:01:43.416777+0000","last_clean":"2024-03-04T07:01:43.416777+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T07:01:43.416777+0000","last_undegraded":"2024-03-04T07:01:43.416777+0000","last_fullsized":"2024-03-04T07:01:43.416777+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4017,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:29.563935+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T07:00:29.563935+0000","last_peered":"2024-03-04T07:00:29.563935+0000","last_clean":"2024-03-04T07:00:29.563935+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T07:00:29.563935+0000","last_undegraded":"2024-03-04T07:00:29.563935+0000","last_fullsized":"2024-03-04T07:00:29.563935+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1093,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244731+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T06:59:53.244731+0000","last_peered":"2024-03-04T06:59:53.244731+0000","last_clean":"2024-03-04T06:59:53.244731+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T06:59:53.244731+0000","last_undegraded":"2024-03-04T06:59:53.244731+0000","last_fullsized":"2024-03-04T06:59:53.244731+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017258+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T07:00:15.017258+0000","last_peered":"2024-03-04T07:00:15.017258+0000","last_clean":"2024-03-04T07:00:15.017258+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T07:00:15.017258+0000","last_undegraded":"2024-03-04T07:00:15.017258+0000","last_fullsized":"2024-03-04T07:00:15.017258+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1150,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976219+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T07:01:22.976219+0000","last_peered":"2024-03-04T07:01:22.976219+0000","last_clean":"2024-03-04T07:01:22.976219+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T07:01:22.976219+0000","last_undegraded":"2024-03-04T07:01:22.976219+0000","last_fullsized":"2024-03-04T07:01:22.976219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1552,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560890+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:00:04.560890+0000","last_peered":"2024-03-04T07:00:04.560890+0000","last_clean":"2024-03-04T07:00:04.560890+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:00:04.560890+0000","last_undegraded":"2024-03-04T07:00:04.560890+0000","last_fullsized":"2024-03-04T07:00:04.560890+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3952,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.965034+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T06:59:42.965034+0000","last_peered":"2024-03-04T06:59:42.965034+0000","last_clean":"2024-03-04T06:59:42.965034+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T06:59:42.965034+0000","last_undegraded":"2024-03-04T06:59:42.965034+0000","last_fullsized":"2024-03-04T06:59:42.965034+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023391+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T07:01:08.023391+0000","last_peered":"2024-03-04T07:01:08.023391+0000","last_clean":"2024-03-04T07:01:08.023391+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T07:01:08.023391+0000","last_undegraded":"2024-03-04T07:01:08.023391+0000","last_fullsized":"2024-03-04T07:01:08.023391+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416752+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T07:01:43.416752+0000","last_peered":"2024-03-04T07:01:43.416752+0000","last_clean":"2024-03-04T07:01:43.416752+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T07:01:43.416752+0000","last_undegraded":"2024-03-04T07:01:43.416752+0000","last_fullsized":"2024-03-04T07:01:43.416752+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560852+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:00:04.560852+0000","last_peered":"2024-03-04T07:00:04.560852+0000","last_clean":"2024-03-04T07:00:04.560852+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:00:04.560852+0000","last_undegraded":"2024-03-04T07:00:04.560852+0000","last_fullsized":"2024-03-04T07:00:04.560852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15293,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:53.244696+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T06:59:53.244696+0000","last_peered":"2024-03-04T06:59:53.244696+0000","last_clean":"2024-03-04T06:59:53.244696+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T06:59:53.244696+0000","last_undegraded":"2024-03-04T06:59:53.244696+0000","last_fullsized":"2024-03-04T06:59:53.244696+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019541+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T07:00:33.019541+0000","last_peered":"2024-03-04T07:00:33.019541+0000","last_clean":"2024-03-04T07:00:33.019541+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T07:00:33.019541+0000","last_undegraded":"2024-03-04T07:00:33.019541+0000","last_fullsized":"2024-03-04T07:00:33.019541+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1075,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.563983+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T07:00:29.563983+0000","last_peered":"2024-03-04T07:00:29.563983+0000","last_clean":"2024-03-04T07:00:29.563983+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T07:00:29.563983+0000","last_undegraded":"2024-03-04T07:00:29.563983+0000","last_fullsized":"2024-03-04T07:00:29.563983+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178580+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T07:01:08.178580+0000","last_peered":"2024-03-04T07:01:08.178580+0000","last_clean":"2024-03-04T07:01:08.178580+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T07:01:08.178580+0000","last_undegraded":"2024-03-04T07:01:08.178580+0000","last_fullsized":"2024-03-04T07:01:08.178580+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4381,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:47.639101+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T07:00:47.639101+0000","last_peered":"2024-03-04T07:00:47.639101+0000","last_clean":"2024-03-04T07:00:47.639101+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T07:00:47.639101+0000","last_undegraded":"2024-03-04T07:00:47.639101+0000","last_fullsized":"2024-03-04T07:00:47.639101+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026676+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T07:01:45.026676+0000","last_peered":"2024-03-04T07:01:45.026676+0000","last_clean":"2024-03-04T07:01:45.026676+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T07:01:45.026676+0000","last_undegraded":"2024-03-04T07:01:45.026676+0000","last_fullsized":"2024-03-04T07:01:45.026676+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1271,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182470+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T07:01:43.182470+0000","last_peered":"2024-03-04T07:01:43.182470+0000","last_clean":"2024-03-04T07:01:43.182470+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T07:01:43.182470+0000","last_undegraded":"2024-03-04T07:01:43.182470+0000","last_fullsized":"2024-03-04T07:01:43.182470+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020800+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T07:00:45.020800+0000","last_peered":"2024-03-04T07:00:45.020800+0000","last_clean":"2024-03-04T07:00:45.020800+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T07:00:45.020800+0000","last_undegraded":"2024-03-04T07:00:45.020800+0000","last_fullsized":"2024-03-04T07:00:45.020800+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4612,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:45.026591+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T07:01:45.026591+0000","last_peered":"2024-03-04T07:01:45.026591+0000","last_clean":"2024-03-04T07:01:45.026591+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T07:01:45.026591+0000","last_undegraded":"2024-03-04T07:01:45.026591+0000","last_fullsized":"2024-03-04T07:01:45.026591+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639077+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T07:00:47.639077+0000","last_peered":"2024-03-04T07:00:47.639077+0000","last_clean":"2024-03-04T07:00:47.639077+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T07:00:47.639077+0000","last_undegraded":"2024-03-04T07:00:47.639077+0000","last_fullsized":"2024-03-04T07:00:47.639077+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1080,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247864+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T07:00:18.247864+0000","last_peered":"2024-03-04T07:00:18.247864+0000","last_clean":"2024-03-04T07:00:18.247864+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T07:00:18.247864+0000","last_undegraded":"2024-03-04T07:00:18.247864+0000","last_fullsized":"2024-03-04T07:00:18.247864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023341+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T07:01:08.023341+0000","last_peered":"2024-03-04T07:01:08.023341+0000","last_clean":"2024-03-04T07:01:08.023341+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T07:01:08.023341+0000","last_undegraded":"2024-03-04T07:01:08.023341+0000","last_fullsized":"2024-03-04T07:01:08.023341+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4636,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:07.967606+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T07:00:07.967606+0000","last_peered":"2024-03-04T07:00:07.967606+0000","last_clean":"2024-03-04T07:00:07.967606+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T07:00:07.967606+0000","last_undegraded":"2024-03-04T07:00:07.967606+0000","last_fullsized":"2024-03-04T07:00:07.967606+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:54.566566+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T07:00:54.566566+0000","last_peered":"2024-03-04T07:00:54.566566+0000","last_clean":"2024-03-04T07:00:54.566566+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T07:00:54.566566+0000","last_undegraded":"2024-03-04T07:00:54.566566+0000","last_fullsized":"2024-03-04T07:00:54.566566+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1187,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:17.642331+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T07:01:17.642331+0000","last_peered":"2024-03-04T07:01:17.642331+0000","last_clean":"2024-03-04T07:01:17.642331+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T07:01:17.642331+0000","last_undegraded":"2024-03-04T07:01:17.642331+0000","last_fullsized":"2024-03-04T07:01:17.642331+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5159,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T06:59:32.631317+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T06:59:32.631317+0000","last_peered":"2024-03-04T06:59:32.631317+0000","last_clean":"2024-03-04T06:59:32.631317+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T06:59:32.631317+0000","last_undegraded":"2024-03-04T06:59:32.631317+0000","last_fullsized":"2024-03-04T06:59:32.631317+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182417+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T07:01:43.182417+0000","last_peered":"2024-03-04T07:01:43.182417+0000","last_clean":"2024-03-04T07:01:43.182417+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T07:01:43.182417+0000","last_undegraded":"2024-03-04T07:01:43.182417+0000","last_fullsized":"2024-03-04T07:01:43.182417+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020733+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T07:00:45.020733+0000","last_peered":"2024-03-04T07:00:45.020733+0000","last_clean":"2024-03-04T07:00:45.020733+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T07:00:45.020733+0000","last_undegraded":"2024-03-04T07:00:45.020733+0000","last_fullsized":"2024-03-04T07:00:45.020733+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4721,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409468+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T07:00:38.409468+0000","last_peered":"2024-03-04T07:00:38.409468+0000","last_clean":"2024-03-04T07:00:38.409468+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T07:00:38.409468+0000","last_undegraded":"2024-03-04T07:00:38.409468+0000","last_fullsized":"2024-03-04T07:00:38.409468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182435+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T07:01:43.182435+0000","last_peered":"2024-03-04T07:01:43.182435+0000","last_clean":"2024-03-04T07:01:43.182435+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T07:01:43.182435+0000","last_undegraded":"2024-03-04T07:01:43.182435+0000","last_fullsized":"2024-03-04T07:01:43.182435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023738+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T07:01:15.023738+0000","last_peered":"2024-03-04T07:01:15.023738+0000","last_clean":"2024-03-04T07:01:15.023738+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T07:01:15.023738+0000","last_undegraded":"2024-03-04T07:01:15.023738+0000","last_fullsized":"2024-03-04T07:01:15.023738+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5556,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:03.171266+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:00:03.171266+0000","last_peered":"2024-03-04T07:00:03.171266+0000","last_clean":"2024-03-04T07:00:03.171266+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:00:03.171266+0000","last_undegraded":"2024-03-04T07:00:03.171266+0000","last_fullsized":"2024-03-04T07:00:03.171266+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T07:01:19.569554+0000","last_peered":"2024-03-04T07:01:19.569554+0000","last_clean":"2024-03-04T07:01:19.569554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T07:01:19.569554+0000","last_undegraded":"2024-03-04T07:01:19.569554+0000","last_fullsized":"2024-03-04T07:01:19.569554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247800+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T07:00:18.247800+0000","last_peered":"2024-03-04T07:00:18.247800+0000","last_clean":"2024-03-04T07:00:18.247800+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T07:00:18.247800+0000","last_undegraded":"2024-03-04T07:00:18.247800+0000","last_fullsized":"2024-03-04T07:00:18.247800+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409421+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T07:00:38.409421+0000","last_peered":"2024-03-04T07:00:38.409421+0000","last_clean":"2024-03-04T07:00:38.409421+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T07:00:38.409421+0000","last_undegraded":"2024-03-04T07:00:38.409421+0000","last_fullsized":"2024-03-04T07:00:38.409421+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409457+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T07:00:38.409457+0000","last_peered":"2024-03-04T07:00:38.409457+0000","last_clean":"2024-03-04T07:00:38.409457+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T07:00:38.409457+0000","last_undegraded":"2024-03-04T07:00:38.409457+0000","last_fullsized":"2024-03-04T07:00:38.409457+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T07:01:19.569599+0000","last_peered":"2024-03-04T07:01:19.569599+0000","last_clean":"2024-03-04T07:01:19.569599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T07:01:19.569599+0000","last_undegraded":"2024-03-04T07:01:19.569599+0000","last_fullsized":"2024-03-04T07:01:19.569599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4368,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405967+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:00:08.405967+0000","last_peered":"2024-03-04T07:00:08.405967+0000","last_clean":"2024-03-04T07:00:08.405967+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:00:08.405967+0000","last_undegraded":"2024-03-04T07:00:08.405967+0000","last_fullsized":"2024-03-04T07:00:08.405967+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:03.171315+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:00:03.171315+0000","last_peered":"2024-03-04T07:00:03.171315+0000","last_clean":"2024-03-04T07:00:03.171315+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:00:03.171315+0000","last_undegraded":"2024-03-04T07:00:03.171315+0000","last_fullsized":"2024-03-04T07:00:03.171315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967580+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T07:00:07.967580+0000","last_peered":"2024-03-04T07:00:07.967580+0000","last_clean":"2024-03-04T07:00:07.967580+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T07:00:07.967580+0000","last_undegraded":"2024-03-04T07:00:07.967580+0000","last_fullsized":"2024-03-04T07:00:07.967580+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4602,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:54.566603+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T07:00:54.566603+0000","last_peered":"2024-03-04T07:00:54.566603+0000","last_clean":"2024-03-04T07:00:54.566603+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T07:00:54.566603+0000","last_undegraded":"2024-03-04T07:00:54.566603+0000","last_fullsized":"2024-03-04T07:00:54.566603+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1247,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409492+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T07:00:38.409492+0000","last_peered":"2024-03-04T07:00:38.409492+0000","last_clean":"2024-03-04T07:00:38.409492+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T07:00:38.409492+0000","last_undegraded":"2024-03-04T07:00:38.409492+0000","last_fullsized":"2024-03-04T07:00:38.409492+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569626+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T07:01:19.569626+0000","last_peered":"2024-03-04T07:01:19.569626+0000","last_clean":"2024-03-04T07:01:19.569626+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T07:01:19.569626+0000","last_undegraded":"2024-03-04T07:01:19.569626+0000","last_fullsized":"2024-03-04T07:01:19.569626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:53.244661+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T06:59:53.244661+0000","last_peered":"2024-03-04T06:59:53.244661+0000","last_clean":"2024-03-04T06:59:53.244661+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T06:59:53.244661+0000","last_undegraded":"2024-03-04T06:59:53.244661+0000","last_fullsized":"2024-03-04T06:59:53.244661+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416787+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T07:01:43.416787+0000","last_peered":"2024-03-04T07:01:43.416787+0000","last_clean":"2024-03-04T07:01:43.416787+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T07:01:43.416787+0000","last_undegraded":"2024-03-04T07:01:43.416787+0000","last_fullsized":"2024-03-04T07:01:43.416787+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976197+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T07:01:22.976197+0000","last_peered":"2024-03-04T07:01:22.976197+0000","last_clean":"2024-03-04T07:01:22.976197+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T07:01:22.976197+0000","last_undegraded":"2024-03-04T07:01:22.976197+0000","last_fullsized":"2024-03-04T07:01:22.976197+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019487+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T07:00:33.019487+0000","last_peered":"2024-03-04T07:00:33.019487+0000","last_clean":"2024-03-04T07:00:33.019487+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T07:00:33.019487+0000","last_undegraded":"2024-03-04T07:00:33.019487+0000","last_fullsized":"2024-03-04T07:00:33.019487+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020779+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T07:00:45.020779+0000","last_peered":"2024-03-04T07:00:45.020779+0000","last_clean":"2024-03-04T07:00:45.020779+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T07:00:45.020779+0000","last_undegraded":"2024-03-04T07:00:45.020779+0000","last_fullsized":"2024-03-04T07:00:45.020779+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182456+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T07:01:43.182456+0000","last_peered":"2024-03-04T07:01:43.182456+0000","last_clean":"2024-03-04T07:01:43.182456+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T07:01:43.182456+0000","last_undegraded":"2024-03-04T07:01:43.182456+0000","last_fullsized":"2024-03-04T07:01:43.182456+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247852+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T07:00:18.247852+0000","last_peered":"2024-03-04T07:00:18.247852+0000","last_clean":"2024-03-04T07:00:18.247852+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T07:00:18.247852+0000","last_undegraded":"2024-03-04T07:00:18.247852+0000","last_fullsized":"2024-03-04T07:00:18.247852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020816+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T07:00:45.020816+0000","last_peered":"2024-03-04T07:00:45.020816+0000","last_clean":"2024-03-04T07:00:45.020816+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T07:00:45.020816+0000","last_undegraded":"2024-03-04T07:00:45.020816+0000","last_fullsized":"2024-03-04T07:00:45.020816+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1147,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:42.964990+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T06:59:42.964990+0000","last_peered":"2024-03-04T06:59:42.964990+0000","last_clean":"2024-03-04T06:59:42.964990+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T06:59:42.964990+0000","last_undegraded":"2024-03-04T06:59:42.964990+0000","last_fullsized":"2024-03-04T06:59:42.964990+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023709+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T07:01:15.023709+0000","last_peered":"2024-03-04T07:01:15.023709+0000","last_clean":"2024-03-04T07:01:15.023709+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T07:01:15.023709+0000","last_undegraded":"2024-03-04T07:01:15.023709+0000","last_fullsized":"2024-03-04T07:01:15.023709+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1122,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967529+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T07:00:07.967529+0000","last_peered":"2024-03-04T07:00:07.967529+0000","last_clean":"2024-03-04T07:00:07.967529+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T07:00:07.967529+0000","last_undegraded":"2024-03-04T07:00:07.967529+0000","last_fullsized":"2024-03-04T07:00:07.967529+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.026774+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T07:01:43.026774+0000","last_peered":"2024-03-04T07:01:43.026774+0000","last_clean":"2024-03-04T07:01:43.026774+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T07:01:43.026774+0000","last_undegraded":"2024-03-04T07:01:43.026774+0000","last_fullsized":"2024-03-04T07:01:43.026774+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:43.250705+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T07:00:43.250705+0000","last_peered":"2024-03-04T07:00:43.250705+0000","last_clean":"2024-03-04T07:00:43.250705+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T07:00:43.250705+0000","last_undegraded":"2024-03-04T07:00:43.250705+0000","last_fullsized":"2024-03-04T07:00:43.250705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503528,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648175,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142482,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287129,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997835,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885892,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937469,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792822,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:04:02.739 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:02.739 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:02.739 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:02.739 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:02.739 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:02.739 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:02.739 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:02.739 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:02.739 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:02.739 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:02.739 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:04:03.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:02 smithi137 ceph-mon[88869]: from='client.34743 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:03.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:02 smithi137 ceph-mon[91314]: from='client.34743 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:03.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:02 smithi203 ceph-mon[85573]: from='client.34743 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:04.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:03 smithi137 ceph-mon[88869]: pgmap v1186: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:04.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:03 smithi137 ceph-mon[91314]: pgmap v1186: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:04.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:03 smithi203 ceph-mon[85573]: pgmap v1186: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:05.689 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:04:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:04:05] "GET /metrics HTTP/1.1" 200 36336 "" "Prometheus/2.43.0" 2024-03-04T07:04:06.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:05 smithi137 ceph-mon[88869]: pgmap v1187: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:06.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:05 smithi137 ceph-mon[91314]: pgmap v1187: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:06.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:05 smithi203 ceph-mon[85573]: pgmap v1187: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:08.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:07 smithi137 ceph-mon[88869]: pgmap v1188: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:08.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:07 smithi137 ceph-mon[91314]: pgmap v1188: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:08.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:07 smithi203 ceph-mon[85573]: pgmap v1188: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:09.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:08 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:04:09.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:08 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:04:09.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:08 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:04:10.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:09 smithi137 ceph-mon[88869]: pgmap v1189: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:10.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:09 smithi137 ceph-mon[91314]: pgmap v1189: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:10.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:09 smithi203 ceph-mon[85573]: pgmap v1189: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:12.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:11 smithi137 ceph-mon[88869]: pgmap v1190: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:12.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:11 smithi137 ceph-mon[91314]: pgmap v1190: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:12.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:11 smithi203 ceph-mon[85573]: pgmap v1190: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:12.740 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:04:12.956 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:04:14.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:13 smithi137 ceph-mon[88869]: pgmap v1191: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:14.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:13 smithi137 ceph-mon[91314]: pgmap v1191: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:14.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:13 smithi203 ceph-mon[85573]: pgmap v1191: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:15.009 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:04:15.011 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:04:15.584 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:04:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:04:15] "GET /metrics HTTP/1.1" 200 36333 "" "Prometheus/2.43.0" 2024-03-04T07:04:15.605 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1192,"stamp":"2024-03-04T07:04:14.627992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003796"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.564000+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T07:00:29.564000+0000","last_peered":"2024-03-04T07:00:29.564000+0000","last_clean":"2024-03-04T07:00:29.564000+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T07:00:29.564000+0000","last_undegraded":"2024-03-04T07:00:29.564000+0000","last_fullsized":"2024-03-04T07:00:29.564000+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178667+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T07:01:08.178667+0000","last_peered":"2024-03-04T07:01:08.178667+0000","last_clean":"2024-03-04T07:01:08.178667+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T07:01:08.178667+0000","last_undegraded":"2024-03-04T07:01:08.178667+0000","last_fullsized":"2024-03-04T07:01:08.178667+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019562+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T07:00:33.019562+0000","last_peered":"2024-03-04T07:00:33.019562+0000","last_clean":"2024-03-04T07:00:33.019562+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T07:00:33.019562+0000","last_undegraded":"2024-03-04T07:00:33.019562+0000","last_fullsized":"2024-03-04T07:00:33.019562+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1143,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:52.972434+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T07:00:52.972434+0000","last_peered":"2024-03-04T07:00:52.972434+0000","last_clean":"2024-03-04T07:00:52.972434+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T07:00:52.972434+0000","last_undegraded":"2024-03-04T07:00:52.972434+0000","last_fullsized":"2024-03-04T07:00:52.972434+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560949+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T07:00:04.560949+0000","last_peered":"2024-03-04T07:00:04.560949+0000","last_clean":"2024-03-04T07:00:04.560949+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T07:00:04.560949+0000","last_undegraded":"2024-03-04T07:00:04.560949+0000","last_fullsized":"2024-03-04T07:00:04.560949+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976210+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T07:01:22.976210+0000","last_peered":"2024-03-04T07:01:22.976210+0000","last_clean":"2024-03-04T07:01:22.976210+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T07:01:22.976210+0000","last_undegraded":"2024-03-04T07:01:22.976210+0000","last_fullsized":"2024-03-04T07:01:22.976210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560930+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T07:00:04.560930+0000","last_peered":"2024-03-04T07:00:04.560930+0000","last_clean":"2024-03-04T07:00:04.560930+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T07:00:04.560930+0000","last_undegraded":"2024-03-04T07:00:04.560930+0000","last_fullsized":"2024-03-04T07:00:04.560930+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017220+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T07:00:15.017220+0000","last_peered":"2024-03-04T07:00:15.017220+0000","last_clean":"2024-03-04T07:00:15.017220+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T07:00:15.017220+0000","last_undegraded":"2024-03-04T07:00:15.017220+0000","last_fullsized":"2024-03-04T07:00:15.017220+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1066,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558470+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:59:44.558470+0000","last_peered":"2024-03-04T06:59:44.558470+0000","last_clean":"2024-03-04T06:59:44.558470+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:59:44.558470+0000","last_undegraded":"2024-03-04T06:59:44.558470+0000","last_fullsized":"2024-03-04T06:59:44.558470+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256498+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T07:01:33.256498+0000","last_peered":"2024-03-04T07:01:33.256498+0000","last_clean":"2024-03-04T07:01:33.256498+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T07:01:33.256498+0000","last_undegraded":"2024-03-04T07:01:33.256498+0000","last_fullsized":"2024-03-04T07:01:33.256498+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256456+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T07:01:33.256456+0000","last_peered":"2024-03-04T07:01:33.256456+0000","last_clean":"2024-03-04T07:01:33.256456+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T07:01:33.256456+0000","last_undegraded":"2024-03-04T07:01:33.256456+0000","last_fullsized":"2024-03-04T07:01:33.256456+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:22.636361+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T07:00:22.636361+0000","last_peered":"2024-03-04T07:00:22.636361+0000","last_clean":"2024-03-04T07:00:22.636361+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T07:00:22.636361+0000","last_undegraded":"2024-03-04T07:00:22.636361+0000","last_fullsized":"2024-03-04T07:00:22.636361+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014730+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:59:50.014730+0000","last_peered":"2024-03-04T06:59:50.014730+0000","last_clean":"2024-03-04T06:59:50.014730+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:59:50.014730+0000","last_undegraded":"2024-03-04T06:59:50.014730+0000","last_fullsized":"2024-03-04T06:59:50.014730+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015553+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:59:58.015553+0000","last_peered":"2024-03-04T06:59:58.015553+0000","last_clean":"2024-03-04T06:59:58.015553+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:59:58.015553+0000","last_undegraded":"2024-03-04T06:59:58.015553+0000","last_fullsized":"2024-03-04T06:59:58.015553+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174897+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T07:00:33.174897+0000","last_peered":"2024-03-04T07:00:33.174897+0000","last_clean":"2024-03-04T07:00:33.174897+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T07:00:33.174897+0000","last_undegraded":"2024-03-04T07:00:33.174897+0000","last_fullsized":"2024-03-04T07:00:33.174897+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970309+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T07:00:32.970309+0000","last_peered":"2024-03-04T07:00:32.970309+0000","last_clean":"2024-03-04T07:00:32.970309+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T07:00:32.970309+0000","last_undegraded":"2024-03-04T07:00:32.970309+0000","last_fullsized":"2024-03-04T07:00:32.970309+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970400+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T07:00:32.970400+0000","last_peered":"2024-03-04T07:00:32.970400+0000","last_clean":"2024-03-04T07:00:32.970400+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T07:00:32.970400+0000","last_undegraded":"2024-03-04T07:00:32.970400+0000","last_fullsized":"2024-03-04T07:00:32.970400+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412366+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T07:01:08.412366+0000","last_peered":"2024-03-04T07:01:08.412366+0000","last_clean":"2024-03-04T07:01:08.412366+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T07:01:08.412366+0000","last_undegraded":"2024-03-04T07:01:08.412366+0000","last_fullsized":"2024-03-04T07:01:08.412366+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T07:01:19.569588+0000","last_peered":"2024-03-04T07:01:19.569588+0000","last_clean":"2024-03-04T07:01:19.569588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T07:01:19.569588+0000","last_undegraded":"2024-03-04T07:01:19.569588+0000","last_fullsized":"2024-03-04T07:01:19.569588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1307,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019623+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T07:00:33.019623+0000","last_peered":"2024-03-04T07:00:33.019623+0000","last_clean":"2024-03-04T07:00:33.019623+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T07:00:33.019623+0000","last_undegraded":"2024-03-04T07:00:33.019623+0000","last_fullsized":"2024-03-04T07:00:33.019623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1197,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026705+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T07:01:45.026705+0000","last_peered":"2024-03-04T07:01:45.026705+0000","last_clean":"2024-03-04T07:01:45.026705+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T07:01:45.026705+0000","last_undegraded":"2024-03-04T07:01:45.026705+0000","last_fullsized":"2024-03-04T07:01:45.026705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026715+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T07:01:45.026715+0000","last_peered":"2024-03-04T07:01:45.026715+0000","last_clean":"2024-03-04T07:01:45.026715+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T07:01:45.026715+0000","last_undegraded":"2024-03-04T07:01:45.026715+0000","last_fullsized":"2024-03-04T07:01:45.026715+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019611+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T07:00:33.019611+0000","last_peered":"2024-03-04T07:00:33.019611+0000","last_clean":"2024-03-04T07:00:33.019611+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T07:00:33.019611+0000","last_undegraded":"2024-03-04T07:00:33.019611+0000","last_fullsized":"2024-03-04T07:00:33.019611+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403128+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:59:38.403128+0000","last_peered":"2024-03-04T06:59:38.403128+0000","last_clean":"2024-03-04T06:59:38.403128+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:59:38.403128+0000","last_undegraded":"2024-03-04T06:59:38.403128+0000","last_fullsized":"2024-03-04T06:59:38.403128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1223,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403103+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:59:38.403103+0000","last_peered":"2024-03-04T06:59:38.403103+0000","last_clean":"2024-03-04T06:59:38.403103+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:59:38.403103+0000","last_undegraded":"2024-03-04T06:59:38.403103+0000","last_fullsized":"2024-03-04T06:59:38.403103+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560965+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T07:00:04.560965+0000","last_peered":"2024-03-04T07:00:04.560965+0000","last_clean":"2024-03-04T07:00:04.560965+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T07:00:04.560965+0000","last_undegraded":"2024-03-04T07:00:04.560965+0000","last_fullsized":"2024-03-04T07:00:04.560965+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976241+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T07:01:22.976241+0000","last_peered":"2024-03-04T07:01:22.976241+0000","last_clean":"2024-03-04T07:01:22.976241+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T07:01:22.976241+0000","last_undegraded":"2024-03-04T07:01:22.976241+0000","last_fullsized":"2024-03-04T07:01:22.976241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017274+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T07:00:15.017274+0000","last_peered":"2024-03-04T07:00:15.017274+0000","last_clean":"2024-03-04T07:00:15.017274+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T07:00:15.017274+0000","last_undegraded":"2024-03-04T07:00:15.017274+0000","last_fullsized":"2024-03-04T07:00:15.017274+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1191,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639127+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T07:00:47.639127+0000","last_peered":"2024-03-04T07:00:47.639127+0000","last_clean":"2024-03-04T07:00:47.639127+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T07:00:47.639127+0000","last_undegraded":"2024-03-04T07:00:47.639127+0000","last_fullsized":"2024-03-04T07:00:47.639127+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.241598+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:59:28.241598+0000","last_peered":"2024-03-04T06:59:28.241598+0000","last_clean":"2024-03-04T06:59:28.241598+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:59:28.241598+0000","last_undegraded":"2024-03-04T06:59:28.241598+0000","last_fullsized":"2024-03-04T06:59:28.241598+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:58.022394+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T07:00:58.022394+0000","last_peered":"2024-03-04T07:00:58.022394+0000","last_clean":"2024-03-04T07:00:58.022394+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T07:00:58.022394+0000","last_undegraded":"2024-03-04T07:00:58.022394+0000","last_fullsized":"2024-03-04T07:00:58.022394+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014712+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:59:50.014712+0000","last_peered":"2024-03-04T06:59:50.014712+0000","last_clean":"2024-03-04T06:59:50.014712+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:59:50.014712+0000","last_undegraded":"2024-03-04T06:59:50.014712+0000","last_fullsized":"2024-03-04T06:59:50.014712+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014675+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:59:50.014675+0000","last_peered":"2024-03-04T06:59:50.014675+0000","last_clean":"2024-03-04T06:59:50.014675+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:59:50.014675+0000","last_undegraded":"2024-03-04T06:59:50.014675+0000","last_fullsized":"2024-03-04T06:59:50.014675+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973153+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T07:00:57.973153+0000","last_peered":"2024-03-04T07:00:57.973153+0000","last_clean":"2024-03-04T07:00:57.973153+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T07:00:57.973153+0000","last_undegraded":"2024-03-04T07:00:57.973153+0000","last_fullsized":"2024-03-04T07:00:57.973153+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178000+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T07:01:03.178000+0000","last_peered":"2024-03-04T07:01:03.178000+0000","last_clean":"2024-03-04T07:01:03.178000+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T07:01:03.178000+0000","last_undegraded":"2024-03-04T07:01:03.178000+0000","last_fullsized":"2024-03-04T07:01:03.178000+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256513+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T07:01:33.256513+0000","last_peered":"2024-03-04T07:01:33.256513+0000","last_clean":"2024-03-04T07:01:33.256513+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T07:01:33.256513+0000","last_undegraded":"2024-03-04T07:01:33.256513+0000","last_fullsized":"2024-03-04T07:01:33.256513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973230+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T07:00:57.973230+0000","last_peered":"2024-03-04T07:00:57.973230+0000","last_clean":"2024-03-04T07:00:57.973230+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T07:00:57.973230+0000","last_undegraded":"2024-03-04T07:00:57.973230+0000","last_fullsized":"2024-03-04T07:00:57.973230+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973215+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T07:00:57.973215+0000","last_peered":"2024-03-04T07:00:57.973215+0000","last_clean":"2024-03-04T07:00:57.973215+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T07:00:57.973215+0000","last_undegraded":"2024-03-04T07:00:57.973215+0000","last_fullsized":"2024-03-04T07:00:57.973215+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:28.018729+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T07:00:28.018729+0000","last_peered":"2024-03-04T07:00:28.018729+0000","last_clean":"2024-03-04T07:00:28.018729+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T07:00:28.018729+0000","last_undegraded":"2024-03-04T07:00:28.018729+0000","last_fullsized":"2024-03-04T07:00:28.018729+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178037+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T07:01:03.178037+0000","last_peered":"2024-03-04T07:01:03.178037+0000","last_clean":"2024-03-04T07:01:03.178037+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T07:01:03.178037+0000","last_undegraded":"2024-03-04T07:01:03.178037+0000","last_fullsized":"2024-03-04T07:01:03.178037+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:57.633964+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:59:57.633964+0000","last_peered":"2024-03-04T06:59:57.633964+0000","last_clean":"2024-03-04T06:59:57.633964+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:59:57.633964+0000","last_undegraded":"2024-03-04T06:59:57.633964+0000","last_fullsized":"2024-03-04T06:59:57.633964+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1132,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253574+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T07:01:08.253574+0000","last_peered":"2024-03-04T07:01:08.253574+0000","last_clean":"2024-03-04T07:01:08.253574+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T07:01:08.253574+0000","last_undegraded":"2024-03-04T07:01:08.253574+0000","last_fullsized":"2024-03-04T07:01:08.253574+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558443+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:59:44.558443+0000","last_peered":"2024-03-04T06:59:44.558443+0000","last_clean":"2024-03-04T06:59:44.558443+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:59:44.558443+0000","last_undegraded":"2024-03-04T06:59:44.558443+0000","last_fullsized":"2024-03-04T06:59:44.558443+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015596+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:59:58.015596+0000","last_peered":"2024-03-04T06:59:58.015596+0000","last_clean":"2024-03-04T06:59:58.015596+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:59:58.015596+0000","last_undegraded":"2024-03-04T06:59:58.015596+0000","last_fullsized":"2024-03-04T06:59:58.015596+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412330+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T07:01:08.412330+0000","last_peered":"2024-03-04T07:01:08.412330+0000","last_clean":"2024-03-04T07:01:08.412330+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T07:01:08.412330+0000","last_undegraded":"2024-03-04T07:01:08.412330+0000","last_fullsized":"2024-03-04T07:01:08.412330+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970340+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T07:00:32.970340+0000","last_peered":"2024-03-04T07:00:32.970340+0000","last_clean":"2024-03-04T07:00:32.970340+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T07:00:32.970340+0000","last_undegraded":"2024-03-04T07:00:32.970340+0000","last_fullsized":"2024-03-04T07:00:32.970340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1053,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:44.572629+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T07:01:44.572629+0000","last_peered":"2024-03-04T07:01:44.572629+0000","last_clean":"2024-03-04T07:01:44.572629+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T07:01:44.572629+0000","last_undegraded":"2024-03-04T07:01:44.572629+0000","last_fullsized":"2024-03-04T07:01:44.572629+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1104,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253553+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T07:01:08.253553+0000","last_peered":"2024-03-04T07:01:08.253553+0000","last_clean":"2024-03-04T07:01:08.253553+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T07:01:08.253553+0000","last_undegraded":"2024-03-04T07:01:08.253553+0000","last_fullsized":"2024-03-04T07:01:08.253553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253528+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T07:01:08.253528+0000","last_peered":"2024-03-04T07:01:08.253528+0000","last_clean":"2024-03-04T07:01:08.253528+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T07:01:08.253528+0000","last_undegraded":"2024-03-04T07:01:08.253528+0000","last_fullsized":"2024-03-04T07:01:08.253528+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412282+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T07:01:08.412282+0000","last_peered":"2024-03-04T07:01:08.412282+0000","last_clean":"2024-03-04T07:01:08.412282+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T07:01:08.412282+0000","last_undegraded":"2024-03-04T07:01:08.412282+0000","last_fullsized":"2024-03-04T07:01:08.412282+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:44.572593+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T07:01:44.572593+0000","last_peered":"2024-03-04T07:01:44.572593+0000","last_clean":"2024-03-04T07:01:44.572593+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T07:01:44.572593+0000","last_undegraded":"2024-03-04T07:01:44.572593+0000","last_fullsized":"2024-03-04T07:01:44.572593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3579,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405911+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:00:08.405911+0000","last_peered":"2024-03-04T07:00:08.405911+0000","last_clean":"2024-03-04T07:00:08.405911+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:00:08.405911+0000","last_undegraded":"2024-03-04T07:00:08.405911+0000","last_fullsized":"2024-03-04T07:00:08.405911+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1162,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:47.645939+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T07:01:47.645939+0000","last_peered":"2024-03-04T07:01:47.645939+0000","last_clean":"2024-03-04T07:01:47.645939+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T07:01:47.645939+0000","last_undegraded":"2024-03-04T07:01:47.645939+0000","last_fullsized":"2024-03-04T07:01:47.645939+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T07:01:19.569613+0000","last_peered":"2024-03-04T07:01:19.569613+0000","last_clean":"2024-03-04T07:01:19.569613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T07:01:19.569613+0000","last_undegraded":"2024-03-04T07:01:19.569613+0000","last_fullsized":"2024-03-04T07:01:19.569613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17118,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019514+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T07:00:33.019514+0000","last_peered":"2024-03-04T07:00:33.019514+0000","last_clean":"2024-03-04T07:00:33.019514+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T07:00:33.019514+0000","last_undegraded":"2024-03-04T07:00:33.019514+0000","last_fullsized":"2024-03-04T07:00:33.019514+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178538+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T07:01:08.178538+0000","last_peered":"2024-03-04T07:01:08.178538+0000","last_clean":"2024-03-04T07:01:08.178538+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T07:01:08.178538+0000","last_undegraded":"2024-03-04T07:01:08.178538+0000","last_fullsized":"2024-03-04T07:01:08.178538+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178614+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T07:01:08.178614+0000","last_peered":"2024-03-04T07:01:08.178614+0000","last_clean":"2024-03-04T07:01:08.178614+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T07:01:08.178614+0000","last_undegraded":"2024-03-04T07:01:08.178614+0000","last_fullsized":"2024-03-04T07:01:08.178614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976230+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T07:01:22.976230+0000","last_peered":"2024-03-04T07:01:22.976230+0000","last_clean":"2024-03-04T07:01:22.976230+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T07:01:22.976230+0000","last_undegraded":"2024-03-04T07:01:22.976230+0000","last_fullsized":"2024-03-04T07:01:22.976230+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4388,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019581+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T07:00:33.019581+0000","last_peered":"2024-03-04T07:00:33.019581+0000","last_clean":"2024-03-04T07:00:33.019581+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T07:00:33.019581+0000","last_undegraded":"2024-03-04T07:00:33.019581+0000","last_fullsized":"2024-03-04T07:00:33.019581+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178564+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T07:01:08.178564+0000","last_peered":"2024-03-04T07:01:08.178564+0000","last_clean":"2024-03-04T07:01:08.178564+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T07:01:08.178564+0000","last_undegraded":"2024-03-04T07:01:08.178564+0000","last_fullsized":"2024-03-04T07:01:08.178564+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976151+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T07:01:22.976151+0000","last_peered":"2024-03-04T07:01:22.976151+0000","last_clean":"2024-03-04T07:01:22.976151+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T07:01:22.976151+0000","last_undegraded":"2024-03-04T07:01:22.976151+0000","last_fullsized":"2024-03-04T07:01:22.976151+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639139+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T07:00:47.639139+0000","last_peered":"2024-03-04T07:00:47.639139+0000","last_clean":"2024-03-04T07:00:47.639139+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T07:00:47.639139+0000","last_undegraded":"2024-03-04T07:00:47.639139+0000","last_fullsized":"2024-03-04T07:00:47.639139+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5641,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.406020+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:00:08.406020+0000","last_peered":"2024-03-04T07:00:08.406020+0000","last_clean":"2024-03-04T07:00:08.406020+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:00:08.406020+0000","last_undegraded":"2024-03-04T07:00:08.406020+0000","last_fullsized":"2024-03-04T07:00:08.406020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182480+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T07:01:43.182480+0000","last_peered":"2024-03-04T07:01:43.182480+0000","last_clean":"2024-03-04T07:01:43.182480+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T07:01:43.182480+0000","last_undegraded":"2024-03-04T07:01:43.182480+0000","last_fullsized":"2024-03-04T07:01:43.182480+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174867+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T07:00:33.174867+0000","last_peered":"2024-03-04T07:00:33.174867+0000","last_clean":"2024-03-04T07:00:33.174867+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T07:00:33.174867+0000","last_undegraded":"2024-03-04T07:00:33.174867+0000","last_fullsized":"2024-03-04T07:00:33.174867+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416777+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T07:01:43.416777+0000","last_peered":"2024-03-04T07:01:43.416777+0000","last_clean":"2024-03-04T07:01:43.416777+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T07:01:43.416777+0000","last_undegraded":"2024-03-04T07:01:43.416777+0000","last_fullsized":"2024-03-04T07:01:43.416777+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4017,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:29.563935+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T07:00:29.563935+0000","last_peered":"2024-03-04T07:00:29.563935+0000","last_clean":"2024-03-04T07:00:29.563935+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T07:00:29.563935+0000","last_undegraded":"2024-03-04T07:00:29.563935+0000","last_fullsized":"2024-03-04T07:00:29.563935+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:58.259258+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T07:01:58.259258+0000","last_peered":"2024-03-04T07:01:58.259258+0000","last_clean":"2024-03-04T07:01:58.259258+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T07:01:58.259258+0000","last_undegraded":"2024-03-04T07:01:58.259258+0000","last_fullsized":"2024-03-04T07:01:58.259258+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1212,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017258+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T07:00:15.017258+0000","last_peered":"2024-03-04T07:00:15.017258+0000","last_clean":"2024-03-04T07:00:15.017258+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T07:00:15.017258+0000","last_undegraded":"2024-03-04T07:00:15.017258+0000","last_fullsized":"2024-03-04T07:00:15.017258+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1150,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976219+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T07:01:22.976219+0000","last_peered":"2024-03-04T07:01:22.976219+0000","last_clean":"2024-03-04T07:01:22.976219+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T07:01:22.976219+0000","last_undegraded":"2024-03-04T07:01:22.976219+0000","last_fullsized":"2024-03-04T07:01:22.976219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1553,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:04.574969+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:02:04.574969+0000","last_peered":"2024-03-04T07:02:04.574969+0000","last_clean":"2024-03-04T07:02:04.574969+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:02:04.574969+0000","last_undegraded":"2024-03-04T07:02:04.574969+0000","last_fullsized":"2024-03-04T07:02:04.574969+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3953,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:52.979497+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T07:01:52.979497+0000","last_peered":"2024-03-04T07:01:52.979497+0000","last_clean":"2024-03-04T07:01:52.979497+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T07:01:52.979497+0000","last_undegraded":"2024-03-04T07:01:52.979497+0000","last_fullsized":"2024-03-04T07:01:52.979497+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023391+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T07:01:08.023391+0000","last_peered":"2024-03-04T07:01:08.023391+0000","last_clean":"2024-03-04T07:01:08.023391+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T07:01:08.023391+0000","last_undegraded":"2024-03-04T07:01:08.023391+0000","last_fullsized":"2024-03-04T07:01:08.023391+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416752+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T07:01:43.416752+0000","last_peered":"2024-03-04T07:01:43.416752+0000","last_clean":"2024-03-04T07:01:43.416752+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T07:01:43.416752+0000","last_undegraded":"2024-03-04T07:01:43.416752+0000","last_fullsized":"2024-03-04T07:01:43.416752+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:04.574922+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:02:04.574922+0000","last_peered":"2024-03-04T07:02:04.574922+0000","last_clean":"2024-03-04T07:02:04.574922+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:02:04.574922+0000","last_undegraded":"2024-03-04T07:02:04.574922+0000","last_fullsized":"2024-03-04T07:02:04.574922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15294,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:58.259228+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T07:01:58.259228+0000","last_peered":"2024-03-04T07:01:58.259228+0000","last_clean":"2024-03-04T07:01:58.259228+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T07:01:58.259228+0000","last_undegraded":"2024-03-04T07:01:58.259228+0000","last_fullsized":"2024-03-04T07:01:58.259228+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019541+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T07:00:33.019541+0000","last_peered":"2024-03-04T07:00:33.019541+0000","last_clean":"2024-03-04T07:00:33.019541+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T07:00:33.019541+0000","last_undegraded":"2024-03-04T07:00:33.019541+0000","last_fullsized":"2024-03-04T07:00:33.019541+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1075,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.563983+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T07:00:29.563983+0000","last_peered":"2024-03-04T07:00:29.563983+0000","last_clean":"2024-03-04T07:00:29.563983+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T07:00:29.563983+0000","last_undegraded":"2024-03-04T07:00:29.563983+0000","last_fullsized":"2024-03-04T07:00:29.563983+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178580+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T07:01:08.178580+0000","last_peered":"2024-03-04T07:01:08.178580+0000","last_clean":"2024-03-04T07:01:08.178580+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T07:01:08.178580+0000","last_undegraded":"2024-03-04T07:01:08.178580+0000","last_fullsized":"2024-03-04T07:01:08.178580+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4381,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:47.639101+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T07:00:47.639101+0000","last_peered":"2024-03-04T07:00:47.639101+0000","last_clean":"2024-03-04T07:00:47.639101+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T07:00:47.639101+0000","last_undegraded":"2024-03-04T07:00:47.639101+0000","last_fullsized":"2024-03-04T07:00:47.639101+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026676+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T07:01:45.026676+0000","last_peered":"2024-03-04T07:01:45.026676+0000","last_clean":"2024-03-04T07:01:45.026676+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T07:01:45.026676+0000","last_undegraded":"2024-03-04T07:01:45.026676+0000","last_fullsized":"2024-03-04T07:01:45.026676+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1271,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182470+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T07:01:43.182470+0000","last_peered":"2024-03-04T07:01:43.182470+0000","last_clean":"2024-03-04T07:01:43.182470+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T07:01:43.182470+0000","last_undegraded":"2024-03-04T07:01:43.182470+0000","last_fullsized":"2024-03-04T07:01:43.182470+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020800+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T07:00:45.020800+0000","last_peered":"2024-03-04T07:00:45.020800+0000","last_clean":"2024-03-04T07:00:45.020800+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T07:00:45.020800+0000","last_undegraded":"2024-03-04T07:00:45.020800+0000","last_fullsized":"2024-03-04T07:00:45.020800+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4612,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:45.026591+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T07:01:45.026591+0000","last_peered":"2024-03-04T07:01:45.026591+0000","last_clean":"2024-03-04T07:01:45.026591+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T07:01:45.026591+0000","last_undegraded":"2024-03-04T07:01:45.026591+0000","last_fullsized":"2024-03-04T07:01:45.026591+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639077+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T07:00:47.639077+0000","last_peered":"2024-03-04T07:00:47.639077+0000","last_clean":"2024-03-04T07:00:47.639077+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T07:00:47.639077+0000","last_undegraded":"2024-03-04T07:00:47.639077+0000","last_fullsized":"2024-03-04T07:00:47.639077+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1080,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247864+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T07:00:18.247864+0000","last_peered":"2024-03-04T07:00:18.247864+0000","last_clean":"2024-03-04T07:00:18.247864+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T07:00:18.247864+0000","last_undegraded":"2024-03-04T07:00:18.247864+0000","last_fullsized":"2024-03-04T07:00:18.247864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023341+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T07:01:08.023341+0000","last_peered":"2024-03-04T07:01:08.023341+0000","last_clean":"2024-03-04T07:01:08.023341+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T07:01:08.023341+0000","last_undegraded":"2024-03-04T07:01:08.023341+0000","last_fullsized":"2024-03-04T07:01:08.023341+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4636,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:07.967606+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T07:00:07.967606+0000","last_peered":"2024-03-04T07:00:07.967606+0000","last_clean":"2024-03-04T07:00:07.967606+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T07:00:07.967606+0000","last_undegraded":"2024-03-04T07:00:07.967606+0000","last_fullsized":"2024-03-04T07:00:07.967606+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:54.566566+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T07:00:54.566566+0000","last_peered":"2024-03-04T07:00:54.566566+0000","last_clean":"2024-03-04T07:00:54.566566+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T07:00:54.566566+0000","last_undegraded":"2024-03-04T07:00:54.566566+0000","last_fullsized":"2024-03-04T07:00:54.566566+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1187,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:17.642331+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T07:01:17.642331+0000","last_peered":"2024-03-04T07:01:17.642331+0000","last_clean":"2024-03-04T07:01:17.642331+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T07:01:17.642331+0000","last_undegraded":"2024-03-04T07:01:17.642331+0000","last_fullsized":"2024-03-04T07:01:17.642331+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5160,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:47.645896+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T07:01:47.645896+0000","last_peered":"2024-03-04T07:01:47.645896+0000","last_clean":"2024-03-04T07:01:47.645896+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T07:01:47.645896+0000","last_undegraded":"2024-03-04T07:01:47.645896+0000","last_fullsized":"2024-03-04T07:01:47.645896+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182417+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T07:01:43.182417+0000","last_peered":"2024-03-04T07:01:43.182417+0000","last_clean":"2024-03-04T07:01:43.182417+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T07:01:43.182417+0000","last_undegraded":"2024-03-04T07:01:43.182417+0000","last_fullsized":"2024-03-04T07:01:43.182417+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020733+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T07:00:45.020733+0000","last_peered":"2024-03-04T07:00:45.020733+0000","last_clean":"2024-03-04T07:00:45.020733+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T07:00:45.020733+0000","last_undegraded":"2024-03-04T07:00:45.020733+0000","last_fullsized":"2024-03-04T07:00:45.020733+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4721,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409468+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T07:00:38.409468+0000","last_peered":"2024-03-04T07:00:38.409468+0000","last_clean":"2024-03-04T07:00:38.409468+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T07:00:38.409468+0000","last_undegraded":"2024-03-04T07:00:38.409468+0000","last_fullsized":"2024-03-04T07:00:38.409468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182435+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T07:01:43.182435+0000","last_peered":"2024-03-04T07:01:43.182435+0000","last_clean":"2024-03-04T07:01:43.182435+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T07:01:43.182435+0000","last_undegraded":"2024-03-04T07:01:43.182435+0000","last_fullsized":"2024-03-04T07:01:43.182435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023738+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T07:01:15.023738+0000","last_peered":"2024-03-04T07:01:15.023738+0000","last_clean":"2024-03-04T07:01:15.023738+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T07:01:15.023738+0000","last_undegraded":"2024-03-04T07:01:15.023738+0000","last_fullsized":"2024-03-04T07:01:15.023738+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5556,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:03.171266+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:00:03.171266+0000","last_peered":"2024-03-04T07:00:03.171266+0000","last_clean":"2024-03-04T07:00:03.171266+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:00:03.171266+0000","last_undegraded":"2024-03-04T07:00:03.171266+0000","last_fullsized":"2024-03-04T07:00:03.171266+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T07:01:19.569554+0000","last_peered":"2024-03-04T07:01:19.569554+0000","last_clean":"2024-03-04T07:01:19.569554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T07:01:19.569554+0000","last_undegraded":"2024-03-04T07:01:19.569554+0000","last_fullsized":"2024-03-04T07:01:19.569554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247800+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T07:00:18.247800+0000","last_peered":"2024-03-04T07:00:18.247800+0000","last_clean":"2024-03-04T07:00:18.247800+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T07:00:18.247800+0000","last_undegraded":"2024-03-04T07:00:18.247800+0000","last_fullsized":"2024-03-04T07:00:18.247800+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409421+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T07:00:38.409421+0000","last_peered":"2024-03-04T07:00:38.409421+0000","last_clean":"2024-03-04T07:00:38.409421+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T07:00:38.409421+0000","last_undegraded":"2024-03-04T07:00:38.409421+0000","last_fullsized":"2024-03-04T07:00:38.409421+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409457+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T07:00:38.409457+0000","last_peered":"2024-03-04T07:00:38.409457+0000","last_clean":"2024-03-04T07:00:38.409457+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T07:00:38.409457+0000","last_undegraded":"2024-03-04T07:00:38.409457+0000","last_fullsized":"2024-03-04T07:00:38.409457+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T07:01:19.569599+0000","last_peered":"2024-03-04T07:01:19.569599+0000","last_clean":"2024-03-04T07:01:19.569599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T07:01:19.569599+0000","last_undegraded":"2024-03-04T07:01:19.569599+0000","last_fullsized":"2024-03-04T07:01:19.569599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4368,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405967+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:00:08.405967+0000","last_peered":"2024-03-04T07:00:08.405967+0000","last_clean":"2024-03-04T07:00:08.405967+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:00:08.405967+0000","last_undegraded":"2024-03-04T07:00:08.405967+0000","last_fullsized":"2024-03-04T07:00:08.405967+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:03.171315+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:00:03.171315+0000","last_peered":"2024-03-04T07:00:03.171315+0000","last_clean":"2024-03-04T07:00:03.171315+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:00:03.171315+0000","last_undegraded":"2024-03-04T07:00:03.171315+0000","last_fullsized":"2024-03-04T07:00:03.171315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967580+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T07:00:07.967580+0000","last_peered":"2024-03-04T07:00:07.967580+0000","last_clean":"2024-03-04T07:00:07.967580+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T07:00:07.967580+0000","last_undegraded":"2024-03-04T07:00:07.967580+0000","last_fullsized":"2024-03-04T07:00:07.967580+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4602,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:54.566603+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T07:00:54.566603+0000","last_peered":"2024-03-04T07:00:54.566603+0000","last_clean":"2024-03-04T07:00:54.566603+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T07:00:54.566603+0000","last_undegraded":"2024-03-04T07:00:54.566603+0000","last_fullsized":"2024-03-04T07:00:54.566603+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1247,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409492+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T07:00:38.409492+0000","last_peered":"2024-03-04T07:00:38.409492+0000","last_clean":"2024-03-04T07:00:38.409492+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T07:00:38.409492+0000","last_undegraded":"2024-03-04T07:00:38.409492+0000","last_fullsized":"2024-03-04T07:00:38.409492+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569626+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T07:01:19.569626+0000","last_peered":"2024-03-04T07:01:19.569626+0000","last_clean":"2024-03-04T07:01:19.569626+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T07:01:19.569626+0000","last_undegraded":"2024-03-04T07:01:19.569626+0000","last_fullsized":"2024-03-04T07:01:19.569626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:58.259166+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T07:01:58.259166+0000","last_peered":"2024-03-04T07:01:58.259166+0000","last_clean":"2024-03-04T07:01:58.259166+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T07:01:58.259166+0000","last_undegraded":"2024-03-04T07:01:58.259166+0000","last_fullsized":"2024-03-04T07:01:58.259166+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416787+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T07:01:43.416787+0000","last_peered":"2024-03-04T07:01:43.416787+0000","last_clean":"2024-03-04T07:01:43.416787+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T07:01:43.416787+0000","last_undegraded":"2024-03-04T07:01:43.416787+0000","last_fullsized":"2024-03-04T07:01:43.416787+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976197+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T07:01:22.976197+0000","last_peered":"2024-03-04T07:01:22.976197+0000","last_clean":"2024-03-04T07:01:22.976197+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T07:01:22.976197+0000","last_undegraded":"2024-03-04T07:01:22.976197+0000","last_fullsized":"2024-03-04T07:01:22.976197+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019487+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T07:00:33.019487+0000","last_peered":"2024-03-04T07:00:33.019487+0000","last_clean":"2024-03-04T07:00:33.019487+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T07:00:33.019487+0000","last_undegraded":"2024-03-04T07:00:33.019487+0000","last_fullsized":"2024-03-04T07:00:33.019487+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020779+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T07:00:45.020779+0000","last_peered":"2024-03-04T07:00:45.020779+0000","last_clean":"2024-03-04T07:00:45.020779+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T07:00:45.020779+0000","last_undegraded":"2024-03-04T07:00:45.020779+0000","last_fullsized":"2024-03-04T07:00:45.020779+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182456+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T07:01:43.182456+0000","last_peered":"2024-03-04T07:01:43.182456+0000","last_clean":"2024-03-04T07:01:43.182456+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T07:01:43.182456+0000","last_undegraded":"2024-03-04T07:01:43.182456+0000","last_fullsized":"2024-03-04T07:01:43.182456+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247852+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T07:00:18.247852+0000","last_peered":"2024-03-04T07:00:18.247852+0000","last_clean":"2024-03-04T07:00:18.247852+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T07:00:18.247852+0000","last_undegraded":"2024-03-04T07:00:18.247852+0000","last_fullsized":"2024-03-04T07:00:18.247852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020816+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T07:00:45.020816+0000","last_peered":"2024-03-04T07:00:45.020816+0000","last_clean":"2024-03-04T07:00:45.020816+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T07:00:45.020816+0000","last_undegraded":"2024-03-04T07:00:45.020816+0000","last_fullsized":"2024-03-04T07:00:45.020816+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:52.979394+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T07:01:52.979394+0000","last_peered":"2024-03-04T07:01:52.979394+0000","last_clean":"2024-03-04T07:01:52.979394+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T07:01:52.979394+0000","last_undegraded":"2024-03-04T07:01:52.979394+0000","last_fullsized":"2024-03-04T07:01:52.979394+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023709+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T07:01:15.023709+0000","last_peered":"2024-03-04T07:01:15.023709+0000","last_clean":"2024-03-04T07:01:15.023709+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T07:01:15.023709+0000","last_undegraded":"2024-03-04T07:01:15.023709+0000","last_fullsized":"2024-03-04T07:01:15.023709+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1122,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967529+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T07:00:07.967529+0000","last_peered":"2024-03-04T07:00:07.967529+0000","last_clean":"2024-03-04T07:00:07.967529+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T07:00:07.967529+0000","last_undegraded":"2024-03-04T07:00:07.967529+0000","last_fullsized":"2024-03-04T07:00:07.967529+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.026774+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T07:01:43.026774+0000","last_peered":"2024-03-04T07:01:43.026774+0000","last_clean":"2024-03-04T07:01:43.026774+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T07:01:43.026774+0000","last_undegraded":"2024-03-04T07:01:43.026774+0000","last_fullsized":"2024-03-04T07:01:43.026774+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:43.250705+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T07:00:43.250705+0000","last_peered":"2024-03-04T07:00:43.250705+0000","last_clean":"2024-03-04T07:00:43.250705+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T07:00:43.250705+0000","last_undegraded":"2024-03-04T07:00:43.250705+0000","last_fullsized":"2024-03-04T07:00:43.250705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503531,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648178,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142485,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287132,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997838,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885894,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937472,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792825,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:04:15.610 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:15.610 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:15.610 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:15.611 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:15.611 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:15.611 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:15.611 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:15.611 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:15.611 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:15.611 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:15.611 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:04:16.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:15 smithi137 ceph-mon[88869]: pgmap v1192: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:16.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:15 smithi137 ceph-mon[88869]: from='client.44690 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:16.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:15 smithi137 ceph-mon[91314]: pgmap v1192: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:16.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:15 smithi137 ceph-mon[91314]: from='client.44690 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:16.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:15 smithi203 ceph-mon[85573]: pgmap v1192: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:16.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:15 smithi203 ceph-mon[85573]: from='client.44690 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:18.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:17 smithi137 ceph-mon[88869]: pgmap v1193: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:18.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:17 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:04:18.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:17 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:04:18.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:17 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:04:18.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:17 smithi137 ceph-mon[91314]: pgmap v1193: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:18.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:17 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:04:18.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:17 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:04:18.043 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:17 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:04:18.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:17 smithi203 ceph-mon[85573]: pgmap v1193: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:18.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:17 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:04:18.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:17 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:04:18.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:17 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:04:19.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:04:19.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:04:19.042 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:04:19.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:04:19.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:04:19.042 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:04:19.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:04:19.094 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:04:19.095 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:04:20.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:20 smithi137 ceph-mon[88869]: pgmap v1194: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:20.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:20 smithi137 ceph-mon[91314]: pgmap v1194: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:20.594 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:20 smithi203 ceph-mon[85573]: pgmap v1194: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:22.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:22 smithi137 ceph-mon[88869]: pgmap v1195: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:22.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:22 smithi137 ceph-mon[91314]: pgmap v1195: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:22.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:22 smithi203 ceph-mon[85573]: pgmap v1195: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:24.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:24 smithi137 ceph-mon[88869]: pgmap v1196: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:24.543 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:24 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:04:24.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:24 smithi137 ceph-mon[91314]: pgmap v1196: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:24.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:24 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:04:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:24 smithi203 ceph-mon[85573]: pgmap v1196: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:24.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:24 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:04:25.613 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:04:25.643 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:04:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:04:25] "GET /metrics HTTP/1.1" 200 36330 "" "Prometheus/2.43.0" 2024-03-04T07:04:25.835 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:04:26.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:26 smithi137 ceph-mon[88869]: pgmap v1197: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:26.543 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:26 smithi137 ceph-mon[91314]: pgmap v1197: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:26.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:26 smithi203 ceph-mon[85573]: pgmap v1197: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:27.777 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:04:27.779 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:04:28.379 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:28 smithi137 ceph-mon[88869]: pgmap v1198: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:28.380 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:28 smithi137 ceph-mon[91314]: pgmap v1198: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:28.401 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1198,"stamp":"2024-03-04T07:04:26.632063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004071"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.564000+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T07:00:29.564000+0000","last_peered":"2024-03-04T07:00:29.564000+0000","last_clean":"2024-03-04T07:00:29.564000+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T07:00:29.564000+0000","last_undegraded":"2024-03-04T07:00:29.564000+0000","last_fullsized":"2024-03-04T07:00:29.564000+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178667+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T07:01:08.178667+0000","last_peered":"2024-03-04T07:01:08.178667+0000","last_clean":"2024-03-04T07:01:08.178667+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T07:01:08.178667+0000","last_undegraded":"2024-03-04T07:01:08.178667+0000","last_fullsized":"2024-03-04T07:01:08.178667+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019562+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T07:00:33.019562+0000","last_peered":"2024-03-04T07:00:33.019562+0000","last_clean":"2024-03-04T07:00:33.019562+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T07:00:33.019562+0000","last_undegraded":"2024-03-04T07:00:33.019562+0000","last_fullsized":"2024-03-04T07:00:33.019562+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1143,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:52.972434+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T07:00:52.972434+0000","last_peered":"2024-03-04T07:00:52.972434+0000","last_clean":"2024-03-04T07:00:52.972434+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T07:00:52.972434+0000","last_undegraded":"2024-03-04T07:00:52.972434+0000","last_fullsized":"2024-03-04T07:00:52.972434+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560949+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T07:00:04.560949+0000","last_peered":"2024-03-04T07:00:04.560949+0000","last_clean":"2024-03-04T07:00:04.560949+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T07:00:04.560949+0000","last_undegraded":"2024-03-04T07:00:04.560949+0000","last_fullsized":"2024-03-04T07:00:04.560949+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976210+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T07:01:22.976210+0000","last_peered":"2024-03-04T07:01:22.976210+0000","last_clean":"2024-03-04T07:01:22.976210+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T07:01:22.976210+0000","last_undegraded":"2024-03-04T07:01:22.976210+0000","last_fullsized":"2024-03-04T07:01:22.976210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560930+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T07:00:04.560930+0000","last_peered":"2024-03-04T07:00:04.560930+0000","last_clean":"2024-03-04T07:00:04.560930+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T07:00:04.560930+0000","last_undegraded":"2024-03-04T07:00:04.560930+0000","last_fullsized":"2024-03-04T07:00:04.560930+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017220+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T07:00:15.017220+0000","last_peered":"2024-03-04T07:00:15.017220+0000","last_clean":"2024-03-04T07:00:15.017220+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T07:00:15.017220+0000","last_undegraded":"2024-03-04T07:00:15.017220+0000","last_fullsized":"2024-03-04T07:00:15.017220+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1066,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558470+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T06:59:44.558470+0000","last_peered":"2024-03-04T06:59:44.558470+0000","last_clean":"2024-03-04T06:59:44.558470+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T06:59:44.558470+0000","last_undegraded":"2024-03-04T06:59:44.558470+0000","last_fullsized":"2024-03-04T06:59:44.558470+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256498+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T07:01:33.256498+0000","last_peered":"2024-03-04T07:01:33.256498+0000","last_clean":"2024-03-04T07:01:33.256498+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T07:01:33.256498+0000","last_undegraded":"2024-03-04T07:01:33.256498+0000","last_fullsized":"2024-03-04T07:01:33.256498+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256456+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T07:01:33.256456+0000","last_peered":"2024-03-04T07:01:33.256456+0000","last_clean":"2024-03-04T07:01:33.256456+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T07:01:33.256456+0000","last_undegraded":"2024-03-04T07:01:33.256456+0000","last_fullsized":"2024-03-04T07:01:33.256456+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:22.636361+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T07:00:22.636361+0000","last_peered":"2024-03-04T07:00:22.636361+0000","last_clean":"2024-03-04T07:00:22.636361+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T07:00:22.636361+0000","last_undegraded":"2024-03-04T07:00:22.636361+0000","last_fullsized":"2024-03-04T07:00:22.636361+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014730+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:59:50.014730+0000","last_peered":"2024-03-04T06:59:50.014730+0000","last_clean":"2024-03-04T06:59:50.014730+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:59:50.014730+0000","last_undegraded":"2024-03-04T06:59:50.014730+0000","last_fullsized":"2024-03-04T06:59:50.014730+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1299,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015553+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T06:59:58.015553+0000","last_peered":"2024-03-04T06:59:58.015553+0000","last_clean":"2024-03-04T06:59:58.015553+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T06:59:58.015553+0000","last_undegraded":"2024-03-04T06:59:58.015553+0000","last_fullsized":"2024-03-04T06:59:58.015553+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174897+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T07:00:33.174897+0000","last_peered":"2024-03-04T07:00:33.174897+0000","last_clean":"2024-03-04T07:00:33.174897+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T07:00:33.174897+0000","last_undegraded":"2024-03-04T07:00:33.174897+0000","last_fullsized":"2024-03-04T07:00:33.174897+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970309+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T07:00:32.970309+0000","last_peered":"2024-03-04T07:00:32.970309+0000","last_clean":"2024-03-04T07:00:32.970309+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T07:00:32.970309+0000","last_undegraded":"2024-03-04T07:00:32.970309+0000","last_fullsized":"2024-03-04T07:00:32.970309+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970400+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T07:00:32.970400+0000","last_peered":"2024-03-04T07:00:32.970400+0000","last_clean":"2024-03-04T07:00:32.970400+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T07:00:32.970400+0000","last_undegraded":"2024-03-04T07:00:32.970400+0000","last_fullsized":"2024-03-04T07:00:32.970400+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412366+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T07:01:08.412366+0000","last_peered":"2024-03-04T07:01:08.412366+0000","last_clean":"2024-03-04T07:01:08.412366+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T07:01:08.412366+0000","last_undegraded":"2024-03-04T07:01:08.412366+0000","last_fullsized":"2024-03-04T07:01:08.412366+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T07:01:19.569588+0000","last_peered":"2024-03-04T07:01:19.569588+0000","last_clean":"2024-03-04T07:01:19.569588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T07:01:19.569588+0000","last_undegraded":"2024-03-04T07:01:19.569588+0000","last_fullsized":"2024-03-04T07:01:19.569588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1307,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019623+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T07:00:33.019623+0000","last_peered":"2024-03-04T07:00:33.019623+0000","last_clean":"2024-03-04T07:00:33.019623+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T07:00:33.019623+0000","last_undegraded":"2024-03-04T07:00:33.019623+0000","last_fullsized":"2024-03-04T07:00:33.019623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1197,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026705+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T07:01:45.026705+0000","last_peered":"2024-03-04T07:01:45.026705+0000","last_clean":"2024-03-04T07:01:45.026705+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T07:01:45.026705+0000","last_undegraded":"2024-03-04T07:01:45.026705+0000","last_fullsized":"2024-03-04T07:01:45.026705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026715+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T07:01:45.026715+0000","last_peered":"2024-03-04T07:01:45.026715+0000","last_clean":"2024-03-04T07:01:45.026715+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T07:01:45.026715+0000","last_undegraded":"2024-03-04T07:01:45.026715+0000","last_fullsized":"2024-03-04T07:01:45.026715+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019611+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T07:00:33.019611+0000","last_peered":"2024-03-04T07:00:33.019611+0000","last_clean":"2024-03-04T07:00:33.019611+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T07:00:33.019611+0000","last_undegraded":"2024-03-04T07:00:33.019611+0000","last_fullsized":"2024-03-04T07:00:33.019611+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1236,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403128+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T06:59:38.403128+0000","last_peered":"2024-03-04T06:59:38.403128+0000","last_clean":"2024-03-04T06:59:38.403128+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T06:59:38.403128+0000","last_undegraded":"2024-03-04T06:59:38.403128+0000","last_fullsized":"2024-03-04T06:59:38.403128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1223,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:38.403103+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T06:59:38.403103+0000","last_peered":"2024-03-04T06:59:38.403103+0000","last_clean":"2024-03-04T06:59:38.403103+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T06:59:38.403103+0000","last_undegraded":"2024-03-04T06:59:38.403103+0000","last_fullsized":"2024-03-04T06:59:38.403103+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560965+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T07:00:04.560965+0000","last_peered":"2024-03-04T07:00:04.560965+0000","last_clean":"2024-03-04T07:00:04.560965+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T07:00:04.560965+0000","last_undegraded":"2024-03-04T07:00:04.560965+0000","last_fullsized":"2024-03-04T07:00:04.560965+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976241+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T07:01:22.976241+0000","last_peered":"2024-03-04T07:01:22.976241+0000","last_clean":"2024-03-04T07:01:22.976241+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T07:01:22.976241+0000","last_undegraded":"2024-03-04T07:01:22.976241+0000","last_fullsized":"2024-03-04T07:01:22.976241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017274+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T07:00:15.017274+0000","last_peered":"2024-03-04T07:00:15.017274+0000","last_clean":"2024-03-04T07:00:15.017274+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T07:00:15.017274+0000","last_undegraded":"2024-03-04T07:00:15.017274+0000","last_fullsized":"2024-03-04T07:00:15.017274+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1191,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639127+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T07:00:47.639127+0000","last_peered":"2024-03-04T07:00:47.639127+0000","last_clean":"2024-03-04T07:00:47.639127+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T07:00:47.639127+0000","last_undegraded":"2024-03-04T07:00:47.639127+0000","last_fullsized":"2024-03-04T07:00:47.639127+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:28.241598+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T06:59:28.241598+0000","last_peered":"2024-03-04T06:59:28.241598+0000","last_clean":"2024-03-04T06:59:28.241598+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T06:59:28.241598+0000","last_undegraded":"2024-03-04T06:59:28.241598+0000","last_fullsized":"2024-03-04T06:59:28.241598+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:58.022394+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T07:00:58.022394+0000","last_peered":"2024-03-04T07:00:58.022394+0000","last_clean":"2024-03-04T07:00:58.022394+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T07:00:58.022394+0000","last_undegraded":"2024-03-04T07:00:58.022394+0000","last_fullsized":"2024-03-04T07:00:58.022394+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014712+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:59:50.014712+0000","last_peered":"2024-03-04T06:59:50.014712+0000","last_clean":"2024-03-04T06:59:50.014712+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:59:50.014712+0000","last_undegraded":"2024-03-04T06:59:50.014712+0000","last_fullsized":"2024-03-04T06:59:50.014712+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014675+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:59:50.014675+0000","last_peered":"2024-03-04T06:59:50.014675+0000","last_clean":"2024-03-04T06:59:50.014675+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:59:50.014675+0000","last_undegraded":"2024-03-04T06:59:50.014675+0000","last_fullsized":"2024-03-04T06:59:50.014675+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973153+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T07:00:57.973153+0000","last_peered":"2024-03-04T07:00:57.973153+0000","last_clean":"2024-03-04T07:00:57.973153+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T07:00:57.973153+0000","last_undegraded":"2024-03-04T07:00:57.973153+0000","last_fullsized":"2024-03-04T07:00:57.973153+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178000+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T07:01:03.178000+0000","last_peered":"2024-03-04T07:01:03.178000+0000","last_clean":"2024-03-04T07:01:03.178000+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T07:01:03.178000+0000","last_undegraded":"2024-03-04T07:01:03.178000+0000","last_fullsized":"2024-03-04T07:01:03.178000+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256513+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T07:01:33.256513+0000","last_peered":"2024-03-04T07:01:33.256513+0000","last_clean":"2024-03-04T07:01:33.256513+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T07:01:33.256513+0000","last_undegraded":"2024-03-04T07:01:33.256513+0000","last_fullsized":"2024-03-04T07:01:33.256513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973230+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T07:00:57.973230+0000","last_peered":"2024-03-04T07:00:57.973230+0000","last_clean":"2024-03-04T07:00:57.973230+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T07:00:57.973230+0000","last_undegraded":"2024-03-04T07:00:57.973230+0000","last_fullsized":"2024-03-04T07:00:57.973230+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973215+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T07:00:57.973215+0000","last_peered":"2024-03-04T07:00:57.973215+0000","last_clean":"2024-03-04T07:00:57.973215+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T07:00:57.973215+0000","last_undegraded":"2024-03-04T07:00:57.973215+0000","last_fullsized":"2024-03-04T07:00:57.973215+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:28.018729+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T07:00:28.018729+0000","last_peered":"2024-03-04T07:00:28.018729+0000","last_clean":"2024-03-04T07:00:28.018729+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T07:00:28.018729+0000","last_undegraded":"2024-03-04T07:00:28.018729+0000","last_fullsized":"2024-03-04T07:00:28.018729+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178037+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T07:01:03.178037+0000","last_peered":"2024-03-04T07:01:03.178037+0000","last_clean":"2024-03-04T07:01:03.178037+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T07:01:03.178037+0000","last_undegraded":"2024-03-04T07:01:03.178037+0000","last_fullsized":"2024-03-04T07:01:03.178037+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:57.633964+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:59:57.633964+0000","last_peered":"2024-03-04T06:59:57.633964+0000","last_clean":"2024-03-04T06:59:57.633964+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:59:57.633964+0000","last_undegraded":"2024-03-04T06:59:57.633964+0000","last_fullsized":"2024-03-04T06:59:57.633964+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1132,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253574+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T07:01:08.253574+0000","last_peered":"2024-03-04T07:01:08.253574+0000","last_clean":"2024-03-04T07:01:08.253574+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T07:01:08.253574+0000","last_undegraded":"2024-03-04T07:01:08.253574+0000","last_fullsized":"2024-03-04T07:01:08.253574+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1052,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:44.558443+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T06:59:44.558443+0000","last_peered":"2024-03-04T06:59:44.558443+0000","last_clean":"2024-03-04T06:59:44.558443+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T06:59:44.558443+0000","last_undegraded":"2024-03-04T06:59:44.558443+0000","last_fullsized":"2024-03-04T06:59:44.558443+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1304,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:58.015596+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T06:59:58.015596+0000","last_peered":"2024-03-04T06:59:58.015596+0000","last_clean":"2024-03-04T06:59:58.015596+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T06:59:58.015596+0000","last_undegraded":"2024-03-04T06:59:58.015596+0000","last_fullsized":"2024-03-04T06:59:58.015596+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412330+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T07:01:08.412330+0000","last_peered":"2024-03-04T07:01:08.412330+0000","last_clean":"2024-03-04T07:01:08.412330+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T07:01:08.412330+0000","last_undegraded":"2024-03-04T07:01:08.412330+0000","last_fullsized":"2024-03-04T07:01:08.412330+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970340+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T07:00:32.970340+0000","last_peered":"2024-03-04T07:00:32.970340+0000","last_clean":"2024-03-04T07:00:32.970340+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T07:00:32.970340+0000","last_undegraded":"2024-03-04T07:00:32.970340+0000","last_fullsized":"2024-03-04T07:00:32.970340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1053,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:44.572629+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T07:01:44.572629+0000","last_peered":"2024-03-04T07:01:44.572629+0000","last_clean":"2024-03-04T07:01:44.572629+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T07:01:44.572629+0000","last_undegraded":"2024-03-04T07:01:44.572629+0000","last_fullsized":"2024-03-04T07:01:44.572629+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1104,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253553+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T07:01:08.253553+0000","last_peered":"2024-03-04T07:01:08.253553+0000","last_clean":"2024-03-04T07:01:08.253553+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T07:01:08.253553+0000","last_undegraded":"2024-03-04T07:01:08.253553+0000","last_fullsized":"2024-03-04T07:01:08.253553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253528+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T07:01:08.253528+0000","last_peered":"2024-03-04T07:01:08.253528+0000","last_clean":"2024-03-04T07:01:08.253528+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T07:01:08.253528+0000","last_undegraded":"2024-03-04T07:01:08.253528+0000","last_fullsized":"2024-03-04T07:01:08.253528+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412282+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T07:01:08.412282+0000","last_peered":"2024-03-04T07:01:08.412282+0000","last_clean":"2024-03-04T07:01:08.412282+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T07:01:08.412282+0000","last_undegraded":"2024-03-04T07:01:08.412282+0000","last_fullsized":"2024-03-04T07:01:08.412282+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:44.572593+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T07:01:44.572593+0000","last_peered":"2024-03-04T07:01:44.572593+0000","last_clean":"2024-03-04T07:01:44.572593+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T07:01:44.572593+0000","last_undegraded":"2024-03-04T07:01:44.572593+0000","last_fullsized":"2024-03-04T07:01:44.572593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3579,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405911+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:00:08.405911+0000","last_peered":"2024-03-04T07:00:08.405911+0000","last_clean":"2024-03-04T07:00:08.405911+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:00:08.405911+0000","last_undegraded":"2024-03-04T07:00:08.405911+0000","last_fullsized":"2024-03-04T07:00:08.405911+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1162,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:47.645939+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T07:01:47.645939+0000","last_peered":"2024-03-04T07:01:47.645939+0000","last_clean":"2024-03-04T07:01:47.645939+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T07:01:47.645939+0000","last_undegraded":"2024-03-04T07:01:47.645939+0000","last_fullsized":"2024-03-04T07:01:47.645939+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T07:01:19.569613+0000","last_peered":"2024-03-04T07:01:19.569613+0000","last_clean":"2024-03-04T07:01:19.569613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T07:01:19.569613+0000","last_undegraded":"2024-03-04T07:01:19.569613+0000","last_fullsized":"2024-03-04T07:01:19.569613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17118,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019514+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T07:00:33.019514+0000","last_peered":"2024-03-04T07:00:33.019514+0000","last_clean":"2024-03-04T07:00:33.019514+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T07:00:33.019514+0000","last_undegraded":"2024-03-04T07:00:33.019514+0000","last_fullsized":"2024-03-04T07:00:33.019514+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178538+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T07:01:08.178538+0000","last_peered":"2024-03-04T07:01:08.178538+0000","last_clean":"2024-03-04T07:01:08.178538+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T07:01:08.178538+0000","last_undegraded":"2024-03-04T07:01:08.178538+0000","last_fullsized":"2024-03-04T07:01:08.178538+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178614+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T07:01:08.178614+0000","last_peered":"2024-03-04T07:01:08.178614+0000","last_clean":"2024-03-04T07:01:08.178614+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T07:01:08.178614+0000","last_undegraded":"2024-03-04T07:01:08.178614+0000","last_fullsized":"2024-03-04T07:01:08.178614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976230+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T07:01:22.976230+0000","last_peered":"2024-03-04T07:01:22.976230+0000","last_clean":"2024-03-04T07:01:22.976230+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T07:01:22.976230+0000","last_undegraded":"2024-03-04T07:01:22.976230+0000","last_fullsized":"2024-03-04T07:01:22.976230+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4388,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019581+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T07:00:33.019581+0000","last_peered":"2024-03-04T07:00:33.019581+0000","last_clean":"2024-03-04T07:00:33.019581+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T07:00:33.019581+0000","last_undegraded":"2024-03-04T07:00:33.019581+0000","last_fullsized":"2024-03-04T07:00:33.019581+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178564+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T07:01:08.178564+0000","last_peered":"2024-03-04T07:01:08.178564+0000","last_clean":"2024-03-04T07:01:08.178564+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T07:01:08.178564+0000","last_undegraded":"2024-03-04T07:01:08.178564+0000","last_fullsized":"2024-03-04T07:01:08.178564+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976151+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T07:01:22.976151+0000","last_peered":"2024-03-04T07:01:22.976151+0000","last_clean":"2024-03-04T07:01:22.976151+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T07:01:22.976151+0000","last_undegraded":"2024-03-04T07:01:22.976151+0000","last_fullsized":"2024-03-04T07:01:22.976151+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639139+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T07:00:47.639139+0000","last_peered":"2024-03-04T07:00:47.639139+0000","last_clean":"2024-03-04T07:00:47.639139+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T07:00:47.639139+0000","last_undegraded":"2024-03-04T07:00:47.639139+0000","last_fullsized":"2024-03-04T07:00:47.639139+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5641,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.406020+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:00:08.406020+0000","last_peered":"2024-03-04T07:00:08.406020+0000","last_clean":"2024-03-04T07:00:08.406020+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:00:08.406020+0000","last_undegraded":"2024-03-04T07:00:08.406020+0000","last_fullsized":"2024-03-04T07:00:08.406020+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182480+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T07:01:43.182480+0000","last_peered":"2024-03-04T07:01:43.182480+0000","last_clean":"2024-03-04T07:01:43.182480+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T07:01:43.182480+0000","last_undegraded":"2024-03-04T07:01:43.182480+0000","last_fullsized":"2024-03-04T07:01:43.182480+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174867+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T07:00:33.174867+0000","last_peered":"2024-03-04T07:00:33.174867+0000","last_clean":"2024-03-04T07:00:33.174867+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T07:00:33.174867+0000","last_undegraded":"2024-03-04T07:00:33.174867+0000","last_fullsized":"2024-03-04T07:00:33.174867+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416777+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T07:01:43.416777+0000","last_peered":"2024-03-04T07:01:43.416777+0000","last_clean":"2024-03-04T07:01:43.416777+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T07:01:43.416777+0000","last_undegraded":"2024-03-04T07:01:43.416777+0000","last_fullsized":"2024-03-04T07:01:43.416777+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4017,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:29.563935+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T07:00:29.563935+0000","last_peered":"2024-03-04T07:00:29.563935+0000","last_clean":"2024-03-04T07:00:29.563935+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T07:00:29.563935+0000","last_undegraded":"2024-03-04T07:00:29.563935+0000","last_fullsized":"2024-03-04T07:00:29.563935+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:58.259258+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T07:01:58.259258+0000","last_peered":"2024-03-04T07:01:58.259258+0000","last_clean":"2024-03-04T07:01:58.259258+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T07:01:58.259258+0000","last_undegraded":"2024-03-04T07:01:58.259258+0000","last_fullsized":"2024-03-04T07:01:58.259258+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:20.030063+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T07:02:20.030063+0000","last_peered":"2024-03-04T07:02:20.030063+0000","last_clean":"2024-03-04T07:02:20.030063+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T07:02:20.030063+0000","last_undegraded":"2024-03-04T07:02:20.030063+0000","last_fullsized":"2024-03-04T07:02:20.030063+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1150,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976219+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T07:01:22.976219+0000","last_peered":"2024-03-04T07:01:22.976219+0000","last_clean":"2024-03-04T07:01:22.976219+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T07:01:22.976219+0000","last_undegraded":"2024-03-04T07:01:22.976219+0000","last_fullsized":"2024-03-04T07:01:22.976219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1553,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:04.574969+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:02:04.574969+0000","last_peered":"2024-03-04T07:02:04.574969+0000","last_clean":"2024-03-04T07:02:04.574969+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:02:04.574969+0000","last_undegraded":"2024-03-04T07:02:04.574969+0000","last_fullsized":"2024-03-04T07:02:04.574969+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3953,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:52.979497+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T07:01:52.979497+0000","last_peered":"2024-03-04T07:01:52.979497+0000","last_clean":"2024-03-04T07:01:52.979497+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T07:01:52.979497+0000","last_undegraded":"2024-03-04T07:01:52.979497+0000","last_fullsized":"2024-03-04T07:01:52.979497+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023391+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T07:01:08.023391+0000","last_peered":"2024-03-04T07:01:08.023391+0000","last_clean":"2024-03-04T07:01:08.023391+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T07:01:08.023391+0000","last_undegraded":"2024-03-04T07:01:08.023391+0000","last_fullsized":"2024-03-04T07:01:08.023391+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416752+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T07:01:43.416752+0000","last_peered":"2024-03-04T07:01:43.416752+0000","last_clean":"2024-03-04T07:01:43.416752+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T07:01:43.416752+0000","last_undegraded":"2024-03-04T07:01:43.416752+0000","last_fullsized":"2024-03-04T07:01:43.416752+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:04.574922+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:02:04.574922+0000","last_peered":"2024-03-04T07:02:04.574922+0000","last_clean":"2024-03-04T07:02:04.574922+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:02:04.574922+0000","last_undegraded":"2024-03-04T07:02:04.574922+0000","last_fullsized":"2024-03-04T07:02:04.574922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15294,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:58.259228+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T07:01:58.259228+0000","last_peered":"2024-03-04T07:01:58.259228+0000","last_clean":"2024-03-04T07:01:58.259228+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T07:01:58.259228+0000","last_undegraded":"2024-03-04T07:01:58.259228+0000","last_fullsized":"2024-03-04T07:01:58.259228+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019541+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T07:00:33.019541+0000","last_peered":"2024-03-04T07:00:33.019541+0000","last_clean":"2024-03-04T07:00:33.019541+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T07:00:33.019541+0000","last_undegraded":"2024-03-04T07:00:33.019541+0000","last_fullsized":"2024-03-04T07:00:33.019541+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1075,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.563983+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T07:00:29.563983+0000","last_peered":"2024-03-04T07:00:29.563983+0000","last_clean":"2024-03-04T07:00:29.563983+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T07:00:29.563983+0000","last_undegraded":"2024-03-04T07:00:29.563983+0000","last_fullsized":"2024-03-04T07:00:29.563983+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178580+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T07:01:08.178580+0000","last_peered":"2024-03-04T07:01:08.178580+0000","last_clean":"2024-03-04T07:01:08.178580+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T07:01:08.178580+0000","last_undegraded":"2024-03-04T07:01:08.178580+0000","last_fullsized":"2024-03-04T07:01:08.178580+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4381,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:47.639101+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T07:00:47.639101+0000","last_peered":"2024-03-04T07:00:47.639101+0000","last_clean":"2024-03-04T07:00:47.639101+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T07:00:47.639101+0000","last_undegraded":"2024-03-04T07:00:47.639101+0000","last_fullsized":"2024-03-04T07:00:47.639101+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026676+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T07:01:45.026676+0000","last_peered":"2024-03-04T07:01:45.026676+0000","last_clean":"2024-03-04T07:01:45.026676+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T07:01:45.026676+0000","last_undegraded":"2024-03-04T07:01:45.026676+0000","last_fullsized":"2024-03-04T07:01:45.026676+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1271,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182470+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T07:01:43.182470+0000","last_peered":"2024-03-04T07:01:43.182470+0000","last_clean":"2024-03-04T07:01:43.182470+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T07:01:43.182470+0000","last_undegraded":"2024-03-04T07:01:43.182470+0000","last_fullsized":"2024-03-04T07:01:43.182470+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020800+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T07:00:45.020800+0000","last_peered":"2024-03-04T07:00:45.020800+0000","last_clean":"2024-03-04T07:00:45.020800+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T07:00:45.020800+0000","last_undegraded":"2024-03-04T07:00:45.020800+0000","last_fullsized":"2024-03-04T07:00:45.020800+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4612,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:45.026591+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T07:01:45.026591+0000","last_peered":"2024-03-04T07:01:45.026591+0000","last_clean":"2024-03-04T07:01:45.026591+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T07:01:45.026591+0000","last_undegraded":"2024-03-04T07:01:45.026591+0000","last_fullsized":"2024-03-04T07:01:45.026591+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639077+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T07:00:47.639077+0000","last_peered":"2024-03-04T07:00:47.639077+0000","last_clean":"2024-03-04T07:00:47.639077+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T07:00:47.639077+0000","last_undegraded":"2024-03-04T07:00:47.639077+0000","last_fullsized":"2024-03-04T07:00:47.639077+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1080,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247864+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T07:00:18.247864+0000","last_peered":"2024-03-04T07:00:18.247864+0000","last_clean":"2024-03-04T07:00:18.247864+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T07:00:18.247864+0000","last_undegraded":"2024-03-04T07:00:18.247864+0000","last_fullsized":"2024-03-04T07:00:18.247864+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023341+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T07:01:08.023341+0000","last_peered":"2024-03-04T07:01:08.023341+0000","last_clean":"2024-03-04T07:01:08.023341+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T07:01:08.023341+0000","last_undegraded":"2024-03-04T07:01:08.023341+0000","last_fullsized":"2024-03-04T07:01:08.023341+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4636,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:07.967606+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T07:00:07.967606+0000","last_peered":"2024-03-04T07:00:07.967606+0000","last_clean":"2024-03-04T07:00:07.967606+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T07:00:07.967606+0000","last_undegraded":"2024-03-04T07:00:07.967606+0000","last_fullsized":"2024-03-04T07:00:07.967606+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:54.566566+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T07:00:54.566566+0000","last_peered":"2024-03-04T07:00:54.566566+0000","last_clean":"2024-03-04T07:00:54.566566+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T07:00:54.566566+0000","last_undegraded":"2024-03-04T07:00:54.566566+0000","last_fullsized":"2024-03-04T07:00:54.566566+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1187,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:17.642331+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T07:01:17.642331+0000","last_peered":"2024-03-04T07:01:17.642331+0000","last_clean":"2024-03-04T07:01:17.642331+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T07:01:17.642331+0000","last_undegraded":"2024-03-04T07:01:17.642331+0000","last_fullsized":"2024-03-04T07:01:17.642331+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5160,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:47.645896+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T07:01:47.645896+0000","last_peered":"2024-03-04T07:01:47.645896+0000","last_clean":"2024-03-04T07:01:47.645896+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T07:01:47.645896+0000","last_undegraded":"2024-03-04T07:01:47.645896+0000","last_fullsized":"2024-03-04T07:01:47.645896+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182417+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T07:01:43.182417+0000","last_peered":"2024-03-04T07:01:43.182417+0000","last_clean":"2024-03-04T07:01:43.182417+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T07:01:43.182417+0000","last_undegraded":"2024-03-04T07:01:43.182417+0000","last_fullsized":"2024-03-04T07:01:43.182417+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020733+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T07:00:45.020733+0000","last_peered":"2024-03-04T07:00:45.020733+0000","last_clean":"2024-03-04T07:00:45.020733+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T07:00:45.020733+0000","last_undegraded":"2024-03-04T07:00:45.020733+0000","last_fullsized":"2024-03-04T07:00:45.020733+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4721,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409468+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T07:00:38.409468+0000","last_peered":"2024-03-04T07:00:38.409468+0000","last_clean":"2024-03-04T07:00:38.409468+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T07:00:38.409468+0000","last_undegraded":"2024-03-04T07:00:38.409468+0000","last_fullsized":"2024-03-04T07:00:38.409468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182435+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T07:01:43.182435+0000","last_peered":"2024-03-04T07:01:43.182435+0000","last_clean":"2024-03-04T07:01:43.182435+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T07:01:43.182435+0000","last_undegraded":"2024-03-04T07:01:43.182435+0000","last_fullsized":"2024-03-04T07:01:43.182435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023738+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T07:01:15.023738+0000","last_peered":"2024-03-04T07:01:15.023738+0000","last_clean":"2024-03-04T07:01:15.023738+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T07:01:15.023738+0000","last_undegraded":"2024-03-04T07:01:15.023738+0000","last_fullsized":"2024-03-04T07:01:15.023738+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5556,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:03.171266+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:00:03.171266+0000","last_peered":"2024-03-04T07:00:03.171266+0000","last_clean":"2024-03-04T07:00:03.171266+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:00:03.171266+0000","last_undegraded":"2024-03-04T07:00:03.171266+0000","last_fullsized":"2024-03-04T07:00:03.171266+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T07:01:19.569554+0000","last_peered":"2024-03-04T07:01:19.569554+0000","last_clean":"2024-03-04T07:01:19.569554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T07:01:19.569554+0000","last_undegraded":"2024-03-04T07:01:19.569554+0000","last_fullsized":"2024-03-04T07:01:19.569554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1102,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247800+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T07:00:18.247800+0000","last_peered":"2024-03-04T07:00:18.247800+0000","last_clean":"2024-03-04T07:00:18.247800+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T07:00:18.247800+0000","last_undegraded":"2024-03-04T07:00:18.247800+0000","last_fullsized":"2024-03-04T07:00:18.247800+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409421+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T07:00:38.409421+0000","last_peered":"2024-03-04T07:00:38.409421+0000","last_clean":"2024-03-04T07:00:38.409421+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T07:00:38.409421+0000","last_undegraded":"2024-03-04T07:00:38.409421+0000","last_fullsized":"2024-03-04T07:00:38.409421+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409457+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T07:00:38.409457+0000","last_peered":"2024-03-04T07:00:38.409457+0000","last_clean":"2024-03-04T07:00:38.409457+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T07:00:38.409457+0000","last_undegraded":"2024-03-04T07:00:38.409457+0000","last_fullsized":"2024-03-04T07:00:38.409457+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T07:01:19.569599+0000","last_peered":"2024-03-04T07:01:19.569599+0000","last_clean":"2024-03-04T07:01:19.569599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T07:01:19.569599+0000","last_undegraded":"2024-03-04T07:01:19.569599+0000","last_fullsized":"2024-03-04T07:01:19.569599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4368,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:08.405967+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:00:08.405967+0000","last_peered":"2024-03-04T07:00:08.405967+0000","last_clean":"2024-03-04T07:00:08.405967+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:00:08.405967+0000","last_undegraded":"2024-03-04T07:00:08.405967+0000","last_fullsized":"2024-03-04T07:00:08.405967+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:03.171315+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:00:03.171315+0000","last_peered":"2024-03-04T07:00:03.171315+0000","last_clean":"2024-03-04T07:00:03.171315+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:00:03.171315+0000","last_undegraded":"2024-03-04T07:00:03.171315+0000","last_fullsized":"2024-03-04T07:00:03.171315+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1141,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967580+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T07:00:07.967580+0000","last_peered":"2024-03-04T07:00:07.967580+0000","last_clean":"2024-03-04T07:00:07.967580+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T07:00:07.967580+0000","last_undegraded":"2024-03-04T07:00:07.967580+0000","last_fullsized":"2024-03-04T07:00:07.967580+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4602,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:54.566603+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T07:00:54.566603+0000","last_peered":"2024-03-04T07:00:54.566603+0000","last_clean":"2024-03-04T07:00:54.566603+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T07:00:54.566603+0000","last_undegraded":"2024-03-04T07:00:54.566603+0000","last_fullsized":"2024-03-04T07:00:54.566603+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1247,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409492+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T07:00:38.409492+0000","last_peered":"2024-03-04T07:00:38.409492+0000","last_clean":"2024-03-04T07:00:38.409492+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T07:00:38.409492+0000","last_undegraded":"2024-03-04T07:00:38.409492+0000","last_fullsized":"2024-03-04T07:00:38.409492+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569626+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T07:01:19.569626+0000","last_peered":"2024-03-04T07:01:19.569626+0000","last_clean":"2024-03-04T07:01:19.569626+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T07:01:19.569626+0000","last_undegraded":"2024-03-04T07:01:19.569626+0000","last_fullsized":"2024-03-04T07:01:19.569626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:58.259166+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T07:01:58.259166+0000","last_peered":"2024-03-04T07:01:58.259166+0000","last_clean":"2024-03-04T07:01:58.259166+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T07:01:58.259166+0000","last_undegraded":"2024-03-04T07:01:58.259166+0000","last_fullsized":"2024-03-04T07:01:58.259166+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416787+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T07:01:43.416787+0000","last_peered":"2024-03-04T07:01:43.416787+0000","last_clean":"2024-03-04T07:01:43.416787+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T07:01:43.416787+0000","last_undegraded":"2024-03-04T07:01:43.416787+0000","last_fullsized":"2024-03-04T07:01:43.416787+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976197+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T07:01:22.976197+0000","last_peered":"2024-03-04T07:01:22.976197+0000","last_clean":"2024-03-04T07:01:22.976197+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T07:01:22.976197+0000","last_undegraded":"2024-03-04T07:01:22.976197+0000","last_fullsized":"2024-03-04T07:01:22.976197+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019487+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T07:00:33.019487+0000","last_peered":"2024-03-04T07:00:33.019487+0000","last_clean":"2024-03-04T07:00:33.019487+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T07:00:33.019487+0000","last_undegraded":"2024-03-04T07:00:33.019487+0000","last_fullsized":"2024-03-04T07:00:33.019487+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020779+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T07:00:45.020779+0000","last_peered":"2024-03-04T07:00:45.020779+0000","last_clean":"2024-03-04T07:00:45.020779+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T07:00:45.020779+0000","last_undegraded":"2024-03-04T07:00:45.020779+0000","last_fullsized":"2024-03-04T07:00:45.020779+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182456+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T07:01:43.182456+0000","last_peered":"2024-03-04T07:01:43.182456+0000","last_clean":"2024-03-04T07:01:43.182456+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T07:01:43.182456+0000","last_undegraded":"2024-03-04T07:01:43.182456+0000","last_fullsized":"2024-03-04T07:01:43.182456+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:18.247852+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T07:00:18.247852+0000","last_peered":"2024-03-04T07:00:18.247852+0000","last_clean":"2024-03-04T07:00:18.247852+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T07:00:18.247852+0000","last_undegraded":"2024-03-04T07:00:18.247852+0000","last_fullsized":"2024-03-04T07:00:18.247852+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020816+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T07:00:45.020816+0000","last_peered":"2024-03-04T07:00:45.020816+0000","last_clean":"2024-03-04T07:00:45.020816+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T07:00:45.020816+0000","last_undegraded":"2024-03-04T07:00:45.020816+0000","last_fullsized":"2024-03-04T07:00:45.020816+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:52.979394+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T07:01:52.979394+0000","last_peered":"2024-03-04T07:01:52.979394+0000","last_clean":"2024-03-04T07:01:52.979394+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T07:01:52.979394+0000","last_undegraded":"2024-03-04T07:01:52.979394+0000","last_fullsized":"2024-03-04T07:01:52.979394+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023709+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T07:01:15.023709+0000","last_peered":"2024-03-04T07:01:15.023709+0000","last_clean":"2024-03-04T07:01:15.023709+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T07:01:15.023709+0000","last_undegraded":"2024-03-04T07:01:15.023709+0000","last_fullsized":"2024-03-04T07:01:15.023709+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1122,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:07.967529+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T07:00:07.967529+0000","last_peered":"2024-03-04T07:00:07.967529+0000","last_clean":"2024-03-04T07:00:07.967529+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T07:00:07.967529+0000","last_undegraded":"2024-03-04T07:00:07.967529+0000","last_fullsized":"2024-03-04T07:00:07.967529+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.026774+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T07:01:43.026774+0000","last_peered":"2024-03-04T07:01:43.026774+0000","last_clean":"2024-03-04T07:01:43.026774+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T07:01:43.026774+0000","last_undegraded":"2024-03-04T07:01:43.026774+0000","last_fullsized":"2024-03-04T07:01:43.026774+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:43.250705+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T07:00:43.250705+0000","last_peered":"2024-03-04T07:00:43.250705+0000","last_clean":"2024-03-04T07:00:43.250705+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T07:00:43.250705+0000","last_undegraded":"2024-03-04T07:00:43.250705+0000","last_fullsized":"2024-03-04T07:00:43.250705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503533,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648180,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142487,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287134,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997840,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885897,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937474,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792827,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:04:28.406 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:28.406 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:28.406 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:28.406 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:28.406 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:28.406 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:28.406 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:28.406 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:28.406 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:28.406 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:28.407 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:04:28.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:28 smithi203 ceph-mon[85573]: pgmap v1198: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:29.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:29 smithi137 ceph-mon[88869]: from='client.44696 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:29.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:29 smithi137 ceph-mon[91314]: from='client.44696 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:29.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:29 smithi203 ceph-mon[85573]: from='client.44696 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:30.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:30 smithi137 ceph-mon[88869]: pgmap v1199: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:30.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:30 smithi137 ceph-mon[91314]: pgmap v1199: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:30.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:30 smithi203 ceph-mon[85573]: pgmap v1199: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:32.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:32 smithi137 ceph-mon[88869]: pgmap v1200: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:32.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:32 smithi137 ceph-mon[91314]: pgmap v1200: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:32.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:32 smithi203 ceph-mon[85573]: pgmap v1200: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:34.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:34 smithi203 ceph-mon[85573]: pgmap v1201: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:34.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:34 smithi137 ceph-mon[88869]: pgmap v1201: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:34.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:34 smithi137 ceph-mon[91314]: pgmap v1201: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:35.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:04:35 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:04:35] "GET /metrics HTTP/1.1" 200 36330 "" "Prometheus/2.43.0" 2024-03-04T07:04:36.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:36 smithi203 ceph-mon[85573]: pgmap v1202: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:36.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:36 smithi137 ceph-mon[88869]: pgmap v1202: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:36.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:36 smithi137 ceph-mon[91314]: pgmap v1202: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:38.407 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:04:38.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:38 smithi203 ceph-mon[85573]: pgmap v1203: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:38.633 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:04:38.754 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:38 smithi137 ceph-mon[88869]: pgmap v1203: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:38.755 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:38 smithi137 ceph-mon[91314]: pgmap v1203: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:39.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:39 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:04:39.775 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:39 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:04:39.775 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:39 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:04:40.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:40 smithi203 ceph-mon[85573]: pgmap v1204: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:40.622 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:04:40.622 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:40 smithi137 ceph-mon[88869]: pgmap v1204: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:40.623 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:40 smithi137 ceph-mon[91314]: pgmap v1204: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:40.630 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:04:41.284 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1204,"stamp":"2024-03-04T07:04:38.635951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003887"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.564000+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T07:00:29.564000+0000","last_peered":"2024-03-04T07:00:29.564000+0000","last_clean":"2024-03-04T07:00:29.564000+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T07:00:29.564000+0000","last_undegraded":"2024-03-04T07:00:29.564000+0000","last_fullsized":"2024-03-04T07:00:29.564000+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178667+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T07:01:08.178667+0000","last_peered":"2024-03-04T07:01:08.178667+0000","last_clean":"2024-03-04T07:01:08.178667+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T07:01:08.178667+0000","last_undegraded":"2024-03-04T07:01:08.178667+0000","last_fullsized":"2024-03-04T07:01:08.178667+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019562+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T07:00:33.019562+0000","last_peered":"2024-03-04T07:00:33.019562+0000","last_clean":"2024-03-04T07:00:33.019562+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T07:00:33.019562+0000","last_undegraded":"2024-03-04T07:00:33.019562+0000","last_fullsized":"2024-03-04T07:00:33.019562+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1143,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:52.972434+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T07:00:52.972434+0000","last_peered":"2024-03-04T07:00:52.972434+0000","last_clean":"2024-03-04T07:00:52.972434+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T07:00:52.972434+0000","last_undegraded":"2024-03-04T07:00:52.972434+0000","last_fullsized":"2024-03-04T07:00:52.972434+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560949+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T07:00:04.560949+0000","last_peered":"2024-03-04T07:00:04.560949+0000","last_clean":"2024-03-04T07:00:04.560949+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T07:00:04.560949+0000","last_undegraded":"2024-03-04T07:00:04.560949+0000","last_fullsized":"2024-03-04T07:00:04.560949+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976210+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T07:01:22.976210+0000","last_peered":"2024-03-04T07:01:22.976210+0000","last_clean":"2024-03-04T07:01:22.976210+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T07:01:22.976210+0000","last_undegraded":"2024-03-04T07:01:22.976210+0000","last_fullsized":"2024-03-04T07:01:22.976210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560930+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T07:00:04.560930+0000","last_peered":"2024-03-04T07:00:04.560930+0000","last_clean":"2024-03-04T07:00:04.560930+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T07:00:04.560930+0000","last_undegraded":"2024-03-04T07:00:04.560930+0000","last_fullsized":"2024-03-04T07:00:04.560930+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017220+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T07:00:15.017220+0000","last_peered":"2024-03-04T07:00:15.017220+0000","last_clean":"2024-03-04T07:00:15.017220+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T07:00:15.017220+0000","last_undegraded":"2024-03-04T07:00:15.017220+0000","last_fullsized":"2024-03-04T07:00:15.017220+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1067,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:09.575780+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T07:02:09.575780+0000","last_peered":"2024-03-04T07:02:09.575780+0000","last_clean":"2024-03-04T07:02:09.575780+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T07:02:09.575780+0000","last_undegraded":"2024-03-04T07:02:09.575780+0000","last_fullsized":"2024-03-04T07:02:09.575780+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256498+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T07:01:33.256498+0000","last_peered":"2024-03-04T07:01:33.256498+0000","last_clean":"2024-03-04T07:01:33.256498+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T07:01:33.256498+0000","last_undegraded":"2024-03-04T07:01:33.256498+0000","last_fullsized":"2024-03-04T07:01:33.256498+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256456+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T07:01:33.256456+0000","last_peered":"2024-03-04T07:01:33.256456+0000","last_clean":"2024-03-04T07:01:33.256456+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T07:01:33.256456+0000","last_undegraded":"2024-03-04T07:01:33.256456+0000","last_fullsized":"2024-03-04T07:01:33.256456+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:22.636361+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T07:00:22.636361+0000","last_peered":"2024-03-04T07:00:22.636361+0000","last_clean":"2024-03-04T07:00:22.636361+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T07:00:22.636361+0000","last_undegraded":"2024-03-04T07:00:22.636361+0000","last_fullsized":"2024-03-04T07:00:22.636361+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1201,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014730+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T06:59:50.014730+0000","last_peered":"2024-03-04T06:59:50.014730+0000","last_clean":"2024-03-04T06:59:50.014730+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T06:59:50.014730+0000","last_undegraded":"2024-03-04T06:59:50.014730+0000","last_fullsized":"2024-03-04T06:59:50.014730+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.030465+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T07:02:18.030465+0000","last_peered":"2024-03-04T07:02:18.030465+0000","last_clean":"2024-03-04T07:02:18.030465+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T07:02:18.030465+0000","last_undegraded":"2024-03-04T07:02:18.030465+0000","last_fullsized":"2024-03-04T07:02:18.030465+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174897+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T07:00:33.174897+0000","last_peered":"2024-03-04T07:00:33.174897+0000","last_clean":"2024-03-04T07:00:33.174897+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T07:00:33.174897+0000","last_undegraded":"2024-03-04T07:00:33.174897+0000","last_fullsized":"2024-03-04T07:00:33.174897+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970309+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T07:00:32.970309+0000","last_peered":"2024-03-04T07:00:32.970309+0000","last_clean":"2024-03-04T07:00:32.970309+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T07:00:32.970309+0000","last_undegraded":"2024-03-04T07:00:32.970309+0000","last_fullsized":"2024-03-04T07:00:32.970309+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970400+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T07:00:32.970400+0000","last_peered":"2024-03-04T07:00:32.970400+0000","last_clean":"2024-03-04T07:00:32.970400+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T07:00:32.970400+0000","last_undegraded":"2024-03-04T07:00:32.970400+0000","last_fullsized":"2024-03-04T07:00:32.970400+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412366+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T07:01:08.412366+0000","last_peered":"2024-03-04T07:01:08.412366+0000","last_clean":"2024-03-04T07:01:08.412366+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T07:01:08.412366+0000","last_undegraded":"2024-03-04T07:01:08.412366+0000","last_fullsized":"2024-03-04T07:01:08.412366+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T07:01:19.569588+0000","last_peered":"2024-03-04T07:01:19.569588+0000","last_clean":"2024-03-04T07:01:19.569588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T07:01:19.569588+0000","last_undegraded":"2024-03-04T07:01:19.569588+0000","last_fullsized":"2024-03-04T07:01:19.569588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1307,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019623+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T07:00:33.019623+0000","last_peered":"2024-03-04T07:00:33.019623+0000","last_clean":"2024-03-04T07:00:33.019623+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T07:00:33.019623+0000","last_undegraded":"2024-03-04T07:00:33.019623+0000","last_fullsized":"2024-03-04T07:00:33.019623+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1197,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026705+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T07:01:45.026705+0000","last_peered":"2024-03-04T07:01:45.026705+0000","last_clean":"2024-03-04T07:01:45.026705+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T07:01:45.026705+0000","last_undegraded":"2024-03-04T07:01:45.026705+0000","last_fullsized":"2024-03-04T07:01:45.026705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026715+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T07:01:45.026715+0000","last_peered":"2024-03-04T07:01:45.026715+0000","last_clean":"2024-03-04T07:01:45.026715+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T07:01:45.026715+0000","last_undegraded":"2024-03-04T07:01:45.026715+0000","last_fullsized":"2024-03-04T07:01:45.026715+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019611+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T07:00:33.019611+0000","last_peered":"2024-03-04T07:00:33.019611+0000","last_clean":"2024-03-04T07:00:33.019611+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T07:00:33.019611+0000","last_undegraded":"2024-03-04T07:00:33.019611+0000","last_fullsized":"2024-03-04T07:00:33.019611+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:08.419543+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T07:02:08.419543+0000","last_peered":"2024-03-04T07:02:08.419543+0000","last_clean":"2024-03-04T07:02:08.419543+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T07:02:08.419543+0000","last_undegraded":"2024-03-04T07:02:08.419543+0000","last_fullsized":"2024-03-04T07:02:08.419543+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1224,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:08.419489+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T07:02:08.419489+0000","last_peered":"2024-03-04T07:02:08.419489+0000","last_clean":"2024-03-04T07:02:08.419489+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T07:02:08.419489+0000","last_undegraded":"2024-03-04T07:02:08.419489+0000","last_fullsized":"2024-03-04T07:02:08.419489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560965+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T07:00:04.560965+0000","last_peered":"2024-03-04T07:00:04.560965+0000","last_clean":"2024-03-04T07:00:04.560965+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T07:00:04.560965+0000","last_undegraded":"2024-03-04T07:00:04.560965+0000","last_fullsized":"2024-03-04T07:00:04.560965+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976241+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T07:01:22.976241+0000","last_peered":"2024-03-04T07:01:22.976241+0000","last_clean":"2024-03-04T07:01:22.976241+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T07:01:22.976241+0000","last_undegraded":"2024-03-04T07:01:22.976241+0000","last_fullsized":"2024-03-04T07:01:22.976241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017274+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T07:00:15.017274+0000","last_peered":"2024-03-04T07:00:15.017274+0000","last_clean":"2024-03-04T07:00:15.017274+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T07:00:15.017274+0000","last_undegraded":"2024-03-04T07:00:15.017274+0000","last_fullsized":"2024-03-04T07:00:15.017274+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1191,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639127+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T07:00:47.639127+0000","last_peered":"2024-03-04T07:00:47.639127+0000","last_clean":"2024-03-04T07:00:47.639127+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T07:00:47.639127+0000","last_undegraded":"2024-03-04T07:00:47.639127+0000","last_fullsized":"2024-03-04T07:00:47.639127+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:58.259212+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T07:01:58.259212+0000","last_peered":"2024-03-04T07:01:58.259212+0000","last_clean":"2024-03-04T07:01:58.259212+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T07:01:58.259212+0000","last_undegraded":"2024-03-04T07:01:58.259212+0000","last_fullsized":"2024-03-04T07:01:58.259212+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:58.022394+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T07:00:58.022394+0000","last_peered":"2024-03-04T07:00:58.022394+0000","last_clean":"2024-03-04T07:00:58.022394+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T07:00:58.022394+0000","last_undegraded":"2024-03-04T07:00:58.022394+0000","last_fullsized":"2024-03-04T07:00:58.022394+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014712+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T06:59:50.014712+0000","last_peered":"2024-03-04T06:59:50.014712+0000","last_clean":"2024-03-04T06:59:50.014712+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T06:59:50.014712+0000","last_undegraded":"2024-03-04T06:59:50.014712+0000","last_fullsized":"2024-03-04T06:59:50.014712+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1207,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:50.014675+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T06:59:50.014675+0000","last_peered":"2024-03-04T06:59:50.014675+0000","last_clean":"2024-03-04T06:59:50.014675+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T06:59:50.014675+0000","last_undegraded":"2024-03-04T06:59:50.014675+0000","last_fullsized":"2024-03-04T06:59:50.014675+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973153+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T07:00:57.973153+0000","last_peered":"2024-03-04T07:00:57.973153+0000","last_clean":"2024-03-04T07:00:57.973153+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T07:00:57.973153+0000","last_undegraded":"2024-03-04T07:00:57.973153+0000","last_fullsized":"2024-03-04T07:00:57.973153+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178000+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T07:01:03.178000+0000","last_peered":"2024-03-04T07:01:03.178000+0000","last_clean":"2024-03-04T07:01:03.178000+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T07:01:03.178000+0000","last_undegraded":"2024-03-04T07:01:03.178000+0000","last_fullsized":"2024-03-04T07:01:03.178000+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256513+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T07:01:33.256513+0000","last_peered":"2024-03-04T07:01:33.256513+0000","last_clean":"2024-03-04T07:01:33.256513+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T07:01:33.256513+0000","last_undegraded":"2024-03-04T07:01:33.256513+0000","last_fullsized":"2024-03-04T07:01:33.256513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973230+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T07:00:57.973230+0000","last_peered":"2024-03-04T07:00:57.973230+0000","last_clean":"2024-03-04T07:00:57.973230+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T07:00:57.973230+0000","last_undegraded":"2024-03-04T07:00:57.973230+0000","last_fullsized":"2024-03-04T07:00:57.973230+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973215+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T07:00:57.973215+0000","last_peered":"2024-03-04T07:00:57.973215+0000","last_clean":"2024-03-04T07:00:57.973215+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T07:00:57.973215+0000","last_undegraded":"2024-03-04T07:00:57.973215+0000","last_fullsized":"2024-03-04T07:00:57.973215+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:28.018729+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T07:00:28.018729+0000","last_peered":"2024-03-04T07:00:28.018729+0000","last_clean":"2024-03-04T07:00:28.018729+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T07:00:28.018729+0000","last_undegraded":"2024-03-04T07:00:28.018729+0000","last_fullsized":"2024-03-04T07:00:28.018729+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178037+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T07:01:03.178037+0000","last_peered":"2024-03-04T07:01:03.178037+0000","last_clean":"2024-03-04T07:01:03.178037+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T07:01:03.178037+0000","last_undegraded":"2024-03-04T07:01:03.178037+0000","last_fullsized":"2024-03-04T07:01:03.178037+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T06:59:57.633964+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T06:59:57.633964+0000","last_peered":"2024-03-04T06:59:57.633964+0000","last_clean":"2024-03-04T06:59:57.633964+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T06:59:57.633964+0000","last_undegraded":"2024-03-04T06:59:57.633964+0000","last_fullsized":"2024-03-04T06:59:57.633964+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1132,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253574+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T07:01:08.253574+0000","last_peered":"2024-03-04T07:01:08.253574+0000","last_clean":"2024-03-04T07:01:08.253574+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T07:01:08.253574+0000","last_undegraded":"2024-03-04T07:01:08.253574+0000","last_fullsized":"2024-03-04T07:01:08.253574+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1053,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:09.575752+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T07:02:09.575752+0000","last_peered":"2024-03-04T07:02:09.575752+0000","last_clean":"2024-03-04T07:02:09.575752+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T07:02:09.575752+0000","last_undegraded":"2024-03-04T07:02:09.575752+0000","last_fullsized":"2024-03-04T07:02:09.575752+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1305,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.030497+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T07:02:18.030497+0000","last_peered":"2024-03-04T07:02:18.030497+0000","last_clean":"2024-03-04T07:02:18.030497+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T07:02:18.030497+0000","last_undegraded":"2024-03-04T07:02:18.030497+0000","last_fullsized":"2024-03-04T07:02:18.030497+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412330+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T07:01:08.412330+0000","last_peered":"2024-03-04T07:01:08.412330+0000","last_clean":"2024-03-04T07:01:08.412330+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T07:01:08.412330+0000","last_undegraded":"2024-03-04T07:01:08.412330+0000","last_fullsized":"2024-03-04T07:01:08.412330+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970340+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T07:00:32.970340+0000","last_peered":"2024-03-04T07:00:32.970340+0000","last_clean":"2024-03-04T07:00:32.970340+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T07:00:32.970340+0000","last_undegraded":"2024-03-04T07:00:32.970340+0000","last_fullsized":"2024-03-04T07:00:32.970340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1053,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:44.572629+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T07:01:44.572629+0000","last_peered":"2024-03-04T07:01:44.572629+0000","last_clean":"2024-03-04T07:01:44.572629+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T07:01:44.572629+0000","last_undegraded":"2024-03-04T07:01:44.572629+0000","last_fullsized":"2024-03-04T07:01:44.572629+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1104,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253553+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T07:01:08.253553+0000","last_peered":"2024-03-04T07:01:08.253553+0000","last_clean":"2024-03-04T07:01:08.253553+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T07:01:08.253553+0000","last_undegraded":"2024-03-04T07:01:08.253553+0000","last_fullsized":"2024-03-04T07:01:08.253553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253528+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T07:01:08.253528+0000","last_peered":"2024-03-04T07:01:08.253528+0000","last_clean":"2024-03-04T07:01:08.253528+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T07:01:08.253528+0000","last_undegraded":"2024-03-04T07:01:08.253528+0000","last_fullsized":"2024-03-04T07:01:08.253528+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412282+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T07:01:08.412282+0000","last_peered":"2024-03-04T07:01:08.412282+0000","last_clean":"2024-03-04T07:01:08.412282+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T07:01:08.412282+0000","last_undegraded":"2024-03-04T07:01:08.412282+0000","last_fullsized":"2024-03-04T07:01:08.412282+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:44.572593+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T07:01:44.572593+0000","last_peered":"2024-03-04T07:01:44.572593+0000","last_clean":"2024-03-04T07:01:44.572593+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T07:01:44.572593+0000","last_undegraded":"2024-03-04T07:01:44.572593+0000","last_fullsized":"2024-03-04T07:01:44.572593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3580,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.420253+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:02:18.420253+0000","last_peered":"2024-03-04T07:02:18.420253+0000","last_clean":"2024-03-04T07:02:18.420253+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:02:18.420253+0000","last_undegraded":"2024-03-04T07:02:18.420253+0000","last_fullsized":"2024-03-04T07:02:18.420253+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1162,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:47.645939+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T07:01:47.645939+0000","last_peered":"2024-03-04T07:01:47.645939+0000","last_clean":"2024-03-04T07:01:47.645939+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T07:01:47.645939+0000","last_undegraded":"2024-03-04T07:01:47.645939+0000","last_fullsized":"2024-03-04T07:01:47.645939+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T07:01:19.569613+0000","last_peered":"2024-03-04T07:01:19.569613+0000","last_clean":"2024-03-04T07:01:19.569613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T07:01:19.569613+0000","last_undegraded":"2024-03-04T07:01:19.569613+0000","last_fullsized":"2024-03-04T07:01:19.569613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17118,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019514+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T07:00:33.019514+0000","last_peered":"2024-03-04T07:00:33.019514+0000","last_clean":"2024-03-04T07:00:33.019514+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T07:00:33.019514+0000","last_undegraded":"2024-03-04T07:00:33.019514+0000","last_fullsized":"2024-03-04T07:00:33.019514+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178538+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T07:01:08.178538+0000","last_peered":"2024-03-04T07:01:08.178538+0000","last_clean":"2024-03-04T07:01:08.178538+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T07:01:08.178538+0000","last_undegraded":"2024-03-04T07:01:08.178538+0000","last_fullsized":"2024-03-04T07:01:08.178538+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178614+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T07:01:08.178614+0000","last_peered":"2024-03-04T07:01:08.178614+0000","last_clean":"2024-03-04T07:01:08.178614+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T07:01:08.178614+0000","last_undegraded":"2024-03-04T07:01:08.178614+0000","last_fullsized":"2024-03-04T07:01:08.178614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976230+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T07:01:22.976230+0000","last_peered":"2024-03-04T07:01:22.976230+0000","last_clean":"2024-03-04T07:01:22.976230+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T07:01:22.976230+0000","last_undegraded":"2024-03-04T07:01:22.976230+0000","last_fullsized":"2024-03-04T07:01:22.976230+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4388,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:33.019581+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T07:00:33.019581+0000","last_peered":"2024-03-04T07:00:33.019581+0000","last_clean":"2024-03-04T07:00:33.019581+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T07:00:33.019581+0000","last_undegraded":"2024-03-04T07:00:33.019581+0000","last_fullsized":"2024-03-04T07:00:33.019581+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178564+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T07:01:08.178564+0000","last_peered":"2024-03-04T07:01:08.178564+0000","last_clean":"2024-03-04T07:01:08.178564+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T07:01:08.178564+0000","last_undegraded":"2024-03-04T07:01:08.178564+0000","last_fullsized":"2024-03-04T07:01:08.178564+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976151+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T07:01:22.976151+0000","last_peered":"2024-03-04T07:01:22.976151+0000","last_clean":"2024-03-04T07:01:22.976151+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T07:01:22.976151+0000","last_undegraded":"2024-03-04T07:01:22.976151+0000","last_fullsized":"2024-03-04T07:01:22.976151+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639139+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T07:00:47.639139+0000","last_peered":"2024-03-04T07:00:47.639139+0000","last_clean":"2024-03-04T07:00:47.639139+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T07:00:47.639139+0000","last_undegraded":"2024-03-04T07:00:47.639139+0000","last_fullsized":"2024-03-04T07:00:47.639139+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5642,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.420330+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:02:18.420330+0000","last_peered":"2024-03-04T07:02:18.420330+0000","last_clean":"2024-03-04T07:02:18.420330+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:02:18.420330+0000","last_undegraded":"2024-03-04T07:02:18.420330+0000","last_fullsized":"2024-03-04T07:02:18.420330+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182480+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T07:01:43.182480+0000","last_peered":"2024-03-04T07:01:43.182480+0000","last_clean":"2024-03-04T07:01:43.182480+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T07:01:43.182480+0000","last_undegraded":"2024-03-04T07:01:43.182480+0000","last_fullsized":"2024-03-04T07:01:43.182480+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:33.187586+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T07:02:33.187586+0000","last_peered":"2024-03-04T07:02:33.187586+0000","last_clean":"2024-03-04T07:02:33.187586+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T07:02:33.187586+0000","last_undegraded":"2024-03-04T07:02:33.187586+0000","last_fullsized":"2024-03-04T07:02:33.187586+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416777+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T07:01:43.416777+0000","last_peered":"2024-03-04T07:01:43.416777+0000","last_clean":"2024-03-04T07:01:43.416777+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T07:01:43.416777+0000","last_undegraded":"2024-03-04T07:01:43.416777+0000","last_fullsized":"2024-03-04T07:01:43.416777+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4017,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:29.563935+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T07:00:29.563935+0000","last_peered":"2024-03-04T07:00:29.563935+0000","last_clean":"2024-03-04T07:00:29.563935+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T07:00:29.563935+0000","last_undegraded":"2024-03-04T07:00:29.563935+0000","last_fullsized":"2024-03-04T07:00:29.563935+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:58.259258+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T07:01:58.259258+0000","last_peered":"2024-03-04T07:01:58.259258+0000","last_clean":"2024-03-04T07:01:58.259258+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T07:01:58.259258+0000","last_undegraded":"2024-03-04T07:01:58.259258+0000","last_fullsized":"2024-03-04T07:01:58.259258+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:20.030063+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T07:02:20.030063+0000","last_peered":"2024-03-04T07:02:20.030063+0000","last_clean":"2024-03-04T07:02:20.030063+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T07:02:20.030063+0000","last_undegraded":"2024-03-04T07:02:20.030063+0000","last_fullsized":"2024-03-04T07:02:20.030063+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1150,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976219+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T07:01:22.976219+0000","last_peered":"2024-03-04T07:01:22.976219+0000","last_clean":"2024-03-04T07:01:22.976219+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T07:01:22.976219+0000","last_undegraded":"2024-03-04T07:01:22.976219+0000","last_fullsized":"2024-03-04T07:01:22.976219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1553,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:04.574969+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:02:04.574969+0000","last_peered":"2024-03-04T07:02:04.574969+0000","last_clean":"2024-03-04T07:02:04.574969+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:02:04.574969+0000","last_undegraded":"2024-03-04T07:02:04.574969+0000","last_fullsized":"2024-03-04T07:02:04.574969+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3953,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:52.979497+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T07:01:52.979497+0000","last_peered":"2024-03-04T07:01:52.979497+0000","last_clean":"2024-03-04T07:01:52.979497+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T07:01:52.979497+0000","last_undegraded":"2024-03-04T07:01:52.979497+0000","last_fullsized":"2024-03-04T07:01:52.979497+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023391+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T07:01:08.023391+0000","last_peered":"2024-03-04T07:01:08.023391+0000","last_clean":"2024-03-04T07:01:08.023391+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T07:01:08.023391+0000","last_undegraded":"2024-03-04T07:01:08.023391+0000","last_fullsized":"2024-03-04T07:01:08.023391+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416752+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T07:01:43.416752+0000","last_peered":"2024-03-04T07:01:43.416752+0000","last_clean":"2024-03-04T07:01:43.416752+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T07:01:43.416752+0000","last_undegraded":"2024-03-04T07:01:43.416752+0000","last_fullsized":"2024-03-04T07:01:43.416752+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:04.574922+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:02:04.574922+0000","last_peered":"2024-03-04T07:02:04.574922+0000","last_clean":"2024-03-04T07:02:04.574922+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:02:04.574922+0000","last_undegraded":"2024-03-04T07:02:04.574922+0000","last_fullsized":"2024-03-04T07:02:04.574922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15294,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:58.259228+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T07:01:58.259228+0000","last_peered":"2024-03-04T07:01:58.259228+0000","last_clean":"2024-03-04T07:01:58.259228+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T07:01:58.259228+0000","last_undegraded":"2024-03-04T07:01:58.259228+0000","last_fullsized":"2024-03-04T07:01:58.259228+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019541+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T07:00:33.019541+0000","last_peered":"2024-03-04T07:00:33.019541+0000","last_clean":"2024-03-04T07:00:33.019541+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T07:00:33.019541+0000","last_undegraded":"2024-03-04T07:00:33.019541+0000","last_fullsized":"2024-03-04T07:00:33.019541+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1075,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:29.563983+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T07:00:29.563983+0000","last_peered":"2024-03-04T07:00:29.563983+0000","last_clean":"2024-03-04T07:00:29.563983+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T07:00:29.563983+0000","last_undegraded":"2024-03-04T07:00:29.563983+0000","last_fullsized":"2024-03-04T07:00:29.563983+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178580+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T07:01:08.178580+0000","last_peered":"2024-03-04T07:01:08.178580+0000","last_clean":"2024-03-04T07:01:08.178580+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T07:01:08.178580+0000","last_undegraded":"2024-03-04T07:01:08.178580+0000","last_fullsized":"2024-03-04T07:01:08.178580+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4381,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:47.639101+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T07:00:47.639101+0000","last_peered":"2024-03-04T07:00:47.639101+0000","last_clean":"2024-03-04T07:00:47.639101+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T07:00:47.639101+0000","last_undegraded":"2024-03-04T07:00:47.639101+0000","last_fullsized":"2024-03-04T07:00:47.639101+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026676+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T07:01:45.026676+0000","last_peered":"2024-03-04T07:01:45.026676+0000","last_clean":"2024-03-04T07:01:45.026676+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T07:01:45.026676+0000","last_undegraded":"2024-03-04T07:01:45.026676+0000","last_fullsized":"2024-03-04T07:01:45.026676+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1271,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182470+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T07:01:43.182470+0000","last_peered":"2024-03-04T07:01:43.182470+0000","last_clean":"2024-03-04T07:01:43.182470+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T07:01:43.182470+0000","last_undegraded":"2024-03-04T07:01:43.182470+0000","last_fullsized":"2024-03-04T07:01:43.182470+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020800+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T07:00:45.020800+0000","last_peered":"2024-03-04T07:00:45.020800+0000","last_clean":"2024-03-04T07:00:45.020800+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T07:00:45.020800+0000","last_undegraded":"2024-03-04T07:00:45.020800+0000","last_fullsized":"2024-03-04T07:00:45.020800+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4612,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:45.026591+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T07:01:45.026591+0000","last_peered":"2024-03-04T07:01:45.026591+0000","last_clean":"2024-03-04T07:01:45.026591+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T07:01:45.026591+0000","last_undegraded":"2024-03-04T07:01:45.026591+0000","last_fullsized":"2024-03-04T07:01:45.026591+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639077+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T07:00:47.639077+0000","last_peered":"2024-03-04T07:00:47.639077+0000","last_clean":"2024-03-04T07:00:47.639077+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T07:00:47.639077+0000","last_undegraded":"2024-03-04T07:00:47.639077+0000","last_fullsized":"2024-03-04T07:00:47.639077+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1081,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:28.263279+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T07:02:28.263279+0000","last_peered":"2024-03-04T07:02:28.263279+0000","last_clean":"2024-03-04T07:02:28.263279+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T07:02:28.263279+0000","last_undegraded":"2024-03-04T07:02:28.263279+0000","last_fullsized":"2024-03-04T07:02:28.263279+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023341+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T07:01:08.023341+0000","last_peered":"2024-03-04T07:01:08.023341+0000","last_clean":"2024-03-04T07:01:08.023341+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T07:01:08.023341+0000","last_undegraded":"2024-03-04T07:01:08.023341+0000","last_fullsized":"2024-03-04T07:01:08.023341+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4637,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:02:22.983330+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T07:02:22.983330+0000","last_peered":"2024-03-04T07:02:22.983330+0000","last_clean":"2024-03-04T07:02:22.983330+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T07:02:22.983330+0000","last_undegraded":"2024-03-04T07:02:22.983330+0000","last_fullsized":"2024-03-04T07:02:22.983330+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:54.566566+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T07:00:54.566566+0000","last_peered":"2024-03-04T07:00:54.566566+0000","last_clean":"2024-03-04T07:00:54.566566+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T07:00:54.566566+0000","last_undegraded":"2024-03-04T07:00:54.566566+0000","last_fullsized":"2024-03-04T07:00:54.566566+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1187,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:17.642331+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T07:01:17.642331+0000","last_peered":"2024-03-04T07:01:17.642331+0000","last_clean":"2024-03-04T07:01:17.642331+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T07:01:17.642331+0000","last_undegraded":"2024-03-04T07:01:17.642331+0000","last_fullsized":"2024-03-04T07:01:17.642331+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5160,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:47.645896+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T07:01:47.645896+0000","last_peered":"2024-03-04T07:01:47.645896+0000","last_clean":"2024-03-04T07:01:47.645896+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T07:01:47.645896+0000","last_undegraded":"2024-03-04T07:01:47.645896+0000","last_fullsized":"2024-03-04T07:01:47.645896+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182417+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T07:01:43.182417+0000","last_peered":"2024-03-04T07:01:43.182417+0000","last_clean":"2024-03-04T07:01:43.182417+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T07:01:43.182417+0000","last_undegraded":"2024-03-04T07:01:43.182417+0000","last_fullsized":"2024-03-04T07:01:43.182417+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020733+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T07:00:45.020733+0000","last_peered":"2024-03-04T07:00:45.020733+0000","last_clean":"2024-03-04T07:00:45.020733+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T07:00:45.020733+0000","last_undegraded":"2024-03-04T07:00:45.020733+0000","last_fullsized":"2024-03-04T07:00:45.020733+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4721,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409468+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T07:00:38.409468+0000","last_peered":"2024-03-04T07:00:38.409468+0000","last_clean":"2024-03-04T07:00:38.409468+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T07:00:38.409468+0000","last_undegraded":"2024-03-04T07:00:38.409468+0000","last_fullsized":"2024-03-04T07:00:38.409468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182435+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T07:01:43.182435+0000","last_peered":"2024-03-04T07:01:43.182435+0000","last_clean":"2024-03-04T07:01:43.182435+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T07:01:43.182435+0000","last_undegraded":"2024-03-04T07:01:43.182435+0000","last_fullsized":"2024-03-04T07:01:43.182435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023738+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T07:01:15.023738+0000","last_peered":"2024-03-04T07:01:15.023738+0000","last_clean":"2024-03-04T07:01:15.023738+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T07:01:15.023738+0000","last_undegraded":"2024-03-04T07:01:15.023738+0000","last_fullsized":"2024-03-04T07:01:15.023738+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5557,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:02:18.186024+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:02:18.186024+0000","last_peered":"2024-03-04T07:02:18.186024+0000","last_clean":"2024-03-04T07:02:18.186024+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:02:18.186024+0000","last_undegraded":"2024-03-04T07:02:18.186024+0000","last_fullsized":"2024-03-04T07:02:18.186024+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T07:01:19.569554+0000","last_peered":"2024-03-04T07:01:19.569554+0000","last_clean":"2024-03-04T07:01:19.569554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T07:01:19.569554+0000","last_undegraded":"2024-03-04T07:01:19.569554+0000","last_fullsized":"2024-03-04T07:01:19.569554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:28.263229+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T07:02:28.263229+0000","last_peered":"2024-03-04T07:02:28.263229+0000","last_clean":"2024-03-04T07:02:28.263229+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T07:02:28.263229+0000","last_undegraded":"2024-03-04T07:02:28.263229+0000","last_fullsized":"2024-03-04T07:02:28.263229+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409421+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T07:00:38.409421+0000","last_peered":"2024-03-04T07:00:38.409421+0000","last_clean":"2024-03-04T07:00:38.409421+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T07:00:38.409421+0000","last_undegraded":"2024-03-04T07:00:38.409421+0000","last_fullsized":"2024-03-04T07:00:38.409421+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409457+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T07:00:38.409457+0000","last_peered":"2024-03-04T07:00:38.409457+0000","last_clean":"2024-03-04T07:00:38.409457+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T07:00:38.409457+0000","last_undegraded":"2024-03-04T07:00:38.409457+0000","last_fullsized":"2024-03-04T07:00:38.409457+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T07:01:19.569599+0000","last_peered":"2024-03-04T07:01:19.569599+0000","last_clean":"2024-03-04T07:01:19.569599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T07:01:19.569599+0000","last_undegraded":"2024-03-04T07:01:19.569599+0000","last_fullsized":"2024-03-04T07:01:19.569599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4369,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.420296+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:02:18.420296+0000","last_peered":"2024-03-04T07:02:18.420296+0000","last_clean":"2024-03-04T07:02:18.420296+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:02:18.420296+0000","last_undegraded":"2024-03-04T07:02:18.420296+0000","last_fullsized":"2024-03-04T07:02:18.420296+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1269,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.186065+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:02:18.186065+0000","last_peered":"2024-03-04T07:02:18.186065+0000","last_clean":"2024-03-04T07:02:18.186065+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:02:18.186065+0000","last_undegraded":"2024-03-04T07:02:18.186065+0000","last_fullsized":"2024-03-04T07:02:18.186065+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:22.983289+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T07:02:22.983289+0000","last_peered":"2024-03-04T07:02:22.983289+0000","last_clean":"2024-03-04T07:02:22.983289+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T07:02:22.983289+0000","last_undegraded":"2024-03-04T07:02:22.983289+0000","last_fullsized":"2024-03-04T07:02:22.983289+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4602,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:54.566603+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T07:00:54.566603+0000","last_peered":"2024-03-04T07:00:54.566603+0000","last_clean":"2024-03-04T07:00:54.566603+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T07:00:54.566603+0000","last_undegraded":"2024-03-04T07:00:54.566603+0000","last_fullsized":"2024-03-04T07:00:54.566603+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1247,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409492+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T07:00:38.409492+0000","last_peered":"2024-03-04T07:00:38.409492+0000","last_clean":"2024-03-04T07:00:38.409492+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T07:00:38.409492+0000","last_undegraded":"2024-03-04T07:00:38.409492+0000","last_fullsized":"2024-03-04T07:00:38.409492+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569626+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T07:01:19.569626+0000","last_peered":"2024-03-04T07:01:19.569626+0000","last_clean":"2024-03-04T07:01:19.569626+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T07:01:19.569626+0000","last_undegraded":"2024-03-04T07:01:19.569626+0000","last_fullsized":"2024-03-04T07:01:19.569626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:58.259166+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T07:01:58.259166+0000","last_peered":"2024-03-04T07:01:58.259166+0000","last_clean":"2024-03-04T07:01:58.259166+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T07:01:58.259166+0000","last_undegraded":"2024-03-04T07:01:58.259166+0000","last_fullsized":"2024-03-04T07:01:58.259166+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416787+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T07:01:43.416787+0000","last_peered":"2024-03-04T07:01:43.416787+0000","last_clean":"2024-03-04T07:01:43.416787+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T07:01:43.416787+0000","last_undegraded":"2024-03-04T07:01:43.416787+0000","last_fullsized":"2024-03-04T07:01:43.416787+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976197+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T07:01:22.976197+0000","last_peered":"2024-03-04T07:01:22.976197+0000","last_clean":"2024-03-04T07:01:22.976197+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T07:01:22.976197+0000","last_undegraded":"2024-03-04T07:01:22.976197+0000","last_fullsized":"2024-03-04T07:01:22.976197+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.019487+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T07:00:33.019487+0000","last_peered":"2024-03-04T07:00:33.019487+0000","last_clean":"2024-03-04T07:00:33.019487+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T07:00:33.019487+0000","last_undegraded":"2024-03-04T07:00:33.019487+0000","last_fullsized":"2024-03-04T07:00:33.019487+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020779+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T07:00:45.020779+0000","last_peered":"2024-03-04T07:00:45.020779+0000","last_clean":"2024-03-04T07:00:45.020779+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T07:00:45.020779+0000","last_undegraded":"2024-03-04T07:00:45.020779+0000","last_fullsized":"2024-03-04T07:00:45.020779+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182456+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T07:01:43.182456+0000","last_peered":"2024-03-04T07:01:43.182456+0000","last_clean":"2024-03-04T07:01:43.182456+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T07:01:43.182456+0000","last_undegraded":"2024-03-04T07:01:43.182456+0000","last_fullsized":"2024-03-04T07:01:43.182456+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:28.263267+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T07:02:28.263267+0000","last_peered":"2024-03-04T07:02:28.263267+0000","last_clean":"2024-03-04T07:02:28.263267+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T07:02:28.263267+0000","last_undegraded":"2024-03-04T07:02:28.263267+0000","last_fullsized":"2024-03-04T07:02:28.263267+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020816+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T07:00:45.020816+0000","last_peered":"2024-03-04T07:00:45.020816+0000","last_clean":"2024-03-04T07:00:45.020816+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T07:00:45.020816+0000","last_undegraded":"2024-03-04T07:00:45.020816+0000","last_fullsized":"2024-03-04T07:00:45.020816+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:52.979394+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T07:01:52.979394+0000","last_peered":"2024-03-04T07:01:52.979394+0000","last_clean":"2024-03-04T07:01:52.979394+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T07:01:52.979394+0000","last_undegraded":"2024-03-04T07:01:52.979394+0000","last_fullsized":"2024-03-04T07:01:52.979394+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023709+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T07:01:15.023709+0000","last_peered":"2024-03-04T07:01:15.023709+0000","last_clean":"2024-03-04T07:01:15.023709+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T07:01:15.023709+0000","last_undegraded":"2024-03-04T07:01:15.023709+0000","last_fullsized":"2024-03-04T07:01:15.023709+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1123,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:22.983241+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T07:02:22.983241+0000","last_peered":"2024-03-04T07:02:22.983241+0000","last_clean":"2024-03-04T07:02:22.983241+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T07:02:22.983241+0000","last_undegraded":"2024-03-04T07:02:22.983241+0000","last_fullsized":"2024-03-04T07:02:22.983241+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.026774+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T07:01:43.026774+0000","last_peered":"2024-03-04T07:01:43.026774+0000","last_clean":"2024-03-04T07:01:43.026774+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T07:01:43.026774+0000","last_undegraded":"2024-03-04T07:01:43.026774+0000","last_fullsized":"2024-03-04T07:01:43.026774+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:43.250705+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T07:00:43.250705+0000","last_peered":"2024-03-04T07:00:43.250705+0000","last_clean":"2024-03-04T07:00:43.250705+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T07:00:43.250705+0000","last_undegraded":"2024-03-04T07:00:43.250705+0000","last_fullsized":"2024-03-04T07:00:43.250705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503535,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648183,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142490,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287137,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997843,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885899,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937477,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792830,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:04:41.290 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:41.290 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:41.290 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:41.290 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:41.290 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:41.290 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:41.290 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:41.290 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:41.291 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:41.291 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:41.291 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:04:42.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:42 smithi203 ceph-mon[85573]: from='client.34761 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:42.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:42 smithi203 ceph-mon[85573]: pgmap v1205: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:42.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:42 smithi137 ceph-mon[88869]: from='client.34761 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:42.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:42 smithi137 ceph-mon[88869]: pgmap v1205: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:42.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:42 smithi137 ceph-mon[91314]: from='client.34761 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:42.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:42 smithi137 ceph-mon[91314]: pgmap v1205: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:44.594 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:44 smithi137 ceph-mon[88869]: pgmap v1206: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:44.594 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:44 smithi137 ceph-mon[91314]: pgmap v1206: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:44.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:44 smithi203 ceph-mon[85573]: pgmap v1206: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:45.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:04:45 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:04:45] "GET /metrics HTTP/1.1" 200 36337 "" "Prometheus/2.43.0" 2024-03-04T07:04:46.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:46 smithi203 ceph-mon[85573]: pgmap v1207: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:46.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:46 smithi137 ceph-mon[88869]: pgmap v1207: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:46.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:46 smithi137 ceph-mon[91314]: pgmap v1207: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:48.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:48 smithi203 ceph-mon[85573]: pgmap v1208: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:48.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:48 smithi137 ceph-mon[88869]: pgmap v1208: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:48.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:48 smithi137 ceph-mon[91314]: pgmap v1208: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:50.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:50 smithi203 ceph-mon[85573]: pgmap v1209: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:50.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:50 smithi137 ceph-mon[91314]: pgmap v1209: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:50.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:50 smithi137 ceph-mon[88869]: pgmap v1209: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:51.292 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:04:51.514 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:04:52.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:52 smithi203 ceph-mon[85573]: pgmap v1210: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:52.617 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:52 smithi137 ceph-mon[88869]: pgmap v1210: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:52.617 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:52 smithi137 ceph-mon[91314]: pgmap v1210: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:04:53.386 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:04:54.040 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1211,"stamp":"2024-03-04T07:04:52.640686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004153"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1062,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:34.578977+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T07:02:34.578977+0000","last_peered":"2024-03-04T07:02:34.578977+0000","last_clean":"2024-03-04T07:02:34.578977+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T07:02:34.578977+0000","last_undegraded":"2024-03-04T07:02:34.578977+0000","last_fullsized":"2024-03-04T07:02:34.578977+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178667+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T07:01:08.178667+0000","last_peered":"2024-03-04T07:01:08.178667+0000","last_clean":"2024-03-04T07:01:08.178667+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T07:01:08.178667+0000","last_undegraded":"2024-03-04T07:01:08.178667+0000","last_fullsized":"2024-03-04T07:01:08.178667+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:38.032856+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T07:02:38.032856+0000","last_peered":"2024-03-04T07:02:38.032856+0000","last_clean":"2024-03-04T07:02:38.032856+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T07:02:38.032856+0000","last_undegraded":"2024-03-04T07:02:38.032856+0000","last_fullsized":"2024-03-04T07:02:38.032856+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1143,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:52.972434+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T07:00:52.972434+0000","last_peered":"2024-03-04T07:00:52.972434+0000","last_clean":"2024-03-04T07:00:52.972434+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T07:00:52.972434+0000","last_undegraded":"2024-03-04T07:00:52.972434+0000","last_fullsized":"2024-03-04T07:00:52.972434+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560949+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T07:00:04.560949+0000","last_peered":"2024-03-04T07:00:04.560949+0000","last_clean":"2024-03-04T07:00:04.560949+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T07:00:04.560949+0000","last_undegraded":"2024-03-04T07:00:04.560949+0000","last_fullsized":"2024-03-04T07:00:04.560949+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976210+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T07:01:22.976210+0000","last_peered":"2024-03-04T07:01:22.976210+0000","last_clean":"2024-03-04T07:01:22.976210+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T07:01:22.976210+0000","last_undegraded":"2024-03-04T07:01:22.976210+0000","last_fullsized":"2024-03-04T07:01:22.976210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560930+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T07:00:04.560930+0000","last_peered":"2024-03-04T07:00:04.560930+0000","last_clean":"2024-03-04T07:00:04.560930+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T07:00:04.560930+0000","last_undegraded":"2024-03-04T07:00:04.560930+0000","last_fullsized":"2024-03-04T07:00:04.560930+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017220+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T07:00:15.017220+0000","last_peered":"2024-03-04T07:00:15.017220+0000","last_clean":"2024-03-04T07:00:15.017220+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T07:00:15.017220+0000","last_undegraded":"2024-03-04T07:00:15.017220+0000","last_fullsized":"2024-03-04T07:00:15.017220+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1067,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:09.575780+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T07:02:09.575780+0000","last_peered":"2024-03-04T07:02:09.575780+0000","last_clean":"2024-03-04T07:02:09.575780+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T07:02:09.575780+0000","last_undegraded":"2024-03-04T07:02:09.575780+0000","last_fullsized":"2024-03-04T07:02:09.575780+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256498+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T07:01:33.256498+0000","last_peered":"2024-03-04T07:01:33.256498+0000","last_clean":"2024-03-04T07:01:33.256498+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T07:01:33.256498+0000","last_undegraded":"2024-03-04T07:01:33.256498+0000","last_fullsized":"2024-03-04T07:01:33.256498+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256456+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T07:01:33.256456+0000","last_peered":"2024-03-04T07:01:33.256456+0000","last_clean":"2024-03-04T07:01:33.256456+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T07:01:33.256456+0000","last_undegraded":"2024-03-04T07:01:33.256456+0000","last_fullsized":"2024-03-04T07:01:33.256456+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:22.636361+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T07:00:22.636361+0000","last_peered":"2024-03-04T07:00:22.636361+0000","last_clean":"2024-03-04T07:00:22.636361+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T07:00:22.636361+0000","last_undegraded":"2024-03-04T07:00:22.636361+0000","last_fullsized":"2024-03-04T07:00:22.636361+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:15.029668+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T07:02:15.029668+0000","last_peered":"2024-03-04T07:02:15.029668+0000","last_clean":"2024-03-04T07:02:15.029668+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T07:02:15.029668+0000","last_undegraded":"2024-03-04T07:02:15.029668+0000","last_fullsized":"2024-03-04T07:02:15.029668+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.030465+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T07:02:18.030465+0000","last_peered":"2024-03-04T07:02:18.030465+0000","last_clean":"2024-03-04T07:02:18.030465+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T07:02:18.030465+0000","last_undegraded":"2024-03-04T07:02:18.030465+0000","last_fullsized":"2024-03-04T07:02:18.030465+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174897+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T07:00:33.174897+0000","last_peered":"2024-03-04T07:00:33.174897+0000","last_clean":"2024-03-04T07:00:33.174897+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T07:00:33.174897+0000","last_undegraded":"2024-03-04T07:00:33.174897+0000","last_fullsized":"2024-03-04T07:00:33.174897+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970309+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T07:00:32.970309+0000","last_peered":"2024-03-04T07:00:32.970309+0000","last_clean":"2024-03-04T07:00:32.970309+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T07:00:32.970309+0000","last_undegraded":"2024-03-04T07:00:32.970309+0000","last_fullsized":"2024-03-04T07:00:32.970309+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970400+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T07:00:32.970400+0000","last_peered":"2024-03-04T07:00:32.970400+0000","last_clean":"2024-03-04T07:00:32.970400+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T07:00:32.970400+0000","last_undegraded":"2024-03-04T07:00:32.970400+0000","last_fullsized":"2024-03-04T07:00:32.970400+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412366+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T07:01:08.412366+0000","last_peered":"2024-03-04T07:01:08.412366+0000","last_clean":"2024-03-04T07:01:08.412366+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T07:01:08.412366+0000","last_undegraded":"2024-03-04T07:01:08.412366+0000","last_fullsized":"2024-03-04T07:01:08.412366+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T07:01:19.569588+0000","last_peered":"2024-03-04T07:01:19.569588+0000","last_clean":"2024-03-04T07:01:19.569588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T07:01:19.569588+0000","last_undegraded":"2024-03-04T07:01:19.569588+0000","last_fullsized":"2024-03-04T07:01:19.569588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1308,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:38.032906+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T07:02:38.032906+0000","last_peered":"2024-03-04T07:02:38.032906+0000","last_clean":"2024-03-04T07:02:38.032906+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T07:02:38.032906+0000","last_undegraded":"2024-03-04T07:02:38.032906+0000","last_fullsized":"2024-03-04T07:02:38.032906+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1197,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026705+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T07:01:45.026705+0000","last_peered":"2024-03-04T07:01:45.026705+0000","last_clean":"2024-03-04T07:01:45.026705+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T07:01:45.026705+0000","last_undegraded":"2024-03-04T07:01:45.026705+0000","last_fullsized":"2024-03-04T07:01:45.026705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026715+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T07:01:45.026715+0000","last_peered":"2024-03-04T07:01:45.026715+0000","last_clean":"2024-03-04T07:01:45.026715+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T07:01:45.026715+0000","last_undegraded":"2024-03-04T07:01:45.026715+0000","last_fullsized":"2024-03-04T07:01:45.026715+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:38.032889+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T07:02:38.032889+0000","last_peered":"2024-03-04T07:02:38.032889+0000","last_clean":"2024-03-04T07:02:38.032889+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T07:02:38.032889+0000","last_undegraded":"2024-03-04T07:02:38.032889+0000","last_fullsized":"2024-03-04T07:02:38.032889+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:08.419543+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T07:02:08.419543+0000","last_peered":"2024-03-04T07:02:08.419543+0000","last_clean":"2024-03-04T07:02:08.419543+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T07:02:08.419543+0000","last_undegraded":"2024-03-04T07:02:08.419543+0000","last_fullsized":"2024-03-04T07:02:08.419543+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1224,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:08.419489+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T07:02:08.419489+0000","last_peered":"2024-03-04T07:02:08.419489+0000","last_clean":"2024-03-04T07:02:08.419489+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T07:02:08.419489+0000","last_undegraded":"2024-03-04T07:02:08.419489+0000","last_fullsized":"2024-03-04T07:02:08.419489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1071,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:04.560965+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T07:00:04.560965+0000","last_peered":"2024-03-04T07:00:04.560965+0000","last_clean":"2024-03-04T07:00:04.560965+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T07:00:04.560965+0000","last_undegraded":"2024-03-04T07:00:04.560965+0000","last_fullsized":"2024-03-04T07:00:04.560965+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976241+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T07:01:22.976241+0000","last_peered":"2024-03-04T07:01:22.976241+0000","last_clean":"2024-03-04T07:01:22.976241+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T07:01:22.976241+0000","last_undegraded":"2024-03-04T07:01:22.976241+0000","last_fullsized":"2024-03-04T07:01:22.976241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017274+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T07:00:15.017274+0000","last_peered":"2024-03-04T07:00:15.017274+0000","last_clean":"2024-03-04T07:00:15.017274+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T07:00:15.017274+0000","last_undegraded":"2024-03-04T07:00:15.017274+0000","last_fullsized":"2024-03-04T07:00:15.017274+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1191,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639127+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T07:00:47.639127+0000","last_peered":"2024-03-04T07:00:47.639127+0000","last_clean":"2024-03-04T07:00:47.639127+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T07:00:47.639127+0000","last_undegraded":"2024-03-04T07:00:47.639127+0000","last_fullsized":"2024-03-04T07:00:47.639127+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:58.259212+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T07:01:58.259212+0000","last_peered":"2024-03-04T07:01:58.259212+0000","last_clean":"2024-03-04T07:01:58.259212+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T07:01:58.259212+0000","last_undegraded":"2024-03-04T07:01:58.259212+0000","last_fullsized":"2024-03-04T07:01:58.259212+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:58.022394+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T07:00:58.022394+0000","last_peered":"2024-03-04T07:00:58.022394+0000","last_clean":"2024-03-04T07:00:58.022394+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T07:00:58.022394+0000","last_undegraded":"2024-03-04T07:00:58.022394+0000","last_fullsized":"2024-03-04T07:00:58.022394+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:15.029652+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T07:02:15.029652+0000","last_peered":"2024-03-04T07:02:15.029652+0000","last_clean":"2024-03-04T07:02:15.029652+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T07:02:15.029652+0000","last_undegraded":"2024-03-04T07:02:15.029652+0000","last_fullsized":"2024-03-04T07:02:15.029652+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:15.029615+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T07:02:15.029615+0000","last_peered":"2024-03-04T07:02:15.029615+0000","last_clean":"2024-03-04T07:02:15.029615+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T07:02:15.029615+0000","last_undegraded":"2024-03-04T07:02:15.029615+0000","last_fullsized":"2024-03-04T07:02:15.029615+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973153+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T07:00:57.973153+0000","last_peered":"2024-03-04T07:00:57.973153+0000","last_clean":"2024-03-04T07:00:57.973153+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T07:00:57.973153+0000","last_undegraded":"2024-03-04T07:00:57.973153+0000","last_fullsized":"2024-03-04T07:00:57.973153+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178000+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T07:01:03.178000+0000","last_peered":"2024-03-04T07:01:03.178000+0000","last_clean":"2024-03-04T07:01:03.178000+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T07:01:03.178000+0000","last_undegraded":"2024-03-04T07:01:03.178000+0000","last_fullsized":"2024-03-04T07:01:03.178000+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256513+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T07:01:33.256513+0000","last_peered":"2024-03-04T07:01:33.256513+0000","last_clean":"2024-03-04T07:01:33.256513+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T07:01:33.256513+0000","last_undegraded":"2024-03-04T07:01:33.256513+0000","last_fullsized":"2024-03-04T07:01:33.256513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973230+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T07:00:57.973230+0000","last_peered":"2024-03-04T07:00:57.973230+0000","last_clean":"2024-03-04T07:00:57.973230+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T07:00:57.973230+0000","last_undegraded":"2024-03-04T07:00:57.973230+0000","last_fullsized":"2024-03-04T07:00:57.973230+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973215+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T07:00:57.973215+0000","last_peered":"2024-03-04T07:00:57.973215+0000","last_clean":"2024-03-04T07:00:57.973215+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T07:00:57.973215+0000","last_undegraded":"2024-03-04T07:00:57.973215+0000","last_fullsized":"2024-03-04T07:00:57.973215+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:28.018729+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T07:00:28.018729+0000","last_peered":"2024-03-04T07:00:28.018729+0000","last_clean":"2024-03-04T07:00:28.018729+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T07:00:28.018729+0000","last_undegraded":"2024-03-04T07:00:28.018729+0000","last_fullsized":"2024-03-04T07:00:28.018729+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178037+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T07:01:03.178037+0000","last_peered":"2024-03-04T07:01:03.178037+0000","last_clean":"2024-03-04T07:01:03.178037+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T07:01:03.178037+0000","last_undegraded":"2024-03-04T07:01:03.178037+0000","last_fullsized":"2024-03-04T07:01:03.178037+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:17.648952+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T07:02:17.648952+0000","last_peered":"2024-03-04T07:02:17.648952+0000","last_clean":"2024-03-04T07:02:17.648952+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T07:02:17.648952+0000","last_undegraded":"2024-03-04T07:02:17.648952+0000","last_fullsized":"2024-03-04T07:02:17.648952+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1132,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253574+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T07:01:08.253574+0000","last_peered":"2024-03-04T07:01:08.253574+0000","last_clean":"2024-03-04T07:01:08.253574+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T07:01:08.253574+0000","last_undegraded":"2024-03-04T07:01:08.253574+0000","last_fullsized":"2024-03-04T07:01:08.253574+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1053,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:09.575752+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T07:02:09.575752+0000","last_peered":"2024-03-04T07:02:09.575752+0000","last_clean":"2024-03-04T07:02:09.575752+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T07:02:09.575752+0000","last_undegraded":"2024-03-04T07:02:09.575752+0000","last_fullsized":"2024-03-04T07:02:09.575752+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1305,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.030497+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T07:02:18.030497+0000","last_peered":"2024-03-04T07:02:18.030497+0000","last_clean":"2024-03-04T07:02:18.030497+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T07:02:18.030497+0000","last_undegraded":"2024-03-04T07:02:18.030497+0000","last_fullsized":"2024-03-04T07:02:18.030497+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412330+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T07:01:08.412330+0000","last_peered":"2024-03-04T07:01:08.412330+0000","last_clean":"2024-03-04T07:01:08.412330+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T07:01:08.412330+0000","last_undegraded":"2024-03-04T07:01:08.412330+0000","last_fullsized":"2024-03-04T07:01:08.412330+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970340+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T07:00:32.970340+0000","last_peered":"2024-03-04T07:00:32.970340+0000","last_clean":"2024-03-04T07:00:32.970340+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T07:00:32.970340+0000","last_undegraded":"2024-03-04T07:00:32.970340+0000","last_fullsized":"2024-03-04T07:00:32.970340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1053,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:44.572629+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T07:01:44.572629+0000","last_peered":"2024-03-04T07:01:44.572629+0000","last_clean":"2024-03-04T07:01:44.572629+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T07:01:44.572629+0000","last_undegraded":"2024-03-04T07:01:44.572629+0000","last_fullsized":"2024-03-04T07:01:44.572629+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1104,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253553+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T07:01:08.253553+0000","last_peered":"2024-03-04T07:01:08.253553+0000","last_clean":"2024-03-04T07:01:08.253553+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T07:01:08.253553+0000","last_undegraded":"2024-03-04T07:01:08.253553+0000","last_fullsized":"2024-03-04T07:01:08.253553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253528+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T07:01:08.253528+0000","last_peered":"2024-03-04T07:01:08.253528+0000","last_clean":"2024-03-04T07:01:08.253528+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T07:01:08.253528+0000","last_undegraded":"2024-03-04T07:01:08.253528+0000","last_fullsized":"2024-03-04T07:01:08.253528+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412282+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T07:01:08.412282+0000","last_peered":"2024-03-04T07:01:08.412282+0000","last_clean":"2024-03-04T07:01:08.412282+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T07:01:08.412282+0000","last_undegraded":"2024-03-04T07:01:08.412282+0000","last_fullsized":"2024-03-04T07:01:08.412282+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:44.572593+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T07:01:44.572593+0000","last_peered":"2024-03-04T07:01:44.572593+0000","last_clean":"2024-03-04T07:01:44.572593+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T07:01:44.572593+0000","last_undegraded":"2024-03-04T07:01:44.572593+0000","last_fullsized":"2024-03-04T07:01:44.572593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3580,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.420253+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:02:18.420253+0000","last_peered":"2024-03-04T07:02:18.420253+0000","last_clean":"2024-03-04T07:02:18.420253+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:02:18.420253+0000","last_undegraded":"2024-03-04T07:02:18.420253+0000","last_fullsized":"2024-03-04T07:02:18.420253+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1162,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:47.645939+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T07:01:47.645939+0000","last_peered":"2024-03-04T07:01:47.645939+0000","last_clean":"2024-03-04T07:01:47.645939+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T07:01:47.645939+0000","last_undegraded":"2024-03-04T07:01:47.645939+0000","last_fullsized":"2024-03-04T07:01:47.645939+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T07:01:19.569613+0000","last_peered":"2024-03-04T07:01:19.569613+0000","last_clean":"2024-03-04T07:01:19.569613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T07:01:19.569613+0000","last_undegraded":"2024-03-04T07:01:19.569613+0000","last_fullsized":"2024-03-04T07:01:19.569613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17119,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:02:38.032816+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T07:02:38.032816+0000","last_peered":"2024-03-04T07:02:38.032816+0000","last_clean":"2024-03-04T07:02:38.032816+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T07:02:38.032816+0000","last_undegraded":"2024-03-04T07:02:38.032816+0000","last_fullsized":"2024-03-04T07:02:38.032816+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178538+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T07:01:08.178538+0000","last_peered":"2024-03-04T07:01:08.178538+0000","last_clean":"2024-03-04T07:01:08.178538+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T07:01:08.178538+0000","last_undegraded":"2024-03-04T07:01:08.178538+0000","last_fullsized":"2024-03-04T07:01:08.178538+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178614+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T07:01:08.178614+0000","last_peered":"2024-03-04T07:01:08.178614+0000","last_clean":"2024-03-04T07:01:08.178614+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T07:01:08.178614+0000","last_undegraded":"2024-03-04T07:01:08.178614+0000","last_fullsized":"2024-03-04T07:01:08.178614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976230+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T07:01:22.976230+0000","last_peered":"2024-03-04T07:01:22.976230+0000","last_clean":"2024-03-04T07:01:22.976230+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T07:01:22.976230+0000","last_undegraded":"2024-03-04T07:01:22.976230+0000","last_fullsized":"2024-03-04T07:01:22.976230+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4389,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:02:38.032866+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T07:02:38.032866+0000","last_peered":"2024-03-04T07:02:38.032866+0000","last_clean":"2024-03-04T07:02:38.032866+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T07:02:38.032866+0000","last_undegraded":"2024-03-04T07:02:38.032866+0000","last_fullsized":"2024-03-04T07:02:38.032866+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178564+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T07:01:08.178564+0000","last_peered":"2024-03-04T07:01:08.178564+0000","last_clean":"2024-03-04T07:01:08.178564+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T07:01:08.178564+0000","last_undegraded":"2024-03-04T07:01:08.178564+0000","last_fullsized":"2024-03-04T07:01:08.178564+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976151+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T07:01:22.976151+0000","last_peered":"2024-03-04T07:01:22.976151+0000","last_clean":"2024-03-04T07:01:22.976151+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T07:01:22.976151+0000","last_undegraded":"2024-03-04T07:01:22.976151+0000","last_fullsized":"2024-03-04T07:01:22.976151+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1159,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639139+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T07:00:47.639139+0000","last_peered":"2024-03-04T07:00:47.639139+0000","last_clean":"2024-03-04T07:00:47.639139+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T07:00:47.639139+0000","last_undegraded":"2024-03-04T07:00:47.639139+0000","last_fullsized":"2024-03-04T07:00:47.639139+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5642,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.420330+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:02:18.420330+0000","last_peered":"2024-03-04T07:02:18.420330+0000","last_clean":"2024-03-04T07:02:18.420330+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:02:18.420330+0000","last_undegraded":"2024-03-04T07:02:18.420330+0000","last_fullsized":"2024-03-04T07:02:18.420330+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182480+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T07:01:43.182480+0000","last_peered":"2024-03-04T07:01:43.182480+0000","last_clean":"2024-03-04T07:01:43.182480+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T07:01:43.182480+0000","last_undegraded":"2024-03-04T07:01:43.182480+0000","last_fullsized":"2024-03-04T07:01:43.182480+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:33.187586+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T07:02:33.187586+0000","last_peered":"2024-03-04T07:02:33.187586+0000","last_clean":"2024-03-04T07:02:33.187586+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T07:02:33.187586+0000","last_undegraded":"2024-03-04T07:02:33.187586+0000","last_fullsized":"2024-03-04T07:02:33.187586+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416777+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T07:01:43.416777+0000","last_peered":"2024-03-04T07:01:43.416777+0000","last_clean":"2024-03-04T07:01:43.416777+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T07:01:43.416777+0000","last_undegraded":"2024-03-04T07:01:43.416777+0000","last_fullsized":"2024-03-04T07:01:43.416777+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4018,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:02:34.578912+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T07:02:34.578912+0000","last_peered":"2024-03-04T07:02:34.578912+0000","last_clean":"2024-03-04T07:02:34.578912+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T07:02:34.578912+0000","last_undegraded":"2024-03-04T07:02:34.578912+0000","last_fullsized":"2024-03-04T07:02:34.578912+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:58.259258+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T07:01:58.259258+0000","last_peered":"2024-03-04T07:01:58.259258+0000","last_clean":"2024-03-04T07:01:58.259258+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T07:01:58.259258+0000","last_undegraded":"2024-03-04T07:01:58.259258+0000","last_fullsized":"2024-03-04T07:01:58.259258+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:20.030063+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T07:02:20.030063+0000","last_peered":"2024-03-04T07:02:20.030063+0000","last_clean":"2024-03-04T07:02:20.030063+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T07:02:20.030063+0000","last_undegraded":"2024-03-04T07:02:20.030063+0000","last_fullsized":"2024-03-04T07:02:20.030063+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1150,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976219+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T07:01:22.976219+0000","last_peered":"2024-03-04T07:01:22.976219+0000","last_clean":"2024-03-04T07:01:22.976219+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T07:01:22.976219+0000","last_undegraded":"2024-03-04T07:01:22.976219+0000","last_fullsized":"2024-03-04T07:01:22.976219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1553,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:04.574969+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:02:04.574969+0000","last_peered":"2024-03-04T07:02:04.574969+0000","last_clean":"2024-03-04T07:02:04.574969+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:02:04.574969+0000","last_undegraded":"2024-03-04T07:02:04.574969+0000","last_fullsized":"2024-03-04T07:02:04.574969+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3953,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:52.979497+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T07:01:52.979497+0000","last_peered":"2024-03-04T07:01:52.979497+0000","last_clean":"2024-03-04T07:01:52.979497+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T07:01:52.979497+0000","last_undegraded":"2024-03-04T07:01:52.979497+0000","last_fullsized":"2024-03-04T07:01:52.979497+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023391+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T07:01:08.023391+0000","last_peered":"2024-03-04T07:01:08.023391+0000","last_clean":"2024-03-04T07:01:08.023391+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T07:01:08.023391+0000","last_undegraded":"2024-03-04T07:01:08.023391+0000","last_fullsized":"2024-03-04T07:01:08.023391+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416752+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T07:01:43.416752+0000","last_peered":"2024-03-04T07:01:43.416752+0000","last_clean":"2024-03-04T07:01:43.416752+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T07:01:43.416752+0000","last_undegraded":"2024-03-04T07:01:43.416752+0000","last_fullsized":"2024-03-04T07:01:43.416752+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:04.574922+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:02:04.574922+0000","last_peered":"2024-03-04T07:02:04.574922+0000","last_clean":"2024-03-04T07:02:04.574922+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:02:04.574922+0000","last_undegraded":"2024-03-04T07:02:04.574922+0000","last_fullsized":"2024-03-04T07:02:04.574922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15294,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:58.259228+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T07:01:58.259228+0000","last_peered":"2024-03-04T07:01:58.259228+0000","last_clean":"2024-03-04T07:01:58.259228+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T07:01:58.259228+0000","last_undegraded":"2024-03-04T07:01:58.259228+0000","last_fullsized":"2024-03-04T07:01:58.259228+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:38.032841+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T07:02:38.032841+0000","last_peered":"2024-03-04T07:02:38.032841+0000","last_clean":"2024-03-04T07:02:38.032841+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T07:02:38.032841+0000","last_undegraded":"2024-03-04T07:02:38.032841+0000","last_fullsized":"2024-03-04T07:02:38.032841+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1076,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:34.578954+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T07:02:34.578954+0000","last_peered":"2024-03-04T07:02:34.578954+0000","last_clean":"2024-03-04T07:02:34.578954+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T07:02:34.578954+0000","last_undegraded":"2024-03-04T07:02:34.578954+0000","last_fullsized":"2024-03-04T07:02:34.578954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178580+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T07:01:08.178580+0000","last_peered":"2024-03-04T07:01:08.178580+0000","last_clean":"2024-03-04T07:01:08.178580+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T07:01:08.178580+0000","last_undegraded":"2024-03-04T07:01:08.178580+0000","last_fullsized":"2024-03-04T07:01:08.178580+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4381,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:47.639101+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T07:00:47.639101+0000","last_peered":"2024-03-04T07:00:47.639101+0000","last_clean":"2024-03-04T07:00:47.639101+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T07:00:47.639101+0000","last_undegraded":"2024-03-04T07:00:47.639101+0000","last_fullsized":"2024-03-04T07:00:47.639101+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026676+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T07:01:45.026676+0000","last_peered":"2024-03-04T07:01:45.026676+0000","last_clean":"2024-03-04T07:01:45.026676+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T07:01:45.026676+0000","last_undegraded":"2024-03-04T07:01:45.026676+0000","last_fullsized":"2024-03-04T07:01:45.026676+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1271,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182470+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T07:01:43.182470+0000","last_peered":"2024-03-04T07:01:43.182470+0000","last_clean":"2024-03-04T07:01:43.182470+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T07:01:43.182470+0000","last_undegraded":"2024-03-04T07:01:43.182470+0000","last_fullsized":"2024-03-04T07:01:43.182470+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020800+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T07:00:45.020800+0000","last_peered":"2024-03-04T07:00:45.020800+0000","last_clean":"2024-03-04T07:00:45.020800+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T07:00:45.020800+0000","last_undegraded":"2024-03-04T07:00:45.020800+0000","last_fullsized":"2024-03-04T07:00:45.020800+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4612,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:45.026591+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T07:01:45.026591+0000","last_peered":"2024-03-04T07:01:45.026591+0000","last_clean":"2024-03-04T07:01:45.026591+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T07:01:45.026591+0000","last_undegraded":"2024-03-04T07:01:45.026591+0000","last_fullsized":"2024-03-04T07:01:45.026591+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1161,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639077+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T07:00:47.639077+0000","last_peered":"2024-03-04T07:00:47.639077+0000","last_clean":"2024-03-04T07:00:47.639077+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T07:00:47.639077+0000","last_undegraded":"2024-03-04T07:00:47.639077+0000","last_fullsized":"2024-03-04T07:00:47.639077+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1081,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:28.263279+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T07:02:28.263279+0000","last_peered":"2024-03-04T07:02:28.263279+0000","last_clean":"2024-03-04T07:02:28.263279+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T07:02:28.263279+0000","last_undegraded":"2024-03-04T07:02:28.263279+0000","last_fullsized":"2024-03-04T07:02:28.263279+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023341+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T07:01:08.023341+0000","last_peered":"2024-03-04T07:01:08.023341+0000","last_clean":"2024-03-04T07:01:08.023341+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T07:01:08.023341+0000","last_undegraded":"2024-03-04T07:01:08.023341+0000","last_fullsized":"2024-03-04T07:01:08.023341+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4637,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:02:22.983330+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T07:02:22.983330+0000","last_peered":"2024-03-04T07:02:22.983330+0000","last_clean":"2024-03-04T07:02:22.983330+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T07:02:22.983330+0000","last_undegraded":"2024-03-04T07:02:22.983330+0000","last_fullsized":"2024-03-04T07:02:22.983330+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:54.566566+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T07:00:54.566566+0000","last_peered":"2024-03-04T07:00:54.566566+0000","last_clean":"2024-03-04T07:00:54.566566+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T07:00:54.566566+0000","last_undegraded":"2024-03-04T07:00:54.566566+0000","last_fullsized":"2024-03-04T07:00:54.566566+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1187,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:17.642331+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T07:01:17.642331+0000","last_peered":"2024-03-04T07:01:17.642331+0000","last_clean":"2024-03-04T07:01:17.642331+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T07:01:17.642331+0000","last_undegraded":"2024-03-04T07:01:17.642331+0000","last_fullsized":"2024-03-04T07:01:17.642331+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5160,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:47.645896+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T07:01:47.645896+0000","last_peered":"2024-03-04T07:01:47.645896+0000","last_clean":"2024-03-04T07:01:47.645896+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T07:01:47.645896+0000","last_undegraded":"2024-03-04T07:01:47.645896+0000","last_fullsized":"2024-03-04T07:01:47.645896+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182417+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T07:01:43.182417+0000","last_peered":"2024-03-04T07:01:43.182417+0000","last_clean":"2024-03-04T07:01:43.182417+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T07:01:43.182417+0000","last_undegraded":"2024-03-04T07:01:43.182417+0000","last_fullsized":"2024-03-04T07:01:43.182417+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020733+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T07:00:45.020733+0000","last_peered":"2024-03-04T07:00:45.020733+0000","last_clean":"2024-03-04T07:00:45.020733+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T07:00:45.020733+0000","last_undegraded":"2024-03-04T07:00:45.020733+0000","last_fullsized":"2024-03-04T07:00:45.020733+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4721,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409468+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T07:00:38.409468+0000","last_peered":"2024-03-04T07:00:38.409468+0000","last_clean":"2024-03-04T07:00:38.409468+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T07:00:38.409468+0000","last_undegraded":"2024-03-04T07:00:38.409468+0000","last_fullsized":"2024-03-04T07:00:38.409468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182435+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T07:01:43.182435+0000","last_peered":"2024-03-04T07:01:43.182435+0000","last_clean":"2024-03-04T07:01:43.182435+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T07:01:43.182435+0000","last_undegraded":"2024-03-04T07:01:43.182435+0000","last_fullsized":"2024-03-04T07:01:43.182435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023738+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T07:01:15.023738+0000","last_peered":"2024-03-04T07:01:15.023738+0000","last_clean":"2024-03-04T07:01:15.023738+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T07:01:15.023738+0000","last_undegraded":"2024-03-04T07:01:15.023738+0000","last_fullsized":"2024-03-04T07:01:15.023738+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5557,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:02:18.186024+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:02:18.186024+0000","last_peered":"2024-03-04T07:02:18.186024+0000","last_clean":"2024-03-04T07:02:18.186024+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:02:18.186024+0000","last_undegraded":"2024-03-04T07:02:18.186024+0000","last_fullsized":"2024-03-04T07:02:18.186024+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T07:01:19.569554+0000","last_peered":"2024-03-04T07:01:19.569554+0000","last_clean":"2024-03-04T07:01:19.569554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T07:01:19.569554+0000","last_undegraded":"2024-03-04T07:01:19.569554+0000","last_fullsized":"2024-03-04T07:01:19.569554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:28.263229+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T07:02:28.263229+0000","last_peered":"2024-03-04T07:02:28.263229+0000","last_clean":"2024-03-04T07:02:28.263229+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T07:02:28.263229+0000","last_undegraded":"2024-03-04T07:02:28.263229+0000","last_fullsized":"2024-03-04T07:02:28.263229+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409421+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T07:00:38.409421+0000","last_peered":"2024-03-04T07:00:38.409421+0000","last_clean":"2024-03-04T07:00:38.409421+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T07:00:38.409421+0000","last_undegraded":"2024-03-04T07:00:38.409421+0000","last_fullsized":"2024-03-04T07:00:38.409421+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409457+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T07:00:38.409457+0000","last_peered":"2024-03-04T07:00:38.409457+0000","last_clean":"2024-03-04T07:00:38.409457+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T07:00:38.409457+0000","last_undegraded":"2024-03-04T07:00:38.409457+0000","last_fullsized":"2024-03-04T07:00:38.409457+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T07:01:19.569599+0000","last_peered":"2024-03-04T07:01:19.569599+0000","last_clean":"2024-03-04T07:01:19.569599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T07:01:19.569599+0000","last_undegraded":"2024-03-04T07:01:19.569599+0000","last_fullsized":"2024-03-04T07:01:19.569599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4369,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.420296+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:02:18.420296+0000","last_peered":"2024-03-04T07:02:18.420296+0000","last_clean":"2024-03-04T07:02:18.420296+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:02:18.420296+0000","last_undegraded":"2024-03-04T07:02:18.420296+0000","last_fullsized":"2024-03-04T07:02:18.420296+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1269,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.186065+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:02:18.186065+0000","last_peered":"2024-03-04T07:02:18.186065+0000","last_clean":"2024-03-04T07:02:18.186065+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:02:18.186065+0000","last_undegraded":"2024-03-04T07:02:18.186065+0000","last_fullsized":"2024-03-04T07:02:18.186065+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:22.983289+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T07:02:22.983289+0000","last_peered":"2024-03-04T07:02:22.983289+0000","last_clean":"2024-03-04T07:02:22.983289+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T07:02:22.983289+0000","last_undegraded":"2024-03-04T07:02:22.983289+0000","last_fullsized":"2024-03-04T07:02:22.983289+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4602,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:54.566603+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T07:00:54.566603+0000","last_peered":"2024-03-04T07:00:54.566603+0000","last_clean":"2024-03-04T07:00:54.566603+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T07:00:54.566603+0000","last_undegraded":"2024-03-04T07:00:54.566603+0000","last_fullsized":"2024-03-04T07:00:54.566603+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1247,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409492+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T07:00:38.409492+0000","last_peered":"2024-03-04T07:00:38.409492+0000","last_clean":"2024-03-04T07:00:38.409492+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T07:00:38.409492+0000","last_undegraded":"2024-03-04T07:00:38.409492+0000","last_fullsized":"2024-03-04T07:00:38.409492+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569626+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T07:01:19.569626+0000","last_peered":"2024-03-04T07:01:19.569626+0000","last_clean":"2024-03-04T07:01:19.569626+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T07:01:19.569626+0000","last_undegraded":"2024-03-04T07:01:19.569626+0000","last_fullsized":"2024-03-04T07:01:19.569626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:58.259166+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T07:01:58.259166+0000","last_peered":"2024-03-04T07:01:58.259166+0000","last_clean":"2024-03-04T07:01:58.259166+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T07:01:58.259166+0000","last_undegraded":"2024-03-04T07:01:58.259166+0000","last_fullsized":"2024-03-04T07:01:58.259166+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416787+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T07:01:43.416787+0000","last_peered":"2024-03-04T07:01:43.416787+0000","last_clean":"2024-03-04T07:01:43.416787+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T07:01:43.416787+0000","last_undegraded":"2024-03-04T07:01:43.416787+0000","last_fullsized":"2024-03-04T07:01:43.416787+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976197+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T07:01:22.976197+0000","last_peered":"2024-03-04T07:01:22.976197+0000","last_clean":"2024-03-04T07:01:22.976197+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T07:01:22.976197+0000","last_undegraded":"2024-03-04T07:01:22.976197+0000","last_fullsized":"2024-03-04T07:01:22.976197+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:38.032758+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T07:02:38.032758+0000","last_peered":"2024-03-04T07:02:38.032758+0000","last_clean":"2024-03-04T07:02:38.032758+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T07:02:38.032758+0000","last_undegraded":"2024-03-04T07:02:38.032758+0000","last_fullsized":"2024-03-04T07:02:38.032758+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020779+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T07:00:45.020779+0000","last_peered":"2024-03-04T07:00:45.020779+0000","last_clean":"2024-03-04T07:00:45.020779+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T07:00:45.020779+0000","last_undegraded":"2024-03-04T07:00:45.020779+0000","last_fullsized":"2024-03-04T07:00:45.020779+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182456+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T07:01:43.182456+0000","last_peered":"2024-03-04T07:01:43.182456+0000","last_clean":"2024-03-04T07:01:43.182456+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T07:01:43.182456+0000","last_undegraded":"2024-03-04T07:01:43.182456+0000","last_fullsized":"2024-03-04T07:01:43.182456+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:28.263267+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T07:02:28.263267+0000","last_peered":"2024-03-04T07:02:28.263267+0000","last_clean":"2024-03-04T07:02:28.263267+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T07:02:28.263267+0000","last_undegraded":"2024-03-04T07:02:28.263267+0000","last_fullsized":"2024-03-04T07:02:28.263267+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020816+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T07:00:45.020816+0000","last_peered":"2024-03-04T07:00:45.020816+0000","last_clean":"2024-03-04T07:00:45.020816+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T07:00:45.020816+0000","last_undegraded":"2024-03-04T07:00:45.020816+0000","last_fullsized":"2024-03-04T07:00:45.020816+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:52.979394+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T07:01:52.979394+0000","last_peered":"2024-03-04T07:01:52.979394+0000","last_clean":"2024-03-04T07:01:52.979394+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T07:01:52.979394+0000","last_undegraded":"2024-03-04T07:01:52.979394+0000","last_fullsized":"2024-03-04T07:01:52.979394+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023709+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T07:01:15.023709+0000","last_peered":"2024-03-04T07:01:15.023709+0000","last_clean":"2024-03-04T07:01:15.023709+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T07:01:15.023709+0000","last_undegraded":"2024-03-04T07:01:15.023709+0000","last_fullsized":"2024-03-04T07:01:15.023709+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1123,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:22.983241+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T07:02:22.983241+0000","last_peered":"2024-03-04T07:02:22.983241+0000","last_clean":"2024-03-04T07:02:22.983241+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T07:02:22.983241+0000","last_undegraded":"2024-03-04T07:02:22.983241+0000","last_fullsized":"2024-03-04T07:02:22.983241+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.026774+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T07:01:43.026774+0000","last_peered":"2024-03-04T07:01:43.026774+0000","last_clean":"2024-03-04T07:01:43.026774+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T07:01:43.026774+0000","last_undegraded":"2024-03-04T07:01:43.026774+0000","last_fullsized":"2024-03-04T07:01:43.026774+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:43.250705+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T07:00:43.250705+0000","last_peered":"2024-03-04T07:00:43.250705+0000","last_clean":"2024-03-04T07:00:43.250705+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T07:00:43.250705+0000","last_undegraded":"2024-03-04T07:00:43.250705+0000","last_fullsized":"2024-03-04T07:00:43.250705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503538,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648185,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142492,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287139,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997845,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885902,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937480,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792832,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:04:54.045 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:54.045 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:54.045 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:54.045 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:54.045 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:54.045 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:54.045 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:54.045 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:54.045 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:54.045 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:04:54.046 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:04:54.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:54 smithi203 ceph-mon[85573]: pgmap v1211: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:54.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:54 smithi203 ceph-mon[85573]: from='client.44708 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:54.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:54 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:04:54.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:54 smithi137 ceph-mon[88869]: pgmap v1211: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:54.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:54 smithi137 ceph-mon[88869]: from='client.44708 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:54.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:54 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:04:54.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:54 smithi137 ceph-mon[91314]: pgmap v1211: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:54.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:54 smithi137 ceph-mon[91314]: from='client.44708 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:04:54.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:54 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:04:55.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:04:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:04:55] "GET /metrics HTTP/1.1" 200 36336 "" "Prometheus/2.43.0" 2024-03-04T07:04:56.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:56 smithi203 ceph-mon[85573]: pgmap v1212: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:56.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:56 smithi137 ceph-mon[88869]: pgmap v1212: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:56.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:56 smithi137 ceph-mon[91314]: pgmap v1212: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:58.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:04:58 smithi203 ceph-mon[85573]: pgmap v1213: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:58.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:04:58 smithi137 ceph-mon[88869]: pgmap v1213: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:04:58.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:04:58 smithi137 ceph-mon[91314]: pgmap v1213: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:00.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:00 smithi203 ceph-mon[85573]: pgmap v1214: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:00.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:00 smithi137 ceph-mon[88869]: pgmap v1214: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:00.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:00 smithi137 ceph-mon[91314]: pgmap v1214: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:02.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:02 smithi203 ceph-mon[85573]: pgmap v1215: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:02.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:02 smithi137 ceph-mon[88869]: pgmap v1215: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:02.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:02 smithi137 ceph-mon[91314]: pgmap v1215: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:04.047 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T07:05:04.266 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T07:05:04.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:04 smithi203 ceph-mon[85573]: pgmap v1216: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:04.677 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:04 smithi137 ceph-mon[88869]: pgmap v1216: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:04.678 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:04 smithi137 ceph-mon[91314]: pgmap v1216: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:05.590 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:05 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:05:05] "GET /metrics HTTP/1.1" 200 36336 "" "Prometheus/2.43.0" 2024-03-04T07:05:06.279 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:05:06.281 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-03-04T07:05:06.542 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:06 smithi137 ceph-mon[88869]: pgmap v1217: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:06.542 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:06 smithi137 ceph-mon[91314]: pgmap v1217: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:06.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:06 smithi203 ceph-mon[85573]: pgmap v1217: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:06.928 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":1217,"stamp":"2024-03-04T07:05:04.644768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1087749116,"num_objects":649,"num_object_clones":575,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":11,"num_read":4647,"num_read_kb":5621469,"num_write":9009,"num_write_kb":1928924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":439576160,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28481,"ondisk_log_size":28481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":6021716,"kb_used_data":1620896,"kb_used_omap":424,"kb_used_meta":4400279,"kb_avail":743939500,"statfs":{"total":767960285184,"available":761794048000,"internally_reserved":0,"allocated":1659797504,"data_stored":3707104758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434603,"internal_metadata":4505886293},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004082"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1062,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:34.578977+0000","last_change":"2024-03-04T06:50:06.495385+0000","last_active":"2024-03-04T07:02:34.578977+0000","last_peered":"2024-03-04T07:02:34.578977+0000","last_clean":"2024-03-04T07:02:34.578977+0000","last_became_active":"2024-03-04T06:50:06.493006+0000","last_became_peered":"2024-03-04T06:50:06.493006+0000","last_unstale":"2024-03-04T07:02:34.578977+0000","last_undegraded":"2024-03-04T07:02:34.578977+0000","last_fullsized":"2024-03-04T07:02:34.578977+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:55.751524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1262,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178667+0000","last_change":"2024-03-04T06:49:30.119521+0000","last_active":"2024-03-04T07:01:08.178667+0000","last_peered":"2024-03-04T07:01:08.178667+0000","last_clean":"2024-03-04T07:01:08.178667+0000","last_became_active":"2024-03-04T06:49:30.119146+0000","last_became_peered":"2024-03-04T06:49:30.119146+0000","last_unstale":"2024-03-04T07:01:08.178667+0000","last_undegraded":"2024-03-04T07:01:08.178667+0000","last_fullsized":"2024-03-04T07:01:08.178667+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:45.911044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:38.032856+0000","last_change":"2024-03-04T06:47:10.343916+0000","last_active":"2024-03-04T07:02:38.032856+0000","last_peered":"2024-03-04T07:02:38.032856+0000","last_clean":"2024-03-04T07:02:38.032856+0000","last_became_active":"2024-03-04T06:47:10.343590+0000","last_became_peered":"2024-03-04T06:47:10.343590+0000","last_unstale":"2024-03-04T07:02:38.032856+0000","last_undegraded":"2024-03-04T07:02:38.032856+0000","last_fullsized":"2024-03-04T07:02:38.032856+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:09:05.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1144,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:52.986538+0000","last_change":"2024-03-04T06:50:06.485325+0000","last_active":"2024-03-04T07:02:52.986538+0000","last_peered":"2024-03-04T07:02:52.986538+0000","last_clean":"2024-03-04T07:02:52.986538+0000","last_became_active":"2024-03-04T06:50:06.485002+0000","last_became_peered":"2024-03-04T06:50:06.485002+0000","last_unstale":"2024-03-04T07:02:52.986538+0000","last_undegraded":"2024-03-04T07:02:52.986538+0000","last_fullsized":"2024-03-04T07:02:52.986538+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:17.379420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:34.578854+0000","last_change":"2024-03-04T06:50:06.494259+0000","last_active":"2024-03-04T07:02:34.578854+0000","last_peered":"2024-03-04T07:02:34.578854+0000","last_clean":"2024-03-04T07:02:34.578854+0000","last_became_active":"2024-03-04T06:50:06.487979+0000","last_became_peered":"2024-03-04T06:50:06.487979+0000","last_unstale":"2024-03-04T07:02:34.578854+0000","last_undegraded":"2024-03-04T07:02:34.578854+0000","last_fullsized":"2024-03-04T07:02:34.578854+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:41.646209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1118,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976210+0000","last_change":"2024-03-04T06:48:54.902933+0000","last_active":"2024-03-04T07:01:22.976210+0000","last_peered":"2024-03-04T07:01:22.976210+0000","last_clean":"2024-03-04T07:01:22.976210+0000","last_became_active":"2024-03-04T06:48:54.902051+0000","last_became_peered":"2024-03-04T06:48:54.902051+0000","last_unstale":"2024-03-04T07:01:22.976210+0000","last_undegraded":"2024-03-04T07:01:22.976210+0000","last_fullsized":"2024-03-04T07:01:22.976210+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:21:13.296967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:34.578813+0000","last_change":"2024-03-04T06:50:06.490944+0000","last_active":"2024-03-04T07:02:34.578813+0000","last_peered":"2024-03-04T07:02:34.578813+0000","last_clean":"2024-03-04T07:02:34.578813+0000","last_became_active":"2024-03-04T06:50:06.490580+0000","last_became_peered":"2024-03-04T06:50:06.490580+0000","last_unstale":"2024-03-04T07:02:34.578813+0000","last_undegraded":"2024-03-04T07:02:34.578813+0000","last_fullsized":"2024-03-04T07:02:34.578813+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:47.404830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1210,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017220+0000","last_change":"2024-03-04T06:49:30.121765+0000","last_active":"2024-03-04T07:00:15.017220+0000","last_peered":"2024-03-04T07:00:15.017220+0000","last_clean":"2024-03-04T07:00:15.017220+0000","last_became_active":"2024-03-04T06:49:30.120971+0000","last_became_peered":"2024-03-04T06:49:30.120971+0000","last_unstale":"2024-03-04T07:00:15.017220+0000","last_undegraded":"2024-03-04T07:00:15.017220+0000","last_fullsized":"2024-03-04T07:00:15.017220+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:41.597392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1067,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:09.575780+0000","last_change":"2024-03-04T06:50:06.499061+0000","last_active":"2024-03-04T07:02:09.575780+0000","last_peered":"2024-03-04T07:02:09.575780+0000","last_clean":"2024-03-04T07:02:09.575780+0000","last_became_active":"2024-03-04T06:50:06.498621+0000","last_became_peered":"2024-03-04T06:50:06.498621+0000","last_unstale":"2024-03-04T07:02:09.575780+0000","last_undegraded":"2024-03-04T07:02:09.575780+0000","last_fullsized":"2024-03-04T07:02:09.575780+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:02:42.399104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256498+0000","last_change":"2024-03-04T06:49:30.129062+0000","last_active":"2024-03-04T07:01:33.256498+0000","last_peered":"2024-03-04T07:01:33.256498+0000","last_clean":"2024-03-04T07:01:33.256498+0000","last_became_active":"2024-03-04T06:49:30.128744+0000","last_became_peered":"2024-03-04T06:49:30.128744+0000","last_unstale":"2024-03-04T07:01:33.256498+0000","last_undegraded":"2024-03-04T07:01:33.256498+0000","last_fullsized":"2024-03-04T07:01:33.256498+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:37.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1095,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256456+0000","last_change":"2024-03-04T06:49:30.128668+0000","last_active":"2024-03-04T07:01:33.256456+0000","last_peered":"2024-03-04T07:01:33.256456+0000","last_clean":"2024-03-04T07:01:33.256456+0000","last_became_active":"2024-03-04T06:49:30.127872+0000","last_became_peered":"2024-03-04T06:49:30.127872+0000","last_unstale":"2024-03-04T07:01:33.256456+0000","last_undegraded":"2024-03-04T07:01:33.256456+0000","last_fullsized":"2024-03-04T07:01:33.256456+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:15.987291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1157,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:22.636361+0000","last_change":"2024-03-04T06:49:30.125975+0000","last_active":"2024-03-04T07:00:22.636361+0000","last_peered":"2024-03-04T07:00:22.636361+0000","last_clean":"2024-03-04T07:00:22.636361+0000","last_became_active":"2024-03-04T06:49:30.125205+0000","last_became_peered":"2024-03-04T06:49:30.125205+0000","last_unstale":"2024-03-04T07:00:22.636361+0000","last_undegraded":"2024-03-04T07:00:22.636361+0000","last_fullsized":"2024-03-04T07:00:22.636361+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:47.173601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1202,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:15.029668+0000","last_change":"2024-03-04T06:49:30.122013+0000","last_active":"2024-03-04T07:02:15.029668+0000","last_peered":"2024-03-04T07:02:15.029668+0000","last_clean":"2024-03-04T07:02:15.029668+0000","last_became_active":"2024-03-04T06:49:30.121530+0000","last_became_peered":"2024-03-04T06:49:30.121530+0000","last_unstale":"2024-03-04T07:02:15.029668+0000","last_undegraded":"2024-03-04T07:02:15.029668+0000","last_fullsized":"2024-03-04T07:02:15.029668+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:46.974023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.030465+0000","last_change":"2024-03-04T06:48:54.892318+0000","last_active":"2024-03-04T07:02:18.030465+0000","last_peered":"2024-03-04T07:02:18.030465+0000","last_clean":"2024-03-04T07:02:18.030465+0000","last_became_active":"2024-03-04T06:48:54.891994+0000","last_became_peered":"2024-03-04T06:48:54.891994+0000","last_unstale":"2024-03-04T07:02:18.030465+0000","last_undegraded":"2024-03-04T07:02:18.030465+0000","last_fullsized":"2024-03-04T07:02:18.030465+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:54:05.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:33.174897+0000","last_change":"2024-03-04T06:48:54.888064+0000","last_active":"2024-03-04T07:00:33.174897+0000","last_peered":"2024-03-04T07:00:33.174897+0000","last_clean":"2024-03-04T07:00:33.174897+0000","last_became_active":"2024-03-04T06:48:54.887699+0000","last_became_peered":"2024-03-04T06:48:54.887699+0000","last_unstale":"2024-03-04T07:00:33.174897+0000","last_undegraded":"2024-03-04T07:00:33.174897+0000","last_fullsized":"2024-03-04T07:00:33.174897+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:04:47.608767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970309+0000","last_change":"2024-03-04T06:50:06.488836+0000","last_active":"2024-03-04T07:00:32.970309+0000","last_peered":"2024-03-04T07:00:32.970309+0000","last_clean":"2024-03-04T07:00:32.970309+0000","last_became_active":"2024-03-04T06:50:06.488532+0000","last_became_peered":"2024-03-04T06:50:06.488532+0000","last_unstale":"2024-03-04T07:00:32.970309+0000","last_undegraded":"2024-03-04T07:00:32.970309+0000","last_fullsized":"2024-03-04T07:00:32.970309+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:36:16.309442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970400+0000","last_change":"2024-03-04T06:50:06.489895+0000","last_active":"2024-03-04T07:00:32.970400+0000","last_peered":"2024-03-04T07:00:32.970400+0000","last_clean":"2024-03-04T07:00:32.970400+0000","last_became_active":"2024-03-04T06:50:06.489602+0000","last_became_peered":"2024-03-04T06:50:06.489602+0000","last_unstale":"2024-03-04T07:00:32.970400+0000","last_undegraded":"2024-03-04T07:00:32.970400+0000","last_fullsized":"2024-03-04T07:00:32.970400+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:01:15.551176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412366+0000","last_change":"2024-03-04T06:50:06.486319+0000","last_active":"2024-03-04T07:01:08.412366+0000","last_peered":"2024-03-04T07:01:08.412366+0000","last_clean":"2024-03-04T07:01:08.412366+0000","last_became_active":"2024-03-04T06:50:06.485917+0000","last_became_peered":"2024-03-04T06:50:06.485917+0000","last_unstale":"2024-03-04T07:01:08.412366+0000","last_undegraded":"2024-03-04T07:01:08.412366+0000","last_fullsized":"2024-03-04T07:01:08.412366+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:46.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569588+0000","last_change":"2024-03-04T06:50:06.494522+0000","last_active":"2024-03-04T07:01:19.569588+0000","last_peered":"2024-03-04T07:01:19.569588+0000","last_clean":"2024-03-04T07:01:19.569588+0000","last_became_active":"2024-03-04T06:50:06.493655+0000","last_became_peered":"2024-03-04T06:50:06.493655+0000","last_unstale":"2024-03-04T07:01:19.569588+0000","last_undegraded":"2024-03-04T07:01:19.569588+0000","last_fullsized":"2024-03-04T07:01:19.569588+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:22.027588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"559'5","reported_seq":1308,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:38.032906+0000","last_change":"2024-03-04T06:50:06.493693+0000","last_active":"2024-03-04T07:02:38.032906+0000","last_peered":"2024-03-04T07:02:38.032906+0000","last_clean":"2024-03-04T07:02:38.032906+0000","last_became_active":"2024-03-04T06:50:06.493159+0000","last_became_peered":"2024-03-04T06:50:06.493159+0000","last_unstale":"2024-03-04T07:02:38.032906+0000","last_undegraded":"2024-03-04T07:02:38.032906+0000","last_fullsized":"2024-03-04T07:02:38.032906+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:05.826480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1197,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026705+0000","last_change":"2024-03-04T06:49:30.119220+0000","last_active":"2024-03-04T07:01:45.026705+0000","last_peered":"2024-03-04T07:01:45.026705+0000","last_clean":"2024-03-04T07:01:45.026705+0000","last_became_active":"2024-03-04T06:49:30.118819+0000","last_became_peered":"2024-03-04T06:49:30.118819+0000","last_unstale":"2024-03-04T07:01:45.026705+0000","last_undegraded":"2024-03-04T07:01:45.026705+0000","last_fullsized":"2024-03-04T07:01:45.026705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:25:04.914805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026715+0000","last_change":"2024-03-04T06:48:54.891199+0000","last_active":"2024-03-04T07:01:45.026715+0000","last_peered":"2024-03-04T07:01:45.026715+0000","last_clean":"2024-03-04T07:01:45.026715+0000","last_became_active":"2024-03-04T06:48:54.890851+0000","last_became_peered":"2024-03-04T06:48:54.890851+0000","last_unstale":"2024-03-04T07:01:45.026715+0000","last_undegraded":"2024-03-04T07:01:45.026715+0000","last_fullsized":"2024-03-04T07:01:45.026715+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:37:14.017811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:38.032889+0000","last_change":"2024-03-04T06:48:54.888900+0000","last_active":"2024-03-04T07:02:38.032889+0000","last_peered":"2024-03-04T07:02:38.032889+0000","last_clean":"2024-03-04T07:02:38.032889+0000","last_became_active":"2024-03-04T06:48:54.888567+0000","last_became_peered":"2024-03-04T06:48:54.888567+0000","last_unstale":"2024-03-04T07:02:38.032889+0000","last_undegraded":"2024-03-04T07:02:38.032889+0000","last_fullsized":"2024-03-04T07:02:38.032889+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:05.309817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1237,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:08.419543+0000","last_change":"2024-03-04T06:49:30.122105+0000","last_active":"2024-03-04T07:02:08.419543+0000","last_peered":"2024-03-04T07:02:08.419543+0000","last_clean":"2024-03-04T07:02:08.419543+0000","last_became_active":"2024-03-04T06:49:30.121050+0000","last_became_peered":"2024-03-04T06:49:30.121050+0000","last_unstale":"2024-03-04T07:02:08.419543+0000","last_undegraded":"2024-03-04T07:02:08.419543+0000","last_fullsized":"2024-03-04T07:02:08.419543+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:17:27.395219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1224,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:08.419489+0000","last_change":"2024-03-04T06:48:19.556570+0000","last_active":"2024-03-04T07:02:08.419489+0000","last_peered":"2024-03-04T07:02:08.419489+0000","last_clean":"2024-03-04T07:02:08.419489+0000","last_became_active":"2024-03-04T06:48:19.555011+0000","last_became_peered":"2024-03-04T06:48:19.555011+0000","last_unstale":"2024-03-04T07:02:08.419489+0000","last_undegraded":"2024-03-04T07:02:08.419489+0000","last_fullsized":"2024-03-04T07:02:08.419489+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:28.125230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1072,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:34.578895+0000","last_change":"2024-03-04T06:50:06.499636+0000","last_active":"2024-03-04T07:02:34.578895+0000","last_peered":"2024-03-04T07:02:34.578895+0000","last_clean":"2024-03-04T07:02:34.578895+0000","last_became_active":"2024-03-04T06:50:06.498736+0000","last_became_peered":"2024-03-04T06:50:06.498736+0000","last_unstale":"2024-03-04T07:02:34.578895+0000","last_undegraded":"2024-03-04T07:02:34.578895+0000","last_fullsized":"2024-03-04T07:02:34.578895+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:50.636575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1128,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976241+0000","last_change":"2024-03-04T06:49:30.123798+0000","last_active":"2024-03-04T07:01:22.976241+0000","last_peered":"2024-03-04T07:01:22.976241+0000","last_clean":"2024-03-04T07:01:22.976241+0000","last_became_active":"2024-03-04T06:49:30.123448+0000","last_became_peered":"2024-03-04T06:49:30.123448+0000","last_unstale":"2024-03-04T07:01:22.976241+0000","last_undegraded":"2024-03-04T07:01:22.976241+0000","last_fullsized":"2024-03-04T07:01:22.976241+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:59.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"559'2","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:15.017274+0000","last_change":"2024-03-04T06:50:06.487954+0000","last_active":"2024-03-04T07:00:15.017274+0000","last_peered":"2024-03-04T07:00:15.017274+0000","last_clean":"2024-03-04T07:00:15.017274+0000","last_became_active":"2024-03-04T06:50:06.487502+0000","last_became_peered":"2024-03-04T06:50:06.487502+0000","last_unstale":"2024-03-04T07:00:15.017274+0000","last_undegraded":"2024-03-04T07:00:15.017274+0000","last_fullsized":"2024-03-04T07:00:15.017274+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:44:56.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1191,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:47.639127+0000","last_change":"2024-03-04T06:48:19.547726+0000","last_active":"2024-03-04T07:00:47.639127+0000","last_peered":"2024-03-04T07:00:47.639127+0000","last_clean":"2024-03-04T07:00:47.639127+0000","last_became_active":"2024-03-04T06:48:19.547393+0000","last_became_peered":"2024-03-04T06:48:19.547393+0000","last_unstale":"2024-03-04T07:00:47.639127+0000","last_undegraded":"2024-03-04T07:00:47.639127+0000","last_fullsized":"2024-03-04T07:00:47.639127+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:11:48.748666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"559'2","reported_seq":1099,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:58.259212+0000","last_change":"2024-03-04T06:50:06.480842+0000","last_active":"2024-03-04T07:01:58.259212+0000","last_peered":"2024-03-04T07:01:58.259212+0000","last_clean":"2024-03-04T07:01:58.259212+0000","last_became_active":"2024-03-04T06:50:06.480318+0000","last_became_peered":"2024-03-04T06:50:06.480318+0000","last_unstale":"2024-03-04T07:01:58.259212+0000","last_undegraded":"2024-03-04T07:01:58.259212+0000","last_fullsized":"2024-03-04T07:01:58.259212+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:14.498412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:58.022394+0000","last_change":"2024-03-04T06:50:06.493308+0000","last_active":"2024-03-04T07:00:58.022394+0000","last_peered":"2024-03-04T07:00:58.022394+0000","last_clean":"2024-03-04T07:00:58.022394+0000","last_became_active":"2024-03-04T06:50:06.492923+0000","last_became_peered":"2024-03-04T06:50:06.492923+0000","last_unstale":"2024-03-04T07:00:58.022394+0000","last_undegraded":"2024-03-04T07:00:58.022394+0000","last_fullsized":"2024-03-04T07:00:58.022394+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:59.364648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:15.029652+0000","last_change":"2024-03-04T06:49:30.118639+0000","last_active":"2024-03-04T07:02:15.029652+0000","last_peered":"2024-03-04T07:02:15.029652+0000","last_clean":"2024-03-04T07:02:15.029652+0000","last_became_active":"2024-03-04T06:49:30.118306+0000","last_became_peered":"2024-03-04T06:49:30.118306+0000","last_unstale":"2024-03-04T07:02:15.029652+0000","last_undegraded":"2024-03-04T07:02:15.029652+0000","last_fullsized":"2024-03-04T07:02:15.029652+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:43:01.945112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1208,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:15.029615+0000","last_change":"2024-03-04T06:47:46.940706+0000","last_active":"2024-03-04T07:02:15.029615+0000","last_peered":"2024-03-04T07:02:15.029615+0000","last_clean":"2024-03-04T07:02:15.029615+0000","last_became_active":"2024-03-04T06:47:46.940404+0000","last_became_peered":"2024-03-04T06:47:46.940404+0000","last_unstale":"2024-03-04T07:02:15.029615+0000","last_undegraded":"2024-03-04T07:02:15.029615+0000","last_fullsized":"2024-03-04T07:02:15.029615+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:28:04.817867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1129,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973153+0000","last_change":"2024-03-04T06:50:06.486228+0000","last_active":"2024-03-04T07:00:57.973153+0000","last_peered":"2024-03-04T07:00:57.973153+0000","last_clean":"2024-03-04T07:00:57.973153+0000","last_became_active":"2024-03-04T06:50:06.485201+0000","last_became_peered":"2024-03-04T06:50:06.485201+0000","last_unstale":"2024-03-04T07:00:57.973153+0000","last_undegraded":"2024-03-04T07:00:57.973153+0000","last_fullsized":"2024-03-04T07:00:57.973153+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:34.396512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1265,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178000+0000","last_change":"2024-03-04T06:48:19.557929+0000","last_active":"2024-03-04T07:01:03.178000+0000","last_peered":"2024-03-04T07:01:03.178000+0000","last_clean":"2024-03-04T07:01:03.178000+0000","last_became_active":"2024-03-04T06:48:19.557295+0000","last_became_peered":"2024-03-04T06:48:19.557295+0000","last_unstale":"2024-03-04T07:01:03.178000+0000","last_undegraded":"2024-03-04T07:01:03.178000+0000","last_fullsized":"2024-03-04T07:01:03.178000+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:55:50.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:33.256513+0000","last_change":"2024-03-04T06:49:30.131211+0000","last_active":"2024-03-04T07:01:33.256513+0000","last_peered":"2024-03-04T07:01:33.256513+0000","last_clean":"2024-03-04T07:01:33.256513+0000","last_became_active":"2024-03-04T06:49:30.128593+0000","last_became_peered":"2024-03-04T06:49:30.128593+0000","last_unstale":"2024-03-04T07:01:33.256513+0000","last_undegraded":"2024-03-04T07:01:33.256513+0000","last_fullsized":"2024-03-04T07:01:33.256513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:10:38.737859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1113,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973230+0000","last_change":"2024-03-04T06:50:06.485944+0000","last_active":"2024-03-04T07:00:57.973230+0000","last_peered":"2024-03-04T07:00:57.973230+0000","last_clean":"2024-03-04T07:00:57.973230+0000","last_became_active":"2024-03-04T06:50:06.485574+0000","last_became_peered":"2024-03-04T06:50:06.485574+0000","last_unstale":"2024-03-04T07:00:57.973230+0000","last_undegraded":"2024-03-04T07:00:57.973230+0000","last_fullsized":"2024-03-04T07:00:57.973230+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:26.200668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1149,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:57.973215+0000","last_change":"2024-03-04T06:49:30.125185+0000","last_active":"2024-03-04T07:00:57.973215+0000","last_peered":"2024-03-04T07:00:57.973215+0000","last_clean":"2024-03-04T07:00:57.973215+0000","last_became_active":"2024-03-04T06:49:30.124890+0000","last_became_peered":"2024-03-04T06:49:30.124890+0000","last_unstale":"2024-03-04T07:00:57.973215+0000","last_undegraded":"2024-03-04T07:00:57.973215+0000","last_fullsized":"2024-03-04T07:00:57.973215+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:32:16.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1298,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:28.018729+0000","last_change":"2024-03-04T06:48:54.889703+0000","last_active":"2024-03-04T07:00:28.018729+0000","last_peered":"2024-03-04T07:00:28.018729+0000","last_clean":"2024-03-04T07:00:28.018729+0000","last_became_active":"2024-03-04T06:48:54.889407+0000","last_became_peered":"2024-03-04T06:48:54.889407+0000","last_unstale":"2024-03-04T07:00:28.018729+0000","last_undegraded":"2024-03-04T07:00:28.018729+0000","last_fullsized":"2024-03-04T07:00:28.018729+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:33.535315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1268,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:03.178037+0000","last_change":"2024-03-04T06:48:54.887537+0000","last_active":"2024-03-04T07:01:03.178037+0000","last_peered":"2024-03-04T07:01:03.178037+0000","last_clean":"2024-03-04T07:01:03.178037+0000","last_became_active":"2024-03-04T06:48:54.887220+0000","last_became_peered":"2024-03-04T06:48:54.887220+0000","last_unstale":"2024-03-04T07:01:03.178037+0000","last_undegraded":"2024-03-04T07:01:03.178037+0000","last_fullsized":"2024-03-04T07:01:03.178037+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:44:09.307169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:17.648952+0000","last_change":"2024-03-04T06:50:06.480748+0000","last_active":"2024-03-04T07:02:17.648952+0000","last_peered":"2024-03-04T07:02:17.648952+0000","last_clean":"2024-03-04T07:02:17.648952+0000","last_became_active":"2024-03-04T06:50:06.480439+0000","last_became_peered":"2024-03-04T06:50:06.480439+0000","last_unstale":"2024-03-04T07:02:17.648952+0000","last_undegraded":"2024-03-04T07:02:17.648952+0000","last_fullsized":"2024-03-04T07:02:17.648952+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.647900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"559'29","reported_seq":1132,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253574+0000","last_change":"2024-03-04T06:49:30.129146+0000","last_active":"2024-03-04T07:01:08.253574+0000","last_peered":"2024-03-04T07:01:08.253574+0000","last_clean":"2024-03-04T07:01:08.253574+0000","last_became_active":"2024-03-04T06:49:30.128616+0000","last_became_peered":"2024-03-04T06:49:30.128616+0000","last_unstale":"2024-03-04T07:01:08.253574+0000","last_undegraded":"2024-03-04T07:01:08.253574+0000","last_fullsized":"2024-03-04T07:01:08.253574+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:38.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1053,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:09.575752+0000","last_change":"2024-03-04T06:50:06.493112+0000","last_active":"2024-03-04T07:02:09.575752+0000","last_peered":"2024-03-04T07:02:09.575752+0000","last_clean":"2024-03-04T07:02:09.575752+0000","last_became_active":"2024-03-04T06:50:06.488675+0000","last_became_peered":"2024-03-04T06:50:06.488675+0000","last_unstale":"2024-03-04T07:02:09.575752+0000","last_undegraded":"2024-03-04T07:02:09.575752+0000","last_fullsized":"2024-03-04T07:02:09.575752+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:13.522682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,1],"acting":[7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1305,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.030497+0000","last_change":"2024-03-04T06:48:19.562492+0000","last_active":"2024-03-04T07:02:18.030497+0000","last_peered":"2024-03-04T07:02:18.030497+0000","last_clean":"2024-03-04T07:02:18.030497+0000","last_became_active":"2024-03-04T06:48:19.562149+0000","last_became_peered":"2024-03-04T06:48:19.562149+0000","last_unstale":"2024-03-04T07:02:18.030497+0000","last_undegraded":"2024-03-04T07:02:18.030497+0000","last_fullsized":"2024-03-04T07:02:18.030497+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.521891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412330+0000","last_change":"2024-03-04T06:50:06.486263+0000","last_active":"2024-03-04T07:01:08.412330+0000","last_peered":"2024-03-04T07:01:08.412330+0000","last_clean":"2024-03-04T07:01:08.412330+0000","last_became_active":"2024-03-04T06:50:06.485890+0000","last_became_peered":"2024-03-04T06:50:06.485890+0000","last_unstale":"2024-03-04T07:01:08.412330+0000","last_undegraded":"2024-03-04T07:01:08.412330+0000","last_fullsized":"2024-03-04T07:01:08.412330+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:37:39.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:32.970340+0000","last_change":"2024-03-04T06:50:06.485989+0000","last_active":"2024-03-04T07:00:32.970340+0000","last_peered":"2024-03-04T07:00:32.970340+0000","last_clean":"2024-03-04T07:00:32.970340+0000","last_became_active":"2024-03-04T06:50:06.485103+0000","last_became_peered":"2024-03-04T06:50:06.485103+0000","last_unstale":"2024-03-04T07:00:32.970340+0000","last_undegraded":"2024-03-04T07:00:32.970340+0000","last_fullsized":"2024-03-04T07:00:32.970340+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:11.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1053,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:44.572629+0000","last_change":"2024-03-04T06:50:06.492887+0000","last_active":"2024-03-04T07:01:44.572629+0000","last_peered":"2024-03-04T07:01:44.572629+0000","last_clean":"2024-03-04T07:01:44.572629+0000","last_became_active":"2024-03-04T06:50:06.492330+0000","last_became_peered":"2024-03-04T06:50:06.492330+0000","last_unstale":"2024-03-04T07:01:44.572629+0000","last_undegraded":"2024-03-04T07:01:44.572629+0000","last_fullsized":"2024-03-04T07:01:44.572629+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:47.907680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,2],"acting":[7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1104,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253553+0000","last_change":"2024-03-04T06:49:30.127538+0000","last_active":"2024-03-04T07:01:08.253553+0000","last_peered":"2024-03-04T07:01:08.253553+0000","last_clean":"2024-03-04T07:01:08.253553+0000","last_became_active":"2024-03-04T06:49:30.126382+0000","last_became_peered":"2024-03-04T06:49:30.126382+0000","last_unstale":"2024-03-04T07:01:08.253553+0000","last_undegraded":"2024-03-04T07:01:08.253553+0000","last_fullsized":"2024-03-04T07:01:08.253553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:31.027458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1096,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.253528+0000","last_change":"2024-03-04T06:49:30.128345+0000","last_active":"2024-03-04T07:01:08.253528+0000","last_peered":"2024-03-04T07:01:08.253528+0000","last_clean":"2024-03-04T07:01:08.253528+0000","last_became_active":"2024-03-04T06:49:30.127893+0000","last_became_peered":"2024-03-04T06:49:30.127893+0000","last_unstale":"2024-03-04T07:01:08.253528+0000","last_undegraded":"2024-03-04T07:01:08.253528+0000","last_fullsized":"2024-03-04T07:01:08.253528+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:47:31.424339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1255,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.412282+0000","last_change":"2024-03-04T06:47:10.348696+0000","last_active":"2024-03-04T07:01:08.412282+0000","last_peered":"2024-03-04T07:01:08.412282+0000","last_clean":"2024-03-04T07:01:08.412282+0000","last_became_active":"2024-03-04T06:47:10.342930+0000","last_became_peered":"2024-03-04T06:47:10.342930+0000","last_unstale":"2024-03-04T07:01:08.412282+0000","last_undegraded":"2024-03-04T07:01:08.412282+0000","last_fullsized":"2024-03-04T07:01:08.412282+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:10:50.524934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:44.572593+0000","last_change":"2024-03-04T06:50:06.494937+0000","last_active":"2024-03-04T07:01:44.572593+0000","last_peered":"2024-03-04T07:01:44.572593+0000","last_clean":"2024-03-04T07:01:44.572593+0000","last_became_active":"2024-03-04T06:50:06.492589+0000","last_became_peered":"2024-03-04T06:50:06.492589+0000","last_unstale":"2024-03-04T07:01:44.572593+0000","last_undegraded":"2024-03-04T07:01:44.572593+0000","last_fullsized":"2024-03-04T07:01:44.572593+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:19.762768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"819'331","reported_seq":3580,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.420253+0000","last_change":"2024-03-04T06:55:12.090492+0000","last_active":"2024-03-04T07:02:18.420253+0000","last_peered":"2024-03-04T07:02:18.420253+0000","last_clean":"2024-03-04T07:02:18.420253+0000","last_became_active":"2024-03-04T06:47:10.343447+0000","last_became_peered":"2024-03-04T06:47:10.343447+0000","last_unstale":"2024-03-04T07:02:18.420253+0000","last_undegraded":"2024-03-04T07:02:18.420253+0000","last_fullsized":"2024-03-04T07:02:18.420253+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:12:27.039416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075560899999999997,"stat_sum":{"num_bytes":5251072,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":69842,"num_write":134,"num_write_kb":16648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4333568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1162,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:47.645939+0000","last_change":"2024-03-04T06:50:06.485610+0000","last_active":"2024-03-04T07:01:47.645939+0000","last_peered":"2024-03-04T07:01:47.645939+0000","last_clean":"2024-03-04T07:01:47.645939+0000","last_became_active":"2024-03-04T06:50:06.484970+0000","last_became_peered":"2024-03-04T06:50:06.484970+0000","last_unstale":"2024-03-04T07:01:47.645939+0000","last_undegraded":"2024-03-04T07:01:47.645939+0000","last_fullsized":"2024-03-04T07:01:47.645939+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:48:44.526772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569613+0000","last_change":"2024-03-04T06:50:06.488030+0000","last_active":"2024-03-04T07:01:19.569613+0000","last_peered":"2024-03-04T07:01:19.569613+0000","last_clean":"2024-03-04T07:01:19.569613+0000","last_became_active":"2024-03-04T06:50:06.487703+0000","last_became_peered":"2024-03-04T06:50:06.487703+0000","last_unstale":"2024-03-04T07:01:19.569613+0000","last_undegraded":"2024-03-04T07:01:19.569613+0000","last_fullsized":"2024-03-04T07:01:19.569613+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:43.017011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"811'16962","reported_seq":17119,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:02:38.032816+0000","last_change":"2024-03-04T06:55:13.117976+0000","last_active":"2024-03-04T07:02:38.032816+0000","last_peered":"2024-03-04T07:02:38.032816+0000","last_clean":"2024-03-04T07:02:38.032816+0000","last_became_active":"2024-03-04T06:49:30.121705+0000","last_became_peered":"2024-03-04T06:49:30.121705+0000","last_unstale":"2024-03-04T07:02:38.032816+0000","last_undegraded":"2024-03-04T07:02:38.032816+0000","last_fullsized":"2024-03-04T07:02:38.032816+0000","mapping_epoch":500,"log_start":"310'11204","ondisk_log_start":"310'11204","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":5758,"log_dups_size":0,"ondisk_log_size":5758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":270,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.713157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067872100000000001,"stat_sum":{"num_bytes":91676672,"num_objects":71,"num_object_clones":68,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":211,"num_read_kb":299964,"num_write":361,"num_write_kb":95360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19120128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178538+0000","last_change":"2024-03-04T06:48:54.894857+0000","last_active":"2024-03-04T07:01:08.178538+0000","last_peered":"2024-03-04T07:01:08.178538+0000","last_clean":"2024-03-04T07:01:08.178538+0000","last_became_active":"2024-03-04T06:48:54.894596+0000","last_became_peered":"2024-03-04T06:48:54.894596+0000","last_unstale":"2024-03-04T07:01:08.178538+0000","last_undegraded":"2024-03-04T07:01:08.178538+0000","last_fullsized":"2024-03-04T07:01:08.178538+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:25.373219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1263,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178614+0000","last_change":"2024-03-04T06:50:06.487687+0000","last_active":"2024-03-04T07:01:08.178614+0000","last_peered":"2024-03-04T07:01:08.178614+0000","last_clean":"2024-03-04T07:01:08.178614+0000","last_became_active":"2024-03-04T06:50:06.487331+0000","last_became_peered":"2024-03-04T06:50:06.487331+0000","last_unstale":"2024-03-04T07:01:08.178614+0000","last_undegraded":"2024-03-04T07:01:08.178614+0000","last_fullsized":"2024-03-04T07:01:08.178614+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:37:23.903242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976230+0000","last_change":"2024-03-04T06:48:54.893263+0000","last_active":"2024-03-04T07:01:22.976230+0000","last_peered":"2024-03-04T07:01:22.976230+0000","last_clean":"2024-03-04T07:01:22.976230+0000","last_became_active":"2024-03-04T06:48:54.892967+0000","last_became_peered":"2024-03-04T06:48:54.892967+0000","last_unstale":"2024-03-04T07:01:22.976230+0000","last_undegraded":"2024-03-04T07:01:22.976230+0000","last_fullsized":"2024-03-04T07:01:22.976230+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:22:08.914359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"810'128","reported_seq":4389,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:02:38.032866+0000","last_change":"2024-03-04T06:55:13.117010+0000","last_active":"2024-03-04T07:02:38.032866+0000","last_peered":"2024-03-04T07:02:38.032866+0000","last_clean":"2024-03-04T07:02:38.032866+0000","last_became_active":"2024-03-04T06:48:19.560272+0000","last_became_peered":"2024-03-04T06:48:19.560272+0000","last_unstale":"2024-03-04T07:02:38.032866+0000","last_undegraded":"2024-03-04T07:02:38.032866+0000","last_fullsized":"2024-03-04T07:02:38.032866+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":267,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:12.737000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064359499999999995,"stat_sum":{"num_bytes":24584192,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":52,"num_read_kb":138003,"num_write":129,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178564+0000","last_change":"2024-03-04T06:47:46.941561+0000","last_active":"2024-03-04T07:01:08.178564+0000","last_peered":"2024-03-04T07:01:08.178564+0000","last_clean":"2024-03-04T07:01:08.178564+0000","last_became_active":"2024-03-04T06:47:46.941243+0000","last_became_peered":"2024-03-04T06:47:46.941243+0000","last_unstale":"2024-03-04T07:01:08.178564+0000","last_undegraded":"2024-03-04T07:01:08.178564+0000","last_fullsized":"2024-03-04T07:01:08.178564+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:43.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1115,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976151+0000","last_change":"2024-03-04T06:49:30.124282+0000","last_active":"2024-03-04T07:01:22.976151+0000","last_peered":"2024-03-04T07:01:22.976151+0000","last_clean":"2024-03-04T07:01:22.976151+0000","last_became_active":"2024-03-04T06:49:30.123460+0000","last_became_peered":"2024-03-04T06:49:30.123460+0000","last_unstale":"2024-03-04T07:01:22.976151+0000","last_undegraded":"2024-03-04T07:01:22.976151+0000","last_fullsized":"2024-03-04T07:01:22.976151+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:09:20.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1160,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:52.653305+0000","last_change":"2024-03-04T06:49:30.123970+0000","last_active":"2024-03-04T07:02:52.653305+0000","last_peered":"2024-03-04T07:02:52.653305+0000","last_clean":"2024-03-04T07:02:52.653305+0000","last_became_active":"2024-03-04T06:49:30.123664+0000","last_became_peered":"2024-03-04T06:49:30.123664+0000","last_unstale":"2024-03-04T07:02:52.653305+0000","last_undegraded":"2024-03-04T07:02:52.653305+0000","last_fullsized":"2024-03-04T07:02:52.653305+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:18.989557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"822'2561","reported_seq":5642,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.420330+0000","last_change":"2024-03-04T06:55:12.108215+0000","last_active":"2024-03-04T07:02:18.420330+0000","last_peered":"2024-03-04T07:02:18.420330+0000","last_clean":"2024-03-04T07:02:18.420330+0000","last_became_active":"2024-03-04T06:48:54.895584+0000","last_became_peered":"2024-03-04T06:48:54.895584+0000","last_unstale":"2024-03-04T07:02:18.420330+0000","last_undegraded":"2024-03-04T07:02:18.420330+0000","last_fullsized":"2024-03-04T07:02:18.420330+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":2561,"log_dups_size":0,"ondisk_log_size":2561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:08.479006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017968227999999999,"stat_sum":{"num_bytes":38838272,"num_objects":18,"num_object_clones":12,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":1,"num_read":473,"num_read_kb":560474,"num_write":1051,"num_write_kb":216008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":26984448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1258,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182480+0000","last_change":"2024-03-04T06:48:54.888555+0000","last_active":"2024-03-04T07:01:43.182480+0000","last_peered":"2024-03-04T07:01:43.182480+0000","last_clean":"2024-03-04T07:01:43.182480+0000","last_became_active":"2024-03-04T06:48:54.888129+0000","last_became_peered":"2024-03-04T06:48:54.888129+0000","last_unstale":"2024-03-04T07:01:43.182480+0000","last_undegraded":"2024-03-04T07:01:43.182480+0000","last_fullsized":"2024-03-04T07:01:43.182480+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:52.752203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1267,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:33.187586+0000","last_change":"2024-03-04T06:49:30.118683+0000","last_active":"2024-03-04T07:02:33.187586+0000","last_peered":"2024-03-04T07:02:33.187586+0000","last_clean":"2024-03-04T07:02:33.187586+0000","last_became_active":"2024-03-04T06:49:30.118252+0000","last_became_peered":"2024-03-04T06:49:30.118252+0000","last_unstale":"2024-03-04T07:02:33.187586+0000","last_undegraded":"2024-03-04T07:02:33.187586+0000","last_fullsized":"2024-03-04T07:02:33.187586+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:59.470258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1242,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416777+0000","last_change":"2024-03-04T06:47:46.929071+0000","last_active":"2024-03-04T07:01:43.416777+0000","last_peered":"2024-03-04T07:01:43.416777+0000","last_clean":"2024-03-04T07:01:43.416777+0000","last_became_active":"2024-03-04T06:47:46.928468+0000","last_became_peered":"2024-03-04T06:47:46.928468+0000","last_unstale":"2024-03-04T07:01:43.416777+0000","last_undegraded":"2024-03-04T07:01:43.416777+0000","last_fullsized":"2024-03-04T07:01:43.416777+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:29.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"809'599","reported_seq":4018,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:02:34.578912+0000","last_change":"2024-03-04T06:55:13.106850+0000","last_active":"2024-03-04T07:02:34.578912+0000","last_peered":"2024-03-04T07:02:34.578912+0000","last_clean":"2024-03-04T07:02:34.578912+0000","last_became_active":"2024-03-04T06:50:06.498712+0000","last_became_peered":"2024-03-04T06:50:06.498712+0000","last_unstale":"2024-03-04T07:02:34.578912+0000","last_undegraded":"2024-03-04T07:02:34.578912+0000","last_fullsized":"2024-03-04T07:02:34.578912+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:17:51.868429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099250420000000002,"stat_sum":{"num_bytes":48128000,"num_objects":25,"num_object_clones":23,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":148,"num_read_kb":270929,"num_write":370,"num_write_kb":71416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":19054592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1094,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:58.259258+0000","last_change":"2024-03-04T06:50:06.481619+0000","last_active":"2024-03-04T07:01:58.259258+0000","last_peered":"2024-03-04T07:01:58.259258+0000","last_clean":"2024-03-04T07:01:58.259258+0000","last_became_active":"2024-03-04T06:50:06.481213+0000","last_became_peered":"2024-03-04T06:50:06.481213+0000","last_unstale":"2024-03-04T07:01:58.259258+0000","last_undegraded":"2024-03-04T07:01:58.259258+0000","last_fullsized":"2024-03-04T07:01:58.259258+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:04.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1213,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:20.030063+0000","last_change":"2024-03-04T06:49:30.123738+0000","last_active":"2024-03-04T07:02:20.030063+0000","last_peered":"2024-03-04T07:02:20.030063+0000","last_clean":"2024-03-04T07:02:20.030063+0000","last_became_active":"2024-03-04T06:49:30.123418+0000","last_became_peered":"2024-03-04T06:49:30.123418+0000","last_unstale":"2024-03-04T07:02:20.030063+0000","last_undegraded":"2024-03-04T07:02:20.030063+0000","last_fullsized":"2024-03-04T07:02:20.030063+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:28.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1150,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976219+0000","last_change":"2024-03-04T06:50:06.487256+0000","last_active":"2024-03-04T07:01:22.976219+0000","last_peered":"2024-03-04T07:01:22.976219+0000","last_clean":"2024-03-04T07:01:22.976219+0000","last_became_active":"2024-03-04T06:50:06.486935+0000","last_became_peered":"2024-03-04T06:50:06.486935+0000","last_unstale":"2024-03-04T07:01:22.976219+0000","last_undegraded":"2024-03-04T07:01:22.976219+0000","last_fullsized":"2024-03-04T07:01:22.976219+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:15:09.998696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"224'197","reported_seq":1553,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:04.574969+0000","last_change":"2024-03-04T06:50:06.488994+0000","last_active":"2024-03-04T07:02:04.574969+0000","last_peered":"2024-03-04T07:02:04.574969+0000","last_clean":"2024-03-04T07:02:04.574969+0000","last_became_active":"2024-03-04T06:50:06.487206+0000","last_became_peered":"2024-03-04T06:50:06.487206+0000","last_unstale":"2024-03-04T07:02:04.574969+0000","last_undegraded":"2024-03-04T07:02:04.574969+0000","last_fullsized":"2024-03-04T07:02:04.574969+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:35:55.260752+0000","last_clean_scrub_stamp":"2024-03-04T06:35:55.260752+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:56:18.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"823'968","reported_seq":3953,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:52.979497+0000","last_change":"2024-03-04T06:55:12.102691+0000","last_active":"2024-03-04T07:01:52.979497+0000","last_peered":"2024-03-04T07:01:52.979497+0000","last_clean":"2024-03-04T07:01:52.979497+0000","last_became_active":"2024-03-04T06:48:54.896620+0000","last_became_peered":"2024-03-04T06:48:54.896620+0000","last_unstale":"2024-03-04T07:01:52.979497+0000","last_undegraded":"2024-03-04T07:01:52.979497+0000","last_fullsized":"2024-03-04T07:01:52.979497+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T06:45:31.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059307350000000003,"stat_sum":{"num_bytes":43442176,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":251782,"num_write":431,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15630336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023391+0000","last_change":"2024-03-04T06:47:10.345088+0000","last_active":"2024-03-04T07:01:08.023391+0000","last_peered":"2024-03-04T07:01:08.023391+0000","last_clean":"2024-03-04T07:01:08.023391+0000","last_became_active":"2024-03-04T06:47:10.344787+0000","last_became_peered":"2024-03-04T06:47:10.344787+0000","last_unstale":"2024-03-04T07:01:08.023391+0000","last_undegraded":"2024-03-04T07:01:08.023391+0000","last_fullsized":"2024-03-04T07:01:08.023391+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:12.486746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1243,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416752+0000","last_change":"2024-03-04T06:48:19.555833+0000","last_active":"2024-03-04T07:01:43.416752+0000","last_peered":"2024-03-04T07:01:43.416752+0000","last_clean":"2024-03-04T07:01:43.416752+0000","last_became_active":"2024-03-04T06:48:19.555517+0000","last_became_peered":"2024-03-04T06:48:19.555517+0000","last_unstale":"2024-03-04T07:01:43.416752+0000","last_undegraded":"2024-03-04T07:01:43.416752+0000","last_fullsized":"2024-03-04T07:01:43.416752+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:12:27.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1060,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:04.574922+0000","last_change":"2024-03-04T06:50:06.493340+0000","last_active":"2024-03-04T07:02:04.574922+0000","last_peered":"2024-03-04T07:02:04.574922+0000","last_clean":"2024-03-04T07:02:04.574922+0000","last_became_active":"2024-03-04T06:50:06.487813+0000","last_became_peered":"2024-03-04T06:50:06.487813+0000","last_unstale":"2024-03-04T07:02:04.574922+0000","last_undegraded":"2024-03-04T07:02:04.574922+0000","last_fullsized":"2024-03-04T07:02:04.574922+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:13:04.059961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"823'11845","reported_seq":15294,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:58.259228+0000","last_change":"2024-03-04T06:55:13.115555+0000","last_active":"2024-03-04T07:01:58.259228+0000","last_peered":"2024-03-04T07:01:58.259228+0000","last_clean":"2024-03-04T07:01:58.259228+0000","last_became_active":"2024-03-04T06:49:30.128875+0000","last_became_peered":"2024-03-04T06:49:30.128875+0000","last_unstale":"2024-03-04T07:01:58.259228+0000","last_undegraded":"2024-03-04T07:01:58.259228+0000","last_fullsized":"2024-03-04T07:01:58.259228+0000","mapping_epoch":500,"log_start":"506'4802","ondisk_log_start":"506'4802","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":7043,"log_dups_size":0,"ondisk_log_size":7043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":165,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:56.845446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089040190000000009,"stat_sum":{"num_bytes":62373888,"num_objects":26,"num_object_clones":24,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":144,"num_read_kb":183762,"num_write":309,"num_write_kb":89112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4800512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5f"},{"start":"104","length":"1"},{"start":"106","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:38.032841+0000","last_change":"2024-03-04T06:50:06.493215+0000","last_active":"2024-03-04T07:02:38.032841+0000","last_peered":"2024-03-04T07:02:38.032841+0000","last_clean":"2024-03-04T07:02:38.032841+0000","last_became_active":"2024-03-04T06:50:06.492860+0000","last_became_peered":"2024-03-04T06:50:06.492860+0000","last_unstale":"2024-03-04T07:02:38.032841+0000","last_undegraded":"2024-03-04T07:02:38.032841+0000","last_fullsized":"2024-03-04T07:02:38.032841+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:15:32.648717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1076,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:34.578954+0000","last_change":"2024-03-04T06:50:06.493982+0000","last_active":"2024-03-04T07:02:34.578954+0000","last_peered":"2024-03-04T07:02:34.578954+0000","last_clean":"2024-03-04T07:02:34.578954+0000","last_became_active":"2024-03-04T06:50:06.490836+0000","last_became_peered":"2024-03-04T06:50:06.490836+0000","last_unstale":"2024-03-04T07:02:34.578954+0000","last_undegraded":"2024-03-04T07:02:34.578954+0000","last_fullsized":"2024-03-04T07:02:34.578954+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:24:29.684431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.178580+0000","last_change":"2024-03-04T06:48:54.887500+0000","last_active":"2024-03-04T07:01:08.178580+0000","last_peered":"2024-03-04T07:01:08.178580+0000","last_clean":"2024-03-04T07:01:08.178580+0000","last_became_active":"2024-03-04T06:48:54.887176+0000","last_became_peered":"2024-03-04T06:48:54.887176+0000","last_unstale":"2024-03-04T07:01:08.178580+0000","last_undegraded":"2024-03-04T07:01:08.178580+0000","last_fullsized":"2024-03-04T07:01:08.178580+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:07.944628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"817'541","reported_seq":4382,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:02:52.653258+0000","last_change":"2024-03-04T06:55:13.097496+0000","last_active":"2024-03-04T07:02:52.653258+0000","last_peered":"2024-03-04T07:02:52.653258+0000","last_clean":"2024-03-04T07:02:52.653258+0000","last_became_active":"2024-03-04T06:50:06.500610+0000","last_became_peered":"2024-03-04T06:50:06.500610+0000","last_unstale":"2024-03-04T07:02:52.653258+0000","last_undegraded":"2024-03-04T07:02:52.653258+0000","last_fullsized":"2024-03-04T07:02:52.653258+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:28.176432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041735169999999999,"stat_sum":{"num_bytes":40968192,"num_objects":38,"num_object_clones":36,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":2,"num_read":175,"num_read_kb":266608,"num_write":310,"num_write_kb":56912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2048000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"4.0","version":"0'0","reported_seq":1206,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:45.026676+0000","last_change":"2024-03-04T06:50:06.488851+0000","last_active":"2024-03-04T07:01:45.026676+0000","last_peered":"2024-03-04T07:01:45.026676+0000","last_clean":"2024-03-04T07:01:45.026676+0000","last_became_active":"2024-03-04T06:50:06.488493+0000","last_became_peered":"2024-03-04T06:50:06.488493+0000","last_unstale":"2024-03-04T07:01:45.026676+0000","last_undegraded":"2024-03-04T07:01:45.026676+0000","last_fullsized":"2024-03-04T07:01:45.026676+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:22:36.032086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"560'2","reported_seq":1271,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182470+0000","last_change":"2024-03-04T06:49:30.119614+0000","last_active":"2024-03-04T07:01:43.182470+0000","last_peered":"2024-03-04T07:01:43.182470+0000","last_clean":"2024-03-04T07:01:43.182470+0000","last_became_active":"2024-03-04T06:49:30.118814+0000","last_became_peered":"2024-03-04T06:49:30.118814+0000","last_unstale":"2024-03-04T07:01:43.182470+0000","last_undegraded":"2024-03-04T07:01:43.182470+0000","last_fullsized":"2024-03-04T07:01:43.182470+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:23:50.277523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020800+0000","last_change":"2024-03-04T06:50:06.487746+0000","last_active":"2024-03-04T07:00:45.020800+0000","last_peered":"2024-03-04T07:00:45.020800+0000","last_clean":"2024-03-04T07:00:45.020800+0000","last_became_active":"2024-03-04T06:50:06.487293+0000","last_became_peered":"2024-03-04T06:50:06.487293+0000","last_unstale":"2024-03-04T07:00:45.020800+0000","last_undegraded":"2024-03-04T07:00:45.020800+0000","last_fullsized":"2024-03-04T07:00:45.020800+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:07:54.403065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"823'683","reported_seq":4612,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:45.026591+0000","last_change":"2024-03-04T06:55:13.098563+0000","last_active":"2024-03-04T07:01:45.026591+0000","last_peered":"2024-03-04T07:01:45.026591+0000","last_clean":"2024-03-04T07:01:45.026591+0000","last_became_active":"2024-03-04T06:48:19.554336+0000","last_became_peered":"2024-03-04T06:48:19.554336+0000","last_unstale":"2024-03-04T07:01:45.026591+0000","last_undegraded":"2024-03-04T07:01:45.026591+0000","last_fullsized":"2024-03-04T07:01:45.026591+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":214,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:54.896684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042426800000000004,"stat_sum":{"num_bytes":95895552,"num_objects":68,"num_object_clones":65,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":1,"num_read":191,"num_read_kb":233727,"num_write":559,"num_write_kb":134584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":26869760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"2c"},{"start":"d2","length":"3"},{"start":"d8","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1162,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:52.653235+0000","last_change":"2024-03-04T06:49:30.125196+0000","last_active":"2024-03-04T07:02:52.653235+0000","last_peered":"2024-03-04T07:02:52.653235+0000","last_clean":"2024-03-04T07:02:52.653235+0000","last_became_active":"2024-03-04T06:49:30.124908+0000","last_became_peered":"2024-03-04T06:49:30.124908+0000","last_unstale":"2024-03-04T07:02:52.653235+0000","last_undegraded":"2024-03-04T07:02:52.653235+0000","last_fullsized":"2024-03-04T07:02:52.653235+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:46.297983+0000","last_clean_scrub_stamp":"2024-03-04T06:38:46.297983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:15.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1081,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:28.263279+0000","last_change":"2024-03-04T06:50:06.483706+0000","last_active":"2024-03-04T07:02:28.263279+0000","last_peered":"2024-03-04T07:02:28.263279+0000","last_clean":"2024-03-04T07:02:28.263279+0000","last_became_active":"2024-03-04T06:50:06.483336+0000","last_became_peered":"2024-03-04T06:50:06.483336+0000","last_unstale":"2024-03-04T07:02:28.263279+0000","last_undegraded":"2024-03-04T07:02:28.263279+0000","last_fullsized":"2024-03-04T07:02:28.263279+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:33:14.882181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:08.023341+0000","last_change":"2024-03-04T06:48:19.563710+0000","last_active":"2024-03-04T07:01:08.023341+0000","last_peered":"2024-03-04T07:01:08.023341+0000","last_clean":"2024-03-04T07:01:08.023341+0000","last_became_active":"2024-03-04T06:48:19.563428+0000","last_became_peered":"2024-03-04T06:48:19.563428+0000","last_unstale":"2024-03-04T07:01:08.023341+0000","last_undegraded":"2024-03-04T07:01:08.023341+0000","last_fullsized":"2024-03-04T07:01:08.023341+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:02:03.653482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"819'965","reported_seq":4637,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:02:22.983330+0000","last_change":"2024-03-04T06:55:13.107390+0000","last_active":"2024-03-04T07:02:22.983330+0000","last_peered":"2024-03-04T07:02:22.983330+0000","last_clean":"2024-03-04T07:02:22.983330+0000","last_became_active":"2024-03-04T06:49:30.125114+0000","last_became_peered":"2024-03-04T06:49:30.125114+0000","last_unstale":"2024-03-04T07:02:22.983330+0000","last_undegraded":"2024-03-04T07:02:22.983330+0000","last_fullsized":"2024-03-04T07:02:22.983330+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":184,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T07:06:42.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076733349999999999,"stat_sum":{"num_bytes":66109440,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":247,"num_read_kb":346769,"num_write":526,"num_write_kb":109976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":44310528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"4b"},{"start":"f0","length":"3"}]},{"pgid":"2.8","version":"0'0","reported_seq":1059,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:54.566566+0000","last_change":"2024-03-04T06:50:06.495898+0000","last_active":"2024-03-04T07:00:54.566566+0000","last_peered":"2024-03-04T07:00:54.566566+0000","last_clean":"2024-03-04T07:00:54.566566+0000","last_became_active":"2024-03-04T06:50:06.493799+0000","last_became_peered":"2024-03-04T06:50:06.493799+0000","last_unstale":"2024-03-04T07:00:54.566566+0000","last_undegraded":"2024-03-04T07:00:54.566566+0000","last_fullsized":"2024-03-04T07:00:54.566566+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:32.803403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1187,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:17.642331+0000","last_change":"2024-03-04T06:50:06.494126+0000","last_active":"2024-03-04T07:01:17.642331+0000","last_peered":"2024-03-04T07:01:17.642331+0000","last_clean":"2024-03-04T07:01:17.642331+0000","last_became_active":"2024-03-04T06:50:06.493727+0000","last_became_peered":"2024-03-04T06:50:06.493727+0000","last_unstale":"2024-03-04T07:01:17.642331+0000","last_undegraded":"2024-03-04T07:01:17.642331+0000","last_fullsized":"2024-03-04T07:01:17.642331+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:15.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"822'1343","reported_seq":5160,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:01:47.645896+0000","last_change":"2024-03-04T06:55:13.097178+0000","last_active":"2024-03-04T07:01:47.645896+0000","last_peered":"2024-03-04T07:01:47.645896+0000","last_clean":"2024-03-04T07:01:47.645896+0000","last_became_active":"2024-03-04T06:48:54.896183+0000","last_became_peered":"2024-03-04T06:48:54.896183+0000","last_unstale":"2024-03-04T07:01:47.645896+0000","last_undegraded":"2024-03-04T07:01:47.645896+0000","last_fullsized":"2024-03-04T07:01:47.645896+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":200,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:39.782124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020369780000000001,"stat_sum":{"num_bytes":125607936,"num_objects":91,"num_object_clones":86,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":2,"num_read":323,"num_read_kb":326868,"num_write":917,"num_write_kb":189264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":74276864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"32"},{"start":"d7","length":"8"},{"start":"e1","length":"1"},{"start":"e3","length":"3"}]},{"pgid":"2.9","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182417+0000","last_change":"2024-03-04T06:50:06.499342+0000","last_active":"2024-03-04T07:01:43.182417+0000","last_peered":"2024-03-04T07:01:43.182417+0000","last_clean":"2024-03-04T07:01:43.182417+0000","last_became_active":"2024-03-04T06:50:06.498844+0000","last_became_peered":"2024-03-04T06:50:06.498844+0000","last_unstale":"2024-03-04T07:01:43.182417+0000","last_undegraded":"2024-03-04T07:01:43.182417+0000","last_fullsized":"2024-03-04T07:01:43.182417+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:44:25.595253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020733+0000","last_change":"2024-03-04T06:50:06.489666+0000","last_active":"2024-03-04T07:00:45.020733+0000","last_peered":"2024-03-04T07:00:45.020733+0000","last_clean":"2024-03-04T07:00:45.020733+0000","last_became_active":"2024-03-04T06:50:06.489349+0000","last_became_peered":"2024-03-04T06:50:06.489349+0000","last_unstale":"2024-03-04T07:00:45.020733+0000","last_undegraded":"2024-03-04T07:00:45.020733+0000","last_fullsized":"2024-03-04T07:00:45.020733+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:54.185829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"823'1530","reported_seq":4721,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409468+0000","last_change":"2024-03-04T06:55:12.105031+0000","last_active":"2024-03-04T07:00:38.409468+0000","last_peered":"2024-03-04T07:00:38.409468+0000","last_clean":"2024-03-04T07:00:38.409468+0000","last_became_active":"2024-03-04T06:50:06.486333+0000","last_became_peered":"2024-03-04T06:50:06.486333+0000","last_unstale":"2024-03-04T07:00:38.409468+0000","last_undegraded":"2024-03-04T07:00:38.409468+0000","last_fullsized":"2024-03-04T07:00:38.409468+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1530,"log_dups_size":0,"ondisk_log_size":1530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:09.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014047438000000001,"stat_sum":{"num_bytes":37527552,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":299,"num_read_kb":743359,"num_write":612,"num_write_kb":134760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":61407232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182435+0000","last_change":"2024-03-04T06:50:06.485087+0000","last_active":"2024-03-04T07:01:43.182435+0000","last_peered":"2024-03-04T07:01:43.182435+0000","last_clean":"2024-03-04T07:01:43.182435+0000","last_became_active":"2024-03-04T06:50:06.484720+0000","last_became_peered":"2024-03-04T06:50:06.484720+0000","last_unstale":"2024-03-04T07:01:43.182435+0000","last_undegraded":"2024-03-04T07:01:43.182435+0000","last_fullsized":"2024-03-04T07:01:43.182435+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:36.243456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023738+0000","last_change":"2024-03-04T06:48:19.546547+0000","last_active":"2024-03-04T07:01:15.023738+0000","last_peered":"2024-03-04T07:01:15.023738+0000","last_clean":"2024-03-04T07:01:15.023738+0000","last_became_active":"2024-03-04T06:48:19.546198+0000","last_became_peered":"2024-03-04T06:48:19.546198+0000","last_unstale":"2024-03-04T07:01:15.023738+0000","last_undegraded":"2024-03-04T07:01:15.023738+0000","last_fullsized":"2024-03-04T07:01:15.023738+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:01:59.890447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"819'1332","reported_seq":5557,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:02:18.186024+0000","last_change":"2024-03-04T06:55:13.117009+0000","last_active":"2024-03-04T07:02:18.186024+0000","last_peered":"2024-03-04T07:02:18.186024+0000","last_clean":"2024-03-04T07:02:18.186024+0000","last_became_active":"2024-03-04T06:48:19.558766+0000","last_became_peered":"2024-03-04T06:48:19.558766+0000","last_unstale":"2024-03-04T07:02:18.186024+0000","last_undegraded":"2024-03-04T07:02:18.186024+0000","last_fullsized":"2024-03-04T07:02:18.186024+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":249,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:13:58.980230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845876999999999,"stat_sum":{"num_bytes":195010560,"num_objects":108,"num_object_clones":103,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":2,"num_read":389,"num_read_kb":656836,"num_write":939,"num_write_kb":212144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":76480512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9f","length":"2"},{"start":"a2","length":"1"},{"start":"a4","length":"4"},{"start":"a9","length":"4"},{"start":"ae","length":"2"},{"start":"b2","length":"3"},{"start":"b7","length":"1"}]},{"pgid":"2.b","version":"559'3","reported_seq":1073,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569554+0000","last_change":"2024-03-04T06:50:06.498467+0000","last_active":"2024-03-04T07:01:19.569554+0000","last_peered":"2024-03-04T07:01:19.569554+0000","last_clean":"2024-03-04T07:01:19.569554+0000","last_became_active":"2024-03-04T06:50:06.498111+0000","last_became_peered":"2024-03-04T06:50:06.498111+0000","last_unstale":"2024-03-04T07:01:19.569554+0000","last_undegraded":"2024-03-04T07:01:19.569554+0000","last_fullsized":"2024-03-04T07:01:19.569554+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:29.963641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:28.263229+0000","last_change":"2024-03-04T06:49:30.126803+0000","last_active":"2024-03-04T07:02:28.263229+0000","last_peered":"2024-03-04T07:02:28.263229+0000","last_clean":"2024-03-04T07:02:28.263229+0000","last_became_active":"2024-03-04T06:49:30.126241+0000","last_became_peered":"2024-03-04T06:49:30.126241+0000","last_unstale":"2024-03-04T07:02:28.263229+0000","last_undegraded":"2024-03-04T07:02:28.263229+0000","last_fullsized":"2024-03-04T07:02:28.263229+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:04.386183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"822'1991","reported_seq":5119,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409421+0000","last_change":"2024-03-04T06:55:12.100046+0000","last_active":"2024-03-04T07:00:38.409421+0000","last_peered":"2024-03-04T07:00:38.409421+0000","last_clean":"2024-03-04T07:00:38.409421+0000","last_became_active":"2024-03-04T06:48:54.895515+0000","last_became_peered":"2024-03-04T06:48:54.895515+0000","last_unstale":"2024-03-04T07:00:38.409421+0000","last_undegraded":"2024-03-04T07:00:38.409421+0000","last_fullsized":"2024-03-04T07:00:38.409421+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:00.009087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098855490000000004,"stat_sum":{"num_bytes":89726976,"num_objects":16,"num_object_clones":11,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":347,"num_read_kb":484428,"num_write":833,"num_write_kb":190784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":24576000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1240,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409457+0000","last_change":"2024-03-04T06:48:54.889527+0000","last_active":"2024-03-04T07:00:38.409457+0000","last_peered":"2024-03-04T07:00:38.409457+0000","last_clean":"2024-03-04T07:00:38.409457+0000","last_became_active":"2024-03-04T06:48:54.889218+0000","last_became_peered":"2024-03-04T06:48:54.889218+0000","last_unstale":"2024-03-04T07:00:38.409457+0000","last_undegraded":"2024-03-04T07:00:38.409457+0000","last_fullsized":"2024-03-04T07:00:38.409457+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:51.094553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1061,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569599+0000","last_change":"2024-03-04T06:50:06.483509+0000","last_active":"2024-03-04T07:01:19.569599+0000","last_peered":"2024-03-04T07:01:19.569599+0000","last_clean":"2024-03-04T07:01:19.569599+0000","last_became_active":"2024-03-04T06:50:06.483141+0000","last_became_peered":"2024-03-04T06:50:06.483141+0000","last_unstale":"2024-03-04T07:01:19.569599+0000","last_undegraded":"2024-03-04T07:01:19.569599+0000","last_fullsized":"2024-03-04T07:01:19.569599+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:11.108213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"823'1227","reported_seq":4369,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.420296+0000","last_change":"2024-03-04T06:55:12.100025+0000","last_active":"2024-03-04T07:02:18.420296+0000","last_peered":"2024-03-04T07:02:18.420296+0000","last_clean":"2024-03-04T07:02:18.420296+0000","last_became_active":"2024-03-04T06:48:19.554114+0000","last_became_peered":"2024-03-04T06:48:19.554114+0000","last_unstale":"2024-03-04T07:02:18.420296+0000","last_undegraded":"2024-03-04T07:02:18.420296+0000","last_fullsized":"2024-03-04T07:02:18.420296+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:16.745789+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010171978,"stat_sum":{"num_bytes":33439744,"num_objects":11,"num_object_clones":8,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":186,"num_read_kb":230023,"num_write":474,"num_write_kb":135584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7733248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"d2"},{"start":"177","length":"22"},{"start":"19a","length":"c"},{"start":"1a7","length":"2"},{"start":"1aa","length":"3"},{"start":"1ae","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1269,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:18.186065+0000","last_change":"2024-03-04T06:48:19.556470+0000","last_active":"2024-03-04T07:02:18.186065+0000","last_peered":"2024-03-04T07:02:18.186065+0000","last_clean":"2024-03-04T07:02:18.186065+0000","last_became_active":"2024-03-04T06:48:19.556151+0000","last_became_peered":"2024-03-04T06:48:19.556151+0000","last_unstale":"2024-03-04T07:02:18.186065+0000","last_undegraded":"2024-03-04T07:02:18.186065+0000","last_fullsized":"2024-03-04T07:02:18.186065+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:00:24.137010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1142,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:22.983289+0000","last_change":"2024-03-04T06:49:30.119435+0000","last_active":"2024-03-04T07:02:22.983289+0000","last_peered":"2024-03-04T07:02:22.983289+0000","last_clean":"2024-03-04T07:02:22.983289+0000","last_became_active":"2024-03-04T06:49:30.119071+0000","last_became_peered":"2024-03-04T06:49:30.119071+0000","last_unstale":"2024-03-04T07:02:22.983289+0000","last_undegraded":"2024-03-04T07:02:22.983289+0000","last_fullsized":"2024-03-04T07:02:22.983289+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:41:57.517750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"823'1216","reported_seq":4602,"reported_epoch":823,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-04T07:00:54.566603+0000","last_change":"2024-03-04T06:55:13.104235+0000","last_active":"2024-03-04T07:00:54.566603+0000","last_peered":"2024-03-04T07:00:54.566603+0000","last_clean":"2024-03-04T07:00:54.566603+0000","last_became_active":"2024-03-04T06:50:06.495747+0000","last_became_peered":"2024-03-04T06:50:06.495747+0000","last_unstale":"2024-03-04T07:00:54.566603+0000","last_undegraded":"2024-03-04T07:00:54.566603+0000","last_fullsized":"2024-03-04T07:00:54.566603+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:42:04.858383+0000","last_clean_scrub_stamp":"2024-03-04T06:42:04.858383+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":152,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:38.136931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01492078,"stat_sum":{"num_bytes":88571904,"num_objects":61,"num_object_clones":57,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":556698,"num_write":675,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":30179328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"8a","length":"1"},{"start":"96","length":"1"},{"start":"99","length":"2"},{"start":"9e","length":"3"},{"start":"a2","length":"1"},{"start":"a4","length":"5e"},{"start":"103","length":"8"},{"start":"10c","length":"2"},{"start":"111","length":"3"},{"start":"115","length":"1"},{"start":"11a","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1247,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:38.409492+0000","last_change":"2024-03-04T06:50:06.488079+0000","last_active":"2024-03-04T07:00:38.409492+0000","last_peered":"2024-03-04T07:00:38.409492+0000","last_clean":"2024-03-04T07:00:38.409492+0000","last_became_active":"2024-03-04T06:50:06.486751+0000","last_became_peered":"2024-03-04T06:50:06.486751+0000","last_unstale":"2024-03-04T07:00:38.409492+0000","last_undegraded":"2024-03-04T07:00:38.409492+0000","last_fullsized":"2024-03-04T07:00:38.409492+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:11.515848+0000","last_clean_scrub_stamp":"2024-03-04T06:38:11.515848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:31.838379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1074,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:19.569626+0000","last_change":"2024-03-04T06:50:06.488692+0000","last_active":"2024-03-04T07:01:19.569626+0000","last_peered":"2024-03-04T07:01:19.569626+0000","last_clean":"2024-03-04T07:01:19.569626+0000","last_became_active":"2024-03-04T06:50:06.487383+0000","last_became_peered":"2024-03-04T06:50:06.487383+0000","last_unstale":"2024-03-04T07:01:19.569626+0000","last_undegraded":"2024-03-04T07:01:19.569626+0000","last_fullsized":"2024-03-04T07:01:19.569626+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:25.215192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1098,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:58.259166+0000","last_change":"2024-03-04T06:49:30.129076+0000","last_active":"2024-03-04T07:01:58.259166+0000","last_peered":"2024-03-04T07:01:58.259166+0000","last_clean":"2024-03-04T07:01:58.259166+0000","last_became_active":"2024-03-04T06:49:30.128587+0000","last_became_peered":"2024-03-04T06:49:30.128587+0000","last_unstale":"2024-03-04T07:01:58.259166+0000","last_undegraded":"2024-03-04T07:01:58.259166+0000","last_fullsized":"2024-03-04T07:01:58.259166+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:30.961484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1244,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.416787+0000","last_change":"2024-03-04T06:49:30.118798+0000","last_active":"2024-03-04T07:01:43.416787+0000","last_peered":"2024-03-04T07:01:43.416787+0000","last_clean":"2024-03-04T07:01:43.416787+0000","last_became_active":"2024-03-04T06:49:30.118353+0000","last_became_peered":"2024-03-04T06:49:30.118353+0000","last_unstale":"2024-03-04T07:01:43.416787+0000","last_undegraded":"2024-03-04T07:01:43.416787+0000","last_fullsized":"2024-03-04T07:01:43.416787+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:52.044933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:22.976197+0000","last_change":"2024-03-04T06:48:54.902524+0000","last_active":"2024-03-04T07:01:22.976197+0000","last_peered":"2024-03-04T07:01:22.976197+0000","last_clean":"2024-03-04T07:01:22.976197+0000","last_became_active":"2024-03-04T06:48:54.899878+0000","last_became_peered":"2024-03-04T06:48:54.899878+0000","last_unstale":"2024-03-04T07:01:22.976197+0000","last_undegraded":"2024-03-04T07:01:22.976197+0000","last_fullsized":"2024-03-04T07:01:22.976197+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:08:59.783306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1301,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:38.032758+0000","last_change":"2024-03-04T06:48:19.561272+0000","last_active":"2024-03-04T07:02:38.032758+0000","last_peered":"2024-03-04T07:02:38.032758+0000","last_clean":"2024-03-04T07:02:38.032758+0000","last_became_active":"2024-03-04T06:48:19.560904+0000","last_became_peered":"2024-03-04T06:48:19.560904+0000","last_unstale":"2024-03-04T07:02:38.032758+0000","last_undegraded":"2024-03-04T07:02:38.032758+0000","last_fullsized":"2024-03-04T07:02:38.032758+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:59.565022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1209,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020779+0000","last_change":"2024-03-04T06:48:19.546377+0000","last_active":"2024-03-04T07:00:45.020779+0000","last_peered":"2024-03-04T07:00:45.020779+0000","last_clean":"2024-03-04T07:00:45.020779+0000","last_became_active":"2024-03-04T06:48:19.546048+0000","last_became_peered":"2024-03-04T06:48:19.546048+0000","last_unstale":"2024-03-04T07:00:45.020779+0000","last_undegraded":"2024-03-04T07:00:45.020779+0000","last_fullsized":"2024-03-04T07:00:45.020779+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:23.579425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1266,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.182456+0000","last_change":"2024-03-04T06:47:46.939225+0000","last_active":"2024-03-04T07:01:43.182456+0000","last_peered":"2024-03-04T07:01:43.182456+0000","last_clean":"2024-03-04T07:01:43.182456+0000","last_became_active":"2024-03-04T06:47:46.938913+0000","last_became_peered":"2024-03-04T06:47:46.938913+0000","last_unstale":"2024-03-04T07:01:43.182456+0000","last_undegraded":"2024-03-04T07:01:43.182456+0000","last_fullsized":"2024-03-04T07:01:43.182456+0000","mapping_epoch":401,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":402,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:27.626886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1097,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:28.263267+0000","last_change":"2024-03-04T06:50:06.489190+0000","last_active":"2024-03-04T07:02:28.263267+0000","last_peered":"2024-03-04T07:02:28.263267+0000","last_clean":"2024-03-04T07:02:28.263267+0000","last_became_active":"2024-03-04T06:50:06.488858+0000","last_became_peered":"2024-03-04T06:50:06.488858+0000","last_unstale":"2024-03-04T07:02:28.263267+0000","last_undegraded":"2024-03-04T07:02:28.263267+0000","last_fullsized":"2024-03-04T07:02:28.263267+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:37.505242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1196,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:45.020816+0000","last_change":"2024-03-04T06:48:19.554946+0000","last_active":"2024-03-04T07:00:45.020816+0000","last_peered":"2024-03-04T07:00:45.020816+0000","last_clean":"2024-03-04T07:00:45.020816+0000","last_became_active":"2024-03-04T06:48:19.554619+0000","last_became_peered":"2024-03-04T06:48:19.554619+0000","last_unstale":"2024-03-04T07:00:45.020816+0000","last_undegraded":"2024-03-04T07:00:45.020816+0000","last_fullsized":"2024-03-04T07:00:45.020816+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:40.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1148,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:52.979394+0000","last_change":"2024-03-04T06:48:54.893132+0000","last_active":"2024-03-04T07:01:52.979394+0000","last_peered":"2024-03-04T07:01:52.979394+0000","last_clean":"2024-03-04T07:01:52.979394+0000","last_became_active":"2024-03-04T06:48:54.892840+0000","last_became_peered":"2024-03-04T06:48:54.892840+0000","last_unstale":"2024-03-04T07:01:52.979394+0000","last_undegraded":"2024-03-04T07:01:52.979394+0000","last_fullsized":"2024-03-04T07:01:52.979394+0000","mapping_epoch":465,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":466,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:33:18.069751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1203,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:15.023709+0000","last_change":"2024-03-04T06:48:19.544071+0000","last_active":"2024-03-04T07:01:15.023709+0000","last_peered":"2024-03-04T07:01:15.023709+0000","last_clean":"2024-03-04T07:01:15.023709+0000","last_became_active":"2024-03-04T06:48:19.543587+0000","last_became_peered":"2024-03-04T06:48:19.543587+0000","last_unstale":"2024-03-04T07:01:15.023709+0000","last_undegraded":"2024-03-04T07:01:15.023709+0000","last_fullsized":"2024-03-04T07:01:15.023709+0000","mapping_epoch":430,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":431,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:31:21.626771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1123,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:02:22.983241+0000","last_change":"2024-03-04T06:50:06.477537+0000","last_active":"2024-03-04T07:02:22.983241+0000","last_peered":"2024-03-04T07:02:22.983241+0000","last_clean":"2024-03-04T07:02:22.983241+0000","last_became_active":"2024-03-04T06:50:06.476996+0000","last_became_peered":"2024-03-04T06:50:06.476996+0000","last_unstale":"2024-03-04T07:02:22.983241+0000","last_undegraded":"2024-03-04T07:02:22.983241+0000","last_fullsized":"2024-03-04T07:02:22.983241+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:06.781292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1300,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:01:43.026774+0000","last_change":"2024-03-04T06:50:06.489614+0000","last_active":"2024-03-04T07:01:43.026774+0000","last_peered":"2024-03-04T07:01:43.026774+0000","last_clean":"2024-03-04T07:01:43.026774+0000","last_became_active":"2024-03-04T06:50:06.489088+0000","last_became_peered":"2024-03-04T06:50:06.489088+0000","last_unstale":"2024-03-04T07:01:43.026774+0000","last_undegraded":"2024-03-04T07:01:43.026774+0000","last_fullsized":"2024-03-04T07:01:43.026774+0000","mapping_epoch":535,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":536,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:29.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1103,"reported_epoch":823,"state":"active+clean","last_fresh":"2024-03-04T07:00:43.250705+0000","last_change":"2024-03-04T06:49:30.121359+0000","last_active":"2024-03-04T07:00:43.250705+0000","last_peered":"2024-03-04T07:00:43.250705+0000","last_clean":"2024-03-04T07:00:43.250705+0000","last_became_active":"2024-03-04T06:49:30.120975+0000","last_became_peered":"2024-03-04T06:49:30.120975+0000","last_unstale":"2024-03-04T07:00:43.250705+0000","last_undegraded":"2024-03-04T07:00:43.250705+0000","last_fullsized":"2024-03-04T07:00:43.250705+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T06:38:12.520695+0000","last_clean_scrub_stamp":"2024-03-04T06:38:12.520695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:01:34.364214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1087152128,"num_objects":625,"num_object_clones":575,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":11,"num_read":3756,"num_read_kb":5620072,"num_write":8630,"num_write_kb":1926472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":437805056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1583394816,"data_stored":3662352384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28216,"ondisk_log_size":28216,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42627,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":535,"seq":2297807503541,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":292412,"kb_used_data":124136,"kb_used_omap":30,"kb_used_meta":168225,"kb_avail":93452740,"statfs":{"total":95995035648,"available":95695605760,"internally_reserved":0,"allocated":127115264,"data_stored":263120555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31218,"internal_metadata":172262926},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648188,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1211736,"kb_used_data":162448,"kb_used_omap":34,"kb_used_meta":1049245,"kb_avail":92533416,"statfs":{"total":95995035648,"available":94754217984,"internally_reserved":0,"allocated":166346752,"data_stored":358114199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35471,"internal_metadata":1074427249},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142495,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":579316,"kb_used_data":242984,"kb_used_omap":38,"kb_used_meta":336281,"kb_avail":93165836,"statfs":{"total":95995035648,"available":95401816064,"internally_reserved":0,"allocated":248815616,"data_stored":609387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39341,"internal_metadata":344352339},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":297,"seq":1275605287142,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1690732,"kb_used_data":295320,"kb_used_omap":85,"kb_used_meta":1395306,"kb_avail":92054420,"statfs":{"total":95995035648,"available":94263726080,"internally_reserved":0,"allocated":302407680,"data_stored":707979047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87964,"internal_metadata":1428793444},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":367,"seq":1576252997848,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":609464,"kb_used_data":112812,"kb_used_omap":33,"kb_used_meta":496606,"kb_avail":93135688,"statfs":{"total":95995035648,"available":95370944512,"internally_reserved":0,"allocated":115519488,"data_stored":201531951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34345,"internal_metadata":508525015},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":401,"seq":1722281885904,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":293480,"kb_used_data":138392,"kb_used_omap":25,"kb_used_meta":155046,"kb_avail":93451672,"statfs":{"total":95995035648,"available":95694512128,"internally_reserved":0,"allocated":141713408,"data_stored":335833429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25708,"internal_metadata":158768020},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":430,"seq":1846835937482,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":514368,"kb_used_data":303284,"kb_used_omap":46,"kb_used_meta":211025,"kb_avail":93230784,"statfs":{"total":95995035648,"available":95468322816,"internally_reserved":0,"allocated":310562816,"data_stored":748242163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47886,"internal_metadata":216089842},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":465,"seq":1997159792835,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":830208,"kb_used_data":241520,"kb_used_omap":129,"kb_used_meta":588542,"kb_avail":92914944,"statfs":{"total":95995035648,"available":95144902656,"internally_reserved":0,"allocated":247316480,"data_stored":482896199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132670,"internal_metadata":602667458},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5861,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4397,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5548,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6057,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6404,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4728,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4688,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4944,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":292483072,"data_stored":702017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":239493120,"data_stored":604016640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106205184,"data_stored":196161536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":132374528,"data_stored":330457088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":301232128,"data_stored":742871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":237981696,"data_stored":477519872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":156426240,"data_stored":352149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":117198848,"data_stored":257159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T07:05:06.933 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:05:06.933 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:05:06.933 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:05:06.933 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:05:06.933 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:05:06.933 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.0 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:05:06.933 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-04T07:05:06.933 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-04T07:05:06.933 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.c in trimming, state: active+clean+snaptrim_error 2024-03-04T07:05:06.933 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-04T07:05:06.933 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-04T07:05:07.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:07 smithi137 ceph-mon[88869]: from='client.44714 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:05:07.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:07 smithi137 ceph-mon[91314]: from='client.44714 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:05:07.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:07 smithi203 ceph-mon[85573]: from='client.44714 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T07:05:08.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:08 smithi137 ceph-mon[88869]: pgmap v1218: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:08.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:08 smithi137 ceph-mon[91314]: pgmap v1218: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:08.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:08 smithi203 ceph-mon[85573]: pgmap v1218: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:09.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:09 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:05:09.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:09 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:05:09.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:09 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-04T07:05:10.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:10 smithi137 ceph-mon[88869]: pgmap v1219: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:10.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:10 smithi137 ceph-mon[91314]: pgmap v1219: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:10.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:10 smithi203 ceph-mon[85573]: pgmap v1219: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:12.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:12 smithi137 ceph-mon[91314]: pgmap v1220: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:12.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:12 smithi137 ceph-mon[88869]: pgmap v1220: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:12.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:12 smithi203 ceph-mon[85573]: pgmap v1220: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:14.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:14 smithi137 ceph-mon[88869]: pgmap v1221: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:14.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:14 smithi137 ceph-mon[91314]: pgmap v1221: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:14.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:14 smithi203 ceph-mon[85573]: pgmap v1221: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:15.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:15 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:05:15] "GET /metrics HTTP/1.1" 200 36335 "" "Prometheus/2.43.0" 2024-03-04T07:05:16.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:16 smithi137 ceph-mon[88869]: pgmap v1222: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:16.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:16 smithi137 ceph-mon[91314]: pgmap v1222: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:16.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:16 smithi203 ceph-mon[85573]: pgmap v1222: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:16.935 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_efb04e5e69d058b0c47e511cb7e10d57a92f59ae/qa/tasks/rados.py", line 290, in thread manager.wait_snap_trimming_complete(pool); File "/home/teuthworker/src/git.ceph.com_ceph-c_efb04e5e69d058b0c47e511cb7e10d57a92f59ae/qa/tasks/ceph_manager.py", line 2506, in wait_snap_trimming_complete assert (now - start) < FATAL_TIMEOUT, \ AssertionError: failed to complete snap trimming before timeout 2024-03-04T07:05:16.937 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/full_sequential.py", line 37, in task mgr.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_efb04e5e69d058b0c47e511cb7e10d57a92f59ae/qa/tasks/rados.py", line 299, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_efb04e5e69d058b0c47e511cb7e10d57a92f59ae/qa/tasks/rados.py", line 290, in thread manager.wait_snap_trimming_complete(pool); File "/home/teuthworker/src/git.ceph.com_ceph-c_efb04e5e69d058b0c47e511cb7e10d57a92f59ae/qa/tasks/ceph_manager.py", line 2506, in wait_snap_trimming_complete assert (now - start) < FATAL_TIMEOUT, \ AssertionError: failed to complete snap trimming before timeout 2024-03-04T07:05:17.144 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=dd197d68fe9b46bcb9c47f2f0970565f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/full_sequential.py", line 37, in task mgr.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_efb04e5e69d058b0c47e511cb7e10d57a92f59ae/qa/tasks/rados.py", line 299, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_efb04e5e69d058b0c47e511cb7e10d57a92f59ae/qa/tasks/rados.py", line 290, in thread manager.wait_snap_trimming_complete(pool); File "/home/teuthworker/src/git.ceph.com_ceph-c_efb04e5e69d058b0c47e511cb7e10d57a92f59ae/qa/tasks/ceph_manager.py", line 2506, in wait_snap_trimming_complete assert (now - start) < FATAL_TIMEOUT, \ AssertionError: failed to complete snap trimming before timeout 2024-03-04T07:05:17.147 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-04T07:05:17.160 INFO:tasks.cephadm:Teardown begin 2024-03-04T07:05:17.160 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-04T07:05:17.161 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T07:05:17.499 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:05:17.500 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":54307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/1009869994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":1009869994},{"type":"v1","addr":"172.21.15.203:6833","nonce":1009869994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T06:38:12.879589+0000","modified":"2024-03-04T06:50:32.848148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":559,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6835/2007899716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2007899716},{"type":"v1","addr":"172.21.15.137:6835","nonce":2007899716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-04T07:05:17.500 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 14 2024-03-04T07:05:17.512 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T07:05:17.831 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:05:17.831 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":54307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/1009869994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":1009869994},{"type":"v1","addr":"172.21.15.203:6833","nonce":1009869994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T06:38:12.879589+0000","modified":"2024-03-04T06:50:32.848148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":559,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6835/2007899716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2007899716},{"type":"v1","addr":"172.21.15.137:6835","nonce":2007899716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-04T07:05:17.831 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 14 2024-03-04T07:05:17.843 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T07:05:18.127 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-03-04T07:05:18.128 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":823,"fsid":"d83bc156-d9f0-11ee-95c6-87774f69a715","created":"2024-03-04T06:32:45.411931+0000","modified":"2024-03-04T06:55:13.088643+0000","last_up_change":"2024-03-04T06:50:05.457349+0000","last_in_change":"2024-03-04T06:37:37.527415+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T06:35:55.259476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T06:38:11.049505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T06:38:12.066145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-04T06:38:45.908437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"unique_pool_0","create_time":"2024-03-04T06:42:04.104800+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"823","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":433,"snap_epoch":823,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"teuthologyprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"b1b7579c-6846-4ce6-a717-07c255155577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":286,"up_from":297,"up_thru":535,"down_at":287,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3821842792},{"type":"v1","addr":"172.21.15.137:6803","nonce":3821842792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3821842792},{"type":"v1","addr":"172.21.15.137:6805","nonce":3821842792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3821842792},{"type":"v1","addr":"172.21.15.137:6809","nonce":3821842792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3821842792},{"type":"v1","addr":"172.21.15.137:6807","nonce":3821842792}]},"public_addr":"172.21.15.137:6803/3821842792","cluster_addr":"172.21.15.137:6805/3821842792","heartbeat_back_addr":"172.21.15.137:6809/3821842792","heartbeat_front_addr":"172.21.15.137:6807/3821842792","state":["exists","up"]},{"osd":1,"uuid":"8b6cf83c-0990-4fd2-b69b-e6dc3fda3339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":321,"up_from":332,"up_thru":535,"down_at":322,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3966921225},{"type":"v1","addr":"172.21.15.137:6811","nonce":3966921225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3966921225},{"type":"v1","addr":"172.21.15.137:6813","nonce":3966921225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3966921225},{"type":"v1","addr":"172.21.15.137:6817","nonce":3966921225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3966921225},{"type":"v1","addr":"172.21.15.137:6815","nonce":3966921225}]},"public_addr":"172.21.15.137:6811/3966921225","cluster_addr":"172.21.15.137:6813/3966921225","heartbeat_back_addr":"172.21.15.137:6817/3966921225","heartbeat_front_addr":"172.21.15.137:6815/3966921225","state":["exists","up"]},{"osd":2,"uuid":"3967105b-5aac-4700-8634-52d41c48bf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":18,"last_clean_end":356,"up_from":367,"up_thru":535,"down_at":357,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2721042151},{"type":"v1","addr":"172.21.15.137:6819","nonce":2721042151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2721042151},{"type":"v1","addr":"172.21.15.137:6821","nonce":2721042151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2721042151},{"type":"v1","addr":"172.21.15.137:6825","nonce":2721042151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2721042151},{"type":"v1","addr":"172.21.15.137:6823","nonce":2721042151}]},"public_addr":"172.21.15.137:6819/2721042151","cluster_addr":"172.21.15.137:6821/2721042151","heartbeat_back_addr":"172.21.15.137:6825/2721042151","heartbeat_front_addr":"172.21.15.137:6823/2721042151","state":["exists","up"]},{"osd":3,"uuid":"c3782548-3104-4ff4-8f6c-e162f3219a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":390,"up_from":401,"up_thru":535,"down_at":391,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3153668955},{"type":"v1","addr":"172.21.15.137:6827","nonce":3153668955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3153668955},{"type":"v1","addr":"172.21.15.137:6829","nonce":3153668955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3153668955},{"type":"v1","addr":"172.21.15.137:6833","nonce":3153668955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3153668955},{"type":"v1","addr":"172.21.15.137:6831","nonce":3153668955}]},"public_addr":"172.21.15.137:6827/3153668955","cluster_addr":"172.21.15.137:6829/3153668955","heartbeat_back_addr":"172.21.15.137:6833/3153668955","heartbeat_front_addr":"172.21.15.137:6831/3153668955","state":["exists","up"]},{"osd":4,"uuid":"85c12b50-823e-41f7-9cd3-df96128e06a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":30,"last_clean_end":419,"up_from":430,"up_thru":535,"down_at":420,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3365634036},{"type":"v1","addr":"172.21.15.203:6801","nonce":3365634036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3365634036},{"type":"v1","addr":"172.21.15.203:6803","nonce":3365634036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3365634036},{"type":"v1","addr":"172.21.15.203:6807","nonce":3365634036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3365634036},{"type":"v1","addr":"172.21.15.203:6805","nonce":3365634036}]},"public_addr":"172.21.15.203:6801/3365634036","cluster_addr":"172.21.15.203:6803/3365634036","heartbeat_back_addr":"172.21.15.203:6807/3365634036","heartbeat_front_addr":"172.21.15.203:6805/3365634036","state":["exists","up"]},{"osd":5,"uuid":"28d2b3b3-e24b-4975-8c7f-191f0c984331","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":38,"last_clean_end":454,"up_from":465,"up_thru":535,"down_at":455,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1125048708},{"type":"v1","addr":"172.21.15.203:6809","nonce":1125048708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1125048708},{"type":"v1","addr":"172.21.15.203:6811","nonce":1125048708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1125048708},{"type":"v1","addr":"172.21.15.203:6815","nonce":1125048708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1125048708},{"type":"v1","addr":"172.21.15.203:6813","nonce":1125048708}]},"public_addr":"172.21.15.203:6809/1125048708","cluster_addr":"172.21.15.203:6811/1125048708","heartbeat_back_addr":"172.21.15.203:6815/1125048708","heartbeat_front_addr":"172.21.15.203:6813/1125048708","state":["exists","up"]},{"osd":6,"uuid":"930f40c0-a191-4015-b238-ab6f546be67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":46,"last_clean_end":488,"up_from":500,"up_thru":535,"down_at":489,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2741919279},{"type":"v1","addr":"172.21.15.203:6817","nonce":2741919279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2741919279},{"type":"v1","addr":"172.21.15.203:6819","nonce":2741919279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2741919279},{"type":"v1","addr":"172.21.15.203:6823","nonce":2741919279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2741919279},{"type":"v1","addr":"172.21.15.203:6821","nonce":2741919279}]},"public_addr":"172.21.15.203:6817/2741919279","cluster_addr":"172.21.15.203:6819/2741919279","heartbeat_back_addr":"172.21.15.203:6823/2741919279","heartbeat_front_addr":"172.21.15.203:6821/2741919279","state":["exists","up"]},{"osd":7,"uuid":"0016ca9e-43b4-4734-9646-70f257795c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":54,"last_clean_end":524,"up_from":535,"up_thru":535,"down_at":525,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3615210313},{"type":"v1","addr":"172.21.15.203:6825","nonce":3615210313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3615210313},{"type":"v1","addr":"172.21.15.203:6827","nonce":3615210313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3615210313},{"type":"v1","addr":"172.21.15.203:6831","nonce":3615210313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3615210313},{"type":"v1","addr":"172.21.15.203:6829","nonce":3615210313}]},"public_addr":"172.21.15.203:6825/3615210313","cluster_addr":"172.21.15.203:6827/3615210313","heartbeat_back_addr":"172.21.15.203:6831/3615210313","heartbeat_front_addr":"172.21.15.203:6829/3615210313","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:04.410711+0000","dead_epoch":286},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:28.576403+0000","dead_epoch":321},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:35:52.952126+0000","dead_epoch":356},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:18.103564+0000","dead_epoch":390},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:36:40.510337+0000","dead_epoch":419},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:04.580884+0000","dead_epoch":454},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:29.140620+0000","dead_epoch":488},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T06:37:53.063259+0000","dead_epoch":524}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1","mappings":[{"from":0,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.13","mappings":[{"from":4,"to":3}]},{"pgid":"3.15","mappings":[{"from":4,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.203:6833/3636376444":"2024-03-05T06:50:30.828153+0000","172.21.15.137:0/797688047":"2024-03-05T06:44:38.286834+0000","172.21.15.137:0/3466338157":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/424246608":"2024-03-05T06:43:18.287977+0000","172.21.15.137:6801/2093655337":"2024-03-05T06:44:38.286834+0000","172.21.15.137:0/3288531182":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6800/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6801/3659854653":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/1351645377":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/2868942133":"2024-03-05T06:33:17.849499+0000","172.21.15.137:0/1807684977":"2024-03-05T06:43:18.287977+0000","172.21.15.137:0/736127774":"2024-03-05T06:43:18.287977+0000","172.21.15.137:6801/3917348362":"2024-03-05T06:43:18.287977+0000","172.21.15.203:0/2570160789":"2024-03-05T06:43:53.917439+0000","172.21.15.203:6834/4072386315":"2024-03-05T06:43:53.917439+0000","172.21.15.137:6800/3917348362":"2024-03-05T06:43:18.287977+0000","172.21.15.203:0/2441156393":"2024-03-05T06:43:53.917439+0000","172.21.15.203:6835/4072386315":"2024-03-05T06:43:53.917439+0000","172.21.15.137:6800/2093655337":"2024-03-05T06:44:38.286834+0000","172.21.15.137:6800/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.203:0/2213464466":"2024-03-05T06:43:53.917439+0000","172.21.15.137:6801/1572449293":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/1341717720":"2024-03-05T06:44:38.286834+0000","172.21.15.137:0/2769280127":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/3274678870":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/79102074":"2024-03-05T06:43:18.287977+0000","172.21.15.137:0/1880969692":"2024-03-05T06:44:38.286834+0000","172.21.15.137:0/3483460019":"2024-03-05T06:44:38.286834+0000","172.21.15.203:0/2182695332":"2024-03-05T06:43:53.917439+0000","172.21.15.203:6832/3636376444":"2024-03-05T06:50:30.828153+0000","172.21.15.137:0/2224775209":"2024-03-05T06:33:17.849499+0000","172.21.15.137:6800/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/95681481":"2024-03-05T06:43:18.287977+0000","172.21.15.203:0/2387075949":"2024-03-05T06:43:53.917439+0000","172.21.15.203:0/956633836":"2024-03-05T06:43:53.917439+0000","172.21.15.137:0/3119089659":"2024-03-05T06:38:44.723555+0000","172.21.15.137:0/2384446660":"2024-03-05T06:33:42.932598+0000","172.21.15.137:6801/1555943422":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3975833893":"2024-03-05T06:44:38.286834+0000","172.21.15.137:0/3973931689":"2024-03-05T06:33:42.932598+0000","172.21.15.137:0/3761145235":"2024-03-05T06:44:38.286834+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"teuthologyprofile":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":138,"length":1},{"begin":150,"length":1},{"begin":153,"length":2},{"begin":158,"length":3},{"begin":162,"length":1},{"begin":164,"length":210},{"begin":375,"length":34},{"begin":410,"length":12},{"begin":423,"length":2},{"begin":426,"length":3},{"begin":430,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T07:05:18.140 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-04T07:05:18.470 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-mon[88869]: pgmap v1223: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:18.471 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/1425151723' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T07:05:18.471 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/2352358549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T07:05:18.471 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/3826936267' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T07:05:18.471 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:05:18.472 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-mon[91314]: pgmap v1223: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:18.472 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/1425151723' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T07:05:18.472 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/2352358549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T07:05:18.472 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/3826936267' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T07:05:18.472 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:05:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-04T07:05:18.493 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-04T07:05:18.724 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:18 smithi203 ceph-mon[85573]: pgmap v1223: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:18.724 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:18 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/1425151723' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T07:05:18.725 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:18 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/2352358549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T07:05:18.725 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:18 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/3826936267' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T07:05:18.725 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:18 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T07:05:18.725 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:18.474+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T07:05:18.725 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:18.474+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T07:05:18.725 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:18.474+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T07:05:18.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T07:05:18.470+0000 7f4397ce1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T07:05:18.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T07:05:18.479+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T07:05:18.793 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T07:05:18.479+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T07:05:18.793 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a[116984]: -5028> 2024-03-04T06:50:34.480+0000 7fd0f0d33700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-04T07:05:18.793 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a[116984]: ignoring --setuser ceph since I am not root 2024-03-04T07:05:18.793 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a[116984]: ignoring --setgroup ceph since I am not root 2024-03-04T07:05:18.793 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a[116984]: starting mds.a at 2024-03-04T07:05:18.794 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T07:05:18.477+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T07:05:18.794 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:18 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T07:05:18.482+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T07:05:19.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:05:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:05:18.723+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6],1b1=[1b1,1b0]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T07:05:19.095 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:05:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:05:18.766+0000 7f30e5547700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T07:05:19.095 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:05:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:05:18.767+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T07:05:19.495 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-04T07:05:19.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:05:19.280+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T07:05:19.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/4252451421' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-04T07:05:19.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-04T07:05:19.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T07:05:19.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/4252451421' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-04T07:05:19.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T07:05:19.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T07:05:19.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: osdmap e824: 8 total, 8 up, 8 in 2024-03-04T07:05:19.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T07:05:19.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T07:05:19.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T07:05:19.596 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-03-04T07:05:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T07:05:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T07:05:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T07:05:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/4012963163' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T07:05:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T07:05:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:05:19.597 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:19 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:05:19.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/4252451421' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-04T07:05:19.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-04T07:05:19.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T07:05:19.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/4252451421' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-04T07:05:19.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T07:05:19.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T07:05:19.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: osdmap e824: 8 total, 8 up, 8 in 2024-03-04T07:05:19.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T07:05:19.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T07:05:19.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T07:05:19.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-03-04T07:05:19.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T07:05:19.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T07:05:19.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T07:05:19.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/4012963163' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T07:05:19.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T07:05:19.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:05:19.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:05:19.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/4252451421' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-04T07:05:19.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-04T07:05:19.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T07:05:19.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/4252451421' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-04T07:05:19.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T07:05:19.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T07:05:19.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: osdmap e824: 8 total, 8 up, 8 in 2024-03-04T07:05:19.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T07:05:19.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T07:05:19.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T07:05:19.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-03-04T07:05:19.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T07:05:19.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T07:05:19.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T07:05:19.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/4012963163' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T07:05:19.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T07:05:19.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:05:19.797 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:19 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:05:20.489 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-03-04T07:05:20.510 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-04T07:05:20.647 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:20.492+0000 7f1a48196700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T07:05:20.647 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:20.492+0000 7f1a45991700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T07:05:20.648 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-mon[85573]: pgmap v1225: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:20.648 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1b1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6],1b1=[1b1,1b0]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T07:05:20.648 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T07:05:20.648 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-mon[85573]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-04T07:05:20.648 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-mon[85573]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-04T07:05:20.648 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-mon[85573]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-04T07:05:20.648 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-mon[85573]: mds.? [v2:172.21.15.137:6834/3637831266,v1:172.21.15.137:6835/3637831266] up:boot 2024-03-04T07:05:20.648 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-mon[85573]: fsmap 2 up:standby 2024-03-04T07:05:20.649 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T07:05:20.649 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:05:20.649 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:05:20.649 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-mon[85573]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:05:20.649 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/412034014' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T07:05:20.649 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:05:20.580+0000 7fa0aebef700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 103 after trimming was started 2024-03-04T07:05:20.649 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:05:20.580+0000 7fa0aebef700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6],1b1=[1b1,1b0]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T07:05:20.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T07:05:20.495+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T07:05:20.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[88869]: pgmap v1225: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:20.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1b1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6],1b1=[1b1,1b0]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T07:05:20.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T07:05:20.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[88869]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-04T07:05:20.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[88869]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-04T07:05:20.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[88869]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-04T07:05:20.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[88869]: mds.? [v2:172.21.15.137:6834/3637831266,v1:172.21.15.137:6835/3637831266] up:boot 2024-03-04T07:05:20.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[88869]: fsmap 2 up:standby 2024-03-04T07:05:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T07:05:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:05:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:05:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[88869]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:05:20.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/412034014' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T07:05:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[91314]: pgmap v1225: 121 pgs: 10 active+clean+snaptrim_error, 111 active+clean; 1.0 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail 2024-03-04T07:05:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1b1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6],1b1=[1b1,1b0]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T07:05:20.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T07:05:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[91314]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-04T07:05:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[91314]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-04T07:05:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[91314]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-04T07:05:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[91314]: mds.? [v2:172.21.15.137:6834/3637831266,v1:172.21.15.137:6835/3637831266] up:boot 2024-03-04T07:05:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[91314]: fsmap 2 up:standby 2024-03-04T07:05:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T07:05:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T07:05:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T07:05:20.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[91314]: from='mgr.34104 172.21.15.137:0/3574118453' entity='mgr.y' 2024-03-04T07:05:20.796 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:20 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/412034014' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T07:05:21.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:05:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:05:20.645+0000 7f78980a4700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T07:05:21.496 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T07:05:21.107+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T07:05:21.496 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T07:05:21.107+0000 7f5c50091700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 9a after trimming was started 2024-03-04T07:05:21.496 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T07:05:21.107+0000 7f5c50091700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T07:05:21.496 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T07:05:21.107+0000 7f5c51093700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T07:05:21.497 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:05:21.107+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T07:05:21.497 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:05:21.107+0000 7f30e7d4c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 102 after trimming was started 2024-03-04T07:05:21.497 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:05:21.107+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T07:05:21.504 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-03-04T07:05:21.523 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-04T07:05:21.552 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-04T07:05:21.584 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-04T07:05:21.585 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-04T07:05:21.608 DEBUG:teuthology.orchestra.run.smithi203:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-04T07:05:21.641 INFO:tasks.cephadm:Stopping all daemons... 2024-03-04T07:05:21.641 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-03-04T07:05:21.641 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.a 2024-03-04T07:05:21.792 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T07:05:21.508+0000 7fb3c517c700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:36653b08:::smithi13777483-25:a2 repair needed (no obc) 2024-03-04T07:05:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/412034014' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-04T07:05:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[88869]: osdmap e825: 8 total, 8 up, 8 in 2024-03-04T07:05:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T07:05:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T07:05:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T07:05:21.793 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1b1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6],1b1=[1b1,1b0]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T07:05:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[88869]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T07:05:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[88869]: from='client.? 172.21.15.137:0/2465925951' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T07:05:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[88869]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T07:05:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T07:05:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[88869]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T07:05:21.794 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 systemd[1]: Stopping Ceph mon.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:05:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/412034014' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-04T07:05:21.794 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[91314]: osdmap e825: 8 total, 8 up, 8 in 2024-03-04T07:05:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T07:05:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T07:05:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T07:05:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1b1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6],1b1=[1b1,1b0]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T07:05:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[91314]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T07:05:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[91314]: from='client.? 172.21.15.137:0/2465925951' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T07:05:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[91314]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T07:05:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T07:05:21.795 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-mon[91314]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T07:05:21.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:05:21.501+0000 7f789c0ac700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T07:05:21.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:21.652+0000 7f1a49999700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T07:05:21.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:21.653+0000 7f1a4c19e700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d6 after trimming was started 2024-03-04T07:05:21.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:21.653+0000 7f1a4c19e700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T07:05:21.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/412034014' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-04T07:05:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-mon[85573]: osdmap e825: 8 total, 8 up, 8 in 2024-03-04T07:05:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:84a107c4:::smithi13777483-17:d6 repair needed (no obc) 2024-03-04T07:05:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:753c0a1a:::smithi13777483-40:d7 repair needed (no obc) 2024-03-04T07:05:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T07:05:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1b1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6],1b1=[1b1,1b0]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T07:05:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-mon[85573]: trim_object: Can not trim 5:f827495c:::smithi13777483-23:ef repair needed (no obc) 2024-03-04T07:05:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-mon[85573]: from='client.? 172.21.15.137:0/2465925951' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T07:05:21.846 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-mon[85573]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T07:05:21.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T07:05:21.847 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:21 smithi203 ceph-mon[85573]: No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T07:05:22.292 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T07:05:22.156+0000 7f3ccd6e5700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:0ed1097c:::smithi13777483-11:d4 repair needed (no obc) 2024-03-04T07:05:22.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T07:05:22.155+0000 7f5c5509b700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c64b2138:::smithi13777483-44:8a repair needed (no obc) 2024-03-04T07:05:22.293 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T07:05:22.157+0000 7f5c54099700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a94e4514:::smithi13777483-4:9c repair needed (no obc) 2024-03-04T07:05:22.293 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T07:05:21.949+0000 7f439d4ec700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:05:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a[88865]: 2024-03-04T07:05:21.949+0000 7f439d4ec700 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-03-04T07:05:22.294 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:22 smithi137 podman[139815]: 2024-03-04 07:05:22.144643991 +0000 UTC m=+0.309116607 container died 317873ab051e367e41bbdeef657827c29f57f2879ab3c7180967c8a0a53e5d5e (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T07:05:22.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:07:05:21] ENGINE Bus STOPPING 2024-03-04T07:05:22.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:07:05:21] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T07:05:22.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:07:05:21] ENGINE Bus STOPPED 2024-03-04T07:05:22.294 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:21 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:07:05:21] ENGINE Bus STARTING 2024-03-04T07:05:22.295 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:07:05:22] ENGINE Serving on http://:::9283 2024-03-04T07:05:22.295 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:22 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:07:05:22] ENGINE Bus STARTED 2024-03-04T07:05:22.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:05:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:05:22.160+0000 7fa0aabe7700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10f=[10f,10e,10b],120=[120,11e,11d,119,117,116,114,110],13c=[13a],143=[143,141],14b=[14b,14a,149,148,147,146,145,144],153=[153,152,151,150,14f,14e],1a0=[1a0,19f,19e,19d,19b,199,198,197,195,190],1a1=[1a1],1a3=[1a3,1a2],1af=[1af,1ae,1ad,1ac,1aa,1a9,1a6],1b1=[1b1,1b0]} for object 5:4447ada0:::smithi13777483-39:10a 2024-03-04T07:05:22.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:05:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:05:22.155+0000 7f30e954f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b0=[]:{11f=[11f,11e,11d,119,118,117,116,114,110,10f,10e],120=[120],122=[122,121],125=[124],13c=[13c,13b,13a,139],142=[141],149=[149,148,147,146,145,144],14d=[14d,14c,14b,14a],150=[150,14f,14e],155=[154,153,152,151],15f=[15f,15e,15d,15b,15a,159,158,157,156],179=[179,178,176,175,172,171,16f,16d,16c,167,160],1b0=[1b0,1af,1ad,1a9,1a6]} for object 5:9c196b24:::smithi13777483-31:10d 2024-03-04T07:05:22.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:05:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:05:22.158+0000 7f30e7d4c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1aa=[]:{118=[118,117,116,114,110,10f,10e],137=[136,135,134,133,131,12b,128],157=[157,156,154,153,152,151,14e,14b,148,145,144],174=[174,173,172,171,170,16f,16d,16c,16b,167,165,164,162,160,15e],177=[177,176,175],180=[180,17f,17b,17a,179,178],19c=[19c,19b,19a,199,198,197,196,195,194,190,18e,187,186,182,181],1a9=[1a9,1a7,1a6,1a4,1a2,19f],1aa=[1aa]} for object 5:20995da8:::smithi13777483-41:10d 2024-03-04T07:05:22.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:22 smithi137 podman[139815]: 2024-03-04 07:05:22.63419984 +0000 UTC m=+0.798672433 container cleanup 317873ab051e367e41bbdeef657827c29f57f2879ab3c7180967c8a0a53e5d5e (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-04T07:05:22.792 INFO:journalctl@ceph.mon.a.smithi137.stdout:Mar 04 07:05:22 smithi137 bash[139815]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-a 2024-03-04T07:05:23.055 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.a.service' 2024-03-04T07:05:23.102 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:05:23.103 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-03-04T07:05:23.103 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-03-04T07:05:23.103 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.c 2024-03-04T07:05:23.404 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:23 smithi137 systemd[1]: Stopping Ceph mon.c for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:05:23.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c[91310]: 2024-03-04T07:05:23.403+0000 7f7f44092700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:05:23.792 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c[91310]: 2024-03-04T07:05:23.403+0000 7f7f44092700 -1 mon.c@2(peon) e4 *** Got Signal Terminated *** 2024-03-04T07:05:23.793 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:23 smithi137 podman[139948]: 2024-03-04 07:05:23.650340679 +0000 UTC m=+0.358480907 container died b69d9079fc81da0c9437d9bd6d786a4b64fa88436c947e414d9167691ee5f465 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-03-04T07:05:23.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:07:05:23] ENGINE Bus STOPPING 2024-03-04T07:05:23.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:07:05:23] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-04T07:05:23.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:07:05:23] ENGINE Bus STOPPED 2024-03-04T07:05:23.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:07:05:23] ENGINE Bus STARTING 2024-03-04T07:05:23.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:07:05:23] ENGINE Serving on http://:::9283 2024-03-04T07:05:23.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: [04/Mar/2024:07:05:23] ENGINE Bus STARTED 2024-03-04T07:05:24.289 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:24 smithi137 podman[139948]: 2024-03-04 07:05:24.08904106 +0000 UTC m=+0.797181287 container cleanup b69d9079fc81da0c9437d9bd6d786a4b64fa88436c947e414d9167691ee5f465 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222) 2024-03-04T07:05:24.289 INFO:journalctl@ceph.mon.c.smithi137.stdout:Mar 04 07:05:24 smithi137 bash[139948]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-c 2024-03-04T07:05:24.503 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.c.service' 2024-03-04T07:05:24.540 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:05:24.540 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-03-04T07:05:24.540 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-03-04T07:05:24.540 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.b 2024-03-04T07:05:24.845 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:24 smithi203 systemd[1]: Stopping Ceph mon.b for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:05:25.253 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b[85569]: 2024-03-04T07:05:24.871+0000 7f81b8b11700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:05:25.253 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b[85569]: 2024-03-04T07:05:24.871+0000 7f81b8b11700 -1 mon.b@1(peon) e4 *** Got Signal Terminated *** 2024-03-04T07:05:25.253 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:24 smithi203 podman[127328]: 2024-03-04 07:05:24.953261468 +0000 UTC m=+0.216230453 container died b544783be085c8ba9572c5755f52615c82e6f4ec56ba3245cda0d4f18b1dee69 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T07:05:25.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:25 smithi203 podman[127328]: 2024-03-04 07:05:25.462290003 +0000 UTC m=+0.725258985 container cleanup b544783be085c8ba9572c5755f52615c82e6f4ec56ba3245cda0d4f18b1dee69 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-04T07:05:25.595 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:25 smithi203 bash[127328]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b 2024-03-04T07:05:25.793 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:25 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: ::ffff:172.21.15.203 - - [04/Mar/2024:07:05:25] "GET /metrics HTTP/1.1" 200 31637 "" "Prometheus/2.43.0" 2024-03-04T07:05:25.916 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.b.service' 2024-03-04T07:05:25.940 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:25 smithi203 podman[127342]: 2024-03-04 07:05:25.689006211 +0000 UTC m=+0.739347949 container remove b544783be085c8ba9572c5755f52615c82e6f4ec56ba3245cda0d4f18b1dee69 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-03-04T07:05:25.941 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:25 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.b.service: Deactivated successfully. 2024-03-04T07:05:25.941 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:25 smithi203 systemd[1]: Stopped Ceph mon.b for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T07:05:25.941 INFO:journalctl@ceph.mon.b.smithi203.stdout:Mar 04 07:05:25 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mon.b.service: Consumed 13.550s CPU time. 2024-03-04T07:05:25.970 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:05:25.970 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-03-04T07:05:25.970 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-03-04T07:05:25.970 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.y 2024-03-04T07:05:26.292 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:26 smithi137 systemd[1]: Stopping Ceph mgr.y for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:05:26.601 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T07:05:26.301+0000 7fcac7850700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:05:26.602 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:26 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y[80234]: 2024-03-04T07:05:26.301+0000 7fcac7850700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-03-04T07:05:26.602 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:26 smithi137 podman[140081]: 2024-03-04 07:05:26.33244072 +0000 UTC m=+0.179465378 container died 766428acf3e507ac9991b76d718f040c4228c1c2c56644db7a2b6212dbb0b2c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5) 2024-03-04T07:05:26.977 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:26 smithi137 podman[140081]: 2024-03-04 07:05:26.685026055 +0000 UTC m=+0.532050711 container cleanup 766428acf3e507ac9991b76d718f040c4228c1c2c56644db7a2b6212dbb0b2c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-03-04T07:05:26.977 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Mar 04 07:05:26 smithi137 bash[140081]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-y 2024-03-04T07:05:27.109 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.y.service' 2024-03-04T07:05:27.145 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:05:27.146 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-03-04T07:05:27.146 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-03-04T07:05:27.146 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.x 2024-03-04T07:05:27.480 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 07:05:27 smithi203 systemd[1]: Stopping Ceph mgr.x for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:05:27.845 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 07:05:27 smithi203 podman[127451]: 2024-03-04 07:05:27.481161299 +0000 UTC m=+0.140179036 container died 48c66fe4203a361f45daa52874f1d7c1f89d7c9a1319b8f77643c8df2393aea0 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-04T07:05:28.264 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 07:05:27 smithi203 podman[127451]: 2024-03-04 07:05:27.8666664 +0000 UTC m=+0.525684136 container cleanup 48c66fe4203a361f45daa52874f1d7c1f89d7c9a1319b8f77643c8df2393aea0 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-04T07:05:28.264 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 07:05:27 smithi203 bash[127451]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x 2024-03-04T07:05:28.264 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 07:05:28 smithi203 podman[127465]: 2024-03-04 07:05:28.072668511 +0000 UTC m=+0.591008722 container remove 48c66fe4203a361f45daa52874f1d7c1f89d7c9a1319b8f77643c8df2393aea0 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5) 2024-03-04T07:05:28.264 INFO:journalctl@ceph.mgr.x.smithi203.stdout:Mar 04 07:05:28 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-03-04T07:05:28.279 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mgr.x.service' 2024-03-04T07:05:28.316 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:05:28.316 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-03-04T07:05:28.316 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-04T07:05:28.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.0 2024-03-04T07:05:28.596 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:28 smithi137 systemd[1]: Stopping Ceph osd.0 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:05:29.042 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T07:05:28.596+0000 7f5c71ad9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:05:29.042 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T07:05:28.596+0000 7f5c71ad9700 -1 osd.0 826 *** Got signal Terminated *** 2024-03-04T07:05:29.042 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:28 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0[96991]: 2024-03-04T07:05:28.596+0000 7f5c71ad9700 -1 osd.0 826 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T07:05:34.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:33.552Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:05:34.043 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:33.552Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:05:34.503 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:34 smithi137 podman[140201]: 2024-03-04 07:05:34.186217075 +0000 UTC m=+5.676499883 container died bd2207652b338904451990e9e5c1da5e3c45a70e407e4661600012ba1dbb2057 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-04T07:05:34.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:34 smithi137 podman[140201]: 2024-03-04 07:05:34.505144024 +0000 UTC m=+5.995426834 container cleanup bd2207652b338904451990e9e5c1da5e3c45a70e407e4661600012ba1dbb2057 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True) 2024-03-04T07:05:34.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:34 smithi137 bash[140201]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0 2024-03-04T07:05:34.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:34 smithi137 podman[140218]: 2024-03-04 07:05:34.739787112 +0000 UTC m=+0.550137075 container remove bd2207652b338904451990e9e5c1da5e3c45a70e407e4661600012ba1dbb2057 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True) 2024-03-04T07:05:35.391 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:35 smithi137 podman[140312]: 2024-03-04 07:05:34.96761327 +0000 UTC m=+0.017819795 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T07:05:35.392 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:35 smithi137 podman[140312]: 2024-03-04 07:05:35.090505407 +0000 UTC m=+0.140711926 container create f4377dc2103f4862bfa29d05765ca5b0565a232dd7db05c576bc7dd616cdce10 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-04T07:05:35.392 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:35 smithi137 podman[140312]: 2024-03-04 07:05:35.30957678 +0000 UTC m=+0.359783309 container init f4377dc2103f4862bfa29d05765ca5b0565a232dd7db05c576bc7dd616cdce10 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T07:05:35.392 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:35 smithi137 podman[140312]: 2024-03-04 07:05:35.31284386 +0000 UTC m=+0.363050380 container start f4377dc2103f4862bfa29d05765ca5b0565a232dd7db05c576bc7dd616cdce10 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-03-04T07:05:35.392 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:35 smithi137 podman[140312]: 2024-03-04 07:05:35.392755007 +0000 UTC m=+0.442961543 container attach f4377dc2103f4862bfa29d05765ca5b0565a232dd7db05c576bc7dd616cdce10 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-deactivate, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-03-04T07:05:35.792 INFO:journalctl@ceph.osd.0.smithi137.stdout:Mar 04 07:05:35 smithi137 podman[140312]: 2024-03-04 07:05:35.608863678 +0000 UTC m=+0.659070209 container died f4377dc2103f4862bfa29d05765ca5b0565a232dd7db05c576bc7dd616cdce10 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T07:05:36.289 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.0.service' 2024-03-04T07:05:36.334 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:05:36.334 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-04T07:05:36.335 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-04T07:05:36.335 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.1 2024-03-04T07:05:36.542 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:36 smithi137 systemd[1]: Stopping Ceph osd.1 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:05:37.042 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T07:05:36.674+0000 7fb3de3b3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:05:37.042 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T07:05:36.674+0000 7fb3de3b3700 -1 osd.1 826 *** Got signal Terminated *** 2024-03-04T07:05:37.042 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:36 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1[101963]: 2024-03-04T07:05:36.674+0000 7fb3de3b3700 -1 osd.1 826 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T07:05:40.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:40.174Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:05:40.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:40.175Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:05:42.333 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:42 smithi137 podman[140421]: 2024-03-04 07:05:42.050051068 +0000 UTC m=+5.504622251 container died 47b5cdaad147457289732c305968f39d1b51d829dbcd669f1f3aa68dfcf08228 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T07:05:42.791 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:42 smithi137 podman[140421]: 2024-03-04 07:05:42.508073256 +0000 UTC m=+5.962644480 container cleanup 47b5cdaad147457289732c305968f39d1b51d829dbcd669f1f3aa68dfcf08228 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-04T07:05:42.791 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:42 smithi137 bash[140421]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1 2024-03-04T07:05:43.042 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:42 smithi137 podman[140449]: 2024-03-04 07:05:42.792812646 +0000 UTC m=+0.738210033 container remove 47b5cdaad147457289732c305968f39d1b51d829dbcd669f1f3aa68dfcf08228 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-03-04T07:05:43.362 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:43 smithi137 podman[140540]: 2024-03-04 07:05:43.016655182 +0000 UTC m=+0.018317468 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T07:05:43.362 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:43 smithi137 podman[140540]: 2024-03-04 07:05:43.144229482 +0000 UTC m=+0.145891798 container create 9c93a1f283a83f2c728807b6733796cc8ccc1c196d15a9999a7959d24eae5144 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240222, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T07:05:43.362 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:43 smithi137 podman[140540]: 2024-03-04 07:05:43.362982179 +0000 UTC m=+0.364644463 container init 9c93a1f283a83f2c728807b6733796cc8ccc1c196d15a9999a7959d24eae5144 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T07:05:43.648 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:43.552Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:05:43.648 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:43.553Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:05:43.648 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:43 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:43.553Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:05:43.649 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:43 smithi137 podman[140540]: 2024-03-04 07:05:43.366179458 +0000 UTC m=+0.367841731 container start 9c93a1f283a83f2c728807b6733796cc8ccc1c196d15a9999a7959d24eae5144 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-03-04T07:05:43.649 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:43 smithi137 podman[140540]: 2024-03-04 07:05:43.454645414 +0000 UTC m=+0.456307704 container attach 9c93a1f283a83f2c728807b6733796cc8ccc1c196d15a9999a7959d24eae5144 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-03-04T07:05:43.947 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:43 smithi137 podman[140540]: 2024-03-04 07:05:43.649533596 +0000 UTC m=+0.651195873 container died 9c93a1f283a83f2c728807b6733796cc8ccc1c196d15a9999a7959d24eae5144 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-deactivate, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-04T07:05:44.204 INFO:journalctl@ceph.osd.1.smithi137.stdout:Mar 04 07:05:44 smithi137 podman[140566]: 2024-03-04 07:05:44.191124337 +0000 UTC m=+0.536333116 container remove 9c93a1f283a83f2c728807b6733796cc8ccc1c196d15a9999a7959d24eae5144 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T07:05:44.210 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.1.service' 2024-03-04T07:05:44.251 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:05:44.251 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-04T07:05:44.251 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-04T07:05:44.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.2 2024-03-04T07:05:44.488 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:44 smithi137 systemd[1]: Stopping Ceph osd.2 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:05:44.793 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[106841]: 2024-03-04T07:05:44.593+0000 7f58a24e2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:05:44.793 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[106841]: 2024-03-04T07:05:44.593+0000 7f58a24e2700 -1 osd.2 826 *** Got signal Terminated *** 2024-03-04T07:05:44.793 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2[106841]: 2024-03-04T07:05:44.593+0000 7f58a24e2700 -1 osd.2 826 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T07:05:44.794 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:44.489Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:05:44.794 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:44 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:44.490Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:05:50.509 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:50 smithi137 podman[140644]: 2024-03-04 07:05:50.201838455 +0000 UTC m=+5.733255482 container died 436ae07776d974e50caf25e0ac9280d19c1a0d9c62e2370cf16018f6368b1644 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2, ceph=True, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-03-04T07:05:50.510 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:50 smithi137 podman[140644]: 2024-03-04 07:05:50.510715982 +0000 UTC m=+6.042133010 container cleanup 436ae07776d974e50caf25e0ac9280d19c1a0d9c62e2370cf16018f6368b1644 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T07:05:50.510 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:50.175Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:05:50.510 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:50.175Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:05:50.511 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:50 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:50.176Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:05:50.792 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:50 smithi137 bash[140644]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2 2024-03-04T07:05:50.792 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:50 smithi137 podman[140661]: 2024-03-04 07:05:50.728830209 +0000 UTC m=+0.527824342 container remove 436ae07776d974e50caf25e0ac9280d19c1a0d9c62e2370cf16018f6368b1644 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240222) 2024-03-04T07:05:51.356 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:51 smithi137 podman[140752]: 2024-03-04 07:05:50.947780207 +0000 UTC m=+0.017388722 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T07:05:51.356 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:51 smithi137 podman[140752]: 2024-03-04 07:05:51.054782702 +0000 UTC m=+0.124391248 container create b0678c54ccb6f67e17bfda01b53bb4414795341f5b73f052d2258530ef16589c (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-deactivate, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-04T07:05:51.356 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:51 smithi137 podman[140752]: 2024-03-04 07:05:51.257577759 +0000 UTC m=+0.327186271 container init b0678c54ccb6f67e17bfda01b53bb4414795341f5b73f052d2258530ef16589c (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-04T07:05:51.356 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:51 smithi137 podman[140752]: 2024-03-04 07:05:51.260974405 +0000 UTC m=+0.330582912 container start b0678c54ccb6f67e17bfda01b53bb4414795341f5b73f052d2258530ef16589c (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-04T07:05:51.356 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:51 smithi137 podman[140752]: 2024-03-04 07:05:51.356835876 +0000 UTC m=+0.426444388 container attach b0678c54ccb6f67e17bfda01b53bb4414795341f5b73f052d2258530ef16589c (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T07:05:51.792 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:51 smithi137 podman[140752]: 2024-03-04 07:05:51.550155578 +0000 UTC m=+0.619764079 container died b0678c54ccb6f67e17bfda01b53bb4414795341f5b73f052d2258530ef16589c (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T07:05:52.063 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.2.service' 2024-03-04T07:05:52.089 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:52 smithi137 podman[140778]: 2024-03-04 07:05:52.0435249 +0000 UTC m=+0.486108668 container remove b0678c54ccb6f67e17bfda01b53bb4414795341f5b73f052d2258530ef16589c (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-03-04T07:05:52.089 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:52 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.2.service: Deactivated successfully. 2024-03-04T07:05:52.089 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:52 smithi137 systemd[1]: Stopped Ceph osd.2 for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T07:05:52.089 INFO:journalctl@ceph.osd.2.smithi137.stdout:Mar 04 07:05:52 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.2.service: Consumed 29.190s CPU time. 2024-03-04T07:05:52.105 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:05:52.105 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-04T07:05:52.105 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-04T07:05:52.105 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.3 2024-03-04T07:05:52.429 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:52 smithi137 systemd[1]: Stopping Ceph osd.3 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:05:52.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T07:05:52.429+0000 7f3ce8920700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:05:52.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T07:05:52.429+0000 7f3ce8920700 -1 osd.3 826 *** Got signal Terminated *** 2024-03-04T07:05:52.792 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:52 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T07:05:52.429+0000 7f3ce8920700 -1 osd.3 826 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T07:05:54.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:53.553Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:05:54.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:53.554Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:05:54.043 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:53 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:53.554Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:05:54.792 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:54.489Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:05:54.792 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:54.490Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:05:54.792 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:05:54 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:05:54.491Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:05:55.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:54 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:54.955+0000 7f1a601c6700 -1 osd.4 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:32.653558+0000 front 2024-03-04T07:05:32.653534+0000 (oldest deadline 2024-03-04T07:05:54.953449+0000) 2024-03-04T07:05:55.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:05:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:05:55.118+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:05:56.292 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:55 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T07:05:55.901+0000 7f3ce0f0c700 -1 osd.3 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:29.777851+0000 front 2024-03-04T07:05:29.777755+0000 (oldest deadline 2024-03-04T07:05:55.677921+0000) 2024-03-04T07:05:56.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:05:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:05:56.160+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:05:56.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:55 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:55.968+0000 7f1a601c6700 -1 osd.4 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:32.653558+0000 front 2024-03-04T07:05:32.653534+0000 (oldest deadline 2024-03-04T07:05:54.953449+0000) 2024-03-04T07:05:57.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:56.947+0000 7f1a601c6700 -1 osd.4 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:32.653558+0000 front 2024-03-04T07:05:32.653534+0000 (oldest deadline 2024-03-04T07:05:54.953449+0000) 2024-03-04T07:05:57.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:05:56 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:05:56.729+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:05:57.292 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:56 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3[111674]: 2024-03-04T07:05:56.894+0000 7f3ce0f0c700 -1 osd.3 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:29.777851+0000 front 2024-03-04T07:05:29.777755+0000 (oldest deadline 2024-03-04T07:05:55.677921+0000) 2024-03-04T07:05:57.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:05:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:05:57.111+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:05:57.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:05:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:05:57.120+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:05:58.042 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:57 smithi137 podman[140858]: 2024-03-04 07:05:57.787310579 +0000 UTC m=+5.455059728 container died 9acd06dda8ec3b8edc961d2a1a3fc5b2ff0f9b5eeb4a22481203532bcf49df07 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-03-04T07:05:58.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:57.947+0000 7f1a601c6700 -1 osd.4 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:32.653558+0000 front 2024-03-04T07:05:32.653534+0000 (oldest deadline 2024-03-04T07:05:54.953449+0000) 2024-03-04T07:05:58.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:05:57 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:05:57.762+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:05:58.312 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:58 smithi137 podman[140858]: 2024-03-04 07:05:58.120680799 +0000 UTC m=+5.788429918 container cleanup 9acd06dda8ec3b8edc961d2a1a3fc5b2ff0f9b5eeb4a22481203532bcf49df07 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T07:05:58.312 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:58 smithi137 bash[140858]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3 2024-03-04T07:05:58.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:05:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:05:58.101+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:05:58.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:05:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:05:58.162+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:05:58.721 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:58 smithi137 podman[140876]: 2024-03-04 07:05:58.313508583 +0000 UTC m=+0.522425356 container remove 9acd06dda8ec3b8edc961d2a1a3fc5b2ff0f9b5eeb4a22481203532bcf49df07 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux ) 2024-03-04T07:05:58.982 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:05:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:05:58.731+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:05:58.998 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:58 smithi137 podman[140970]: 2024-03-04 07:05:58.722527732 +0000 UTC m=+0.104532429 container create 1b51f3a1ef3b48085d540bb68a49eecdd7f1bc07800d0db1a88b1fb315e4d3cb (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T07:05:58.998 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:58 smithi137 podman[140970]: 2024-03-04 07:05:58.636581848 +0000 UTC m=+0.018586544 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T07:05:58.998 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:58 smithi137 podman[140970]: 2024-03-04 07:05:58.916874761 +0000 UTC m=+0.298879472 container init 1b51f3a1ef3b48085d540bb68a49eecdd7f1bc07800d0db1a88b1fb315e4d3cb (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-03-04T07:05:58.999 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:58 smithi137 podman[140970]: 2024-03-04 07:05:58.920203398 +0000 UTC m=+0.302208103 container start 1b51f3a1ef3b48085d540bb68a49eecdd7f1bc07800d0db1a88b1fb315e4d3cb (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222) 2024-03-04T07:05:58.999 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:58 smithi137 podman[140970]: 2024-03-04 07:05:58.999720877 +0000 UTC m=+0.381725595 container attach 1b51f3a1ef3b48085d540bb68a49eecdd7f1bc07800d0db1a88b1fb315e4d3cb (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T07:05:59.292 INFO:journalctl@ceph.osd.3.smithi137.stdout:Mar 04 07:05:59 smithi137 podman[140970]: 2024-03-04 07:05:59.21038945 +0000 UTC m=+0.592394147 container died 1b51f3a1ef3b48085d540bb68a49eecdd7f1bc07800d0db1a88b1fb315e4d3cb (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-03-04T07:05:59.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:05:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:05:59.149+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:05:59.345 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:58 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:58.983+0000 7f1a601c6700 -1 osd.4 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:32.653558+0000 front 2024-03-04T07:05:32.653534+0000 (oldest deadline 2024-03-04T07:05:54.953449+0000) 2024-03-04T07:05:59.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:05:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:05:59.147+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:05:59.839 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.3.service' 2024-03-04T07:05:59.882 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:05:59.882 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-04T07:05:59.882 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-04T07:05:59.882 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.4 2024-03-04T07:06:00.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:59 smithi203 systemd[1]: Stopping Ceph osd.4 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:06:00.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:05:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:05:59.943+0000 7f1a601c6700 -1 osd.4 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:32.653558+0000 front 2024-03-04T07:05:32.653534+0000 (oldest deadline 2024-03-04T07:05:54.953449+0000) 2024-03-04T07:06:00.096 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:05:59 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:05:59.731+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:00.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:00.175Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:00.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:00.175Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:00.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:00 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:00.176Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:00.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:00.188+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:00.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:00.186+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:06:00.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:06:00.193+0000 7f1a63bd2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:06:00.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:06:00.193+0000 7f1a63bd2700 -1 osd.4 826 *** Got signal Terminated *** 2024-03-04T07:06:00.596 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:06:00.193+0000 7f1a63bd2700 -1 osd.4 826 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T07:06:01.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:06:00.897+0000 7f1a601c6700 -1 osd.4 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:32.653558+0000 front 2024-03-04T07:05:32.653534+0000 (oldest deadline 2024-03-04T07:05:54.953449+0000) 2024-03-04T07:06:01.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:00 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:00.708+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:01.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:01.193+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:06:01.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:01.193+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:02.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:01.697+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:02.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:01 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:06:01.924+0000 7f1a601c6700 -1 osd.4 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:32.653558+0000 front 2024-03-04T07:05:32.653534+0000 (oldest deadline 2024-03-04T07:05:54.953449+0000) 2024-03-04T07:06:02.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:02.191+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:06:02.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:02.232+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:02.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:02.232+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:03.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:06:02.947+0000 7f1a601c6700 -1 osd.4 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:32.653558+0000 front 2024-03-04T07:05:32.653534+0000 (oldest deadline 2024-03-04T07:05:54.953449+0000) 2024-03-04T07:06:03.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:02 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:02.701+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:03.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:03.237+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:06:03.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:03.216+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:03.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:03.216+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:04.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:03.553Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:04.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:03.554Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:04.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:03 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:03.554Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:04.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:03.702+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:04.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:06:03.922+0000 7f1a601c6700 -1 osd.4 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:32.653558+0000 front 2024-03-04T07:05:32.653534+0000 (oldest deadline 2024-03-04T07:05:54.953449+0000) 2024-03-04T07:06:04.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:03 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:06:03.922+0000 7f1a601c6700 -1 osd.4 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:37.854548+0000 front 2024-03-04T07:05:37.854613+0000 (oldest deadline 2024-03-04T07:06:03.754452+0000) 2024-03-04T07:06:04.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:04.210+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:06:04.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:04.182+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:04.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:04.182+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:04.792 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:04.490Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:04.792 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:04.491Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:04.792 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:04 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:04.492Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:05.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:06:04.883+0000 7f1a601c6700 -1 osd.4 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:32.653558+0000 front 2024-03-04T07:05:32.653534+0000 (oldest deadline 2024-03-04T07:05:54.953449+0000) 2024-03-04T07:06:05.095 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4[91072]: 2024-03-04T07:06:04.883+0000 7f1a601c6700 -1 osd.4 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:37.854548+0000 front 2024-03-04T07:05:37.854613+0000 (oldest deadline 2024-03-04T07:06:03.754452+0000) 2024-03-04T07:06:05.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:04 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:04.662+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:05.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:05.254+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:06:05.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:05.203+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:05.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:05.203+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:05.975 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:05 smithi203 podman[127588]: 2024-03-04 07:06:05.596475147 +0000 UTC m=+5.516938555 container died 9a246a0996bd6c412ed81e8e4c89c57a7c967a229f70df1505dd010ec2463f29 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4, CEPH_POINT_RELEASE=, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5) 2024-03-04T07:06:05.975 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:05.667+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:05.976 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:05 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:05.667+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:06.227 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:05 smithi203 podman[127588]: 2024-03-04 07:06:05.976723261 +0000 UTC m=+5.897186673 container cleanup 9a246a0996bd6c412ed81e8e4c89c57a7c967a229f70df1505dd010ec2463f29 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4, ceph=True, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T07:06:06.227 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:05 smithi203 bash[127588]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4 2024-03-04T07:06:06.227 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:06.199+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:06.227 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:06.199+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:06.586 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:06 smithi203 podman[127605]: 2024-03-04 07:06:06.227766051 +0000 UTC m=+0.634183940 container remove 9a246a0996bd6c412ed81e8e4c89c57a7c967a229f70df1505dd010ec2463f29 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-03-04T07:06:06.586 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:06.267+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:06:06.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:06.706+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:06.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:06 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:06.706+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:06.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:06 smithi203 podman[127700]: 2024-03-04 07:06:06.490010551 +0000 UTC m=+0.018290204 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T07:06:06.845 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:06 smithi203 podman[127700]: 2024-03-04 07:06:06.62879837 +0000 UTC m=+0.157078023 container create fe5e260b0eeefe462222838412c24a8cc7912caa0b15c3bd4afcf3edc4de66af (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T07:06:07.171 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:06 smithi203 podman[127700]: 2024-03-04 07:06:06.877312246 +0000 UTC m=+0.405591912 container init fe5e260b0eeefe462222838412c24a8cc7912caa0b15c3bd4afcf3edc4de66af (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T07:06:07.171 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:06 smithi203 podman[127700]: 2024-03-04 07:06:06.880615255 +0000 UTC m=+0.408894921 container start fe5e260b0eeefe462222838412c24a8cc7912caa0b15c3bd4afcf3edc4de66af (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-04T07:06:07.171 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:06 smithi203 podman[127700]: 2024-03-04 07:06:06.956556053 +0000 UTC m=+0.484835716 container attach fe5e260b0eeefe462222838412c24a8cc7912caa0b15c3bd4afcf3edc4de66af (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T07:06:07.438 INFO:journalctl@ceph.osd.4.smithi203.stdout:Mar 04 07:06:07 smithi203 podman[127700]: 2024-03-04 07:06:07.172033075 +0000 UTC m=+0.700312733 container died fe5e260b0eeefe462222838412c24a8cc7912caa0b15c3bd4afcf3edc4de66af (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-03-04T07:06:07.439 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:07.190+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:07.439 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:07.190+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:07.439 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:07.293+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:06:07.767 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:07.681+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:07.767 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:07 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:07.681+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:07.794 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.4.service' 2024-03-04T07:06:07.835 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:06:07.836 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-04T07:06:07.836 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-04T07:06:07.836 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.5 2024-03-04T07:06:08.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:07 smithi203 systemd[1]: Stopping Ceph osd.5 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:06:08.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:08.217+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:08.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:08.217+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:08.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:08.196+0000 7f78b6ae6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:06:08.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:08.196+0000 7f78b6ae6700 -1 osd.5 826 *** Got signal Terminated *** 2024-03-04T07:06:08.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:08.196+0000 7f78b6ae6700 -1 osd.5 826 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T07:06:08.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:08.274+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:06:08.596 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:08.274+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.646793+0000 front 2024-03-04T07:05:41.646737+0000 (oldest deadline 2024-03-04T07:06:07.546623+0000) 2024-03-04T07:06:09.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:08.636+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:09.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:08 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:08.636+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:09.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:09.189+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:09.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:09.189+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:09.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:09.281+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:06:09.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:09.281+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.646793+0000 front 2024-03-04T07:05:41.646737+0000 (oldest deadline 2024-03-04T07:06:07.546623+0000) 2024-03-04T07:06:10.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:09.601+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:10.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:09 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:09.601+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:10.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:10.175Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:10.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:10.176Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:10.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:10 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:10.176Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:10.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:10.296+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:06:10.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:10.296+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.646793+0000 front 2024-03-04T07:05:41.646737+0000 (oldest deadline 2024-03-04T07:06:07.546623+0000) 2024-03-04T07:06:10.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:10.209+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:10.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:10.209+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:11.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:10.616+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:11.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:10 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:10.616+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:11.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:11.297+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:06:11.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:11.297+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.646793+0000 front 2024-03-04T07:05:41.646737+0000 (oldest deadline 2024-03-04T07:06:07.546623+0000) 2024-03-04T07:06:11.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:11.177+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:11.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:11.177+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:12.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:11.628+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:12.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:11 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:11.628+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:12.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:12.291+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:33.544967+0000 front 2024-03-04T07:05:33.545041+0000 (oldest deadline 2024-03-04T07:05:56.444887+0000) 2024-03-04T07:06:12.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5[95761]: 2024-03-04T07:06:12.291+0000 7f78b30da700 -1 osd.5 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.646793+0000 front 2024-03-04T07:05:41.646737+0000 (oldest deadline 2024-03-04T07:06:07.546623+0000) 2024-03-04T07:06:12.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:12.147+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:12.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:12.147+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:12.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:12.147+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:13.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:12.604+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:13.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:12 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:12.604+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:13.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:13.138+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:13.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:13.138+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:13.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:13.138+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:14.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:13.555Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:14.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:13.555Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:14.043 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:13 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:13.555Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:14.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:13 smithi203 podman[127816]: 2024-03-04 07:06:13.813759177 +0000 UTC m=+5.743515429 container died 9e05ca76b1642c020d53db50e67d3d2d97565be866388a17e783b7db018cb1b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5, org.label-schema.schema-version=1.0, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True) 2024-03-04T07:06:14.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:13.614+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:14.095 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:13 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:13.614+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:14.366 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:14 smithi203 podman[127816]: 2024-03-04 07:06:14.35484453 +0000 UTC m=+6.284600779 container cleanup 9e05ca76b1642c020d53db50e67d3d2d97565be866388a17e783b7db018cb1b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T07:06:14.366 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:14 smithi203 bash[127816]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5 2024-03-04T07:06:14.367 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:14.118+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:14.367 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:14.118+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:14.367 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:14.118+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:14.367 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:14.112Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.137:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.137:8765: connect: connection refused" 2024-03-04T07:06:14.367 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:14.114Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.137:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.137:8765: connect: connection refused" 2024-03-04T07:06:14.368 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:14.114Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.137:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.137:8765: connect: connection refused" 2024-03-04T07:06:14.368 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:14.115Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.137:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.137:8765: connect: connection refused" 2024-03-04T07:06:14.368 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:14.115Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.137:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.137:8765: connect: connection refused" 2024-03-04T07:06:14.792 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:14.491Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:14.792 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:14.491Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:14.792 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:14 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:14.492Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:15.009 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:14 smithi203 podman[127834]: 2024-03-04 07:06:14.656291286 +0000 UTC m=+0.847007995 container remove 9e05ca76b1642c020d53db50e67d3d2d97565be866388a17e783b7db018cb1b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T07:06:15.009 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:14.648+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:15.009 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:14.648+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:15.010 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:14 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:14.648+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:48.483837+0000 front 2024-03-04T07:05:48.483765+0000 (oldest deadline 2024-03-04T07:06:13.783697+0000) 2024-03-04T07:06:15.308 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:15.111+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:15.308 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:15.111+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:15.308 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:15.111+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:15.309 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:15 smithi203 podman[127930]: 2024-03-04 07:06:14.912731985 +0000 UTC m=+0.017521209 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T07:06:15.309 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:15 smithi203 podman[127930]: 2024-03-04 07:06:15.023929427 +0000 UTC m=+0.128718682 container create c6cc455c5a20ec5c76a6a153af0529b9b51b5a5c7fd5b3d9f5a9048858b51a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-03-04T07:06:15.309 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:15 smithi203 podman[127930]: 2024-03-04 07:06:15.234751479 +0000 UTC m=+0.339540713 container init c6cc455c5a20ec5c76a6a153af0529b9b51b5a5c7fd5b3d9f5a9048858b51a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240222, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-03-04T07:06:15.309 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:15 smithi203 podman[127930]: 2024-03-04 07:06:15.237905906 +0000 UTC m=+0.342695122 container start c6cc455c5a20ec5c76a6a153af0529b9b51b5a5c7fd5b3d9f5a9048858b51a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T07:06:15.309 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:15 smithi203 podman[127930]: 2024-03-04 07:06:15.309586287 +0000 UTC m=+0.414375506 container attach c6cc455c5a20ec5c76a6a153af0529b9b51b5a5c7fd5b3d9f5a9048858b51a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T07:06:15.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:Mar 04 07:06:15 smithi203 podman[127930]: 2024-03-04 07:06:15.522940114 +0000 UTC m=+0.627729334 container died c6cc455c5a20ec5c76a6a153af0529b9b51b5a5c7fd5b3d9f5a9048858b51a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T07:06:16.053 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:15.610+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:16.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:15.610+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:16.054 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:15 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:15.610+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:48.483837+0000 front 2024-03-04T07:05:48.483765+0000 (oldest deadline 2024-03-04T07:06:13.783697+0000) 2024-03-04T07:06:16.072 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.5.service' 2024-03-04T07:06:16.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:06:16.113 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-04T07:06:16.114 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-03-04T07:06:16.114 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.6 2024-03-04T07:06:16.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:16 smithi203 systemd[1]: Stopping Ceph osd.6 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:06:16.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:16.125+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:16.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:16.125+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:16.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:16.125+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:16.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:16.441+0000 7fa0cae2c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:06:16.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:16.441+0000 7fa0cae2c700 -1 osd.6 826 *** Got signal Terminated *** 2024-03-04T07:06:16.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:16.441+0000 7fa0cae2c700 -1 osd.6 826 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T07:06:16.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:16.661+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:16.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:16.661+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:16.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:16 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:16.661+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:48.483837+0000 front 2024-03-04T07:05:48.483765+0000 (oldest deadline 2024-03-04T07:06:13.783697+0000) 2024-03-04T07:06:17.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:17.087+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:17.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:17.087+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:17.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:17.087+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:18.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:17.698+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:18.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:17.698+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:18.078 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:17 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:17.698+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:48.483837+0000 front 2024-03-04T07:05:48.483765+0000 (oldest deadline 2024-03-04T07:06:13.783697+0000) 2024-03-04T07:06:18.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:18.078+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:18.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:18.078+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:18.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:18.078+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:18.845 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:18.683+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:18.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:18.683+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:18.846 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:18 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:18.683+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:48.483837+0000 front 2024-03-04T07:05:48.483765+0000 (oldest deadline 2024-03-04T07:06:13.783697+0000) 2024-03-04T07:06:19.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:19.040+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:19.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:19.040+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:19.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:19.040+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:20.079 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:19.654+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:20.080 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:19.654+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:20.080 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:19 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:19.654+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:48.483837+0000 front 2024-03-04T07:05:48.483765+0000 (oldest deadline 2024-03-04T07:06:13.783697+0000) 2024-03-04T07:06:20.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:20.079+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:20.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:20.079+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:20.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:20.080+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:20.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:20.080+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6830 osd.3 since back 2024-03-04T07:05:55.460958+0000 front 2024-03-04T07:05:55.461063+0000 (oldest deadline 2024-03-04T07:06:19.461216+0000) 2024-03-04T07:06:20.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:20.176Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:20.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:20.177Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:20.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:20 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:20.177Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:21.083 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:20.694+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.981158+0000 front 2024-03-04T07:05:30.981124+0000 (oldest deadline 2024-03-04T07:05:56.281244+0000) 2024-03-04T07:06:21.083 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:20.694+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:40.882971+0000 front 2024-03-04T07:05:40.882986+0000 (oldest deadline 2024-03-04T07:06:05.582874+0000) 2024-03-04T07:06:21.083 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:20.694+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:48.483837+0000 front 2024-03-04T07:05:48.483765+0000 (oldest deadline 2024-03-04T07:06:13.783697+0000) 2024-03-04T07:06:21.084 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:20 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6[100291]: 2024-03-04T07:06:20.694+0000 7fa0c3418700 -1 osd.6 826 heartbeat_check: no reply from 172.21.15.137:6830 osd.3 since back 2024-03-04T07:05:57.185543+0000 front 2024-03-04T07:05:57.185568+0000 (oldest deadline 2024-03-04T07:06:20.085415+0000) 2024-03-04T07:06:21.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:21.082+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:21.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:21.082+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:21.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:21.082+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:21.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:21 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:21.082+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6830 osd.3 since back 2024-03-04T07:05:55.460958+0000 front 2024-03-04T07:05:55.461063+0000 (oldest deadline 2024-03-04T07:06:19.461216+0000) 2024-03-04T07:06:22.289 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:21 smithi203 podman[128036]: 2024-03-04 07:06:21.979814876 +0000 UTC m=+5.644453641 container died ddb88aa8bce61286e4ccbd382e3e81543589529f5896abeea6663a9d7d0f5914 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T07:06:22.290 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:22.039+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:22.290 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:22.039+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:22.290 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:22.039+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:22.290 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:22 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:22.039+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6830 osd.3 since back 2024-03-04T07:05:55.460958+0000 front 2024-03-04T07:05:55.461063+0000 (oldest deadline 2024-03-04T07:06:19.461216+0000) 2024-03-04T07:06:22.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:22 smithi203 podman[128036]: 2024-03-04 07:06:22.290776416 +0000 UTC m=+5.955415193 container cleanup ddb88aa8bce61286e4ccbd382e3e81543589529f5896abeea6663a9d7d0f5914 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2) 2024-03-04T07:06:22.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:22 smithi203 bash[128036]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6 2024-03-04T07:06:22.595 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:22 smithi203 podman[128054]: 2024-03-04 07:06:22.49196183 +0000 UTC m=+0.508785976 container remove ddb88aa8bce61286e4ccbd382e3e81543589529f5896abeea6663a9d7d0f5914 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T07:06:23.081 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:22 smithi203 podman[128144]: 2024-03-04 07:06:22.724909213 +0000 UTC m=+0.017731346 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T07:06:23.082 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:22 smithi203 podman[128144]: 2024-03-04 07:06:22.834598847 +0000 UTC m=+0.127421017 container create ac4ac697f2a921301dc4c190e3da0c0b1ff0ef77bca329a99c2ada311b07cba4 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-03-04T07:06:23.082 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:23 smithi203 podman[128144]: 2024-03-04 07:06:23.064136595 +0000 UTC m=+0.356958748 container init ac4ac697f2a921301dc4c190e3da0c0b1ff0ef77bca329a99c2ada311b07cba4 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_CLEAN=True, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T07:06:23.083 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:23 smithi203 podman[128144]: 2024-03-04 07:06:23.067564251 +0000 UTC m=+0.360386378 container start ac4ac697f2a921301dc4c190e3da0c0b1ff0ef77bca329a99c2ada311b07cba4 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T07:06:23.345 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:23 smithi203 podman[128144]: 2024-03-04 07:06:23.18721523 +0000 UTC m=+0.480037370 container attach ac4ac697f2a921301dc4c190e3da0c0b1ff0ef77bca329a99c2ada311b07cba4 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-deactivate, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T07:06:23.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:23.081+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:23.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:23.081+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:23.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:23.081+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:23.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:23 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:23.081+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6830 osd.3 since back 2024-03-04T07:05:55.460958+0000 front 2024-03-04T07:05:55.461063+0000 (oldest deadline 2024-03-04T07:06:19.461216+0000) 2024-03-04T07:06:23.623 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:23 smithi203 podman[128144]: 2024-03-04 07:06:23.358469389 +0000 UTC m=+0.651291514 container died ac4ac697f2a921301dc4c190e3da0c0b1ff0ef77bca329a99c2ada311b07cba4 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-deactivate, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-04T07:06:23.875 INFO:journalctl@ceph.osd.6.smithi203.stdout:Mar 04 07:06:23 smithi203 podman[128170]: 2024-03-04 07:06:23.85701823 +0000 UTC m=+0.493560053 container remove ac4ac697f2a921301dc4c190e3da0c0b1ff0ef77bca329a99c2ada311b07cba4 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T07:06:23.881 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.6.service' 2024-03-04T07:06:23.922 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:06:23.922 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-03-04T07:06:23.922 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-03-04T07:06:23.923 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.7 2024-03-04T07:06:24.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:23.555Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:24.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:23.556Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:24.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:23 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:23.556Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:24.250 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:24 smithi203 systemd[1]: Stopping Ceph osd.7 for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:06:24.250 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:24.053+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:24.251 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:24.053+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:24.251 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:24.053+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:24.251 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:24.053+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6830 osd.3 since back 2024-03-04T07:05:55.460958+0000 front 2024-03-04T07:05:55.461063+0000 (oldest deadline 2024-03-04T07:06:19.461216+0000) 2024-03-04T07:06:24.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:24.250+0000 7f3100f83700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:06:24.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:24.250+0000 7f3100f83700 -1 osd.7 826 *** Got signal Terminated *** 2024-03-04T07:06:24.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:24 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:24.250+0000 7f3100f83700 -1 osd.7 826 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T07:06:24.792 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:24.492Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:24.792 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:24.492Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:24.792 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:24 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:24.492Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:25.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:25.080+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:25.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:25.080+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:25.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:25.080+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:25.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:25 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:25.080+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6830 osd.3 since back 2024-03-04T07:05:55.460958+0000 front 2024-03-04T07:05:55.461063+0000 (oldest deadline 2024-03-04T07:06:19.461216+0000) 2024-03-04T07:06:26.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:26.068+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:26.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:26.068+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:26.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:26.068+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:26.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:26 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:26.068+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6830 osd.3 since back 2024-03-04T07:05:55.460958+0000 front 2024-03-04T07:05:55.461063+0000 (oldest deadline 2024-03-04T07:06:19.461216+0000) 2024-03-04T07:06:27.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:27.047+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:27.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:27.047+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:27.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:27.047+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:27.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:27.047+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6830 osd.3 since back 2024-03-04T07:05:55.460958+0000 front 2024-03-04T07:05:55.461063+0000 (oldest deadline 2024-03-04T07:06:19.461216+0000) 2024-03-04T07:06:27.346 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:27 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:27.047+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.203:6804 osd.4 since back 2024-03-04T07:06:04.762021+0000 front 2024-03-04T07:06:04.762091+0000 (oldest deadline 2024-03-04T07:06:26.962347+0000) 2024-03-04T07:06:28.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:28.050+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:28.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:28.050+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:28.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:28.050+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:28.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:28.050+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6830 osd.3 since back 2024-03-04T07:05:55.460958+0000 front 2024-03-04T07:05:55.461063+0000 (oldest deadline 2024-03-04T07:06:19.461216+0000) 2024-03-04T07:06:28.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:28 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:28.050+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.203:6804 osd.4 since back 2024-03-04T07:06:04.762021+0000 front 2024-03-04T07:06:04.762091+0000 (oldest deadline 2024-03-04T07:06:26.962347+0000) 2024-03-04T07:06:29.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:29.098+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-03-04T07:05:30.755793+0000 front 2024-03-04T07:05:30.755862+0000 (oldest deadline 2024-03-04T07:05:54.255696+0000) 2024-03-04T07:06:29.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:29.098+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6814 osd.1 since back 2024-03-04T07:05:41.558860+0000 front 2024-03-04T07:05:41.558775+0000 (oldest deadline 2024-03-04T07:06:02.058668+0000) 2024-03-04T07:06:29.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:29.098+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6822 osd.2 since back 2024-03-04T07:05:46.159582+0000 front 2024-03-04T07:05:46.159612+0000 (oldest deadline 2024-03-04T07:06:11.459446+0000) 2024-03-04T07:06:29.595 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:29.098+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.137:6830 osd.3 since back 2024-03-04T07:05:55.460958+0000 front 2024-03-04T07:05:55.461063+0000 (oldest deadline 2024-03-04T07:06:19.461216+0000) 2024-03-04T07:06:29.596 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:29 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7[104816]: 2024-03-04T07:06:29.098+0000 7f30fd577700 -1 osd.7 826 heartbeat_check: no reply from 172.21.15.203:6804 osd.4 since back 2024-03-04T07:06:04.762021+0000 front 2024-03-04T07:06:04.762091+0000 (oldest deadline 2024-03-04T07:06:26.962347+0000) 2024-03-04T07:06:30.009 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:29 smithi203 podman[128250]: 2024-03-04 07:06:29.726791393 +0000 UTC m=+5.582279581 container died b9857bcd7602c89f0e007348daa7c21a5e0ab21374e8d28954ce3b080958b861 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-04T07:06:30.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:30 smithi203 podman[128250]: 2024-03-04 07:06:30.100696336 +0000 UTC m=+5.956184551 container cleanup b9857bcd7602c89f0e007348daa7c21a5e0ab21374e8d28954ce3b080958b861 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T07:06:30.347 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:30 smithi203 bash[128250]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7 2024-03-04T07:06:30.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:30.177Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:30.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:30.177Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:30.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:30 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:30.178Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:30.669 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:30 smithi203 podman[128268]: 2024-03-04 07:06:30.368524514 +0000 UTC m=+0.636949248 container remove b9857bcd7602c89f0e007348daa7c21a5e0ab21374e8d28954ce3b080958b861 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T07:06:30.979 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:30 smithi203 podman[128355]: 2024-03-04 07:06:30.573023243 +0000 UTC m=+0.018638138 image pull 0c401cd3e778d46c28209e97490abc41ad21a7c01ac860654d53f4b5b682dbe4 quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f 2024-03-04T07:06:30.979 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:30 smithi203 podman[128355]: 2024-03-04 07:06:30.677720536 +0000 UTC m=+0.123335420 container create 54471f19a9030a03182bd368c4bc815e9c7a07d9ef78e5b1b434d2f8d6aa0c12 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-deactivate, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-04T07:06:30.979 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:30 smithi203 podman[128355]: 2024-03-04 07:06:30.898599485 +0000 UTC m=+0.344214365 container init 54471f19a9030a03182bd368c4bc815e9c7a07d9ef78e5b1b434d2f8d6aa0c12 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T07:06:30.979 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:30 smithi203 podman[128355]: 2024-03-04 07:06:30.902128808 +0000 UTC m=+0.347743688 container start 54471f19a9030a03182bd368c4bc815e9c7a07d9ef78e5b1b434d2f8d6aa0c12 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5) 2024-03-04T07:06:30.980 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:30 smithi203 podman[128355]: 2024-03-04 07:06:30.98009079 +0000 UTC m=+0.425705705 container attach 54471f19a9030a03182bd368c4bc815e9c7a07d9ef78e5b1b434d2f8d6aa0c12 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T07:06:31.345 INFO:journalctl@ceph.osd.7.smithi203.stdout:Mar 04 07:06:31 smithi203 podman[128355]: 2024-03-04 07:06:31.18916337 +0000 UTC m=+0.634778249 container died 54471f19a9030a03182bd368c4bc815e9c7a07d9ef78e5b1b434d2f8d6aa0c12 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-osd-7-deactivate, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T07:06:31.758 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@osd.7.service' 2024-03-04T07:06:31.799 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:06:31.799 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-03-04T07:06:31.799 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-03-04T07:06:31.799 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mds.a 2024-03-04T07:06:32.094 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 07:06:31 smithi137 systemd[1]: Stopping Ceph mds.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:06:32.542 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 07:06:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a[116984]: 2024-03-04T07:06:32.094+0000 7fac8bd18700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:06:32.542 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 07:06:32 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a[116984]: 2024-03-04T07:06:32.094+0000 7fac8bd18700 -1 mds.a *** got signal Terminated *** 2024-03-04T07:06:34.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:33.556Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:34.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:33.556Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:34.042 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:33 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:33.557Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:34.752 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 07:06:34 smithi137 podman[141089]: 2024-03-04 07:06:34.532612922 +0000 UTC m=+2.532022185 container died b6a5f935218297817d5ef54a45bec200c814cf437c7a9cf938d9aa75d811ef2b (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5) 2024-03-04T07:06:34.752 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:34.492Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:34.752 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:34.493Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:34.753 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:34 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:34.493Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:35.042 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 07:06:34 smithi137 podman[141089]: 2024-03-04 07:06:34.893893203 +0000 UTC m=+2.893302471 container cleanup b6a5f935218297817d5ef54a45bec200c814cf437c7a9cf938d9aa75d811ef2b (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-03-04T07:06:35.042 INFO:journalctl@ceph.mds.a.smithi137.stdout:Mar 04 07:06:34 smithi137 bash[141089]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-a 2024-03-04T07:06:35.229 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mds.a.service' 2024-03-04T07:06:35.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:06:35.267 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-03-04T07:06:35.267 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-03-04T07:06:35.267 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mds.b 2024-03-04T07:06:35.568 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 07:06:35 smithi203 systemd[1]: Stopping Ceph mds.b for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:06:35.845 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 07:06:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b[109437]: 2024-03-04T07:06:35.568+0000 7ffb1d83c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T07:06:35.845 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 07:06:35 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b[109437]: 2024-03-04T07:06:35.568+0000 7ffb1d83c700 -1 mds.b *** got signal Terminated *** 2024-03-04T07:06:37.077 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 07:06:36 smithi203 podman[128460]: 2024-03-04 07:06:36.800579045 +0000 UTC m=+1.342026829 container died 6797a1307e300ff39588d6394d3022111a6ff75ab342bd46fd06dde203c231f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-04T07:06:37.345 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 07:06:37 smithi203 podman[128460]: 2024-03-04 07:06:37.185690536 +0000 UTC m=+1.727138308 container cleanup 6797a1307e300ff39588d6394d3022111a6ff75ab342bd46fd06dde203c231f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:cab7afa4cad91e5327badcfa09954d5b9107c9a386d41cb4a44f67ae0f57aa4f, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-yuri-testing-2024-03-01-0756-efb04e5, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-04T07:06:37.345 INFO:journalctl@ceph.mds.b.smithi203.stdout:Mar 04 07:06:37 smithi203 bash[128460]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-mds-b 2024-03-04T07:06:37.552 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@mds.b.service' 2024-03-04T07:06:37.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:06:37.589 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-03-04T07:06:37.590 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-03-04T07:06:37.590 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@prometheus.a 2024-03-04T07:06:37.932 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 systemd[1]: Stopping Ceph prometheus.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:06:37.933 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:37.923Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-04T07:06:37.933 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:37.923Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-04T07:06:37.933 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:37.923Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-04T07:06:37.933 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:37.923Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-04T07:06:37.933 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:37.923Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-04T07:06:37.933 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:37.923Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-04T07:06:37.933 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:37.923Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-04T07:06:37.933 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:37.923Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-04T07:06:37.934 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:37.923Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-04T07:06:37.934 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:37.923Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-04T07:06:37.934 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:37.923Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-04T07:06:37.934 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a[117223]: ts=2024-03-04T07:06:37.923Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-04T07:06:37.934 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:37 smithi203 podman[128581]: 2024-03-04 07:06:37.933677315 +0000 UTC m=+0.120403721 container died 85dcb15cec84891aaf4104fcce0f82c39b3c459303e65fb78fda1ed1e38f6b65 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T07:06:38.552 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:38 smithi203 podman[128581]: 2024-03-04 07:06:38.310794616 +0000 UTC m=+0.497521030 container cleanup 85dcb15cec84891aaf4104fcce0f82c39b3c459303e65fb78fda1ed1e38f6b65 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-04T07:06:38.552 INFO:journalctl@ceph.prometheus.a.smithi203.stdout:Mar 04 07:06:38 smithi203 bash[128581]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-prometheus-a 2024-03-04T07:06:38.673 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@prometheus.a.service' 2024-03-04T07:06:38.710 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T07:06:38.711 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-03-04T07:06:38.711 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 --force --keep-logs 2024-03-04T07:06:38.865 INFO:teuthology.orchestra.run.smithi137.stdout:Deleting cluster with fsid: d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T07:06:40.539 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:40.178Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:40.540 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:40.179Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi137.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.137:8443: connect: connection refused" 2024-03-04T07:06:40.540 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:40.179Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi203.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.203:8443: connect: connection refused" 2024-03-04T07:06:40.540 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:40 smithi137 systemd[1]: Stopping Ceph alertmanager.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:06:40.540 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:40 smithi137 ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a[125008]: ts=2024-03-04T07:06:40.540Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-03-04T07:06:40.792 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:40 smithi137 podman[141540]: 2024-03-04 07:06:40.581444255 +0000 UTC m=+0.137745035 container died ce9f080c2c947382dd2d5f440f685d9f34183e5678f02f686b44cc46525e5d9f (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T07:06:41.190 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:40 smithi137 podman[141540]: 2024-03-04 07:06:40.982063372 +0000 UTC m=+0.538364154 container cleanup ce9f080c2c947382dd2d5f440f685d9f34183e5678f02f686b44cc46525e5d9f (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T07:06:41.190 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:40 smithi137 bash[141540]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a 2024-03-04T07:06:41.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:41 smithi137 podman[141552]: 2024-03-04 07:06:41.191584879 +0000 UTC m=+0.605268599 container remove ce9f080c2c947382dd2d5f440f685d9f34183e5678f02f686b44cc46525e5d9f (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-04T07:06:41.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:41 smithi137 podman[141552]: 2024-03-04 07:06:41.258783619 +0000 UTC m=+0.672467343 volume remove af1ef32b51108f90efe978eb8a935b8cb4433217f4afbd52c53ab4cf127a544a 2024-03-04T07:06:41.542 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:41 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@alertmanager.a.service: Deactivated successfully. 2024-03-04T07:06:41.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:41 smithi137 systemd[1]: Stopped Ceph alertmanager.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T07:06:41.543 INFO:journalctl@ceph.alertmanager.a.smithi137.stdout:Mar 04 07:06:41 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@alertmanager.a.service: Consumed 1.592s CPU time. 2024-03-04T07:06:41.969 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 07:06:41 smithi137 systemd[1]: Stopping Ceph node-exporter.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:06:41.969 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 07:06:41 smithi137 podman[141665]: 2024-03-04 07:06:41.771853392 +0000 UTC m=+0.093420469 container died ff9dbbaf9aebe2148a4b815632e0056f1e78e190afedb0a48f3e66fe1559f55c (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-04T07:06:42.236 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 07:06:42 smithi137 podman[141665]: 2024-03-04 07:06:42.053169438 +0000 UTC m=+0.374736525 container cleanup ff9dbbaf9aebe2148a4b815632e0056f1e78e190afedb0a48f3e66fe1559f55c (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-04T07:06:42.236 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 07:06:42 smithi137 bash[141665]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a 2024-03-04T07:06:42.542 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 07:06:42 smithi137 podman[141676]: 2024-03-04 07:06:42.237491515 +0000 UTC m=+0.469867929 container remove ff9dbbaf9aebe2148a4b815632e0056f1e78e190afedb0a48f3e66fe1559f55c (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-04T07:06:42.542 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 07:06:42 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-03-04T07:06:42.542 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 07:06:42 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-03-04T07:06:42.542 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 07:06:42 smithi137 systemd[1]: Stopped Ceph node-exporter.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T07:06:42.543 INFO:journalctl@ceph.node-exporter.a.smithi137.stdout:Mar 04 07:06:42 smithi137 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.a.service: Consumed 2.230s CPU time. 2024-03-04T07:06:43.085 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 --force --keep-logs 2024-03-04T07:06:43.244 INFO:teuthology.orchestra.run.smithi203.stdout:Deleting cluster with fsid: d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T07:06:45.093 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 07:06:44 smithi203 systemd[1]: Stopping Ceph grafana.a for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:06:45.345 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 07:06:45 smithi203 podman[129038]: 2024-03-04 07:06:45.092913477 +0000 UTC m=+0.106761633 container died 12caa13589e2f6cfc6a85d9c6a215cb5234621ef9ea337356c5fff5079ff1d9d (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a, vendor=Red Hat, Inc., build-date=2022-04-29T11:48:11.055897, architecture=x86_64, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.expose-services=, io.openshift.tags=base rhel8, maintainer=Paul Cuzner , name=ubi8, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, release=239.1651231664, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, distribution-scope=public, vcs-type=git, version=8.5, com.redhat.component=ubi8-container, description=Ceph Grafana Container, io.buildah.version=1.32.0, io.k8s.display-name=Red Hat Universal Base Image 8) 2024-03-04T07:06:45.818 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 07:06:45 smithi203 podman[129038]: 2024-03-04 07:06:45.423688006 +0000 UTC m=+0.437536157 container cleanup 12caa13589e2f6cfc6a85d9c6a215cb5234621ef9ea337356c5fff5079ff1d9d (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a, name=ubi8, description=Ceph Grafana Container, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=239.1651231664, architecture=x86_64, com.redhat.component=ubi8-container, io.buildah.version=1.32.0, io.k8s.display-name=Red Hat Universal Base Image 8, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.expose-services=, io.openshift.tags=base rhel8, build-date=2022-04-29T11:48:11.055897, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, distribution-scope=public, vcs-type=git, version=8.5, maintainer=Paul Cuzner ) 2024-03-04T07:06:45.819 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 07:06:45 smithi203 bash[129038]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a 2024-03-04T07:06:45.819 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 07:06:45 smithi203 podman[129052]: 2024-03-04 07:06:45.599828171 +0000 UTC m=+0.509176099 container remove 12caa13589e2f6cfc6a85d9c6a215cb5234621ef9ea337356c5fff5079ff1d9d (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-grafana-a, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.display-name=Red Hat Universal Base Image 8, vendor=Red Hat, Inc., io.buildah.version=1.32.0, release=239.1651231664, description=Ceph Grafana Container, io.openshift.expose-services=, architecture=x86_64, build-date=2022-04-29T11:48:11.055897, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, name=ubi8, io.openshift.tags=base rhel8, version=8.5, vcs-type=git, maintainer=Paul Cuzner , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, com.redhat.component=ubi8-container, distribution-scope=public) 2024-03-04T07:06:45.819 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 07:06:45 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-03-04T07:06:46.095 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 07:06:46 smithi203 systemd[1]: Stopping Ceph node-exporter.b for d83bc156-d9f0-11ee-95c6-87774f69a715... 2024-03-04T07:06:46.095 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 07:06:45 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-03-04T07:06:46.095 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 07:06:45 smithi203 systemd[1]: Stopped Ceph grafana.a for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T07:06:46.095 INFO:journalctl@ceph.grafana.a.smithi203.stdout:Mar 04 07:06:45 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@grafana.a.service: Consumed 8.324s CPU time. 2024-03-04T07:06:46.535 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 07:06:46 smithi203 podman[129157]: 2024-03-04 07:06:46.271256046 +0000 UTC m=+0.130622993 container died 28b7879b0fcbaef5ba2f76850295b3fee635e5a33e15b7d9b5bb7772d4bd4132 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-04T07:06:46.845 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 07:06:46 smithi203 podman[129157]: 2024-03-04 07:06:46.635684335 +0000 UTC m=+0.495051283 container cleanup 28b7879b0fcbaef5ba2f76850295b3fee635e5a33e15b7d9b5bb7772d4bd4132 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-04T07:06:46.845 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 07:06:46 smithi203 bash[129157]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b 2024-03-04T07:06:47.342 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 07:06:46 smithi203 podman[129171]: 2024-03-04 07:06:46.995290035 +0000 UTC m=+0.724887681 container remove 28b7879b0fcbaef5ba2f76850295b3fee635e5a33e15b7d9b5bb7772d4bd4132 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d83bc156-d9f0-11ee-95c6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-04T07:06:47.343 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 07:06:46 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-03-04T07:06:47.343 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 07:06:47 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-03-04T07:06:47.343 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 07:06:47 smithi203 systemd[1]: Stopped Ceph node-exporter.b for d83bc156-d9f0-11ee-95c6-87774f69a715. 2024-03-04T07:06:47.344 INFO:journalctl@ceph.node-exporter.b.smithi203.stdout:Mar 04 07:06:47 smithi203 systemd[1]: ceph-d83bc156-d9f0-11ee-95c6-87774f69a715@node-exporter.b.service: Consumed 2.193s CPU time. 2024-03-04T07:06:47.819 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-04T07:06:47.857 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-04T07:06:47.888 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-04T07:06:47.890 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/crash to /home/teuthworker/archive/pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7580657/remote/smithi137/crash 2024-03-04T07:06:47.891 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/crash -- . 2024-03-04T07:06:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:tar: /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/crash: Cannot open: No such file or directory 2024-03-04T07:06:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:tar: Error is not recoverable: exiting now 2024-03-04T07:06:47.941 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/crash to /home/teuthworker/archive/pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7580657/remote/smithi203/crash 2024-03-04T07:06:47.942 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/crash -- . 2024-03-04T07:06:47.984 INFO:teuthology.orchestra.run.smithi203.stderr:tar: /var/lib/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/crash: Cannot open: No such file or directory 2024-03-04T07:06:47.984 INFO:teuthology.orchestra.run.smithi203.stderr:tar: Error is not recoverable: exiting now 2024-03-04T07:06:47.985 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-04T07:06:47.986 DEBUG:teuthology.orchestra.run.smithi137:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-03-04T07:06:48.018 INFO:teuthology.orchestra.run.smithi137.stdout:2024-03-04T06:50:00.000226+0000 mon.a (mon.0) 819 : cluster 4 [WRN] OSD_DOWN: 1 osds down 2024-03-04T07:06:48.018 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-04T07:06:48.018 INFO:tasks.cephadm:Compressing logs... 2024-03-04T07:06:48.018 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-04T07:06:48.060 DEBUG:teuthology.orchestra.run.smithi203:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-04T07:06:48.086 INFO:teuthology.orchestra.run.smithi137.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-04T07:06:48.087 INFO:teuthology.orchestra.run.smithi137.stderr:: No such file or directory 2024-03-04T07:06:48.087 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mon.a.log 2024-03-04T07:06:48.087 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/cephadm.log: -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.audit.log 2024-03-04T07:06:48.087 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.1.log 2024-03-04T07:06:48.093 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.3.log 2024-03-04T07:06:48.093 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mgr.y.log 2024-03-04T07:06:48.093 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.0.log 2024-03-04T07:06:48.093 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.cephadm.log 2024-03-04T07:06:48.093 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.log 2024-03-04T07:06:48.093 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.cephadm.log: 90.8% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.cephadm.log.gz 2024-03-04T07:06:48.094 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.2.log 2024-03-04T07:06:48.094 INFO:teuthology.orchestra.run.smithi137.stderr: 92.6% -- replaced with /var/log/ceph/cephadm.log.gz/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.log: 2024-03-04T07:06:48.095 INFO:teuthology.orchestra.run.smithi203.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-04T07:06:48.096 INFO:teuthology.orchestra.run.smithi203.stderr:: No such file or directory 2024-03-04T07:06:48.096 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.6.log 2024-03-04T07:06:48.096 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.audit.log 2024-03-04T07:06:48.096 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mds.b.log 2024-03-04T07:06:48.096 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.4.log 2024-03-04T07:06:48.096 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.7.log 2024-03-04T07:06:48.096 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mds.b.log: /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.5.log 2024-03-04T07:06:48.096 INFO:teuthology.orchestra.run.smithi203.stderr: 82.6% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mds.b.log.gz 2024-03-04T07:06:48.097 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mgr.x.log 2024-03-04T07:06:48.097 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.cephadm.log 2024-03-04T07:06:48.097 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.log 2024-03-04T07:06:48.097 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.cephadm.log: 84.0% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.cephadm.log.gz 2024-03-04T07:06:48.097 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-volume.log 2024-03-04T07:06:48.097 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.log: 90.8% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.audit.log.gz 2024-03-04T07:06:48.099 INFO:teuthology.orchestra.run.smithi203.stderr: 83.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-04T07:06:48.099 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mon.b.log 2024-03-04T07:06:48.100 INFO:teuthology.orchestra.run.smithi137.stderr: 94.4% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.audit.log.gz 2024-03-04T07:06:48.100 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-volume.log 2024-03-04T07:06:48.101 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mds.a.log 2024-03-04T07:06:48.106 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-volume.log: /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mon.b.log: 91.3% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.log.gz 2024-03-04T07:06:48.114 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mon.c.log 2024-03-04T07:06:48.115 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mds.a.log: 94.9% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph.log.gz 2024-03-04T07:06:48.117 INFO:teuthology.orchestra.run.smithi203.stderr: 91.1% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-volume.log.gz 2024-03-04T07:06:48.122 INFO:teuthology.orchestra.run.smithi137.stderr: 91.1% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-volume.log.gz 2024-03-04T07:06:48.125 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mon.c.log: 91.6% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mds.a.log.gz 2024-03-04T07:06:48.137 INFO:teuthology.orchestra.run.smithi203.stderr: 89.3% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mgr.x.log.gz 2024-03-04T07:06:48.453 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mgr.y.log.gz 2024-03-04T07:06:48.692 INFO:teuthology.orchestra.run.smithi203.stderr: 91.8% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mon.b.log.gz 2024-03-04T07:06:48.925 INFO:teuthology.orchestra.run.smithi137.stderr: 91.8% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mon.c.log.gz 2024-03-04T07:06:49.963 INFO:teuthology.orchestra.run.smithi137.stderr: 90.5% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-mon.a.log.gz 2024-03-04T07:06:51.542 INFO:teuthology.orchestra.run.smithi203.stderr: 93.8% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.4.log.gz 2024-03-04T07:06:51.639 INFO:teuthology.orchestra.run.smithi203.stderr: 94.0% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.7.log.gz 2024-03-04T07:06:51.876 INFO:teuthology.orchestra.run.smithi137.stderr: 94.4% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.3.log.gz 2024-03-04T07:06:51.932 INFO:teuthology.orchestra.run.smithi137.stderr: 93.9% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.1.log.gz 2024-03-04T07:06:52.933 INFO:teuthology.orchestra.run.smithi203.stderr: 94.4% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.5.log.gz 2024-03-04T07:06:53.458 INFO:teuthology.orchestra.run.smithi137.stderr: 93.8% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.2.log.gz 2024-03-04T07:06:54.547 INFO:teuthology.orchestra.run.smithi203.stderr: 94.5% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.6.log.gz 2024-03-04T07:06:54.548 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-03-04T07:06:54.549 INFO:teuthology.orchestra.run.smithi203.stderr:real 0m6.474s 2024-03-04T07:06:54.549 INFO:teuthology.orchestra.run.smithi203.stderr:user 0m18.227s 2024-03-04T07:06:54.549 INFO:teuthology.orchestra.run.smithi203.stderr:sys 0m0.761s 2024-03-04T07:06:56.113 INFO:teuthology.orchestra.run.smithi137.stderr: 94.6% -- replaced with /var/log/ceph/d83bc156-d9f0-11ee-95c6-87774f69a715/ceph-osd.0.log.gz 2024-03-04T07:06:56.115 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-03-04T07:06:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:real 0m8.041s 2024-03-04T07:06:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:user 0m23.237s 2024-03-04T07:06:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m0.879s 2024-03-04T07:06:56.115 INFO:tasks.cephadm:Archiving logs... 2024-03-04T07:06:56.116 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7580657/remote/smithi137/log 2024-03-04T07:06:56.117 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-04T07:06:59.047 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7580657/remote/smithi203/log 2024-03-04T07:06:59.048 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-04T07:07:01.408 INFO:tasks.cephadm:Removing cluster... 2024-03-04T07:07:01.409 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 --force 2024-03-04T07:07:01.556 INFO:teuthology.orchestra.run.smithi137.stdout:Deleting cluster with fsid: d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T07:07:01.846 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d83bc156-d9f0-11ee-95c6-87774f69a715 --force 2024-03-04T07:07:02.002 INFO:teuthology.orchestra.run.smithi203.stdout:Deleting cluster with fsid: d83bc156-d9f0-11ee-95c6-87774f69a715 2024-03-04T07:07:02.281 INFO:tasks.cephadm:Removing cephadm ... 2024-03-04T07:07:02.281 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-04T07:07:02.297 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-04T07:07:02.311 INFO:tasks.cephadm:Teardown complete 2024-03-04T07:07:02.312 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-04T07:07:02.323 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-04T07:07:02.323 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-04T07:07:02.339 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-04T07:07:02.430 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-04T07:07:02.440 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-04T07:07:02.440 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T07:07:02.443 DEBUG:teuthology.orchestra.run.smithi203:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T07:07:02.455 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-03-04T07:07:02.456 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-03-04T07:07:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T07:07:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-03-04T07:07:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 50 +1453us[+1453us] +/- 99ms 2024-03-04T07:07:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:^* hv02.front.sepia.ceph.com 3 6 377 56 -1190us[-1184us] +/- 64ms 2024-03-04T07:07:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +332us[ +332us] +/- 79ms 2024-03-04T07:07:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T07:07:02.461 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T07:07:02.461 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-03-04T07:07:02.461 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 51 +1475us[+1475us] +/- 99ms 2024-03-04T07:07:02.461 INFO:teuthology.orchestra.run.smithi203.stdout:^* hv02.front.sepia.ceph.com 3 6 377 51 -1197us[-1190us] +/- 64ms 2024-03-04T07:07:02.461 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +337us[ +337us] +/- 79ms 2024-03-04T07:07:02.461 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T07:07:02.462 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-04T07:07:02.472 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-04T07:07:02.472 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-04T07:07:02.507 DEBUG:teuthology.orchestra.run.smithi137:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-04T07:07:02.592 DEBUG:teuthology.orchestra.run.smithi203:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-04T07:07:02.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T07:07:02.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T07:07:02.702 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T07:07:02.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T07:07:02.732 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-04T07:07:02.743 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-04T07:07:02.754 INFO:teuthology.task.internal:Duration was 2509.118936 seconds 2024-03-04T07:07:02.754 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-04T07:07:02.771 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-04T07:07:02.771 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-04T07:07:02.774 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-04T07:07:02.815 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T07:07:02.816 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T07:07:03.127 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-04T07:07:03.127 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-03-04T07:07:03.128 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-04T07:07:03.157 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi203.front.sepia.ceph.com 2024-03-04T07:07:03.157 DEBUG:teuthology.orchestra.run.smithi203:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-04T07:07:03.195 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-04T07:07:03.195 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-04T07:07:03.200 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-04T07:07:03.262 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-04T07:07:03.263 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-04T07:07:03.268 DEBUG:teuthology.orchestra.run.smithi203:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-04T07:07:04.104 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-04T07:07:04.116 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-04T07:07:04.116 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-04T07:07:04.142 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-04T07:07:04.170 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-04T07:07:04.181 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-04T07:07:04.185 DEBUG:teuthology.orchestra.run.smithi203:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-04T07:07:04.208 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-03-04T07:07:04.235 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = core 2024-03-04T07:07:04.256 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-04T07:07:04.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T07:07:04.278 DEBUG:teuthology.orchestra.run.smithi203:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-04T07:07:04.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T07:07:04.310 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-04T07:07:04.321 INFO:teuthology.task.internal:Transferring archived files... 2024-03-04T07:07:04.322 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7580657/remote/smithi137 2024-03-04T07:07:04.322 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-04T07:07:04.390 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7580657/remote/smithi203 2024-03-04T07:07:04.390 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-04T07:07:04.430 INFO:teuthology.task.internal:Removing archive directory... 2024-03-04T07:07:04.431 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-04T07:07:04.433 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-04T07:07:04.478 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-04T07:07:04.490 INFO:teuthology.task.internal:Not uploading archives. 2024-03-04T07:07:04.491 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-04T07:07:04.514 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-04T07:07:04.514 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-04T07:07:04.516 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-04T07:07:04.529 INFO:teuthology.orchestra.run.smithi137.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 4 07:07 /home/ubuntu/cephtest 2024-03-04T07:07:04.533 INFO:teuthology.orchestra.run.smithi203.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 4 07:07 /home/ubuntu/cephtest 2024-03-04T07:07:04.534 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-04T07:07:04.545 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-04T07:07:04.581 INFO:teuthology.nuke:Checking targets against current locks 2024-03-04T07:07:04.606 DEBUG:teuthology.nuke:shortname: smithi137 2024-03-04T07:07:04.607 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T07:07:04.625 DEBUG:teuthology.nuke:shortname: smithi203 2024-03-04T07:07:04.625 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T07:07:04.628 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7580657', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 06:14:33.554744', 'locked_by': 'scheduled_pdhange@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL5et8RVHHsCf3HAN+HeYMnTKbTXm4aGXvpfGQaCvlVGWmJINU3sgDYoN7U8xqtWW8/G1yX3wdjnBXsd1kTMQRs='} 2024-03-04T07:07:04.646 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdhange-2024-03-04_06:12:22-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7580657', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 06:14:33.551727', 'locked_by': 'scheduled_pdhange@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPVvhukuPV/SZNKqeAmvye5Qd10whdRAe4O76RdkFqx9nvVQMH7ei7DTlMigLfCrStUuQX27mw9jpE6QQPiMMPo='} 2024-03-04T07:07:04.674 INFO:teuthology.orchestra.console.smithi137:Power off 2024-03-04T07:07:04.675 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T07:07:04.699 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-03-04T07:07:04.699 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T07:07:04.714 INFO:teuthology.orchestra.console.smithi203:Power off 2024-03-04T07:07:04.715 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T07:07:04.725 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-03-04T07:07:04.737 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2024-03-04T07:07:04.738 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T07:07:04.758 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-03-04T07:07:08.726 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T07:07:08.759 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T07:07:08.837 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-03-04T07:07:08.867 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-03-04T07:07:12.842 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T07:07:12.868 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T07:07:12.952 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-03-04T07:07:12.976 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2024-03-04T07:07:13.054 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-03-04T07:07:13.077 INFO:teuthology.orchestra.console.smithi203:Power off completed 2024-03-04T07:07:13.181 INFO:teuthology.run:Summary data: description: rados/upgrade/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} duration: 2509.1189358234406 failure_reason: failed to complete snap trimming before timeout flavor: default owner: scheduled_pdhange@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=dd197d68fe9b46bcb9c47f2f0970565f status: fail success: false 2024-03-04T07:07:13.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T07:07:13.258 INFO:teuthology.run:FAIL